2024-09-05T01:03:40.445 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-05T01:03:40.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-05T01:03:40.565 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7889758 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/blogbench}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7889758' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1743 sha1: 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 sleep_before_teardown: 0 subset: 459/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi012.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBInE84MCaOIvnkzCr6bCw5WvQnD/t99NFKVPl9Y3T+jX93Ka4f01X2Gp4i6hWCPudTcRBbP15ikds1aC/s88cX0= smithi145.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDNBn/KfsGehTaCxt3FD/7+R8ZeV9nbTtyEd1AYmimIGv8s2Npybo8JxxQGkevFDWj/ERvCxnlTIhaKgsJEuWnI= smithi151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIptzZtLz/NLkSfxkpyMHkUBYmGPZ+VSQSXqo3hWFvXLkvHowwcnmR2+dp1U27pUTqQrmMD2opB6jrQR8q5O5/E= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-04_21:24:16 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-05T01:03:40.566 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/qa; will attempt to use it 2024-09-05T01:03:40.566 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/qa/tasks 2024-09-05T01:03:40.566 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-05T01:03:40.568 INFO:teuthology.task.internal:Checking packages... 2024-09-05T01:03:40.589 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4' 2024-09-05T01:03:40.589 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-05T01:03:40.590 INFO:teuthology.packaging:ref: None 2024-09-05T01:03:40.590 INFO:teuthology.packaging:tag: None 2024-09-05T01:03:40.590 INFO:teuthology.packaging:branch: squid 2024-09-05T01:03:40.590 INFO:teuthology.packaging:sha1: 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T01:03:40.590 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-05T01:03:40.806 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-259.g91c8a7e5 2024-09-05T01:03:40.807 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-05T01:03:40.814 INFO:teuthology.task.internal:no buildpackages task found 2024-09-05T01:03:40.814 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-05T01:03:40.841 INFO:teuthology.task.internal:Saving configuration 2024-09-05T01:03:40.862 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-05T01:03:40.868 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-05T01:03:40.893 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7889758', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-05 00:58:20.757405', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBInE84MCaOIvnkzCr6bCw5WvQnD/t99NFKVPl9Y3T+jX93Ka4f01X2Gp4i6hWCPudTcRBbP15ikds1aC/s88cX0='} 2024-09-05T01:03:40.913 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7889758', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-05 00:58:20.760091', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDNBn/KfsGehTaCxt3FD/7+R8ZeV9nbTtyEd1AYmimIGv8s2Npybo8JxxQGkevFDWj/ERvCxnlTIhaKgsJEuWnI='} 2024-09-05T01:03:40.935 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7889758', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-05 00:58:20.758865', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIptzZtLz/NLkSfxkpyMHkUBYmGPZ+VSQSXqo3hWFvXLkvHowwcnmR2+dp1U27pUTqQrmMD2opB6jrQR8q5O5/E='} 2024-09-05T01:03:40.935 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-05T01:03:40.941 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-05T01:03:40.941 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-05T01:03:40.941 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-05T01:03:40.941 INFO:teuthology.run_tasks:Running task console_log... 2024-09-05T01:03:41.057 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f36adcbf520>, signals=[15]) 2024-09-05T01:03:41.057 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-05T01:03:41.063 INFO:teuthology.task.internal:Opening connections... 2024-09-05T01:03:41.063 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi012.front.sepia.ceph.com 2024-09-05T01:03:41.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T01:03:41.150 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi145.front.sepia.ceph.com 2024-09-05T01:03:41.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T01:03:41.227 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2024-09-05T01:03:41.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T01:03:41.315 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-05T01:03:41.322 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2024-09-05T01:03:41.340 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2024-09-05T01:03:41.341 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2024-09-05T01:03:41.397 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2024-09-05T01:03:41.397 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2024-09-05T01:03:41.397 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2024-09-05T01:03:41.398 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2024-09-05T01:03:41.398 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2024-09-05T01:03:41.398 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2024-09-05T01:03:41.398 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-05T01:03:41.398 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2024-09-05T01:03:41.398 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2024-09-05T01:03:41.398 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-05T01:03:41.398 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2024-09-05T01:03:41.398 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-05T01:03:41.398 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-05T01:03:41.398 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-05T01:03:41.399 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2024-09-05T01:03:41.417 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2024-09-05T01:03:41.435 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2024-09-05T01:03:41.436 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2024-09-05T01:03:41.493 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2024-09-05T01:03:41.493 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="9" 2024-09-05T01:03:41.493 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2024-09-05T01:03:41.493 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2024-09-05T01:03:41.494 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="9" 2024-09-05T01:03:41.494 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el9" 2024-09-05T01:03:41.494 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-05T01:03:41.494 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2024-09-05T01:03:41.494 INFO:teuthology.orchestra.run.smithi145.stdout:LOGO="fedora-logo-icon" 2024-09-05T01:03:41.494 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-05T01:03:41.494 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2024-09-05T01:03:41.494 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-05T01:03:41.494 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-05T01:03:41.494 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-05T01:03:41.494 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2024-09-05T01:03:41.517 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2024-09-05T01:03:41.535 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2024-09-05T01:03:41.535 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2024-09-05T01:03:41.593 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream" 2024-09-05T01:03:41.593 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9" 2024-09-05T01:03:41.593 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos" 2024-09-05T01:03:41.593 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora" 2024-09-05T01:03:41.593 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9" 2024-09-05T01:03:41.593 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9" 2024-09-05T01:03:41.593 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-05T01:03:41.593 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2024-09-05T01:03:41.593 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon" 2024-09-05T01:03:41.594 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-05T01:03:41.594 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/" 2024-09-05T01:03:41.594 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-05T01:03:41.594 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-05T01:03:41.594 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-05T01:03:41.594 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2024-09-05T01:03:41.616 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-05T01:03:41.626 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-05T01:03:41.658 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-05T01:03:41.658 DEBUG:teuthology.orchestra.run.smithi012:> test '!' -e /home/ubuntu/cephtest 2024-09-05T01:03:41.661 DEBUG:teuthology.orchestra.run.smithi145:> test '!' -e /home/ubuntu/cephtest 2024-09-05T01:03:41.663 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2024-09-05T01:03:41.680 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-05T01:03:41.685 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-05T01:03:41.686 DEBUG:teuthology.orchestra.run.smithi012:> test -z $(ls -A /var/lib/ceph) 2024-09-05T01:03:41.718 DEBUG:teuthology.orchestra.run.smithi145:> test -z $(ls -A /var/lib/ceph) 2024-09-05T01:03:41.721 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2024-09-05T01:03:41.817 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-05T01:03:41.891 INFO:teuthology.run_tasks:Running task kernel... 2024-09-05T01:03:41.906 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-05T01:03:41.906 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-05T01:03:41.906 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-05T01:03:41.906 DEBUG:teuthology.orchestra.run.smithi012:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-05T01:03:41.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T01:03:41.923 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-05T01:03:42.105 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 2024-09-05T01:03:42.105 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8ad8b8b160987a14eb199bb67cc00e23a08d43f6"... 2024-09-05T01:03:42.105 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2024-09-05T01:03:42.122 INFO:teuthology.orchestra.run.smithi012.stdout:5.14.0-503.el9.x86_64 2024-09-05T01:03:42.123 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 2024-09-05T01:03:42.123 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-05T01:03:42.123 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum upgrade -y linux-firmware 2024-09-05T01:03:44.493 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-05T01:03:46.269 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - AppStream 33 MB/s | 20 MB 00:00 2024-09-05T01:03:50.836 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-05T01:03:52.337 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 19 kB 00:00 2024-09-05T01:03:53.499 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-05T01:03:59.109 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-09-05T01:04:01.252 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-05T01:04:01.253 INFO:teuthology.orchestra.run.smithi012.stdout:Nothing to do. 2024-09-05T01:04:01.253 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-05T01:04:01.378 INFO:teuthology.task.kernel:Downloading kernel 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 on client.0... 2024-09-05T01:04:01.378 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8ad8b8b160987a14eb199bb67cc00e23a08d43f6 2024-09-05T01:04:01.533 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/8ad8b8b160987a14eb199bb67cc00e23a08d43f6/centos/9/flavors/default/x86_64/ 2024-09-05T01:04:01.533 DEBUG:teuthology.orchestra.run.smithi012:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g8ad8b8b16098-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/8ad8b8b160987a14eb199bb67cc00e23a08d43f6/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-05T01:04:01.536 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi012.front.sepia.ceph.com to complete... 2024-09-05T01:04:07.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05 01:04:07 URL:https://1.chacra.ceph.com/r/kernel/testing/8ad8b8b160987a14eb199bb67cc00e23a08d43f6/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g8ad8b8b16098-1.x86_64.rpm [359646365/359646365] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-05T01:04:07.868 INFO:teuthology.orchestra.run.smithi012.stderr:FINISHED --2024-09-05 01:04:07-- 2024-09-05T01:04:07.868 INFO:teuthology.orchestra.run.smithi012.stderr:Total wall clock time: 6.3s 2024-09-05T01:04:07.868 INFO:teuthology.orchestra.run.smithi012.stderr:Downloaded: 1 files, 343M in 6.0s (56.9 MB/s) 2024-09-05T01:04:07.871 INFO:teuthology.task.kernel:Installing kernel 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 on client.0... 2024-09-05T01:04:07.871 DEBUG:teuthology.orchestra.run.smithi012:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-05T01:04:10.079 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying... ######################################## 2024-09-05T01:04:10.225 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing... ######################################## 2024-09-05T01:04:10.342 INFO:teuthology.orchestra.run.smithi012.stdout:Updating / installing... 2024-09-05T01:04:18.824 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-6.11.0_rc5_g8ad8b8b16098-1 ######################################## 2024-09-05T01:04:59.325 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi012.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-05T01:04:59.326 DEBUG:teuthology.orchestra.run.smithi012:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-05T01:04:59.422 INFO:teuthology.orchestra.run.smithi012.stdout:/boot/System.map-6.11.0-rc5-g8ad8b8b16098 2024-09-05T01:04:59.423 INFO:teuthology.orchestra.run.smithi012.stdout:/boot/config-6.11.0-rc5-g8ad8b8b16098 2024-09-05T01:04:59.423 INFO:teuthology.orchestra.run.smithi012.stdout:/boot/vmlinuz-6.11.0-rc5-g8ad8b8b16098 2024-09-05T01:04:59.423 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098 2024-09-05T01:04:59.423 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/System.map 2024-09-05T01:04:59.423 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/config 2024-09-05T01:04:59.423 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel 2024-09-05T01:04:59.423 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch 2024-09-05T01:04:59.423 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86 2024-09-05T01:04:59.423 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto 2024-09-05T01:04:59.423 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-05T01:04:59.424 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-05T01:04:59.424 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-05T01:04:59.424 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-05T01:04:59.424 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-05T01:04:59.424 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-05T01:04:59.424 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-05T01:04:59.424 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-05T01:04:59.424 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-05T01:04:59.424 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-05T01:04:59.424 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-05T01:04:59.425 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-05T01:04:59.425 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-05T01:04:59.425 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-05T01:04:59.425 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-05T01:04:59.425 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-05T01:04:59.425 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-05T01:04:59.425 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-05T01:04:59.425 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-05T01:04:59.425 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-05T01:04:59.425 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel 2024-09-05T01:04:59.426 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel/cpu 2024-09-05T01:04:59.426 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel/cpu/mce 2024-09-05T01:04:59.426 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-05T01:04:59.426 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kvm 2024-09-05T01:04:59.426 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-05T01:04:59.426 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-05T01:04:59.426 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/arch/x86/kvm/kvm.ko 2024-09-05T01:04:59.426 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto 2024-09-05T01:04:59.426 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/ansi_cprng.ko 2024-09-05T01:04:59.426 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/anubis.ko 2024-09-05T01:04:59.427 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/arc4.ko 2024-09-05T01:04:59.427 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx 2024-09-05T01:04:59.427 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_memcpy.ko 2024-09-05T01:04:59.427 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_pq.ko 2024-09-05T01:04:59.427 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-05T01:04:59.427 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_tx.ko 2024-09-05T01:04:59.427 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/async_xor.ko 2024-09-05T01:04:59.427 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/async_tx/raid6test.ko 2024-09-05T01:04:59.427 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/authenc.ko 2024-09-05T01:04:59.427 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/authencesn.ko 2024-09-05T01:04:59.428 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/blake2b_generic.ko 2024-09-05T01:04:59.428 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/blowfish_common.ko 2024-09-05T01:04:59.428 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/blowfish_generic.ko 2024-09-05T01:04:59.428 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/camellia_generic.ko 2024-09-05T01:04:59.428 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cast5_generic.ko 2024-09-05T01:04:59.428 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cast6_generic.ko 2024-09-05T01:04:59.428 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cast_common.ko 2024-09-05T01:04:59.428 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/ccm.ko 2024-09-05T01:04:59.428 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cmac.ko 2024-09-05T01:04:59.428 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/crc32_generic.ko 2024-09-05T01:04:59.428 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/crypto_engine.ko 2024-09-05T01:04:59.428 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/crypto_user.ko 2024-09-05T01:04:59.429 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/cts.ko 2024-09-05T01:04:59.429 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/des_generic.ko 2024-09-05T01:04:59.429 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/dh_generic.ko 2024-09-05T01:04:59.429 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/ecc.ko 2024-09-05T01:04:59.429 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/ecdh_generic.ko 2024-09-05T01:04:59.429 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/echainiv.ko 2024-09-05T01:04:59.429 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/essiv.ko 2024-09-05T01:04:59.429 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/fcrypt.ko 2024-09-05T01:04:59.429 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/khazad.ko 2024-09-05T01:04:59.429 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/lz4.ko 2024-09-05T01:04:59.429 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/lz4hc.ko 2024-09-05T01:04:59.429 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/md4.ko 2024-09-05T01:04:59.429 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/michael_mic.ko 2024-09-05T01:04:59.430 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/pcbc.ko 2024-09-05T01:04:59.430 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/pcrypt.ko 2024-09-05T01:04:59.430 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/rmd160.ko 2024-09-05T01:04:59.430 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/seed.ko 2024-09-05T01:04:59.430 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/serpent_generic.ko 2024-09-05T01:04:59.430 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/tcrypt.ko 2024-09-05T01:04:59.430 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/tea.ko 2024-09-05T01:04:59.430 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/twofish_common.ko 2024-09-05T01:04:59.430 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/twofish_generic.ko 2024-09-05T01:04:59.430 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/vmac.ko 2024-09-05T01:04:59.430 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/wp512.ko 2024-09-05T01:04:59.430 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/xcbc.ko 2024-09-05T01:04:59.430 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/xor.ko 2024-09-05T01:04:59.431 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/crypto/xxhash_generic.ko 2024-09-05T01:04:59.431 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers 2024-09-05T01:04:59.431 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi 2024-09-05T01:04:59.431 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-05T01:04:59.431 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/acpi_pad.ko 2024-09-05T01:04:59.431 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/ec_sys.ko 2024-09-05T01:04:59.431 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/platform_profile.ko 2024-09-05T01:04:59.431 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/sbs.ko 2024-09-05T01:04:59.431 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/sbshc.ko 2024-09-05T01:04:59.431 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/acpi/video.ko 2024-09-05T01:04:59.431 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata 2024-09-05T01:04:59.431 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/acard-ahci.ko 2024-09-05T01:04:59.432 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/ahci_platform.ko 2024-09-05T01:04:59.432 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/ata_generic.ko 2024-09-05T01:04:59.432 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/libahci_platform.ko 2024-09-05T01:04:59.432 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_acpi.ko 2024-09-05T01:04:59.432 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_ali.ko 2024-09-05T01:04:59.432 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_amd.ko 2024-09-05T01:04:59.432 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_artop.ko 2024-09-05T01:04:59.432 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_atiixp.ko 2024-09-05T01:04:59.432 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_atp867x.ko 2024-09-05T01:04:59.432 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_cmd640.ko 2024-09-05T01:04:59.432 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_cmd64x.ko 2024-09-05T01:04:59.432 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_cypress.ko 2024-09-05T01:04:59.432 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_efar.ko 2024-09-05T01:04:59.433 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_hpt366.ko 2024-09-05T01:04:59.433 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_hpt37x.ko 2024-09-05T01:04:59.433 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-05T01:04:59.433 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-05T01:04:59.433 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_it8213.ko 2024-09-05T01:04:59.433 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_it821x.ko 2024-09-05T01:04:59.433 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_jmicron.ko 2024-09-05T01:04:59.433 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_marvell.ko 2024-09-05T01:04:59.433 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_mpiix.ko 2024-09-05T01:04:59.433 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_netcell.ko 2024-09-05T01:04:59.433 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_ninja32.ko 2024-09-05T01:04:59.434 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_ns87410.ko 2024-09-05T01:04:59.434 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_ns87415.ko 2024-09-05T01:04:59.434 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_oldpiix.ko 2024-09-05T01:04:59.434 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_opti.ko 2024-09-05T01:04:59.434 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_optidma.ko 2024-09-05T01:04:59.434 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_pcmcia.ko 2024-09-05T01:04:59.434 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-05T01:04:59.434 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-05T01:04:59.434 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_piccolo.ko 2024-09-05T01:04:59.434 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_rdc.ko 2024-09-05T01:04:59.434 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_sch.ko 2024-09-05T01:04:59.434 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_serverworks.ko 2024-09-05T01:04:59.435 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_sil680.ko 2024-09-05T01:04:59.435 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_sis.ko 2024-09-05T01:04:59.435 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_sl82c105.ko 2024-09-05T01:04:59.435 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_triflex.ko 2024-09-05T01:04:59.435 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pata_via.ko 2024-09-05T01:04:59.435 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/pdc_adma.ko 2024-09-05T01:04:59.435 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_inic162x.ko 2024-09-05T01:04:59.435 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_mv.ko 2024-09-05T01:04:59.435 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_nv.ko 2024-09-05T01:04:59.435 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_promise.ko 2024-09-05T01:04:59.435 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_qstor.ko 2024-09-05T01:04:59.435 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_sil.ko 2024-09-05T01:04:59.435 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_sil24.ko 2024-09-05T01:04:59.436 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_sis.ko 2024-09-05T01:04:59.436 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_svw.ko 2024-09-05T01:04:59.436 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_sx4.ko 2024-09-05T01:04:59.436 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_uli.ko 2024-09-05T01:04:59.436 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_via.ko 2024-09-05T01:04:59.436 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ata/sata_vsc.ko 2024-09-05T01:04:59.436 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/auxdisplay 2024-09-05T01:04:59.436 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/auxdisplay/ks0108.ko 2024-09-05T01:04:59.436 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/base 2024-09-05T01:04:59.436 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/base/regmap 2024-09-05T01:04:59.436 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-05T01:04:59.436 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-05T01:04:59.437 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/bcma 2024-09-05T01:04:59.437 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/bcma/bcma.ko 2024-09-05T01:04:59.437 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block 2024-09-05T01:04:59.437 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/aoe 2024-09-05T01:04:59.437 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/aoe/aoe.ko 2024-09-05T01:04:59.437 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/brd.ko 2024-09-05T01:04:59.437 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/drbd 2024-09-05T01:04:59.437 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/drbd/drbd.ko 2024-09-05T01:04:59.437 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/floppy.ko 2024-09-05T01:04:59.437 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/loop.ko 2024-09-05T01:04:59.437 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/mtip32xx 2024-09-05T01:04:59.437 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-05T01:04:59.438 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/nbd.ko 2024-09-05T01:04:59.438 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/null_blk 2024-09-05T01:04:59.438 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/null_blk/null_blk.ko 2024-09-05T01:04:59.438 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/pktcdvd.ko 2024-09-05T01:04:59.438 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/rbd.ko 2024-09-05T01:04:59.438 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/virtio_blk.ko 2024-09-05T01:04:59.438 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/xen-blkback 2024-09-05T01:04:59.438 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-05T01:04:59.438 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/xen-blkfront.ko 2024-09-05T01:04:59.438 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/zram 2024-09-05T01:04:59.438 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/block/zram/zram.ko 2024-09-05T01:04:59.438 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char 2024-09-05T01:04:59.439 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hangcheck-timer.ko 2024-09-05T01:04:59.439 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random 2024-09-05T01:04:59.439 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-05T01:04:59.439 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-05T01:04:59.439 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-05T01:04:59.439 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/via-rng.ko 2024-09-05T01:04:59.439 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-05T01:04:59.439 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi 2024-09-05T01:04:59.439 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-05T01:04:59.439 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-05T01:04:59.439 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-05T01:04:59.439 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-05T01:04:59.439 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-05T01:04:59.440 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-05T01:04:59.440 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/lp.ko 2024-09-05T01:04:59.440 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/mwave 2024-09-05T01:04:59.440 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/mwave/mwave.ko 2024-09-05T01:04:59.440 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/ppdev.ko 2024-09-05T01:04:59.440 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tlclk.ko 2024-09-05T01:04:59.440 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm 2024-09-05T01:04:59.440 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm.ko 2024-09-05T01:04:59.440 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-05T01:04:59.440 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-05T01:04:59.440 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-05T01:04:59.440 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-05T01:04:59.441 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-05T01:04:59.441 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/uv_mmtimer.ko 2024-09-05T01:04:59.441 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/char/virtio_console.ko 2024-09-05T01:04:59.441 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq 2024-09-05T01:04:59.441 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-05T01:04:59.441 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-05T01:04:59.441 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-05T01:04:59.441 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-05T01:04:59.441 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-05T01:04:59.441 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-05T01:04:59.441 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto 2024-09-05T01:04:59.441 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/ccp 2024-09-05T01:04:59.442 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-05T01:04:59.442 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/ccp/ccp.ko 2024-09-05T01:04:59.442 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel 2024-09-05T01:04:59.442 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat 2024-09-05T01:04:59.442 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/qat_common 2024-09-05T01:04:59.442 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-05T01:04:59.442 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-05T01:04:59.442 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-05T01:04:59.442 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/padlock-aes.ko 2024-09-05T01:04:59.442 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/padlock-sha.ko 2024-09-05T01:04:59.442 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/virtio 2024-09-05T01:04:59.442 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-05T01:04:59.443 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dca 2024-09-05T01:04:59.443 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dca/dca.ko 2024-09-05T01:04:59.443 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/devfreq 2024-09-05T01:04:59.443 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-05T01:04:59.443 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma 2024-09-05T01:04:59.443 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/dw 2024-09-05T01:04:59.443 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-05T01:04:59.443 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/ioat 2024-09-05T01:04:59.443 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-05T01:04:59.443 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac 2024-09-05T01:04:59.443 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/amd64_edac.ko 2024-09-05T01:04:59.443 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/e752x_edac.ko 2024-09-05T01:04:59.444 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/edac_mce_amd.ko 2024-09-05T01:04:59.444 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i3000_edac.ko 2024-09-05T01:04:59.444 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i3200_edac.ko 2024-09-05T01:04:59.444 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i5100_edac.ko 2024-09-05T01:04:59.444 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i5400_edac.ko 2024-09-05T01:04:59.444 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i7300_edac.ko 2024-09-05T01:04:59.444 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i7core_edac.ko 2024-09-05T01:04:59.444 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/i82975x_edac.ko 2024-09-05T01:04:59.444 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/ie31200_edac.ko 2024-09-05T01:04:59.444 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/sb_edac.ko 2024-09-05T01:04:59.444 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/edac/x38_edac.ko 2024-09-05T01:04:59.444 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/firmware 2024-09-05T01:04:59.445 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/firmware/edd.ko 2024-09-05T01:04:59.445 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-05T01:04:59.445 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio 2024-09-05T01:04:59.445 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-ich.ko 2024-09-05T01:04:59.445 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-05T01:04:59.445 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid 2024-09-05T01:04:59.445 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-appleir.ko 2024-09-05T01:04:59.445 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-aureal.ko 2024-09-05T01:04:59.445 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-axff.ko 2024-09-05T01:04:59.445 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-dr.ko 2024-09-05T01:04:59.445 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-elecom.ko 2024-09-05T01:04:59.445 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-elo.ko 2024-09-05T01:04:59.446 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-emsff.ko 2024-09-05T01:04:59.446 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-gaff.ko 2024-09-05T01:04:59.446 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-gt683r.ko 2024-09-05T01:04:59.446 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-gyration.ko 2024-09-05T01:04:59.446 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-05T01:04:59.446 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-05T01:04:59.446 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-holtekff.ko 2024-09-05T01:04:59.446 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-hyperv.ko 2024-09-05T01:04:59.446 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-icade.ko 2024-09-05T01:04:59.446 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-keytouch.ko 2024-09-05T01:04:59.446 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-kye.ko 2024-09-05T01:04:59.446 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-lcpower.ko 2024-09-05T01:04:59.447 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-led.ko 2024-09-05T01:04:59.447 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-lenovo.ko 2024-09-05T01:04:59.447 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-05T01:04:59.447 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-05T01:04:59.447 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-multitouch.ko 2024-09-05T01:04:59.447 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-ortek.ko 2024-09-05T01:04:59.447 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-penmount.ko 2024-09-05T01:04:59.447 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-petalynx.ko 2024-09-05T01:04:59.447 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-picolcd.ko 2024-09-05T01:04:59.447 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-pl.ko 2024-09-05T01:04:59.447 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-plantronics.ko 2024-09-05T01:04:59.448 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-primax.ko 2024-09-05T01:04:59.448 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-rmi.ko 2024-09-05T01:04:59.448 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-05T01:04:59.448 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-common.ko 2024-09-05T01:04:59.448 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-05T01:04:59.448 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-05T01:04:59.448 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-05T01:04:59.448 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-05T01:04:59.448 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-05T01:04:59.448 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-05T01:04:59.448 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-05T01:04:59.449 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-05T01:04:59.449 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-05T01:04:59.449 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-roccat.ko 2024-09-05T01:04:59.449 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-saitek.ko 2024-09-05T01:04:59.449 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-samsung.ko 2024-09-05T01:04:59.449 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-05T01:04:59.449 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-sjoy.ko 2024-09-05T01:04:59.449 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-sony.ko 2024-09-05T01:04:59.449 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-speedlink.ko 2024-09-05T01:04:59.449 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-steelseries.ko 2024-09-05T01:04:59.449 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-sunplus.ko 2024-09-05T01:04:59.450 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-05T01:04:59.450 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-tivo.ko 2024-09-05T01:04:59.450 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-tmff.ko 2024-09-05T01:04:59.450 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-topseed.ko 2024-09-05T01:04:59.450 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-twinhan.ko 2024-09-05T01:04:59.450 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-uclogic.ko 2024-09-05T01:04:59.450 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-waltop.ko 2024-09-05T01:04:59.450 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-wiimote.ko 2024-09-05T01:04:59.450 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-xinmo.ko 2024-09-05T01:04:59.450 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-zpff.ko 2024-09-05T01:04:59.450 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/hid-zydacron.ko 2024-09-05T01:04:59.451 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/uhid.ko 2024-09-05T01:04:59.451 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hid/wacom.ko 2024-09-05T01:04:59.451 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hv 2024-09-05T01:04:59.451 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hv/hv_balloon.ko 2024-09-05T01:04:59.451 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hv/hv_utils.ko 2024-09-05T01:04:59.451 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hv/hv_vmbus.ko 2024-09-05T01:04:59.451 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon 2024-09-05T01:04:59.451 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/abituguru.ko 2024-09-05T01:04:59.451 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/abituguru3.ko 2024-09-05T01:04:59.451 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-05T01:04:59.452 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ad7414.ko 2024-09-05T01:04:59.452 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ad7418.ko 2024-09-05T01:04:59.452 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adc128d818.ko 2024-09-05T01:04:59.452 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm1025.ko 2024-09-05T01:04:59.452 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm1026.ko 2024-09-05T01:04:59.452 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm1029.ko 2024-09-05T01:04:59.452 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm1031.ko 2024-09-05T01:04:59.452 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adm9240.ko 2024-09-05T01:04:59.452 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ads7828.ko 2024-09-05T01:04:59.452 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7410.ko 2024-09-05T01:04:59.452 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7411.ko 2024-09-05T01:04:59.453 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7462.ko 2024-09-05T01:04:59.453 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7470.ko 2024-09-05T01:04:59.453 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7475.ko 2024-09-05T01:04:59.453 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/adt7x10.ko 2024-09-05T01:04:59.453 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/amc6821.ko 2024-09-05T01:04:59.453 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/applesmc.ko 2024-09-05T01:04:59.453 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/asb100.ko 2024-09-05T01:04:59.453 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/asc7621.ko 2024-09-05T01:04:59.453 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-05T01:04:59.453 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/atxp1.ko 2024-09-05T01:04:59.453 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/coretemp.ko 2024-09-05T01:04:59.453 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-05T01:04:59.454 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/dme1737.ko 2024-09-05T01:04:59.454 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ds1621.ko 2024-09-05T01:04:59.454 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ds620.ko 2024-09-05T01:04:59.454 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/emc1403.ko 2024-09-05T01:04:59.454 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/emc6w201.ko 2024-09-05T01:04:59.454 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/f71805f.ko 2024-09-05T01:04:59.454 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/f71882fg.ko 2024-09-05T01:04:59.454 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/f75375s.ko 2024-09-05T01:04:59.454 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/fam15h_power.ko 2024-09-05T01:04:59.454 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/fschmd.ko 2024-09-05T01:04:59.454 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/g760a.ko 2024-09-05T01:04:59.454 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/g762.ko 2024-09-05T01:04:59.455 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/gl518sm.ko 2024-09-05T01:04:59.455 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/gl520sm.ko 2024-09-05T01:04:59.455 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-05T01:04:59.455 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/i5500_temp.ko 2024-09-05T01:04:59.455 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/i5k_amb.ko 2024-09-05T01:04:59.455 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ibmaem.ko 2024-09-05T01:04:59.455 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ibmpex.ko 2024-09-05T01:04:59.455 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ina209.ko 2024-09-05T01:04:59.455 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ina2xx.ko 2024-09-05T01:04:59.455 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/it87.ko 2024-09-05T01:04:59.455 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/k10temp.ko 2024-09-05T01:04:59.456 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/k8temp.ko 2024-09-05T01:04:59.456 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lineage-pem.ko 2024-09-05T01:04:59.456 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm63.ko 2024-09-05T01:04:59.456 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm73.ko 2024-09-05T01:04:59.456 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm75.ko 2024-09-05T01:04:59.456 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm77.ko 2024-09-05T01:04:59.456 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm78.ko 2024-09-05T01:04:59.456 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm80.ko 2024-09-05T01:04:59.456 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm83.ko 2024-09-05T01:04:59.456 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm85.ko 2024-09-05T01:04:59.456 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm87.ko 2024-09-05T01:04:59.457 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm90.ko 2024-09-05T01:04:59.457 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm92.ko 2024-09-05T01:04:59.457 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm93.ko 2024-09-05T01:04:59.457 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm95234.ko 2024-09-05T01:04:59.457 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm95241.ko 2024-09-05T01:04:59.457 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/lm95245.ko 2024-09-05T01:04:59.457 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc2945.ko 2024-09-05T01:04:59.457 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4151.ko 2024-09-05T01:04:59.457 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4215.ko 2024-09-05T01:04:59.457 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4222.ko 2024-09-05T01:04:59.457 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4245.ko 2024-09-05T01:04:59.457 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4260.ko 2024-09-05T01:04:59.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/ltc4261.ko 2024-09-05T01:04:59.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max16065.ko 2024-09-05T01:04:59.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max1619.ko 2024-09-05T01:04:59.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max1668.ko 2024-09-05T01:04:59.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max197.ko 2024-09-05T01:04:59.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max6639.ko 2024-09-05T01:04:59.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max6650.ko 2024-09-05T01:04:59.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/max6697.ko 2024-09-05T01:04:59.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/mcp3021.ko 2024-09-05T01:04:59.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/nct6683.ko 2024-09-05T01:04:59.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/nct6775-core.ko 2024-09-05T01:04:59.458 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/nct6775.ko 2024-09-05T01:04:59.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/nct7802.ko 2024-09-05T01:04:59.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pc87360.ko 2024-09-05T01:04:59.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pc87427.ko 2024-09-05T01:04:59.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pcf8591.ko 2024-09-05T01:04:59.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus 2024-09-05T01:04:59.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-05T01:04:59.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-05T01:04:59.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-05T01:04:59.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-05T01:04:59.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-05T01:04:59.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-05T01:04:59.459 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-05T01:04:59.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-05T01:04:59.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-05T01:04:59.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-05T01:04:59.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-05T01:04:59.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-05T01:04:59.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/powr1220.ko 2024-09-05T01:04:59.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sch5627.ko 2024-09-05T01:04:59.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sch5636.ko 2024-09-05T01:04:59.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-05T01:04:59.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sht15.ko 2024-09-05T01:04:59.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sht21.ko 2024-09-05T01:04:59.460 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/shtc1.ko 2024-09-05T01:04:59.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/sis5595.ko 2024-09-05T01:04:59.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/smsc47b397.ko 2024-09-05T01:04:59.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/smsc47m1.ko 2024-09-05T01:04:59.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/smsc47m192.ko 2024-09-05T01:04:59.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/thmc50.ko 2024-09-05T01:04:59.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/tmp102.ko 2024-09-05T01:04:59.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/tmp103.ko 2024-09-05T01:04:59.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/tmp401.ko 2024-09-05T01:04:59.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/tmp421.ko 2024-09-05T01:04:59.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/via-cputemp.ko 2024-09-05T01:04:59.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/via686a.ko 2024-09-05T01:04:59.461 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/vt1211.ko 2024-09-05T01:04:59.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/vt8231.ko 2024-09-05T01:04:59.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83627ehf.ko 2024-09-05T01:04:59.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83627hf.ko 2024-09-05T01:04:59.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83781d.ko 2024-09-05T01:04:59.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83791d.ko 2024-09-05T01:04:59.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83792d.ko 2024-09-05T01:04:59.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83793.ko 2024-09-05T01:04:59.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83795.ko 2024-09-05T01:04:59.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83l785ts.ko 2024-09-05T01:04:59.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/hwmon/w83l786ng.ko 2024-09-05T01:04:59.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c 2024-09-05T01:04:59.462 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/algos 2024-09-05T01:04:59.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-05T01:04:59.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-05T01:04:59.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses 2024-09-05T01:04:59.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-05T01:04:59.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-05T01:04:59.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-05T01:04:59.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-05T01:04:59.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-05T01:04:59.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-05T01:04:59.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-05T01:04:59.463 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-05T01:04:59.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-05T01:04:59.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-05T01:04:59.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-05T01:04:59.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-05T01:04:59.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-05T01:04:59.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-05T01:04:59.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-05T01:04:59.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-05T01:04:59.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-05T01:04:59.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-05T01:04:59.464 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-05T01:04:59.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-05T01:04:59.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-05T01:04:59.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-05T01:04:59.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-05T01:04:59.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-dev.ko 2024-09-05T01:04:59.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-mux.ko 2024-09-05T01:04:59.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-05T01:04:59.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-smbus.ko 2024-09-05T01:04:59.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/i2c/i2c-stub.ko 2024-09-05T01:04:59.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband 2024-09-05T01:04:59.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core 2024-09-05T01:04:59.465 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-05T01:04:59.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ib_core.ko 2024-09-05T01:04:59.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-05T01:04:59.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-05T01:04:59.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-05T01:04:59.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-05T01:04:59.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-05T01:04:59.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw 2024-09-05T01:04:59.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/cxgb4 2024-09-05T01:04:59.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-05T01:04:59.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mlx4 2024-09-05T01:04:59.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-05T01:04:59.466 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mlx5 2024-09-05T01:04:59.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-05T01:04:59.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mthca 2024-09-05T01:04:59.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-05T01:04:59.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp 2024-09-05T01:04:59.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/ipoib 2024-09-05T01:04:59.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-05T01:04:59.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/iser 2024-09-05T01:04:59.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-05T01:04:59.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/isert 2024-09-05T01:04:59.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-05T01:04:59.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/srp 2024-09-05T01:04:59.467 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-05T01:04:59.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/srpt 2024-09-05T01:04:59.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-05T01:04:59.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input 2024-09-05T01:04:59.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/gameport 2024-09-05T01:04:59.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-05T01:04:59.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-05T01:04:59.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/gameport/gameport.ko 2024-09-05T01:04:59.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/joydev.ko 2024-09-05T01:04:59.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard 2024-09-05T01:04:59.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-05T01:04:59.468 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse 2024-09-05T01:04:59.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/appletouch.ko 2024-09-05T01:04:59.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/bcm5974.ko 2024-09-05T01:04:59.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/cyapatp.ko 2024-09-05T01:04:59.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-05T01:04:59.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/sermouse.ko 2024-09-05T01:04:59.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-05T01:04:59.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-05T01:04:59.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-05T01:04:59.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/rmi4 2024-09-05T01:04:59.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-05T01:04:59.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio 2024-09-05T01:04:59.469 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/altera_ps2.ko 2024-09-05T01:04:59.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/arc_ps2.ko 2024-09-05T01:04:59.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-05T01:04:59.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/serio/serio_raw.ko 2024-09-05T01:04:59.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/input/sparse-keymap.ko 2024-09-05T01:04:59.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds 2024-09-05T01:04:59.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-blinkm.ko 2024-09-05T01:04:59.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-lm3530.ko 2024-09-05T01:04:59.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-lp3944.ko 2024-09-05T01:04:59.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/leds-ss4200.ko 2024-09-05T01:04:59.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger 2024-09-05T01:04:59.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-05T01:04:59.470 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-05T01:04:59.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-05T01:04:59.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-05T01:04:59.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-05T01:04:59.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-05T01:04:59.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-05T01:04:59.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-05T01:04:59.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md 2024-09-05T01:04:59.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/bcache 2024-09-05T01:04:59.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/bcache/bcache.ko 2024-09-05T01:04:59.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-bio-prison.ko 2024-09-05T01:04:59.471 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-cache-smq.ko 2024-09-05T01:04:59.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-cache.ko 2024-09-05T01:04:59.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-crypt.ko 2024-09-05T01:04:59.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-delay.ko 2024-09-05T01:04:59.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-flakey.ko 2024-09-05T01:04:59.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-log-userspace.ko 2024-09-05T01:04:59.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-multipath.ko 2024-09-05T01:04:59.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-queue-length.ko 2024-09-05T01:04:59.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-raid.ko 2024-09-05T01:04:59.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-round-robin.ko 2024-09-05T01:04:59.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-service-time.ko 2024-09-05T01:04:59.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-switch.ko 2024-09-05T01:04:59.472 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-thin-pool.ko 2024-09-05T01:04:59.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/dm-verity.ko 2024-09-05T01:04:59.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/persistent-data 2024-09-05T01:04:59.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-05T01:04:59.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/raid0.ko 2024-09-05T01:04:59.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/raid1.ko 2024-09-05T01:04:59.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/raid10.ko 2024-09-05T01:04:59.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/md/raid456.ko 2024-09-05T01:04:59.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message 2024-09-05T01:04:59.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion 2024-09-05T01:04:59.473 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptbase.ko 2024-09-05T01:04:59.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptctl.ko 2024-09-05T01:04:59.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptfc.ko 2024-09-05T01:04:59.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptlan.ko 2024-09-05T01:04:59.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptsas.ko 2024-09-05T01:04:59.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptscsih.ko 2024-09-05T01:04:59.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/message/fusion/mptspi.ko 2024-09-05T01:04:59.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd 2024-09-05T01:04:59.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/lpc_ich.ko 2024-09-05T01:04:59.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/lpc_sch.ko 2024-09-05T01:04:59.474 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/mfd-core.ko 2024-09-05T01:04:59.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/sm501.ko 2024-09-05T01:04:59.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/viperboard.ko 2024-09-05T01:04:59.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/vx855.ko 2024-09-05T01:04:59.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/mfd/wl1273-core.ko 2024-09-05T01:04:59.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc 2024-09-05T01:04:59.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/altera-stapl 2024-09-05T01:04:59.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-05T01:04:59.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/apds9802als.ko 2024-09-05T01:04:59.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/apds990x.ko 2024-09-05T01:04:59.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/bh1770glc.ko 2024-09-05T01:04:59.475 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/cb710 2024-09-05T01:04:59.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/cb710/cb710.ko 2024-09-05T01:04:59.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/eeprom 2024-09-05T01:04:59.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/eeprom/at24.ko 2024-09-05T01:04:59.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-05T01:04:59.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/eeprom/max6875.ko 2024-09-05T01:04:59.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/enclosure.ko 2024-09-05T01:04:59.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/hpilo.ko 2024-09-05T01:04:59.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/isl29003.ko 2024-09-05T01:04:59.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/isl29020.ko 2024-09-05T01:04:59.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/lis3lv02d 2024-09-05T01:04:59.476 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-05T01:04:59.477 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-05T01:04:59.477 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/mei 2024-09-05T01:04:59.477 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/mei/mei-me.ko 2024-09-05T01:04:59.477 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/mei/mei-txe.ko 2024-09-05T01:04:59.477 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/mei/mei.ko 2024-09-05T01:04:59.477 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/sgi-gru 2024-09-05T01:04:59.477 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-05T01:04:59.477 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/sgi-xp 2024-09-05T01:04:59.477 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-05T01:04:59.477 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-05T01:04:59.477 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-05T01:04:59.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/tifm_7xx1.ko 2024-09-05T01:04:59.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/tifm_core.ko 2024-09-05T01:04:59.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/tsl2550.ko 2024-09-05T01:04:59.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/vmw_balloon.ko 2024-09-05T01:04:59.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/vmw_vmci 2024-09-05T01:04:59.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-05T01:04:59.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net 2024-09-05T01:04:59.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/bonding 2024-09-05T01:04:59.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/bonding/bonding.ko 2024-09-05T01:04:59.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa 2024-09-05T01:04:59.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/b53 2024-09-05T01:04:59.478 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-05T01:04:59.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-05T01:04:59.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-05T01:04:59.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/mv88e6xxx 2024-09-05T01:04:59.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-05T01:04:59.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/dummy.ko 2024-09-05T01:04:59.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/eql.ko 2024-09-05T01:04:59.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet 2024-09-05T01:04:59.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com 2024-09-05T01:04:59.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-05T01:04:59.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-05T01:04:59.479 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-05T01:04:59.480 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-05T01:04:59.480 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390 2024-09-05T01:04:59.480 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-05T01:04:59.480 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-05T01:04:59.480 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-05T01:04:59.480 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-05T01:04:59.480 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/adaptec 2024-09-05T01:04:59.480 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-05T01:04:59.480 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/agere 2024-09-05T01:04:59.480 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-05T01:04:59.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/alteon 2024-09-05T01:04:59.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-05T01:04:59.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/altera 2024-09-05T01:04:59.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-05T01:04:59.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/amd 2024-09-05T01:04:59.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-05T01:04:59.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-05T01:04:59.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-05T01:04:59.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros 2024-09-05T01:04:59.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/alx 2024-09-05T01:04:59.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-05T01:04:59.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-05T01:04:59.481 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-05T01:04:59.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-05T01:04:59.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-05T01:04:59.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atlx 2024-09-05T01:04:59.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-05T01:04:59.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-05T01:04:59.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom 2024-09-05T01:04:59.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-05T01:04:59.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-05T01:04:59.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-05T01:04:59.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-05T01:04:59.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-05T01:04:59.482 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/genet 2024-09-05T01:04:59.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-05T01:04:59.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-05T01:04:59.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/brocade 2024-09-05T01:04:59.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/brocade/bna 2024-09-05T01:04:59.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-05T01:04:59.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio 2024-09-05T01:04:59.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-05T01:04:59.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-05T01:04:59.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-05T01:04:59.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-05T01:04:59.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-05T01:04:59.483 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-05T01:04:59.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-05T01:04:59.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-05T01:04:59.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-05T01:04:59.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-05T01:04:59.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/cisco 2024-09-05T01:04:59.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/cisco/enic 2024-09-05T01:04:59.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-05T01:04:59.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec 2024-09-05T01:04:59.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip 2024-09-05T01:04:59.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-05T01:04:59.484 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-05T01:04:59.485 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-05T01:04:59.485 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-05T01:04:59.485 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-05T01:04:59.488 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-05T01:04:59.488 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dlink 2024-09-05T01:04:59.488 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-05T01:04:59.488 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-05T01:04:59.488 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/dnet.ko 2024-09-05T01:04:59.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/emulex 2024-09-05T01:04:59.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/emulex/benet 2024-09-05T01:04:59.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-05T01:04:59.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/ethoc.ko 2024-09-05T01:04:59.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/fealnx.ko 2024-09-05T01:04:59.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel 2024-09-05T01:04:59.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-05T01:04:59.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e1000 2024-09-05T01:04:59.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-05T01:04:59.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e1000e 2024-09-05T01:04:59.489 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-05T01:04:59.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/fm10k 2024-09-05T01:04:59.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-05T01:04:59.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/i40e 2024-09-05T01:04:59.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-05T01:04:59.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/iavf 2024-09-05T01:04:59.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-05T01:04:59.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/igb 2024-09-05T01:04:59.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-05T01:04:59.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/igbvf 2024-09-05T01:04:59.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-05T01:04:59.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-05T01:04:59.490 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-05T01:04:59.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-05T01:04:59.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-05T01:04:59.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/libeth 2024-09-05T01:04:59.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-05T01:04:59.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/libie 2024-09-05T01:04:59.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-05T01:04:59.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/jme.ko 2024-09-05T01:04:59.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/marvell 2024-09-05T01:04:59.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-05T01:04:59.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-05T01:04:59.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-05T01:04:59.491 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox 2024-09-05T01:04:59.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-05T01:04:59.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-05T01:04:59.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-05T01:04:59.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-05T01:04:59.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-05T01:04:59.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-05T01:04:59.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/micrel 2024-09-05T01:04:59.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-05T01:04:59.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/myricom 2024-09-05T01:04:59.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-05T01:04:59.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-05T01:04:59.492 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/natsemi 2024-09-05T01:04:59.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-05T01:04:59.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-05T01:04:59.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/neterion 2024-09-05T01:04:59.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-05T01:04:59.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/nvidia 2024-09-05T01:04:59.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-05T01:04:59.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/packetengines 2024-09-05T01:04:59.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-05T01:04:59.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-05T01:04:59.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic 2024-09-05T01:04:59.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-05T01:04:59.493 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-05T01:04:59.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-05T01:04:59.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-05T01:04:59.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-05T01:04:59.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/rdc 2024-09-05T01:04:59.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-05T01:04:59.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek 2024-09-05T01:04:59.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-05T01:04:59.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-05T01:04:59.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-05T01:04:59.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-05T01:04:59.494 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/rocker 2024-09-05T01:04:59.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-05T01:04:59.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sfc 2024-09-05T01:04:59.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-05T01:04:59.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/silan 2024-09-05T01:04:59.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-05T01:04:59.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sis 2024-09-05T01:04:59.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-05T01:04:59.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-05T01:04:59.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc 2024-09-05T01:04:59.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-05T01:04:59.495 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-05T01:04:59.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-05T01:04:59.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-05T01:04:59.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro 2024-09-05T01:04:59.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-05T01:04:59.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-05T01:04:59.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-05T01:04:59.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun 2024-09-05T01:04:59.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-05T01:04:59.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-05T01:04:59.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-05T01:04:59.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-05T01:04:59.496 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/tehuti 2024-09-05T01:04:59.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-05T01:04:59.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/ti 2024-09-05T01:04:59.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-05T01:04:59.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/via 2024-09-05T01:04:59.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-05T01:04:59.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-05T01:04:59.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/wiznet 2024-09-05T01:04:59.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-05T01:04:59.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-05T01:04:59.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/xircom 2024-09-05T01:04:59.497 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-05T01:04:59.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/geneve.ko 2024-09-05T01:04:59.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/hyperv 2024-09-05T01:04:59.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-05T01:04:59.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ieee802154 2024-09-05T01:04:59.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-05T01:04:59.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ifb.ko 2024-09-05T01:04:59.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ipvlan 2024-09-05T01:04:59.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-05T01:04:59.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/macvlan.ko 2024-09-05T01:04:59.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/macvtap.ko 2024-09-05T01:04:59.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio 2024-09-05T01:04:59.498 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio.ko 2024-09-05T01:04:59.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-05T01:04:59.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-05T01:04:59.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-05T01:04:59.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/mii.ko 2024-09-05T01:04:59.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/net_failover.ko 2024-09-05T01:04:59.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/netconsole.ko 2024-09-05T01:04:59.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/nlmon.ko 2024-09-05T01:04:59.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/pcs 2024-09-05T01:04:59.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-05T01:04:59.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-05T01:04:59.499 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy 2024-09-05T01:04:59.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/amd.ko 2024-09-05T01:04:59.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-05T01:04:59.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-05T01:04:59.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-05T01:04:59.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/bcm87xx.ko 2024-09-05T01:04:59.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/broadcom.ko 2024-09-05T01:04:59.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/cicada.ko 2024-09-05T01:04:59.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/davicom.ko 2024-09-05T01:04:59.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/dp83640.ko 2024-09-05T01:04:59.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/et1011c.ko 2024-09-05T01:04:59.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/icplus.ko 2024-09-05T01:04:59.500 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/lxt.ko 2024-09-05T01:04:59.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/marvell.ko 2024-09-05T01:04:59.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/micrel.ko 2024-09-05T01:04:59.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/national.ko 2024-09-05T01:04:59.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/phylink.ko 2024-09-05T01:04:59.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/qsemi.ko 2024-09-05T01:04:59.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/realtek.ko 2024-09-05T01:04:59.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/smsc.ko 2024-09-05T01:04:59.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/ste10Xp.ko 2024-09-05T01:04:59.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/phy/vitesse.ko 2024-09-05T01:04:59.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp 2024-09-05T01:04:59.501 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-05T01:04:59.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_async.ko 2024-09-05T01:04:59.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-05T01:04:59.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-05T01:04:59.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-05T01:04:59.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-05T01:04:59.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/pppoe.ko 2024-09-05T01:04:59.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/pppox.ko 2024-09-05T01:04:59.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/ppp/pptp.ko 2024-09-05T01:04:59.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/slip 2024-09-05T01:04:59.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/slip/slhc.ko 2024-09-05T01:04:59.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/slip/slip.ko 2024-09-05T01:04:59.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/sungem_phy.ko 2024-09-05T01:04:59.502 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/tap.ko 2024-09-05T01:04:59.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team 2024-09-05T01:04:59.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team.ko 2024-09-05T01:04:59.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-05T01:04:59.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-05T01:04:59.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-05T01:04:59.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_random.ko 2024-09-05T01:04:59.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-05T01:04:59.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/tun.ko 2024-09-05T01:04:59.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/veth.ko 2024-09-05T01:04:59.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/virtio_net.ko 2024-09-05T01:04:59.503 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/vmxnet3 2024-09-05T01:04:59.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-05T01:04:59.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/vxlan 2024-09-05T01:04:59.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/vxlan/vxlan.ko 2024-09-05T01:04:59.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/xen-netback 2024-09-05T01:04:59.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-05T01:04:59.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/net/xen-netfront.ko 2024-09-05T01:04:59.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ntb 2024-09-05T01:04:59.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ntb/ntb.ko 2024-09-05T01:04:59.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/nvme 2024-09-05T01:04:59.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/nvme/host 2024-09-05T01:04:59.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/nvme/host/nvme-core.ko 2024-09-05T01:04:59.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/nvme/host/nvme.ko 2024-09-05T01:04:59.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport 2024-09-05T01:04:59.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/parport.ko 2024-09-05T01:04:59.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/parport_cs.ko 2024-09-05T01:04:59.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/parport_pc.ko 2024-09-05T01:04:59.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/parport/parport_serial.ko 2024-09-05T01:04:59.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci 2024-09-05T01:04:59.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/hotplug 2024-09-05T01:04:59.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-05T01:04:59.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/pcie 2024-09-05T01:04:59.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-05T01:04:59.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pci/xen-pcifront.ko 2024-09-05T01:04:59.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia 2024-09-05T01:04:59.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/i82092.ko 2024-09-05T01:04:59.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/pd6729.ko 2024-09-05T01:04:59.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-05T01:04:59.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pinctrl 2024-09-05T01:04:59.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pinctrl/intel 2024-09-05T01:04:59.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-05T01:04:59.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform 2024-09-05T01:04:59.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86 2024-09-05T01:04:59.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-05T01:04:59.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/acerhdf.ko 2024-09-05T01:04:59.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-05T01:04:59.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-05T01:04:59.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-05T01:04:59.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-05T01:04:59.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-05T01:04:59.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-05T01:04:59.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-05T01:04:59.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-05T01:04:59.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-05T01:04:59.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/hdaps.ko 2024-09-05T01:04:59.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/intel 2024-09-05T01:04:59.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-05T01:04:59.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/intel_ips.ko 2024-09-05T01:04:59.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-05T01:04:59.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-05T01:04:59.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-05T01:04:59.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-05T01:04:59.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-05T01:04:59.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-05T01:04:59.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-05T01:04:59.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-05T01:04:59.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-05T01:04:59.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/platform/x86/wmi.ko 2024-09-05T01:04:59.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/powercap 2024-09-05T01:04:59.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-05T01:04:59.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-05T01:04:59.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps 2024-09-05T01:04:59.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/clients 2024-09-05T01:04:59.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-05T01:04:59.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-05T01:04:59.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/clients/pps_parport.ko 2024-09-05T01:04:59.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/pps/pps_core.ko 2024-09-05T01:04:59.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ptp 2024-09-05T01:04:59.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ptp/ptp.ko 2024-09-05T01:04:59.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ptp/ptp_kvm.ko 2024-09-05T01:04:59.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras 2024-09-05T01:04:59.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/amd 2024-09-05T01:04:59.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/amd/atl 2024-09-05T01:04:59.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-05T01:04:59.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ras/amd/fmpm.ko 2024-09-05T01:04:59.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc 2024-09-05T01:04:59.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-05T01:04:59.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-05T01:04:59.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-05T01:04:59.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-05T01:04:59.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-05T01:04:59.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-05T01:04:59.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-05T01:04:59.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-05T01:04:59.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-05T01:04:59.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-05T01:04:59.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-em3027.ko 2024-09-05T01:04:59.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-05T01:04:59.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-05T01:04:59.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-05T01:04:59.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-05T01:04:59.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-05T01:04:59.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-05T01:04:59.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-max6900.ko 2024-09-05T01:04:59.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-05T01:04:59.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-05T01:04:59.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-05T01:04:59.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-05T01:04:59.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-05T01:04:59.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-05T01:04:59.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-05T01:04:59.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-05T01:04:59.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-05T01:04:59.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-05T01:04:59.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-05T01:04:59.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-05T01:04:59.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/rtc/rtc-x1205.ko 2024-09-05T01:04:59.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi 2024-09-05T01:04:59.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/3w-9xxx.ko 2024-09-05T01:04:59.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/3w-sas.ko 2024-09-05T01:04:59.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/3w-xxxx.ko 2024-09-05T01:04:59.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/BusLogic.ko 2024-09-05T01:04:59.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/a100u2w.ko 2024-09-05T01:04:59.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aacraid 2024-09-05T01:04:59.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-05T01:04:59.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/advansys.ko 2024-09-05T01:04:59.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aic7xxx 2024-09-05T01:04:59.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-05T01:04:59.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-05T01:04:59.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/am53c974.ko 2024-09-05T01:04:59.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/arcmsr 2024-09-05T01:04:59.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-05T01:04:59.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/atp870u.ko 2024-09-05T01:04:59.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/be2iscsi 2024-09-05T01:04:59.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-05T01:04:59.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bfa 2024-09-05T01:04:59.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bfa/bfa.ko 2024-09-05T01:04:59.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bnx2fc 2024-09-05T01:04:59.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-05T01:04:59.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bnx2i 2024-09-05T01:04:59.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-05T01:04:59.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ch.ko 2024-09-05T01:04:59.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/csiostor 2024-09-05T01:04:59.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-05T01:04:59.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi 2024-09-05T01:04:59.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-05T01:04:59.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-05T01:04:59.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-05T01:04:59.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-05T01:04:59.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-05T01:04:59.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/dc395x.ko 2024-09-05T01:04:59.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/device_handler 2024-09-05T01:04:59.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-05T01:04:59.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-05T01:04:59.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-05T01:04:59.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-05T01:04:59.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/dmx3191d.ko 2024-09-05T01:04:59.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/esas2r 2024-09-05T01:04:59.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-05T01:04:59.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/esp_scsi.ko 2024-09-05T01:04:59.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fcoe 2024-09-05T01:04:59.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-05T01:04:59.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-05T01:04:59.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fnic 2024-09-05T01:04:59.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/fnic/fnic.ko 2024-09-05T01:04:59.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/hpsa.ko 2024-09-05T01:04:59.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/hptiop.ko 2024-09-05T01:04:59.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/hv_storvsc.ko 2024-09-05T01:04:59.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/initio.ko 2024-09-05T01:04:59.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ipr.ko 2024-09-05T01:04:59.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ips.ko 2024-09-05T01:04:59.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/isci 2024-09-05T01:04:59.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/isci/isci.ko 2024-09-05T01:04:59.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-05T01:04:59.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-05T01:04:59.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libfc 2024-09-05T01:04:59.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libfc/libfc.ko 2024-09-05T01:04:59.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libiscsi.ko 2024-09-05T01:04:59.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-05T01:04:59.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libsas 2024-09-05T01:04:59.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/libsas/libsas.ko 2024-09-05T01:04:59.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/lpfc 2024-09-05T01:04:59.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-05T01:04:59.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid 2024-09-05T01:04:59.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid.ko 2024-09-05T01:04:59.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-05T01:04:59.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-05T01:04:59.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-05T01:04:59.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mpt3sas 2024-09-05T01:04:59.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-05T01:04:59.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mvsas 2024-09-05T01:04:59.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-05T01:04:59.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/mvumi.ko 2024-09-05T01:04:59.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pm8001 2024-09-05T01:04:59.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-05T01:04:59.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/pmcraid.ko 2024-09-05T01:04:59.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla1280.ko 2024-09-05T01:04:59.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla2xxx 2024-09-05T01:04:59.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-05T01:04:59.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-05T01:04:59.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla4xxx 2024-09-05T01:04:59.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-05T01:04:59.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/raid_class.ko 2024-09-05T01:04:59.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_debug.ko 2024-09-05T01:04:59.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-05T01:04:59.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-05T01:04:59.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-05T01:04:59.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-05T01:04:59.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-05T01:04:59.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/ses.ko 2024-09-05T01:04:59.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/st.ko 2024-09-05T01:04:59.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/stex.ko 2024-09-05T01:04:59.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/sym53c8xx_2 2024-09-05T01:04:59.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-05T01:04:59.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/virtio_scsi.ko 2024-09-05T01:04:59.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-05T01:04:59.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/scsi/wd719x.ko 2024-09-05T01:04:59.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ssb 2024-09-05T01:04:59.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ssb/ssb.ko 2024-09-05T01:04:59.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target 2024-09-05T01:04:59.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/iscsi 2024-09-05T01:04:59.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-05T01:04:59.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/loopback 2024-09-05T01:04:59.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-05T01:04:59.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_file.ko 2024-09-05T01:04:59.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_iblock.ko 2024-09-05T01:04:59.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_mod.ko 2024-09-05T01:04:59.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_pscsi.ko 2024-09-05T01:04:59.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/target_core_user.ko 2024-09-05T01:04:59.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/tcm_fc 2024-09-05T01:04:59.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-05T01:04:59.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal 2024-09-05T01:04:59.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel 2024-09-05T01:04:59.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal 2024-09-05T01:04:59.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-05T01:04:59.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-05T01:04:59.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-05T01:04:59.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-05T01:04:59.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-05T01:04:59.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-05T01:04:59.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-05T01:04:59.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-05T01:04:59.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-05T01:04:59.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-05T01:04:59.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-05T01:04:59.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-05T01:04:59.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-05T01:04:59.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-05T01:04:59.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-05T01:04:59.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-05T01:04:59.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-05T01:04:59.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-05T01:04:59.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty 2024-09-05T01:04:59.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/ipwireless 2024-09-05T01:04:59.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-05T01:04:59.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/n_gsm.ko 2024-09-05T01:04:59.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/n_hdlc.ko 2024-09-05T01:04:59.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/nozomi.ko 2024-09-05T01:04:59.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial 2024-09-05T01:04:59.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/8250 2024-09-05T01:04:59.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-05T01:04:59.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/arc_uart.ko 2024-09-05T01:04:59.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/jsm 2024-09-05T01:04:59.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-05T01:04:59.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs 2024-09-05T01:04:59.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/core 2024-09-05T01:04:59.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-05T01:04:59.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/host 2024-09-05T01:04:59.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-05T01:04:59.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio 2024-09-05T01:04:59.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio.ko 2024-09-05T01:04:59.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_aec.ko 2024-09-05T01:04:59.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_cif.ko 2024-09-05T01:04:59.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_pci_generic.ko 2024-09-05T01:04:59.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/uio/uio_sercos3.ko 2024-09-05T01:04:59.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb 2024-09-05T01:04:59.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class 2024-09-05T01:04:59.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/cdc-acm.ko 2024-09-05T01:04:59.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-05T01:04:59.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/usblp.ko 2024-09-05T01:04:59.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/class/usbtmc.ko 2024-09-05T01:04:59.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host 2024-09-05T01:04:59.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-05T01:04:59.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/image 2024-09-05T01:04:59.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/image/mdc800.ko 2024-09-05T01:04:59.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/image/microtek.ko 2024-09-05T01:04:59.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc 2024-09-05T01:04:59.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/adutux.ko 2024-09-05T01:04:59.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/appledisplay.ko 2024-09-05T01:04:59.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/emi26.ko 2024-09-05T01:04:59.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/emi62.ko 2024-09-05T01:04:59.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/ezusb.ko 2024-09-05T01:04:59.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/idmouse.ko 2024-09-05T01:04:59.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/iowarrior.ko 2024-09-05T01:04:59.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-05T01:04:59.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/ldusb.ko 2024-09-05T01:04:59.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/legousbtower.ko 2024-09-05T01:04:59.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/sisusbvga 2024-09-05T01:04:59.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-05T01:04:59.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-05T01:04:59.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/usb3503.ko 2024-09-05T01:04:59.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/usblcd.ko 2024-09-05T01:04:59.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-05T01:04:59.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/uss720.ko 2024-09-05T01:04:59.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/misc/yurex.ko 2024-09-05T01:04:59.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/phy 2024-09-05T01:04:59.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/phy/phy-generic.ko 2024-09-05T01:04:59.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial 2024-09-05T01:04:59.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/aircable.ko 2024-09-05T01:04:59.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ark3116.ko 2024-09-05T01:04:59.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-05T01:04:59.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ch341.ko 2024-09-05T01:04:59.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/cp210x.ko 2024-09-05T01:04:59.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/cyberjack.ko 2024-09-05T01:04:59.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-05T01:04:59.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-05T01:04:59.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/empeg.ko 2024-09-05T01:04:59.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-05T01:04:59.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-05T01:04:59.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-05T01:04:59.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/io_ti.ko 2024-09-05T01:04:59.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ipaq.ko 2024-09-05T01:04:59.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ipw.ko 2024-09-05T01:04:59.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ir-usb.ko 2024-09-05T01:04:59.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-05T01:04:59.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/keyspan.ko 2024-09-05T01:04:59.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-05T01:04:59.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-05T01:04:59.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-05T01:04:59.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/mct_u232.ko 2024-09-05T01:04:59.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/mos7720.ko 2024-09-05T01:04:59.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/mos7840.ko 2024-09-05T01:04:59.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/navman.ko 2024-09-05T01:04:59.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/omninet.ko 2024-09-05T01:04:59.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/opticon.ko 2024-09-05T01:04:59.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/option.ko 2024-09-05T01:04:59.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/oti6858.ko 2024-09-05T01:04:59.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/pl2303.ko 2024-09-05T01:04:59.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/qcaux.ko 2024-09-05T01:04:59.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/qcserial.ko 2024-09-05T01:04:59.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/quatech2.ko 2024-09-05T01:04:59.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/safe_serial.ko 2024-09-05T01:04:59.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/sierra.ko 2024-09-05T01:04:59.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-05T01:04:59.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ssu100.ko 2024-09-05T01:04:59.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/symbolserial.ko 2024-09-05T01:04:59.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-05T01:04:59.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-05T01:04:59.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/usb_debug.ko 2024-09-05T01:04:59.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-05T01:04:59.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/visor.ko 2024-09-05T01:04:59.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/whiteheat.ko 2024-09-05T01:04:59.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-05T01:04:59.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage 2024-09-05T01:04:59.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/uas.ko 2024-09-05T01:04:59.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-05T01:04:59.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-05T01:04:59.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-05T01:04:59.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-05T01:04:59.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-05T01:04:59.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-05T01:04:59.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-05T01:04:59.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-karma.ko 2024-09-05T01:04:59.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-05T01:04:59.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-05T01:04:59.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-05T01:04:59.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-05T01:04:59.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-05T01:04:59.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/storage/usb-storage.ko 2024-09-05T01:04:59.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/usbip 2024-09-05T01:04:59.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-05T01:04:59.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-05T01:04:59.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-05T01:04:59.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio 2024-09-05T01:04:59.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/pci 2024-09-05T01:04:59.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-05T01:04:59.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-05T01:04:59.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/vfio.ko 2024-09-05T01:04:59.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-05T01:04:59.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost 2024-09-05T01:04:59.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/vhost.ko 2024-09-05T01:04:59.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-05T01:04:59.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/vhost_net.ko 2024-09-05T01:04:59.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/vhost/vhost_scsi.ko 2024-09-05T01:04:59.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video 2024-09-05T01:04:59.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight 2024-09-05T01:04:59.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/apple_bl.ko 2024-09-05T01:04:59.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/lcd.ko 2024-09-05T01:04:59.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-05T01:04:59.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio 2024-09-05T01:04:59.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio.ko 2024-09-05T01:04:59.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio_balloon.ko 2024-09-05T01:04:59.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio_mmio.ko 2024-09-05T01:04:59.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio_pci.ko 2024-09-05T01:04:59.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-05T01:04:59.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-05T01:04:59.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/virtio/virtio_ring.ko 2024-09-05T01:04:59.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1 2024-09-05T01:04:59.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/masters 2024-09-05T01:04:59.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/masters/ds2482.ko 2024-09-05T01:04:59.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/masters/ds2490.ko 2024-09-05T01:04:59.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves 2024-09-05T01:04:59.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-05T01:04:59.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-05T01:04:59.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-05T01:04:59.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-05T01:04:59.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-05T01:04:59.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-05T01:04:59.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-05T01:04:59.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-05T01:04:59.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-05T01:04:59.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-05T01:04:59.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-05T01:04:59.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/w1/wire.ko 2024-09-05T01:04:59.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog 2024-09-05T01:04:59.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-05T01:04:59.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-05T01:04:59.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-05T01:04:59.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/hpwdt.ko 2024-09-05T01:04:59.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/i6300esb.ko 2024-09-05T01:04:59.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-05T01:04:59.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-05T01:04:59.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/ib700wdt.ko 2024-09-05T01:04:59.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/ibmasr.ko 2024-09-05T01:04:59.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-05T01:04:59.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-05T01:04:59.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/it87_wdt.ko 2024-09-05T01:04:59.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/machzwd.ko 2024-09-05T01:04:59.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/nv_tco.ko 2024-09-05T01:04:59.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-05T01:04:59.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-05T01:04:59.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-05T01:04:59.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-05T01:04:59.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/softdog.ko 2024-09-05T01:04:59.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-05T01:04:59.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/via_wdt.ko 2024-09-05T01:04:59.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-05T01:04:59.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-05T01:04:59.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-05T01:04:59.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/wdt_pci.ko 2024-09-05T01:04:59.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/watchdog/xen_wdt.ko 2024-09-05T01:04:59.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen 2024-09-05T01:04:59.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-05T01:04:59.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-evtchn.ko 2024-09-05T01:04:59.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-gntalloc.ko 2024-09-05T01:04:59.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-gntdev.ko 2024-09-05T01:04:59.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-pciback 2024-09-05T01:04:59.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-05T01:04:59.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xen-privcmd.ko 2024-09-05T01:04:59.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xenfs 2024-09-05T01:04:59.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-05T01:04:59.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs 2024-09-05T01:04:59.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/9p 2024-09-05T01:04:59.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/9p/9p.ko 2024-09-05T01:04:59.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/affs 2024-09-05T01:04:59.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/affs/affs.ko 2024-09-05T01:04:59.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/befs 2024-09-05T01:04:59.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/befs/befs.ko 2024-09-05T01:04:59.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/binfmt_misc.ko 2024-09-05T01:04:59.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/btrfs 2024-09-05T01:04:59.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/btrfs/btrfs.ko 2024-09-05T01:04:59.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/cachefiles 2024-09-05T01:04:59.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/cachefiles/cachefiles.ko 2024-09-05T01:04:59.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ceph 2024-09-05T01:04:59.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ceph/ceph.ko 2024-09-05T01:04:59.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/coda 2024-09-05T01:04:59.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/coda/coda.ko 2024-09-05T01:04:59.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/cramfs 2024-09-05T01:04:59.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/cramfs/cramfs.ko 2024-09-05T01:04:59.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/dlm 2024-09-05T01:04:59.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/dlm/dlm.ko 2024-09-05T01:04:59.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ecryptfs 2024-09-05T01:04:59.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-05T01:04:59.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/f2fs 2024-09-05T01:04:59.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/f2fs/f2fs.ko 2024-09-05T01:04:59.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fat 2024-09-05T01:04:59.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fat/fat.ko 2024-09-05T01:04:59.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fat/msdos.ko 2024-09-05T01:04:59.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fat/vfat.ko 2024-09-05T01:04:59.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fuse 2024-09-05T01:04:59.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fuse/cuse.ko 2024-09-05T01:04:59.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/fuse/fuse.ko 2024-09-05T01:04:59.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/gfs2 2024-09-05T01:04:59.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/gfs2/gfs2.ko 2024-09-05T01:04:59.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hfs 2024-09-05T01:04:59.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hfs/hfs.ko 2024-09-05T01:04:59.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hfsplus 2024-09-05T01:04:59.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/hfsplus/hfsplus.ko 2024-09-05T01:04:59.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/isofs 2024-09-05T01:04:59.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/isofs/isofs.ko 2024-09-05T01:04:59.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/jfs 2024-09-05T01:04:59.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/jfs/jfs.ko 2024-09-05T01:04:59.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/lockd 2024-09-05T01:04:59.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/lockd/lockd.ko 2024-09-05T01:04:59.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/minix 2024-09-05T01:04:59.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/minix/minix.ko 2024-09-05T01:04:59.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/netfs 2024-09-05T01:04:59.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/netfs/netfs.ko 2024-09-05T01:04:59.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs 2024-09-05T01:04:59.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/blocklayout 2024-09-05T01:04:59.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-05T01:04:59.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/filelayout 2024-09-05T01:04:59.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-05T01:04:59.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/flexfilelayout 2024-09-05T01:04:59.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-05T01:04:59.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/nfs.ko 2024-09-05T01:04:59.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/nfsv3.ko 2024-09-05T01:04:59.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs/nfsv4.ko 2024-09-05T01:04:59.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs_common 2024-09-05T01:04:59.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs_common/grace.ko 2024-09-05T01:04:59.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfs_common/nfs_acl.ko 2024-09-05T01:04:59.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfsd 2024-09-05T01:04:59.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nfsd/nfsd.ko 2024-09-05T01:04:59.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nilfs2 2024-09-05T01:04:59.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nilfs2/nilfs2.ko 2024-09-05T01:04:59.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls 2024-09-05T01:04:59.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-celtic.ko 2024-09-05T01:04:59.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-centeuro.ko 2024-09-05T01:04:59.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-croatian.ko 2024-09-05T01:04:59.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-cyrillic.ko 2024-09-05T01:04:59.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-gaelic.ko 2024-09-05T01:04:59.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-greek.ko 2024-09-05T01:04:59.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-iceland.ko 2024-09-05T01:04:59.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-inuit.ko 2024-09-05T01:04:59.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-roman.ko 2024-09-05T01:04:59.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-romanian.ko 2024-09-05T01:04:59.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/mac-turkish.ko 2024-09-05T01:04:59.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp1250.ko 2024-09-05T01:04:59.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp1251.ko 2024-09-05T01:04:59.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp1255.ko 2024-09-05T01:04:59.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp737.ko 2024-09-05T01:04:59.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp775.ko 2024-09-05T01:04:59.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp850.ko 2024-09-05T01:04:59.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp852.ko 2024-09-05T01:04:59.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp855.ko 2024-09-05T01:04:59.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp857.ko 2024-09-05T01:04:59.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp860.ko 2024-09-05T01:04:59.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp861.ko 2024-09-05T01:04:59.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp862.ko 2024-09-05T01:04:59.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp863.ko 2024-09-05T01:04:59.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp864.ko 2024-09-05T01:04:59.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp865.ko 2024-09-05T01:04:59.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp866.ko 2024-09-05T01:04:59.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp869.ko 2024-09-05T01:04:59.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp874.ko 2024-09-05T01:04:59.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp932.ko 2024-09-05T01:04:59.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp936.ko 2024-09-05T01:04:59.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp949.ko 2024-09-05T01:04:59.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_cp950.ko 2024-09-05T01:04:59.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_euc-jp.ko 2024-09-05T01:04:59.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-1.ko 2024-09-05T01:04:59.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-13.ko 2024-09-05T01:04:59.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-14.ko 2024-09-05T01:04:59.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-15.ko 2024-09-05T01:04:59.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-2.ko 2024-09-05T01:04:59.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-3.ko 2024-09-05T01:04:59.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-4.ko 2024-09-05T01:04:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-5.ko 2024-09-05T01:04:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-6.ko 2024-09-05T01:04:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-7.ko 2024-09-05T01:04:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_iso8859-9.ko 2024-09-05T01:04:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_koi8-r.ko 2024-09-05T01:04:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_koi8-ru.ko 2024-09-05T01:04:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_koi8-u.ko 2024-09-05T01:04:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-05T01:04:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/nls/nls_utf8.ko 2024-09-05T01:04:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2 2024-09-05T01:04:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/cluster 2024-09-05T01:04:59.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-05T01:04:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/dlm 2024-09-05T01:04:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-05T01:04:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/dlmfs 2024-09-05T01:04:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-05T01:04:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ocfs2.ko 2024-09-05T01:04:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-05T01:04:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-05T01:04:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-05T01:04:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/overlayfs 2024-09-05T01:04:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/overlayfs/overlay.ko 2024-09-05T01:04:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/pstore 2024-09-05T01:04:59.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/pstore/ramoops.ko 2024-09-05T01:04:59.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/reiserfs 2024-09-05T01:04:59.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/reiserfs/reiserfs.ko 2024-09-05T01:04:59.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/romfs 2024-09-05T01:04:59.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/romfs/romfs.ko 2024-09-05T01:04:59.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb 2024-09-05T01:04:59.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/client 2024-09-05T01:04:59.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/client/cifs.ko 2024-09-05T01:04:59.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/common 2024-09-05T01:04:59.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/common/cifs_arc4.ko 2024-09-05T01:04:59.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/smb/common/cifs_md4.ko 2024-09-05T01:04:59.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/squashfs 2024-09-05T01:04:59.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/squashfs/squashfs.ko 2024-09-05T01:04:59.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/sysv 2024-09-05T01:04:59.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/sysv/sysv.ko 2024-09-05T01:04:59.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/udf 2024-09-05T01:04:59.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/udf/udf.ko 2024-09-05T01:04:59.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ufs 2024-09-05T01:04:59.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/ufs/ufs.ko 2024-09-05T01:04:59.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/xfs 2024-09-05T01:04:59.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/fs/xfs/xfs.ko 2024-09-05T01:04:59.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel 2024-09-05T01:04:59.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/rcu 2024-09-05T01:04:59.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/rcu/rcutorture.ko 2024-09-05T01:04:59.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/torture.ko 2024-09-05T01:04:59.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/trace 2024-09-05T01:04:59.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-05T01:04:59.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib 2024-09-05T01:04:59.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/asn1_encoder.ko 2024-09-05T01:04:59.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crc-itu-t.ko 2024-09-05T01:04:59.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crc8.ko 2024-09-05T01:04:59.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crypto 2024-09-05T01:04:59.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crypto/libaescfb.ko 2024-09-05T01:04:59.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crypto/libarc4.ko 2024-09-05T01:04:59.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/crypto/libdes.ko 2024-09-05T01:04:59.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/libcrc32c.ko 2024-09-05T01:04:59.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/lru_cache.ko 2024-09-05T01:04:59.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/lz4 2024-09-05T01:04:59.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/lz4/lz4_compress.ko 2024-09-05T01:04:59.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/lz4/lz4hc_compress.ko 2024-09-05T01:04:59.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/math 2024-09-05T01:04:59.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/math/cordic.ko 2024-09-05T01:04:59.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/raid6 2024-09-05T01:04:59.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/raid6/raid6_pq.ko 2024-09-05T01:04:59.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/reed_solomon 2024-09-05T01:04:59.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-05T01:04:59.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/ts_bm.ko 2024-09-05T01:04:59.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/ts_fsm.ko 2024-09-05T01:04:59.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/ts_kmp.ko 2024-09-05T01:04:59.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/zstd 2024-09-05T01:04:59.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/lib/zstd/zstd_compress.ko 2024-09-05T01:04:59.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/mm 2024-09-05T01:04:59.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/mm/hwpoison-inject.ko 2024-09-05T01:04:59.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net 2024-09-05T01:04:59.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan 2024-09-05T01:04:59.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/6lowpan.ko 2024-09-05T01:04:59.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_dest.ko 2024-09-05T01:04:59.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_fragment.ko 2024-09-05T01:04:59.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_hop.ko 2024-09-05T01:04:59.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-05T01:04:59.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_mobility.ko 2024-09-05T01:04:59.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_routing.ko 2024-09-05T01:04:59.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/6lowpan/nhc_udp.ko 2024-09-05T01:04:59.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802 2024-09-05T01:04:59.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/garp.ko 2024-09-05T01:04:59.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/mrp.ko 2024-09-05T01:04:59.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/p8022.ko 2024-09-05T01:04:59.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/psnap.ko 2024-09-05T01:04:59.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/802/stp.ko 2024-09-05T01:04:59.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/8021q 2024-09-05T01:04:59.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/8021q/8021q.ko 2024-09-05T01:04:59.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p 2024-09-05T01:04:59.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/9pnet.ko 2024-09-05T01:04:59.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/9pnet_fd.ko 2024-09-05T01:04:59.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/9pnet_rdma.ko 2024-09-05T01:04:59.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/9p/9pnet_virtio.ko 2024-09-05T01:04:59.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/batman-adv 2024-09-05T01:04:59.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/batman-adv/batman-adv.ko 2024-09-05T01:04:59.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge 2024-09-05T01:04:59.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/br_netfilter.ko 2024-09-05T01:04:59.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/bridge.ko 2024-09-05T01:04:59.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter 2024-09-05T01:04:59.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-05T01:04:59.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-05T01:04:59.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-05T01:04:59.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-05T01:04:59.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-05T01:04:59.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-05T01:04:59.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-05T01:04:59.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-05T01:04:59.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-05T01:04:59.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-05T01:04:59.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-05T01:04:59.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-05T01:04:59.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-05T01:04:59.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-05T01:04:59.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-05T01:04:59.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-05T01:04:59.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-05T01:04:59.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-05T01:04:59.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-05T01:04:59.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-05T01:04:59.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/ebtables.ko 2024-09-05T01:04:59.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-05T01:04:59.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-05T01:04:59.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-05T01:04:59.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ceph 2024-09-05T01:04:59.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ceph/libceph.ko 2024-09-05T01:04:59.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/core 2024-09-05T01:04:59.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/core/failover.ko 2024-09-05T01:04:59.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/core/pktgen.ko 2024-09-05T01:04:59.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp 2024-09-05T01:04:59.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/dccp.ko 2024-09-05T01:04:59.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/dccp_diag.ko 2024-09-05T01:04:59.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/dccp_ipv4.ko 2024-09-05T01:04:59.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dccp/dccp_ipv6.ko 2024-09-05T01:04:59.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dns_resolver 2024-09-05T01:04:59.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dns_resolver/dns_resolver.ko 2024-09-05T01:04:59.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa 2024-09-05T01:04:59.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/dsa_core.ko 2024-09-05T01:04:59.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/tag_brcm.ko 2024-09-05T01:04:59.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/tag_dsa.ko 2024-09-05T01:04:59.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/tag_none.ko 2024-09-05T01:04:59.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/dsa/tag_trailer.ko 2024-09-05T01:04:59.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154 2024-09-05T01:04:59.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/6lowpan 2024-09-05T01:04:59.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-05T01:04:59.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/ieee802154.ko 2024-09-05T01:04:59.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-05T01:04:59.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4 2024-09-05T01:04:59.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ah4.ko 2024-09-05T01:04:59.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/esp4.ko 2024-09-05T01:04:59.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/fou.ko 2024-09-05T01:04:59.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/gre.ko 2024-09-05T01:04:59.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/inet_diag.ko 2024-09-05T01:04:59.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ip_gre.ko 2024-09-05T01:04:59.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ip_tunnel.ko 2024-09-05T01:04:59.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ip_vti.ko 2024-09-05T01:04:59.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ipcomp.ko 2024-09-05T01:04:59.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/ipip.ko 2024-09-05T01:04:59.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter 2024-09-05T01:04:59.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-05T01:04:59.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-05T01:04:59.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-05T01:04:59.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-05T01:04:59.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-05T01:04:59.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-05T01:04:59.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-05T01:04:59.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-05T01:04:59.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-05T01:04:59.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-05T01:04:59.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-05T01:04:59.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-05T01:04:59.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-05T01:04:59.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-05T01:04:59.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-05T01:04:59.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-05T01:04:59.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-05T01:04:59.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-05T01:04:59.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-05T01:04:59.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-05T01:04:59.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-05T01:04:59.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_bic.ko 2024-09-05T01:04:59.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_dctcp.ko 2024-09-05T01:04:59.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_diag.ko 2024-09-05T01:04:59.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_highspeed.ko 2024-09-05T01:04:59.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_htcp.ko 2024-09-05T01:04:59.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_hybla.ko 2024-09-05T01:04:59.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_illinois.ko 2024-09-05T01:04:59.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_lp.ko 2024-09-05T01:04:59.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_scalable.ko 2024-09-05T01:04:59.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_vegas.ko 2024-09-05T01:04:59.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_veno.ko 2024-09-05T01:04:59.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_westwood.ko 2024-09-05T01:04:59.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tcp_yeah.ko 2024-09-05T01:04:59.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/tunnel4.ko 2024-09-05T01:04:59.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/udp_diag.ko 2024-09-05T01:04:59.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/udp_tunnel.ko 2024-09-05T01:04:59.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-05T01:04:59.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6 2024-09-05T01:04:59.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ah6.ko 2024-09-05T01:04:59.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/esp6.ko 2024-09-05T01:04:59.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/fou6.ko 2024-09-05T01:04:59.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ip6_tunnel.ko 2024-09-05T01:04:59.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-05T01:04:59.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ip6_vti.ko 2024-09-05T01:04:59.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/ipcomp6.ko 2024-09-05T01:04:59.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter 2024-09-05T01:04:59.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-05T01:04:59.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-05T01:04:59.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-05T01:04:59.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-05T01:04:59.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-05T01:04:59.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-05T01:04:59.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-05T01:04:59.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-05T01:04:59.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-05T01:04:59.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-05T01:04:59.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-05T01:04:59.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-05T01:04:59.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-05T01:04:59.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-05T01:04:59.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-05T01:04:59.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-05T01:04:59.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-05T01:04:59.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-05T01:04:59.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-05T01:04:59.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-05T01:04:59.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-05T01:04:59.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-05T01:04:59.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-05T01:04:59.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-05T01:04:59.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/sit.ko 2024-09-05T01:04:59.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/tunnel6.ko 2024-09-05T01:04:59.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-05T01:04:59.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/key 2024-09-05T01:04:59.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/key/af_key.ko 2024-09-05T01:04:59.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp 2024-09-05T01:04:59.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_core.ko 2024-09-05T01:04:59.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-05T01:04:59.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_eth.ko 2024-09-05T01:04:59.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_ip.ko 2024-09-05T01:04:59.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_ip6.ko 2024-09-05T01:04:59.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_netlink.ko 2024-09-05T01:04:59.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/l2tp/l2tp_ppp.ko 2024-09-05T01:04:59.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/llc 2024-09-05T01:04:59.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/llc/llc.ko 2024-09-05T01:04:59.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/mac802154 2024-09-05T01:04:59.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/mac802154/mac802154.ko 2024-09-05T01:04:59.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/mpls 2024-09-05T01:04:59.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/mpls/mpls_gso.ko 2024-09-05T01:04:59.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter 2024-09-05T01:04:59.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset 2024-09-05T01:04:59.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set.ko 2024-09-05T01:04:59.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-05T01:04:59.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-05T01:04:59.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-05T01:04:59.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-05T01:04:59.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-05T01:04:59.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-05T01:04:59.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-05T01:04:59.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-05T01:04:59.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-05T01:04:59.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-05T01:04:59.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-05T01:04:59.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-05T01:04:59.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-05T01:04:59.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-05T01:04:59.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-05T01:04:59.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs 2024-09-05T01:04:59.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-05T01:04:59.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-05T01:04:59.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-05T01:04:59.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-05T01:04:59.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-05T01:04:59.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-05T01:04:59.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-05T01:04:59.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-05T01:04:59.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-05T01:04:59.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-05T01:04:59.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-05T01:04:59.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-05T01:04:59.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-05T01:04:59.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-05T01:04:59.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conncount.ko 2024-09-05T01:04:59.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack.ko 2024-09-05T01:04:59.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-05T01:04:59.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-05T01:04:59.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-05T01:04:59.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-05T01:04:59.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-05T01:04:59.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-05T01:04:59.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-05T01:04:59.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-05T01:04:59.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-05T01:04:59.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-05T01:04:59.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-05T01:04:59.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-05T01:04:59.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-05T01:04:59.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_flow_table.ko 2024-09-05T01:04:59.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-05T01:04:59.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_log_syslog.ko 2024-09-05T01:04:59.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat.ko 2024-09-05T01:04:59.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-05T01:04:59.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-05T01:04:59.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_irc.ko 2024-09-05T01:04:59.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_sip.ko 2024-09-05T01:04:59.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-05T01:04:59.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-05T01:04:59.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nf_tables.ko 2024-09-05T01:04:59.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink.ko 2024-09-05T01:04:59.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-05T01:04:59.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_log.ko 2024-09-05T01:04:59.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-05T01:04:59.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-05T01:04:59.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_chain_nat.ko 2024-09-05T01:04:59.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_compat.ko 2024-09-05T01:04:59.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_ct.ko 2024-09-05T01:04:59.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-05T01:04:59.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_fib.ko 2024-09-05T01:04:59.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-05T01:04:59.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_hash.ko 2024-09-05T01:04:59.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_limit.ko 2024-09-05T01:04:59.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_log.ko 2024-09-05T01:04:59.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_masq.ko 2024-09-05T01:04:59.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_nat.ko 2024-09-05T01:04:59.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_numgen.ko 2024-09-05T01:04:59.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_queue.ko 2024-09-05T01:04:59.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_quota.ko 2024-09-05T01:04:59.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_redir.ko 2024-09-05T01:04:59.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_reject.ko 2024-09-05T01:04:59.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_reject_inet.ko 2024-09-05T01:04:59.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_socket.ko 2024-09-05T01:04:59.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/nft_tunnel.ko 2024-09-05T01:04:59.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_AUDIT.ko 2024-09-05T01:04:59.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-05T01:04:59.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-05T01:04:59.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-05T01:04:59.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_CT.ko 2024-09-05T01:04:59.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_DSCP.ko 2024-09-05T01:04:59.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_HL.ko 2024-09-05T01:04:59.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_HMARK.ko 2024-09-05T01:04:59.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-05T01:04:59.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_LED.ko 2024-09-05T01:04:59.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_LOG.ko 2024-09-05T01:04:59.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-05T01:04:59.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_NETMAP.ko 2024-09-05T01:04:59.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_NFLOG.ko 2024-09-05T01:04:59.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-05T01:04:59.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_RATEEST.ko 2024-09-05T01:04:59.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-05T01:04:59.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_SECMARK.ko 2024-09-05T01:04:59.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-05T01:04:59.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-05T01:04:59.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TEE.ko 2024-09-05T01:04:59.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TPROXY.ko 2024-09-05T01:04:59.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_TRACE.ko 2024-09-05T01:04:59.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_addrtype.ko 2024-09-05T01:04:59.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_bpf.ko 2024-09-05T01:04:59.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_cgroup.ko 2024-09-05T01:04:59.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_cluster.ko 2024-09-05T01:04:59.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_comment.ko 2024-09-05T01:04:59.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_connbytes.ko 2024-09-05T01:04:59.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_connlabel.ko 2024-09-05T01:04:59.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_connlimit.ko 2024-09-05T01:04:59.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_connmark.ko 2024-09-05T01:04:59.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_conntrack.ko 2024-09-05T01:04:59.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_cpu.ko 2024-09-05T01:04:59.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_dccp.ko 2024-09-05T01:04:59.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_devgroup.ko 2024-09-05T01:04:59.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_dscp.ko 2024-09-05T01:04:59.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_ecn.ko 2024-09-05T01:04:59.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_esp.ko 2024-09-05T01:04:59.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_hashlimit.ko 2024-09-05T01:04:59.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_helper.ko 2024-09-05T01:04:59.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_hl.ko 2024-09-05T01:04:59.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_ipcomp.ko 2024-09-05T01:04:59.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_iprange.ko 2024-09-05T01:04:59.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_ipvs.ko 2024-09-05T01:04:59.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_l2tp.ko 2024-09-05T01:04:59.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_length.ko 2024-09-05T01:04:59.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_limit.ko 2024-09-05T01:04:59.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_mac.ko 2024-09-05T01:04:59.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_mark.ko 2024-09-05T01:04:59.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_multiport.ko 2024-09-05T01:04:59.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_nat.ko 2024-09-05T01:04:59.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_nfacct.ko 2024-09-05T01:04:59.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_osf.ko 2024-09-05T01:04:59.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_owner.ko 2024-09-05T01:04:59.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_physdev.ko 2024-09-05T01:04:59.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_pkttype.ko 2024-09-05T01:04:59.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_policy.ko 2024-09-05T01:04:59.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_quota.ko 2024-09-05T01:04:59.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_rateest.ko 2024-09-05T01:04:59.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_realm.ko 2024-09-05T01:04:59.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_recent.ko 2024-09-05T01:04:59.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_sctp.ko 2024-09-05T01:04:59.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_set.ko 2024-09-05T01:04:59.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_socket.ko 2024-09-05T01:04:59.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_state.ko 2024-09-05T01:04:59.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_statistic.ko 2024-09-05T01:04:59.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_string.ko 2024-09-05T01:04:59.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_tcpmss.ko 2024-09-05T01:04:59.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_time.ko 2024-09-05T01:04:59.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netfilter/xt_u32.ko 2024-09-05T01:04:59.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netlink 2024-09-05T01:04:59.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/netlink/netlink_diag.ko 2024-09-05T01:04:59.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/nsh 2024-09-05T01:04:59.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/nsh/nsh.ko 2024-09-05T01:04:59.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch 2024-09-05T01:04:59.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/openvswitch.ko 2024-09-05T01:04:59.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/vport-geneve.ko 2024-09-05T01:04:59.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/vport-gre.ko 2024-09-05T01:04:59.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/openvswitch/vport-vxlan.ko 2024-09-05T01:04:59.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/packet 2024-09-05T01:04:59.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/packet/af_packet_diag.ko 2024-09-05T01:04:59.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rds 2024-09-05T01:04:59.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rds/rds.ko 2024-09-05T01:04:59.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rds/rds_rdma.ko 2024-09-05T01:04:59.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/rds/rds_tcp.ko 2024-09-05T01:04:59.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched 2024-09-05T01:04:59.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_csum.ko 2024-09-05T01:04:59.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_gact.ko 2024-09-05T01:04:59.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_mirred.ko 2024-09-05T01:04:59.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_nat.ko 2024-09-05T01:04:59.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_pedit.ko 2024-09-05T01:04:59.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_police.ko 2024-09-05T01:04:59.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_simple.ko 2024-09-05T01:04:59.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_skbedit.ko 2024-09-05T01:04:59.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/act_vlan.ko 2024-09-05T01:04:59.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_basic.ko 2024-09-05T01:04:59.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_bpf.ko 2024-09-05T01:04:59.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_flow.ko 2024-09-05T01:04:59.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_fw.ko 2024-09-05T01:04:59.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_route.ko 2024-09-05T01:04:59.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/cls_u32.ko 2024-09-05T01:04:59.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_cmp.ko 2024-09-05T01:04:59.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_ipset.ko 2024-09-05T01:04:59.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_meta.ko 2024-09-05T01:04:59.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_nbyte.ko 2024-09-05T01:04:59.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_text.ko 2024-09-05T01:04:59.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/em_u32.ko 2024-09-05T01:04:59.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_choke.ko 2024-09-05T01:04:59.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_codel.ko 2024-09-05T01:04:59.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_drr.ko 2024-09-05T01:04:59.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_fq.ko 2024-09-05T01:04:59.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_gred.ko 2024-09-05T01:04:59.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_hfsc.ko 2024-09-05T01:04:59.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_hhf.ko 2024-09-05T01:04:59.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_htb.ko 2024-09-05T01:04:59.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_ingress.ko 2024-09-05T01:04:59.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_mqprio.ko 2024-09-05T01:04:59.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_mqprio_lib.ko 2024-09-05T01:04:59.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_multiq.ko 2024-09-05T01:04:59.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_netem.ko 2024-09-05T01:04:59.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_pie.ko 2024-09-05T01:04:59.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_plug.ko 2024-09-05T01:04:59.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_prio.ko 2024-09-05T01:04:59.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_qfq.ko 2024-09-05T01:04:59.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_red.ko 2024-09-05T01:04:59.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_sfb.ko 2024-09-05T01:04:59.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_sfq.ko 2024-09-05T01:04:59.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_tbf.ko 2024-09-05T01:04:59.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sched/sch_teql.ko 2024-09-05T01:04:59.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sctp 2024-09-05T01:04:59.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sctp/sctp.ko 2024-09-05T01:04:59.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sctp/sctp_diag.ko 2024-09-05T01:04:59.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc 2024-09-05T01:04:59.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/auth_gss 2024-09-05T01:04:59.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-05T01:04:59.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-05T01:04:59.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/sunrpc.ko 2024-09-05T01:04:59.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/xprtrdma 2024-09-05T01:04:59.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-05T01:04:59.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/tipc 2024-09-05T01:04:59.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/tipc/tipc.ko 2024-09-05T01:04:59.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/tipc/tipc_diag.ko 2024-09-05T01:04:59.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/unix 2024-09-05T01:04:59.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/unix/unix_diag.ko 2024-09-05T01:04:59.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock 2024-09-05T01:04:59.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-05T01:04:59.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-05T01:04:59.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vsock.ko 2024-09-05T01:04:59.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-05T01:04:59.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-05T01:04:59.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/xfrm 2024-09-05T01:04:59.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-05T01:04:59.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/security 2024-09-05T01:04:59.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/security/keys 2024-09-05T01:04:59.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/security/keys/encrypted-keys 2024-09-05T01:04:59.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-05T01:04:59.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/security/keys/trusted-keys 2024-09-05T01:04:59.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/kernel/security/keys/trusted-keys/trusted.ko 2024-09-05T01:04:59.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.alias 2024-09-05T01:04:59.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.alias.bin 2024-09-05T01:04:59.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.builtin 2024-09-05T01:04:59.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.builtin.alias.bin 2024-09-05T01:04:59.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.builtin.bin 2024-09-05T01:04:59.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.builtin.modinfo 2024-09-05T01:04:59.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.dep 2024-09-05T01:04:59.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.dep.bin 2024-09-05T01:04:59.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.devname 2024-09-05T01:04:59.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.order 2024-09-05T01:04:59.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.softdep 2024-09-05T01:04:59.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.symbols 2024-09-05T01:04:59.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.symbols.bin 2024-09-05T01:04:59.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.weakdep 2024-09-05T01:04:59.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.11.0-rc5-g8ad8b8b16098/vmlinuz 2024-09-05T01:04:59.596 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g8ad8b8b16098 2024-09-05T01:04:59.596 DEBUG:teuthology.orchestra.run.smithi012:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-05T01:04:59.620 INFO:teuthology.orchestra.run.smithi012.stdout:postinstall scriptlet (using /bin/sh): 2024-09-05T01:04:59.620 INFO:teuthology.orchestra.run.smithi012.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-05T01:04:59.620 INFO:teuthology.orchestra.run.smithi012.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g8ad8b8b16098 /lib/modules/6.11.0-rc5-g8ad8b8b16098/vmlinuz 2024-09-05T01:04:59.620 INFO:teuthology.orchestra.run.smithi012.stdout:fi 2024-09-05T01:04:59.620 INFO:teuthology.orchestra.run.smithi012.stdout:for file in vmlinuz System.map config; do 2024-09-05T01:04:59.620 INFO:teuthology.orchestra.run.smithi012.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g8ad8b8b16098/${file}" "/boot/${file}-6.11.0-rc5-g8ad8b8b16098"; then 2024-09-05T01:04:59.620 INFO:teuthology.orchestra.run.smithi012.stdout: cp "/lib/modules/6.11.0-rc5-g8ad8b8b16098/${file}" "/boot/${file}-6.11.0-rc5-g8ad8b8b16098" 2024-09-05T01:04:59.620 INFO:teuthology.orchestra.run.smithi012.stdout: fi 2024-09-05T01:04:59.620 INFO:teuthology.orchestra.run.smithi012.stdout:done 2024-09-05T01:04:59.620 INFO:teuthology.orchestra.run.smithi012.stdout:if [ -d "/lib/modules/6.11.0-rc5-g8ad8b8b16098/dtb" ] && \ 2024-09-05T01:04:59.621 INFO:teuthology.orchestra.run.smithi012.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g8ad8b8b16098/dtb" "/boot/dtb-6.11.0-rc5-g8ad8b8b16098" >/dev/null 2>&1; then 2024-09-05T01:04:59.621 INFO:teuthology.orchestra.run.smithi012.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g8ad8b8b16098" 2024-09-05T01:04:59.621 INFO:teuthology.orchestra.run.smithi012.stdout: cp -r "/lib/modules/6.11.0-rc5-g8ad8b8b16098/dtb" "/boot/dtb-6.11.0-rc5-g8ad8b8b16098" 2024-09-05T01:04:59.621 INFO:teuthology.orchestra.run.smithi012.stdout:fi 2024-09-05T01:04:59.621 INFO:teuthology.orchestra.run.smithi012.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g8ad8b8b16098/modules.dep" ]; then 2024-09-05T01:04:59.621 INFO:teuthology.orchestra.run.smithi012.stdout: /usr/sbin/depmod 6.11.0-rc5-g8ad8b8b16098 2024-09-05T01:04:59.621 INFO:teuthology.orchestra.run.smithi012.stdout:fi 2024-09-05T01:04:59.621 INFO:teuthology.orchestra.run.smithi012.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-05T01:04:59.621 INFO:teuthology.orchestra.run.smithi012.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-05T01:04:59.621 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-install remove 6.11.0-rc5-g8ad8b8b16098 2024-09-05T01:04:59.621 INFO:teuthology.orchestra.run.smithi012.stdout:fi 2024-09-05T01:04:59.622 DEBUG:teuthology.orchestra.run.smithi012:> sudo rpm -qi grub2-tools 2024-09-05T01:04:59.698 INFO:teuthology.orchestra.run.smithi012.stdout:Name : grub2-tools 2024-09-05T01:04:59.698 INFO:teuthology.orchestra.run.smithi012.stdout:Epoch : 1 2024-09-05T01:04:59.698 INFO:teuthology.orchestra.run.smithi012.stdout:Version : 2.06 2024-09-05T01:04:59.698 INFO:teuthology.orchestra.run.smithi012.stdout:Release : 82.el9 2024-09-05T01:04:59.699 INFO:teuthology.orchestra.run.smithi012.stdout:Architecture: x86_64 2024-09-05T01:04:59.699 INFO:teuthology.orchestra.run.smithi012.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-05T01:04:59.699 INFO:teuthology.orchestra.run.smithi012.stdout:Group : Unspecified 2024-09-05T01:04:59.699 INFO:teuthology.orchestra.run.smithi012.stdout:Size : 8274670 2024-09-05T01:04:59.699 INFO:teuthology.orchestra.run.smithi012.stdout:License : GPLv3+ 2024-09-05T01:04:59.699 INFO:teuthology.orchestra.run.smithi012.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-05T01:04:59.699 INFO:teuthology.orchestra.run.smithi012.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-05T01:04:59.699 INFO:teuthology.orchestra.run.smithi012.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-05T01:04:59.699 INFO:teuthology.orchestra.run.smithi012.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-05T01:04:59.699 INFO:teuthology.orchestra.run.smithi012.stdout:Packager : builder@centos.org 2024-09-05T01:04:59.699 INFO:teuthology.orchestra.run.smithi012.stdout:Vendor : CentOS 2024-09-05T01:04:59.699 INFO:teuthology.orchestra.run.smithi012.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-05T01:04:59.700 INFO:teuthology.orchestra.run.smithi012.stdout:Summary : Support tools for GRUB. 2024-09-05T01:04:59.700 INFO:teuthology.orchestra.run.smithi012.stdout:Description : 2024-09-05T01:04:59.700 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:04:59.700 INFO:teuthology.orchestra.run.smithi012.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-05T01:04:59.700 INFO:teuthology.orchestra.run.smithi012.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-05T01:04:59.700 INFO:teuthology.orchestra.run.smithi012.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-05T01:04:59.700 INFO:teuthology.orchestra.run.smithi012.stdout:hardware devices. 2024-09-05T01:04:59.700 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:04:59.700 INFO:teuthology.orchestra.run.smithi012.stdout:This subpackage provides tools for support of all platforms. 2024-09-05T01:04:59.701 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-05T01:04:59.701 INFO:teuthology.task.kernel:Updating grub on smithi012 to boot 6.11.0-rc5-g8ad8b8b16098 2024-09-05T01:04:59.702 DEBUG:teuthology.orchestra.run.smithi012:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-05T01:05:00.305 INFO:teuthology.orchestra.run.smithi012.stderr:Generating grub configuration file ... 2024-09-05T01:05:01.672 INFO:teuthology.orchestra.run.smithi012.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-05T01:05:01.686 INFO:teuthology.orchestra.run.smithi012.stderr:done 2024-09-05T01:05:01.698 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2024-09-05T01:05:01.713 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.NfS83bE5rm 2024-09-05T01:05:01.714 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NfS83bE5rm 2024-09-05T01:05:01.781 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.NfS83bE5rm 2024-09-05T01:05:01.924 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.NfS83bE5rm is 6KB 2024-09-05T01:05:01.974 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.NfS83bE5rm 2024-09-05T01:05:01.988 DEBUG:teuthology.orchestra.run.smithi012:> sudo /bin/ls /boot/loader/entries || true 2024-09-05T01:05:02.050 INFO:teuthology.orchestra.run.smithi012.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-05T01:05:02.050 INFO:teuthology.orchestra.run.smithi012.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-05T01:05:02.050 INFO:teuthology.orchestra.run.smithi012.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-05T01:05:02.050 INFO:teuthology.orchestra.run.smithi012.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g8ad8b8b16098.conf 2024-09-05T01:05:02.052 DEBUG:teuthology.orchestra.run.smithi012:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g8ad8b8b16098 2024-09-05T01:05:02.224 DEBUG:teuthology.orchestra.run.smithi012:> sudo shutdown -r now 2024-09-05T01:05:32.227 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-05T01:05:32.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-05T01:05:32.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T01:05:50.653 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-09-05T01:05:59.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-05T01:05:59.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T01:06:18.049 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-09-05T01:06:30.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-05T01:06:30.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T01:06:33.117 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-09-05T01:06:48.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-05T01:06:48.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T01:06:48.567 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-09-05T01:06:49.110 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-05T01:06:49.110 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g8ad8b8b16098"... 2024-09-05T01:06:49.110 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2024-09-05T01:06:49.191 INFO:teuthology.orchestra.run.smithi012.stdout:6.11.0-rc5-g8ad8b8b16098 2024-09-05T01:06:49.192 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g8ad8b8b16098 vs 6.11.0-rc5-g8ad8b8b16098 2024-09-05T01:06:49.192 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-05T01:06:49.192 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-05T01:06:50.193 DEBUG:teuthology.parallel:result is None 2024-09-05T01:06:50.193 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-05T01:06:50.200 INFO:teuthology.task.internal:Creating test directory... 2024-09-05T01:06:50.200 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-05T01:06:50.214 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-05T01:06:50.216 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-05T01:06:50.275 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-05T01:06:50.281 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-05T01:06:50.305 INFO:teuthology.task.internal:Creating archive directory... 2024-09-05T01:06:50.305 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-05T01:06:50.313 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-05T01:06:50.317 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-05T01:06:50.435 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-05T01:06:50.442 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-05T01:06:50.442 DEBUG:teuthology.orchestra.run.smithi145:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-05T01:06:50.459 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T01:06:50.460 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-05T01:06:50.476 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T01:06:50.477 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-05T01:06:50.486 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-05T01:06:50.502 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-05T01:06:50.536 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T01:06:50.556 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T01:06:50.579 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T01:06:50.596 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T01:06:50.695 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T01:06:50.757 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-05T01:06:50.766 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-05T01:06:50.774 INFO:teuthology.task.internal:Configuring sudo... 2024-09-05T01:06:50.774 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-05T01:06:50.782 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-05T01:06:50.785 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-05T01:06:50.899 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-05T01:06:50.908 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-05T01:06:50.909 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-05T01:06:50.921 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-05T01:06:50.924 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-05T01:06:50.984 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T01:06:51.090 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T01:06:51.148 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T01:06:51.211 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T01:06:51.283 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-05T01:06:51.283 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-05T01:06:51.341 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T01:06:51.386 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T01:06:51.440 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T01:06:51.526 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T01:06:51.568 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-05T01:06:51.568 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-05T01:06:51.635 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T01:06:51.681 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-05T01:06:51.732 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T01:06:51.818 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-05T01:06:51.861 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-05T01:06:51.861 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-05T01:06:51.930 DEBUG:teuthology.orchestra.run.smithi012:> sudo service rsyslog restart 2024-09-05T01:06:51.934 DEBUG:teuthology.orchestra.run.smithi145:> sudo service rsyslog restart 2024-09-05T01:06:51.936 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2024-09-05T01:06:51.971 INFO:teuthology.orchestra.run.smithi145.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-05T01:06:52.013 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-05T01:06:52.020 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-05T01:06:52.393 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-05T01:06:52.400 INFO:teuthology.task.internal:Starting timer... 2024-09-05T01:06:52.400 INFO:teuthology.run_tasks:Running task pcp... 2024-09-05T01:06:52.441 INFO:teuthology.run_tasks:Running task selinux... 2024-09-05T01:06:52.473 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-05T01:06:52.473 DEBUG:teuthology.orchestra.run.smithi012:> sudo service auditd rotate 2024-09-05T01:06:52.649 INFO:teuthology.orchestra.run.smithi012.stdout:Rotating logs: 2024-09-05T01:06:52.653 DEBUG:teuthology.orchestra.run.smithi145:> sudo service auditd rotate 2024-09-05T01:06:52.758 INFO:teuthology.orchestra.run.smithi145.stdout:Rotating logs: 2024-09-05T01:06:52.760 DEBUG:teuthology.orchestra.run.smithi151:> sudo service auditd rotate 2024-09-05T01:06:52.818 INFO:teuthology.orchestra.run.smithi151.stdout:Rotating logs: 2024-09-05T01:06:52.820 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-05T01:06:52.820 DEBUG:teuthology.orchestra.run.smithi012:> /usr/sbin/getenforce 2024-09-05T01:06:52.881 INFO:teuthology.orchestra.run.smithi012.stdout:Permissive 2024-09-05T01:06:52.881 DEBUG:teuthology.orchestra.run.smithi145:> /usr/sbin/getenforce 2024-09-05T01:06:52.905 INFO:teuthology.orchestra.run.smithi145.stdout:Permissive 2024-09-05T01:06:52.905 DEBUG:teuthology.orchestra.run.smithi151:> /usr/sbin/getenforce 2024-09-05T01:06:52.933 INFO:teuthology.orchestra.run.smithi151.stdout:Permissive 2024-09-05T01:06:52.933 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi012.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi145.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi151.front.sepia.ceph.com': 'permissive'} 2024-09-05T01:06:52.933 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-05T01:06:52.991 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T01:06:52.992 DEBUG:teuthology.orchestra.run.smithi145:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-05T01:06:53.022 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T01:06:53.022 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-05T01:06:53.051 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T01:06:53.052 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-05T01:06:53.052 DEBUG:teuthology.orchestra.run.smithi012:> sudo /usr/sbin/setenforce permissive 2024-09-05T01:06:53.164 DEBUG:teuthology.orchestra.run.smithi145:> sudo /usr/sbin/setenforce permissive 2024-09-05T01:06:53.197 DEBUG:teuthology.orchestra.run.smithi151:> sudo /usr/sbin/setenforce permissive 2024-09-05T01:06:53.230 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-05T01:06:53.240 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-05T01:06:53.254 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-05T01:06:53.255 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi012.front.sepia.ceph.com,smithi145.front.sepia.ceph.com,smithi151.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-05T01:11:31.094 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi012.front.sepia.ceph.com'), Remote(name='ubuntu@smithi145.front.sepia.ceph.com'), Remote(name='ubuntu@smithi151.front.sepia.ceph.com')] 2024-09-05T01:11:31.095 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-05T01:11:31.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T01:11:31.199 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-09-05T01:11:31.308 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-05T01:11:31.308 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-05T01:11:31.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T01:11:31.386 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-09-05T01:11:31.469 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-05T01:11:31.469 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-05T01:11:31.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-05T01:11:31.550 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-09-05T01:11:31.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-05T01:11:31.643 INFO:teuthology.run_tasks:Running task clock... 2024-09-05T01:11:31.657 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-05T01:11:31.657 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-05T01:11:31.658 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T01:11:31.662 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-05T01:11:31.662 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T01:11:31.665 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-05T01:11:31.665 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T01:11:31.693 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-05T01:11:31.708 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-05T01:11:31.716 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-05T01:11:31.720 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-05T01:11:31.731 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-05T01:11:31.733 INFO:teuthology.orchestra.run.smithi145.stderr:sudo: ntpd: command not found 2024-09-05T01:11:31.744 INFO:teuthology.orchestra.run.smithi145.stdout:506 Cannot talk to daemon 2024-09-05T01:11:31.749 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-05T01:11:31.756 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: ntpd: command not found 2024-09-05T01:11:31.758 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-05T01:11:31.768 INFO:teuthology.orchestra.run.smithi151.stdout:506 Cannot talk to daemon 2024-09-05T01:11:31.772 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-05T01:11:31.782 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-05T01:11:31.796 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-05T01:11:31.801 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: ntpd: command not found 2024-09-05T01:11:31.825 INFO:teuthology.orchestra.run.smithi012.stdout:506 Cannot talk to daemon 2024-09-05T01:11:31.826 INFO:teuthology.orchestra.run.smithi145.stderr:bash: line 1: ntpq: command not found 2024-09-05T01:11:31.829 INFO:teuthology.orchestra.run.smithi145.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-05T01:11:31.830 INFO:teuthology.orchestra.run.smithi145.stdout:=============================================================================== 2024-09-05T01:11:31.830 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T01:11:31.830 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T01:11:31.830 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T01:11:31.830 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T01:11:31.854 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-05T01:11:31.855 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 1: ntpq: command not found 2024-09-05T01:11:31.858 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-05T01:11:31.858 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2024-09-05T01:11:31.858 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T01:11:31.858 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T01:11:31.858 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T01:11:31.858 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T01:11:31.883 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-05T01:11:31.980 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2024-09-05T01:11:31.987 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-05T01:11:31.987 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2024-09-05T01:11:31.987 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T01:11:31.987 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T01:11:31.987 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T01:11:31.987 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T01:11:31.988 INFO:teuthology.run_tasks:Running task install... 2024-09-05T01:11:31.996 DEBUG:teuthology.task.install:project ceph 2024-09-05T01:11:31.996 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4'}} 2024-09-05T01:11:31.996 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4'} 2024-09-05T01:11:31.996 INFO:teuthology.task.install:Using flavor: default 2024-09-05T01:11:32.002 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-05T01:11:32.002 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-05T01:11:32.002 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4', 'tag': None, 'wait_for_package': False} 2024-09-05T01:11:32.003 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T01:11:32.005 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4', 'tag': None, 'wait_for_package': False} 2024-09-05T01:11:32.005 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T01:11:32.006 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4', 'tag': None, 'wait_for_package': False} 2024-09-05T01:11:32.006 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T01:11:32.147 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/ 2024-09-05T01:11:32.147 INFO:teuthology.task.install.rpm:Package version is 19.1.1-259.g91c8a7e5 2024-09-05T01:11:32.160 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/ 2024-09-05T01:11:32.160 INFO:teuthology.task.install.rpm:Package version is 19.1.1-259.g91c8a7e5 2024-09-05T01:11:32.164 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/ 2024-09-05T01:11:32.164 INFO:teuthology.task.install.rpm:Package version is 19.1.1-259.g91c8a7e5 2024-09-05T01:11:32.260 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-05T01:11:32.261 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-05T01:11:32.261 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-05T01:11:32.269 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-05T01:11:32.270 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-05T01:11:32.270 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-05T01:11:32.280 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-05T01:11:32.280 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-05T01:11:32.281 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-05T01:11:32.296 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-05T01:11:32.296 DEBUG:teuthology.orchestra.run.smithi151:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-05T01:11:32.306 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-05T01:11:32.306 DEBUG:teuthology.orchestra.run.smithi145:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-05T01:11:32.317 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-05T01:11:32.317 DEBUG:teuthology.orchestra.run.smithi012:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-05T01:11:32.362 DEBUG:teuthology.orchestra.run.smithi151:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-05T01:11:32.372 DEBUG:teuthology.orchestra.run.smithi145:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-05T01:11:32.415 DEBUG:teuthology.orchestra.run.smithi012:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-05T01:11:32.438 DEBUG:teuthology.orchestra.run.smithi151:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-05T01:11:32.447 DEBUG:teuthology.orchestra.run.smithi145:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-05T01:11:32.493 DEBUG:teuthology.orchestra.run.smithi012:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-05T01:11:32.502 INFO:teuthology.orchestra.run.smithi151.stdout:check_obsoletes = 1 2024-09-05T01:11:32.504 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum clean all 2024-09-05T01:11:32.511 INFO:teuthology.orchestra.run.smithi145.stdout:check_obsoletes = 1 2024-09-05T01:11:32.512 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum clean all 2024-09-05T01:11:32.548 INFO:teuthology.orchestra.run.smithi012.stdout:check_obsoletes = 1 2024-09-05T01:11:32.551 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum clean all 2024-09-05T01:11:32.732 INFO:teuthology.orchestra.run.smithi151.stdout:45 files removed 2024-09-05T01:11:32.736 INFO:teuthology.orchestra.run.smithi145.stdout:45 files removed 2024-09-05T01:11:32.760 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-05T01:11:32.764 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-05T01:11:32.835 INFO:teuthology.orchestra.run.smithi012.stdout:45 files removed 2024-09-05T01:11:32.868 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-05T01:11:33.311 INFO:teuthology.orchestra.run.smithi145.stdout:ceph packages for x86_64 313 kB/s | 84 kB 00:00 2024-09-05T01:11:33.317 INFO:teuthology.orchestra.run.smithi151.stdout:ceph packages for x86_64 302 kB/s | 84 kB 00:00 2024-09-05T01:11:33.577 INFO:teuthology.orchestra.run.smithi012.stdout:ceph packages for x86_64 299 kB/s | 84 kB 00:00 2024-09-05T01:11:33.595 INFO:teuthology.orchestra.run.smithi145.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-05T01:11:33.601 INFO:teuthology.orchestra.run.smithi151.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-05T01:11:33.869 INFO:teuthology.orchestra.run.smithi151.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-05T01:11:33.870 INFO:teuthology.orchestra.run.smithi145.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-05T01:11:33.878 INFO:teuthology.orchestra.run.smithi012.stdout:ceph noarch packages 46 kB/s | 12 kB 00:00 2024-09-05T01:11:34.179 INFO:teuthology.orchestra.run.smithi012.stdout:ceph source packages 7.2 kB/s | 1.9 kB 00:00 2024-09-05T01:11:34.462 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-05T01:11:35.136 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - BaseOS 6.7 MB/s | 8.2 MB 00:01 2024-09-05T01:11:35.895 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.2 MB 00:01 2024-09-05T01:11:36.238 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-05T01:11:36.871 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-05T01:11:39.233 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 20 MB 00:02 2024-09-05T01:11:43.055 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.5 MB 00:02 2024-09-05T01:11:43.705 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - CRB 1.8 MB/s | 6.5 MB 00:03 2024-09-05T01:11:44.080 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - CRB 9.7 MB/s | 6.5 MB 00:00 2024-09-05T01:11:44.615 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 19 kB 00:00 2024-09-05T01:11:45.314 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 19 kB 00:00 2024-09-05T01:11:45.394 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-05T01:11:45.689 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 19 kB 00:00 2024-09-05T01:11:46.193 INFO:teuthology.orchestra.run.smithi145.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-05T01:11:46.668 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-05T01:11:50.800 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-05T01:11:51.607 INFO:teuthology.orchestra.run.smithi145.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-05T01:11:53.038 INFO:teuthology.orchestra.run.smithi151.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-05T01:11:53.039 INFO:teuthology.orchestra.run.smithi151.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-05T01:11:53.052 INFO:teuthology.orchestra.run.smithi151.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-05T01:11:53.053 INFO:teuthology.orchestra.run.smithi151.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-05T01:11:53.055 INFO:teuthology.orchestra.run.smithi151.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-05T01:11:53.056 INFO:teuthology.orchestra.run.smithi151.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-05T01:11:53.057 INFO:teuthology.orchestra.run.smithi151.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-05T01:11:53.060 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-05T01:11:53.061 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-05T01:11:53.123 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-09-05T01:11:53.139 INFO:teuthology.orchestra.run.smithi151.stdout:====================================================================================== 2024-09-05T01:11:53.139 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-09-05T01:11:53.139 INFO:teuthology.orchestra.run.smithi151.stdout:====================================================================================== 2024-09-05T01:11:53.140 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-09-05T01:11:53.140 INFO:teuthology.orchestra.run.smithi151.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-05T01:11:53.140 INFO:teuthology.orchestra.run.smithi151.stdout: ceph x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 6.6 k 2024-09-05T01:11:53.140 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 5.4 M 2024-09-05T01:11:53.140 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 896 k 2024-09-05T01:11:53.140 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 145 k 2024-09-05T01:11:53.140 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 1.5 M 2024-09-05T01:11:53.140 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 146 k 2024-09-05T01:11:53.140 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 3.6 M 2024-09-05T01:11:53.140 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 7.4 M 2024-09-05T01:11:53.140 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 49 k 2024-09-05T01:11:53.141 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 11 M 2024-09-05T01:11:53.141 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 49 M 2024-09-05T01:11:53.141 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 285 k 2024-09-05T01:11:53.141 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 765 k 2024-09-05T01:11:53.141 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 224 k 2024-09-05T01:11:53.141 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-shell x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 27 k 2024-09-05T01:11:53.141 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 18 k 2024-09-05T01:11:53.141 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-05T01:11:53.141 INFO:teuthology.orchestra.run.smithi151.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-05T01:11:53.141 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-05T01:11:53.141 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 32 k 2024-09-05T01:11:53.141 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 752 k 2024-09-05T01:11:53.141 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 127 k 2024-09-05T01:11:53.141 INFO:teuthology.orchestra.run.smithi151.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-05T01:11:53.142 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-05T01:11:53.142 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-09-05T01:11:53.142 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-05T01:11:53.142 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-05T01:11:53.142 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-05T01:11:53.142 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 162 k 2024-09-05T01:11:53.142 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 321 k 2024-09-05T01:11:53.142 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 301 k 2024-09-05T01:11:53.142 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 99 k 2024-09-05T01:11:53.142 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 85 k 2024-09-05T01:11:53.142 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 3.1 M 2024-09-05T01:11:53.142 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 170 k 2024-09-05T01:11:53.142 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-05T01:11:53.143 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2024-09-05T01:11:53.143 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager x86_64 1:1.48.10-1.el9 baseos 2.3 M 2024-09-05T01:11:53.143 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-libnm x86_64 1:1.48.10-1.el9 baseos 1.8 M 2024-09-05T01:11:53.143 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-team x86_64 1:1.48.10-1.el9 baseos 40 k 2024-09-05T01:11:53.143 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-tui x86_64 1:1.48.10-1.el9 baseos 248 k 2024-09-05T01:11:53.143 INFO:teuthology.orchestra.run.smithi151.stdout: librados2 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 3.4 M 2024-09-05T01:11:53.143 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 3.2 M 2024-09-05T01:11:53.143 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2024-09-05T01:11:53.143 INFO:teuthology.orchestra.run.smithi151.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-05T01:11:53.143 INFO:teuthology.orchestra.run.smithi151.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-05T01:11:53.143 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-05T01:11:53.143 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 21 M 2024-09-05T01:11:53.143 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 32 k 2024-09-05T01:11:53.144 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 2.4 M 2024-09-05T01:11:53.144 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 249 k 2024-09-05T01:11:53.144 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 4.7 M 2024-09-05T01:11:53.144 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 17 M 2024-09-05T01:11:53.144 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 16 k 2024-09-05T01:11:53.144 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 25 k 2024-09-05T01:11:53.144 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-05T01:11:53.144 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-05T01:11:53.144 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-05T01:11:53.144 INFO:teuthology.orchestra.run.smithi151.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-05T01:11:53.144 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-05T01:11:53.144 INFO:teuthology.orchestra.run.smithi151.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-05T01:11:53.144 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-05T01:11:53.145 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-05T01:11:53.145 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 163 k 2024-09-05T01:11:53.145 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-05T01:11:53.145 INFO:teuthology.orchestra.run.smithi151.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-05T01:11:53.145 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-05T01:11:53.145 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-05T01:11:53.145 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-05T01:11:53.145 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 506 k 2024-09-05T01:11:53.145 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-05T01:11:53.145 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 5.3 M 2024-09-05T01:11:53.145 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-05T01:11:53.145 INFO:teuthology.orchestra.run.smithi151.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-05T01:11:53.146 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-05T01:11:53.146 INFO:teuthology.orchestra.run.smithi151.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-05T01:11:53.146 INFO:teuthology.orchestra.run.smithi151.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-05T01:11:53.146 INFO:teuthology.orchestra.run.smithi151.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-05T01:11:53.146 INFO:teuthology.orchestra.run.smithi151.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-05T01:11:53.146 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-05T01:11:53.146 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-05T01:11:53.146 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-05T01:11:53.146 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-05T01:11:53.146 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-05T01:11:53.146 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-05T01:11:53.146 INFO:teuthology.orchestra.run.smithi151.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-05T01:11:53.146 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-05T01:11:53.146 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-05T01:11:53.147 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-05T01:11:53.147 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 45 k 2024-09-05T01:11:53.147 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 136 k 2024-09-05T01:11:53.147 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-05T01:11:53.147 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-05T01:11:53.147 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-05T01:11:53.147 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-05T01:11:53.147 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-05T01:11:53.147 INFO:teuthology.orchestra.run.smithi151.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-05T01:11:53.147 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-05T01:11:53.147 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-05T01:11:53.147 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-05T01:11:53.147 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-05T01:11:53.147 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-05T01:11:53.148 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-05T01:11:53.148 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-05T01:11:53.148 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-05T01:11:53.148 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-05T01:11:53.148 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-05T01:11:53.148 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-05T01:11:53.148 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-05T01:11:53.148 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-05T01:11:53.148 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-05T01:11:53.148 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-05T01:11:53.148 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-05T01:11:53.148 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-05T01:11:53.148 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-05T01:11:53.149 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-05T01:11:53.149 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-05T01:11:53.149 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-05T01:11:53.149 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-05T01:11:53.149 INFO:teuthology.orchestra.run.smithi151.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-05T01:11:53.149 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-05T01:11:53.149 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-05T01:11:53.149 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-05T01:11:53.149 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-05T01:11:53.149 INFO:teuthology.orchestra.run.smithi151.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-05T01:11:53.149 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-05T01:11:53.149 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-05T01:11:53.149 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-05T01:11:53.150 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-05T01:11:53.150 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-05T01:11:53.150 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-05T01:11:53.150 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-05T01:11:53.150 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-05T01:11:53.150 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-05T01:11:53.150 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-05T01:11:53.150 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-05T01:11:53.150 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-05T01:11:53.150 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-05T01:11:53.150 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-05T01:11:53.150 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-05T01:11:53.150 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-05T01:11:53.150 INFO:teuthology.orchestra.run.smithi151.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-05T01:11:53.150 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-05T01:11:53.151 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-05T01:11:53.151 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-05T01:11:53.151 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-05T01:11:53.151 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-05T01:11:53.151 INFO:teuthology.orchestra.run.smithi151.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-05T01:11:53.151 INFO:teuthology.orchestra.run.smithi151.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-05T01:11:53.151 INFO:teuthology.orchestra.run.smithi151.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-05T01:11:53.151 INFO:teuthology.orchestra.run.smithi151.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-05T01:11:53.151 INFO:teuthology.orchestra.run.smithi151.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-05T01:11:53.151 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-05T01:11:53.151 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-05T01:11:53.151 INFO:teuthology.orchestra.run.smithi151.stdout:Installing weak dependencies: 2024-09-05T01:11:53.151 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-05T01:11:53.151 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-05T01:11:53.152 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-09-05T01:11:53.152 INFO:teuthology.orchestra.run.smithi151.stdout:====================================================================================== 2024-09-05T01:11:53.152 INFO:teuthology.orchestra.run.smithi151.stdout:Install 148 Packages 2024-09-05T01:11:53.152 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 6 Packages 2024-09-05T01:11:53.152 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-05T01:11:53.152 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 222 M 2024-09-05T01:11:53.152 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-09-05T01:11:53.406 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-09-05T01:11:53.886 INFO:teuthology.orchestra.run.smithi145.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-05T01:11:53.887 INFO:teuthology.orchestra.run.smithi145.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-05T01:11:53.899 INFO:teuthology.orchestra.run.smithi145.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-05T01:11:53.900 INFO:teuthology.orchestra.run.smithi145.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-05T01:11:53.901 INFO:teuthology.orchestra.run.smithi145.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-05T01:11:53.902 INFO:teuthology.orchestra.run.smithi145.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-05T01:11:53.904 INFO:teuthology.orchestra.run.smithi145.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-05T01:11:53.907 INFO:teuthology.orchestra.run.smithi145.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-05T01:11:53.908 INFO:teuthology.orchestra.run.smithi145.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-05T01:11:53.973 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-05T01:11:53.988 INFO:teuthology.orchestra.run.smithi145.stdout:====================================================================================== 2024-09-05T01:11:53.988 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-05T01:11:53.988 INFO:teuthology.orchestra.run.smithi145.stdout:====================================================================================== 2024-09-05T01:11:53.988 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-05T01:11:53.988 INFO:teuthology.orchestra.run.smithi145.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-05T01:11:53.989 INFO:teuthology.orchestra.run.smithi145.stdout: ceph x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 6.6 k 2024-09-05T01:11:53.989 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 5.4 M 2024-09-05T01:11:53.989 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-fuse x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 896 k 2024-09-05T01:11:53.989 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 145 k 2024-09-05T01:11:53.989 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 1.5 M 2024-09-05T01:11:53.989 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-cephadm noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 146 k 2024-09-05T01:11:53.989 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 3.6 M 2024-09-05T01:11:53.989 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 7.4 M 2024-09-05T01:11:53.989 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-rook noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 49 k 2024-09-05T01:11:53.989 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-radosgw x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 11 M 2024-09-05T01:11:53.989 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-test x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 49 M 2024-09-05T01:11:53.989 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-volume noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 285 k 2024-09-05T01:11:53.989 INFO:teuthology.orchestra.run.smithi145.stdout: cephadm noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 765 k 2024-09-05T01:11:53.990 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-mirror x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 224 k 2024-09-05T01:11:53.990 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-shell x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 27 k 2024-09-05T01:11:53.990 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-top noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 18 k 2024-09-05T01:11:53.990 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-05T01:11:53.990 INFO:teuthology.orchestra.run.smithi145.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-05T01:11:53.990 INFO:teuthology.orchestra.run.smithi145.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-05T01:11:53.990 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-devel x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 32 k 2024-09-05T01:11:53.990 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 752 k 2024-09-05T01:11:53.990 INFO:teuthology.orchestra.run.smithi145.stdout: librados-devel x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 127 k 2024-09-05T01:11:53.990 INFO:teuthology.orchestra.run.smithi145.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-05T01:11:53.990 INFO:teuthology.orchestra.run.smithi145.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-05T01:11:53.991 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-09-05T01:11:53.991 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-05T01:11:53.991 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-05T01:11:53.991 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-05T01:11:53.991 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cephfs x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 162 k 2024-09-05T01:11:53.991 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rados x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 321 k 2024-09-05T01:11:53.991 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rbd x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 301 k 2024-09-05T01:11:53.991 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rgw x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 99 k 2024-09-05T01:11:53.991 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-fuse x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 85 k 2024-09-05T01:11:53.991 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-mirror x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 3.1 M 2024-09-05T01:11:53.991 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-nbd x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 170 k 2024-09-05T01:11:53.991 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-05T01:11:53.991 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrading: 2024-09-05T01:11:53.992 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager x86_64 1:1.48.10-1.el9 baseos 2.3 M 2024-09-05T01:11:53.992 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-libnm x86_64 1:1.48.10-1.el9 baseos 1.8 M 2024-09-05T01:11:53.992 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-team x86_64 1:1.48.10-1.el9 baseos 40 k 2024-09-05T01:11:53.992 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-tui x86_64 1:1.48.10-1.el9 baseos 248 k 2024-09-05T01:11:53.992 INFO:teuthology.orchestra.run.smithi145.stdout: librados2 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 3.4 M 2024-09-05T01:11:53.992 INFO:teuthology.orchestra.run.smithi145.stdout: librbd1 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 3.2 M 2024-09-05T01:11:53.992 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-05T01:11:53.992 INFO:teuthology.orchestra.run.smithi145.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-05T01:11:53.992 INFO:teuthology.orchestra.run.smithi145.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-05T01:11:53.992 INFO:teuthology.orchestra.run.smithi145.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-05T01:11:53.992 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-common x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 21 M 2024-09-05T01:11:53.992 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-grafana-dashboards noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 32 k 2024-09-05T01:11:53.993 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mds x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 2.4 M 2024-09-05T01:11:53.993 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 249 k 2024-09-05T01:11:53.993 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mon x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 4.7 M 2024-09-05T01:11:53.993 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-osd x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 17 M 2024-09-05T01:11:53.993 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-prometheus-alerts noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 16 k 2024-09-05T01:11:53.993 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-selinux x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 25 k 2024-09-05T01:11:53.993 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-05T01:11:53.993 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-05T01:11:53.994 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-05T01:11:53.994 INFO:teuthology.orchestra.run.smithi145.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-05T01:11:53.994 INFO:teuthology.orchestra.run.smithi145.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-05T01:11:53.994 INFO:teuthology.orchestra.run.smithi145.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-05T01:11:53.994 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-05T01:11:53.994 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-05T01:11:53.994 INFO:teuthology.orchestra.run.smithi145.stdout: libcephsqlite x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 163 k 2024-09-05T01:11:53.994 INFO:teuthology.orchestra.run.smithi145.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-05T01:11:53.994 INFO:teuthology.orchestra.run.smithi145.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-05T01:11:53.994 INFO:teuthology.orchestra.run.smithi145.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-05T01:11:53.994 INFO:teuthology.orchestra.run.smithi145.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-05T01:11:53.994 INFO:teuthology.orchestra.run.smithi145.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-05T01:11:53.994 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 506 k 2024-09-05T01:11:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-05T01:11:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: librgw2 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 5.3 M 2024-09-05T01:11:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-05T01:11:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-05T01:11:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-05T01:11:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-05T01:11:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-05T01:11:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-05T01:11:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-05T01:11:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-05T01:11:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-05T01:11:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-05T01:11:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-05T01:11:53.995 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-05T01:11:53.996 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-05T01:11:53.996 INFO:teuthology.orchestra.run.smithi145.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-05T01:11:53.996 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-05T01:11:53.996 INFO:teuthology.orchestra.run.smithi145.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-05T01:11:53.996 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-05T01:11:53.996 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 45 k 2024-09-05T01:11:53.996 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 136 k 2024-09-05T01:11:53.996 INFO:teuthology.orchestra.run.smithi145.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-05T01:11:53.996 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-05T01:11:53.996 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-05T01:11:53.996 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-05T01:11:53.996 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-05T01:11:53.997 INFO:teuthology.orchestra.run.smithi145.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-05T01:11:53.997 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-05T01:11:53.997 INFO:teuthology.orchestra.run.smithi145.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-05T01:11:53.997 INFO:teuthology.orchestra.run.smithi145.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-05T01:11:53.997 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-05T01:11:53.997 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-05T01:11:53.997 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-05T01:11:53.997 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-05T01:11:53.997 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-05T01:11:53.997 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-05T01:11:53.997 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-05T01:11:53.997 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-05T01:11:53.998 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-05T01:11:53.998 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-05T01:11:53.998 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-05T01:11:53.998 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-05T01:11:53.998 INFO:teuthology.orchestra.run.smithi145.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-05T01:11:53.998 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-05T01:11:53.998 INFO:teuthology.orchestra.run.smithi145.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-05T01:11:53.998 INFO:teuthology.orchestra.run.smithi145.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-05T01:11:53.998 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-05T01:11:53.998 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-05T01:11:53.998 INFO:teuthology.orchestra.run.smithi145.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-05T01:11:53.998 INFO:teuthology.orchestra.run.smithi145.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-05T01:11:53.998 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-05T01:11:53.998 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-05T01:11:53.999 INFO:teuthology.orchestra.run.smithi145.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-05T01:11:53.999 INFO:teuthology.orchestra.run.smithi145.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-05T01:11:53.999 INFO:teuthology.orchestra.run.smithi145.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-05T01:11:53.999 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-05T01:11:53.999 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-05T01:11:53.999 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-05T01:11:53.999 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-05T01:11:53.999 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-05T01:11:53.999 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-05T01:11:53.999 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-05T01:11:53.999 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-05T01:11:53.999 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-05T01:11:53.999 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-05T01:11:54.000 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-05T01:11:54.000 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-05T01:11:54.000 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-05T01:11:54.000 INFO:teuthology.orchestra.run.smithi145.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-05T01:11:54.000 INFO:teuthology.orchestra.run.smithi145.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-05T01:11:54.000 INFO:teuthology.orchestra.run.smithi145.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-05T01:11:54.000 INFO:teuthology.orchestra.run.smithi145.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-05T01:11:54.000 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-05T01:11:54.000 INFO:teuthology.orchestra.run.smithi145.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-05T01:11:54.000 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-05T01:11:54.000 INFO:teuthology.orchestra.run.smithi145.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-05T01:11:54.000 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-05T01:11:54.000 INFO:teuthology.orchestra.run.smithi145.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-05T01:11:54.001 INFO:teuthology.orchestra.run.smithi145.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-05T01:11:54.001 INFO:teuthology.orchestra.run.smithi145.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-05T01:11:54.001 INFO:teuthology.orchestra.run.smithi145.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-05T01:11:54.001 INFO:teuthology.orchestra.run.smithi145.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-05T01:11:54.001 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-05T01:11:54.001 INFO:teuthology.orchestra.run.smithi145.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-05T01:11:54.001 INFO:teuthology.orchestra.run.smithi145.stdout:Installing weak dependencies: 2024-09-05T01:11:54.001 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-05T01:11:54.001 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-05T01:11:54.001 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-05T01:11:54.001 INFO:teuthology.orchestra.run.smithi145.stdout:====================================================================================== 2024-09-05T01:11:54.001 INFO:teuthology.orchestra.run.smithi145.stdout:Install 148 Packages 2024-09-05T01:11:54.001 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrade 6 Packages 2024-09-05T01:11:54.002 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-05T01:11:54.002 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 222 M 2024-09-05T01:11:54.002 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-05T01:11:54.044 INFO:teuthology.orchestra.run.smithi151.stdout:(1/154): ceph-19.1.1-259.g91c8a7e5.el9.x86_64.r 54 kB/s | 6.6 kB 00:00 2024-09-05T01:11:54.219 INFO:teuthology.orchestra.run.smithi151.stdout:(2/154): ceph-fuse-19.1.1-259.g91c8a7e5.el9.x86 5.0 MB/s | 896 kB 00:00 2024-09-05T01:11:54.278 INFO:teuthology.orchestra.run.smithi151.stdout:(3/154): ceph-immutable-object-cache-19.1.1-259 2.4 MB/s | 145 kB 00:00 2024-09-05T01:11:54.403 INFO:teuthology.orchestra.run.smithi151.stdout:(4/154): ceph-base-19.1.1-259.g91c8a7e5.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-05T01:11:54.529 INFO:teuthology.orchestra.run.smithi151.stdout:(5/154): ceph-mds-19.1.1-259.g91c8a7e5.el9.x86_ 9.5 MB/s | 2.4 MB 00:00 2024-09-05T01:11:54.570 INFO:teuthology.orchestra.run.smithi151.stdout:(6/154): ceph-mgr-19.1.1-259.g91c8a7e5.el9.x86_ 9.1 MB/s | 1.5 MB 00:00 2024-09-05T01:11:54.846 INFO:teuthology.orchestra.run.smithi151.stdout:(7/154): ceph-mon-19.1.1-259.g91c8a7e5.el9.x86_ 15 MB/s | 4.7 MB 00:00 2024-09-05T01:11:55.333 INFO:teuthology.orchestra.run.smithi145.stdout:(1/154): ceph-19.1.1-259.g91c8a7e5.el9.x86_64.r 12 kB/s | 6.6 kB 00:00 2024-09-05T01:11:55.421 INFO:teuthology.orchestra.run.smithi151.stdout:(8/154): ceph-osd-19.1.1-259.g91c8a7e5.el9.x86_ 20 MB/s | 17 MB 00:00 2024-09-05T01:11:55.533 INFO:teuthology.orchestra.run.smithi145.stdout:(2/154): ceph-fuse-19.1.1-259.g91c8a7e5.el9.x86 4.4 MB/s | 896 kB 00:00 2024-09-05T01:11:55.600 INFO:teuthology.orchestra.run.smithi145.stdout:(3/154): ceph-immutable-object-cache-19.1.1-259 2.1 MB/s | 145 kB 00:00 2024-09-05T01:11:55.621 INFO:teuthology.orchestra.run.smithi151.stdout:(9/154): ceph-common-19.1.1-259.g91c8a7e5.el9.x 12 MB/s | 21 MB 00:01 2024-09-05T01:11:55.647 INFO:teuthology.orchestra.run.smithi151.stdout:(10/154): ceph-selinux-19.1.1-259.g91c8a7e5.el9 112 kB/s | 25 kB 00:00 2024-09-05T01:11:55.734 INFO:teuthology.orchestra.run.smithi145.stdout:(4/154): ceph-base-19.1.1-259.g91c8a7e5.el9.x86 5.8 MB/s | 5.4 MB 00:00 2024-09-05T01:11:55.772 INFO:teuthology.orchestra.run.smithi151.stdout:(11/154): ceph-radosgw-19.1.1-259.g91c8a7e5.el9 11 MB/s | 11 MB 00:00 2024-09-05T01:11:55.797 INFO:teuthology.orchestra.run.smithi151.stdout:(12/154): cephfs-mirror-19.1.1-259.g91c8a7e5.el 1.5 MB/s | 224 kB 00:00 2024-09-05T01:11:55.826 INFO:teuthology.orchestra.run.smithi145.stdout:(5/154): ceph-mds-19.1.1-259.g91c8a7e5.el9.x86_ 11 MB/s | 2.4 MB 00:00 2024-09-05T01:11:55.856 INFO:teuthology.orchestra.run.smithi151.stdout:(13/154): cephfs-shell-19.1.1-259.g91c8a7e5.el9 324 kB/s | 27 kB 00:00 2024-09-05T01:11:55.881 INFO:teuthology.orchestra.run.smithi151.stdout:(14/154): libcephfs-devel-19.1.1-259.g91c8a7e5. 378 kB/s | 32 kB 00:00 2024-09-05T01:11:55.909 INFO:teuthology.orchestra.run.smithi145.stdout:(6/154): ceph-mgr-19.1.1-259.g91c8a7e5.el9.x86_ 8.7 MB/s | 1.5 MB 00:00 2024-09-05T01:11:55.974 INFO:teuthology.orchestra.run.smithi151.stdout:(15/154): libcephsqlite-19.1.1-259.g91c8a7e5.el 1.7 MB/s | 163 kB 00:00 2024-09-05T01:11:55.978 INFO:teuthology.orchestra.run.smithi012.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-05T01:11:55.979 INFO:teuthology.orchestra.run.smithi012.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-05T01:11:55.992 INFO:teuthology.orchestra.run.smithi012.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-05T01:11:55.993 INFO:teuthology.orchestra.run.smithi012.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-05T01:11:55.996 INFO:teuthology.orchestra.run.smithi012.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-05T01:11:55.996 INFO:teuthology.orchestra.run.smithi012.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-05T01:11:55.996 INFO:teuthology.orchestra.run.smithi012.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-05T01:11:55.999 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-05T01:11:56.000 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-05T01:11:56.066 INFO:teuthology.orchestra.run.smithi151.stdout:(16/154): librados-devel-19.1.1-259.g91c8a7e5.e 1.4 MB/s | 127 kB 00:00 2024-09-05T01:11:56.070 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-09-05T01:11:56.091 INFO:teuthology.orchestra.run.smithi012.stdout:====================================================================================== 2024-09-05T01:11:56.091 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2024-09-05T01:11:56.091 INFO:teuthology.orchestra.run.smithi012.stdout:====================================================================================== 2024-09-05T01:11:56.091 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-09-05T01:11:56.091 INFO:teuthology.orchestra.run.smithi012.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-05T01:11:56.091 INFO:teuthology.orchestra.run.smithi012.stdout: ceph x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 6.6 k 2024-09-05T01:11:56.091 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 5.4 M 2024-09-05T01:11:56.091 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 896 k 2024-09-05T01:11:56.092 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 145 k 2024-09-05T01:11:56.092 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 1.5 M 2024-09-05T01:11:56.092 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 146 k 2024-09-05T01:11:56.092 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 3.6 M 2024-09-05T01:11:56.092 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 7.4 M 2024-09-05T01:11:56.092 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 49 k 2024-09-05T01:11:56.092 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 11 M 2024-09-05T01:11:56.092 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 49 M 2024-09-05T01:11:56.092 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 285 k 2024-09-05T01:11:56.092 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 765 k 2024-09-05T01:11:56.092 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 224 k 2024-09-05T01:11:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-shell x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 27 k 2024-09-05T01:11:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 18 k 2024-09-05T01:11:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-05T01:11:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-05T01:11:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-05T01:11:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 32 k 2024-09-05T01:11:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 752 k 2024-09-05T01:11:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 127 k 2024-09-05T01:11:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-05T01:11:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-05T01:11:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-09-05T01:11:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-05T01:11:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-05T01:11:56.094 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-05T01:11:56.094 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 162 k 2024-09-05T01:11:56.094 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 321 k 2024-09-05T01:11:56.094 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 301 k 2024-09-05T01:11:56.094 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 99 k 2024-09-05T01:11:56.094 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 85 k 2024-09-05T01:11:56.094 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 3.1 M 2024-09-05T01:11:56.094 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 170 k 2024-09-05T01:11:56.094 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-05T01:11:56.094 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrading: 2024-09-05T01:11:56.094 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager x86_64 1:1.48.10-1.el9 baseos 2.3 M 2024-09-05T01:11:56.094 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-libnm x86_64 1:1.48.10-1.el9 baseos 1.8 M 2024-09-05T01:11:56.094 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-team x86_64 1:1.48.10-1.el9 baseos 40 k 2024-09-05T01:11:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-tui x86_64 1:1.48.10-1.el9 baseos 248 k 2024-09-05T01:11:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: librados2 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 3.4 M 2024-09-05T01:11:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 3.2 M 2024-09-05T01:11:56.095 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-09-05T01:11:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-05T01:11:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-05T01:11:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-05T01:11:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 21 M 2024-09-05T01:11:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 32 k 2024-09-05T01:11:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 2.4 M 2024-09-05T01:11:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 249 k 2024-09-05T01:11:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 4.7 M 2024-09-05T01:11:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 17 M 2024-09-05T01:11:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts noarch 2:19.1.1-259.g91c8a7e5.el9 ceph-noarch 16 k 2024-09-05T01:11:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 25 k 2024-09-05T01:11:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-05T01:11:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-05T01:11:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-05T01:11:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-05T01:11:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-05T01:11:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-05T01:11:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-05T01:11:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-05T01:11:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 163 k 2024-09-05T01:11:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-05T01:11:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-05T01:11:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-05T01:11:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-05T01:11:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-05T01:11:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 506 k 2024-09-05T01:11:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-05T01:11:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2 x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 5.3 M 2024-09-05T01:11:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-05T01:11:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-05T01:11:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-05T01:11:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-05T01:11:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-05T01:11:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-05T01:11:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-05T01:11:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-05T01:11:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-05T01:11:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-05T01:11:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-05T01:11:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-05T01:11:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-05T01:11:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-05T01:11:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-05T01:11:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-05T01:11:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-05T01:11:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 45 k 2024-09-05T01:11:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common x86_64 2:19.1.1-259.g91c8a7e5.el9 ceph 136 k 2024-09-05T01:11:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-05T01:11:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-05T01:11:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-05T01:11:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-05T01:11:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-05T01:11:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-05T01:11:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-05T01:11:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-05T01:11:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-05T01:11:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-05T01:11:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-05T01:11:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-05T01:11:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-05T01:11:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-05T01:11:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-05T01:11:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-05T01:11:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-05T01:11:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-05T01:11:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-05T01:11:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-05T01:11:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-05T01:11:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-05T01:11:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-05T01:11:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-05T01:11:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-05T01:11:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-05T01:11:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-05T01:11:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-05T01:11:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-05T01:11:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-05T01:11:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-05T01:11:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-05T01:11:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-05T01:11:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-05T01:11:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-05T01:11:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-05T01:11:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-05T01:11:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-05T01:11:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-05T01:11:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-05T01:11:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-05T01:11:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-05T01:11:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-05T01:11:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-05T01:11:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-05T01:11:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-05T01:11:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-05T01:11:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-05T01:11:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-05T01:11:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-05T01:11:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-05T01:11:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-05T01:11:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-05T01:11:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-05T01:11:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-05T01:11:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-05T01:11:56.103 INFO:teuthology.orchestra.run.smithi012.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-05T01:11:56.103 INFO:teuthology.orchestra.run.smithi012.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-05T01:11:56.103 INFO:teuthology.orchestra.run.smithi012.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-05T01:11:56.103 INFO:teuthology.orchestra.run.smithi012.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-05T01:11:56.103 INFO:teuthology.orchestra.run.smithi012.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-05T01:11:56.103 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-05T01:11:56.103 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-05T01:11:56.103 INFO:teuthology.orchestra.run.smithi012.stdout:Installing weak dependencies: 2024-09-05T01:11:56.103 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-05T01:11:56.103 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:11:56.103 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-09-05T01:11:56.103 INFO:teuthology.orchestra.run.smithi012.stdout:====================================================================================== 2024-09-05T01:11:56.103 INFO:teuthology.orchestra.run.smithi012.stdout:Install 148 Packages 2024-09-05T01:11:56.104 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrade 6 Packages 2024-09-05T01:11:56.104 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:11:56.104 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 222 M 2024-09-05T01:11:56.104 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-09-05T01:11:56.166 INFO:teuthology.orchestra.run.smithi151.stdout:(17/154): libradosstriper1-19.1.1-259.g91c8a7e5 4.9 MB/s | 506 kB 00:00 2024-09-05T01:11:56.260 INFO:teuthology.orchestra.run.smithi145.stdout:(7/154): ceph-mon-19.1.1-259.g91c8a7e5.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-09-05T01:11:56.575 INFO:teuthology.orchestra.run.smithi151.stdout:(18/154): librgw2-19.1.1-259.g91c8a7e5.el9.x86_ 13 MB/s | 5.3 MB 00:00 2024-09-05T01:11:56.600 INFO:teuthology.orchestra.run.smithi151.stdout:(19/154): libcephfs2-19.1.1-259.g91c8a7e5.el9.x 1.0 MB/s | 752 kB 00:00 2024-09-05T01:11:56.625 INFO:teuthology.orchestra.run.smithi151.stdout:(20/154): python3-ceph-argparse-19.1.1-259.g91c 900 kB/s | 45 kB 00:00 2024-09-05T01:11:56.642 INFO:teuthology.orchestra.run.smithi151.stdout:(21/154): python3-ceph-common-19.1.1-259.g91c8a 3.2 MB/s | 136 kB 00:00 2024-09-05T01:11:56.668 INFO:teuthology.orchestra.run.smithi145.stdout:(8/154): ceph-common-19.1.1-259.g91c8a7e5.el9.x 11 MB/s | 21 MB 00:01 2024-09-05T01:11:56.676 INFO:teuthology.orchestra.run.smithi151.stdout:(22/154): python3-cephfs-19.1.1-259.g91c8a7e5.e 3.1 MB/s | 162 kB 00:00 2024-09-05T01:11:56.691 INFO:teuthology.orchestra.run.smithi012.stdout:(1/154): ceph-19.1.1-259.g91c8a7e5.el9.x86_64.r 42 kB/s | 6.6 kB 00:00 2024-09-05T01:11:56.710 INFO:teuthology.orchestra.run.smithi151.stdout:(23/154): python3-rados-19.1.1-259.g91c8a7e5.el 4.7 MB/s | 321 kB 00:00 2024-09-05T01:11:56.727 INFO:teuthology.orchestra.run.smithi145.stdout:(9/154): ceph-selinux-19.1.1-259.g91c8a7e5.el9. 434 kB/s | 25 kB 00:00 2024-09-05T01:11:56.743 INFO:teuthology.orchestra.run.smithi151.stdout:(24/154): python3-rbd-19.1.1-259.g91c8a7e5.el9. 4.4 MB/s | 301 kB 00:00 2024-09-05T01:11:56.777 INFO:teuthology.orchestra.run.smithi151.stdout:(25/154): python3-rgw-19.1.1-259.g91c8a7e5.el9. 1.4 MB/s | 99 kB 00:00 2024-09-05T01:11:56.819 INFO:teuthology.orchestra.run.smithi151.stdout:(26/154): rbd-fuse-19.1.1-259.g91c8a7e5.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-05T01:11:57.145 INFO:teuthology.orchestra.run.smithi151.stdout:(27/154): rbd-mirror-19.1.1-259.g91c8a7e5.el9.x 8.5 MB/s | 3.1 MB 00:00 2024-09-05T01:11:57.212 INFO:teuthology.orchestra.run.smithi151.stdout:(28/154): ceph-grafana-dashboards-19.1.1-259.g9 478 kB/s | 32 kB 00:00 2024-09-05T01:11:57.262 INFO:teuthology.orchestra.run.smithi151.stdout:(29/154): ceph-mgr-cephadm-19.1.1-259.g91c8a7e5 2.9 MB/s | 146 kB 00:00 2024-09-05T01:11:57.294 INFO:teuthology.orchestra.run.smithi145.stdout:(10/154): ceph-radosgw-19.1.1-259.g91c8a7e5.el9 10 MB/s | 11 MB 00:01 2024-09-05T01:11:57.296 INFO:teuthology.orchestra.run.smithi151.stdout:(30/154): rbd-nbd-19.1.1-259.g91c8a7e5.el9.x86_ 358 kB/s | 170 kB 00:00 2024-09-05T01:11:57.349 INFO:teuthology.orchestra.run.smithi012.stdout:(2/154): ceph-fuse-19.1.1-259.g91c8a7e5.el9.x86 1.3 MB/s | 896 kB 00:00 2024-09-05T01:11:57.361 INFO:teuthology.orchestra.run.smithi145.stdout:(11/154): cephfs-mirror-19.1.1-259.g91c8a7e5.el 3.3 MB/s | 224 kB 00:00 2024-09-05T01:11:57.461 INFO:teuthology.orchestra.run.smithi145.stdout:(12/154): cephfs-shell-19.1.1-259.g91c8a7e5.el9 271 kB/s | 27 kB 00:00 2024-09-05T01:11:57.525 INFO:teuthology.orchestra.run.smithi012.stdout:(3/154): ceph-immutable-object-cache-19.1.1-259 833 kB/s | 145 kB 00:00 2024-09-05T01:11:57.561 INFO:teuthology.orchestra.run.smithi145.stdout:(13/154): libcephfs-devel-19.1.1-259.g91c8a7e5. 317 kB/s | 32 kB 00:00 2024-09-05T01:11:57.795 INFO:teuthology.orchestra.run.smithi145.stdout:(14/154): libcephfs2-19.1.1-259.g91c8a7e5.el9.x 3.1 MB/s | 752 kB 00:00 2024-09-05T01:11:57.821 INFO:teuthology.orchestra.run.smithi151.stdout:(31/154): ceph-mgr-dashboard-19.1.1-259.g91c8a7 6.4 MB/s | 3.6 MB 00:00 2024-09-05T01:11:57.870 INFO:teuthology.orchestra.run.smithi145.stdout:(15/154): libcephsqlite-19.1.1-259.g91c8a7e5.el 2.1 MB/s | 163 kB 00:00 2024-09-05T01:11:57.913 INFO:teuthology.orchestra.run.smithi151.stdout:(32/154): ceph-mgr-modules-core-19.1.1-259.g91c 2.7 MB/s | 249 kB 00:00 2024-09-05T01:11:57.945 INFO:teuthology.orchestra.run.smithi145.stdout:(16/154): librados-devel-19.1.1-259.g91c8a7e5.e 1.7 MB/s | 127 kB 00:00 2024-09-05T01:11:57.997 INFO:teuthology.orchestra.run.smithi151.stdout:(33/154): ceph-mgr-diskprediction-local-19.1.1- 11 MB/s | 7.4 MB 00:00 2024-09-05T01:11:58.014 INFO:teuthology.orchestra.run.smithi151.stdout:(34/154): ceph-mgr-rook-19.1.1-259.g91c8a7e5.el 492 kB/s | 49 kB 00:00 2024-09-05T01:11:58.054 INFO:teuthology.orchestra.run.smithi145.stdout:(17/154): libradosstriper1-19.1.1-259.g91c8a7e5 4.6 MB/s | 506 kB 00:00 2024-09-05T01:11:58.056 INFO:teuthology.orchestra.run.smithi151.stdout:(35/154): ceph-prometheus-alerts-19.1.1-259.g91 280 kB/s | 16 kB 00:00 2024-09-05T01:11:58.089 INFO:teuthology.orchestra.run.smithi151.stdout:(36/154): ceph-volume-19.1.1-259.g91c8a7e5.el9. 3.7 MB/s | 285 kB 00:00 2024-09-05T01:11:58.190 INFO:teuthology.orchestra.run.smithi151.stdout:(37/154): cephfs-top-19.1.1-259.g91c8a7e5.el9.n 182 kB/s | 18 kB 00:00 2024-09-05T01:11:58.224 INFO:teuthology.orchestra.run.smithi151.stdout:(38/154): cephadm-19.1.1-259.g91c8a7e5.el9.noar 4.5 MB/s | 765 kB 00:00 2024-09-05T01:11:58.341 INFO:teuthology.orchestra.run.smithi012.stdout:(4/154): ceph-mds-19.1.1-259.g91c8a7e5.el9.x86_ 2.9 MB/s | 2.4 MB 00:00 2024-09-05T01:11:58.349 INFO:teuthology.orchestra.run.smithi151.stdout:(39/154): fuse-2.9.9-16.el9.x86_64.rpm 504 kB/s | 80 kB 00:00 2024-09-05T01:11:58.413 INFO:teuthology.orchestra.run.smithi145.stdout:(18/154): ceph-osd-19.1.1-259.g91c8a7e5.el9.x86 6.7 MB/s | 17 MB 00:02 2024-09-05T01:11:58.441 INFO:teuthology.orchestra.run.smithi151.stdout:(40/154): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-05T01:11:58.480 INFO:teuthology.orchestra.run.smithi145.stdout:(19/154): python3-ceph-argparse-19.1.1-259.g91c 678 kB/s | 45 kB 00:00 2024-09-05T01:11:58.491 INFO:teuthology.orchestra.run.smithi151.stdout:(41/154): libgfortran-11.5.0-2.el9.x86_64.rpm 2.9 MB/s | 801 kB 00:00 2024-09-05T01:11:58.547 INFO:teuthology.orchestra.run.smithi145.stdout:(20/154): python3-ceph-common-19.1.1-259.g91c8a 2.0 MB/s | 136 kB 00:00 2024-09-05T01:11:58.550 INFO:teuthology.orchestra.run.smithi151.stdout:(42/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-05T01:11:58.600 INFO:teuthology.orchestra.run.smithi012.stdout:(5/154): ceph-mgr-19.1.1-259.g91c8a7e5.el9.x86_ 5.9 MB/s | 1.5 MB 00:00 2024-09-05T01:11:58.600 INFO:teuthology.orchestra.run.smithi151.stdout:(43/154): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-05T01:11:58.605 INFO:teuthology.orchestra.run.smithi145.stdout:(21/154): python3-cephfs-19.1.1-259.g91c8a7e5.e 2.7 MB/s | 162 kB 00:00 2024-09-05T01:11:58.650 INFO:teuthology.orchestra.run.smithi151.stdout:(44/154): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-05T01:11:58.680 INFO:teuthology.orchestra.run.smithi145.stdout:(22/154): python3-rados-19.1.1-259.g91c8a7e5.el 4.2 MB/s | 321 kB 00:00 2024-09-05T01:11:58.701 INFO:teuthology.orchestra.run.smithi151.stdout:(45/154): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-05T01:11:58.742 INFO:teuthology.orchestra.run.smithi012.stdout:(6/154): ceph-base-19.1.1-259.g91c8a7e5.el9.x86 2.5 MB/s | 5.4 MB 00:02 2024-09-05T01:11:58.751 INFO:teuthology.orchestra.run.smithi151.stdout:(46/154): python3-cryptography-36.0.1-4.el9.x86 4.7 MB/s | 1.2 MB 00:00 2024-09-05T01:11:58.781 INFO:teuthology.orchestra.run.smithi145.stdout:(23/154): librgw2-19.1.1-259.g91c8a7e5.el9.x86_ 7.4 MB/s | 5.3 MB 00:00 2024-09-05T01:11:58.802 INFO:teuthology.orchestra.run.smithi151.stdout:(47/154): python3-urllib3-1.26.5-6.el9.noarch.r 2.1 MB/s | 215 kB 00:00 2024-09-05T01:11:58.806 INFO:teuthology.orchestra.run.smithi145.stdout:(24/154): python3-rbd-19.1.1-259.g91c8a7e5.el9. 2.4 MB/s | 301 kB 00:00 2024-09-05T01:11:58.839 INFO:teuthology.orchestra.run.smithi145.stdout:(25/154): python3-rgw-19.1.1-259.g91c8a7e5.el9. 1.7 MB/s | 99 kB 00:00 2024-09-05T01:11:58.865 INFO:teuthology.orchestra.run.smithi145.stdout:(26/154): rbd-fuse-19.1.1-259.g91c8a7e5.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-05T01:11:58.932 INFO:teuthology.orchestra.run.smithi145.stdout:(27/154): rbd-nbd-19.1.1-259.g91c8a7e5.el9.x86_ 2.5 MB/s | 170 kB 00:00 2024-09-05T01:11:58.990 INFO:teuthology.orchestra.run.smithi145.stdout:(28/154): ceph-grafana-dashboards-19.1.1-259.g9 545 kB/s | 32 kB 00:00 2024-09-05T01:11:59.057 INFO:teuthology.orchestra.run.smithi145.stdout:(29/154): ceph-mgr-cephadm-19.1.1-259.g91c8a7e5 2.1 MB/s | 146 kB 00:00 2024-09-05T01:11:59.084 INFO:teuthology.orchestra.run.smithi012.stdout:(7/154): ceph-mon-19.1.1-259.g91c8a7e5.el9.x86_ 9.7 MB/s | 4.7 MB 00:00 2024-09-05T01:11:59.191 INFO:teuthology.orchestra.run.smithi145.stdout:(30/154): rbd-mirror-19.1.1-259.g91c8a7e5.el9.x 8.8 MB/s | 3.1 MB 00:00 2024-09-05T01:11:59.236 INFO:teuthology.orchestra.run.smithi151.stdout:(48/154): ceph-test-19.1.1-259.g91c8a7e5.el9.x8 13 MB/s | 49 MB 00:03 2024-09-05T01:11:59.500 INFO:teuthology.orchestra.run.smithi145.stdout:(31/154): ceph-mgr-dashboard-19.1.1-259.g91c8a7 8.1 MB/s | 3.6 MB 00:00 2024-09-05T01:11:59.734 INFO:teuthology.orchestra.run.smithi012.stdout:(8/154): ceph-radosgw-19.1.1-259.g91c8a7e5.el9. 16 MB/s | 11 MB 00:00 2024-09-05T01:11:59.776 INFO:teuthology.orchestra.run.smithi012.stdout:(9/154): ceph-selinux-19.1.1-259.g91c8a7e5.el9. 609 kB/s | 25 kB 00:00 2024-09-05T01:11:59.942 INFO:teuthology.orchestra.run.smithi145.stdout:(32/154): ceph-test-19.1.1-259.g91c8a7e5.el9.x8 15 MB/s | 49 MB 00:03 2024-09-05T01:11:59.961 INFO:teuthology.orchestra.run.smithi151.stdout:(49/154): boost-program-options-1.75.0-8.el9.x8 147 kB/s | 107 kB 00:00 2024-09-05T01:11:59.967 INFO:teuthology.orchestra.run.smithi145.stdout:(33/154): ceph-mgr-modules-core-19.1.1-259.g91c 534 kB/s | 249 kB 00:00 2024-09-05T01:11:59.992 INFO:teuthology.orchestra.run.smithi145.stdout:(34/154): ceph-mgr-rook-19.1.1-259.g91c8a7e5.el 989 kB/s | 49 kB 00:00 2024-09-05T01:12:00.026 INFO:teuthology.orchestra.run.smithi145.stdout:(35/154): ceph-prometheus-alerts-19.1.1-259.g91 281 kB/s | 16 kB 00:00 2024-09-05T01:12:00.028 INFO:teuthology.orchestra.run.smithi151.stdout:(50/154): automake-1.16.2-8.el9.noarch.rpm 540 kB/s | 689 kB 00:01 2024-09-05T01:12:00.078 INFO:teuthology.orchestra.run.smithi151.stdout:(51/154): bison-3.7.4-5.el9.x86_64.rpm 739 kB/s | 943 kB 00:01 2024-09-05T01:12:00.159 INFO:teuthology.orchestra.run.smithi145.stdout:(36/154): ceph-mgr-diskprediction-local-19.1.1- 7.6 MB/s | 7.4 MB 00:00 2024-09-05T01:12:00.185 INFO:teuthology.orchestra.run.smithi145.stdout:(37/154): ceph-volume-19.1.1-259.g91c8a7e5.el9. 1.5 MB/s | 285 kB 00:00 2024-09-05T01:12:00.227 INFO:teuthology.orchestra.run.smithi145.stdout:(38/154): cephadm-19.1.1-259.g91c8a7e5.el9.noar 3.7 MB/s | 765 kB 00:00 2024-09-05T01:12:00.252 INFO:teuthology.orchestra.run.smithi145.stdout:(39/154): cephfs-top-19.1.1-259.g91c8a7e5.el9.n 198 kB/s | 18 kB 00:00 2024-09-05T01:12:00.512 INFO:teuthology.orchestra.run.smithi151.stdout:(52/154): elfutils-libelf-devel-0.191-4.el9.x86 39 kB/s | 22 kB 00:00 2024-09-05T01:12:00.610 INFO:teuthology.orchestra.run.smithi145.stdout:(40/154): fuse-2.9.9-16.el9.x86_64.rpm 187 kB/s | 80 kB 00:00 2024-09-05T01:12:00.671 INFO:teuthology.orchestra.run.smithi151.stdout:(53/154): flexiblas-3.0.4-8.el9.x86_64.rpm 55 kB/s | 33 kB 00:00 2024-09-05T01:12:00.761 INFO:teuthology.orchestra.run.smithi145.stdout:(41/154): libquadmath-11.5.0-2.el9.x86_64.rpm 376 kB/s | 191 kB 00:00 2024-09-05T01:12:00.813 INFO:teuthology.orchestra.run.smithi151.stdout:(54/154): flex-2.6.4-9.el9.x86_64.rpm 400 kB/s | 313 kB 00:00 2024-09-05T01:12:00.877 INFO:teuthology.orchestra.run.smithi145.stdout:(42/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 949 kB/s | 253 kB 00:00 2024-09-05T01:12:00.986 INFO:teuthology.orchestra.run.smithi145.stdout:(43/154): libgfortran-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 801 kB 00:00 2024-09-05T01:12:01.011 INFO:teuthology.orchestra.run.smithi145.stdout:(44/154): python3-ply-3.11-14.el9.noarch.rpm 796 kB/s | 106 kB 00:00 2024-09-05T01:12:01.095 INFO:teuthology.orchestra.run.smithi145.stdout:(45/154): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-05T01:12:01.129 INFO:teuthology.orchestra.run.smithi145.stdout:(46/154): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-05T01:12:01.154 INFO:teuthology.orchestra.run.smithi151.stdout:(55/154): flexiblas-openblas-openmp-3.0.4-8.el9 38 kB/s | 18 kB 00:00 2024-09-05T01:12:01.204 INFO:teuthology.orchestra.run.smithi145.stdout:(47/154): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-09-05T01:12:01.246 INFO:teuthology.orchestra.run.smithi145.stdout:(48/154): python3-cryptography-36.0.1-4.el9.x86 2.5 MB/s | 1.2 MB 00:00 2024-09-05T01:12:01.259 INFO:teuthology.orchestra.run.smithi012.stdout:(10/154): ceph-test-19.1.1-259.g91c8a7e5.el9.x8 33 MB/s | 49 MB 00:01 2024-09-05T01:12:01.288 INFO:teuthology.orchestra.run.smithi151.stdout:(56/154): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-09-05T01:12:01.309 INFO:teuthology.orchestra.run.smithi012.stdout:(11/154): cephfs-mirror-19.1.1-259.g91c8a7e5.el 4.4 MB/s | 224 kB 00:00 2024-09-05T01:12:01.313 INFO:teuthology.orchestra.run.smithi145.stdout:(49/154): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2024-09-05T01:12:01.351 INFO:teuthology.orchestra.run.smithi012.stdout:(12/154): cephfs-shell-19.1.1-259.g91c8a7e5.el9 656 kB/s | 27 kB 00:00 2024-09-05T01:12:01.354 INFO:teuthology.orchestra.run.smithi145.stdout:(50/154): elfutils-libelf-devel-0.191-4.el9.x86 523 kB/s | 22 kB 00:00 2024-09-05T01:12:01.380 INFO:teuthology.orchestra.run.smithi145.stdout:(51/154): boost-program-options-1.75.0-8.el9.x8 800 kB/s | 107 kB 00:00 2024-09-05T01:12:01.402 INFO:teuthology.orchestra.run.smithi012.stdout:(13/154): libcephfs-devel-19.1.1-259.g91c8a7e5. 638 kB/s | 32 kB 00:00 2024-09-05T01:12:01.405 INFO:teuthology.orchestra.run.smithi145.stdout:(52/154): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-05T01:12:01.431 INFO:teuthology.orchestra.run.smithi145.stdout:(53/154): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-09-05T01:12:01.464 INFO:teuthology.orchestra.run.smithi145.stdout:(54/154): bison-3.7.4-5.el9.x86_64.rpm 3.5 MB/s | 943 kB 00:00 2024-09-05T01:12:01.485 INFO:teuthology.orchestra.run.smithi012.stdout:(14/154): libcephfs2-19.1.1-259.g91c8a7e5.el9.x 8.8 MB/s | 752 kB 00:00 2024-09-05T01:12:01.489 INFO:teuthology.orchestra.run.smithi145.stdout:(55/154): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-05T01:12:01.536 INFO:teuthology.orchestra.run.smithi012.stdout:(15/154): libcephsqlite-19.1.1-259.g91c8a7e5.el 3.2 MB/s | 163 kB 00:00 2024-09-05T01:12:01.540 INFO:teuthology.orchestra.run.smithi145.stdout:(56/154): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-09-05T01:12:01.565 INFO:teuthology.orchestra.run.smithi145.stdout:(57/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-05T01:12:01.586 INFO:teuthology.orchestra.run.smithi012.stdout:(16/154): librados-devel-19.1.1-259.g91c8a7e5.e 2.5 MB/s | 127 kB 00:00 2024-09-05T01:12:01.590 INFO:teuthology.orchestra.run.smithi145.stdout:(58/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-09-05T01:12:01.632 INFO:teuthology.orchestra.run.smithi145.stdout:(59/154): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-05T01:12:01.644 INFO:teuthology.orchestra.run.smithi012.stdout:(17/154): libradosstriper1-19.1.1-259.g91c8a7e5 8.5 MB/s | 506 kB 00:00 2024-09-05T01:12:01.655 INFO:teuthology.orchestra.run.smithi151.stdout:(57/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.6 MB/s | 3.0 MB 00:01 2024-09-05T01:12:01.691 INFO:teuthology.orchestra.run.smithi145.stdout:(60/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 10 MB/s | 3.0 MB 00:00 2024-09-05T01:12:01.716 INFO:teuthology.orchestra.run.smithi145.stdout:(61/154): libuuid-devel-2.37.4-20.el9.x86_64.rp 292 kB/s | 24 kB 00:00 2024-09-05T01:12:01.741 INFO:teuthology.orchestra.run.smithi145.stdout:(62/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-05T01:12:01.767 INFO:teuthology.orchestra.run.smithi145.stdout:(63/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-05T01:12:01.792 INFO:teuthology.orchestra.run.smithi145.stdout:(64/154): libtool-2.4.6-46.el9.x86_64.rpm 2.8 MB/s | 581 kB 00:00 2024-09-05T01:12:01.817 INFO:teuthology.orchestra.run.smithi145.stdout:(65/154): openblas-0.3.26-2.el9.x86_64.rpm 769 kB/s | 38 kB 00:00 2024-09-05T01:12:01.837 INFO:teuthology.orchestra.run.smithi012.stdout:(18/154): librgw2-19.1.1-259.g91c8a7e5.el9.x86_ 28 MB/s | 5.3 MB 00:00 2024-09-05T01:12:01.842 INFO:teuthology.orchestra.run.smithi145.stdout:(66/154): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-05T01:12:01.855 INFO:teuthology.orchestra.run.smithi151.stdout:(58/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 80 kB/s | 45 kB 00:00 2024-09-05T01:12:01.886 INFO:teuthology.orchestra.run.smithi012.stdout:(19/154): python3-ceph-argparse-19.1.1-259.g91c 913 kB/s | 45 kB 00:00 2024-09-05T01:12:01.937 INFO:teuthology.orchestra.run.smithi012.stdout:(20/154): python3-ceph-common-19.1.1-259.g91c8a 2.7 MB/s | 136 kB 00:00 2024-09-05T01:12:01.943 INFO:teuthology.orchestra.run.smithi145.stdout:(67/154): openssl-devel-3.2.2-4.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-05T01:12:01.947 INFO:teuthology.orchestra.run.smithi151.stdout:(59/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 202 kB/s | 160 kB 00:00 2024-09-05T01:12:01.985 INFO:teuthology.orchestra.run.smithi145.stdout:(68/154): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-05T01:12:01.987 INFO:teuthology.orchestra.run.smithi012.stdout:(21/154): python3-cephfs-19.1.1-259.g91c8a7e5.e 3.2 MB/s | 162 kB 00:00 2024-09-05T01:12:02.027 INFO:teuthology.orchestra.run.smithi145.stdout:(69/154): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-05T01:12:02.046 INFO:teuthology.orchestra.run.smithi012.stdout:(22/154): python3-rados-19.1.1-259.g91c8a7e5.el 5.4 MB/s | 321 kB 00:00 2024-09-05T01:12:02.052 INFO:teuthology.orchestra.run.smithi145.stdout:(70/154): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-05T01:12:02.096 INFO:teuthology.orchestra.run.smithi012.stdout:(23/154): python3-rbd-19.1.1-259.g91c8a7e5.el9. 5.9 MB/s | 301 kB 00:00 2024-09-05T01:12:02.119 INFO:teuthology.orchestra.run.smithi145.stdout:(71/154): openblas-openmp-0.3.26-2.el9.x86_64.r 15 MB/s | 4.9 MB 00:00 2024-09-05T01:12:02.163 INFO:teuthology.orchestra.run.smithi012.stdout:(24/154): python3-rgw-19.1.1-259.g91c8a7e5.el9. 1.5 MB/s | 99 kB 00:00 2024-09-05T01:12:02.179 INFO:teuthology.orchestra.run.smithi145.stdout:(72/154): protobuf-3.14.0-13.el9.x86_64.rpm 8.0 MB/s | 1.0 MB 00:00 2024-09-05T01:12:02.213 INFO:teuthology.orchestra.run.smithi012.stdout:(25/154): rbd-fuse-19.1.1-259.g91c8a7e5.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-05T01:12:02.278 INFO:teuthology.orchestra.run.smithi145.stdout:(73/154): python3-attrs-20.3.0-7.el9.noarch.rpm 552 kB/s | 87 kB 00:00 2024-09-05T01:12:02.320 INFO:teuthology.orchestra.run.smithi145.stdout:(74/154): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-05T01:12:02.404 INFO:teuthology.orchestra.run.smithi145.stdout:(75/154): postgresql-server-13.16-1.el9.x86_64. 15 MB/s | 5.8 MB 00:00 2024-09-05T01:12:02.422 INFO:teuthology.orchestra.run.smithi012.stdout:(26/154): ceph-osd-19.1.1-259.g91c8a7e5.el9.x86 4.6 MB/s | 17 MB 00:03 2024-09-05T01:12:02.429 INFO:teuthology.orchestra.run.smithi145.stdout:(76/154): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-05T01:12:02.454 INFO:teuthology.orchestra.run.smithi145.stdout:(77/154): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-05T01:12:02.472 INFO:teuthology.orchestra.run.smithi012.stdout:(27/154): rbd-nbd-19.1.1-259.g91c8a7e5.el9.x86_ 3.4 MB/s | 170 kB 00:00 2024-09-05T01:12:02.479 INFO:teuthology.orchestra.run.smithi145.stdout:(78/154): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-05T01:12:02.481 INFO:teuthology.orchestra.run.smithi151.stdout:(60/154): libuuid-devel-2.37.4-20.el9.x86_64.rp 46 kB/s | 24 kB 00:00 2024-09-05T01:12:02.505 INFO:teuthology.orchestra.run.smithi145.stdout:(79/154): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-05T01:12:02.531 INFO:teuthology.orchestra.run.smithi012.stdout:(28/154): rbd-mirror-19.1.1-259.g91c8a7e5.el9.x 9.8 MB/s | 3.1 MB 00:00 2024-09-05T01:12:02.538 INFO:teuthology.orchestra.run.smithi145.stdout:(80/154): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-05T01:12:02.556 INFO:teuthology.orchestra.run.smithi012.stdout:(29/154): ceph-grafana-dashboards-19.1.1-259.g9 382 kB/s | 32 kB 00:00 2024-09-05T01:12:02.563 INFO:teuthology.orchestra.run.smithi145.stdout:(81/154): python3-markupsafe-1.1.1-12.el9.x86_6 593 kB/s | 35 kB 00:00 2024-09-05T01:12:02.581 INFO:teuthology.orchestra.run.smithi012.stdout:(30/154): ceph-mgr-cephadm-19.1.1-259.g91c8a7e5 2.9 MB/s | 146 kB 00:00 2024-09-05T01:12:02.647 INFO:teuthology.orchestra.run.smithi145.stdout:(82/154): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-09-05T01:12:02.672 INFO:teuthology.orchestra.run.smithi145.stdout:(83/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-05T01:12:02.697 INFO:teuthology.orchestra.run.smithi145.stdout:(84/154): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-05T01:12:02.723 INFO:teuthology.orchestra.run.smithi145.stdout:(85/154): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-05T01:12:02.748 INFO:teuthology.orchestra.run.smithi145.stdout:(86/154): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-09-05T01:12:02.773 INFO:teuthology.orchestra.run.smithi145.stdout:(87/154): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-05T01:12:02.799 INFO:teuthology.orchestra.run.smithi145.stdout:(88/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-05T01:12:02.824 INFO:teuthology.orchestra.run.smithi145.stdout:(89/154): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-05T01:12:02.832 INFO:teuthology.orchestra.run.smithi012.stdout:(31/154): ceph-mgr-diskprediction-local-19.1.1- 30 MB/s | 7.4 MB 00:00 2024-09-05T01:12:02.849 INFO:teuthology.orchestra.run.smithi145.stdout:(90/154): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-05T01:12:02.874 INFO:teuthology.orchestra.run.smithi145.stdout:(91/154): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-05T01:12:02.882 INFO:teuthology.orchestra.run.smithi012.stdout:(32/154): ceph-mgr-modules-core-19.1.1-259.g91c 4.9 MB/s | 249 kB 00:00 2024-09-05T01:12:02.932 INFO:teuthology.orchestra.run.smithi012.stdout:(33/154): ceph-mgr-rook-19.1.1-259.g91c8a7e5.el 991 kB/s | 49 kB 00:00 2024-09-05T01:12:02.958 INFO:teuthology.orchestra.run.smithi145.stdout:(92/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-05T01:12:02.974 INFO:teuthology.orchestra.run.smithi012.stdout:(34/154): ceph-prometheus-alerts-19.1.1-259.g91 399 kB/s | 16 kB 00:00 2024-09-05T01:12:02.984 INFO:teuthology.orchestra.run.smithi145.stdout:(93/154): python3-toml-0.10.2-6.el9.noarch.rpm 382 kB/s | 42 kB 00:00 2024-09-05T01:12:03.009 INFO:teuthology.orchestra.run.smithi145.stdout:(94/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 878 kB/s | 44 kB 00:00 2024-09-05T01:12:03.024 INFO:teuthology.orchestra.run.smithi012.stdout:(35/154): ceph-volume-19.1.1-259.g91c8a7e5.el9. 5.6 MB/s | 285 kB 00:00 2024-09-05T01:12:03.032 INFO:teuthology.orchestra.run.smithi151.stdout:(61/154): librdkafka-1.6.1-102.el9.x86_64.rpm 481 kB/s | 662 kB 00:01 2024-09-05T01:12:03.034 INFO:teuthology.orchestra.run.smithi145.stdout:(95/154): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-05T01:12:03.059 INFO:teuthology.orchestra.run.smithi145.stdout:(96/154): qatlib-service-24.02.0-1.el9.x86_64.r 716 kB/s | 36 kB 00:00 2024-09-05T01:12:03.065 INFO:teuthology.orchestra.run.smithi151.stdout:(62/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 81 kB/s | 47 kB 00:00 2024-09-05T01:12:03.083 INFO:teuthology.orchestra.run.smithi012.stdout:(36/154): cephadm-19.1.1-259.g91c8a7e5.el9.noar 13 MB/s | 765 kB 00:00 2024-09-05T01:12:03.085 INFO:teuthology.orchestra.run.smithi145.stdout:(97/154): qatzip-libs-1.2.0-1.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-05T01:12:03.118 INFO:teuthology.orchestra.run.smithi145.stdout:(98/154): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-05T01:12:03.144 INFO:teuthology.orchestra.run.smithi145.stdout:(99/154): uuid-1.6.2-55.el9.x86_64.rpm 990 kB/s | 58 kB 00:00 2024-09-05T01:12:03.150 INFO:teuthology.orchestra.run.smithi012.stdout:(37/154): ceph-mgr-dashboard-19.1.1-259.g91c8a7 6.0 MB/s | 3.6 MB 00:00 2024-09-05T01:12:03.175 INFO:teuthology.orchestra.run.smithi012.stdout:(38/154): cephfs-top-19.1.1-259.g91c8a7e5.el9.n 198 kB/s | 18 kB 00:00 2024-09-05T01:12:03.178 INFO:teuthology.orchestra.run.smithi145.stdout:(100/154): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-05T01:12:03.202 INFO:teuthology.orchestra.run.smithi145.stdout:(101/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-05T01:12:03.215 INFO:teuthology.orchestra.run.smithi151.stdout:(63/154): libtool-2.4.6-46.el9.x86_64.rpm 427 kB/s | 581 kB 00:01 2024-09-05T01:12:03.228 INFO:teuthology.orchestra.run.smithi145.stdout:(102/154): zlib-devel-1.2.11-41.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-09-05T01:12:03.292 INFO:teuthology.orchestra.run.smithi012.stdout:(39/154): fuse-2.9.9-16.el9.x86_64.rpm 564 kB/s | 80 kB 00:00 2024-09-05T01:12:03.453 INFO:teuthology.orchestra.run.smithi145.stdout:(103/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-05T01:12:03.478 INFO:teuthology.orchestra.run.smithi145.stdout:(104/154): lua-devel-5.4.4-4.el9.x86_64.rpm 81 kB/s | 22 kB 00:00 2024-09-05T01:12:03.534 INFO:teuthology.orchestra.run.smithi012.stdout:(40/154): ceph-common-19.1.1-259.g91c8a7e5.el9. 3.0 MB/s | 21 MB 00:06 2024-09-05T01:12:03.537 INFO:teuthology.orchestra.run.smithi145.stdout:(105/154): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-05T01:12:03.559 INFO:teuthology.orchestra.run.smithi012.stdout:(41/154): libquadmath-11.5.0-2.el9.x86_64.rpm 716 kB/s | 191 kB 00:00 2024-09-05T01:12:03.562 INFO:teuthology.orchestra.run.smithi145.stdout:(106/154): grpc-data-1.46.7-10.el9.noarch.rpm 790 kB/s | 19 kB 00:00 2024-09-05T01:12:03.587 INFO:teuthology.orchestra.run.smithi145.stdout:(107/154): gperftools-libs-2.9.1-2.el9.x86_64.r 2.8 MB/s | 309 kB 00:00 2024-09-05T01:12:03.601 INFO:teuthology.orchestra.run.smithi012.stdout:(42/154): libgfortran-11.5.0-2.el9.x86_64.rpm 1.8 MB/s | 801 kB 00:00 2024-09-05T01:12:03.613 INFO:teuthology.orchestra.run.smithi145.stdout:(108/154): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-05T01:12:03.638 INFO:teuthology.orchestra.run.smithi145.stdout:(109/154): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-05T01:12:03.643 INFO:teuthology.orchestra.run.smithi012.stdout:(43/154): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-05T01:12:03.655 INFO:teuthology.orchestra.run.smithi145.stdout:(110/154): libunwind-1.6.2-1.el9.x86_64.rpm 4.0 MB/s | 67 kB 00:00 2024-09-05T01:12:03.685 INFO:teuthology.orchestra.run.smithi012.stdout:(44/154): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-09-05T01:12:03.688 INFO:teuthology.orchestra.run.smithi145.stdout:(111/154): protobuf-compiler-3.14.0-13.el9.x86_ 1.8 MB/s | 863 kB 00:00 2024-09-05T01:12:03.710 INFO:teuthology.orchestra.run.smithi012.stdout:(45/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2024-09-05T01:12:03.722 INFO:teuthology.orchestra.run.smithi145.stdout:(112/154): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-05T01:12:03.735 INFO:teuthology.orchestra.run.smithi012.stdout:(46/154): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-05T01:12:03.761 INFO:teuthology.orchestra.run.smithi012.stdout:(47/154): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-05T01:12:03.764 INFO:teuthology.orchestra.run.smithi145.stdout:(113/154): python3-asyncssh-2.13.2-5.el9.noarch 14 MB/s | 548 kB 00:00 2024-09-05T01:12:03.786 INFO:teuthology.orchestra.run.smithi012.stdout:(48/154): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-05T01:12:03.789 INFO:teuthology.orchestra.run.smithi145.stdout:(114/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-05T01:12:03.799 INFO:teuthology.orchestra.run.smithi151.stdout:(64/154): openblas-0.3.26-2.el9.x86_64.rpm 66 kB/s | 38 kB 00:00 2024-09-05T01:12:03.814 INFO:teuthology.orchestra.run.smithi145.stdout:(115/154): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-05T01:12:03.840 INFO:teuthology.orchestra.run.smithi145.stdout:(116/154): python3-certifi-2023.05.07-4.el9.noa 568 kB/s | 14 kB 00:00 2024-09-05T01:12:03.855 INFO:teuthology.orchestra.run.smithi151.stdout:(65/154): lua-5.4.4-4.el9.x86_64.rpm 239 kB/s | 188 kB 00:00 2024-09-05T01:12:03.873 INFO:teuthology.orchestra.run.smithi145.stdout:(117/154): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-05T01:12:03.886 INFO:teuthology.orchestra.run.smithi012.stdout:(49/154): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-09-05T01:12:03.911 INFO:teuthology.orchestra.run.smithi012.stdout:(50/154): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-09-05T01:12:03.915 INFO:teuthology.orchestra.run.smithi145.stdout:(118/154): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.6 MB/s | 839 kB 00:00 2024-09-05T01:12:03.949 INFO:teuthology.orchestra.run.smithi145.stdout:(119/154): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-09-05T01:12:03.962 INFO:teuthology.orchestra.run.smithi012.stdout:(51/154): elfutils-libelf-devel-0.191-4.el9.x86 289 kB/s | 22 kB 00:00 2024-09-05T01:12:03.974 INFO:teuthology.orchestra.run.smithi145.stdout:(120/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-05T01:12:03.995 INFO:teuthology.orchestra.run.smithi012.stdout:(52/154): bison-3.7.4-5.el9.x86_64.rpm 3.9 MB/s | 943 kB 00:00 2024-09-05T01:12:03.999 INFO:teuthology.orchestra.run.smithi145.stdout:(121/154): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-05T01:12:04.024 INFO:teuthology.orchestra.run.smithi145.stdout:(122/154): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-05T01:12:04.046 INFO:teuthology.orchestra.run.smithi012.stdout:(53/154): flexiblas-3.0.4-8.el9.x86_64.rpm 392 kB/s | 33 kB 00:00 2024-09-05T01:12:04.047 INFO:teuthology.orchestra.run.smithi151.stdout:(66/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 288 kB/s | 292 kB 00:01 2024-09-05T01:12:04.050 INFO:teuthology.orchestra.run.smithi145.stdout:(123/154): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-05T01:12:04.067 INFO:teuthology.orchestra.run.smithi145.stdout:(124/154): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-05T01:12:04.070 INFO:teuthology.orchestra.run.smithi012.stdout:(54/154): flex-2.6.4-9.el9.x86_64.rpm 1.9 MB/s | 313 kB 00:00 2024-09-05T01:12:04.084 INFO:teuthology.orchestra.run.smithi145.stdout:(125/154): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-05T01:12:04.101 INFO:teuthology.orchestra.run.smithi145.stdout:(126/154): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-05T01:12:04.118 INFO:teuthology.orchestra.run.smithi145.stdout:(127/154): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-05T01:12:04.121 INFO:teuthology.orchestra.run.smithi012.stdout:(55/154): flexiblas-openblas-openmp-3.0.4-8.el9 243 kB/s | 18 kB 00:00 2024-09-05T01:12:04.171 INFO:teuthology.orchestra.run.smithi012.stdout:(56/154): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-09-05T01:12:04.185 INFO:teuthology.orchestra.run.smithi145.stdout:(128/154): libarrow-9.0.0-11.el9.x86_64.rpm 7.1 MB/s | 4.4 MB 00:00 2024-09-05T01:12:04.197 INFO:teuthology.orchestra.run.smithi012.stdout:(57/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-05T01:12:04.202 INFO:teuthology.orchestra.run.smithi145.stdout:(129/154): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-05T01:12:04.227 INFO:teuthology.orchestra.run.smithi145.stdout:(130/154): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-05T01:12:04.247 INFO:teuthology.orchestra.run.smithi012.stdout:(58/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 604 kB/s | 45 kB 00:00 2024-09-05T01:12:04.252 INFO:teuthology.orchestra.run.smithi145.stdout:(131/154): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-05T01:12:04.286 INFO:teuthology.orchestra.run.smithi145.stdout:(132/154): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-05T01:12:04.319 INFO:teuthology.orchestra.run.smithi145.stdout:(133/154): python3-kubernetes-26.1.0-2.el9.noar 5.1 MB/s | 1.0 MB 00:00 2024-09-05T01:12:04.344 INFO:teuthology.orchestra.run.smithi145.stdout:(134/154): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-09-05T01:12:04.364 INFO:teuthology.orchestra.run.smithi012.stdout:(59/154): libtool-2.4.6-46.el9.x86_64.rpm 4.9 MB/s | 581 kB 00:00 2024-09-05T01:12:04.370 INFO:teuthology.orchestra.run.smithi145.stdout:(135/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-05T01:12:04.395 INFO:teuthology.orchestra.run.smithi145.stdout:(136/154): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-05T01:12:04.421 INFO:teuthology.orchestra.run.smithi145.stdout:(137/154): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-05T01:12:04.431 INFO:teuthology.orchestra.run.smithi012.stdout:(60/154): libuuid-devel-2.37.4-20.el9.x86_64.rp 367 kB/s | 24 kB 00:00 2024-09-05T01:12:04.446 INFO:teuthology.orchestra.run.smithi145.stdout:(138/154): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-05T01:12:04.456 INFO:teuthology.orchestra.run.smithi012.stdout:(61/154): librdkafka-1.6.1-102.el9.x86_64.rpm 2.5 MB/s | 662 kB 00:00 2024-09-05T01:12:04.488 INFO:teuthology.orchestra.run.smithi145.stdout:(139/154): python3-grpcio-1.46.7-10.el9.x86_64. 4.0 MB/s | 2.0 MB 00:00 2024-09-05T01:12:04.507 INFO:teuthology.orchestra.run.smithi012.stdout:(62/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 632 kB/s | 47 kB 00:00 2024-09-05T01:12:04.513 INFO:teuthology.orchestra.run.smithi145.stdout:(140/154): python3-tempora-5.0.0-2.el9.noarch.r 535 kB/s | 36 kB 00:00 2024-09-05T01:12:04.532 INFO:teuthology.orchestra.run.smithi012.stdout:(63/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-05T01:12:04.538 INFO:teuthology.orchestra.run.smithi145.stdout:(141/154): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-09-05T01:12:04.557 INFO:teuthology.orchestra.run.smithi012.stdout:(64/154): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-05T01:12:04.563 INFO:teuthology.orchestra.run.smithi145.stdout:(142/154): python3-typing-extensions-4.12.2-2.e 988 kB/s | 74 kB 00:00 2024-09-05T01:12:04.589 INFO:teuthology.orchestra.run.smithi145.stdout:(143/154): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-05T01:12:04.599 INFO:teuthology.orchestra.run.smithi012.stdout:(65/154): openblas-0.3.26-2.el9.x86_64.rpm 576 kB/s | 38 kB 00:00 2024-09-05T01:12:04.614 INFO:teuthology.orchestra.run.smithi145.stdout:(144/154): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-05T01:12:04.639 INFO:teuthology.orchestra.run.smithi145.stdout:(145/154): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-05T01:12:04.665 INFO:teuthology.orchestra.run.smithi145.stdout:(146/154): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-05T01:12:04.690 INFO:teuthology.orchestra.run.smithi145.stdout:(147/154): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-05T01:12:04.740 INFO:teuthology.orchestra.run.smithi145.stdout:(148/154): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-05T01:12:04.866 INFO:teuthology.orchestra.run.smithi012.stdout:(66/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.4 MB/s | 3.0 MB 00:00 2024-09-05T01:12:04.965 INFO:teuthology.orchestra.run.smithi145.stdout:(149/154): librados2-19.1.1-259.g91c8a7e5.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-05T01:12:05.047 INFO:teuthology.orchestra.run.smithi151.stdout:(67/154): postgresql-13.16-1.el9.x86_64.rpm 1.6 MB/s | 1.6 MB 00:00 2024-09-05T01:12:05.091 INFO:teuthology.orchestra.run.smithi145.stdout:(150/154): librbd1-19.1.1-259.g91c8a7e5.el9.x86 7.9 MB/s | 3.2 MB 00:00 2024-09-05T01:12:05.239 INFO:teuthology.orchestra.run.smithi151.stdout:(68/154): openssl-devel-3.2.2-4.el9.x86_64.rpm 3.2 MB/s | 4.4 MB 00:01 2024-09-05T01:12:05.308 INFO:teuthology.orchestra.run.smithi012.stdout:(67/154): postgresql-13.16-1.el9.x86_64.rpm 3.6 MB/s | 1.6 MB 00:00 2024-09-05T01:12:05.379 INFO:teuthology.orchestra.run.smithi145.stdout:(151/154): NetworkManager-team-1.48.10-1.el9.x8 140 kB/s | 40 kB 00:00 2024-09-05T01:12:05.575 INFO:teuthology.orchestra.run.smithi012.stdout:(68/154): postgresql-contrib-13.16-1.el9.x86_64 3.3 MB/s | 910 kB 00:00 2024-09-05T01:12:05.616 INFO:teuthology.orchestra.run.smithi145.stdout:(152/154): NetworkManager-1.48.10-1.el9.x86_64. 2.7 MB/s | 2.3 MB 00:00 2024-09-05T01:12:05.650 INFO:teuthology.orchestra.run.smithi012.stdout:(69/154): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-05T01:12:05.733 INFO:teuthology.orchestra.run.smithi145.stdout:(153/154): NetworkManager-tui-1.48.10-1.el9.x86 701 kB/s | 248 kB 00:00 2024-09-05T01:12:05.756 INFO:teuthology.orchestra.run.smithi151.stdout:(69/154): openblas-openmp-0.3.26-2.el9.x86_64.r 2.5 MB/s | 4.9 MB 00:01 2024-09-05T01:12:05.775 INFO:teuthology.orchestra.run.smithi012.stdout:(70/154): openssl-devel-3.2.2-4.el9.x86_64.rpm 3.8 MB/s | 4.4 MB 00:01 2024-09-05T01:12:05.808 INFO:teuthology.orchestra.run.smithi145.stdout:(154/154): NetworkManager-libnm-1.48.10-1.el9.x 2.1 MB/s | 1.8 MB 00:00 2024-09-05T01:12:05.814 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-05T01:12:05.814 INFO:teuthology.orchestra.run.smithi145.stdout:Total 19 MB/s | 222 MB 00:11 2024-09-05T01:12:05.909 INFO:teuthology.orchestra.run.smithi012.stdout:(71/154): openblas-openmp-0.3.26-2.el9.x86_64.r 3.7 MB/s | 4.9 MB 00:01 2024-09-05T01:12:05.965 INFO:teuthology.orchestra.run.smithi151.stdout:(70/154): postgresql-private-libs-13.16-1.el9.x 189 kB/s | 137 kB 00:00 2024-09-05T01:12:05.967 INFO:teuthology.orchestra.run.smithi012.stdout:(72/154): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-05T01:12:06.023 INFO:teuthology.orchestra.run.smithi151.stdout:(71/154): postgresql-contrib-13.16-1.el9.x86_64 932 kB/s | 910 kB 00:00 2024-09-05T01:12:06.142 INFO:teuthology.orchestra.run.smithi012.stdout:(73/154): protobuf-3.14.0-13.el9.x86_64.rpm 2.8 MB/s | 1.0 MB 00:00 2024-09-05T01:12:06.210 INFO:teuthology.orchestra.run.smithi012.stdout:(74/154): python3-colorama-0.4.6-3.el9.noarch.r 919 kB/s | 61 kB 00:00 2024-09-05T01:12:06.310 INFO:teuthology.orchestra.run.smithi012.stdout:(75/154): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-05T01:12:06.402 INFO:teuthology.orchestra.run.smithi012.stdout:(76/154): python3-jinja2-2.11.3-6.el9.noarch.rp 2.7 MB/s | 248 kB 00:00 2024-09-05T01:12:06.460 INFO:teuthology.orchestra.run.smithi012.stdout:(77/154): python3-jsonpatch-1.21-16.el9.noarch. 441 kB/s | 26 kB 00:00 2024-09-05T01:12:06.519 INFO:teuthology.orchestra.run.smithi012.stdout:(78/154): python3-jsonpointer-2.0-4.el9.noarch. 330 kB/s | 19 kB 00:00 2024-09-05T01:12:06.594 INFO:teuthology.orchestra.run.smithi012.stdout:(79/154): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-05T01:12:06.653 INFO:teuthology.orchestra.run.smithi012.stdout:(80/154): python3-markupsafe-1.1.1-12.el9.x86_6 597 kB/s | 35 kB 00:00 2024-09-05T01:12:06.690 INFO:teuthology.orchestra.run.smithi151.stdout:(72/154): python3-attrs-20.3.0-7.el9.noarch.rpm 131 kB/s | 87 kB 00:00 2024-09-05T01:12:06.924 INFO:teuthology.orchestra.run.smithi151.stdout:(73/154): postgresql-server-13.16-1.el9.x86_64. 4.9 MB/s | 5.8 MB 00:01 2024-09-05T01:12:06.966 INFO:teuthology.orchestra.run.smithi151.stdout:(74/154): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:01 2024-09-05T01:12:06.976 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-05T01:12:07.109 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-05T01:12:07.109 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-05T01:12:07.519 INFO:teuthology.orchestra.run.smithi012.stdout:(81/154): postgresql-server-13.16-1.el9.x86_64. 3.1 MB/s | 5.8 MB 00:01 2024-09-05T01:12:07.550 INFO:teuthology.orchestra.run.smithi151.stdout:(75/154): python3-colorama-0.4.6-3.el9.noarch.r 99 kB/s | 61 kB 00:00 2024-09-05T01:12:07.612 INFO:teuthology.orchestra.run.smithi012.stdout:(82/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-09-05T01:12:07.704 INFO:teuthology.orchestra.run.smithi012.stdout:(83/154): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-05T01:12:07.754 INFO:teuthology.orchestra.run.smithi012.stdout:(84/154): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-05T01:12:07.808 INFO:teuthology.orchestra.run.smithi151.stdout:(76/154): python3-devel-3.9.19-8.el9.x86_64.rpm 291 kB/s | 245 kB 00:00 2024-09-05T01:12:07.812 INFO:teuthology.orchestra.run.smithi012.stdout:(85/154): python3-prettytable-0.7.2-27.el9.noar 723 kB/s | 42 kB 00:00 2024-09-05T01:12:07.930 INFO:teuthology.orchestra.run.smithi012.stdout:(86/154): python3-babel-2.9.1-2.el9.noarch.rpm 3.0 MB/s | 6.0 MB 00:01 2024-09-05T01:12:07.996 INFO:teuthology.orchestra.run.smithi012.stdout:(87/154): python3-protobuf-3.14.0-13.el9.noarch 1.4 MB/s | 269 kB 00:00 2024-09-05T01:12:08.022 INFO:teuthology.orchestra.run.smithi012.stdout:(88/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-09-05T01:12:08.080 INFO:teuthology.orchestra.run.smithi012.stdout:(89/154): python3-pytz-2021.1-5.el9.noarch.rpm 877 kB/s | 51 kB 00:00 2024-09-05T01:12:08.139 INFO:teuthology.orchestra.run.smithi012.stdout:(90/154): python3-requests-oauthlib-1.3.0-12.el 924 kB/s | 54 kB 00:00 2024-09-05T01:12:08.164 INFO:teuthology.orchestra.run.smithi012.stdout:(91/154): python3-pyasn1-modules-0.4.8-6.el9.no 1.6 MB/s | 279 kB 00:00 2024-09-05T01:12:08.223 INFO:teuthology.orchestra.run.smithi012.stdout:(92/154): python3-toml-0.10.2-6.el9.noarch.rpm 715 kB/s | 42 kB 00:00 2024-09-05T01:12:08.282 INFO:teuthology.orchestra.run.smithi012.stdout:(93/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 761 kB/s | 44 kB 00:00 2024-09-05T01:12:08.367 INFO:teuthology.orchestra.run.smithi151.stdout:(77/154): python3-jsonpatch-1.21-16.el9.noarch. 46 kB/s | 26 kB 00:00 2024-09-05T01:12:08.373 INFO:teuthology.orchestra.run.smithi012.stdout:(94/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.0 MB/s | 5.1 MB 00:01 2024-09-05T01:12:08.490 INFO:teuthology.orchestra.run.smithi012.stdout:(95/154): qatlib-service-24.02.0-1.el9.x86_64.r 308 kB/s | 36 kB 00:00 2024-09-05T01:12:08.492 INFO:teuthology.orchestra.run.smithi151.stdout:(78/154): python3-jinja2-2.11.3-6.el9.noarch.rp 263 kB/s | 248 kB 00:00 2024-09-05T01:12:08.516 INFO:teuthology.orchestra.run.smithi012.stdout:(96/154): qatlib-24.02.0-1.el9.x86_64.rpm 944 kB/s | 221 kB 00:00 2024-09-05T01:12:08.566 INFO:teuthology.orchestra.run.smithi012.stdout:(97/154): qatzip-libs-1.2.0-1.el9.x86_64.rpm 632 kB/s | 47 kB 00:00 2024-09-05T01:12:08.625 INFO:teuthology.orchestra.run.smithi012.stdout:(98/154): uuid-1.6.2-55.el9.x86_64.rpm 993 kB/s | 58 kB 00:00 2024-09-05T01:12:08.691 INFO:teuthology.orchestra.run.smithi012.stdout:(99/154): socat-1.7.4.1-6.el9.x86_64.rpm 1.7 MB/s | 304 kB 00:00 2024-09-05T01:12:08.717 INFO:teuthology.orchestra.run.smithi012.stdout:(100/154): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.0 MB/s | 96 kB 00:00 2024-09-05T01:12:08.775 INFO:teuthology.orchestra.run.smithi012.stdout:(101/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 764 kB/s | 64 kB 00:00 2024-09-05T01:12:08.801 INFO:teuthology.orchestra.run.smithi012.stdout:(102/154): zlib-devel-1.2.11-41.el9.x86_64.rpm 538 kB/s | 45 kB 00:00 2024-09-05T01:12:08.859 INFO:teuthology.orchestra.run.smithi151.stdout:(79/154): python3-jsonpointer-2.0-4.el9.noarch. 39 kB/s | 19 kB 00:00 2024-09-05T01:12:08.863 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-05T01:12:08.863 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-05T01:12:08.918 INFO:teuthology.orchestra.run.smithi012.stdout:(103/154): lua-devel-5.4.4-4.el9.x86_64.rpm 157 kB/s | 22 kB 00:00 2024-09-05T01:12:08.985 INFO:teuthology.orchestra.run.smithi012.stdout:(104/154): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-05T01:12:09.018 INFO:teuthology.orchestra.run.smithi012.stdout:(105/154): gperftools-libs-2.9.1-2.el9.x86_64.r 9.2 MB/s | 309 kB 00:00 2024-09-05T01:12:09.043 INFO:teuthology.orchestra.run.smithi012.stdout:(106/154): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-05T01:12:09.119 INFO:teuthology.orchestra.run.smithi012.stdout:(107/154): protobuf-compiler-3.14.0-13.el9.x86_ 2.7 MB/s | 863 kB 00:00 2024-09-05T01:12:09.169 INFO:teuthology.orchestra.run.smithi012.stdout:(108/154): libarrow-doc-9.0.0-11.el9.noarch.rpm 521 kB/s | 26 kB 00:00 2024-09-05T01:12:09.194 INFO:teuthology.orchestra.run.smithi012.stdout:(109/154): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-09-05T01:12:09.219 INFO:teuthology.orchestra.run.smithi012.stdout:(110/154): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-05T01:12:09.245 INFO:teuthology.orchestra.run.smithi012.stdout:(111/154): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-05T01:12:09.276 INFO:teuthology.orchestra.run.smithi151.stdout:(80/154): python3-mako-1.1.4-6.el9.noarch.rpm 220 kB/s | 172 kB 00:00 2024-09-05T01:12:09.337 INFO:teuthology.orchestra.run.smithi012.stdout:(112/154): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-05T01:12:09.370 INFO:teuthology.orchestra.run.smithi012.stdout:(113/154): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.6 MB/s | 839 kB 00:00 2024-09-05T01:12:09.395 INFO:teuthology.orchestra.run.smithi012.stdout:(114/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-05T01:12:09.429 INFO:teuthology.orchestra.run.smithi012.stdout:(115/154): python3-cachetools-4.2.4-1.el9.noarc 962 kB/s | 32 kB 00:00 2024-09-05T01:12:09.435 INFO:teuthology.orchestra.run.smithi151.stdout:(81/154): python3-markupsafe-1.1.1-12.el9.x86_6 60 kB/s | 35 kB 00:00 2024-09-05T01:12:09.454 INFO:teuthology.orchestra.run.smithi012.stdout:(116/154): python3-certifi-2023.05.07-4.el9.noa 570 kB/s | 14 kB 00:00 2024-09-05T01:12:09.488 INFO:teuthology.orchestra.run.smithi012.stdout:(117/154): python3-asyncssh-2.13.2-5.el9.noarch 3.5 MB/s | 548 kB 00:00 2024-09-05T01:12:09.513 INFO:teuthology.orchestra.run.smithi012.stdout:(118/154): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-05T01:12:09.547 INFO:teuthology.orchestra.run.smithi012.stdout:(119/154): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-05T01:12:09.573 INFO:teuthology.orchestra.run.smithi012.stdout:(120/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-09-05T01:12:09.598 INFO:teuthology.orchestra.run.smithi012.stdout:(121/154): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-05T01:12:09.631 INFO:teuthology.orchestra.run.smithi012.stdout:(122/154): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-05T01:12:09.657 INFO:teuthology.orchestra.run.smithi012.stdout:(123/154): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-05T01:12:09.682 INFO:teuthology.orchestra.run.smithi012.stdout:(124/154): python3-jaraco-classes-3.2.1-5.el9.n 719 kB/s | 18 kB 00:00 2024-09-05T01:12:09.707 INFO:teuthology.orchestra.run.smithi012.stdout:(125/154): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-09-05T01:12:09.732 INFO:teuthology.orchestra.run.smithi012.stdout:(126/154): python3-jaraco-functools-3.5.0-2.el9 785 kB/s | 19 kB 00:00 2024-09-05T01:12:09.758 INFO:teuthology.orchestra.run.smithi012.stdout:(127/154): python3-jaraco-text-3.2.0-6.el9.noar 791 kB/s | 20 kB 00:00 2024-09-05T01:12:09.808 INFO:teuthology.orchestra.run.smithi012.stdout:(128/154): python3-kubernetes-26.1.0-2.el9.noar 21 MB/s | 1.0 MB 00:00 2024-09-05T01:12:09.833 INFO:teuthology.orchestra.run.smithi012.stdout:(129/154): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-05T01:12:09.858 INFO:teuthology.orchestra.run.smithi012.stdout:(130/154): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-05T01:12:09.883 INFO:teuthology.orchestra.run.smithi012.stdout:(131/154): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-05T01:12:09.934 INFO:teuthology.orchestra.run.smithi012.stdout:(132/154): python3-grpcio-1.46.7-10.el9.x86_64. 5.6 MB/s | 2.0 MB 00:00 2024-09-05T01:12:09.959 INFO:teuthology.orchestra.run.smithi012.stdout:(133/154): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-05T01:12:10.001 INFO:teuthology.orchestra.run.smithi012.stdout:(134/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-09-05T01:12:10.027 INFO:teuthology.orchestra.run.smithi012.stdout:(135/154): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-09-05T01:12:10.043 INFO:teuthology.orchestra.run.smithi012.stdout:(136/154): python3-pyperclip-1.8.2-2.el9.noarch 676 kB/s | 28 kB 00:00 2024-09-05T01:12:10.052 INFO:teuthology.orchestra.run.smithi151.stdout:(82/154): python3-babel-2.9.1-2.el9.noarch.rpm 1.8 MB/s | 6.0 MB 00:03 2024-09-05T01:12:10.061 INFO:teuthology.orchestra.run.smithi012.stdout:(137/154): python3-repoze-lru-0.7-16.el9.noarch 920 kB/s | 31 kB 00:00 2024-09-05T01:12:10.078 INFO:teuthology.orchestra.run.smithi012.stdout:(138/154): python3-rsa-4.9-2.el9.noarch.rpm 3.4 MB/s | 59 kB 00:00 2024-09-05T01:12:10.103 INFO:teuthology.orchestra.run.smithi012.stdout:(139/154): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-05T01:12:10.137 INFO:teuthology.orchestra.run.smithi012.stdout:(140/154): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-09-05T01:12:10.162 INFO:teuthology.orchestra.run.smithi012.stdout:(141/154): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-09-05T01:12:10.217 INFO:teuthology.orchestra.run.smithi012.stdout:(142/154): python3-websocket-client-1.2.3-2.el9 1.6 MB/s | 90 kB 00:00 2024-09-05T01:12:10.246 INFO:teuthology.orchestra.run.smithi012.stdout:(143/154): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-05T01:12:10.271 INFO:teuthology.orchestra.run.smithi012.stdout:(144/154): python3-zc-lockfile-2.0-10.el9.noarc 807 kB/s | 20 kB 00:00 2024-09-05T01:12:10.296 INFO:teuthology.orchestra.run.smithi012.stdout:(145/154): python3-werkzeug-2.0.3-3.el9.1.noarc 5.3 MB/s | 427 kB 00:00 2024-09-05T01:12:10.298 INFO:teuthology.orchestra.run.smithi151.stdout:(83/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 290 kB/s | 250 kB 00:00 2024-09-05T01:12:10.322 INFO:teuthology.orchestra.run.smithi012.stdout:(146/154): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-05T01:12:10.380 INFO:teuthology.orchestra.run.smithi012.stdout:(147/154): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-05T01:12:10.570 INFO:teuthology.orchestra.run.smithi151.stdout:(84/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.9 MB/s | 5.1 MB 00:01 2024-09-05T01:12:10.581 INFO:teuthology.orchestra.run.smithi012.stdout:(148/154): librados2-19.1.1-259.g91c8a7e5.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-05T01:12:10.764 INFO:teuthology.orchestra.run.smithi012.stdout:(149/154): NetworkManager-1.48.10-1.el9.x86_64. 13 MB/s | 2.3 MB 00:00 2024-09-05T01:12:10.848 INFO:teuthology.orchestra.run.smithi012.stdout:(150/154): NetworkManager-libnm-1.48.10-1.el9.x 22 MB/s | 1.8 MB 00:00 2024-09-05T01:12:10.890 INFO:teuthology.orchestra.run.smithi012.stdout:(151/154): NetworkManager-team-1.48.10-1.el9.x8 978 kB/s | 40 kB 00:00 2024-09-05T01:12:10.932 INFO:teuthology.orchestra.run.smithi012.stdout:(152/154): NetworkManager-tui-1.48.10-1.el9.x86 5.9 MB/s | 248 kB 00:00 2024-09-05T01:12:11.024 INFO:teuthology.orchestra.run.smithi012.stdout:(153/154): librbd1-19.1.1-259.g91c8a7e5.el9.x86 4.9 MB/s | 3.2 MB 00:00 2024-09-05T01:12:11.053 INFO:teuthology.orchestra.run.smithi151.stdout:(85/154): python3-packaging-20.9-5.el9.noarch.r 102 kB/s | 77 kB 00:00 2024-09-05T01:12:11.078 INFO:teuthology.orchestra.run.smithi151.stdout:(86/154): python3-oauthlib-3.1.1-5.el9.noarch.r 217 kB/s | 222 kB 00:01 2024-09-05T01:12:11.170 INFO:teuthology.orchestra.run.smithi151.stdout:(87/154): python3-prettytable-0.7.2-27.el9.noar 71 kB/s | 42 kB 00:00 2024-09-05T01:12:11.872 INFO:teuthology.orchestra.run.smithi151.stdout:(88/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 200 kB/s | 159 kB 00:00 2024-09-05T01:12:12.013 INFO:teuthology.orchestra.run.smithi151.stdout:(89/154): python3-protobuf-3.14.0-13.el9.noarch 281 kB/s | 269 kB 00:00 2024-09-05T01:12:12.147 INFO:teuthology.orchestra.run.smithi151.stdout:(90/154): python3-pyasn1-modules-0.4.8-6.el9.no 286 kB/s | 279 kB 00:00 2024-09-05T01:12:12.472 INFO:teuthology.orchestra.run.smithi151.stdout:(91/154): python3-pytz-2021.1-5.el9.noarch.rpm 85 kB/s | 51 kB 00:00 2024-09-05T01:12:12.622 INFO:teuthology.orchestra.run.smithi151.stdout:(92/154): python3-requests-oauthlib-1.3.0-12.el 88 kB/s | 54 kB 00:00 2024-09-05T01:12:13.056 INFO:teuthology.orchestra.run.smithi151.stdout:(93/154): python3-toml-0.10.2-6.el9.noarch.rpm 71 kB/s | 42 kB 00:00 2024-09-05T01:12:13.248 INFO:teuthology.orchestra.run.smithi151.stdout:(94/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 71 kB/s | 44 kB 00:00 2024-09-05T01:12:13.679 INFO:teuthology.orchestra.run.smithi012.stdout:(154/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.9 MB/s | 16 MB 00:05 2024-09-05T01:12:13.685 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-05T01:12:13.685 INFO:teuthology.orchestra.run.smithi012.stdout:Total 13 MB/s | 222 MB 00:17 2024-09-05T01:12:13.815 INFO:teuthology.orchestra.run.smithi151.stdout:(95/154): qatlib-service-24.02.0-1.el9.x86_64.r 63 kB/s | 36 kB 00:00 2024-09-05T01:12:13.915 INFO:teuthology.orchestra.run.smithi151.stdout:(96/154): qatlib-24.02.0-1.el9.x86_64.rpm 257 kB/s | 221 kB 00:00 2024-09-05T01:12:14.391 INFO:teuthology.orchestra.run.smithi151.stdout:(97/154): qatzip-libs-1.2.0-1.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-09-05T01:12:14.824 INFO:teuthology.orchestra.run.smithi151.stdout:(98/154): socat-1.7.4.1-6.el9.x86_64.rpm 335 kB/s | 304 kB 00:00 2024-09-05T01:12:14.885 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-05T01:12:14.952 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/160 2024-09-05T01:12:14.999 INFO:teuthology.orchestra.run.smithi151.stdout:(99/154): uuid-1.6.2-55.el9.x86_64.rpm 95 kB/s | 58 kB 00:00 2024-09-05T01:12:15.002 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/160 2024-09-05T01:12:15.219 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/160 2024-09-05T01:12:15.550 INFO:teuthology.orchestra.run.smithi151.stdout:(100/154): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 132 kB/s | 96 kB 00:00 2024-09-05T01:12:15.623 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/160 2024-09-05T01:12:15.633 INFO:teuthology.orchestra.run.smithi151.stdout:(101/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 100 kB/s | 64 kB 00:00 2024-09-05T01:12:15.661 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 5/160 2024-09-05T01:12:15.691 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-09-05T01:12:15.708 INFO:teuthology.orchestra.run.smithi151.stdout:(102/154): lua-devel-5.4.4-4.el9.x86_64.rpm 299 kB/s | 22 kB 00:00 2024-09-05T01:12:15.784 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 5/160 2024-09-05T01:12:15.821 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 6/160 2024-09-05T01:12:15.864 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-09-05T01:12:15.864 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-09-05T01:12:15.895 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 6/160 2024-09-05T01:12:15.926 INFO:teuthology.orchestra.run.smithi151.stdout:(103/154): protobuf-compiler-3.14.0-13.el9.x86_ 3.9 MB/s | 863 kB 00:00 2024-09-05T01:12:15.937 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rados-2:19.1.1-259.g91c8a7e5.el9.x86_64 7/160 2024-09-05T01:12:15.975 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/160 2024-09-05T01:12:15.976 INFO:teuthology.orchestra.run.smithi151.stdout:(104/154): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-05T01:12:16.002 INFO:teuthology.orchestra.run.smithi151.stdout:(105/154): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-09-05T01:12:16.010 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/160 2024-09-05T01:12:16.027 INFO:teuthology.orchestra.run.smithi151.stdout:(106/154): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-05T01:12:16.136 INFO:teuthology.orchestra.run.smithi151.stdout:(107/154): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-05T01:12:16.160 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/160 2024-09-05T01:12:16.161 INFO:teuthology.orchestra.run.smithi151.stdout:(108/154): zlib-devel-1.2.11-41.el9.x86_64.rpm 73 kB/s | 45 kB 00:00 2024-09-05T01:12:16.186 INFO:teuthology.orchestra.run.smithi151.stdout:(109/154): libarrow-doc-9.0.0-11.el9.noarch.rpm 517 kB/s | 26 kB 00:00 2024-09-05T01:12:16.214 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/160 2024-09-05T01:12:16.220 INFO:teuthology.orchestra.run.smithi151.stdout:(110/154): libunwind-1.6.2-1.el9.x86_64.rpm 2.5 MB/s | 67 kB 00:00 2024-09-05T01:12:16.243 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 12/160 2024-09-05T01:12:16.245 INFO:teuthology.orchestra.run.smithi151.stdout:(111/154): liboath-2.6.7-2.el9.x86_64.rpm 578 kB/s | 49 kB 00:00 2024-09-05T01:12:16.263 INFO:teuthology.orchestra.run.smithi151.stdout:(112/154): luarocks-3.9.2-5.el9.noarch.rpm 3.7 MB/s | 151 kB 00:00 2024-09-05T01:12:16.345 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 12/160 2024-09-05T01:12:16.369 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_ 13/160 2024-09-05T01:12:16.414 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_ 13/160 2024-09-05T01:12:16.430 INFO:teuthology.orchestra.run.smithi151.stdout:(113/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-09-05T01:12:16.436 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/160 2024-09-05T01:12:16.455 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/160 2024-09-05T01:12:16.472 INFO:teuthology.orchestra.run.smithi151.stdout:(114/154): python3-asyncssh-2.13.2-5.el9.noarch 2.6 MB/s | 548 kB 00:00 2024-09-05T01:12:16.497 INFO:teuthology.orchestra.run.smithi151.stdout:(115/154): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2024-09-05T01:12:16.522 INFO:teuthology.orchestra.run.smithi151.stdout:(116/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 472 kB/s | 43 kB 00:00 2024-09-05T01:12:16.547 INFO:teuthology.orchestra.run.smithi151.stdout:(117/154): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-05T01:12:16.590 INFO:teuthology.orchestra.run.smithi151.stdout:(118/154): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.4 MB/s | 839 kB 00:00 2024-09-05T01:12:16.615 INFO:teuthology.orchestra.run.smithi151.stdout:(119/154): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-09-05T01:12:16.640 INFO:teuthology.orchestra.run.smithi151.stdout:(120/154): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-09-05T01:12:16.646 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/160 2024-09-05T01:12:16.666 INFO:teuthology.orchestra.run.smithi151.stdout:(121/154): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-05T01:12:16.691 INFO:teuthology.orchestra.run.smithi151.stdout:(122/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.9 MB/s | 303 kB 00:00 2024-09-05T01:12:16.725 INFO:teuthology.orchestra.run.smithi151.stdout:(123/154): python3-jaraco-8.2.1-3.el9.noarch.rp 319 kB/s | 11 kB 00:00 2024-09-05T01:12:16.750 INFO:teuthology.orchestra.run.smithi151.stdout:(124/154): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-09-05T01:12:16.776 INFO:teuthology.orchestra.run.smithi151.stdout:(125/154): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-05T01:12:16.801 INFO:teuthology.orchestra.run.smithi151.stdout:(126/154): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-05T01:12:16.803 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/160 2024-09-05T01:12:16.826 INFO:teuthology.orchestra.run.smithi151.stdout:(127/154): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-05T01:12:16.852 INFO:teuthology.orchestra.run.smithi151.stdout:(128/154): python3-jaraco-text-3.2.0-6.el9.noar 388 kB/s | 20 kB 00:00 2024-09-05T01:12:16.877 INFO:teuthology.orchestra.run.smithi151.stdout:(129/154): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-05T01:12:16.903 INFO:teuthology.orchestra.run.smithi151.stdout:(130/154): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-05T01:12:16.937 INFO:teuthology.orchestra.run.smithi151.stdout:(131/154): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-05T01:12:16.953 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : NetworkManager-libnm-1:1.48.10-1.el9.x86_64 16/160 2024-09-05T01:12:16.970 INFO:teuthology.orchestra.run.smithi151.stdout:(132/154): python3-kubernetes-26.1.0-2.el9.noar 7.1 MB/s | 1.0 MB 00:00 2024-09-05T01:12:16.995 INFO:teuthology.orchestra.run.smithi151.stdout:(133/154): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-09-05T01:12:17.012 INFO:teuthology.orchestra.run.smithi151.stdout:(134/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 5.3 MB/s | 90 kB 00:00 2024-09-05T01:12:17.019 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.10-1.el9.x86_64 16/160 2024-09-05T01:12:17.038 INFO:teuthology.orchestra.run.smithi151.stdout:(135/154): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-05T01:12:17.063 INFO:teuthology.orchestra.run.smithi151.stdout:(136/154): python3-pyperclip-1.8.2-2.el9.noarch 560 kB/s | 28 kB 00:00 2024-09-05T01:12:17.089 INFO:teuthology.orchestra.run.smithi151.stdout:(137/154): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-05T01:12:17.114 INFO:teuthology.orchestra.run.smithi151.stdout:(138/154): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-05T01:12:17.129 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T01:12:17.139 INFO:teuthology.orchestra.run.smithi151.stdout:(139/154): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-05T01:12:17.165 INFO:teuthology.orchestra.run.smithi151.stdout:(140/154): python3-tempora-5.0.0-2.el9.noarch.r 708 kB/s | 36 kB 00:00 2024-09-05T01:12:17.190 INFO:teuthology.orchestra.run.smithi151.stdout:(141/154): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-05T01:12:17.203 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T01:12:17.232 INFO:teuthology.orchestra.run.smithi151.stdout:(142/154): python3-grpcio-1.46.7-10.el9.x86_64. 3.4 MB/s | 2.0 MB 00:00 2024-09-05T01:12:17.257 INFO:teuthology.orchestra.run.smithi151.stdout:(143/154): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-05T01:12:17.283 INFO:teuthology.orchestra.run.smithi151.stdout:(144/154): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-05T01:12:17.333 INFO:teuthology.orchestra.run.smithi151.stdout:(145/154): python3-zc-lockfile-2.0-10.el9.noarc 264 kB/s | 20 kB 00:00 2024-09-05T01:12:17.359 INFO:teuthology.orchestra.run.smithi151.stdout:(146/154): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-05T01:12:17.384 INFO:teuthology.orchestra.run.smithi151.stdout:(147/154): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-05T01:12:17.426 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T01:12:17.443 INFO:teuthology.orchestra.run.smithi151.stdout:(148/154): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-05T01:12:17.551 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : re2-1:20211101-20.el9.x86_64 18/160 2024-09-05T01:12:17.648 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 19/160 2024-09-05T01:12:17.685 INFO:teuthology.orchestra.run.smithi151.stdout:(149/154): librbd1-19.1.1-259.g91c8a7e5.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-05T01:12:17.691 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/160 2024-09-05T01:12:17.726 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/160 2024-09-05T01:12:17.752 INFO:teuthology.orchestra.run.smithi151.stdout:(150/154): librados2-19.1.1-259.g91c8a7e5.el9.x 8.7 MB/s | 3.4 MB 00:00 2024-09-05T01:12:17.800 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/160 2024-09-05T01:12:17.819 INFO:teuthology.orchestra.run.smithi151.stdout:(151/154): NetworkManager-1.48.10-1.el9.x86_64. 6.2 MB/s | 2.3 MB 00:00 2024-09-05T01:12:17.852 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/160 2024-09-05T01:12:17.877 INFO:teuthology.orchestra.run.smithi151.stdout:(152/154): NetworkManager-tui-1.48.10-1.el9.x86 4.2 MB/s | 248 kB 00:00 2024-09-05T01:12:17.892 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-packaging-20.9-5.el9.noarch 24/160 2024-09-05T01:12:17.903 INFO:teuthology.orchestra.run.smithi151.stdout:(153/154): NetworkManager-team-1.48.10-1.el9.x8 269 kB/s | 40 kB 00:00 2024-09-05T01:12:17.936 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/160 2024-09-05T01:12:17.969 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/160 2024-09-05T01:12:17.994 INFO:teuthology.orchestra.run.smithi151.stdout:(154/154): NetworkManager-libnm-1.48.10-1.el9.x 5.8 MB/s | 1.8 MB 00:00 2024-09-05T01:12:17.996 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/160 2024-09-05T01:12:18.001 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-09-05T01:12:18.001 INFO:teuthology.orchestra.run.smithi151.stdout:Total 8.9 MB/s | 222 MB 00:24 2024-09-05T01:12:18.067 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/160 2024-09-05T01:12:18.127 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 29/160 2024-09-05T01:12:18.157 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/160 2024-09-05T01:12:18.192 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 31/160 2024-09-05T01:12:18.261 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-09-05T01:12:18.262 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-09-05T01:12:18.270 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 32/160 2024-09-05T01:12:18.303 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ceph-common-2:19.1.1-259.g91c8a7e5.el9.x 33/160 2024-09-05T01:12:18.347 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ceph-argparse-2:19.1.1-259.g91c8a7e5.el9 34/160 2024-09-05T01:12:18.375 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cephfs-2:19.1.1-259.g91c8a7e5.el9.x86_64 35/160 2024-09-05T01:12:18.446 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/160 2024-09-05T01:12:18.498 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : luarocks-3.9.2-5.el9.noarch 37/160 2024-09-05T01:12:18.582 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/160 2024-09-05T01:12:18.717 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/160 2024-09-05T01:12:18.780 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/160 2024-09-05T01:12:19.123 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-09-05T01:12:19.259 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-09-05T01:12:19.259 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-09-05T01:12:19.318 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/160 2024-09-05T01:12:19.400 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/160 2024-09-05T01:12:19.428 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 43/160 2024-09-05T01:12:19.463 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/160 2024-09-05T01:12:19.501 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librados-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 45/160 2024-09-05T01:12:19.534 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/160 2024-09-05T01:12:19.589 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/160 2024-09-05T01:12:19.663 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/160 2024-09-05T01:12:19.694 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 49/160 2024-09-05T01:12:19.730 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 50/160 2024-09-05T01:12:19.776 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/160 2024-09-05T01:12:19.812 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/160 2024-09-05T01:12:19.856 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/160 2024-09-05T01:12:19.897 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/160 2024-09-05T01:12:20.035 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/160 2024-09-05T01:12:20.075 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/160 2024-09-05T01:12:20.115 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 57/160 2024-09-05T01:12:20.218 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 58/160 2024-09-05T01:12:20.266 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 59/160 2024-09-05T01:12:20.306 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 60/160 2024-09-05T01:12:20.331 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 61/160 2024-09-05T01:12:20.356 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 62/160 2024-09-05T01:12:20.431 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 63/160 2024-09-05T01:12:20.559 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 64/160 2024-09-05T01:12:20.692 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 65/160 2024-09-05T01:12:20.828 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 66/160 2024-09-05T01:12:20.868 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 67/160 2024-09-05T01:12:20.913 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : uuid-1.6.2-55.el9.x86_64 68/160 2024-09-05T01:12:20.950 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 69/160 2024-09-05T01:12:20.989 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/160 2024-09-05T01:12:21.019 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/160 2024-09-05T01:12:21.031 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-09-05T01:12:21.036 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-09-05T01:12:21.053 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/160 2024-09-05T01:12:21.087 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/160 2024-09-05T01:12:21.137 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/160 2024-09-05T01:12:21.171 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/160 2024-09-05T01:12:21.260 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/160 2024-09-05T01:12:21.310 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/160 2024-09-05T01:12:21.341 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/160 2024-09-05T01:12:21.445 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/160 2024-09-05T01:12:21.500 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/160 2024-09-05T01:12:22.251 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/160 2024-09-05T01:12:22.297 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/160 2024-09-05T01:12:22.331 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/160 2024-09-05T01:12:22.431 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/160 2024-09-05T01:12:22.487 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 85/160 2024-09-05T01:12:22.532 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 86/160 2024-09-05T01:12:22.619 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/160 2024-09-05T01:12:22.650 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/160 2024-09-05T01:12:22.834 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openblas-0.3.26-2.el9.x86_64 89/160 2024-09-05T01:12:22.873 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 90/160 2024-09-05T01:12:22.950 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/160 2024-09-05T01:12:23.611 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/160 2024-09-05T01:12:23.723 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/160 2024-09-05T01:12:24.956 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-09-05T01:12:24.975 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/160 2024-09-05T01:12:25.053 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/160 2024-09-05T01:12:25.061 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/160 2024-09-05T01:12:25.081 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/160 2024-09-05T01:12:25.092 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/160 2024-09-05T01:12:25.113 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 97/160 2024-09-05T01:12:25.153 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/160 2024-09-05T01:12:25.416 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/160 2024-09-05T01:12:25.459 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 99/160 2024-09-05T01:12:25.551 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 99/160 2024-09-05T01:12:25.553 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/160 2024-09-05T01:12:25.581 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 100/160 2024-09-05T01:12:25.617 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/160 2024-09-05T01:12:25.659 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 5/160 2024-09-05T01:12:25.810 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 5/160 2024-09-05T01:12:25.852 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 6/160 2024-09-05T01:12:25.967 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 6/160 2024-09-05T01:12:26.019 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rados-2:19.1.1-259.g91c8a7e5.el9.x86_64 7/160 2024-09-05T01:12:26.050 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/160 2024-09-05T01:12:26.099 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/160 2024-09-05T01:12:26.099 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/160 2024-09-05T01:12:26.129 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 103/160 2024-09-05T01:12:26.184 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 103/160 2024-09-05T01:12:26.233 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 104/160 2024-09-05T01:12:26.338 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/160 2024-09-05T01:12:26.406 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/160 2024-09-05T01:12:26.432 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 12/160 2024-09-05T01:12:26.561 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 12/160 2024-09-05T01:12:26.600 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_ 13/160 2024-09-05T01:12:26.674 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_ 13/160 2024-09-05T01:12:26.701 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/160 2024-09-05T01:12:26.744 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/160 2024-09-05T01:12:26.939 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/160 2024-09-05T01:12:27.132 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/160 2024-09-05T01:12:27.273 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-libnm-1:1.48.10-1.el9.x86_64 16/160 2024-09-05T01:12:27.351 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.10-1.el9.x86_64 16/160 2024-09-05T01:12:27.381 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-09-05T01:12:27.456 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/160 2024-09-05T01:12:27.490 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/160 2024-09-05T01:12:27.494 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T01:12:27.532 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/160 2024-09-05T01:12:27.618 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T01:12:27.865 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/160 2024-09-05T01:12:27.912 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T01:12:27.974 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 5/160 2024-09-05T01:12:28.057 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : re2-1:20211101-20.el9.x86_64 18/160 2024-09-05T01:12:28.096 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 5/160 2024-09-05T01:12:28.134 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 6/160 2024-09-05T01:12:28.176 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 19/160 2024-09-05T01:12:28.226 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 6/160 2024-09-05T01:12:28.231 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/160 2024-09-05T01:12:28.268 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rados-2:19.1.1-259.g91c8a7e5.el9.x86_64 7/160 2024-09-05T01:12:28.270 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/160 2024-09-05T01:12:28.298 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/160 2024-09-05T01:12:28.323 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/160 2024-09-05T01:12:28.357 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/160 2024-09-05T01:12:28.415 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/160 2024-09-05T01:12:28.461 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-packaging-20.9-5.el9.noarch 24/160 2024-09-05T01:12:28.477 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/160 2024-09-05T01:12:28.517 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/160 2024-09-05T01:12:28.521 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/160 2024-09-05T01:12:28.528 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 105/160 2024-09-05T01:12:28.549 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 12/160 2024-09-05T01:12:28.554 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/160 2024-09-05T01:12:28.560 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 105/160 2024-09-05T01:12:28.587 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/160 2024-09-05T01:12:28.654 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 12/160 2024-09-05T01:12:28.681 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/160 2024-09-05T01:12:28.684 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_ 13/160 2024-09-05T01:12:28.742 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 29/160 2024-09-05T01:12:28.755 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_ 13/160 2024-09-05T01:12:28.774 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/160 2024-09-05T01:12:28.785 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/160 2024-09-05T01:12:28.803 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/160 2024-09-05T01:12:28.821 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 31/160 2024-09-05T01:12:28.914 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 32/160 2024-09-05T01:12:28.961 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-common-2:19.1.1-259.g91c8a7e5.el9.x 33/160 2024-09-05T01:12:28.995 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/160 2024-09-05T01:12:29.006 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-argparse-2:19.1.1-259.g91c8a7e5.el9 34/160 2024-09-05T01:12:29.050 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cephfs-2:19.1.1-259.g91c8a7e5.el9.x86_64 35/160 2024-09-05T01:12:29.106 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 105/160 2024-09-05T01:12:29.146 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/160 2024-09-05T01:12:29.147 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 106/160 2024-09-05T01:12:29.170 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/160 2024-09-05T01:12:29.203 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : luarocks-3.9.2-5.el9.noarch 37/160 2024-09-05T01:12:29.241 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 106/160 2024-09-05T01:12:29.242 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-05T01:12:29.242 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-05T01:12:29.242 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-05T01:12:29.273 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 107/160 2024-09-05T01:12:29.283 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-libnm-1:1.48.10-1.el9.x86_64 16/160 2024-09-05T01:12:29.299 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/160 2024-09-05T01:12:29.352 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.10-1.el9.x86_64 16/160 2024-09-05T01:12:29.460 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T01:12:29.485 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/160 2024-09-05T01:12:29.546 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T01:12:29.557 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/160 2024-09-05T01:12:29.766 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.48.10-1.el9.x86_64 17/160 2024-09-05T01:12:29.873 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : re2-1:20211101-20.el9.x86_64 18/160 2024-09-05T01:12:29.966 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 19/160 2024-09-05T01:12:30.002 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/160 2024-09-05T01:12:30.038 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/160 2024-09-05T01:12:30.112 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/160 2024-09-05T01:12:30.173 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/160 2024-09-05T01:12:30.213 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-packaging-20.9-5.el9.noarch 24/160 2024-09-05T01:12:30.241 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/160 2024-09-05T01:12:30.257 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/160 2024-09-05T01:12:30.289 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 26/160 2024-09-05T01:12:30.318 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lua-5.4.4-4.el9.x86_64 27/160 2024-09-05T01:12:30.351 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/160 2024-09-05T01:12:30.387 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/160 2024-09-05T01:12:30.404 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 43/160 2024-09-05T01:12:30.449 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 29/160 2024-09-05T01:12:30.478 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/160 2024-09-05T01:12:30.514 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 31/160 2024-09-05T01:12:30.592 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 32/160 2024-09-05T01:12:30.625 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-common-2:19.1.1-259.g91c8a7e5.el9.x 33/160 2024-09-05T01:12:30.669 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-argparse-2:19.1.1-259.g91c8a7e5.el9 34/160 2024-09-05T01:12:30.697 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cephfs-2:19.1.1-259.g91c8a7e5.el9.x86_64 35/160 2024-09-05T01:12:30.769 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 36/160 2024-09-05T01:12:30.814 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : luarocks-3.9.2-5.el9.noarch 37/160 2024-09-05T01:12:30.889 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 38/160 2024-09-05T01:12:30.906 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/160 2024-09-05T01:12:30.950 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librados-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 45/160 2024-09-05T01:12:31.008 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/160 2024-09-05T01:12:31.037 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 39/160 2024-09-05T01:12:31.079 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/160 2024-09-05T01:12:31.089 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 40/160 2024-09-05T01:12:31.182 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/160 2024-09-05T01:12:31.217 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 49/160 2024-09-05T01:12:31.253 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 50/160 2024-09-05T01:12:31.313 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/160 2024-09-05T01:12:31.352 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/160 2024-09-05T01:12:31.399 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/160 2024-09-05T01:12:31.449 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/160 2024-09-05T01:12:31.630 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rsa-4.9-2.el9.noarch 41/160 2024-09-05T01:12:31.635 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/160 2024-09-05T01:12:31.681 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/160 2024-09-05T01:12:31.711 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 42/160 2024-09-05T01:12:31.747 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 43/160 2024-09-05T01:12:31.750 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 57/160 2024-09-05T01:12:31.791 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 44/160 2024-09-05T01:12:31.829 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librados-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 45/160 2024-09-05T01:12:31.879 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 46/160 2024-09-05T01:12:31.882 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 58/160 2024-09-05T01:12:31.930 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 59/160 2024-09-05T01:12:31.935 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/160 2024-09-05T01:12:31.973 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 60/160 2024-09-05T01:12:32.002 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 61/160 2024-09-05T01:12:32.009 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/160 2024-09-05T01:12:32.026 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 62/160 2024-09-05T01:12:32.047 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 49/160 2024-09-05T01:12:32.083 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 50/160 2024-09-05T01:12:32.131 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/160 2024-09-05T01:12:32.153 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 63/160 2024-09-05T01:12:32.167 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/160 2024-09-05T01:12:32.210 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/160 2024-09-05T01:12:32.252 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/160 2024-09-05T01:12:32.316 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 64/160 2024-09-05T01:12:32.363 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 65/160 2024-09-05T01:12:32.391 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/160 2024-09-05T01:12:32.399 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 66/160 2024-09-05T01:12:32.429 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/160 2024-09-05T01:12:32.437 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 67/160 2024-09-05T01:12:32.471 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 57/160 2024-09-05T01:12:32.491 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : uuid-1.6.2-55.el9.x86_64 68/160 2024-09-05T01:12:32.535 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 69/160 2024-09-05T01:12:32.574 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/160 2024-09-05T01:12:32.575 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 58/160 2024-09-05T01:12:32.610 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/160 2024-09-05T01:12:32.622 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 59/160 2024-09-05T01:12:32.645 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/160 2024-09-05T01:12:32.662 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 60/160 2024-09-05T01:12:32.678 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/160 2024-09-05T01:12:32.687 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 61/160 2024-09-05T01:12:32.723 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/160 2024-09-05T01:12:32.747 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 62/160 2024-09-05T01:12:32.754 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/160 2024-09-05T01:12:32.861 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/160 2024-09-05T01:12:32.914 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/160 2024-09-05T01:12:32.942 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 63/160 2024-09-05T01:12:32.949 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/160 2024-09-05T01:12:33.078 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/160 2024-09-05T01:12:33.148 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/160 2024-09-05T01:12:33.257 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 64/160 2024-09-05T01:12:33.293 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 65/160 2024-09-05T01:12:33.321 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 66/160 2024-09-05T01:12:33.356 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 67/160 2024-09-05T01:12:33.400 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : uuid-1.6.2-55.el9.x86_64 68/160 2024-09-05T01:12:33.438 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 69/160 2024-09-05T01:12:33.470 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/160 2024-09-05T01:12:33.500 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/160 2024-09-05T01:12:33.534 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/160 2024-09-05T01:12:33.568 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/160 2024-09-05T01:12:33.609 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/160 2024-09-05T01:12:33.644 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/160 2024-09-05T01:12:33.733 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/160 2024-09-05T01:12:33.792 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/160 2024-09-05T01:12:33.823 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/160 2024-09-05T01:12:33.928 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/160 2024-09-05T01:12:33.983 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/160 2024-09-05T01:12:34.121 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/160 2024-09-05T01:12:34.189 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/160 2024-09-05T01:12:34.223 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/160 2024-09-05T01:12:34.347 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/160 2024-09-05T01:12:34.442 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 85/160 2024-09-05T01:12:34.503 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 86/160 2024-09-05T01:12:34.614 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/160 2024-09-05T01:12:34.649 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/160 2024-09-05T01:12:34.729 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/160 2024-09-05T01:12:34.789 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/160 2024-09-05T01:12:34.823 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/160 2024-09-05T01:12:34.899 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-0.3.26-2.el9.x86_64 89/160 2024-09-05T01:12:34.926 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/160 2024-09-05T01:12:34.929 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 90/160 2024-09-05T01:12:34.987 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 85/160 2024-09-05T01:12:35.028 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/160 2024-09-05T01:12:35.032 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 86/160 2024-09-05T01:12:35.121 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/160 2024-09-05T01:12:35.152 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/160 2024-09-05T01:12:35.339 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-0.3.26-2.el9.x86_64 89/160 2024-09-05T01:12:35.366 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 90/160 2024-09-05T01:12:35.453 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/160 2024-09-05T01:12:35.904 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/160 2024-09-05T01:12:36.059 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/160 2024-09-05T01:12:36.112 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/160 2024-09-05T01:12:36.226 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/160 2024-09-05T01:12:37.486 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/160 2024-09-05T01:12:37.568 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/160 2024-09-05T01:12:37.596 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/160 2024-09-05T01:12:37.629 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 97/160 2024-09-05T01:12:37.758 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/160 2024-09-05T01:12:37.875 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/160 2024-09-05T01:12:37.912 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/160 2024-09-05T01:12:37.940 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/160 2024-09-05T01:12:37.947 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 97/160 2024-09-05T01:12:37.984 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 99/160 2024-09-05T01:12:38.075 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 99/160 2024-09-05T01:12:38.105 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 100/160 2024-09-05T01:12:38.142 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/160 2024-09-05T01:12:38.303 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/160 2024-09-05T01:12:38.349 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 99/160 2024-09-05T01:12:38.496 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 99/160 2024-09-05T01:12:38.530 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 100/160 2024-09-05T01:12:38.580 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/160 2024-09-05T01:12:38.622 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/160 2024-09-05T01:12:38.654 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 103/160 2024-09-05T01:12:38.726 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 103/160 2024-09-05T01:12:38.756 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 104/160 2024-09-05T01:12:39.144 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/160 2024-09-05T01:12:39.177 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 103/160 2024-09-05T01:12:39.268 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 103/160 2024-09-05T01:12:39.295 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 104/160 2024-09-05T01:12:41.075 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 105/160 2024-09-05T01:12:41.112 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 105/160 2024-09-05T01:12:41.241 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 107/160 2024-09-05T01:12:41.241 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /sys 2024-09-05T01:12:41.241 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /proc 2024-09-05T01:12:41.241 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /mnt 2024-09-05T01:12:41.241 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /var/tmp 2024-09-05T01:12:41.242 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /home 2024-09-05T01:12:41.242 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /root 2024-09-05T01:12:41.242 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /tmp 2024-09-05T01:12:41.242 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-05T01:12:41.409 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 108/160 2024-09-05T01:12:41.426 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 108/160 2024-09-05T01:12:41.426 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:12:41.426 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-05T01:12:41.426 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-05T01:12:41.658 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 105/160 2024-09-05T01:12:41.709 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 106/160 2024-09-05T01:12:41.803 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 106/160 2024-09-05T01:12:41.803 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-05T01:12:41.803 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-05T01:12:41.803 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-05T01:12:41.835 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 107/160 2024-09-05T01:12:42.206 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 105/160 2024-09-05T01:12:42.258 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 105/160 2024-09-05T01:12:42.921 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 109/160 2024-09-05T01:12:42.931 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 105/160 2024-09-05T01:12:42.947 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 109/160 2024-09-05T01:12:42.947 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:12:42.948 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-05T01:12:42.948 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-05T01:12:42.948 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-05T01:12:42.948 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-05T01:12:42.978 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 106/160 2024-09-05T01:12:43.135 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 106/160 2024-09-05T01:12:43.135 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-05T01:12:43.135 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-05T01:12:43.135 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:12:43.179 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 107/160 2024-09-05T01:12:43.180 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 110/160 2024-09-05T01:12:43.202 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 110/160 2024-09-05T01:12:43.202 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:12:43.202 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-05T01:12:43.203 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-05T01:12:43.203 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-05T01:12:43.203 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-05T01:12:43.638 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 111/160 2024-09-05T01:12:43.662 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 111/160 2024-09-05T01:12:43.662 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:12:43.662 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-05T01:12:43.662 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-05T01:12:43.662 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-05T01:12:43.662 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-05T01:12:43.768 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : automake-1.16.2-8.el9.noarch 112/160 2024-09-05T01:12:43.825 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/160 2024-09-05T01:12:43.881 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/160 2024-09-05T01:12:44.067 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/160 2024-09-05T01:12:44.114 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/160 2024-09-05T01:12:44.192 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/160 2024-09-05T01:12:44.281 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/160 2024-09-05T01:12:44.420 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/160 2024-09-05T01:12:44.472 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/160 2024-09-05T01:12:44.504 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/160 2024-09-05T01:12:44.540 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : fuse-2.9.9-16.el9.x86_64 122/160 2024-09-05T01:12:44.986 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 123/160 2024-09-05T01:12:45.014 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 123/160 2024-09-05T01:12:45.045 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-259.g91c8a7e5.el 124/160 2024-09-05T01:12:45.108 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-259.g91c8a7e5.e 125/160 2024-09-05T01:12:45.136 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noar 126/160 2024-09-05T01:12:46.180 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noar 126/160 2024-09-05T01:12:46.221 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.no 127/160 2024-09-05T01:12:47.186 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.no 127/160 2024-09-05T01:12:47.205 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8 128/160 2024-09-05T01:12:47.310 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8 128/160 2024-09-05T01:12:47.475 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-259.g91c8a7e5.el9 129/160 2024-09-05T01:12:47.507 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 130/160 2024-09-05T01:12:47.531 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 130/160 2024-09-05T01:12:47.531 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:12:47.531 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-05T01:12:47.532 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-05T01:12:47.532 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-05T01:12:47.532 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-05T01:12:47.583 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 131/160 2024-09-05T01:12:47.595 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 131/160 2024-09-05T01:12:47.692 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-2:19.1.1-259.g91c8a7e5.el9.x86_64 132/160 2024-09-05T01:12:47.739 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 133/160 2024-09-05T01:12:48.667 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libtool-2.4.6-46.el9.x86_64 134/160 2024-09-05T01:12:48.702 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 135/160 2024-09-05T01:12:48.726 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 135/160 2024-09-05T01:12:48.726 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:12:48.726 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-05T01:12:48.726 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-05T01:12:48.726 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-05T01:12:48.726 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-05T01:12:48.769 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-259.g91c8a7 136/160 2024-09-05T01:12:48.792 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-259.g91c8a7 136/160 2024-09-05T01:12:48.792 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:12:48.792 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-05T01:12:48.792 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-05T01:12:48.837 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 137/160 2024-09-05T01:12:48.860 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 137/160 2024-09-05T01:12:48.860 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:12:48.860 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-05T01:12:48.860 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-05T01:12:48.860 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-05T01:12:48.860 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-05T01:12:49.162 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 138/160 2024-09-05T01:12:49.185 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 138/160 2024-09-05T01:12:49.186 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:12:49.186 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-05T01:12:49.186 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-05T01:12:49.186 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-05T01:12:49.186 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-05T01:12:53.716 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-test-2:19.1.1-259.g91c8a7e5.el9.x86_64 139/160 2024-09-05T01:12:53.756 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 140/160 2024-09-05T01:12:53.798 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-nbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 141/160 2024-09-05T01:12:53.839 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 142/160 2024-09-05T01:12:53.857 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 143/160 2024-09-05T01:12:53.889 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 107/160 2024-09-05T01:12:53.889 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /sys 2024-09-05T01:12:53.889 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /proc 2024-09-05T01:12:53.889 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /mnt 2024-09-05T01:12:53.889 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /var/tmp 2024-09-05T01:12:53.889 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /home 2024-09-05T01:12:53.890 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /root 2024-09-05T01:12:53.890 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /tmp 2024-09-05T01:12:53.890 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-05T01:12:54.039 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephfs-shell-2:19.1.1-259.g91c8a7e5.el9.x86_64 144/160 2024-09-05T01:12:54.067 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 108/160 2024-09-05T01:12:54.079 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 145/160 2024-09-05T01:12:54.083 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 108/160 2024-09-05T01:12:54.083 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:12:54.083 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-05T01:12:54.083 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-05T01:12:54.109 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephfs-devel-2:19.1.1-259.g91c8a7e5.el9.x86_6 146/160 2024-09-05T01:12:54.139 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : NetworkManager-team-1:1.48.10-1.el9.x86_64 147/160 2024-09-05T01:12:54.176 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : NetworkManager-tui-1:1.48.10-1.el9.x86_64 148/160 2024-09-05T01:12:54.792 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T01:12:54.832 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T01:12:54.852 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T01:12:55.562 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 109/160 2024-09-05T01:12:55.589 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 109/160 2024-09-05T01:12:55.589 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:12:55.589 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-05T01:12:55.589 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-05T01:12:55.589 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-05T01:12:55.589 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-05T01:12:55.689 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephfs-top-2:19.1.1-259.g91c8a7e5.el9.noarch 150/160 2024-09-05T01:12:55.779 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 151/160 2024-09-05T01:12:55.819 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/160 2024-09-05T01:12:55.821 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 110/160 2024-09-05T01:12:55.844 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 110/160 2024-09-05T01:12:55.844 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:12:55.844 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-05T01:12:55.844 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-05T01:12:55.845 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-05T01:12:55.845 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-05T01:12:55.922 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/160 2024-09-05T01:12:55.956 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/160 2024-09-05T01:12:55.982 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 155/160 2024-09-05T01:12:55.983 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 156/160 2024-09-05T01:12:56.058 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 156/160 2024-09-05T01:12:56.083 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 157/160 2024-09-05T01:12:56.089 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T01:12:56.089 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T01:12:56.277 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T01:12:56.277 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 159/160 2024-09-05T01:12:56.280 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 111/160 2024-09-05T01:12:56.303 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 111/160 2024-09-05T01:12:56.303 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:12:56.303 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-05T01:12:56.303 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-05T01:12:56.304 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-05T01:12:56.304 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-05T01:12:56.352 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 159/160 2024-09-05T01:12:56.352 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/160 2024-09-05T01:12:56.386 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 107/160 2024-09-05T01:12:56.386 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /sys 2024-09-05T01:12:56.386 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /proc 2024-09-05T01:12:56.386 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /mnt 2024-09-05T01:12:56.386 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /var/tmp 2024-09-05T01:12:56.386 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /home 2024-09-05T01:12:56.386 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /root 2024-09-05T01:12:56.386 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /tmp 2024-09-05T01:12:56.386 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:12:56.411 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : automake-1.16.2-8.el9.noarch 112/160 2024-09-05T01:12:56.459 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/160 2024-09-05T01:12:56.515 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/160 2024-09-05T01:12:56.605 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 108/160 2024-09-05T01:12:56.641 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 108/160 2024-09-05T01:12:56.641 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:12:56.641 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-05T01:12:56.641 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:12:56.708 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/160 2024-09-05T01:12:56.757 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/160 2024-09-05T01:12:56.835 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/160 2024-09-05T01:12:56.924 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/160 2024-09-05T01:12:57.072 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/160 2024-09-05T01:12:57.108 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/160 2024-09-05T01:12:57.141 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/160 2024-09-05T01:12:57.177 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fuse-2.9.9-16.el9.x86_64 122/160 2024-09-05T01:12:57.582 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 123/160 2024-09-05T01:12:57.610 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 123/160 2024-09-05T01:12:57.642 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-259.g91c8a7e5.el 124/160 2024-09-05T01:12:57.705 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-259.g91c8a7e5.e 125/160 2024-09-05T01:12:57.733 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noar 126/160 2024-09-05T01:12:58.317 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 109/160 2024-09-05T01:12:58.378 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 109/160 2024-09-05T01:12:58.378 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:12:58.378 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-05T01:12:58.378 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-05T01:12:58.378 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-05T01:12:58.378 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:12:58.634 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 110/160 2024-09-05T01:12:58.685 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 110/160 2024-09-05T01:12:58.685 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:12:58.685 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-05T01:12:58.685 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-05T01:12:58.685 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-05T01:12:58.685 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:12:58.779 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noar 126/160 2024-09-05T01:12:58.819 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.no 127/160 2024-09-05T01:12:59.184 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 111/160 2024-09-05T01:12:59.235 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 111/160 2024-09-05T01:12:59.236 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:12:59.236 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-05T01:12:59.236 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-05T01:12:59.236 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-05T01:12:59.236 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:12:59.377 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : automake-1.16.2-8.el9.noarch 112/160 2024-09-05T01:12:59.438 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/160 2024-09-05T01:12:59.511 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/160 2024-09-05T01:12:59.747 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/160 2024-09-05T01:12:59.782 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.no 127/160 2024-09-05T01:12:59.806 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/160 2024-09-05T01:12:59.811 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8 128/160 2024-09-05T01:12:59.893 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/160 2024-09-05T01:12:59.913 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8 128/160 2024-09-05T01:13:00.004 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/160 2024-09-05T01:13:00.073 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-259.g91c8a7e5.el9 129/160 2024-09-05T01:13:00.117 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 130/160 2024-09-05T01:13:00.140 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 130/160 2024-09-05T01:13:00.140 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:13:00.140 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-05T01:13:00.140 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-05T01:13:00.140 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-05T01:13:00.141 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-05T01:13:00.173 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/160 2024-09-05T01:13:00.190 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 131/160 2024-09-05T01:13:00.201 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 131/160 2024-09-05T01:13:00.222 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/160 2024-09-05T01:13:00.278 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/160 2024-09-05T01:13:00.299 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-2:19.1.1-259.g91c8a7e5.el9.x86_64 132/160 2024-09-05T01:13:00.303 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : fuse-2.9.9-16.el9.x86_64 122/160 2024-09-05T01:13:00.347 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 133/160 2024-09-05T01:13:00.827 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 123/160 2024-09-05T01:13:00.861 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 123/160 2024-09-05T01:13:00.902 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-259.g91c8a7e5.el 124/160 2024-09-05T01:13:00.973 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-259.g91c8a7e5.e 125/160 2024-09-05T01:13:00.999 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noar 126/160 2024-09-05T01:13:01.269 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libtool-2.4.6-46.el9.x86_64 134/160 2024-09-05T01:13:01.301 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 135/160 2024-09-05T01:13:01.325 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 135/160 2024-09-05T01:13:01.325 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:13:01.325 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-05T01:13:01.325 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-05T01:13:01.326 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-05T01:13:01.326 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-05T01:13:01.369 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-259.g91c8a7 136/160 2024-09-05T01:13:01.391 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-259.g91c8a7 136/160 2024-09-05T01:13:01.391 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:13:01.391 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-05T01:13:01.392 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-05T01:13:01.436 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 137/160 2024-09-05T01:13:01.459 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 137/160 2024-09-05T01:13:01.459 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:13:01.459 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-05T01:13:01.459 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-05T01:13:01.459 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-05T01:13:01.459 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-05T01:13:01.770 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 138/160 2024-09-05T01:13:01.793 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 138/160 2024-09-05T01:13:01.794 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:13:01.794 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-05T01:13:01.794 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-05T01:13:01.794 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-05T01:13:01.794 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-05T01:13:02.115 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/160 2024-09-05T01:13:02.115 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-2:19.1.1-259.g91c8a7e5.el9.x86_64 1/160 2024-09-05T01:13:02.115 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 2/160 2024-09-05T01:13:02.116 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 3/160 2024-09-05T01:13:02.116 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 4/160 2024-09-05T01:13:02.116 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-259.g91c8a7 5/160 2024-09-05T01:13:02.116 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 6/160 2024-09-05T01:13:02.116 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 7/160 2024-09-05T01:13:02.116 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 8/160 2024-09-05T01:13:02.117 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 9/160 2024-09-05T01:13:02.117 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 10/160 2024-09-05T01:13:02.117 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 11/160 2024-09-05T01:13:02.117 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-test-2:19.1.1-259.g91c8a7e5.el9.x86_64 12/160 2024-09-05T01:13:02.117 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 13/160 2024-09-05T01:13:02.117 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephfs-shell-2:19.1.1-259.g91c8a7e5.el9.x86_64 14/160 2024-09-05T01:13:02.118 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephfs-devel-2:19.1.1-259.g91c8a7e5.el9.x86_6 15/160 2024-09-05T01:13:02.118 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 16/160 2024-09-05T01:13:02.118 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 17/160 2024-09-05T01:13:02.118 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 18/160 2024-09-05T01:13:02.118 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_ 19/160 2024-09-05T01:13:02.118 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 20/160 2024-09-05T01:13:02.119 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ceph-argparse-2:19.1.1-259.g91c8a7e5.el9 21/160 2024-09-05T01:13:02.119 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ceph-common-2:19.1.1-259.g91c8a7e5.el9.x 22/160 2024-09-05T01:13:02.119 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cephfs-2:19.1.1-259.g91c8a7e5.el9.x86_64 23/160 2024-09-05T01:13:02.119 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rados-2:19.1.1-259.g91c8a7e5.el9.x86_64 24/160 2024-09-05T01:13:02.119 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 25/160 2024-09-05T01:13:02.119 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 26/160 2024-09-05T01:13:02.119 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 27/160 2024-09-05T01:13:02.120 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 28/160 2024-09-05T01:13:02.120 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-nbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 29/160 2024-09-05T01:13:02.120 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-259.g91c8a7e5.e 30/160 2024-09-05T01:13:02.120 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noar 31/160 2024-09-05T01:13:02.120 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.no 32/160 2024-09-05T01:13:02.120 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8 33/160 2024-09-05T01:13:02.121 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-259.g91c8a7e5.el9 34/160 2024-09-05T01:13:02.121 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 35/160 2024-09-05T01:13:02.121 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-259.g91c8a7e5.el 36/160 2024-09-05T01:13:02.121 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 37/160 2024-09-05T01:13:02.121 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 38/160 2024-09-05T01:13:02.121 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephfs-top-2:19.1.1-259.g91c8a7e5.el9.noarch 39/160 2024-09-05T01:13:02.121 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/160 2024-09-05T01:13:02.121 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/160 2024-09-05T01:13:02.122 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/160 2024-09-05T01:13:02.122 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/160 2024-09-05T01:13:02.122 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/160 2024-09-05T01:13:02.122 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/160 2024-09-05T01:13:02.122 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/160 2024-09-05T01:13:02.122 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/160 2024-09-05T01:13:02.122 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/160 2024-09-05T01:13:02.122 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/160 2024-09-05T01:13:02.123 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/160 2024-09-05T01:13:02.123 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/160 2024-09-05T01:13:02.123 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/160 2024-09-05T01:13:02.123 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/160 2024-09-05T01:13:02.123 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/160 2024-09-05T01:13:02.123 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/160 2024-09-05T01:13:02.123 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/160 2024-09-05T01:13:02.123 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/160 2024-09-05T01:13:02.123 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/160 2024-09-05T01:13:02.124 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/160 2024-09-05T01:13:02.124 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/160 2024-09-05T01:13:02.124 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/160 2024-09-05T01:13:02.124 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/160 2024-09-05T01:13:02.124 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/160 2024-09-05T01:13:02.124 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/160 2024-09-05T01:13:02.124 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/160 2024-09-05T01:13:02.124 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/160 2024-09-05T01:13:02.124 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/160 2024-09-05T01:13:02.125 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/160 2024-09-05T01:13:02.125 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/160 2024-09-05T01:13:02.125 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/160 2024-09-05T01:13:02.125 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/160 2024-09-05T01:13:02.125 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/160 2024-09-05T01:13:02.125 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/160 2024-09-05T01:13:02.125 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/160 2024-09-05T01:13:02.125 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/160 2024-09-05T01:13:02.125 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/160 2024-09-05T01:13:02.126 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/160 2024-09-05T01:13:02.126 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/160 2024-09-05T01:13:02.126 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/160 2024-09-05T01:13:02.126 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/160 2024-09-05T01:13:02.126 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/160 2024-09-05T01:13:02.126 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/160 2024-09-05T01:13:02.126 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/160 2024-09-05T01:13:02.126 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/160 2024-09-05T01:13:02.127 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/160 2024-09-05T01:13:02.127 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/160 2024-09-05T01:13:02.127 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/160 2024-09-05T01:13:02.127 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/160 2024-09-05T01:13:02.127 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/160 2024-09-05T01:13:02.127 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/160 2024-09-05T01:13:02.127 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/160 2024-09-05T01:13:02.127 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/160 2024-09-05T01:13:02.128 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/160 2024-09-05T01:13:02.128 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/160 2024-09-05T01:13:02.128 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/160 2024-09-05T01:13:02.128 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/160 2024-09-05T01:13:02.128 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/160 2024-09-05T01:13:02.128 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/160 2024-09-05T01:13:02.128 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/160 2024-09-05T01:13:02.128 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/160 2024-09-05T01:13:02.128 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/160 2024-09-05T01:13:02.128 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/160 2024-09-05T01:13:02.128 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/160 2024-09-05T01:13:02.129 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/160 2024-09-05T01:13:02.129 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/160 2024-09-05T01:13:02.129 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/160 2024-09-05T01:13:02.129 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/160 2024-09-05T01:13:02.129 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/160 2024-09-05T01:13:02.129 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/160 2024-09-05T01:13:02.129 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/160 2024-09-05T01:13:02.129 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/160 2024-09-05T01:13:02.130 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/160 2024-09-05T01:13:02.130 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/160 2024-09-05T01:13:02.130 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/160 2024-09-05T01:13:02.130 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/160 2024-09-05T01:13:02.130 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/160 2024-09-05T01:13:02.130 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/160 2024-09-05T01:13:02.130 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/160 2024-09-05T01:13:02.131 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/160 2024-09-05T01:13:02.131 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/160 2024-09-05T01:13:02.131 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/160 2024-09-05T01:13:02.131 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/160 2024-09-05T01:13:02.131 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/160 2024-09-05T01:13:02.131 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/160 2024-09-05T01:13:02.131 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/160 2024-09-05T01:13:02.132 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/160 2024-09-05T01:13:02.132 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/160 2024-09-05T01:13:02.132 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/160 2024-09-05T01:13:02.132 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/160 2024-09-05T01:13:02.132 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/160 2024-09-05T01:13:02.132 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/160 2024-09-05T01:13:02.132 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/160 2024-09-05T01:13:02.133 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/160 2024-09-05T01:13:02.133 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/160 2024-09-05T01:13:02.133 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/160 2024-09-05T01:13:02.133 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/160 2024-09-05T01:13:02.133 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/160 2024-09-05T01:13:02.133 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/160 2024-09-05T01:13:02.134 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/160 2024-09-05T01:13:02.134 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/160 2024-09-05T01:13:02.134 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/160 2024-09-05T01:13:02.134 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/160 2024-09-05T01:13:02.134 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/160 2024-09-05T01:13:02.134 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/160 2024-09-05T01:13:02.134 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/160 2024-09-05T01:13:02.134 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/160 2024-09-05T01:13:02.134 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/160 2024-09-05T01:13:02.134 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/160 2024-09-05T01:13:02.134 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 149/160 2024-09-05T01:13:02.134 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/160 2024-09-05T01:13:02.135 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 151/160 2024-09-05T01:13:02.135 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/160 2024-09-05T01:13:02.135 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-1:1.48.10-1.el9.x86_64 153/160 2024-09-05T01:13:02.135 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/160 2024-09-05T01:13:02.135 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-libnm-1:1.48.10-1.el9.x86_64 155/160 2024-09-05T01:13:02.135 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/160 2024-09-05T01:13:02.135 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-team-1:1.48.10-1.el9.x86_64 157/160 2024-09-05T01:13:02.135 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T01:13:02.135 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-tui-1:1.48.10-1.el9.x86_64 159/160 2024-09-05T01:13:02.297 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noar 126/160 2024-09-05T01:13:02.343 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.no 127/160 2024-09-05T01:13:03.497 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.no 127/160 2024-09-05T01:13:03.526 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8 128/160 2024-09-05T01:13:03.671 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8 128/160 2024-09-05T01:13:03.858 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-259.g91c8a7e5.el9 129/160 2024-09-05T01:13:03.895 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 130/160 2024-09-05T01:13:03.947 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 130/160 2024-09-05T01:13:03.947 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:13:03.947 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-05T01:13:03.947 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-05T01:13:03.948 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-05T01:13:03.948 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:13:04.004 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 131/160 2024-09-05T01:13:04.030 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 131/160 2024-09-05T01:13:04.142 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-2:19.1.1-259.g91c8a7e5.el9.x86_64 132/160 2024-09-05T01:13:04.215 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 133/160 2024-09-05T01:13:04.878 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/160 2024-09-05T01:13:04.878 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-05T01:13:04.878 INFO:teuthology.orchestra.run.smithi145.stdout:Upgraded: 2024-09-05T01:13:04.878 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-1:1.48.10-1.el9.x86_64 2024-09-05T01:13:04.878 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-libnm-1:1.48.10-1.el9.x86_64 2024-09-05T01:13:04.878 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-team-1:1.48.10-1.el9.x86_64 2024-09-05T01:13:04.879 INFO:teuthology.orchestra.run.smithi145.stdout: NetworkManager-tui-1:1.48.10-1.el9.x86_64 2024-09-05T01:13:04.879 INFO:teuthology.orchestra.run.smithi145.stdout: librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.879 INFO:teuthology.orchestra.run.smithi145.stdout: librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.879 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-05T01:13:04.879 INFO:teuthology.orchestra.run.smithi145.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-05T01:13:04.879 INFO:teuthology.orchestra.run.smithi145.stdout: automake-1.16.2-8.el9.noarch 2024-09-05T01:13:04.879 INFO:teuthology.orchestra.run.smithi145.stdout: bison-3.7.4-5.el9.x86_64 2024-09-05T01:13:04.879 INFO:teuthology.orchestra.run.smithi145.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-05T01:13:04.879 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.879 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.879 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.879 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.880 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-grafana-dashboards-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:04.880 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-immutable-object-cache-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.880 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.880 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.880 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:04.880 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:04.880 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:04.880 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:04.880 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:04.880 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.880 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.881 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-prometheus-alerts-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:04.881 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.881 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.881 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-test-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.881 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:04.881 INFO:teuthology.orchestra.run.smithi145.stdout: cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:04.881 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.881 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-shell-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.881 INFO:teuthology.orchestra.run.smithi145.stdout: cephfs-top-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:04.881 INFO:teuthology.orchestra.run.smithi145.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-05T01:13:04.881 INFO:teuthology.orchestra.run.smithi145.stdout: flex-2.6.4-9.el9.x86_64 2024-09-05T01:13:04.881 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-05T01:13:04.881 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-05T01:13:04.882 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-05T01:13:04.882 INFO:teuthology.orchestra.run.smithi145.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-05T01:13:04.882 INFO:teuthology.orchestra.run.smithi145.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-05T01:13:04.882 INFO:teuthology.orchestra.run.smithi145.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-05T01:13:04.882 INFO:teuthology.orchestra.run.smithi145.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-05T01:13:04.882 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-05T01:13:04.882 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-05T01:13:04.882 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.882 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.882 INFO:teuthology.orchestra.run.smithi145.stdout: libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.882 INFO:teuthology.orchestra.run.smithi145.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-05T01:13:04.882 INFO:teuthology.orchestra.run.smithi145.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-05T01:13:04.882 INFO:teuthology.orchestra.run.smithi145.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-05T01:13:04.883 INFO:teuthology.orchestra.run.smithi145.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-05T01:13:04.883 INFO:teuthology.orchestra.run.smithi145.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-05T01:13:04.883 INFO:teuthology.orchestra.run.smithi145.stdout: librados-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.883 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.883 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-05T01:13:04.883 INFO:teuthology.orchestra.run.smithi145.stdout: librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.883 INFO:teuthology.orchestra.run.smithi145.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-05T01:13:04.883 INFO:teuthology.orchestra.run.smithi145.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-05T01:13:04.883 INFO:teuthology.orchestra.run.smithi145.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-05T01:13:04.883 INFO:teuthology.orchestra.run.smithi145.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-05T01:13:04.883 INFO:teuthology.orchestra.run.smithi145.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-05T01:13:04.883 INFO:teuthology.orchestra.run.smithi145.stdout: lua-5.4.4-4.el9.x86_64 2024-09-05T01:13:04.884 INFO:teuthology.orchestra.run.smithi145.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-05T01:13:04.884 INFO:teuthology.orchestra.run.smithi145.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-05T01:13:04.884 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-05T01:13:04.884 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-05T01:13:04.884 INFO:teuthology.orchestra.run.smithi145.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-09-05T01:13:04.884 INFO:teuthology.orchestra.run.smithi145.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-05T01:13:04.884 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-13.16-1.el9.x86_64 2024-09-05T01:13:04.884 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-05T01:13:04.884 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-05T01:13:04.884 INFO:teuthology.orchestra.run.smithi145.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-05T01:13:04.884 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-05T01:13:04.884 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-05T01:13:04.885 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-05T01:13:04.885 INFO:teuthology.orchestra.run.smithi145.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-05T01:13:04.885 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-05T01:13:04.885 INFO:teuthology.orchestra.run.smithi145.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-05T01:13:04.885 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-05T01:13:04.885 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.885 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.885 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cephfs-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.885 INFO:teuthology.orchestra.run.smithi145.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-05T01:13:04.885 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-05T01:13:04.885 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-05T01:13:04.885 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-05T01:13:04.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-05T01:13:04.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-05T01:13:04.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-05T01:13:04.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-05T01:13:04.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-05T01:13:04.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-05T01:13:04.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-05T01:13:04.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-05T01:13:04.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-05T01:13:04.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-05T01:13:04.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-05T01:13:04.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-05T01:13:04.886 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-05T01:13:04.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-05T01:13:04.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-05T01:13:04.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-05T01:13:04.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-05T01:13:04.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-05T01:13:04.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-05T01:13:04.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-05T01:13:04.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-05T01:13:04.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-05T01:13:04.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-05T01:13:04.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-05T01:13:04.887 INFO:teuthology.orchestra.run.smithi145.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-05T01:13:04.888 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-05T01:13:04.888 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ply-3.11-14.el9.noarch 2024-09-05T01:13:04.888 INFO:teuthology.orchestra.run.smithi145.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-05T01:13:04.888 INFO:teuthology.orchestra.run.smithi145.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-05T01:13:04.888 INFO:teuthology.orchestra.run.smithi145.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-05T01:13:04.888 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-05T01:13:04.888 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-05T01:13:04.888 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-05T01:13:04.888 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-05T01:13:04.888 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-05T01:13:04.888 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-05T01:13:04.888 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rados-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.889 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.889 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-05T01:13:04.889 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-05T01:13:04.889 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-05T01:13:04.889 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.889 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-05T01:13:04.889 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-05T01:13:04.889 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-05T01:13:04.889 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-05T01:13:04.889 INFO:teuthology.orchestra.run.smithi145.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-05T01:13:04.889 INFO:teuthology.orchestra.run.smithi145.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-05T01:13:04.889 INFO:teuthology.orchestra.run.smithi145.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-05T01:13:04.889 INFO:teuthology.orchestra.run.smithi145.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-05T01:13:04.889 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-05T01:13:04.890 INFO:teuthology.orchestra.run.smithi145.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-05T01:13:04.890 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-05T01:13:04.890 INFO:teuthology.orchestra.run.smithi145.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-05T01:13:04.890 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-05T01:13:04.890 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-05T01:13:04.890 INFO:teuthology.orchestra.run.smithi145.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-05T01:13:04.890 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.890 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.890 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-nbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:04.890 INFO:teuthology.orchestra.run.smithi145.stdout: re2-1:20211101-20.el9.x86_64 2024-09-05T01:13:04.890 INFO:teuthology.orchestra.run.smithi145.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-05T01:13:04.890 INFO:teuthology.orchestra.run.smithi145.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-05T01:13:04.891 INFO:teuthology.orchestra.run.smithi145.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-05T01:13:04.891 INFO:teuthology.orchestra.run.smithi145.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-05T01:13:04.891 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-05T01:13:04.891 INFO:teuthology.orchestra.run.smithi145.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-05T01:13:04.891 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-05T01:13:04.891 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-05T01:13:05.254 DEBUG:teuthology.parallel:result is None 2024-09-05T01:13:05.507 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libtool-2.4.6-46.el9.x86_64 134/160 2024-09-05T01:13:05.548 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 135/160 2024-09-05T01:13:05.600 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 135/160 2024-09-05T01:13:05.600 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:13:05.600 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-05T01:13:05.601 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-05T01:13:05.601 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-05T01:13:05.601 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:13:05.648 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-259.g91c8a7 136/160 2024-09-05T01:13:05.699 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-259.g91c8a7 136/160 2024-09-05T01:13:05.699 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:13:05.699 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-05T01:13:05.699 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:13:05.757 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 137/160 2024-09-05T01:13:05.809 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 137/160 2024-09-05T01:13:05.810 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:13:05.810 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-05T01:13:05.810 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-05T01:13:05.810 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-05T01:13:05.810 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:13:06.158 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 138/160 2024-09-05T01:13:06.209 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 138/160 2024-09-05T01:13:06.210 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-05T01:13:06.210 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-05T01:13:06.210 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-05T01:13:06.210 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-05T01:13:06.210 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:13:06.334 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-test-2:19.1.1-259.g91c8a7e5.el9.x86_64 139/160 2024-09-05T01:13:06.375 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 140/160 2024-09-05T01:13:06.416 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-nbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 141/160 2024-09-05T01:13:06.449 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 142/160 2024-09-05T01:13:06.476 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 143/160 2024-09-05T01:13:06.658 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-shell-2:19.1.1-259.g91c8a7e5.el9.x86_64 144/160 2024-09-05T01:13:06.708 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 145/160 2024-09-05T01:13:06.730 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs-devel-2:19.1.1-259.g91c8a7e5.el9.x86_6 146/160 2024-09-05T01:13:06.760 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-team-1:1.48.10-1.el9.x86_64 147/160 2024-09-05T01:13:06.798 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-tui-1:1.48.10-1.el9.x86_64 148/160 2024-09-05T01:13:07.425 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T01:13:07.465 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T01:13:07.485 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T01:13:08.318 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-top-2:19.1.1-259.g91c8a7e5.el9.noarch 150/160 2024-09-05T01:13:08.407 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 151/160 2024-09-05T01:13:08.448 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/160 2024-09-05T01:13:08.529 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/160 2024-09-05T01:13:08.561 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/160 2024-09-05T01:13:08.586 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 155/160 2024-09-05T01:13:08.587 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 156/160 2024-09-05T01:13:08.662 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 156/160 2024-09-05T01:13:08.687 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 157/160 2024-09-05T01:13:08.692 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T01:13:08.692 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T01:13:08.873 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T01:13:08.873 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 159/160 2024-09-05T01:13:08.957 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 159/160 2024-09-05T01:13:08.957 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/160 2024-09-05T01:13:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-test-2:19.1.1-259.g91c8a7e5.el9.x86_64 139/160 2024-09-05T01:13:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 140/160 2024-09-05T01:13:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-nbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 141/160 2024-09-05T01:13:11.561 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 142/160 2024-09-05T01:13:11.596 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 143/160 2024-09-05T01:13:11.842 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-shell-2:19.1.1-259.g91c8a7e5.el9.x86_64 144/160 2024-09-05T01:13:11.902 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 145/160 2024-09-05T01:13:11.922 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs-devel-2:19.1.1-259.g91c8a7e5.el9.x86_6 146/160 2024-09-05T01:13:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-team-1:1.48.10-1.el9.x86_64 147/160 2024-09-05T01:13:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : NetworkManager-tui-1:1.48.10-1.el9.x86_64 148/160 2024-09-05T01:13:12.759 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T01:13:12.804 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T01:13:12.846 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 149/160 2024-09-05T01:13:14.209 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-top-2:19.1.1-259.g91c8a7e5.el9.noarch 150/160 2024-09-05T01:13:14.318 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 151/160 2024-09-05T01:13:14.374 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/160 2024-09-05T01:13:14.494 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/160 2024-09-05T01:13:14.528 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/160 2024-09-05T01:13:14.557 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 155/160 2024-09-05T01:13:14.557 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 156/160 2024-09-05T01:13:14.672 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 156/160 2024-09-05T01:13:14.696 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 157/160 2024-09-05T01:13:14.713 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T01:13:14.713 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T01:13:14.958 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T01:13:14.958 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 159/160 2024-09-05T01:13:15.105 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 159/160 2024-09-05T01:13:15.105 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/160 2024-09-05T01:13:15.107 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/160 2024-09-05T01:13:15.107 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-2:19.1.1-259.g91c8a7e5.el9.x86_64 1/160 2024-09-05T01:13:15.108 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 2/160 2024-09-05T01:13:15.108 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 3/160 2024-09-05T01:13:15.108 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 4/160 2024-09-05T01:13:15.108 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-259.g91c8a7 5/160 2024-09-05T01:13:15.108 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 6/160 2024-09-05T01:13:15.108 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 7/160 2024-09-05T01:13:15.108 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 8/160 2024-09-05T01:13:15.108 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 9/160 2024-09-05T01:13:15.108 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 10/160 2024-09-05T01:13:15.108 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 11/160 2024-09-05T01:13:15.108 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-test-2:19.1.1-259.g91c8a7e5.el9.x86_64 12/160 2024-09-05T01:13:15.108 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 13/160 2024-09-05T01:13:15.108 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-shell-2:19.1.1-259.g91c8a7e5.el9.x86_64 14/160 2024-09-05T01:13:15.109 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs-devel-2:19.1.1-259.g91c8a7e5.el9.x86_6 15/160 2024-09-05T01:13:15.109 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 16/160 2024-09-05T01:13:15.109 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 17/160 2024-09-05T01:13:15.109 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 18/160 2024-09-05T01:13:15.109 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_ 19/160 2024-09-05T01:13:15.109 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 20/160 2024-09-05T01:13:15.109 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-argparse-2:19.1.1-259.g91c8a7e5.el9 21/160 2024-09-05T01:13:15.109 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-common-2:19.1.1-259.g91c8a7e5.el9.x 22/160 2024-09-05T01:13:15.109 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cephfs-2:19.1.1-259.g91c8a7e5.el9.x86_64 23/160 2024-09-05T01:13:15.109 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rados-2:19.1.1-259.g91c8a7e5.el9.x86_64 24/160 2024-09-05T01:13:15.109 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 25/160 2024-09-05T01:13:15.109 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 26/160 2024-09-05T01:13:15.110 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 27/160 2024-09-05T01:13:15.110 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 28/160 2024-09-05T01:13:15.110 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-nbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 29/160 2024-09-05T01:13:15.110 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-259.g91c8a7e5.e 30/160 2024-09-05T01:13:15.110 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noar 31/160 2024-09-05T01:13:15.110 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.no 32/160 2024-09-05T01:13:15.110 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8 33/160 2024-09-05T01:13:15.110 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-259.g91c8a7e5.el9 34/160 2024-09-05T01:13:15.110 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 35/160 2024-09-05T01:13:15.110 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-259.g91c8a7e5.el 36/160 2024-09-05T01:13:15.110 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 37/160 2024-09-05T01:13:15.110 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 38/160 2024-09-05T01:13:15.111 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-top-2:19.1.1-259.g91c8a7e5.el9.noarch 39/160 2024-09-05T01:13:15.111 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/160 2024-09-05T01:13:15.111 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/160 2024-09-05T01:13:15.111 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/160 2024-09-05T01:13:15.111 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/160 2024-09-05T01:13:15.111 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/160 2024-09-05T01:13:15.111 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/160 2024-09-05T01:13:15.111 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/160 2024-09-05T01:13:15.111 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/160 2024-09-05T01:13:15.111 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/160 2024-09-05T01:13:15.111 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/160 2024-09-05T01:13:15.111 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/160 2024-09-05T01:13:15.112 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/160 2024-09-05T01:13:15.112 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/160 2024-09-05T01:13:15.112 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/160 2024-09-05T01:13:15.112 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/160 2024-09-05T01:13:15.112 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/160 2024-09-05T01:13:15.112 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/160 2024-09-05T01:13:15.112 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/160 2024-09-05T01:13:15.112 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/160 2024-09-05T01:13:15.112 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/160 2024-09-05T01:13:15.112 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/160 2024-09-05T01:13:15.112 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/160 2024-09-05T01:13:15.112 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/160 2024-09-05T01:13:15.113 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/160 2024-09-05T01:13:15.113 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/160 2024-09-05T01:13:15.113 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/160 2024-09-05T01:13:15.113 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/160 2024-09-05T01:13:15.113 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/160 2024-09-05T01:13:15.113 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/160 2024-09-05T01:13:15.113 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/160 2024-09-05T01:13:15.113 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/160 2024-09-05T01:13:15.113 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/160 2024-09-05T01:13:15.113 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/160 2024-09-05T01:13:15.113 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/160 2024-09-05T01:13:15.113 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/160 2024-09-05T01:13:15.113 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/160 2024-09-05T01:13:15.114 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/160 2024-09-05T01:13:15.114 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/160 2024-09-05T01:13:15.114 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/160 2024-09-05T01:13:15.114 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/160 2024-09-05T01:13:15.114 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/160 2024-09-05T01:13:15.114 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/160 2024-09-05T01:13:15.114 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/160 2024-09-05T01:13:15.114 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/160 2024-09-05T01:13:15.114 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/160 2024-09-05T01:13:15.114 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/160 2024-09-05T01:13:15.114 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/160 2024-09-05T01:13:15.114 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/160 2024-09-05T01:13:15.114 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/160 2024-09-05T01:13:15.115 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/160 2024-09-05T01:13:15.115 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/160 2024-09-05T01:13:15.115 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/160 2024-09-05T01:13:15.115 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/160 2024-09-05T01:13:15.115 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/160 2024-09-05T01:13:15.115 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/160 2024-09-05T01:13:15.115 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/160 2024-09-05T01:13:15.115 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/160 2024-09-05T01:13:15.115 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/160 2024-09-05T01:13:15.115 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/160 2024-09-05T01:13:15.115 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/160 2024-09-05T01:13:15.115 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/160 2024-09-05T01:13:15.115 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/160 2024-09-05T01:13:15.116 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/160 2024-09-05T01:13:15.116 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/160 2024-09-05T01:13:15.116 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/160 2024-09-05T01:13:15.116 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/160 2024-09-05T01:13:15.116 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/160 2024-09-05T01:13:15.116 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/160 2024-09-05T01:13:15.116 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/160 2024-09-05T01:13:15.116 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/160 2024-09-05T01:13:15.116 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/160 2024-09-05T01:13:15.116 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/160 2024-09-05T01:13:15.116 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/160 2024-09-05T01:13:15.116 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/160 2024-09-05T01:13:15.117 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/160 2024-09-05T01:13:15.117 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/160 2024-09-05T01:13:15.117 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/160 2024-09-05T01:13:15.117 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/160 2024-09-05T01:13:15.117 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/160 2024-09-05T01:13:15.117 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/160 2024-09-05T01:13:15.117 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/160 2024-09-05T01:13:15.117 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/160 2024-09-05T01:13:15.117 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/160 2024-09-05T01:13:15.117 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/160 2024-09-05T01:13:15.117 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/160 2024-09-05T01:13:15.117 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/160 2024-09-05T01:13:15.117 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/160 2024-09-05T01:13:15.118 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/160 2024-09-05T01:13:15.118 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/160 2024-09-05T01:13:15.118 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/160 2024-09-05T01:13:15.118 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/160 2024-09-05T01:13:15.118 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/160 2024-09-05T01:13:15.118 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/160 2024-09-05T01:13:15.118 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/160 2024-09-05T01:13:15.118 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/160 2024-09-05T01:13:15.118 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/160 2024-09-05T01:13:15.118 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/160 2024-09-05T01:13:15.118 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/160 2024-09-05T01:13:15.118 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/160 2024-09-05T01:13:15.119 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/160 2024-09-05T01:13:15.119 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/160 2024-09-05T01:13:15.119 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/160 2024-09-05T01:13:15.119 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/160 2024-09-05T01:13:15.119 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/160 2024-09-05T01:13:15.119 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/160 2024-09-05T01:13:15.119 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/160 2024-09-05T01:13:15.119 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/160 2024-09-05T01:13:15.119 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/160 2024-09-05T01:13:15.119 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/160 2024-09-05T01:13:15.119 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 149/160 2024-09-05T01:13:15.119 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/160 2024-09-05T01:13:15.119 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 151/160 2024-09-05T01:13:15.120 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/160 2024-09-05T01:13:15.120 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-1:1.48.10-1.el9.x86_64 153/160 2024-09-05T01:13:15.120 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/160 2024-09-05T01:13:15.120 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-libnm-1:1.48.10-1.el9.x86_64 155/160 2024-09-05T01:13:15.120 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/160 2024-09-05T01:13:15.120 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-team-1:1.48.10-1.el9.x86_64 157/160 2024-09-05T01:13:15.120 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T01:13:15.120 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-tui-1:1.48.10-1.el9.x86_64 159/160 2024-09-05T01:13:15.528 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/160 2024-09-05T01:13:15.528 INFO:teuthology.orchestra.run.smithi012.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-05T01:13:15.528 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:13:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/160 2024-09-05T01:13:17.534 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-05T01:13:17.535 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2024-09-05T01:13:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-1:1.48.10-1.el9.x86_64 2024-09-05T01:13:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-libnm-1:1.48.10-1.el9.x86_64 2024-09-05T01:13:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-team-1:1.48.10-1.el9.x86_64 2024-09-05T01:13:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-tui-1:1.48.10-1.el9.x86_64 2024-09-05T01:13:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.535 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-09-05T01:13:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-05T01:13:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: automake-1.16.2-8.el9.noarch 2024-09-05T01:13:17.535 INFO:teuthology.orchestra.run.smithi151.stdout: bison-3.7.4-5.el9.x86_64 2024-09-05T01:13:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-05T01:13:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:17.536 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-shell-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:17.537 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-05T01:13:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: flex-2.6.4-9.el9.x86_64 2024-09-05T01:13:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-05T01:13:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-05T01:13:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-05T01:13:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-05T01:13:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-05T01:13:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-05T01:13:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-05T01:13:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-05T01:13:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-05T01:13:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.538 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-05T01:13:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-05T01:13:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-05T01:13:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-05T01:13:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-05T01:13:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-05T01:13:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-05T01:13:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-05T01:13:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-05T01:13:17.539 INFO:teuthology.orchestra.run.smithi151.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-05T01:13:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-05T01:13:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: lua-5.4.4-4.el9.x86_64 2024-09-05T01:13:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-05T01:13:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-05T01:13:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-05T01:13:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-05T01:13:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-09-05T01:13:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-05T01:13:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-13.16-1.el9.x86_64 2024-09-05T01:13:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-05T01:13:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-05T01:13:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-05T01:13:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-05T01:13:17.540 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-05T01:13:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-05T01:13:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-05T01:13:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-05T01:13:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-05T01:13:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-05T01:13:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-05T01:13:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-05T01:13:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-05T01:13:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-05T01:13:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-05T01:13:17.541 INFO:teuthology.orchestra.run.smithi151.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-05T01:13:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-05T01:13:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-05T01:13:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-05T01:13:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-05T01:13:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-05T01:13:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-05T01:13:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-05T01:13:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-05T01:13:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-05T01:13:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-05T01:13:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-05T01:13:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-05T01:13:17.542 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-05T01:13:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-05T01:13:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-05T01:13:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-05T01:13:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-05T01:13:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-05T01:13:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-05T01:13:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-05T01:13:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-05T01:13:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-05T01:13:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-05T01:13:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-05T01:13:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply-3.11-14.el9.noarch 2024-09-05T01:13:17.543 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-05T01:13:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-05T01:13:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-05T01:13:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-05T01:13:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-05T01:13:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-05T01:13:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-05T01:13:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-05T01:13:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-05T01:13:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-05T01:13:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-05T01:13:17.544 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-05T01:13:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-05T01:13:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-05T01:13:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-05T01:13:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-05T01:13:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-05T01:13:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-05T01:13:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-05T01:13:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-05T01:13:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-05T01:13:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-05T01:13:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-05T01:13:17.545 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-05T01:13:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-05T01:13:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-05T01:13:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-05T01:13:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: re2-1:20211101-20.el9.x86_64 2024-09-05T01:13:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-05T01:13:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-05T01:13:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-05T01:13:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-05T01:13:17.546 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-05T01:13:17.547 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-05T01:13:17.547 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-05T01:13:17.547 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-09-05T01:13:17.944 DEBUG:teuthology.parallel:result is None 2024-09-05T01:13:21.029 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-2:19.1.1-259.g91c8a7e5.el9.x86_64 1/160 2024-09-05T01:13:21.030 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 2/160 2024-09-05T01:13:21.030 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 3/160 2024-09-05T01:13:21.030 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 4/160 2024-09-05T01:13:21.030 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-259.g91c8a7 5/160 2024-09-05T01:13:21.030 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 6/160 2024-09-05T01:13:21.030 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 7/160 2024-09-05T01:13:21.030 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 8/160 2024-09-05T01:13:21.030 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 9/160 2024-09-05T01:13:21.030 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 10/160 2024-09-05T01:13:21.030 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 11/160 2024-09-05T01:13:21.031 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-test-2:19.1.1-259.g91c8a7e5.el9.x86_64 12/160 2024-09-05T01:13:21.031 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 13/160 2024-09-05T01:13:21.031 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-shell-2:19.1.1-259.g91c8a7e5.el9.x86_64 14/160 2024-09-05T01:13:21.031 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs-devel-2:19.1.1-259.g91c8a7e5.el9.x86_6 15/160 2024-09-05T01:13:21.031 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 16/160 2024-09-05T01:13:21.031 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 17/160 2024-09-05T01:13:21.031 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 18/160 2024-09-05T01:13:21.031 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_ 19/160 2024-09-05T01:13:21.031 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 20/160 2024-09-05T01:13:21.031 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-argparse-2:19.1.1-259.g91c8a7e5.el9 21/160 2024-09-05T01:13:21.031 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-common-2:19.1.1-259.g91c8a7e5.el9.x 22/160 2024-09-05T01:13:21.031 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cephfs-2:19.1.1-259.g91c8a7e5.el9.x86_64 23/160 2024-09-05T01:13:21.031 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rados-2:19.1.1-259.g91c8a7e5.el9.x86_64 24/160 2024-09-05T01:13:21.032 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 25/160 2024-09-05T01:13:21.045 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 26/160 2024-09-05T01:13:21.045 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 27/160 2024-09-05T01:13:21.045 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 28/160 2024-09-05T01:13:21.045 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-nbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 29/160 2024-09-05T01:13:21.045 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-259.g91c8a7e5.e 30/160 2024-09-05T01:13:21.045 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noar 31/160 2024-09-05T01:13:21.045 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.no 32/160 2024-09-05T01:13:21.046 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8 33/160 2024-09-05T01:13:21.046 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-259.g91c8a7e5.el9 34/160 2024-09-05T01:13:21.046 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 35/160 2024-09-05T01:13:21.046 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-259.g91c8a7e5.el 36/160 2024-09-05T01:13:21.046 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 37/160 2024-09-05T01:13:21.046 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 38/160 2024-09-05T01:13:21.046 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-top-2:19.1.1-259.g91c8a7e5.el9.noarch 39/160 2024-09-05T01:13:21.046 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/160 2024-09-05T01:13:21.046 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/160 2024-09-05T01:13:21.046 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/160 2024-09-05T01:13:21.046 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/160 2024-09-05T01:13:21.046 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/160 2024-09-05T01:13:21.046 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/160 2024-09-05T01:13:21.047 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/160 2024-09-05T01:13:21.047 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/160 2024-09-05T01:13:21.047 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/160 2024-09-05T01:13:21.047 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/160 2024-09-05T01:13:21.047 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/160 2024-09-05T01:13:21.047 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/160 2024-09-05T01:13:21.047 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/160 2024-09-05T01:13:21.047 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/160 2024-09-05T01:13:21.047 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/160 2024-09-05T01:13:21.047 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/160 2024-09-05T01:13:21.047 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/160 2024-09-05T01:13:21.047 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/160 2024-09-05T01:13:21.047 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/160 2024-09-05T01:13:21.048 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/160 2024-09-05T01:13:21.048 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/160 2024-09-05T01:13:21.048 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/160 2024-09-05T01:13:21.048 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/160 2024-09-05T01:13:21.048 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/160 2024-09-05T01:13:21.048 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/160 2024-09-05T01:13:21.048 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/160 2024-09-05T01:13:21.048 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/160 2024-09-05T01:13:21.048 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/160 2024-09-05T01:13:21.048 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/160 2024-09-05T01:13:21.048 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/160 2024-09-05T01:13:21.048 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/160 2024-09-05T01:13:21.049 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/160 2024-09-05T01:13:21.049 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/160 2024-09-05T01:13:21.049 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/160 2024-09-05T01:13:21.049 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/160 2024-09-05T01:13:21.049 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/160 2024-09-05T01:13:21.049 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/160 2024-09-05T01:13:21.049 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/160 2024-09-05T01:13:21.049 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/160 2024-09-05T01:13:21.049 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/160 2024-09-05T01:13:21.049 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/160 2024-09-05T01:13:21.049 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/160 2024-09-05T01:13:21.049 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/160 2024-09-05T01:13:21.049 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/160 2024-09-05T01:13:21.050 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/160 2024-09-05T01:13:21.050 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/160 2024-09-05T01:13:21.050 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/160 2024-09-05T01:13:21.050 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/160 2024-09-05T01:13:21.050 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/160 2024-09-05T01:13:21.050 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/160 2024-09-05T01:13:21.050 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/160 2024-09-05T01:13:21.050 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/160 2024-09-05T01:13:21.050 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/160 2024-09-05T01:13:21.050 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/160 2024-09-05T01:13:21.050 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/160 2024-09-05T01:13:21.050 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/160 2024-09-05T01:13:21.050 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/160 2024-09-05T01:13:21.051 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/160 2024-09-05T01:13:21.051 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/160 2024-09-05T01:13:21.051 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/160 2024-09-05T01:13:21.051 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/160 2024-09-05T01:13:21.051 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/160 2024-09-05T01:13:21.051 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/160 2024-09-05T01:13:21.051 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/160 2024-09-05T01:13:21.051 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/160 2024-09-05T01:13:21.051 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/160 2024-09-05T01:13:21.051 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/160 2024-09-05T01:13:21.051 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/160 2024-09-05T01:13:21.051 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/160 2024-09-05T01:13:21.051 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/160 2024-09-05T01:13:21.051 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/160 2024-09-05T01:13:21.052 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/160 2024-09-05T01:13:21.052 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/160 2024-09-05T01:13:21.052 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/160 2024-09-05T01:13:21.052 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/160 2024-09-05T01:13:21.052 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/160 2024-09-05T01:13:21.052 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/160 2024-09-05T01:13:21.052 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/160 2024-09-05T01:13:21.052 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/160 2024-09-05T01:13:21.052 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/160 2024-09-05T01:13:21.052 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/160 2024-09-05T01:13:21.052 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/160 2024-09-05T01:13:21.052 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/160 2024-09-05T01:13:21.052 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/160 2024-09-05T01:13:21.052 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/160 2024-09-05T01:13:21.053 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/160 2024-09-05T01:13:21.053 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/160 2024-09-05T01:13:21.053 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/160 2024-09-05T01:13:21.053 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/160 2024-09-05T01:13:21.053 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/160 2024-09-05T01:13:21.053 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/160 2024-09-05T01:13:21.053 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/160 2024-09-05T01:13:21.053 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/160 2024-09-05T01:13:21.053 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/160 2024-09-05T01:13:21.053 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/160 2024-09-05T01:13:21.053 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/160 2024-09-05T01:13:21.053 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/160 2024-09-05T01:13:21.054 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/160 2024-09-05T01:13:21.054 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/160 2024-09-05T01:13:21.054 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/160 2024-09-05T01:13:21.054 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/160 2024-09-05T01:13:21.054 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/160 2024-09-05T01:13:21.054 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/160 2024-09-05T01:13:21.054 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/160 2024-09-05T01:13:21.054 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/160 2024-09-05T01:13:21.054 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/160 2024-09-05T01:13:21.054 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/160 2024-09-05T01:13:21.054 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/160 2024-09-05T01:13:21.054 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/160 2024-09-05T01:13:21.055 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 149/160 2024-09-05T01:13:21.055 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/160 2024-09-05T01:13:21.055 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 151/160 2024-09-05T01:13:21.055 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/160 2024-09-05T01:13:21.055 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-1:1.48.10-1.el9.x86_64 153/160 2024-09-05T01:13:21.055 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/160 2024-09-05T01:13:21.055 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-libnm-1:1.48.10-1.el9.x86_64 155/160 2024-09-05T01:13:21.055 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/160 2024-09-05T01:13:21.055 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-team-1:1.48.10-1.el9.x86_64 157/160 2024-09-05T01:13:21.055 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/160 2024-09-05T01:13:21.055 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-tui-1:1.48.10-1.el9.x86_64 159/160 2024-09-05T01:13:23.276 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/160 2024-09-05T01:13:23.276 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:13:23.276 INFO:teuthology.orchestra.run.smithi012.stdout:Upgraded: 2024-09-05T01:13:23.276 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-1:1.48.10-1.el9.x86_64 2024-09-05T01:13:23.276 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-libnm-1:1.48.10-1.el9.x86_64 2024-09-05T01:13:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-team-1:1.48.10-1.el9.x86_64 2024-09-05T01:13:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-tui-1:1.48.10-1.el9.x86_64 2024-09-05T01:13:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: librados2-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.277 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-09-05T01:13:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-05T01:13:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: automake-1.16.2-8.el9.noarch 2024-09-05T01:13:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: bison-3.7.4-5.el9.x86_64 2024-09-05T01:13:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-05T01:13:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.277 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.278 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-shell-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top-2:19.1.1-259.g91c8a7e5.el9.noarch 2024-09-05T01:13:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-05T01:13:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: flex-2.6.4-9.el9.x86_64 2024-09-05T01:13:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-05T01:13:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-05T01:13:23.279 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-05T01:13:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-05T01:13:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-05T01:13:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-05T01:13:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-05T01:13:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-05T01:13:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-05T01:13:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-05T01:13:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-05T01:13:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-05T01:13:23.280 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-05T01:13:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-05T01:13:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-05T01:13:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-05T01:13:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-05T01:13:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-05T01:13:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-05T01:13:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-05T01:13:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: lua-5.4.4-4.el9.x86_64 2024-09-05T01:13:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-05T01:13:23.281 INFO:teuthology.orchestra.run.smithi012.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-05T01:13:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-05T01:13:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-05T01:13:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-09-05T01:13:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-05T01:13:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-13.16-1.el9.x86_64 2024-09-05T01:13:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-05T01:13:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-05T01:13:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-05T01:13:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-05T01:13:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-05T01:13:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-05T01:13:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-05T01:13:23.282 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-05T01:13:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-05T01:13:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-05T01:13:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-05T01:13:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-05T01:13:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-05T01:13:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-05T01:13:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-05T01:13:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-05T01:13:23.283 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-05T01:13:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-05T01:13:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-05T01:13:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-05T01:13:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-05T01:13:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-05T01:13:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-05T01:13:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-05T01:13:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-05T01:13:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-05T01:13:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-05T01:13:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-05T01:13:23.284 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-05T01:13:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-05T01:13:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-05T01:13:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-05T01:13:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-05T01:13:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-05T01:13:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-05T01:13:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-05T01:13:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-05T01:13:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-05T01:13:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-05T01:13:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-05T01:13:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply-3.11-14.el9.noarch 2024-09-05T01:13:23.285 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-05T01:13:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-05T01:13:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-05T01:13:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-05T01:13:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-05T01:13:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-05T01:13:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-05T01:13:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-05T01:13:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-05T01:13:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-05T01:13:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-05T01:13:23.286 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-05T01:13:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-05T01:13:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-05T01:13:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-05T01:13:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-05T01:13:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-05T01:13:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-05T01:13:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-05T01:13:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-05T01:13:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-05T01:13:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-05T01:13:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-05T01:13:23.287 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-05T01:13:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-05T01:13:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-05T01:13:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-05T01:13:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd-2:19.1.1-259.g91c8a7e5.el9.x86_64 2024-09-05T01:13:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: re2-1:20211101-20.el9.x86_64 2024-09-05T01:13:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-05T01:13:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-05T01:13:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-05T01:13:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-05T01:13:23.288 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-05T01:13:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-05T01:13:23.289 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:13:23.289 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-09-05T01:13:23.949 DEBUG:teuthology.parallel:result is None 2024-09-05T01:13:23.950 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T01:13:24.098 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-05T01:13:24.142 INFO:teuthology.orchestra.run.smithi012.stdout:19.1.1-259.g91c8a7e5.el9 2024-09-05T01:13:24.143 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-259.g91c8a7e5.el9 2024-09-05T01:13:24.143 INFO:teuthology.task.install:The correct ceph version 19.1.1-259.g91c8a7e5 is installed. 2024-09-05T01:13:24.145 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T01:13:24.290 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-05T01:13:24.317 INFO:teuthology.orchestra.run.smithi145.stdout:19.1.1-259.g91c8a7e5.el9 2024-09-05T01:13:24.317 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-259.g91c8a7e5.el9 2024-09-05T01:13:24.317 INFO:teuthology.task.install:The correct ceph version 19.1.1-259.g91c8a7e5 is installed. 2024-09-05T01:13:24.319 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T01:13:24.464 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-05T01:13:24.490 INFO:teuthology.orchestra.run.smithi151.stdout:19.1.1-259.g91c8a7e5.el9 2024-09-05T01:13:24.490 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-259.g91c8a7e5.el9 2024-09-05T01:13:24.491 INFO:teuthology.task.install:The correct ceph version 19.1.1-259.g91c8a7e5 is installed. 2024-09-05T01:13:24.492 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-05T01:13:24.493 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-05T01:13:24.493 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-05T01:13:24.551 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-05T01:13:24.552 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-05T01:13:24.584 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-05T01:13:24.584 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-05T01:13:24.615 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-05T01:13:24.615 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-05T01:13:24.615 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/daemon-helper 2024-09-05T01:13:24.671 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-05T01:13:24.768 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-05T01:13:24.769 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/daemon-helper 2024-09-05T01:13:24.798 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-05T01:13:24.868 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-05T01:13:24.868 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2024-09-05T01:13:24.898 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-05T01:13:24.967 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-05T01:13:24.967 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-05T01:13:24.967 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-05T01:13:25.023 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-05T01:13:25.120 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-05T01:13:25.120 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-05T01:13:25.144 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-05T01:13:25.210 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-05T01:13:25.210 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-05T01:13:25.239 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-05T01:13:25.308 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-05T01:13:25.308 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-05T01:13:25.308 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/stdin-killer 2024-09-05T01:13:25.364 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-05T01:13:25.463 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-05T01:13:25.463 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/stdin-killer 2024-09-05T01:13:25.488 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-05T01:13:25.553 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-05T01:13:25.553 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2024-09-05T01:13:25.583 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-05T01:13:25.651 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-05T01:13:25.737 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-05T01:13:25.737 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T01:13:25.738 INFO:tasks.cephadm:Cluster fsid is 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:13:25.738 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-05T01:13:25.738 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.12', 'mon.b': '172.21.15.145', 'mon.c': '172.21.15.151'} 2024-09-05T01:13:25.738 INFO:tasks.cephadm:First mon is mon.a on smithi012 2024-09-05T01:13:25.738 INFO:tasks.cephadm:First mgr is x 2024-09-05T01:13:25.739 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-05T01:13:25.739 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname $(hostname -s) 2024-09-05T01:13:25.796 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname $(hostname -s) 2024-09-05T01:13:25.820 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname $(hostname -s) 2024-09-05T01:13:25.849 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-05T01:13:25.850 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T01:13:26.001 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56000/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-259-g91c8a7e5', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-259.g91c8a7e5'}, 'url': 'https://3.chacra.ceph.com/r/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-04 16:53:37.418684', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-05T01:13:26.139 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref squid, sha1 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T01:13:26.141 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/x86_64/flavors/default/cephadm 2024-09-05T01:13:26.141 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/x86_64/flavors/default/cephadm 2024-09-05T01:13:26.141 DEBUG:teuthology.orchestra.run.smithi012:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-05T01:13:26.547 INFO:teuthology.orchestra.run.smithi012.stdout:-rw-r--r--. 1 ubuntu ubuntu 784521 Sep 5 01:13 /home/ubuntu/cephtest/cephadm 2024-09-05T01:13:26.547 DEBUG:teuthology.orchestra.run.smithi145:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-05T01:13:26.967 INFO:teuthology.orchestra.run.smithi145.stdout:-rw-r--r--. 1 ubuntu ubuntu 784521 Sep 5 01:13 /home/ubuntu/cephtest/cephadm 2024-09-05T01:13:26.968 DEBUG:teuthology.orchestra.run.smithi151:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/squid/91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-05T01:13:27.376 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-r--r--. 1 ubuntu ubuntu 784521 Sep 5 01:13 /home/ubuntu/cephtest/cephadm 2024-09-05T01:13:27.376 DEBUG:teuthology.orchestra.run.smithi012:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-05T01:13:27.413 DEBUG:teuthology.orchestra.run.smithi145:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-05T01:13:27.433 DEBUG:teuthology.orchestra.run.smithi151:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-05T01:13:27.467 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 on all hosts... 2024-09-05T01:13:27.467 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 pull 2024-09-05T01:13:27.471 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 pull 2024-09-05T01:13:27.476 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 pull 2024-09-05T01:13:29.099 INFO:teuthology.orchestra.run.smithi145.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4... 2024-09-05T01:13:29.110 INFO:teuthology.orchestra.run.smithi151.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4... 2024-09-05T01:13:29.414 INFO:teuthology.orchestra.run.smithi012.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4... 2024-09-05T01:13:59.325 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-05T01:13:59.326 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_version": "ceph version 19.1.1-259-g91c8a7e5 (91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4) squid (stable)", 2024-09-05T01:13:59.326 INFO:teuthology.orchestra.run.smithi151.stdout: "image_id": "77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac", 2024-09-05T01:13:59.326 INFO:teuthology.orchestra.run.smithi151.stdout: "repo_digests": [ 2024-09-05T01:13:59.326 INFO:teuthology.orchestra.run.smithi151.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067" 2024-09-05T01:13:59.326 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-09-05T01:13:59.326 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-05T01:14:05.440 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-09-05T01:14:05.440 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_version": "ceph version 19.1.1-259-g91c8a7e5 (91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4) squid (stable)", 2024-09-05T01:14:05.440 INFO:teuthology.orchestra.run.smithi145.stdout: "image_id": "77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac", 2024-09-05T01:14:05.440 INFO:teuthology.orchestra.run.smithi145.stdout: "repo_digests": [ 2024-09-05T01:14:05.440 INFO:teuthology.orchestra.run.smithi145.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067" 2024-09-05T01:14:05.440 INFO:teuthology.orchestra.run.smithi145.stdout: ] 2024-09-05T01:14:05.440 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-09-05T01:14:10.307 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:14:10.308 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_version": "ceph version 19.1.1-259-g91c8a7e5 (91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4) squid (stable)", 2024-09-05T01:14:10.308 INFO:teuthology.orchestra.run.smithi012.stdout: "image_id": "77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac", 2024-09-05T01:14:10.308 INFO:teuthology.orchestra.run.smithi012.stdout: "repo_digests": [ 2024-09-05T01:14:10.308 INFO:teuthology.orchestra.run.smithi012.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067" 2024-09-05T01:14:10.308 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-05T01:14:10.308 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:14:10.339 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /etc/ceph 2024-09-05T01:14:10.396 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /etc/ceph 2024-09-05T01:14:10.429 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph 2024-09-05T01:14:10.464 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 777 /etc/ceph 2024-09-05T01:14:10.519 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 777 /etc/ceph 2024-09-05T01:14:10.548 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /etc/ceph 2024-09-05T01:14:10.577 INFO:tasks.cephadm:Writing seed config... 2024-09-05T01:14:10.578 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-05T01:14:10.578 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-05T01:14:10.578 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-05T01:14:10.578 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-05T01:14:10.578 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-05T01:14:10.578 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-05T01:14:10.578 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-05T01:14:10.578 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-05T01:14:10.578 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-05T01:14:10.578 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-05T01:14:10.579 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-05T01:14:10.579 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-05T01:14:10.579 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-05T01:14:10.579 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-05T01:14:10.579 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-05T01:14:10.579 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-05T01:14:10.579 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-05T01:14:10.579 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-05T01:14:10.579 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-05T01:14:10.579 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-05T01:14:10.579 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-05T01:14:10.579 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-05T01:14:10.579 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-05T01:14:10.579 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-05T01:14:10.579 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-05T01:14:10.579 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-05T01:14:10.580 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-05T01:14:10.580 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-05T01:14:10.580 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-05T01:14:10.580 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-05T01:14:10.580 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-05T01:14:10.580 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-05T01:14:10.580 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-05T01:14:10.580 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-05T01:14:10.580 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-05T01:14:10.580 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-05T01:14:10.580 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-05T01:14:10.580 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-05T01:14:10.580 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-05T01:14:10.581 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-05T01:14:10.581 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-05T01:14:10.581 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-05T01:14:10.581 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-05T01:14:10.581 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-05T01:14:10.581 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-05T01:14:10.581 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-05T01:14:10.581 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-05T01:14:10.581 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-05T01:14:10.581 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-05T01:14:10.582 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-05T01:14:10.582 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-05T01:14:10.616 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 0d44cd7e-6b24-11ef-bcd6-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-05T01:14:10.617 DEBUG:teuthology.orchestra.run.smithi012:mon.a> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mon.a.service 2024-09-05T01:14:10.661 DEBUG:teuthology.orchestra.run.smithi012:mgr.x> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mgr.x.service 2024-09-05T01:14:10.707 INFO:tasks.cephadm:Bootstrapping... 2024-09-05T01:14:10.707 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 -v bootstrap --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.12 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-05T01:14:10.971 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-09-05T01:14:10.971 INFO:teuthology.orchestra.run.smithi012.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4', '-v', 'bootstrap', '--fsid', '0d44cd7e-6b24-11ef-bcd6-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.12', '--skip-admin-label'] 2024-09-05T01:14:10.971 INFO:teuthology.orchestra.run.smithi012.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-05T01:14:10.972 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying podman|docker is present... 2024-09-05T01:14:11.016 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stdout 5.2.2 2024-09-05T01:14:11.016 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying lvm2 is present... 2024-09-05T01:14:11.016 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying time synchronization is in place... 2024-09-05T01:14:11.030 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-05T01:14:11.030 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-05T01:14:11.042 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-05T01:14:11.043 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-09-05T01:14:11.056 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout enabled 2024-09-05T01:14:11.069 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout active 2024-09-05T01:14:11.069 INFO:teuthology.orchestra.run.smithi012.stdout:Unit chronyd.service is enabled and running 2024-09-05T01:14:11.069 INFO:teuthology.orchestra.run.smithi012.stdout:Repeating the final host check... 2024-09-05T01:14:11.112 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stdout 5.2.2 2024-09-05T01:14:11.112 INFO:teuthology.orchestra.run.smithi012.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-05T01:14:11.112 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl is present 2024-09-05T01:14:11.112 INFO:teuthology.orchestra.run.smithi012.stdout:lvcreate is present 2024-09-05T01:14:11.125 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-05T01:14:11.125 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-05T01:14:11.137 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-05T01:14:11.137 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-09-05T01:14:11.150 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout enabled 2024-09-05T01:14:11.163 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout active 2024-09-05T01:14:11.163 INFO:teuthology.orchestra.run.smithi012.stdout:Unit chronyd.service is enabled and running 2024-09-05T01:14:11.163 INFO:teuthology.orchestra.run.smithi012.stdout:Host looks OK 2024-09-05T01:14:11.163 INFO:teuthology.orchestra.run.smithi012.stdout:Cluster fsid: 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:14:11.164 INFO:teuthology.orchestra.run.smithi012.stdout:Acquiring lock 140508761318256 on /run/cephadm/0d44cd7e-6b24-11ef-bcd6-c7b262605968.lock 2024-09-05T01:14:11.164 INFO:teuthology.orchestra.run.smithi012.stdout:Lock 140508761318256 acquired on /run/cephadm/0d44cd7e-6b24-11ef-bcd6-c7b262605968.lock 2024-09-05T01:14:11.164 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying IP 172.21.15.12 port 3300 ... 2024-09-05T01:14:11.164 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying IP 172.21.15.12 port 6789 ... 2024-09-05T01:14:11.165 INFO:teuthology.orchestra.run.smithi012.stdout:Base mon IP(s) is [172.21.15.12:3300, 172.21.15.12:6789], mon addrv is [v2:172.21.15.12:3300,v1:172.21.15.12:6789] 2024-09-05T01:14:11.171 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.12 metric 100 2024-09-05T01:14:11.172 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.12 metric 100 2024-09-05T01:14:11.177 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-05T01:14:11.178 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-05T01:14:11.178 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1778sec hoplimit 64 pref medium 2024-09-05T01:14:11.183 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-05T01:14:11.183 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-05T01:14:11.183 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-05T01:14:11.184 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-05T01:14:11.184 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2024-09-05T01:14:11.184 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-05T01:14:11.184 INFO:teuthology.orchestra.run.smithi012.stdout:Mon IP `172.21.15.12` is in CIDR network `172.21.0.0/20` 2024-09-05T01:14:11.184 INFO:teuthology.orchestra.run.smithi012.stdout:Mon IP `172.21.15.12` is in CIDR network `172.21.0.0/20` 2024-09-05T01:14:11.185 INFO:teuthology.orchestra.run.smithi012.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-05T01:14:11.185 INFO:teuthology.orchestra.run.smithi012.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-05T01:14:11.186 INFO:teuthology.orchestra.run.smithi012.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4... 2024-09-05T01:14:11.735 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stdout 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac 2024-09-05T01:14:11.735 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4... 2024-09-05T01:14:11.735 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Getting image source signatures 2024-09-05T01:14:11.735 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Copying blob sha256:3f43494a24a2d1fe0d791eb19b05391e70ab9f54611bc9deae80cf7c3fb2dba9 2024-09-05T01:14:11.735 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-05T01:14:11.735 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Copying config sha256:77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac 2024-09-05T01:14:11.735 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-05T01:14:12.866 INFO:teuthology.orchestra.run.smithi012.stdout:ceph: stdout ceph version 19.1.1-259-g91c8a7e5 (91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4) squid (stable) 2024-09-05T01:14:12.866 INFO:teuthology.orchestra.run.smithi012.stdout:Ceph version: ceph version 19.1.1-259-g91c8a7e5 (91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4) squid (stable) 2024-09-05T01:14:12.866 INFO:teuthology.orchestra.run.smithi012.stdout:Extracting ceph user uid/gid from container image... 2024-09-05T01:14:13.884 INFO:teuthology.orchestra.run.smithi012.stdout:stat: stdout 167 167 2024-09-05T01:14:13.884 INFO:teuthology.orchestra.run.smithi012.stdout:Creating initial keys... 2024-09-05T01:14:15.058 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph-authtool: stdout AQDmBdlmR4FyEhAAxDc0laeLbJdX4we8SlAxTQ== 2024-09-05T01:14:16.024 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph-authtool: stdout AQDnBdlmNum7GRAAVA9zAegxbB6vSpy7nF3zAA== 2024-09-05T01:14:17.002 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph-authtool: stdout AQDoBdlm0C4dGBAA0rER7sAv+NZ0leyvMdiBsA== 2024-09-05T01:14:17.003 INFO:teuthology.orchestra.run.smithi012.stdout:Creating initial monmap... 2024-09-05T01:14:17.969 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-05T01:14:17.969 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-05T01:14:17.969 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:14:17.969 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-05T01:14:17.969 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool for a [v2:172.21.15.12:3300,v1:172.21.15.12:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-05T01:14:17.969 INFO:teuthology.orchestra.run.smithi012.stdout:setting min_mon_release = quincy 2024-09-05T01:14:17.969 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: set fsid to 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:14:17.969 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-05T01:14:17.969 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:14:17.970 INFO:teuthology.orchestra.run.smithi012.stdout:Creating mon... 2024-09-05T01:14:19.066 INFO:teuthology.orchestra.run.smithi012.stdout:create mon.a on 2024-09-05T01:14:19.394 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-05T01:14:19.628 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-05T01:14:19.896 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968.target → /etc/systemd/system/ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968.target. 2024-09-05T01:14:19.897 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968.target → /etc/systemd/system/ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968.target. 2024-09-05T01:14:20.260 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mon.a 2024-09-05T01:14:20.260 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Failed to reset failed state of unit ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mon.a.service: Unit ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mon.a.service not loaded. 2024-09-05T01:14:20.522 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968.target.wants/ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mon.a.service → /etc/systemd/system/ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@.service. 2024-09-05T01:14:21.166 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:21 smithi012 podman[29561]: 2024-09-05 01:14:21.103386824 +0000 UTC m=+0.364668567 container start abc69643ba2c8ba152fbfbd275bce97155dd4f85de6cebc1b33459c4e3fe584b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-a, RELEASE=squid-91c8a7e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T01:14:21.166 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:21 smithi012 ceph-mon[29580]: mkfs 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:14:21.198 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-05T01:14:21.198 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout disabled 2024-09-05T01:14:21.211 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-05T01:14:21.211 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-09-05T01:14:21.211 INFO:teuthology.orchestra.run.smithi012.stdout:firewalld.service is not enabled 2024-09-05T01:14:21.211 INFO:teuthology.orchestra.run.smithi012.stdout:Not possible to enable service . firewalld.service is not available 2024-09-05T01:14:21.212 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mon to start... 2024-09-05T01:14:21.212 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mon... 2024-09-05T01:14:21.439 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:21 smithi012 ceph-mon[29580]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-05T01:14:21.439 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:21 smithi012 bash[29561]: abc69643ba2c8ba152fbfbd275bce97155dd4f85de6cebc1b33459c4e3fe584b 2024-09-05T01:14:21.439 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:21 smithi012 systemd[1]: Started Ceph mon.a for 0d44cd7e-6b24-11ef-bcd6-c7b262605968. 2024-09-05T01:14:22.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:22 smithi012 ceph-mon[29580]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-05T01:14:22.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:22 smithi012 ceph-mon[29580]: monmap epoch 1 2024-09-05T01:14:22.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:22 smithi012 ceph-mon[29580]: fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:14:22.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:22 smithi012 ceph-mon[29580]: last_changed 2024-09-05T01:14:17.366670+0000 2024-09-05T01:14:22.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:22 smithi012 ceph-mon[29580]: created 2024-09-05T01:14:17.366670+0000 2024-09-05T01:14:22.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:22 smithi012 ceph-mon[29580]: min_mon_release 19 (squid) 2024-09-05T01:14:22.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:22 smithi012 ceph-mon[29580]: election_strategy: 1 2024-09-05T01:14:22.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:22 smithi012 ceph-mon[29580]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-05T01:14:22.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:22 smithi012 ceph-mon[29580]: fsmap 2024-09-05T01:14:22.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:22 smithi012 ceph-mon[29580]: osdmap e1: 0 total, 0 up, 0 in 2024-09-05T01:14:22.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:22 smithi012 ceph-mon[29580]: mgrmap e1: no daemons active 2024-09-05T01:14:22.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:22 smithi012 ceph-mon[29580]: from='client.? 172.21.15.12:0/4135021236' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-05T01:14:22.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout cluster: 2024-09-05T01:14:22.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout id: 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:14:22.602 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-05T01:14:22.602 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-05T01:14:22.602 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout services: 2024-09-05T01:14:22.608 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.635164s) 2024-09-05T01:14:22.608 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-05T01:14:22.608 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-05T01:14:22.608 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-05T01:14:22.608 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout data: 2024-09-05T01:14:22.608 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-05T01:14:22.608 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-05T01:14:22.609 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-05T01:14:22.609 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout pgs: 2024-09-05T01:14:22.609 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-05T01:14:22.609 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.717+0000 7fc9d2600640 1 Processor -- start 2024-09-05T01:14:22.609 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.718+0000 7fc9d2600640 1 -- start start 2024-09-05T01:14:22.609 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.718+0000 7fc9d2600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc1098f0 0x7fc9cc109cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:22.609 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.718+0000 7fc9d2600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc10a2c0 con 0x7fc9cc1098f0 2024-09-05T01:14:22.609 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.719+0000 7fc9cb400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc1098f0 0x7fc9cc109cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:22.609 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.719+0000 7fc9cb400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc1098f0 0x7fc9cc109cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57488/0 (socket says 172.21.15.12:57488) 2024-09-05T01:14:22.609 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.719+0000 7fc9cb400640 1 -- 172.21.15.12:0/3974987956 learned_addr learned my addr 172.21.15.12:0/3974987956 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:22.609 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.719+0000 7fc9cb400640 1 -- 172.21.15.12:0/3974987956 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9cc10ab10 con 0x7fc9cc1098f0 2024-09-05T01:14:22.609 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.722+0000 7fc9cb400640 1 --2- 172.21.15.12:0/3974987956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc1098f0 0x7fc9cc109cf0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc009820 tx=0x7fc9bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687d33ddc5bd09f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:22.610 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.722+0000 7fc9caa00640 1 -- 172.21.15.12:0/3974987956 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9bc037070 con 0x7fc9cc1098f0 2024-09-05T01:14:22.610 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.722+0000 7fc9caa00640 1 -- 172.21.15.12:0/3974987956 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9bc032440 con 0x7fc9cc1098f0 2024-09-05T01:14:22.610 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.722+0000 7fc9caa00640 1 -- 172.21.15.12:0/3974987956 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9bc032740 con 0x7fc9cc1098f0 2024-09-05T01:14:22.610 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.723+0000 7fc9d2600640 1 -- 172.21.15.12:0/3974987956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc1098f0 msgr2=0x7fc9cc109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:22.610 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.723+0000 7fc9d2600640 1 --2- 172.21.15.12:0/3974987956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc1098f0 0x7fc9cc109cf0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc009820 tx=0x7fc9bc02a270 comp rx=0 tx=0).stop 2024-09-05T01:14:22.610 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.723+0000 7fc9d2600640 1 -- 172.21.15.12:0/3974987956 shutdown_connections 2024-09-05T01:14:22.610 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.723+0000 7fc9d2600640 1 --2- 172.21.15.12:0/3974987956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc1098f0 0x7fc9cc109cf0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:22.610 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.723+0000 7fc9d2600640 1 -- 172.21.15.12:0/3974987956 >> 172.21.15.12:0/3974987956 conn(0x7fc9cc07ceb0 msgr2=0x7fc9cc07d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:22.610 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.723+0000 7fc9d2600640 1 -- 172.21.15.12:0/3974987956 shutdown_connections 2024-09-05T01:14:22.610 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.723+0000 7fc9d2600640 1 -- 172.21.15.12:0/3974987956 wait complete. 2024-09-05T01:14:22.610 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.724+0000 7fc9d2600640 1 Processor -- start 2024-09-05T01:14:22.611 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.724+0000 7fc9d2600640 1 -- start start 2024-09-05T01:14:22.611 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.724+0000 7fc9d2600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc1098f0 0x7fc9cc19d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:22.611 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.724+0000 7fc9d2600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc10b0b0 con 0x7fc9cc1098f0 2024-09-05T01:14:22.611 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.725+0000 7fc9cb400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc1098f0 0x7fc9cc19d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:22.611 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.725+0000 7fc9cb400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc1098f0 0x7fc9cc19d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57498/0 (socket says 172.21.15.12:57498) 2024-09-05T01:14:22.611 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.725+0000 7fc9cb400640 1 -- 172.21.15.12:0/4135021236 learned_addr learned my addr 172.21.15.12:0/4135021236 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:22.611 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.725+0000 7fc9cb400640 1 -- 172.21.15.12:0/4135021236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9cc19d620 con 0x7fc9cc1098f0 2024-09-05T01:14:22.611 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.725+0000 7fc9cb400640 1 --2- 172.21.15.12:0/4135021236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc1098f0 0x7fc9cc19d0e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0090b0 tx=0x7fc9bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:22.611 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.726+0000 7fc9c8c00640 1 -- 172.21.15.12:0/4135021236 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9bc041070 con 0x7fc9cc1098f0 2024-09-05T01:14:22.611 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.726+0000 7fc9c8c00640 1 -- 172.21.15.12:0/4135021236 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9bc03c7a0 con 0x7fc9cc1098f0 2024-09-05T01:14:22.611 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.726+0000 7fc9c8c00640 1 -- 172.21.15.12:0/4135021236 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9bc037040 con 0x7fc9cc1098f0 2024-09-05T01:14:22.611 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.726+0000 7fc9d2600640 1 -- 172.21.15.12:0/4135021236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9cc19d8b0 con 0x7fc9cc1098f0 2024-09-05T01:14:22.611 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.726+0000 7fc9d2600640 1 -- 172.21.15.12:0/4135021236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9cc1a05a0 con 0x7fc9cc1098f0 2024-09-05T01:14:22.611 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.726+0000 7fc9c8c00640 1 -- 172.21.15.12:0/4135021236 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc9bc044070 con 0x7fc9cc1098f0 2024-09-05T01:14:22.612 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.726+0000 7fc9c8c00640 1 -- 172.21.15.12:0/4135021236 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc9bc03d3f0 con 0x7fc9cc1098f0 2024-09-05T01:14:22.612 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.727+0000 7fc9d2600640 1 -- 172.21.15.12:0/4135021236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9cc10b720 con 0x7fc9cc1098f0 2024-09-05T01:14:22.612 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.730+0000 7fc9c8c00640 1 -- 172.21.15.12:0/4135021236 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc9bc046450 con 0x7fc9cc1098f0 2024-09-05T01:14:22.612 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.795+0000 7fc9d2600640 1 -- 172.21.15.12:0/4135021236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fc9cc1a0af0 con 0x7fc9cc1098f0 2024-09-05T01:14:22.612 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.795+0000 7fc9c8c00640 1 -- 172.21.15.12:0/4135021236 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fc9bc046630 con 0x7fc9cc1098f0 2024-09-05T01:14:22.612 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.796+0000 7fc9d2600640 1 -- 172.21.15.12:0/4135021236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc1098f0 msgr2=0x7fc9cc19d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:22.612 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.796+0000 7fc9d2600640 1 --2- 172.21.15.12:0/4135021236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc1098f0 0x7fc9cc19d0e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0090b0 tx=0x7fc9bc0046c0 comp rx=0 tx=0).stop 2024-09-05T01:14:22.612 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.796+0000 7fc9d2600640 1 -- 172.21.15.12:0/4135021236 shutdown_connections 2024-09-05T01:14:22.612 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.796+0000 7fc9d2600640 1 --2- 172.21.15.12:0/4135021236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc9cc1098f0 0x7fc9cc19d0e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:22.612 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.796+0000 7fc9d2600640 1 -- 172.21.15.12:0/4135021236 >> 172.21.15.12:0/4135021236 conn(0x7fc9cc07ceb0 msgr2=0x7fc9cc1913d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:22.612 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.796+0000 7fc9d2600640 1 -- 172.21.15.12:0/4135021236 shutdown_connections 2024-09-05T01:14:22.612 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:21.797+0000 7fc9d2600640 1 -- 172.21.15.12:0/4135021236 wait complete. 2024-09-05T01:14:22.612 INFO:teuthology.orchestra.run.smithi012.stdout:mon is available 2024-09-05T01:14:22.612 INFO:teuthology.orchestra.run.smithi012.stdout:Assimilating anything we can from ceph.conf... 2024-09-05T01:14:23.450 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:23 smithi012 ceph-mon[29580]: from='client.? 172.21.15.12:0/945265488' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-05T01:14:23.450 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:23 smithi012 ceph-mon[29580]: from='client.? 172.21.15.12:0/945265488' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-05T01:14:23.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-05T01:14:23.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [global] 2024-09-05T01:14:23.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout fsid = 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:14:23.722 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.12:3300,v1:172.21.15.12:6789] 2024-09-05T01:14:23.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-05T01:14:23.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-05T01:14:23.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-05T01:14:23.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-05T01:14:23.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-05T01:14:23.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-05T01:14:23.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-05T01:14:23.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-05T01:14:23.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [osd] 2024-09-05T01:14:23.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-05T01:14:23.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-05T01:14:23.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-05T01:14:23.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-05T01:14:23.723 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-05T01:14:23.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.088+0000 7fea87400640 1 Processor -- start 2024-09-05T01:14:23.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.088+0000 7fea87400640 1 -- start start 2024-09-05T01:14:23.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.088+0000 7fea87400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8007de80 0x7fea8007c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:23.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.088+0000 7fea87400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fea8007c8b0 con 0x7fea8007de80 2024-09-05T01:14:23.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.089+0000 7fea84a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8007de80 0x7fea8007c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:23.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.089+0000 7fea84a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8007de80 0x7fea8007c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57510/0 (socket says 172.21.15.12:57510) 2024-09-05T01:14:23.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.089+0000 7fea84a00640 1 -- 172.21.15.12:0/3792322847 learned_addr learned my addr 172.21.15.12:0/3792322847 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:23.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.089+0000 7fea84a00640 1 -- 172.21.15.12:0/3792322847 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea8007ca30 con 0x7fea8007de80 2024-09-05T01:14:23.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.090+0000 7fea84a00640 1 --2- 172.21.15.12:0/3792322847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8007de80 0x7fea8007c2e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fea74009820 tx=0x7fea7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bfda9f965503a2c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:23.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.090+0000 7fea7f400640 1 -- 172.21.15.12:0/3792322847 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea74037070 con 0x7fea8007de80 2024-09-05T01:14:23.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.091+0000 7fea7f400640 1 -- 172.21.15.12:0/3792322847 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea74032440 con 0x7fea8007de80 2024-09-05T01:14:23.724 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.091+0000 7fea7f400640 1 -- 172.21.15.12:0/3792322847 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea74032740 con 0x7fea8007de80 2024-09-05T01:14:23.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.091+0000 7fea87400640 1 -- 172.21.15.12:0/3792322847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8007de80 msgr2=0x7fea8007c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:23.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.091+0000 7fea87400640 1 --2- 172.21.15.12:0/3792322847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8007de80 0x7fea8007c2e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fea74009820 tx=0x7fea7402a270 comp rx=0 tx=0).stop 2024-09-05T01:14:23.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.091+0000 7fea87400640 1 -- 172.21.15.12:0/3792322847 shutdown_connections 2024-09-05T01:14:23.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.091+0000 7fea87400640 1 --2- 172.21.15.12:0/3792322847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8007de80 0x7fea8007c2e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:23.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.091+0000 7fea87400640 1 -- 172.21.15.12:0/3792322847 >> 172.21.15.12:0/3792322847 conn(0x7fea80102e80 msgr2=0x7fea801052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:23.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.091+0000 7fea87400640 1 -- 172.21.15.12:0/3792322847 shutdown_connections 2024-09-05T01:14:23.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.091+0000 7fea87400640 1 -- 172.21.15.12:0/3792322847 wait complete. 2024-09-05T01:14:23.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.092+0000 7fea87400640 1 Processor -- start 2024-09-05T01:14:23.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.092+0000 7fea87400640 1 -- start start 2024-09-05T01:14:23.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.093+0000 7fea87400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8007de80 0x7fea8019d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:23.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.093+0000 7fea87400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fea8007cfd0 con 0x7fea8007de80 2024-09-05T01:14:23.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.093+0000 7fea84a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8007de80 0x7fea8019d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:23.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.093+0000 7fea84a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8007de80 0x7fea8019d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57522/0 (socket says 172.21.15.12:57522) 2024-09-05T01:14:23.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.093+0000 7fea84a00640 1 -- 172.21.15.12:0/945265488 learned_addr learned my addr 172.21.15.12:0/945265488 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:23.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.093+0000 7fea84a00640 1 -- 172.21.15.12:0/945265488 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea8019d600 con 0x7fea8007de80 2024-09-05T01:14:23.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.094+0000 7fea84a00640 1 --2- 172.21.15.12:0/945265488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8007de80 0x7fea8019d0c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fea740090b0 tx=0x7fea740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:23.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.094+0000 7fea7d600640 1 -- 172.21.15.12:0/945265488 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea74041070 con 0x7fea8007de80 2024-09-05T01:14:23.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.094+0000 7fea7d600640 1 -- 172.21.15.12:0/945265488 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea7403c7a0 con 0x7fea8007de80 2024-09-05T01:14:23.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.094+0000 7fea7d600640 1 -- 172.21.15.12:0/945265488 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea74037040 con 0x7fea8007de80 2024-09-05T01:14:23.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.094+0000 7fea87400640 1 -- 172.21.15.12:0/945265488 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea8019d890 con 0x7fea8007de80 2024-09-05T01:14:23.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.094+0000 7fea87400640 1 -- 172.21.15.12:0/945265488 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea801a0580 con 0x7fea8007de80 2024-09-05T01:14:23.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.094+0000 7fea7d600640 1 -- 172.21.15.12:0/945265488 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fea74044070 con 0x7fea8007de80 2024-09-05T01:14:23.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.094+0000 7fea7d600640 1 -- 172.21.15.12:0/945265488 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fea7403d3f0 con 0x7fea8007de80 2024-09-05T01:14:23.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.095+0000 7fea87400640 1 -- 172.21.15.12:0/945265488 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea8007c360 con 0x7fea8007de80 2024-09-05T01:14:23.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.098+0000 7fea7d600640 1 -- 172.21.15.12:0/945265488 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fea74046450 con 0x7fea8007de80 2024-09-05T01:14:23.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.160+0000 7fea87400640 1 -- 172.21.15.12:0/945265488 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fea8002d910 con 0x7fea8007de80 2024-09-05T01:14:23.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.164+0000 7fea7d600640 1 -- 172.21.15.12:0/945265488 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7fea74046630 con 0x7fea8007de80 2024-09-05T01:14:23.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.165+0000 7fea7d600640 1 -- 172.21.15.12:0/945265488 <== mon.0 v2:172.21.15.12:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea740584b0 con 0x7fea8007de80 2024-09-05T01:14:23.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.166+0000 7fea87400640 1 -- 172.21.15.12:0/945265488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8007de80 msgr2=0x7fea8019d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:23.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.166+0000 7fea87400640 1 --2- 172.21.15.12:0/945265488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8007de80 0x7fea8019d0c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fea740090b0 tx=0x7fea740046c0 comp rx=0 tx=0).stop 2024-09-05T01:14:23.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.166+0000 7fea87400640 1 -- 172.21.15.12:0/945265488 shutdown_connections 2024-09-05T01:14:23.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.166+0000 7fea87400640 1 --2- 172.21.15.12:0/945265488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea8007de80 0x7fea8019d0c0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:23.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.166+0000 7fea87400640 1 -- 172.21.15.12:0/945265488 >> 172.21.15.12:0/945265488 conn(0x7fea80102e80 msgr2=0x7fea80103f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:23.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.166+0000 7fea87400640 1 -- 172.21.15.12:0/945265488 shutdown_connections 2024-09-05T01:14:23.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:23.166+0000 7fea87400640 1 -- 172.21.15.12:0/945265488 wait complete. 2024-09-05T01:14:23.727 INFO:teuthology.orchestra.run.smithi012.stdout:Generating new minimal ceph.conf... 2024-09-05T01:14:24.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:24 smithi012 ceph-mon[29580]: from='client.? 172.21.15.12:0/3619443931' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:14:24.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.195+0000 7fab05a00640 1 Processor -- start 2024-09-05T01:14:24.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.195+0000 7fab05a00640 1 -- start start 2024-09-05T01:14:24.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.195+0000 7fab05a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab001098a0 0x7fab00109ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:24.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.195+0000 7fab05a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fab0010a270 con 0x7fab001098a0 2024-09-05T01:14:24.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.195+0000 7faaffe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab001098a0 0x7fab00109ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:24.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.196+0000 7faaffe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab001098a0 0x7fab00109ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57536/0 (socket says 172.21.15.12:57536) 2024-09-05T01:14:24.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.196+0000 7faaffe00640 1 -- 172.21.15.12:0/4263192712 learned_addr learned my addr 172.21.15.12:0/4263192712 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:24.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.196+0000 7faaffe00640 1 -- 172.21.15.12:0/4263192712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab0010a960 con 0x7fab001098a0 2024-09-05T01:14:24.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.197+0000 7faaffe00640 1 --2- 172.21.15.12:0/4263192712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab001098a0 0x7fab00109ca0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7faaf0009820 tx=0x7faaf002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2f350a37ca2489 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:24.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.197+0000 7faaff400640 1 -- 172.21.15.12:0/4263192712 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faaf0037070 con 0x7fab001098a0 2024-09-05T01:14:24.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.197+0000 7faaff400640 1 -- 172.21.15.12:0/4263192712 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faaf0032900 con 0x7fab001098a0 2024-09-05T01:14:24.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.197+0000 7faaff400640 1 -- 172.21.15.12:0/4263192712 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faaf0030850 con 0x7fab001098a0 2024-09-05T01:14:24.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.198+0000 7fab05a00640 1 -- 172.21.15.12:0/4263192712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab001098a0 msgr2=0x7fab00109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:24.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.198+0000 7fab05a00640 1 --2- 172.21.15.12:0/4263192712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab001098a0 0x7fab00109ca0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7faaf0009820 tx=0x7faaf002a270 comp rx=0 tx=0).stop 2024-09-05T01:14:24.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.198+0000 7fab05a00640 1 -- 172.21.15.12:0/4263192712 shutdown_connections 2024-09-05T01:14:24.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.198+0000 7fab05a00640 1 --2- 172.21.15.12:0/4263192712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab001098a0 0x7fab00109ca0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:24.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.198+0000 7fab05a00640 1 -- 172.21.15.12:0/4263192712 >> 172.21.15.12:0/4263192712 conn(0x7fab0007cd40 msgr2=0x7fab0007d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:24.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.198+0000 7fab05a00640 1 -- 172.21.15.12:0/4263192712 shutdown_connections 2024-09-05T01:14:24.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.198+0000 7fab05a00640 1 -- 172.21.15.12:0/4263192712 wait complete. 2024-09-05T01:14:24.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.199+0000 7fab05a00640 1 Processor -- start 2024-09-05T01:14:24.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.199+0000 7fab05a00640 1 -- start start 2024-09-05T01:14:24.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.199+0000 7fab05a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab001098a0 0x7fab0019d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:24.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.199+0000 7fab05a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fab0010dd10 con 0x7fab001098a0 2024-09-05T01:14:24.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.200+0000 7faaffe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab001098a0 0x7fab0019d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:24.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.200+0000 7faaffe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab001098a0 0x7fab0019d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57538/0 (socket says 172.21.15.12:57538) 2024-09-05T01:14:24.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.200+0000 7faaffe00640 1 -- 172.21.15.12:0/3619443931 learned_addr learned my addr 172.21.15.12:0/3619443931 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:24.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.200+0000 7faaffe00640 1 -- 172.21.15.12:0/3619443931 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab0019dcd0 con 0x7fab001098a0 2024-09-05T01:14:24.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.200+0000 7faaffe00640 1 --2- 172.21.15.12:0/3619443931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab001098a0 0x7fab0019d790 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7faaf00097f0 tx=0x7faaf0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:24.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.201+0000 7faafd600640 1 -- 172.21.15.12:0/3619443931 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faaf0037040 con 0x7fab001098a0 2024-09-05T01:14:24.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.201+0000 7faafd600640 1 -- 172.21.15.12:0/3619443931 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faaf0040070 con 0x7fab001098a0 2024-09-05T01:14:24.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.201+0000 7faafd600640 1 -- 172.21.15.12:0/3619443931 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faaf003a390 con 0x7fab001098a0 2024-09-05T01:14:24.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.201+0000 7fab05a00640 1 -- 172.21.15.12:0/3619443931 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab0019df60 con 0x7fab001098a0 2024-09-05T01:14:24.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.201+0000 7fab05a00640 1 -- 172.21.15.12:0/3619443931 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab001a0c50 con 0x7fab001098a0 2024-09-05T01:14:24.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.201+0000 7faafd600640 1 -- 172.21.15.12:0/3619443931 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faaf003a5e0 con 0x7fab001098a0 2024-09-05T01:14:24.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.201+0000 7faafd600640 1 -- 172.21.15.12:0/3619443931 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faaf0045950 con 0x7fab001098a0 2024-09-05T01:14:24.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.202+0000 7fab05a00640 1 -- 172.21.15.12:0/3619443931 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab00109d20 con 0x7fab001098a0 2024-09-05T01:14:24.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.205+0000 7faafd600640 1 -- 172.21.15.12:0/3619443931 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7faaf0045460 con 0x7fab001098a0 2024-09-05T01:14:24.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.268+0000 7fab05a00640 1 -- 172.21.15.12:0/3619443931 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fab001a0e20 con 0x7fab001098a0 2024-09-05T01:14:24.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.268+0000 7faafd600640 1 -- 172.21.15.12:0/3619443931 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7faaf003b430 con 0x7fab001098a0 2024-09-05T01:14:24.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.270+0000 7fab05a00640 1 -- 172.21.15.12:0/3619443931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab001098a0 msgr2=0x7fab0019d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:24.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.270+0000 7fab05a00640 1 --2- 172.21.15.12:0/3619443931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab001098a0 0x7fab0019d790 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7faaf00097f0 tx=0x7faaf0030d80 comp rx=0 tx=0).stop 2024-09-05T01:14:24.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.270+0000 7fab05a00640 1 -- 172.21.15.12:0/3619443931 shutdown_connections 2024-09-05T01:14:24.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.270+0000 7fab05a00640 1 --2- 172.21.15.12:0/3619443931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab001098a0 0x7fab0019d790 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:24.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.270+0000 7fab05a00640 1 -- 172.21.15.12:0/3619443931 >> 172.21.15.12:0/3619443931 conn(0x7fab0007cd40 msgr2=0x7fab00107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:24.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.270+0000 7fab05a00640 1 -- 172.21.15.12:0/3619443931 shutdown_connections 2024-09-05T01:14:24.798 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:24.270+0000 7fab05a00640 1 -- 172.21.15.12:0/3619443931 wait complete. 2024-09-05T01:14:24.798 INFO:teuthology.orchestra.run.smithi012.stdout:Restarting the monitor... 2024-09-05T01:14:25.166 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:24 smithi012 systemd[1]: Stopping Ceph mon.a for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:14:25.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:25 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-a[29576]: 2024-09-05T01:14:25.164+0000 7f3ad9000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:14:25.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:25 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-a[29576]: 2024-09-05T01:14:25.164+0000 7f3ad9000640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-05T01:14:25.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:25 smithi012 podman[29821]: 2024-09-05 01:14:25.288751535 +0000 UTC m=+0.260860324 container died abc69643ba2c8ba152fbfbd275bce97155dd4f85de6cebc1b33459c4e3fe584b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-05T01:14:25.904 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:25 smithi012 podman[29821]: 2024-09-05 01:14:25.711416617 +0000 UTC m=+0.683525405 container cleanup abc69643ba2c8ba152fbfbd275bce97155dd4f85de6cebc1b33459c4e3fe584b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-91c8a7e, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-05T01:14:25.904 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:25 smithi012 bash[29821]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-a 2024-09-05T01:14:26.180 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:25 smithi012 podman[29835]: 2024-09-05 01:14:25.903973083 +0000 UTC m=+0.609630476 container remove abc69643ba2c8ba152fbfbd275bce97155dd4f85de6cebc1b33459c4e3fe584b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-a, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-05T01:14:26.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 systemd[1]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-05T01:14:26.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 systemd[1]: Stopped Ceph mon.a for 0d44cd7e-6b24-11ef-bcd6-c7b262605968. 2024-09-05T01:14:26.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 systemd[1]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mon.a.service: Consumed 1.234s CPU time. 2024-09-05T01:14:26.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 systemd[1]: Starting Ceph mon.a for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:14:26.782 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 podman[29923]: 2024-09-05 01:14:26.50502994 +0000 UTC m=+0.121612560 container create 2b0036d96b7cab00d6a5d5d605f0046ba3fbeccf207605341a858b7868d5efaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-a, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-05T01:14:26.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 podman[29923]: 2024-09-05 01:14:26.41096621 +0000 UTC m=+0.027548832 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T01:14:26.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 podman[29923]: 2024-09-05 01:14:26.690988371 +0000 UTC m=+0.307571001 container init 2b0036d96b7cab00d6a5d5d605f0046ba3fbeccf207605341a858b7868d5efaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-05T01:14:26.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 podman[29923]: 2024-09-05 01:14:26.697694886 +0000 UTC m=+0.314277507 container start 2b0036d96b7cab00d6a5d5d605f0046ba3fbeccf207605341a858b7868d5efaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-05T01:14:26.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: set uid:gid to 167:167 (ceph:ceph) 2024-09-05T01:14:26.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: ceph version 19.1.1-259-g91c8a7e5 (91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4) squid (stable), process ceph-mon, pid 2 2024-09-05T01:14:26.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: pidfile_write: ignore empty --pid-file 2024-09-05T01:14:26.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: load: jerasure load: lrc 2024-09-05T01:14:26.783 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: RocksDB version: 7.9.2 2024-09-05T01:14:26.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Git sha 0 2024-09-05T01:14:26.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Compile date 2024-09-04 15:32:03 2024-09-05T01:14:26.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: DB SUMMARY 2024-09-05T01:14:26.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: DB Session ID: FLEBRSEF4TXWPC28OS3O 2024-09-05T01:14:26.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: CURRENT file: CURRENT 2024-09-05T01:14:26.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: IDENTITY file: IDENTITY 2024-09-05T01:14:26.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-05T01:14:26.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-05T01:14:26.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 106074 ; 2024-09-05T01:14:26.784 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.error_if_exists: 0 2024-09-05T01:14:26.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.create_if_missing: 0 2024-09-05T01:14:26.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.paranoid_checks: 1 2024-09-05T01:14:26.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-05T01:14:26.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-05T01:14:26.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-05T01:14:26.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.env: 0x55d0679b2940 2024-09-05T01:14:26.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.fs: PosixFileSystem 2024-09-05T01:14:26.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.info_log: 0x55d0a27776a0 2024-09-05T01:14:26.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_file_opening_threads: 16 2024-09-05T01:14:26.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.statistics: (nil) 2024-09-05T01:14:26.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.use_fsync: 0 2024-09-05T01:14:26.785 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_log_file_size: 0 2024-09-05T01:14:26.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-05T01:14:26.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-05T01:14:26.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.keep_log_file_num: 1000 2024-09-05T01:14:26.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.recycle_log_file_num: 0 2024-09-05T01:14:26.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.allow_fallocate: 1 2024-09-05T01:14:26.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.allow_mmap_reads: 0 2024-09-05T01:14:26.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.allow_mmap_writes: 0 2024-09-05T01:14:26.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.use_direct_reads: 0 2024-09-05T01:14:26.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-05T01:14:26.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.create_missing_column_families: 0 2024-09-05T01:14:26.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.db_log_dir: 2024-09-05T01:14:26.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.wal_dir: 2024-09-05T01:14:26.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-05T01:14:26.786 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-05T01:14:26.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-05T01:14:26.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-05T01:14:26.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-05T01:14:26.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-05T01:14:26.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.advise_random_on_open: 1 2024-09-05T01:14:26.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.db_write_buffer_size: 0 2024-09-05T01:14:26.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.write_buffer_manager: 0x55d0a2786dc0 2024-09-05T01:14:26.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-05T01:14:26.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-05T01:14:26.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-05T01:14:26.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.rate_limiter: (nil) 2024-09-05T01:14:26.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-05T01:14:26.787 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.wal_recovery_mode: 2 2024-09-05T01:14:26.788 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.enable_thread_tracking: 0 2024-09-05T01:14:26.788 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.enable_pipelined_write: 0 2024-09-05T01:14:26.789 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.unordered_write: 0 2024-09-05T01:14:26.789 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-05T01:14:26.789 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-05T01:14:26.789 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-05T01:14:26.789 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-05T01:14:26.789 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.row_cache: None 2024-09-05T01:14:26.789 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.wal_filter: None 2024-09-05T01:14:26.789 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-05T01:14:26.789 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.allow_ingest_behind: 0 2024-09-05T01:14:26.789 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.two_write_queues: 0 2024-09-05T01:14:26.789 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.manual_wal_flush: 0 2024-09-05T01:14:26.789 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.wal_compression: 0 2024-09-05T01:14:26.789 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.atomic_flush: 0 2024-09-05T01:14:26.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-05T01:14:26.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-05T01:14:26.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-05T01:14:26.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.log_readahead_size: 0 2024-09-05T01:14:26.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-05T01:14:26.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.best_efforts_recovery: 0 2024-09-05T01:14:26.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-05T01:14:26.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-05T01:14:26.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.allow_data_in_errors: 0 2024-09-05T01:14:26.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.db_host_id: __hostname__ 2024-09-05T01:14:26.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-05T01:14:26.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_background_jobs: 2 2024-09-05T01:14:26.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_background_compactions: -1 2024-09-05T01:14:26.790 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_subcompactions: 1 2024-09-05T01:14:26.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-05T01:14:26.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-05T01:14:26.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-05T01:14:26.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_total_wal_size: 0 2024-09-05T01:14:26.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-05T01:14:26.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-05T01:14:26.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-05T01:14:26.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-05T01:14:26.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_open_files: -1 2024-09-05T01:14:26.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.bytes_per_sync: 0 2024-09-05T01:14:26.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-05T01:14:26.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-05T01:14:26.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.compaction_readahead_size: 0 2024-09-05T01:14:26.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_background_flushes: -1 2024-09-05T01:14:26.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Compression algorithms supported: 2024-09-05T01:14:26.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: kZSTD supported: 0 2024-09-05T01:14:26.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: kXpressCompression supported: 0 2024-09-05T01:14:26.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: kBZip2Compression supported: 0 2024-09-05T01:14:26.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-05T01:14:26.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: kLZ4Compression supported: 1 2024-09-05T01:14:26.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: kZlibCompression supported: 1 2024-09-05T01:14:26.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: kLZ4HCCompression supported: 1 2024-09-05T01:14:26.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: kSnappyCompression supported: 1 2024-09-05T01:14:26.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-05T01:14:26.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-05T01:14:26.792 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-05T01:14:26.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-05T01:14:26.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-05T01:14:26.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.merge_operator: 2024-09-05T01:14:26.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.compaction_filter: None 2024-09-05T01:14:26.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.compaction_filter_factory: None 2024-09-05T01:14:26.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.sst_partitioner_factory: None 2024-09-05T01:14:26.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-05T01:14:26.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-05T01:14:26.793 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d0a2777300) 2024-09-05T01:14:26.793 INFO:journalctl@ceph.mon.a.smithi012.stdout: cache_index_and_filter_blocks: 1 2024-09-05T01:14:26.793 INFO:journalctl@ceph.mon.a.smithi012.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-05T01:14:26.793 INFO:journalctl@ceph.mon.a.smithi012.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-05T01:14:26.793 INFO:journalctl@ceph.mon.a.smithi012.stdout: pin_top_level_index_and_filter: 1 2024-09-05T01:14:26.794 INFO:journalctl@ceph.mon.a.smithi012.stdout: index_type: 0 2024-09-05T01:14:26.794 INFO:journalctl@ceph.mon.a.smithi012.stdout: data_block_index_type: 0 2024-09-05T01:14:26.794 INFO:journalctl@ceph.mon.a.smithi012.stdout: index_shortening: 1 2024-09-05T01:14:26.794 INFO:journalctl@ceph.mon.a.smithi012.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-05T01:14:26.794 INFO:journalctl@ceph.mon.a.smithi012.stdout: checksum: 4 2024-09-05T01:14:26.794 INFO:journalctl@ceph.mon.a.smithi012.stdout: no_block_cache: 0 2024-09-05T01:14:26.794 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache: 0x55d0a276b1f0 2024-09-05T01:14:26.794 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache_name: BinnedLRUCache 2024-09-05T01:14:26.794 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache_options: 2024-09-05T01:14:26.794 INFO:journalctl@ceph.mon.a.smithi012.stdout: capacity : 536870912 2024-09-05T01:14:26.794 INFO:journalctl@ceph.mon.a.smithi012.stdout: num_shard_bits : 4 2024-09-05T01:14:26.794 INFO:journalctl@ceph.mon.a.smithi012.stdout: strict_capacity_limit : 0 2024-09-05T01:14:26.794 INFO:journalctl@ceph.mon.a.smithi012.stdout: high_pri_pool_ratio: 0.000 2024-09-05T01:14:26.794 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_cache_compressed: (nil) 2024-09-05T01:14:26.795 INFO:journalctl@ceph.mon.a.smithi012.stdout: persistent_cache: (nil) 2024-09-05T01:14:26.795 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_size: 4096 2024-09-05T01:14:26.795 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_size_deviation: 10 2024-09-05T01:14:26.795 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_restart_interval: 16 2024-09-05T01:14:26.795 INFO:journalctl@ceph.mon.a.smithi012.stdout: index_block_restart_interval: 1 2024-09-05T01:14:26.795 INFO:journalctl@ceph.mon.a.smithi012.stdout: metadata_block_size: 4096 2024-09-05T01:14:26.795 INFO:journalctl@ceph.mon.a.smithi012.stdout: partition_filters: 0 2024-09-05T01:14:26.795 INFO:journalctl@ceph.mon.a.smithi012.stdout: use_delta_encoding: 1 2024-09-05T01:14:26.795 INFO:journalctl@ceph.mon.a.smithi012.stdout: filter_policy: bloomfilter 2024-09-05T01:14:26.795 INFO:journalctl@ceph.mon.a.smithi012.stdout: whole_key_filtering: 1 2024-09-05T01:14:26.795 INFO:journalctl@ceph.mon.a.smithi012.stdout: verify_compression: 0 2024-09-05T01:14:26.795 INFO:journalctl@ceph.mon.a.smithi012.stdout: read_amp_bytes_per_bit: 0 2024-09-05T01:14:26.795 INFO:journalctl@ceph.mon.a.smithi012.stdout: format_version: 5 2024-09-05T01:14:26.795 INFO:journalctl@ceph.mon.a.smithi012.stdout: enable_index_compression: 1 2024-09-05T01:14:26.796 INFO:journalctl@ceph.mon.a.smithi012.stdout: block_align: 0 2024-09-05T01:14:26.796 INFO:journalctl@ceph.mon.a.smithi012.stdout: max_auto_readahead_size: 262144 2024-09-05T01:14:26.796 INFO:journalctl@ceph.mon.a.smithi012.stdout: prepopulate_block_cache: 0 2024-09-05T01:14:26.796 INFO:journalctl@ceph.mon.a.smithi012.stdout: initial_auto_readahead_size: 8192 2024-09-05T01:14:26.796 INFO:journalctl@ceph.mon.a.smithi012.stdout: num_file_reads_for_auto_readahead: 2 2024-09-05T01:14:26.796 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.write_buffer_size: 33554432 2024-09-05T01:14:26.796 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_write_buffer_number: 2 2024-09-05T01:14:26.796 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.compression: NoCompression 2024-09-05T01:14:26.796 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.bottommost_compression: Disabled 2024-09-05T01:14:26.796 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.prefix_extractor: nullptr 2024-09-05T01:14:26.796 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-05T01:14:26.796 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.num_levels: 7 2024-09-05T01:14:26.796 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-05T01:14:26.797 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-05T01:14:26.797 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-05T01:14:26.797 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-05T01:14:26.797 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-05T01:14:26.797 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-05T01:14:26.797 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-05T01:14:26.797 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-05T01:14:26.797 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-05T01:14:26.797 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-05T01:14:26.797 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-05T01:14:26.797 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-05T01:14:26.797 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-05T01:14:26.797 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.compression_opts.level: 32767 2024-09-05T01:14:26.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.compression_opts.strategy: 0 2024-09-05T01:14:26.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-05T01:14:26.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-05T01:14:26.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-05T01:14:26.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-05T01:14:26.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.compression_opts.enabled: false 2024-09-05T01:14:26.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-05T01:14:26.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-05T01:14:26.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-05T01:14:26.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-05T01:14:26.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.target_file_size_base: 67108864 2024-09-05T01:14:26.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-05T01:14:26.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-05T01:14:26.798 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-05T01:14:26.799 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-05T01:14:26.799 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-05T01:14:26.799 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-05T01:14:26.799 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-05T01:14:26.799 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-05T01:14:26.799 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-05T01:14:26.799 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-05T01:14:26.799 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-05T01:14:26.799 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-05T01:14:26.799 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-05T01:14:26.799 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-05T01:14:26.799 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.arena_block_size: 1048576 2024-09-05T01:14:26.799 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-05T01:14:26.800 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-05T01:14:26.800 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.disable_auto_compactions: 0 2024-09-05T01:14:26.800 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-05T01:14:26.800 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-05T01:14:26.800 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-05T01:14:26.800 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-05T01:14:26.800 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-05T01:14:26.800 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-05T01:14:26.800 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-05T01:14:26.800 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-05T01:14:26.800 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-05T01:14:26.800 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-05T01:14:26.800 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-05T01:14:26.801 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.inplace_update_support: 0 2024-09-05T01:14:26.801 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-05T01:14:26.801 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-05T01:14:26.801 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-05T01:14:26.801 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-05T01:14:26.801 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.bloom_locality: 0 2024-09-05T01:14:26.801 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.max_successive_merges: 0 2024-09-05T01:14:26.801 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-05T01:14:26.801 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.paranoid_file_checks: 0 2024-09-05T01:14:26.801 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.force_consistency_checks: 1 2024-09-05T01:14:26.801 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.report_bg_io_stats: 0 2024-09-05T01:14:26.801 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.ttl: 2592000 2024-09-05T01:14:26.801 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-05T01:14:26.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-05T01:14:26.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-05T01:14:26.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.enable_blob_files: false 2024-09-05T01:14:26.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.min_blob_size: 0 2024-09-05T01:14:26.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.blob_file_size: 268435456 2024-09-05T01:14:26.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-05T01:14:26.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-05T01:14:26.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-05T01:14:26.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-05T01:14:26.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-05T01:14:26.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.blob_file_starting_level: 0 2024-09-05T01:14:26.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-05T01:14:26.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-05T01:14:26.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-05T01:14:26.802 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ebb4b245-3982-43d1-9f55-7023123ae89f 2024-09-05T01:14:26.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725498866739858, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-05T01:14:26.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-05T01:14:26.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725498866741524, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 101034, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 332, "table_properties": {"data_size": 98919, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14508, "raw_average_key_size": 49, "raw_value_size": 91101, "raw_average_value_size": 313, "num_data_blocks": 12, "num_entries": 291, "num_filter_entries": 291, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725498866, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ebb4b245-3982-43d1-9f55-7023123ae89f", "db_session_id": "FLEBRSEF4TXWPC28OS3O", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-05T01:14:26.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725498866741703, "job": 1, "event": "recovery_finished"} 2024-09-05T01:14:26.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-05T01:14:26.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-05T01:14:26.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d0a279ae00 2024-09-05T01:14:26.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: DB pointer 0x55d0a2896000 2024-09-05T01:14:26.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-05T01:14:26.803 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-05T01:14:26.803 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** DB Stats ** 2024-09-05T01:14:26.803 INFO:journalctl@ceph.mon.a.smithi012.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-05T01:14:26.803 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-05T01:14:26.803 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-05T01:14:26.804 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-05T01:14:26.804 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-05T01:14:26.804 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-05T01:14:26.804 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-05T01:14:26.804 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-05T01:14:26.804 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** Compaction Stats [default] ** 2024-09-05T01:14:26.804 INFO:journalctl@ceph.mon.a.smithi012.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-05T01:14:26.804 INFO:journalctl@ceph.mon.a.smithi012.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-05T01:14:26.804 INFO:journalctl@ceph.mon.a.smithi012.stdout: L0 2/0 100.53 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 95.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-05T01:14:26.804 INFO:journalctl@ceph.mon.a.smithi012.stdout: Sum 2/0 100.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 95.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-05T01:14:26.804 INFO:journalctl@ceph.mon.a.smithi012.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 95.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-05T01:14:26.804 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-05T01:14:26.804 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** Compaction Stats [default] ** 2024-09-05T01:14:26.804 INFO:journalctl@ceph.mon.a.smithi012.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-05T01:14:26.805 INFO:journalctl@ceph.mon.a.smithi012.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-05T01:14:26.805 INFO:journalctl@ceph.mon.a.smithi012.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 95.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-05T01:14:26.805 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-05T01:14:26.805 INFO:journalctl@ceph.mon.a.smithi012.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-05T01:14:26.805 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-05T01:14:26.805 INFO:journalctl@ceph.mon.a.smithi012.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-05T01:14:26.805 INFO:journalctl@ceph.mon.a.smithi012.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-05T01:14:26.805 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-05T01:14:26.805 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-05T01:14:26.805 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-05T01:14:26.805 INFO:journalctl@ceph.mon.a.smithi012.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-05T01:14:26.805 INFO:journalctl@ceph.mon.a.smithi012.stdout: Cumulative compaction: 0.00 GB write, 16.91 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-05T01:14:26.806 INFO:journalctl@ceph.mon.a.smithi012.stdout: Interval compaction: 0.00 GB write, 16.91 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-05T01:14:26.806 INFO:journalctl@ceph.mon.a.smithi012.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-05T01:14:26.806 INFO:journalctl@ceph.mon.a.smithi012.stdout: Block cache BinnedLRUCache@0x55d0a276b1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-05T01:14:26.806 INFO:journalctl@ceph.mon.a.smithi012.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-05T01:14:26.806 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-05T01:14:26.806 INFO:journalctl@ceph.mon.a.smithi012.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-05T01:14:26.806 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: starting mon.a rank 0 at public addrs [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] at bind addrs [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:14:26.806 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: mon.a@-1(???) e1 preinit fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:14:26.806 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: mon.a@-1(???).mds e1 new map 2024-09-05T01:14:26.806 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: mon.a@-1(???).mds e1 print_map 2024-09-05T01:14:26.806 INFO:journalctl@ceph.mon.a.smithi012.stdout: e1 2024-09-05T01:14:26.806 INFO:journalctl@ceph.mon.a.smithi012.stdout: btime 2024-09-05T01:14:21:162585+0000 2024-09-05T01:14:26.806 INFO:journalctl@ceph.mon.a.smithi012.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-05T01:14:26.807 INFO:journalctl@ceph.mon.a.smithi012.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-05T01:14:26.807 INFO:journalctl@ceph.mon.a.smithi012.stdout: legacy client fscid: -1 2024-09-05T01:14:26.807 INFO:journalctl@ceph.mon.a.smithi012.stdout: 2024-09-05T01:14:26.807 INFO:journalctl@ceph.mon.a.smithi012.stdout: No filesystems configured 2024-09-05T01:14:26.807 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-05T01:14:26.807 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-05T01:14:26.807 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-05T01:14:26.807 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-05T01:14:26.807 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-05T01:14:26.807 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 bash[29923]: 2b0036d96b7cab00d6a5d5d605f0046ba3fbeccf207605341a858b7868d5efaa 2024-09-05T01:14:26.808 INFO:teuthology.orchestra.run.smithi012.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-05T01:14:27.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 systemd[1]: Started Ceph mon.a for 0d44cd7e-6b24-11ef-bcd6-c7b262605968. 2024-09-05T01:14:27.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-05T01:14:27.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: monmap epoch 1 2024-09-05T01:14:27.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:14:27.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: last_changed 2024-09-05T01:14:17.366670+0000 2024-09-05T01:14:27.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: created 2024-09-05T01:14:17.366670+0000 2024-09-05T01:14:27.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: min_mon_release 19 (squid) 2024-09-05T01:14:27.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: election_strategy: 1 2024-09-05T01:14:27.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-05T01:14:27.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: fsmap 2024-09-05T01:14:27.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: osdmap e1: 0 total, 0 up, 0 in 2024-09-05T01:14:27.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:26 smithi012 ceph-mon[29942]: mgrmap e1: no daemons active 2024-09-05T01:14:27.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.296+0000 7ff451400640 1 Processor -- start 2024-09-05T01:14:27.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.297+0000 7ff451400640 1 -- start start 2024-09-05T01:14:27.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.297+0000 7ff451400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff44c1098f0 0x7ff44c109cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:27.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.297+0000 7ff451400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff44c10a2c0 con 0x7ff44c1098f0 2024-09-05T01:14:27.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.297+0000 7ff44a800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff44c1098f0 0x7ff44c109cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:27.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.297+0000 7ff44a800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff44c1098f0 0x7ff44c109cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42532/0 (socket says 172.21.15.12:42532) 2024-09-05T01:14:27.923 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.297+0000 7ff44a800640 1 -- 172.21.15.12:0/2709474452 learned_addr learned my addr 172.21.15.12:0/2709474452 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:27.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.298+0000 7ff44a800640 1 -- 172.21.15.12:0/2709474452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff44c10ab10 con 0x7ff44c1098f0 2024-09-05T01:14:27.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.300+0000 7ff44a800640 1 --2- 172.21.15.12:0/2709474452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff44c1098f0 0x7ff44c109cf0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009820 tx=0x7ff43c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bafd2ee99c4bb25 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:27.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.301+0000 7ff449e00640 1 -- 172.21.15.12:0/2709474452 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff43c037070 con 0x7ff44c1098f0 2024-09-05T01:14:27.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.301+0000 7ff449e00640 1 -- 172.21.15.12:0/2709474452 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff43c032900 con 0x7ff44c1098f0 2024-09-05T01:14:27.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.301+0000 7ff449e00640 1 -- 172.21.15.12:0/2709474452 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff43c030850 con 0x7ff44c1098f0 2024-09-05T01:14:27.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.301+0000 7ff451400640 1 -- 172.21.15.12:0/2709474452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff44c1098f0 msgr2=0x7ff44c109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:27.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.301+0000 7ff451400640 1 --2- 172.21.15.12:0/2709474452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff44c1098f0 0x7ff44c109cf0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009820 tx=0x7ff43c02a270 comp rx=0 tx=0).stop 2024-09-05T01:14:27.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.301+0000 7ff451400640 1 -- 172.21.15.12:0/2709474452 shutdown_connections 2024-09-05T01:14:27.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.301+0000 7ff451400640 1 --2- 172.21.15.12:0/2709474452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff44c1098f0 0x7ff44c109cf0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:27.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.301+0000 7ff451400640 1 -- 172.21.15.12:0/2709474452 >> 172.21.15.12:0/2709474452 conn(0x7ff44c07ceb0 msgr2=0x7ff44c07d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:27.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.301+0000 7ff451400640 1 -- 172.21.15.12:0/2709474452 shutdown_connections 2024-09-05T01:14:27.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.302+0000 7ff451400640 1 -- 172.21.15.12:0/2709474452 wait complete. 2024-09-05T01:14:27.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.302+0000 7ff451400640 1 Processor -- start 2024-09-05T01:14:27.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.303+0000 7ff451400640 1 -- start start 2024-09-05T01:14:27.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.303+0000 7ff451400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff44c1098f0 0x7ff44c19d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:27.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.303+0000 7ff451400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff44c10dec0 con 0x7ff44c1098f0 2024-09-05T01:14:27.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.303+0000 7ff44a800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff44c1098f0 0x7ff44c19d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:27.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.303+0000 7ff44a800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff44c1098f0 0x7ff44c19d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42544/0 (socket says 172.21.15.12:42544) 2024-09-05T01:14:27.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.303+0000 7ff44a800640 1 -- 172.21.15.12:0/1656698701 learned_addr learned my addr 172.21.15.12:0/1656698701 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:27.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.304+0000 7ff44a800640 1 -- 172.21.15.12:0/1656698701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff44c19de80 con 0x7ff44c1098f0 2024-09-05T01:14:27.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.304+0000 7ff44a800640 1 --2- 172.21.15.12:0/1656698701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff44c1098f0 0x7ff44c19d940 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff43c032ce0 tx=0x7ff43c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:27.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.304+0000 7ff443e00640 1 -- 172.21.15.12:0/1656698701 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff43c042070 con 0x7ff44c1098f0 2024-09-05T01:14:27.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.304+0000 7ff443e00640 1 -- 172.21.15.12:0/1656698701 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff43c0308c0 con 0x7ff44c1098f0 2024-09-05T01:14:27.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.304+0000 7ff443e00640 1 -- 172.21.15.12:0/1656698701 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff43c037040 con 0x7ff44c1098f0 2024-09-05T01:14:27.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.304+0000 7ff451400640 1 -- 172.21.15.12:0/1656698701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff44c19e110 con 0x7ff44c1098f0 2024-09-05T01:14:27.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.304+0000 7ff451400640 1 -- 172.21.15.12:0/1656698701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff44c1a0e00 con 0x7ff44c1098f0 2024-09-05T01:14:27.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.305+0000 7ff443e00640 1 -- 172.21.15.12:0/1656698701 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff43c045070 con 0x7ff44c1098f0 2024-09-05T01:14:27.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.305+0000 7ff443e00640 1 -- 172.21.15.12:0/1656698701 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff43c047b70 con 0x7ff44c1098f0 2024-09-05T01:14:27.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.306+0000 7ff451400640 1 -- 172.21.15.12:0/1656698701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff44c109cf0 con 0x7ff44c1098f0 2024-09-05T01:14:27.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.309+0000 7ff443e00640 1 -- 172.21.15.12:0/1656698701 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff43c03dbf0 con 0x7ff44c1098f0 2024-09-05T01:14:27.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.371+0000 7ff451400640 1 -- 172.21.15.12:0/1656698701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7ff44c1a13e0 con 0x7ff44c1098f0 2024-09-05T01:14:27.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.373+0000 7ff443e00640 1 -- 172.21.15.12:0/1656698701 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7ff43c03d430 con 0x7ff44c1098f0 2024-09-05T01:14:27.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.374+0000 7ff451400640 1 -- 172.21.15.12:0/1656698701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff44c1098f0 msgr2=0x7ff44c19d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:27.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.374+0000 7ff451400640 1 --2- 172.21.15.12:0/1656698701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff44c1098f0 0x7ff44c19d940 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff43c032ce0 tx=0x7ff43c032d10 comp rx=0 tx=0).stop 2024-09-05T01:14:27.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.374+0000 7ff451400640 1 -- 172.21.15.12:0/1656698701 shutdown_connections 2024-09-05T01:14:27.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.374+0000 7ff451400640 1 --2- 172.21.15.12:0/1656698701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff44c1098f0 0x7ff44c19d940 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:27.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.374+0000 7ff451400640 1 -- 172.21.15.12:0/1656698701 >> 172.21.15.12:0/1656698701 conn(0x7ff44c07ceb0 msgr2=0x7ff44c107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:27.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.374+0000 7ff451400640 1 -- 172.21.15.12:0/1656698701 shutdown_connections 2024-09-05T01:14:27.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:27.374+0000 7ff451400640 1 -- 172.21.15.12:0/1656698701 wait complete. 2024-09-05T01:14:27.926 INFO:teuthology.orchestra.run.smithi012.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-05T01:14:27.946 INFO:teuthology.orchestra.run.smithi012.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-05T01:14:27.946 INFO:teuthology.orchestra.run.smithi012.stdout:Creating mgr... 2024-09-05T01:14:27.947 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-05T01:14:27.947 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-05T01:14:28.308 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mgr.x 2024-09-05T01:14:28.308 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Failed to reset failed state of unit ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mgr.x.service: Unit ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mgr.x.service not loaded. 2024-09-05T01:14:28.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:28 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/1656698701' entity='client.admin' 2024-09-05T01:14:28.831 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968.target.wants/ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@.service. 2024-09-05T01:14:29.172 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:28 smithi012 systemd[1]: Starting Ceph mgr.x for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:14:29.562 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:29 smithi012 podman[30154]: 2024-09-05 01:14:29.076271535 +0000 UTC m=+0.027584096 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T01:14:33.562 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:33 smithi012 podman[30154]: 2024-09-05 01:14:33.125873874 +0000 UTC m=+4.077186441 container create 2b85e24fdb2467858c93880764802bac49f202333eb79b978ea3349b178247d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-05T01:14:37.141 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-05T01:14:37.141 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout disabled 2024-09-05T01:14:37.156 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-05T01:14:37.156 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-09-05T01:14:37.156 INFO:teuthology.orchestra.run.smithi012.stdout:firewalld.service is not enabled 2024-09-05T01:14:37.156 INFO:teuthology.orchestra.run.smithi012.stdout:Not possible to enable service . firewalld.service is not available 2024-09-05T01:14:37.178 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-05T01:14:37.178 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout disabled 2024-09-05T01:14:37.193 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-05T01:14:37.193 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-09-05T01:14:37.193 INFO:teuthology.orchestra.run.smithi012.stdout:firewalld.service is not enabled 2024-09-05T01:14:37.193 INFO:teuthology.orchestra.run.smithi012.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-05T01:14:37.193 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mgr to start... 2024-09-05T01:14:37.193 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mgr... 2024-09-05T01:14:37.312 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:37 smithi012 podman[30154]: 2024-09-05 01:14:37.039241828 +0000 UTC m=+7.990554412 container init 2b85e24fdb2467858c93880764802bac49f202333eb79b978ea3349b178247d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-05T01:14:37.312 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:37 smithi012 podman[30154]: 2024-09-05 01:14:37.045916392 +0000 UTC m=+7.997228953 container start 2b85e24fdb2467858c93880764802bac49f202333eb79b978ea3349b178247d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-91c8a7e, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-05T01:14:37.312 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:37 smithi012 bash[30154]: 2b85e24fdb2467858c93880764802bac49f202333eb79b978ea3349b178247d3 2024-09-05T01:14:37.312 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:37 smithi012 systemd[1]: Started Ceph mgr.x for 0d44cd7e-6b24-11ef-bcd6-c7b262605968. 2024-09-05T01:14:37.312 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:37 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:37.238+0000 7f995302d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-05T01:14:37.312 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:37 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:37.310+0000 7f995302d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-05T01:14:37.566 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:37 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:37.518+0000 7f995302d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-05T01:14:37.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:37 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3136853579' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-05T01:14:37.967 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:37 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:37.603+0000 7f995302d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-05T01:14:37.968 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:37 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:37.793+0000 7f995302d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-05T01:14:37.968 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:37 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:37.966+0000 7f995302d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-05T01:14:38.406 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-05T01:14:38.406 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-05T01:14:38.406 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsid": "0d44cd7e-6b24-11ef-bcd6-c7b262605968", 2024-09-05T01:14:38.406 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "health": { 2024-09-05T01:14:38.406 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-05T01:14:38.406 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-05T01:14:38.406 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-05T01:14:38.406 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-05T01:14:38.406 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-05T01:14:38.406 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-05T01:14:38.407 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 0 2024-09-05T01:14:38.407 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-05T01:14:38.407 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-05T01:14:38.407 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "a" 2024-09-05T01:14:38.407 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-05T01:14:38.407 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-05T01:14:38.407 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-05T01:14:38.407 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T01:14:38.407 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-05T01:14:38.407 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-05T01:14:38.407 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-05T01:14:38.407 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-05T01:14:38.407 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T01:14:38.407 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-05T01:14:38.407 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-05T01:14:38.408 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-05T01:14:38.416 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-05T01:14:38.416 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-05T01:14:38.417 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-05T01:14:38.417 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-05T01:14:38.417 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-05T01:14:38.417 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-05T01:14:38.417 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-05T01:14:38.417 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-05T01:14:38.417 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-05T01:14:38.417 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-05T01:14:38.417 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-05T01:14:38.417 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-05T01:14:38.417 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-05T01:14:38.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-05T01:14:38.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-05T01:14:38.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T01:14:38.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "btime": "2024-09-05T01:14:21:162585+0000", 2024-09-05T01:14:38.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-05T01:14:38.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-05T01:14:38.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-05T01:14:38.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-05T01:14:38.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-05T01:14:38.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-05T01:14:38.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-05T01:14:38.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-05T01:14:38.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-05T01:14:38.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "restful" 2024-09-05T01:14:38.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-05T01:14:38.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-05T01:14:38.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-05T01:14:38.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-05T01:14:38.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T01:14:38.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modified": "2024-09-05T01:14:21.163472+0000", 2024-09-05T01:14:38.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-05T01:14:38.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-05T01:14:38.419 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-05T01:14:38.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-05T01:14:38.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.669+0000 7f5291c00640 1 Processor -- start 2024-09-05T01:14:38.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.669+0000 7f5291c00640 1 -- start start 2024-09-05T01:14:38.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.669+0000 7f5291c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c1098f0 0x7f528c109cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:38.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.669+0000 7f5291c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f528c10a2c0 con 0x7f528c1098f0 2024-09-05T01:14:38.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.670+0000 7f528aa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c1098f0 0x7f528c109cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:38.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.670+0000 7f528aa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c1098f0 0x7f528c109cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49708/0 (socket says 172.21.15.12:49708) 2024-09-05T01:14:38.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.670+0000 7f528aa00640 1 -- 172.21.15.12:0/1147428065 learned_addr learned my addr 172.21.15.12:0/1147428065 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:38.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.670+0000 7f528aa00640 1 -- 172.21.15.12:0/1147428065 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528c10ab10 con 0x7f528c1098f0 2024-09-05T01:14:38.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.671+0000 7f528aa00640 1 --2- 172.21.15.12:0/1147428065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c1098f0 0x7f528c109cf0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f527c009820 tx=0x7f527c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701b7b5ff81584fd server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:38.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.672+0000 7f5289600640 1 -- 172.21.15.12:0/1147428065 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f527c037070 con 0x7f528c1098f0 2024-09-05T01:14:38.420 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.672+0000 7f5289600640 1 -- 172.21.15.12:0/1147428065 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f527c032900 con 0x7f528c1098f0 2024-09-05T01:14:38.421 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.672+0000 7f5289600640 1 -- 172.21.15.12:0/1147428065 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f527c030850 con 0x7f528c1098f0 2024-09-05T01:14:38.421 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.672+0000 7f5291c00640 1 -- 172.21.15.12:0/1147428065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c1098f0 msgr2=0x7f528c109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:38.421 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.672+0000 7f5291c00640 1 --2- 172.21.15.12:0/1147428065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c1098f0 0x7f528c109cf0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f527c009820 tx=0x7f527c02a270 comp rx=0 tx=0).stop 2024-09-05T01:14:38.421 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.672+0000 7f5291c00640 1 -- 172.21.15.12:0/1147428065 shutdown_connections 2024-09-05T01:14:38.421 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.672+0000 7f5291c00640 1 --2- 172.21.15.12:0/1147428065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c1098f0 0x7f528c109cf0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:38.421 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.672+0000 7f5291c00640 1 -- 172.21.15.12:0/1147428065 >> 172.21.15.12:0/1147428065 conn(0x7f528c07ceb0 msgr2=0x7f528c07d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:38.421 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.673+0000 7f5291c00640 1 -- 172.21.15.12:0/1147428065 shutdown_connections 2024-09-05T01:14:38.421 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.673+0000 7f5291c00640 1 -- 172.21.15.12:0/1147428065 wait complete. 2024-09-05T01:14:38.421 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.674+0000 7f5291c00640 1 Processor -- start 2024-09-05T01:14:38.422 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.674+0000 7f5291c00640 1 -- start start 2024-09-05T01:14:38.422 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.674+0000 7f5291c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c1098f0 0x7f528c19d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:38.422 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.674+0000 7f5291c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f528c10dec0 con 0x7f528c1098f0 2024-09-05T01:14:38.422 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.674+0000 7f528aa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c1098f0 0x7f528c19d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:38.422 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.674+0000 7f528aa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c1098f0 0x7f528c19d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49724/0 (socket says 172.21.15.12:49724) 2024-09-05T01:14:38.422 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.674+0000 7f528aa00640 1 -- 172.21.15.12:0/3136853579 learned_addr learned my addr 172.21.15.12:0/3136853579 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:38.422 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.675+0000 7f528aa00640 1 -- 172.21.15.12:0/3136853579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528c19de80 con 0x7f528c1098f0 2024-09-05T01:14:38.422 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.675+0000 7f528aa00640 1 --2- 172.21.15.12:0/3136853579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c1098f0 0x7f528c19d940 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f527c032ce0 tx=0x7f527c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:38.422 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.675+0000 7f5283400640 1 -- 172.21.15.12:0/3136853579 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f527c042070 con 0x7f528c1098f0 2024-09-05T01:14:38.422 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.675+0000 7f5283400640 1 -- 172.21.15.12:0/3136853579 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f527c0308c0 con 0x7f528c1098f0 2024-09-05T01:14:38.422 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.675+0000 7f5291c00640 1 -- 172.21.15.12:0/3136853579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f528c19e110 con 0x7f528c1098f0 2024-09-05T01:14:38.422 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.675+0000 7f5283400640 1 -- 172.21.15.12:0/3136853579 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f527c037040 con 0x7f528c1098f0 2024-09-05T01:14:38.422 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.675+0000 7f5291c00640 1 -- 172.21.15.12:0/3136853579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f528c1a0e00 con 0x7f528c1098f0 2024-09-05T01:14:38.423 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.676+0000 7f5283400640 1 -- 172.21.15.12:0/3136853579 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f527c045070 con 0x7f528c1098f0 2024-09-05T01:14:38.423 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.676+0000 7f5283400640 1 -- 172.21.15.12:0/3136853579 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f527c047bd0 con 0x7f528c1098f0 2024-09-05T01:14:38.423 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.677+0000 7f5291c00640 1 -- 172.21.15.12:0/3136853579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f528c109cf0 con 0x7f528c1098f0 2024-09-05T01:14:38.423 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.679+0000 7f5283400640 1 -- 172.21.15.12:0/3136853579 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f527c03dbf0 con 0x7f528c1098f0 2024-09-05T01:14:38.423 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.746+0000 7f5291c00640 1 -- 172.21.15.12:0/3136853579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f528c1a1370 con 0x7f528c1098f0 2024-09-05T01:14:38.423 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.747+0000 7f5283400640 1 -- 172.21.15.12:0/3136853579 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1292 (secure 0 0 0) 0x7f527c03d430 con 0x7f528c1098f0 2024-09-05T01:14:38.423 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.748+0000 7f5291c00640 1 -- 172.21.15.12:0/3136853579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c1098f0 msgr2=0x7f528c19d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:38.423 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.748+0000 7f5291c00640 1 --2- 172.21.15.12:0/3136853579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c1098f0 0x7f528c19d940 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f527c032ce0 tx=0x7f527c032d10 comp rx=0 tx=0).stop 2024-09-05T01:14:38.423 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.748+0000 7f5291c00640 1 -- 172.21.15.12:0/3136853579 shutdown_connections 2024-09-05T01:14:38.423 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.748+0000 7f5291c00640 1 --2- 172.21.15.12:0/3136853579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f528c1098f0 0x7f528c19d940 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:38.423 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.748+0000 7f5291c00640 1 -- 172.21.15.12:0/3136853579 >> 172.21.15.12:0/3136853579 conn(0x7f528c07ceb0 msgr2=0x7f528c107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:38.423 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.748+0000 7f5291c00640 1 -- 172.21.15.12:0/3136853579 shutdown_connections 2024-09-05T01:14:38.423 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:37.748+0000 7f5291c00640 1 -- 172.21.15.12:0/3136853579 wait complete. 2024-09-05T01:14:38.423 INFO:teuthology.orchestra.run.smithi012.stdout:mgr not available, waiting (1/15)... 2024-09-05T01:14:38.663 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:38 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:38.365+0000 7f995302d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-05T01:14:38.664 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:38 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:38.442+0000 7f995302d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-05T01:14:38.664 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:38 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:38.662+0000 7f995302d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-05T01:14:40.312 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:39 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:39.819+0000 7f995302d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-05T01:14:40.312 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:39 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:39.903+0000 7f995302d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-05T01:14:41.236 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:41 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/480443373' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-05T01:14:41.236 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:40 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:40.907+0000 7f995302d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-05T01:14:41.236 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:41 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:41.059+0000 7f995302d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-05T01:14:41.236 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:41 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:41.234+0000 7f995302d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-05T01:14:41.562 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:41 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:41.313+0000 7f995302d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-05T01:14:41.874 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:41 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:41.500+0000 7f995302d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-05T01:14:41.874 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:41 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:41.587+0000 7f995302d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-05T01:14:41.874 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:41 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:41.665+0000 7f995302d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-05T01:14:41.874 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:41 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:41.872+0000 7f995302d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-05T01:14:42.422 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:42 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:42.159+0000 7f995302d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-05T01:14:42.422 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:42 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:42.243+0000 7f995302d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-05T01:14:42.422 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:42 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:42.346+0000 7f995302d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-05T01:14:42.422 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:42 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:42.420+0000 7f995302d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-05T01:14:42.753 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:42 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:42.494+0000 7f995302d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-05T01:14:42.761 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-05T01:14:42.764 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-05T01:14:42.764 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsid": "0d44cd7e-6b24-11ef-bcd6-c7b262605968", 2024-09-05T01:14:42.764 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "health": { 2024-09-05T01:14:42.764 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-05T01:14:42.764 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-05T01:14:42.764 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-05T01:14:42.764 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-05T01:14:42.764 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-05T01:14:42.764 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-05T01:14:42.765 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 0 2024-09-05T01:14:42.765 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-05T01:14:42.765 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-05T01:14:42.765 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "a" 2024-09-05T01:14:42.765 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-05T01:14:42.765 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-09-05T01:14:42.765 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-05T01:14:42.765 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T01:14:42.765 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-05T01:14:42.765 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-05T01:14:42.765 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-05T01:14:42.765 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-05T01:14:42.765 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T01:14:42.765 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-05T01:14:42.766 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-05T01:14:42.766 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-05T01:14:42.773 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-05T01:14:42.773 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-05T01:14:42.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-05T01:14:42.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-05T01:14:42.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-05T01:14:42.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-05T01:14:42.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-05T01:14:42.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-05T01:14:42.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-05T01:14:42.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-05T01:14:42.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-05T01:14:42.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-05T01:14:42.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-05T01:14:42.774 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-05T01:14:42.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-05T01:14:42.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T01:14:42.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "btime": "2024-09-05T01:14:21:162585+0000", 2024-09-05T01:14:42.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-05T01:14:42.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-05T01:14:42.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-05T01:14:42.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-05T01:14:42.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-05T01:14:42.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-05T01:14:42.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-05T01:14:42.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-05T01:14:42.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-05T01:14:42.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "restful" 2024-09-05T01:14:42.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-05T01:14:42.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-05T01:14:42.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-05T01:14:42.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-05T01:14:42.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T01:14:42.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modified": "2024-09-05T01:14:21.163472+0000", 2024-09-05T01:14:42.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-05T01:14:42.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-05T01:14:42.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-05T01:14:42.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-05T01:14:42.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.900+0000 7f86a5a00640 1 Processor -- start 2024-09-05T01:14:42.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.901+0000 7f86a5a00640 1 -- start start 2024-09-05T01:14:42.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.901+0000 7f86a5a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a01098f0 0x7f86a0109cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:42.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.901+0000 7f86a5a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f86a010a2c0 con 0x7f86a01098f0 2024-09-05T01:14:42.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.902+0000 7f869ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a01098f0 0x7f86a0109cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:42.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.902+0000 7f869ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a01098f0 0x7f86a0109cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49738/0 (socket says 172.21.15.12:49738) 2024-09-05T01:14:42.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.902+0000 7f869ea00640 1 -- 172.21.15.12:0/4258018886 learned_addr learned my addr 172.21.15.12:0/4258018886 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:42.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.902+0000 7f869ea00640 1 -- 172.21.15.12:0/4258018886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a010ab10 con 0x7f86a01098f0 2024-09-05T01:14:42.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.903+0000 7f869ea00640 1 --2- 172.21.15.12:0/4258018886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a01098f0 0x7f86a0109cf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8690009820 tx=0x7f869002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe4cdb32d69747a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:42.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.904+0000 7f869d600640 1 -- 172.21.15.12:0/4258018886 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8690037070 con 0x7f86a01098f0 2024-09-05T01:14:42.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.904+0000 7f869d600640 1 -- 172.21.15.12:0/4258018886 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8690032900 con 0x7f86a01098f0 2024-09-05T01:14:42.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.904+0000 7f869d600640 1 -- 172.21.15.12:0/4258018886 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8690030850 con 0x7f86a01098f0 2024-09-05T01:14:42.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.904+0000 7f86a5a00640 1 -- 172.21.15.12:0/4258018886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a01098f0 msgr2=0x7f86a0109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:42.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.904+0000 7f86a5a00640 1 --2- 172.21.15.12:0/4258018886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a01098f0 0x7f86a0109cf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8690009820 tx=0x7f869002a270 comp rx=0 tx=0).stop 2024-09-05T01:14:42.777 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.905+0000 7f86a5a00640 1 -- 172.21.15.12:0/4258018886 shutdown_connections 2024-09-05T01:14:42.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.905+0000 7f86a5a00640 1 --2- 172.21.15.12:0/4258018886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a01098f0 0x7f86a0109cf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:42.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.905+0000 7f86a5a00640 1 -- 172.21.15.12:0/4258018886 >> 172.21.15.12:0/4258018886 conn(0x7f86a007ceb0 msgr2=0x7f86a007d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:42.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.905+0000 7f86a5a00640 1 -- 172.21.15.12:0/4258018886 shutdown_connections 2024-09-05T01:14:42.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.905+0000 7f86a5a00640 1 -- 172.21.15.12:0/4258018886 wait complete. 2024-09-05T01:14:42.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.906+0000 7f86a5a00640 1 Processor -- start 2024-09-05T01:14:42.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.906+0000 7f86a5a00640 1 -- start start 2024-09-05T01:14:42.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.906+0000 7f86a5a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a01098f0 0x7f86a019d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:42.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.906+0000 7f86a5a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f86a010dec0 con 0x7f86a01098f0 2024-09-05T01:14:42.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.906+0000 7f869ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a01098f0 0x7f86a019d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:42.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.906+0000 7f869ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a01098f0 0x7f86a019d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49746/0 (socket says 172.21.15.12:49746) 2024-09-05T01:14:42.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.906+0000 7f869ea00640 1 -- 172.21.15.12:0/480443373 learned_addr learned my addr 172.21.15.12:0/480443373 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:42.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.907+0000 7f869ea00640 1 -- 172.21.15.12:0/480443373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a019de80 con 0x7f86a01098f0 2024-09-05T01:14:42.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.907+0000 7f869ea00640 1 --2- 172.21.15.12:0/480443373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a01098f0 0x7f86a019d940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8690032ce0 tx=0x7f8690032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:42.778 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.907+0000 7f8697400640 1 -- 172.21.15.12:0/480443373 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8690042070 con 0x7f86a01098f0 2024-09-05T01:14:42.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.908+0000 7f8697400640 1 -- 172.21.15.12:0/480443373 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f86900308c0 con 0x7f86a01098f0 2024-09-05T01:14:42.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.908+0000 7f86a5a00640 1 -- 172.21.15.12:0/480443373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86a019e110 con 0x7f86a01098f0 2024-09-05T01:14:42.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.908+0000 7f8697400640 1 -- 172.21.15.12:0/480443373 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8690037040 con 0x7f86a01098f0 2024-09-05T01:14:42.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.908+0000 7f86a5a00640 1 -- 172.21.15.12:0/480443373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86a01a0e00 con 0x7f86a01098f0 2024-09-05T01:14:42.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.908+0000 7f8697400640 1 -- 172.21.15.12:0/480443373 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8690045070 con 0x7f86a01098f0 2024-09-05T01:14:42.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.908+0000 7f8697400640 1 -- 172.21.15.12:0/480443373 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8690047b70 con 0x7f86a01098f0 2024-09-05T01:14:42.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.909+0000 7f86a5a00640 1 -- 172.21.15.12:0/480443373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86a0109cf0 con 0x7f86a01098f0 2024-09-05T01:14:42.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.912+0000 7f8697400640 1 -- 172.21.15.12:0/480443373 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f869003dbf0 con 0x7f86a01098f0 2024-09-05T01:14:42.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.978+0000 7f86a5a00640 1 -- 172.21.15.12:0/480443373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f86a01a1370 con 0x7f86a01098f0 2024-09-05T01:14:42.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.978+0000 7f8697400640 1 -- 172.21.15.12:0/480443373 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1292 (secure 0 0 0) 0x7f869003d430 con 0x7f86a01098f0 2024-09-05T01:14:42.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.980+0000 7f86a5a00640 1 -- 172.21.15.12:0/480443373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a01098f0 msgr2=0x7f86a019d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:42.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.980+0000 7f86a5a00640 1 --2- 172.21.15.12:0/480443373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a01098f0 0x7f86a019d940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8690032ce0 tx=0x7f8690032d10 comp rx=0 tx=0).stop 2024-09-05T01:14:42.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.980+0000 7f86a5a00640 1 -- 172.21.15.12:0/480443373 shutdown_connections 2024-09-05T01:14:42.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.980+0000 7f86a5a00640 1 --2- 172.21.15.12:0/480443373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86a01098f0 0x7f86a019d940 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:42.779 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.980+0000 7f86a5a00640 1 -- 172.21.15.12:0/480443373 >> 172.21.15.12:0/480443373 conn(0x7f86a007ceb0 msgr2=0x7f86a0107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:42.780 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.980+0000 7f86a5a00640 1 -- 172.21.15.12:0/480443373 shutdown_connections 2024-09-05T01:14:42.780 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:40.980+0000 7f86a5a00640 1 -- 172.21.15.12:0/480443373 wait complete. 2024-09-05T01:14:42.780 INFO:teuthology.orchestra.run.smithi012.stdout:mgr not available, waiting (2/15)... 2024-09-05T01:14:43.812 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:43 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:43.456+0000 7f995302d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-05T01:14:43.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:43 smithi012 ceph-mon[29942]: Activating manager daemon x 2024-09-05T01:14:43.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:43 smithi012 ceph-mon[29942]: mgrmap e2: x(active, starting, since 0.00442201s) 2024-09-05T01:14:43.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:43 smithi012 ceph-mon[29942]: from='mgr.14100 172.21.15.12:0/2120743849' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-05T01:14:43.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:43 smithi012 ceph-mon[29942]: from='mgr.14100 172.21.15.12:0/2120743849' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-05T01:14:43.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:43 smithi012 ceph-mon[29942]: from='mgr.14100 172.21.15.12:0/2120743849' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-05T01:14:43.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:43 smithi012 ceph-mon[29942]: from='mgr.14100 172.21.15.12:0/2120743849' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T01:14:43.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:43 smithi012 ceph-mon[29942]: from='mgr.14100 172.21.15.12:0/2120743849' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-05T01:14:43.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:43 smithi012 ceph-mon[29942]: Manager daemon x is now available 2024-09-05T01:14:43.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:43 smithi012 ceph-mon[29942]: from='mgr.14100 172.21.15.12:0/2120743849' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-05T01:14:43.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:43 smithi012 ceph-mon[29942]: from='mgr.14100 172.21.15.12:0/2120743849' entity='mgr.x' 2024-09-05T01:14:43.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:43 smithi012 ceph-mon[29942]: from='mgr.14100 172.21.15.12:0/2120743849' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-05T01:14:43.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:43 smithi012 ceph-mon[29942]: from='mgr.14100 172.21.15.12:0/2120743849' entity='mgr.x' 2024-09-05T01:14:43.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:43 smithi012 ceph-mon[29942]: from='mgr.14100 172.21.15.12:0/2120743849' entity='mgr.x' 2024-09-05T01:14:45.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:45 smithi012 ceph-mon[29942]: mgrmap e3: x(active, since 1.00969s) 2024-09-05T01:14:46.108 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-05T01:14:46.108 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-05T01:14:46.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsid": "0d44cd7e-6b24-11ef-bcd6-c7b262605968", 2024-09-05T01:14:46.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "health": { 2024-09-05T01:14:46.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-05T01:14:46.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-05T01:14:46.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-05T01:14:46.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-05T01:14:46.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-05T01:14:46.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-05T01:14:46.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 0 2024-09-05T01:14:46.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-05T01:14:46.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-05T01:14:46.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "a" 2024-09-05T01:14:46.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-05T01:14:46.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "quorum_age": 18, 2024-09-05T01:14:46.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-05T01:14:46.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T01:14:46.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-05T01:14:46.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-05T01:14:46.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-05T01:14:46.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-05T01:14:46.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T01:14:46.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-05T01:14:46.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-05T01:14:46.111 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-05T01:14:46.120 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-05T01:14:46.120 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-05T01:14:46.120 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-05T01:14:46.121 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-05T01:14:46.121 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-05T01:14:46.121 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-05T01:14:46.121 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-05T01:14:46.121 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-05T01:14:46.121 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-05T01:14:46.121 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-05T01:14:46.121 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-05T01:14:46.121 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-05T01:14:46.121 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-05T01:14:46.121 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-05T01:14:46.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-05T01:14:46.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T01:14:46.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "btime": "2024-09-05T01:14:21:162585+0000", 2024-09-05T01:14:46.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-05T01:14:46.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-05T01:14:46.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-05T01:14:46.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-05T01:14:46.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-05T01:14:46.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-05T01:14:46.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-05T01:14:46.122 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-05T01:14:46.123 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-05T01:14:46.123 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "restful" 2024-09-05T01:14:46.123 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ], 2024-09-05T01:14:46.123 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-05T01:14:46.123 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-05T01:14:46.123 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-05T01:14:46.123 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-05T01:14:46.123 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "modified": "2024-09-05T01:14:21.163472+0000", 2024-09-05T01:14:46.123 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-05T01:14:46.123 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout }, 2024-09-05T01:14:46.123 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-05T01:14:46.124 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-05T01:14:46.124 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.254+0000 7f4fe4c00640 1 Processor -- start 2024-09-05T01:14:46.124 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.254+0000 7f4fe4c00640 1 -- start start 2024-09-05T01:14:46.124 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.254+0000 7f4fe4c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fe01076f0 0x7f4fe0107af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:46.124 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.254+0000 7f4fe4c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe01080c0 con 0x7f4fe01076f0 2024-09-05T01:14:46.124 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.254+0000 7f4fdde00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fe01076f0 0x7f4fe0107af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:46.124 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.254+0000 7f4fdde00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fe01076f0 0x7f4fe0107af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49812/0 (socket says 172.21.15.12:49812) 2024-09-05T01:14:46.124 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.254+0000 7f4fdde00640 1 -- 172.21.15.12:0/1256850432 learned_addr learned my addr 172.21.15.12:0/1256850432 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:46.124 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.255+0000 7f4fdde00640 1 -- 172.21.15.12:0/1256850432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe01088f0 con 0x7f4fe01076f0 2024-09-05T01:14:46.125 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.256+0000 7f4fdde00640 1 --2- 172.21.15.12:0/1256850432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fe01076f0 0x7f4fe0107af0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009820 tx=0x7f4fd002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f389b6375e10de7d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:46.125 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.256+0000 7f4fdd400640 1 -- 172.21.15.12:0/1256850432 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fd0037070 con 0x7f4fe01076f0 2024-09-05T01:14:46.125 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.256+0000 7f4fdd400640 1 -- 172.21.15.12:0/1256850432 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4fd0032900 con 0x7f4fe01076f0 2024-09-05T01:14:46.125 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.256+0000 7f4fdd400640 1 -- 172.21.15.12:0/1256850432 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fd0030850 con 0x7f4fe01076f0 2024-09-05T01:14:46.125 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.257+0000 7f4fe4c00640 1 -- 172.21.15.12:0/1256850432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fe01076f0 msgr2=0x7f4fe0107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:46.125 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.257+0000 7f4fe4c00640 1 --2- 172.21.15.12:0/1256850432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fe01076f0 0x7f4fe0107af0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009820 tx=0x7f4fd002a270 comp rx=0 tx=0).stop 2024-09-05T01:14:46.125 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.257+0000 7f4fe4c00640 1 -- 172.21.15.12:0/1256850432 shutdown_connections 2024-09-05T01:14:46.125 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.257+0000 7f4fe4c00640 1 --2- 172.21.15.12:0/1256850432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fe01076f0 0x7f4fe0107af0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:46.125 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.257+0000 7f4fe4c00640 1 -- 172.21.15.12:0/1256850432 >> 172.21.15.12:0/1256850432 conn(0x7f4fe0102e80 msgr2=0x7f4fe01052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:46.125 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.257+0000 7f4fe4c00640 1 -- 172.21.15.12:0/1256850432 shutdown_connections 2024-09-05T01:14:46.125 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.257+0000 7f4fe4c00640 1 -- 172.21.15.12:0/1256850432 wait complete. 2024-09-05T01:14:46.126 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.258+0000 7f4fe4c00640 1 Processor -- start 2024-09-05T01:14:46.126 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.258+0000 7f4fe4c00640 1 -- start start 2024-09-05T01:14:46.126 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.259+0000 7f4fe4c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fe01076f0 0x7f4fe019d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:46.126 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.259+0000 7f4fe4c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe010bca0 con 0x7f4fe01076f0 2024-09-05T01:14:46.126 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.259+0000 7f4fdde00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fe01076f0 0x7f4fe019d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:46.126 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.259+0000 7f4fdde00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fe01076f0 0x7f4fe019d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49824/0 (socket says 172.21.15.12:49824) 2024-09-05T01:14:46.126 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.259+0000 7f4fdde00640 1 -- 172.21.15.12:0/2766489084 learned_addr learned my addr 172.21.15.12:0/2766489084 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:46.126 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.259+0000 7f4fdde00640 1 -- 172.21.15.12:0/2766489084 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe019deb0 con 0x7f4fe01076f0 2024-09-05T01:14:46.126 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.259+0000 7f4fdde00640 1 --2- 172.21.15.12:0/2766489084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fe01076f0 0x7f4fe019d970 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4fd00097f0 tx=0x7f4fd0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:46.126 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.260+0000 7f4fd6a00640 1 -- 172.21.15.12:0/2766489084 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fd0037040 con 0x7f4fe01076f0 2024-09-05T01:14:46.126 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.260+0000 7f4fd6a00640 1 -- 172.21.15.12:0/2766489084 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4fd0040070 con 0x7f4fe01076f0 2024-09-05T01:14:46.127 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.260+0000 7f4fd6a00640 1 -- 172.21.15.12:0/2766489084 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fd003a390 con 0x7f4fe01076f0 2024-09-05T01:14:46.127 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.260+0000 7f4fe4c00640 1 -- 172.21.15.12:0/2766489084 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fe019e140 con 0x7f4fe01076f0 2024-09-05T01:14:46.127 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.260+0000 7f4fe4c00640 1 -- 172.21.15.12:0/2766489084 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fe01a0e30 con 0x7f4fe01076f0 2024-09-05T01:14:46.127 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.261+0000 7f4fd6a00640 1 -- 172.21.15.12:0/2766489084 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7f4fd003b430 con 0x7f4fe01076f0 2024-09-05T01:14:46.127 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.261+0000 7f4fe4c00640 1 -- 172.21.15.12:0/2766489084 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fe0107b70 con 0x7f4fe01076f0 2024-09-05T01:14:46.127 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.261+0000 7f4fd6a00640 1 --2- 172.21.15.12:0/2766489084 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f4fc4038e60 0x7f4fc403b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:46.127 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.262+0000 7f4fd6a00640 1 -- 172.21.15.12:0/2766489084 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4fd006bec0 con 0x7f4fe01076f0 2024-09-05T01:14:46.127 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.263+0000 7f4fd7e00640 1 --2- 172.21.15.12:0/2766489084 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f4fc4038e60 0x7f4fc403b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:46.127 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.263+0000 7f4fd7e00640 1 --2- 172.21.15.12:0/2766489084 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f4fc4038e60 0x7f4fc403b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80098c0 tx=0x7f4fc8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:46.127 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.267+0000 7f4fd6a00640 1 -- 172.21.15.12:0/2766489084 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4fd0032900 con 0x7f4fe01076f0 2024-09-05T01:14:46.128 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.468+0000 7f4fd6a00640 1 -- 172.21.15.12:0/2766489084 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f4fd0040ca0 con 0x7f4fe01076f0 2024-09-05T01:14:46.128 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.520+0000 7f4fe4c00640 1 -- 172.21.15.12:0/2766489084 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f4fe01a13a0 con 0x7f4fe01076f0 2024-09-05T01:14:46.128 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.521+0000 7f4fd6a00640 1 -- 172.21.15.12:0/2766489084 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f4fd0063b20 con 0x7f4fe01076f0 2024-09-05T01:14:46.128 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.523+0000 7f4fe4c00640 1 -- 172.21.15.12:0/2766489084 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f4fc4038e60 msgr2=0x7f4fc403b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:46.128 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.523+0000 7f4fe4c00640 1 --2- 172.21.15.12:0/2766489084 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f4fc4038e60 0x7f4fc403b320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80098c0 tx=0x7f4fc8006db0 comp rx=0 tx=0).stop 2024-09-05T01:14:46.128 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.523+0000 7f4fe4c00640 1 -- 172.21.15.12:0/2766489084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fe01076f0 msgr2=0x7f4fe019d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:46.128 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.523+0000 7f4fe4c00640 1 --2- 172.21.15.12:0/2766489084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fe01076f0 0x7f4fe019d970 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4fd00097f0 tx=0x7f4fd0030d80 comp rx=0 tx=0).stop 2024-09-05T01:14:46.128 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.523+0000 7f4fe4c00640 1 -- 172.21.15.12:0/2766489084 shutdown_connections 2024-09-05T01:14:46.128 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.523+0000 7f4fe4c00640 1 --2- 172.21.15.12:0/2766489084 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f4fc4038e60 0x7f4fc403b320 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:46.128 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.523+0000 7f4fe4c00640 1 --2- 172.21.15.12:0/2766489084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fe01076f0 0x7f4fe019d970 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:46.129 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.523+0000 7f4fe4c00640 1 -- 172.21.15.12:0/2766489084 >> 172.21.15.12:0/2766489084 conn(0x7f4fe0102e80 msgr2=0x7f4fe01039e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:46.129 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.524+0000 7f4fe4c00640 1 -- 172.21.15.12:0/2766489084 shutdown_connections 2024-09-05T01:14:46.129 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:45.524+0000 7f4fe4c00640 1 -- 172.21.15.12:0/2766489084 wait complete. 2024-09-05T01:14:46.129 INFO:teuthology.orchestra.run.smithi012.stdout:mgr is available 2024-09-05T01:14:46.768 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:46 smithi012 ceph-mon[29942]: mgrmap e4: x(active, since 2s) 2024-09-05T01:14:46.768 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:46 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2766489084' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-05T01:14:47.322 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-05T01:14:47.323 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [global] 2024-09-05T01:14:47.323 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout fsid = 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:14:47.323 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.12:3300,v1:172.21.15.12:6789] 2024-09-05T01:14:47.323 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-05T01:14:47.323 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-05T01:14:47.323 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-05T01:14:47.323 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-05T01:14:47.323 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-05T01:14:47.323 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-05T01:14:47.323 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-05T01:14:47.323 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 2024-09-05T01:14:47.324 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout [osd] 2024-09-05T01:14:47.324 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-05T01:14:47.324 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-05T01:14:47.324 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-05T01:14:47.324 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-05T01:14:47.324 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-05T01:14:47.324 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.569+0000 7fbb84200640 1 Processor -- start 2024-09-05T01:14:47.324 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.569+0000 7fbb84200640 1 -- start start 2024-09-05T01:14:47.324 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.570+0000 7fbb84200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb7c106610 0x7fbb7c106a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:47.324 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.570+0000 7fbb84200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7c106fe0 con 0x7fbb7c106610 2024-09-05T01:14:47.324 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.570+0000 7fbb81800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb7c106610 0x7fbb7c106a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:47.325 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.570+0000 7fbb81800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb7c106610 0x7fbb7c106a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49840/0 (socket says 172.21.15.12:49840) 2024-09-05T01:14:47.325 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.570+0000 7fbb81800640 1 -- 172.21.15.12:0/303606351 learned_addr learned my addr 172.21.15.12:0/303606351 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:47.325 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.571+0000 7fbb81800640 1 -- 172.21.15.12:0/303606351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb7c107810 con 0x7fbb7c106610 2024-09-05T01:14:47.325 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.572+0000 7fbb81800640 1 --2- 172.21.15.12:0/303606351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb7c106610 0x7fbb7c106a10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbb70009820 tx=0x7fbb7002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572cf024b1e1b9b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:47.325 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.572+0000 7fbb7be00640 1 -- 172.21.15.12:0/303606351 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb70037070 con 0x7fbb7c106610 2024-09-05T01:14:47.325 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.572+0000 7fbb7be00640 1 -- 172.21.15.12:0/303606351 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb70032900 con 0x7fbb7c106610 2024-09-05T01:14:47.325 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.572+0000 7fbb7be00640 1 -- 172.21.15.12:0/303606351 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb70030850 con 0x7fbb7c106610 2024-09-05T01:14:47.325 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.572+0000 7fbb84200640 1 -- 172.21.15.12:0/303606351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb7c106610 msgr2=0x7fbb7c106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:47.325 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.572+0000 7fbb84200640 1 --2- 172.21.15.12:0/303606351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb7c106610 0x7fbb7c106a10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbb70009820 tx=0x7fbb7002a270 comp rx=0 tx=0).stop 2024-09-05T01:14:47.325 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.573+0000 7fbb84200640 1 -- 172.21.15.12:0/303606351 shutdown_connections 2024-09-05T01:14:47.325 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.573+0000 7fbb84200640 1 --2- 172.21.15.12:0/303606351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb7c106610 0x7fbb7c106a10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:47.325 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.573+0000 7fbb84200640 1 -- 172.21.15.12:0/303606351 >> 172.21.15.12:0/303606351 conn(0x7fbb7c101da0 msgr2=0x7fbb7c1041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:47.326 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.573+0000 7fbb84200640 1 -- 172.21.15.12:0/303606351 shutdown_connections 2024-09-05T01:14:47.326 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.573+0000 7fbb84200640 1 -- 172.21.15.12:0/303606351 wait complete. 2024-09-05T01:14:47.326 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.574+0000 7fbb84200640 1 Processor -- start 2024-09-05T01:14:47.326 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.574+0000 7fbb84200640 1 -- start start 2024-09-05T01:14:47.326 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.574+0000 7fbb84200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb7c106610 0x7fbb7c1a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:47.326 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.574+0000 7fbb84200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7c10abc0 con 0x7fbb7c106610 2024-09-05T01:14:47.326 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.574+0000 7fbb81800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb7c106610 0x7fbb7c1a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:47.326 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.574+0000 7fbb81800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb7c106610 0x7fbb7c1a1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49842/0 (socket says 172.21.15.12:49842) 2024-09-05T01:14:47.326 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.574+0000 7fbb81800640 1 -- 172.21.15.12:0/911216102 learned_addr learned my addr 172.21.15.12:0/911216102 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:47.327 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.575+0000 7fbb81800640 1 -- 172.21.15.12:0/911216102 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb7c1a2290 con 0x7fbb7c106610 2024-09-05T01:14:47.327 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.575+0000 7fbb81800640 1 --2- 172.21.15.12:0/911216102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb7c106610 0x7fbb7c1a1d50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbb700097f0 tx=0x7fbb70030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:47.327 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.575+0000 7fbb7a000640 1 -- 172.21.15.12:0/911216102 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb70037040 con 0x7fbb7c106610 2024-09-05T01:14:47.327 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.575+0000 7fbb7a000640 1 -- 172.21.15.12:0/911216102 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbb70040070 con 0x7fbb7c106610 2024-09-05T01:14:47.327 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.575+0000 7fbb7a000640 1 -- 172.21.15.12:0/911216102 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb7003a390 con 0x7fbb7c106610 2024-09-05T01:14:47.327 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.575+0000 7fbb84200640 1 -- 172.21.15.12:0/911216102 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb7c1a2520 con 0x7fbb7c106610 2024-09-05T01:14:47.327 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.575+0000 7fbb84200640 1 -- 172.21.15.12:0/911216102 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb7c1a5210 con 0x7fbb7c106610 2024-09-05T01:14:47.327 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.576+0000 7fbb7a000640 1 -- 172.21.15.12:0/911216102 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fbb7003b430 con 0x7fbb7c106610 2024-09-05T01:14:47.327 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.576+0000 7fbb84200640 1 -- 172.21.15.12:0/911216102 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb7c106a90 con 0x7fbb7c106610 2024-09-05T01:14:47.327 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.577+0000 7fbb7a000640 1 --2- 172.21.15.12:0/911216102 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7fbb64038f70 0x7fbb6403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:47.328 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.577+0000 7fbb7a000640 1 -- 172.21.15.12:0/911216102 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbb7006c0d0 con 0x7fbb7c106610 2024-09-05T01:14:47.328 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.577+0000 7fbb80e00640 1 --2- 172.21.15.12:0/911216102 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7fbb64038f70 0x7fbb6403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:47.328 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.578+0000 7fbb80e00640 1 --2- 172.21.15.12:0/911216102 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7fbb64038f70 0x7fbb6403b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbb680098c0 tx=0x7fbb68006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:47.328 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.582+0000 7fbb7a000640 1 -- 172.21.15.12:0/911216102 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbb700371e0 con 0x7fbb7c106610 2024-09-05T01:14:47.328 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.766+0000 7fbb84200640 1 -- 172.21.15.12:0/911216102 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fbb7c1a29a0 con 0x7fbb7c106610 2024-09-05T01:14:47.328 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.768+0000 7fbb7a000640 1 -- 172.21.15.12:0/911216102 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7fbb70032dd0 con 0x7fbb7c106610 2024-09-05T01:14:47.328 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.771+0000 7fbb84200640 1 -- 172.21.15.12:0/911216102 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7fbb64038f70 msgr2=0x7fbb6403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:47.328 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.771+0000 7fbb84200640 1 --2- 172.21.15.12:0/911216102 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7fbb64038f70 0x7fbb6403b430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbb680098c0 tx=0x7fbb68006db0 comp rx=0 tx=0).stop 2024-09-05T01:14:47.328 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.771+0000 7fbb84200640 1 -- 172.21.15.12:0/911216102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb7c106610 msgr2=0x7fbb7c1a1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:47.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.771+0000 7fbb84200640 1 --2- 172.21.15.12:0/911216102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb7c106610 0x7fbb7c1a1d50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbb700097f0 tx=0x7fbb70030d80 comp rx=0 tx=0).stop 2024-09-05T01:14:47.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.771+0000 7fbb84200640 1 -- 172.21.15.12:0/911216102 shutdown_connections 2024-09-05T01:14:47.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.771+0000 7fbb84200640 1 --2- 172.21.15.12:0/911216102 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7fbb64038f70 0x7fbb6403b430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:47.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.771+0000 7fbb84200640 1 --2- 172.21.15.12:0/911216102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb7c106610 0x7fbb7c1a1d50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:47.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.771+0000 7fbb84200640 1 -- 172.21.15.12:0/911216102 >> 172.21.15.12:0/911216102 conn(0x7fbb7c101da0 msgr2=0x7fbb7c102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:47.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.771+0000 7fbb84200640 1 -- 172.21.15.12:0/911216102 shutdown_connections 2024-09-05T01:14:47.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:46.771+0000 7fbb84200640 1 -- 172.21.15.12:0/911216102 wait complete. 2024-09-05T01:14:47.329 INFO:teuthology.orchestra.run.smithi012.stdout:Enabling cephadm module... 2024-09-05T01:14:47.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:47 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/911216102' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-05T01:14:48.491 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:48 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3429548969' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-05T01:14:48.778 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:48 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: ignoring --setuser ceph since I am not root 2024-09-05T01:14:48.778 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:48 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: ignoring --setgroup ceph since I am not root 2024-09-05T01:14:48.778 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:48 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:48.701+0000 7f8974231040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-05T01:14:48.778 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:48 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:48.777+0000 7f8974231040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-05T01:14:49.057 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:48 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:48.971+0000 7f8974231040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-05T01:14:49.057 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:49 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:49.055+0000 7f8974231040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-05T01:14:49.311 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:49 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:49.234+0000 7f8974231040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-05T01:14:49.340 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.986+0000 7fcc32600640 1 Processor -- start 2024-09-05T01:14:49.340 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.986+0000 7fcc32600640 1 -- start start 2024-09-05T01:14:49.340 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.986+0000 7fcc32600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc2c1098f0 0x7fcc2c109cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:49.340 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.986+0000 7fcc32600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2c10a2c0 con 0x7fcc2c1098f0 2024-09-05T01:14:49.341 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.987+0000 7fcc2b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc2c1098f0 0x7fcc2c109cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:49.341 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.987+0000 7fcc2b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc2c1098f0 0x7fcc2c109cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32950/0 (socket says 172.21.15.12:32950) 2024-09-05T01:14:49.341 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.987+0000 7fcc2b400640 1 -- 172.21.15.12:0/3396931028 learned_addr learned my addr 172.21.15.12:0/3396931028 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:49.341 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.987+0000 7fcc2b400640 1 -- 172.21.15.12:0/3396931028 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc2c10ab10 con 0x7fcc2c1098f0 2024-09-05T01:14:49.341 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.988+0000 7fcc2b400640 1 --2- 172.21.15.12:0/3396931028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc2c1098f0 0x7fcc2c109cf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009820 tx=0x7fcc1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ed8ec7eebefd6e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:49.341 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.988+0000 7fcc2a000640 1 -- 172.21.15.12:0/3396931028 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc1c037070 con 0x7fcc2c1098f0 2024-09-05T01:14:49.341 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.988+0000 7fcc2a000640 1 -- 172.21.15.12:0/3396931028 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcc1c032900 con 0x7fcc2c1098f0 2024-09-05T01:14:49.341 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.988+0000 7fcc2a000640 1 -- 172.21.15.12:0/3396931028 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc1c030850 con 0x7fcc2c1098f0 2024-09-05T01:14:49.341 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.989+0000 7fcc32600640 1 -- 172.21.15.12:0/3396931028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc2c1098f0 msgr2=0x7fcc2c109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:49.341 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.989+0000 7fcc32600640 1 --2- 172.21.15.12:0/3396931028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc2c1098f0 0x7fcc2c109cf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009820 tx=0x7fcc1c02a270 comp rx=0 tx=0).stop 2024-09-05T01:14:49.341 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.989+0000 7fcc32600640 1 -- 172.21.15.12:0/3396931028 shutdown_connections 2024-09-05T01:14:49.341 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.989+0000 7fcc32600640 1 --2- 172.21.15.12:0/3396931028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc2c1098f0 0x7fcc2c109cf0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:49.341 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.989+0000 7fcc32600640 1 -- 172.21.15.12:0/3396931028 >> 172.21.15.12:0/3396931028 conn(0x7fcc2c07ceb0 msgr2=0x7fcc2c07d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:49.342 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.989+0000 7fcc32600640 1 -- 172.21.15.12:0/3396931028 shutdown_connections 2024-09-05T01:14:49.342 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.989+0000 7fcc32600640 1 -- 172.21.15.12:0/3396931028 wait complete. 2024-09-05T01:14:49.342 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.990+0000 7fcc32600640 1 Processor -- start 2024-09-05T01:14:49.342 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.990+0000 7fcc32600640 1 -- start start 2024-09-05T01:14:49.342 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.991+0000 7fcc32600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc2c1098f0 0x7fcc2c19d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:49.342 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.991+0000 7fcc32600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2c10dec0 con 0x7fcc2c1098f0 2024-09-05T01:14:49.342 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.991+0000 7fcc2b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc2c1098f0 0x7fcc2c19d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:49.342 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.991+0000 7fcc2b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc2c1098f0 0x7fcc2c19d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32958/0 (socket says 172.21.15.12:32958) 2024-09-05T01:14:49.342 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.991+0000 7fcc2b400640 1 -- 172.21.15.12:0/3429548969 learned_addr learned my addr 172.21.15.12:0/3429548969 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:49.342 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.991+0000 7fcc2b400640 1 -- 172.21.15.12:0/3429548969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc2c19de80 con 0x7fcc2c1098f0 2024-09-05T01:14:49.342 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.992+0000 7fcc2b400640 1 --2- 172.21.15.12:0/3429548969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc2c1098f0 0x7fcc2c19d940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c032ce0 tx=0x7fcc1c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:49.342 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.992+0000 7fcc23e00640 1 -- 172.21.15.12:0/3429548969 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc1c042070 con 0x7fcc2c1098f0 2024-09-05T01:14:49.343 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.992+0000 7fcc23e00640 1 -- 172.21.15.12:0/3429548969 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcc1c0308c0 con 0x7fcc2c1098f0 2024-09-05T01:14:49.343 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.992+0000 7fcc32600640 1 -- 172.21.15.12:0/3429548969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc2c19e110 con 0x7fcc2c1098f0 2024-09-05T01:14:49.343 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.992+0000 7fcc23e00640 1 -- 172.21.15.12:0/3429548969 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc1c037040 con 0x7fcc2c1098f0 2024-09-05T01:14:49.343 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.992+0000 7fcc32600640 1 -- 172.21.15.12:0/3429548969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc2c1a0e00 con 0x7fcc2c1098f0 2024-09-05T01:14:49.343 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.993+0000 7fcc23e00640 1 -- 172.21.15.12:0/3429548969 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fcc1c045070 con 0x7fcc2c1098f0 2024-09-05T01:14:49.343 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.993+0000 7fcc32600640 1 -- 172.21.15.12:0/3429548969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc2c109cf0 con 0x7fcc2c1098f0 2024-09-05T01:14:49.343 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.993+0000 7fcc23e00640 1 --2- 172.21.15.12:0/3429548969 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7fcc10038f70 0x7fcc1003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:49.343 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.994+0000 7fcc23e00640 1 -- 172.21.15.12:0/3429548969 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcc1c06bf20 con 0x7fcc2c1098f0 2024-09-05T01:14:49.343 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.994+0000 7fcc2aa00640 1 --2- 172.21.15.12:0/3429548969 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7fcc10038f70 0x7fcc1003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:49.343 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.994+0000 7fcc2aa00640 1 --2- 172.21.15.12:0/3429548969 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7fcc10038f70 0x7fcc1003b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcc180098c0 tx=0x7fcc18006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:49.343 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:47.998+0000 7fcc23e00640 1 -- 172.21.15.12:0/3429548969 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcc1c045360 con 0x7fcc2c1098f0 2024-09-05T01:14:49.343 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:48.235+0000 7fcc32600640 1 -- 172.21.15.12:0/3429548969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fcc2c1a1480 con 0x7fcc2c1098f0 2024-09-05T01:14:49.343 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:48.471+0000 7fcc23e00640 1 -- 172.21.15.12:0/3429548969 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fcc1c043260 con 0x7fcc2c1098f0 2024-09-05T01:14:49.344 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:48.473+0000 7fcc23e00640 1 -- 172.21.15.12:0/3429548969 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fcc1c067090 con 0x7fcc2c1098f0 2024-09-05T01:14:49.344 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:48.475+0000 7fcc32600640 1 -- 172.21.15.12:0/3429548969 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7fcc10038f70 msgr2=0x7fcc1003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:49.344 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:48.475+0000 7fcc32600640 1 --2- 172.21.15.12:0/3429548969 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7fcc10038f70 0x7fcc1003b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcc180098c0 tx=0x7fcc18006db0 comp rx=0 tx=0).stop 2024-09-05T01:14:49.344 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:48.475+0000 7fcc32600640 1 -- 172.21.15.12:0/3429548969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc2c1098f0 msgr2=0x7fcc2c19d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:49.344 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:48.475+0000 7fcc32600640 1 --2- 172.21.15.12:0/3429548969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc2c1098f0 0x7fcc2c19d940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c032ce0 tx=0x7fcc1c032d10 comp rx=0 tx=0).stop 2024-09-05T01:14:49.344 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:48.475+0000 7fcc32600640 1 -- 172.21.15.12:0/3429548969 shutdown_connections 2024-09-05T01:14:49.344 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:48.475+0000 7fcc32600640 1 --2- 172.21.15.12:0/3429548969 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7fcc10038f70 0x7fcc1003b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:49.344 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:48.475+0000 7fcc32600640 1 --2- 172.21.15.12:0/3429548969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc2c1098f0 0x7fcc2c19d940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:49.344 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:48.475+0000 7fcc32600640 1 -- 172.21.15.12:0/3429548969 >> 172.21.15.12:0/3429548969 conn(0x7fcc2c07ceb0 msgr2=0x7fcc2c107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:49.344 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:48.475+0000 7fcc32600640 1 -- 172.21.15.12:0/3429548969 shutdown_connections 2024-09-05T01:14:49.344 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:48.475+0000 7fcc32600640 1 -- 172.21.15.12:0/3429548969 wait complete. 2024-09-05T01:14:49.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:49 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3429548969' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-05T01:14:49.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:49 smithi012 ceph-mon[29942]: mgrmap e5: x(active, since 5s) 2024-09-05T01:14:49.607 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:49 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:49.410+0000 7f8974231040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-05T01:14:49.883 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:49 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:49.803+0000 7f8974231040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-05T01:14:49.883 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:49 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:49.882+0000 7f8974231040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-05T01:14:50.311 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:50 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:50.106+0000 7f8974231040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-05T01:14:50.712 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:50 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/427047740' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-05T01:14:50.725 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-05T01:14:50.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-05T01:14:50.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-05T01:14:50.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-05T01:14:50.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-05T01:14:50.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-05T01:14:50.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.832+0000 7f23f7e00640 1 Processor -- start 2024-09-05T01:14:50.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.832+0000 7f23f7e00640 1 -- start start 2024-09-05T01:14:50.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.832+0000 7f23f7e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23f8107530 0x7f23f8107930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:50.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.832+0000 7f23f7e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f23f8107f00 con 0x7f23f8107530 2024-09-05T01:14:50.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.832+0000 7f23f6a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23f8107530 0x7f23f8107930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:50.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.833+0000 7f23f6a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23f8107530 0x7f23f8107930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32982/0 (socket says 172.21.15.12:32982) 2024-09-05T01:14:50.726 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.833+0000 7f23f6a00640 1 -- 172.21.15.12:0/1196353390 learned_addr learned my addr 172.21.15.12:0/1196353390 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:50.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.833+0000 7f23f6a00640 1 -- 172.21.15.12:0/1196353390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f8108730 con 0x7f23f8107530 2024-09-05T01:14:50.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.834+0000 7f23f6a00640 1 --2- 172.21.15.12:0/1196353390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23f8107530 0x7f23f8107930 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f23e8009820 tx=0x7f23e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e51476e5b33098 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:50.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.834+0000 7f23f5600640 1 -- 172.21.15.12:0/1196353390 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23e8037070 con 0x7f23f8107530 2024-09-05T01:14:50.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.834+0000 7f23f5600640 1 -- 172.21.15.12:0/1196353390 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f23e8032900 con 0x7f23f8107530 2024-09-05T01:14:50.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.834+0000 7f23f5600640 1 -- 172.21.15.12:0/1196353390 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23e8030850 con 0x7f23f8107530 2024-09-05T01:14:50.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.835+0000 7f23f7e00640 1 -- 172.21.15.12:0/1196353390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23f8107530 msgr2=0x7f23f8107930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:50.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.835+0000 7f23f7e00640 1 --2- 172.21.15.12:0/1196353390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23f8107530 0x7f23f8107930 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f23e8009820 tx=0x7f23e802a270 comp rx=0 tx=0).stop 2024-09-05T01:14:50.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.835+0000 7f23f7e00640 1 -- 172.21.15.12:0/1196353390 shutdown_connections 2024-09-05T01:14:50.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.835+0000 7f23f7e00640 1 --2- 172.21.15.12:0/1196353390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23f8107530 0x7f23f8107930 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:50.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.835+0000 7f23f7e00640 1 -- 172.21.15.12:0/1196353390 >> 172.21.15.12:0/1196353390 conn(0x7f23f8102ce0 msgr2=0x7f23f8105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:50.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.835+0000 7f23f7e00640 1 -- 172.21.15.12:0/1196353390 shutdown_connections 2024-09-05T01:14:50.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.835+0000 7f23f7e00640 1 -- 172.21.15.12:0/1196353390 wait complete. 2024-09-05T01:14:50.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.837+0000 7f23f7e00640 1 Processor -- start 2024-09-05T01:14:50.728 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.837+0000 7f23f7e00640 1 -- start start 2024-09-05T01:14:50.728 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.837+0000 7f23f7e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23f8107530 0x7f23f819d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:50.728 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.837+0000 7f23f7e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f23f810bae0 con 0x7f23f8107530 2024-09-05T01:14:50.728 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.838+0000 7f23f6a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23f8107530 0x7f23f819d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:50.728 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.838+0000 7f23f6a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23f8107530 0x7f23f819d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32998/0 (socket says 172.21.15.12:32998) 2024-09-05T01:14:50.728 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.838+0000 7f23f6a00640 1 -- 172.21.15.12:0/427047740 learned_addr learned my addr 172.21.15.12:0/427047740 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:50.728 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.838+0000 7f23f6a00640 1 -- 172.21.15.12:0/427047740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f819dcd0 con 0x7f23f8107530 2024-09-05T01:14:50.728 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.838+0000 7f23f6a00640 1 --2- 172.21.15.12:0/427047740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23f8107530 0x7f23f819d790 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f23e80097f0 tx=0x7f23e8030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:50.728 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.839+0000 7f23ef400640 1 -- 172.21.15.12:0/427047740 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23e8037040 con 0x7f23f8107530 2024-09-05T01:14:50.728 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.839+0000 7f23ef400640 1 -- 172.21.15.12:0/427047740 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f23e8040070 con 0x7f23f8107530 2024-09-05T01:14:50.728 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.839+0000 7f23f7e00640 1 -- 172.21.15.12:0/427047740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23f819df60 con 0x7f23f8107530 2024-09-05T01:14:50.728 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.839+0000 7f23f7e00640 1 -- 172.21.15.12:0/427047740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23f81a0c50 con 0x7f23f8107530 2024-09-05T01:14:50.728 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.839+0000 7f23ef400640 1 -- 172.21.15.12:0/427047740 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23e803a390 con 0x7f23f8107530 2024-09-05T01:14:50.729 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.840+0000 7f23ef400640 1 -- 172.21.15.12:0/427047740 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f23e803a640 con 0x7f23f8107530 2024-09-05T01:14:50.729 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.840+0000 7f23f7e00640 1 -- 172.21.15.12:0/427047740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23f81079b0 con 0x7f23f8107530 2024-09-05T01:14:50.729 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.841+0000 7f23ef400640 1 --2- 172.21.15.12:0/427047740 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f23dc038fc0 0x7f23dc03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:50.729 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.841+0000 7f23ef400640 1 -- 172.21.15.12:0/427047740 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f23e806c140 con 0x7f23f8107530 2024-09-05T01:14:50.729 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.841+0000 7f23f6000640 1 -- 172.21.15.12:0/427047740 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f23dc038fc0 msgr2=0x7f23dc03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/3541208629 2024-09-05T01:14:50.729 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.841+0000 7f23f6000640 1 --2- 172.21.15.12:0/427047740 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f23dc038fc0 0x7f23dc03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T01:14:50.729 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:49.846+0000 7f23ef400640 1 -- 172.21.15.12:0/427047740 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f23e804a200 con 0x7f23f8107530 2024-09-05T01:14:50.729 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:50.042+0000 7f23f6000640 1 -- 172.21.15.12:0/427047740 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f23dc038fc0 msgr2=0x7f23dc03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/3541208629 2024-09-05T01:14:50.729 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:50.042+0000 7f23f6000640 1 --2- 172.21.15.12:0/427047740 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f23dc038fc0 0x7f23dc03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-05T01:14:50.729 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:50.080+0000 7f23f7e00640 1 -- 172.21.15.12:0/427047740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f23f81a1320 con 0x7f23f8107530 2024-09-05T01:14:50.729 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:50.080+0000 7f23ef400640 1 -- 172.21.15.12:0/427047740 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f23e8043bb0 con 0x7f23f8107530 2024-09-05T01:14:50.729 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:50.083+0000 7f23f7e00640 1 -- 172.21.15.12:0/427047740 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f23dc038fc0 msgr2=0x7f23dc03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T01:14:50.729 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:50.083+0000 7f23f7e00640 1 --2- 172.21.15.12:0/427047740 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f23dc038fc0 0x7f23dc03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:50.729 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:50.083+0000 7f23f7e00640 1 -- 172.21.15.12:0/427047740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23f8107530 msgr2=0x7f23f819d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:50.730 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:50.083+0000 7f23f7e00640 1 --2- 172.21.15.12:0/427047740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23f8107530 0x7f23f819d790 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f23e80097f0 tx=0x7f23e8030d80 comp rx=0 tx=0).stop 2024-09-05T01:14:50.730 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:50.083+0000 7f23f7e00640 1 -- 172.21.15.12:0/427047740 shutdown_connections 2024-09-05T01:14:50.730 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:50.083+0000 7f23f7e00640 1 --2- 172.21.15.12:0/427047740 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f23dc038fc0 0x7f23dc03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:50.730 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:50.083+0000 7f23f7e00640 1 --2- 172.21.15.12:0/427047740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23f8107530 0x7f23f819d790 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:50.730 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:50.083+0000 7f23f7e00640 1 -- 172.21.15.12:0/427047740 >> 172.21.15.12:0/427047740 conn(0x7f23f8102ce0 msgr2=0x7f23f81037f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:50.730 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:50.083+0000 7f23f7e00640 1 -- 172.21.15.12:0/427047740 shutdown_connections 2024-09-05T01:14:50.730 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:50.083+0000 7f23f7e00640 1 -- 172.21.15.12:0/427047740 wait complete. 2024-09-05T01:14:50.730 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for the mgr to restart... 2024-09-05T01:14:50.730 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mgr epoch 5... 2024-09-05T01:14:51.562 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:51 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:51.275+0000 7f8974231040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-05T01:14:51.562 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:51 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:51.360+0000 7f8974231040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-05T01:14:52.611 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:52 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:52.339+0000 7f8974231040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-05T01:14:52.611 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:52 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:52.482+0000 7f8974231040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-05T01:14:52.910 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:52 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:52.654+0000 7f8974231040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-05T01:14:52.910 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:52 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:52.729+0000 7f8974231040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-05T01:14:52.910 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:52 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:52.909+0000 7f8974231040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-05T01:14:53.258 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:52 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:52.994+0000 7f8974231040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-05T01:14:53.258 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:53 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:53.069+0000 7f8974231040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-05T01:14:53.258 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:53 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:53.257+0000 7f8974231040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-05T01:14:53.522 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:53 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:53.338+0000 7f8974231040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-05T01:14:53.522 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:53 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:53.420+0000 7f8974231040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-05T01:14:53.523 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:53 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:53.521+0000 7f8974231040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-05T01:14:53.812 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:53 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:53.595+0000 7f8974231040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-05T01:14:53.812 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:53 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:53.668+0000 7f8974231040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-05T01:14:55.062 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:54 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:54.622+0000 7f8974231040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-05T01:14:55.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:54 smithi012 ceph-mon[29942]: Active manager daemon x restarted 2024-09-05T01:14:55.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:54 smithi012 ceph-mon[29942]: Activating manager daemon x 2024-09-05T01:14:55.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:54 smithi012 ceph-mon[29942]: osdmap e2: 0 total, 0 up, 0 in 2024-09-05T01:14:55.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:54 smithi012 ceph-mon[29942]: mgrmap e6: x(active, starting, since 0.00372686s) 2024-09-05T01:14:55.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:54 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T01:14:55.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:54 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-05T01:14:55.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:54 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-05T01:14:55.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:54 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-05T01:14:55.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:54 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-05T01:14:55.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:54 smithi012 ceph-mon[29942]: Manager daemon x is now available 2024-09-05T01:14:55.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:54 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' 2024-09-05T01:14:55.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:54 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' 2024-09-05T01:14:55.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:54 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:14:55.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:54 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:14:55.967 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:55 smithi012 ceph-mon[29942]: Found migration_current of "None". Setting to last migration. 2024-09-05T01:14:55.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:55 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-05T01:14:55.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:55 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-05T01:14:55.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:55 smithi012 ceph-mon[29942]: mgrmap e7: x(active, since 1.00735s) 2024-09-05T01:14:56.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-05T01:14:56.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-05T01:14:56.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-05T01:14:56.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-05T01:14:56.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.199+0000 7f0ca1200640 1 Processor -- start 2024-09-05T01:14:56.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.199+0000 7f0ca1200640 1 -- start start 2024-09-05T01:14:56.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.200+0000 7f0ca1200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c9c107530 0x7f0c9c107930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:56.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.200+0000 7f0ca1200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c107f00 con 0x7f0c9c107530 2024-09-05T01:14:56.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.200+0000 7f0c9b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c9c107530 0x7f0c9c107930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:56.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.200+0000 7f0c9b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c9c107530 0x7f0c9c107930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33014/0 (socket says 172.21.15.12:33014) 2024-09-05T01:14:56.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.200+0000 7f0c9b400640 1 -- 172.21.15.12:0/1971036102 learned_addr learned my addr 172.21.15.12:0/1971036102 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:56.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.201+0000 7f0c9b400640 1 -- 172.21.15.12:0/1971036102 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9c108730 con 0x7f0c9c107530 2024-09-05T01:14:56.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.202+0000 7f0c9b400640 1 --2- 172.21.15.12:0/1971036102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c9c107530 0x7f0c9c107930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009820 tx=0x7f0c8c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94422f6839669154 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:56.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.202+0000 7f0c9aa00640 1 -- 172.21.15.12:0/1971036102 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c8c037070 con 0x7f0c9c107530 2024-09-05T01:14:56.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.202+0000 7f0c9aa00640 1 -- 172.21.15.12:0/1971036102 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0c8c032900 con 0x7f0c9c107530 2024-09-05T01:14:56.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.202+0000 7f0c9aa00640 1 -- 172.21.15.12:0/1971036102 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c8c030850 con 0x7f0c9c107530 2024-09-05T01:14:56.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.203+0000 7f0ca1200640 1 -- 172.21.15.12:0/1971036102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c9c107530 msgr2=0x7f0c9c107930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:56.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.203+0000 7f0ca1200640 1 --2- 172.21.15.12:0/1971036102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c9c107530 0x7f0c9c107930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009820 tx=0x7f0c8c02a270 comp rx=0 tx=0).stop 2024-09-05T01:14:56.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.203+0000 7f0ca1200640 1 -- 172.21.15.12:0/1971036102 shutdown_connections 2024-09-05T01:14:56.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.203+0000 7f0ca1200640 1 --2- 172.21.15.12:0/1971036102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c9c107530 0x7f0c9c107930 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:56.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.203+0000 7f0ca1200640 1 -- 172.21.15.12:0/1971036102 >> 172.21.15.12:0/1971036102 conn(0x7f0c9c102ce0 msgr2=0x7f0c9c105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:56.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.203+0000 7f0ca1200640 1 -- 172.21.15.12:0/1971036102 shutdown_connections 2024-09-05T01:14:56.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.203+0000 7f0ca1200640 1 -- 172.21.15.12:0/1971036102 wait complete. 2024-09-05T01:14:56.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.204+0000 7f0ca1200640 1 Processor -- start 2024-09-05T01:14:56.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.204+0000 7f0ca1200640 1 -- start start 2024-09-05T01:14:56.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.204+0000 7f0ca1200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c9c107530 0x7f0c9c07db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:56.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.204+0000 7f0ca1200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c10bae0 con 0x7f0c9c107530 2024-09-05T01:14:56.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.204+0000 7f0c9b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c9c107530 0x7f0c9c07db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:56.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.205+0000 7f0c9b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c9c107530 0x7f0c9c07db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33028/0 (socket says 172.21.15.12:33028) 2024-09-05T01:14:56.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.205+0000 7f0c9b400640 1 -- 172.21.15.12:0/807712515 learned_addr learned my addr 172.21.15.12:0/807712515 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:56.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.205+0000 7f0c9b400640 1 -- 172.21.15.12:0/807712515 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9c07e090 con 0x7f0c9c107530 2024-09-05T01:14:56.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.205+0000 7f0c9b400640 1 --2- 172.21.15.12:0/807712515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c9c107530 0x7f0c9c07db50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0097f0 tx=0x7f0c8c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:56.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.205+0000 7f0c98c00640 1 -- 172.21.15.12:0/807712515 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c8c037040 con 0x7f0c9c107530 2024-09-05T01:14:56.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.205+0000 7f0c98c00640 1 -- 172.21.15.12:0/807712515 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0c8c040070 con 0x7f0c9c107530 2024-09-05T01:14:56.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.206+0000 7f0ca1200640 1 -- 172.21.15.12:0/807712515 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c9c07c280 con 0x7f0c9c107530 2024-09-05T01:14:56.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.206+0000 7f0c98c00640 1 -- 172.21.15.12:0/807712515 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c8c03a390 con 0x7f0c9c107530 2024-09-05T01:14:56.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.206+0000 7f0ca1200640 1 -- 172.21.15.12:0/807712515 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c9c07c760 con 0x7f0c9c107530 2024-09-05T01:14:56.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.207+0000 7f0c98c00640 1 -- 172.21.15.12:0/807712515 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f0c8c032900 con 0x7f0c9c107530 2024-09-05T01:14:56.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.207+0000 7f0c98c00640 1 --2- 172.21.15.12:0/807712515 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f0c80038fc0 0x7f0c8003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:56.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.207+0000 7f0c98c00640 1 -- 172.21.15.12:0/807712515 --> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0c8003bb90 con 0x7f0c80038fc0 2024-09-05T01:14:56.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.207+0000 7f0c98c00640 1 -- 172.21.15.12:0/807712515 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0c8c06c0f0 con 0x7f0c9c107530 2024-09-05T01:14:56.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.207+0000 7f0c93e00640 1 -- 172.21.15.12:0/807712515 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f0c80038fc0 msgr2=0x7f0c8003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/3541208629 2024-09-05T01:14:56.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.207+0000 7f0c93e00640 1 --2- 172.21.15.12:0/807712515 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f0c80038fc0 0x7f0c8003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T01:14:56.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.408+0000 7f0c93e00640 1 -- 172.21.15.12:0/807712515 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f0c80038fc0 msgr2=0x7f0c8003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/3541208629 2024-09-05T01:14:56.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.408+0000 7f0c93e00640 1 --2- 172.21.15.12:0/807712515 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f0c80038fc0 0x7f0c8003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-05T01:14:56.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.809+0000 7f0c93e00640 1 -- 172.21.15.12:0/807712515 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f0c80038fc0 msgr2=0x7f0c8003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/3541208629 2024-09-05T01:14:56.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:51.809+0000 7f0c93e00640 1 --2- 172.21.15.12:0/807712515 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f0c80038fc0 0x7f0c8003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-05T01:14:56.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:52.610+0000 7f0c93e00640 1 -- 172.21.15.12:0/807712515 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f0c80038fc0 msgr2=0x7f0c8003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/3541208629 2024-09-05T01:14:56.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:52.610+0000 7f0c93e00640 1 --2- 172.21.15.12:0/807712515 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f0c80038fc0 0x7f0c8003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-05T01:14:56.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:54.211+0000 7f0c93e00640 1 -- 172.21.15.12:0/807712515 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f0c80038fc0 msgr2=0x7f0c8003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/3541208629 2024-09-05T01:14:56.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:54.211+0000 7f0c93e00640 1 --2- 172.21.15.12:0/807712515 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f0c80038fc0 0x7f0c8003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-05T01:14:56.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:54.626+0000 7f0c98c00640 1 -- 172.21.15.12:0/807712515 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f0c8c040ce0 con 0x7f0c9c107530 2024-09-05T01:14:56.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:54.627+0000 7f0c98c00640 1 -- 172.21.15.12:0/807712515 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f0c80038fc0 msgr2=0x7f0c8003b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T01:14:56.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:54.627+0000 7f0c98c00640 1 --2- 172.21.15.12:0/807712515 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f0c80038fc0 0x7f0c8003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:56.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:55.629+0000 7f0c98c00640 1 -- 172.21.15.12:0/807712515 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f0c8c044ca0 con 0x7f0c9c107530 2024-09-05T01:14:56.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:55.629+0000 7f0c98c00640 1 --2- 172.21.15.12:0/807712515 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f0c8003c8f0 0x7f0c8003ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:56.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:55.629+0000 7f0c98c00640 1 -- 172.21.15.12:0/807712515 --> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0c8c047e70 con 0x7f0c8003c8f0 2024-09-05T01:14:56.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:55.630+0000 7f0c93e00640 1 --2- 172.21.15.12:0/807712515 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f0c8003c8f0 0x7f0c8003ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:56.286 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:55.632+0000 7f0c93e00640 1 --2- 172.21.15.12:0/807712515 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f0c8003c8f0 0x7f0c8003ece0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0c84003980 tx=0x7f0c840092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:56.287 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:55.633+0000 7f0c98c00640 1 -- 172.21.15.12:0/807712515 <== mgr.14118 v2:172.21.15.12:6800/4067110310 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f0c8c047e70 con 0x7f0c8003c8f0 2024-09-05T01:14:56.287 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:55.640+0000 7f0ca1200640 1 -- 172.21.15.12:0/807712515 --> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f0c9c10bc60 con 0x7f0c8003c8f0 2024-09-05T01:14:56.287 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:55.641+0000 7f0c98c00640 1 -- 172.21.15.12:0/807712515 <== mgr.14118 v2:172.21.15.12:6800/4067110310 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f0c9c10bc60 con 0x7f0c8003c8f0 2024-09-05T01:14:56.287 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:55.641+0000 7f0ca1200640 1 -- 172.21.15.12:0/807712515 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f0c8003c8f0 msgr2=0x7f0c8003ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:56.287 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:55.641+0000 7f0ca1200640 1 --2- 172.21.15.12:0/807712515 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f0c8003c8f0 0x7f0c8003ece0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0c84003980 tx=0x7f0c840092b0 comp rx=0 tx=0).stop 2024-09-05T01:14:56.287 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:55.641+0000 7f0ca1200640 1 -- 172.21.15.12:0/807712515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c9c107530 msgr2=0x7f0c9c07db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:56.287 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:55.641+0000 7f0ca1200640 1 --2- 172.21.15.12:0/807712515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c9c107530 0x7f0c9c07db50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0097f0 tx=0x7f0c8c030d80 comp rx=0 tx=0).stop 2024-09-05T01:14:56.287 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:55.641+0000 7f0ca1200640 1 -- 172.21.15.12:0/807712515 shutdown_connections 2024-09-05T01:14:56.287 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:55.641+0000 7f0ca1200640 1 --2- 172.21.15.12:0/807712515 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f0c8003c8f0 0x7f0c8003ece0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:56.287 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:55.641+0000 7f0ca1200640 1 --2- 172.21.15.12:0/807712515 >> [v2:172.21.15.12:6800/3541208629,v1:172.21.15.12:6801/3541208629] conn(0x7f0c80038fc0 0x7f0c8003b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:56.287 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:55.641+0000 7f0ca1200640 1 --2- 172.21.15.12:0/807712515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c9c107530 0x7f0c9c07db50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:56.287 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:55.641+0000 7f0ca1200640 1 -- 172.21.15.12:0/807712515 >> 172.21.15.12:0/807712515 conn(0x7f0c9c102ce0 msgr2=0x7f0c9c103870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:56.287 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:55.642+0000 7f0ca1200640 1 -- 172.21.15.12:0/807712515 shutdown_connections 2024-09-05T01:14:56.288 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:55.642+0000 7f0ca1200640 1 -- 172.21.15.12:0/807712515 wait complete. 2024-09-05T01:14:56.288 INFO:teuthology.orchestra.run.smithi012.stdout:mgr epoch 5 is available 2024-09-05T01:14:56.288 INFO:teuthology.orchestra.run.smithi012.stdout:Setting orchestrator backend to cephadm... 2024-09-05T01:14:57.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-mon[29942]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-05T01:14:57.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-mon[29942]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-05T01:14:57.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' 2024-09-05T01:14:57.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' 2024-09-05T01:14:57.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' 2024-09-05T01:14:57.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:14:57.630 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.756+0000 7fb213200640 1 Processor -- start 2024-09-05T01:14:57.631 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.756+0000 7fb213200640 1 -- start start 2024-09-05T01:14:57.631 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.756+0000 7fb213200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb21407dec0 0x7fb21407c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:57.631 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.756+0000 7fb213200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb21407c8f0 con 0x7fb21407dec0 2024-09-05T01:14:57.631 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.756+0000 7fb211e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb21407dec0 0x7fb21407c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:57.631 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.756+0000 7fb211e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb21407dec0 0x7fb21407c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33094/0 (socket says 172.21.15.12:33094) 2024-09-05T01:14:57.631 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.757+0000 7fb211e00640 1 -- 172.21.15.12:0/1937965703 learned_addr learned my addr 172.21.15.12:0/1937965703 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:57.631 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.757+0000 7fb211e00640 1 -- 172.21.15.12:0/1937965703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21407ca70 con 0x7fb21407dec0 2024-09-05T01:14:57.631 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.758+0000 7fb211e00640 1 --2- 172.21.15.12:0/1937965703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb21407dec0 0x7fb21407c320 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb204009820 tx=0x7fb20402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d36ade2eccbd96c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:57.631 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.758+0000 7fb210a00640 1 -- 172.21.15.12:0/1937965703 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb204037070 con 0x7fb21407dec0 2024-09-05T01:14:57.631 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.758+0000 7fb210a00640 1 -- 172.21.15.12:0/1937965703 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb204032900 con 0x7fb21407dec0 2024-09-05T01:14:57.632 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.758+0000 7fb210a00640 1 -- 172.21.15.12:0/1937965703 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb204030850 con 0x7fb21407dec0 2024-09-05T01:14:57.632 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.759+0000 7fb213200640 1 -- 172.21.15.12:0/1937965703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb21407dec0 msgr2=0x7fb21407c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:57.632 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.759+0000 7fb213200640 1 --2- 172.21.15.12:0/1937965703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb21407dec0 0x7fb21407c320 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb204009820 tx=0x7fb20402a270 comp rx=0 tx=0).stop 2024-09-05T01:14:57.632 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.759+0000 7fb213200640 1 -- 172.21.15.12:0/1937965703 shutdown_connections 2024-09-05T01:14:57.632 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.759+0000 7fb213200640 1 --2- 172.21.15.12:0/1937965703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb21407dec0 0x7fb21407c320 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:57.632 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.759+0000 7fb213200640 1 -- 172.21.15.12:0/1937965703 >> 172.21.15.12:0/1937965703 conn(0x7fb214102ce0 msgr2=0x7fb214105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:57.632 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.759+0000 7fb213200640 1 -- 172.21.15.12:0/1937965703 shutdown_connections 2024-09-05T01:14:57.632 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.759+0000 7fb213200640 1 -- 172.21.15.12:0/1937965703 wait complete. 2024-09-05T01:14:57.632 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.760+0000 7fb213200640 1 Processor -- start 2024-09-05T01:14:57.632 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.760+0000 7fb213200640 1 -- start start 2024-09-05T01:14:57.632 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.760+0000 7fb213200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb21407dec0 0x7fb21419d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:57.633 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.760+0000 7fb213200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb21410db60 con 0x7fb21407dec0 2024-09-05T01:14:57.633 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.761+0000 7fb211e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb21407dec0 0x7fb21419d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:57.633 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.761+0000 7fb211e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb21407dec0 0x7fb21419d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33100/0 (socket says 172.21.15.12:33100) 2024-09-05T01:14:57.633 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.761+0000 7fb211e00640 1 -- 172.21.15.12:0/180730601 learned_addr learned my addr 172.21.15.12:0/180730601 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:57.633 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.761+0000 7fb211e00640 1 -- 172.21.15.12:0/180730601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21419dc90 con 0x7fb21407dec0 2024-09-05T01:14:57.633 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.761+0000 7fb211e00640 1 --2- 172.21.15.12:0/180730601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb21407dec0 0x7fb21419d750 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb204009940 tx=0x7fb204032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:57.633 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.762+0000 7fb20aa00640 1 -- 172.21.15.12:0/180730601 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb204042070 con 0x7fb21407dec0 2024-09-05T01:14:57.633 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.762+0000 7fb20aa00640 1 -- 172.21.15.12:0/180730601 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb2040308c0 con 0x7fb21407dec0 2024-09-05T01:14:57.633 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.762+0000 7fb213200640 1 -- 172.21.15.12:0/180730601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb21419df20 con 0x7fb21407dec0 2024-09-05T01:14:57.633 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.762+0000 7fb20aa00640 1 -- 172.21.15.12:0/180730601 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb204037040 con 0x7fb21407dec0 2024-09-05T01:14:57.633 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.762+0000 7fb213200640 1 -- 172.21.15.12:0/180730601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2141a0c10 con 0x7fb21407dec0 2024-09-05T01:14:57.633 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.763+0000 7fb20aa00640 1 -- 172.21.15.12:0/180730601 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7fb204045070 con 0x7fb21407dec0 2024-09-05T01:14:57.634 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.763+0000 7fb213200640 1 -- 172.21.15.12:0/180730601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb21407c3a0 con 0x7fb21407dec0 2024-09-05T01:14:57.634 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.763+0000 7fb20aa00640 1 --2- 172.21.15.12:0/180730601 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fb1f8038eb0 0x7fb1f803b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:57.634 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.764+0000 7fb20aa00640 1 -- 172.21.15.12:0/180730601 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb20406c010 con 0x7fb21407dec0 2024-09-05T01:14:57.634 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.764+0000 7fb211400640 1 --2- 172.21.15.12:0/180730601 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fb1f8038eb0 0x7fb1f803b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:57.634 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.765+0000 7fb211400640 1 --2- 172.21.15.12:0/180730601 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fb1f8038eb0 0x7fb1f803b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb2000098c0 tx=0x7fb200006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:57.634 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.769+0000 7fb20aa00640 1 -- 172.21.15.12:0/180730601 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb20403be10 con 0x7fb21407dec0 2024-09-05T01:14:57.634 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.977+0000 7fb213200640 1 -- 172.21.15.12:0/180730601 --> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fb214103f80 con 0x7fb1f8038eb0 2024-09-05T01:14:57.634 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.985+0000 7fb20aa00640 1 -- 172.21.15.12:0/180730601 <== mgr.14118 v2:172.21.15.12:6800/4067110310 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb214103f80 con 0x7fb1f8038eb0 2024-09-05T01:14:57.634 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.988+0000 7fb213200640 1 -- 172.21.15.12:0/180730601 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fb1f8038eb0 msgr2=0x7fb1f803b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:57.634 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.988+0000 7fb213200640 1 --2- 172.21.15.12:0/180730601 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fb1f8038eb0 0x7fb1f803b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb2000098c0 tx=0x7fb200006db0 comp rx=0 tx=0).stop 2024-09-05T01:14:57.634 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.988+0000 7fb213200640 1 -- 172.21.15.12:0/180730601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb21407dec0 msgr2=0x7fb21419d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:57.635 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.988+0000 7fb213200640 1 --2- 172.21.15.12:0/180730601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb21407dec0 0x7fb21419d750 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb204009940 tx=0x7fb204032ce0 comp rx=0 tx=0).stop 2024-09-05T01:14:57.635 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.988+0000 7fb213200640 1 -- 172.21.15.12:0/180730601 shutdown_connections 2024-09-05T01:14:57.635 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.988+0000 7fb213200640 1 --2- 172.21.15.12:0/180730601 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fb1f8038eb0 0x7fb1f803b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:57.635 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.988+0000 7fb213200640 1 --2- 172.21.15.12:0/180730601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb21407dec0 0x7fb21419d750 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:57.635 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.988+0000 7fb213200640 1 -- 172.21.15.12:0/180730601 >> 172.21.15.12:0/180730601 conn(0x7fb214102ce0 msgr2=0x7fb214103870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:57.635 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.988+0000 7fb213200640 1 -- 172.21.15.12:0/180730601 shutdown_connections 2024-09-05T01:14:57.635 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:56.988+0000 7fb213200640 1 -- 172.21.15.12:0/180730601 wait complete. 2024-09-05T01:14:57.902 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:57.694+0000 7f88cc600640 -1 log_channel(cephadm) log [ERR] : [05/Sep/2024:01:14:57] ENGINE Error in HTTPServer.serve 2024-09-05T01:14:57.902 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: Traceback (most recent call last): 2024-09-05T01:14:57.903 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-05T01:14:57.903 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: self._connections.run(self.expiration_interval) 2024-09-05T01:14:57.903 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-05T01:14:57.903 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: self._run(expiration_interval) 2024-09-05T01:14:57.903 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-05T01:14:57.903 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: new_conn = self._from_server_socket(self.server.socket) 2024-09-05T01:14:57.903 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-05T01:14:57.903 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-05T01:14:57.903 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-05T01:14:57.903 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: s = self.context.wrap_socket( 2024-09-05T01:14:57.903 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-05T01:14:57.903 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: return self.sslsocket_class._create( 2024-09-05T01:14:57.903 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-05T01:14:57.903 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: self.do_handshake() 2024-09-05T01:14:57.904 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-05T01:14:57.904 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: self._sslobj.do_handshake() 2024-09-05T01:14:57.904 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-05T01:14:57.904 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:14:58.713 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:58 smithi012 ceph-mon[29942]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:14:58.714 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:58 smithi012 ceph-mon[29942]: [05/Sep/2024:01:14:57] ENGINE Bus STARTING 2024-09-05T01:14:58.714 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:58 smithi012 ceph-mon[29942]: mgrmap e8: x(active, since 2s) 2024-09-05T01:14:58.714 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:58 smithi012 ceph-mon[29942]: [05/Sep/2024:01:14:57] ENGINE Serving on http://172.21.15.12:8765 2024-09-05T01:14:58.714 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:58 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:14:58.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-05T01:14:58.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.112+0000 7f924b000640 1 Processor -- start 2024-09-05T01:14:58.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.112+0000 7f924b000640 1 -- start start 2024-09-05T01:14:58.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.113+0000 7f924b000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f924407de80 0x7f924407c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:58.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.113+0000 7f924b000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f924407c8b0 con 0x7f924407de80 2024-09-05T01:14:58.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.113+0000 7f9243e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f924407de80 0x7f924407c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:58.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.113+0000 7f9243e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f924407de80 0x7f924407c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59814/0 (socket says 172.21.15.12:59814) 2024-09-05T01:14:58.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.113+0000 7f9243e00640 1 -- 172.21.15.12:0/2922207826 learned_addr learned my addr 172.21.15.12:0/2922207826 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:58.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.113+0000 7f9243e00640 1 -- 172.21.15.12:0/2922207826 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f924407ca30 con 0x7f924407de80 2024-09-05T01:14:58.994 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.114+0000 7f9243e00640 1 --2- 172.21.15.12:0/2922207826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f924407de80 0x7f924407c2e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9234009820 tx=0x7f923402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dacaa3297014d769 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:58.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.115+0000 7f9243400640 1 -- 172.21.15.12:0/2922207826 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9234037070 con 0x7f924407de80 2024-09-05T01:14:58.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.115+0000 7f9243400640 1 -- 172.21.15.12:0/2922207826 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9234032900 con 0x7f924407de80 2024-09-05T01:14:58.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.115+0000 7f9243400640 1 -- 172.21.15.12:0/2922207826 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9234030850 con 0x7f924407de80 2024-09-05T01:14:58.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.115+0000 7f924b000640 1 -- 172.21.15.12:0/2922207826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f924407de80 msgr2=0x7f924407c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:58.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.115+0000 7f924b000640 1 --2- 172.21.15.12:0/2922207826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f924407de80 0x7f924407c2e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9234009820 tx=0x7f923402a270 comp rx=0 tx=0).stop 2024-09-05T01:14:58.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.115+0000 7f924b000640 1 -- 172.21.15.12:0/2922207826 shutdown_connections 2024-09-05T01:14:58.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.115+0000 7f924b000640 1 --2- 172.21.15.12:0/2922207826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f924407de80 0x7f924407c2e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:58.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.115+0000 7f924b000640 1 -- 172.21.15.12:0/2922207826 >> 172.21.15.12:0/2922207826 conn(0x7f9244102e80 msgr2=0x7f92441052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:58.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.115+0000 7f924b000640 1 -- 172.21.15.12:0/2922207826 shutdown_connections 2024-09-05T01:14:58.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.116+0000 7f924b000640 1 -- 172.21.15.12:0/2922207826 wait complete. 2024-09-05T01:14:58.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.116+0000 7f924b000640 1 Processor -- start 2024-09-05T01:14:58.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.117+0000 7f924b000640 1 -- start start 2024-09-05T01:14:58.995 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.117+0000 7f924b000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f924407de80 0x7f924419d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:58.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.117+0000 7f924b000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f924410dd60 con 0x7f924407de80 2024-09-05T01:14:58.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.117+0000 7f9243e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f924407de80 0x7f924419d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:58.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.117+0000 7f9243e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f924407de80 0x7f924419d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59816/0 (socket says 172.21.15.12:59816) 2024-09-05T01:14:58.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.117+0000 7f9243e00640 1 -- 172.21.15.12:0/1805464715 learned_addr learned my addr 172.21.15.12:0/1805464715 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:14:58.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.117+0000 7f9243e00640 1 -- 172.21.15.12:0/1805464715 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f924419deb0 con 0x7f924407de80 2024-09-05T01:14:58.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.118+0000 7f9243e00640 1 --2- 172.21.15.12:0/1805464715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f924407de80 0x7f924419d970 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f92340097f0 tx=0x7f9234030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:58.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.118+0000 7f9241600640 1 -- 172.21.15.12:0/1805464715 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9234037040 con 0x7f924407de80 2024-09-05T01:14:58.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.118+0000 7f9241600640 1 -- 172.21.15.12:0/1805464715 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9234040070 con 0x7f924407de80 2024-09-05T01:14:58.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.118+0000 7f9241600640 1 -- 172.21.15.12:0/1805464715 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f923403a390 con 0x7f924407de80 2024-09-05T01:14:58.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.118+0000 7f924b000640 1 -- 172.21.15.12:0/1805464715 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f924419e140 con 0x7f924407de80 2024-09-05T01:14:58.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.118+0000 7f924b000640 1 -- 172.21.15.12:0/1805464715 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92441a0e30 con 0x7f924407de80 2024-09-05T01:14:58.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.119+0000 7f9241600640 1 -- 172.21.15.12:0/1805464715 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f923403b430 con 0x7f924407de80 2024-09-05T01:14:58.996 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.119+0000 7f924b000640 1 -- 172.21.15.12:0/1805464715 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f924407c360 con 0x7f924407de80 2024-09-05T01:14:58.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.119+0000 7f9241600640 1 --2- 172.21.15.12:0/1805464715 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f9228038fc0 0x7f922803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:14:58.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.120+0000 7f9241600640 1 -- 172.21.15.12:0/1805464715 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f923406c4c0 con 0x7f924407de80 2024-09-05T01:14:58.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.120+0000 7f923be00640 1 --2- 172.21.15.12:0/1805464715 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f9228038fc0 0x7f922803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:14:58.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.120+0000 7f923be00640 1 --2- 172.21.15.12:0/1805464715 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f9228038fc0 0x7f922803b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f922c0098c0 tx=0x7f922c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:14:58.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.125+0000 7f9241600640 1 -- 172.21.15.12:0/1805464715 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f92340371e0 con 0x7f924407de80 2024-09-05T01:14:58.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.316+0000 7f924b000640 1 -- 172.21.15.12:0/1805464715 --> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f9244104170 con 0x7f9228038fc0 2024-09-05T01:14:58.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.316+0000 7f9241600640 1 -- 172.21.15.12:0/1805464715 <== mgr.14118 v2:172.21.15.12:6800/4067110310 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f9244104170 con 0x7f9228038fc0 2024-09-05T01:14:58.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.319+0000 7f924b000640 1 -- 172.21.15.12:0/1805464715 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f9228038fc0 msgr2=0x7f922803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:58.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.319+0000 7f924b000640 1 --2- 172.21.15.12:0/1805464715 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f9228038fc0 0x7f922803b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f922c0098c0 tx=0x7f922c006db0 comp rx=0 tx=0).stop 2024-09-05T01:14:58.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.319+0000 7f924b000640 1 -- 172.21.15.12:0/1805464715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f924407de80 msgr2=0x7f924419d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:14:58.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.319+0000 7f924b000640 1 --2- 172.21.15.12:0/1805464715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f924407de80 0x7f924419d970 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f92340097f0 tx=0x7f9234030d80 comp rx=0 tx=0).stop 2024-09-05T01:14:58.998 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.319+0000 7f924b000640 1 -- 172.21.15.12:0/1805464715 shutdown_connections 2024-09-05T01:14:58.998 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.319+0000 7f924b000640 1 --2- 172.21.15.12:0/1805464715 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f9228038fc0 0x7f922803b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:58.998 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.319+0000 7f924b000640 1 --2- 172.21.15.12:0/1805464715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f924407de80 0x7f924419d970 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:14:58.998 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.319+0000 7f924b000640 1 -- 172.21.15.12:0/1805464715 >> 172.21.15.12:0/1805464715 conn(0x7f9244102e80 msgr2=0x7f9244103a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:14:58.998 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.319+0000 7f924b000640 1 -- 172.21.15.12:0/1805464715 shutdown_connections 2024-09-05T01:14:58.998 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:58.319+0000 7f924b000640 1 -- 172.21.15.12:0/1805464715 wait complete. 2024-09-05T01:14:58.998 INFO:teuthology.orchestra.run.smithi012.stdout:Generating ssh key... 2024-09-05T01:14:59.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:59 smithi012 ceph-mon[29942]: [05/Sep/2024:01:14:57] ENGINE Serving on https://172.21.15.12:7150 2024-09-05T01:14:59.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:59 smithi012 ceph-mon[29942]: [05/Sep/2024:01:14:57] ENGINE Bus STARTED 2024-09-05T01:14:59.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:59 smithi012 ceph-mon[29942]: [05/Sep/2024:01:14:57] ENGINE Error in HTTPServer.serve 2024-09-05T01:14:59.812 INFO:journalctl@ceph.mon.a.smithi012.stdout: Traceback (most recent call last): 2024-09-05T01:14:59.812 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-05T01:14:59.812 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._connections.run(self.expiration_interval) 2024-09-05T01:14:59.812 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-05T01:14:59.812 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._run(expiration_interval) 2024-09-05T01:14:59.812 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-05T01:14:59.812 INFO:journalctl@ceph.mon.a.smithi012.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-05T01:14:59.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-05T01:14:59.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-05T01:14:59.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-05T01:14:59.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: s = self.context.wrap_socket( 2024-09-05T01:14:59.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-05T01:14:59.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: return self.sslsocket_class._create( 2024-09-05T01:14:59.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-05T01:14:59.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: self.do_handshake() 2024-09-05T01:14:59.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-05T01:14:59.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._sslobj.do_handshake() 2024-09-05T01:14:59.813 INFO:journalctl@ceph.mon.a.smithi012.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-05T01:14:59.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:14:59 smithi012 ceph-mon[29942]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:15:00.173 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:59 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: Generating public/private rsa key pair. 2024-09-05T01:15:00.173 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:59 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: Your identification has been saved in /tmp/tmpo1wqppa7/key 2024-09-05T01:15:00.173 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:59 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: Your public key has been saved in /tmp/tmpo1wqppa7/key.pub 2024-09-05T01:15:00.173 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:59 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: The key fingerprint is: 2024-09-05T01:15:00.173 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:59 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: SHA256:lPLHdJXIHUHow4QxZQ0JlKLuru0g0PrTHbtWou8bkAE ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:15:00.173 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:59 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: The key's randomart image is: 2024-09-05T01:15:00.173 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:59 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: +---[RSA 3072]----+ 2024-09-05T01:15:00.173 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:59 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: | E .=B+O=+ | 2024-09-05T01:15:00.173 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:59 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: | . ..oo*.+ | 2024-09-05T01:15:00.174 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:59 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: | . ..o..+. | 2024-09-05T01:15:00.174 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:59 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: | . o.+ o .+ | 2024-09-05T01:15:00.174 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:59 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: |. . o. S o . | 2024-09-05T01:15:00.174 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:59 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: | o .+ .. | 2024-09-05T01:15:00.174 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:59 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: |. ...+.= | 2024-09-05T01:15:00.174 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:59 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: | ...oo=. | 2024-09-05T01:15:00.174 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:59 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: | ...BOo | 2024-09-05T01:15:00.174 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:14:59 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: +----[SHA256]-----+ 2024-09-05T01:15:00.455 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.468+0000 7f0edca00640 1 Processor -- start 2024-09-05T01:15:00.455 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.468+0000 7f0edca00640 1 -- start start 2024-09-05T01:15:00.455 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.469+0000 7f0edca00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ed81076f0 0x7f0ed8107af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:00.455 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.469+0000 7f0edca00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed81080c0 con 0x7f0ed81076f0 2024-09-05T01:15:00.456 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.469+0000 7f0ed5e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ed81076f0 0x7f0ed8107af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:00.456 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.469+0000 7f0ed5e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ed81076f0 0x7f0ed8107af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59828/0 (socket says 172.21.15.12:59828) 2024-09-05T01:15:00.456 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.469+0000 7f0ed5e00640 1 -- 172.21.15.12:0/3249963151 learned_addr learned my addr 172.21.15.12:0/3249963151 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:00.456 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.469+0000 7f0ed5e00640 1 -- 172.21.15.12:0/3249963151 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed81088f0 con 0x7f0ed81076f0 2024-09-05T01:15:00.456 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.470+0000 7f0ed5e00640 1 --2- 172.21.15.12:0/3249963151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ed81076f0 0x7f0ed8107af0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009e80 tx=0x7f0ec802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32573d0bb1753ec2 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:00.456 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.471+0000 7f0ed5400640 1 -- 172.21.15.12:0/3249963151 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ec8036070 con 0x7f0ed81076f0 2024-09-05T01:15:00.457 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.471+0000 7f0ed5400640 1 -- 172.21.15.12:0/3249963151 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0ec80318c0 con 0x7f0ed81076f0 2024-09-05T01:15:00.457 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.471+0000 7f0ed5400640 1 -- 172.21.15.12:0/3249963151 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ec8007ab0 con 0x7f0ed81076f0 2024-09-05T01:15:00.457 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.471+0000 7f0edca00640 1 -- 172.21.15.12:0/3249963151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ed81076f0 msgr2=0x7f0ed8107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:00.457 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.471+0000 7f0edca00640 1 --2- 172.21.15.12:0/3249963151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ed81076f0 0x7f0ed8107af0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009e80 tx=0x7f0ec802a7a0 comp rx=0 tx=0).stop 2024-09-05T01:15:00.457 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.471+0000 7f0edca00640 1 -- 172.21.15.12:0/3249963151 shutdown_connections 2024-09-05T01:15:00.458 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.471+0000 7f0edca00640 1 --2- 172.21.15.12:0/3249963151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ed81076f0 0x7f0ed8107af0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:00.458 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.471+0000 7f0edca00640 1 -- 172.21.15.12:0/3249963151 >> 172.21.15.12:0/3249963151 conn(0x7f0ed8102e80 msgr2=0x7f0ed81052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:00.458 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.471+0000 7f0edca00640 1 -- 172.21.15.12:0/3249963151 shutdown_connections 2024-09-05T01:15:00.458 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.471+0000 7f0edca00640 1 -- 172.21.15.12:0/3249963151 wait complete. 2024-09-05T01:15:00.458 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.472+0000 7f0edca00640 1 Processor -- start 2024-09-05T01:15:00.458 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.472+0000 7f0edca00640 1 -- start start 2024-09-05T01:15:00.459 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.473+0000 7f0edca00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ed81076f0 0x7f0ed819b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:00.459 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.473+0000 7f0edca00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed810bca0 con 0x7f0ed81076f0 2024-09-05T01:15:00.459 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.473+0000 7f0ed5e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ed81076f0 0x7f0ed819b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:00.459 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.473+0000 7f0ed5e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ed81076f0 0x7f0ed819b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59842/0 (socket says 172.21.15.12:59842) 2024-09-05T01:15:00.459 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.473+0000 7f0ed5e00640 1 -- 172.21.15.12:0/3364085662 learned_addr learned my addr 172.21.15.12:0/3364085662 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:00.459 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.473+0000 7f0ed5e00640 1 -- 172.21.15.12:0/3364085662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed819bc80 con 0x7f0ed81076f0 2024-09-05T01:15:00.460 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.474+0000 7f0ed5e00640 1 --2- 172.21.15.12:0/3364085662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ed81076f0 0x7f0ed819b740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0ec802acc0 tx=0x7f0ec8031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:00.460 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.474+0000 7f0ecf400640 1 -- 172.21.15.12:0/3364085662 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ec8036050 con 0x7f0ed81076f0 2024-09-05T01:15:00.460 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.474+0000 7f0ecf400640 1 -- 172.21.15.12:0/3364085662 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0ec8037040 con 0x7f0ed81076f0 2024-09-05T01:15:00.460 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.474+0000 7f0ecf400640 1 -- 172.21.15.12:0/3364085662 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ec803d8c0 con 0x7f0ed81076f0 2024-09-05T01:15:00.460 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.474+0000 7f0edca00640 1 -- 172.21.15.12:0/3364085662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed819bf10 con 0x7f0ed81076f0 2024-09-05T01:15:00.460 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.474+0000 7f0edca00640 1 -- 172.21.15.12:0/3364085662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed819c330 con 0x7f0ed81076f0 2024-09-05T01:15:00.461 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.475+0000 7f0ecf400640 1 -- 172.21.15.12:0/3364085662 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f0ec8044020 con 0x7f0ed81076f0 2024-09-05T01:15:00.461 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.475+0000 7f0edca00640 1 -- 172.21.15.12:0/3364085662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ed8107b70 con 0x7f0ed81076f0 2024-09-05T01:15:00.461 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.476+0000 7f0ecf400640 1 --2- 172.21.15.12:0/3364085662 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f0ebc038fc0 0x7f0ebc03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:00.461 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.476+0000 7f0ecf400640 1 -- 172.21.15.12:0/3364085662 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0ec8042020 con 0x7f0ed81076f0 2024-09-05T01:15:00.461 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.476+0000 7f0ecd400640 1 --2- 172.21.15.12:0/3364085662 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f0ebc038fc0 0x7f0ebc03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:00.461 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.477+0000 7f0ecd400640 1 --2- 172.21.15.12:0/3364085662 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f0ebc038fc0 0x7f0ebc03b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0ec00098c0 tx=0x7f0ec0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:00.461 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.481+0000 7f0ecf400640 1 -- 172.21.15.12:0/3364085662 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0ec804b020 con 0x7f0ed81076f0 2024-09-05T01:15:00.462 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.668+0000 7f0edca00640 1 -- 172.21.15.12:0/3364085662 --> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f0ed8104130 con 0x7f0ebc038fc0 2024-09-05T01:15:00.462 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.854+0000 7f0ecf400640 1 -- 172.21.15.12:0/3364085662 <== mgr.14118 v2:172.21.15.12:6800/4067110310 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0ed8104130 con 0x7f0ebc038fc0 2024-09-05T01:15:00.462 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.856+0000 7f0edca00640 1 -- 172.21.15.12:0/3364085662 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f0ebc038fc0 msgr2=0x7f0ebc03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:00.462 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.856+0000 7f0edca00640 1 --2- 172.21.15.12:0/3364085662 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f0ebc038fc0 0x7f0ebc03b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0ec00098c0 tx=0x7f0ec0006db0 comp rx=0 tx=0).stop 2024-09-05T01:15:00.462 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.856+0000 7f0edca00640 1 -- 172.21.15.12:0/3364085662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ed81076f0 msgr2=0x7f0ed819b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:00.462 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.856+0000 7f0edca00640 1 --2- 172.21.15.12:0/3364085662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ed81076f0 0x7f0ed819b740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0ec802acc0 tx=0x7f0ec8031ca0 comp rx=0 tx=0).stop 2024-09-05T01:15:00.462 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.857+0000 7f0edca00640 1 -- 172.21.15.12:0/3364085662 shutdown_connections 2024-09-05T01:15:00.462 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.857+0000 7f0edca00640 1 --2- 172.21.15.12:0/3364085662 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f0ebc038fc0 0x7f0ebc03b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:00.462 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.857+0000 7f0edca00640 1 --2- 172.21.15.12:0/3364085662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ed81076f0 0x7f0ed819b740 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:00.462 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.857+0000 7f0edca00640 1 -- 172.21.15.12:0/3364085662 >> 172.21.15.12:0/3364085662 conn(0x7f0ed8102e80 msgr2=0x7f0ed8103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:00.463 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.857+0000 7f0edca00640 1 -- 172.21.15.12:0/3364085662 shutdown_connections 2024-09-05T01:15:00.463 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:14:59.857+0000 7f0edca00640 1 -- 172.21.15.12:0/3364085662 wait complete. 2024-09-05T01:15:01.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:00 smithi012 ceph-mon[29942]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:15:01.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:00 smithi012 ceph-mon[29942]: Generating ssh key... 2024-09-05T01:15:01.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:00 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' 2024-09-05T01:15:01.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:00 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' 2024-09-05T01:15:01.690 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwYkyFzjwwCOqIXEalLTJDYMBeKuefF9V+VAYEHYROrjJltUjs3H0l+Z8Uzda9jQwCM5oQfYq3uUvkwlFGwcCpA1zAMSH45U9vkC4XCr/TjTae6P6QWXwoBu4GxqeBMI+tQTmQhdDKi1wBujXnyWV4Fhano1fm4OSmslGnluPgOppanRYmNjleTJ/uFJPh0re5ftfMHP/RzGIgZNEUx3O87wUEH9ZTvJEPZ+2dwMm7qc2LinOqhgkxmJ2FF22lKU7++IPVQf4Ab/sXP7JRBrKjcvhLr/96Rq+POjdjqHAe1atjHFMUa6vZ7hDE0sIQYe9+UB2itElXxLYfqjZqO32VU5RJkpbmo77P/7+Qt10kIInAJ7Cb3ke5+D1lUJ85WQ+5RqvYyMXrwPca5YRKEDRwTpLmEnxmexn4QnISLDQTAvvKsJAONQmWHXdQwJbPxslWNOS8VbR8QF3NCKm4cGzXBRDa2Ss5Qm+2YHlRvJqMfzspb2OFhtgtMILedbjkV8M= ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:15:01.690 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.898+0000 7fe6ca800640 1 Processor -- start 2024-09-05T01:15:01.690 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.898+0000 7fe6ca800640 1 -- start start 2024-09-05T01:15:01.690 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.899+0000 7fe6ca800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6c41076f0 0x7fe6c4107af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:01.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.899+0000 7fe6ca800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c41080c0 con 0x7fe6c41076f0 2024-09-05T01:15:01.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.899+0000 7fe6c3400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6c41076f0 0x7fe6c4107af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:01.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.899+0000 7fe6c3400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6c41076f0 0x7fe6c4107af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59846/0 (socket says 172.21.15.12:59846) 2024-09-05T01:15:01.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.899+0000 7fe6c3400640 1 -- 172.21.15.12:0/2929579926 learned_addr learned my addr 172.21.15.12:0/2929579926 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:01.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.899+0000 7fe6c3400640 1 -- 172.21.15.12:0/2929579926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c41088f0 con 0x7fe6c41076f0 2024-09-05T01:15:01.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.900+0000 7fe6c3400640 1 --2- 172.21.15.12:0/2929579926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6c41076f0 0x7fe6c4107af0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4009820 tx=0x7fe6b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b73e0091323967b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:01.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.901+0000 7fe6c2a00640 1 -- 172.21.15.12:0/2929579926 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b4037070 con 0x7fe6c41076f0 2024-09-05T01:15:01.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.901+0000 7fe6c2a00640 1 -- 172.21.15.12:0/2929579926 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe6b4032900 con 0x7fe6c41076f0 2024-09-05T01:15:01.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.901+0000 7fe6c2a00640 1 -- 172.21.15.12:0/2929579926 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b4030850 con 0x7fe6c41076f0 2024-09-05T01:15:01.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.901+0000 7fe6ca800640 1 -- 172.21.15.12:0/2929579926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6c41076f0 msgr2=0x7fe6c4107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:01.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.901+0000 7fe6ca800640 1 --2- 172.21.15.12:0/2929579926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6c41076f0 0x7fe6c4107af0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4009820 tx=0x7fe6b402a270 comp rx=0 tx=0).stop 2024-09-05T01:15:01.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.902+0000 7fe6ca800640 1 -- 172.21.15.12:0/2929579926 shutdown_connections 2024-09-05T01:15:01.692 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.902+0000 7fe6ca800640 1 --2- 172.21.15.12:0/2929579926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6c41076f0 0x7fe6c4107af0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:01.692 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.902+0000 7fe6ca800640 1 -- 172.21.15.12:0/2929579926 >> 172.21.15.12:0/2929579926 conn(0x7fe6c4102e80 msgr2=0x7fe6c41052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:01.692 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.902+0000 7fe6ca800640 1 -- 172.21.15.12:0/2929579926 shutdown_connections 2024-09-05T01:15:01.692 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.902+0000 7fe6ca800640 1 -- 172.21.15.12:0/2929579926 wait complete. 2024-09-05T01:15:01.692 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.903+0000 7fe6ca800640 1 Processor -- start 2024-09-05T01:15:01.692 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.903+0000 7fe6ca800640 1 -- start start 2024-09-05T01:15:01.692 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.903+0000 7fe6ca800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6c41076f0 0x7fe6c419d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:01.692 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.903+0000 7fe6ca800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c410bca0 con 0x7fe6c41076f0 2024-09-05T01:15:01.692 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.903+0000 7fe6c3400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6c41076f0 0x7fe6c419d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:01.692 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.903+0000 7fe6c3400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6c41076f0 0x7fe6c419d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59862/0 (socket says 172.21.15.12:59862) 2024-09-05T01:15:01.692 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.903+0000 7fe6c3400640 1 -- 172.21.15.12:0/1175214230 learned_addr learned my addr 172.21.15.12:0/1175214230 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:01.692 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.904+0000 7fe6c3400640 1 -- 172.21.15.12:0/1175214230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c419deb0 con 0x7fe6c41076f0 2024-09-05T01:15:01.692 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.904+0000 7fe6c3400640 1 --2- 172.21.15.12:0/1175214230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6c41076f0 0x7fe6c419d970 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4009940 tx=0x7fe6b4032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:01.693 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.904+0000 7fe6c0c00640 1 -- 172.21.15.12:0/1175214230 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b4042070 con 0x7fe6c41076f0 2024-09-05T01:15:01.693 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.904+0000 7fe6c0c00640 1 -- 172.21.15.12:0/1175214230 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe6b40308c0 con 0x7fe6c41076f0 2024-09-05T01:15:01.693 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.904+0000 7fe6c0c00640 1 -- 172.21.15.12:0/1175214230 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b4037040 con 0x7fe6c41076f0 2024-09-05T01:15:01.693 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.904+0000 7fe6ca800640 1 -- 172.21.15.12:0/1175214230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6c419e140 con 0x7fe6c41076f0 2024-09-05T01:15:01.693 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.905+0000 7fe6ca800640 1 -- 172.21.15.12:0/1175214230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6c41a0e30 con 0x7fe6c41076f0 2024-09-05T01:15:01.693 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.905+0000 7fe6c0c00640 1 -- 172.21.15.12:0/1175214230 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fe6b4045070 con 0x7fe6c41076f0 2024-09-05T01:15:01.693 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.905+0000 7fe6ca800640 1 -- 172.21.15.12:0/1175214230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6c410be20 con 0x7fe6c41076f0 2024-09-05T01:15:01.693 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.906+0000 7fe6c0c00640 1 --2- 172.21.15.12:0/1175214230 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fe6a8038fc0 0x7fe6a803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:01.693 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.906+0000 7fe6c0c00640 1 -- 172.21.15.12:0/1175214230 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe6b406c030 con 0x7fe6c41076f0 2024-09-05T01:15:01.693 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.906+0000 7fe6baa00640 1 --2- 172.21.15.12:0/1175214230 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fe6a8038fc0 0x7fe6a803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:01.693 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.907+0000 7fe6baa00640 1 --2- 172.21.15.12:0/1175214230 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fe6a8038fc0 0x7fe6a803b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac0098c0 tx=0x7fe6ac006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:01.694 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:00.911+0000 7fe6c0c00640 1 -- 172.21.15.12:0/1175214230 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe6b404b170 con 0x7fe6c41076f0 2024-09-05T01:15:01.694 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:01.095+0000 7fe6ca800640 1 -- 172.21.15.12:0/1175214230 --> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fe6c41040f0 con 0x7fe6a8038fc0 2024-09-05T01:15:01.694 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:01.096+0000 7fe6c0c00640 1 -- 172.21.15.12:0/1175214230 <== mgr.14118 v2:172.21.15.12:6800/4067110310 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fe6c41040f0 con 0x7fe6a8038fc0 2024-09-05T01:15:01.694 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:01.099+0000 7fe6ca800640 1 -- 172.21.15.12:0/1175214230 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fe6a8038fc0 msgr2=0x7fe6a803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:01.694 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:01.099+0000 7fe6ca800640 1 --2- 172.21.15.12:0/1175214230 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fe6a8038fc0 0x7fe6a803b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac0098c0 tx=0x7fe6ac006db0 comp rx=0 tx=0).stop 2024-09-05T01:15:01.694 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:01.099+0000 7fe6ca800640 1 -- 172.21.15.12:0/1175214230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6c41076f0 msgr2=0x7fe6c419d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:01.694 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:01.099+0000 7fe6ca800640 1 --2- 172.21.15.12:0/1175214230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6c41076f0 0x7fe6c419d970 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4009940 tx=0x7fe6b4032ce0 comp rx=0 tx=0).stop 2024-09-05T01:15:01.694 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:01.099+0000 7fe6ca800640 1 -- 172.21.15.12:0/1175214230 shutdown_connections 2024-09-05T01:15:01.694 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:01.099+0000 7fe6ca800640 1 --2- 172.21.15.12:0/1175214230 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fe6a8038fc0 0x7fe6a803b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:01.694 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:01.099+0000 7fe6ca800640 1 --2- 172.21.15.12:0/1175214230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6c41076f0 0x7fe6c419d970 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:01.694 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:01.099+0000 7fe6ca800640 1 -- 172.21.15.12:0/1175214230 >> 172.21.15.12:0/1175214230 conn(0x7fe6c4102e80 msgr2=0x7fe6c41039e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:01.694 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:01.099+0000 7fe6ca800640 1 -- 172.21.15.12:0/1175214230 shutdown_connections 2024-09-05T01:15:01.694 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:01.099+0000 7fe6ca800640 1 -- 172.21.15.12:0/1175214230 wait complete. 2024-09-05T01:15:01.695 INFO:teuthology.orchestra.run.smithi012.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-05T01:15:01.695 INFO:teuthology.orchestra.run.smithi012.stdout:Adding key to root@localhost authorized_keys... 2024-09-05T01:15:01.695 INFO:teuthology.orchestra.run.smithi012.stdout:Adding host smithi012... 2024-09-05T01:15:02.081 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:01 smithi012 ceph-mon[29942]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:15:03.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:02 smithi012 ceph-mon[29942]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi012", "addr": "172.21.15.12", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:15:05.012 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:04 smithi012 ceph-mon[29942]: Deploying cephadm binary to smithi012 2024-09-05T01:15:07.532 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout Added host 'smithi012' with addr '172.21.15.12' 2024-09-05T01:15:07.532 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.192+0000 7f7222400640 1 Processor -- start 2024-09-05T01:15:07.532 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.192+0000 7f7222400640 1 -- start start 2024-09-05T01:15:07.532 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.193+0000 7f7222400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f721c1098f0 0x7f721c109cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:07.532 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.193+0000 7f7222400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f721c10a2c0 con 0x7f721c1098f0 2024-09-05T01:15:07.532 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.193+0000 7f721b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f721c1098f0 0x7f721c109cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:07.532 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.193+0000 7f721b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f721c1098f0 0x7f721c109cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59868/0 (socket says 172.21.15.12:59868) 2024-09-05T01:15:07.532 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.193+0000 7f721b400640 1 -- 172.21.15.12:0/1485371139 learned_addr learned my addr 172.21.15.12:0/1485371139 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:07.532 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.193+0000 7f721b400640 1 -- 172.21.15.12:0/1485371139 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f721c10ab10 con 0x7f721c1098f0 2024-09-05T01:15:07.532 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.195+0000 7f721b400640 1 --2- 172.21.15.12:0/1485371139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f721c1098f0 0x7f721c109cf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f720c009820 tx=0x7f720c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd44008d01f425ae server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:07.533 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.195+0000 7f721aa00640 1 -- 172.21.15.12:0/1485371139 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f720c037070 con 0x7f721c1098f0 2024-09-05T01:15:07.533 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.195+0000 7f721aa00640 1 -- 172.21.15.12:0/1485371139 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f720c032900 con 0x7f721c1098f0 2024-09-05T01:15:07.533 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.195+0000 7f721aa00640 1 -- 172.21.15.12:0/1485371139 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f720c030850 con 0x7f721c1098f0 2024-09-05T01:15:07.533 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.195+0000 7f7222400640 1 -- 172.21.15.12:0/1485371139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f721c1098f0 msgr2=0x7f721c109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:07.533 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.195+0000 7f7222400640 1 --2- 172.21.15.12:0/1485371139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f721c1098f0 0x7f721c109cf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f720c009820 tx=0x7f720c02a270 comp rx=0 tx=0).stop 2024-09-05T01:15:07.533 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.196+0000 7f7222400640 1 -- 172.21.15.12:0/1485371139 shutdown_connections 2024-09-05T01:15:07.533 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.196+0000 7f7222400640 1 --2- 172.21.15.12:0/1485371139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f721c1098f0 0x7f721c109cf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:07.533 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.196+0000 7f7222400640 1 -- 172.21.15.12:0/1485371139 >> 172.21.15.12:0/1485371139 conn(0x7f721c07ceb0 msgr2=0x7f721c07d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:07.533 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.196+0000 7f7222400640 1 -- 172.21.15.12:0/1485371139 shutdown_connections 2024-09-05T01:15:07.533 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.196+0000 7f7222400640 1 -- 172.21.15.12:0/1485371139 wait complete. 2024-09-05T01:15:07.533 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.197+0000 7f7222400640 1 Processor -- start 2024-09-05T01:15:07.533 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.197+0000 7f7222400640 1 -- start start 2024-09-05T01:15:07.534 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.197+0000 7f7222400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f721c1098f0 0x7f721c19d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:07.534 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.197+0000 7f7222400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f721c10dec0 con 0x7f721c1098f0 2024-09-05T01:15:07.534 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.197+0000 7f721b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f721c1098f0 0x7f721c19d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:07.534 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.197+0000 7f721b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f721c1098f0 0x7f721c19d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59884/0 (socket says 172.21.15.12:59884) 2024-09-05T01:15:07.534 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.197+0000 7f721b400640 1 -- 172.21.15.12:0/1089300917 learned_addr learned my addr 172.21.15.12:0/1089300917 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:07.534 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.198+0000 7f721b400640 1 -- 172.21.15.12:0/1089300917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f721c19de80 con 0x7f721c1098f0 2024-09-05T01:15:07.534 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.198+0000 7f721b400640 1 --2- 172.21.15.12:0/1089300917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f721c1098f0 0x7f721c19d940 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f720c032ce0 tx=0x7f720c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:07.534 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.198+0000 7f7218c00640 1 -- 172.21.15.12:0/1089300917 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f720c042070 con 0x7f721c1098f0 2024-09-05T01:15:07.534 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.198+0000 7f7222400640 1 -- 172.21.15.12:0/1089300917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f721c19e110 con 0x7f721c1098f0 2024-09-05T01:15:07.534 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.198+0000 7f7218c00640 1 -- 172.21.15.12:0/1089300917 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f720c0308c0 con 0x7f721c1098f0 2024-09-05T01:15:07.534 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.198+0000 7f7218c00640 1 -- 172.21.15.12:0/1089300917 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f720c037040 con 0x7f721c1098f0 2024-09-05T01:15:07.534 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.198+0000 7f7222400640 1 -- 172.21.15.12:0/1089300917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f721c1a0e00 con 0x7f721c1098f0 2024-09-05T01:15:07.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.200+0000 7f7222400640 1 -- 172.21.15.12:0/1089300917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f721c109cf0 con 0x7f721c1098f0 2024-09-05T01:15:07.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.200+0000 7f7218c00640 1 -- 172.21.15.12:0/1089300917 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f720c045070 con 0x7f721c1098f0 2024-09-05T01:15:07.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.200+0000 7f7218c00640 1 --2- 172.21.15.12:0/1089300917 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f7200038fc0 0x7f720003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:07.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.200+0000 7f7218c00640 1 -- 172.21.15.12:0/1089300917 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f720c06bfd0 con 0x7f721c1098f0 2024-09-05T01:15:07.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.200+0000 7f7213e00640 1 --2- 172.21.15.12:0/1089300917 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f7200038fc0 0x7f720003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:07.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.201+0000 7f7213e00640 1 --2- 172.21.15.12:0/1089300917 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f7200038fc0 0x7f720003b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f72040098c0 tx=0x7f7204006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:07.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.205+0000 7f7218c00640 1 -- 172.21.15.12:0/1089300917 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f720c045360 con 0x7f721c1098f0 2024-09-05T01:15:07.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:02.393+0000 7f7222400640 1 -- 172.21.15.12:0/1089300917 --> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi012", "addr": "172.21.15.12", "target": ["mon-mgr", ""]}) -- 0x7f721c107c20 con 0x7f7200038fc0 2024-09-05T01:15:07.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:06.895+0000 7f7218c00640 1 -- 172.21.15.12:0/1089300917 <== mgr.14118 v2:172.21.15.12:6800/4067110310 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f721c107c20 con 0x7f7200038fc0 2024-09-05T01:15:07.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:06.898+0000 7f7222400640 1 -- 172.21.15.12:0/1089300917 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f7200038fc0 msgr2=0x7f720003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:07.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:06.898+0000 7f7222400640 1 --2- 172.21.15.12:0/1089300917 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f7200038fc0 0x7f720003b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f72040098c0 tx=0x7f7204006db0 comp rx=0 tx=0).stop 2024-09-05T01:15:07.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:06.898+0000 7f7222400640 1 -- 172.21.15.12:0/1089300917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f721c1098f0 msgr2=0x7f721c19d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:07.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:06.898+0000 7f7222400640 1 --2- 172.21.15.12:0/1089300917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f721c1098f0 0x7f721c19d940 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f720c032ce0 tx=0x7f720c032d10 comp rx=0 tx=0).stop 2024-09-05T01:15:07.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:06.898+0000 7f7222400640 1 -- 172.21.15.12:0/1089300917 shutdown_connections 2024-09-05T01:15:07.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:06.898+0000 7f7222400640 1 --2- 172.21.15.12:0/1089300917 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f7200038fc0 0x7f720003b480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:07.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:06.898+0000 7f7222400640 1 --2- 172.21.15.12:0/1089300917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f721c1098f0 0x7f721c19d940 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:07.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:06.898+0000 7f7222400640 1 -- 172.21.15.12:0/1089300917 >> 172.21.15.12:0/1089300917 conn(0x7f721c07ceb0 msgr2=0x7f721c107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:07.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:06.898+0000 7f7222400640 1 -- 172.21.15.12:0/1089300917 shutdown_connections 2024-09-05T01:15:07.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:06.898+0000 7f7222400640 1 -- 172.21.15.12:0/1089300917 wait complete. 2024-09-05T01:15:07.536 INFO:teuthology.orchestra.run.smithi012.stdout:Deploying unmanaged mon service... 2024-09-05T01:15:08.112 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:07 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' 2024-09-05T01:15:08.112 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:07 smithi012 ceph-mon[29942]: Added host smithi012 2024-09-05T01:15:08.112 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:07 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:15:09.102 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-05T01:15:09.102 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.110+0000 7ff6eb200640 1 Processor -- start 2024-09-05T01:15:09.103 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.111+0000 7ff6eb200640 1 -- start start 2024-09-05T01:15:09.103 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.111+0000 7ff6eb200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6e41098f0 0x7ff6e4109cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:09.103 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.111+0000 7ff6eb200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e410a2c0 con 0x7ff6e41098f0 2024-09-05T01:15:09.103 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.111+0000 7ff6e3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6e41098f0 0x7ff6e4109cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:09.103 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.111+0000 7ff6e3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6e41098f0 0x7ff6e4109cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35806/0 (socket says 172.21.15.12:35806) 2024-09-05T01:15:09.103 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.111+0000 7ff6e3e00640 1 -- 172.21.15.12:0/2077868873 learned_addr learned my addr 172.21.15.12:0/2077868873 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:09.107 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.112+0000 7ff6e3e00640 1 -- 172.21.15.12:0/2077868873 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e410ab10 con 0x7ff6e41098f0 2024-09-05T01:15:09.107 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.113+0000 7ff6e3e00640 1 --2- 172.21.15.12:0/2077868873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6e41098f0 0x7ff6e4109cf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4009820 tx=0x7ff6d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aac6d7271da9e34 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:09.108 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.113+0000 7ff6e3400640 1 -- 172.21.15.12:0/2077868873 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6d4037070 con 0x7ff6e41098f0 2024-09-05T01:15:09.108 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.113+0000 7ff6e3400640 1 -- 172.21.15.12:0/2077868873 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff6d4032900 con 0x7ff6e41098f0 2024-09-05T01:15:09.108 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.113+0000 7ff6e3400640 1 -- 172.21.15.12:0/2077868873 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6d4030850 con 0x7ff6e41098f0 2024-09-05T01:15:09.108 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.113+0000 7ff6eb200640 1 -- 172.21.15.12:0/2077868873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6e41098f0 msgr2=0x7ff6e4109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:09.108 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.113+0000 7ff6eb200640 1 --2- 172.21.15.12:0/2077868873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6e41098f0 0x7ff6e4109cf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4009820 tx=0x7ff6d402a270 comp rx=0 tx=0).stop 2024-09-05T01:15:09.108 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.113+0000 7ff6eb200640 1 -- 172.21.15.12:0/2077868873 shutdown_connections 2024-09-05T01:15:09.108 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.113+0000 7ff6eb200640 1 --2- 172.21.15.12:0/2077868873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6e41098f0 0x7ff6e4109cf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:09.108 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.114+0000 7ff6eb200640 1 -- 172.21.15.12:0/2077868873 >> 172.21.15.12:0/2077868873 conn(0x7ff6e407ceb0 msgr2=0x7ff6e407d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:09.108 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.114+0000 7ff6eb200640 1 -- 172.21.15.12:0/2077868873 shutdown_connections 2024-09-05T01:15:09.108 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.114+0000 7ff6eb200640 1 -- 172.21.15.12:0/2077868873 wait complete. 2024-09-05T01:15:09.108 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.115+0000 7ff6eb200640 1 Processor -- start 2024-09-05T01:15:09.108 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.115+0000 7ff6eb200640 1 -- start start 2024-09-05T01:15:09.108 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.115+0000 7ff6eb200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6e41098f0 0x7ff6e419d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:09.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.115+0000 7ff6eb200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e410dec0 con 0x7ff6e41098f0 2024-09-05T01:15:09.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.115+0000 7ff6e3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6e41098f0 0x7ff6e419d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:09.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.115+0000 7ff6e3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6e41098f0 0x7ff6e419d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35820/0 (socket says 172.21.15.12:35820) 2024-09-05T01:15:09.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.115+0000 7ff6e3e00640 1 -- 172.21.15.12:0/1993113395 learned_addr learned my addr 172.21.15.12:0/1993113395 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:09.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.116+0000 7ff6e3e00640 1 -- 172.21.15.12:0/1993113395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e419de80 con 0x7ff6e41098f0 2024-09-05T01:15:09.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.116+0000 7ff6e3e00640 1 --2- 172.21.15.12:0/1993113395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6e41098f0 0x7ff6e419d940 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4009940 tx=0x7ff6d4032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:09.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.116+0000 7ff6e1600640 1 -- 172.21.15.12:0/1993113395 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6d4042070 con 0x7ff6e41098f0 2024-09-05T01:15:09.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.116+0000 7ff6e1600640 1 -- 172.21.15.12:0/1993113395 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff6d40308c0 con 0x7ff6e41098f0 2024-09-05T01:15:09.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.116+0000 7ff6eb200640 1 -- 172.21.15.12:0/1993113395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e419e110 con 0x7ff6e41098f0 2024-09-05T01:15:09.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.116+0000 7ff6e1600640 1 -- 172.21.15.12:0/1993113395 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6d4037040 con 0x7ff6e41098f0 2024-09-05T01:15:09.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.116+0000 7ff6eb200640 1 -- 172.21.15.12:0/1993113395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e41a0e00 con 0x7ff6e41098f0 2024-09-05T01:15:09.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.117+0000 7ff6e1600640 1 -- 172.21.15.12:0/1993113395 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7ff6d4045070 con 0x7ff6e41098f0 2024-09-05T01:15:09.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.117+0000 7ff6eb200640 1 -- 172.21.15.12:0/1993113395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6e4109cf0 con 0x7ff6e41098f0 2024-09-05T01:15:09.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.118+0000 7ff6e1600640 1 --2- 172.21.15.12:0/1993113395 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7ff6c8038fc0 0x7ff6c803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:09.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.118+0000 7ff6e1600640 1 -- 172.21.15.12:0/1993113395 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff6d406c090 con 0x7ff6e41098f0 2024-09-05T01:15:09.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.118+0000 7ff6db400640 1 --2- 172.21.15.12:0/1993113395 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7ff6c8038fc0 0x7ff6c803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:09.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.119+0000 7ff6db400640 1 --2- 172.21.15.12:0/1993113395 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7ff6c8038fc0 0x7ff6c803b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc0098c0 tx=0x7ff6cc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:09.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.123+0000 7ff6e1600640 1 -- 172.21.15.12:0/1993113395 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff6d404b170 con 0x7ff6e41098f0 2024-09-05T01:15:09.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.326+0000 7ff6eb200640 1 -- 172.21.15.12:0/1993113395 --> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7ff6e4107c20 con 0x7ff6c8038fc0 2024-09-05T01:15:09.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.331+0000 7ff6e1600640 1 -- 172.21.15.12:0/1993113395 <== mgr.14118 v2:172.21.15.12:6800/4067110310 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff6e4107c20 con 0x7ff6c8038fc0 2024-09-05T01:15:09.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.334+0000 7ff6eb200640 1 -- 172.21.15.12:0/1993113395 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7ff6c8038fc0 msgr2=0x7ff6c803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:09.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.334+0000 7ff6eb200640 1 --2- 172.21.15.12:0/1993113395 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7ff6c8038fc0 0x7ff6c803b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc0098c0 tx=0x7ff6cc006db0 comp rx=0 tx=0).stop 2024-09-05T01:15:09.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.334+0000 7ff6eb200640 1 -- 172.21.15.12:0/1993113395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6e41098f0 msgr2=0x7ff6e419d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:09.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.334+0000 7ff6eb200640 1 --2- 172.21.15.12:0/1993113395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6e41098f0 0x7ff6e419d940 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4009940 tx=0x7ff6d4032ce0 comp rx=0 tx=0).stop 2024-09-05T01:15:09.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.334+0000 7ff6eb200640 1 -- 172.21.15.12:0/1993113395 shutdown_connections 2024-09-05T01:15:09.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.334+0000 7ff6eb200640 1 --2- 172.21.15.12:0/1993113395 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7ff6c8038fc0 0x7ff6c803b480 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:09.111 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.334+0000 7ff6eb200640 1 --2- 172.21.15.12:0/1993113395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6e41098f0 0x7ff6e419d940 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:09.111 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.334+0000 7ff6eb200640 1 -- 172.21.15.12:0/1993113395 >> 172.21.15.12:0/1993113395 conn(0x7ff6e407ceb0 msgr2=0x7ff6e4107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:09.111 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.334+0000 7ff6eb200640 1 -- 172.21.15.12:0/1993113395 shutdown_connections 2024-09-05T01:15:09.111 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:08.334+0000 7ff6eb200640 1 -- 172.21.15.12:0/1993113395 wait complete. 2024-09-05T01:15:09.111 INFO:teuthology.orchestra.run.smithi012.stdout:Deploying unmanaged mgr service... 2024-09-05T01:15:09.358 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:09 smithi012 ceph-mon[29942]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:15:09.358 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:09 smithi012 ceph-mon[29942]: Saving service mon spec with placement count:5 2024-09-05T01:15:09.358 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:09 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' 2024-09-05T01:15:11.132 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-05T01:15:11.133 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.055+0000 7ff402800640 1 Processor -- start 2024-09-05T01:15:11.133 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.055+0000 7ff402800640 1 -- start start 2024-09-05T01:15:11.133 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.055+0000 7ff402800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3fc1076f0 0x7ff3fc107af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:11.133 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.055+0000 7ff402800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc1080c0 con 0x7ff3fc1076f0 2024-09-05T01:15:11.133 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.056+0000 7ff3fb400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3fc1076f0 0x7ff3fc107af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:11.133 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.056+0000 7ff3fb400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3fc1076f0 0x7ff3fc107af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35836/0 (socket says 172.21.15.12:35836) 2024-09-05T01:15:11.133 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.056+0000 7ff3fb400640 1 -- 172.21.15.12:0/1577632486 learned_addr learned my addr 172.21.15.12:0/1577632486 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:11.133 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.056+0000 7ff3fb400640 1 -- 172.21.15.12:0/1577632486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3fc1088f0 con 0x7ff3fc1076f0 2024-09-05T01:15:11.133 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.057+0000 7ff3fb400640 1 --2- 172.21.15.12:0/1577632486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3fc1076f0 0x7ff3fc107af0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec009820 tx=0x7ff3ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35c44090f7f0ac5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:11.133 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.057+0000 7ff3faa00640 1 -- 172.21.15.12:0/1577632486 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3ec037070 con 0x7ff3fc1076f0 2024-09-05T01:15:11.133 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.058+0000 7ff3faa00640 1 -- 172.21.15.12:0/1577632486 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff3ec032900 con 0x7ff3fc1076f0 2024-09-05T01:15:11.133 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.058+0000 7ff3faa00640 1 -- 172.21.15.12:0/1577632486 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3ec030850 con 0x7ff3fc1076f0 2024-09-05T01:15:11.133 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.058+0000 7ff402800640 1 -- 172.21.15.12:0/1577632486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3fc1076f0 msgr2=0x7ff3fc107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:11.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.058+0000 7ff402800640 1 --2- 172.21.15.12:0/1577632486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3fc1076f0 0x7ff3fc107af0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec009820 tx=0x7ff3ec02a270 comp rx=0 tx=0).stop 2024-09-05T01:15:11.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.058+0000 7ff402800640 1 -- 172.21.15.12:0/1577632486 shutdown_connections 2024-09-05T01:15:11.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.058+0000 7ff402800640 1 --2- 172.21.15.12:0/1577632486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3fc1076f0 0x7ff3fc107af0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:11.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.058+0000 7ff402800640 1 -- 172.21.15.12:0/1577632486 >> 172.21.15.12:0/1577632486 conn(0x7ff3fc102e80 msgr2=0x7ff3fc1052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:11.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.058+0000 7ff402800640 1 -- 172.21.15.12:0/1577632486 shutdown_connections 2024-09-05T01:15:11.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.058+0000 7ff402800640 1 -- 172.21.15.12:0/1577632486 wait complete. 2024-09-05T01:15:11.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.059+0000 7ff402800640 1 Processor -- start 2024-09-05T01:15:11.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.059+0000 7ff402800640 1 -- start start 2024-09-05T01:15:11.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.060+0000 7ff402800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3fc1076f0 0x7ff3fc19b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:11.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.060+0000 7ff402800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc10bca0 con 0x7ff3fc1076f0 2024-09-05T01:15:11.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.060+0000 7ff3fb400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3fc1076f0 0x7ff3fc19b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:11.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.060+0000 7ff3fb400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3fc1076f0 0x7ff3fc19b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35846/0 (socket says 172.21.15.12:35846) 2024-09-05T01:15:11.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.060+0000 7ff3fb400640 1 -- 172.21.15.12:0/2815150781 learned_addr learned my addr 172.21.15.12:0/2815150781 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:11.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.060+0000 7ff3fb400640 1 -- 172.21.15.12:0/2815150781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3fc19bc80 con 0x7ff3fc1076f0 2024-09-05T01:15:11.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.061+0000 7ff3fb400640 1 --2- 172.21.15.12:0/2815150781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3fc1076f0 0x7ff3fc19b740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec0097f0 tx=0x7ff3ec030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:11.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.061+0000 7ff3f8c00640 1 -- 172.21.15.12:0/2815150781 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3ec037040 con 0x7ff3fc1076f0 2024-09-05T01:15:11.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.061+0000 7ff3f8c00640 1 -- 172.21.15.12:0/2815150781 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff3ec040070 con 0x7ff3fc1076f0 2024-09-05T01:15:11.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.061+0000 7ff3f8c00640 1 -- 172.21.15.12:0/2815150781 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3ec03a390 con 0x7ff3fc1076f0 2024-09-05T01:15:11.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.061+0000 7ff402800640 1 -- 172.21.15.12:0/2815150781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3fc19bf10 con 0x7ff3fc1076f0 2024-09-05T01:15:11.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.061+0000 7ff402800640 1 -- 172.21.15.12:0/2815150781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3fc19ec00 con 0x7ff3fc1076f0 2024-09-05T01:15:11.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.062+0000 7ff402800640 1 -- 172.21.15.12:0/2815150781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3fc10be20 con 0x7ff3fc1076f0 2024-09-05T01:15:11.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.062+0000 7ff3f8c00640 1 -- 172.21.15.12:0/2815150781 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7ff3ec03b430 con 0x7ff3fc1076f0 2024-09-05T01:15:11.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.063+0000 7ff3f8c00640 1 --2- 172.21.15.12:0/2815150781 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7ff3e0038fc0 0x7ff3e003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:11.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.063+0000 7ff3f8c00640 1 -- 172.21.15.12:0/2815150781 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff3ec06c4e0 con 0x7ff3fc1076f0 2024-09-05T01:15:11.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.063+0000 7ff3f2a00640 1 --2- 172.21.15.12:0/2815150781 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7ff3e0038fc0 0x7ff3e003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:11.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.064+0000 7ff3f2a00640 1 --2- 172.21.15.12:0/2815150781 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7ff3e0038fc0 0x7ff3e003b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40098c0 tx=0x7ff3e4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:11.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.068+0000 7ff3f8c00640 1 -- 172.21.15.12:0/2815150781 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff3ec06be30 con 0x7ff3fc1076f0 2024-09-05T01:15:11.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.271+0000 7ff402800640 1 -- 172.21.15.12:0/2815150781 --> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7ff3fc104130 con 0x7ff3e0038fc0 2024-09-05T01:15:11.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.276+0000 7ff3f8c00640 1 -- 172.21.15.12:0/2815150781 <== mgr.14118 v2:172.21.15.12:6800/4067110310 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff3fc104130 con 0x7ff3e0038fc0 2024-09-05T01:15:11.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.278+0000 7ff402800640 1 -- 172.21.15.12:0/2815150781 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7ff3e0038fc0 msgr2=0x7ff3e003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:11.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.278+0000 7ff402800640 1 --2- 172.21.15.12:0/2815150781 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7ff3e0038fc0 0x7ff3e003b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40098c0 tx=0x7ff3e4006db0 comp rx=0 tx=0).stop 2024-09-05T01:15:11.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.278+0000 7ff402800640 1 -- 172.21.15.12:0/2815150781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3fc1076f0 msgr2=0x7ff3fc19b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:11.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.278+0000 7ff402800640 1 --2- 172.21.15.12:0/2815150781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3fc1076f0 0x7ff3fc19b740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec0097f0 tx=0x7ff3ec030d80 comp rx=0 tx=0).stop 2024-09-05T01:15:11.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.278+0000 7ff402800640 1 -- 172.21.15.12:0/2815150781 shutdown_connections 2024-09-05T01:15:11.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.278+0000 7ff402800640 1 --2- 172.21.15.12:0/2815150781 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7ff3e0038fc0 0x7ff3e003b480 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:11.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.278+0000 7ff402800640 1 --2- 172.21.15.12:0/2815150781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3fc1076f0 0x7ff3fc19b740 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:11.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.278+0000 7ff402800640 1 -- 172.21.15.12:0/2815150781 >> 172.21.15.12:0/2815150781 conn(0x7ff3fc102e80 msgr2=0x7ff3fc103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:11.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.279+0000 7ff402800640 1 -- 172.21.15.12:0/2815150781 shutdown_connections 2024-09-05T01:15:11.136 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:10.279+0000 7ff402800640 1 -- 172.21.15.12:0/2815150781 wait complete. 2024-09-05T01:15:11.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:11 smithi012 ceph-mon[29942]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:15:11.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:11 smithi012 ceph-mon[29942]: Saving service mgr spec with placement count:2 2024-09-05T01:15:11.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:11 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' 2024-09-05T01:15:11.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:11 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' 2024-09-05T01:15:11.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:11 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' 2024-09-05T01:15:13.136 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:12 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3965905662' entity='client.admin' 2024-09-05T01:15:13.137 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:12 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' 2024-09-05T01:15:13.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.634+0000 7f9f76400640 1 Processor -- start 2024-09-05T01:15:13.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.634+0000 7f9f76400640 1 -- start start 2024-09-05T01:15:13.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.635+0000 7f9f76400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f701098f0 0x7f9f70109cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:13.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.635+0000 7f9f76400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7010a2c0 con 0x7f9f701098f0 2024-09-05T01:15:13.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.635+0000 7f9f6f400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f701098f0 0x7f9f70109cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:13.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.635+0000 7f9f6f400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f701098f0 0x7f9f70109cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35850/0 (socket says 172.21.15.12:35850) 2024-09-05T01:15:13.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.635+0000 7f9f6f400640 1 -- 172.21.15.12:0/1811041407 learned_addr learned my addr 172.21.15.12:0/1811041407 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:13.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.635+0000 7f9f6f400640 1 -- 172.21.15.12:0/1811041407 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7010ab10 con 0x7f9f701098f0 2024-09-05T01:15:13.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.636+0000 7f9f6f400640 1 --2- 172.21.15.12:0/1811041407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f701098f0 0x7f9f70109cf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9f60009820 tx=0x7f9f6002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef6bf4617367a6c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:13.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.637+0000 7f9f6e000640 1 -- 172.21.15.12:0/1811041407 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f60037070 con 0x7f9f701098f0 2024-09-05T01:15:13.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.637+0000 7f9f6e000640 1 -- 172.21.15.12:0/1811041407 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f60032920 con 0x7f9f701098f0 2024-09-05T01:15:13.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.637+0000 7f9f6e000640 1 -- 172.21.15.12:0/1811041407 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f60030810 con 0x7f9f701098f0 2024-09-05T01:15:13.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.637+0000 7f9f76400640 1 -- 172.21.15.12:0/1811041407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f701098f0 msgr2=0x7f9f70109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:13.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.637+0000 7f9f76400640 1 --2- 172.21.15.12:0/1811041407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f701098f0 0x7f9f70109cf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9f60009820 tx=0x7f9f6002a270 comp rx=0 tx=0).stop 2024-09-05T01:15:13.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.638+0000 7f9f76400640 1 -- 172.21.15.12:0/1811041407 shutdown_connections 2024-09-05T01:15:13.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.638+0000 7f9f76400640 1 --2- 172.21.15.12:0/1811041407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f701098f0 0x7f9f70109cf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:13.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.638+0000 7f9f76400640 1 -- 172.21.15.12:0/1811041407 >> 172.21.15.12:0/1811041407 conn(0x7f9f7007ceb0 msgr2=0x7f9f7007d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:13.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.638+0000 7f9f76400640 1 -- 172.21.15.12:0/1811041407 shutdown_connections 2024-09-05T01:15:13.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.638+0000 7f9f76400640 1 -- 172.21.15.12:0/1811041407 wait complete. 2024-09-05T01:15:13.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.639+0000 7f9f76400640 1 Processor -- start 2024-09-05T01:15:13.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.639+0000 7f9f76400640 1 -- start start 2024-09-05T01:15:13.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.639+0000 7f9f76400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f701098f0 0x7f9f7019d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:13.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.639+0000 7f9f76400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7010dec0 con 0x7f9f701098f0 2024-09-05T01:15:13.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.640+0000 7f9f6f400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f701098f0 0x7f9f7019d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:13.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.640+0000 7f9f6f400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f701098f0 0x7f9f7019d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35862/0 (socket says 172.21.15.12:35862) 2024-09-05T01:15:13.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.640+0000 7f9f6f400640 1 -- 172.21.15.12:0/3965905662 learned_addr learned my addr 172.21.15.12:0/3965905662 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:13.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.640+0000 7f9f6f400640 1 -- 172.21.15.12:0/3965905662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7019de50 con 0x7f9f701098f0 2024-09-05T01:15:13.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.640+0000 7f9f6f400640 1 --2- 172.21.15.12:0/3965905662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f701098f0 0x7f9f7019d910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9f600097f0 tx=0x7f9f600327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:13.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.641+0000 7f9f67e00640 1 -- 172.21.15.12:0/3965905662 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f60037040 con 0x7f9f701098f0 2024-09-05T01:15:13.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.641+0000 7f9f67e00640 1 -- 172.21.15.12:0/3965905662 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f60030cc0 con 0x7f9f701098f0 2024-09-05T01:15:13.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.641+0000 7f9f76400640 1 -- 172.21.15.12:0/3965905662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f7019e0e0 con 0x7f9f701098f0 2024-09-05T01:15:13.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.641+0000 7f9f67e00640 1 -- 172.21.15.12:0/3965905662 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f6003a6b0 con 0x7f9f701098f0 2024-09-05T01:15:13.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.641+0000 7f9f76400640 1 -- 172.21.15.12:0/3965905662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f701a0dd0 con 0x7f9f701098f0 2024-09-05T01:15:13.375 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.642+0000 7f9f67e00640 1 -- 172.21.15.12:0/3965905662 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f9f6003b3f0 con 0x7f9f701098f0 2024-09-05T01:15:13.375 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.642+0000 7f9f76400640 1 -- 172.21.15.12:0/3965905662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f70109d70 con 0x7f9f701098f0 2024-09-05T01:15:13.375 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.643+0000 7f9f67e00640 1 --2- 172.21.15.12:0/3965905662 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f9f54038fc0 0x7f9f5403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:13.375 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.643+0000 7f9f67e00640 1 -- 172.21.15.12:0/3965905662 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9f6006c550 con 0x7f9f701098f0 2024-09-05T01:15:13.375 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.643+0000 7f9f6ea00640 1 --2- 172.21.15.12:0/3965905662 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f9f54038fc0 0x7f9f5403b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:13.375 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.644+0000 7f9f6ea00640 1 --2- 172.21.15.12:0/3965905662 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f9f54038fc0 0x7f9f5403b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0098c0 tx=0x7f9f5c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:13.375 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.648+0000 7f9f67e00640 1 -- 172.21.15.12:0/3965905662 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9f600371e0 con 0x7f9f701098f0 2024-09-05T01:15:13.375 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.851+0000 7f9f76400640 1 -- 172.21.15.12:0/3965905662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f9f701a13c0 con 0x7f9f701098f0 2024-09-05T01:15:13.375 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.854+0000 7f9f67e00640 1 -- 172.21.15.12:0/3965905662 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f9f6006bea0 con 0x7f9f701098f0 2024-09-05T01:15:13.375 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.857+0000 7f9f76400640 1 -- 172.21.15.12:0/3965905662 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f9f54038fc0 msgr2=0x7f9f5403b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:13.375 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.857+0000 7f9f76400640 1 --2- 172.21.15.12:0/3965905662 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f9f54038fc0 0x7f9f5403b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0098c0 tx=0x7f9f5c006db0 comp rx=0 tx=0).stop 2024-09-05T01:15:13.375 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.857+0000 7f9f76400640 1 -- 172.21.15.12:0/3965905662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f701098f0 msgr2=0x7f9f7019d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:13.375 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.857+0000 7f9f76400640 1 --2- 172.21.15.12:0/3965905662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f701098f0 0x7f9f7019d910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9f600097f0 tx=0x7f9f600327b0 comp rx=0 tx=0).stop 2024-09-05T01:15:13.376 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.857+0000 7f9f76400640 1 -- 172.21.15.12:0/3965905662 shutdown_connections 2024-09-05T01:15:13.376 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.857+0000 7f9f76400640 1 --2- 172.21.15.12:0/3965905662 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f9f54038fc0 0x7f9f5403b480 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:13.376 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.857+0000 7f9f76400640 1 --2- 172.21.15.12:0/3965905662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f701098f0 0x7f9f7019d910 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:13.376 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.857+0000 7f9f76400640 1 -- 172.21.15.12:0/3965905662 >> 172.21.15.12:0/3965905662 conn(0x7f9f7007ceb0 msgr2=0x7f9f70107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:13.376 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.857+0000 7f9f76400640 1 -- 172.21.15.12:0/3965905662 shutdown_connections 2024-09-05T01:15:13.376 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:11.857+0000 7f9f76400640 1 -- 172.21.15.12:0/3965905662 wait complete. 2024-09-05T01:15:14.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.903+0000 7fa4daa00640 1 Processor -- start 2024-09-05T01:15:14.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.903+0000 7fa4daa00640 1 -- start start 2024-09-05T01:15:14.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.904+0000 7fa4daa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d41098f0 0x7fa4d4109cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:14.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.904+0000 7fa4daa00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d410a2c0 con 0x7fa4d41098f0 2024-09-05T01:15:14.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.904+0000 7fa4d3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d41098f0 0x7fa4d4109cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:14.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.904+0000 7fa4d3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d41098f0 0x7fa4d4109cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35866/0 (socket says 172.21.15.12:35866) 2024-09-05T01:15:14.794 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.904+0000 7fa4d3e00640 1 -- 172.21.15.12:0/3933627863 learned_addr learned my addr 172.21.15.12:0/3933627863 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:14.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.905+0000 7fa4d3e00640 1 -- 172.21.15.12:0/3933627863 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d410ab10 con 0x7fa4d41098f0 2024-09-05T01:15:14.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.906+0000 7fa4d3e00640 1 --2- 172.21.15.12:0/3933627863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d41098f0 0x7fa4d4109cf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009820 tx=0x7fa4c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded3422a83f054d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:14.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.906+0000 7fa4d3400640 1 -- 172.21.15.12:0/3933627863 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4c4037070 con 0x7fa4d41098f0 2024-09-05T01:15:14.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.906+0000 7fa4d3400640 1 -- 172.21.15.12:0/3933627863 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4c4032920 con 0x7fa4d41098f0 2024-09-05T01:15:14.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.906+0000 7fa4d3400640 1 -- 172.21.15.12:0/3933627863 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4c4030810 con 0x7fa4d41098f0 2024-09-05T01:15:14.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.907+0000 7fa4daa00640 1 -- 172.21.15.12:0/3933627863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d41098f0 msgr2=0x7fa4d4109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:14.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.907+0000 7fa4daa00640 1 --2- 172.21.15.12:0/3933627863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d41098f0 0x7fa4d4109cf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009820 tx=0x7fa4c402a270 comp rx=0 tx=0).stop 2024-09-05T01:15:14.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.907+0000 7fa4daa00640 1 -- 172.21.15.12:0/3933627863 shutdown_connections 2024-09-05T01:15:14.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.907+0000 7fa4daa00640 1 --2- 172.21.15.12:0/3933627863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d41098f0 0x7fa4d4109cf0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:14.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.907+0000 7fa4daa00640 1 -- 172.21.15.12:0/3933627863 >> 172.21.15.12:0/3933627863 conn(0x7fa4d407ceb0 msgr2=0x7fa4d407d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:14.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.907+0000 7fa4daa00640 1 -- 172.21.15.12:0/3933627863 shutdown_connections 2024-09-05T01:15:14.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.907+0000 7fa4daa00640 1 -- 172.21.15.12:0/3933627863 wait complete. 2024-09-05T01:15:14.795 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.908+0000 7fa4daa00640 1 Processor -- start 2024-09-05T01:15:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.908+0000 7fa4daa00640 1 -- start start 2024-09-05T01:15:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.908+0000 7fa4daa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d41098f0 0x7fa4d419d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.908+0000 7fa4daa00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d410dec0 con 0x7fa4d41098f0 2024-09-05T01:15:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.909+0000 7fa4d3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d41098f0 0x7fa4d419d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.909+0000 7fa4d3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d41098f0 0x7fa4d419d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35874/0 (socket says 172.21.15.12:35874) 2024-09-05T01:15:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.909+0000 7fa4d3e00640 1 -- 172.21.15.12:0/513249704 learned_addr learned my addr 172.21.15.12:0/513249704 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.909+0000 7fa4d3e00640 1 -- 172.21.15.12:0/513249704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d419de70 con 0x7fa4d41098f0 2024-09-05T01:15:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.909+0000 7fa4d3e00640 1 --2- 172.21.15.12:0/513249704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d41098f0 0x7fa4d419d930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40097f0 tx=0x7fa4c40327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.909+0000 7fa4d1600640 1 -- 172.21.15.12:0/513249704 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4c4037040 con 0x7fa4d41098f0 2024-09-05T01:15:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.910+0000 7fa4daa00640 1 -- 172.21.15.12:0/513249704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d419e100 con 0x7fa4d41098f0 2024-09-05T01:15:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.910+0000 7fa4d1600640 1 -- 172.21.15.12:0/513249704 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4c4030cc0 con 0x7fa4d41098f0 2024-09-05T01:15:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.910+0000 7fa4daa00640 1 -- 172.21.15.12:0/513249704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d41a0df0 con 0x7fa4d41098f0 2024-09-05T01:15:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.910+0000 7fa4d1600640 1 -- 172.21.15.12:0/513249704 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4c403a670 con 0x7fa4d41098f0 2024-09-05T01:15:14.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.911+0000 7fa4daa00640 1 -- 172.21.15.12:0/513249704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4d4109d70 con 0x7fa4d41098f0 2024-09-05T01:15:14.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.911+0000 7fa4d1600640 1 -- 172.21.15.12:0/513249704 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fa4c403baf0 con 0x7fa4d41098f0 2024-09-05T01:15:14.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.911+0000 7fa4d1600640 1 --2- 172.21.15.12:0/513249704 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fa4b8038f70 0x7fa4b803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:14.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.911+0000 7fa4d1600640 1 -- 172.21.15.12:0/513249704 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa4c406c570 con 0x7fa4d41098f0 2024-09-05T01:15:14.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.911+0000 7fa4cbe00640 1 --2- 172.21.15.12:0/513249704 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fa4b8038f70 0x7fa4b803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:14.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.912+0000 7fa4cbe00640 1 --2- 172.21.15.12:0/513249704 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fa4b8038f70 0x7fa4b803b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc0098c0 tx=0x7fa4bc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:14.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:13.916+0000 7fa4d1600640 1 -- 172.21.15.12:0/513249704 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa4c406bf00 con 0x7fa4d41098f0 2024-09-05T01:15:14.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:14.121+0000 7fa4daa00640 1 -- 172.21.15.12:0/513249704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fa4d41a1450 con 0x7fa4d41098f0 2024-09-05T01:15:14.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:14.125+0000 7fa4d1600640 1 -- 172.21.15.12:0/513249704 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fa4c403a810 con 0x7fa4d41098f0 2024-09-05T01:15:14.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:14.127+0000 7fa4daa00640 1 -- 172.21.15.12:0/513249704 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fa4b8038f70 msgr2=0x7fa4b803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:14.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:14.127+0000 7fa4daa00640 1 --2- 172.21.15.12:0/513249704 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fa4b8038f70 0x7fa4b803b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc0098c0 tx=0x7fa4bc006db0 comp rx=0 tx=0).stop 2024-09-05T01:15:14.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:14.127+0000 7fa4daa00640 1 -- 172.21.15.12:0/513249704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d41098f0 msgr2=0x7fa4d419d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:14.797 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:14.127+0000 7fa4daa00640 1 --2- 172.21.15.12:0/513249704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d41098f0 0x7fa4d419d930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40097f0 tx=0x7fa4c40327b0 comp rx=0 tx=0).stop 2024-09-05T01:15:14.798 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:14.128+0000 7fa4daa00640 1 -- 172.21.15.12:0/513249704 shutdown_connections 2024-09-05T01:15:14.798 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:14.128+0000 7fa4daa00640 1 --2- 172.21.15.12:0/513249704 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fa4b8038f70 0x7fa4b803b430 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:14.798 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:14.128+0000 7fa4daa00640 1 --2- 172.21.15.12:0/513249704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d41098f0 0x7fa4d419d930 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:14.798 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:14.128+0000 7fa4daa00640 1 -- 172.21.15.12:0/513249704 >> 172.21.15.12:0/513249704 conn(0x7fa4d407ceb0 msgr2=0x7fa4d41075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:14.798 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:14.128+0000 7fa4daa00640 1 -- 172.21.15.12:0/513249704 shutdown_connections 2024-09-05T01:15:14.798 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:14.128+0000 7fa4daa00640 1 -- 172.21.15.12:0/513249704 wait complete. 2024-09-05T01:15:14.798 INFO:teuthology.orchestra.run.smithi012.stdout:Enabling the dashboard module... 2024-09-05T01:15:15.040 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:14 smithi012 ceph-mon[29942]: from='mgr.14118 172.21.15.12:0/4265089139' entity='mgr.x' 2024-09-05T01:15:15.040 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:14 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/513249704' entity='client.admin' 2024-09-05T01:15:16.248 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:15 smithi012 ceph-mon[29942]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:15:16.248 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:15 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/1086885197' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-05T01:15:16.248 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:16 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: ignoring --setuser ceph since I am not root 2024-09-05T01:15:16.248 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:16 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: ignoring --setgroup ceph since I am not root 2024-09-05T01:15:16.248 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:16 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:16.246+0000 7f31b59da040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-05T01:15:16.510 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:16 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:16.318+0000 7f31b59da040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-05T01:15:16.510 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:16 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:16.509+0000 7f31b59da040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-05T01:15:16.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.381+0000 7f429ee00640 1 Processor -- start 2024-09-05T01:15:16.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.381+0000 7f429ee00640 1 -- start start 2024-09-05T01:15:16.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.381+0000 7f429ee00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4298107530 0x7f4298107930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:16.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.381+0000 7f429ee00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4298107f00 con 0x7f4298107530 2024-09-05T01:15:16.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.381+0000 7f429da00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4298107530 0x7f4298107930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:16.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.382+0000 7f429da00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4298107530 0x7f4298107930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35886/0 (socket says 172.21.15.12:35886) 2024-09-05T01:15:16.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.382+0000 7f429da00640 1 -- 172.21.15.12:0/4201369026 learned_addr learned my addr 172.21.15.12:0/4201369026 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:16.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.382+0000 7f429da00640 1 -- 172.21.15.12:0/4201369026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4298108730 con 0x7f4298107530 2024-09-05T01:15:16.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.383+0000 7f429da00640 1 --2- 172.21.15.12:0/4201369026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4298107530 0x7f4298107930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f428c009e80 tx=0x7f428c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f39f22b2dac56cc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:16.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.383+0000 7f4297e00640 1 -- 172.21.15.12:0/4201369026 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f428c036070 con 0x7f4298107530 2024-09-05T01:15:16.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.383+0000 7f4297e00640 1 -- 172.21.15.12:0/4201369026 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f428c0318e0 con 0x7f4298107530 2024-09-05T01:15:16.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.383+0000 7f4297e00640 1 -- 172.21.15.12:0/4201369026 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f428c007a00 con 0x7f4298107530 2024-09-05T01:15:16.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.384+0000 7f429ee00640 1 -- 172.21.15.12:0/4201369026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4298107530 msgr2=0x7f4298107930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:16.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.384+0000 7f429ee00640 1 --2- 172.21.15.12:0/4201369026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4298107530 0x7f4298107930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f428c009e80 tx=0x7f428c02a7a0 comp rx=0 tx=0).stop 2024-09-05T01:15:16.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.384+0000 7f429ee00640 1 -- 172.21.15.12:0/4201369026 shutdown_connections 2024-09-05T01:15:16.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.384+0000 7f429ee00640 1 --2- 172.21.15.12:0/4201369026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4298107530 0x7f4298107930 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:16.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.384+0000 7f429ee00640 1 -- 172.21.15.12:0/4201369026 >> 172.21.15.12:0/4201369026 conn(0x7f4298102ce0 msgr2=0x7f4298105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:16.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.384+0000 7f429ee00640 1 -- 172.21.15.12:0/4201369026 shutdown_connections 2024-09-05T01:15:16.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.384+0000 7f429ee00640 1 -- 172.21.15.12:0/4201369026 wait complete. 2024-09-05T01:15:16.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.385+0000 7f429ee00640 1 Processor -- start 2024-09-05T01:15:16.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.385+0000 7f429ee00640 1 -- start start 2024-09-05T01:15:16.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.385+0000 7f429ee00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4298107530 0x7f429819d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:16.743 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.385+0000 7f429ee00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f429810bae0 con 0x7f4298107530 2024-09-05T01:15:16.743 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.385+0000 7f429da00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4298107530 0x7f429819d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:16.743 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.386+0000 7f429da00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4298107530 0x7f429819d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35902/0 (socket says 172.21.15.12:35902) 2024-09-05T01:15:16.743 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.386+0000 7f429da00640 1 -- 172.21.15.12:0/1086885197 learned_addr learned my addr 172.21.15.12:0/1086885197 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:16.743 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.386+0000 7f429da00640 1 -- 172.21.15.12:0/1086885197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f429819dcf0 con 0x7f4298107530 2024-09-05T01:15:16.743 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.386+0000 7f429da00640 1 --2- 172.21.15.12:0/1086885197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4298107530 0x7f429819d7b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f428c02acc0 tx=0x7f428c031cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:16.743 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.386+0000 7f4296000640 1 -- 172.21.15.12:0/1086885197 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f428c036050 con 0x7f4298107530 2024-09-05T01:15:16.743 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.386+0000 7f4296000640 1 -- 172.21.15.12:0/1086885197 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f428c037040 con 0x7f4298107530 2024-09-05T01:15:16.744 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.386+0000 7f429ee00640 1 -- 172.21.15.12:0/1086885197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f429819df80 con 0x7f4298107530 2024-09-05T01:15:16.744 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.386+0000 7f4296000640 1 -- 172.21.15.12:0/1086885197 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f428c03b890 con 0x7f4298107530 2024-09-05T01:15:16.744 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.387+0000 7f429ee00640 1 -- 172.21.15.12:0/1086885197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42981a0c70 con 0x7f4298107530 2024-09-05T01:15:16.744 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.388+0000 7f4296000640 1 -- 172.21.15.12:0/1086885197 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f428c044020 con 0x7f4298107530 2024-09-05T01:15:16.744 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.388+0000 7f429ee00640 1 -- 172.21.15.12:0/1086885197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f429810bc60 con 0x7f4298107530 2024-09-05T01:15:16.744 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.388+0000 7f4296000640 1 --2- 172.21.15.12:0/1086885197 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f4280038f70 0x7f428003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:16.744 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.388+0000 7f4296000640 1 -- 172.21.15.12:0/1086885197 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f428c042020 con 0x7f4298107530 2024-09-05T01:15:16.744 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.388+0000 7f429d000640 1 --2- 172.21.15.12:0/1086885197 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f4280038f70 0x7f428003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:16.744 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.389+0000 7f429d000640 1 --2- 172.21.15.12:0/1086885197 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f4280038f70 0x7f428003b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f42840098c0 tx=0x7f4284006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:16.744 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.393+0000 7f4296000640 1 -- 172.21.15.12:0/1086885197 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f428c04b020 con 0x7f4298107530 2024-09-05T01:15:16.744 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.630+0000 7f429ee00640 1 -- 172.21.15.12:0/1086885197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f42981a0e40 con 0x7f4298107530 2024-09-05T01:15:16.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:15.998+0000 7f4296000640 1 -- 172.21.15.12:0/1086885197 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f428c038da0 con 0x7f4298107530 2024-09-05T01:15:16.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:16.000+0000 7f4296000640 1 -- 172.21.15.12:0/1086885197 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f428c03d450 con 0x7f4298107530 2024-09-05T01:15:16.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:16.002+0000 7f429ee00640 1 -- 172.21.15.12:0/1086885197 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f4280038f70 msgr2=0x7f428003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:16.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:16.002+0000 7f429ee00640 1 --2- 172.21.15.12:0/1086885197 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f4280038f70 0x7f428003b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f42840098c0 tx=0x7f4284006db0 comp rx=0 tx=0).stop 2024-09-05T01:15:16.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:16.002+0000 7f429ee00640 1 -- 172.21.15.12:0/1086885197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4298107530 msgr2=0x7f429819d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:16.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:16.002+0000 7f429ee00640 1 --2- 172.21.15.12:0/1086885197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4298107530 0x7f429819d7b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f428c02acc0 tx=0x7f428c031cc0 comp rx=0 tx=0).stop 2024-09-05T01:15:16.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:16.002+0000 7f429ee00640 1 -- 172.21.15.12:0/1086885197 shutdown_connections 2024-09-05T01:15:16.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:16.002+0000 7f429ee00640 1 --2- 172.21.15.12:0/1086885197 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7f4280038f70 0x7f428003b430 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:16.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:16.002+0000 7f429ee00640 1 --2- 172.21.15.12:0/1086885197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4298107530 0x7f429819d7b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:16.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:16.002+0000 7f429ee00640 1 -- 172.21.15.12:0/1086885197 >> 172.21.15.12:0/1086885197 conn(0x7f4298102ce0 msgr2=0x7f4298103810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:16.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:16.002+0000 7f429ee00640 1 -- 172.21.15.12:0/1086885197 shutdown_connections 2024-09-05T01:15:16.745 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:16.003+0000 7f429ee00640 1 -- 172.21.15.12:0/1086885197 wait complete. 2024-09-05T01:15:16.772 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:16 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:16.592+0000 7f31b59da040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-05T01:15:17.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:17 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/1086885197' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-05T01:15:17.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:17 smithi012 ceph-mon[29942]: mgrmap e9: x(active, since 21s) 2024-09-05T01:15:17.062 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:16 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:16.771+0000 7f31b59da040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-05T01:15:17.062 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:16 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:16.943+0000 7f31b59da040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-05T01:15:17.363 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:17 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:17.333+0000 7f31b59da040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-05T01:15:17.638 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:17 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:17.411+0000 7f31b59da040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-05T01:15:17.638 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:17 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:17.636+0000 7f31b59da040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-05T01:15:18.311 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:18 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2867527658' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-05T01:15:18.519 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-05T01:15:18.519 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-05T01:15:18.519 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-05T01:15:18.519 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-05T01:15:18.519 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-05T01:15:18.519 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-05T01:15:18.520 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.584+0000 7fdaf3e00640 1 Processor -- start 2024-09-05T01:15:18.520 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.584+0000 7fdaf3e00640 1 -- start start 2024-09-05T01:15:18.520 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.585+0000 7fdaf3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdaf4107530 0x7fdaf4107930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:18.520 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.585+0000 7fdaf3e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf4107f00 con 0x7fdaf4107530 2024-09-05T01:15:18.520 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.585+0000 7fdaf2a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdaf4107530 0x7fdaf4107930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:18.520 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.585+0000 7fdaf2a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdaf4107530 0x7fdaf4107930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36990/0 (socket says 172.21.15.12:36990) 2024-09-05T01:15:18.520 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.585+0000 7fdaf2a00640 1 -- 172.21.15.12:0/2695008448 learned_addr learned my addr 172.21.15.12:0/2695008448 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:18.520 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.586+0000 7fdaf2a00640 1 -- 172.21.15.12:0/2695008448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf4108730 con 0x7fdaf4107530 2024-09-05T01:15:18.520 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.587+0000 7fdaf2a00640 1 --2- 172.21.15.12:0/2695008448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdaf4107530 0x7fdaf4107930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdae4009820 tx=0x7fdae402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8151564780abd75c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:18.520 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.588+0000 7fdaf2000640 1 -- 172.21.15.12:0/2695008448 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdae4037070 con 0x7fdaf4107530 2024-09-05T01:15:18.520 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.588+0000 7fdaf2000640 1 -- 172.21.15.12:0/2695008448 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdae4032920 con 0x7fdaf4107530 2024-09-05T01:15:18.520 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.588+0000 7fdaf2000640 1 -- 172.21.15.12:0/2695008448 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdae4030810 con 0x7fdaf4107530 2024-09-05T01:15:18.520 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.588+0000 7fdaf3e00640 1 -- 172.21.15.12:0/2695008448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdaf4107530 msgr2=0x7fdaf4107930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:18.521 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.588+0000 7fdaf3e00640 1 --2- 172.21.15.12:0/2695008448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdaf4107530 0x7fdaf4107930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdae4009820 tx=0x7fdae402a270 comp rx=0 tx=0).stop 2024-09-05T01:15:18.521 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.589+0000 7fdaf3e00640 1 -- 172.21.15.12:0/2695008448 shutdown_connections 2024-09-05T01:15:18.521 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.589+0000 7fdaf3e00640 1 --2- 172.21.15.12:0/2695008448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdaf4107530 0x7fdaf4107930 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:18.521 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.589+0000 7fdaf3e00640 1 -- 172.21.15.12:0/2695008448 >> 172.21.15.12:0/2695008448 conn(0x7fdaf4102ce0 msgr2=0x7fdaf4105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:18.521 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.589+0000 7fdaf3e00640 1 -- 172.21.15.12:0/2695008448 shutdown_connections 2024-09-05T01:15:18.521 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.589+0000 7fdaf3e00640 1 -- 172.21.15.12:0/2695008448 wait complete. 2024-09-05T01:15:18.521 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.590+0000 7fdaf3e00640 1 Processor -- start 2024-09-05T01:15:18.521 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.590+0000 7fdaf3e00640 1 -- start start 2024-09-05T01:15:18.521 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.590+0000 7fdaf3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdaf4107530 0x7fdaf419d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:18.521 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.590+0000 7fdaf3e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf410bae0 con 0x7fdaf4107530 2024-09-05T01:15:18.521 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.590+0000 7fdaf2a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdaf4107530 0x7fdaf419d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:18.521 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.590+0000 7fdaf2a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdaf4107530 0x7fdaf419d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36992/0 (socket says 172.21.15.12:36992) 2024-09-05T01:15:18.521 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.591+0000 7fdaf2a00640 1 -- 172.21.15.12:0/2867527658 learned_addr learned my addr 172.21.15.12:0/2867527658 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:18.522 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.591+0000 7fdaf2a00640 1 -- 172.21.15.12:0/2867527658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf419dcf0 con 0x7fdaf4107530 2024-09-05T01:15:18.522 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.591+0000 7fdaf2a00640 1 --2- 172.21.15.12:0/2867527658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdaf4107530 0x7fdaf419d7b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdae40097f0 tx=0x7fdae40327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:18.522 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.592+0000 7fdaeb400640 1 -- 172.21.15.12:0/2867527658 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdae4037040 con 0x7fdaf4107530 2024-09-05T01:15:18.522 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.592+0000 7fdaeb400640 1 -- 172.21.15.12:0/2867527658 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdae4030cc0 con 0x7fdaf4107530 2024-09-05T01:15:18.522 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.592+0000 7fdaf3e00640 1 -- 172.21.15.12:0/2867527658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaf419df80 con 0x7fdaf4107530 2024-09-05T01:15:18.522 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.592+0000 7fdaeb400640 1 -- 172.21.15.12:0/2867527658 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdae403a640 con 0x7fdaf4107530 2024-09-05T01:15:18.522 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.592+0000 7fdaf3e00640 1 -- 172.21.15.12:0/2867527658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaf41a0c70 con 0x7fdaf4107530 2024-09-05T01:15:18.522 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.593+0000 7fdaf3e00640 1 -- 172.21.15.12:0/2867527658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaf410bc60 con 0x7fdaf4107530 2024-09-05T01:15:18.522 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.593+0000 7fdaeb400640 1 -- 172.21.15.12:0/2867527658 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fdae403b3f0 con 0x7fdaf4107530 2024-09-05T01:15:18.522 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.594+0000 7fdaeb400640 1 --2- 172.21.15.12:0/2867527658 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fdad8038fc0 0x7fdad803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:18.522 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.594+0000 7fdaeb400640 1 -- 172.21.15.12:0/2867527658 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fdae406c610 con 0x7fdaf4107530 2024-09-05T01:15:18.522 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.594+0000 7fdaebe00640 1 -- 172.21.15.12:0/2867527658 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fdad8038fc0 msgr2=0x7fdad803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/4067110310 2024-09-05T01:15:18.522 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.594+0000 7fdaebe00640 1 --2- 172.21.15.12:0/2867527658 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fdad8038fc0 0x7fdad803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T01:15:18.523 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.599+0000 7fdaeb400640 1 -- 172.21.15.12:0/2867527658 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdae4042e10 con 0x7fdaf4107530 2024-09-05T01:15:18.523 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.795+0000 7fdaebe00640 1 -- 172.21.15.12:0/2867527658 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fdad8038fc0 msgr2=0x7fdad803b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/4067110310 2024-09-05T01:15:18.523 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.795+0000 7fdaebe00640 1 --2- 172.21.15.12:0/2867527658 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fdad8038fc0 0x7fdad803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-05T01:15:18.523 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.834+0000 7fdaf3e00640 1 -- 172.21.15.12:0/2867527658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fdaf41a0e40 con 0x7fdaf4107530 2024-09-05T01:15:18.523 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.834+0000 7fdaeb400640 1 -- 172.21.15.12:0/2867527658 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fdae4043de0 con 0x7fdaf4107530 2024-09-05T01:15:18.523 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.837+0000 7fdaf3e00640 1 -- 172.21.15.12:0/2867527658 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fdad8038fc0 msgr2=0x7fdad803b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T01:15:18.523 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.837+0000 7fdaf3e00640 1 --2- 172.21.15.12:0/2867527658 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fdad8038fc0 0x7fdad803b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:18.523 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.837+0000 7fdaf3e00640 1 -- 172.21.15.12:0/2867527658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdaf4107530 msgr2=0x7fdaf419d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:18.523 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.837+0000 7fdaf3e00640 1 --2- 172.21.15.12:0/2867527658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdaf4107530 0x7fdaf419d7b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdae40097f0 tx=0x7fdae40327b0 comp rx=0 tx=0).stop 2024-09-05T01:15:18.523 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.837+0000 7fdaf3e00640 1 -- 172.21.15.12:0/2867527658 shutdown_connections 2024-09-05T01:15:18.523 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.837+0000 7fdaf3e00640 1 --2- 172.21.15.12:0/2867527658 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fdad8038fc0 0x7fdad803b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:18.523 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.837+0000 7fdaf3e00640 1 --2- 172.21.15.12:0/2867527658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdaf4107530 0x7fdaf419d7b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:18.523 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.837+0000 7fdaf3e00640 1 -- 172.21.15.12:0/2867527658 >> 172.21.15.12:0/2867527658 conn(0x7fdaf4102ce0 msgr2=0x7fdaf4103810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:18.524 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.837+0000 7fdaf3e00640 1 -- 172.21.15.12:0/2867527658 shutdown_connections 2024-09-05T01:15:18.524 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:17.837+0000 7fdaf3e00640 1 -- 172.21.15.12:0/2867527658 wait complete. 2024-09-05T01:15:18.524 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for the mgr to restart... 2024-09-05T01:15:18.524 INFO:teuthology.orchestra.run.smithi012.stdout:Waiting for mgr epoch 9... 2024-09-05T01:15:19.057 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:18 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:18.787+0000 7f31b59da040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-05T01:15:19.057 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:18 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:18.875+0000 7f31b59da040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-05T01:15:19.967 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:19 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:19.825+0000 7f31b59da040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-05T01:15:19.967 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:19 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:19.966+0000 7f31b59da040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-05T01:15:20.312 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:20 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:20.135+0000 7f31b59da040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-05T01:15:20.312 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:20 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:20.210+0000 7f31b59da040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-05T01:15:20.734 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:20 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:20.387+0000 7f31b59da040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-05T01:15:20.734 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:20 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:20.472+0000 7f31b59da040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-05T01:15:20.734 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:20 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:20.546+0000 7f31b59da040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-05T01:15:20.734 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:20 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:20.733+0000 7f31b59da040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-05T01:15:20.997 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:20 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:20.813+0000 7f31b59da040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-05T01:15:20.997 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:20 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:20.895+0000 7f31b59da040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-05T01:15:20.997 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:20 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:20.996+0000 7f31b59da040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-05T01:15:21.312 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:21 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:21.069+0000 7f31b59da040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-05T01:15:21.312 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:21 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:21.141+0000 7f31b59da040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-05T01:15:22.359 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:22 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:22.090+0000 7f31b59da040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-05T01:15:22.360 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:22 smithi012 ceph-mon[29942]: Active manager daemon x restarted 2024-09-05T01:15:22.360 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:22 smithi012 ceph-mon[29942]: Activating manager daemon x 2024-09-05T01:15:22.360 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:22 smithi012 ceph-mon[29942]: osdmap e3: 0 total, 0 up, 0 in 2024-09-05T01:15:22.360 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:22 smithi012 ceph-mon[29942]: mgrmap e10: x(active, starting, since 0.00394091s) 2024-09-05T01:15:22.360 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T01:15:22.360 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-05T01:15:22.360 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-05T01:15:22.360 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-05T01:15:22.360 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-05T01:15:22.360 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:22 smithi012 ceph-mon[29942]: Manager daemon x is now available 2024-09-05T01:15:22.360 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:15:23.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:23 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-05T01:15:23.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:23 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-05T01:15:23.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:23 smithi012 ceph-mon[29942]: mgrmap e11: x(active, since 1.00685s) 2024-09-05T01:15:23.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:23 smithi012 ceph-mon[29942]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-05T01:15:23.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:23 smithi012 ceph-mon[29942]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-05T01:15:24.367 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout { 2024-09-05T01:15:24.368 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-05T01:15:24.368 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-05T01:15:24.368 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout } 2024-09-05T01:15:24.368 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.083+0000 7fa202200640 1 Processor -- start 2024-09-05T01:15:24.368 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.084+0000 7fa202200640 1 -- start start 2024-09-05T01:15:24.368 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.084+0000 7fa202200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1fc1098f0 0x7fa1fc109cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:24.368 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.084+0000 7fa202200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc10a2c0 con 0x7fa1fc1098f0 2024-09-05T01:15:24.368 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.084+0000 7fa1fb400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1fc1098f0 0x7fa1fc109cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:24.368 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.084+0000 7fa1fb400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1fc1098f0 0x7fa1fc109cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36996/0 (socket says 172.21.15.12:36996) 2024-09-05T01:15:24.368 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.084+0000 7fa1fb400640 1 -- 172.21.15.12:0/3618859691 learned_addr learned my addr 172.21.15.12:0/3618859691 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:24.368 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.085+0000 7fa1fb400640 1 -- 172.21.15.12:0/3618859691 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1fc10ab10 con 0x7fa1fc1098f0 2024-09-05T01:15:24.369 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.086+0000 7fa1fb400640 1 --2- 172.21.15.12:0/3618859691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1fc1098f0 0x7fa1fc109cf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec009820 tx=0x7fa1ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43bd2043dc2f2a17 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:24.369 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.086+0000 7fa1fa000640 1 -- 172.21.15.12:0/3618859691 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1ec037070 con 0x7fa1fc1098f0 2024-09-05T01:15:24.369 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.086+0000 7fa1fa000640 1 -- 172.21.15.12:0/3618859691 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1ec032920 con 0x7fa1fc1098f0 2024-09-05T01:15:24.369 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.086+0000 7fa1fa000640 1 -- 172.21.15.12:0/3618859691 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1ec030810 con 0x7fa1fc1098f0 2024-09-05T01:15:24.369 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.086+0000 7fa202200640 1 -- 172.21.15.12:0/3618859691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1fc1098f0 msgr2=0x7fa1fc109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:24.369 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.086+0000 7fa202200640 1 --2- 172.21.15.12:0/3618859691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1fc1098f0 0x7fa1fc109cf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec009820 tx=0x7fa1ec02a270 comp rx=0 tx=0).stop 2024-09-05T01:15:24.369 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.087+0000 7fa202200640 1 -- 172.21.15.12:0/3618859691 shutdown_connections 2024-09-05T01:15:24.369 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.087+0000 7fa202200640 1 --2- 172.21.15.12:0/3618859691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1fc1098f0 0x7fa1fc109cf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:24.369 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.087+0000 7fa202200640 1 -- 172.21.15.12:0/3618859691 >> 172.21.15.12:0/3618859691 conn(0x7fa1fc07ceb0 msgr2=0x7fa1fc07d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:24.369 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.087+0000 7fa202200640 1 -- 172.21.15.12:0/3618859691 shutdown_connections 2024-09-05T01:15:24.369 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.087+0000 7fa202200640 1 -- 172.21.15.12:0/3618859691 wait complete. 2024-09-05T01:15:24.370 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.088+0000 7fa202200640 1 Processor -- start 2024-09-05T01:15:24.370 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.088+0000 7fa202200640 1 -- start start 2024-09-05T01:15:24.370 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.088+0000 7fa202200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1fc1098f0 0x7fa1fc19d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:24.370 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.088+0000 7fa202200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc10dec0 con 0x7fa1fc1098f0 2024-09-05T01:15:24.370 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.088+0000 7fa1fb400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1fc1098f0 0x7fa1fc19d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:24.370 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.088+0000 7fa1fb400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1fc1098f0 0x7fa1fc19d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37006/0 (socket says 172.21.15.12:37006) 2024-09-05T01:15:24.370 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.088+0000 7fa1fb400640 1 -- 172.21.15.12:0/1614544377 learned_addr learned my addr 172.21.15.12:0/1614544377 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:24.370 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.089+0000 7fa1fb400640 1 -- 172.21.15.12:0/1614544377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1fc19de70 con 0x7fa1fc1098f0 2024-09-05T01:15:24.370 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.089+0000 7fa1fb400640 1 --2- 172.21.15.12:0/1614544377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1fc1098f0 0x7fa1fc19d930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec030380 tx=0x7fa1ec032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:24.370 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.089+0000 7fa1f3e00640 1 -- 172.21.15.12:0/1614544377 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1ec037040 con 0x7fa1fc1098f0 2024-09-05T01:15:24.370 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.089+0000 7fa1f3e00640 1 -- 172.21.15.12:0/1614544377 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1ec040070 con 0x7fa1fc1098f0 2024-09-05T01:15:24.370 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.089+0000 7fa1f3e00640 1 -- 172.21.15.12:0/1614544377 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1ec03a7b0 con 0x7fa1fc1098f0 2024-09-05T01:15:24.371 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.089+0000 7fa202200640 1 -- 172.21.15.12:0/1614544377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1fc19e100 con 0x7fa1fc1098f0 2024-09-05T01:15:24.371 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.090+0000 7fa202200640 1 -- 172.21.15.12:0/1614544377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1fc1a0df0 con 0x7fa1fc1098f0 2024-09-05T01:15:24.371 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.091+0000 7fa1f3e00640 1 -- 172.21.15.12:0/1614544377 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fa1ec03b420 con 0x7fa1fc1098f0 2024-09-05T01:15:24.371 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.091+0000 7fa1f3e00640 1 --2- 172.21.15.12:0/1614544377 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fa1e0039020 0x7fa1e003b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:24.371 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.091+0000 7fa1f3e00640 1 -- 172.21.15.12:0/1614544377 --> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa1e003bbf0 con 0x7fa1e0039020 2024-09-05T01:15:24.371 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.091+0000 7fa1f3e00640 1 -- 172.21.15.12:0/1614544377 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa1ec06c6f0 con 0x7fa1fc1098f0 2024-09-05T01:15:24.371 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.091+0000 7fa1faa00640 1 -- 172.21.15.12:0/1614544377 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fa1e0039020 msgr2=0x7fa1e003b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/4067110310 2024-09-05T01:15:24.371 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.091+0000 7fa1faa00640 1 --2- 172.21.15.12:0/1614544377 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fa1e0039020 0x7fa1e003b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T01:15:24.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.292+0000 7fa1faa00640 1 -- 172.21.15.12:0/1614544377 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fa1e0039020 msgr2=0x7fa1e003b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/4067110310 2024-09-05T01:15:24.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.292+0000 7fa1faa00640 1 --2- 172.21.15.12:0/1614544377 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fa1e0039020 0x7fa1e003b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-05T01:15:24.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.693+0000 7fa1faa00640 1 -- 172.21.15.12:0/1614544377 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fa1e0039020 msgr2=0x7fa1e003b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/4067110310 2024-09-05T01:15:24.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:19.693+0000 7fa1faa00640 1 --2- 172.21.15.12:0/1614544377 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fa1e0039020 0x7fa1e003b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-05T01:15:24.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:20.494+0000 7fa1faa00640 1 -- 172.21.15.12:0/1614544377 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fa1e0039020 msgr2=0x7fa1e003b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/4067110310 2024-09-05T01:15:24.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:20.494+0000 7fa1faa00640 1 --2- 172.21.15.12:0/1614544377 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fa1e0039020 0x7fa1e003b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-05T01:15:24.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:22.095+0000 7fa1faa00640 1 -- 172.21.15.12:0/1614544377 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fa1e0039020 msgr2=0x7fa1e003b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/4067110310 2024-09-05T01:15:24.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:22.095+0000 7fa1faa00640 1 --2- 172.21.15.12:0/1614544377 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fa1e0039020 0x7fa1e003b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-05T01:15:24.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:22.095+0000 7fa1f3e00640 1 -- 172.21.15.12:0/1614544377 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7fa1ec03bc00 con 0x7fa1fc1098f0 2024-09-05T01:15:24.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:22.095+0000 7fa1f3e00640 1 -- 172.21.15.12:0/1614544377 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fa1e0039020 msgr2=0x7fa1e003b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T01:15:24.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:22.095+0000 7fa1f3e00640 1 --2- 172.21.15.12:0/1614544377 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fa1e0039020 0x7fa1e003b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:24.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:23.096+0000 7fa1f3e00640 1 -- 172.21.15.12:0/1614544377 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7fa1ec031750 con 0x7fa1fc1098f0 2024-09-05T01:15:24.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:23.097+0000 7fa1f3e00640 1 --2- 172.21.15.12:0/1614544377 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa1e003cae0 0x7fa1e003eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:24.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:23.097+0000 7fa1f3e00640 1 -- 172.21.15.12:0/1614544377 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa1e003bbf0 con 0x7fa1e003cae0 2024-09-05T01:15:24.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:23.097+0000 7fa1faa00640 1 --2- 172.21.15.12:0/1614544377 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa1e003cae0 0x7fa1e003eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:24.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:23.099+0000 7fa1faa00640 1 --2- 172.21.15.12:0/1614544377 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa1e003cae0 0x7fa1e003eed0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8003980 tx=0x7fa1e80092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:24.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:23.100+0000 7fa1f3e00640 1 -- 172.21.15.12:0/1614544377 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fa1e003bbf0 con 0x7fa1e003cae0 2024-09-05T01:15:24.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:23.107+0000 7fa202200640 1 -- 172.21.15.12:0/1614544377 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fa1fc109d70 con 0x7fa1e003cae0 2024-09-05T01:15:24.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:23.107+0000 7fa1f3e00640 1 -- 172.21.15.12:0/1614544377 <== mgr.14150 v2:172.21.15.12:6800/2664180840 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7fa1fc109d70 con 0x7fa1e003cae0 2024-09-05T01:15:24.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:23.108+0000 7fa202200640 1 -- 172.21.15.12:0/1614544377 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa1e003cae0 msgr2=0x7fa1e003eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:24.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:23.108+0000 7fa202200640 1 --2- 172.21.15.12:0/1614544377 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa1e003cae0 0x7fa1e003eed0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8003980 tx=0x7fa1e80092b0 comp rx=0 tx=0).stop 2024-09-05T01:15:24.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:23.108+0000 7fa202200640 1 -- 172.21.15.12:0/1614544377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1fc1098f0 msgr2=0x7fa1fc19d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:24.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:23.108+0000 7fa202200640 1 --2- 172.21.15.12:0/1614544377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1fc1098f0 0x7fa1fc19d930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec030380 tx=0x7fa1ec032670 comp rx=0 tx=0).stop 2024-09-05T01:15:24.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:23.108+0000 7fa202200640 1 -- 172.21.15.12:0/1614544377 shutdown_connections 2024-09-05T01:15:24.373 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:23.108+0000 7fa202200640 1 --2- 172.21.15.12:0/1614544377 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa1e003cae0 0x7fa1e003eed0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:24.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:23.108+0000 7fa202200640 1 --2- 172.21.15.12:0/1614544377 >> [v2:172.21.15.12:6800/4067110310,v1:172.21.15.12:6801/4067110310] conn(0x7fa1e0039020 0x7fa1e003b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:24.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:23.108+0000 7fa202200640 1 --2- 172.21.15.12:0/1614544377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1fc1098f0 0x7fa1fc19d930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:24.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:23.108+0000 7fa202200640 1 -- 172.21.15.12:0/1614544377 >> 172.21.15.12:0/1614544377 conn(0x7fa1fc07ceb0 msgr2=0x7fa1fc107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:24.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:23.108+0000 7fa202200640 1 -- 172.21.15.12:0/1614544377 shutdown_connections 2024-09-05T01:15:24.374 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:23.108+0000 7fa202200640 1 -- 172.21.15.12:0/1614544377 wait complete. 2024-09-05T01:15:24.374 INFO:teuthology.orchestra.run.smithi012.stdout:mgr epoch 9 is available 2024-09-05T01:15:24.374 INFO:teuthology.orchestra.run.smithi012.stdout:Generating a dashboard self-signed certificate... 2024-09-05T01:15:24.549 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:24 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:24.261+0000 7f3112200640 -1 log_channel(cephadm) log [ERR] : [05/Sep/2024:01:15:24] ENGINE Error in HTTPServer.serve 2024-09-05T01:15:24.549 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:24 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: Traceback (most recent call last): 2024-09-05T01:15:24.549 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:24 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-05T01:15:24.549 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:24 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: self._connections.run(self.expiration_interval) 2024-09-05T01:15:24.549 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:24 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-05T01:15:24.549 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:24 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: self._run(expiration_interval) 2024-09-05T01:15:24.549 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:24 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-05T01:15:24.549 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:24 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: new_conn = self._from_server_socket(self.server.socket) 2024-09-05T01:15:24.549 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:24 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-05T01:15:24.550 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:24 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-05T01:15:24.550 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:24 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-05T01:15:24.550 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:24 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: s = self.context.wrap_socket( 2024-09-05T01:15:24.550 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:24 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-05T01:15:24.550 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:24 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: return self.sslsocket_class._create( 2024-09-05T01:15:24.550 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:24 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-05T01:15:24.550 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:24 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: self.do_handshake() 2024-09-05T01:15:24.550 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:24 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-05T01:15:24.550 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:24 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: self._sslobj.do_handshake() 2024-09-05T01:15:24.550 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:24 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-05T01:15:24.550 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:15:24 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:15:25.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:25 smithi012 ceph-mon[29942]: [05/Sep/2024:01:15:24] ENGINE Bus STARTING 2024-09-05T01:15:25.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:25 smithi012 ceph-mon[29942]: mgrmap e12: x(active, since 2s) 2024-09-05T01:15:25.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:25 smithi012 ceph-mon[29942]: [05/Sep/2024:01:15:24] ENGINE Serving on https://172.21.15.12:7150 2024-09-05T01:15:25.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:25 smithi012 ceph-mon[29942]: [05/Sep/2024:01:15:24] ENGINE Error in HTTPServer.serve 2024-09-05T01:15:25.562 INFO:journalctl@ceph.mon.a.smithi012.stdout: Traceback (most recent call last): 2024-09-05T01:15:25.563 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-05T01:15:25.563 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._connections.run(self.expiration_interval) 2024-09-05T01:15:25.563 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-05T01:15:25.563 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._run(expiration_interval) 2024-09-05T01:15:25.563 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-05T01:15:25.563 INFO:journalctl@ceph.mon.a.smithi012.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-05T01:15:25.564 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-05T01:15:25.564 INFO:journalctl@ceph.mon.a.smithi012.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-05T01:15:25.564 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-05T01:15:25.564 INFO:journalctl@ceph.mon.a.smithi012.stdout: s = self.context.wrap_socket( 2024-09-05T01:15:25.564 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-05T01:15:25.564 INFO:journalctl@ceph.mon.a.smithi012.stdout: return self.sslsocket_class._create( 2024-09-05T01:15:25.564 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-05T01:15:25.565 INFO:journalctl@ceph.mon.a.smithi012.stdout: self.do_handshake() 2024-09-05T01:15:25.565 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-05T01:15:25.565 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._sslobj.do_handshake() 2024-09-05T01:15:25.565 INFO:journalctl@ceph.mon.a.smithi012.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-05T01:15:25.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:25 smithi012 ceph-mon[29942]: [05/Sep/2024:01:15:24] ENGINE Serving on http://172.21.15.12:8765 2024-09-05T01:15:25.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:25 smithi012 ceph-mon[29942]: [05/Sep/2024:01:15:24] ENGINE Bus STARTED 2024-09-05T01:15:25.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:25 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:25.936 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-05T01:15:25.936 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.921+0000 7f79a5600640 1 Processor -- start 2024-09-05T01:15:25.936 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.922+0000 7f79a5600640 1 -- start start 2024-09-05T01:15:25.936 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.922+0000 7f79a5600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79a01098f0 0x7f79a0109cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:25.937 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.922+0000 7f79a5600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f79a010a2c0 con 0x7f79a01098f0 2024-09-05T01:15:25.937 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.922+0000 7f799ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79a01098f0 0x7f79a0109cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:25.937 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.922+0000 7f799ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79a01098f0 0x7f79a0109cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37068/0 (socket says 172.21.15.12:37068) 2024-09-05T01:15:25.937 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.922+0000 7f799ea00640 1 -- 172.21.15.12:0/3250021455 learned_addr learned my addr 172.21.15.12:0/3250021455 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:25.937 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.923+0000 7f799ea00640 1 -- 172.21.15.12:0/3250021455 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a010ab10 con 0x7f79a01098f0 2024-09-05T01:15:25.938 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.924+0000 7f799ea00640 1 --2- 172.21.15.12:0/3250021455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79a01098f0 0x7f79a0109cf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7990009820 tx=0x7f799002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6dcb62aed0805e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:25.938 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.924+0000 7f799d600640 1 -- 172.21.15.12:0/3250021455 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7990037070 con 0x7f79a01098f0 2024-09-05T01:15:25.938 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.924+0000 7f799d600640 1 -- 172.21.15.12:0/3250021455 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7990032920 con 0x7f79a01098f0 2024-09-05T01:15:25.938 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.924+0000 7f799d600640 1 -- 172.21.15.12:0/3250021455 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7990030810 con 0x7f79a01098f0 2024-09-05T01:15:25.939 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.925+0000 7f79a5600640 1 -- 172.21.15.12:0/3250021455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79a01098f0 msgr2=0x7f79a0109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:25.939 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.925+0000 7f79a5600640 1 --2- 172.21.15.12:0/3250021455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79a01098f0 0x7f79a0109cf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7990009820 tx=0x7f799002a270 comp rx=0 tx=0).stop 2024-09-05T01:15:25.939 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.925+0000 7f79a5600640 1 -- 172.21.15.12:0/3250021455 shutdown_connections 2024-09-05T01:15:25.939 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.925+0000 7f79a5600640 1 --2- 172.21.15.12:0/3250021455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79a01098f0 0x7f79a0109cf0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:25.939 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.925+0000 7f79a5600640 1 -- 172.21.15.12:0/3250021455 >> 172.21.15.12:0/3250021455 conn(0x7f79a007ceb0 msgr2=0x7f79a007d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:25.940 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.925+0000 7f79a5600640 1 -- 172.21.15.12:0/3250021455 shutdown_connections 2024-09-05T01:15:25.940 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.925+0000 7f79a5600640 1 -- 172.21.15.12:0/3250021455 wait complete. 2024-09-05T01:15:25.940 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.926+0000 7f79a5600640 1 Processor -- start 2024-09-05T01:15:25.940 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.926+0000 7f79a5600640 1 -- start start 2024-09-05T01:15:25.941 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.927+0000 7f79a5600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79a01098f0 0x7f79a019d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:25.941 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.927+0000 7f79a5600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f79a010dec0 con 0x7f79a01098f0 2024-09-05T01:15:25.941 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.927+0000 7f799ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79a01098f0 0x7f79a019d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:25.941 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.927+0000 7f799ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79a01098f0 0x7f79a019d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37074/0 (socket says 172.21.15.12:37074) 2024-09-05T01:15:25.941 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.927+0000 7f799ea00640 1 -- 172.21.15.12:0/2865574574 learned_addr learned my addr 172.21.15.12:0/2865574574 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:25.942 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.928+0000 7f799ea00640 1 -- 172.21.15.12:0/2865574574 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a019de70 con 0x7f79a01098f0 2024-09-05T01:15:25.942 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.928+0000 7f799ea00640 1 --2- 172.21.15.12:0/2865574574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79a01098f0 0x7f79a019d930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f79900097f0 tx=0x7f79900327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:25.942 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.928+0000 7f7997400640 1 -- 172.21.15.12:0/2865574574 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7990037040 con 0x7f79a01098f0 2024-09-05T01:15:25.942 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.928+0000 7f7997400640 1 -- 172.21.15.12:0/2865574574 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7990030cc0 con 0x7f79a01098f0 2024-09-05T01:15:25.942 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.928+0000 7f7997400640 1 -- 172.21.15.12:0/2865574574 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f799003a6b0 con 0x7f79a01098f0 2024-09-05T01:15:25.943 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.928+0000 7f79a5600640 1 -- 172.21.15.12:0/2865574574 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a019e100 con 0x7f79a01098f0 2024-09-05T01:15:25.943 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.928+0000 7f79a5600640 1 -- 172.21.15.12:0/2865574574 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a01a0df0 con 0x7f79a01098f0 2024-09-05T01:15:25.943 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.929+0000 7f7997400640 1 -- 172.21.15.12:0/2865574574 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f799003baf0 con 0x7f79a01098f0 2024-09-05T01:15:25.943 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.930+0000 7f7997400640 1 --2- 172.21.15.12:0/2865574574 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f7984039020 0x7f798403b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:25.943 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.930+0000 7f7997400640 1 -- 172.21.15.12:0/2865574574 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f799006c6b0 con 0x7f79a01098f0 2024-09-05T01:15:25.944 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.930+0000 7f79a5600640 1 -- 172.21.15.12:0/2865574574 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79a0109d70 con 0x7f79a01098f0 2024-09-05T01:15:25.944 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.930+0000 7f799e000640 1 --2- 172.21.15.12:0/2865574574 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f7984039020 0x7f798403b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:25.944 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.931+0000 7f799e000640 1 --2- 172.21.15.12:0/2865574574 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f7984039020 0x7f798403b4e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f798c0098c0 tx=0x7f798c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:25.944 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:24.936+0000 7f7997400640 1 -- 172.21.15.12:0/2865574574 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f79900371e0 con 0x7f79a01098f0 2024-09-05T01:15:25.944 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:25.131+0000 7f79a5600640 1 -- 172.21.15.12:0/2865574574 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f79a0107cb0 con 0x7f7984039020 2024-09-05T01:15:25.945 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:25.217+0000 7f7997400640 1 -- 172.21.15.12:0/2865574574 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f79a0107cb0 con 0x7f7984039020 2024-09-05T01:15:25.945 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:25.220+0000 7f79a5600640 1 -- 172.21.15.12:0/2865574574 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f7984039020 msgr2=0x7f798403b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:25.945 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:25.220+0000 7f79a5600640 1 --2- 172.21.15.12:0/2865574574 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f7984039020 0x7f798403b4e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f798c0098c0 tx=0x7f798c006db0 comp rx=0 tx=0).stop 2024-09-05T01:15:25.945 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:25.220+0000 7f79a5600640 1 -- 172.21.15.12:0/2865574574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79a01098f0 msgr2=0x7f79a019d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:25.946 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:25.220+0000 7f79a5600640 1 --2- 172.21.15.12:0/2865574574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79a01098f0 0x7f79a019d930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f79900097f0 tx=0x7f79900327b0 comp rx=0 tx=0).stop 2024-09-05T01:15:25.946 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:25.220+0000 7f79a5600640 1 -- 172.21.15.12:0/2865574574 shutdown_connections 2024-09-05T01:15:25.946 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:25.220+0000 7f79a5600640 1 --2- 172.21.15.12:0/2865574574 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f7984039020 0x7f798403b4e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:25.946 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:25.220+0000 7f79a5600640 1 --2- 172.21.15.12:0/2865574574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79a01098f0 0x7f79a019d930 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:25.946 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:25.220+0000 7f79a5600640 1 -- 172.21.15.12:0/2865574574 >> 172.21.15.12:0/2865574574 conn(0x7f79a007ceb0 msgr2=0x7f79a01075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:25.947 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:25.220+0000 7f79a5600640 1 -- 172.21.15.12:0/2865574574 shutdown_connections 2024-09-05T01:15:25.947 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:25.220+0000 7f79a5600640 1 -- 172.21.15.12:0/2865574574 wait complete. 2024-09-05T01:15:25.947 INFO:teuthology.orchestra.run.smithi012.stdout:Creating initial admin user... 2024-09-05T01:15:26.474 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:26 smithi012 ceph-mon[29942]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:15:26.474 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:26 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:26.474 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:26 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:26.474 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:26 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:28.225 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:27 smithi012 ceph-mon[29942]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:15:28.226 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:27 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:28.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$R6I/xUUdfPEszI6INq9ip.5teszFTqNZCqAcEhfxgJ.ckTOsilXKK", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1725498926, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-05T01:15:28.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.507+0000 7f6431800640 1 Processor -- start 2024-09-05T01:15:28.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.507+0000 7f6431800640 1 -- start start 2024-09-05T01:15:28.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.508+0000 7f6431800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f642c1098f0 0x7f642c109cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:28.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.508+0000 7f6431800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f642c10a2c0 con 0x7f642c1098f0 2024-09-05T01:15:28.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.508+0000 7f642aa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f642c1098f0 0x7f642c109cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:28.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.508+0000 7f642aa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f642c1098f0 0x7f642c109cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37078/0 (socket says 172.21.15.12:37078) 2024-09-05T01:15:28.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.508+0000 7f642aa00640 1 -- 172.21.15.12:0/1535591050 learned_addr learned my addr 172.21.15.12:0/1535591050 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:28.236 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.508+0000 7f642aa00640 1 -- 172.21.15.12:0/1535591050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642c10ab10 con 0x7f642c1098f0 2024-09-05T01:15:28.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.509+0000 7f642aa00640 1 --2- 172.21.15.12:0/1535591050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f642c1098f0 0x7f642c109cf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f641c009820 tx=0x7f641c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214fd19c7956108f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:28.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.510+0000 7f6429600640 1 -- 172.21.15.12:0/1535591050 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f641c037070 con 0x7f642c1098f0 2024-09-05T01:15:28.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.510+0000 7f6429600640 1 -- 172.21.15.12:0/1535591050 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f641c032920 con 0x7f642c1098f0 2024-09-05T01:15:28.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.510+0000 7f6429600640 1 -- 172.21.15.12:0/1535591050 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f641c030810 con 0x7f642c1098f0 2024-09-05T01:15:28.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.511+0000 7f6431800640 1 -- 172.21.15.12:0/1535591050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f642c1098f0 msgr2=0x7f642c109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:28.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.511+0000 7f6431800640 1 --2- 172.21.15.12:0/1535591050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f642c1098f0 0x7f642c109cf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f641c009820 tx=0x7f641c02a270 comp rx=0 tx=0).stop 2024-09-05T01:15:28.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.511+0000 7f6431800640 1 -- 172.21.15.12:0/1535591050 shutdown_connections 2024-09-05T01:15:28.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.511+0000 7f6431800640 1 --2- 172.21.15.12:0/1535591050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f642c1098f0 0x7f642c109cf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:28.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.511+0000 7f6431800640 1 -- 172.21.15.12:0/1535591050 >> 172.21.15.12:0/1535591050 conn(0x7f642c07ceb0 msgr2=0x7f642c07d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:28.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.511+0000 7f6431800640 1 -- 172.21.15.12:0/1535591050 shutdown_connections 2024-09-05T01:15:28.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.511+0000 7f6431800640 1 -- 172.21.15.12:0/1535591050 wait complete. 2024-09-05T01:15:28.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.512+0000 7f6431800640 1 Processor -- start 2024-09-05T01:15:28.237 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.512+0000 7f6431800640 1 -- start start 2024-09-05T01:15:28.238 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.512+0000 7f6431800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f642c1098f0 0x7f642c19d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:28.238 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.512+0000 7f6431800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f642c10dec0 con 0x7f642c1098f0 2024-09-05T01:15:28.238 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.512+0000 7f642aa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f642c1098f0 0x7f642c19d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:28.238 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.513+0000 7f642aa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f642c1098f0 0x7f642c19d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37094/0 (socket says 172.21.15.12:37094) 2024-09-05T01:15:28.238 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.513+0000 7f642aa00640 1 -- 172.21.15.12:0/680822685 learned_addr learned my addr 172.21.15.12:0/680822685 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:28.238 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.513+0000 7f642aa00640 1 -- 172.21.15.12:0/680822685 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642c19de50 con 0x7f642c1098f0 2024-09-05T01:15:28.238 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.513+0000 7f642aa00640 1 --2- 172.21.15.12:0/680822685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f642c1098f0 0x7f642c19d910 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f641c0097f0 tx=0x7f641c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:28.238 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.513+0000 7f6423400640 1 -- 172.21.15.12:0/680822685 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f641c037040 con 0x7f642c1098f0 2024-09-05T01:15:28.238 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.514+0000 7f6423400640 1 -- 172.21.15.12:0/680822685 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f641c030cc0 con 0x7f642c1098f0 2024-09-05T01:15:28.238 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.514+0000 7f6431800640 1 -- 172.21.15.12:0/680822685 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f642c19e0e0 con 0x7f642c1098f0 2024-09-05T01:15:28.238 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.514+0000 7f6423400640 1 -- 172.21.15.12:0/680822685 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f641c03a6b0 con 0x7f642c1098f0 2024-09-05T01:15:28.238 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.514+0000 7f6431800640 1 -- 172.21.15.12:0/680822685 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f642c1a0dd0 con 0x7f642c1098f0 2024-09-05T01:15:28.238 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.515+0000 7f6423400640 1 -- 172.21.15.12:0/680822685 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f641c03b3f0 con 0x7f642c1098f0 2024-09-05T01:15:28.238 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.515+0000 7f6431800640 1 -- 172.21.15.12:0/680822685 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f642c109d70 con 0x7f642c1098f0 2024-09-05T01:15:28.238 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.515+0000 7f6423400640 1 --2- 172.21.15.12:0/680822685 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6410038fc0 0x7f641003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:28.239 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.515+0000 7f6423400640 1 -- 172.21.15.12:0/680822685 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f641c06c690 con 0x7f642c1098f0 2024-09-05T01:15:28.239 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.516+0000 7f642a000640 1 --2- 172.21.15.12:0/680822685 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6410038fc0 0x7f641003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:28.239 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.516+0000 7f642a000640 1 --2- 172.21.15.12:0/680822685 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6410038fc0 0x7f641003b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f64180098c0 tx=0x7f6418006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:28.239 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.521+0000 7f6423400640 1 -- 172.21.15.12:0/680822685 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f641c040210 con 0x7f642c1098f0 2024-09-05T01:15:28.239 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.732+0000 7f6431800640 1 -- 172.21.15.12:0/680822685 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f642c19e5c0 con 0x7f6410038fc0 2024-09-05T01:15:28.239 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.983+0000 7f6423400640 1 -- 172.21.15.12:0/680822685 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f642c19e5c0 con 0x7f6410038fc0 2024-09-05T01:15:28.239 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.986+0000 7f6431800640 1 -- 172.21.15.12:0/680822685 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6410038fc0 msgr2=0x7f641003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:28.239 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.986+0000 7f6431800640 1 --2- 172.21.15.12:0/680822685 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6410038fc0 0x7f641003b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f64180098c0 tx=0x7f6418006db0 comp rx=0 tx=0).stop 2024-09-05T01:15:28.239 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.986+0000 7f6431800640 1 -- 172.21.15.12:0/680822685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f642c1098f0 msgr2=0x7f642c19d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:28.239 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.986+0000 7f6431800640 1 --2- 172.21.15.12:0/680822685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f642c1098f0 0x7f642c19d910 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f641c0097f0 tx=0x7f641c0327b0 comp rx=0 tx=0).stop 2024-09-05T01:15:28.239 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.986+0000 7f6431800640 1 -- 172.21.15.12:0/680822685 shutdown_connections 2024-09-05T01:15:28.239 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.986+0000 7f6431800640 1 --2- 172.21.15.12:0/680822685 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6410038fc0 0x7f641003b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:28.239 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.986+0000 7f6431800640 1 --2- 172.21.15.12:0/680822685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f642c1098f0 0x7f642c19d910 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:28.239 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.986+0000 7f6431800640 1 -- 172.21.15.12:0/680822685 >> 172.21.15.12:0/680822685 conn(0x7f642c07ceb0 msgr2=0x7f642c107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:28.240 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.986+0000 7f6431800640 1 -- 172.21.15.12:0/680822685 shutdown_connections 2024-09-05T01:15:28.240 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:26.986+0000 7f6431800640 1 -- 172.21.15.12:0/680822685 wait complete. 2024-09-05T01:15:28.240 INFO:teuthology.orchestra.run.smithi012.stdout:Fetching dashboard port number... 2024-09-05T01:15:29.002 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:28 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2989768055' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-05T01:15:29.586 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stdout 8443 2024-09-05T01:15:29.586 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.740+0000 7f1f1b200640 1 Processor -- start 2024-09-05T01:15:29.586 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.740+0000 7f1f1b200640 1 -- start start 2024-09-05T01:15:29.586 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.740+0000 7f1f1b200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f141098a0 0x7f1f14109ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:29.586 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.740+0000 7f1f1b200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1410a270 con 0x7f1f141098a0 2024-09-05T01:15:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.741+0000 7f1f19e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f141098a0 0x7f1f14109ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.741+0000 7f1f19e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f141098a0 0x7f1f14109ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36202/0 (socket says 172.21.15.12:36202) 2024-09-05T01:15:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.741+0000 7f1f19e00640 1 -- 172.21.15.12:0/3066766437 learned_addr learned my addr 172.21.15.12:0/3066766437 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.741+0000 7f1f19e00640 1 -- 172.21.15.12:0/3066766437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1410a960 con 0x7f1f141098a0 2024-09-05T01:15:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.742+0000 7f1f19e00640 1 --2- 172.21.15.12:0/3066766437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f141098a0 0x7f1f14109ca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1f08009820 tx=0x7f1f0802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661179dd726b4378 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.742+0000 7f1f18a00640 1 -- 172.21.15.12:0/3066766437 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f08037070 con 0x7f1f141098a0 2024-09-05T01:15:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.742+0000 7f1f18a00640 1 -- 172.21.15.12:0/3066766437 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f08032920 con 0x7f1f141098a0 2024-09-05T01:15:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.742+0000 7f1f18a00640 1 -- 172.21.15.12:0/3066766437 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f08030810 con 0x7f1f141098a0 2024-09-05T01:15:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.743+0000 7f1f1b200640 1 -- 172.21.15.12:0/3066766437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f141098a0 msgr2=0x7f1f14109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.743+0000 7f1f1b200640 1 --2- 172.21.15.12:0/3066766437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f141098a0 0x7f1f14109ca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1f08009820 tx=0x7f1f0802a270 comp rx=0 tx=0).stop 2024-09-05T01:15:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.743+0000 7f1f1b200640 1 -- 172.21.15.12:0/3066766437 shutdown_connections 2024-09-05T01:15:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.743+0000 7f1f1b200640 1 --2- 172.21.15.12:0/3066766437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f141098a0 0x7f1f14109ca0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:29.587 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.743+0000 7f1f1b200640 1 -- 172.21.15.12:0/3066766437 >> 172.21.15.12:0/3066766437 conn(0x7f1f1407cd40 msgr2=0x7f1f1407d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:29.588 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.743+0000 7f1f1b200640 1 -- 172.21.15.12:0/3066766437 shutdown_connections 2024-09-05T01:15:29.588 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.743+0000 7f1f1b200640 1 -- 172.21.15.12:0/3066766437 wait complete. 2024-09-05T01:15:29.588 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.744+0000 7f1f1b200640 1 Processor -- start 2024-09-05T01:15:29.588 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.744+0000 7f1f1b200640 1 -- start start 2024-09-05T01:15:29.588 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.744+0000 7f1f1b200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f141098a0 0x7f1f1419d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:29.588 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.744+0000 7f1f1b200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1410dd10 con 0x7f1f141098a0 2024-09-05T01:15:29.588 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.745+0000 7f1f19e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f141098a0 0x7f1f1419d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:29.588 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.745+0000 7f1f19e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f141098a0 0x7f1f1419d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36216/0 (socket says 172.21.15.12:36216) 2024-09-05T01:15:29.588 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.745+0000 7f1f19e00640 1 -- 172.21.15.12:0/2989768055 learned_addr learned my addr 172.21.15.12:0/2989768055 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:29.588 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.745+0000 7f1f19e00640 1 -- 172.21.15.12:0/2989768055 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1419dcd0 con 0x7f1f141098a0 2024-09-05T01:15:29.588 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.745+0000 7f1f19e00640 1 --2- 172.21.15.12:0/2989768055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f141098a0 0x7f1f1419d790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1f080097f0 tx=0x7f1f080327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:29.588 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.746+0000 7f1f0ea00640 1 -- 172.21.15.12:0/2989768055 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f08037040 con 0x7f1f141098a0 2024-09-05T01:15:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.746+0000 7f1f0ea00640 1 -- 172.21.15.12:0/2989768055 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f08030cc0 con 0x7f1f141098a0 2024-09-05T01:15:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.746+0000 7f1f1b200640 1 -- 172.21.15.12:0/2989768055 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1419df60 con 0x7f1f141098a0 2024-09-05T01:15:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.746+0000 7f1f0ea00640 1 -- 172.21.15.12:0/2989768055 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f0803a640 con 0x7f1f141098a0 2024-09-05T01:15:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.746+0000 7f1f1b200640 1 -- 172.21.15.12:0/2989768055 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f141a0c50 con 0x7f1f141098a0 2024-09-05T01:15:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.747+0000 7f1f0ea00640 1 -- 172.21.15.12:0/2989768055 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7f1f0803b3f0 con 0x7f1f141098a0 2024-09-05T01:15:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.747+0000 7f1f1b200640 1 -- 172.21.15.12:0/2989768055 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f1410de90 con 0x7f1f141098a0 2024-09-05T01:15:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.747+0000 7f1f0ea00640 1 --2- 172.21.15.12:0/2989768055 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f1efc039020 0x7f1efc03b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.747+0000 7f1f0ea00640 1 -- 172.21.15.12:0/2989768055 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1f0806c660 con 0x7f1f141098a0 2024-09-05T01:15:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.748+0000 7f1f19400640 1 --2- 172.21.15.12:0/2989768055 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f1efc039020 0x7f1efc03b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.749+0000 7f1f19400640 1 --2- 172.21.15.12:0/2989768055 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f1efc039020 0x7f1efc03b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1f040098c0 tx=0x7f1f04006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.753+0000 7f1f0ea00640 1 -- 172.21.15.12:0/2989768055 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1f08042dc0 con 0x7f1f141098a0 2024-09-05T01:15:29.589 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.943+0000 7f1f1b200640 1 -- 172.21.15.12:0/2989768055 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f1f141a0e20 con 0x7f1f141098a0 2024-09-05T01:15:29.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.943+0000 7f1f0ea00640 1 -- 172.21.15.12:0/2989768055 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f1f0803ba40 con 0x7f1f141098a0 2024-09-05T01:15:29.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.945+0000 7f1f1b200640 1 -- 172.21.15.12:0/2989768055 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f1efc039020 msgr2=0x7f1efc03b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:29.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.945+0000 7f1f1b200640 1 --2- 172.21.15.12:0/2989768055 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f1efc039020 0x7f1efc03b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1f040098c0 tx=0x7f1f04006db0 comp rx=0 tx=0).stop 2024-09-05T01:15:29.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.945+0000 7f1f1b200640 1 -- 172.21.15.12:0/2989768055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f141098a0 msgr2=0x7f1f1419d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:29.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.945+0000 7f1f1b200640 1 --2- 172.21.15.12:0/2989768055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f141098a0 0x7f1f1419d790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1f080097f0 tx=0x7f1f080327b0 comp rx=0 tx=0).stop 2024-09-05T01:15:29.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.945+0000 7f1f1b200640 1 -- 172.21.15.12:0/2989768055 shutdown_connections 2024-09-05T01:15:29.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.945+0000 7f1f1b200640 1 --2- 172.21.15.12:0/2989768055 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f1efc039020 0x7f1efc03b4e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:29.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.945+0000 7f1f1b200640 1 --2- 172.21.15.12:0/2989768055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f141098a0 0x7f1f1419d790 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:29.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.945+0000 7f1f1b200640 1 -- 172.21.15.12:0/2989768055 >> 172.21.15.12:0/2989768055 conn(0x7f1f1407cd40 msgr2=0x7f1f14107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:29.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.946+0000 7f1f1b200640 1 -- 172.21.15.12:0/2989768055 shutdown_connections 2024-09-05T01:15:29.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:28.946+0000 7f1f1b200640 1 -- 172.21.15.12:0/2989768055 wait complete. 2024-09-05T01:15:29.602 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-05T01:15:29.602 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout disabled 2024-09-05T01:15:29.615 INFO:teuthology.orchestra.run.smithi012.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-05T01:15:29.615 INFO:teuthology.orchestra.run.smithi012.stdout:systemctl: stdout inactive 2024-09-05T01:15:29.615 INFO:teuthology.orchestra.run.smithi012.stdout:firewalld.service is not enabled 2024-09-05T01:15:29.615 INFO:teuthology.orchestra.run.smithi012.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-05T01:15:29.618 INFO:teuthology.orchestra.run.smithi012.stdout:Ceph Dashboard is now available at: 2024-09-05T01:15:29.618 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:15:29.618 INFO:teuthology.orchestra.run.smithi012.stdout: URL: https://smithi012.front.sepia.ceph.com:8443/ 2024-09-05T01:15:29.618 INFO:teuthology.orchestra.run.smithi012.stdout: User: admin 2024-09-05T01:15:29.618 INFO:teuthology.orchestra.run.smithi012.stdout: Password: 9lie3oifjz 2024-09-05T01:15:29.618 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:15:29.619 INFO:teuthology.orchestra.run.smithi012.stdout:Saving cluster configuration to /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config directory 2024-09-05T01:15:30.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:29 smithi012 ceph-mon[29942]: mgrmap e13: x(active, since 6s) 2024-09-05T01:15:31.025 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.078+0000 7fa744200640 1 Processor -- start 2024-09-05T01:15:31.025 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.078+0000 7fa744200640 1 -- start start 2024-09-05T01:15:31.025 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.078+0000 7fa744200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa73c1098f0 0x7fa73c109cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:31.025 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.078+0000 7fa744200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c10a2c0 con 0x7fa73c1098f0 2024-09-05T01:15:31.025 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.078+0000 7fa741800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa73c1098f0 0x7fa73c109cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:31.026 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.079+0000 7fa741800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa73c1098f0 0x7fa73c109cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36226/0 (socket says 172.21.15.12:36226) 2024-09-05T01:15:31.026 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.079+0000 7fa741800640 1 -- 172.21.15.12:0/2279387615 learned_addr learned my addr 172.21.15.12:0/2279387615 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:31.026 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.079+0000 7fa741800640 1 -- 172.21.15.12:0/2279387615 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa73c10ab10 con 0x7fa73c1098f0 2024-09-05T01:15:31.026 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.080+0000 7fa741800640 1 --2- 172.21.15.12:0/2279387615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa73c1098f0 0x7fa73c109cf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa730009820 tx=0x7fa73002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e2b4dab417c75 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:31.026 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.080+0000 7fa73be00640 1 -- 172.21.15.12:0/2279387615 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa730037070 con 0x7fa73c1098f0 2024-09-05T01:15:31.026 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.080+0000 7fa73be00640 1 -- 172.21.15.12:0/2279387615 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa730032920 con 0x7fa73c1098f0 2024-09-05T01:15:31.026 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.080+0000 7fa73be00640 1 -- 172.21.15.12:0/2279387615 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa730030810 con 0x7fa73c1098f0 2024-09-05T01:15:31.026 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.081+0000 7fa744200640 1 -- 172.21.15.12:0/2279387615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa73c1098f0 msgr2=0x7fa73c109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:31.026 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.081+0000 7fa744200640 1 --2- 172.21.15.12:0/2279387615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa73c1098f0 0x7fa73c109cf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa730009820 tx=0x7fa73002a270 comp rx=0 tx=0).stop 2024-09-05T01:15:31.026 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.081+0000 7fa744200640 1 -- 172.21.15.12:0/2279387615 shutdown_connections 2024-09-05T01:15:31.026 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.081+0000 7fa744200640 1 --2- 172.21.15.12:0/2279387615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa73c1098f0 0x7fa73c109cf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:31.026 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.081+0000 7fa744200640 1 -- 172.21.15.12:0/2279387615 >> 172.21.15.12:0/2279387615 conn(0x7fa73c07ceb0 msgr2=0x7fa73c07d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:31.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.081+0000 7fa744200640 1 -- 172.21.15.12:0/2279387615 shutdown_connections 2024-09-05T01:15:31.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.081+0000 7fa744200640 1 -- 172.21.15.12:0/2279387615 wait complete. 2024-09-05T01:15:31.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.082+0000 7fa744200640 1 Processor -- start 2024-09-05T01:15:31.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.082+0000 7fa744200640 1 -- start start 2024-09-05T01:15:31.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.082+0000 7fa744200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa73c1098f0 0x7fa73c19d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:31.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.082+0000 7fa744200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c10dec0 con 0x7fa73c1098f0 2024-09-05T01:15:31.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.083+0000 7fa741800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa73c1098f0 0x7fa73c19d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:31.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.083+0000 7fa741800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa73c1098f0 0x7fa73c19d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36234/0 (socket says 172.21.15.12:36234) 2024-09-05T01:15:31.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.083+0000 7fa741800640 1 -- 172.21.15.12:0/4236185056 learned_addr learned my addr 172.21.15.12:0/4236185056 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:31.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.083+0000 7fa741800640 1 -- 172.21.15.12:0/4236185056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa73c19de70 con 0x7fa73c1098f0 2024-09-05T01:15:31.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.083+0000 7fa741800640 1 --2- 172.21.15.12:0/4236185056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa73c1098f0 0x7fa73c19d930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa7300097f0 tx=0x7fa7300327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:31.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.083+0000 7fa73a000640 1 -- 172.21.15.12:0/4236185056 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa730037040 con 0x7fa73c1098f0 2024-09-05T01:15:31.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.083+0000 7fa73a000640 1 -- 172.21.15.12:0/4236185056 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa730030cc0 con 0x7fa73c1098f0 2024-09-05T01:15:31.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.083+0000 7fa73a000640 1 -- 172.21.15.12:0/4236185056 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa73003a6b0 con 0x7fa73c1098f0 2024-09-05T01:15:31.027 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.083+0000 7fa744200640 1 -- 172.21.15.12:0/4236185056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa73c19e100 con 0x7fa73c1098f0 2024-09-05T01:15:31.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.084+0000 7fa744200640 1 -- 172.21.15.12:0/4236185056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa73c1a0df0 con 0x7fa73c1098f0 2024-09-05T01:15:31.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.085+0000 7fa744200640 1 -- 172.21.15.12:0/4236185056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa73c109d70 con 0x7fa73c1098f0 2024-09-05T01:15:31.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.085+0000 7fa73a000640 1 -- 172.21.15.12:0/4236185056 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fa73003baf0 con 0x7fa73c1098f0 2024-09-05T01:15:31.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.086+0000 7fa73a000640 1 --2- 172.21.15.12:0/4236185056 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa7240390c0 0x7fa72403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:31.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.086+0000 7fa73a000640 1 -- 172.21.15.12:0/4236185056 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa73006c790 con 0x7fa73c1098f0 2024-09-05T01:15:31.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.086+0000 7fa740e00640 1 --2- 172.21.15.12:0/4236185056 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa7240390c0 0x7fa72403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:31.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.087+0000 7fa740e00640 1 --2- 172.21.15.12:0/4236185056 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa7240390c0 0x7fa72403b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa7280098c0 tx=0x7fa728006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:31.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.091+0000 7fa73a000640 1 -- 172.21.15.12:0/4236185056 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa7300418d0 con 0x7fa73c1098f0 2024-09-05T01:15:31.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.369+0000 7fa744200640 1 -- 172.21.15.12:0/4236185056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fa73c1a13e0 con 0x7fa73c1098f0 2024-09-05T01:15:31.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.371+0000 7fa73a000640 1 -- 172.21.15.12:0/4236185056 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7fa7300371e0 con 0x7fa73c1098f0 2024-09-05T01:15:31.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-05T01:15:31.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.374+0000 7fa744200640 1 -- 172.21.15.12:0/4236185056 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa7240390c0 msgr2=0x7fa72403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:31.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.374+0000 7fa744200640 1 --2- 172.21.15.12:0/4236185056 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa7240390c0 0x7fa72403b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa7280098c0 tx=0x7fa728006db0 comp rx=0 tx=0).stop 2024-09-05T01:15:31.028 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.374+0000 7fa744200640 1 -- 172.21.15.12:0/4236185056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa73c1098f0 msgr2=0x7fa73c19d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:31.029 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.374+0000 7fa744200640 1 --2- 172.21.15.12:0/4236185056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa73c1098f0 0x7fa73c19d930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa7300097f0 tx=0x7fa7300327b0 comp rx=0 tx=0).stop 2024-09-05T01:15:31.029 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.374+0000 7fa744200640 1 -- 172.21.15.12:0/4236185056 shutdown_connections 2024-09-05T01:15:31.029 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.374+0000 7fa744200640 1 --2- 172.21.15.12:0/4236185056 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa7240390c0 0x7fa72403b580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:31.029 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.374+0000 7fa744200640 1 --2- 172.21.15.12:0/4236185056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa73c1098f0 0x7fa73c19d930 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:31.029 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.374+0000 7fa744200640 1 -- 172.21.15.12:0/4236185056 >> 172.21.15.12:0/4236185056 conn(0x7fa73c07ceb0 msgr2=0x7fa73c1075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:31.029 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.374+0000 7fa744200640 1 -- 172.21.15.12:0/4236185056 shutdown_connections 2024-09-05T01:15:31.029 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/ceph: stderr 2024-09-05T01:15:30.374+0000 7fa744200640 1 -- 172.21.15.12:0/4236185056 wait complete. 2024-09-05T01:15:31.029 INFO:teuthology.orchestra.run.smithi012.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-05T01:15:31.029 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:15:31.029 INFO:teuthology.orchestra.run.smithi012.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-05T01:15:31.029 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:15:31.029 INFO:teuthology.orchestra.run.smithi012.stdout:Or, if you are only running a single cluster on this host: 2024-09-05T01:15:31.029 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:15:31.029 INFO:teuthology.orchestra.run.smithi012.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-05T01:15:31.030 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:15:31.030 INFO:teuthology.orchestra.run.smithi012.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-05T01:15:31.030 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:15:31.030 INFO:teuthology.orchestra.run.smithi012.stdout: ceph telemetry on 2024-09-05T01:15:31.030 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:15:31.030 INFO:teuthology.orchestra.run.smithi012.stdout:For more information see: 2024-09-05T01:15:31.030 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:15:31.030 INFO:teuthology.orchestra.run.smithi012.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-05T01:15:31.030 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:15:31.030 INFO:teuthology.orchestra.run.smithi012.stdout:Bootstrap complete. 2024-09-05T01:15:31.081 INFO:tasks.cephadm:Fetching config... 2024-09-05T01:15:31.082 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-05T01:15:31.082 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-05T01:15:31.118 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-05T01:15:31.118 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-05T01:15:31.119 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-05T01:15:31.194 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-05T01:15:31.195 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-05T01:15:31.195 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-05T01:15:31.291 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-05T01:15:31.292 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-05T01:15:31.292 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-05T01:15:31.366 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-05T01:15:31.367 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwYkyFzjwwCOqIXEalLTJDYMBeKuefF9V+VAYEHYROrjJltUjs3H0l+Z8Uzda9jQwCM5oQfYq3uUvkwlFGwcCpA1zAMSH45U9vkC4XCr/TjTae6P6QWXwoBu4GxqeBMI+tQTmQhdDKi1wBujXnyWV4Fhano1fm4OSmslGnluPgOppanRYmNjleTJ/uFJPh0re5ftfMHP/RzGIgZNEUx3O87wUEH9ZTvJEPZ+2dwMm7qc2LinOqhgkxmJ2FF22lKU7++IPVQf4Ab/sXP7JRBrKjcvhLr/96Rq+POjdjqHAe1atjHFMUa6vZ7hDE0sIQYe9+UB2itElXxLYfqjZqO32VU5RJkpbmo77P/7+Qt10kIInAJ7Cb3ke5+D1lUJ85WQ+5RqvYyMXrwPca5YRKEDRwTpLmEnxmexn4QnISLDQTAvvKsJAONQmWHXdQwJbPxslWNOS8VbR8QF3NCKm4cGzXBRDa2Ss5Qm+2YHlRvJqMfzspb2OFhtgtMILedbjkV8M= ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-05T01:15:31.499 INFO:teuthology.orchestra.run.smithi012.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwYkyFzjwwCOqIXEalLTJDYMBeKuefF9V+VAYEHYROrjJltUjs3H0l+Z8Uzda9jQwCM5oQfYq3uUvkwlFGwcCpA1zAMSH45U9vkC4XCr/TjTae6P6QWXwoBu4GxqeBMI+tQTmQhdDKi1wBujXnyWV4Fhano1fm4OSmslGnluPgOppanRYmNjleTJ/uFJPh0re5ftfMHP/RzGIgZNEUx3O87wUEH9ZTvJEPZ+2dwMm7qc2LinOqhgkxmJ2FF22lKU7++IPVQf4Ab/sXP7JRBrKjcvhLr/96Rq+POjdjqHAe1atjHFMUa6vZ7hDE0sIQYe9+UB2itElXxLYfqjZqO32VU5RJkpbmo77P/7+Qt10kIInAJ7Cb3ke5+D1lUJ85WQ+5RqvYyMXrwPca5YRKEDRwTpLmEnxmexn4QnISLDQTAvvKsJAONQmWHXdQwJbPxslWNOS8VbR8QF3NCKm4cGzXBRDa2Ss5Qm+2YHlRvJqMfzspb2OFhtgtMILedbjkV8M= ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:15:31.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:31 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/4236185056' entity='client.admin' 2024-09-05T01:15:31.524 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwYkyFzjwwCOqIXEalLTJDYMBeKuefF9V+VAYEHYROrjJltUjs3H0l+Z8Uzda9jQwCM5oQfYq3uUvkwlFGwcCpA1zAMSH45U9vkC4XCr/TjTae6P6QWXwoBu4GxqeBMI+tQTmQhdDKi1wBujXnyWV4Fhano1fm4OSmslGnluPgOppanRYmNjleTJ/uFJPh0re5ftfMHP/RzGIgZNEUx3O87wUEH9ZTvJEPZ+2dwMm7qc2LinOqhgkxmJ2FF22lKU7++IPVQf4Ab/sXP7JRBrKjcvhLr/96Rq+POjdjqHAe1atjHFMUa6vZ7hDE0sIQYe9+UB2itElXxLYfqjZqO32VU5RJkpbmo77P/7+Qt10kIInAJ7Cb3ke5+D1lUJ85WQ+5RqvYyMXrwPca5YRKEDRwTpLmEnxmexn4QnISLDQTAvvKsJAONQmWHXdQwJbPxslWNOS8VbR8QF3NCKm4cGzXBRDa2Ss5Qm+2YHlRvJqMfzspb2OFhtgtMILedbjkV8M= ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-05T01:15:31.565 INFO:teuthology.orchestra.run.smithi145.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwYkyFzjwwCOqIXEalLTJDYMBeKuefF9V+VAYEHYROrjJltUjs3H0l+Z8Uzda9jQwCM5oQfYq3uUvkwlFGwcCpA1zAMSH45U9vkC4XCr/TjTae6P6QWXwoBu4GxqeBMI+tQTmQhdDKi1wBujXnyWV4Fhano1fm4OSmslGnluPgOppanRYmNjleTJ/uFJPh0re5ftfMHP/RzGIgZNEUx3O87wUEH9ZTvJEPZ+2dwMm7qc2LinOqhgkxmJ2FF22lKU7++IPVQf4Ab/sXP7JRBrKjcvhLr/96Rq+POjdjqHAe1atjHFMUa6vZ7hDE0sIQYe9+UB2itElXxLYfqjZqO32VU5RJkpbmo77P/7+Qt10kIInAJ7Cb3ke5+D1lUJ85WQ+5RqvYyMXrwPca5YRKEDRwTpLmEnxmexn4QnISLDQTAvvKsJAONQmWHXdQwJbPxslWNOS8VbR8QF3NCKm4cGzXBRDa2Ss5Qm+2YHlRvJqMfzspb2OFhtgtMILedbjkV8M= ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:15:31.577 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwYkyFzjwwCOqIXEalLTJDYMBeKuefF9V+VAYEHYROrjJltUjs3H0l+Z8Uzda9jQwCM5oQfYq3uUvkwlFGwcCpA1zAMSH45U9vkC4XCr/TjTae6P6QWXwoBu4GxqeBMI+tQTmQhdDKi1wBujXnyWV4Fhano1fm4OSmslGnluPgOppanRYmNjleTJ/uFJPh0re5ftfMHP/RzGIgZNEUx3O87wUEH9ZTvJEPZ+2dwMm7qc2LinOqhgkxmJ2FF22lKU7++IPVQf4Ab/sXP7JRBrKjcvhLr/96Rq+POjdjqHAe1atjHFMUa6vZ7hDE0sIQYe9+UB2itElXxLYfqjZqO32VU5RJkpbmo77P/7+Qt10kIInAJ7Cb3ke5+D1lUJ85WQ+5RqvYyMXrwPca5YRKEDRwTpLmEnxmexn4QnISLDQTAvvKsJAONQmWHXdQwJbPxslWNOS8VbR8QF3NCKm4cGzXBRDa2Ss5Qm+2YHlRvJqMfzspb2OFhtgtMILedbjkV8M= ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-05T01:15:31.620 INFO:teuthology.orchestra.run.smithi151.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwYkyFzjwwCOqIXEalLTJDYMBeKuefF9V+VAYEHYROrjJltUjs3H0l+Z8Uzda9jQwCM5oQfYq3uUvkwlFGwcCpA1zAMSH45U9vkC4XCr/TjTae6P6QWXwoBu4GxqeBMI+tQTmQhdDKi1wBujXnyWV4Fhano1fm4OSmslGnluPgOppanRYmNjleTJ/uFJPh0re5ftfMHP/RzGIgZNEUx3O87wUEH9ZTvJEPZ+2dwMm7qc2LinOqhgkxmJ2FF22lKU7++IPVQf4Ab/sXP7JRBrKjcvhLr/96Rq+POjdjqHAe1atjHFMUa6vZ7hDE0sIQYe9+UB2itElXxLYfqjZqO32VU5RJkpbmo77P/7+Qt10kIInAJ7Cb3ke5+D1lUJ85WQ+5RqvYyMXrwPca5YRKEDRwTpLmEnxmexn4QnISLDQTAvvKsJAONQmWHXdQwJbPxslWNOS8VbR8QF3NCKm4cGzXBRDa2Ss5Qm+2YHlRvJqMfzspb2OFhtgtMILedbjkV8M= ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:15:31.632 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-05T01:15:31.999 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:15:32.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.520+0000 7fbe44800640 1 -- 172.21.15.12:0/3351231266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c101600 msgr2=0x7fbe3c101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:32.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.520+0000 7fbe44800640 1 --2- 172.21.15.12:0/3351231266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c101600 0x7fbe3c101a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbe30009880 tx=0x7fbe3002a5d0 comp rx=0 tx=0).stop 2024-09-05T01:15:32.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.521+0000 7fbe44800640 1 -- 172.21.15.12:0/3351231266 shutdown_connections 2024-09-05T01:15:32.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.521+0000 7fbe44800640 1 --2- 172.21.15.12:0/3351231266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c101600 0x7fbe3c101a00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:32.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.521+0000 7fbe44800640 1 -- 172.21.15.12:0/3351231266 >> 172.21.15.12:0/3351231266 conn(0x7fbe3c0fcdb0 msgr2=0x7fbe3c0ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:32.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.521+0000 7fbe44800640 1 -- 172.21.15.12:0/3351231266 shutdown_connections 2024-09-05T01:15:32.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.521+0000 7fbe44800640 1 -- 172.21.15.12:0/3351231266 wait complete. 2024-09-05T01:15:32.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.522+0000 7fbe44800640 1 Processor -- start 2024-09-05T01:15:32.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.522+0000 7fbe44800640 1 -- start start 2024-09-05T01:15:32.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.522+0000 7fbe44800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c101600 0x7fbe3c198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:32.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.522+0000 7fbe44800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3c107710 con 0x7fbe3c101600 2024-09-05T01:15:32.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.523+0000 7fbe41e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c101600 0x7fbe3c198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:32.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.523+0000 7fbe41e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c101600 0x7fbe3c198fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36252/0 (socket says 172.21.15.12:36252) 2024-09-05T01:15:32.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.523+0000 7fbe41e00640 1 -- 172.21.15.12:0/2495202630 learned_addr learned my addr 172.21.15.12:0/2495202630 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:32.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.523+0000 7fbe41e00640 1 -- 172.21.15.12:0/2495202630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe3c199510 con 0x7fbe3c101600 2024-09-05T01:15:32.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.523+0000 7fbe41e00640 1 --2- 172.21.15.12:0/2495202630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c101600 0x7fbe3c198fd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbe30004f60 tx=0x7fbe300048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:32.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.524+0000 7fbe36a00640 1 -- 172.21.15.12:0/2495202630 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe3003f070 con 0x7fbe3c101600 2024-09-05T01:15:32.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.524+0000 7fbe36a00640 1 -- 172.21.15.12:0/2495202630 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe30004d40 con 0x7fbe3c101600 2024-09-05T01:15:32.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.524+0000 7fbe44800640 1 -- 172.21.15.12:0/2495202630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe3c1997a0 con 0x7fbe3c101600 2024-09-05T01:15:32.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.524+0000 7fbe36a00640 1 -- 172.21.15.12:0/2495202630 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe30035030 con 0x7fbe3c101600 2024-09-05T01:15:32.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.524+0000 7fbe44800640 1 -- 172.21.15.12:0/2495202630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe3c19c490 con 0x7fbe3c101600 2024-09-05T01:15:32.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.525+0000 7fbe36a00640 1 -- 172.21.15.12:0/2495202630 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fbe30042070 con 0x7fbe3c101600 2024-09-05T01:15:32.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.525+0000 7fbe44800640 1 -- 172.21.15.12:0/2495202630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe3c107e90 con 0x7fbe3c101600 2024-09-05T01:15:32.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.525+0000 7fbe36a00640 1 --2- 172.21.15.12:0/2495202630 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fbe24039060 0x7fbe2403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:32.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.526+0000 7fbe36a00640 1 -- 172.21.15.12:0/2495202630 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbe3006cd10 con 0x7fbe3c101600 2024-09-05T01:15:32.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.526+0000 7fbe41400640 1 --2- 172.21.15.12:0/2495202630 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fbe24039060 0x7fbe2403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:32.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.527+0000 7fbe41400640 1 --2- 172.21.15.12:0/2495202630 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fbe24039060 0x7fbe2403b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c0098c0 tx=0x7fbe2c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:32.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.531+0000 7fbe36a00640 1 -- 172.21.15.12:0/2495202630 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbe3004a260 con 0x7fbe3c101600 2024-09-05T01:15:32.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.719+0000 7fbe44800640 1 -- 172.21.15.12:0/2495202630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fbe3c02d830 con 0x7fbe3c101600 2024-09-05T01:15:32.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.723+0000 7fbe36a00640 1 -- 172.21.15.12:0/2495202630 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fbe300035f0 con 0x7fbe3c101600 2024-09-05T01:15:32.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.726+0000 7fbe44800640 1 -- 172.21.15.12:0/2495202630 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fbe24039060 msgr2=0x7fbe2403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:32.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.726+0000 7fbe44800640 1 --2- 172.21.15.12:0/2495202630 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fbe24039060 0x7fbe2403b520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c0098c0 tx=0x7fbe2c006db0 comp rx=0 tx=0).stop 2024-09-05T01:15:32.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.726+0000 7fbe44800640 1 -- 172.21.15.12:0/2495202630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c101600 msgr2=0x7fbe3c198fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:32.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.726+0000 7fbe44800640 1 --2- 172.21.15.12:0/2495202630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c101600 0x7fbe3c198fd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbe30004f60 tx=0x7fbe300048f0 comp rx=0 tx=0).stop 2024-09-05T01:15:32.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.726+0000 7fbe44800640 1 -- 172.21.15.12:0/2495202630 shutdown_connections 2024-09-05T01:15:32.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.726+0000 7fbe44800640 1 --2- 172.21.15.12:0/2495202630 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fbe24039060 0x7fbe2403b520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:32.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.726+0000 7fbe44800640 1 --2- 172.21.15.12:0/2495202630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c101600 0x7fbe3c198fd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:32.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.726+0000 7fbe44800640 1 -- 172.21.15.12:0/2495202630 >> 172.21.15.12:0/2495202630 conn(0x7fbe3c0fcdb0 msgr2=0x7fbe3c0ff1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:32.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.726+0000 7fbe44800640 1 -- 172.21.15.12:0/2495202630 shutdown_connections 2024-09-05T01:15:32.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:32.726+0000 7fbe44800640 1 -- 172.21.15.12:0/2495202630 wait complete. 2024-09-05T01:15:33.523 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-05T01:15:33.523 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-05T01:15:33.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:33 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2495202630' entity='client.admin' 2024-09-05T01:15:33.975 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:15:34.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.692+0000 7f47ff600640 1 -- 172.21.15.12:0/3648028111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47f81037f0 msgr2=0x7f47f8103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:34.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.692+0000 7f47ff600640 1 --2- 172.21.15.12:0/3648028111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47f81037f0 0x7f47f8103bf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009880 tx=0x7f47ec02a5d0 comp rx=0 tx=0).stop 2024-09-05T01:15:34.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.693+0000 7f47ff600640 1 -- 172.21.15.12:0/3648028111 shutdown_connections 2024-09-05T01:15:34.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.693+0000 7f47ff600640 1 --2- 172.21.15.12:0/3648028111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47f81037f0 0x7f47f8103bf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:34.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.693+0000 7f47ff600640 1 -- 172.21.15.12:0/3648028111 >> 172.21.15.12:0/3648028111 conn(0x7f47f80fefc0 msgr2=0x7f47f8101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:34.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.693+0000 7f47ff600640 1 -- 172.21.15.12:0/3648028111 shutdown_connections 2024-09-05T01:15:34.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.693+0000 7f47ff600640 1 -- 172.21.15.12:0/3648028111 wait complete. 2024-09-05T01:15:34.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.694+0000 7f47ff600640 1 Processor -- start 2024-09-05T01:15:34.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.694+0000 7f47ff600640 1 -- start start 2024-09-05T01:15:34.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.695+0000 7f47ff600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47f81037f0 0x7f47f8198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:34.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.695+0000 7f47ff600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f47f8109900 con 0x7f47f81037f0 2024-09-05T01:15:34.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.695+0000 7f47fcc00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47f81037f0 0x7f47f8198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:34.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.695+0000 7f47fcc00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47f81037f0 0x7f47f8198fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36270/0 (socket says 172.21.15.12:36270) 2024-09-05T01:15:34.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.695+0000 7f47fcc00640 1 -- 172.21.15.12:0/4127200444 learned_addr learned my addr 172.21.15.12:0/4127200444 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:34.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.695+0000 7f47fcc00640 1 -- 172.21.15.12:0/4127200444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f81994e0 con 0x7f47f81037f0 2024-09-05T01:15:34.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.695+0000 7f47fcc00640 1 --2- 172.21.15.12:0/4127200444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47f81037f0 0x7f47f8198fa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f47ec004f60 tx=0x7f47ec0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:34.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.696+0000 7f47f5600640 1 -- 172.21.15.12:0/4127200444 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47ec03f070 con 0x7f47f81037f0 2024-09-05T01:15:34.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.696+0000 7f47f5600640 1 -- 172.21.15.12:0/4127200444 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47ec004cc0 con 0x7f47f81037f0 2024-09-05T01:15:34.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.696+0000 7f47f5600640 1 -- 172.21.15.12:0/4127200444 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47ec035030 con 0x7f47f81037f0 2024-09-05T01:15:34.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.696+0000 7f47ff600640 1 -- 172.21.15.12:0/4127200444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f8199770 con 0x7f47f81037f0 2024-09-05T01:15:34.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.697+0000 7f47ff600640 1 -- 172.21.15.12:0/4127200444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f819c460 con 0x7f47f81037f0 2024-09-05T01:15:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.698+0000 7f47f5600640 1 -- 172.21.15.12:0/4127200444 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f47ec042070 con 0x7f47f81037f0 2024-09-05T01:15:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.698+0000 7f47ff600640 1 -- 172.21.15.12:0/4127200444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f810a080 con 0x7f47f81037f0 2024-09-05T01:15:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.698+0000 7f47f5600640 1 --2- 172.21.15.12:0/4127200444 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f47e00390c0 0x7f47e003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.698+0000 7f47f5600640 1 -- 172.21.15.12:0/4127200444 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f47ec06cac0 con 0x7f47f81037f0 2024-09-05T01:15:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.699+0000 7f47f7e00640 1 --2- 172.21.15.12:0/4127200444 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f47e00390c0 0x7f47e003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:34.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.699+0000 7f47f7e00640 1 --2- 172.21.15.12:0/4127200444 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f47e00390c0 0x7f47e003b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f47e40098c0 tx=0x7f47e4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:34.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.703+0000 7f47f5600640 1 -- 172.21.15.12:0/4127200444 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f47ec06ee20 con 0x7f47f81037f0 2024-09-05T01:15:34.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.895+0000 7f47ff600640 1 -- 172.21.15.12:0/4127200444 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f47f802d830 con 0x7f47e00390c0 2024-09-05T01:15:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.898+0000 7f47f5600640 1 -- 172.21.15.12:0/4127200444 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f47f802d830 con 0x7f47e00390c0 2024-09-05T01:15:34.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.901+0000 7f47ff600640 1 -- 172.21.15.12:0/4127200444 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f47e00390c0 msgr2=0x7f47e003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.901+0000 7f47ff600640 1 --2- 172.21.15.12:0/4127200444 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f47e00390c0 0x7f47e003b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f47e40098c0 tx=0x7f47e4006db0 comp rx=0 tx=0).stop 2024-09-05T01:15:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.901+0000 7f47ff600640 1 -- 172.21.15.12:0/4127200444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47f81037f0 msgr2=0x7f47f8198fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.901+0000 7f47ff600640 1 --2- 172.21.15.12:0/4127200444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47f81037f0 0x7f47f8198fa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f47ec004f60 tx=0x7f47ec0048f0 comp rx=0 tx=0).stop 2024-09-05T01:15:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.901+0000 7f47ff600640 1 -- 172.21.15.12:0/4127200444 shutdown_connections 2024-09-05T01:15:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.901+0000 7f47ff600640 1 --2- 172.21.15.12:0/4127200444 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f47e00390c0 0x7f47e003b580 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.901+0000 7f47ff600640 1 --2- 172.21.15.12:0/4127200444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47f81037f0 0x7f47f8198fa0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.901+0000 7f47ff600640 1 -- 172.21.15.12:0/4127200444 >> 172.21.15.12:0/4127200444 conn(0x7f47f80fefc0 msgr2=0x7f47f80ff9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.902+0000 7f47ff600640 1 -- 172.21.15.12:0/4127200444 shutdown_connections 2024-09-05T01:15:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:34.902+0000 7f47ff600640 1 -- 172.21.15.12:0/4127200444 wait complete. 2024-09-05T01:15:35.292 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:34 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:35.292 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:34 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:35.293 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:34 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi012", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:15:35.293 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:34 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:35.293 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:34 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:15:35.293 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:34 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:35.293 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:34 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:35.293 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:34 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:15:35.293 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:34 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:15:35.293 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:34 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:15:35.658 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi145 2024-09-05T01:15:35.658 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-05T01:15:35.658 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/etc/ceph/ceph.conf 2024-09-05T01:15:35.678 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-05T01:15:35.678 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-05T01:15:35.736 INFO:tasks.cephadm:Adding host smithi145 to orchestrator... 2024-09-05T01:15:35.736 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph orch host add smithi145 2024-09-05T01:15:36.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:35 smithi012 ceph-mon[29942]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:15:36.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:35 smithi012 ceph-mon[29942]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-05T01:15:36.777 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:15:37.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:36 smithi012 ceph-mon[29942]: Updating smithi012:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:15:37.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:36 smithi012 ceph-mon[29942]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2024-09-05T01:15:37.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:36 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:37.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:36 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:37.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:36 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:37.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.332+0000 7f8ab5a00640 1 -- 172.21.15.12:0/2047316371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ab0109740 msgr2=0x7f8ab0109b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:37.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.332+0000 7f8ab5a00640 1 --2- 172.21.15.12:0/2047316371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ab0109740 0x7f8ab0109b20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0009880 tx=0x7f8aa002a5d0 comp rx=0 tx=0).stop 2024-09-05T01:15:37.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.332+0000 7f8ab5a00640 1 -- 172.21.15.12:0/2047316371 shutdown_connections 2024-09-05T01:15:37.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.332+0000 7f8ab5a00640 1 --2- 172.21.15.12:0/2047316371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ab0109740 0x7f8ab0109b20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:37.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.332+0000 7f8ab5a00640 1 -- 172.21.15.12:0/2047316371 >> 172.21.15.12:0/2047316371 conn(0x7f8ab00ff2c0 msgr2=0x7f8ab01016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:37.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.332+0000 7f8ab5a00640 1 -- 172.21.15.12:0/2047316371 shutdown_connections 2024-09-05T01:15:37.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.332+0000 7f8ab5a00640 1 -- 172.21.15.12:0/2047316371 wait complete. 2024-09-05T01:15:37.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.333+0000 7f8ab5a00640 1 Processor -- start 2024-09-05T01:15:37.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.333+0000 7f8ab5a00640 1 -- start start 2024-09-05T01:15:37.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.333+0000 7f8ab5a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ab0109740 0x7f8ab01991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:37.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.333+0000 7f8ab5a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab010dd50 con 0x7f8ab0109740 2024-09-05T01:15:37.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.334+0000 7f8aafe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ab0109740 0x7f8ab01991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:37.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.334+0000 7f8aafe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ab0109740 0x7f8ab01991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50616/0 (socket says 172.21.15.12:50616) 2024-09-05T01:15:37.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.334+0000 7f8aafe00640 1 -- 172.21.15.12:0/1215790731 learned_addr learned my addr 172.21.15.12:0/1215790731 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:37.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.334+0000 7f8aafe00640 1 -- 172.21.15.12:0/1215790731 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab0199700 con 0x7f8ab0109740 2024-09-05T01:15:37.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.334+0000 7f8aafe00640 1 --2- 172.21.15.12:0/1215790731 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ab0109740 0x7f8ab01991c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0009230 tx=0x7f8aa0003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:37.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.335+0000 7f8aad600640 1 -- 172.21.15.12:0/1215790731 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa003f070 con 0x7f8ab0109740 2024-09-05T01:15:37.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.335+0000 7f8aad600640 1 -- 172.21.15.12:0/1215790731 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8aa003bd40 con 0x7f8ab0109740 2024-09-05T01:15:37.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.335+0000 7f8aad600640 1 -- 172.21.15.12:0/1215790731 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa0035030 con 0x7f8ab0109740 2024-09-05T01:15:37.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.335+0000 7f8ab5a00640 1 -- 172.21.15.12:0/1215790731 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab01999f0 con 0x7f8ab0109740 2024-09-05T01:15:37.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.335+0000 7f8ab5a00640 1 -- 172.21.15.12:0/1215790731 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab019da90 con 0x7f8ab0109740 2024-09-05T01:15:37.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.336+0000 7f8aad600640 1 -- 172.21.15.12:0/1215790731 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f8aa0042070 con 0x7f8ab0109740 2024-09-05T01:15:37.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.336+0000 7f8ab5a00640 1 -- 172.21.15.12:0/1215790731 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ab0104ce0 con 0x7f8ab0109740 2024-09-05T01:15:37.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.336+0000 7f8aad600640 1 --2- 172.21.15.12:0/1215790731 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8a940390c0 0x7f8a9403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:37.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.336+0000 7f8aad600640 1 -- 172.21.15.12:0/1215790731 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8aa006cc70 con 0x7f8ab0109740 2024-09-05T01:15:37.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.337+0000 7f8aa7e00640 1 --2- 172.21.15.12:0/1215790731 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8a940390c0 0x7f8a9403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:37.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.337+0000 7f8aa7e00640 1 --2- 172.21.15.12:0/1215790731 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8a940390c0 0x7f8a9403b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8a980098c0 tx=0x7f8a98006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:37.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.342+0000 7f8aad600640 1 -- 172.21.15.12:0/1215790731 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8aa0030d60 con 0x7f8ab0109740 2024-09-05T01:15:37.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:37.529+0000 7f8ab5a00640 1 -- 172.21.15.12:0/1215790731 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi145", "target": ["mon-mgr", ""]}) -- 0x7f8ab0109bd0 con 0x7f8a940390c0 2024-09-05T01:15:38.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:37 smithi012 ceph-mon[29942]: Updating smithi012:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-05T01:15:39.213 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:38 smithi012 ceph-mon[29942]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi145", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:15:40.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:39 smithi012 ceph-mon[29942]: Deploying cephadm binary to smithi145 2024-09-05T01:15:41.364 INFO:teuthology.orchestra.run.smithi012.stdout:Added host 'smithi145' with addr '172.21.15.145' 2024-09-05T01:15:41.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:41.363+0000 7f8aad600640 1 -- 172.21.15.12:0/1215790731 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f8ab0109bd0 con 0x7f8a940390c0 2024-09-05T01:15:41.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:41.365+0000 7f8ab5a00640 1 -- 172.21.15.12:0/1215790731 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8a940390c0 msgr2=0x7f8a9403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:41.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:41.365+0000 7f8ab5a00640 1 --2- 172.21.15.12:0/1215790731 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8a940390c0 0x7f8a9403b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8a980098c0 tx=0x7f8a98006db0 comp rx=0 tx=0).stop 2024-09-05T01:15:41.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:41.365+0000 7f8ab5a00640 1 -- 172.21.15.12:0/1215790731 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ab0109740 msgr2=0x7f8ab01991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:41.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:41.365+0000 7f8ab5a00640 1 --2- 172.21.15.12:0/1215790731 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ab0109740 0x7f8ab01991c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0009230 tx=0x7f8aa0003d80 comp rx=0 tx=0).stop 2024-09-05T01:15:41.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:41.365+0000 7f8ab5a00640 1 -- 172.21.15.12:0/1215790731 shutdown_connections 2024-09-05T01:15:41.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:41.365+0000 7f8ab5a00640 1 --2- 172.21.15.12:0/1215790731 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8a940390c0 0x7f8a9403b580 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:41.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:41.365+0000 7f8ab5a00640 1 --2- 172.21.15.12:0/1215790731 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ab0109740 0x7f8ab01991c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:41.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:41.365+0000 7f8ab5a00640 1 -- 172.21.15.12:0/1215790731 >> 172.21.15.12:0/1215790731 conn(0x7f8ab00ff2c0 msgr2=0x7f8ab00ff6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:41.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:41.366+0000 7f8ab5a00640 1 -- 172.21.15.12:0/1215790731 shutdown_connections 2024-09-05T01:15:41.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:41.366+0000 7f8ab5a00640 1 -- 172.21.15.12:0/1215790731 wait complete. 2024-09-05T01:15:42.262 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph orch host ls --format=json 2024-09-05T01:15:42.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:42 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:42.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:42 smithi012 ceph-mon[29942]: Added host smithi145 2024-09-05T01:15:42.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:42 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:15:42.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:42 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:42.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:42 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:42.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:42 smithi012 ceph-mon[29942]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:15:42.630 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:15:43.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.154+0000 7fd0ae400640 1 -- 172.21.15.12:0/2253918413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0a8101610 msgr2=0x7fd0a81019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:43.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.154+0000 7fd0ae400640 1 --2- 172.21.15.12:0/2253918413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0a8101610 0x7fd0a81019f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd098009880 tx=0x7fd09802a5d0 comp rx=0 tx=0).stop 2024-09-05T01:15:43.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.154+0000 7fd0ae400640 1 -- 172.21.15.12:0/2253918413 shutdown_connections 2024-09-05T01:15:43.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.154+0000 7fd0ae400640 1 --2- 172.21.15.12:0/2253918413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0a8101610 0x7fd0a81019f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:43.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.154+0000 7fd0ae400640 1 -- 172.21.15.12:0/2253918413 >> 172.21.15.12:0/2253918413 conn(0x7fd0a80fd0b0 msgr2=0x7fd0a80ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:43.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.154+0000 7fd0ae400640 1 -- 172.21.15.12:0/2253918413 shutdown_connections 2024-09-05T01:15:43.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.154+0000 7fd0ae400640 1 -- 172.21.15.12:0/2253918413 wait complete. 2024-09-05T01:15:43.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.155+0000 7fd0ae400640 1 Processor -- start 2024-09-05T01:15:43.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.155+0000 7fd0ae400640 1 -- start start 2024-09-05T01:15:43.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.156+0000 7fd0ae400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0a8101610 0x7fd0a8196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:43.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.156+0000 7fd0ae400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a810ba60 con 0x7fd0a8101610 2024-09-05T01:15:43.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.156+0000 7fd0ad000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0a8101610 0x7fd0a8196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:43.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.156+0000 7fd0ad000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0a8101610 0x7fd0a8196f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50642/0 (socket says 172.21.15.12:50642) 2024-09-05T01:15:43.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.156+0000 7fd0ad000640 1 -- 172.21.15.12:0/215027001 learned_addr learned my addr 172.21.15.12:0/215027001 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:43.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.156+0000 7fd0ad000640 1 -- 172.21.15.12:0/215027001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a81974d0 con 0x7fd0a8101610 2024-09-05T01:15:43.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.157+0000 7fd0ad000640 1 --2- 172.21.15.12:0/215027001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0a8101610 0x7fd0a8196f90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd098009230 tx=0x7fd098003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:43.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.157+0000 7fd0a6000640 1 -- 172.21.15.12:0/215027001 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd09803f070 con 0x7fd0a8101610 2024-09-05T01:15:43.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.157+0000 7fd0a6000640 1 -- 172.21.15.12:0/215027001 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd09803bc80 con 0x7fd0a8101610 2024-09-05T01:15:43.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.157+0000 7fd0ae400640 1 -- 172.21.15.12:0/215027001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0a81977c0 con 0x7fd0a8101610 2024-09-05T01:15:43.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.157+0000 7fd0a6000640 1 -- 172.21.15.12:0/215027001 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd098035030 con 0x7fd0a8101610 2024-09-05T01:15:43.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.157+0000 7fd0ae400640 1 -- 172.21.15.12:0/215027001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0a819b860 con 0x7fd0a8101610 2024-09-05T01:15:43.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.158+0000 7fd0a6000640 1 -- 172.21.15.12:0/215027001 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fd098042070 con 0x7fd0a8101610 2024-09-05T01:15:43.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.158+0000 7fd0ae400640 1 -- 172.21.15.12:0/215027001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0a8102af0 con 0x7fd0a8101610 2024-09-05T01:15:43.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.159+0000 7fd0a6000640 1 --2- 172.21.15.12:0/215027001 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd08c0390c0 0x7fd08c03b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:43.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.159+0000 7fd0a6000640 1 -- 172.21.15.12:0/215027001 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd09806cd00 con 0x7fd0a8101610 2024-09-05T01:15:43.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.159+0000 7fd09fe00640 1 --2- 172.21.15.12:0/215027001 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd08c0390c0 0x7fd08c03b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:43.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.159+0000 7fd09fe00640 1 --2- 172.21.15.12:0/215027001 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd08c0390c0 0x7fd08c03b580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd0900098c0 tx=0x7fd090006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:43.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.164+0000 7fd0a6000640 1 -- 172.21.15.12:0/215027001 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd0980372d0 con 0x7fd0a8101610 2024-09-05T01:15:43.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.356+0000 7fd0ae400640 1 -- 172.21.15.12:0/215027001 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd0a81982f0 con 0x7fd08c0390c0 2024-09-05T01:15:43.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.357+0000 7fd0a6000640 1 -- 172.21.15.12:0/215027001 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7fd0a81982f0 con 0x7fd08c0390c0 2024-09-05T01:15:43.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:15:43.357 INFO:teuthology.orchestra.run.smithi012.stdout:[{"addr": "172.21.15.12", "hostname": "smithi012", "labels": [], "status": ""}, {"addr": "172.21.15.145", "hostname": "smithi145", "labels": [], "status": ""}] 2024-09-05T01:15:43.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.359+0000 7fd0ae400640 1 -- 172.21.15.12:0/215027001 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd08c0390c0 msgr2=0x7fd08c03b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:43.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.359+0000 7fd0ae400640 1 --2- 172.21.15.12:0/215027001 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd08c0390c0 0x7fd08c03b580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd0900098c0 tx=0x7fd090006db0 comp rx=0 tx=0).stop 2024-09-05T01:15:43.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.359+0000 7fd0ae400640 1 -- 172.21.15.12:0/215027001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0a8101610 msgr2=0x7fd0a8196f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:43.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.359+0000 7fd0ae400640 1 --2- 172.21.15.12:0/215027001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0a8101610 0x7fd0a8196f90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd098009230 tx=0x7fd098003d40 comp rx=0 tx=0).stop 2024-09-05T01:15:43.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.360+0000 7fd0ae400640 1 -- 172.21.15.12:0/215027001 shutdown_connections 2024-09-05T01:15:43.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.360+0000 7fd0ae400640 1 --2- 172.21.15.12:0/215027001 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd08c0390c0 0x7fd08c03b580 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:43.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.360+0000 7fd0ae400640 1 --2- 172.21.15.12:0/215027001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0a8101610 0x7fd0a8196f90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:43.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.360+0000 7fd0ae400640 1 -- 172.21.15.12:0/215027001 >> 172.21.15.12:0/215027001 conn(0x7fd0a80fd0b0 msgr2=0x7fd0a8109070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:43.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.360+0000 7fd0ae400640 1 -- 172.21.15.12:0/215027001 shutdown_connections 2024-09-05T01:15:43.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:43.360+0000 7fd0ae400640 1 -- 172.21.15.12:0/215027001 wait complete. 2024-09-05T01:15:44.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:43 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:44.198 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi151 2024-09-05T01:15:44.198 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-05T01:15:44.198 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/etc/ceph/ceph.conf 2024-09-05T01:15:44.217 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-05T01:15:44.217 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-05T01:15:44.276 INFO:tasks.cephadm:Adding host smithi151 to orchestrator... 2024-09-05T01:15:44.276 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph orch host add smithi151 2024-09-05T01:15:44.640 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:15:44.959 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:44 smithi012 ceph-mon[29942]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T01:15:44.959 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:44 smithi012 ceph-mon[29942]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:15:45.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.178+0000 7f42f0e00640 1 -- 172.21.15.12:0/2115722898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42ec107640 msgr2=0x7f42ec107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:45.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.178+0000 7f42f0e00640 1 --2- 172.21.15.12:0/2115722898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42ec107640 0x7f42ec107a20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009880 tx=0x7f42dc02a5d0 comp rx=0 tx=0).stop 2024-09-05T01:15:45.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.178+0000 7f42f0e00640 1 -- 172.21.15.12:0/2115722898 shutdown_connections 2024-09-05T01:15:45.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.178+0000 7f42f0e00640 1 --2- 172.21.15.12:0/2115722898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42ec107640 0x7f42ec107a20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:45.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.178+0000 7f42f0e00640 1 -- 172.21.15.12:0/2115722898 >> 172.21.15.12:0/2115722898 conn(0x7f42ec0fd230 msgr2=0x7f42ec0ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:45.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.178+0000 7f42f0e00640 1 -- 172.21.15.12:0/2115722898 shutdown_connections 2024-09-05T01:15:45.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.178+0000 7f42f0e00640 1 -- 172.21.15.12:0/2115722898 wait complete. 2024-09-05T01:15:45.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.179+0000 7f42f0e00640 1 Processor -- start 2024-09-05T01:15:45.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.180+0000 7f42f0e00640 1 -- start start 2024-09-05T01:15:45.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.180+0000 7f42f0e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42ec107640 0x7f42ec199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:45.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.180+0000 7f42f0e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f42ec10bc70 con 0x7f42ec107640 2024-09-05T01:15:45.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.180+0000 7f42e9e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42ec107640 0x7f42ec199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:45.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.180+0000 7f42e9e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42ec107640 0x7f42ec199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50666/0 (socket says 172.21.15.12:50666) 2024-09-05T01:15:45.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.180+0000 7f42e9e00640 1 -- 172.21.15.12:0/3074325156 learned_addr learned my addr 172.21.15.12:0/3074325156 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:45.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.181+0000 7f42e9e00640 1 -- 172.21.15.12:0/3074325156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ec199870 con 0x7f42ec107640 2024-09-05T01:15:45.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.181+0000 7f42e9e00640 1 --2- 172.21.15.12:0/3074325156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42ec107640 0x7f42ec199330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009230 tx=0x7f42dc003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:45.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.181+0000 7f42e2a00640 1 -- 172.21.15.12:0/3074325156 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42dc03f070 con 0x7f42ec107640 2024-09-05T01:15:45.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.181+0000 7f42f0e00640 1 -- 172.21.15.12:0/3074325156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42ec199b00 con 0x7f42ec107640 2024-09-05T01:15:45.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.181+0000 7f42e2a00640 1 -- 172.21.15.12:0/3074325156 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42dc03bd40 con 0x7f42ec107640 2024-09-05T01:15:45.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.181+0000 7f42e2a00640 1 -- 172.21.15.12:0/3074325156 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42dc035030 con 0x7f42ec107640 2024-09-05T01:15:45.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.181+0000 7f42f0e00640 1 -- 172.21.15.12:0/3074325156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42ec19dc00 con 0x7f42ec107640 2024-09-05T01:15:45.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.182+0000 7f42e2a00640 1 -- 172.21.15.12:0/3074325156 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f42dc042070 con 0x7f42ec107640 2024-09-05T01:15:45.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.182+0000 7f42f0e00640 1 -- 172.21.15.12:0/3074325156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42ec102cb0 con 0x7f42ec107640 2024-09-05T01:15:45.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.183+0000 7f42e2a00640 1 --2- 172.21.15.12:0/3074325156 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f42d0039060 0x7f42d003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:45.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.183+0000 7f42e2a00640 1 -- 172.21.15.12:0/3074325156 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f42dc06ca80 con 0x7f42ec107640 2024-09-05T01:15:45.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.183+0000 7f42e9400640 1 --2- 172.21.15.12:0/3074325156 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f42d0039060 0x7f42d003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:45.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.184+0000 7f42e9400640 1 --2- 172.21.15.12:0/3074325156 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f42d0039060 0x7f42d003b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f42d80098c0 tx=0x7f42d8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:45.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.188+0000 7f42e2a00640 1 -- 172.21.15.12:0/3074325156 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f42dc044450 con 0x7f42ec107640 2024-09-05T01:15:45.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:45.378+0000 7f42f0e00640 1 -- 172.21.15.12:0/3074325156 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi151", "target": ["mon-mgr", ""]}) -- 0x7f42ec19a690 con 0x7f42d0039060 2024-09-05T01:15:46.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:46 smithi012 ceph-mon[29942]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi151", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:15:46.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:46 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:46.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:46 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:46.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:46 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:46.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:46 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:46.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:46 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi145", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:15:46.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:46 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:15:46.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:46 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:15:46.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:46 smithi012 ceph-mon[29942]: Updating smithi145:/etc/ceph/ceph.conf 2024-09-05T01:15:46.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:46 smithi012 ceph-mon[29942]: Updating smithi145:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:15:46.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:46 smithi012 ceph-mon[29942]: Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-09-05T01:15:46.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:46 smithi012 ceph-mon[29942]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:15:46.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:46 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:46.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:46 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:46.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:46 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:47.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:47 smithi012 ceph-mon[29942]: Updating smithi145:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-05T01:15:47.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:47 smithi012 ceph-mon[29942]: Deploying cephadm binary to smithi151 2024-09-05T01:15:48.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:48 smithi012 ceph-mon[29942]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:15:49.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:49.284+0000 7f42e2a00640 1 -- 172.21.15.12:0/3074325156 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f42ec19a690 con 0x7f42d0039060 2024-09-05T01:15:49.284 INFO:teuthology.orchestra.run.smithi012.stdout:Added host 'smithi151' with addr '172.21.15.151' 2024-09-05T01:15:49.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:49.287+0000 7f42f0e00640 1 -- 172.21.15.12:0/3074325156 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f42d0039060 msgr2=0x7f42d003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:49.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:49.287+0000 7f42f0e00640 1 --2- 172.21.15.12:0/3074325156 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f42d0039060 0x7f42d003b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f42d80098c0 tx=0x7f42d8006db0 comp rx=0 tx=0).stop 2024-09-05T01:15:49.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:49.287+0000 7f42f0e00640 1 -- 172.21.15.12:0/3074325156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42ec107640 msgr2=0x7f42ec199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:49.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:49.287+0000 7f42f0e00640 1 --2- 172.21.15.12:0/3074325156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42ec107640 0x7f42ec199330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009230 tx=0x7f42dc003d80 comp rx=0 tx=0).stop 2024-09-05T01:15:49.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:49.287+0000 7f42f0e00640 1 -- 172.21.15.12:0/3074325156 shutdown_connections 2024-09-05T01:15:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:49.287+0000 7f42f0e00640 1 --2- 172.21.15.12:0/3074325156 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f42d0039060 0x7f42d003b520 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:49.287+0000 7f42f0e00640 1 --2- 172.21.15.12:0/3074325156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42ec107640 0x7f42ec199330 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:49.287+0000 7f42f0e00640 1 -- 172.21.15.12:0/3074325156 >> 172.21.15.12:0/3074325156 conn(0x7f42ec0fd230 msgr2=0x7f42ec075e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:49.287+0000 7f42f0e00640 1 -- 172.21.15.12:0/3074325156 shutdown_connections 2024-09-05T01:15:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:49.287+0000 7f42f0e00640 1 -- 172.21.15.12:0/3074325156 wait complete. 2024-09-05T01:15:50.089 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph orch host ls --format=json 2024-09-05T01:15:50.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:50.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:50 smithi012 ceph-mon[29942]: Added host smithi151 2024-09-05T01:15:50.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:15:50.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:50.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:50.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:50 smithi012 ceph-mon[29942]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:15:50.459 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:15:51.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.143+0000 7ffb31800640 1 -- 172.21.15.12:0/93002393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb2c109740 msgr2=0x7ffb2c109b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:51.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.143+0000 7ffb31800640 1 --2- 172.21.15.12:0/93002393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb2c109740 0x7ffb2c109b20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009880 tx=0x7ffb1c02a5d0 comp rx=0 tx=0).stop 2024-09-05T01:15:51.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.143+0000 7ffb31800640 1 -- 172.21.15.12:0/93002393 shutdown_connections 2024-09-05T01:15:51.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.143+0000 7ffb31800640 1 --2- 172.21.15.12:0/93002393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb2c109740 0x7ffb2c109b20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:51.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.143+0000 7ffb31800640 1 -- 172.21.15.12:0/93002393 >> 172.21.15.12:0/93002393 conn(0x7ffb2c0ff2c0 msgr2=0x7ffb2c1016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:51.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.143+0000 7ffb31800640 1 -- 172.21.15.12:0/93002393 shutdown_connections 2024-09-05T01:15:51.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.143+0000 7ffb31800640 1 -- 172.21.15.12:0/93002393 wait complete. 2024-09-05T01:15:51.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.144+0000 7ffb31800640 1 Processor -- start 2024-09-05T01:15:51.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.145+0000 7ffb31800640 1 -- start start 2024-09-05T01:15:51.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.145+0000 7ffb31800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb2c109740 0x7ffb2c1991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:51.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.145+0000 7ffb31800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2c10dd50 con 0x7ffb2c109740 2024-09-05T01:15:51.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.145+0000 7ffb2be00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb2c109740 0x7ffb2c1991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:51.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.145+0000 7ffb2be00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb2c109740 0x7ffb2c1991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59544/0 (socket says 172.21.15.12:59544) 2024-09-05T01:15:51.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.145+0000 7ffb2be00640 1 -- 172.21.15.12:0/1275695855 learned_addr learned my addr 172.21.15.12:0/1275695855 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:51.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.146+0000 7ffb2be00640 1 -- 172.21.15.12:0/1275695855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2c199720 con 0x7ffb2c109740 2024-09-05T01:15:51.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.146+0000 7ffb2be00640 1 --2- 172.21.15.12:0/1275695855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb2c109740 0x7ffb2c1991e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009230 tx=0x7ffb1c003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:51.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.146+0000 7ffb28c00640 1 -- 172.21.15.12:0/1275695855 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb1c03f070 con 0x7ffb2c109740 2024-09-05T01:15:51.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.146+0000 7ffb28c00640 1 -- 172.21.15.12:0/1275695855 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb1c03bd40 con 0x7ffb2c109740 2024-09-05T01:15:51.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.146+0000 7ffb31800640 1 -- 172.21.15.12:0/1275695855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb2c199a10 con 0x7ffb2c109740 2024-09-05T01:15:51.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.146+0000 7ffb28c00640 1 -- 172.21.15.12:0/1275695855 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb1c035030 con 0x7ffb2c109740 2024-09-05T01:15:51.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.146+0000 7ffb31800640 1 -- 172.21.15.12:0/1275695855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb2c19dab0 con 0x7ffb2c109740 2024-09-05T01:15:51.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.147+0000 7ffb28c00640 1 -- 172.21.15.12:0/1275695855 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ffb1c042070 con 0x7ffb2c109740 2024-09-05T01:15:51.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.147+0000 7ffb31800640 1 -- 172.21.15.12:0/1275695855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb2c104ce0 con 0x7ffb2c109740 2024-09-05T01:15:51.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.148+0000 7ffb28c00640 1 --2- 172.21.15.12:0/1275695855 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7ffb10039060 0x7ffb1003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:51.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.148+0000 7ffb28c00640 1 -- 172.21.15.12:0/1275695855 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ffb1c06cc70 con 0x7ffb2c109740 2024-09-05T01:15:51.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.148+0000 7ffb2b400640 1 --2- 172.21.15.12:0/1275695855 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7ffb10039060 0x7ffb1003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:51.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.149+0000 7ffb2b400640 1 --2- 172.21.15.12:0/1275695855 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7ffb10039060 0x7ffb1003b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ffb180098c0 tx=0x7ffb18006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:51.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.153+0000 7ffb28c00640 1 -- 172.21.15.12:0/1275695855 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffb1c036df0 con 0x7ffb2c109740 2024-09-05T01:15:51.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.342+0000 7ffb31800640 1 -- 172.21.15.12:0/1275695855 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffb2c109bd0 con 0x7ffb10039060 2024-09-05T01:15:51.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.343+0000 7ffb28c00640 1 -- 172.21.15.12:0/1275695855 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7ffb2c109bd0 con 0x7ffb10039060 2024-09-05T01:15:51.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:15:51.343 INFO:teuthology.orchestra.run.smithi012.stdout:[{"addr": "172.21.15.12", "hostname": "smithi012", "labels": [], "status": ""}, {"addr": "172.21.15.145", "hostname": "smithi145", "labels": [], "status": ""}, {"addr": "172.21.15.151", "hostname": "smithi151", "labels": [], "status": ""}] 2024-09-05T01:15:51.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.345+0000 7ffb31800640 1 -- 172.21.15.12:0/1275695855 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7ffb10039060 msgr2=0x7ffb1003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:51.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.345+0000 7ffb31800640 1 --2- 172.21.15.12:0/1275695855 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7ffb10039060 0x7ffb1003b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ffb180098c0 tx=0x7ffb18006db0 comp rx=0 tx=0).stop 2024-09-05T01:15:51.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.345+0000 7ffb31800640 1 -- 172.21.15.12:0/1275695855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb2c109740 msgr2=0x7ffb2c1991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:51.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.345+0000 7ffb31800640 1 --2- 172.21.15.12:0/1275695855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb2c109740 0x7ffb2c1991e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009230 tx=0x7ffb1c003d80 comp rx=0 tx=0).stop 2024-09-05T01:15:51.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.346+0000 7ffb31800640 1 -- 172.21.15.12:0/1275695855 shutdown_connections 2024-09-05T01:15:51.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.346+0000 7ffb31800640 1 --2- 172.21.15.12:0/1275695855 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7ffb10039060 0x7ffb1003b520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:51.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.346+0000 7ffb31800640 1 --2- 172.21.15.12:0/1275695855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb2c109740 0x7ffb2c1991e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.346+0000 7ffb31800640 1 -- 172.21.15.12:0/1275695855 >> 172.21.15.12:0/1275695855 conn(0x7ffb2c0ff2c0 msgr2=0x7ffb2c0ff6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.346+0000 7ffb31800640 1 -- 172.21.15.12:0/1275695855 shutdown_connections 2024-09-05T01:15:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:51.346+0000 7ffb31800640 1 -- 172.21.15.12:0/1275695855 wait complete. 2024-09-05T01:15:51.898 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:51 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:51.935 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-05T01:15:51.935 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd crush tunables default 2024-09-05T01:15:52.298 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:15:52.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:52 smithi012 ceph-mon[29942]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T01:15:52.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:52 smithi012 ceph-mon[29942]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:15:52.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.840+0000 7f11f5a00640 1 -- 172.21.15.12:0/3187224267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11f0074590 msgr2=0x7f11f0074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:52.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.840+0000 7f11f5a00640 1 --2- 172.21.15.12:0/3187224267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11f0074590 0x7f11f0074970 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f11e0009880 tx=0x7f11e002a670 comp rx=0 tx=0).stop 2024-09-05T01:15:52.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.840+0000 7f11f5a00640 1 -- 172.21.15.12:0/3187224267 shutdown_connections 2024-09-05T01:15:52.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.840+0000 7f11f5a00640 1 --2- 172.21.15.12:0/3187224267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11f0074590 0x7f11f0074970 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:52.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.840+0000 7f11f5a00640 1 -- 172.21.15.12:0/3187224267 >> 172.21.15.12:0/3187224267 conn(0x7f11f00fd290 msgr2=0x7f11f00ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:52.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.840+0000 7f11f5a00640 1 -- 172.21.15.12:0/3187224267 shutdown_connections 2024-09-05T01:15:52.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.840+0000 7f11f5a00640 1 -- 172.21.15.12:0/3187224267 wait complete. 2024-09-05T01:15:52.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.841+0000 7f11f5a00640 1 Processor -- start 2024-09-05T01:15:52.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.841+0000 7f11f5a00640 1 -- start start 2024-09-05T01:15:52.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.842+0000 7f11f5a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11f0074590 0x7f11f01a3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:52.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.842+0000 7f11f5a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f11f01122b0 con 0x7f11f0074590 2024-09-05T01:15:52.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.842+0000 7f11eea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11f0074590 0x7f11f01a3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:52.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.842+0000 7f11eea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11f0074590 0x7f11f01a3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59558/0 (socket says 172.21.15.12:59558) 2024-09-05T01:15:52.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.842+0000 7f11eea00640 1 -- 172.21.15.12:0/3427145756 learned_addr learned my addr 172.21.15.12:0/3427145756 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:15:52.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.842+0000 7f11eea00640 1 -- 172.21.15.12:0/3427145756 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f01a3950 con 0x7f11f0074590 2024-09-05T01:15:52.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.842+0000 7f11eea00640 1 --2- 172.21.15.12:0/3427145756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11f0074590 0x7f11f01a3410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f11e0009230 tx=0x7f11e0003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:52.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.843+0000 7f11e7400640 1 -- 172.21.15.12:0/3427145756 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11e003f070 con 0x7f11f0074590 2024-09-05T01:15:52.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.843+0000 7f11e7400640 1 -- 172.21.15.12:0/3427145756 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11e003bd40 con 0x7f11f0074590 2024-09-05T01:15:52.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.843+0000 7f11f5a00640 1 -- 172.21.15.12:0/3427145756 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11f01a3be0 con 0x7f11f0074590 2024-09-05T01:15:52.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.843+0000 7f11e7400640 1 -- 172.21.15.12:0/3427145756 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11e0035030 con 0x7f11f0074590 2024-09-05T01:15:52.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.843+0000 7f11f5a00640 1 -- 172.21.15.12:0/3427145756 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11f019d5d0 con 0x7f11f0074590 2024-09-05T01:15:52.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.844+0000 7f11e7400640 1 -- 172.21.15.12:0/3427145756 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f11e0042070 con 0x7f11f0074590 2024-09-05T01:15:52.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.844+0000 7f11f5a00640 1 -- 172.21.15.12:0/3427145756 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11f0075cd0 con 0x7f11f0074590 2024-09-05T01:15:52.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.845+0000 7f11e7400640 1 --2- 172.21.15.12:0/3427145756 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f11d4039060 0x7f11d403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:52.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.845+0000 7f11e7400640 1 -- 172.21.15.12:0/3427145756 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f11e006cd20 con 0x7f11f0074590 2024-09-05T01:15:52.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.845+0000 7f11ee000640 1 --2- 172.21.15.12:0/3427145756 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f11d4039060 0x7f11d403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:52.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.846+0000 7f11ee000640 1 --2- 172.21.15.12:0/3427145756 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f11d4039060 0x7f11d403b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f11dc0098c0 tx=0x7f11dc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:52.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:52.850+0000 7f11e7400640 1 -- 172.21.15.12:0/3427145756 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f11e0030d60 con 0x7f11f0074590 2024-09-05T01:15:53.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:53.043+0000 7f11f5a00640 1 -- 172.21.15.12:0/3427145756 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f11f019eb00 con 0x7f11f0074590 2024-09-05T01:15:53.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:53.644+0000 7f11e7400640 1 -- 172.21.15.12:0/3427145756 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f11e003b860 con 0x7f11f0074590 2024-09-05T01:15:53.646 INFO:teuthology.orchestra.run.smithi012.stderr:adjusted tunables profile to default 2024-09-05T01:15:53.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:53.647+0000 7f11f5a00640 1 -- 172.21.15.12:0/3427145756 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f11d4039060 msgr2=0x7f11d403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:53.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:53.647+0000 7f11f5a00640 1 --2- 172.21.15.12:0/3427145756 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f11d4039060 0x7f11d403b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f11dc0098c0 tx=0x7f11dc006db0 comp rx=0 tx=0).stop 2024-09-05T01:15:53.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:53.647+0000 7f11f5a00640 1 -- 172.21.15.12:0/3427145756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11f0074590 msgr2=0x7f11f01a3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:53.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:53.647+0000 7f11f5a00640 1 --2- 172.21.15.12:0/3427145756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11f0074590 0x7f11f01a3410 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f11e0009230 tx=0x7f11e0003d80 comp rx=0 tx=0).stop 2024-09-05T01:15:53.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:53.647+0000 7f11f5a00640 1 -- 172.21.15.12:0/3427145756 shutdown_connections 2024-09-05T01:15:53.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:53.647+0000 7f11f5a00640 1 --2- 172.21.15.12:0/3427145756 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f11d4039060 0x7f11d403b520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:53.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:53.647+0000 7f11f5a00640 1 --2- 172.21.15.12:0/3427145756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11f0074590 0x7f11f01a3410 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:53.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:53.647+0000 7f11f5a00640 1 -- 172.21.15.12:0/3427145756 >> 172.21.15.12:0/3427145756 conn(0x7f11f00fd290 msgr2=0x7f11f00fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:53.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:53.647+0000 7f11f5a00640 1 -- 172.21.15.12:0/3427145756 shutdown_connections 2024-09-05T01:15:53.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:15:53.647+0000 7f11f5a00640 1 -- 172.21.15.12:0/3427145756 wait complete. 2024-09-05T01:15:53.980 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:53 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3427145756' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-05T01:15:53.980 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:53 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:53.980 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:53 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:53.980 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:53 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:53.981 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:53 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:53.981 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:53 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi151", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:15:53.981 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:53 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:15:53.981 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:53 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:15:54.344 INFO:tasks.cephadm:Adding mon.a on smithi012 2024-09-05T01:15:54.345 INFO:tasks.cephadm:Adding mon.b on smithi145 2024-09-05T01:15:54.345 INFO:tasks.cephadm:Adding mon.c on smithi151 2024-09-05T01:15:54.345 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph orch apply mon '3;smithi012:172.21.15.12=a;smithi145:172.21.15.145=b;smithi151:172.21.15.151=c' 2024-09-05T01:15:54.580 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:15:54.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.978+0000 7ff349201640 1 -- 172.21.15.151:0/2288113139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff344100530 msgr2=0x7ff344100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:54.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.978+0000 7ff349201640 1 --2- 172.21.15.151:0/2288113139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff344100530 0x7ff344100910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff334009880 tx=0x7ff33402a5d0 comp rx=0 tx=0).stop 2024-09-05T01:15:54.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.978+0000 7ff349201640 1 -- 172.21.15.151:0/2288113139 shutdown_connections 2024-09-05T01:15:54.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.978+0000 7ff349201640 1 --2- 172.21.15.151:0/2288113139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff344100530 0x7ff344100910 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:54.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.978+0000 7ff349201640 1 -- 172.21.15.151:0/2288113139 >> 172.21.15.151:0/2288113139 conn(0x7ff3440fbff0 msgr2=0x7ff3440fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:54.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.978+0000 7ff349201640 1 -- 172.21.15.151:0/2288113139 shutdown_connections 2024-09-05T01:15:54.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.978+0000 7ff349201640 1 -- 172.21.15.151:0/2288113139 wait complete. 2024-09-05T01:15:54.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.979+0000 7ff349201640 1 Processor -- start 2024-09-05T01:15:54.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.980+0000 7ff349201640 1 -- start start 2024-09-05T01:15:54.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.980+0000 7ff349201640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff344100530 0x7ff3440fc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:54.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.980+0000 7ff349201640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff34410a980 con 0x7ff344100530 2024-09-05T01:15:54.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.980+0000 7ff342d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff344100530 0x7ff3440fc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:54.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.980+0000 7ff342d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff344100530 0x7ff3440fc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:51726/0 (socket says 172.21.15.151:51726) 2024-09-05T01:15:54.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.980+0000 7ff342d9d640 1 -- 172.21.15.151:0/73678742 learned_addr learned my addr 172.21.15.151:0/73678742 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-05T01:15:54.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.981+0000 7ff342d9d640 1 -- 172.21.15.151:0/73678742 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3440fe340 con 0x7ff344100530 2024-09-05T01:15:54.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.981+0000 7ff342d9d640 1 --2- 172.21.15.151:0/73678742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff344100530 0x7ff3440fc4a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff334009230 tx=0x7ff334003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:54.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.981+0000 7ff32bfff640 1 -- 172.21.15.151:0/73678742 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff33403f070 con 0x7ff344100530 2024-09-05T01:15:54.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.981+0000 7ff349201640 1 -- 172.21.15.151:0/73678742 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3440fc9e0 con 0x7ff344100530 2024-09-05T01:15:54.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.981+0000 7ff32bfff640 1 -- 172.21.15.151:0/73678742 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff33403bc80 con 0x7ff344100530 2024-09-05T01:15:54.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.981+0000 7ff32bfff640 1 -- 172.21.15.151:0/73678742 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff334035030 con 0x7ff344100530 2024-09-05T01:15:54.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.981+0000 7ff349201640 1 -- 172.21.15.151:0/73678742 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3440fcea0 con 0x7ff344100530 2024-09-05T01:15:54.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.982+0000 7ff32bfff640 1 -- 172.21.15.151:0/73678742 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7ff334042070 con 0x7ff344100530 2024-09-05T01:15:54.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.982+0000 7ff349201640 1 -- 172.21.15.151:0/73678742 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff344101a10 con 0x7ff344100530 2024-09-05T01:15:54.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.982+0000 7ff32bfff640 1 --2- 172.21.15.151:0/73678742 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7ff32c039060 0x7ff32c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:54.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.982+0000 7ff32bfff640 1 -- 172.21.15.151:0/73678742 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff33406cee0 con 0x7ff344100530 2024-09-05T01:15:54.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.983+0000 7ff34259c640 1 --2- 172.21.15.151:0/73678742 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7ff32c039060 0x7ff32c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:54.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.983+0000 7ff34259c640 1 --2- 172.21.15.151:0/73678742 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7ff32c039060 0x7ff32c03b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff3380098c0 tx=0x7ff338006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:54.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:54.988+0000 7ff32bfff640 1 -- 172.21.15.151:0/73678742 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff33404c350 con 0x7ff344100530 2024-09-05T01:15:55.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:54 smithi012 ceph-mon[29942]: Updating smithi151:/etc/ceph/ceph.conf 2024-09-05T01:15:55.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:54 smithi012 ceph-mon[29942]: Updating smithi151:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:15:55.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:54 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3427145756' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-05T01:15:55.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:54 smithi012 ceph-mon[29942]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T01:15:55.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:54 smithi012 ceph-mon[29942]: Updating smithi151:/etc/ceph/ceph.client.admin.keyring 2024-09-05T01:15:55.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:54 smithi012 ceph-mon[29942]: Updating smithi151:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-05T01:15:55.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:54 smithi012 ceph-mon[29942]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:15:55.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:54 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:55.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:54 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:55.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:54 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:55.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:55.172+0000 7ff349201640 1 -- 172.21.15.151:0/73678742 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi012:172.21.15.12=a;smithi145:172.21.15.145=b;smithi151:172.21.15.151=c", "target": ["mon-mgr", ""]}) -- 0x7ff3440fda40 con 0x7ff32c039060 2024-09-05T01:15:55.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:55.178+0000 7ff32bfff640 1 -- 172.21.15.151:0/73678742 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff3440fda40 con 0x7ff32c039060 2024-09-05T01:15:55.180 INFO:teuthology.orchestra.run.smithi151.stdout:Scheduled mon update... 2024-09-05T01:15:55.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:55.181+0000 7ff349201640 1 -- 172.21.15.151:0/73678742 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7ff32c039060 msgr2=0x7ff32c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:55.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:55.181+0000 7ff349201640 1 --2- 172.21.15.151:0/73678742 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7ff32c039060 0x7ff32c03b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff3380098c0 tx=0x7ff338006db0 comp rx=0 tx=0).stop 2024-09-05T01:15:55.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:55.181+0000 7ff349201640 1 -- 172.21.15.151:0/73678742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff344100530 msgr2=0x7ff3440fc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:55.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:55.181+0000 7ff349201640 1 --2- 172.21.15.151:0/73678742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff344100530 0x7ff3440fc4a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff334009230 tx=0x7ff334003d40 comp rx=0 tx=0).stop 2024-09-05T01:15:55.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:55.181+0000 7ff349201640 1 -- 172.21.15.151:0/73678742 shutdown_connections 2024-09-05T01:15:55.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:55.181+0000 7ff349201640 1 --2- 172.21.15.151:0/73678742 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7ff32c039060 0x7ff32c03b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:55.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:55.181+0000 7ff349201640 1 --2- 172.21.15.151:0/73678742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff344100530 0x7ff3440fc4a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:55.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:55.181+0000 7ff349201640 1 -- 172.21.15.151:0/73678742 >> 172.21.15.151:0/73678742 conn(0x7ff3440fbff0 msgr2=0x7ff344103f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:55.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:55.181+0000 7ff349201640 1 -- 172.21.15.151:0/73678742 shutdown_connections 2024-09-05T01:15:55.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:55.181+0000 7ff349201640 1 -- 172.21.15.151:0/73678742 wait complete. 2024-09-05T01:15:55.794 DEBUG:teuthology.orchestra.run.smithi145:mon.b> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mon.b.service 2024-09-05T01:15:55.797 DEBUG:teuthology.orchestra.run.smithi151:mon.c> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mon.c.service 2024-09-05T01:15:55.799 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-05T01:15:55.800 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-05T01:15:56.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:56 smithi012 ceph-mon[29942]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi012:172.21.15.12=a;smithi145:172.21.15.145=b;smithi151:172.21.15.151=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:15:56.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:56 smithi012 ceph-mon[29942]: Saving service mon spec with placement smithi012:172.21.15.12=a;smithi145:172.21.15.145=b;smithi151:172.21.15.151=c;count:3 2024-09-05T01:15:56.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:56.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:15:56.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:15:56.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:15:56.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:15:56.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T01:15:56.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:15:56.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:56 smithi012 ceph-mon[29942]: Deploying daemon mon.c on smithi151 2024-09-05T01:15:56.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:56 smithi012 ceph-mon[29942]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:15:56.692 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:15:57.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.303+0000 7f07004f9640 1 -- 172.21.15.151:0/2274493790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06f80ffe40 msgr2=0x7f06f8100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:57.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.303+0000 7f07004f9640 1 --2- 172.21.15.151:0/2274493790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06f80ffe40 0x7f06f8100220 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009880 tx=0x7f06f402a5d0 comp rx=0 tx=0).stop 2024-09-05T01:15:57.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.303+0000 7f07004f9640 1 -- 172.21.15.151:0/2274493790 shutdown_connections 2024-09-05T01:15:57.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.303+0000 7f07004f9640 1 --2- 172.21.15.151:0/2274493790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06f80ffe40 0x7f06f8100220 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:57.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.303+0000 7f07004f9640 1 -- 172.21.15.151:0/2274493790 >> 172.21.15.151:0/2274493790 conn(0x7f06f80fb8c0 msgr2=0x7f06f80fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:57.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.303+0000 7f07004f9640 1 -- 172.21.15.151:0/2274493790 shutdown_connections 2024-09-05T01:15:57.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.303+0000 7f07004f9640 1 -- 172.21.15.151:0/2274493790 wait complete. 2024-09-05T01:15:57.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.303+0000 7f07004f9640 1 Processor -- start 2024-09-05T01:15:57.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.303+0000 7f07004f9640 1 -- start start 2024-09-05T01:15:57.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.304+0000 7f07004f9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06f80ffe40 0x7f06f8197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:57.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.304+0000 7f07004f9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f06f810a290 con 0x7f06f80ffe40 2024-09-05T01:15:57.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.304+0000 7f06fe295640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06f80ffe40 0x7f06f8197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:57.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.304+0000 7f06fe295640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06f80ffe40 0x7f06f8197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:51744/0 (socket says 172.21.15.151:51744) 2024-09-05T01:15:57.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.304+0000 7f06fe295640 1 -- 172.21.15.151:0/3151430162 learned_addr learned my addr 172.21.15.151:0/3151430162 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-05T01:15:57.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.304+0000 7f06fe295640 1 -- 172.21.15.151:0/3151430162 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f81984f0 con 0x7f06f80ffe40 2024-09-05T01:15:57.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.305+0000 7f06fe295640 1 --2- 172.21.15.151:0/3151430162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06f80ffe40 0x7f06f8197fb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009230 tx=0x7f06f4003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:57.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.305+0000 7f06ef7fe640 1 -- 172.21.15.151:0/3151430162 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f403f070 con 0x7f06f80ffe40 2024-09-05T01:15:57.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.305+0000 7f07004f9640 1 -- 172.21.15.151:0/3151430162 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f81987e0 con 0x7f06f80ffe40 2024-09-05T01:15:57.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.305+0000 7f06ef7fe640 1 -- 172.21.15.151:0/3151430162 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06f403bc80 con 0x7f06f80ffe40 2024-09-05T01:15:57.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.305+0000 7f06ef7fe640 1 -- 172.21.15.151:0/3151430162 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f4035030 con 0x7f06f80ffe40 2024-09-05T01:15:57.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.305+0000 7f07004f9640 1 -- 172.21.15.151:0/3151430162 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f8198ca0 con 0x7f06f80ffe40 2024-09-05T01:15:57.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.306+0000 7f06ef7fe640 1 -- 172.21.15.151:0/3151430162 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f06f4042070 con 0x7f06f80ffe40 2024-09-05T01:15:57.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.306+0000 7f06ef7fe640 1 --2- 172.21.15.151:0/3151430162 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f06e4039060 0x7f06e403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:57.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.306+0000 7f06ef7fe640 1 -- 172.21.15.151:0/3151430162 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f06f406cdd0 con 0x7f06f80ffe40 2024-09-05T01:15:57.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.306+0000 7f07004f9640 1 -- 172.21.15.151:0/3151430162 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f8101320 con 0x7f06f80ffe40 2024-09-05T01:15:57.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.306+0000 7f06fda94640 1 --2- 172.21.15.151:0/3151430162 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f06e4039060 0x7f06e403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:57.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.307+0000 7f06fda94640 1 --2- 172.21.15.151:0/3151430162 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f06e4039060 0x7f06e403b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f06e80098c0 tx=0x7f06e8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:57.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.312+0000 7f06ef7fe640 1 -- 172.21.15.151:0/3151430162 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f06f40372d0 con 0x7f06f80ffe40 2024-09-05T01:15:57.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.547+0000 7f07004f9640 1 -- 172.21.15.151:0/3151430162 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f06f81002a0 con 0x7f06f80ffe40 2024-09-05T01:15:57.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.548+0000 7f06ef7fe640 1 -- 172.21.15.151:0/3151430162 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f06f40314c0 con 0x7f06f80ffe40 2024-09-05T01:15:57.659 INFO:teuthology.orchestra.run.smithi151.stderr:dumped monmap epoch 1 2024-09-05T01:15:57.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.550+0000 7f07004f9640 1 -- 172.21.15.151:0/3151430162 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f06e4039060 msgr2=0x7f06e403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:57.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.550+0000 7f07004f9640 1 --2- 172.21.15.151:0/3151430162 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f06e4039060 0x7f06e403b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f06e80098c0 tx=0x7f06e8006db0 comp rx=0 tx=0).stop 2024-09-05T01:15:57.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.550+0000 7f07004f9640 1 -- 172.21.15.151:0/3151430162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06f80ffe40 msgr2=0x7f06f8197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:57.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.550+0000 7f07004f9640 1 --2- 172.21.15.151:0/3151430162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06f80ffe40 0x7f06f8197fb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009230 tx=0x7f06f4003d40 comp rx=0 tx=0).stop 2024-09-05T01:15:57.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.550+0000 7f07004f9640 1 -- 172.21.15.151:0/3151430162 shutdown_connections 2024-09-05T01:15:57.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.550+0000 7f07004f9640 1 --2- 172.21.15.151:0/3151430162 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f06e4039060 0x7f06e403b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:57.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.550+0000 7f07004f9640 1 --2- 172.21.15.151:0/3151430162 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f06f80ffe40 0x7f06f8197fb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:57.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.550+0000 7f07004f9640 1 -- 172.21.15.151:0/3151430162 >> 172.21.15.151:0/3151430162 conn(0x7f06f80fb8c0 msgr2=0x7f06f80fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:57.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.550+0000 7f07004f9640 1 -- 172.21.15.151:0/3151430162 shutdown_connections 2024-09-05T01:15:57.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:57.550+0000 7f07004f9640 1 -- 172.21.15.151:0/3151430162 wait complete. 2024-09-05T01:15:57.660 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-05T01:15:57.660 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":1,"fsid":"0d44cd7e-6b24-11ef-bcd6-c7b262605968","modified":"2024-09-05T01:14:17.366670Z","created":"2024-09-05T01:14:17.366670Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3300","nonce":0},{"type":"v1","addr":"172.21.15.12:6789","nonce":0}]},"addr":"172.21.15.12:6789/0","public_addr":"172.21.15.12:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-05T01:15:58.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:57 smithi012 ceph-mon[29942]: from='client.? 172.21.15.151:0/3151430162' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T01:15:59.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:15:58 smithi012 ceph-mon[29942]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:15:59.175 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-05T01:15:59.176 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-05T01:15:59.484 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T01:15:59.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.902+0000 7efdcef68640 1 -- 172.21.15.151:0/2711440803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdc8106650 msgr2=0x7efdc8106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:15:59.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.902+0000 7efdcef68640 1 --2- 172.21.15.151:0/2711440803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdc8106650 0x7efdc8106a30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efdbc009880 tx=0x7efdbc02a5d0 comp rx=0 tx=0).stop 2024-09-05T01:15:59.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.903+0000 7efdcef68640 1 -- 172.21.15.151:0/2711440803 shutdown_connections 2024-09-05T01:15:59.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.903+0000 7efdcef68640 1 --2- 172.21.15.151:0/2711440803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdc8106650 0x7efdc8106a30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:15:59.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.903+0000 7efdcef68640 1 -- 172.21.15.151:0/2711440803 >> 172.21.15.151:0/2711440803 conn(0x7efdc80fc280 msgr2=0x7efdc80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:15:59.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.903+0000 7efdcef68640 1 -- 172.21.15.151:0/2711440803 shutdown_connections 2024-09-05T01:15:59.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.903+0000 7efdcef68640 1 -- 172.21.15.151:0/2711440803 wait complete. 2024-09-05T01:15:59.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.903+0000 7efdcef68640 1 Processor -- start 2024-09-05T01:15:59.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.903+0000 7efdcef68640 1 -- start start 2024-09-05T01:15:59.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.903+0000 7efdcef68640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdc8106650 0x7efdc8196120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:59.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.903+0000 7efdcef68640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efdc810ac80 con 0x7efdc8106650 2024-09-05T01:15:59.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.904+0000 7efdccd04640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdc8106650 0x7efdc8196120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:59.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.904+0000 7efdccd04640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdc8106650 0x7efdc8196120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:51762/0 (socket says 172.21.15.151:51762) 2024-09-05T01:15:59.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.904+0000 7efdccd04640 1 -- 172.21.15.151:0/2784767997 learned_addr learned my addr 172.21.15.151:0/2784767997 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-05T01:15:59.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.904+0000 7efdccd04640 1 -- 172.21.15.151:0/2784767997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc8196660 con 0x7efdc8106650 2024-09-05T01:15:59.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.905+0000 7efdccd04640 1 --2- 172.21.15.151:0/2784767997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdc8106650 0x7efdc8196120 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efdbc009230 tx=0x7efdbc003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:59.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.905+0000 7efdc5ffb640 1 -- 172.21.15.151:0/2784767997 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdbc03f070 con 0x7efdc8106650 2024-09-05T01:15:59.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.905+0000 7efdcef68640 1 -- 172.21.15.151:0/2784767997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc81968f0 con 0x7efdc8106650 2024-09-05T01:15:59.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.905+0000 7efdc5ffb640 1 -- 172.21.15.151:0/2784767997 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdbc03bc80 con 0x7efdc8106650 2024-09-05T01:15:59.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.905+0000 7efdc5ffb640 1 -- 172.21.15.151:0/2784767997 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdbc035030 con 0x7efdc8106650 2024-09-05T01:15:59.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.905+0000 7efdcef68640 1 -- 172.21.15.151:0/2784767997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc819a9f0 con 0x7efdc8106650 2024-09-05T01:15:59.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.906+0000 7efdcef68640 1 -- 172.21.15.151:0/2784767997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdc8101cc0 con 0x7efdc8106650 2024-09-05T01:15:59.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.906+0000 7efdc5ffb640 1 -- 172.21.15.151:0/2784767997 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7efdbc042070 con 0x7efdc8106650 2024-09-05T01:15:59.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.906+0000 7efdc5ffb640 1 --2- 172.21.15.151:0/2784767997 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7efdb803b270 0x7efdb803d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:15:59.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.906+0000 7efdc5ffb640 1 -- 172.21.15.151:0/2784767997 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7efdbc06cce0 con 0x7efdc8106650 2024-09-05T01:15:59.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.907+0000 7efdc7fff640 1 --2- 172.21.15.151:0/2784767997 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7efdb803b270 0x7efdb803d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:15:59.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.908+0000 7efdc7fff640 1 --2- 172.21.15.151:0/2784767997 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7efdb803b270 0x7efdb803d730 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efdb40098c0 tx=0x7efdb4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:15:59.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:15:59.912+0000 7efdc5ffb640 1 -- 172.21.15.151:0/2784767997 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efdbc031e20 con 0x7efdc8106650 2024-09-05T01:16:00.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 podman[34977]: 2024-09-05 01:16:00.067213744 +0000 UTC m=+0.109182209 container create 28c7935e5f5c2ee92797c961ad12b0240848cbb31fdd4fcbd4f23a3abc010d1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-c, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-05T01:16:00.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 podman[34977]: 2024-09-05 01:15:59.976369163 +0000 UTC m=+0.018337650 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:16:00.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:00.160+0000 7efdcef68640 1 -- 172.21.15.151:0/2784767997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7efdc8197480 con 0x7efdc8106650 2024-09-05T01:16:00.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:00.160+0000 7efdc5ffb640 1 -- 172.21.15.151:0/2784767997 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7efdbc0372d0 con 0x7efdc8106650 2024-09-05T01:16:00.161 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-05T01:16:00.161 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":1,"fsid":"0d44cd7e-6b24-11ef-bcd6-c7b262605968","modified":"2024-09-05T01:14:17.366670Z","created":"2024-09-05T01:14:17.366670Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3300","nonce":0},{"type":"v1","addr":"172.21.15.12:6789","nonce":0}]},"addr":"172.21.15.12:6789/0","public_addr":"172.21.15.12:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-05T01:16:00.162 INFO:teuthology.orchestra.run.smithi151.stderr:dumped monmap epoch 1 2024-09-05T01:16:00.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:00.163+0000 7efdcef68640 1 -- 172.21.15.151:0/2784767997 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7efdb803b270 msgr2=0x7efdb803d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:00.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:00.163+0000 7efdcef68640 1 --2- 172.21.15.151:0/2784767997 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7efdb803b270 0x7efdb803d730 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efdb40098c0 tx=0x7efdb4006db0 comp rx=0 tx=0).stop 2024-09-05T01:16:00.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:00.163+0000 7efdcef68640 1 -- 172.21.15.151:0/2784767997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdc8106650 msgr2=0x7efdc8196120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:00.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:00.163+0000 7efdcef68640 1 --2- 172.21.15.151:0/2784767997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdc8106650 0x7efdc8196120 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efdbc009230 tx=0x7efdbc003d40 comp rx=0 tx=0).stop 2024-09-05T01:16:00.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:00.163+0000 7efdcef68640 1 -- 172.21.15.151:0/2784767997 shutdown_connections 2024-09-05T01:16:00.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:00.163+0000 7efdcef68640 1 --2- 172.21.15.151:0/2784767997 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7efdb803b270 0x7efdb803d730 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:00.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:00.163+0000 7efdcef68640 1 --2- 172.21.15.151:0/2784767997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdc8106650 0x7efdc8196120 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:00.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:00.163+0000 7efdcef68640 1 -- 172.21.15.151:0/2784767997 >> 172.21.15.151:0/2784767997 conn(0x7efdc80fc280 msgr2=0x7efdc80fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:16:00.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:00.163+0000 7efdcef68640 1 -- 172.21.15.151:0/2784767997 shutdown_connections 2024-09-05T01:16:00.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:00.163+0000 7efdcef68640 1 -- 172.21.15.151:0/2784767997 wait complete. 2024-09-05T01:16:00.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:00 smithi012 ceph-mon[29942]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:00.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:00 smithi012 ceph-mon[29942]: from='client.? 172.21.15.151:0/2784767997' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T01:16:00.882 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 podman[34977]: 2024-09-05 01:16:00.856987784 +0000 UTC m=+0.898956258 container init 28c7935e5f5c2ee92797c961ad12b0240848cbb31fdd4fcbd4f23a3abc010d1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-05T01:16:00.883 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 podman[34977]: 2024-09-05 01:16:00.860671871 +0000 UTC m=+0.902640338 container start 28c7935e5f5c2ee92797c961ad12b0240848cbb31fdd4fcbd4f23a3abc010d1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-c, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-05T01:16:01.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: set uid:gid to 167:167 (ceph:ceph) 2024-09-05T01:16:01.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: ceph version 19.1.1-259-g91c8a7e5 (91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4) squid (stable), process ceph-mon, pid 2 2024-09-05T01:16:01.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: pidfile_write: ignore empty --pid-file 2024-09-05T01:16:01.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: load: jerasure load: lrc 2024-09-05T01:16:01.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: RocksDB version: 7.9.2 2024-09-05T01:16:01.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Git sha 0 2024-09-05T01:16:01.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Compile date 2024-09-04 15:32:03 2024-09-05T01:16:01.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: DB SUMMARY 2024-09-05T01:16:01.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: DB Session ID: ZGEO8QS443MQ2274TMSG 2024-09-05T01:16:01.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: CURRENT file: CURRENT 2024-09-05T01:16:01.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: IDENTITY file: IDENTITY 2024-09-05T01:16:01.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-05T01:16:01.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-05T01:16:01.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-05T01:16:01.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.error_if_exists: 0 2024-09-05T01:16:01.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.create_if_missing: 0 2024-09-05T01:16:01.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.paranoid_checks: 1 2024-09-05T01:16:01.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-05T01:16:01.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-05T01:16:01.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-05T01:16:01.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.env: 0x561ddf7bb940 2024-09-05T01:16:01.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.fs: PosixFileSystem 2024-09-05T01:16:01.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.info_log: 0x561de0ead6e0 2024-09-05T01:16:01.358 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_file_opening_threads: 16 2024-09-05T01:16:01.358 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.statistics: (nil) 2024-09-05T01:16:01.358 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.use_fsync: 0 2024-09-05T01:16:01.358 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_log_file_size: 0 2024-09-05T01:16:01.358 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-05T01:16:01.358 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-05T01:16:01.358 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.keep_log_file_num: 1000 2024-09-05T01:16:01.359 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.recycle_log_file_num: 0 2024-09-05T01:16:01.359 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.allow_fallocate: 1 2024-09-05T01:16:01.359 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.allow_mmap_reads: 0 2024-09-05T01:16:01.359 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.allow_mmap_writes: 0 2024-09-05T01:16:01.359 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.use_direct_reads: 0 2024-09-05T01:16:01.359 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-05T01:16:01.359 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.create_missing_column_families: 0 2024-09-05T01:16:01.359 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.db_log_dir: 2024-09-05T01:16:01.360 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.wal_dir: 2024-09-05T01:16:01.360 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-05T01:16:01.363 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-05T01:16:01.363 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-05T01:16:01.363 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-05T01:16:01.363 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-05T01:16:01.363 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-05T01:16:01.363 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.advise_random_on_open: 1 2024-09-05T01:16:01.364 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.db_write_buffer_size: 0 2024-09-05T01:16:01.364 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.write_buffer_manager: 0x561de0ebcdc0 2024-09-05T01:16:01.364 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-05T01:16:01.364 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-05T01:16:01.364 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-05T01:16:01.365 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.rate_limiter: (nil) 2024-09-05T01:16:01.365 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-05T01:16:01.365 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.wal_recovery_mode: 2 2024-09-05T01:16:01.365 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.enable_thread_tracking: 0 2024-09-05T01:16:01.365 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.enable_pipelined_write: 0 2024-09-05T01:16:01.365 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.unordered_write: 0 2024-09-05T01:16:01.365 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-05T01:16:01.366 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-05T01:16:01.366 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-05T01:16:01.366 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-05T01:16:01.366 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.row_cache: None 2024-09-05T01:16:01.366 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.wal_filter: None 2024-09-05T01:16:01.366 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-05T01:16:01.366 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.allow_ingest_behind: 0 2024-09-05T01:16:01.367 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.two_write_queues: 0 2024-09-05T01:16:01.367 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.manual_wal_flush: 0 2024-09-05T01:16:01.367 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.wal_compression: 0 2024-09-05T01:16:01.367 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.atomic_flush: 0 2024-09-05T01:16:01.367 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-05T01:16:01.367 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-05T01:16:01.367 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-05T01:16:01.368 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.log_readahead_size: 0 2024-09-05T01:16:01.368 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-05T01:16:01.368 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.best_efforts_recovery: 0 2024-09-05T01:16:01.368 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-05T01:16:01.368 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-05T01:16:01.368 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.allow_data_in_errors: 0 2024-09-05T01:16:01.368 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.db_host_id: __hostname__ 2024-09-05T01:16:01.369 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-05T01:16:01.369 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_background_jobs: 2 2024-09-05T01:16:01.369 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_background_compactions: -1 2024-09-05T01:16:01.369 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_subcompactions: 1 2024-09-05T01:16:01.369 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-05T01:16:01.369 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-05T01:16:01.369 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-05T01:16:01.370 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_total_wal_size: 0 2024-09-05T01:16:01.370 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-05T01:16:01.370 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-05T01:16:01.370 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-05T01:16:01.370 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-05T01:16:01.370 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_open_files: -1 2024-09-05T01:16:01.371 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.bytes_per_sync: 0 2024-09-05T01:16:01.371 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-05T01:16:01.371 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-05T01:16:01.371 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.compaction_readahead_size: 0 2024-09-05T01:16:01.371 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_background_flushes: -1 2024-09-05T01:16:01.371 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Compression algorithms supported: 2024-09-05T01:16:01.371 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: kZSTD supported: 0 2024-09-05T01:16:01.371 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: kXpressCompression supported: 0 2024-09-05T01:16:01.372 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: kBZip2Compression supported: 0 2024-09-05T01:16:01.372 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-05T01:16:01.372 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: kLZ4Compression supported: 1 2024-09-05T01:16:01.372 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: kZlibCompression supported: 1 2024-09-05T01:16:01.372 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: kLZ4HCCompression supported: 1 2024-09-05T01:16:01.372 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: kSnappyCompression supported: 1 2024-09-05T01:16:01.373 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-05T01:16:01.373 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-05T01:16:01.373 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-05T01:16:01.373 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-05T01:16:01.373 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-05T01:16:01.373 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.merge_operator: 2024-09-05T01:16:01.373 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.compaction_filter: None 2024-09-05T01:16:01.374 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.compaction_filter_factory: None 2024-09-05T01:16:01.374 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.sst_partitioner_factory: None 2024-09-05T01:16:01.374 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-05T01:16:01.374 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-05T01:16:01.374 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561de0ead320) 2024-09-05T01:16:01.374 INFO:journalctl@ceph.mon.c.smithi151.stdout: cache_index_and_filter_blocks: 1 2024-09-05T01:16:01.374 INFO:journalctl@ceph.mon.c.smithi151.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-05T01:16:01.375 INFO:journalctl@ceph.mon.c.smithi151.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-05T01:16:01.375 INFO:journalctl@ceph.mon.c.smithi151.stdout: pin_top_level_index_and_filter: 1 2024-09-05T01:16:01.375 INFO:journalctl@ceph.mon.c.smithi151.stdout: index_type: 0 2024-09-05T01:16:01.375 INFO:journalctl@ceph.mon.c.smithi151.stdout: data_block_index_type: 0 2024-09-05T01:16:01.375 INFO:journalctl@ceph.mon.c.smithi151.stdout: index_shortening: 1 2024-09-05T01:16:01.375 INFO:journalctl@ceph.mon.c.smithi151.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-05T01:16:01.376 INFO:journalctl@ceph.mon.c.smithi151.stdout: checksum: 4 2024-09-05T01:16:01.376 INFO:journalctl@ceph.mon.c.smithi151.stdout: no_block_cache: 0 2024-09-05T01:16:01.376 INFO:journalctl@ceph.mon.c.smithi151.stdout: block_cache: 0x561de0ea11f0 2024-09-05T01:16:01.376 INFO:journalctl@ceph.mon.c.smithi151.stdout: block_cache_name: BinnedLRUCache 2024-09-05T01:16:01.376 INFO:journalctl@ceph.mon.c.smithi151.stdout: block_cache_options: 2024-09-05T01:16:01.376 INFO:journalctl@ceph.mon.c.smithi151.stdout: capacity : 536870912 2024-09-05T01:16:01.376 INFO:journalctl@ceph.mon.c.smithi151.stdout: num_shard_bits : 4 2024-09-05T01:16:01.377 INFO:journalctl@ceph.mon.c.smithi151.stdout: strict_capacity_limit : 0 2024-09-05T01:16:01.377 INFO:journalctl@ceph.mon.c.smithi151.stdout: high_pri_pool_ratio: 0.000 2024-09-05T01:16:01.377 INFO:journalctl@ceph.mon.c.smithi151.stdout: block_cache_compressed: (nil) 2024-09-05T01:16:01.377 INFO:journalctl@ceph.mon.c.smithi151.stdout: persistent_cache: (nil) 2024-09-05T01:16:01.377 INFO:journalctl@ceph.mon.c.smithi151.stdout: block_size: 4096 2024-09-05T01:16:01.377 INFO:journalctl@ceph.mon.c.smithi151.stdout: block_size_deviation: 10 2024-09-05T01:16:01.377 INFO:journalctl@ceph.mon.c.smithi151.stdout: block_restart_interval: 16 2024-09-05T01:16:01.378 INFO:journalctl@ceph.mon.c.smithi151.stdout: index_block_restart_interval: 1 2024-09-05T01:16:01.378 INFO:journalctl@ceph.mon.c.smithi151.stdout: metadata_block_size: 4096 2024-09-05T01:16:01.378 INFO:journalctl@ceph.mon.c.smithi151.stdout: partition_filters: 0 2024-09-05T01:16:01.378 INFO:journalctl@ceph.mon.c.smithi151.stdout: use_delta_encoding: 1 2024-09-05T01:16:01.378 INFO:journalctl@ceph.mon.c.smithi151.stdout: filter_policy: bloomfilter 2024-09-05T01:16:01.378 INFO:journalctl@ceph.mon.c.smithi151.stdout: whole_key_filtering: 1 2024-09-05T01:16:01.378 INFO:journalctl@ceph.mon.c.smithi151.stdout: verify_compression: 0 2024-09-05T01:16:01.379 INFO:journalctl@ceph.mon.c.smithi151.stdout: read_amp_bytes_per_bit: 0 2024-09-05T01:16:01.379 INFO:journalctl@ceph.mon.c.smithi151.stdout: format_version: 5 2024-09-05T01:16:01.379 INFO:journalctl@ceph.mon.c.smithi151.stdout: enable_index_compression: 1 2024-09-05T01:16:01.379 INFO:journalctl@ceph.mon.c.smithi151.stdout: block_align: 0 2024-09-05T01:16:01.379 INFO:journalctl@ceph.mon.c.smithi151.stdout: max_auto_readahead_size: 262144 2024-09-05T01:16:01.379 INFO:journalctl@ceph.mon.c.smithi151.stdout: prepopulate_block_cache: 0 2024-09-05T01:16:01.379 INFO:journalctl@ceph.mon.c.smithi151.stdout: initial_auto_readahead_size: 8192 2024-09-05T01:16:01.380 INFO:journalctl@ceph.mon.c.smithi151.stdout: num_file_reads_for_auto_readahead: 2 2024-09-05T01:16:01.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.write_buffer_size: 33554432 2024-09-05T01:16:01.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_write_buffer_number: 2 2024-09-05T01:16:01.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.compression: NoCompression 2024-09-05T01:16:01.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.bottommost_compression: Disabled 2024-09-05T01:16:01.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.prefix_extractor: nullptr 2024-09-05T01:16:01.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-05T01:16:01.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.num_levels: 7 2024-09-05T01:16:01.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-05T01:16:01.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-05T01:16:01.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-05T01:16:01.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-05T01:16:01.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-05T01:16:01.382 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-05T01:16:01.382 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-05T01:16:01.382 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-05T01:16:01.382 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-05T01:16:01.382 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-05T01:16:01.382 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-05T01:16:01.383 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-05T01:16:01.383 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-05T01:16:01.383 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.compression_opts.level: 32767 2024-09-05T01:16:01.383 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.compression_opts.strategy: 0 2024-09-05T01:16:01.383 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-05T01:16:01.383 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-05T01:16:01.383 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-05T01:16:01.384 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-05T01:16:01.384 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.compression_opts.enabled: false 2024-09-05T01:16:01.384 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-05T01:16:01.384 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-05T01:16:01.384 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-05T01:16:01.384 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-05T01:16:01.384 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.target_file_size_base: 67108864 2024-09-05T01:16:01.385 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-05T01:16:01.385 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-05T01:16:01.385 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-05T01:16:01.385 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-05T01:16:01.385 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-05T01:16:01.386 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-05T01:16:01.386 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-05T01:16:01.386 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-05T01:16:01.386 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-05T01:16:01.386 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-05T01:16:01.386 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-05T01:16:01.387 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-05T01:16:01.387 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-05T01:16:01.387 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-05T01:16:01.387 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.arena_block_size: 1048576 2024-09-05T01:16:01.387 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-05T01:16:01.387 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-05T01:16:01.387 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.disable_auto_compactions: 0 2024-09-05T01:16:01.388 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-05T01:16:01.388 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-05T01:16:01.388 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-05T01:16:01.388 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-05T01:16:01.388 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-05T01:16:01.388 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-05T01:16:01.388 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-05T01:16:01.389 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-05T01:16:01.389 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-05T01:16:01.389 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-05T01:16:01.389 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-05T01:16:01.389 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.inplace_update_support: 0 2024-09-05T01:16:01.389 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-05T01:16:01.390 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-05T01:16:01.390 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-05T01:16:01.390 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-05T01:16:01.390 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.bloom_locality: 0 2024-09-05T01:16:01.390 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.max_successive_merges: 0 2024-09-05T01:16:01.390 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-05T01:16:01.390 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.paranoid_file_checks: 0 2024-09-05T01:16:01.391 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.force_consistency_checks: 1 2024-09-05T01:16:01.391 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.report_bg_io_stats: 0 2024-09-05T01:16:01.391 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.ttl: 2592000 2024-09-05T01:16:01.391 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-05T01:16:01.391 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-05T01:16:01.391 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-05T01:16:01.392 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.enable_blob_files: false 2024-09-05T01:16:01.392 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.min_blob_size: 0 2024-09-05T01:16:01.392 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.blob_file_size: 268435456 2024-09-05T01:16:01.392 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-05T01:16:01.393 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-05T01:16:01.393 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-05T01:16:01.393 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-05T01:16:01.393 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-05T01:16:01.393 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.blob_file_starting_level: 0 2024-09-05T01:16:01.393 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-05T01:16:01.394 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-05T01:16:01.394 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-05T01:16:01.394 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3d2c4d55-08c1-4c62-9860-7aef4fcc2224 2024-09-05T01:16:01.394 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725498960888606, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-05T01:16:01.394 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-05T01:16:01.394 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725498960889178, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725498960, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3d2c4d55-08c1-4c62-9860-7aef4fcc2224", "db_session_id": "ZGEO8QS443MQ2274TMSG", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-05T01:16:01.394 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725498960889304, "job": 1, "event": "recovery_finished"} 2024-09-05T01:16:01.395 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-05T01:16:01.395 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-05T01:16:01.395 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x561de0ecee00 2024-09-05T01:16:01.395 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: DB pointer 0x561de0fca000 2024-09-05T01:16:01.395 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-05T01:16:01.395 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-05T01:16:01.395 INFO:journalctl@ceph.mon.c.smithi151.stdout: ** DB Stats ** 2024-09-05T01:16:01.396 INFO:journalctl@ceph.mon.c.smithi151.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-05T01:16:01.396 INFO:journalctl@ceph.mon.c.smithi151.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-05T01:16:01.396 INFO:journalctl@ceph.mon.c.smithi151.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-05T01:16:01.396 INFO:journalctl@ceph.mon.c.smithi151.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-05T01:16:01.396 INFO:journalctl@ceph.mon.c.smithi151.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-05T01:16:01.396 INFO:journalctl@ceph.mon.c.smithi151.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-05T01:16:01.397 INFO:journalctl@ceph.mon.c.smithi151.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-05T01:16:01.397 INFO:journalctl@ceph.mon.c.smithi151.stdout: 2024-09-05T01:16:01.397 INFO:journalctl@ceph.mon.c.smithi151.stdout: ** Compaction Stats [default] ** 2024-09-05T01:16:01.397 INFO:journalctl@ceph.mon.c.smithi151.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-05T01:16:01.397 INFO:journalctl@ceph.mon.c.smithi151.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-05T01:16:01.397 INFO:journalctl@ceph.mon.c.smithi151.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-05T01:16:01.398 INFO:journalctl@ceph.mon.c.smithi151.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-05T01:16:01.398 INFO:journalctl@ceph.mon.c.smithi151.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-05T01:16:01.398 INFO:journalctl@ceph.mon.c.smithi151.stdout: 2024-09-05T01:16:01.398 INFO:journalctl@ceph.mon.c.smithi151.stdout: ** Compaction Stats [default] ** 2024-09-05T01:16:01.398 INFO:journalctl@ceph.mon.c.smithi151.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-05T01:16:01.398 INFO:journalctl@ceph.mon.c.smithi151.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-05T01:16:01.398 INFO:journalctl@ceph.mon.c.smithi151.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-05T01:16:01.399 INFO:journalctl@ceph.mon.c.smithi151.stdout: 2024-09-05T01:16:01.399 INFO:journalctl@ceph.mon.c.smithi151.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-05T01:16:01.399 INFO:journalctl@ceph.mon.c.smithi151.stdout: 2024-09-05T01:16:01.399 INFO:journalctl@ceph.mon.c.smithi151.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-05T01:16:01.399 INFO:journalctl@ceph.mon.c.smithi151.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-05T01:16:01.399 INFO:journalctl@ceph.mon.c.smithi151.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-05T01:16:01.399 INFO:journalctl@ceph.mon.c.smithi151.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-05T01:16:01.399 INFO:journalctl@ceph.mon.c.smithi151.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-05T01:16:01.400 INFO:journalctl@ceph.mon.c.smithi151.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-05T01:16:01.400 INFO:journalctl@ceph.mon.c.smithi151.stdout: Cumulative compaction: 0.00 GB write, 0.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-05T01:16:01.400 INFO:journalctl@ceph.mon.c.smithi151.stdout: Interval compaction: 0.00 GB write, 0.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-05T01:16:01.400 INFO:journalctl@ceph.mon.c.smithi151.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-05T01:16:01.400 INFO:journalctl@ceph.mon.c.smithi151.stdout: Block cache BinnedLRUCache@0x561de0ea11f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-05T01:16:01.400 INFO:journalctl@ceph.mon.c.smithi151.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-05T01:16:01.401 INFO:journalctl@ceph.mon.c.smithi151.stdout: 2024-09-05T01:16:01.401 INFO:journalctl@ceph.mon.c.smithi151.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-05T01:16:01.401 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-05T01:16:01.401 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: using public_addr v2:172.21.15.151:0/0 -> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-05T01:16:01.401 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: starting mon.c rank -1 at public addrs [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] at bind addrs [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:16:01.401 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: mon.c@-1(???) e0 preinit fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:16:01.401 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: mon.c@-1(synchronizing).mds e1 new map 2024-09-05T01:16:01.402 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-05T01:16:01.402 INFO:journalctl@ceph.mon.c.smithi151.stdout: e1 2024-09-05T01:16:01.402 INFO:journalctl@ceph.mon.c.smithi151.stdout: btime 2024-09-05T01:14:21:162585+0000 2024-09-05T01:16:01.402 INFO:journalctl@ceph.mon.c.smithi151.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-05T01:16:01.402 INFO:journalctl@ceph.mon.c.smithi151.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-05T01:16:01.402 INFO:journalctl@ceph.mon.c.smithi151.stdout: legacy client fscid: -1 2024-09-05T01:16:01.402 INFO:journalctl@ceph.mon.c.smithi151.stdout: 2024-09-05T01:16:01.403 INFO:journalctl@ceph.mon.c.smithi151.stdout: No filesystems configured 2024-09-05T01:16:01.403 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-05T01:16:01.403 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-05T01:16:01.403 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-05T01:16:01.403 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-05T01:16:01.403 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-05T01:16:01.403 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-05T01:16:01.404 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-05T01:16:01.404 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-05T01:16:01.404 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-05T01:16:01.404 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-05T01:16:01.404 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi151", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:16:01.404 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:01.404 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:01.405 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:01.405 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:01.405 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi145", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:16:01.405 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:01.405 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:16:01.405 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: Updating smithi145:/etc/ceph/ceph.conf 2024-09-05T01:16:01.405 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: Updating smithi145:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:16:01.406 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-09-05T01:16:01.406 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:01.406 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:01.407 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:01.407 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:01.407 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: Updating smithi145:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-05T01:16:01.407 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: Deploying cephadm binary to smithi151 2024-09-05T01:16:01.407 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:01.407 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:01.407 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: Added host smithi151 2024-09-05T01:16:01.407 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:16:01.408 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:01.408 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:01.408 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:01.408 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:01.408 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T01:16:01.408 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:01.408 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3427145756' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-05T01:16:01.409 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:01.409 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:01.409 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:01.409 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:01.409 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi151", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:16:01.409 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:01.409 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:16:01.410 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: Updating smithi151:/etc/ceph/ceph.conf 2024-09-05T01:16:01.410 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: Updating smithi151:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:16:01.410 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3427145756' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-05T01:16:01.410 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T01:16:01.410 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: Updating smithi151:/etc/ceph/ceph.client.admin.keyring 2024-09-05T01:16:01.410 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: Updating smithi151:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-05T01:16:01.410 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:01.411 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:01.411 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:01.411 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:01.411 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi012:172.21.15.12=a;smithi145:172.21.15.145=b;smithi151:172.21.15.151=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:16:01.411 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: Saving service mon spec with placement smithi012:172.21.15.12=a;smithi145:172.21.15.145=b;smithi151:172.21.15.151=c;count:3 2024-09-05T01:16:01.411 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:01.412 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:16:01.412 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:01.412 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:16:01.412 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:01.412 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T01:16:01.412 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:01.412 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: Deploying daemon mon.c on smithi151 2024-09-05T01:16:01.412 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:01.413 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 bash[34977]: 28c7935e5f5c2ee92797c961ad12b0240848cbb31fdd4fcbd4f23a3abc010d1a 2024-09-05T01:16:01.413 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='client.? 172.21.15.151:0/3151430162' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T01:16:01.413 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:01.413 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:01.413 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: from='client.? 172.21.15.151:0/2784767997' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T01:16:01.413 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 ceph-mon[35013]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-05T01:16:01.413 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:00 smithi151 systemd[1]: Started Ceph mon.c for 0d44cd7e-6b24-11ef-bcd6-c7b262605968. 2024-09-05T01:16:01.766 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-05T01:16:01.766 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-05T01:16:02.024 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T01:16:06.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.060+0000 7f400399f640 1 -- 172.21.15.151:0/700549353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fe8003530 msgr2=0x7f3fe80059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:06.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.060+0000 7f400399f640 1 --2- 172.21.15.151:0/700549353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fe8003530 0x7f3fe80059c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc102af0 tx=0x7f3ff002c3f0 comp rx=0 tx=0).stop 2024-09-05T01:16:06.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.060+0000 7f400399f640 1 -- 172.21.15.151:0/700549353 shutdown_connections 2024-09-05T01:16:06.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.060+0000 7f400399f640 1 --2- 172.21.15.151:0/700549353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fe8003530 0x7f3fe80059c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:06.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.060+0000 7f400399f640 1 -- 172.21.15.151:0/700549353 >> 172.21.15.151:0/700549353 conn(0x7f3ffc0fd320 msgr2=0x7f3ffc0ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:16:06.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.060+0000 7f400399f640 1 -- 172.21.15.151:0/700549353 shutdown_connections 2024-09-05T01:16:06.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.060+0000 7f400399f640 1 -- 172.21.15.151:0/700549353 wait complete. 2024-09-05T01:16:06.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.061+0000 7f400399f640 1 Processor -- start 2024-09-05T01:16:06.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.061+0000 7f400399f640 1 -- start start 2024-09-05T01:16:06.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.061+0000 7f400399f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fe8003530 0x7f3ffc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:06.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.061+0000 7f400399f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ffc074a30 0x7f3ffc074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:06.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.062+0000 7f400399f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3ffc109780 con 0x7f3fe8003530 2024-09-05T01:16:06.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.062+0000 7f400399f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3ffc109600 con 0x7f3ffc074a30 2024-09-05T01:16:06.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.062+0000 7f4000f3a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ffc074a30 0x7f3ffc074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:06.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.062+0000 7f4000f3a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ffc074a30 0x7f3ffc074e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49008/0 (socket says 172.21.15.151:49008) 2024-09-05T01:16:06.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.062+0000 7f4000f3a640 1 -- 172.21.15.151:0/18495338 learned_addr learned my addr 172.21.15.151:0/18495338 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-05T01:16:06.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.062+0000 7f4000f3a640 1 -- 172.21.15.151:0/18495338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ffc074a30 msgr2=0x7f3ffc074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-05T01:16:06.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.062+0000 7f4000f3a640 1 -- 172.21.15.151:0/18495338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ffc074a30 msgr2=0x7f3ffc074e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-05T01:16:06.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.062+0000 7f4000f3a640 1 --2- 172.21.15.151:0/18495338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ffc074a30 0x7f3ffc074e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-05T01:16:06.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.062+0000 7f400173b640 1 --2- 172.21.15.151:0/18495338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fe8003530 0x7f3ffc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:06.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.062+0000 7f4000f3a640 1 --2- 172.21.15.151:0/18495338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ffc074a30 0x7f3ffc074e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T01:16:06.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.062+0000 7f400173b640 1 -- 172.21.15.151:0/18495338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ffc074a30 msgr2=0x7f3ffc074e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T01:16:06.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.062+0000 7f400173b640 1 --2- 172.21.15.151:0/18495338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ffc074a30 0x7f3ffc074e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:06.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.062+0000 7f400173b640 1 -- 172.21.15.151:0/18495338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ffc0763e0 con 0x7f3fe8003530 2024-09-05T01:16:06.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.063+0000 7f400173b640 1 --2- 172.21.15.151:0/18495338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fe8003530 0x7f3ffc0744f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0005f10 tx=0x7f3ff0034bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:16:06.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.063+0000 7f3fee7fc640 1 -- 172.21.15.151:0/18495338 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f3ff00125f0 con 0x7f3fe8003530 2024-09-05T01:16:06.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.063+0000 7f3fee7fc640 1 -- 172.21.15.151:0/18495338 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ff0042070 con 0x7f3fe8003530 2024-09-05T01:16:06.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.063+0000 7f400399f640 1 -- 172.21.15.151:0/18495338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ffc1a3450 con 0x7f3fe8003530 2024-09-05T01:16:06.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.063+0000 7f3fee7fc640 1 -- 172.21.15.151:0/18495338 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f3ff003da90 con 0x7f3fe8003530 2024-09-05T01:16:06.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.063+0000 7f400399f640 1 -- 172.21.15.151:0/18495338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ffc1a39e0 con 0x7f3fe8003530 2024-09-05T01:16:06.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.064+0000 7f3fee7fc640 1 -- 172.21.15.151:0/18495338 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f3ff0012790 con 0x7f3fe8003530 2024-09-05T01:16:06.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.064+0000 7f400399f640 1 -- 172.21.15.151:0/18495338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ffc102da0 con 0x7f3fe8003530 2024-09-05T01:16:06.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.064+0000 7f3fee7fc640 1 --2- 172.21.15.151:0/18495338 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3fe0038e50 0x7f3fe003b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:06.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.064+0000 7f3fee7fc640 1 -- 172.21.15.151:0/18495338 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3ff006e6b0 con 0x7f3fe8003530 2024-09-05T01:16:06.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.065+0000 7f4000f3a640 1 --2- 172.21.15.151:0/18495338 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3fe0038e50 0x7f3fe003b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:06.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.065+0000 7f4000f3a640 1 --2- 172.21.15.151:0/18495338 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3fe0038e50 0x7f3fe003b310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009100 tx=0x7f3ff8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:16:06.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.070+0000 7f3fee7fc640 1 -- 172.21.15.151:0/18495338 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3ff0045e40 con 0x7f3fe8003530 2024-09-05T01:16:06.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.304+0000 7f400399f640 1 -- 172.21.15.151:0/18495338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f3ffc190ee0 con 0x7f3fe8003530 2024-09-05T01:16:06.305 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T01:16:06.306 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:16:06.306 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: mon.a calling monitor election 2024-09-05T01:16:06.306 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:16:06.306 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:06.306 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:16:06.306 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: mon.c calling monitor election 2024-09-05T01:16:06.306 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:16:06.306 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:06.306 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:16:06.306 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:16:06.306 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-05T01:16:06.306 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: monmap epoch 2 2024-09-05T01:16:06.307 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:16:06.307 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: last_changed 2024-09-05T01:16:00.918922+0000 2024-09-05T01:16:06.307 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: created 2024-09-05T01:14:17.366670+0000 2024-09-05T01:16:06.307 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: min_mon_release 19 (squid) 2024-09-05T01:16:06.307 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: election_strategy: 1 2024-09-05T01:16:06.307 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-05T01:16:06.307 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-09-05T01:16:06.307 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: fsmap 2024-09-05T01:16:06.307 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T01:16:06.307 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: mgrmap e13: x(active, since 43s) 2024-09-05T01:16:06.307 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: overall HEALTH_OK 2024-09-05T01:16:06.307 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:06.307 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:06.308 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:06.308 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T01:16:06.308 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:06.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.305+0000 7f3fee7fc640 1 -- 172.21.15.151:0/18495338 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f3ff0012bd0 con 0x7f3fe8003530 2024-09-05T01:16:06.308 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-05T01:16:06.308 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":2,"fsid":"0d44cd7e-6b24-11ef-bcd6-c7b262605968","modified":"2024-09-05T01:16:00.918922Z","created":"2024-09-05T01:14:17.366670Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3300","nonce":0},{"type":"v1","addr":"172.21.15.12:6789","nonce":0}]},"addr":"172.21.15.12:6789/0","public_addr":"172.21.15.12:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:3300","nonce":0},{"type":"v1","addr":"172.21.15.151:6789","nonce":0}]},"addr":"172.21.15.151:6789/0","public_addr":"172.21.15.151:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-05T01:16:06.309 INFO:teuthology.orchestra.run.smithi151.stderr:dumped monmap epoch 2 2024-09-05T01:16:06.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.307+0000 7f400399f640 1 -- 172.21.15.151:0/18495338 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3fe0038e50 msgr2=0x7f3fe003b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:06.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.307+0000 7f400399f640 1 --2- 172.21.15.151:0/18495338 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3fe0038e50 0x7f3fe003b310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009100 tx=0x7f3ff8008040 comp rx=0 tx=0).stop 2024-09-05T01:16:06.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.307+0000 7f400399f640 1 -- 172.21.15.151:0/18495338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fe8003530 msgr2=0x7f3ffc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:06.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.307+0000 7f400399f640 1 --2- 172.21.15.151:0/18495338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fe8003530 0x7f3ffc0744f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0005f10 tx=0x7f3ff0034bb0 comp rx=0 tx=0).stop 2024-09-05T01:16:06.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.307+0000 7f400399f640 1 -- 172.21.15.151:0/18495338 shutdown_connections 2024-09-05T01:16:06.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.307+0000 7f400399f640 1 --2- 172.21.15.151:0/18495338 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3fe0038e50 0x7f3fe003b310 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:06.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.307+0000 7f400399f640 1 --2- 172.21.15.151:0/18495338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ffc074a30 0x7f3ffc074e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:06.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.307+0000 7f400399f640 1 --2- 172.21.15.151:0/18495338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fe8003530 0x7f3ffc0744f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:06.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.307+0000 7f400399f640 1 -- 172.21.15.151:0/18495338 >> 172.21.15.151:0/18495338 conn(0x7f3ffc0fd320 msgr2=0x7f3ffc0ff250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:16:06.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.307+0000 7f400399f640 1 -- 172.21.15.151:0/18495338 shutdown_connections 2024-09-05T01:16:06.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:06.307+0000 7f400399f640 1 -- 172.21.15.151:0/18495338 wait complete. 2024-09-05T01:16:06.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T01:16:06.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:16:06.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: mon.a calling monitor election 2024-09-05T01:16:06.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:16:06.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:06.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:16:06.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: mon.c calling monitor election 2024-09-05T01:16:06.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:16:06.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:06.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:16:06.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:16:06.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-05T01:16:06.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: monmap epoch 2 2024-09-05T01:16:06.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:16:06.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: last_changed 2024-09-05T01:16:00.918922+0000 2024-09-05T01:16:06.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: created 2024-09-05T01:14:17.366670+0000 2024-09-05T01:16:06.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: min_mon_release 19 (squid) 2024-09-05T01:16:06.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: election_strategy: 1 2024-09-05T01:16:06.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-05T01:16:06.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-09-05T01:16:06.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: fsmap 2024-09-05T01:16:06.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T01:16:06.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: mgrmap e13: x(active, since 43s) 2024-09-05T01:16:06.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: overall HEALTH_OK 2024-09-05T01:16:06.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:06.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:06.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:06.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T01:16:06.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:07.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:06 smithi012 ceph-mon[29942]: Deploying daemon mon.b on smithi145 2024-09-05T01:16:07.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:06 smithi012 ceph-mon[29942]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:07.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:06 smithi012 ceph-mon[29942]: from='client.? 172.21.15.151:0/18495338' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T01:16:07.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:07 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:16:07.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:07 smithi151 ceph-mon[35013]: Deploying daemon mon.b on smithi145 2024-09-05T01:16:07.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:07 smithi151 ceph-mon[35013]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:07.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:07 smithi151 ceph-mon[35013]: from='client.? 172.21.15.151:0/18495338' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T01:16:07.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:07 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:16:07.881 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-05T01:16:07.882 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-05T01:16:08.132 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T01:16:08.186 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:16:07 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:16:07.918+0000 7f3152800640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-05T01:16:08.499 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:08 smithi151 ceph-mon[35013]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:08.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:08 smithi012 ceph-mon[29942]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:08.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.578+0000 7f8166e71640 1 -- 172.21.15.151:0/47552143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81601076e0 msgr2=0x7f8160107ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:08.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.578+0000 7f8166e71640 1 --2- 172.21.15.151:0/47552143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81601076e0 0x7f8160107ac0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8154009880 tx=0x7f815402a5d0 comp rx=0 tx=0).stop 2024-09-05T01:16:08.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.578+0000 7f8166e71640 1 -- 172.21.15.151:0/47552143 shutdown_connections 2024-09-05T01:16:08.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.578+0000 7f8166e71640 1 --2- 172.21.15.151:0/47552143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81601076e0 0x7f8160107ac0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:08.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.578+0000 7f8166e71640 1 -- 172.21.15.151:0/47552143 >> 172.21.15.151:0/47552143 conn(0x7f81600fb9a0 msgr2=0x7f81600fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:16:08.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.578+0000 7f8166e71640 1 -- 172.21.15.151:0/47552143 shutdown_connections 2024-09-05T01:16:08.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.578+0000 7f8166e71640 1 -- 172.21.15.151:0/47552143 wait complete. 2024-09-05T01:16:08.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.579+0000 7f8166e71640 1 Processor -- start 2024-09-05T01:16:08.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.579+0000 7f8166e71640 1 -- start start 2024-09-05T01:16:08.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.579+0000 7f8166e71640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81601076e0 0x7f8160100c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:08.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.579+0000 7f8166e71640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81601011d0 0x7f8160101630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:08.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.579+0000 7f8166e71640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f816010bd50 con 0x7f81601076e0 2024-09-05T01:16:08.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.579+0000 7f8166e71640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f816010bbd0 con 0x7f81601011d0 2024-09-05T01:16:08.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.579+0000 7f815ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81601011d0 0x7f8160101630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:08.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.579+0000 7f815ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81601011d0 0x7f8160101630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49014/0 (socket says 172.21.15.151:49014) 2024-09-05T01:16:08.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.579+0000 7f815ffff640 1 -- 172.21.15.151:0/3338376468 learned_addr learned my addr 172.21.15.151:0/3338376468 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-05T01:16:08.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.579+0000 7f815ffff640 1 -- 172.21.15.151:0/3338376468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81601011d0 msgr2=0x7f8160101630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-05T01:16:08.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.579+0000 7f815ffff640 1 -- 172.21.15.151:0/3338376468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81601011d0 msgr2=0x7f8160101630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-05T01:16:08.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.579+0000 7f815ffff640 1 --2- 172.21.15.151:0/3338376468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81601011d0 0x7f8160101630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-05T01:16:08.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.579+0000 7f8164c0d640 1 --2- 172.21.15.151:0/3338376468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81601076e0 0x7f8160100c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:08.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.579+0000 7f815ffff640 1 --2- 172.21.15.151:0/3338376468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81601011d0 0x7f8160101630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T01:16:08.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.580+0000 7f8164c0d640 1 -- 172.21.15.151:0/3338376468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81601011d0 msgr2=0x7f8160101630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T01:16:08.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.580+0000 7f8164c0d640 1 --2- 172.21.15.151:0/3338376468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81601011d0 0x7f8160101630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:08.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.580+0000 7f8164c0d640 1 -- 172.21.15.151:0/3338376468 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8160102b80 con 0x7f81601076e0 2024-09-05T01:16:08.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.580+0000 7f8164c0d640 1 --2- 172.21.15.151:0/3338376468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81601076e0 0x7f8160100c90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8154009880 tx=0x7f8154032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:16:08.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.580+0000 7f815dffb640 1 -- 172.21.15.151:0/3338376468 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f8154035070 con 0x7f81601076e0 2024-09-05T01:16:08.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.580+0000 7f8166e71640 1 -- 172.21.15.151:0/3338376468 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81601a35c0 con 0x7f81601076e0 2024-09-05T01:16:08.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.580+0000 7f815dffb640 1 -- 172.21.15.151:0/3338376468 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8154032e40 con 0x7f81601076e0 2024-09-05T01:16:08.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.580+0000 7f815dffb640 1 -- 172.21.15.151:0/3338376468 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f815403bb20 con 0x7f81601076e0 2024-09-05T01:16:08.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.581+0000 7f8166e71640 1 -- 172.21.15.151:0/3338376468 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81601a3af0 con 0x7f81601076e0 2024-09-05T01:16:08.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.581+0000 7f8166e71640 1 -- 172.21.15.151:0/3338376468 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8160107b40 con 0x7f81601076e0 2024-09-05T01:16:08.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.582+0000 7f815dffb640 1 -- 172.21.15.151:0/3338376468 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f8154042030 con 0x7f81601076e0 2024-09-05T01:16:08.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.582+0000 7f815dffb640 1 --2- 172.21.15.151:0/3338376468 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8150038e00 0x7f815003b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:08.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.582+0000 7f815dffb640 1 -- 172.21.15.151:0/3338376468 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8154040070 con 0x7f81601076e0 2024-09-05T01:16:08.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.582+0000 7f815ffff640 1 --2- 172.21.15.151:0/3338376468 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8150038e00 0x7f815003b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:08.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.583+0000 7f815ffff640 1 --2- 172.21.15.151:0/3338376468 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8150038e00 0x7f815003b2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f814c009100 tx=0x7f814c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:16:08.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.588+0000 7f815dffb640 1 -- 172.21.15.151:0/3338376468 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f815404a260 con 0x7f81601076e0 2024-09-05T01:16:08.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.819+0000 7f8166e71640 1 -- 172.21.15.151:0/3338376468 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f81601a3da0 con 0x7f81601076e0 2024-09-05T01:16:08.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.819+0000 7f815dffb640 1 -- 172.21.15.151:0/3338376468 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f815403bdd0 con 0x7f81601076e0 2024-09-05T01:16:08.820 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-05T01:16:08.820 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":2,"fsid":"0d44cd7e-6b24-11ef-bcd6-c7b262605968","modified":"2024-09-05T01:16:00.918922Z","created":"2024-09-05T01:14:17.366670Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3300","nonce":0},{"type":"v1","addr":"172.21.15.12:6789","nonce":0}]},"addr":"172.21.15.12:6789/0","public_addr":"172.21.15.12:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:3300","nonce":0},{"type":"v1","addr":"172.21.15.151:6789","nonce":0}]},"addr":"172.21.15.151:6789/0","public_addr":"172.21.15.151:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-05T01:16:08.820 INFO:teuthology.orchestra.run.smithi151.stderr:dumped monmap epoch 2 2024-09-05T01:16:08.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.821+0000 7f8166e71640 1 -- 172.21.15.151:0/3338376468 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8150038e00 msgr2=0x7f815003b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:08.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.821+0000 7f8166e71640 1 --2- 172.21.15.151:0/3338376468 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8150038e00 0x7f815003b2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f814c009100 tx=0x7f814c008040 comp rx=0 tx=0).stop 2024-09-05T01:16:08.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.821+0000 7f8166e71640 1 -- 172.21.15.151:0/3338376468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81601076e0 msgr2=0x7f8160100c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:08.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.821+0000 7f8166e71640 1 --2- 172.21.15.151:0/3338376468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81601076e0 0x7f8160100c90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8154009880 tx=0x7f8154032c50 comp rx=0 tx=0).stop 2024-09-05T01:16:08.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.821+0000 7f8166e71640 1 -- 172.21.15.151:0/3338376468 shutdown_connections 2024-09-05T01:16:08.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.821+0000 7f8166e71640 1 --2- 172.21.15.151:0/3338376468 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8150038e00 0x7f815003b2c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:08.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.821+0000 7f8166e71640 1 --2- 172.21.15.151:0/3338376468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81601011d0 0x7f8160101630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:08.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.821+0000 7f8166e71640 1 --2- 172.21.15.151:0/3338376468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81601076e0 0x7f8160100c90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:08.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.821+0000 7f8166e71640 1 -- 172.21.15.151:0/3338376468 >> 172.21.15.151:0/3338376468 conn(0x7f81600fb9a0 msgr2=0x7f81600fbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:16:08.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.822+0000 7f8166e71640 1 -- 172.21.15.151:0/3338376468 shutdown_connections 2024-09-05T01:16:08.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:08.822+0000 7f8166e71640 1 -- 172.21.15.151:0/3338376468 wait complete. 2024-09-05T01:16:09.463 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:09 smithi012 ceph-mon[29942]: from='client.? 172.21.15.151:0/3338376468' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T01:16:09.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:09 smithi151 ceph-mon[35013]: from='client.? 172.21.15.151:0/3338376468' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T01:16:09.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:09 smithi145 systemd[1]: Started Ceph mon.b for 0d44cd7e-6b24-11ef-bcd6-c7b262605968. 2024-09-05T01:16:10.438 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-05T01:16:10.439 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph mon dump -f json 2024-09-05T01:16:10.691 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T01:16:14.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.713+0000 7fb695587640 1 -- 172.21.15.151:0/970490765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb690106680 msgr2=0x7fb67c005580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:14.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.713+0000 7fb695587640 1 --2- 172.21.15.151:0/970490765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb690106680 0x7fb67c005580 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb678014d10 tx=0x7fb67802c570 comp rx=0 tx=0).stop 2024-09-05T01:16:14.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.713+0000 7fb695587640 1 -- 172.21.15.151:0/970490765 shutdown_connections 2024-09-05T01:16:14.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.713+0000 7fb695587640 1 --2- 172.21.15.151:0/970490765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb690106680 0x7fb67c005580 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:14.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.713+0000 7fb695587640 1 -- 172.21.15.151:0/970490765 >> 172.21.15.151:0/970490765 conn(0x7fb6900fc290 msgr2=0x7fb6900fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:16:14.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.713+0000 7fb695587640 1 -- 172.21.15.151:0/970490765 shutdown_connections 2024-09-05T01:16:14.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.713+0000 7fb695587640 1 -- 172.21.15.151:0/970490765 wait complete. 2024-09-05T01:16:14.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.714+0000 7fb695587640 1 Processor -- start 2024-09-05T01:16:14.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.714+0000 7fb695587640 1 -- start start 2024-09-05T01:16:14.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.714+0000 7fb695587640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb690106680 0x7fb6901972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:14.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.714+0000 7fb695587640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb690197830 0x7fb69019bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:14.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.714+0000 7fb695587640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb69019c100 0x7fb69019c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:14.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.714+0000 7fb695587640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb6901086c0 con 0x7fb690106680 2024-09-05T01:16:14.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.714+0000 7fb695587640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb690108540 con 0x7fb690197830 2024-09-05T01:16:14.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.714+0000 7fb695587640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb690108840 con 0x7fb69019c100 2024-09-05T01:16:14.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.714+0000 7fb68f7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb69019c100 0x7fb69019c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:14.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.715+0000 7fb68effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb690106680 0x7fb6901972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:14.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.715+0000 7fb68f7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb69019c100 0x7fb69019c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50492/0 (socket says 172.21.15.151:50492) 2024-09-05T01:16:14.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.715+0000 7fb68f7fe640 1 -- 172.21.15.151:0/3953623576 learned_addr learned my addr 172.21.15.151:0/3953623576 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-05T01:16:14.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.715+0000 7fb68e7fc640 1 --2- 172.21.15.151:0/3953623576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb690197830 0x7fb69019bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:14.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.715+0000 7fb68f7fe640 1 -- 172.21.15.151:0/3953623576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb69019c100 msgr2=0x7fb69019c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-05T01:16:14.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.715+0000 7fb68f7fe640 1 -- 172.21.15.151:0/3953623576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb69019c100 msgr2=0x7fb69019c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-05T01:16:14.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.715+0000 7fb68f7fe640 1 --2- 172.21.15.151:0/3953623576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb69019c100 0x7fb69019c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-05T01:16:14.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.715+0000 7fb68f7fe640 1 --2- 172.21.15.151:0/3953623576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb69019c100 0x7fb69019c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T01:16:14.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.715+0000 7fb68e7fc640 1 -- 172.21.15.151:0/3953623576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb690197830 msgr2=0x7fb69019bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-05T01:16:14.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.715+0000 7fb68e7fc640 1 -- 172.21.15.151:0/3953623576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb690197830 msgr2=0x7fb69019bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-05T01:16:14.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.715+0000 7fb68e7fc640 1 --2- 172.21.15.151:0/3953623576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb690197830 0x7fb69019bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-05T01:16:14.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.715+0000 7fb68e7fc640 1 --2- 172.21.15.151:0/3953623576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb690197830 0x7fb69019bbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T01:16:14.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.715+0000 7fb68effd640 1 -- 172.21.15.151:0/3953623576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb69019c100 msgr2=0x7fb69019c5b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T01:16:14.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.715+0000 7fb68effd640 1 --2- 172.21.15.151:0/3953623576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb69019c100 0x7fb69019c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:14.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.715+0000 7fb68effd640 1 -- 172.21.15.151:0/3953623576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb690197830 msgr2=0x7fb69019bbc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T01:16:14.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.715+0000 7fb68effd640 1 --2- 172.21.15.151:0/3953623576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb690197830 0x7fb69019bbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:14.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.715+0000 7fb68effd640 1 -- 172.21.15.151:0/3953623576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6901a3e70 con 0x7fb690106680 2024-09-05T01:16:14.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.715+0000 7fb68effd640 1 --2- 172.21.15.151:0/3953623576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb690106680 0x7fb6901972f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb678035040 tx=0x7fb678005290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:16:14.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.716+0000 7fb687fff640 1 -- 172.21.15.151:0/3953623576 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678041070 con 0x7fb690106680 2024-09-05T01:16:14.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.716+0000 7fb687fff640 1 -- 172.21.15.151:0/3953623576 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb678004220 con 0x7fb690106680 2024-09-05T01:16:14.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.716+0000 7fb695587640 1 -- 172.21.15.151:0/3953623576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6901a4040 con 0x7fb690106680 2024-09-05T01:16:14.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.716+0000 7fb687fff640 1 -- 172.21.15.151:0/3953623576 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678003e20 con 0x7fb690106680 2024-09-05T01:16:14.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.716+0000 7fb695587640 1 -- 172.21.15.151:0/3953623576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6901a45d0 con 0x7fb690106680 2024-09-05T01:16:14.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.717+0000 7fb687fff640 1 -- 172.21.15.151:0/3953623576 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fb678012450 con 0x7fb690106680 2024-09-05T01:16:14.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.717+0000 7fb695587640 1 -- 172.21.15.151:0/3953623576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb690101cf0 con 0x7fb690106680 2024-09-05T01:16:14.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.717+0000 7fb687fff640 1 --2- 172.21.15.151:0/3953623576 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb6700394f0 0x7fb67003b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:14.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.717+0000 7fb687fff640 1 -- 172.21.15.151:0/3953623576 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb67806e550 con 0x7fb690106680 2024-09-05T01:16:14.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.717+0000 7fb68e7fc640 1 --2- 172.21.15.151:0/3953623576 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb6700394f0 0x7fb67003b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:14.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.718+0000 7fb68e7fc640 1 --2- 172.21.15.151:0/3953623576 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb6700394f0 0x7fb67003b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb680006fd0 tx=0x7fb680008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:16:14.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.722+0000 7fb687fff640 1 -- 172.21.15.151:0/3953623576 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb6780035f0 con 0x7fb690106680 2024-09-05T01:16:14.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.968+0000 7fb695587640 1 -- 172.21.15.151:0/3953623576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fb6901a48c0 con 0x7fb690106680 2024-09-05T01:16:14.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.968+0000 7fb687fff640 1 -- 172.21.15.151:0/3953623576 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1283 (secure 0 0 0) 0x7fb678031dc0 con 0x7fb690106680 2024-09-05T01:16:14.969 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-05T01:16:14.969 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":3,"fsid":"0d44cd7e-6b24-11ef-bcd6-c7b262605968","modified":"2024-09-05T01:16:09.633248Z","created":"2024-09-05T01:14:17.366670Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3300","nonce":0},{"type":"v1","addr":"172.21.15.12:6789","nonce":0}]},"addr":"172.21.15.12:6789/0","public_addr":"172.21.15.12:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:3300","nonce":0},{"type":"v1","addr":"172.21.15.151:6789","nonce":0}]},"addr":"172.21.15.151:6789/0","public_addr":"172.21.15.151:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:3300","nonce":0},{"type":"v1","addr":"172.21.15.145:6789","nonce":0}]},"addr":"172.21.15.145:6789/0","public_addr":"172.21.15.145:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-05T01:16:14.970 INFO:teuthology.orchestra.run.smithi151.stderr:dumped monmap epoch 3 2024-09-05T01:16:14.970 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T01:16:14.970 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: mon.c calling monitor election 2024-09-05T01:16:14.970 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: mon.a calling monitor election 2024-09-05T01:16:14.970 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:16:14.970 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:16:14.970 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:14.970 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:16:14.970 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:16:14.970 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:14.971 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:16:14.971 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:16:14.971 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:14.971 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:16:14.971 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-05T01:16:14.971 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: monmap epoch 3 2024-09-05T01:16:14.971 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:16:14.971 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: last_changed 2024-09-05T01:16:09.633248+0000 2024-09-05T01:16:14.971 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: created 2024-09-05T01:14:17.366670+0000 2024-09-05T01:16:14.971 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: min_mon_release 19 (squid) 2024-09-05T01:16:14.971 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: election_strategy: 1 2024-09-05T01:16:14.971 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-05T01:16:14.971 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-09-05T01:16:14.972 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: 2: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.b 2024-09-05T01:16:14.972 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: fsmap 2024-09-05T01:16:14.972 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T01:16:14.972 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: mgrmap e13: x(active, since 52s) 2024-09-05T01:16:14.972 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: overall HEALTH_OK 2024-09-05T01:16:14.972 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:14.972 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:14.972 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:14.972 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:14.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.970+0000 7fb695587640 1 -- 172.21.15.151:0/3953623576 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb6700394f0 msgr2=0x7fb67003b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:14.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.970+0000 7fb695587640 1 --2- 172.21.15.151:0/3953623576 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb6700394f0 0x7fb67003b9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb680006fd0 tx=0x7fb680008040 comp rx=0 tx=0).stop 2024-09-05T01:16:14.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.970+0000 7fb695587640 1 -- 172.21.15.151:0/3953623576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb690106680 msgr2=0x7fb6901972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:14.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.970+0000 7fb695587640 1 --2- 172.21.15.151:0/3953623576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb690106680 0x7fb6901972f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb678035040 tx=0x7fb678005290 comp rx=0 tx=0).stop 2024-09-05T01:16:14.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.971+0000 7fb695587640 1 -- 172.21.15.151:0/3953623576 shutdown_connections 2024-09-05T01:16:14.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.971+0000 7fb695587640 1 --2- 172.21.15.151:0/3953623576 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb6700394f0 0x7fb67003b9b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:14.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.971+0000 7fb695587640 1 --2- 172.21.15.151:0/3953623576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb69019c100 0x7fb69019c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:14.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.971+0000 7fb695587640 1 --2- 172.21.15.151:0/3953623576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb690197830 0x7fb69019bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:14.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.971+0000 7fb695587640 1 --2- 172.21.15.151:0/3953623576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb690106680 0x7fb6901972f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:14.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.971+0000 7fb695587640 1 -- 172.21.15.151:0/3953623576 >> 172.21.15.151:0/3953623576 conn(0x7fb6900fc290 msgr2=0x7fb69006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:16:14.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.971+0000 7fb695587640 1 -- 172.21.15.151:0/3953623576 shutdown_connections 2024-09-05T01:16:14.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:14.971+0000 7fb695587640 1 -- 172.21.15.151:0/3953623576 wait complete. 2024-09-05T01:16:15.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T01:16:15.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: mon.c calling monitor election 2024-09-05T01:16:15.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: mon.a calling monitor election 2024-09-05T01:16:15.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:16:15.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:16:15.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:15.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:16:15.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:16:15.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:15.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:16:15.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:16:15.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:15.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:16:15.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-05T01:16:15.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: monmap epoch 3 2024-09-05T01:16:15.064 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:16:15.064 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: last_changed 2024-09-05T01:16:09.633248+0000 2024-09-05T01:16:15.064 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: created 2024-09-05T01:14:17.366670+0000 2024-09-05T01:16:15.064 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: min_mon_release 19 (squid) 2024-09-05T01:16:15.064 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: election_strategy: 1 2024-09-05T01:16:15.064 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-05T01:16:15.064 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-09-05T01:16:15.064 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: 2: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.b 2024-09-05T01:16:15.064 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: fsmap 2024-09-05T01:16:15.064 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T01:16:15.064 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: mgrmap e13: x(active, since 52s) 2024-09-05T01:16:15.064 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: overall HEALTH_OK 2024-09-05T01:16:15.064 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:15.064 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:15.065 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:15.065 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:15.569 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-05T01:16:15.569 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph config generate-minimal-conf 2024-09-05T01:16:15.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:15 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:16:15.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:15 smithi151 ceph-mon[35013]: from='client.? 172.21.15.151:0/3953623576' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T01:16:15.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:15 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:16:15.947 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:16:16.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:15 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:16:16.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:15 smithi012 ceph-mon[29942]: from='client.? 172.21.15.151:0/3953623576' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T01:16:16.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:15 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:16:16.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.509+0000 7f4931000640 1 -- 172.21.15.12:0/3082693989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f492c074590 msgr2=0x7f492c074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:16.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.509+0000 7f4931000640 1 --2- 172.21.15.12:0/3082693989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f492c074590 0x7f492c074970 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f491c009880 tx=0x7f491c02a670 comp rx=0 tx=0).stop 2024-09-05T01:16:16.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.509+0000 7f4931000640 1 -- 172.21.15.12:0/3082693989 shutdown_connections 2024-09-05T01:16:16.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.509+0000 7f4931000640 1 --2- 172.21.15.12:0/3082693989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f492c074590 0x7f492c074970 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:16.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.509+0000 7f4931000640 1 -- 172.21.15.12:0/3082693989 >> 172.21.15.12:0/3082693989 conn(0x7f492c0fd230 msgr2=0x7f492c0ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:16:16.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.509+0000 7f4931000640 1 -- 172.21.15.12:0/3082693989 shutdown_connections 2024-09-05T01:16:16.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.509+0000 7f4931000640 1 -- 172.21.15.12:0/3082693989 wait complete. 2024-09-05T01:16:16.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.510+0000 7f4931000640 1 Processor -- start 2024-09-05T01:16:16.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.510+0000 7f4931000640 1 -- start start 2024-09-05T01:16:16.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.511+0000 7f4931000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f492c074590 0x7f492c1a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:16.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.511+0000 7f4931000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f492c1a3bd0 0x7f492c19d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:16.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.511+0000 7f4931000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f492c19dd50 0x7f492c19e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:16.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.511+0000 7f4931000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f492c112290 con 0x7f492c074590 2024-09-05T01:16:16.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.511+0000 7f4931000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f492c112110 con 0x7f492c1a3bd0 2024-09-05T01:16:16.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.511+0000 7f4931000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f492c112410 con 0x7f492c19dd50 2024-09-05T01:16:16.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.511+0000 7f4929e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f492c074590 0x7f492c1a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:16.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.511+0000 7f4929400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f492c1a3bd0 0x7f492c19d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:16.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.511+0000 7f4929e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f492c074590 0x7f492c1a3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51700/0 (socket says 172.21.15.12:51700) 2024-09-05T01:16:16.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.511+0000 7f492a800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f492c19dd50 0x7f492c19e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:16.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.511+0000 7f4929e00640 1 -- 172.21.15.12:0/2739816703 learned_addr learned my addr 172.21.15.12:0/2739816703 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:16:16.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.511+0000 7f4929400640 1 -- 172.21.15.12:0/2739816703 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f492c1a3bd0 msgr2=0x7f492c19d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-05T01:16:16.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.511+0000 7f4929400640 1 -- 172.21.15.12:0/2739816703 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f492c1a3bd0 msgr2=0x7f492c19d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-05T01:16:16.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.511+0000 7f4929400640 1 --2- 172.21.15.12:0/2739816703 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f492c1a3bd0 0x7f492c19d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-05T01:16:16.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.511+0000 7f4929400640 1 --2- 172.21.15.12:0/2739816703 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f492c1a3bd0 0x7f492c19d810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T01:16:16.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.512+0000 7f4929e00640 1 -- 172.21.15.12:0/2739816703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f492c19dd50 msgr2=0x7f492c19e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:16.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.512+0000 7f4929e00640 1 --2- 172.21.15.12:0/2739816703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f492c19dd50 0x7f492c19e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:16.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.512+0000 7f4929e00640 1 -- 172.21.15.12:0/2739816703 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f492c1a3bd0 msgr2=0x7f492c19d810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T01:16:16.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.512+0000 7f4929e00640 1 --2- 172.21.15.12:0/2739816703 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f492c1a3bd0 0x7f492c19d810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:16.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.512+0000 7f4929e00640 1 -- 172.21.15.12:0/2739816703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492c1aa4f0 con 0x7f492c074590 2024-09-05T01:16:16.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.512+0000 7f492a800640 1 --2- 172.21.15.12:0/2739816703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f492c19dd50 0x7f492c19e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:16:16.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.512+0000 7f4929e00640 1 --2- 172.21.15.12:0/2739816703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f492c074590 0x7f492c1a3690 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f491c006010 tx=0x7f491c003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:16:16.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.512+0000 7f4922a00640 1 -- 172.21.15.12:0/2739816703 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491c03f070 con 0x7f492c074590 2024-09-05T01:16:16.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.512+0000 7f4922a00640 1 -- 172.21.15.12:0/2739816703 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f491c03b460 con 0x7f492c074590 2024-09-05T01:16:16.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.512+0000 7f4922a00640 1 -- 172.21.15.12:0/2739816703 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491c035030 con 0x7f492c074590 2024-09-05T01:16:16.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.512+0000 7f4931000640 1 -- 172.21.15.12:0/2739816703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f492c1aa720 con 0x7f492c074590 2024-09-05T01:16:16.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.513+0000 7f4931000640 1 -- 172.21.15.12:0/2739816703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f492c1aacb0 con 0x7f492c074590 2024-09-05T01:16:16.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.514+0000 7f4922a00640 1 -- 172.21.15.12:0/2739816703 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f491c042070 con 0x7f492c074590 2024-09-05T01:16:16.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.514+0000 7f4931000640 1 -- 172.21.15.12:0/2739816703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f492c075cd0 con 0x7f492c074590 2024-09-05T01:16:16.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.515+0000 7f4922a00640 1 --2- 172.21.15.12:0/2739816703 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f49100394f0 0x7f491003b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:16.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.515+0000 7f4922a00640 1 -- 172.21.15.12:0/2739816703 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f491c06ccd0 con 0x7f492c074590 2024-09-05T01:16:16.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.515+0000 7f4929400640 1 --2- 172.21.15.12:0/2739816703 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f49100394f0 0x7f491003b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:16.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.516+0000 7f4929400640 1 --2- 172.21.15.12:0/2739816703 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f49100394f0 0x7f491003b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4918006fd0 tx=0x7f4918008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:16:16.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.520+0000 7f4922a00640 1 -- 172.21.15.12:0/2739816703 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f491c04c350 con 0x7f492c074590 2024-09-05T01:16:16.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.712+0000 7f4931000640 1 -- 172.21.15.12:0/2739816703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f492c1aaf10 con 0x7f492c074590 2024-09-05T01:16:16.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.713+0000 7f4922a00640 1 -- 172.21.15.12:0/2739816703 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f491c036260 con 0x7f492c074590 2024-09-05T01:16:16.714 INFO:teuthology.orchestra.run.smithi012.stdout:# minimal ceph.conf for 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:16:16.714 INFO:teuthology.orchestra.run.smithi012.stdout:[global] 2024-09-05T01:16:16.714 INFO:teuthology.orchestra.run.smithi012.stdout: fsid = 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:16:16.714 INFO:teuthology.orchestra.run.smithi012.stdout: mon_host = [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-09-05T01:16:16.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.716+0000 7f4931000640 1 -- 172.21.15.12:0/2739816703 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f49100394f0 msgr2=0x7f491003b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:16.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.716+0000 7f4931000640 1 --2- 172.21.15.12:0/2739816703 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f49100394f0 0x7f491003b9b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4918006fd0 tx=0x7f4918008040 comp rx=0 tx=0).stop 2024-09-05T01:16:16.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.716+0000 7f4931000640 1 -- 172.21.15.12:0/2739816703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f492c074590 msgr2=0x7f492c1a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:16.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.716+0000 7f4931000640 1 --2- 172.21.15.12:0/2739816703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f492c074590 0x7f492c1a3690 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f491c006010 tx=0x7f491c003c00 comp rx=0 tx=0).stop 2024-09-05T01:16:16.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.716+0000 7f4931000640 1 -- 172.21.15.12:0/2739816703 shutdown_connections 2024-09-05T01:16:16.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.716+0000 7f4931000640 1 --2- 172.21.15.12:0/2739816703 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f49100394f0 0x7f491003b9b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:16.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.716+0000 7f4931000640 1 --2- 172.21.15.12:0/2739816703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f492c19dd50 0x7f492c19e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:16.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.716+0000 7f4931000640 1 --2- 172.21.15.12:0/2739816703 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f492c1a3bd0 0x7f492c19d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:16.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.716+0000 7f4931000640 1 --2- 172.21.15.12:0/2739816703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f492c074590 0x7f492c1a3690 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:16.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.716+0000 7f4931000640 1 -- 172.21.15.12:0/2739816703 >> 172.21.15.12:0/2739816703 conn(0x7f492c0fd230 msgr2=0x7f492c0fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:16:16.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.716+0000 7f4931000640 1 -- 172.21.15.12:0/2739816703 shutdown_connections 2024-09-05T01:16:16.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:16.716+0000 7f4931000640 1 -- 172.21.15.12:0/2739816703 wait complete. 2024-09-05T01:16:17.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T01:16:17.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: mon.c calling monitor election 2024-09-05T01:16:17.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: mon.a calling monitor election 2024-09-05T01:16:17.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:16:17.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:16:17.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:17.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:16:17.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:16:17.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:17.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:16:17.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:16:17.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:17.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:16:17.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-05T01:16:17.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: monmap epoch 3 2024-09-05T01:16:17.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:16:17.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: last_changed 2024-09-05T01:16:09.633248+0000 2024-09-05T01:16:17.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: created 2024-09-05T01:14:17.366670+0000 2024-09-05T01:16:17.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: min_mon_release 19 (squid) 2024-09-05T01:16:17.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: election_strategy: 1 2024-09-05T01:16:17.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-05T01:16:17.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-09-05T01:16:17.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: 2: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.b 2024-09-05T01:16:17.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: fsmap 2024-09-05T01:16:17.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T01:16:17.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: mgrmap e13: x(active, since 52s) 2024-09-05T01:16:17.086 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: overall HEALTH_OK 2024-09-05T01:16:17.086 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:17.086 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:17.086 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:17.086 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:17.086 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:16:17.086 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: from='client.? 172.21.15.151:0/3953623576' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-05T01:16:17.086 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:16 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:16:17.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: mon.b calling monitor election 2024-09-05T01:16:17.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-05T01:16:17.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: Updating smithi145:/etc/ceph/ceph.conf 2024-09-05T01:16:17.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: Updating smithi151:/etc/ceph/ceph.conf 2024-09-05T01:16:17.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: Updating smithi151:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:16:17.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: Updating smithi145:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:16:17.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: mon.b calling monitor election 2024-09-05T01:16:17.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: mon.c calling monitor election 2024-09-05T01:16:17.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: mon.a calling monitor election 2024-09-05T01:16:17.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-05T01:16:17.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: monmap epoch 3 2024-09-05T01:16:17.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:16:17.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: last_changed 2024-09-05T01:16:09.633248+0000 2024-09-05T01:16:17.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: created 2024-09-05T01:14:17.366670+0000 2024-09-05T01:16:17.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: min_mon_release 19 (squid) 2024-09-05T01:16:17.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: election_strategy: 1 2024-09-05T01:16:17.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-05T01:16:17.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-09-05T01:16:17.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: 2: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.b 2024-09-05T01:16:17.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: fsmap 2024-09-05T01:16:17.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T01:16:17.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: mgrmap e13: x(active, since 54s) 2024-09-05T01:16:17.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: overall HEALTH_OK 2024-09-05T01:16:17.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:17.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:17.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:17.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:17.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: Updating smithi012:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:16:17.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2739816703' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:17.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:17 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:17.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: mon.b calling monitor election 2024-09-05T01:16:17.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-05T01:16:17.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: Updating smithi145:/etc/ceph/ceph.conf 2024-09-05T01:16:17.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: Updating smithi151:/etc/ceph/ceph.conf 2024-09-05T01:16:17.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: Updating smithi151:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:16:17.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: Updating smithi145:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:16:17.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: mon.b calling monitor election 2024-09-05T01:16:17.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: mon.c calling monitor election 2024-09-05T01:16:17.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: mon.a calling monitor election 2024-09-05T01:16:17.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-05T01:16:17.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: monmap epoch 3 2024-09-05T01:16:17.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:16:17.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: last_changed 2024-09-05T01:16:09.633248+0000 2024-09-05T01:16:17.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: created 2024-09-05T01:14:17.366670+0000 2024-09-05T01:16:17.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: min_mon_release 19 (squid) 2024-09-05T01:16:17.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: election_strategy: 1 2024-09-05T01:16:17.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-05T01:16:17.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-09-05T01:16:17.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: 2: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.b 2024-09-05T01:16:17.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: fsmap 2024-09-05T01:16:17.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T01:16:17.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: mgrmap e13: x(active, since 54s) 2024-09-05T01:16:17.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: overall HEALTH_OK 2024-09-05T01:16:17.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:17.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:17.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:17.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:17.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: Updating smithi012:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:16:17.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/2739816703' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:17.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:17 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:17.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: mon.b calling monitor election 2024-09-05T01:16:17.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-05T01:16:17.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: Updating smithi145:/etc/ceph/ceph.conf 2024-09-05T01:16:17.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: Updating smithi151:/etc/ceph/ceph.conf 2024-09-05T01:16:17.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: Updating smithi151:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:16:17.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: Updating smithi145:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:16:17.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: mon.b calling monitor election 2024-09-05T01:16:17.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: mon.c calling monitor election 2024-09-05T01:16:17.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: mon.a calling monitor election 2024-09-05T01:16:17.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-05T01:16:17.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: monmap epoch 3 2024-09-05T01:16:17.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:16:17.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: last_changed 2024-09-05T01:16:09.633248+0000 2024-09-05T01:16:17.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: created 2024-09-05T01:14:17.366670+0000 2024-09-05T01:16:17.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: min_mon_release 19 (squid) 2024-09-05T01:16:17.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: election_strategy: 1 2024-09-05T01:16:17.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: 0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-05T01:16:17.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-09-05T01:16:17.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: 2: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.b 2024-09-05T01:16:17.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: fsmap 2024-09-05T01:16:17.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: osdmap e4: 0 total, 0 up, 0 in 2024-09-05T01:16:17.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: mgrmap e13: x(active, since 54s) 2024-09-05T01:16:17.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: overall HEALTH_OK 2024-09-05T01:16:17.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:17.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:17.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:17.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:17.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: Updating smithi012:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:16:17.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/2739816703' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:17.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:17 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:17.631 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-05T01:16:17.631 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-05T01:16:17.632 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.conf 2024-09-05T01:16:17.689 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-05T01:16:17.689 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-05T01:16:17.789 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-05T01:16:17.790 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/ceph.conf 2024-09-05T01:16:17.823 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-05T01:16:17.823 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-05T01:16:17.893 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-05T01:16:17.893 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.conf 2024-09-05T01:16:17.924 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-05T01:16:17.924 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-05T01:16:17.993 INFO:tasks.cephadm:Adding mgr.x on smithi012 2024-09-05T01:16:17.993 INFO:tasks.cephadm:Adding mgr.y on smithi145 2024-09-05T01:16:17.993 INFO:tasks.cephadm:Adding mgr.z on smithi151 2024-09-05T01:16:17.994 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph orch apply mgr '3;smithi012=x;smithi145=y;smithi151=z' 2024-09-05T01:16:18.276 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T01:16:18.477 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:18.477 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:18.477 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:18.477 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:18.477 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:18.478 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:18.478 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:18.478 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:18 smithi145 ceph-mon[34376]: Reconfiguring mon.a (unknown last config time)... 2024-09-05T01:16:18.478 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T01:16:18.478 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T01:16:18.478 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:18.478 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:18 smithi145 ceph-mon[34376]: Reconfiguring daemon mon.a on smithi012 2024-09-05T01:16:18.478 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:16:18.478 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:18 smithi145 ceph-mon[34376]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:18.500 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:18.501 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:18.501 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:18.501 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:18.501 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:18.501 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:18.501 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:18.501 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:18 smithi151 ceph-mon[35013]: Reconfiguring mon.a (unknown last config time)... 2024-09-05T01:16:18.501 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T01:16:18.501 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T01:16:18.501 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:18.501 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:18 smithi151 ceph-mon[35013]: Reconfiguring daemon mon.a on smithi012 2024-09-05T01:16:18.501 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:16:18.502 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:18 smithi151 ceph-mon[35013]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:18.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:18.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:18.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:18.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:18.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:18.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:18.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:18.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:18 smithi012 ceph-mon[29942]: Reconfiguring mon.a (unknown last config time)... 2024-09-05T01:16:18.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T01:16:18.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T01:16:18.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:18.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:18 smithi012 ceph-mon[29942]: Reconfiguring daemon mon.a on smithi012 2024-09-05T01:16:18.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:16:18.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:18 smithi012 ceph-mon[29942]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:18.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.695+0000 7f11dad9f640 1 -- 172.21.15.151:0/1843397251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11d41005f0 msgr2=0x7f11d41009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:18.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.695+0000 7f11dad9f640 1 --2- 172.21.15.151:0/1843397251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11d41005f0 0x7f11d41009f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f11cc009880 tx=0x7f11cc02a5d0 comp rx=0 tx=0).stop 2024-09-05T01:16:18.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.695+0000 7f11dad9f640 1 -- 172.21.15.151:0/1843397251 shutdown_connections 2024-09-05T01:16:18.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.695+0000 7f11dad9f640 1 --2- 172.21.15.151:0/1843397251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11d41005f0 0x7f11d41009f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:18.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.695+0000 7f11dad9f640 1 -- 172.21.15.151:0/1843397251 >> 172.21.15.151:0/1843397251 conn(0x7f11d40fbda0 msgr2=0x7f11d40fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:16:18.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.695+0000 7f11dad9f640 1 -- 172.21.15.151:0/1843397251 shutdown_connections 2024-09-05T01:16:18.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.695+0000 7f11dad9f640 1 -- 172.21.15.151:0/1843397251 wait complete. 2024-09-05T01:16:18.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.696+0000 7f11dad9f640 1 Processor -- start 2024-09-05T01:16:18.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.696+0000 7f11dad9f640 1 -- start start 2024-09-05T01:16:18.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.696+0000 7f11dad9f640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11d41005f0 0x7f11d4197000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:18.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.696+0000 7f11dad9f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11d4197540 0x7f11d419c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:18.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.696+0000 7f11dad9f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11d41979c0 0x7f11d419eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:18.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.696+0000 7f11dad9f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f11d41066e0 con 0x7f11d4197540 2024-09-05T01:16:18.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.696+0000 7f11dad9f640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f11d4106560 con 0x7f11d41005f0 2024-09-05T01:16:18.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.696+0000 7f11dad9f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f11d4106860 con 0x7f11d41979c0 2024-09-05T01:16:18.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.696+0000 7f11d933c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11d41979c0 0x7f11d419eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:18.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.696+0000 7f11d933c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11d41979c0 0x7f11d419eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50494/0 (socket says 172.21.15.151:50494) 2024-09-05T01:16:18.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.696+0000 7f11d933c640 1 -- 172.21.15.151:0/3239430921 learned_addr learned my addr 172.21.15.151:0/3239430921 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-05T01:16:18.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.696+0000 7f11d3fff640 1 --2- 172.21.15.151:0/3239430921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11d4197540 0x7f11d419c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:18.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.696+0000 7f11d8b3b640 1 --2- 172.21.15.151:0/3239430921 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11d41005f0 0x7f11d4197000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:18.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.696+0000 7f11d933c640 1 -- 172.21.15.151:0/3239430921 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11d41005f0 msgr2=0x7f11d4197000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:18.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.696+0000 7f11d933c640 1 --2- 172.21.15.151:0/3239430921 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11d41005f0 0x7f11d4197000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:18.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.696+0000 7f11d933c640 1 -- 172.21.15.151:0/3239430921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11d4197540 msgr2=0x7f11d419c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:18.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.696+0000 7f11d933c640 1 --2- 172.21.15.151:0/3239430921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11d4197540 0x7f11d419c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:18.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.696+0000 7f11d933c640 1 -- 172.21.15.151:0/3239430921 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d419f400 con 0x7f11d41979c0 2024-09-05T01:16:18.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.697+0000 7f11d933c640 1 --2- 172.21.15.151:0/3239430921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11d41979c0 0x7f11d419eb40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00b450 tx=0x7f11bc00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:16:18.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.697+0000 7f11d1ffb640 1 -- 172.21.15.151:0/3239430921 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc015020 con 0x7f11d41979c0 2024-09-05T01:16:18.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.697+0000 7f11dad9f640 1 -- 172.21.15.151:0/3239430921 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11d419f6f0 con 0x7f11d41979c0 2024-09-05T01:16:18.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.697+0000 7f11d1ffb640 1 -- 172.21.15.151:0/3239430921 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11bc011d70 con 0x7f11d41979c0 2024-09-05T01:16:18.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.697+0000 7f11d1ffb640 1 -- 172.21.15.151:0/3239430921 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc00f340 con 0x7f11d41979c0 2024-09-05T01:16:18.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.697+0000 7f11dad9f640 1 -- 172.21.15.151:0/3239430921 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11d419fcb0 con 0x7f11d41979c0 2024-09-05T01:16:18.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.698+0000 7f11d1ffb640 1 -- 172.21.15.151:0/3239430921 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f11bc018020 con 0x7f11d41979c0 2024-09-05T01:16:18.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.698+0000 7f11d1ffb640 1 --2- 172.21.15.151:0/3239430921 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f11c00394f0 0x7f11c003b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:18.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.698+0000 7f11d1ffb640 1 -- 172.21.15.151:0/3239430921 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f11bc04be50 con 0x7f11d41979c0 2024-09-05T01:16:18.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.698+0000 7f11d8b3b640 1 --2- 172.21.15.151:0/3239430921 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f11c00394f0 0x7f11c003b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:18.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.698+0000 7f11dad9f640 1 -- 172.21.15.151:0/3239430921 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11d4100a70 con 0x7f11d41979c0 2024-09-05T01:16:18.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.699+0000 7f11d8b3b640 1 --2- 172.21.15.151:0/3239430921 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f11c00394f0 0x7f11c003b9b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f11cc000c00 tx=0x7f11cc031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:16:18.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.703+0000 7f11d1ffb640 1 -- 172.21.15.151:0/3239430921 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f11bc01f020 con 0x7f11d41979c0 2024-09-05T01:16:18.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.881+0000 7f11dad9f640 1 -- 172.21.15.151:0/3239430921 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi012=x;smithi145=y;smithi151=z", "target": ["mon-mgr", ""]}) -- 0x7f11d406ab40 con 0x7f11c00394f0 2024-09-05T01:16:18.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.888+0000 7f11d1ffb640 1 -- 172.21.15.151:0/3239430921 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f11d406ab40 con 0x7f11c00394f0 2024-09-05T01:16:18.889 INFO:teuthology.orchestra.run.smithi151.stdout:Scheduled mgr update... 2024-09-05T01:16:18.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.890+0000 7f11dad9f640 1 -- 172.21.15.151:0/3239430921 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f11c00394f0 msgr2=0x7f11c003b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:18.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.890+0000 7f11dad9f640 1 --2- 172.21.15.151:0/3239430921 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f11c00394f0 0x7f11c003b9b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f11cc000c00 tx=0x7f11cc031400 comp rx=0 tx=0).stop 2024-09-05T01:16:18.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.890+0000 7f11dad9f640 1 -- 172.21.15.151:0/3239430921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11d41979c0 msgr2=0x7f11d419eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:18.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.890+0000 7f11dad9f640 1 --2- 172.21.15.151:0/3239430921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11d41979c0 0x7f11d419eb40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00b450 tx=0x7f11bc00b910 comp rx=0 tx=0).stop 2024-09-05T01:16:18.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.890+0000 7f11dad9f640 1 -- 172.21.15.151:0/3239430921 shutdown_connections 2024-09-05T01:16:18.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.890+0000 7f11dad9f640 1 --2- 172.21.15.151:0/3239430921 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f11c00394f0 0x7f11c003b9b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:18.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.890+0000 7f11dad9f640 1 --2- 172.21.15.151:0/3239430921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11d41979c0 0x7f11d419eb40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:18.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.890+0000 7f11dad9f640 1 --2- 172.21.15.151:0/3239430921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11d4197540 0x7f11d419c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:18.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.890+0000 7f11dad9f640 1 --2- 172.21.15.151:0/3239430921 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11d41005f0 0x7f11d4197000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:18.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.890+0000 7f11dad9f640 1 -- 172.21.15.151:0/3239430921 >> 172.21.15.151:0/3239430921 conn(0x7f11d40fbda0 msgr2=0x7f11d406a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:16:18.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.890+0000 7f11dad9f640 1 -- 172.21.15.151:0/3239430921 shutdown_connections 2024-09-05T01:16:18.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:16:18.890+0000 7f11dad9f640 1 -- 172.21.15.151:0/3239430921 wait complete. 2024-09-05T01:16:19.386 DEBUG:teuthology.orchestra.run.smithi145:mgr.y> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mgr.y.service 2024-09-05T01:16:19.389 DEBUG:teuthology.orchestra.run.smithi151:mgr.z> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mgr.z.service 2024-09-05T01:16:19.391 INFO:tasks.cephadm:Deploying OSDs... 2024-09-05T01:16:19.391 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-05T01:16:19.391 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/scratch_devs of=/dev/stdout 2024-09-05T01:16:19.427 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-05T01:16:19.427 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_1 2024-09-05T01:16:19.503 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-05T01:16:19.503 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T01:16:19.504 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-09-05T01:16:19.504 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T01:16:19.504 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T01:16:19.504 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-05 01:15:35.584156669 +0000 2024-09-05T01:16:19.504 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-05 01:11:07.863155512 +0000 2024-09-05T01:16:19.504 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-05 01:11:07.863155512 +0000 2024-09-05T01:16:19.504 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-05 01:11:07.863155512 +0000 2024-09-05T01:16:19.504 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-05T01:16:19.598 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-05T01:16:19.599 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-05T01:16:19.599 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000278638 s, 1.8 MB/s 2024-09-05T01:16:19.601 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-05T01:16:19.640 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_2 2024-09-05T01:16:19.716 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-05T01:16:19.716 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T01:16:19.716 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-09-05T01:16:19.717 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T01:16:19.717 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T01:16:19.717 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-05 01:15:35.627156288 +0000 2024-09-05T01:16:19.717 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-05 01:11:08.342151231 +0000 2024-09-05T01:16:19.717 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-05 01:11:08.342151231 +0000 2024-09-05T01:16:19.717 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-05 01:11:08.342151231 +0000 2024-09-05T01:16:19.717 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-05T01:16:19.812 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-05T01:16:19.812 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-05T01:16:19.812 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000263035 s, 1.9 MB/s 2024-09-05T01:16:19.814 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-05T01:16:19.852 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_3 2024-09-05T01:16:19.931 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-05T01:16:19.931 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T01:16:19.931 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-09-05T01:16:19.931 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T01:16:19.932 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T01:16:19.932 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-05 01:15:35.673155880 +0000 2024-09-05T01:16:19.932 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-05 01:11:08.858146621 +0000 2024-09-05T01:16:19.932 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-05 01:11:08.858146621 +0000 2024-09-05T01:16:19.932 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-05 01:11:08.858146621 +0000 2024-09-05T01:16:19.932 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-05T01:16:20.019 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:19 smithi012 ceph-mon[29942]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi012=x;smithi145=y;smithi151=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:16:20.019 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:19 smithi012 ceph-mon[29942]: Saving service mgr spec with placement smithi012=x;smithi145=y;smithi151=z;count:3 2024-09-05T01:16:20.019 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:19 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:20.019 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:19 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:20.019 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:19 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:20.019 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:19 smithi012 ceph-mon[29942]: Reconfiguring mgr.x (unknown last config time)... 2024-09-05T01:16:20.019 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:19 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T01:16:20.019 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:19 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T01:16:20.019 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:19 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:20.020 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:19 smithi012 ceph-mon[29942]: Reconfiguring daemon mgr.x on smithi012 2024-09-05T01:16:20.024 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-05T01:16:20.025 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-05T01:16:20.025 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000324559 s, 1.6 MB/s 2024-09-05T01:16:20.027 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-05T01:16:20.064 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_4 2024-09-05T01:16:20.140 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-05T01:16:20.140 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T01:16:20.140 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-09-05T01:16:20.141 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T01:16:20.141 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T01:16:20.141 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-05 01:15:35.717155490 +0000 2024-09-05T01:16:20.141 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-05 01:11:09.361142126 +0000 2024-09-05T01:16:20.141 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-05 01:11:09.361142126 +0000 2024-09-05T01:16:20.141 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-05 01:11:09.361142126 +0000 2024-09-05T01:16:20.141 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-05T01:16:20.237 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-05T01:16:20.237 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-05T01:16:20.237 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.00316073 s, 162 kB/s 2024-09-05T01:16:20.240 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-05T01:16:20.277 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-05T01:16:20.277 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/scratch_devs of=/dev/stdout 2024-09-05T01:16:20.297 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-05T01:16:20.298 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_1 2024-09-05T01:16:20.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:19 smithi145 ceph-mon[34376]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi012=x;smithi145=y;smithi151=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:16:20.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:19 smithi145 ceph-mon[34376]: Saving service mgr spec with placement smithi012=x;smithi145=y;smithi151=z;count:3 2024-09-05T01:16:20.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:19 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:20.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:19 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:20.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:19 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:20.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:19 smithi145 ceph-mon[34376]: Reconfiguring mgr.x (unknown last config time)... 2024-09-05T01:16:20.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:19 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T01:16:20.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:19 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T01:16:20.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:19 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:20.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:19 smithi145 ceph-mon[34376]: Reconfiguring daemon mgr.x on smithi012 2024-09-05T01:16:20.352 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-05T01:16:20.352 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T01:16:20.352 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-05T01:16:20.352 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T01:16:20.353 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T01:16:20.353 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-05 01:16:09.081724576 +0000 2024-09-05T01:16:20.353 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-05 01:10:32.074804825 +0000 2024-09-05T01:16:20.353 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-05 01:10:32.074804825 +0000 2024-09-05T01:16:20.353 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-05 01:10:32.074804825 +0000 2024-09-05T01:16:20.353 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-05T01:16:20.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:19 smithi151 ceph-mon[35013]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi012=x;smithi145=y;smithi151=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:16:20.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:19 smithi151 ceph-mon[35013]: Saving service mgr spec with placement smithi012=x;smithi145=y;smithi151=z;count:3 2024-09-05T01:16:20.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:19 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:20.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:19 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:20.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:19 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:20.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:19 smithi151 ceph-mon[35013]: Reconfiguring mgr.x (unknown last config time)... 2024-09-05T01:16:20.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:19 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T01:16:20.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:19 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T01:16:20.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:19 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:20.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:19 smithi151 ceph-mon[35013]: Reconfiguring daemon mgr.x on smithi012 2024-09-05T01:16:20.419 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-05T01:16:20.419 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-05T01:16:20.420 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000265614 s, 1.9 MB/s 2024-09-05T01:16:20.421 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-05T01:16:20.479 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_2 2024-09-05T01:16:20.536 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-05T01:16:20.536 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T01:16:20.536 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-05T01:16:20.537 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T01:16:20.537 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T01:16:20.537 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-05 01:16:09.081724576 +0000 2024-09-05T01:16:20.537 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-05 01:10:32.390798297 +0000 2024-09-05T01:16:20.537 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-05 01:10:32.390798297 +0000 2024-09-05T01:16:20.537 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-05 01:10:32.390798297 +0000 2024-09-05T01:16:20.537 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-05T01:16:20.601 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-05T01:16:20.602 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-05T01:16:20.602 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000214895 s, 2.4 MB/s 2024-09-05T01:16:20.603 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-05T01:16:20.660 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_3 2024-09-05T01:16:20.717 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-05T01:16:20.717 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T01:16:20.717 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-05T01:16:20.717 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T01:16:20.717 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T01:16:20.717 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-05 01:16:09.082724556 +0000 2024-09-05T01:16:20.717 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-05 01:10:32.713791625 +0000 2024-09-05T01:16:20.718 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-05 01:10:32.713791625 +0000 2024-09-05T01:16:20.718 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-05 01:10:32.713791625 +0000 2024-09-05T01:16:20.718 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-05T01:16:20.781 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-05T01:16:20.781 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-05T01:16:20.781 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000187303 s, 2.7 MB/s 2024-09-05T01:16:20.782 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-05T01:16:20.839 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_4 2024-09-05T01:16:20.896 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-05T01:16:20.896 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T01:16:20.896 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-09-05T01:16:20.896 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T01:16:20.896 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T01:16:20.896 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-05 01:16:09.082724556 +0000 2024-09-05T01:16:20.896 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-05 01:10:33.037784933 +0000 2024-09-05T01:16:20.896 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-05 01:10:33.037784933 +0000 2024-09-05T01:16:20.896 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-05 01:10:33.037784933 +0000 2024-09-05T01:16:20.897 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-05T01:16:20.960 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-05T01:16:20.960 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-05T01:16:20.960 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000231082 s, 2.2 MB/s 2024-09-05T01:16:20.961 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-05T01:16:21.018 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-05T01:16:21.018 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2024-09-05T01:16:21.038 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-05T01:16:21.038 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 2024-09-05T01:16:21.073 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:20 smithi145 ceph-mon[34376]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:21.073 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:20 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:21.073 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:20 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:21.073 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:20 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T01:16:21.073 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:20 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T01:16:21.073 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:20 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:21.097 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-05T01:16:21.097 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T01:16:21.097 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-05T01:16:21.097 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T01:16:21.097 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T01:16:21.097 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-05 01:15:59.398838955 +0000 2024-09-05T01:16:21.097 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-05 01:10:32.056948990 +0000 2024-09-05T01:16:21.097 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-05 01:10:32.056948990 +0000 2024-09-05T01:16:21.098 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-09-05 01:10:32.056948990 +0000 2024-09-05T01:16:21.098 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-05T01:16:21.162 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:20 smithi151 ceph-mon[35013]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:21.162 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:20 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:21.162 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:20 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:21.162 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:20 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T01:16:21.162 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:20 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T01:16:21.162 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:20 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:21.164 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-05T01:16:21.165 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-05T01:16:21.165 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000234678 s, 2.2 MB/s 2024-09-05T01:16:21.166 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-05T01:16:21.225 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 2024-09-05T01:16:21.282 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-05T01:16:21.282 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T01:16:21.282 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-05T01:16:21.282 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T01:16:21.283 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T01:16:21.283 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-05 01:15:59.399838942 +0000 2024-09-05T01:16:21.283 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-05 01:10:32.379944673 +0000 2024-09-05T01:16:21.283 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-05 01:10:32.379944673 +0000 2024-09-05T01:16:21.283 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-09-05 01:10:32.379944673 +0000 2024-09-05T01:16:21.283 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-05T01:16:21.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:20 smithi012 ceph-mon[29942]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:21.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:20 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:21.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:20 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:21.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:20 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T01:16:21.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:20 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T01:16:21.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:20 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:21.348 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-05T01:16:21.348 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-05T01:16:21.348 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000191726 s, 2.7 MB/s 2024-09-05T01:16:21.349 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-05T01:16:21.406 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 2024-09-05T01:16:21.462 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-05T01:16:21.462 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T01:16:21.462 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-05T01:16:21.462 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T01:16:21.462 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T01:16:21.463 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-05 01:15:59.399838942 +0000 2024-09-05T01:16:21.463 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-05 01:10:32.687940557 +0000 2024-09-05T01:16:21.463 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-05 01:10:32.687940557 +0000 2024-09-05T01:16:21.463 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-09-05 01:10:32.687940557 +0000 2024-09-05T01:16:21.463 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-05T01:16:21.527 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-05T01:16:21.527 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-05T01:16:21.527 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000233007 s, 2.2 MB/s 2024-09-05T01:16:21.528 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-05T01:16:21.585 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 2024-09-05T01:16:21.640 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-05T01:16:21.641 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-05T01:16:21.641 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-05T01:16:21.641 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T01:16:21.641 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-09-05T01:16:21.641 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-05 01:15:59.400838929 +0000 2024-09-05T01:16:21.641 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-05 01:10:33.023936066 +0000 2024-09-05T01:16:21.641 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-05 01:10:33.023936066 +0000 2024-09-05T01:16:21.641 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-09-05 01:10:33.023936066 +0000 2024-09-05T01:16:21.641 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-05T01:16:21.704 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-05T01:16:21.755 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-05T01:16:21.755 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.00018298 s, 2.8 MB/s 2024-09-05T01:16:21.756 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-05T01:16:21.813 INFO:tasks.cephadm:Deploying osd.0 on smithi012 with /dev/vg_nvme/lv_4... 2024-09-05T01:16:21.813 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-05T01:16:22.189 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:16:22.277 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:21 smithi151 ceph-mon[35013]: Reconfiguring mon.b (monmap changed)... 2024-09-05T01:16:22.278 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:21 smithi151 ceph-mon[35013]: Reconfiguring daemon mon.b on smithi145 2024-09-05T01:16:22.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:21 smithi012 ceph-mon[29942]: Reconfiguring mon.b (monmap changed)... 2024-09-05T01:16:22.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:21 smithi012 ceph-mon[29942]: Reconfiguring daemon mon.b on smithi145 2024-09-05T01:16:22.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:21 smithi145 ceph-mon[34376]: Reconfiguring mon.b (monmap changed)... 2024-09-05T01:16:22.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:21 smithi145 ceph-mon[34376]: Reconfiguring daemon mon.b on smithi145 2024-09-05T01:16:23.190 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:23.191 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:23.191 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:22 smithi012 ceph-mon[29942]: Reconfiguring mon.c (monmap changed)... 2024-09-05T01:16:23.191 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T01:16:23.191 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T01:16:23.191 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:23.191 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:22 smithi012 ceph-mon[29942]: Reconfiguring daemon mon.c on smithi151 2024-09-05T01:16:23.191 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:22 smithi012 ceph-mon[29942]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:23.280 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:22 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:23.280 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:22 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:23.280 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:22 smithi151 ceph-mon[35013]: Reconfiguring mon.c (monmap changed)... 2024-09-05T01:16:23.280 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:22 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T01:16:23.281 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:22 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T01:16:23.281 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:22 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:23.281 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:22 smithi151 ceph-mon[35013]: Reconfiguring daemon mon.c on smithi151 2024-09-05T01:16:23.281 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:22 smithi151 ceph-mon[35013]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:23.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:22 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:23.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:22 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:23.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:22 smithi145 ceph-mon[34376]: Reconfiguring mon.c (monmap changed)... 2024-09-05T01:16:23.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:22 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-05T01:16:23.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:22 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-05T01:16:23.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:22 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:23.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:22 smithi145 ceph-mon[34376]: Reconfiguring daemon mon.c on smithi151 2024-09-05T01:16:23.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:22 smithi145 ceph-mon[34376]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:24.462 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:24 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:24.463 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:24 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:24.463 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:24 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:16:24.463 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:24 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:24.463 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:24 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:16:24.463 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:24 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:24.463 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:24 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T01:16:24.463 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:24 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-05T01:16:24.463 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:24 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T01:16:24.463 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:24 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:24.463 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:24 smithi151 ceph-mon[35013]: Deploying daemon mgr.z on smithi151 2024-09-05T01:16:24.463 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:24 smithi151 ceph-mon[35013]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:24.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:24 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:24.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:24 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:24.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:24 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:16:24.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:24 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:24.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:24 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:16:24.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:24 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:24.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:24 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T01:16:24.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:24 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-05T01:16:24.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:24 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T01:16:24.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:24 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:24.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:24 smithi012 ceph-mon[29942]: Deploying daemon mgr.z on smithi151 2024-09-05T01:16:24.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:24 smithi012 ceph-mon[29942]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:24.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:24 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:24.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:24 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:24.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:24 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:16:24.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:24 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:24.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:24 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:16:24.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:24 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:24.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:24 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T01:16:24.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:24 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-05T01:16:24.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:24 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T01:16:24.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:24 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:24.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:24 smithi145 ceph-mon[34376]: Deploying daemon mgr.z on smithi151 2024-09-05T01:16:24.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:24 smithi145 ceph-mon[34376]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:24.995 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:16:25.028 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi012:vg_nvme/lv_4 2024-09-05T01:16:25.104 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:25 smithi151 podman[36813]: 2024-09-05 01:16:25.049487711 +0000 UTC m=+0.117670207 container create 075d33658ae8cf19e83ba40f137413fa7c752fca9c0d09dbc2893fd8ceecdabe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-91c8a7e) 2024-09-05T01:16:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:16:25.439 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:25 smithi151 podman[36813]: 2024-09-05 01:16:25.251674083 +0000 UTC m=+0.319856537 container init 075d33658ae8cf19e83ba40f137413fa7c752fca9c0d09dbc2893fd8ceecdabe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-91c8a7e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-05T01:16:25.439 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:25 smithi151 podman[36813]: 2024-09-05 01:16:25.254461197 +0000 UTC m=+0.322643652 container start 075d33658ae8cf19e83ba40f137413fa7c752fca9c0d09dbc2893fd8ceecdabe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-05T01:16:25.439 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:25 smithi151 ceph-mgr[36832]: -- 172.21.15.151:0/3841231309 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56085debb0e0 con 0x56085de99000 2024-09-05T01:16:25.439 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:25 smithi151 bash[36813]: 075d33658ae8cf19e83ba40f137413fa7c752fca9c0d09dbc2893fd8ceecdabe 2024-09-05T01:16:25.439 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:25 smithi151 systemd[1]: Started Ceph mgr.z for 0d44cd7e-6b24-11ef-bcd6-c7b262605968. 2024-09-05T01:16:25.439 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:25 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:25.379+0000 7f310f165040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-05T01:16:25.439 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:25 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:25.437+0000 7f310f165040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-05T01:16:25.800 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:25 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:25.586+0000 7f310f165040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-05T01:16:25.800 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:25 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:25.653+0000 7f310f165040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-05T01:16:25.800 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:25 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:25.799+0000 7f310f165040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-05T01:16:25.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.910+0000 7fce17200640 1 -- 172.21.15.12:0/1244100779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce181098b0 msgr2=0x7fce1810bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:25.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.910+0000 7fce17200640 1 --2- 172.21.15.12:0/1244100779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce181098b0 0x7fce1810bd70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fce10009900 tx=0x7fce1002a3f0 comp rx=0 tx=0).stop 2024-09-05T01:16:25.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.910+0000 7fce17200640 1 -- 172.21.15.12:0/1244100779 shutdown_connections 2024-09-05T01:16:25.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.910+0000 7fce17200640 1 --2- 172.21.15.12:0/1244100779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce181098b0 0x7fce1810bd70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:25.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.910+0000 7fce17200640 1 --2- 172.21.15.12:0/1244100779 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce18074b40 0x7fce18074fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:25.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.910+0000 7fce17200640 1 --2- 172.21.15.12:0/1244100779 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fce180761a0 0x7fce18074600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:25.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.910+0000 7fce17200640 1 -- 172.21.15.12:0/1244100779 >> 172.21.15.12:0/1244100779 conn(0x7fce180fd1f0 msgr2=0x7fce180ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:16:25.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.910+0000 7fce17200640 1 -- 172.21.15.12:0/1244100779 shutdown_connections 2024-09-05T01:16:25.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.910+0000 7fce17200640 1 -- 172.21.15.12:0/1244100779 wait complete. 2024-09-05T01:16:25.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.911+0000 7fce17200640 1 Processor -- start 2024-09-05T01:16:25.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.911+0000 7fce17200640 1 -- start start 2024-09-05T01:16:25.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.912+0000 7fce17200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fce18074b40 0x7fce18199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:25.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.912+0000 7fce17200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce180761a0 0x7fce1819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:25.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.912+0000 7fce17200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce181098b0 0x7fce181a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:25.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.912+0000 7fce17200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fce1810f890 con 0x7fce181098b0 2024-09-05T01:16:25.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.912+0000 7fce17200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fce1810f710 con 0x7fce18074b40 2024-09-05T01:16:25.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.912+0000 7fce17200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fce1810fa10 con 0x7fce180761a0 2024-09-05T01:16:25.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.912+0000 7fce15e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fce18074b40 0x7fce18199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:25.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.912+0000 7fce15e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fce18074b40 0x7fce18199e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:60130/0 (socket says 172.21.15.12:60130) 2024-09-05T01:16:25.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.912+0000 7fce15e00640 1 -- 172.21.15.12:0/914301675 learned_addr learned my addr 172.21.15.12:0/914301675 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:16:25.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.912+0000 7fce07e00640 1 --2- 172.21.15.12:0/914301675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce180761a0 0x7fce1819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:25.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.912+0000 7fce16800640 1 --2- 172.21.15.12:0/914301675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce181098b0 0x7fce181a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:25.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.912+0000 7fce15e00640 1 -- 172.21.15.12:0/914301675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce180761a0 msgr2=0x7fce1819a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:25.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.912+0000 7fce15e00640 1 --2- 172.21.15.12:0/914301675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce180761a0 0x7fce1819a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:25.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.912+0000 7fce15e00640 1 -- 172.21.15.12:0/914301675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce181098b0 msgr2=0x7fce181a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:25.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.912+0000 7fce15e00640 1 --2- 172.21.15.12:0/914301675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce181098b0 0x7fce181a1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:25.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.912+0000 7fce15e00640 1 -- 172.21.15.12:0/914301675 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce181a1ac0 con 0x7fce18074b40 2024-09-05T01:16:25.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.912+0000 7fce07e00640 1 --2- 172.21.15.12:0/914301675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce180761a0 0x7fce1819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:16:25.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.913+0000 7fce15e00640 1 --2- 172.21.15.12:0/914301675 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fce18074b40 0x7fce18199e90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fce0800ebc0 tx=0x7fce0800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:16:25.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.913+0000 7fce0f400640 1 -- 172.21.15.12:0/914301675 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce08010630 con 0x7fce18074b40 2024-09-05T01:16:25.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.913+0000 7fce17200640 1 -- 172.21.15.12:0/914301675 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce181a1db0 con 0x7fce18074b40 2024-09-05T01:16:25.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.913+0000 7fce0f400640 1 -- 172.21.15.12:0/914301675 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce08010cb0 con 0x7fce18074b40 2024-09-05T01:16:25.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.913+0000 7fce0f400640 1 -- 172.21.15.12:0/914301675 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce08018bd0 con 0x7fce18074b40 2024-09-05T01:16:25.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.913+0000 7fce17200640 1 -- 172.21.15.12:0/914301675 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce181a2210 con 0x7fce18074b40 2024-09-05T01:16:25.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.914+0000 7fce0f400640 1 -- 172.21.15.12:0/914301675 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fce080107d0 con 0x7fce18074b40 2024-09-05T01:16:25.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.914+0000 7fce17200640 1 -- 172.21.15.12:0/914301675 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce181086c0 con 0x7fce18074b40 2024-09-05T01:16:25.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.915+0000 7fce0f400640 1 --2- 172.21.15.12:0/914301675 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fcdf80392c0 0x7fcdf803b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:25.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.915+0000 7fce0f400640 1 -- 172.21.15.12:0/914301675 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fce0804cb00 con 0x7fce18074b40 2024-09-05T01:16:25.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.915+0000 7fce07e00640 1 --2- 172.21.15.12:0/914301675 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fcdf80392c0 0x7fcdf803b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:25.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.915+0000 7fce07e00640 1 --2- 172.21.15.12:0/914301675 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fcdf80392c0 0x7fcdf803b780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fce1819b3b0 tx=0x7fce00005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:16:25.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:25.920+0000 7fce0f400640 1 -- 172.21.15.12:0/914301675 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fce08010ac0 con 0x7fce18074b40 2024-09-05T01:16:26.103 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:25 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:25.938+0000 7f310f165040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-05T01:16:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:26.115+0000 7fce17200640 1 -- 172.21.15.12:0/914301675 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fce18062630 con 0x7fcdf80392c0 2024-09-05T01:16:26.509 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:26 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:26.257+0000 7f310f165040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-05T01:16:26.510 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:26 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:26.318+0000 7f310f165040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-05T01:16:26.510 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:26 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:26.510 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:26 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:26.510 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:26 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:26.510 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:26 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T01:16:26.510 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:26 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-05T01:16:26.510 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:26 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T01:16:26.510 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:26 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:26.510 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:26 smithi151 ceph-mon[35013]: Deploying daemon mgr.y on smithi145 2024-09-05T01:16:26.510 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:26 smithi151 ceph-mon[35013]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:26.510 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:26 smithi151 ceph-mon[35013]: from='client.24110 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:16:26.511 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:26 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:16:26.511 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:26 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:16:26.511 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:26 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:26.708 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:26 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:26.708 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:26 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:26.708 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:26 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:26.708 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:26 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T01:16:26.708 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:26 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-05T01:16:26.708 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:26 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T01:16:26.708 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:26 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:26.709 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:26 smithi012 ceph-mon[29942]: Deploying daemon mgr.y on smithi145 2024-09-05T01:16:26.709 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:26 smithi012 ceph-mon[29942]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:26.709 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:26 smithi012 ceph-mon[29942]: from='client.24110 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:16:26.709 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:26 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:16:26.709 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:26 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:16:26.709 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:26 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:26.724 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:26 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:26.724 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:26 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:26.724 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:26 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:26.724 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:26 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-05T01:16:26.724 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:26 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-05T01:16:26.724 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:26 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-05T01:16:26.725 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:26 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:26.725 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:26 smithi145 ceph-mon[34376]: Deploying daemon mgr.y on smithi145 2024-09-05T01:16:26.725 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:26 smithi145 ceph-mon[34376]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:26.725 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:26 smithi145 ceph-mon[34376]: from='client.24110 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:16:26.725 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:26 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:16:26.725 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:26 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:16:26.725 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:26 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:26.854 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:26 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:26.508+0000 7f310f165040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-05T01:16:27.334 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:27 smithi145 systemd[1]: Starting Ceph mgr.y for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:16:27.678 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:27 smithi145 podman[35724]: 2024-09-05 01:16:27.309713711 +0000 UTC m=+0.015389584 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:16:27.678 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:27 smithi145 podman[35724]: 2024-09-05 01:16:27.409575459 +0000 UTC m=+0.115251322 container create 0007f54337ed2aeab7e04c120797c248cb8a3512cc90ae71720c2adda8a25c50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-05T01:16:27.678 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:27 smithi145 podman[35724]: 2024-09-05 01:16:27.603693231 +0000 UTC m=+0.309369095 container init 0007f54337ed2aeab7e04c120797c248cb8a3512cc90ae71720c2adda8a25c50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-05T01:16:27.679 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:27 smithi145 podman[35724]: 2024-09-05 01:16:27.606630831 +0000 UTC m=+0.312306696 container start 0007f54337ed2aeab7e04c120797c248cb8a3512cc90ae71720c2adda8a25c50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-05T01:16:27.679 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:27 smithi145 ceph-mgr[35743]: -- 172.21.15.145:0/547338315 <== mon.2 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c9b172b0e0 con 0x55c9b1708800 2024-09-05T01:16:27.679 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:27 smithi145 bash[35724]: 0007f54337ed2aeab7e04c120797c248cb8a3512cc90ae71720c2adda8a25c50 2024-09-05T01:16:27.693 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:27 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:27.434+0000 7f310f165040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-05T01:16:27.693 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:27 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:27.504+0000 7f310f165040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-05T01:16:27.951 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:27 smithi145 systemd[1]: Started Ceph mgr.y for 0d44cd7e-6b24-11ef-bcd6-c7b262605968. 2024-09-05T01:16:27.951 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:27.737+0000 7f0fa794f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-05T01:16:27.951 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:27.797+0000 7f0fa794f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-05T01:16:27.951 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:27.950+0000 7f0fa794f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-05T01:16:28.333 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:28.020+0000 7f0fa794f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-05T01:16:28.333 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:28.182+0000 7f0fa794f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-05T01:16:28.535 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:28 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:28.264+0000 7f310f165040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-05T01:16:28.535 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:28 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:28.389+0000 7f310f165040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-05T01:16:28.536 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:28 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:28.534+0000 7f310f165040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-05T01:16:28.595 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:28.342+0000 7f0fa794f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-05T01:16:28.825 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:28 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:28.825 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:28 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:28.825 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:28 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:28.825 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:28 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:28.825 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:28 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:16:28.825 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:28 smithi151 ceph-mon[35013]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:28.825 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:28 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:28.602+0000 7f310f165040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-05T01:16:28.825 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:28 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:28.755+0000 7f310f165040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-05T01:16:28.826 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:28 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:28.824+0000 7f310f165040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-05T01:16:28.935 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:28.668+0000 7f0fa794f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-05T01:16:28.935 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:28.730+0000 7f0fa794f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-05T01:16:28.935 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:28 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:28.935 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:28 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:28.935 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:28 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:28.936 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:28 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:28.936 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:28 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:16:28.936 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:28 smithi145 ceph-mon[34376]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:29.061 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:28 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:29.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:28 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:29.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:28 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:29.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:28 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:29.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:28 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:16:29.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:28 smithi012 ceph-mon[29942]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:29.104 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:28 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:28.885+0000 7f310f165040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-05T01:16:29.104 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:29 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:29.056+0000 7f310f165040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-05T01:16:29.333 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:28.934+0000 7f0fa794f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-05T01:16:29.401 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:29 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:29.123+0000 7f310f165040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-05T01:16:29.401 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:29 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:29.193+0000 7f310f165040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-05T01:16:29.401 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:29 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:29.277+0000 7f310f165040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-05T01:16:29.401 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:29 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:29.340+0000 7f310f165040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-05T01:16:29.401 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:29 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:29.400+0000 7f310f165040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-05T01:16:30.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:29 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:30.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:29 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:30.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:29 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:30.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:29 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:30.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:29 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:30.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:29 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:16:30.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:29 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:30.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:29 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3711570786' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b74ac640-b680-46e2-9106-d24168e685e9"}]: dispatch 2024-09-05T01:16:30.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:29 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3711570786' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b74ac640-b680-46e2-9106-d24168e685e9"}]': finished 2024-09-05T01:16:30.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:29 smithi012 ceph-mon[29942]: osdmap e5: 1 total, 0 up, 1 in 2024-09-05T01:16:30.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:29 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T01:16:30.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:29 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:16:30.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:29 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:30.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:29 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:16:30.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:29 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:30.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:29 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3620436388' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:16:30.083 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:29.824+0000 7f0fa794f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-05T01:16:30.083 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:29.890+0000 7f0fa794f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-05T01:16:30.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:29 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:30.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:29 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:30.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:29 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:30.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:29 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:30.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:29 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:30.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:29 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:16:30.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:29 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:30.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:29 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3711570786' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b74ac640-b680-46e2-9106-d24168e685e9"}]: dispatch 2024-09-05T01:16:30.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:29 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3711570786' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b74ac640-b680-46e2-9106-d24168e685e9"}]': finished 2024-09-05T01:16:30.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:29 smithi145 ceph-mon[34376]: osdmap e5: 1 total, 0 up, 1 in 2024-09-05T01:16:30.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:29 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T01:16:30.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:29 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:16:30.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:29 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:30.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:29 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:16:30.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:29 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:30.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:29 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3620436388' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:16:30.197 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:29 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:30.197 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:29 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:30.197 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:29 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:30.197 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:29 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:30.197 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:29 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:30.198 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:29 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:16:30.198 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:29 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:30.198 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:29 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3711570786' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b74ac640-b680-46e2-9106-d24168e685e9"}]: dispatch 2024-09-05T01:16:30.198 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:29 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3711570786' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b74ac640-b680-46e2-9106-d24168e685e9"}]': finished 2024-09-05T01:16:30.198 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:29 smithi151 ceph-mon[35013]: osdmap e5: 1 total, 0 up, 1 in 2024-09-05T01:16:30.198 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:29 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T01:16:30.198 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:29 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:16:30.198 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:29 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:30.198 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:29 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:16:30.198 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:29 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:30.198 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:29 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3620436388' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:16:30.604 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:16:30 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:16:30.196+0000 7f310f165040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-05T01:16:30.860 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:30 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:30.604+0000 7f0fa794f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-05T01:16:30.861 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:30 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:30.719+0000 7f0fa794f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-05T01:16:30.861 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:30 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:30.859+0000 7f0fa794f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-05T01:16:30.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:30.933+0000 7fce0f400640 1 -- 172.21.15.12:0/914301675 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7fce08017750 con 0x7fce18074b40 2024-09-05T01:16:31.138 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:30 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:30.920+0000 7f0fa794f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-05T01:16:31.138 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:31 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:31.070+0000 7f0fa794f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-05T01:16:31.138 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:31 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:31.137+0000 7f0fa794f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-05T01:16:31.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:30 smithi145 ceph-mon[34376]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:31.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:30 smithi145 ceph-mon[34376]: Standby manager daemon z started 2024-09-05T01:16:31.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:30 smithi145 ceph-mon[34376]: from='mgr.? 172.21.15.151:0/1203572513' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-05T01:16:31.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:30 smithi145 ceph-mon[34376]: from='mgr.? 172.21.15.151:0/1203572513' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-05T01:16:31.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:30 smithi145 ceph-mon[34376]: from='mgr.? 172.21.15.151:0/1203572513' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-05T01:16:31.139 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:30 smithi145 ceph-mon[34376]: from='mgr.? 172.21.15.151:0/1203572513' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-05T01:16:31.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:30 smithi012 ceph-mon[29942]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:31.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:30 smithi012 ceph-mon[29942]: Standby manager daemon z started 2024-09-05T01:16:31.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:30 smithi012 ceph-mon[29942]: from='mgr.? 172.21.15.151:0/1203572513' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-05T01:16:31.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:30 smithi012 ceph-mon[29942]: from='mgr.? 172.21.15.151:0/1203572513' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-05T01:16:31.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:30 smithi012 ceph-mon[29942]: from='mgr.? 172.21.15.151:0/1203572513' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-05T01:16:31.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:30 smithi012 ceph-mon[29942]: from='mgr.? 172.21.15.151:0/1203572513' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-05T01:16:31.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:30 smithi151 ceph-mon[35013]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:31.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:30 smithi151 ceph-mon[35013]: Standby manager daemon z started 2024-09-05T01:16:31.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:30 smithi151 ceph-mon[35013]: from='mgr.? 172.21.15.151:0/1203572513' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-05T01:16:31.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:30 smithi151 ceph-mon[35013]: from='mgr.? 172.21.15.151:0/1203572513' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-05T01:16:31.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:30 smithi151 ceph-mon[35013]: from='mgr.? 172.21.15.151:0/1203572513' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-05T01:16:31.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:30 smithi151 ceph-mon[35013]: from='mgr.? 172.21.15.151:0/1203572513' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-05T01:16:31.417 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:31 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:31.197+0000 7f0fa794f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-05T01:16:31.418 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:31 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:31.353+0000 7f0fa794f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-05T01:16:31.418 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:31 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:31.417+0000 7f0fa794f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-05T01:16:31.684 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:31 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:31.482+0000 7f0fa794f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-05T01:16:31.685 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:31 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:31.565+0000 7f0fa794f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-05T01:16:31.685 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:31 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:31.624+0000 7f0fa794f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-05T01:16:31.685 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:31 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:31.683+0000 7f0fa794f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-05T01:16:32.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:31 smithi145 ceph-mon[34376]: mgrmap e14: x(active, since 68s), standbys: z 2024-09-05T01:16:32.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:31 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-05T01:16:32.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:31 smithi012 ceph-mon[29942]: mgrmap e14: x(active, since 68s), standbys: z 2024-09-05T01:16:32.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:31 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-05T01:16:32.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:31 smithi151 ceph-mon[35013]: mgrmap e14: x(active, since 68s), standbys: z 2024-09-05T01:16:32.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:31 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-05T01:16:32.833 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:16:32 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:16:32.468+0000 7f0fa794f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-05T01:16:33.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:33.152+0000 7fce0f400640 1 -- 172.21.15.12:0/914301675 <== mon.2 v2:172.21.15.145:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fce08014b00 con 0x7fce18074b40 2024-09-05T01:16:33.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:32 smithi012 ceph-mon[29942]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:33.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:32 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:33.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:32 smithi012 ceph-mon[29942]: Standby manager daemon y started 2024-09-05T01:16:33.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:32 smithi012 ceph-mon[29942]: from='mgr.? 172.21.15.145:0/2838178077' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-05T01:16:33.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:32 smithi012 ceph-mon[29942]: from='mgr.? 172.21.15.145:0/2838178077' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-05T01:16:33.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:32 smithi012 ceph-mon[29942]: from='mgr.? 172.21.15.145:0/2838178077' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-05T01:16:33.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:32 smithi012 ceph-mon[29942]: from='mgr.? 172.21.15.145:0/2838178077' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-05T01:16:33.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:32 smithi145 ceph-mon[34376]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:33.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:32 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:33.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:32 smithi145 ceph-mon[34376]: Standby manager daemon y started 2024-09-05T01:16:33.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:32 smithi145 ceph-mon[34376]: from='mgr.? 172.21.15.145:0/2838178077' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-05T01:16:33.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:32 smithi145 ceph-mon[34376]: from='mgr.? 172.21.15.145:0/2838178077' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-05T01:16:33.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:32 smithi145 ceph-mon[34376]: from='mgr.? 172.21.15.145:0/2838178077' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-05T01:16:33.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:32 smithi145 ceph-mon[34376]: from='mgr.? 172.21.15.145:0/2838178077' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-05T01:16:33.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:32 smithi151 ceph-mon[35013]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:33.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:32 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:33.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:32 smithi151 ceph-mon[35013]: Standby manager daemon y started 2024-09-05T01:16:33.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:32 smithi151 ceph-mon[35013]: from='mgr.? 172.21.15.145:0/2838178077' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-05T01:16:33.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:32 smithi151 ceph-mon[35013]: from='mgr.? 172.21.15.145:0/2838178077' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-05T01:16:33.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:32 smithi151 ceph-mon[35013]: from='mgr.? 172.21.15.145:0/2838178077' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-05T01:16:33.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:32 smithi151 ceph-mon[35013]: from='mgr.? 172.21.15.145:0/2838178077' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-05T01:16:34.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:34 smithi012 ceph-mon[29942]: mgrmap e15: x(active, since 71s), standbys: z, y 2024-09-05T01:16:34.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:34 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-05T01:16:34.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:34 smithi012 ceph-mon[29942]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:34.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:34 smithi145 ceph-mon[34376]: mgrmap e15: x(active, since 71s), standbys: z, y 2024-09-05T01:16:34.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:34 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-05T01:16:34.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:34 smithi145 ceph-mon[34376]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:34.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:34 smithi151 ceph-mon[35013]: mgrmap e15: x(active, since 71s), standbys: z, y 2024-09-05T01:16:34.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:34 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-05T01:16:34.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:34 smithi151 ceph-mon[35013]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:36.403 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:36 smithi012 ceph-mon[29942]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:36.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:36 smithi145 ceph-mon[34376]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:36.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:36 smithi151 ceph-mon[35013]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:38.413 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:38 smithi012 ceph-mon[29942]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:38.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:38 smithi145 ceph-mon[34376]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:38.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:38 smithi151 ceph-mon[35013]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:39.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:39 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-05T01:16:39.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:39 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:39.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:39 smithi012 ceph-mon[29942]: Deploying daemon osd.0 on smithi012 2024-09-05T01:16:39.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:39 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-05T01:16:39.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:39 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:39.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:39 smithi145 ceph-mon[34376]: Deploying daemon osd.0 on smithi012 2024-09-05T01:16:39.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:39 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-05T01:16:39.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:39 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:39.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:39 smithi151 ceph-mon[35013]: Deploying daemon osd.0 on smithi012 2024-09-05T01:16:40.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:40 smithi012 ceph-mon[29942]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:40.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:40 smithi145 ceph-mon[34376]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:40.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:40 smithi151 ceph-mon[35013]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:42.256 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:42 smithi012 ceph-mon[29942]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:42.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:42 smithi145 ceph-mon[34376]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:42.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:42 smithi151 ceph-mon[35013]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:44.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:44 smithi012 ceph-mon[29942]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:44.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:44 smithi145 ceph-mon[34376]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:44.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:44 smithi151 ceph-mon[35013]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:45.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:45 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:16:45.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:45 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:45.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:45 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:45.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:45 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:16:45.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:45 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:45.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:45 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:45.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:45 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:16:45.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:45 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:45.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:45 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:46.811 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:46 smithi012 ceph-mon[29942]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:46.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:46 smithi145 ceph-mon[34376]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:46.853 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:46 smithi151 ceph-mon[35013]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:48.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:48 smithi012 ceph-mon[29942]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:48.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:48 smithi145 ceph-mon[34376]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:48.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:48 smithi151 ceph-mon[35013]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:49.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:49 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:49.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:49 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:49.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:49 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:49.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:49 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:16:49.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:49 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:49.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:49 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:49.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:49 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:49.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:49 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:49.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:49 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:16:49.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:49 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:49.853 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:49 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:49.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:49 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:49.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:49 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:49.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:49 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:16:49.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:49 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:50.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:50.333+0000 7fce0f400640 1 -- 172.21.15.12:0/914301675 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fce18062630 con 0x7fcdf80392c0 2024-09-05T01:16:50.335 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 0 on host 'smithi012' 2024-09-05T01:16:50.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:50.335+0000 7fce17200640 1 -- 172.21.15.12:0/914301675 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fcdf80392c0 msgr2=0x7fcdf803b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:50.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:50.335+0000 7fce17200640 1 --2- 172.21.15.12:0/914301675 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fcdf80392c0 0x7fcdf803b780 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fce1819b3b0 tx=0x7fce00005f90 comp rx=0 tx=0).stop 2024-09-05T01:16:50.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:50.335+0000 7fce17200640 1 -- 172.21.15.12:0/914301675 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fce18074b40 msgr2=0x7fce18199e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:50.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:50.336+0000 7fce17200640 1 --2- 172.21.15.12:0/914301675 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fce18074b40 0x7fce18199e90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fce0800ebc0 tx=0x7fce0800c6a0 comp rx=0 tx=0).stop 2024-09-05T01:16:50.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:50.336+0000 7fce17200640 1 -- 172.21.15.12:0/914301675 shutdown_connections 2024-09-05T01:16:50.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:50.336+0000 7fce17200640 1 --2- 172.21.15.12:0/914301675 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fcdf80392c0 0x7fcdf803b780 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:50.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:50.336+0000 7fce17200640 1 --2- 172.21.15.12:0/914301675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce181098b0 0x7fce181a1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:50.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:50.336+0000 7fce17200640 1 --2- 172.21.15.12:0/914301675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce180761a0 0x7fce1819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:50.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:50.336+0000 7fce17200640 1 --2- 172.21.15.12:0/914301675 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fce18074b40 0x7fce18199e90 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:50.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:50.336+0000 7fce17200640 1 -- 172.21.15.12:0/914301675 >> 172.21.15.12:0/914301675 conn(0x7fce180fd1f0 msgr2=0x7fce18105890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:16:50.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:50.336+0000 7fce17200640 1 -- 172.21.15.12:0/914301675 shutdown_connections 2024-09-05T01:16:50.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:16:50.336+0000 7fce17200640 1 -- 172.21.15.12:0/914301675 wait complete. 2024-09-05T01:16:50.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:50 smithi012 ceph-mon[29942]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:50.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:16:50.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:50.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:50.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:50 smithi145 ceph-mon[34376]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:50.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:50 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:16:50.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:50 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:50.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:50 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:50.853 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:50 smithi151 ceph-mon[35013]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:50.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:50 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:16:50.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:50 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:50.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:50 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:51.035 DEBUG:teuthology.orchestra.run.smithi012:osd.0> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.0.service 2024-09-05T01:16:51.040 INFO:tasks.cephadm:Deploying osd.1 on smithi145 with /dev/vg_nvme/lv_4... 2024-09-05T01:16:51.040 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-05T01:16:51.289 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T01:16:52.299 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:51 smithi012 ceph-mon[29942]: from='osd.0 [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-05T01:16:52.299 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:16:51 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-0[43795]: 2024-09-05T01:16:51.917+0000 7fca94c2b640 -1 osd.0 0 log_to_monitors true 2024-09-05T01:16:52.302 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:51 smithi145 ceph-mon[34376]: from='osd.0 [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-05T01:16:52.353 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:51 smithi151 ceph-mon[35013]: from='osd.0 [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-05T01:16:53.096 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:52 smithi145 ceph-mon[34376]: from='osd.0 [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-05T01:16:53.096 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:52 smithi145 ceph-mon[34376]: osdmap e6: 1 total, 0 up, 1 in 2024-09-05T01:16:53.096 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:52 smithi145 ceph-mon[34376]: from='osd.0 [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-05T01:16:53.096 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:52 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T01:16:53.097 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:52 smithi145 ceph-mon[34376]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:53.097 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:52 smithi145 ceph-mon[34376]: from='osd.0 [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-05T01:16:53.097 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:52 smithi145 ceph-mon[34376]: osdmap e7: 1 total, 0 up, 1 in 2024-09-05T01:16:53.097 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:52 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T01:16:53.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:52 smithi012 ceph-mon[29942]: from='osd.0 [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-05T01:16:53.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:52 smithi012 ceph-mon[29942]: osdmap e6: 1 total, 0 up, 1 in 2024-09-05T01:16:53.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:52 smithi012 ceph-mon[29942]: from='osd.0 [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-05T01:16:53.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:52 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T01:16:53.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:52 smithi012 ceph-mon[29942]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:53.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:52 smithi012 ceph-mon[29942]: from='osd.0 [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-05T01:16:53.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:52 smithi012 ceph-mon[29942]: osdmap e7: 1 total, 0 up, 1 in 2024-09-05T01:16:53.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:52 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T01:16:53.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:52 smithi151 ceph-mon[35013]: from='osd.0 [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-05T01:16:53.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:52 smithi151 ceph-mon[35013]: osdmap e6: 1 total, 0 up, 1 in 2024-09-05T01:16:53.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:52 smithi151 ceph-mon[35013]: from='osd.0 [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-05T01:16:53.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:52 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T01:16:53.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:52 smithi151 ceph-mon[35013]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:53.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:52 smithi151 ceph-mon[35013]: from='osd.0 [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-05T01:16:53.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:52 smithi151 ceph-mon[35013]: osdmap e7: 1 total, 0 up, 1 in 2024-09-05T01:16:53.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:52 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T01:16:53.638 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-05T01:16:53.665 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi145:vg_nvme/lv_4 2024-09-05T01:16:53.916 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T01:16:54.305 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:53 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T01:16:54.305 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:53 smithi145 ceph-mon[34376]: from='osd.0 [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987]' entity='osd.0' 2024-09-05T01:16:54.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:53 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T01:16:54.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:53 smithi012 ceph-mon[29942]: from='osd.0 [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987]' entity='osd.0' 2024-09-05T01:16:54.312 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:16:53 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-0[43795]: 2024-09-05T01:16:53.982+0000 7fca90200640 -1 osd.0 0 waiting for initial osdmap 2024-09-05T01:16:54.312 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:16:53 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-0[43795]: 2024-09-05T01:16:53.998+0000 7fca85800640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T01:16:54.353 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:53 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T01:16:54.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:53 smithi151 ceph-mon[35013]: from='osd.0 [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987]' entity='osd.0' 2024-09-05T01:16:54.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.389+0000 7f033fc79640 1 -- 172.21.15.145:0/3014650628 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0338102e00 msgr2=0x7f0338103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:54.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.389+0000 7f033fc79640 1 --2- 172.21.15.145:0/3014650628 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0338102e00 0x7f0338103280 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0328009900 tx=0x7f032802a410 comp rx=0 tx=0).stop 2024-09-05T01:16:54.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.389+0000 7f033fc79640 1 -- 172.21.15.145:0/3014650628 shutdown_connections 2024-09-05T01:16:54.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.389+0000 7f033fc79640 1 --2- 172.21.15.145:0/3014650628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03381037c0 0x7f033810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:54.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.389+0000 7f033fc79640 1 --2- 172.21.15.145:0/3014650628 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0338102e00 0x7f0338103280 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:54.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.389+0000 7f033fc79640 1 --2- 172.21.15.145:0/3014650628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0338101c00 0x7f0338102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:54.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.389+0000 7f033fc79640 1 -- 172.21.15.145:0/3014650628 >> 172.21.15.145:0/3014650628 conn(0x7f03380fd390 msgr2=0x7f03380ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:16:54.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.389+0000 7f033fc79640 1 -- 172.21.15.145:0/3014650628 shutdown_connections 2024-09-05T01:16:54.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.389+0000 7f033fc79640 1 -- 172.21.15.145:0/3014650628 wait complete. 2024-09-05T01:16:54.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.390+0000 7f033fc79640 1 Processor -- start 2024-09-05T01:16:54.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.390+0000 7f033fc79640 1 -- start start 2024-09-05T01:16:54.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.390+0000 7f033fc79640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0338101c00 0x7f0338197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:54.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.390+0000 7f033fc79640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0338102e00 0x7f0338198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:54.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.390+0000 7f033fc79640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03381037c0 0x7f033819f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:54.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.390+0000 7f033fc79640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f033810d8e0 con 0x7f03381037c0 2024-09-05T01:16:54.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.390+0000 7f033fc79640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f033810d760 con 0x7f0338102e00 2024-09-05T01:16:54.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.390+0000 7f033fc79640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f033810da60 con 0x7f0338101c00 2024-09-05T01:16:54.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.390+0000 7f033d214640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0338102e00 0x7f0338198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:54.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.390+0000 7f033d214640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0338102e00 0x7f0338198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:35342/0 (socket says 172.21.15.145:35342) 2024-09-05T01:16:54.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.390+0000 7f033d214640 1 -- 172.21.15.145:0/1736419395 learned_addr learned my addr 172.21.15.145:0/1736419395 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-05T01:16:54.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.390+0000 7f033da15640 1 --2- 172.21.15.145:0/1736419395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0338101c00 0x7f0338197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:54.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.390+0000 7f033d214640 1 -- 172.21.15.145:0/1736419395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0338101c00 msgr2=0x7f0338197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:54.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.390+0000 7f033e216640 1 --2- 172.21.15.145:0/1736419395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03381037c0 0x7f033819f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:54.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.390+0000 7f033d214640 1 --2- 172.21.15.145:0/1736419395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0338101c00 0x7f0338197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:54.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.391+0000 7f033d214640 1 -- 172.21.15.145:0/1736419395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03381037c0 msgr2=0x7f033819f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:16:54.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.391+0000 7f033d214640 1 --2- 172.21.15.145:0/1736419395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03381037c0 0x7f033819f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:16:54.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.391+0000 7f033d214640 1 -- 172.21.15.145:0/1736419395 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033819fb60 con 0x7f0338102e00 2024-09-05T01:16:54.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.391+0000 7f033e216640 1 --2- 172.21.15.145:0/1736419395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03381037c0 0x7f033819f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:16:54.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.391+0000 7f033d214640 1 --2- 172.21.15.145:0/1736419395 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0338102e00 0x7f0338198470 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0328009230 tx=0x7f0328004430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:16:54.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.391+0000 7f032effd640 1 -- 172.21.15.145:0/1736419395 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032803f030 con 0x7f0338102e00 2024-09-05T01:16:54.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.391+0000 7f033fc79640 1 -- 172.21.15.145:0/1736419395 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f033819fdf0 con 0x7f0338102e00 2024-09-05T01:16:54.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.391+0000 7f032effd640 1 -- 172.21.15.145:0/1736419395 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0328003ce0 con 0x7f0338102e00 2024-09-05T01:16:54.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.391+0000 7f032effd640 1 -- 172.21.15.145:0/1736419395 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0328035070 con 0x7f0338102e00 2024-09-05T01:16:54.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.391+0000 7f033fc79640 1 -- 172.21.15.145:0/1736419395 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03381a02f0 con 0x7f0338102e00 2024-09-05T01:16:54.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.392+0000 7f033fc79640 1 -- 172.21.15.145:0/1736419395 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0338108fa0 con 0x7f0338102e00 2024-09-05T01:16:54.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.393+0000 7f032effd640 1 -- 172.21.15.145:0/1736419395 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f0328042030 con 0x7f0338102e00 2024-09-05T01:16:54.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.393+0000 7f032effd640 1 --2- 172.21.15.145:0/1736419395 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f03240a2b20 0x7f03240a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:16:54.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.394+0000 7f032effd640 1 -- 172.21.15.145:0/1736419395 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f03280ed840 con 0x7f0338102e00 2024-09-05T01:16:54.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.394+0000 7f033da15640 1 --2- 172.21.15.145:0/1736419395 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f03240a2b20 0x7f03240a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:16:54.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.394+0000 7f033da15640 1 --2- 172.21.15.145:0/1736419395 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f03240a2b20 0x7f03240a4fe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0338102c60 tx=0x7f033400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:16:54.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.398+0000 7f032effd640 1 -- 172.21.15.145:0/1736419395 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f03280bc330 con 0x7f0338102e00 2024-09-05T01:16:54.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:16:54.572+0000 7f033fc79640 1 -- 172.21.15.145:0/1736419395 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f0338062630 con 0x7f03240a2b20 2024-09-05T01:16:55.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:55 smithi012 ceph-mon[29942]: purged_snaps scrub starts 2024-09-05T01:16:55.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:55 smithi012 ceph-mon[29942]: purged_snaps scrub ok 2024-09-05T01:16:55.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:55 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T01:16:55.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:55 smithi012 ceph-mon[29942]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:55.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:55 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:16:55.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:55 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:16:55.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:55 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:55.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:55 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:55.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:55 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:55.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:55 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:16:55.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:55 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:55.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:55 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:55.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:55 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:16:55.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:55 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:55.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:55 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T01:16:55.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:55 smithi145 ceph-mon[34376]: purged_snaps scrub starts 2024-09-05T01:16:55.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:55 smithi145 ceph-mon[34376]: purged_snaps scrub ok 2024-09-05T01:16:55.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:55 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T01:16:55.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:55 smithi145 ceph-mon[34376]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:55.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:55 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:16:55.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:55 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:16:55.283 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:55 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:55.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:55 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:55.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:55 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:55.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:55 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:16:55.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:55 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:55.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:55 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:55.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:55 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:16:55.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:55 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:55.284 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:55 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T01:16:55.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:55 smithi151 ceph-mon[35013]: purged_snaps scrub starts 2024-09-05T01:16:55.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:55 smithi151 ceph-mon[35013]: purged_snaps scrub ok 2024-09-05T01:16:55.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:55 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T01:16:55.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:55 smithi151 ceph-mon[35013]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-05T01:16:55.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:55 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:16:55.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:55 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:16:55.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:55 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:55.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:55 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:55.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:55 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:55.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:55 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:16:55.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:55 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:55.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:55 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:16:55.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:55 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:16:55.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:55 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:16:55.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:55 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T01:16:56.306 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:56 smithi145 ceph-mon[34376]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:16:56.306 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:56 smithi145 ceph-mon[34376]: Detected new or changed devices on smithi012 2024-09-05T01:16:56.306 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:56 smithi145 ceph-mon[34376]: Adjusting osd_memory_target on smithi012 to 17094M 2024-09-05T01:16:56.306 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:56 smithi145 ceph-mon[34376]: osd.0 [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987] boot 2024-09-05T01:16:56.307 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:56 smithi145 ceph-mon[34376]: osdmap e8: 1 total, 1 up, 1 in 2024-09-05T01:16:56.307 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:56 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T01:16:56.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:56 smithi012 ceph-mon[29942]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:16:56.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:56 smithi012 ceph-mon[29942]: Detected new or changed devices on smithi012 2024-09-05T01:16:56.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:56 smithi012 ceph-mon[29942]: Adjusting osd_memory_target on smithi012 to 17094M 2024-09-05T01:16:56.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:56 smithi012 ceph-mon[29942]: osd.0 [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987] boot 2024-09-05T01:16:56.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:56 smithi012 ceph-mon[29942]: osdmap e8: 1 total, 1 up, 1 in 2024-09-05T01:16:56.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T01:16:56.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:56 smithi151 ceph-mon[35013]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:16:56.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:56 smithi151 ceph-mon[35013]: Detected new or changed devices on smithi012 2024-09-05T01:16:56.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:56 smithi151 ceph-mon[35013]: Adjusting osd_memory_target on smithi012 to 17094M 2024-09-05T01:16:56.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:56 smithi151 ceph-mon[35013]: osd.0 [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987] boot 2024-09-05T01:16:56.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:56 smithi151 ceph-mon[35013]: osdmap e8: 1 total, 1 up, 1 in 2024-09-05T01:16:56.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:56 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T01:16:57.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:57 smithi012 ceph-mon[29942]: osdmap e9: 1 total, 1 up, 1 in 2024-09-05T01:16:57.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:57 smithi012 ceph-mon[29942]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:16:57.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:57 smithi012 ceph-mon[29942]: from='client.? 172.21.15.145:0/2408642075' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "efca1216-8d85-4e6a-8c49-0afb511ece59"}]: dispatch 2024-09-05T01:16:57.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:57 smithi012 ceph-mon[29942]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "efca1216-8d85-4e6a-8c49-0afb511ece59"}]: dispatch 2024-09-05T01:16:57.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:57 smithi012 ceph-mon[29942]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "efca1216-8d85-4e6a-8c49-0afb511ece59"}]': finished 2024-09-05T01:16:57.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:57 smithi012 ceph-mon[29942]: osdmap e10: 2 total, 1 up, 2 in 2024-09-05T01:16:57.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:57 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T01:16:57.323 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:57 smithi145 ceph-mon[34376]: osdmap e9: 1 total, 1 up, 1 in 2024-09-05T01:16:57.323 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:57 smithi145 ceph-mon[34376]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:16:57.323 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:57 smithi145 ceph-mon[34376]: from='client.? 172.21.15.145:0/2408642075' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "efca1216-8d85-4e6a-8c49-0afb511ece59"}]: dispatch 2024-09-05T01:16:57.323 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:57 smithi145 ceph-mon[34376]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "efca1216-8d85-4e6a-8c49-0afb511ece59"}]: dispatch 2024-09-05T01:16:57.323 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:57 smithi145 ceph-mon[34376]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "efca1216-8d85-4e6a-8c49-0afb511ece59"}]': finished 2024-09-05T01:16:57.323 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:57 smithi145 ceph-mon[34376]: osdmap e10: 2 total, 1 up, 2 in 2024-09-05T01:16:57.323 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:57 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T01:16:57.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:57 smithi151 ceph-mon[35013]: osdmap e9: 1 total, 1 up, 1 in 2024-09-05T01:16:57.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:57 smithi151 ceph-mon[35013]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:16:57.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:57 smithi151 ceph-mon[35013]: from='client.? 172.21.15.145:0/2408642075' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "efca1216-8d85-4e6a-8c49-0afb511ece59"}]: dispatch 2024-09-05T01:16:57.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:57 smithi151 ceph-mon[35013]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "efca1216-8d85-4e6a-8c49-0afb511ece59"}]: dispatch 2024-09-05T01:16:57.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:57 smithi151 ceph-mon[35013]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "efca1216-8d85-4e6a-8c49-0afb511ece59"}]': finished 2024-09-05T01:16:57.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:57 smithi151 ceph-mon[35013]: osdmap e10: 2 total, 1 up, 2 in 2024-09-05T01:16:57.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:57 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T01:16:58.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:58 smithi012 ceph-mon[29942]: from='client.? 172.21.15.145:0/47637973' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:16:58.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:58 smithi145 ceph-mon[34376]: from='client.? 172.21.15.145:0/47637973' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:16:58.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:58 smithi151 ceph-mon[35013]: from='client.? 172.21.15.145:0/47637973' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:16:59.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:16:59 smithi012 ceph-mon[29942]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:16:59.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:16:59 smithi145 ceph-mon[34376]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:16:59.353 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:16:59 smithi151 ceph-mon[35013]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:00.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:00 smithi012 ceph-mon[29942]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:00.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:00 smithi145 ceph-mon[34376]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:00.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:00 smithi151 ceph-mon[35013]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:02.470 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:02 smithi145 ceph-mon[34376]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:02.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:02 smithi012 ceph-mon[29942]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:02.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:02 smithi151 ceph-mon[35013]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:04.387 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:04 smithi145 ceph-mon[34376]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:04.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:04 smithi012 ceph-mon[29942]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:04.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:04 smithi151 ceph-mon[35013]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:05.775 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:05 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-05T01:17:05.775 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:05 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:05.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-05T01:17:05.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:05.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-05T01:17:05.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:06.777 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:06 smithi145 ceph-mon[34376]: Deploying daemon osd.1 on smithi145 2024-09-05T01:17:06.777 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:06 smithi145 ceph-mon[34376]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:06.811 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:06 smithi012 ceph-mon[29942]: Deploying daemon osd.1 on smithi145 2024-09-05T01:17:06.811 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:06 smithi012 ceph-mon[29942]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:06.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:06 smithi151 ceph-mon[35013]: Deploying daemon osd.1 on smithi145 2024-09-05T01:17:06.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:06 smithi151 ceph-mon[35013]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:08.520 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:08 smithi145 ceph-mon[34376]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:08.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:08 smithi012 ceph-mon[29942]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:08.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:08 smithi151 ceph-mon[35013]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:10.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:10 smithi145 ceph-mon[34376]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:10.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:10 smithi012 ceph-mon[29942]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:10.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:10 smithi151 ceph-mon[35013]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:11.310 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:11 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:17:11.310 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:11 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:11.310 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:11 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:11.311 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:11 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:17:11.311 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:11 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:11.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:11 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:11.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:11 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:17:11.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:11 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:11.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:11 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:12.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:12 smithi012 ceph-mon[29942]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:12.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:12 smithi145 ceph-mon[34376]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:12.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:12 smithi151 ceph-mon[35013]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:14.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:17:14.314+0000 7f032effd640 1 -- 172.21.15.145:0/1736419395 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0338062630 con 0x7f03240a2b20 2024-09-05T01:17:14.315 INFO:teuthology.orchestra.run.smithi145.stdout:Created osd(s) 1 on host 'smithi145' 2024-09-05T01:17:14.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:17:14.316+0000 7f033fc79640 1 -- 172.21.15.145:0/1736419395 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f03240a2b20 msgr2=0x7f03240a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:17:14.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:17:14.316+0000 7f033fc79640 1 --2- 172.21.15.145:0/1736419395 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f03240a2b20 0x7f03240a4fe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0338102c60 tx=0x7f033400a2d0 comp rx=0 tx=0).stop 2024-09-05T01:17:14.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:17:14.316+0000 7f033fc79640 1 -- 172.21.15.145:0/1736419395 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0338102e00 msgr2=0x7f0338198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:17:14.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:17:14.316+0000 7f033fc79640 1 --2- 172.21.15.145:0/1736419395 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0338102e00 0x7f0338198470 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0328009230 tx=0x7f0328004430 comp rx=0 tx=0).stop 2024-09-05T01:17:14.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:17:14.316+0000 7f033fc79640 1 -- 172.21.15.145:0/1736419395 shutdown_connections 2024-09-05T01:17:14.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:17:14.316+0000 7f033fc79640 1 --2- 172.21.15.145:0/1736419395 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f03240a2b20 0x7f03240a4fe0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:17:14.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:17:14.316+0000 7f033fc79640 1 --2- 172.21.15.145:0/1736419395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03381037c0 0x7f033819f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:17:14.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:17:14.316+0000 7f033fc79640 1 --2- 172.21.15.145:0/1736419395 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0338102e00 0x7f0338198470 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:17:14.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:17:14.316+0000 7f033fc79640 1 --2- 172.21.15.145:0/1736419395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0338101c00 0x7f0338197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:17:14.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:17:14.317+0000 7f033fc79640 1 -- 172.21.15.145:0/1736419395 >> 172.21.15.145:0/1736419395 conn(0x7f03380fd390 msgr2=0x7f0338106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:17:14.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:17:14.317+0000 7f033fc79640 1 -- 172.21.15.145:0/1736419395 shutdown_connections 2024-09-05T01:17:14.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:17:14.317+0000 7f033fc79640 1 -- 172.21.15.145:0/1736419395 wait complete. 2024-09-05T01:17:14.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:14 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:14.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:14 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:14.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:14 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:14.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:14 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:17:14.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:14 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:14.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:14 smithi145 ceph-mon[34376]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:14.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:14 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:17:14.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:14 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:14.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:14 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:14.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:14.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:14.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:14.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:17:14.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:14.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:14 smithi151 ceph-mon[35013]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:14.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:17:14.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:14.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:14.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:14.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:14.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:14.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:17:14.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:14.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:14 smithi012 ceph-mon[29942]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:14.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:17:14.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:14.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:14.929 DEBUG:teuthology.orchestra.run.smithi145:osd.1> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.1.service 2024-09-05T01:17:14.932 INFO:tasks.cephadm:Deploying osd.2 on smithi151 with /dev/vg_nvme/lv_4... 2024-09-05T01:17:14.932 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-05T01:17:15.182 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T01:17:16.383 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:16 smithi145 ceph-mon[34376]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:16.464 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:16 smithi151 ceph-mon[35013]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:16.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:16 smithi012 ceph-mon[29942]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:17.148 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:17:16 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-1[38825]: 2024-09-05T01:17:16.893+0000 7f8dfcba7640 -1 osd.1 0 log_to_monitors true 2024-09-05T01:17:17.448 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:17 smithi145 ceph-mon[34376]: from='osd.1 [v2:172.21.15.145:6800/2639126629,v1:172.21.15.145:6801/2639126629]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-05T01:17:17.448 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:17 smithi145 ceph-mon[34376]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-05T01:17:17.506 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:17 smithi151 ceph-mon[35013]: from='osd.1 [v2:172.21.15.145:6800/2639126629,v1:172.21.15.145:6801/2639126629]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-05T01:17:17.506 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:17 smithi151 ceph-mon[35013]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-05T01:17:17.508 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-05T01:17:17.534 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi151:vg_nvme/lv_4 2024-09-05T01:17:17.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:17 smithi012 ceph-mon[29942]: from='osd.1 [v2:172.21.15.145:6800/2639126629,v1:172.21.15.145:6801/2639126629]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-05T01:17:17.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:17 smithi012 ceph-mon[29942]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-05T01:17:17.786 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T01:17:18.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.223+0000 7fd7d81df640 1 -- 172.21.15.151:0/3838511563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7d0101cd0 msgr2=0x7fd7d0102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:17:18.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.223+0000 7fd7d81df640 1 --2- 172.21.15.151:0/3838511563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7d0101cd0 0x7fd7d0102150 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009900 tx=0x7fd7c002a410 comp rx=0 tx=0).stop 2024-09-05T01:17:18.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.223+0000 7fd7d81df640 1 -- 172.21.15.151:0/3838511563 shutdown_connections 2024-09-05T01:17:18.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.223+0000 7fd7d81df640 1 --2- 172.21.15.151:0/3838511563 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7d0102690 0x7fd7d0108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:17:18.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.223+0000 7fd7d81df640 1 --2- 172.21.15.151:0/3838511563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7d0101cd0 0x7fd7d0102150 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:17:18.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.223+0000 7fd7d81df640 1 --2- 172.21.15.151:0/3838511563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7d0100ad0 0x7fd7d0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:17:18.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.223+0000 7fd7d81df640 1 -- 172.21.15.151:0/3838511563 >> 172.21.15.151:0/3838511563 conn(0x7fd7d00fc280 msgr2=0x7fd7d00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:17:18.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.223+0000 7fd7d81df640 1 -- 172.21.15.151:0/3838511563 shutdown_connections 2024-09-05T01:17:18.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.223+0000 7fd7d81df640 1 -- 172.21.15.151:0/3838511563 wait complete. 2024-09-05T01:17:18.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.224+0000 7fd7d81df640 1 Processor -- start 2024-09-05T01:17:18.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.224+0000 7fd7d81df640 1 -- start start 2024-09-05T01:17:18.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.224+0000 7fd7d81df640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7d0100ad0 0x7fd7d006aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:17:18.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.224+0000 7fd7d81df640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7d0101cd0 0x7fd7d019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:17:18.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.224+0000 7fd7d81df640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7d0102690 0x7fd7d019f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:17:18.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.224+0000 7fd7d81df640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d010c780 con 0x7fd7d0100ad0 2024-09-05T01:17:18.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.224+0000 7fd7d81df640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d010c600 con 0x7fd7d0101cd0 2024-09-05T01:17:18.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.224+0000 7fd7d81df640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d010c900 con 0x7fd7d0102690 2024-09-05T01:17:18.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.224+0000 7fd7d677c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7d0102690 0x7fd7d019f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:17:18.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.224+0000 7fd7d677c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7d0102690 0x7fd7d019f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47698/0 (socket says 172.21.15.151:47698) 2024-09-05T01:17:18.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.224+0000 7fd7d677c640 1 -- 172.21.15.151:0/473070106 learned_addr learned my addr 172.21.15.151:0/473070106 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-05T01:17:18.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.224+0000 7fd7d577a640 1 --2- 172.21.15.151:0/473070106 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7d0101cd0 0x7fd7d019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:17:18.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.224+0000 7fd7d5f7b640 1 --2- 172.21.15.151:0/473070106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7d0100ad0 0x7fd7d006aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:17:18.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.224+0000 7fd7d677c640 1 -- 172.21.15.151:0/473070106 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7d0101cd0 msgr2=0x7fd7d019cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:17:18.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.224+0000 7fd7d677c640 1 --2- 172.21.15.151:0/473070106 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7d0101cd0 0x7fd7d019cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:17:18.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.224+0000 7fd7d677c640 1 -- 172.21.15.151:0/473070106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7d0100ad0 msgr2=0x7fd7d006aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:17:18.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.224+0000 7fd7d677c640 1 --2- 172.21.15.151:0/473070106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7d0100ad0 0x7fd7d006aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:17:18.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.224+0000 7fd7d677c640 1 -- 172.21.15.151:0/473070106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d019fb00 con 0x7fd7d0102690 2024-09-05T01:17:18.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.224+0000 7fd7d5f7b640 1 --2- 172.21.15.151:0/473070106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7d0100ad0 0x7fd7d006aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:17:18.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.225+0000 7fd7d677c640 1 --2- 172.21.15.151:0/473070106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7d0102690 0x7fd7d019f1f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009fd0 tx=0x7fd7c800b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:17:18.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.225+0000 7fd7c6ffd640 1 -- 172.21.15.151:0/473070106 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8017070 con 0x7fd7d0102690 2024-09-05T01:17:18.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.225+0000 7fd7d81df640 1 -- 172.21.15.151:0/473070106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d019fd90 con 0x7fd7d0102690 2024-09-05T01:17:18.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.225+0000 7fd7c6ffd640 1 -- 172.21.15.151:0/473070106 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7c8003e50 con 0x7fd7d0102690 2024-09-05T01:17:18.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.225+0000 7fd7c6ffd640 1 -- 172.21.15.151:0/473070106 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c80106c0 con 0x7fd7d0102690 2024-09-05T01:17:18.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.225+0000 7fd7d81df640 1 -- 172.21.15.151:0/473070106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d01a0250 con 0x7fd7d0102690 2024-09-05T01:17:18.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.226+0000 7fd7d81df640 1 -- 172.21.15.151:0/473070106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7d0100ed0 con 0x7fd7d0102690 2024-09-05T01:17:18.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.227+0000 7fd7c6ffd640 1 -- 172.21.15.151:0/473070106 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7fd7c8003970 con 0x7fd7d0102690 2024-09-05T01:17:18.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.228+0000 7fd7c6ffd640 1 --2- 172.21.15.151:0/473070106 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd7bc0a2af0 0x7fd7bc0a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:17:18.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.228+0000 7fd7c6ffd640 1 -- 172.21.15.151:0/473070106 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7fd7c80cd430 con 0x7fd7d0102690 2024-09-05T01:17:18.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.228+0000 7fd7d5f7b640 1 --2- 172.21.15.151:0/473070106 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd7bc0a2af0 0x7fd7bc0a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:17:18.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.229+0000 7fd7d5f7b640 1 --2- 172.21.15.151:0/473070106 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd7bc0a2af0 0x7fd7bc0a4fb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0101b30 tx=0x7fd7cc00a5e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:17:18.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.231+0000 7fd7c6ffd640 1 -- 172.21.15.151:0/473070106 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd7c809bd00 con 0x7fd7d0102690 2024-09-05T01:17:18.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:18.413+0000 7fd7d81df640 1 -- 172.21.15.151:0/473070106 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fd7d0062630 con 0x7fd7bc0a2af0 2024-09-05T01:17:18.414 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:18 smithi151 ceph-mon[35013]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-05T01:17:18.414 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:18 smithi151 ceph-mon[35013]: osdmap e11: 2 total, 1 up, 2 in 2024-09-05T01:17:18.414 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:18 smithi151 ceph-mon[35013]: from='osd.1 [v2:172.21.15.145:6800/2639126629,v1:172.21.15.145:6801/2639126629]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-05T01:17:18.414 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T01:17:18.414 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:18 smithi151 ceph-mon[35013]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-05T01:17:18.415 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:18 smithi151 ceph-mon[35013]: Detected new or changed devices on smithi145 2024-09-05T01:17:18.415 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:18.415 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:18.415 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:17:18.415 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:18 smithi151 ceph-mon[35013]: Adjusting osd_memory_target on smithi145 to 17088M 2024-09-05T01:17:18.415 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:18.415 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:18.415 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:17:18.415 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:18.415 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:18 smithi151 ceph-mon[35013]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:18.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:18 smithi012 ceph-mon[29942]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-05T01:17:18.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:18 smithi012 ceph-mon[29942]: osdmap e11: 2 total, 1 up, 2 in 2024-09-05T01:17:18.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:18 smithi012 ceph-mon[29942]: from='osd.1 [v2:172.21.15.145:6800/2639126629,v1:172.21.15.145:6801/2639126629]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-05T01:17:18.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T01:17:18.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:18 smithi012 ceph-mon[29942]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-05T01:17:18.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:18 smithi012 ceph-mon[29942]: Detected new or changed devices on smithi145 2024-09-05T01:17:18.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:18.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:18.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:17:18.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:18 smithi012 ceph-mon[29942]: Adjusting osd_memory_target on smithi145 to 17088M 2024-09-05T01:17:18.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:18.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:18.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:17:18.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:18.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:18 smithi012 ceph-mon[29942]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:18.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:18 smithi145 ceph-mon[34376]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-05T01:17:18.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:18 smithi145 ceph-mon[34376]: osdmap e11: 2 total, 1 up, 2 in 2024-09-05T01:17:18.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:18 smithi145 ceph-mon[34376]: from='osd.1 [v2:172.21.15.145:6800/2639126629,v1:172.21.15.145:6801/2639126629]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-05T01:17:18.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T01:17:18.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:18 smithi145 ceph-mon[34376]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-05T01:17:18.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:18 smithi145 ceph-mon[34376]: Detected new or changed devices on smithi145 2024-09-05T01:17:18.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:18.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:18.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:17:18.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:18 smithi145 ceph-mon[34376]: Adjusting osd_memory_target on smithi145 to 17088M 2024-09-05T01:17:18.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:18.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:18.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:17:18.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:18.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:18 smithi145 ceph-mon[34376]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:19.333 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:17:18 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-1[38825]: 2024-09-05T01:17:18.987+0000 7f8df8307640 -1 osd.1 0 waiting for initial osdmap 2024-09-05T01:17:19.333 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:17:18 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-1[38825]: 2024-09-05T01:17:18.996+0000 7f8df0939640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T01:17:19.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:19 smithi145 ceph-mon[34376]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-05T01:17:19.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:19 smithi145 ceph-mon[34376]: osdmap e12: 2 total, 1 up, 2 in 2024-09-05T01:17:19.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:19 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T01:17:19.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:19 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T01:17:19.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:19 smithi145 ceph-mon[34376]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:17:19.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:19 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:17:19.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:19 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:17:19.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:19 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:19.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:19 smithi145 ceph-mon[34376]: from='osd.1 ' entity='osd.1' 2024-09-05T01:17:19.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:19 smithi151 ceph-mon[35013]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-05T01:17:19.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:19 smithi151 ceph-mon[35013]: osdmap e12: 2 total, 1 up, 2 in 2024-09-05T01:17:19.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:19 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T01:17:19.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:19 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T01:17:19.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:19 smithi151 ceph-mon[35013]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:17:19.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:19 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:17:19.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:19 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:17:19.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:19 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:19.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:19 smithi151 ceph-mon[35013]: from='osd.1 ' entity='osd.1' 2024-09-05T01:17:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:19 smithi012 ceph-mon[29942]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-05T01:17:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:19 smithi012 ceph-mon[29942]: osdmap e12: 2 total, 1 up, 2 in 2024-09-05T01:17:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:19 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T01:17:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:19 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T01:17:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:19 smithi012 ceph-mon[29942]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:17:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:19 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:17:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:19 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:17:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:19 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:19 smithi012 ceph-mon[29942]: from='osd.1 ' entity='osd.1' 2024-09-05T01:17:20.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:20 smithi151 ceph-mon[35013]: purged_snaps scrub starts 2024-09-05T01:17:20.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:20 smithi151 ceph-mon[35013]: purged_snaps scrub ok 2024-09-05T01:17:20.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:20 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T01:17:20.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:20 smithi151 ceph-mon[35013]: osd.1 [v2:172.21.15.145:6800/2639126629,v1:172.21.15.145:6801/2639126629] boot 2024-09-05T01:17:20.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:20 smithi151 ceph-mon[35013]: osdmap e13: 2 total, 2 up, 2 in 2024-09-05T01:17:20.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:20 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T01:17:20.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:20 smithi151 ceph-mon[35013]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:20.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:20 smithi012 ceph-mon[29942]: purged_snaps scrub starts 2024-09-05T01:17:20.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:20 smithi012 ceph-mon[29942]: purged_snaps scrub ok 2024-09-05T01:17:20.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:20 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T01:17:20.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:20 smithi012 ceph-mon[29942]: osd.1 [v2:172.21.15.145:6800/2639126629,v1:172.21.15.145:6801/2639126629] boot 2024-09-05T01:17:20.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:20 smithi012 ceph-mon[29942]: osdmap e13: 2 total, 2 up, 2 in 2024-09-05T01:17:20.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:20 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T01:17:20.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:20 smithi012 ceph-mon[29942]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:20.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:20 smithi145 ceph-mon[34376]: purged_snaps scrub starts 2024-09-05T01:17:20.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:20 smithi145 ceph-mon[34376]: purged_snaps scrub ok 2024-09-05T01:17:20.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:20 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T01:17:20.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:20 smithi145 ceph-mon[34376]: osd.1 [v2:172.21.15.145:6800/2639126629,v1:172.21.15.145:6801/2639126629] boot 2024-09-05T01:17:20.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:20 smithi145 ceph-mon[34376]: osdmap e13: 2 total, 2 up, 2 in 2024-09-05T01:17:20.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:20 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T01:17:20.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:20 smithi145 ceph-mon[34376]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-05T01:17:21.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:21 smithi012 ceph-mon[29942]: from='client.? 172.21.15.151:0/1753502050' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d5699b2-646a-4ab6-94a5-ad223aa27ac2"}]: dispatch 2024-09-05T01:17:21.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:21 smithi012 ceph-mon[29942]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d5699b2-646a-4ab6-94a5-ad223aa27ac2"}]: dispatch 2024-09-05T01:17:21.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:21 smithi012 ceph-mon[29942]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d5699b2-646a-4ab6-94a5-ad223aa27ac2"}]': finished 2024-09-05T01:17:21.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:21 smithi012 ceph-mon[29942]: osdmap e14: 3 total, 2 up, 3 in 2024-09-05T01:17:21.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:21 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T01:17:21.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:21 smithi145 ceph-mon[34376]: from='client.? 172.21.15.151:0/1753502050' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d5699b2-646a-4ab6-94a5-ad223aa27ac2"}]: dispatch 2024-09-05T01:17:21.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:21 smithi145 ceph-mon[34376]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d5699b2-646a-4ab6-94a5-ad223aa27ac2"}]: dispatch 2024-09-05T01:17:21.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:21 smithi145 ceph-mon[34376]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d5699b2-646a-4ab6-94a5-ad223aa27ac2"}]': finished 2024-09-05T01:17:21.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:21 smithi145 ceph-mon[34376]: osdmap e14: 3 total, 2 up, 3 in 2024-09-05T01:17:21.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:21 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T01:17:21.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:21 smithi151 ceph-mon[35013]: from='client.? 172.21.15.151:0/1753502050' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d5699b2-646a-4ab6-94a5-ad223aa27ac2"}]: dispatch 2024-09-05T01:17:21.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:21 smithi151 ceph-mon[35013]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4d5699b2-646a-4ab6-94a5-ad223aa27ac2"}]: dispatch 2024-09-05T01:17:21.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:21 smithi151 ceph-mon[35013]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4d5699b2-646a-4ab6-94a5-ad223aa27ac2"}]': finished 2024-09-05T01:17:21.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:21 smithi151 ceph-mon[35013]: osdmap e14: 3 total, 2 up, 3 in 2024-09-05T01:17:21.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:21 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T01:17:22.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:22 smithi012 ceph-mon[29942]: from='client.? 172.21.15.151:0/1416458229' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:17:22.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:22 smithi012 ceph-mon[29942]: osdmap e15: 3 total, 2 up, 3 in 2024-09-05T01:17:22.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T01:17:22.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:22 smithi012 ceph-mon[29942]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:22.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:22 smithi145 ceph-mon[34376]: from='client.? 172.21.15.151:0/1416458229' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:17:22.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:22 smithi145 ceph-mon[34376]: osdmap e15: 3 total, 2 up, 3 in 2024-09-05T01:17:22.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:22 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T01:17:22.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:22 smithi145 ceph-mon[34376]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:22 smithi151 ceph-mon[35013]: from='client.? 172.21.15.151:0/1416458229' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:17:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:22 smithi151 ceph-mon[35013]: osdmap e15: 3 total, 2 up, 3 in 2024-09-05T01:17:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:22 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T01:17:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:22 smithi151 ceph-mon[35013]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:24.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:24 smithi012 ceph-mon[29942]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:24.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:24 smithi145 ceph-mon[34376]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:24.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:24 smithi151 ceph-mon[35013]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:26.440 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:26 smithi151 ceph-mon[35013]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:26.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:26 smithi012 ceph-mon[29942]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:26.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:26 smithi145 ceph-mon[34376]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:28.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:28 smithi151 ceph-mon[35013]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:28 smithi012 ceph-mon[29942]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:28.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:28 smithi145 ceph-mon[34376]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:29.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:29 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-05T01:17:29.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:29 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:29.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:29 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-05T01:17:29.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:29 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:29.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:29 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-05T01:17:29.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:29 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:30.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:30 smithi151 ceph-mon[35013]: Deploying daemon osd.2 on smithi151 2024-09-05T01:17:30.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:30 smithi151 ceph-mon[35013]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:30.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:30 smithi012 ceph-mon[29942]: Deploying daemon osd.2 on smithi151 2024-09-05T01:17:30.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:30 smithi012 ceph-mon[29942]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:30.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:30 smithi145 ceph-mon[34376]: Deploying daemon osd.2 on smithi151 2024-09-05T01:17:30.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:30 smithi145 ceph-mon[34376]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:32.499 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:32 smithi151 ceph-mon[35013]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:32.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:32 smithi012 ceph-mon[29942]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:32.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:32 smithi145 ceph-mon[34376]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:34.294 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:34 smithi151 ceph-mon[35013]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:34.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:34 smithi012 ceph-mon[29942]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:34.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:34 smithi145 ceph-mon[34376]: pgmap v71: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:35.433 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:35 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:17:35.433 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:35 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:35.433 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:35 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:35.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:35 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:17:35.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:35 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:35.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:35 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:35.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:35 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:17:35.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:35 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:35.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:35 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:36.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:36 smithi151 ceph-mon[35013]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:36.484 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:36 smithi145 ceph-mon[34376]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:36.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:36 smithi012 ceph-mon[29942]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:38.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:37 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:38.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:37 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:38.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:37 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:38.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:37 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:17:38.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:37 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:38.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:37 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:38.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:37 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:38.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:37 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:38.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:37 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:17:38.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:37 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:38.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:37 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:38.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:37 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:38.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:37 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:38.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:37 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:17:38.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:37 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:38.552 INFO:teuthology.orchestra.run.smithi151.stdout:Created osd(s) 2 on host 'smithi151' 2024-09-05T01:17:38.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:38.550+0000 7fd7c6ffd640 1 -- 172.21.15.151:0/473070106 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd7d0062630 con 0x7fd7bc0a2af0 2024-09-05T01:17:38.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:38.553+0000 7fd7d81df640 1 -- 172.21.15.151:0/473070106 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd7bc0a2af0 msgr2=0x7fd7bc0a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:17:38.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:38.553+0000 7fd7d81df640 1 --2- 172.21.15.151:0/473070106 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd7bc0a2af0 0x7fd7bc0a4fb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0101b30 tx=0x7fd7cc00a5e0 comp rx=0 tx=0).stop 2024-09-05T01:17:38.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:38.553+0000 7fd7d81df640 1 -- 172.21.15.151:0/473070106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7d0102690 msgr2=0x7fd7d019f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:17:38.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:38.553+0000 7fd7d81df640 1 --2- 172.21.15.151:0/473070106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7d0102690 0x7fd7d019f1f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009fd0 tx=0x7fd7c800b260 comp rx=0 tx=0).stop 2024-09-05T01:17:38.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:38.553+0000 7fd7d81df640 1 -- 172.21.15.151:0/473070106 shutdown_connections 2024-09-05T01:17:38.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:38.553+0000 7fd7d81df640 1 --2- 172.21.15.151:0/473070106 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd7bc0a2af0 0x7fd7bc0a4fb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:17:38.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:38.553+0000 7fd7d81df640 1 --2- 172.21.15.151:0/473070106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7d0102690 0x7fd7d019f1f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:17:38.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:38.553+0000 7fd7d81df640 1 --2- 172.21.15.151:0/473070106 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd7d0101cd0 0x7fd7d019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:17:38.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:38.553+0000 7fd7d81df640 1 --2- 172.21.15.151:0/473070106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7d0100ad0 0x7fd7d006aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:17:38.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:38.553+0000 7fd7d81df640 1 -- 172.21.15.151:0/473070106 >> 172.21.15.151:0/473070106 conn(0x7fd7d00fc280 msgr2=0x7fd7d0105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:17:38.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:38.553+0000 7fd7d81df640 1 -- 172.21.15.151:0/473070106 shutdown_connections 2024-09-05T01:17:38.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:17:38.553+0000 7fd7d81df640 1 -- 172.21.15.151:0/473070106 wait complete. 2024-09-05T01:17:39.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:38 smithi012 ceph-mon[29942]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:39.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:38 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:17:39.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:38 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:39.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:38 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:39.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:38 smithi145 ceph-mon[34376]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:39.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:38 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:17:39.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:38 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:39.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:38 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:39.103 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:38 smithi151 ceph-mon[35013]: pgmap v73: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:39.103 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:38 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:17:39.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:38 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:39.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:38 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:39.233 DEBUG:teuthology.orchestra.run.smithi151:osd.2> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.2.service 2024-09-05T01:17:39.236 INFO:tasks.cephadm:Deploying osd.3 on smithi012 with /dev/vg_nvme/lv_3... 2024-09-05T01:17:39.236 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-05T01:17:39.615 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:17:40.469 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:40 smithi012 ceph-mon[29942]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:40.524 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:40 smithi151 ceph-mon[35013]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:40.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:40 smithi145 ceph-mon[34376]: pgmap v74: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:40.854 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:17:40 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-2[39994]: 2024-09-05T01:17:40.749+0000 7fbd27992640 -1 osd.2 0 log_to_monitors true 2024-09-05T01:17:41.435 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:41 smithi012 ceph-mon[29942]: from='osd.2 [v2:172.21.15.151:6800/3753171761,v1:172.21.15.151:6801/3753171761]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-05T01:17:41.435 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:41 smithi012 ceph-mon[29942]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-05T01:17:41.526 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:41 smithi151 ceph-mon[35013]: from='osd.2 [v2:172.21.15.151:6800/3753171761,v1:172.21.15.151:6801/3753171761]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-05T01:17:41.526 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:41 smithi151 ceph-mon[35013]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-05T01:17:41.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:41 smithi145 ceph-mon[34376]: from='osd.2 [v2:172.21.15.151:6800/3753171761,v1:172.21.15.151:6801/3753171761]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-05T01:17:41.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:41 smithi145 ceph-mon[34376]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-05T01:17:42.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:42 smithi012 ceph-mon[29942]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-05T01:17:42.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:42 smithi012 ceph-mon[29942]: from='osd.2 [v2:172.21.15.151:6800/3753171761,v1:172.21.15.151:6801/3753171761]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-09-05T01:17:42.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:42 smithi012 ceph-mon[29942]: osdmap e16: 3 total, 2 up, 3 in 2024-09-05T01:17:42.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:42 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T01:17:42.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:42 smithi012 ceph-mon[29942]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-09-05T01:17:42.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:42 smithi012 ceph-mon[29942]: Detected new or changed devices on smithi151 2024-09-05T01:17:42.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:42 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:42.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:42 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:42.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:42 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:17:42.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:42 smithi012 ceph-mon[29942]: Adjusting osd_memory_target on smithi151 to 17088M 2024-09-05T01:17:42.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:42 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:42.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:42 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:42.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:42 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:17:42.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:42 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:42.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:42 smithi012 ceph-mon[29942]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:42.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:42 smithi012 ceph-mon[29942]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-09-05T01:17:42.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:42 smithi145 ceph-mon[34376]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-05T01:17:42.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:42 smithi145 ceph-mon[34376]: from='osd.2 [v2:172.21.15.151:6800/3753171761,v1:172.21.15.151:6801/3753171761]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-09-05T01:17:42.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:42 smithi145 ceph-mon[34376]: osdmap e16: 3 total, 2 up, 3 in 2024-09-05T01:17:42.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:42 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T01:17:42.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:42 smithi145 ceph-mon[34376]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-09-05T01:17:42.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:42 smithi145 ceph-mon[34376]: Detected new or changed devices on smithi151 2024-09-05T01:17:42.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:42 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:42.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:42 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:42.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:42 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:17:42.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:42 smithi145 ceph-mon[34376]: Adjusting osd_memory_target on smithi151 to 17088M 2024-09-05T01:17:42.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:42 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:42.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:42 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:42.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:42 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:17:42.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:42 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:42.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:42 smithi145 ceph-mon[34376]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:42.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:42 smithi145 ceph-mon[34376]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-09-05T01:17:42.604 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:17:42 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-2[39994]: 2024-09-05T01:17:42.217+0000 7fbd230f2640 -1 osd.2 0 waiting for initial osdmap 2024-09-05T01:17:42.604 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:17:42 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-2[39994]: 2024-09-05T01:17:42.221+0000 7fbd1f72c640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T01:17:42.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:42 smithi151 ceph-mon[35013]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-05T01:17:42.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:42 smithi151 ceph-mon[35013]: from='osd.2 [v2:172.21.15.151:6800/3753171761,v1:172.21.15.151:6801/3753171761]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-09-05T01:17:42.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:42 smithi151 ceph-mon[35013]: osdmap e16: 3 total, 2 up, 3 in 2024-09-05T01:17:42.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:42 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T01:17:42.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:42 smithi151 ceph-mon[35013]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-09-05T01:17:42.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:42 smithi151 ceph-mon[35013]: Detected new or changed devices on smithi151 2024-09-05T01:17:42.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:42 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:42.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:42 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:42.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:42 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:17:42.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:42 smithi151 ceph-mon[35013]: Adjusting osd_memory_target on smithi151 to 17088M 2024-09-05T01:17:42.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:42 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:42.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:42 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:42.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:42 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:17:42.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:42 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:42.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:42 smithi151 ceph-mon[35013]: pgmap v76: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:42.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:42 smithi151 ceph-mon[35013]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-09-05T01:17:42.762 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:17:42.795 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi012:vg_nvme/lv_3 2024-09-05T01:17:43.181 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:17:43.486 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:43 smithi012 ceph-mon[29942]: osdmap e17: 3 total, 2 up, 3 in 2024-09-05T01:17:43.487 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:43 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T01:17:43.487 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:43 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T01:17:43.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:43 smithi145 ceph-mon[34376]: osdmap e17: 3 total, 2 up, 3 in 2024-09-05T01:17:43.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:43 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T01:17:43.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:43 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T01:17:43.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:43 smithi151 ceph-mon[35013]: osdmap e17: 3 total, 2 up, 3 in 2024-09-05T01:17:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:43 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T01:17:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:43 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T01:17:43.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.694+0000 7f65de000640 1 -- 172.21.15.12:0/3977032284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65d8104e50 msgr2=0x7f65d81052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:17:43.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.694+0000 7f65de000640 1 --2- 172.21.15.12:0/3977032284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65d8104e50 0x7f65d81052d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f65c4009900 tx=0x7f65c402a3f0 comp rx=0 tx=0).stop 2024-09-05T01:17:43.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.694+0000 7f65de000640 1 -- 172.21.15.12:0/3977032284 shutdown_connections 2024-09-05T01:17:43.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.694+0000 7f65de000640 1 --2- 172.21.15.12:0/3977032284 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65d8105810 0x7f65d810c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:17:43.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.694+0000 7f65de000640 1 --2- 172.21.15.12:0/3977032284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65d8104e50 0x7f65d81052d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:17:43.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.694+0000 7f65de000640 1 --2- 172.21.15.12:0/3977032284 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65d8103c50 0x7f65d8104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:17:43.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.694+0000 7f65de000640 1 -- 172.21.15.12:0/3977032284 >> 172.21.15.12:0/3977032284 conn(0x7f65d80ff3e0 msgr2=0x7f65d8101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:17:43.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.694+0000 7f65de000640 1 -- 172.21.15.12:0/3977032284 shutdown_connections 2024-09-05T01:17:43.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.694+0000 7f65de000640 1 -- 172.21.15.12:0/3977032284 wait complete. 2024-09-05T01:17:43.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.695+0000 7f65de000640 1 Processor -- start 2024-09-05T01:17:43.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.695+0000 7f65de000640 1 -- start start 2024-09-05T01:17:43.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.695+0000 7f65de000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65d8103c50 0x7f65d8199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:17:43.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.696+0000 7f65de000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65d8104e50 0x7f65d819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:17:43.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.696+0000 7f65de000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65d8105810 0x7f65d81a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:17:43.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.696+0000 7f65de000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f65d810f8b0 con 0x7f65d8103c50 2024-09-05T01:17:43.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.696+0000 7f65de000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f65d810f730 con 0x7f65d8104e50 2024-09-05T01:17:43.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.696+0000 7f65de000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f65d810fa30 con 0x7f65d8105810 2024-09-05T01:17:43.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.696+0000 7f65dcc00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65d8103c50 0x7f65d8199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:17:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.696+0000 7f65dcc00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65d8103c50 0x7f65d8199f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43798/0 (socket says 172.21.15.12:43798) 2024-09-05T01:17:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.696+0000 7f65dcc00640 1 -- 172.21.15.12:0/2190885042 learned_addr learned my addr 172.21.15.12:0/2190885042 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:17:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.696+0000 7f65d7e00640 1 --2- 172.21.15.12:0/2190885042 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65d8104e50 0x7f65d819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:17:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.696+0000 7f65dd600640 1 --2- 172.21.15.12:0/2190885042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65d8105810 0x7f65d81a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:17:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.696+0000 7f65dcc00640 1 -- 172.21.15.12:0/2190885042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65d8105810 msgr2=0x7f65d81a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:17:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.696+0000 7f65dcc00640 1 --2- 172.21.15.12:0/2190885042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65d8105810 0x7f65d81a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:17:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.696+0000 7f65dcc00640 1 -- 172.21.15.12:0/2190885042 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65d8104e50 msgr2=0x7f65d819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:17:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.696+0000 7f65dcc00640 1 --2- 172.21.15.12:0/2190885042 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65d8104e50 0x7f65d819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:17:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.696+0000 7f65dcc00640 1 -- 172.21.15.12:0/2190885042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d81a1b70 con 0x7f65d8103c50 2024-09-05T01:17:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.696+0000 7f65dd600640 1 --2- 172.21.15.12:0/2190885042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65d8105810 0x7f65d81a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:17:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.696+0000 7f65dcc00640 1 --2- 172.21.15.12:0/2190885042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65d8103c50 0x7f65d8199f40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f65cc00e9c0 tx=0x7f65cc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:17:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.697+0000 7f65d5600640 1 -- 172.21.15.12:0/2190885042 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc00cd80 con 0x7f65d8103c50 2024-09-05T01:17:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.697+0000 7f65d5600640 1 -- 172.21.15.12:0/2190885042 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65cc0035f0 con 0x7f65d8103c50 2024-09-05T01:17:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.697+0000 7f65de000640 1 -- 172.21.15.12:0/2190885042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d81a1e60 con 0x7f65d8103c50 2024-09-05T01:17:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.697+0000 7f65d5600640 1 -- 172.21.15.12:0/2190885042 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc010690 con 0x7f65d8103c50 2024-09-05T01:17:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.697+0000 7f65de000640 1 -- 172.21.15.12:0/2190885042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d81a22b0 con 0x7f65d8103c50 2024-09-05T01:17:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.698+0000 7f65de000640 1 -- 172.21.15.12:0/2190885042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65d810b0a0 con 0x7f65d8103c50 2024-09-05T01:17:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.700+0000 7f65d5600640 1 -- 172.21.15.12:0/2190885042 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f65cc0037a0 con 0x7f65d8103c50 2024-09-05T01:17:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.701+0000 7f65d5600640 1 --2- 172.21.15.12:0/2190885042 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f65c00a2b20 0x7f65c00a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:17:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.701+0000 7f65d5600640 1 -- 172.21.15.12:0/2190885042 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2851+0+0 (secure 0 0 0) 0x7f65cc0cdea0 con 0x7f65d8103c50 2024-09-05T01:17:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.701+0000 7f65d7e00640 1 --2- 172.21.15.12:0/2190885042 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f65c00a2b20 0x7f65c00a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:17:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.702+0000 7f65d7e00640 1 --2- 172.21.15.12:0/2190885042 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f65c00a2b20 0x7f65c00a4fe0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f65c40314e0 tx=0x7f65c4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:17:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.705+0000 7f65d5600640 1 -- 172.21.15.12:0/2190885042 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f65cc09c390 con 0x7f65d8103c50 2024-09-05T01:17:43.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:43.900+0000 7f65de000640 1 -- 172.21.15.12:0/2190885042 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f65d8062630 con 0x7f65c00a2b20 2024-09-05T01:17:44.771 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:44 smithi012 ceph-mon[29942]: purged_snaps scrub starts 2024-09-05T01:17:44.771 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:44 smithi012 ceph-mon[29942]: purged_snaps scrub ok 2024-09-05T01:17:44.771 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:44 smithi012 ceph-mon[29942]: osd.2 [v2:172.21.15.151:6800/3753171761,v1:172.21.15.151:6801/3753171761] boot 2024-09-05T01:17:44.771 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:44 smithi012 ceph-mon[29942]: osdmap e18: 3 total, 3 up, 3 in 2024-09-05T01:17:44.771 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:44 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T01:17:44.771 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:44 smithi012 ceph-mon[29942]: from='client.14265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:17:44.771 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:44 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:17:44.771 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:44 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:17:44.771 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:44 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:44.771 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:44 smithi012 ceph-mon[29942]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:45.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:44 smithi145 ceph-mon[34376]: purged_snaps scrub starts 2024-09-05T01:17:45.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:44 smithi145 ceph-mon[34376]: purged_snaps scrub ok 2024-09-05T01:17:45.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:44 smithi145 ceph-mon[34376]: osd.2 [v2:172.21.15.151:6800/3753171761,v1:172.21.15.151:6801/3753171761] boot 2024-09-05T01:17:45.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:44 smithi145 ceph-mon[34376]: osdmap e18: 3 total, 3 up, 3 in 2024-09-05T01:17:45.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:44 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T01:17:45.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:44 smithi145 ceph-mon[34376]: from='client.14265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:17:45.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:44 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:17:45.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:44 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:17:45.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:44 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:45.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:44 smithi145 ceph-mon[34376]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:45.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:44 smithi151 ceph-mon[35013]: purged_snaps scrub starts 2024-09-05T01:17:45.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:44 smithi151 ceph-mon[35013]: purged_snaps scrub ok 2024-09-05T01:17:45.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:44 smithi151 ceph-mon[35013]: osd.2 [v2:172.21.15.151:6800/3753171761,v1:172.21.15.151:6801/3753171761] boot 2024-09-05T01:17:45.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:44 smithi151 ceph-mon[35013]: osdmap e18: 3 total, 3 up, 3 in 2024-09-05T01:17:45.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:44 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T01:17:45.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:44 smithi151 ceph-mon[35013]: from='client.14265 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:17:45.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:44 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:17:45.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:44 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:17:45.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:44 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:45.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:44 smithi151 ceph-mon[35013]: pgmap v79: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-05T01:17:45.915 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:45 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-05T01:17:45.915 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:45 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-05T01:17:45.916 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:45 smithi012 ceph-mon[29942]: osdmap e19: 3 total, 3 up, 3 in 2024-09-05T01:17:45.916 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:45 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-05T01:17:46.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:45 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-05T01:17:46.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:45 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-05T01:17:46.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:45 smithi145 ceph-mon[34376]: osdmap e19: 3 total, 3 up, 3 in 2024-09-05T01:17:46.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:45 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-05T01:17:46.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:45 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-05T01:17:46.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:45 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-05T01:17:46.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:45 smithi151 ceph-mon[35013]: osdmap e19: 3 total, 3 up, 3 in 2024-09-05T01:17:46.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:45 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-05T01:17:46.537 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:17:46 smithi012 sudo[48488]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-05T01:17:46.538 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:17:46 smithi012 sudo[48488]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T01:17:46.538 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:17:46 smithi012 sudo[48488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T01:17:46.538 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:17:46 smithi012 sudo[48488]: pam_unix(sudo:session): session closed for user root 2024-09-05T01:17:46.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:17:46.775+0000 7f65d5600640 1 -- 172.21.15.12:0/2190885042 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f65cc098300 con 0x7f65d8103c50 2024-09-05T01:17:46.811 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:46 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-05T01:17:46.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:46 smithi012 ceph-mon[29942]: osdmap e20: 3 total, 3 up, 3 in 2024-09-05T01:17:46.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:46 smithi012 ceph-mon[29942]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-05T01:17:47.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:46 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-05T01:17:47.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:46 smithi145 ceph-mon[34376]: osdmap e20: 3 total, 3 up, 3 in 2024-09-05T01:17:47.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:46 smithi145 ceph-mon[34376]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-05T01:17:47.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:46 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-05T01:17:47.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:46 smithi151 ceph-mon[35013]: osdmap e20: 3 total, 3 up, 3 in 2024-09-05T01:17:47.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:46 smithi151 ceph-mon[35013]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-05T01:17:47.250 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:17:46 smithi012 sudo[48529]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-05T01:17:47.250 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:17:46 smithi012 sudo[48529]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T01:17:47.250 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:17:46 smithi012 sudo[48529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T01:17:47.250 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:17:46 smithi012 sudo[48529]: pam_unix(sudo:session): session closed for user root 2024-09-05T01:17:47.522 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:17:47 smithi145 sudo[43012]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-05T01:17:47.522 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:17:47 smithi145 sudo[43012]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T01:17:47.522 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:17:47 smithi145 sudo[43012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T01:17:47.522 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:17:47 smithi145 sudo[43012]: pam_unix(sudo:session): session closed for user root 2024-09-05T01:17:47.833 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:17:47 smithi145 sudo[43015]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-05T01:17:47.834 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:17:47 smithi145 sudo[43015]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T01:17:47.834 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:17:47 smithi145 sudo[43015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T01:17:47.834 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:17:47 smithi145 sudo[43015]: pam_unix(sudo:session): session closed for user root 2024-09-05T01:17:47.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:47 smithi145 ceph-mon[34376]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-05T01:17:47.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:47 smithi145 ceph-mon[34376]: osdmap e21: 3 total, 3 up, 3 in 2024-09-05T01:17:47.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:47 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/1934967249' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "275ad2ad-93e6-4a68-8784-8f8dcb620f45"}]: dispatch 2024-09-05T01:17:47.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:47 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/1934967249' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "275ad2ad-93e6-4a68-8784-8f8dcb620f45"}]': finished 2024-09-05T01:17:47.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:47 smithi145 ceph-mon[34376]: osdmap e22: 4 total, 3 up, 4 in 2024-09-05T01:17:47.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:47 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T01:17:47.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:47 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:47.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:47 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:47.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:47 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/641505777' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:17:48.053 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:17:47 smithi151 sudo[43784]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-05T01:17:48.053 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:17:47 smithi151 sudo[43784]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T01:17:48.053 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:17:47 smithi151 sudo[43784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T01:17:48.053 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:17:47 smithi151 sudo[43784]: pam_unix(sudo:session): session closed for user root 2024-09-05T01:17:48.054 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:47 smithi151 ceph-mon[35013]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-05T01:17:48.055 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:47 smithi151 ceph-mon[35013]: osdmap e21: 3 total, 3 up, 3 in 2024-09-05T01:17:48.055 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:47 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/1934967249' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "275ad2ad-93e6-4a68-8784-8f8dcb620f45"}]: dispatch 2024-09-05T01:17:48.055 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:47 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/1934967249' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "275ad2ad-93e6-4a68-8784-8f8dcb620f45"}]': finished 2024-09-05T01:17:48.055 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:47 smithi151 ceph-mon[35013]: osdmap e22: 4 total, 3 up, 4 in 2024-09-05T01:17:48.055 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:47 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T01:17:48.055 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:47 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:48.055 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:47 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:48.055 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:47 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/641505777' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:17:48.061 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:47 smithi012 ceph-mon[29942]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-05T01:17:48.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:47 smithi012 ceph-mon[29942]: osdmap e21: 3 total, 3 up, 3 in 2024-09-05T01:17:48.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:47 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/1934967249' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "275ad2ad-93e6-4a68-8784-8f8dcb620f45"}]: dispatch 2024-09-05T01:17:48.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:47 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/1934967249' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "275ad2ad-93e6-4a68-8784-8f8dcb620f45"}]': finished 2024-09-05T01:17:48.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:47 smithi012 ceph-mon[29942]: osdmap e22: 4 total, 3 up, 4 in 2024-09-05T01:17:48.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:47 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T01:17:48.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:47 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:48.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:47 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:48.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:47 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/641505777' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:17:48.354 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:17:48 smithi151 sudo[43787]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-05T01:17:48.354 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:17:48 smithi151 sudo[43787]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T01:17:48.354 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:17:48 smithi151 sudo[43787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T01:17:48.354 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:17:48 smithi151 sudo[43787]: pam_unix(sudo:session): session closed for user root 2024-09-05T01:17:49.311 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:48 smithi012 sudo[48618]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-05T01:17:49.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:48 smithi012 sudo[48618]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T01:17:49.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:48 smithi012 sudo[48618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T01:17:49.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:48 smithi012 sudo[48618]: pam_unix(sudo:session): session closed for user root 2024-09-05T01:17:49.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:49 smithi012 sudo[48993]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-05T01:17:49.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:49 smithi012 sudo[48993]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T01:17:49.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:49 smithi012 sudo[48993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T01:17:49.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:49 smithi012 sudo[48993]: pam_unix(sudo:session): session closed for user root 2024-09-05T01:17:49.920 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:49 smithi151 sudo[43790]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-05T01:17:49.921 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:49 smithi151 sudo[43790]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T01:17:49.921 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:49 smithi151 sudo[43790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T01:17:49.921 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:49 smithi151 sudo[43790]: pam_unix(sudo:session): session closed for user root 2024-09-05T01:17:50.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:49 smithi145 ceph-mon[34376]: pgmap v85: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-05T01:17:50.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:49 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:50.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:49 smithi145 ceph-mon[34376]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T01:17:50.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:50 smithi145 sudo[43018]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-05T01:17:50.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:50 smithi145 sudo[43018]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T01:17:50.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:50 smithi145 sudo[43018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T01:17:50.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:50 smithi145 sudo[43018]: pam_unix(sudo:session): session closed for user root 2024-09-05T01:17:50.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:49 smithi012 ceph-mon[29942]: pgmap v85: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-05T01:17:50.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:49 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:50.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:49 smithi012 ceph-mon[29942]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T01:17:50.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:49 smithi151 sudo[43793]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-05T01:17:50.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:49 smithi151 sudo[43793]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T01:17:50.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:49 smithi151 sudo[43793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T01:17:50.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:49 smithi151 sudo[43793]: pam_unix(sudo:session): session closed for user root 2024-09-05T01:17:50.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:49 smithi151 ceph-mon[35013]: pgmap v85: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-05T01:17:50.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:49 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:17:50.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:49 smithi151 ceph-mon[35013]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T01:17:50.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:50 smithi145 sudo[43021]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-05T01:17:50.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:50 smithi145 sudo[43021]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-05T01:17:50.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:50 smithi145 sudo[43021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-05T01:17:50.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:50 smithi145 sudo[43021]: pam_unix(sudo:session): session closed for user root 2024-09-05T01:17:51.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:50 smithi012 ceph-mon[29942]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T01:17:51.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T01:17:51.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:17:51.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:17:51.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:50 smithi012 ceph-mon[29942]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T01:17:51.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T01:17:51.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:17:51.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:17:51.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:50 smithi012 ceph-mon[29942]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T01:17:51.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:50 smithi012 ceph-mon[29942]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T01:17:51.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T01:17:51.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:17:51.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:17:51.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:50 smithi012 ceph-mon[29942]: pgmap v86: 1 pgs: 1 creating+peering; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-05T01:17:51.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:50 smithi012 ceph-mon[29942]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T01:17:51.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:50 smithi145 ceph-mon[34376]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T01:17:51.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:50 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T01:17:51.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:50 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:17:51.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:50 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:17:51.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:50 smithi145 ceph-mon[34376]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T01:17:51.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:50 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T01:17:51.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:50 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:17:51.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:50 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:17:51.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:50 smithi145 ceph-mon[34376]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T01:17:51.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:50 smithi145 ceph-mon[34376]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T01:17:51.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:50 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T01:17:51.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:50 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:17:51.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:50 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:17:51.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:50 smithi145 ceph-mon[34376]: pgmap v86: 1 pgs: 1 creating+peering; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-05T01:17:51.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:50 smithi145 ceph-mon[34376]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T01:17:51.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:50 smithi151 ceph-mon[35013]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T01:17:51.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:50 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T01:17:51.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:50 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:17:51.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:50 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:17:51.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:50 smithi151 ceph-mon[35013]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T01:17:51.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:50 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T01:17:51.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:50 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:17:51.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:50 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:17:51.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:50 smithi151 ceph-mon[35013]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T01:17:51.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:50 smithi151 ceph-mon[35013]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-05T01:17:51.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:50 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T01:17:51.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:50 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:17:51.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:50 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:17:51.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:50 smithi151 ceph-mon[35013]: pgmap v86: 1 pgs: 1 creating+peering; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-05T01:17:51.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:50 smithi151 ceph-mon[35013]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-05T01:17:52.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:52 smithi012 ceph-mon[29942]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-05T01:17:52.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:52 smithi145 ceph-mon[34376]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-05T01:17:52.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:52 smithi151 ceph-mon[35013]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-05T01:17:54.302 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:54 smithi012 ceph-mon[29942]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-05T01:17:54.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:54 smithi145 ceph-mon[34376]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-05T01:17:54.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:54 smithi151 ceph-mon[35013]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-05T01:17:56.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:56 smithi012 ceph-mon[29942]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-05T01:17:56.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:56 smithi145 ceph-mon[34376]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-05T01:17:56.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:56 smithi151 ceph-mon[35013]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-05T01:17:57.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:57 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-05T01:17:57.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:57 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:57.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:57 smithi012 ceph-mon[29942]: Deploying daemon osd.3 on smithi012 2024-09-05T01:17:57.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:57 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-05T01:17:57.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:57 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:57.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:57 smithi145 ceph-mon[34376]: Deploying daemon osd.3 on smithi012 2024-09-05T01:17:57.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:57 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-05T01:17:57.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:57 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:17:57.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:57 smithi151 ceph-mon[35013]: Deploying daemon osd.3 on smithi012 2024-09-05T01:17:58.476 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:17:58 smithi012 ceph-mon[29942]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-05T01:17:58.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:17:58 smithi145 ceph-mon[34376]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-05T01:17:58.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:17:58 smithi151 ceph-mon[35013]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-05T01:18:00.236 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:00 smithi012 ceph-mon[29942]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-05T01:18:00.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:00 smithi145 ceph-mon[34376]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-05T01:18:00.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:00 smithi151 ceph-mon[35013]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-05T01:18:02.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:02 smithi012 ceph-mon[29942]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-05T01:18:02.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:02 smithi145 ceph-mon[34376]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-05T01:18:02.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:02 smithi151 ceph-mon[35013]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-05T01:18:03.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:03 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:18:03.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:03 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:03.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:03 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:03.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:03 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:18:03.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:03 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:03.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:03 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:03.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:03 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:18:03.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:03 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:03.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:03 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:04.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:04 smithi012 ceph-mon[29942]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-05T01:18:04.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:04 smithi145 ceph-mon[34376]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-05T01:18:04.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:04 smithi151 ceph-mon[35013]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-05T01:18:06.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:06 smithi012 ceph-mon[29942]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-05T01:18:06.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:06 smithi145 ceph-mon[34376]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-05T01:18:06.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:06 smithi151 ceph-mon[35013]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-05T01:18:07.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:07 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:07.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:07 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:07.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:07 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:07.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:07 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:18:07.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:07 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:07.806 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:07 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:07.806 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:07 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:07.806 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:07 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:07.807 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:07 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:18:07.807 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:07 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:07.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:07 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:07.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:07 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:07.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:07 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:07.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:07 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:18:07.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:07 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:07.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:18:07.926+0000 7f65d5600640 1 -- 172.21.15.12:0/2190885042 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f65d8062630 con 0x7f65c00a2b20 2024-09-05T01:18:07.928 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 3 on host 'smithi012' 2024-09-05T01:18:07.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:18:07.928+0000 7f65de000640 1 -- 172.21.15.12:0/2190885042 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f65c00a2b20 msgr2=0x7f65c00a4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:18:07.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:18:07.928+0000 7f65de000640 1 --2- 172.21.15.12:0/2190885042 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f65c00a2b20 0x7f65c00a4fe0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f65c40314e0 tx=0x7f65c4000bc0 comp rx=0 tx=0).stop 2024-09-05T01:18:07.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:18:07.928+0000 7f65de000640 1 -- 172.21.15.12:0/2190885042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65d8103c50 msgr2=0x7f65d8199f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:18:07.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:18:07.928+0000 7f65de000640 1 --2- 172.21.15.12:0/2190885042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65d8103c50 0x7f65d8199f40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f65cc00e9c0 tx=0x7f65cc00ee80 comp rx=0 tx=0).stop 2024-09-05T01:18:07.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:18:07.929+0000 7f65de000640 1 -- 172.21.15.12:0/2190885042 shutdown_connections 2024-09-05T01:18:07.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:18:07.929+0000 7f65de000640 1 --2- 172.21.15.12:0/2190885042 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f65c00a2b20 0x7f65c00a4fe0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:18:07.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:18:07.929+0000 7f65de000640 1 --2- 172.21.15.12:0/2190885042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65d8105810 0x7f65d81a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:18:07.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:18:07.929+0000 7f65de000640 1 --2- 172.21.15.12:0/2190885042 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f65d8104e50 0x7f65d819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:18:07.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:18:07.929+0000 7f65de000640 1 --2- 172.21.15.12:0/2190885042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65d8103c50 0x7f65d8199f40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:18:07.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:18:07.929+0000 7f65de000640 1 -- 172.21.15.12:0/2190885042 >> 172.21.15.12:0/2190885042 conn(0x7f65d80ff3e0 msgr2=0x7f65d8108270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:18:07.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:18:07.929+0000 7f65de000640 1 -- 172.21.15.12:0/2190885042 shutdown_connections 2024-09-05T01:18:07.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:18:07.929+0000 7f65de000640 1 -- 172.21.15.12:0/2190885042 wait complete. 2024-09-05T01:18:08.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:08 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:18:08.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:08 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:08.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:08 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:08.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:08 smithi012 ceph-mon[29942]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-05T01:18:08.636 DEBUG:teuthology.orchestra.run.smithi012:osd.3> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.3.service 2024-09-05T01:18:08.641 INFO:tasks.cephadm:Deploying osd.4 on smithi145 with /dev/vg_nvme/lv_3... 2024-09-05T01:18:08.641 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-05T01:18:08.665 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:08 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:18:08.665 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:08 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:08.665 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:08 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:08.665 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:08 smithi145 ceph-mon[34376]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-05T01:18:08.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:08 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:18:08.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:08 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:08.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:08 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:08.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:08 smithi151 ceph-mon[35013]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-05T01:18:08.882 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T01:18:10.120 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:09 smithi012 ceph-mon[29942]: from='osd.3 [v2:172.21.15.12:6810/2231650146,v1:172.21.15.12:6811/2231650146]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-05T01:18:10.120 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:09 smithi012 ceph-mon[29942]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-05T01:18:10.121 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 05 01:18:09 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-3[50569]: 2024-09-05T01:18:09.866+0000 7f06fdc93640 -1 osd.3 0 log_to_monitors true 2024-09-05T01:18:10.275 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:09 smithi145 ceph-mon[34376]: from='osd.3 [v2:172.21.15.12:6810/2231650146,v1:172.21.15.12:6811/2231650146]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-05T01:18:10.275 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:09 smithi145 ceph-mon[34376]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-05T01:18:10.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:09 smithi151 ceph-mon[35013]: from='osd.3 [v2:172.21.15.12:6810/2231650146,v1:172.21.15.12:6811/2231650146]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-05T01:18:10.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:09 smithi151 ceph-mon[35013]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-05T01:18:11.312 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 05 01:18:10 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-3[50569]: 2024-09-05T01:18:10.941+0000 7f06f8200640 -1 osd.3 0 waiting for initial osdmap 2024-09-05T01:18:11.312 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 05 01:18:10 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-3[50569]: 2024-09-05T01:18:10.963+0000 7f06f3c00640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T01:18:11.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:10 smithi012 ceph-mon[29942]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-05T01:18:11.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:10 smithi012 ceph-mon[29942]: osdmap e23: 4 total, 3 up, 4 in 2024-09-05T01:18:11.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:10 smithi012 ceph-mon[29942]: from='osd.3 [v2:172.21.15.12:6810/2231650146,v1:172.21.15.12:6811/2231650146]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-05T01:18:11.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:10 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T01:18:11.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:10 smithi012 ceph-mon[29942]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-05T01:18:11.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:10 smithi012 ceph-mon[29942]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-05T01:18:11.325 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:10 smithi145 ceph-mon[34376]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-05T01:18:11.325 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:10 smithi145 ceph-mon[34376]: osdmap e23: 4 total, 3 up, 4 in 2024-09-05T01:18:11.325 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:10 smithi145 ceph-mon[34376]: from='osd.3 [v2:172.21.15.12:6810/2231650146,v1:172.21.15.12:6811/2231650146]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-05T01:18:11.325 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:10 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T01:18:11.325 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:10 smithi145 ceph-mon[34376]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-05T01:18:11.326 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:10 smithi145 ceph-mon[34376]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-05T01:18:11.328 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-05T01:18:11.354 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi145:vg_nvme/lv_3 2024-09-05T01:18:11.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:10 smithi151 ceph-mon[35013]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-05T01:18:11.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:10 smithi151 ceph-mon[35013]: osdmap e23: 4 total, 3 up, 4 in 2024-09-05T01:18:11.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:10 smithi151 ceph-mon[35013]: from='osd.3 [v2:172.21.15.12:6810/2231650146,v1:172.21.15.12:6811/2231650146]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-05T01:18:11.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:10 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T01:18:11.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:10 smithi151 ceph-mon[35013]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-05T01:18:11.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:10 smithi151 ceph-mon[35013]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-05T01:18:11.635 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T01:18:12.061 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:11 smithi145 ceph-mon[34376]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-05T01:18:12.061 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:11 smithi145 ceph-mon[34376]: osdmap e24: 4 total, 3 up, 4 in 2024-09-05T01:18:12.061 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:11 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T01:18:12.061 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:11 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T01:18:12.061 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:11 smithi145 ceph-mon[34376]: osd.3 [v2:172.21.15.12:6810/2231650146,v1:172.21.15.12:6811/2231650146] boot 2024-09-05T01:18:12.061 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:11 smithi145 ceph-mon[34376]: osdmap e25: 4 total, 4 up, 4 in 2024-09-05T01:18:12.061 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:11 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T01:18:12.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.060+0000 7f5209970640 1 -- 172.21.15.145:0/1448849758 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5204101c00 msgr2=0x7f5204102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:18:12.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.060+0000 7f5209970640 1 --2- 172.21.15.145:0/1448849758 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5204101c00 0x7f5204102000 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009900 tx=0x7f51ec02a410 comp rx=0 tx=0).stop 2024-09-05T01:18:12.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.060+0000 7f5209970640 1 -- 172.21.15.145:0/1448849758 shutdown_connections 2024-09-05T01:18:12.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.060+0000 7f5209970640 1 --2- 172.21.15.145:0/1448849758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52041037c0 0x7f520410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:18:12.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.060+0000 7f5209970640 1 --2- 172.21.15.145:0/1448849758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5204102e00 0x7f5204103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:18:12.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.060+0000 7f5209970640 1 --2- 172.21.15.145:0/1448849758 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5204101c00 0x7f5204102000 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:18:12.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.060+0000 7f5209970640 1 -- 172.21.15.145:0/1448849758 >> 172.21.15.145:0/1448849758 conn(0x7f52040fd3b0 msgr2=0x7f52040ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:18:12.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.060+0000 7f5209970640 1 -- 172.21.15.145:0/1448849758 shutdown_connections 2024-09-05T01:18:12.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.060+0000 7f5209970640 1 -- 172.21.15.145:0/1448849758 wait complete. 2024-09-05T01:18:12.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.061+0000 7f5209970640 1 Processor -- start 2024-09-05T01:18:12.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.061+0000 7f5209970640 1 -- start start 2024-09-05T01:18:12.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.061+0000 7f5209970640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5204101c00 0x7f5204197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:18:12.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.061+0000 7f5209970640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5204102e00 0x7f5204198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:18:12.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.061+0000 7f5209970640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52041037c0 0x7f520419f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:18:12.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.061+0000 7f5209970640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f520410d880 con 0x7f5204101c00 2024-09-05T01:18:12.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.061+0000 7f5209970640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f520410d700 con 0x7f5204102e00 2024-09-05T01:18:12.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.061+0000 7f5209970640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f520410da00 con 0x7f52041037c0 2024-09-05T01:18:12.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.061+0000 7f52027fc640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5204102e00 0x7f5204198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:18:12.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.061+0000 7f52027fc640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5204102e00 0x7f5204198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:38216/0 (socket says 172.21.15.145:38216) 2024-09-05T01:18:12.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.061+0000 7f52027fc640 1 -- 172.21.15.145:0/3580451276 learned_addr learned my addr 172.21.15.145:0/3580451276 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-05T01:18:12.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.062+0000 7f5202ffd640 1 --2- 172.21.15.145:0/3580451276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5204101c00 0x7f5204197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:18:12.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.062+0000 7f52037fe640 1 --2- 172.21.15.145:0/3580451276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52041037c0 0x7f520419f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:18:12.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.062+0000 7f52027fc640 1 -- 172.21.15.145:0/3580451276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52041037c0 msgr2=0x7f520419f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:18:12.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.062+0000 7f52027fc640 1 --2- 172.21.15.145:0/3580451276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52041037c0 0x7f520419f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:18:12.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.062+0000 7f52027fc640 1 -- 172.21.15.145:0/3580451276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5204101c00 msgr2=0x7f5204197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:18:12.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.062+0000 7f52027fc640 1 --2- 172.21.15.145:0/3580451276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5204101c00 0x7f5204197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:18:12.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.062+0000 7f52027fc640 1 -- 172.21.15.145:0/3580451276 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f520419fb00 con 0x7f5204102e00 2024-09-05T01:18:12.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.062+0000 7f5202ffd640 1 --2- 172.21.15.145:0/3580451276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5204101c00 0x7f5204197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:18:12.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.062+0000 7f52027fc640 1 --2- 172.21.15.145:0/3580451276 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5204102e00 0x7f5204198410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f51f400d770 tx=0x7f51f400dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:18:12.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.062+0000 7f520896e640 1 -- 172.21.15.145:0/3580451276 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f4017070 con 0x7f5204102e00 2024-09-05T01:18:12.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.062+0000 7f5209970640 1 -- 172.21.15.145:0/3580451276 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f520419fdf0 con 0x7f5204102e00 2024-09-05T01:18:12.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.062+0000 7f520896e640 1 -- 172.21.15.145:0/3580451276 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51f4005500 con 0x7f5204102e00 2024-09-05T01:18:12.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.062+0000 7f520896e640 1 -- 172.21.15.145:0/3580451276 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f4004e00 con 0x7f5204102e00 2024-09-05T01:18:12.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.062+0000 7f5209970640 1 -- 172.21.15.145:0/3580451276 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52041a02a0 con 0x7f5204102e00 2024-09-05T01:18:12.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.063+0000 7f5209970640 1 -- 172.21.15.145:0/3580451276 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5204109050 con 0x7f5204102e00 2024-09-05T01:18:12.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.064+0000 7f520896e640 1 -- 172.21.15.145:0/3580451276 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f51f4004fa0 con 0x7f5204102e00 2024-09-05T01:18:12.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.065+0000 7f520896e640 1 --2- 172.21.15.145:0/3580451276 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f51f00a2c30 0x7f51f00a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:18:12.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.065+0000 7f520896e640 1 -- 172.21.15.145:0/3580451276 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3702+0+0 (secure 0 0 0) 0x7f51f40cd860 con 0x7f5204102e00 2024-09-05T01:18:12.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.065+0000 7f5202ffd640 1 --2- 172.21.15.145:0/3580451276 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f51f00a2c30 0x7f51f00a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:18:12.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.066+0000 7f5202ffd640 1 --2- 172.21.15.145:0/3580451276 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f51f00a2c30 0x7f51f00a50f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f51ec006010 tx=0x7f51ec032cf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:18:12.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.069+0000 7f520896e640 1 -- 172.21.15.145:0/3580451276 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f51f409b9c0 con 0x7f5204102e00 2024-09-05T01:18:12.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:12.245+0000 7f5209970640 1 -- 172.21.15.145:0/3580451276 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f5204062630 con 0x7f51f00a2c30 2024-09-05T01:18:12.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:11 smithi012 ceph-mon[29942]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-05T01:18:12.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:11 smithi012 ceph-mon[29942]: osdmap e24: 4 total, 3 up, 4 in 2024-09-05T01:18:12.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:11 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T01:18:12.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:11 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T01:18:12.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:11 smithi012 ceph-mon[29942]: osd.3 [v2:172.21.15.12:6810/2231650146,v1:172.21.15.12:6811/2231650146] boot 2024-09-05T01:18:12.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:11 smithi012 ceph-mon[29942]: osdmap e25: 4 total, 4 up, 4 in 2024-09-05T01:18:12.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:11 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T01:18:12.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:11 smithi151 ceph-mon[35013]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-05T01:18:12.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:11 smithi151 ceph-mon[35013]: osdmap e24: 4 total, 3 up, 4 in 2024-09-05T01:18:12.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:11 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T01:18:12.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:11 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T01:18:12.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:11 smithi151 ceph-mon[35013]: osd.3 [v2:172.21.15.12:6810/2231650146,v1:172.21.15.12:6811/2231650146] boot 2024-09-05T01:18:12.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:11 smithi151 ceph-mon[35013]: osdmap e25: 4 total, 4 up, 4 in 2024-09-05T01:18:12.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:11 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T01:18:13.306 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:12 smithi012 ceph-mon[29942]: purged_snaps scrub starts 2024-09-05T01:18:13.306 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:12 smithi012 ceph-mon[29942]: purged_snaps scrub ok 2024-09-05T01:18:13.306 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:12 smithi012 ceph-mon[29942]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:13.306 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:12 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:13.306 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:13 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:13.306 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:13 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:18:13.307 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:13 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:18:13.307 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:13 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:13.307 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:13 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:13.307 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:13 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:18:13.307 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:13 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:13.307 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:13 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:18:13.307 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:13 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:18:13.307 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:13 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:13.307 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:13 smithi012 ceph-mon[29942]: osdmap e26: 4 total, 4 up, 4 in 2024-09-05T01:18:13.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:12 smithi145 ceph-mon[34376]: purged_snaps scrub starts 2024-09-05T01:18:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:12 smithi145 ceph-mon[34376]: purged_snaps scrub ok 2024-09-05T01:18:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:12 smithi145 ceph-mon[34376]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:18:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:18:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:18:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:18:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:18:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:13.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:12 smithi145 ceph-mon[34376]: osdmap e26: 4 total, 4 up, 4 in 2024-09-05T01:18:13.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:12 smithi151 ceph-mon[35013]: purged_snaps scrub starts 2024-09-05T01:18:13.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:12 smithi151 ceph-mon[35013]: purged_snaps scrub ok 2024-09-05T01:18:13.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:12 smithi151 ceph-mon[35013]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:13.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:13.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:13.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:18:13.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:18:13.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:13.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:13.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:18:13.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:13.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:18:13.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:18:13.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:13.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:12 smithi151 ceph-mon[35013]: osdmap e26: 4 total, 4 up, 4 in 2024-09-05T01:18:14.029 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:13 smithi145 ceph-mon[34376]: Detected new or changed devices on smithi012 2024-09-05T01:18:14.029 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:13 smithi145 ceph-mon[34376]: Adjusting osd_memory_target on smithi012 to 8547M 2024-09-05T01:18:14.029 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:13 smithi145 ceph-mon[34376]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:18:14.029 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:13 smithi145 ceph-mon[34376]: osdmap e27: 4 total, 4 up, 4 in 2024-09-05T01:18:14.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:13 smithi151 ceph-mon[35013]: Detected new or changed devices on smithi012 2024-09-05T01:18:14.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:13 smithi151 ceph-mon[35013]: Adjusting osd_memory_target on smithi012 to 8547M 2024-09-05T01:18:14.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:13 smithi151 ceph-mon[35013]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:18:14.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:13 smithi151 ceph-mon[35013]: osdmap e27: 4 total, 4 up, 4 in 2024-09-05T01:18:14.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:13 smithi012 ceph-mon[29942]: Detected new or changed devices on smithi012 2024-09-05T01:18:14.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:13 smithi012 ceph-mon[29942]: Adjusting osd_memory_target on smithi012 to 8547M 2024-09-05T01:18:14.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:13 smithi012 ceph-mon[29942]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:18:14.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:13 smithi012 ceph-mon[29942]: osdmap e27: 4 total, 4 up, 4 in 2024-09-05T01:18:15.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:14 smithi145 ceph-mon[34376]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:15.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:14 smithi145 ceph-mon[34376]: from='client.? 172.21.15.145:0/4026673944' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21a0c5b4-4e0e-4fb6-8be6-a300cb811cb7"}]: dispatch 2024-09-05T01:18:15.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:14 smithi145 ceph-mon[34376]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21a0c5b4-4e0e-4fb6-8be6-a300cb811cb7"}]: dispatch 2024-09-05T01:18:15.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:14 smithi145 ceph-mon[34376]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21a0c5b4-4e0e-4fb6-8be6-a300cb811cb7"}]': finished 2024-09-05T01:18:15.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:14 smithi145 ceph-mon[34376]: osdmap e28: 5 total, 4 up, 5 in 2024-09-05T01:18:15.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:14 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T01:18:15.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:14 smithi012 ceph-mon[29942]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:15.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:14 smithi012 ceph-mon[29942]: from='client.? 172.21.15.145:0/4026673944' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21a0c5b4-4e0e-4fb6-8be6-a300cb811cb7"}]: dispatch 2024-09-05T01:18:15.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:14 smithi012 ceph-mon[29942]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21a0c5b4-4e0e-4fb6-8be6-a300cb811cb7"}]: dispatch 2024-09-05T01:18:15.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:14 smithi012 ceph-mon[29942]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21a0c5b4-4e0e-4fb6-8be6-a300cb811cb7"}]': finished 2024-09-05T01:18:15.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:14 smithi012 ceph-mon[29942]: osdmap e28: 5 total, 4 up, 5 in 2024-09-05T01:18:15.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T01:18:15.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:14 smithi151 ceph-mon[35013]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:15.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:14 smithi151 ceph-mon[35013]: from='client.? 172.21.15.145:0/4026673944' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21a0c5b4-4e0e-4fb6-8be6-a300cb811cb7"}]: dispatch 2024-09-05T01:18:15.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:14 smithi151 ceph-mon[35013]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21a0c5b4-4e0e-4fb6-8be6-a300cb811cb7"}]: dispatch 2024-09-05T01:18:15.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:14 smithi151 ceph-mon[35013]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21a0c5b4-4e0e-4fb6-8be6-a300cb811cb7"}]': finished 2024-09-05T01:18:15.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:14 smithi151 ceph-mon[35013]: osdmap e28: 5 total, 4 up, 5 in 2024-09-05T01:18:15.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T01:18:16.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:15 smithi012 ceph-mon[29942]: from='client.? 172.21.15.145:0/2753723771' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:18:16.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:15 smithi012 ceph-mon[29942]: osdmap e29: 5 total, 4 up, 5 in 2024-09-05T01:18:16.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:15 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T01:18:16.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:15 smithi145 ceph-mon[34376]: from='client.? 172.21.15.145:0/2753723771' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:18:16.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:15 smithi145 ceph-mon[34376]: osdmap e29: 5 total, 4 up, 5 in 2024-09-05T01:18:16.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:15 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T01:18:16.353 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:15 smithi151 ceph-mon[35013]: from='client.? 172.21.15.145:0/2753723771' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:18:16.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:15 smithi151 ceph-mon[35013]: osdmap e29: 5 total, 4 up, 5 in 2024-09-05T01:18:16.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:15 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T01:18:17.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:16 smithi012 ceph-mon[29942]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-05T01:18:17.314 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:16 smithi145 ceph-mon[34376]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-05T01:18:17.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:16 smithi151 ceph-mon[35013]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-05T01:18:18.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:18 smithi012 ceph-mon[29942]: pgmap v107: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-05T01:18:18.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:18 smithi145 ceph-mon[34376]: pgmap v107: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-05T01:18:18.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:18 smithi151 ceph-mon[35013]: pgmap v107: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-05T01:18:20.309 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:20 smithi145 ceph-mon[34376]: pgmap v108: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-05T01:18:20.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:20 smithi012 ceph-mon[29942]: pgmap v108: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-05T01:18:20.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:20 smithi151 ceph-mon[35013]: pgmap v108: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-05T01:18:22.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:22 smithi012 ceph-mon[29942]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-05T01:18:22.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:22 smithi145 ceph-mon[34376]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-05T01:18:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:22 smithi151 ceph-mon[35013]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-05T01:18:23.557 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:23 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-05T01:18:23.557 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:23 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:23.557 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:23 smithi145 ceph-mon[34376]: Deploying daemon osd.4 on smithi145 2024-09-05T01:18:23.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:23 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-05T01:18:23.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:23 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:23.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:23 smithi012 ceph-mon[29942]: Deploying daemon osd.4 on smithi145 2024-09-05T01:18:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:23 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-05T01:18:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:23 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:23 smithi151 ceph-mon[35013]: Deploying daemon osd.4 on smithi145 2024-09-05T01:18:24.473 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:24 smithi151 ceph-mon[35013]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-05T01:18:24.486 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:24 smithi145 ceph-mon[34376]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-05T01:18:24.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:24 smithi012 ceph-mon[29942]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-05T01:18:26.421 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:26 smithi145 ceph-mon[34376]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:26.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:26 smithi012 ceph-mon[29942]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:26.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:26 smithi151 ceph-mon[35013]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:28 smithi012 ceph-mon[29942]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:28 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:18:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:28 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:28 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:28.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:28 smithi145 ceph-mon[34376]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:28.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:28 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:18:28.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:28 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:28.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:28 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:28.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:28 smithi151 ceph-mon[35013]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:28.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:28 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:18:28.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:28 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:28.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:28 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:30.437 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:30 smithi145 ceph-mon[34376]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:30.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:30 smithi012 ceph-mon[29942]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:30.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:30 smithi151 ceph-mon[35013]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:31.968 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:31 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:31.969 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:31 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:31.969 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:31 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:31.969 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:31 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:18:31.969 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:31 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:32.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:32.009+0000 7f520896e640 1 -- 172.21.15.145:0/3580451276 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5204062630 con 0x7f51f00a2c30 2024-09-05T01:18:32.010 INFO:teuthology.orchestra.run.smithi145.stdout:Created osd(s) 4 on host 'smithi145' 2024-09-05T01:18:32.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:32.011+0000 7f5209970640 1 -- 172.21.15.145:0/3580451276 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f51f00a2c30 msgr2=0x7f51f00a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:18:32.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:32.011+0000 7f5209970640 1 --2- 172.21.15.145:0/3580451276 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f51f00a2c30 0x7f51f00a50f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f51ec006010 tx=0x7f51ec032cf0 comp rx=0 tx=0).stop 2024-09-05T01:18:32.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:32.011+0000 7f5209970640 1 -- 172.21.15.145:0/3580451276 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5204102e00 msgr2=0x7f5204198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:18:32.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:32.011+0000 7f5209970640 1 --2- 172.21.15.145:0/3580451276 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5204102e00 0x7f5204198410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f51f400d770 tx=0x7f51f400dc30 comp rx=0 tx=0).stop 2024-09-05T01:18:32.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:32.011+0000 7f5209970640 1 -- 172.21.15.145:0/3580451276 shutdown_connections 2024-09-05T01:18:32.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:32.011+0000 7f5209970640 1 --2- 172.21.15.145:0/3580451276 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f51f00a2c30 0x7f51f00a50f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:18:32.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:32.011+0000 7f5209970640 1 --2- 172.21.15.145:0/3580451276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52041037c0 0x7f520419f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:18:32.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:32.011+0000 7f5209970640 1 --2- 172.21.15.145:0/3580451276 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5204102e00 0x7f5204198410 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:18:32.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:32.011+0000 7f5209970640 1 --2- 172.21.15.145:0/3580451276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5204101c00 0x7f5204197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:18:32.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:32.011+0000 7f5209970640 1 -- 172.21.15.145:0/3580451276 >> 172.21.15.145:0/3580451276 conn(0x7f52040fd3b0 msgr2=0x7f5204106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:18:32.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:32.012+0000 7f5209970640 1 -- 172.21.15.145:0/3580451276 shutdown_connections 2024-09-05T01:18:32.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:18:32.012+0000 7f5209970640 1 -- 172.21.15.145:0/3580451276 wait complete. 2024-09-05T01:18:32.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:31 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:32.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:31 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:32.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:31 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:32.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:31 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:18:32.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:31 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:32.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:31 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:32.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:31 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:32.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:31 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:32.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:31 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:18:32.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:31 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:32.658 DEBUG:teuthology.orchestra.run.smithi145:osd.4> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.4.service 2024-09-05T01:18:32.661 INFO:tasks.cephadm:Deploying osd.5 on smithi151 with /dev/vg_nvme/lv_3... 2024-09-05T01:18:32.661 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-05T01:18:32.916 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T01:18:32.926 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:32 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:18:32.926 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:32 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:32.926 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:32 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:32.926 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:32 smithi145 ceph-mon[34376]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:33.037 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:32 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:18:33.037 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:32 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:33.037 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:32 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:33.038 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:32 smithi151 ceph-mon[35013]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:33.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:32 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:18:33.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:32 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:33.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:32 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:33.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:32 smithi012 ceph-mon[29942]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:34.285 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:34 smithi151 ceph-mon[35013]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:34.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:34 smithi145 ceph-mon[34376]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:34.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:34 smithi012 ceph-mon[29942]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:34.690 INFO:journalctl@ceph.osd.4.smithi145.stdout:Sep 05 01:18:34 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-4[45785]: 2024-09-05T01:18:34.428+0000 7fd33abc1640 -1 osd.4 0 log_to_monitors true 2024-09-05T01:18:35.261 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:35 smithi145 ceph-mon[34376]: from='osd.4 [v2:172.21.15.145:6808/1828591275,v1:172.21.15.145:6809/1828591275]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-05T01:18:35.261 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:35 smithi145 ceph-mon[34376]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-05T01:18:35.319 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:35 smithi151 ceph-mon[35013]: from='osd.4 [v2:172.21.15.145:6808/1828591275,v1:172.21.15.145:6809/1828591275]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-05T01:18:35.319 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:35 smithi151 ceph-mon[35013]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-05T01:18:35.322 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-05T01:18:35.347 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi151:vg_nvme/lv_3 2024-09-05T01:18:35.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:35 smithi012 ceph-mon[29942]: from='osd.4 [v2:172.21.15.145:6808/1828591275,v1:172.21.15.145:6809/1828591275]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-05T01:18:35.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:35 smithi012 ceph-mon[29942]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-05T01:18:35.602 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T01:18:36.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.040+0000 7f168cfca640 1 -- 172.21.15.151:0/1940291677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1688107920 msgr2=0x7f1688109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:18:36.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.040+0000 7f168cfca640 1 --2- 172.21.15.151:0/1940291677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1688107920 0x7f1688109d10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1680009ca0 tx=0x7f168002a8c0 comp rx=0 tx=0).stop 2024-09-05T01:18:36.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.041+0000 7f168cfca640 1 -- 172.21.15.151:0/1940291677 shutdown_connections 2024-09-05T01:18:36.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.041+0000 7f168cfca640 1 --2- 172.21.15.151:0/1940291677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1688107920 0x7f1688109d10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:18:36.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.041+0000 7f168cfca640 1 --2- 172.21.15.151:0/1940291677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1688104ff0 0x7f16881073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:18:36.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.041+0000 7f168cfca640 1 --2- 172.21.15.151:0/1940291677 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f16881026c0 0x7f1688104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:18:36.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.041+0000 7f168cfca640 1 -- 172.21.15.151:0/1940291677 >> 172.21.15.151:0/1940291677 conn(0x7f16880fc280 msgr2=0x7f16880fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:18:36.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.041+0000 7f168cfca640 1 -- 172.21.15.151:0/1940291677 shutdown_connections 2024-09-05T01:18:36.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.041+0000 7f168cfca640 1 -- 172.21.15.151:0/1940291677 wait complete. 2024-09-05T01:18:36.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.042+0000 7f168cfca640 1 Processor -- start 2024-09-05T01:18:36.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.042+0000 7f168cfca640 1 -- start start 2024-09-05T01:18:36.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.042+0000 7f168cfca640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16881026c0 0x7f1688197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:18:36.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.042+0000 7f168cfca640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1688104ff0 0x7f16881983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:18:36.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.042+0000 7f168cfca640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1688107920 0x7f168819f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:18:36.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.042+0000 7f168cfca640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f168810d8d0 con 0x7f1688104ff0 2024-09-05T01:18:36.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.042+0000 7f168cfca640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f168810d750 con 0x7f1688107920 2024-09-05T01:18:36.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.042+0000 7f168cfca640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f168810da50 con 0x7f16881026c0 2024-09-05T01:18:36.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.042+0000 7f168659c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16881026c0 0x7f1688197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:18:36.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.042+0000 7f168659c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16881026c0 0x7f1688197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53988/0 (socket says 172.21.15.151:53988) 2024-09-05T01:18:36.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.042+0000 7f168659c640 1 -- 172.21.15.151:0/420634335 learned_addr learned my addr 172.21.15.151:0/420634335 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-05T01:18:36.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.042+0000 7f1685d9b640 1 --2- 172.21.15.151:0/420634335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1688104ff0 0x7f16881983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:18:36.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.042+0000 7f168659c640 1 -- 172.21.15.151:0/420634335 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1688107920 msgr2=0x7f168819f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:18:36.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.042+0000 7f168659c640 1 --2- 172.21.15.151:0/420634335 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1688107920 0x7f168819f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:18:36.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.042+0000 7f168659c640 1 -- 172.21.15.151:0/420634335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1688104ff0 msgr2=0x7f16881983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:18:36.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.042+0000 7f168659c640 1 --2- 172.21.15.151:0/420634335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1688104ff0 0x7f16881983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:18:36.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.042+0000 7f168659c640 1 -- 172.21.15.151:0/420634335 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f168819faa0 con 0x7f16881026c0 2024-09-05T01:18:36.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.042+0000 7f168659c640 1 --2- 172.21.15.151:0/420634335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16881026c0 0x7f1688197e70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f167c00c920 tx=0x7f167c00cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:18:36.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.043+0000 7f16777fe640 1 -- 172.21.15.151:0/420634335 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c007c70 con 0x7f16881026c0 2024-09-05T01:18:36.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.043+0000 7f16777fe640 1 -- 172.21.15.151:0/420634335 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f167c007e10 con 0x7f16881026c0 2024-09-05T01:18:36.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.043+0000 7f168cfca640 1 -- 172.21.15.151:0/420634335 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f168819fd90 con 0x7f16881026c0 2024-09-05T01:18:36.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.043+0000 7f16777fe640 1 -- 172.21.15.151:0/420634335 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c018890 con 0x7f16881026c0 2024-09-05T01:18:36.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.043+0000 7f168cfca640 1 -- 172.21.15.151:0/420634335 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16881a02c0 con 0x7f16881026c0 2024-09-05T01:18:36.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.044+0000 7f168cfca640 1 -- 172.21.15.151:0/420634335 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16880fdd70 con 0x7f16881026c0 2024-09-05T01:18:36.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.045+0000 7f16777fe640 1 -- 172.21.15.151:0/420634335 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f167c018a30 con 0x7f16881026c0 2024-09-05T01:18:36.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.046+0000 7f16777fe640 1 --2- 172.21.15.151:0/420634335 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f16700a2c30 0x7f16700a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:18:36.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.046+0000 7f16777fe640 1 -- 172.21.15.151:0/420634335 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3805+0+0 (secure 0 0 0) 0x7f167c0cdfe0 con 0x7f16881026c0 2024-09-05T01:18:36.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.046+0000 7f1685d9b640 1 --2- 172.21.15.151:0/420634335 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f16700a2c30 0x7f16700a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:18:36.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.047+0000 7f1685d9b640 1 --2- 172.21.15.151:0/420634335 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f16700a2c30 0x7f16700a50f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1688199390 tx=0x7f1678008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:18:36.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.050+0000 7f16777fe640 1 -- 172.21.15.151:0/420634335 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f167c014030 con 0x7f16881026c0 2024-09-05T01:18:36.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:36.231+0000 7f168cfca640 1 -- 172.21.15.151:0/420634335 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1688062630 con 0x7f16700a2c30 2024-09-05T01:18:36.485 INFO:journalctl@ceph.osd.4.smithi145.stdout:Sep 05 01:18:36 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-4[45785]: 2024-09-05T01:18:36.230+0000 7fd336321640 -1 osd.4 0 waiting for initial osdmap 2024-09-05T01:18:36.485 INFO:journalctl@ceph.osd.4.smithi145.stdout:Sep 05 01:18:36 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-4[45785]: 2024-09-05T01:18:36.238+0000 7fd33295b640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T01:18:36.486 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:36 smithi145 ceph-mon[34376]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-05T01:18:36.486 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:36 smithi145 ceph-mon[34376]: from='osd.4 [v2:172.21.15.145:6808/1828591275,v1:172.21.15.145:6809/1828591275]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-05T01:18:36.486 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:36 smithi145 ceph-mon[34376]: osdmap e30: 5 total, 4 up, 5 in 2024-09-05T01:18:36.486 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:36 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T01:18:36.486 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:36 smithi145 ceph-mon[34376]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-05T01:18:36.486 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:36 smithi145 ceph-mon[34376]: Detected new or changed devices on smithi145 2024-09-05T01:18:36.486 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:36 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:36.486 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:36 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:36.486 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:36 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:18:36.487 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:36 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:18:36.487 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:36 smithi145 ceph-mon[34376]: Adjusting osd_memory_target on smithi145 to 8544M 2024-09-05T01:18:36.487 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:36 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:36.487 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:36 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:36.487 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:36 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:18:36.487 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:36 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:36.487 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:36 smithi145 ceph-mon[34376]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:36.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:36 smithi012 ceph-mon[29942]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-05T01:18:36.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:36 smithi012 ceph-mon[29942]: from='osd.4 [v2:172.21.15.145:6808/1828591275,v1:172.21.15.145:6809/1828591275]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-05T01:18:36.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:36 smithi012 ceph-mon[29942]: osdmap e30: 5 total, 4 up, 5 in 2024-09-05T01:18:36.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:36 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T01:18:36.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:36 smithi012 ceph-mon[29942]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-05T01:18:36.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:36 smithi012 ceph-mon[29942]: Detected new or changed devices on smithi145 2024-09-05T01:18:36.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:36 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:36.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:36 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:36.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:36 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:18:36.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:36 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:18:36.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:36 smithi012 ceph-mon[29942]: Adjusting osd_memory_target on smithi145 to 8544M 2024-09-05T01:18:36.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:36 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:36.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:36 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:36.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:36 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:18:36.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:36 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:36.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:36 smithi012 ceph-mon[29942]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:36.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:36 smithi151 ceph-mon[35013]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-05T01:18:36.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:36 smithi151 ceph-mon[35013]: from='osd.4 [v2:172.21.15.145:6808/1828591275,v1:172.21.15.145:6809/1828591275]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-05T01:18:36.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:36 smithi151 ceph-mon[35013]: osdmap e30: 5 total, 4 up, 5 in 2024-09-05T01:18:36.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:36 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T01:18:36.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:36 smithi151 ceph-mon[35013]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-05T01:18:36.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:36 smithi151 ceph-mon[35013]: Detected new or changed devices on smithi145 2024-09-05T01:18:36.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:36 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:36 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:36 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:18:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:36 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:18:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:36 smithi151 ceph-mon[35013]: Adjusting osd_memory_target on smithi145 to 8544M 2024-09-05T01:18:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:36 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:36 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:36 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:18:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:36 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:36 smithi151 ceph-mon[35013]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:37.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:37 smithi012 ceph-mon[29942]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-05T01:18:37.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:37 smithi012 ceph-mon[29942]: osdmap e31: 5 total, 4 up, 5 in 2024-09-05T01:18:37.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:37 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T01:18:37.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:37 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T01:18:37.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:37 smithi012 ceph-mon[29942]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:18:37.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:37 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:18:37.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:37 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:18:37.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:37 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:37.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:37 smithi145 ceph-mon[34376]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-05T01:18:37.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:37 smithi145 ceph-mon[34376]: osdmap e31: 5 total, 4 up, 5 in 2024-09-05T01:18:37.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:37 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T01:18:37.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:37 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T01:18:37.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:37 smithi145 ceph-mon[34376]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:18:37.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:37 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:18:37.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:37 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:18:37.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:37 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:37 smithi151 ceph-mon[35013]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-05T01:18:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:37 smithi151 ceph-mon[35013]: osdmap e31: 5 total, 4 up, 5 in 2024-09-05T01:18:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:37 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T01:18:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:37 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T01:18:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:37 smithi151 ceph-mon[35013]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:18:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:37 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:18:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:37 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:18:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:37 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:38.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:38 smithi012 ceph-mon[29942]: purged_snaps scrub starts 2024-09-05T01:18:38.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:38 smithi012 ceph-mon[29942]: purged_snaps scrub ok 2024-09-05T01:18:38.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:38 smithi012 ceph-mon[29942]: osd.4 [v2:172.21.15.145:6808/1828591275,v1:172.21.15.145:6809/1828591275] boot 2024-09-05T01:18:38.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:38 smithi012 ceph-mon[29942]: osdmap e32: 5 total, 5 up, 5 in 2024-09-05T01:18:38.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:38 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T01:18:38.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:38 smithi012 ceph-mon[29942]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:38.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:38 smithi145 ceph-mon[34376]: purged_snaps scrub starts 2024-09-05T01:18:38.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:38 smithi145 ceph-mon[34376]: purged_snaps scrub ok 2024-09-05T01:18:38.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:38 smithi145 ceph-mon[34376]: osd.4 [v2:172.21.15.145:6808/1828591275,v1:172.21.15.145:6809/1828591275] boot 2024-09-05T01:18:38.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:38 smithi145 ceph-mon[34376]: osdmap e32: 5 total, 5 up, 5 in 2024-09-05T01:18:38.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:38 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T01:18:38.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:38 smithi145 ceph-mon[34376]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:38.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:38 smithi151 ceph-mon[35013]: purged_snaps scrub starts 2024-09-05T01:18:38.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:38 smithi151 ceph-mon[35013]: purged_snaps scrub ok 2024-09-05T01:18:38.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:38 smithi151 ceph-mon[35013]: osd.4 [v2:172.21.15.145:6808/1828591275,v1:172.21.15.145:6809/1828591275] boot 2024-09-05T01:18:38.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:38 smithi151 ceph-mon[35013]: osdmap e32: 5 total, 5 up, 5 in 2024-09-05T01:18:38.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:38 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T01:18:38.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:38 smithi151 ceph-mon[35013]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-05T01:18:39.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:39 smithi151 ceph-mon[35013]: osdmap e33: 5 total, 5 up, 5 in 2024-09-05T01:18:39.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:39 smithi151 ceph-mon[35013]: from='client.? 172.21.15.151:0/2147216852' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e2c7e6fb-5dea-459f-8d7a-7ae5b1936218"}]: dispatch 2024-09-05T01:18:39.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:39 smithi151 ceph-mon[35013]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e2c7e6fb-5dea-459f-8d7a-7ae5b1936218"}]: dispatch 2024-09-05T01:18:39.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:39 smithi151 ceph-mon[35013]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e2c7e6fb-5dea-459f-8d7a-7ae5b1936218"}]': finished 2024-09-05T01:18:39.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:39 smithi151 ceph-mon[35013]: osdmap e34: 6 total, 5 up, 6 in 2024-09-05T01:18:39.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:39 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T01:18:39.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:39 smithi151 ceph-mon[35013]: from='client.? 172.21.15.151:0/1963231705' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:18:39.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:39 smithi012 ceph-mon[29942]: osdmap e33: 5 total, 5 up, 5 in 2024-09-05T01:18:39.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:39 smithi012 ceph-mon[29942]: from='client.? 172.21.15.151:0/2147216852' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e2c7e6fb-5dea-459f-8d7a-7ae5b1936218"}]: dispatch 2024-09-05T01:18:39.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:39 smithi012 ceph-mon[29942]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e2c7e6fb-5dea-459f-8d7a-7ae5b1936218"}]: dispatch 2024-09-05T01:18:39.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:39 smithi012 ceph-mon[29942]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e2c7e6fb-5dea-459f-8d7a-7ae5b1936218"}]': finished 2024-09-05T01:18:39.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:39 smithi012 ceph-mon[29942]: osdmap e34: 6 total, 5 up, 6 in 2024-09-05T01:18:39.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:39 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T01:18:39.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:39 smithi012 ceph-mon[29942]: from='client.? 172.21.15.151:0/1963231705' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:18:39.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:39 smithi145 ceph-mon[34376]: osdmap e33: 5 total, 5 up, 5 in 2024-09-05T01:18:39.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:39 smithi145 ceph-mon[34376]: from='client.? 172.21.15.151:0/2147216852' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e2c7e6fb-5dea-459f-8d7a-7ae5b1936218"}]: dispatch 2024-09-05T01:18:39.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:39 smithi145 ceph-mon[34376]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e2c7e6fb-5dea-459f-8d7a-7ae5b1936218"}]: dispatch 2024-09-05T01:18:39.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:39 smithi145 ceph-mon[34376]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e2c7e6fb-5dea-459f-8d7a-7ae5b1936218"}]': finished 2024-09-05T01:18:39.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:39 smithi145 ceph-mon[34376]: osdmap e34: 6 total, 5 up, 6 in 2024-09-05T01:18:39.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:39 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T01:18:39.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:39 smithi145 ceph-mon[34376]: from='client.? 172.21.15.151:0/1963231705' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:18:40.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:40 smithi012 ceph-mon[29942]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:40.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:40 smithi145 ceph-mon[34376]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:40.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:40 smithi151 ceph-mon[35013]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:42.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:42 smithi012 ceph-mon[29942]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:42.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:42 smithi145 ceph-mon[34376]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:42.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:42 smithi151 ceph-mon[35013]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:44.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:44 smithi012 ceph-mon[29942]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:44.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:44 smithi145 ceph-mon[34376]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:44.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:44 smithi151 ceph-mon[35013]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:46.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:46 smithi012 ceph-mon[29942]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:46.577 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:46 smithi151 ceph-mon[35013]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:46.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:46 smithi145 ceph-mon[34376]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:47.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:47 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-05T01:18:47.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:47 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:47.583 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:47 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-05T01:18:47.583 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:47 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:47.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:47 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-05T01:18:47.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:47 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:48.481 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:48 smithi151 ceph-mon[35013]: Deploying daemon osd.5 on smithi151 2024-09-05T01:18:48.481 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:48 smithi151 ceph-mon[35013]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:48.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:48 smithi012 ceph-mon[29942]: Deploying daemon osd.5 on smithi151 2024-09-05T01:18:48.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:48 smithi012 ceph-mon[29942]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:48.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:48 smithi145 ceph-mon[34376]: Deploying daemon osd.5 on smithi151 2024-09-05T01:18:48.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:48 smithi145 ceph-mon[34376]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:50.466 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:50 smithi151 ceph-mon[35013]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:50.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:50 smithi012 ceph-mon[29942]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:50.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:50 smithi145 ceph-mon[34376]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:52.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:52 smithi151 ceph-mon[35013]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:52.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:52 smithi012 ceph-mon[29942]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:52.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:52 smithi145 ceph-mon[34376]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:53.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:53 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:18:53.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:53 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:53.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:53 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:53.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:53 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:18:53.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:53 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:53.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:53 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:53.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:53 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:18:53.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:53 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:53.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:53 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:54.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:54 smithi012 ceph-mon[29942]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:54.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:54 smithi151 ceph-mon[35013]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:54.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:54 smithi145 ceph-mon[34376]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:55.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:55.540+0000 7f16777fe640 1 -- 172.21.15.151:0/420634335 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1688062630 con 0x7f16700a2c30 2024-09-05T01:18:55.541 INFO:teuthology.orchestra.run.smithi151.stdout:Created osd(s) 5 on host 'smithi151' 2024-09-05T01:18:55.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:55.542+0000 7f168cfca640 1 -- 172.21.15.151:0/420634335 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f16700a2c30 msgr2=0x7f16700a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:18:55.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:55.542+0000 7f168cfca640 1 --2- 172.21.15.151:0/420634335 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f16700a2c30 0x7f16700a50f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1688199390 tx=0x7f1678008040 comp rx=0 tx=0).stop 2024-09-05T01:18:55.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:55.542+0000 7f168cfca640 1 -- 172.21.15.151:0/420634335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16881026c0 msgr2=0x7f1688197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:18:55.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:55.542+0000 7f168cfca640 1 --2- 172.21.15.151:0/420634335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16881026c0 0x7f1688197e70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f167c00c920 tx=0x7f167c00cde0 comp rx=0 tx=0).stop 2024-09-05T01:18:55.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:55.542+0000 7f168cfca640 1 -- 172.21.15.151:0/420634335 shutdown_connections 2024-09-05T01:18:55.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:55.542+0000 7f168cfca640 1 --2- 172.21.15.151:0/420634335 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f16700a2c30 0x7f16700a50f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:18:55.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:55.542+0000 7f168cfca640 1 --2- 172.21.15.151:0/420634335 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1688107920 0x7f168819f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:18:55.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:55.542+0000 7f168cfca640 1 --2- 172.21.15.151:0/420634335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1688104ff0 0x7f16881983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:18:55.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:55.542+0000 7f168cfca640 1 --2- 172.21.15.151:0/420634335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16881026c0 0x7f1688197e70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:18:55.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:55.542+0000 7f168cfca640 1 -- 172.21.15.151:0/420634335 >> 172.21.15.151:0/420634335 conn(0x7f16880fc280 msgr2=0x7f1688102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:18:55.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:55.542+0000 7f168cfca640 1 -- 172.21.15.151:0/420634335 shutdown_connections 2024-09-05T01:18:55.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:18:55.542+0000 7f168cfca640 1 -- 172.21.15.151:0/420634335 wait complete. 2024-09-05T01:18:56.200 DEBUG:teuthology.orchestra.run.smithi151:osd.5> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.5.service 2024-09-05T01:18:56.202 INFO:tasks.cephadm:Deploying osd.6 on smithi012 with /dev/vg_nvme/lv_2... 2024-09-05T01:18:56.202 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-05T01:18:56.447 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:56 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:56.447 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:56 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:56.447 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:56 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:56.447 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:56 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:18:56.447 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:56 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:56.447 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:56 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:18:56.447 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:56 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:56.447 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:56 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:56.447 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:56 smithi151 ceph-mon[35013]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:56.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:56.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:56.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:56.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:18:56.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:56.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:18:56.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:56.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:56.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:56 smithi012 ceph-mon[29942]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:56.582 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:18:56.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:56 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:56.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:56 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:56.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:56 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:56.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:56 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:18:56.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:56 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:56.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:56 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:18:56.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:56 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:56.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:56 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:56.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:56 smithi145 ceph-mon[34376]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:58.406 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:58 smithi012 ceph-mon[29942]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:58.500 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:58 smithi151 ceph-mon[35013]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:58.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:58 smithi145 ceph-mon[34376]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:18:58.854 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:18:58 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:18:58.546+0000 7f1bb9307640 -1 osd.5 0 log_to_monitors true 2024-09-05T01:18:59.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:59 smithi012 ceph-mon[29942]: from='osd.5 [v2:172.21.15.151:6808/3888870109,v1:172.21.15.151:6809/3888870109]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-05T01:18:59.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:59 smithi012 ceph-mon[29942]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-05T01:18:59.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:59 smithi012 ceph-mon[29942]: Detected new or changed devices on smithi151 2024-09-05T01:18:59.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:59 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:59.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:59 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:59.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:59 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:18:59.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:59 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:18:59.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:59 smithi012 ceph-mon[29942]: Adjusting osd_memory_target on smithi151 to 8544M 2024-09-05T01:18:59.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:59 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:59.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:59 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:59.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:59 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:18:59.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:18:59 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:59.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:59 smithi145 ceph-mon[34376]: from='osd.5 [v2:172.21.15.151:6808/3888870109,v1:172.21.15.151:6809/3888870109]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-05T01:18:59.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:59 smithi145 ceph-mon[34376]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-05T01:18:59.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:59 smithi145 ceph-mon[34376]: Detected new or changed devices on smithi151 2024-09-05T01:18:59.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:59 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:59.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:59 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:59.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:59 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:18:59.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:59 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:18:59.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:59 smithi145 ceph-mon[34376]: Adjusting osd_memory_target on smithi151 to 8544M 2024-09-05T01:18:59.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:59 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:59.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:59 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:59.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:59 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:18:59.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:18:59 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:59.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:59 smithi151 ceph-mon[35013]: from='osd.5 [v2:172.21.15.151:6808/3888870109,v1:172.21.15.151:6809/3888870109]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-05T01:18:59.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:59 smithi151 ceph-mon[35013]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-05T01:18:59.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:59 smithi151 ceph-mon[35013]: Detected new or changed devices on smithi151 2024-09-05T01:18:59.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:59 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:59.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:59 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:59.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:59 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:18:59.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:59 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:18:59.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:59 smithi151 ceph-mon[35013]: Adjusting osd_memory_target on smithi151 to 8544M 2024-09-05T01:18:59.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:59 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:59.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:59 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:18:59.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:59 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:18:59.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:18:59 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:18:59.869 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:18:59.905 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi012:vg_nvme/lv_2 2024-09-05T01:19:00.279 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:19:00.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:00 smithi012 ceph-mon[29942]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-05T01:19:00.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:00 smithi012 ceph-mon[29942]: osdmap e35: 6 total, 5 up, 6 in 2024-09-05T01:19:00.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:00 smithi012 ceph-mon[29942]: from='osd.5 [v2:172.21.15.151:6808/3888870109,v1:172.21.15.151:6809/3888870109]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-09-05T01:19:00.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:00 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T01:19:00.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:00 smithi012 ceph-mon[29942]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-09-05T01:19:00.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:00 smithi012 ceph-mon[29942]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:19:00.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:00 smithi145 ceph-mon[34376]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-05T01:19:00.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:00 smithi145 ceph-mon[34376]: osdmap e35: 6 total, 5 up, 6 in 2024-09-05T01:19:00.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:00 smithi145 ceph-mon[34376]: from='osd.5 [v2:172.21.15.151:6808/3888870109,v1:172.21.15.151:6809/3888870109]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-09-05T01:19:00.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:00 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T01:19:00.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:00 smithi145 ceph-mon[34376]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-09-05T01:19:00.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:00 smithi145 ceph-mon[34376]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:19:00.604 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:19:00 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:19:00.232+0000 7f1bb4a67640 -1 osd.5 0 waiting for initial osdmap 2024-09-05T01:19:00.604 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:19:00 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:19:00.242+0000 7f1bb10a1640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T01:19:00.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:00 smithi151 ceph-mon[35013]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-05T01:19:00.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:00 smithi151 ceph-mon[35013]: osdmap e35: 6 total, 5 up, 6 in 2024-09-05T01:19:00.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:00 smithi151 ceph-mon[35013]: from='osd.5 [v2:172.21.15.151:6808/3888870109,v1:172.21.15.151:6809/3888870109]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-09-05T01:19:00.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T01:19:00.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:00 smithi151 ceph-mon[35013]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-09-05T01:19:00.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:00 smithi151 ceph-mon[35013]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:19:00.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.946+0000 7f6902600640 1 -- 172.21.15.12:0/3682472625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68fc074c50 msgr2=0x7f68fc0750b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:19:00.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.946+0000 7f6902600640 1 --2- 172.21.15.12:0/3682472625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68fc074c50 0x7f68fc0750b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f68e4009860 tx=0x7f68e402a340 comp rx=0 tx=0).stop 2024-09-05T01:19:00.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.947+0000 7f6902600640 1 -- 172.21.15.12:0/3682472625 shutdown_connections 2024-09-05T01:19:00.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.947+0000 7f6902600640 1 --2- 172.21.15.12:0/3682472625 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f68fc10e1e0 0x7f68fc1105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:19:00.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.947+0000 7f6902600640 1 --2- 172.21.15.12:0/3682472625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68fc074c50 0x7f68fc0750b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:19:00.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.947+0000 7f6902600640 1 --2- 172.21.15.12:0/3682472625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68fc076220 0x7f68fc074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:19:00.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.947+0000 7f6902600640 1 -- 172.21.15.12:0/3682472625 >> 172.21.15.12:0/3682472625 conn(0x7f68fc0fd390 msgr2=0x7f68fc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:19:00.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.947+0000 7f6902600640 1 -- 172.21.15.12:0/3682472625 shutdown_connections 2024-09-05T01:19:00.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.947+0000 7f6902600640 1 -- 172.21.15.12:0/3682472625 wait complete. 2024-09-05T01:19:00.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.948+0000 7f6902600640 1 Processor -- start 2024-09-05T01:19:00.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.948+0000 7f6902600640 1 -- start start 2024-09-05T01:19:00.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.948+0000 7f6902600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68fc074c50 0x7f68fc19e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:19:00.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.948+0000 7f6902600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68fc076220 0x7f68fc19ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:19:00.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.948+0000 7f6902600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f68fc10e1e0 0x7f68fc1a5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:19:00.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.948+0000 7f6902600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc113ea0 con 0x7f68fc074c50 2024-09-05T01:19:00.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.948+0000 7f6902600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc113d20 con 0x7f68fc10e1e0 2024-09-05T01:19:00.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.948+0000 7f6902600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc114020 con 0x7f68fc076220 2024-09-05T01:19:00.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.948+0000 7f68fb400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68fc074c50 0x7f68fc19e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:19:00.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.948+0000 7f68fb400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68fc074c50 0x7f68fc19e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37064/0 (socket says 172.21.15.12:37064) 2024-09-05T01:19:00.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.948+0000 7f68fb400640 1 -- 172.21.15.12:0/2191933992 learned_addr learned my addr 172.21.15.12:0/2191933992 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:19:00.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.949+0000 7f68f3e00640 1 --2- 172.21.15.12:0/2191933992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68fc076220 0x7f68fc19ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:19:00.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.949+0000 7f68fbe00640 1 --2- 172.21.15.12:0/2191933992 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f68fc10e1e0 0x7f68fc1a5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:19:00.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.949+0000 7f68fb400640 1 -- 172.21.15.12:0/2191933992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68fc076220 msgr2=0x7f68fc19ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:19:00.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.949+0000 7f68fb400640 1 --2- 172.21.15.12:0/2191933992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68fc076220 0x7f68fc19ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:19:00.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.949+0000 7f68fb400640 1 -- 172.21.15.12:0/2191933992 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f68fc10e1e0 msgr2=0x7f68fc1a5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:19:00.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.949+0000 7f68fb400640 1 --2- 172.21.15.12:0/2191933992 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f68fc10e1e0 0x7f68fc1a5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:19:00.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.949+0000 7f68fb400640 1 -- 172.21.15.12:0/2191933992 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68fc1a6160 con 0x7f68fc074c50 2024-09-05T01:19:00.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.949+0000 7f68fbe00640 1 --2- 172.21.15.12:0/2191933992 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f68fc10e1e0 0x7f68fc1a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:19:00.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.949+0000 7f68f3e00640 1 --2- 172.21.15.12:0/2191933992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68fc076220 0x7f68fc19ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:19:00.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.949+0000 7f68fb400640 1 --2- 172.21.15.12:0/2191933992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68fc074c50 0x7f68fc19e530 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00e9a0 tx=0x7f68ec00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:19:00.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.949+0000 7f68f8c00640 1 -- 172.21.15.12:0/2191933992 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec00cd80 con 0x7f68fc074c50 2024-09-05T01:19:00.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.949+0000 7f68f8c00640 1 -- 172.21.15.12:0/2191933992 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68ec0035f0 con 0x7f68fc074c50 2024-09-05T01:19:00.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.950+0000 7f6902600640 1 -- 172.21.15.12:0/2191933992 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68fc1a6450 con 0x7f68fc074c50 2024-09-05T01:19:00.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.950+0000 7f68f8c00640 1 -- 172.21.15.12:0/2191933992 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec010670 con 0x7f68fc074c50 2024-09-05T01:19:00.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.950+0000 7f6902600640 1 -- 172.21.15.12:0/2191933992 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68fc1a69b0 con 0x7f68fc074c50 2024-09-05T01:19:00.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.951+0000 7f6902600640 1 -- 172.21.15.12:0/2191933992 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68fc103b80 con 0x7f68fc074c50 2024-09-05T01:19:00.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.954+0000 7f68f8c00640 1 -- 172.21.15.12:0/2191933992 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f68ec0037a0 con 0x7f68fc074c50 2024-09-05T01:19:00.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.955+0000 7f68f8c00640 1 --2- 172.21.15.12:0/2191933992 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f68e00a2c30 0x7f68e00a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:19:00.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.955+0000 7f68f8c00640 1 -- 172.21.15.12:0/2191933992 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4253+0+0 (secure 0 0 0) 0x7f68ec0ce430 con 0x7f68fc074c50 2024-09-05T01:19:00.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.956+0000 7f68f3e00640 1 --2- 172.21.15.12:0/2191933992 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f68e00a2c30 0x7f68e00a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:19:00.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.956+0000 7f68f3e00640 1 --2- 172.21.15.12:0/2191933992 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f68e00a2c30 0x7f68e00a50f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f68e4009830 tx=0x7f68e4030550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:19:00.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:00.958+0000 7f68f8c00640 1 -- 172.21.15.12:0/2191933992 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f68ec09c360 con 0x7f68fc074c50 2024-09-05T01:19:01.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:01.154+0000 7f6902600640 1 -- 172.21.15.12:0/2191933992 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f68fc062630 con 0x7f68e00a2c30 2024-09-05T01:19:01.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:01 smithi012 ceph-mon[29942]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-09-05T01:19:01.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:01 smithi012 ceph-mon[29942]: osdmap e36: 6 total, 5 up, 6 in 2024-09-05T01:19:01.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:01 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T01:19:01.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:01 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T01:19:01.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:01 smithi012 ceph-mon[29942]: from='client.14328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:19:01.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:01 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:19:01.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:01 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:19:01.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:01 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:01.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:01 smithi145 ceph-mon[34376]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-09-05T01:19:01.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:01 smithi145 ceph-mon[34376]: osdmap e36: 6 total, 5 up, 6 in 2024-09-05T01:19:01.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:01 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T01:19:01.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:01 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T01:19:01.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:01 smithi145 ceph-mon[34376]: from='client.14328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:19:01.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:01 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:19:01.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:01 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:19:01.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:01 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:01.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:01 smithi151 ceph-mon[35013]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-09-05T01:19:01.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:01 smithi151 ceph-mon[35013]: osdmap e36: 6 total, 5 up, 6 in 2024-09-05T01:19:01.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:01 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T01:19:01.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:01 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T01:19:01.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:01 smithi151 ceph-mon[35013]: from='client.14328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:19:01.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:01 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:19:01.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:01 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:19:01.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:01 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:02.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:02 smithi012 ceph-mon[29942]: purged_snaps scrub starts 2024-09-05T01:19:02.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:02 smithi012 ceph-mon[29942]: purged_snaps scrub ok 2024-09-05T01:19:02.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:02 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T01:19:02.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:02 smithi012 ceph-mon[29942]: osd.5 [v2:172.21.15.151:6808/3888870109,v1:172.21.15.151:6809/3888870109] boot 2024-09-05T01:19:02.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:02 smithi012 ceph-mon[29942]: osdmap e37: 6 total, 6 up, 6 in 2024-09-05T01:19:02.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:02 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T01:19:02.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:02 smithi012 ceph-mon[29942]: osdmap e38: 6 total, 6 up, 6 in 2024-09-05T01:19:02.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:02 smithi012 ceph-mon[29942]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:19:02.505 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:02 smithi151 ceph-mon[35013]: purged_snaps scrub starts 2024-09-05T01:19:02.505 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:02 smithi151 ceph-mon[35013]: purged_snaps scrub ok 2024-09-05T01:19:02.505 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:02 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T01:19:02.505 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:02 smithi151 ceph-mon[35013]: osd.5 [v2:172.21.15.151:6808/3888870109,v1:172.21.15.151:6809/3888870109] boot 2024-09-05T01:19:02.505 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:02 smithi151 ceph-mon[35013]: osdmap e37: 6 total, 6 up, 6 in 2024-09-05T01:19:02.505 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:02 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T01:19:02.505 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:02 smithi151 ceph-mon[35013]: osdmap e38: 6 total, 6 up, 6 in 2024-09-05T01:19:02.506 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:02 smithi151 ceph-mon[35013]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:19:02.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:02 smithi145 ceph-mon[34376]: purged_snaps scrub starts 2024-09-05T01:19:02.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:02 smithi145 ceph-mon[34376]: purged_snaps scrub ok 2024-09-05T01:19:02.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:02 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T01:19:02.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:02 smithi145 ceph-mon[34376]: osd.5 [v2:172.21.15.151:6808/3888870109,v1:172.21.15.151:6809/3888870109] boot 2024-09-05T01:19:02.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:02 smithi145 ceph-mon[34376]: osdmap e37: 6 total, 6 up, 6 in 2024-09-05T01:19:02.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:02 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T01:19:02.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:02 smithi145 ceph-mon[34376]: osdmap e38: 6 total, 6 up, 6 in 2024-09-05T01:19:02.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:02 smithi145 ceph-mon[34376]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-05T01:19:03.992 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:03 smithi012 ceph-mon[29942]: osdmap e39: 6 total, 6 up, 6 in 2024-09-05T01:19:04.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:03 smithi145 ceph-mon[34376]: osdmap e39: 6 total, 6 up, 6 in 2024-09-05T01:19:04.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:03 smithi151 ceph-mon[35013]: osdmap e39: 6 total, 6 up, 6 in 2024-09-05T01:19:05.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:04 smithi012 ceph-mon[29942]: osdmap e40: 6 total, 6 up, 6 in 2024-09-05T01:19:05.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:04 smithi012 ceph-mon[29942]: pgmap v141: 1 pgs: 1 peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-05T01:19:05.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:04 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/1158772401' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0df0a29c-3404-4ff5-ae48-78b69b77cbd6"}]: dispatch 2024-09-05T01:19:05.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:04 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/1158772401' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0df0a29c-3404-4ff5-ae48-78b69b77cbd6"}]': finished 2024-09-05T01:19:05.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:04 smithi012 ceph-mon[29942]: osdmap e41: 7 total, 6 up, 7 in 2024-09-05T01:19:05.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:04 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T01:19:05.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:04 smithi145 ceph-mon[34376]: osdmap e40: 6 total, 6 up, 6 in 2024-09-05T01:19:05.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:04 smithi145 ceph-mon[34376]: pgmap v141: 1 pgs: 1 peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-05T01:19:05.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:04 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/1158772401' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0df0a29c-3404-4ff5-ae48-78b69b77cbd6"}]: dispatch 2024-09-05T01:19:05.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:04 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/1158772401' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0df0a29c-3404-4ff5-ae48-78b69b77cbd6"}]': finished 2024-09-05T01:19:05.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:04 smithi145 ceph-mon[34376]: osdmap e41: 7 total, 6 up, 7 in 2024-09-05T01:19:05.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:04 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T01:19:05.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:04 smithi151 ceph-mon[35013]: osdmap e40: 6 total, 6 up, 6 in 2024-09-05T01:19:05.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:04 smithi151 ceph-mon[35013]: pgmap v141: 1 pgs: 1 peering; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-05T01:19:05.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:04 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/1158772401' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0df0a29c-3404-4ff5-ae48-78b69b77cbd6"}]: dispatch 2024-09-05T01:19:05.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:04 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/1158772401' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0df0a29c-3404-4ff5-ae48-78b69b77cbd6"}]': finished 2024-09-05T01:19:05.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:04 smithi151 ceph-mon[35013]: osdmap e41: 7 total, 6 up, 7 in 2024-09-05T01:19:05.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:04 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T01:19:06.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:05 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/153325618' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:19:06.103 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:05 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/153325618' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:19:06.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:05 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/153325618' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:19:07.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:06 smithi145 ceph-mon[34376]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 133 KiB/s, 0 objects/s recovering 2024-09-05T01:19:07.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:06 smithi151 ceph-mon[35013]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 133 KiB/s, 0 objects/s recovering 2024-09-05T01:19:07.311 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:06 smithi012 ceph-mon[29942]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 133 KiB/s, 0 objects/s recovering 2024-09-05T01:19:08.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:08 smithi012 ceph-mon[29942]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-05T01:19:08.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:08 smithi145 ceph-mon[34376]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-05T01:19:08.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:08 smithi151 ceph-mon[35013]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-05T01:19:10.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:10 smithi012 ceph-mon[29942]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-05T01:19:10.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:10 smithi145 ceph-mon[34376]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-05T01:19:10.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:10 smithi151 ceph-mon[35013]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-05T01:19:12.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:12 smithi012 ceph-mon[29942]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-05T01:19:12.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:12 smithi145 ceph-mon[34376]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-05T01:19:12.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:12 smithi151 ceph-mon[35013]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-05T01:19:14.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:14 smithi012 ceph-mon[29942]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-05T01:19:14.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:14 smithi145 ceph-mon[34376]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-05T01:19:14.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:14 smithi151 ceph-mon[35013]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-05T01:19:15.377 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:15 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-05T01:19:15.377 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:15 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:15.377 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:15 smithi012 ceph-mon[29942]: Deploying daemon osd.6 on smithi012 2024-09-05T01:19:15.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:15 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-05T01:19:15.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:15 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:15.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:15 smithi145 ceph-mon[34376]: Deploying daemon osd.6 on smithi012 2024-09-05T01:19:15.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:15 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-05T01:19:15.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:15 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:15.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:15 smithi151 ceph-mon[35013]: Deploying daemon osd.6 on smithi012 2024-09-05T01:19:16.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:16 smithi012 ceph-mon[29942]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-05T01:19:16.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:16 smithi145 ceph-mon[34376]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-05T01:19:16.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:16 smithi151 ceph-mon[35013]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-05T01:19:18.358 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:18 smithi012 ceph-mon[29942]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-05T01:19:18.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:18 smithi145 ceph-mon[34376]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-05T01:19:18.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:18 smithi151 ceph-mon[35013]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-05T01:19:20.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:20 smithi012 ceph-mon[29942]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-05T01:19:20.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:20 smithi145 ceph-mon[34376]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-05T01:19:20.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:20 smithi151 ceph-mon[35013]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-05T01:19:21.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:21 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:19:21.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:21 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:21.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:21 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:21.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:21 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:19:21.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:21 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:21.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:21 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:21.853 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:21 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:19:21.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:21 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:21.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:21 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:22.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:22 smithi012 ceph-mon[29942]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-05T01:19:22.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:22 smithi145 ceph-mon[34376]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-05T01:19:22.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:22 smithi151 ceph-mon[35013]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-05T01:19:24.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:24 smithi012 ceph-mon[29942]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-05T01:19:24.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:24 smithi145 ceph-mon[34376]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-05T01:19:24.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:24 smithi151 ceph-mon[35013]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-05T01:19:25.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:25.928+0000 7f68f8c00640 1 -- 172.21.15.12:0/2191933992 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f68fc062630 con 0x7f68e00a2c30 2024-09-05T01:19:25.929 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 6 on host 'smithi012' 2024-09-05T01:19:25.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:25.930+0000 7f6902600640 1 -- 172.21.15.12:0/2191933992 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f68e00a2c30 msgr2=0x7f68e00a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:19:25.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:25.930+0000 7f6902600640 1 --2- 172.21.15.12:0/2191933992 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f68e00a2c30 0x7f68e00a50f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f68e4009830 tx=0x7f68e4030550 comp rx=0 tx=0).stop 2024-09-05T01:19:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:25.930+0000 7f6902600640 1 -- 172.21.15.12:0/2191933992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68fc074c50 msgr2=0x7f68fc19e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:19:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:25.930+0000 7f6902600640 1 --2- 172.21.15.12:0/2191933992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68fc074c50 0x7f68fc19e530 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00e9a0 tx=0x7f68ec00ee60 comp rx=0 tx=0).stop 2024-09-05T01:19:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:25.930+0000 7f6902600640 1 -- 172.21.15.12:0/2191933992 shutdown_connections 2024-09-05T01:19:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:25.930+0000 7f6902600640 1 --2- 172.21.15.12:0/2191933992 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f68e00a2c30 0x7f68e00a50f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:19:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:25.930+0000 7f6902600640 1 --2- 172.21.15.12:0/2191933992 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f68fc10e1e0 0x7f68fc1a5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:19:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:25.930+0000 7f6902600640 1 --2- 172.21.15.12:0/2191933992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68fc076220 0x7f68fc19ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:19:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:25.930+0000 7f6902600640 1 --2- 172.21.15.12:0/2191933992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68fc074c50 0x7f68fc19e530 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:19:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:25.930+0000 7f6902600640 1 -- 172.21.15.12:0/2191933992 >> 172.21.15.12:0/2191933992 conn(0x7f68fc0fd390 msgr2=0x7f68fc0ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:19:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:25.931+0000 7f6902600640 1 -- 172.21.15.12:0/2191933992 shutdown_connections 2024-09-05T01:19:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:19:25.931+0000 7f6902600640 1 -- 172.21.15.12:0/2191933992 wait complete. 2024-09-05T01:19:25.993 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:25 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:25.993 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:25 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:25.993 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:25 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:25.993 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:25 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:19:25.993 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:25 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:26.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:25 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:26.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:25 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:26.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:25 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:26.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:25 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:19:26.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:25 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:26.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:25 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:26.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:25 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:26.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:25 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:26.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:25 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:19:26.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:25 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:26.710 DEBUG:teuthology.orchestra.run.smithi012:osd.6> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.6.service 2024-09-05T01:19:26.715 INFO:tasks.cephadm:Deploying osd.7 on smithi145 with /dev/vg_nvme/lv_2... 2024-09-05T01:19:26.715 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-05T01:19:26.925 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:26 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:19:26.925 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:26 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:26.925 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:26 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:26.925 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:26 smithi012 ceph-mon[29942]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-05T01:19:26.968 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T01:19:27.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:26 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:19:27.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:26 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:27.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:26 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:27.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:26 smithi145 ceph-mon[34376]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-05T01:19:27.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:26 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:19:27.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:26 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:27.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:26 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:27.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:26 smithi151 ceph-mon[35013]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-05T01:19:27.933 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:19:27 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:19:27.857+0000 7ffa48052640 -1 osd.6 0 log_to_monitors true 2024-09-05T01:19:28.028 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:27 smithi145 ceph-mon[34376]: from='osd.6 [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-05T01:19:28.299 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:27 smithi012 ceph-mon[29942]: from='osd.6 [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-05T01:19:28.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:27 smithi151 ceph-mon[35013]: from='osd.6 [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-05T01:19:29.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:28 smithi012 ceph-mon[29942]: from='osd.6 [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-05T01:19:29.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:28 smithi012 ceph-mon[29942]: osdmap e42: 7 total, 6 up, 7 in 2024-09-05T01:19:29.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:28 smithi012 ceph-mon[29942]: from='osd.6 [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-05T01:19:29.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:28 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T01:19:29.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:28 smithi012 ceph-mon[29942]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-05T01:19:29.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:28 smithi145 ceph-mon[34376]: from='osd.6 [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-05T01:19:29.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:28 smithi145 ceph-mon[34376]: osdmap e42: 7 total, 6 up, 7 in 2024-09-05T01:19:29.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:28 smithi145 ceph-mon[34376]: from='osd.6 [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-05T01:19:29.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:28 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T01:19:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:28 smithi145 ceph-mon[34376]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-05T01:19:29.347 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-05T01:19:29.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:28 smithi151 ceph-mon[35013]: from='osd.6 [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-05T01:19:29.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:28 smithi151 ceph-mon[35013]: osdmap e42: 7 total, 6 up, 7 in 2024-09-05T01:19:29.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:28 smithi151 ceph-mon[35013]: from='osd.6 [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-05T01:19:29.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:28 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T01:19:29.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:28 smithi151 ceph-mon[35013]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-05T01:19:29.373 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi145:vg_nvme/lv_2 2024-09-05T01:19:29.618 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T01:19:30.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.059+0000 7fcf3a1e0640 1 -- 172.21.15.145:0/3094482558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf34102690 msgr2=0x7fcf34108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:19:30.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.059+0000 7fcf3a1e0640 1 --2- 172.21.15.145:0/3094482558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf34102690 0x7fcf34108f20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009ca0 tx=0x7fcf2c02a8c0 comp rx=0 tx=0).stop 2024-09-05T01:19:30.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.059+0000 7fcf3a1e0640 1 -- 172.21.15.145:0/3094482558 shutdown_connections 2024-09-05T01:19:30.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.059+0000 7fcf3a1e0640 1 --2- 172.21.15.145:0/3094482558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf34102690 0x7fcf34108f20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:19:30.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.059+0000 7fcf3a1e0640 1 --2- 172.21.15.145:0/3094482558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf34101cd0 0x7fcf34102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:19:30.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.059+0000 7fcf3a1e0640 1 --2- 172.21.15.145:0/3094482558 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf34100ad0 0x7fcf34100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:19:30.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.059+0000 7fcf3a1e0640 1 -- 172.21.15.145:0/3094482558 >> 172.21.15.145:0/3094482558 conn(0x7fcf340fc280 msgr2=0x7fcf340fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:19:30.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.059+0000 7fcf3a1e0640 1 -- 172.21.15.145:0/3094482558 shutdown_connections 2024-09-05T01:19:30.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.059+0000 7fcf3a1e0640 1 -- 172.21.15.145:0/3094482558 wait complete. 2024-09-05T01:19:30.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.059+0000 7fcf3a1e0640 1 Processor -- start 2024-09-05T01:19:30.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.060+0000 7fcf3a1e0640 1 -- start start 2024-09-05T01:19:30.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.060+0000 7fcf3a1e0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf34100ad0 0x7fcf34197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:19:30.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.060+0000 7fcf3a1e0640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf34101cd0 0x7fcf341983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:19:30.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.060+0000 7fcf3a1e0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf34102690 0x7fcf3419f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:19:30.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.060+0000 7fcf3a1e0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcf3410c750 con 0x7fcf34100ad0 2024-09-05T01:19:30.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.060+0000 7fcf3a1e0640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fcf3410c5d0 con 0x7fcf34101cd0 2024-09-05T01:19:30.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.060+0000 7fcf3a1e0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcf3410c8d0 con 0x7fcf34102690 2024-09-05T01:19:30.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.060+0000 7fcf32ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf34101cd0 0x7fcf341983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:19:30.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.060+0000 7fcf32ffd640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf34101cd0 0x7fcf341983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:46822/0 (socket says 172.21.15.145:46822) 2024-09-05T01:19:30.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.060+0000 7fcf32ffd640 1 -- 172.21.15.145:0/1998063388 learned_addr learned my addr 172.21.15.145:0/1998063388 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-05T01:19:30.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.060+0000 7fcf33fff640 1 --2- 172.21.15.145:0/1998063388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf34102690 0x7fcf3419f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:19:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.060+0000 7fcf337fe640 1 --2- 172.21.15.145:0/1998063388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf34100ad0 0x7fcf34197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:19:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.060+0000 7fcf32ffd640 1 -- 172.21.15.145:0/1998063388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf34102690 msgr2=0x7fcf3419f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:19:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.060+0000 7fcf32ffd640 1 --2- 172.21.15.145:0/1998063388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf34102690 0x7fcf3419f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:19:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.060+0000 7fcf32ffd640 1 -- 172.21.15.145:0/1998063388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf34100ad0 msgr2=0x7fcf34197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:19:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.060+0000 7fcf32ffd640 1 --2- 172.21.15.145:0/1998063388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf34100ad0 0x7fcf34197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:19:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.060+0000 7fcf32ffd640 1 -- 172.21.15.145:0/1998063388 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf3419fab0 con 0x7fcf34101cd0 2024-09-05T01:19:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.060+0000 7fcf32ffd640 1 --2- 172.21.15.145:0/1998063388 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf34101cd0 0x7fcf341983c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcf2400d950 tx=0x7fcf2400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:19:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.060+0000 7fcf30ff9640 1 -- 172.21.15.145:0/1998063388 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf24017070 con 0x7fcf34101cd0 2024-09-05T01:19:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.061+0000 7fcf30ff9640 1 -- 172.21.15.145:0/1998063388 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf24009c30 con 0x7fcf34101cd0 2024-09-05T01:19:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.061+0000 7fcf3a1e0640 1 -- 172.21.15.145:0/1998063388 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf3419fda0 con 0x7fcf34101cd0 2024-09-05T01:19:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.061+0000 7fcf30ff9640 1 -- 172.21.15.145:0/1998063388 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf2400f6b0 con 0x7fcf34101cd0 2024-09-05T01:19:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.061+0000 7fcf3a1e0640 1 -- 172.21.15.145:0/1998063388 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf341a0260 con 0x7fcf34101cd0 2024-09-05T01:19:30.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.062+0000 7fcf3a1e0640 1 -- 172.21.15.145:0/1998063388 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf341a04c0 con 0x7fcf34101cd0 2024-09-05T01:19:30.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.063+0000 7fcf30ff9640 1 -- 172.21.15.145:0/1998063388 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fcf240109d0 con 0x7fcf34101cd0 2024-09-05T01:19:30.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.063+0000 7fcf30ff9640 1 --2- 172.21.15.145:0/1998063388 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fcf1c0a2c30 0x7fcf1c0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:19:30.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.063+0000 7fcf30ff9640 1 -- 172.21.15.145:0/1998063388 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4685+0+0 (secure 0 0 0) 0x7fcf240cdca0 con 0x7fcf34101cd0 2024-09-05T01:19:30.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.063+0000 7fcf337fe640 1 --2- 172.21.15.145:0/1998063388 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fcf1c0a2c30 0x7fcf1c0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:19:30.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.064+0000 7fcf337fe640 1 --2- 172.21.15.145:0/1998063388 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fcf1c0a2c30 0x7fcf1c0a50f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcf28005fd0 tx=0x7fcf2800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:19:30.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.068+0000 7fcf30ff9640 1 -- 172.21.15.145:0/1998063388 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcf2409b3e0 con 0x7fcf34101cd0 2024-09-05T01:19:30.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:30.252+0000 7fcf3a1e0640 1 -- 172.21.15.145:0/1998063388 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fcf3406a680 con 0x7fcf1c0a2c30 2024-09-05T01:19:30.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:29 smithi145 ceph-mon[34376]: from='osd.6 [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-05T01:19:30.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:29 smithi145 ceph-mon[34376]: osdmap e43: 7 total, 6 up, 7 in 2024-09-05T01:19:30.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:29 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T01:19:30.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:29 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T01:19:30.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:29 smithi012 ceph-mon[29942]: from='osd.6 [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-05T01:19:30.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:29 smithi012 ceph-mon[29942]: osdmap e43: 7 total, 6 up, 7 in 2024-09-05T01:19:30.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:29 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T01:19:30.285 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:29 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T01:19:30.286 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:19:29 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:19:29.982+0000 7ffa42200640 -1 osd.6 0 waiting for initial osdmap 2024-09-05T01:19:30.286 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:19:30 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:19:30.011+0000 7ffa38c00640 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T01:19:30.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:29 smithi151 ceph-mon[35013]: from='osd.6 [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-05T01:19:30.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:29 smithi151 ceph-mon[35013]: osdmap e43: 7 total, 6 up, 7 in 2024-09-05T01:19:30.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:29 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T01:19:30.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:29 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T01:19:31.200 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:30 smithi012 ceph-mon[29942]: purged_snaps scrub starts 2024-09-05T01:19:31.200 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:30 smithi012 ceph-mon[29942]: purged_snaps scrub ok 2024-09-05T01:19:31.200 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:30 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T01:19:31.200 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:30 smithi012 ceph-mon[29942]: from='osd.6 [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269]' entity='osd.6' 2024-09-05T01:19:31.200 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:30 smithi012 ceph-mon[29942]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-05T01:19:31.200 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:30 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:19:31.200 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:30 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:19:31.200 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:30 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:31.201 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:30 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:31.201 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:30 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:31.201 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:30 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:19:31.201 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:30 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:19:31.201 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:30 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:19:31.201 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:30 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:31.201 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:30 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:31.201 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:30 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:19:31.201 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:30 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:31.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:30 smithi145 ceph-mon[34376]: purged_snaps scrub starts 2024-09-05T01:19:31.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:30 smithi145 ceph-mon[34376]: purged_snaps scrub ok 2024-09-05T01:19:31.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:30 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T01:19:31.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:30 smithi145 ceph-mon[34376]: from='osd.6 [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269]' entity='osd.6' 2024-09-05T01:19:31.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:30 smithi145 ceph-mon[34376]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-05T01:19:31.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:30 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:19:31.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:30 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:19:31.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:30 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:31.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:30 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:31.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:30 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:31.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:30 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:19:31.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:30 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:19:31.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:30 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:19:31.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:30 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:31.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:30 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:31.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:30 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:19:31.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:30 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:31.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:30 smithi151 ceph-mon[35013]: purged_snaps scrub starts 2024-09-05T01:19:31.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:30 smithi151 ceph-mon[35013]: purged_snaps scrub ok 2024-09-05T01:19:31.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:30 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T01:19:31.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:30 smithi151 ceph-mon[35013]: from='osd.6 [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269]' entity='osd.6' 2024-09-05T01:19:31.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:30 smithi151 ceph-mon[35013]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-05T01:19:31.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:30 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:19:31.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:30 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:19:31.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:30 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:31.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:30 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:31.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:30 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:31.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:30 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:19:31.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:30 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:19:31.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:30 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:19:31.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:30 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:31.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:30 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:31.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:30 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:19:31.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:30 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:32.255 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:31 smithi151 ceph-mon[35013]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:19:32.255 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:31 smithi151 ceph-mon[35013]: Detected new or changed devices on smithi012 2024-09-05T01:19:32.255 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:31 smithi151 ceph-mon[35013]: Adjusting osd_memory_target on smithi012 to 5698M 2024-09-05T01:19:32.255 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:31 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T01:19:32.256 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:31 smithi151 ceph-mon[35013]: osd.6 [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269] boot 2024-09-05T01:19:32.256 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:31 smithi151 ceph-mon[35013]: osdmap e44: 7 total, 7 up, 7 in 2024-09-05T01:19:32.256 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:31 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T01:19:32.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:31 smithi012 ceph-mon[29942]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:19:32.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:31 smithi012 ceph-mon[29942]: Detected new or changed devices on smithi012 2024-09-05T01:19:32.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:31 smithi012 ceph-mon[29942]: Adjusting osd_memory_target on smithi012 to 5698M 2024-09-05T01:19:32.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:31 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T01:19:32.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:31 smithi012 ceph-mon[29942]: osd.6 [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269] boot 2024-09-05T01:19:32.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:31 smithi012 ceph-mon[29942]: osdmap e44: 7 total, 7 up, 7 in 2024-09-05T01:19:32.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:31 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T01:19:32.326 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:31 smithi145 ceph-mon[34376]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:19:32.326 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:31 smithi145 ceph-mon[34376]: Detected new or changed devices on smithi012 2024-09-05T01:19:32.326 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:31 smithi145 ceph-mon[34376]: Adjusting osd_memory_target on smithi012 to 5698M 2024-09-05T01:19:32.326 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:31 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T01:19:32.326 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:31 smithi145 ceph-mon[34376]: osd.6 [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269] boot 2024-09-05T01:19:32.326 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:31 smithi145 ceph-mon[34376]: osdmap e44: 7 total, 7 up, 7 in 2024-09-05T01:19:32.326 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:31 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T01:19:33.230 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:33 smithi145 ceph-mon[34376]: osdmap e45: 7 total, 7 up, 7 in 2024-09-05T01:19:33.231 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:33 smithi145 ceph-mon[34376]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:33.231 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:33 smithi145 ceph-mon[34376]: from='client.? 172.21.15.145:0/1620115486' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7b3ad7c-a566-435c-9ef8-837bb764acb3"}]: dispatch 2024-09-05T01:19:33.231 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:33 smithi145 ceph-mon[34376]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7b3ad7c-a566-435c-9ef8-837bb764acb3"}]: dispatch 2024-09-05T01:19:33.231 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:33 smithi145 ceph-mon[34376]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7b3ad7c-a566-435c-9ef8-837bb764acb3"}]': finished 2024-09-05T01:19:33.231 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:33 smithi145 ceph-mon[34376]: osdmap e46: 8 total, 7 up, 8 in 2024-09-05T01:19:33.231 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:33 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T01:19:33.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:32 smithi012 ceph-mon[29942]: osdmap e45: 7 total, 7 up, 7 in 2024-09-05T01:19:33.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:32 smithi012 ceph-mon[29942]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:33.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:32 smithi012 ceph-mon[29942]: from='client.? 172.21.15.145:0/1620115486' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7b3ad7c-a566-435c-9ef8-837bb764acb3"}]: dispatch 2024-09-05T01:19:33.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:32 smithi012 ceph-mon[29942]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7b3ad7c-a566-435c-9ef8-837bb764acb3"}]: dispatch 2024-09-05T01:19:33.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:32 smithi012 ceph-mon[29942]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7b3ad7c-a566-435c-9ef8-837bb764acb3"}]': finished 2024-09-05T01:19:33.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:32 smithi012 ceph-mon[29942]: osdmap e46: 8 total, 7 up, 8 in 2024-09-05T01:19:33.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:32 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T01:19:33.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:32 smithi151 ceph-mon[35013]: osdmap e45: 7 total, 7 up, 7 in 2024-09-05T01:19:33.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:32 smithi151 ceph-mon[35013]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:33.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:32 smithi151 ceph-mon[35013]: from='client.? 172.21.15.145:0/1620115486' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7b3ad7c-a566-435c-9ef8-837bb764acb3"}]: dispatch 2024-09-05T01:19:33.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:32 smithi151 ceph-mon[35013]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7b3ad7c-a566-435c-9ef8-837bb764acb3"}]: dispatch 2024-09-05T01:19:33.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:32 smithi151 ceph-mon[35013]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7b3ad7c-a566-435c-9ef8-837bb764acb3"}]': finished 2024-09-05T01:19:33.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:32 smithi151 ceph-mon[35013]: osdmap e46: 8 total, 7 up, 8 in 2024-09-05T01:19:33.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:32 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T01:19:34.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:34 smithi012 ceph-mon[29942]: from='client.? 172.21.15.145:0/398730245' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:19:34.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:34 smithi145 ceph-mon[34376]: from='client.? 172.21.15.145:0/398730245' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:19:34.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:34 smithi151 ceph-mon[35013]: from='client.? 172.21.15.145:0/398730245' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:19:35.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:35 smithi012 ceph-mon[29942]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:35.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:35 smithi145 ceph-mon[34376]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:35.353 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:35 smithi151 ceph-mon[35013]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:36.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:36 smithi012 ceph-mon[29942]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:36.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:36 smithi145 ceph-mon[34376]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:36.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:36 smithi151 ceph-mon[35013]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:38.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:38 smithi145 ceph-mon[34376]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:38.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:38 smithi012 ceph-mon[29942]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:38.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:38 smithi151 ceph-mon[35013]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:40.319 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:40 smithi145 ceph-mon[34376]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:40.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:40 smithi012 ceph-mon[29942]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:40.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:40 smithi151 ceph-mon[35013]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:41.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:41 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-05T01:19:41.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:41 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:41.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:41 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-05T01:19:41.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:41 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:41.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:41 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-05T01:19:41.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:41 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:42.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:42 smithi151 ceph-mon[35013]: Deploying daemon osd.7 on smithi145 2024-09-05T01:19:42.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:42 smithi151 ceph-mon[35013]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:42.640 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:42 smithi145 ceph-mon[34376]: Deploying daemon osd.7 on smithi145 2024-09-05T01:19:42.641 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:42 smithi145 ceph-mon[34376]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:42.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:42 smithi012 ceph-mon[29942]: Deploying daemon osd.7 on smithi145 2024-09-05T01:19:42.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:42 smithi012 ceph-mon[29942]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:44.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:44 smithi012 ceph-mon[29942]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:44.572 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:44 smithi145 ceph-mon[34376]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:44.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:44 smithi151 ceph-mon[35013]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:46.406 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:46 smithi145 ceph-mon[34376]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:46.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:46 smithi012 ceph-mon[29942]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:46.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:46 smithi151 ceph-mon[35013]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:47.301 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:47 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:19:47.302 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:47 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:47.302 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:47 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:47.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:47 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:19:47.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:47 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:47.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:47 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:47 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:19:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:47 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:47 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:48.492 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:48 smithi145 ceph-mon[34376]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:48.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:48 smithi012 ceph-mon[29942]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:48.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:48 smithi151 ceph-mon[35013]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:50.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:50.202+0000 7fcf30ff9640 1 -- 172.21.15.145:0/1998063388 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcf3406a680 con 0x7fcf1c0a2c30 2024-09-05T01:19:50.203 INFO:teuthology.orchestra.run.smithi145.stdout:Created osd(s) 7 on host 'smithi145' 2024-09-05T01:19:50.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:50.204+0000 7fcf3a1e0640 1 -- 172.21.15.145:0/1998063388 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fcf1c0a2c30 msgr2=0x7fcf1c0a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:19:50.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:50.204+0000 7fcf3a1e0640 1 --2- 172.21.15.145:0/1998063388 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fcf1c0a2c30 0x7fcf1c0a50f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcf28005fd0 tx=0x7fcf2800b390 comp rx=0 tx=0).stop 2024-09-05T01:19:50.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:50.204+0000 7fcf3a1e0640 1 -- 172.21.15.145:0/1998063388 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf34101cd0 msgr2=0x7fcf341983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:19:50.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:50.204+0000 7fcf3a1e0640 1 --2- 172.21.15.145:0/1998063388 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf34101cd0 0x7fcf341983c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcf2400d950 tx=0x7fcf2400de10 comp rx=0 tx=0).stop 2024-09-05T01:19:50.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:50.204+0000 7fcf3a1e0640 1 -- 172.21.15.145:0/1998063388 shutdown_connections 2024-09-05T01:19:50.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:50.204+0000 7fcf3a1e0640 1 --2- 172.21.15.145:0/1998063388 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fcf1c0a2c30 0x7fcf1c0a50f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:19:50.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:50.204+0000 7fcf3a1e0640 1 --2- 172.21.15.145:0/1998063388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf34102690 0x7fcf3419f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:19:50.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:50.204+0000 7fcf3a1e0640 1 --2- 172.21.15.145:0/1998063388 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf34101cd0 0x7fcf341983c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:19:50.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:50.204+0000 7fcf3a1e0640 1 --2- 172.21.15.145:0/1998063388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf34100ad0 0x7fcf34197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:19:50.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:50.204+0000 7fcf3a1e0640 1 -- 172.21.15.145:0/1998063388 >> 172.21.15.145:0/1998063388 conn(0x7fcf340fc280 msgr2=0x7fcf34069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:19:50.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:50.204+0000 7fcf3a1e0640 1 -- 172.21.15.145:0/1998063388 shutdown_connections 2024-09-05T01:19:50.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:19:50.204+0000 7fcf3a1e0640 1 -- 172.21.15.145:0/1998063388 wait complete. 2024-09-05T01:19:50.526 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:50 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:50.527 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:50 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:50.527 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:50 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:50.527 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:50 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:19:50.527 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:50 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:50.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:50.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:50.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:50.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:19:50.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:50.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:50 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:50.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:50 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:50.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:50 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:50.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:50 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:19:50.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:50 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:50.857 DEBUG:teuthology.orchestra.run.smithi145:osd.7> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.7.service 2024-09-05T01:19:50.859 INFO:tasks.cephadm:Deploying osd.8 on smithi151 with /dev/vg_nvme/lv_2... 2024-09-05T01:19:50.859 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-05T01:19:51.114 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T01:19:51.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:51 smithi012 ceph-mon[29942]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:51.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:51 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:19:51.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:51 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:51.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:51 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:51.442 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:51 smithi151 ceph-mon[35013]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:51.442 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:51 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:19:51.442 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:51 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:51.442 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:51 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:51.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:51 smithi145 ceph-mon[34376]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:51.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:51 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:19:51.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:51 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:51.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:51 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:52.833 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:19:52 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:19:52.570+0000 7fa19f04a640 -1 osd.7 0 log_to_monitors true 2024-09-05T01:19:53.322 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:53 smithi145 ceph-mon[34376]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:53.322 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:53 smithi145 ceph-mon[34376]: from='osd.7 [v2:172.21.15.145:6816/3058588721,v1:172.21.15.145:6817/3058588721]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-05T01:19:53.323 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:53 smithi145 ceph-mon[34376]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-05T01:19:53.437 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:53 smithi151 ceph-mon[35013]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:53.437 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:53 smithi151 ceph-mon[35013]: from='osd.7 [v2:172.21.15.145:6816/3058588721,v1:172.21.15.145:6817/3058588721]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-05T01:19:53.437 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:53 smithi151 ceph-mon[35013]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-05T01:19:53.440 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-05T01:19:53.466 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi151:vg_nvme/lv_2 2024-09-05T01:19:53.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:53 smithi012 ceph-mon[29942]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:53.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:53 smithi012 ceph-mon[29942]: from='osd.7 [v2:172.21.15.145:6816/3058588721,v1:172.21.15.145:6817/3058588721]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-05T01:19:53.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:53 smithi012 ceph-mon[29942]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-05T01:19:53.720 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T01:19:54.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.142+0000 7f11d92f4640 1 -- 172.21.15.151:0/1667456599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11d4101c00 msgr2=0x7f11d4102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:19:54.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.142+0000 7f11d92f4640 1 --2- 172.21.15.151:0/1667456599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11d4101c00 0x7f11d4102000 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009900 tx=0x7f11c402a410 comp rx=0 tx=0).stop 2024-09-05T01:19:54.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.142+0000 7f11d92f4640 1 -- 172.21.15.151:0/1667456599 shutdown_connections 2024-09-05T01:19:54.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.142+0000 7f11d92f4640 1 --2- 172.21.15.151:0/1667456599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11d41037c0 0x7f11d410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:19:54.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.142+0000 7f11d92f4640 1 --2- 172.21.15.151:0/1667456599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11d4102e00 0x7f11d4103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:19:54.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.142+0000 7f11d92f4640 1 --2- 172.21.15.151:0/1667456599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11d4101c00 0x7f11d4102000 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:19:54.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.142+0000 7f11d92f4640 1 -- 172.21.15.151:0/1667456599 >> 172.21.15.151:0/1667456599 conn(0x7f11d40fd390 msgr2=0x7f11d40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:19:54.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.142+0000 7f11d92f4640 1 -- 172.21.15.151:0/1667456599 shutdown_connections 2024-09-05T01:19:54.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.142+0000 7f11d92f4640 1 -- 172.21.15.151:0/1667456599 wait complete. 2024-09-05T01:19:54.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.142+0000 7f11d92f4640 1 Processor -- start 2024-09-05T01:19:54.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.143+0000 7f11d92f4640 1 -- start start 2024-09-05T01:19:54.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.143+0000 7f11d92f4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11d4101c00 0x7f11d4197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:19:54.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.143+0000 7f11d92f4640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11d4102e00 0x7f11d41984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:19:54.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.143+0000 7f11d92f4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11d41037c0 0x7f11d419f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:19:54.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.143+0000 7f11d92f4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f11d410d8e0 con 0x7f11d4101c00 2024-09-05T01:19:54.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.143+0000 7f11d92f4640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f11d410d760 con 0x7f11d4102e00 2024-09-05T01:19:54.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.143+0000 7f11d92f4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f11d410da60 con 0x7f11d41037c0 2024-09-05T01:19:54.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.143+0000 7f11d37fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11d41037c0 0x7f11d419f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:19:54.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.143+0000 7f11d37fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11d41037c0 0x7f11d419f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52968/0 (socket says 172.21.15.151:52968) 2024-09-05T01:19:54.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.143+0000 7f11d37fe640 1 -- 172.21.15.151:0/2625124131 learned_addr learned my addr 172.21.15.151:0/2625124131 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-05T01:19:54.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.143+0000 7f11d2ffd640 1 --2- 172.21.15.151:0/2625124131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11d4101c00 0x7f11d4197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:19:54.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.143+0000 7f11d27fc640 1 --2- 172.21.15.151:0/2625124131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11d4102e00 0x7f11d41984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:19:54.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.143+0000 7f11d37fe640 1 -- 172.21.15.151:0/2625124131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11d4102e00 msgr2=0x7f11d41984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:19:54.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.143+0000 7f11d37fe640 1 --2- 172.21.15.151:0/2625124131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11d4102e00 0x7f11d41984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:19:54.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.143+0000 7f11d37fe640 1 -- 172.21.15.151:0/2625124131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11d4101c00 msgr2=0x7f11d4197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:19:54.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.143+0000 7f11d37fe640 1 --2- 172.21.15.151:0/2625124131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11d4101c00 0x7f11d4197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:19:54.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.143+0000 7f11d37fe640 1 -- 172.21.15.151:0/2625124131 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d419fbe0 con 0x7f11d41037c0 2024-09-05T01:19:54.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.143+0000 7f11d2ffd640 1 --2- 172.21.15.151:0/2625124131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11d4101c00 0x7f11d4197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:19:54.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.143+0000 7f11d27fc640 1 --2- 172.21.15.151:0/2625124131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11d4102e00 0x7f11d41984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:19:54.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.144+0000 7f11d37fe640 1 --2- 172.21.15.151:0/2625124131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11d41037c0 0x7f11d419f570 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f11cc009fd0 tx=0x7f11cc00b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:19:54.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.144+0000 7f11bbfff640 1 -- 172.21.15.151:0/2625124131 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11cc017070 con 0x7f11d41037c0 2024-09-05T01:19:54.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.144+0000 7f11d92f4640 1 -- 172.21.15.151:0/2625124131 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11d419fed0 con 0x7f11d41037c0 2024-09-05T01:19:54.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.144+0000 7f11d92f4640 1 -- 172.21.15.151:0/2625124131 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11d41a0380 con 0x7f11d41037c0 2024-09-05T01:19:54.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.144+0000 7f11bbfff640 1 -- 172.21.15.151:0/2625124131 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11cc003e50 con 0x7f11d41037c0 2024-09-05T01:19:54.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.144+0000 7f11bbfff640 1 -- 172.21.15.151:0/2625124131 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11cc0106c0 con 0x7f11d41037c0 2024-09-05T01:19:54.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.145+0000 7f11d92f4640 1 -- 172.21.15.151:0/2625124131 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11d4108ff0 con 0x7f11d41037c0 2024-09-05T01:19:54.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.146+0000 7f11bbfff640 1 -- 172.21.15.151:0/2625124131 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f11cc003970 con 0x7f11d41037c0 2024-09-05T01:19:54.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.147+0000 7f11bbfff640 1 --2- 172.21.15.151:0/2625124131 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f11bc0a2bb0 0x7f11bc0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:19:54.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.147+0000 7f11bbfff640 1 -- 172.21.15.151:0/2625124131 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5101+0+0 (secure 0 0 0) 0x7f11cc0ce200 con 0x7f11d41037c0 2024-09-05T01:19:54.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.147+0000 7f11d2ffd640 1 --2- 172.21.15.151:0/2625124131 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f11bc0a2bb0 0x7f11bc0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:19:54.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.148+0000 7f11d2ffd640 1 --2- 172.21.15.151:0/2625124131 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f11bc0a2bb0 0x7f11bc0a5070 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f11c4006010 tx=0x7f11c4032dd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:19:54.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.151+0000 7f11bbfff640 1 -- 172.21.15.151:0/2625124131 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f11cc09bdf0 con 0x7f11d41037c0 2024-09-05T01:19:54.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:19:54.333+0000 7f11d92f4640 1 -- 172.21.15.151:0/2625124131 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f11d4062630 con 0x7f11bc0a2bb0 2024-09-05T01:19:54.334 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:54 smithi151 ceph-mon[35013]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-05T01:19:54.334 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:54 smithi151 ceph-mon[35013]: osdmap e47: 8 total, 7 up, 8 in 2024-09-05T01:19:54.334 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:54 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T01:19:54.334 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:54 smithi151 ceph-mon[35013]: from='osd.7 [v2:172.21.15.145:6816/3058588721,v1:172.21.15.145:6817/3058588721]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-05T01:19:54.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:54 smithi151 ceph-mon[35013]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-05T01:19:54.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:54 smithi151 ceph-mon[35013]: Detected new or changed devices on smithi145 2024-09-05T01:19:54.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:54 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:54.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:54 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:54.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:54 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:19:54.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:54 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:19:54.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:54 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:19:54.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:54 smithi151 ceph-mon[35013]: Adjusting osd_memory_target on smithi145 to 5696M 2024-09-05T01:19:54.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:54 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:54.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:54 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:54.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:54 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:19:54.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:54 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:54.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:54 smithi151 ceph-mon[35013]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:54.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:54 smithi012 ceph-mon[29942]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-05T01:19:54.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:54 smithi012 ceph-mon[29942]: osdmap e47: 8 total, 7 up, 8 in 2024-09-05T01:19:54.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:54 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T01:19:54.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:54 smithi012 ceph-mon[29942]: from='osd.7 [v2:172.21.15.145:6816/3058588721,v1:172.21.15.145:6817/3058588721]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-05T01:19:54.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:54 smithi012 ceph-mon[29942]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-05T01:19:54.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:54 smithi012 ceph-mon[29942]: Detected new or changed devices on smithi145 2024-09-05T01:19:54.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:54 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:54.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:54 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:54.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:54 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:19:54.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:54 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:19:54.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:54 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:19:54.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:54 smithi012 ceph-mon[29942]: Adjusting osd_memory_target on smithi145 to 5696M 2024-09-05T01:19:54.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:54 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:54.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:54 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:54.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:54 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:19:54.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:54 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:54.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:54 smithi012 ceph-mon[29942]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:54.583 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:19:54 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:19:54.191+0000 7fa19a7aa640 -1 osd.7 0 waiting for initial osdmap 2024-09-05T01:19:54.584 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:19:54 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:19:54.200+0000 7fa196de4640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T01:19:54.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:54 smithi145 ceph-mon[34376]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-05T01:19:54.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:54 smithi145 ceph-mon[34376]: osdmap e47: 8 total, 7 up, 8 in 2024-09-05T01:19:54.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:54 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T01:19:54.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:54 smithi145 ceph-mon[34376]: from='osd.7 [v2:172.21.15.145:6816/3058588721,v1:172.21.15.145:6817/3058588721]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-05T01:19:54.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:54 smithi145 ceph-mon[34376]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-05T01:19:54.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:54 smithi145 ceph-mon[34376]: Detected new or changed devices on smithi145 2024-09-05T01:19:54.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:54 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:54.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:54 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:54.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:54 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:19:54.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:54 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:19:54.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:54 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:19:54.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:54 smithi145 ceph-mon[34376]: Adjusting osd_memory_target on smithi145 to 5696M 2024-09-05T01:19:54.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:54 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:54.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:54 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:54.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:54 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:19:54.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:54 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:19:54.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:54 smithi145 ceph-mon[34376]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:55.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:55 smithi151 ceph-mon[35013]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-05T01:19:55.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:55 smithi151 ceph-mon[35013]: osdmap e48: 8 total, 7 up, 8 in 2024-09-05T01:19:55.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:55 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T01:19:55.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:55 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T01:19:55.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:55 smithi151 ceph-mon[35013]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:19:55.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:55 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:19:55.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:55 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:19:55.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:55 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:55.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:55 smithi012 ceph-mon[29942]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-05T01:19:55.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:55 smithi012 ceph-mon[29942]: osdmap e48: 8 total, 7 up, 8 in 2024-09-05T01:19:55.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:55 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T01:19:55.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:55 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T01:19:55.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:55 smithi012 ceph-mon[29942]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:19:55.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:55 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:19:55.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:55 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:19:55.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:55 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:55.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:55 smithi145 ceph-mon[34376]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-05T01:19:55.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:55 smithi145 ceph-mon[34376]: osdmap e48: 8 total, 7 up, 8 in 2024-09-05T01:19:55.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:55 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T01:19:55.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:55 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T01:19:55.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:55 smithi145 ceph-mon[34376]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:19:55.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:55 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:19:55.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:55 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:19:55.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:55 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:19:56.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:56 smithi012 ceph-mon[29942]: purged_snaps scrub starts 2024-09-05T01:19:56.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:56 smithi012 ceph-mon[29942]: purged_snaps scrub ok 2024-09-05T01:19:56.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T01:19:56.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:56 smithi012 ceph-mon[29942]: osd.7 [v2:172.21.15.145:6816/3058588721,v1:172.21.15.145:6817/3058588721] boot 2024-09-05T01:19:56.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:56 smithi012 ceph-mon[29942]: osdmap e49: 8 total, 8 up, 8 in 2024-09-05T01:19:56.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T01:19:56.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:56 smithi012 ceph-mon[29942]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:56.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:56 smithi145 ceph-mon[34376]: purged_snaps scrub starts 2024-09-05T01:19:56.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:56 smithi145 ceph-mon[34376]: purged_snaps scrub ok 2024-09-05T01:19:56.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:56 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T01:19:56.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:56 smithi145 ceph-mon[34376]: osd.7 [v2:172.21.15.145:6816/3058588721,v1:172.21.15.145:6817/3058588721] boot 2024-09-05T01:19:56.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:56 smithi145 ceph-mon[34376]: osdmap e49: 8 total, 8 up, 8 in 2024-09-05T01:19:56.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:56 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T01:19:56.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:56 smithi145 ceph-mon[34376]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:56.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:56 smithi151 ceph-mon[35013]: purged_snaps scrub starts 2024-09-05T01:19:56.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:56 smithi151 ceph-mon[35013]: purged_snaps scrub ok 2024-09-05T01:19:56.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:56 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T01:19:56.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:56 smithi151 ceph-mon[35013]: osd.7 [v2:172.21.15.145:6816/3058588721,v1:172.21.15.145:6817/3058588721] boot 2024-09-05T01:19:56.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:56 smithi151 ceph-mon[35013]: osdmap e49: 8 total, 8 up, 8 in 2024-09-05T01:19:56.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:56 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T01:19:56.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:56 smithi151 ceph-mon[35013]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-05T01:19:57.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:57 smithi012 ceph-mon[29942]: osdmap e50: 8 total, 8 up, 8 in 2024-09-05T01:19:57.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:57 smithi012 ceph-mon[29942]: from='client.? 172.21.15.151:0/591458180' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8018a468-fbc5-4667-a53c-2e97c08713bb"}]: dispatch 2024-09-05T01:19:57.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:57 smithi012 ceph-mon[29942]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8018a468-fbc5-4667-a53c-2e97c08713bb"}]: dispatch 2024-09-05T01:19:57.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:57 smithi012 ceph-mon[29942]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8018a468-fbc5-4667-a53c-2e97c08713bb"}]': finished 2024-09-05T01:19:57.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:57 smithi012 ceph-mon[29942]: osdmap e51: 9 total, 8 up, 9 in 2024-09-05T01:19:57.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:57 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T01:19:57.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:57 smithi012 ceph-mon[29942]: osdmap e52: 9 total, 8 up, 9 in 2024-09-05T01:19:57.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:57 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T01:19:57.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:57 smithi145 ceph-mon[34376]: osdmap e50: 8 total, 8 up, 8 in 2024-09-05T01:19:57.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:57 smithi145 ceph-mon[34376]: from='client.? 172.21.15.151:0/591458180' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8018a468-fbc5-4667-a53c-2e97c08713bb"}]: dispatch 2024-09-05T01:19:57.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:57 smithi145 ceph-mon[34376]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8018a468-fbc5-4667-a53c-2e97c08713bb"}]: dispatch 2024-09-05T01:19:57.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:57 smithi145 ceph-mon[34376]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8018a468-fbc5-4667-a53c-2e97c08713bb"}]': finished 2024-09-05T01:19:57.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:57 smithi145 ceph-mon[34376]: osdmap e51: 9 total, 8 up, 9 in 2024-09-05T01:19:57.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:57 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T01:19:57.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:57 smithi145 ceph-mon[34376]: osdmap e52: 9 total, 8 up, 9 in 2024-09-05T01:19:57.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:57 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T01:19:57.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:57 smithi151 ceph-mon[35013]: osdmap e50: 8 total, 8 up, 8 in 2024-09-05T01:19:57.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:57 smithi151 ceph-mon[35013]: from='client.? 172.21.15.151:0/591458180' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8018a468-fbc5-4667-a53c-2e97c08713bb"}]: dispatch 2024-09-05T01:19:57.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:57 smithi151 ceph-mon[35013]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8018a468-fbc5-4667-a53c-2e97c08713bb"}]: dispatch 2024-09-05T01:19:57.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:57 smithi151 ceph-mon[35013]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8018a468-fbc5-4667-a53c-2e97c08713bb"}]': finished 2024-09-05T01:19:57.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:57 smithi151 ceph-mon[35013]: osdmap e51: 9 total, 8 up, 9 in 2024-09-05T01:19:57.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:57 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T01:19:57.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:57 smithi151 ceph-mon[35013]: osdmap e52: 9 total, 8 up, 9 in 2024-09-05T01:19:57.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:57 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T01:19:58.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:58 smithi012 ceph-mon[29942]: from='client.? 172.21.15.151:0/2633650938' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:19:58.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:58 smithi012 ceph-mon[29942]: osdmap e53: 9 total, 8 up, 9 in 2024-09-05T01:19:58.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:58 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T01:19:58.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:19:58 smithi012 ceph-mon[29942]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:19:58.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:58 smithi145 ceph-mon[34376]: from='client.? 172.21.15.151:0/2633650938' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:19:58.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:58 smithi145 ceph-mon[34376]: osdmap e53: 9 total, 8 up, 9 in 2024-09-05T01:19:58.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:58 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T01:19:58.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:19:58 smithi145 ceph-mon[34376]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:19:58.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:58 smithi151 ceph-mon[35013]: from='client.? 172.21.15.151:0/2633650938' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:19:58.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:58 smithi151 ceph-mon[35013]: osdmap e53: 9 total, 8 up, 9 in 2024-09-05T01:19:58.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:58 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T01:19:58.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:19:58 smithi151 ceph-mon[35013]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:00.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:00 smithi012 ceph-mon[29942]: overall HEALTH_OK 2024-09-05T01:20:00.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:00 smithi145 ceph-mon[34376]: overall HEALTH_OK 2024-09-05T01:20:00.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:00 smithi151 ceph-mon[35013]: overall HEALTH_OK 2024-09-05T01:20:01.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:01 smithi012 ceph-mon[29942]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:01.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:01 smithi145 ceph-mon[34376]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:01.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:01 smithi151 ceph-mon[35013]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:02.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:02 smithi151 ceph-mon[35013]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:02.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:02 smithi012 ceph-mon[29942]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:02.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:02 smithi145 ceph-mon[34376]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:04.344 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:04 smithi151 ceph-mon[35013]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:04.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:04 smithi012 ceph-mon[29942]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:04.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:04 smithi145 ceph-mon[34376]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:05.784 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-05T01:20:05.784 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:05.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-05T01:20:05.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:05.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:05 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-05T01:20:05.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:05 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:06.683 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:06 smithi151 ceph-mon[35013]: Deploying daemon osd.8 on smithi151 2024-09-05T01:20:06.683 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:06 smithi151 ceph-mon[35013]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:06.735 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:06 smithi145 ceph-mon[34376]: Deploying daemon osd.8 on smithi151 2024-09-05T01:20:06.735 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:06 smithi145 ceph-mon[34376]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:06.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:06 smithi012 ceph-mon[29942]: Deploying daemon osd.8 on smithi151 2024-09-05T01:20:06.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:06 smithi012 ceph-mon[29942]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:08.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:08 smithi151 ceph-mon[35013]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:08.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:08 smithi012 ceph-mon[29942]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:08.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:08 smithi145 ceph-mon[34376]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:10.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:10 smithi151 ceph-mon[35013]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:10.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:10 smithi012 ceph-mon[29942]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:10.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:10 smithi145 ceph-mon[34376]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:11.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:11 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:20:11.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:11 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:11.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:11 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:11.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:11 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:20:11.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:11 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:11.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:11 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:11.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:11 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:20:11.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:11 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:11.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:11 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:12.546 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:12 smithi151 ceph-mon[35013]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:12.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:12 smithi012 ceph-mon[29942]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:12.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:12 smithi145 ceph-mon[34376]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:13.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:20:13.802+0000 7f11bbfff640 1 -- 172.21.15.151:0/2625124131 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f11d4062630 con 0x7f11bc0a2bb0 2024-09-05T01:20:13.803 INFO:teuthology.orchestra.run.smithi151.stdout:Created osd(s) 8 on host 'smithi151' 2024-09-05T01:20:13.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:20:13.804+0000 7f11d92f4640 1 -- 172.21.15.151:0/2625124131 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f11bc0a2bb0 msgr2=0x7f11bc0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:20:13.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:20:13.804+0000 7f11d92f4640 1 --2- 172.21.15.151:0/2625124131 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f11bc0a2bb0 0x7f11bc0a5070 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f11c4006010 tx=0x7f11c4032dd0 comp rx=0 tx=0).stop 2024-09-05T01:20:13.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:20:13.804+0000 7f11d92f4640 1 -- 172.21.15.151:0/2625124131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11d41037c0 msgr2=0x7f11d419f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:20:13.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:20:13.804+0000 7f11d92f4640 1 --2- 172.21.15.151:0/2625124131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11d41037c0 0x7f11d419f570 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f11cc009fd0 tx=0x7f11cc00b260 comp rx=0 tx=0).stop 2024-09-05T01:20:13.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:20:13.804+0000 7f11d92f4640 1 -- 172.21.15.151:0/2625124131 shutdown_connections 2024-09-05T01:20:13.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:20:13.804+0000 7f11d92f4640 1 --2- 172.21.15.151:0/2625124131 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f11bc0a2bb0 0x7f11bc0a5070 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:20:13.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:20:13.804+0000 7f11d92f4640 1 --2- 172.21.15.151:0/2625124131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11d41037c0 0x7f11d419f570 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:20:13.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:20:13.804+0000 7f11d92f4640 1 --2- 172.21.15.151:0/2625124131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f11d4102e00 0x7f11d41984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:20:13.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:20:13.804+0000 7f11d92f4640 1 --2- 172.21.15.151:0/2625124131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11d4101c00 0x7f11d4197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:20:13.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:20:13.804+0000 7f11d92f4640 1 -- 172.21.15.151:0/2625124131 >> 172.21.15.151:0/2625124131 conn(0x7f11d40fd390 msgr2=0x7f11d41061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:20:13.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:20:13.804+0000 7f11d92f4640 1 -- 172.21.15.151:0/2625124131 shutdown_connections 2024-09-05T01:20:13.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:20:13.805+0000 7f11d92f4640 1 -- 172.21.15.151:0/2625124131 wait complete. 2024-09-05T01:20:14.384 DEBUG:teuthology.orchestra.run.smithi151:osd.8> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.8.service 2024-09-05T01:20:14.387 INFO:tasks.cephadm:Deploying osd.9 on smithi012 with /dev/vg_nvme/lv_1... 2024-09-05T01:20:14.387 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-05T01:20:14.774 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:20:15.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:15.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:15.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:14 smithi012 ceph-mon[29942]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:15.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:15.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:15.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:14 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:15.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:14 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:15.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:14 smithi145 ceph-mon[34376]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:15.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:14 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:15.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:14 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:15.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:15.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:15.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:14 smithi151 ceph-mon[35013]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:15.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:15.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:16.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:16 smithi012 ceph-mon[29942]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:16.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:16 smithi145 ceph-mon[34376]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:16.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:16 smithi151 ceph-mon[35013]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:17.061 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:20:16 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:20:16.791+0000 7fabfc75c640 -1 osd.8 0 log_to_monitors true 2024-09-05T01:20:17.336 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:17 smithi151 ceph-mon[35013]: from='osd.8 [v2:172.21.15.151:6816/905705309,v1:172.21.15.151:6817/905705309]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-05T01:20:17.336 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:17 smithi151 ceph-mon[35013]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-05T01:20:17.485 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:17 smithi012 ceph-mon[29942]: from='osd.8 [v2:172.21.15.151:6816/905705309,v1:172.21.15.151:6817/905705309]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-05T01:20:17.485 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:17 smithi012 ceph-mon[29942]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-05T01:20:17.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:17 smithi145 ceph-mon[34376]: from='osd.8 [v2:172.21.15.151:6816/905705309,v1:172.21.15.151:6817/905705309]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-05T01:20:17.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:17 smithi145 ceph-mon[34376]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-05T01:20:17.902 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:20:17.934 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi012:vg_nvme/lv_1 2024-09-05T01:20:18.319 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:20:18.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:18 smithi145 ceph-mon[34376]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-05T01:20:18.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:18 smithi145 ceph-mon[34376]: osdmap e54: 9 total, 8 up, 9 in 2024-09-05T01:20:18.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T01:20:18.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:18 smithi145 ceph-mon[34376]: from='osd.8 [v2:172.21.15.151:6816/905705309,v1:172.21.15.151:6817/905705309]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-09-05T01:20:18.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:18 smithi145 ceph-mon[34376]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-09-05T01:20:18.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:18 smithi145 ceph-mon[34376]: Detected new or changed devices on smithi151 2024-09-05T01:20:18.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:18.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:18.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:20:18.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:20:18.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:20:18.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:18 smithi145 ceph-mon[34376]: Adjusting osd_memory_target on smithi151 to 5696M 2024-09-05T01:20:18.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:18.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:18.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:20:18.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:18.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:20:18.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:18.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:20:18.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:18.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:18 smithi145 ceph-mon[34376]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:18.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:18 smithi012 ceph-mon[29942]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-05T01:20:18.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:18 smithi012 ceph-mon[29942]: osdmap e54: 9 total, 8 up, 9 in 2024-09-05T01:20:18.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T01:20:18.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:18 smithi012 ceph-mon[29942]: from='osd.8 [v2:172.21.15.151:6816/905705309,v1:172.21.15.151:6817/905705309]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-09-05T01:20:18.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:18 smithi012 ceph-mon[29942]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-09-05T01:20:18.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:18 smithi012 ceph-mon[29942]: Detected new or changed devices on smithi151 2024-09-05T01:20:18.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:18.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:18.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:20:18.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:20:18.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:20:18.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:18 smithi012 ceph-mon[29942]: Adjusting osd_memory_target on smithi151 to 5696M 2024-09-05T01:20:18.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:18.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:18.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:20:18.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:18.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:20:18.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:18.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:20:18.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:18.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:18 smithi012 ceph-mon[29942]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:18.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:18 smithi151 ceph-mon[35013]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-05T01:20:18.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:18 smithi151 ceph-mon[35013]: osdmap e54: 9 total, 8 up, 9 in 2024-09-05T01:20:18.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T01:20:18.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:18 smithi151 ceph-mon[35013]: from='osd.8 [v2:172.21.15.151:6816/905705309,v1:172.21.15.151:6817/905705309]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-09-05T01:20:18.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:18 smithi151 ceph-mon[35013]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-09-05T01:20:18.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:18 smithi151 ceph-mon[35013]: Detected new or changed devices on smithi151 2024-09-05T01:20:18.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:18.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:18.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:20:18.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:20:18.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:20:18.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:18 smithi151 ceph-mon[35013]: Adjusting osd_memory_target on smithi151 to 5696M 2024-09-05T01:20:18.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:18.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:18.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:20:18.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:18.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:20:18.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:18.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:20:18.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:18.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:18 smithi151 ceph-mon[35013]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-09-05T01:20:18.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.885+0000 7f3923c00640 1 -- 172.21.15.12:0/1262042658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f391c105920 msgr2=0x7f391c10c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:20:18.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.885+0000 7f3923c00640 1 --2- 172.21.15.12:0/1262042658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f391c105920 0x7f391c10c240 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3914009ca0 tx=0x7f391402a8c0 comp rx=0 tx=0).stop 2024-09-05T01:20:18.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.885+0000 7f3923c00640 1 -- 172.21.15.12:0/1262042658 shutdown_connections 2024-09-05T01:20:18.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.885+0000 7f3923c00640 1 --2- 172.21.15.12:0/1262042658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f391c105920 0x7f391c10c240 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:20:18.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.885+0000 7f3923c00640 1 --2- 172.21.15.12:0/1262042658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f391c104f60 0x7f391c1053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:20:18.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.885+0000 7f3923c00640 1 --2- 172.21.15.12:0/1262042658 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f391c103e00 0x7f391c104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:20:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.885+0000 7f3923c00640 1 -- 172.21.15.12:0/1262042658 >> 172.21.15.12:0/1262042658 conn(0x7f391c0ff5b0 msgr2=0x7f391c1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:20:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.885+0000 7f3923c00640 1 -- 172.21.15.12:0/1262042658 shutdown_connections 2024-09-05T01:20:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.885+0000 7f3923c00640 1 -- 172.21.15.12:0/1262042658 wait complete. 2024-09-05T01:20:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.886+0000 7f3923c00640 1 Processor -- start 2024-09-05T01:20:18.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.886+0000 7f3923c00640 1 -- start start 2024-09-05T01:20:18.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.887+0000 7f3923c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f391c103e00 0x7f391c19a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:20:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.887+0000 7f3923c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f391c104f60 0x7f391c19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:20:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.887+0000 7f3923c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f391c105920 0x7f391c1a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:20:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.887+0000 7f3923c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f391c10fa90 con 0x7f391c104f60 2024-09-05T01:20:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.887+0000 7f3923c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f391c10f910 con 0x7f391c105920 2024-09-05T01:20:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.887+0000 7f3923c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f391c10fc10 con 0x7f391c103e00 2024-09-05T01:20:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.887+0000 7f3921200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f391c103e00 0x7f391c19a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:20:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.887+0000 7f3921200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f391c103e00 0x7f391c19a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:53296/0 (socket says 172.21.15.12:53296) 2024-09-05T01:20:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.887+0000 7f3921200640 1 -- 172.21.15.12:0/1430037082 learned_addr learned my addr 172.21.15.12:0/1430037082 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:20:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.887+0000 7f391be00640 1 --2- 172.21.15.12:0/1430037082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f391c104f60 0x7f391c19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:20:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.887+0000 7f3921c00640 1 --2- 172.21.15.12:0/1430037082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f391c105920 0x7f391c1a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:20:18.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.887+0000 7f3921200640 1 -- 172.21.15.12:0/1430037082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f391c105920 msgr2=0x7f391c1a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:20:18.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.887+0000 7f3921200640 1 --2- 172.21.15.12:0/1430037082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f391c105920 0x7f391c1a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:20:18.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.887+0000 7f3921200640 1 -- 172.21.15.12:0/1430037082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f391c104f60 msgr2=0x7f391c19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:20:18.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.887+0000 7f3921200640 1 --2- 172.21.15.12:0/1430037082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f391c104f60 0x7f391c19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:20:18.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.887+0000 7f3921200640 1 -- 172.21.15.12:0/1430037082 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f391c1a1c80 con 0x7f391c103e00 2024-09-05T01:20:18.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.888+0000 7f3921200640 1 --2- 172.21.15.12:0/1430037082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f391c103e00 0x7f391c19a050 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f391000d950 tx=0x7f391000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:20:18.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.888+0000 7f3919600640 1 -- 172.21.15.12:0/1430037082 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3910017070 con 0x7f391c103e00 2024-09-05T01:20:18.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.888+0000 7f3919600640 1 -- 172.21.15.12:0/1430037082 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3910009c30 con 0x7f391c103e00 2024-09-05T01:20:18.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.888+0000 7f3923c00640 1 -- 172.21.15.12:0/1430037082 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f391c1a1f70 con 0x7f391c103e00 2024-09-05T01:20:18.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.888+0000 7f3919600640 1 -- 172.21.15.12:0/1430037082 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391000f6b0 con 0x7f391c103e00 2024-09-05T01:20:18.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.888+0000 7f3923c00640 1 -- 172.21.15.12:0/1430037082 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f391c1a23c0 con 0x7f391c103e00 2024-09-05T01:20:18.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.889+0000 7f3923c00640 1 -- 172.21.15.12:0/1430037082 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f391c10b190 con 0x7f391c103e00 2024-09-05T01:20:18.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.891+0000 7f3919600640 1 -- 172.21.15.12:0/1430037082 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f39100109d0 con 0x7f391c103e00 2024-09-05T01:20:18.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.893+0000 7f3919600640 1 --2- 172.21.15.12:0/1430037082 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f39040a2bb0 0x7f39040a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:20:18.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.893+0000 7f3919600640 1 -- 172.21.15.12:0/1430037082 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5549+0+0 (secure 0 0 0) 0x7f39100ce1d0 con 0x7f391c103e00 2024-09-05T01:20:18.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.893+0000 7f391be00640 1 --2- 172.21.15.12:0/1430037082 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f39040a2bb0 0x7f39040a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:20:18.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.894+0000 7f391be00640 1 --2- 172.21.15.12:0/1430037082 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f39040a2bb0 0x7f39040a5070 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f39080095f0 tx=0x7f3908005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:20:18.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:18.899+0000 7f3919600640 1 -- 172.21.15.12:0/1430037082 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3910009de0 con 0x7f391c103e00 2024-09-05T01:20:19.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:19.093+0000 7f3923c00640 1 -- 172.21.15.12:0/1430037082 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f391c062630 con 0x7f39040a2bb0 2024-09-05T01:20:19.354 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:20:19 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:20:19.052+0000 7fabf7ebc640 -1 osd.8 0 waiting for initial osdmap 2024-09-05T01:20:19.354 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:20:19 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:20:19.068+0000 7fabf04ee640 -1 osd.8 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T01:20:19.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:19 smithi151 ceph-mon[35013]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-09-05T01:20:19.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:19 smithi151 ceph-mon[35013]: osdmap e55: 9 total, 8 up, 9 in 2024-09-05T01:20:19.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:19 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T01:20:19.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:19 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T01:20:19.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:19 smithi151 ceph-mon[35013]: from='osd.8 ' entity='osd.8' 2024-09-05T01:20:19.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:19 smithi151 ceph-mon[35013]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:20:19.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:19 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:20:19.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:19 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:20:19.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:19 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:19.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:19 smithi151 ceph-mon[35013]: osd.8 [v2:172.21.15.151:6816/905705309,v1:172.21.15.151:6817/905705309] boot 2024-09-05T01:20:19.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:19 smithi151 ceph-mon[35013]: osdmap e56: 9 total, 9 up, 9 in 2024-09-05T01:20:19.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:19 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T01:20:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:19 smithi012 ceph-mon[29942]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-09-05T01:20:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:19 smithi012 ceph-mon[29942]: osdmap e55: 9 total, 8 up, 9 in 2024-09-05T01:20:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:19 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T01:20:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:19 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T01:20:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:19 smithi012 ceph-mon[29942]: from='osd.8 ' entity='osd.8' 2024-09-05T01:20:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:19 smithi012 ceph-mon[29942]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:20:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:19 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:20:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:19 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:20:19.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:19 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:19.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:19 smithi012 ceph-mon[29942]: osd.8 [v2:172.21.15.151:6816/905705309,v1:172.21.15.151:6817/905705309] boot 2024-09-05T01:20:19.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:19 smithi012 ceph-mon[29942]: osdmap e56: 9 total, 9 up, 9 in 2024-09-05T01:20:19.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:19 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T01:20:19.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:19 smithi145 ceph-mon[34376]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-09-05T01:20:19.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:19 smithi145 ceph-mon[34376]: osdmap e55: 9 total, 8 up, 9 in 2024-09-05T01:20:19.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:19 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T01:20:19.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:19 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T01:20:19.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:19 smithi145 ceph-mon[34376]: from='osd.8 ' entity='osd.8' 2024-09-05T01:20:19.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:19 smithi145 ceph-mon[34376]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi012:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:20:19.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:19 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:20:19.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:19 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:20:19.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:19 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:19.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:19 smithi145 ceph-mon[34376]: osd.8 [v2:172.21.15.151:6816/905705309,v1:172.21.15.151:6817/905705309] boot 2024-09-05T01:20:19.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:19 smithi145 ceph-mon[34376]: osdmap e56: 9 total, 9 up, 9 in 2024-09-05T01:20:19.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:19 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T01:20:20.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:20 smithi012 ceph-mon[29942]: purged_snaps scrub starts 2024-09-05T01:20:20.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:20 smithi012 ceph-mon[29942]: purged_snaps scrub ok 2024-09-05T01:20:20.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:20 smithi012 ceph-mon[29942]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 662 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:20.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:20 smithi145 ceph-mon[34376]: purged_snaps scrub starts 2024-09-05T01:20:20.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:20 smithi145 ceph-mon[34376]: purged_snaps scrub ok 2024-09-05T01:20:20.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:20 smithi145 ceph-mon[34376]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 662 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:20.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:20 smithi151 ceph-mon[35013]: purged_snaps scrub starts 2024-09-05T01:20:20.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:20 smithi151 ceph-mon[35013]: purged_snaps scrub ok 2024-09-05T01:20:20.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:20 smithi151 ceph-mon[35013]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 662 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:21.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:21 smithi012 ceph-mon[29942]: osdmap e57: 9 total, 9 up, 9 in 2024-09-05T01:20:21.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:21 smithi145 ceph-mon[34376]: osdmap e57: 9 total, 9 up, 9 in 2024-09-05T01:20:21.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:21 smithi151 ceph-mon[35013]: osdmap e57: 9 total, 9 up, 9 in 2024-09-05T01:20:22.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:22 smithi012 ceph-mon[29942]: osdmap e58: 9 total, 9 up, 9 in 2024-09-05T01:20:22.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:22 smithi012 ceph-mon[29942]: osdmap e59: 9 total, 9 up, 9 in 2024-09-05T01:20:22.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:22 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3896622842' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dcf3b524-c8b8-4ab6-83c6-fc52c776d72b"}]: dispatch 2024-09-05T01:20:22.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:22 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3896622842' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dcf3b524-c8b8-4ab6-83c6-fc52c776d72b"}]': finished 2024-09-05T01:20:22.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:22 smithi012 ceph-mon[29942]: osdmap e60: 10 total, 9 up, 10 in 2024-09-05T01:20:22.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T01:20:22.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:22 smithi012 ceph-mon[29942]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 663 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:22.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:22 smithi145 ceph-mon[34376]: osdmap e58: 9 total, 9 up, 9 in 2024-09-05T01:20:22.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:22 smithi145 ceph-mon[34376]: osdmap e59: 9 total, 9 up, 9 in 2024-09-05T01:20:22.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:22 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3896622842' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dcf3b524-c8b8-4ab6-83c6-fc52c776d72b"}]: dispatch 2024-09-05T01:20:22.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:22 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3896622842' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dcf3b524-c8b8-4ab6-83c6-fc52c776d72b"}]': finished 2024-09-05T01:20:22.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:22 smithi145 ceph-mon[34376]: osdmap e60: 10 total, 9 up, 10 in 2024-09-05T01:20:22.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:22 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T01:20:22.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:22 smithi145 ceph-mon[34376]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 663 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:22 smithi151 ceph-mon[35013]: osdmap e58: 9 total, 9 up, 9 in 2024-09-05T01:20:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:22 smithi151 ceph-mon[35013]: osdmap e59: 9 total, 9 up, 9 in 2024-09-05T01:20:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:22 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3896622842' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dcf3b524-c8b8-4ab6-83c6-fc52c776d72b"}]: dispatch 2024-09-05T01:20:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:22 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3896622842' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dcf3b524-c8b8-4ab6-83c6-fc52c776d72b"}]': finished 2024-09-05T01:20:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:22 smithi151 ceph-mon[35013]: osdmap e60: 10 total, 9 up, 10 in 2024-09-05T01:20:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:22 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T01:20:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:22 smithi151 ceph-mon[35013]: pgmap v200: 1 pgs: 1 remapped+peering; 577 KiB data, 663 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:23.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:23 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/15522673' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:20:23.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:23 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/15522673' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:20:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:23 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/15522673' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:20:24.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:24 smithi145 ceph-mon[34376]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 663 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:24.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:24 smithi151 ceph-mon[35013]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 663 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:24.811 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:24 smithi012 ceph-mon[29942]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 663 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:26.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:26 smithi012 ceph-mon[29942]: pgmap v202: 1 pgs: 1 remapped+peering; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:26.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:26 smithi145 ceph-mon[34376]: pgmap v202: 1 pgs: 1 remapped+peering; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:26.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:26 smithi151 ceph-mon[35013]: pgmap v202: 1 pgs: 1 remapped+peering; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:28 smithi012 ceph-mon[29942]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-05T01:20:28.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:28 smithi145 ceph-mon[34376]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-05T01:20:28.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:28 smithi151 ceph-mon[35013]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-05T01:20:30.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:30 smithi012 ceph-mon[29942]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-05T01:20:30.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:30 smithi145 ceph-mon[34376]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-05T01:20:30.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:30 smithi151 ceph-mon[35013]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-05T01:20:32.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:32 smithi012 ceph-mon[29942]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-05T01:20:32.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:32 smithi145 ceph-mon[34376]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-05T01:20:32.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:32 smithi151 ceph-mon[35013]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-05T01:20:33.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:33 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-05T01:20:33.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:33 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:33.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:33 smithi012 ceph-mon[29942]: Deploying daemon osd.9 on smithi012 2024-09-05T01:20:33.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:33 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-05T01:20:33.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:33 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:33.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:33 smithi145 ceph-mon[34376]: Deploying daemon osd.9 on smithi012 2024-09-05T01:20:33.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:33 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-05T01:20:33.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:33 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:33.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:33 smithi151 ceph-mon[35013]: Deploying daemon osd.9 on smithi012 2024-09-05T01:20:34.390 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:34 smithi012 ceph-mon[29942]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T01:20:34.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:34 smithi145 ceph-mon[34376]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T01:20:34.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:34 smithi151 ceph-mon[35013]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T01:20:36.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:36 smithi012 ceph-mon[29942]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T01:20:36.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:36 smithi145 ceph-mon[34376]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T01:20:36.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:36 smithi151 ceph-mon[35013]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T01:20:38.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:38 smithi012 ceph-mon[29942]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T01:20:38.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:38 smithi145 ceph-mon[34376]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T01:20:38.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:38 smithi151 ceph-mon[35013]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-05T01:20:39.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:39 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:20:39.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:39 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:39.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:39 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:39.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:39 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:20:39.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:39 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:39.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:39 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:39.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:39 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:20:39.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:39 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:39.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:39 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:40.668 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:40 smithi012 ceph-mon[29942]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:40.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:40 smithi145 ceph-mon[34376]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:40.853 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:40 smithi151 ceph-mon[35013]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:42.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:42 smithi012 ceph-mon[29942]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:42.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:42 smithi145 ceph-mon[34376]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:42.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:42 smithi151 ceph-mon[35013]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:43.933 INFO:teuthology.orchestra.run.smithi012.stdout:Created osd(s) 9 on host 'smithi012' 2024-09-05T01:20:43.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:43.932+0000 7f3919600640 1 -- 172.21.15.12:0/1430037082 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f391c062630 con 0x7f39040a2bb0 2024-09-05T01:20:43.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:43.934+0000 7f3923c00640 1 -- 172.21.15.12:0/1430037082 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f39040a2bb0 msgr2=0x7f39040a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:20:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:43.934+0000 7f3923c00640 1 --2- 172.21.15.12:0/1430037082 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f39040a2bb0 0x7f39040a5070 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f39080095f0 tx=0x7f3908005f90 comp rx=0 tx=0).stop 2024-09-05T01:20:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:43.934+0000 7f3923c00640 1 -- 172.21.15.12:0/1430037082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f391c103e00 msgr2=0x7f391c19a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:20:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:43.934+0000 7f3923c00640 1 --2- 172.21.15.12:0/1430037082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f391c103e00 0x7f391c19a050 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f391000d950 tx=0x7f391000de10 comp rx=0 tx=0).stop 2024-09-05T01:20:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:43.934+0000 7f3923c00640 1 -- 172.21.15.12:0/1430037082 shutdown_connections 2024-09-05T01:20:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:43.934+0000 7f3923c00640 1 --2- 172.21.15.12:0/1430037082 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f39040a2bb0 0x7f39040a5070 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:20:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:43.934+0000 7f3923c00640 1 --2- 172.21.15.12:0/1430037082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f391c105920 0x7f391c1a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:20:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:43.934+0000 7f3923c00640 1 --2- 172.21.15.12:0/1430037082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f391c104f60 0x7f391c19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:20:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:43.934+0000 7f3923c00640 1 --2- 172.21.15.12:0/1430037082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f391c103e00 0x7f391c19a050 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:20:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:43.934+0000 7f3923c00640 1 -- 172.21.15.12:0/1430037082 >> 172.21.15.12:0/1430037082 conn(0x7f391c0ff5b0 msgr2=0x7f391c108360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:20:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:43.935+0000 7f3923c00640 1 -- 172.21.15.12:0/1430037082 shutdown_connections 2024-09-05T01:20:43.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:20:43.935+0000 7f3923c00640 1 -- 172.21.15.12:0/1430037082 wait complete. 2024-09-05T01:20:43.978 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:43 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:43.979 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:43 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:43.979 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:43 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:43.979 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:43 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:20:44.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:43 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:44.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:43 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:20:44.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:43 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:44.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:43 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:44.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:43 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:44.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:43 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:44.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:43 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:44.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:43 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:20:44.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:43 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:44.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:43 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:20:44.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:43 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:44.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:43 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:44.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:43 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:44.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:43 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:44.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:43 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:44.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:43 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:20:44.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:43 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:44.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:43 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:20:44.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:43 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:44.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:43 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:44.706 DEBUG:teuthology.orchestra.run.smithi012:osd.9> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.9.service 2024-09-05T01:20:44.710 INFO:tasks.cephadm:Deploying osd.10 on smithi145 with /dev/vg_nvme/lv_1... 2024-09-05T01:20:44.710 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-05T01:20:44.963 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T01:20:45.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:44 smithi145 ceph-mon[34376]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:45.235 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:44 smithi012 ceph-mon[29942]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:45.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:44 smithi151 ceph-mon[35013]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:45.977 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:20:45 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:20:45.834+0000 7f29c6724640 -1 osd.9 0 log_to_monitors true 2024-09-05T01:20:46.255 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:45 smithi012 ceph-mon[29942]: from='osd.9 [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-05T01:20:46.285 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:45 smithi145 ceph-mon[34376]: from='osd.9 [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-05T01:20:46.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:45 smithi151 ceph-mon[35013]: from='osd.9 [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-05T01:20:47.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:46 smithi145 ceph-mon[34376]: from='osd.9 [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-05T01:20:47.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:46 smithi145 ceph-mon[34376]: osdmap e61: 10 total, 9 up, 10 in 2024-09-05T01:20:47.225 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:46 smithi145 ceph-mon[34376]: from='osd.9 [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-05T01:20:47.225 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:46 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T01:20:47.225 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:46 smithi145 ceph-mon[34376]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:47.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:46 smithi012 ceph-mon[29942]: from='osd.9 [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-05T01:20:47.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:46 smithi012 ceph-mon[29942]: osdmap e61: 10 total, 9 up, 10 in 2024-09-05T01:20:47.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:46 smithi012 ceph-mon[29942]: from='osd.9 [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-05T01:20:47.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:46 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T01:20:47.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:46 smithi012 ceph-mon[29942]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:47.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:46 smithi151 ceph-mon[35013]: from='osd.9 [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-05T01:20:47.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:46 smithi151 ceph-mon[35013]: osdmap e61: 10 total, 9 up, 10 in 2024-09-05T01:20:47.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:46 smithi151 ceph-mon[35013]: from='osd.9 [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]: dispatch 2024-09-05T01:20:47.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:46 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T01:20:47.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:46 smithi151 ceph-mon[35013]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:47.511 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-05T01:20:47.536 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi145:vg_nvme/lv_1 2024-09-05T01:20:47.795 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T01:20:48.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:47 smithi145 ceph-mon[34376]: from='osd.9 [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-05T01:20:48.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:47 smithi145 ceph-mon[34376]: osdmap e62: 10 total, 9 up, 10 in 2024-09-05T01:20:48.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:47 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T01:20:48.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:47 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T01:20:48.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:47 smithi145 ceph-mon[34376]: from='osd.9 [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496]' entity='osd.9' 2024-09-05T01:20:48.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.247+0000 7f754a504640 1 -- 172.21.15.145:0/481014683 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7544101790 msgr2=0x7f7544101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:20:48.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.247+0000 7f754a504640 1 --2- 172.21.15.145:0/481014683 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7544101790 0x7f7544101c40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f753c009ca0 tx=0x7f753c02a8c0 comp rx=0 tx=0).stop 2024-09-05T01:20:48.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.247+0000 7f754a504640 1 -- 172.21.15.145:0/481014683 shutdown_connections 2024-09-05T01:20:48.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.247+0000 7f754a504640 1 --2- 172.21.15.145:0/481014683 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7544101790 0x7f7544101c40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:20:48.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.247+0000 7f754a504640 1 --2- 172.21.15.145:0/481014683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7544100df0 0x7f7544101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:20:48.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.247+0000 7f754a504640 1 --2- 172.21.15.145:0/481014683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75441004b0 0x7f75441008b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:20:48.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.247+0000 7f754a504640 1 -- 172.21.15.145:0/481014683 >> 172.21.15.145:0/481014683 conn(0x7f75440fc280 msgr2=0x7f75440fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:20:48.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.247+0000 7f754a504640 1 -- 172.21.15.145:0/481014683 shutdown_connections 2024-09-05T01:20:48.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.247+0000 7f754a504640 1 -- 172.21.15.145:0/481014683 wait complete. 2024-09-05T01:20:48.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.247+0000 7f754a504640 1 Processor -- start 2024-09-05T01:20:48.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.247+0000 7f754a504640 1 -- start start 2024-09-05T01:20:48.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.248+0000 7f754a504640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75441004b0 0x7f754419a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:20:48.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.248+0000 7f754a504640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7544100df0 0x7f754419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:20:48.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.248+0000 7f754a504640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7544101790 0x7f75441a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:20:48.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.248+0000 7f754a504640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f754410fac0 con 0x7f75441004b0 2024-09-05T01:20:48.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.248+0000 7f754a504640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f754410f940 con 0x7f7544100df0 2024-09-05T01:20:48.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.248+0000 7f754a504640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f754410fc40 con 0x7f7544101790 2024-09-05T01:20:48.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.248+0000 7f75437fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7544100df0 0x7f754419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:20:48.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.248+0000 7f75437fe640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7544100df0 0x7f754419a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.145:38076/0 (socket says 172.21.15.145:38076) 2024-09-05T01:20:48.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.248+0000 7f75437fe640 1 -- 172.21.15.145:0/1049964778 learned_addr learned my addr 172.21.15.145:0/1049964778 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-05T01:20:48.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.248+0000 7f7543fff640 1 --2- 172.21.15.145:0/1049964778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75441004b0 0x7f754419a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:20:48.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.248+0000 7f7548aa1640 1 --2- 172.21.15.145:0/1049964778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7544101790 0x7f75441a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:20:48.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.248+0000 7f75437fe640 1 -- 172.21.15.145:0/1049964778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7544101790 msgr2=0x7f75441a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:20:48.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.248+0000 7f75437fe640 1 --2- 172.21.15.145:0/1049964778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7544101790 0x7f75441a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:20:48.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.248+0000 7f75437fe640 1 -- 172.21.15.145:0/1049964778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75441004b0 msgr2=0x7f754419a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:20:48.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.248+0000 7f75437fe640 1 --2- 172.21.15.145:0/1049964778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75441004b0 0x7f754419a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:20:48.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.248+0000 7f75437fe640 1 -- 172.21.15.145:0/1049964778 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75441a1d40 con 0x7f7544100df0 2024-09-05T01:20:48.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.248+0000 7f7543fff640 1 --2- 172.21.15.145:0/1049964778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75441004b0 0x7f754419a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:20:48.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.248+0000 7f75437fe640 1 --2- 172.21.15.145:0/1049964778 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7544100df0 0x7f754419a650 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f753800b4a0 tx=0x7f753800b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:20:48.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.248+0000 7f75417fa640 1 -- 172.21.15.145:0/1049964778 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7538014070 con 0x7f7544100df0 2024-09-05T01:20:48.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.248+0000 7f75417fa640 1 -- 172.21.15.145:0/1049964778 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7538010af0 con 0x7f7544100df0 2024-09-05T01:20:48.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.248+0000 7f754a504640 1 -- 172.21.15.145:0/1049964778 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75441a1fd0 con 0x7f7544100df0 2024-09-05T01:20:48.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.248+0000 7f75417fa640 1 -- 172.21.15.145:0/1049964778 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7538017d10 con 0x7f7544100df0 2024-09-05T01:20:48.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.249+0000 7f754a504640 1 -- 172.21.15.145:0/1049964778 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75441a2560 con 0x7f7544100df0 2024-09-05T01:20:48.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.249+0000 7f754a504640 1 -- 172.21.15.145:0/1049964778 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f754410b200 con 0x7f7544100df0 2024-09-05T01:20:48.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.251+0000 7f75417fa640 1 -- 172.21.15.145:0/1049964778 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7538017070 con 0x7f7544100df0 2024-09-05T01:20:48.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.251+0000 7f75417fa640 1 --2- 172.21.15.145:0/1049964778 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f752c0a2bb0 0x7f752c0a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:20:48.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.251+0000 7f75417fa640 1 -- 172.21.15.145:0/1049964778 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5981+0+0 (secure 0 0 0) 0x7f75380cda70 con 0x7f7544100df0 2024-09-05T01:20:48.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.252+0000 7f7543fff640 1 --2- 172.21.15.145:0/1049964778 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f752c0a2bb0 0x7f752c0a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:20:48.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.252+0000 7f7543fff640 1 --2- 172.21.15.145:0/1049964778 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f752c0a2bb0 0x7f752c0a5070 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f75340058c0 tx=0x7f7534005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:20:48.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.256+0000 7f75417fa640 1 -- 172.21.15.145:0/1049964778 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f753809b2f0 con 0x7f7544100df0 2024-09-05T01:20:48.280 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:47 smithi012 ceph-mon[29942]: from='osd.9 [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-05T01:20:48.280 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:47 smithi012 ceph-mon[29942]: osdmap e62: 10 total, 9 up, 10 in 2024-09-05T01:20:48.280 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:47 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T01:20:48.280 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:47 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T01:20:48.280 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:47 smithi012 ceph-mon[29942]: from='osd.9 [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496]' entity='osd.9' 2024-09-05T01:20:48.281 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:20:47 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:20:47.976+0000 7f29bfe00640 -1 osd.9 0 waiting for initial osdmap 2024-09-05T01:20:48.281 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:20:48 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:20:48.018+0000 7f29b6800640 -1 osd.9 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T01:20:48.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:47 smithi151 ceph-mon[35013]: from='osd.9 [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi012", "root=default"]}]': finished 2024-09-05T01:20:48.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:47 smithi151 ceph-mon[35013]: osdmap e62: 10 total, 9 up, 10 in 2024-09-05T01:20:48.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:47 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T01:20:48.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:47 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T01:20:48.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:47 smithi151 ceph-mon[35013]: from='osd.9 [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496]' entity='osd.9' 2024-09-05T01:20:48.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:20:48.437+0000 7f754a504640 1 -- 172.21.15.145:0/1049964778 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f7544062630 con 0x7f752c0a2bb0 2024-09-05T01:20:49.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:49 smithi145 ceph-mon[34376]: purged_snaps scrub starts 2024-09-05T01:20:49.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:49 smithi145 ceph-mon[34376]: purged_snaps scrub ok 2024-09-05T01:20:49.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:49 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T01:20:49.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:49 smithi145 ceph-mon[34376]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:49.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:49 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:49.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:49 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:49.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:49 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:20:49.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:49 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:20:49.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:49 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:20:49.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:49 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:20:49.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:49 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:49.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:49 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:49.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:49 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:20:49.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:49 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:49.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:49 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:20:49.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:49 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:20:49.085 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:49 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:49.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:49 smithi012 ceph-mon[29942]: purged_snaps scrub starts 2024-09-05T01:20:49.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:49 smithi012 ceph-mon[29942]: purged_snaps scrub ok 2024-09-05T01:20:49.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:49 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T01:20:49.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:49 smithi012 ceph-mon[29942]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:49.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:49 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:49.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:49 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:49.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:49 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:20:49.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:49 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:20:49.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:49 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:20:49.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:49 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:20:49.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:49 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:49.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:49 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:49.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:49 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:20:49.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:49 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:49.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:49 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:20:49.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:49 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:20:49.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:49 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:49.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:49 smithi151 ceph-mon[35013]: purged_snaps scrub starts 2024-09-05T01:20:49.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:49 smithi151 ceph-mon[35013]: purged_snaps scrub ok 2024-09-05T01:20:49.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:49 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T01:20:49.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:49 smithi151 ceph-mon[35013]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-05T01:20:49.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:49 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:49.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:49 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:49.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:49 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:20:49.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:49 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:20:49.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:49 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:20:49.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:49 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:20:49.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:49 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:49.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:49 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:49.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:49 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:20:49.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:49 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:20:49.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:49 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:20:49.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:49 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:20:49.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:49 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:50.068 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:50 smithi145 ceph-mon[34376]: Detected new or changed devices on smithi012 2024-09-05T01:20:50.068 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:50 smithi145 ceph-mon[34376]: Adjusting osd_memory_target on smithi012 to 4273M 2024-09-05T01:20:50.068 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:50 smithi145 ceph-mon[34376]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:20:50.068 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:50 smithi145 ceph-mon[34376]: osd.9 [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496] boot 2024-09-05T01:20:50.068 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:50 smithi145 ceph-mon[34376]: osdmap e63: 10 total, 10 up, 10 in 2024-09-05T01:20:50.068 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:50 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T01:20:50.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:50 smithi012 ceph-mon[29942]: Detected new or changed devices on smithi012 2024-09-05T01:20:50.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:50 smithi012 ceph-mon[29942]: Adjusting osd_memory_target on smithi012 to 4273M 2024-09-05T01:20:50.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:50 smithi012 ceph-mon[29942]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:20:50.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:50 smithi012 ceph-mon[29942]: osd.9 [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496] boot 2024-09-05T01:20:50.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:50 smithi012 ceph-mon[29942]: osdmap e63: 10 total, 10 up, 10 in 2024-09-05T01:20:50.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T01:20:50.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:50 smithi151 ceph-mon[35013]: Detected new or changed devices on smithi012 2024-09-05T01:20:50.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:50 smithi151 ceph-mon[35013]: Adjusting osd_memory_target on smithi012 to 4273M 2024-09-05T01:20:50.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:50 smithi151 ceph-mon[35013]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi145:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:20:50.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:50 smithi151 ceph-mon[35013]: osd.9 [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496] boot 2024-09-05T01:20:50.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:50 smithi151 ceph-mon[35013]: osdmap e63: 10 total, 10 up, 10 in 2024-09-05T01:20:50.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:50 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T01:20:51.303 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:51 smithi145 ceph-mon[34376]: osdmap e64: 10 total, 10 up, 10 in 2024-09-05T01:20:51.303 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:51 smithi145 ceph-mon[34376]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:20:51.303 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:51 smithi145 ceph-mon[34376]: from='client.? 172.21.15.145:0/1474437604' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b5b34c3-8814-4d16-80ce-0b0c9be07cf7"}]: dispatch 2024-09-05T01:20:51.303 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:51 smithi145 ceph-mon[34376]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b5b34c3-8814-4d16-80ce-0b0c9be07cf7"}]: dispatch 2024-09-05T01:20:51.303 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:51 smithi145 ceph-mon[34376]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b5b34c3-8814-4d16-80ce-0b0c9be07cf7"}]': finished 2024-09-05T01:20:51.303 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:51 smithi145 ceph-mon[34376]: osdmap e65: 11 total, 10 up, 11 in 2024-09-05T01:20:51.303 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:51 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T01:20:51.311 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:51 smithi012 ceph-mon[29942]: osdmap e64: 10 total, 10 up, 10 in 2024-09-05T01:20:51.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:51 smithi012 ceph-mon[29942]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:20:51.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:51 smithi012 ceph-mon[29942]: from='client.? 172.21.15.145:0/1474437604' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b5b34c3-8814-4d16-80ce-0b0c9be07cf7"}]: dispatch 2024-09-05T01:20:51.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:51 smithi012 ceph-mon[29942]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b5b34c3-8814-4d16-80ce-0b0c9be07cf7"}]: dispatch 2024-09-05T01:20:51.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:51 smithi012 ceph-mon[29942]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b5b34c3-8814-4d16-80ce-0b0c9be07cf7"}]': finished 2024-09-05T01:20:51.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:51 smithi012 ceph-mon[29942]: osdmap e65: 11 total, 10 up, 11 in 2024-09-05T01:20:51.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:51 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T01:20:51.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:51 smithi151 ceph-mon[35013]: osdmap e64: 10 total, 10 up, 10 in 2024-09-05T01:20:51.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:51 smithi151 ceph-mon[35013]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:20:51.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:51 smithi151 ceph-mon[35013]: from='client.? 172.21.15.145:0/1474437604' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b5b34c3-8814-4d16-80ce-0b0c9be07cf7"}]: dispatch 2024-09-05T01:20:51.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:51 smithi151 ceph-mon[35013]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b5b34c3-8814-4d16-80ce-0b0c9be07cf7"}]: dispatch 2024-09-05T01:20:51.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:51 smithi151 ceph-mon[35013]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b5b34c3-8814-4d16-80ce-0b0c9be07cf7"}]': finished 2024-09-05T01:20:51.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:51 smithi151 ceph-mon[35013]: osdmap e65: 11 total, 10 up, 11 in 2024-09-05T01:20:51.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:51 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T01:20:52.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:52 smithi012 ceph-mon[29942]: from='client.? 172.21.15.145:0/2351825611' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:20:52.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:52 smithi145 ceph-mon[34376]: from='client.? 172.21.15.145:0/2351825611' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:20:52.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:52 smithi151 ceph-mon[35013]: from='client.? 172.21.15.145:0/2351825611' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:20:53.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:53 smithi012 ceph-mon[29942]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:20:53.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:53 smithi145 ceph-mon[34376]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:20:53.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:53 smithi151 ceph-mon[35013]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:20:54.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:54 smithi012 ceph-mon[29942]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:20:54.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:54 smithi145 ceph-mon[34376]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:20:54.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:54 smithi151 ceph-mon[35013]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:20:56.460 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:56 smithi145 ceph-mon[34376]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:20:56.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:56 smithi012 ceph-mon[29942]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:20:56.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:56 smithi151 ceph-mon[35013]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:20:58.424 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:58 smithi145 ceph-mon[34376]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:20:58.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:58 smithi012 ceph-mon[29942]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:20:58.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:58 smithi151 ceph-mon[35013]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:20:59.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:59 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-05T01:20:59.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:20:59 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:59.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:59 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-05T01:20:59.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:20:59 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:20:59.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:59 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-05T01:20:59.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:20:59 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:00.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:00 smithi012 ceph-mon[29942]: Deploying daemon osd.10 on smithi145 2024-09-05T01:21:00.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:00 smithi012 ceph-mon[29942]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:21:00.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:00 smithi145 ceph-mon[34376]: Deploying daemon osd.10 on smithi145 2024-09-05T01:21:00.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:00 smithi145 ceph-mon[34376]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:21:00.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:00 smithi151 ceph-mon[35013]: Deploying daemon osd.10 on smithi145 2024-09-05T01:21:00.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:00 smithi151 ceph-mon[35013]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:21:02.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:02 smithi145 ceph-mon[34376]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:21:02.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:02 smithi012 ceph-mon[29942]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:21:02.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:02 smithi151 ceph-mon[35013]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:21:04.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:04 smithi012 ceph-mon[29942]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:21:04.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:04 smithi145 ceph-mon[34376]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:21:04.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:04 smithi151 ceph-mon[35013]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:21:05.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:05 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:21:05.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:05 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:05.535 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:05 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:05.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:21:05.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:05.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:05.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:21:05.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:05.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:06.507 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:06 smithi145 ceph-mon[34376]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:21:06.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:06 smithi012 ceph-mon[29942]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:21:06.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:06 smithi151 ceph-mon[35013]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:21:08.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:21:08.465+0000 7f75417fa640 1 -- 172.21.15.145:0/1049964778 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f7544062630 con 0x7f752c0a2bb0 2024-09-05T01:21:08.468 INFO:teuthology.orchestra.run.smithi145.stdout:Created osd(s) 10 on host 'smithi145' 2024-09-05T01:21:08.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:21:08.468+0000 7f754a504640 1 -- 172.21.15.145:0/1049964778 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f752c0a2bb0 msgr2=0x7f752c0a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:08.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:21:08.468+0000 7f754a504640 1 --2- 172.21.15.145:0/1049964778 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f752c0a2bb0 0x7f752c0a5070 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f75340058c0 tx=0x7f7534005850 comp rx=0 tx=0).stop 2024-09-05T01:21:08.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:21:08.468+0000 7f754a504640 1 -- 172.21.15.145:0/1049964778 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7544100df0 msgr2=0x7f754419a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:08.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:21:08.468+0000 7f754a504640 1 --2- 172.21.15.145:0/1049964778 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7544100df0 0x7f754419a650 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f753800b4a0 tx=0x7f753800b960 comp rx=0 tx=0).stop 2024-09-05T01:21:08.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:21:08.468+0000 7f754a504640 1 -- 172.21.15.145:0/1049964778 shutdown_connections 2024-09-05T01:21:08.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:21:08.468+0000 7f754a504640 1 --2- 172.21.15.145:0/1049964778 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f752c0a2bb0 0x7f752c0a5070 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:08.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:21:08.468+0000 7f754a504640 1 --2- 172.21.15.145:0/1049964778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7544101790 0x7f75441a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:08.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:21:08.468+0000 7f754a504640 1 --2- 172.21.15.145:0/1049964778 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7544100df0 0x7f754419a650 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:08.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:21:08.468+0000 7f754a504640 1 --2- 172.21.15.145:0/1049964778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75441004b0 0x7f754419a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:08.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:21:08.468+0000 7f754a504640 1 -- 172.21.15.145:0/1049964778 >> 172.21.15.145:0/1049964778 conn(0x7f75440fc280 msgr2=0x7f75440fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:21:08.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:21:08.469+0000 7f754a504640 1 -- 172.21.15.145:0/1049964778 shutdown_connections 2024-09-05T01:21:08.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-05T01:21:08.469+0000 7f754a504640 1 -- 172.21.15.145:0/1049964778 wait complete. 2024-09-05T01:21:09.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:08 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:09.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:08 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:09.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:08 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:09.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:08 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:21:09.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:08 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:09.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:08 smithi012 ceph-mon[29942]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:21:09.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:08 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:21:09.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:08 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:09.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:08 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:09.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:08 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:09.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:08 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:09.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:08 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:09.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:08 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:21:09.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:08 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:09.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:08 smithi145 ceph-mon[34376]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:21:09.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:08 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:21:09.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:08 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:09.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:08 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:09.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:08 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:09.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:08 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:09.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:08 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:09.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:08 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:21:09.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:08 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:09.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:08 smithi151 ceph-mon[35013]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:21:09.105 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:08 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:21:09.105 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:08 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:09.105 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:08 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:09.121 DEBUG:teuthology.orchestra.run.smithi145:osd.10> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.10.service 2024-09-05T01:21:09.124 INFO:tasks.cephadm:Deploying osd.11 on smithi151 with /dev/vg_nvme/lv_1... 2024-09-05T01:21:09.124 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-05T01:21:09.378 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T01:21:10.495 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:10 smithi151 ceph-mon[35013]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:21:10.522 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:10 smithi145 ceph-mon[34376]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:21:10.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:10 smithi012 ceph-mon[29942]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:21:11.300 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:11 smithi151 ceph-mon[35013]: from='osd.10 [v2:172.21.15.145:6824/1296813755,v1:172.21.15.145:6825/1296813755]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-05T01:21:11.300 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:11 smithi151 ceph-mon[35013]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-05T01:21:11.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:11 smithi012 ceph-mon[29942]: from='osd.10 [v2:172.21.15.145:6824/1296813755,v1:172.21.15.145:6825/1296813755]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-05T01:21:11.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:11 smithi012 ceph-mon[29942]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-05T01:21:11.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:11 smithi145 ceph-mon[34376]: from='osd.10 [v2:172.21.15.145:6824/1296813755,v1:172.21.15.145:6825/1296813755]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-05T01:21:11.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:11 smithi145 ceph-mon[34376]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-05T01:21:11.584 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:21:11 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:21:11.225+0000 7ff910195640 -1 osd.10 0 log_to_monitors true 2024-09-05T01:21:11.817 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-05T01:21:11.843 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph orch daemon add osd smithi151:vg_nvme/lv_1 2024-09-05T01:21:12.098 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T01:21:12.545 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:12 smithi151 ceph-mon[35013]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-05T01:21:12.545 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:12 smithi151 ceph-mon[35013]: from='osd.10 [v2:172.21.15.145:6824/1296813755,v1:172.21.15.145:6825/1296813755]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-05T01:21:12.545 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:12 smithi151 ceph-mon[35013]: osdmap e66: 11 total, 10 up, 11 in 2024-09-05T01:21:12.546 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T01:21:12.546 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:12 smithi151 ceph-mon[35013]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-05T01:21:12.546 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:12 smithi151 ceph-mon[35013]: Detected new or changed devices on smithi145 2024-09-05T01:21:12.546 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:12.546 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:12.546 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:21:12.546 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:21:12.546 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:21:12.546 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:21:12.546 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:12 smithi151 ceph-mon[35013]: Adjusting osd_memory_target on smithi145 to 4272M 2024-09-05T01:21:12.546 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:12.547 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:12.547 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:21:12.547 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:12.547 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:12 smithi151 ceph-mon[35013]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:21:12.547 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:12 smithi151 ceph-mon[35013]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-05T01:21:12.547 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:12 smithi151 ceph-mon[35013]: osdmap e67: 11 total, 10 up, 11 in 2024-09-05T01:21:12.547 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T01:21:12.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:12 smithi012 ceph-mon[29942]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-05T01:21:12.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:12 smithi012 ceph-mon[29942]: from='osd.10 [v2:172.21.15.145:6824/1296813755,v1:172.21.15.145:6825/1296813755]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-05T01:21:12.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:12 smithi012 ceph-mon[29942]: osdmap e66: 11 total, 10 up, 11 in 2024-09-05T01:21:12.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:12 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T01:21:12.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:12 smithi012 ceph-mon[29942]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-05T01:21:12.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:12 smithi012 ceph-mon[29942]: Detected new or changed devices on smithi145 2024-09-05T01:21:12.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:12 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:12.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:12 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:12.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:12 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:21:12.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:12 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:21:12.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:12 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:21:12.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:12 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:21:12.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:12 smithi012 ceph-mon[29942]: Adjusting osd_memory_target on smithi145 to 4272M 2024-09-05T01:21:12.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:12 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:12.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:12 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:12.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:12 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:21:12.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:12 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:12.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:12 smithi012 ceph-mon[29942]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:21:12.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:12 smithi012 ceph-mon[29942]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-05T01:21:12.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:12 smithi012 ceph-mon[29942]: osdmap e67: 11 total, 10 up, 11 in 2024-09-05T01:21:12.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:12 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T01:21:12.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.543+0000 7f6243aa5640 1 -- 172.21.15.151:0/2285027647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f623c10e1e0 msgr2=0x7f623c1105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:12.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.543+0000 7f6243aa5640 1 --2- 172.21.15.151:0/2285027647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f623c10e1e0 0x7f623c1105d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6234009ca0 tx=0x7f623402a8c0 comp rx=0 tx=0).stop 2024-09-05T01:21:12.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.543+0000 7f6243aa5640 1 -- 172.21.15.151:0/2285027647 shutdown_connections 2024-09-05T01:21:12.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.543+0000 7f6243aa5640 1 --2- 172.21.15.151:0/2285027647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f623c10e1e0 0x7f623c1105d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:12.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.543+0000 7f6243aa5640 1 --2- 172.21.15.151:0/2285027647 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f623c074c50 0x7f623c0750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:12.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.543+0000 7f6243aa5640 1 --2- 172.21.15.151:0/2285027647 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f623c076220 0x7f623c074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:12.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.543+0000 7f6243aa5640 1 -- 172.21.15.151:0/2285027647 >> 172.21.15.151:0/2285027647 conn(0x7f623c0fd390 msgr2=0x7f623c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:21:12.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.543+0000 7f6243aa5640 1 -- 172.21.15.151:0/2285027647 shutdown_connections 2024-09-05T01:21:12.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.543+0000 7f6243aa5640 1 -- 172.21.15.151:0/2285027647 wait complete. 2024-09-05T01:21:12.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.544+0000 7f6243aa5640 1 Processor -- start 2024-09-05T01:21:12.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.544+0000 7f6243aa5640 1 -- start start 2024-09-05T01:21:12.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.544+0000 7f6243aa5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f623c074c50 0x7f623c19e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:12.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.544+0000 7f6243aa5640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f623c076220 0x7f623c19e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:12.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.544+0000 7f6243aa5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f623c10e1e0 0x7f623c1a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:12.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.544+0000 7f6243aa5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f623c113ea0 con 0x7f623c074c50 2024-09-05T01:21:12.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.544+0000 7f6243aa5640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f623c113d20 con 0x7f623c076220 2024-09-05T01:21:12.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.544+0000 7f6243aa5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f623c114020 con 0x7f623c10e1e0 2024-09-05T01:21:12.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.545+0000 7f6241040640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f623c076220 0x7f623c19e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:12.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.545+0000 7f6241040640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f623c076220 0x7f623c19e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.151:54328/0 (socket says 172.21.15.151:54328) 2024-09-05T01:21:12.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.545+0000 7f6241040640 1 -- 172.21.15.151:0/4104079285 learned_addr learned my addr 172.21.15.151:0/4104079285 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-05T01:21:12.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.545+0000 7f6241841640 1 --2- 172.21.15.151:0/4104079285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f623c074c50 0x7f623c19e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:12.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.545+0000 7f6242042640 1 --2- 172.21.15.151:0/4104079285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f623c10e1e0 0x7f623c1a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:12.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.545+0000 7f6241040640 1 -- 172.21.15.151:0/4104079285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f623c10e1e0 msgr2=0x7f623c1a5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:12.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.545+0000 7f6241040640 1 --2- 172.21.15.151:0/4104079285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f623c10e1e0 0x7f623c1a5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:12.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.545+0000 7f6241040640 1 -- 172.21.15.151:0/4104079285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f623c074c50 msgr2=0x7f623c19e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:12.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.545+0000 7f6241040640 1 --2- 172.21.15.151:0/4104079285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f623c074c50 0x7f623c19e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:12.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.545+0000 7f6241040640 1 -- 172.21.15.151:0/4104079285 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623c1a6080 con 0x7f623c076220 2024-09-05T01:21:12.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.545+0000 7f6241040640 1 --2- 172.21.15.151:0/4104079285 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f623c076220 0x7f623c19e990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f622c00d950 tx=0x7f622c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:21:12.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.545+0000 7f6232ffd640 1 -- 172.21.15.151:0/4104079285 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c017070 con 0x7f623c076220 2024-09-05T01:21:12.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.545+0000 7f6232ffd640 1 -- 172.21.15.151:0/4104079285 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f622c009c30 con 0x7f623c076220 2024-09-05T01:21:12.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.545+0000 7f6243aa5640 1 -- 172.21.15.151:0/4104079285 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f623c1a6370 con 0x7f623c076220 2024-09-05T01:21:12.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.545+0000 7f6232ffd640 1 -- 172.21.15.151:0/4104079285 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c00f6b0 con 0x7f623c076220 2024-09-05T01:21:12.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.545+0000 7f6243aa5640 1 -- 172.21.15.151:0/4104079285 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f623c1a68b0 con 0x7f623c076220 2024-09-05T01:21:12.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.546+0000 7f6243aa5640 1 -- 172.21.15.151:0/4104079285 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f623c104290 con 0x7f623c076220 2024-09-05T01:21:12.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.547+0000 7f6232ffd640 1 -- 172.21.15.151:0/4104079285 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f622c0109d0 con 0x7f623c076220 2024-09-05T01:21:12.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.548+0000 7f6232ffd640 1 --2- 172.21.15.151:0/4104079285 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f62280a2bb0 0x7f62280a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:12.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.548+0000 7f6232ffd640 1 -- 172.21.15.151:0/4104079285 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6414+0+0 (secure 0 0 0) 0x7f622c0ce470 con 0x7f623c076220 2024-09-05T01:21:12.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.548+0000 7f6241841640 1 --2- 172.21.15.151:0/4104079285 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f62280a2bb0 0x7f62280a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:12.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.549+0000 7f6241841640 1 --2- 172.21.15.151:0/4104079285 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f62280a2bb0 0x7f62280a5070 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f623c076600 tx=0x7f623800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:21:12.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.551+0000 7f6232ffd640 1 -- 172.21.15.151:0/4104079285 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f622c09b490 con 0x7f623c076220 2024-09-05T01:21:12.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:12 smithi145 ceph-mon[34376]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-05T01:21:12.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:12 smithi145 ceph-mon[34376]: from='osd.10 [v2:172.21.15.145:6824/1296813755,v1:172.21.15.145:6825/1296813755]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-05T01:21:12.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:12 smithi145 ceph-mon[34376]: osdmap e66: 11 total, 10 up, 11 in 2024-09-05T01:21:12.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T01:21:12.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:12 smithi145 ceph-mon[34376]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]: dispatch 2024-09-05T01:21:12.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:12 smithi145 ceph-mon[34376]: Detected new or changed devices on smithi145 2024-09-05T01:21:12.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:12.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:12.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:21:12.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:21:12.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:21:12.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:21:12.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:12 smithi145 ceph-mon[34376]: Adjusting osd_memory_target on smithi145 to 4272M 2024-09-05T01:21:12.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:12.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:12.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:21:12.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:12.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:12 smithi145 ceph-mon[34376]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:21:12.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:12 smithi145 ceph-mon[34376]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi145", "root=default"]}]': finished 2024-09-05T01:21:12.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:12 smithi145 ceph-mon[34376]: osdmap e67: 11 total, 10 up, 11 in 2024-09-05T01:21:12.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T01:21:12.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:12.729+0000 7f6243aa5640 1 -- 172.21.15.151:0/4104079285 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f623c062630 con 0x7f62280a2bb0 2024-09-05T01:21:13.333 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:21:13 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:21:13.036+0000 7ff90c92c640 -1 osd.10 0 waiting for initial osdmap 2024-09-05T01:21:13.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:21:13 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:21:13.051+0000 7ff903f27640 -1 osd.10 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T01:21:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:13 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T01:21:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:13 smithi145 ceph-mon[34376]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:21:13.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:13 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:21:13.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:13 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:21:13.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:13 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:13.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:13 smithi145 ceph-mon[34376]: from='osd.10 ' entity='osd.10' 2024-09-05T01:21:13.463 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:13 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T01:21:13.463 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:13 smithi151 ceph-mon[35013]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:21:13.463 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:13 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:21:13.463 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:13 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:21:13.463 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:13 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:13.463 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:13 smithi151 ceph-mon[35013]: from='osd.10 ' entity='osd.10' 2024-09-05T01:21:13.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:13 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T01:21:13.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:13 smithi012 ceph-mon[29942]: from='client.24389 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:21:13.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:13 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-05T01:21:13.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:13 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-05T01:21:13.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:13 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:13.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:13 smithi012 ceph-mon[29942]: from='osd.10 ' entity='osd.10' 2024-09-05T01:21:14.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:14 smithi151 ceph-mon[35013]: purged_snaps scrub starts 2024-09-05T01:21:14.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:14 smithi151 ceph-mon[35013]: purged_snaps scrub ok 2024-09-05T01:21:14.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T01:21:14.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:14 smithi151 ceph-mon[35013]: osd.10 [v2:172.21.15.145:6824/1296813755,v1:172.21.15.145:6825/1296813755] boot 2024-09-05T01:21:14.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:14 smithi151 ceph-mon[35013]: osdmap e68: 11 total, 11 up, 11 in 2024-09-05T01:21:14.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:14 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T01:21:14.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:14 smithi151 ceph-mon[35013]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:21:14.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:14 smithi012 ceph-mon[29942]: purged_snaps scrub starts 2024-09-05T01:21:14.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:14 smithi012 ceph-mon[29942]: purged_snaps scrub ok 2024-09-05T01:21:14.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T01:21:14.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:14 smithi012 ceph-mon[29942]: osd.10 [v2:172.21.15.145:6824/1296813755,v1:172.21.15.145:6825/1296813755] boot 2024-09-05T01:21:14.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:14 smithi012 ceph-mon[29942]: osdmap e68: 11 total, 11 up, 11 in 2024-09-05T01:21:14.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:14 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T01:21:14.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:14 smithi012 ceph-mon[29942]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:21:14.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:14 smithi145 ceph-mon[34376]: purged_snaps scrub starts 2024-09-05T01:21:14.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:14 smithi145 ceph-mon[34376]: purged_snaps scrub ok 2024-09-05T01:21:14.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:14 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T01:21:14.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:14 smithi145 ceph-mon[34376]: osd.10 [v2:172.21.15.145:6824/1296813755,v1:172.21.15.145:6825/1296813755] boot 2024-09-05T01:21:14.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:14 smithi145 ceph-mon[34376]: osdmap e68: 11 total, 11 up, 11 in 2024-09-05T01:21:14.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:14 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T01:21:14.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:14 smithi145 ceph-mon[34376]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-09-05T01:21:15.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:15 smithi012 ceph-mon[29942]: osdmap e69: 11 total, 11 up, 11 in 2024-09-05T01:21:15.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:15 smithi012 ceph-mon[29942]: from='client.? 172.21.15.151:0/1513481217' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "157ee32a-43f0-4e5a-8dac-fce53c1efdbf"}]: dispatch 2024-09-05T01:21:15.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:15 smithi012 ceph-mon[29942]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "157ee32a-43f0-4e5a-8dac-fce53c1efdbf"}]: dispatch 2024-09-05T01:21:15.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:15 smithi012 ceph-mon[29942]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "157ee32a-43f0-4e5a-8dac-fce53c1efdbf"}]': finished 2024-09-05T01:21:15.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:15 smithi012 ceph-mon[29942]: osdmap e70: 12 total, 11 up, 12 in 2024-09-05T01:21:15.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:15 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:21:15.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:15 smithi145 ceph-mon[34376]: osdmap e69: 11 total, 11 up, 11 in 2024-09-05T01:21:15.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:15 smithi145 ceph-mon[34376]: from='client.? 172.21.15.151:0/1513481217' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "157ee32a-43f0-4e5a-8dac-fce53c1efdbf"}]: dispatch 2024-09-05T01:21:15.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:15 smithi145 ceph-mon[34376]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "157ee32a-43f0-4e5a-8dac-fce53c1efdbf"}]: dispatch 2024-09-05T01:21:15.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:15 smithi145 ceph-mon[34376]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "157ee32a-43f0-4e5a-8dac-fce53c1efdbf"}]': finished 2024-09-05T01:21:15.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:15 smithi145 ceph-mon[34376]: osdmap e70: 12 total, 11 up, 12 in 2024-09-05T01:21:15.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:15 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:21:15.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:15 smithi151 ceph-mon[35013]: osdmap e69: 11 total, 11 up, 11 in 2024-09-05T01:21:15.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:15 smithi151 ceph-mon[35013]: from='client.? 172.21.15.151:0/1513481217' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "157ee32a-43f0-4e5a-8dac-fce53c1efdbf"}]: dispatch 2024-09-05T01:21:15.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:15 smithi151 ceph-mon[35013]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "157ee32a-43f0-4e5a-8dac-fce53c1efdbf"}]: dispatch 2024-09-05T01:21:15.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:15 smithi151 ceph-mon[35013]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "157ee32a-43f0-4e5a-8dac-fce53c1efdbf"}]': finished 2024-09-05T01:21:15.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:15 smithi151 ceph-mon[35013]: osdmap e70: 12 total, 11 up, 12 in 2024-09-05T01:21:15.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:15 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:21:16.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:16 smithi012 ceph-mon[29942]: from='client.? 172.21.15.151:0/2493269559' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:21:16.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:16 smithi012 ceph-mon[29942]: osdmap e71: 12 total, 11 up, 12 in 2024-09-05T01:21:16.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:16 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:21:16.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:16 smithi012 ceph-mon[29942]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-05T01:21:16.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:16 smithi145 ceph-mon[34376]: from='client.? 172.21.15.151:0/2493269559' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:21:16.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:16 smithi145 ceph-mon[34376]: osdmap e71: 12 total, 11 up, 12 in 2024-09-05T01:21:16.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:16 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:21:16.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:16 smithi145 ceph-mon[34376]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-05T01:21:16.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:16 smithi151 ceph-mon[35013]: from='client.? 172.21.15.151:0/2493269559' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-05T01:21:16.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:16 smithi151 ceph-mon[35013]: osdmap e71: 12 total, 11 up, 12 in 2024-09-05T01:21:16.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:16 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:21:16.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:16 smithi151 ceph-mon[35013]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-05T01:21:18.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:18 smithi151 ceph-mon[35013]: osdmap e72: 12 total, 11 up, 12 in 2024-09-05T01:21:18.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:18 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:21:18.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:18 smithi145 ceph-mon[34376]: osdmap e72: 12 total, 11 up, 12 in 2024-09-05T01:21:18.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:18 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:21:18.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:18 smithi012 ceph-mon[29942]: osdmap e72: 12 total, 11 up, 12 in 2024-09-05T01:21:18.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:18 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:21:19.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:19 smithi145 ceph-mon[34376]: pgmap v240: 1 pgs: 1 peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-05T01:21:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:19 smithi012 ceph-mon[29942]: pgmap v240: 1 pgs: 1 peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-05T01:21:19.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:19 smithi151 ceph-mon[35013]: pgmap v240: 1 pgs: 1 peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-05T01:21:20.507 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:20 smithi151 ceph-mon[35013]: pgmap v241: 1 pgs: 1 peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-05T01:21:20.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:20 smithi012 ceph-mon[29942]: pgmap v241: 1 pgs: 1 peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-05T01:21:20.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:20 smithi145 ceph-mon[34376]: pgmap v241: 1 pgs: 1 peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-05T01:21:22.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:22 smithi151 ceph-mon[35013]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-05T01:21:22.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:22 smithi012 ceph-mon[29942]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-05T01:21:22.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:22 smithi145 ceph-mon[34376]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-05T01:21:23.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:23 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-05T01:21:23.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:23 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:23.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:23 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-05T01:21:23.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:23 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:23.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:23 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-05T01:21:23.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:23 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:24.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:24 smithi012 ceph-mon[29942]: Deploying daemon osd.11 on smithi151 2024-09-05T01:21:24.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:24 smithi012 ceph-mon[29942]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-05T01:21:24.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:24 smithi145 ceph-mon[34376]: Deploying daemon osd.11 on smithi151 2024-09-05T01:21:24.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:24 smithi145 ceph-mon[34376]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-05T01:21:24.836 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:24 smithi151 ceph-mon[35013]: Deploying daemon osd.11 on smithi151 2024-09-05T01:21:24.837 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:24 smithi151 ceph-mon[35013]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-05T01:21:26.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:26 smithi012 ceph-mon[29942]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-05T01:21:26.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:26 smithi145 ceph-mon[34376]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-05T01:21:26.598 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:26 smithi151 ceph-mon[35013]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-05T01:21:28.500 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:28 smithi151 ceph-mon[35013]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-05T01:21:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:28 smithi012 ceph-mon[29942]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-05T01:21:28.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:28 smithi145 ceph-mon[34376]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-05T01:21:29.458 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:29 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:21:29.458 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:29 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:29.459 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:29 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:29.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:29 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:21:29.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:29 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:29.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:29 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:29.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:29 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:21:29.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:29 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:29.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:29 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:30.562 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:30 smithi151 ceph-mon[35013]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-05T01:21:30.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:30 smithi012 ceph-mon[29942]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-05T01:21:30.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:30 smithi145 ceph-mon[34376]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-05T01:21:32.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:32.130+0000 7f6232ffd640 1 -- 172.21.15.151:0/4104079285 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f623c062630 con 0x7f62280a2bb0 2024-09-05T01:21:32.131 INFO:teuthology.orchestra.run.smithi151.stdout:Created osd(s) 11 on host 'smithi151' 2024-09-05T01:21:32.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:32.132+0000 7f6243aa5640 1 -- 172.21.15.151:0/4104079285 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f62280a2bb0 msgr2=0x7f62280a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:32.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:32.132+0000 7f6243aa5640 1 --2- 172.21.15.151:0/4104079285 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f62280a2bb0 0x7f62280a5070 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f623c076600 tx=0x7f623800b390 comp rx=0 tx=0).stop 2024-09-05T01:21:32.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:32.132+0000 7f6243aa5640 1 -- 172.21.15.151:0/4104079285 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f623c076220 msgr2=0x7f623c19e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:32.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:32.132+0000 7f6243aa5640 1 --2- 172.21.15.151:0/4104079285 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f623c076220 0x7f623c19e990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f622c00d950 tx=0x7f622c00de10 comp rx=0 tx=0).stop 2024-09-05T01:21:32.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:32.132+0000 7f6243aa5640 1 -- 172.21.15.151:0/4104079285 shutdown_connections 2024-09-05T01:21:32.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:32.132+0000 7f6243aa5640 1 --2- 172.21.15.151:0/4104079285 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f62280a2bb0 0x7f62280a5070 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:32.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:32.132+0000 7f6243aa5640 1 --2- 172.21.15.151:0/4104079285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f623c10e1e0 0x7f623c1a5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:32.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:32.132+0000 7f6243aa5640 1 --2- 172.21.15.151:0/4104079285 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f623c076220 0x7f623c19e990 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:32.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:32.132+0000 7f6243aa5640 1 --2- 172.21.15.151:0/4104079285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f623c074c50 0x7f623c19e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:32.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:32.132+0000 7f6243aa5640 1 -- 172.21.15.151:0/4104079285 >> 172.21.15.151:0/4104079285 conn(0x7f623c0fd390 msgr2=0x7f623c101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:21:32.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:32.132+0000 7f6243aa5640 1 -- 172.21.15.151:0/4104079285 shutdown_connections 2024-09-05T01:21:32.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:32.132+0000 7f6243aa5640 1 -- 172.21.15.151:0/4104079285 wait complete. 2024-09-05T01:21:32.693 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:32 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:32.693 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:32 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:32.693 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:32 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:32.693 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:32 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:21:32.693 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:32 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:32.693 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:32 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:21:32.694 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:32 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:32.694 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:32 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:32.694 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:32 smithi151 ceph-mon[35013]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-05T01:21:32.720 DEBUG:teuthology.orchestra.run.smithi151:osd.11> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.11.service 2024-09-05T01:21:32.722 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-05T01:21:32.723 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd stat -f json 2024-09-05T01:21:32.780 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:32 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:32.780 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:32 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:32.780 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:32 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:32.780 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:32 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:21:32.780 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:32 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:32.781 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:32 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:21:32.781 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:32 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:32.781 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:32 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:32.781 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:32 smithi012 ceph-mon[29942]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-05T01:21:32.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:32 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:32.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:32 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:32.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:32 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:32.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:32 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:21:32.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:32 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:32.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:32 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:21:32.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:32 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:32.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:32 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:32.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:32 smithi145 ceph-mon[34376]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-05T01:21:33.107 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:21:33.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.625+0000 7f1bb5c00640 1 -- 172.21.15.12:0/1040106152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bb0104e50 msgr2=0x7f1bb01052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:33.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.625+0000 7f1bb5c00640 1 --2- 172.21.15.12:0/1040106152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bb0104e50 0x7f1bb01052d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c009900 tx=0x7f1b9c02a3f0 comp rx=0 tx=0).stop 2024-09-05T01:21:33.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.625+0000 7f1bb5c00640 1 -- 172.21.15.12:0/1040106152 shutdown_connections 2024-09-05T01:21:33.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.625+0000 7f1bb5c00640 1 --2- 172.21.15.12:0/1040106152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb0105810 0x7f1bb010c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:33.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.625+0000 7f1bb5c00640 1 --2- 172.21.15.12:0/1040106152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bb0104e50 0x7f1bb01052d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:33.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.625+0000 7f1bb5c00640 1 --2- 172.21.15.12:0/1040106152 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1bb0103c50 0x7f1bb0104050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:33.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.625+0000 7f1bb5c00640 1 -- 172.21.15.12:0/1040106152 >> 172.21.15.12:0/1040106152 conn(0x7f1bb00ff3e0 msgr2=0x7f1bb0101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:21:33.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.625+0000 7f1bb5c00640 1 -- 172.21.15.12:0/1040106152 shutdown_connections 2024-09-05T01:21:33.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.625+0000 7f1bb5c00640 1 -- 172.21.15.12:0/1040106152 wait complete. 2024-09-05T01:21:33.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.626+0000 7f1bb5c00640 1 Processor -- start 2024-09-05T01:21:33.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.626+0000 7f1bb5c00640 1 -- start start 2024-09-05T01:21:33.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.626+0000 7f1bb5c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bb0103c50 0x7f1bb0199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:33.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.626+0000 7f1bb5c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb0104e50 0x7f1bb019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:33.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.626+0000 7f1bb5c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1bb0105810 0x7f1bb01a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:33.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.626+0000 7f1bb5c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb010f8d0 con 0x7f1bb0103c50 2024-09-05T01:21:33.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.626+0000 7f1bb5c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb010f750 con 0x7f1bb0105810 2024-09-05T01:21:33.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.626+0000 7f1bb5c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb010fa50 con 0x7f1bb0104e50 2024-09-05T01:21:33.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.626+0000 7f1bafe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bb0103c50 0x7f1bb0199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:33.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.627+0000 7f1bafe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bb0103c50 0x7f1bb0199f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60562/0 (socket says 172.21.15.12:60562) 2024-09-05T01:21:33.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.627+0000 7f1bafe00640 1 -- 172.21.15.12:0/1642645407 learned_addr learned my addr 172.21.15.12:0/1642645407 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:21:33.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.627+0000 7f1baf400640 1 --2- 172.21.15.12:0/1642645407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb0104e50 0x7f1bb019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:33.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.627+0000 7f1bb5200640 1 --2- 172.21.15.12:0/1642645407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1bb0105810 0x7f1bb01a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:33.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.627+0000 7f1bafe00640 1 -- 172.21.15.12:0/1642645407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb0104e50 msgr2=0x7f1bb019a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:33.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.627+0000 7f1bafe00640 1 --2- 172.21.15.12:0/1642645407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb0104e50 0x7f1bb019a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:33.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.627+0000 7f1bafe00640 1 -- 172.21.15.12:0/1642645407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1bb0105810 msgr2=0x7f1bb01a14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:33.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.627+0000 7f1bafe00640 1 --2- 172.21.15.12:0/1642645407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1bb0105810 0x7f1bb01a14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:33.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.627+0000 7f1bafe00640 1 -- 172.21.15.12:0/1642645407 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb01a1b50 con 0x7f1bb0103c50 2024-09-05T01:21:33.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.627+0000 7f1bafe00640 1 --2- 172.21.15.12:0/1642645407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bb0103c50 0x7f1bb0199f20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000e9c0 tx=0x7f1ba000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:21:33.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.628+0000 7f1bacc00640 1 -- 172.21.15.12:0/1642645407 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba000cd80 con 0x7f1bb0103c50 2024-09-05T01:21:33.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.628+0000 7f1bacc00640 1 -- 172.21.15.12:0/1642645407 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ba00035f0 con 0x7f1bb0103c50 2024-09-05T01:21:33.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.628+0000 7f1bb5c00640 1 -- 172.21.15.12:0/1642645407 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb01a1e40 con 0x7f1bb0103c50 2024-09-05T01:21:33.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.628+0000 7f1bacc00640 1 -- 172.21.15.12:0/1642645407 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0010690 con 0x7f1bb0103c50 2024-09-05T01:21:33.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.628+0000 7f1bb5c00640 1 -- 172.21.15.12:0/1642645407 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb01a22a0 con 0x7f1bb0103c50 2024-09-05T01:21:33.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.629+0000 7f1bb5c00640 1 -- 172.21.15.12:0/1642645407 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bb010b070 con 0x7f1bb0103c50 2024-09-05T01:21:33.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.631+0000 7f1bacc00640 1 -- 172.21.15.12:0/1642645407 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1ba00037a0 con 0x7f1bb0103c50 2024-09-05T01:21:33.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.632+0000 7f1bacc00640 1 --2- 172.21.15.12:0/1642645407 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f1b940a2c30 0x7f1b940a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:33.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.632+0000 7f1bacc00640 1 -- 172.21.15.12:0/1642645407 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6809+0+0 (secure 0 0 0) 0x7f1ba00cee00 con 0x7f1bb0103c50 2024-09-05T01:21:33.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.632+0000 7f1baf400640 1 --2- 172.21.15.12:0/1642645407 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f1b940a2c30 0x7f1b940a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:33.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.633+0000 7f1baf400640 1 --2- 172.21.15.12:0/1642645407 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f1b940a2c30 0x7f1b940a50f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c0314e0 tx=0x7f1b9c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:21:33.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.637+0000 7f1bacc00640 1 -- 172.21.15.12:0/1642645407 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1ba009c2a0 con 0x7f1bb0103c50 2024-09-05T01:21:33.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.826+0000 7f1bb5c00640 1 -- 172.21.15.12:0/1642645407 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f1bb0062ef0 con 0x7f1bb0103c50 2024-09-05T01:21:33.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.827+0000 7f1bacc00640 1 -- 172.21.15.12:0/1642645407 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7f1ba009bba0 con 0x7f1bb0103c50 2024-09-05T01:21:33.828 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:21:33.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.829+0000 7f1bb5c00640 1 -- 172.21.15.12:0/1642645407 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f1b940a2c30 msgr2=0x7f1b940a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:33.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.829+0000 7f1bb5c00640 1 --2- 172.21.15.12:0/1642645407 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f1b940a2c30 0x7f1b940a50f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c0314e0 tx=0x7f1b9c000bc0 comp rx=0 tx=0).stop 2024-09-05T01:21:33.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.829+0000 7f1bb5c00640 1 -- 172.21.15.12:0/1642645407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bb0103c50 msgr2=0x7f1bb0199f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:33.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.829+0000 7f1bb5c00640 1 --2- 172.21.15.12:0/1642645407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bb0103c50 0x7f1bb0199f20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000e9c0 tx=0x7f1ba000ee80 comp rx=0 tx=0).stop 2024-09-05T01:21:33.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.829+0000 7f1bb5c00640 1 -- 172.21.15.12:0/1642645407 shutdown_connections 2024-09-05T01:21:33.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.829+0000 7f1bb5c00640 1 --2- 172.21.15.12:0/1642645407 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f1b940a2c30 0x7f1b940a50f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:33.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.829+0000 7f1bb5c00640 1 --2- 172.21.15.12:0/1642645407 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1bb0105810 0x7f1bb01a14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:33.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.829+0000 7f1bb5c00640 1 --2- 172.21.15.12:0/1642645407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb0104e50 0x7f1bb019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:33.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.829+0000 7f1bb5c00640 1 --2- 172.21.15.12:0/1642645407 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bb0103c50 0x7f1bb0199f20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:33.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.829+0000 7f1bb5c00640 1 -- 172.21.15.12:0/1642645407 >> 172.21.15.12:0/1642645407 conn(0x7f1bb00ff3e0 msgr2=0x7f1bb0108240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:21:33.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.829+0000 7f1bb5c00640 1 -- 172.21.15.12:0/1642645407 shutdown_connections 2024-09-05T01:21:33.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:33.829+0000 7f1bb5c00640 1 -- 172.21.15.12:0/1642645407 wait complete. 2024-09-05T01:21:34.194 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:34 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/1642645407' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T01:21:34.399 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:34 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/1642645407' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T01:21:34.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:34 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/1642645407' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T01:21:34.826 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1725499273,"num_in_osds":12,"osd_in_since":1725499275,"num_remapped_pgs":0} 2024-09-05T01:21:35.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:21:34 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:21:34.842+0000 7f06b786d640 -1 osd.11 0 log_to_monitors true 2024-09-05T01:21:35.494 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:35 smithi151 ceph-mon[35013]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-05T01:21:35.494 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:35 smithi151 ceph-mon[35013]: from='osd.11 [v2:172.21.15.151:6824/2855185758,v1:172.21.15.151:6825/2855185758]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-05T01:21:35.494 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:35 smithi151 ceph-mon[35013]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-05T01:21:35.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:35 smithi012 ceph-mon[29942]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-05T01:21:35.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:35 smithi012 ceph-mon[29942]: from='osd.11 [v2:172.21.15.151:6824/2855185758,v1:172.21.15.151:6825/2855185758]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-05T01:21:35.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:35 smithi012 ceph-mon[29942]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-05T01:21:35.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:35 smithi145 ceph-mon[34376]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-05T01:21:35.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:35 smithi145 ceph-mon[34376]: from='osd.11 [v2:172.21.15.151:6824/2855185758,v1:172.21.15.151:6825/2855185758]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-05T01:21:35.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:35 smithi145 ceph-mon[34376]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-05T01:21:35.827 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd stat -f json 2024-09-05T01:21:36.213 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:21:36.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:36 smithi012 ceph-mon[29942]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-05T01:21:36.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:36 smithi012 ceph-mon[29942]: osdmap e73: 12 total, 11 up, 12 in 2024-09-05T01:21:36.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:36 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:21:36.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:36 smithi012 ceph-mon[29942]: from='osd.11 [v2:172.21.15.151:6824/2855185758,v1:172.21.15.151:6825/2855185758]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-09-05T01:21:36.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:36 smithi012 ceph-mon[29942]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-09-05T01:21:36.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:36 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:36.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:36 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:36.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:36 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:21:36.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:36 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:21:36.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:36 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:21:36.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:36 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:21:36.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:36 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:36.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:36 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:36.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:36 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:21:36.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:36 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:36.485 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:36 smithi145 ceph-mon[34376]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-05T01:21:36.485 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:36 smithi145 ceph-mon[34376]: osdmap e73: 12 total, 11 up, 12 in 2024-09-05T01:21:36.486 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:36 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:21:36.486 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:36 smithi145 ceph-mon[34376]: from='osd.11 [v2:172.21.15.151:6824/2855185758,v1:172.21.15.151:6825/2855185758]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-09-05T01:21:36.486 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:36 smithi145 ceph-mon[34376]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-09-05T01:21:36.486 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:36 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:36.486 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:36 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:36.486 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:36 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:21:36.486 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:36 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:21:36.486 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:36 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:21:36.486 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:36 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:21:36.486 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:36 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:36.486 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:36 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:36.486 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:36 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:21:36.486 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:36 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:36.604 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:21:36 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:21:36.141+0000 7f06b2fcd640 -1 osd.11 0 waiting for initial osdmap 2024-09-05T01:21:36.604 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:21:36 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:21:36.155+0000 7f06af607640 -1 osd.11 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-05T01:21:36.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:36 smithi151 ceph-mon[35013]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-05T01:21:36.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:36 smithi151 ceph-mon[35013]: osdmap e73: 12 total, 11 up, 12 in 2024-09-05T01:21:36.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:36 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:21:36.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:36 smithi151 ceph-mon[35013]: from='osd.11 [v2:172.21.15.151:6824/2855185758,v1:172.21.15.151:6825/2855185758]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-09-05T01:21:36.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:36 smithi151 ceph-mon[35013]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-09-05T01:21:36.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:36 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:36 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:36 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:21:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:36 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:21:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:36 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:21:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:36 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:21:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:36 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:36 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:36 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:21:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:36 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:36.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.934+0000 7fc7f2400640 1 -- 172.21.15.12:0/3739357081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7ec101c00 msgr2=0x7fc7ec102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:36.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.934+0000 7fc7f2400640 1 --2- 172.21.15.12:0/3739357081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7ec101c00 0x7fc7ec102000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009860 tx=0x7fc7dc02a340 comp rx=0 tx=0).stop 2024-09-05T01:21:36.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.934+0000 7fc7f2400640 1 -- 172.21.15.12:0/3739357081 shutdown_connections 2024-09-05T01:21:36.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.934+0000 7fc7f2400640 1 --2- 172.21.15.12:0/3739357081 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7ec1037c0 0x7fc7ec10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:36.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.934+0000 7fc7f2400640 1 --2- 172.21.15.12:0/3739357081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7ec102e00 0x7fc7ec103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:36.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.934+0000 7fc7f2400640 1 --2- 172.21.15.12:0/3739357081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7ec101c00 0x7fc7ec102000 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:36.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.934+0000 7fc7f2400640 1 -- 172.21.15.12:0/3739357081 >> 172.21.15.12:0/3739357081 conn(0x7fc7ec0fd390 msgr2=0x7fc7ec0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:21:36.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.934+0000 7fc7f2400640 1 -- 172.21.15.12:0/3739357081 shutdown_connections 2024-09-05T01:21:36.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.934+0000 7fc7f2400640 1 -- 172.21.15.12:0/3739357081 wait complete. 2024-09-05T01:21:36.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.935+0000 7fc7f2400640 1 Processor -- start 2024-09-05T01:21:36.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.936+0000 7fc7f2400640 1 -- start start 2024-09-05T01:21:36.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.936+0000 7fc7f2400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7ec101c00 0x7fc7ec19a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:36.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.936+0000 7fc7f2400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7ec102e00 0x7fc7ec19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:36.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.936+0000 7fc7f2400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7ec1037c0 0x7fc7ec1a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:36.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.936+0000 7fc7f2400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ec10d890 con 0x7fc7ec101c00 2024-09-05T01:21:36.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.936+0000 7fc7f2400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ec10d710 con 0x7fc7ec1037c0 2024-09-05T01:21:36.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.936+0000 7fc7f2400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ec10da10 con 0x7fc7ec102e00 2024-09-05T01:21:36.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.936+0000 7fc7eb400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7ec101c00 0x7fc7ec19a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:36.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.936+0000 7fc7eb400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7ec101c00 0x7fc7ec19a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33282/0 (socket says 172.21.15.12:33282) 2024-09-05T01:21:36.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.936+0000 7fc7eaa00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7ec102e00 0x7fc7ec19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:36.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.936+0000 7fc7eb400640 1 -- 172.21.15.12:0/1030949599 learned_addr learned my addr 172.21.15.12:0/1030949599 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:21:36.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.936+0000 7fc7ebe00640 1 --2- 172.21.15.12:0/1030949599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7ec1037c0 0x7fc7ec1a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:36.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.937+0000 7fc7eb400640 1 -- 172.21.15.12:0/1030949599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7ec102e00 msgr2=0x7fc7ec19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:36.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.937+0000 7fc7eb400640 1 --2- 172.21.15.12:0/1030949599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7ec102e00 0x7fc7ec19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:36.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.937+0000 7fc7eb400640 1 -- 172.21.15.12:0/1030949599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7ec1037c0 msgr2=0x7fc7ec1a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:36.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.937+0000 7fc7eb400640 1 --2- 172.21.15.12:0/1030949599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7ec1037c0 0x7fc7ec1a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:36.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.937+0000 7fc7eb400640 1 -- 172.21.15.12:0/1030949599 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7ec1a1d00 con 0x7fc7ec101c00 2024-09-05T01:21:36.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.937+0000 7fc7eb400640 1 --2- 172.21.15.12:0/1030949599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7ec101c00 0x7fc7ec19a0d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0305b0 tx=0x7fc7dc033d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:21:36.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.937+0000 7fc7e3e00640 1 -- 172.21.15.12:0/1030949599 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc03f020 con 0x7fc7ec101c00 2024-09-05T01:21:36.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.937+0000 7fc7e3e00640 1 -- 172.21.15.12:0/1030949599 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7dc030850 con 0x7fc7ec101c00 2024-09-05T01:21:36.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.937+0000 7fc7e3e00640 1 -- 172.21.15.12:0/1030949599 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc037040 con 0x7fc7ec101c00 2024-09-05T01:21:36.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.937+0000 7fc7f2400640 1 -- 172.21.15.12:0/1030949599 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7ec1a1f90 con 0x7fc7ec101c00 2024-09-05T01:21:36.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.938+0000 7fc7f2400640 1 -- 172.21.15.12:0/1030949599 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7ec1a23e0 con 0x7fc7ec101c00 2024-09-05T01:21:36.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.939+0000 7fc7f2400640 1 -- 172.21.15.12:0/1030949599 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7ec1a26d0 con 0x7fc7ec101c00 2024-09-05T01:21:36.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.941+0000 7fc7e3e00640 1 -- 172.21.15.12:0/1030949599 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc7dc042020 con 0x7fc7ec101c00 2024-09-05T01:21:36.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.943+0000 7fc7e3e00640 1 --2- 172.21.15.12:0/1030949599 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc7d00a2c30 0x7fc7d00a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:36.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.943+0000 7fc7e3e00640 1 -- 172.21.15.12:0/1030949599 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6847+0+0 (secure 0 0 0) 0x7fc7dc0eed70 con 0x7fc7ec101c00 2024-09-05T01:21:36.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.943+0000 7fc7eaa00640 1 --2- 172.21.15.12:0/1030949599 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc7d00a2c30 0x7fc7d00a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:36.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.944+0000 7fc7eaa00640 1 --2- 172.21.15.12:0/1030949599 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc7d00a2c30 0x7fc7d00a50f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec19b5f0 tx=0x7fc7d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:21:36.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:36.945+0000 7fc7e3e00640 1 -- 172.21.15.12:0/1030949599 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc7dc049030 con 0x7fc7ec101c00 2024-09-05T01:21:37.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:37.131+0000 7fc7f2400640 1 -- 172.21.15.12:0/1030949599 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fc7ec1a29c0 con 0x7fc7ec101c00 2024-09-05T01:21:37.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:37.131+0000 7fc7e3e00640 1 -- 172.21.15.12:0/1030949599 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7fc7dc0ee020 con 0x7fc7ec101c00 2024-09-05T01:21:37.132 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:21:37.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:37.133+0000 7fc7f2400640 1 -- 172.21.15.12:0/1030949599 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc7d00a2c30 msgr2=0x7fc7d00a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:37.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:37.133+0000 7fc7f2400640 1 --2- 172.21.15.12:0/1030949599 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc7d00a2c30 0x7fc7d00a50f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec19b5f0 tx=0x7fc7d8005f90 comp rx=0 tx=0).stop 2024-09-05T01:21:37.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:37.133+0000 7fc7f2400640 1 -- 172.21.15.12:0/1030949599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7ec101c00 msgr2=0x7fc7ec19a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:37.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:37.133+0000 7fc7f2400640 1 --2- 172.21.15.12:0/1030949599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7ec101c00 0x7fc7ec19a0d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0305b0 tx=0x7fc7dc033d90 comp rx=0 tx=0).stop 2024-09-05T01:21:37.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:37.133+0000 7fc7f2400640 1 -- 172.21.15.12:0/1030949599 shutdown_connections 2024-09-05T01:21:37.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:37.133+0000 7fc7f2400640 1 --2- 172.21.15.12:0/1030949599 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc7d00a2c30 0x7fc7d00a50f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:37.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:37.133+0000 7fc7f2400640 1 --2- 172.21.15.12:0/1030949599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7ec1037c0 0x7fc7ec1a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:37.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:37.133+0000 7fc7f2400640 1 --2- 172.21.15.12:0/1030949599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7ec102e00 0x7fc7ec19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:37.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:37.133+0000 7fc7f2400640 1 --2- 172.21.15.12:0/1030949599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7ec101c00 0x7fc7ec19a0d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:37.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:37.133+0000 7fc7f2400640 1 -- 172.21.15.12:0/1030949599 >> 172.21.15.12:0/1030949599 conn(0x7fc7ec0fd390 msgr2=0x7fc7ec074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:21:37.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:37.134+0000 7fc7f2400640 1 -- 172.21.15.12:0/1030949599 shutdown_connections 2024-09-05T01:21:37.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:37.134+0000 7fc7f2400640 1 -- 172.21.15.12:0/1030949599 wait complete. 2024-09-05T01:21:37.310 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:37 smithi012 ceph-mon[29942]: Detected new or changed devices on smithi151 2024-09-05T01:21:37.311 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:37 smithi012 ceph-mon[29942]: Adjusting osd_memory_target on smithi151 to 4272M 2024-09-05T01:21:37.311 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:37 smithi012 ceph-mon[29942]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-09-05T01:21:37.311 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:37 smithi012 ceph-mon[29942]: osdmap e74: 12 total, 11 up, 12 in 2024-09-05T01:21:37.311 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:37 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:21:37.311 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:37 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:21:37.311 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:37 smithi012 ceph-mon[29942]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-05T01:21:37.311 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:37 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/1030949599' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T01:21:37.311 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:37 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:21:37.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:37 smithi145 ceph-mon[34376]: Detected new or changed devices on smithi151 2024-09-05T01:21:37.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:37 smithi145 ceph-mon[34376]: Adjusting osd_memory_target on smithi151 to 4272M 2024-09-05T01:21:37.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:37 smithi145 ceph-mon[34376]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-09-05T01:21:37.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:37 smithi145 ceph-mon[34376]: osdmap e74: 12 total, 11 up, 12 in 2024-09-05T01:21:37.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:37 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:21:37.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:37 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:21:37.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:37 smithi145 ceph-mon[34376]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-05T01:21:37.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:37 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/1030949599' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T01:21:37.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:37 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:21:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:37 smithi151 ceph-mon[35013]: Detected new or changed devices on smithi151 2024-09-05T01:21:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:37 smithi151 ceph-mon[35013]: Adjusting osd_memory_target on smithi151 to 4272M 2024-09-05T01:21:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:37 smithi151 ceph-mon[35013]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-09-05T01:21:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:37 smithi151 ceph-mon[35013]: osdmap e74: 12 total, 11 up, 12 in 2024-09-05T01:21:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:37 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:21:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:37 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:21:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:37 smithi151 ceph-mon[35013]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-05T01:21:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:37 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/1030949599' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T01:21:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:37 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:21:38.019 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":74,"num_osds":12,"num_up_osds":11,"osd_up_since":1725499273,"num_in_osds":12,"osd_in_since":1725499275,"num_remapped_pgs":0} 2024-09-05T01:21:38.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:38 smithi012 ceph-mon[29942]: purged_snaps scrub starts 2024-09-05T01:21:38.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:38 smithi012 ceph-mon[29942]: purged_snaps scrub ok 2024-09-05T01:21:38.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:38 smithi012 ceph-mon[29942]: osd.11 [v2:172.21.15.151:6824/2855185758,v1:172.21.15.151:6825/2855185758] boot 2024-09-05T01:21:38.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:38 smithi012 ceph-mon[29942]: osdmap e75: 12 total, 12 up, 12 in 2024-09-05T01:21:38.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:38 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:21:38.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:38 smithi145 ceph-mon[34376]: purged_snaps scrub starts 2024-09-05T01:21:38.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:38 smithi145 ceph-mon[34376]: purged_snaps scrub ok 2024-09-05T01:21:38.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:38 smithi145 ceph-mon[34376]: osd.11 [v2:172.21.15.151:6824/2855185758,v1:172.21.15.151:6825/2855185758] boot 2024-09-05T01:21:38.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:38 smithi145 ceph-mon[34376]: osdmap e75: 12 total, 12 up, 12 in 2024-09-05T01:21:38.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:38 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:21:38.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:38 smithi151 ceph-mon[35013]: purged_snaps scrub starts 2024-09-05T01:21:38.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:38 smithi151 ceph-mon[35013]: purged_snaps scrub ok 2024-09-05T01:21:38.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:38 smithi151 ceph-mon[35013]: osd.11 [v2:172.21.15.151:6824/2855185758,v1:172.21.15.151:6825/2855185758] boot 2024-09-05T01:21:38.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:38 smithi151 ceph-mon[35013]: osdmap e75: 12 total, 12 up, 12 in 2024-09-05T01:21:38.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:38 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:21:39.020 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd stat -f json 2024-09-05T01:21:39.408 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:21:39.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:39 smithi012 ceph-mon[29942]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:39.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:39 smithi012 ceph-mon[29942]: osdmap e76: 12 total, 12 up, 12 in 2024-09-05T01:21:39.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:39 smithi145 ceph-mon[34376]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:39.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:39 smithi145 ceph-mon[34376]: osdmap e76: 12 total, 12 up, 12 in 2024-09-05T01:21:39.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:39 smithi151 ceph-mon[35013]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:39.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:39 smithi151 ceph-mon[35013]: osdmap e76: 12 total, 12 up, 12 in 2024-09-05T01:21:39.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.932+0000 7f230b000640 1 -- 172.21.15.12:0/1546307776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2304105920 msgr2=0x7f230410c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:39.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.932+0000 7f230b000640 1 --2- 172.21.15.12:0/1546307776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2304105920 0x7f230410c240 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f22fc009ca0 tx=0x7f22fc02a8c0 comp rx=0 tx=0).stop 2024-09-05T01:21:39.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.933+0000 7f230b000640 1 -- 172.21.15.12:0/1546307776 shutdown_connections 2024-09-05T01:21:39.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.933+0000 7f230b000640 1 --2- 172.21.15.12:0/1546307776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2304105920 0x7f230410c240 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:39.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.933+0000 7f230b000640 1 --2- 172.21.15.12:0/1546307776 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2304104f60 0x7f23041053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:39.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.933+0000 7f230b000640 1 --2- 172.21.15.12:0/1546307776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2304103e00 0x7f2304104200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:39.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.933+0000 7f230b000640 1 -- 172.21.15.12:0/1546307776 >> 172.21.15.12:0/1546307776 conn(0x7f23040ff5b0 msgr2=0x7f23041019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:21:39.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.933+0000 7f230b000640 1 -- 172.21.15.12:0/1546307776 shutdown_connections 2024-09-05T01:21:39.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.933+0000 7f230b000640 1 -- 172.21.15.12:0/1546307776 wait complete. 2024-09-05T01:21:39.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.934+0000 7f230b000640 1 Processor -- start 2024-09-05T01:21:39.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.934+0000 7f230b000640 1 -- start start 2024-09-05T01:21:39.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.934+0000 7f230b000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2304103e00 0x7f230419a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:39.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.934+0000 7f230b000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2304104f60 0x7f230419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:39.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.934+0000 7f230b000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2304105920 0x7f23041a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:39.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.934+0000 7f230b000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f230410fa90 con 0x7f2304103e00 2024-09-05T01:21:39.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.934+0000 7f230b000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f230410f910 con 0x7f2304104f60 2024-09-05T01:21:39.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.934+0000 7f230b000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f230410fc10 con 0x7f2304105920 2024-09-05T01:21:39.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.934+0000 7f2303e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2304103e00 0x7f230419a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:39.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.935+0000 7f22fbe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2304104f60 0x7f230419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:39.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.935+0000 7f2303e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2304103e00 0x7f230419a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33308/0 (socket says 172.21.15.12:33308) 2024-09-05T01:21:39.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.935+0000 7f2303e00640 1 -- 172.21.15.12:0/3835308359 learned_addr learned my addr 172.21.15.12:0/3835308359 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:21:39.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.935+0000 7f22fbe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2304104f60 0x7f230419a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:59364/0 (socket says 172.21.15.12:59364) 2024-09-05T01:21:39.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.935+0000 7f2309000640 1 --2- 172.21.15.12:0/3835308359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2304105920 0x7f23041a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:39.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.935+0000 7f22fbe00640 1 -- 172.21.15.12:0/3835308359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2304105920 msgr2=0x7f23041a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:39.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.935+0000 7f22fbe00640 1 --2- 172.21.15.12:0/3835308359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2304105920 0x7f23041a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:39.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.935+0000 7f22fbe00640 1 -- 172.21.15.12:0/3835308359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2304103e00 msgr2=0x7f230419a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:39.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.935+0000 7f22fbe00640 1 --2- 172.21.15.12:0/3835308359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2304103e00 0x7f230419a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:39.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.935+0000 7f22fbe00640 1 -- 172.21.15.12:0/3835308359 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23041a1c80 con 0x7f2304104f60 2024-09-05T01:21:39.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.935+0000 7f22fbe00640 1 --2- 172.21.15.12:0/3835308359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2304104f60 0x7f230419a590 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00e9c0 tx=0x7f22ec00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:21:39.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.936+0000 7f2301600640 1 -- 172.21.15.12:0/3835308359 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec00ccc0 con 0x7f2304104f60 2024-09-05T01:21:39.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.936+0000 7f2301600640 1 -- 172.21.15.12:0/3835308359 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22ec0035f0 con 0x7f2304104f60 2024-09-05T01:21:39.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.936+0000 7f230b000640 1 -- 172.21.15.12:0/3835308359 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23041a1f70 con 0x7f2304104f60 2024-09-05T01:21:39.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.936+0000 7f2301600640 1 -- 172.21.15.12:0/3835308359 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec00ce60 con 0x7f2304104f60 2024-09-05T01:21:39.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.936+0000 7f230b000640 1 -- 172.21.15.12:0/3835308359 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23041a2470 con 0x7f2304104f60 2024-09-05T01:21:39.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.937+0000 7f230b000640 1 -- 172.21.15.12:0/3835308359 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f230410b190 con 0x7f2304104f60 2024-09-05T01:21:39.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.939+0000 7f2301600640 1 -- 172.21.15.12:0/3835308359 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f22ec0037a0 con 0x7f2304104f60 2024-09-05T01:21:39.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.940+0000 7f2301600640 1 --2- 172.21.15.12:0/3835308359 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f22e80a2c30 0x7f22e80a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:39.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.940+0000 7f2301600640 1 -- 172.21.15.12:0/3835308359 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f22ec0cef70 con 0x7f2304104f60 2024-09-05T01:21:39.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.941+0000 7f2303e00640 1 --2- 172.21.15.12:0/3835308359 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f22e80a2c30 0x7f22e80a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:39.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.941+0000 7f2303e00640 1 --2- 172.21.15.12:0/3835308359 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f22e80a2c30 0x7f22e80a50f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f22f4009c90 tx=0x7f22f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:21:39.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:39.942+0000 7f2301600640 1 -- 172.21.15.12:0/3835308359 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f22ec09c360 con 0x7f2304104f60 2024-09-05T01:21:40.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:40.128+0000 7f230b000640 1 -- 172.21.15.12:0/3835308359 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f230402d9e0 con 0x7f2304104f60 2024-09-05T01:21:40.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:40.129+0000 7f2301600640 1 -- 172.21.15.12:0/3835308359 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) ==== 74+0+133 (secure 0 0 0) 0x7f22ec09bc60 con 0x7f2304104f60 2024-09-05T01:21:40.130 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:21:40.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:40.132+0000 7f230b000640 1 -- 172.21.15.12:0/3835308359 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f22e80a2c30 msgr2=0x7f22e80a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:40.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:40.132+0000 7f230b000640 1 --2- 172.21.15.12:0/3835308359 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f22e80a2c30 0x7f22e80a50f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f22f4009c90 tx=0x7f22f4005f90 comp rx=0 tx=0).stop 2024-09-05T01:21:40.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:40.132+0000 7f230b000640 1 -- 172.21.15.12:0/3835308359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2304104f60 msgr2=0x7f230419a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:40.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:40.132+0000 7f230b000640 1 --2- 172.21.15.12:0/3835308359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2304104f60 0x7f230419a590 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00e9c0 tx=0x7f22ec00ee80 comp rx=0 tx=0).stop 2024-09-05T01:21:40.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:40.132+0000 7f230b000640 1 -- 172.21.15.12:0/3835308359 shutdown_connections 2024-09-05T01:21:40.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:40.132+0000 7f230b000640 1 --2- 172.21.15.12:0/3835308359 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f22e80a2c30 0x7f22e80a50f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:40.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:40.132+0000 7f230b000640 1 --2- 172.21.15.12:0/3835308359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2304105920 0x7f23041a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:40.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:40.132+0000 7f230b000640 1 --2- 172.21.15.12:0/3835308359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2304104f60 0x7f230419a590 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:40.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:40.132+0000 7f230b000640 1 --2- 172.21.15.12:0/3835308359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2304103e00 0x7f230419a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:40.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:40.132+0000 7f230b000640 1 -- 172.21.15.12:0/3835308359 >> 172.21.15.12:0/3835308359 conn(0x7f23040ff5b0 msgr2=0x7f2304108360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:21:40.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:40.133+0000 7f230b000640 1 -- 172.21.15.12:0/3835308359 shutdown_connections 2024-09-05T01:21:40.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:40.133+0000 7f230b000640 1 -- 172.21.15.12:0/3835308359 wait complete. 2024-09-05T01:21:40.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:40 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3835308359' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T01:21:40.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:40 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3835308359' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T01:21:40.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:40 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3835308359' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-05T01:21:41.147 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":76,"num_osds":12,"num_up_osds":12,"osd_up_since":1725499297,"num_in_osds":12,"osd_in_since":1725499275,"num_remapped_pgs":0} 2024-09-05T01:21:41.148 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T01:21:41.521 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:21:41.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:41 smithi012 ceph-mon[29942]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:41.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:41 smithi145 ceph-mon[34376]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:41.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:41 smithi151 ceph-mon[35013]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:42.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.198+0000 7f1366a00640 1 -- 172.21.15.12:0/4268997883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1360104010 msgr2=0x7f13601043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:42.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.198+0000 7f1366a00640 1 --2- 172.21.15.12:0/4268997883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1360104010 0x7f13601043f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1350009900 tx=0x7f135002a410 comp rx=0 tx=0).stop 2024-09-05T01:21:42.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.199+0000 7f1366a00640 1 -- 172.21.15.12:0/4268997883 shutdown_connections 2024-09-05T01:21:42.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.199+0000 7f1366a00640 1 --2- 172.21.15.12:0/4268997883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1360109140 0x7f1360110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:42.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.199+0000 7f1366a00640 1 --2- 172.21.15.12:0/4268997883 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13601049c0 0x7f1360108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:42.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.199+0000 7f1366a00640 1 --2- 172.21.15.12:0/4268997883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1360104010 0x7f13601043f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:42.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.199+0000 7f1366a00640 1 -- 172.21.15.12:0/4268997883 >> 172.21.15.12:0/4268997883 conn(0x7f13600ffa50 msgr2=0x7f1360101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:21:42.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.199+0000 7f1366a00640 1 -- 172.21.15.12:0/4268997883 shutdown_connections 2024-09-05T01:21:42.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.199+0000 7f1366a00640 1 -- 172.21.15.12:0/4268997883 wait complete. 2024-09-05T01:21:42.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.200+0000 7f1366a00640 1 Processor -- start 2024-09-05T01:21:42.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.200+0000 7f1366a00640 1 -- start start 2024-09-05T01:21:42.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.200+0000 7f1366a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1360104010 0x7f136019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:42.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.200+0000 7f1366a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13601049c0 0x7f136019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:42.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.200+0000 7f1366a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1360109140 0x7f136019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:42.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.200+0000 7f1366a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f13601141c0 con 0x7f1360109140 2024-09-05T01:21:42.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.200+0000 7f1366a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1360114040 con 0x7f13601049c0 2024-09-05T01:21:42.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.200+0000 7f1366a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1360114340 con 0x7f1360104010 2024-09-05T01:21:42.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.201+0000 7f1364a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1360109140 0x7f136019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:42.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.201+0000 7f135fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1360104010 0x7f136019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:42.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.201+0000 7f1364a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1360109140 0x7f136019ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33318/0 (socket says 172.21.15.12:33318) 2024-09-05T01:21:42.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.201+0000 7f1364a00640 1 -- 172.21.15.12:0/1170147752 learned_addr learned my addr 172.21.15.12:0/1170147752 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:21:42.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.201+0000 7f1357400640 1 --2- 172.21.15.12:0/1170147752 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13601049c0 0x7f136019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:42.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.201+0000 7f1364a00640 1 -- 172.21.15.12:0/1170147752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1360104010 msgr2=0x7f136019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:42.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.201+0000 7f1364a00640 1 --2- 172.21.15.12:0/1170147752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1360104010 0x7f136019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:42.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.201+0000 7f1364a00640 1 -- 172.21.15.12:0/1170147752 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13601049c0 msgr2=0x7f136019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:42.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.201+0000 7f1364a00640 1 --2- 172.21.15.12:0/1170147752 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13601049c0 0x7f136019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:42.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.201+0000 7f1364a00640 1 -- 172.21.15.12:0/1170147752 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f136019f5f0 con 0x7f1360109140 2024-09-05T01:21:42.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.201+0000 7f1364a00640 1 --2- 172.21.15.12:0/1170147752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1360109140 0x7f136019ef10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f135800eb10 tx=0x7f135800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:21:42.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.202+0000 7f135d600640 1 -- 172.21.15.12:0/1170147752 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1358004b20 con 0x7f1360109140 2024-09-05T01:21:42.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.202+0000 7f135d600640 1 -- 172.21.15.12:0/1170147752 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1358004cc0 con 0x7f1360109140 2024-09-05T01:21:42.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.202+0000 7f1366a00640 1 -- 172.21.15.12:0/1170147752 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f136019f8e0 con 0x7f1360109140 2024-09-05T01:21:42.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.202+0000 7f135d600640 1 -- 172.21.15.12:0/1170147752 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1358010760 con 0x7f1360109140 2024-09-05T01:21:42.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.202+0000 7f1366a00640 1 -- 172.21.15.12:0/1170147752 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13601a71c0 con 0x7f1360109140 2024-09-05T01:21:42.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.203+0000 7f1366a00640 1 -- 172.21.15.12:0/1170147752 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13601043f0 con 0x7f1360109140 2024-09-05T01:21:42.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.205+0000 7f135d600640 1 -- 172.21.15.12:0/1170147752 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1358005020 con 0x7f1360109140 2024-09-05T01:21:42.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.206+0000 7f135d600640 1 --2- 172.21.15.12:0/1170147752 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f13440a2c00 0x7f13440a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:42.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.206+0000 7f135d600640 1 -- 172.21.15.12:0/1170147752 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f13580cf1f0 con 0x7f1360109140 2024-09-05T01:21:42.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.206+0000 7f135fe00640 1 --2- 172.21.15.12:0/1170147752 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f13440a2c00 0x7f13440a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:42.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.207+0000 7f135fe00640 1 --2- 172.21.15.12:0/1170147752 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f13440a2c00 0x7f13440a50c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1350000c00 tx=0x7f1350005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:21:42.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.210+0000 7f135d600640 1 -- 172.21.15.12:0/1170147752 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f135809c550 con 0x7f1360109140 2024-09-05T01:21:42.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.397+0000 7f1366a00640 1 -- 172.21.15.12:0/1170147752 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f136002d7c0 con 0x7f1360109140 2024-09-05T01:21:42.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.399+0000 7f135d600640 1 -- 172.21.15.12:0/1170147752 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+18504 (secure 0 0 0) 0x7f135809be50 con 0x7f1360109140 2024-09-05T01:21:42.400 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:21:42.400 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":76,"fsid":"0d44cd7e-6b24-11ef-bcd6-c7b262605968","created":"2024-09-05T01:14:21.162850+0000","modified":"2024-09-05T01:21:38.156448+0000","last_up_change":"2024-09-05T01:21:37.145073+0000","last_in_change":"2024-09-05T01:21:15.076991+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T01:17:44.744065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b74ac640-b680-46e2-9106-d24168e685e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6803","nonce":2090563987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6805","nonce":2090563987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6809","nonce":2090563987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6807","nonce":2090563987}]},"public_addr":"172.21.15.12:6803/2090563987","cluster_addr":"172.21.15.12:6805/2090563987","heartbeat_back_addr":"172.21.15.12:6809/2090563987","heartbeat_front_addr":"172.21.15.12:6807/2090563987","state":["exists","up"]},{"osd":1,"uuid":"efca1216-8d85-4e6a-8c49-0afb511ece59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6801","nonce":2639126629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6803","nonce":2639126629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6807","nonce":2639126629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6805","nonce":2639126629}]},"public_addr":"172.21.15.145:6801/2639126629","cluster_addr":"172.21.15.145:6803/2639126629","heartbeat_back_addr":"172.21.15.145:6807/2639126629","heartbeat_front_addr":"172.21.15.145:6805/2639126629","state":["exists","up"]},{"osd":2,"uuid":"4d5699b2-646a-4ab6-94a5-ad223aa27ac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6801","nonce":3753171761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6803","nonce":3753171761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6807","nonce":3753171761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6805","nonce":3753171761}]},"public_addr":"172.21.15.151:6801/3753171761","cluster_addr":"172.21.15.151:6803/3753171761","heartbeat_back_addr":"172.21.15.151:6807/3753171761","heartbeat_front_addr":"172.21.15.151:6805/3753171761","state":["exists","up"]},{"osd":3,"uuid":"275ad2ad-93e6-4a68-8784-8f8dcb620f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6811","nonce":2231650146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6813","nonce":2231650146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6817","nonce":2231650146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6815","nonce":2231650146}]},"public_addr":"172.21.15.12:6811/2231650146","cluster_addr":"172.21.15.12:6813/2231650146","heartbeat_back_addr":"172.21.15.12:6817/2231650146","heartbeat_front_addr":"172.21.15.12:6815/2231650146","state":["exists","up"]},{"osd":4,"uuid":"21a0c5b4-4e0e-4fb6-8be6-a300cb811cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6809","nonce":1828591275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6811","nonce":1828591275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6815","nonce":1828591275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6813","nonce":1828591275}]},"public_addr":"172.21.15.145:6809/1828591275","cluster_addr":"172.21.15.145:6811/1828591275","heartbeat_back_addr":"172.21.15.145:6815/1828591275","heartbeat_front_addr":"172.21.15.145:6813/1828591275","state":["exists","up"]},{"osd":5,"uuid":"e2c7e6fb-5dea-459f-8d7a-7ae5b1936218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6809","nonce":3888870109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6811","nonce":3888870109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6815","nonce":3888870109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6813","nonce":3888870109}]},"public_addr":"172.21.15.151:6809/3888870109","cluster_addr":"172.21.15.151:6811/3888870109","heartbeat_back_addr":"172.21.15.151:6815/3888870109","heartbeat_front_addr":"172.21.15.151:6813/3888870109","state":["exists","up"]},{"osd":6,"uuid":"0df0a29c-3404-4ff5-ae48-78b69b77cbd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6819","nonce":3084810269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6821","nonce":3084810269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6825","nonce":3084810269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6823","nonce":3084810269}]},"public_addr":"172.21.15.12:6819/3084810269","cluster_addr":"172.21.15.12:6821/3084810269","heartbeat_back_addr":"172.21.15.12:6825/3084810269","heartbeat_front_addr":"172.21.15.12:6823/3084810269","state":["exists","up"]},{"osd":7,"uuid":"c7b3ad7c-a566-435c-9ef8-837bb764acb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6817","nonce":3058588721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6819","nonce":3058588721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6823","nonce":3058588721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6821","nonce":3058588721}]},"public_addr":"172.21.15.145:6817/3058588721","cluster_addr":"172.21.15.145:6819/3058588721","heartbeat_back_addr":"172.21.15.145:6823/3058588721","heartbeat_front_addr":"172.21.15.145:6821/3058588721","state":["exists","up"]},{"osd":8,"uuid":"8018a468-fbc5-4667-a53c-2e97c08713bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6817","nonce":905705309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6819","nonce":905705309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6823","nonce":905705309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6821","nonce":905705309}]},"public_addr":"172.21.15.151:6817/905705309","cluster_addr":"172.21.15.151:6819/905705309","heartbeat_back_addr":"172.21.15.151:6823/905705309","heartbeat_front_addr":"172.21.15.151:6821/905705309","state":["exists","up"]},{"osd":9,"uuid":"dcf3b524-c8b8-4ab6-83c6-fc52c776d72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6827","nonce":1193852496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6829","nonce":1193852496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6833","nonce":1193852496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6831","nonce":1193852496}]},"public_addr":"172.21.15.12:6827/1193852496","cluster_addr":"172.21.15.12:6829/1193852496","heartbeat_back_addr":"172.21.15.12:6833/1193852496","heartbeat_front_addr":"172.21.15.12:6831/1193852496","state":["exists","up"]},{"osd":10,"uuid":"7b5b34c3-8814-4d16-80ce-0b0c9be07cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6825","nonce":1296813755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6827","nonce":1296813755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6831","nonce":1296813755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6829","nonce":1296813755}]},"public_addr":"172.21.15.145:6825/1296813755","cluster_addr":"172.21.15.145:6827/1296813755","heartbeat_back_addr":"172.21.15.145:6831/1296813755","heartbeat_front_addr":"172.21.15.145:6829/1296813755","state":["exists","up"]},{"osd":11,"uuid":"157ee32a-43f0-4e5a-8dac-fce53c1efdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6825","nonce":2855185758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6827","nonce":2855185758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6831","nonce":2855185758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6829","nonce":2855185758}]},"public_addr":"172.21.15.151:6825/2855185758","cluster_addr":"172.21.15.151:6827/2855185758","heartbeat_back_addr":"172.21.15.151:6831/2855185758","heartbeat_front_addr":"172.21.15.151:6829/2855185758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:16:52.947222+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:17:17.845611+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:17:41.769521+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:10.848974+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:35.471340+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:59.554980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:19:28.908089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:19:53.540000+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:20:17.764886+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:20:46.835859+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:21:12.186176+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:21:35.863935+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/1132389058":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6801/4067110310":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/1040591124":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/1171838695":"2024-09-06T01:14:54.625209+0000","172.21.15.12:6800/4067110310":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/784506983":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/992405704":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6801/3541208629":"2024-09-06T01:14:54.625209+0000","172.21.15.12:6800/3541208629":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/1532325396":"2024-09-06T01:14:54.625209+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T01:21:42.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.401+0000 7f1366a00640 1 -- 172.21.15.12:0/1170147752 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f13440a2c00 msgr2=0x7f13440a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:42.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.401+0000 7f1366a00640 1 --2- 172.21.15.12:0/1170147752 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f13440a2c00 0x7f13440a50c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1350000c00 tx=0x7f1350005b50 comp rx=0 tx=0).stop 2024-09-05T01:21:42.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.401+0000 7f1366a00640 1 -- 172.21.15.12:0/1170147752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1360109140 msgr2=0x7f136019ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:42.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.401+0000 7f1366a00640 1 --2- 172.21.15.12:0/1170147752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1360109140 0x7f136019ef10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f135800eb10 tx=0x7f135800c2d0 comp rx=0 tx=0).stop 2024-09-05T01:21:42.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.401+0000 7f1366a00640 1 -- 172.21.15.12:0/1170147752 shutdown_connections 2024-09-05T01:21:42.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.402+0000 7f1366a00640 1 --2- 172.21.15.12:0/1170147752 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f13440a2c00 0x7f13440a50c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:42.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.402+0000 7f1366a00640 1 --2- 172.21.15.12:0/1170147752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1360109140 0x7f136019ef10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:42.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.402+0000 7f1366a00640 1 --2- 172.21.15.12:0/1170147752 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f13601049c0 0x7f136019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:42.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.402+0000 7f1366a00640 1 --2- 172.21.15.12:0/1170147752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1360104010 0x7f136019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:42.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.402+0000 7f1366a00640 1 -- 172.21.15.12:0/1170147752 >> 172.21.15.12:0/1170147752 conn(0x7f13600ffa50 msgr2=0x7f1360100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:21:42.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.402+0000 7f1366a00640 1 -- 172.21.15.12:0/1170147752 shutdown_connections 2024-09-05T01:21:42.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:42.402+0000 7f1366a00640 1 -- 172.21.15.12:0/1170147752 wait complete. 2024-09-05T01:21:43.174 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-05T01:17:44.744065+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-05T01:21:43.175 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-05T01:21:43.547 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:21:43.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:43 smithi012 ceph-mon[29942]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:43.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:43 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/1170147752' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:21:43.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:43 smithi145 ceph-mon[34376]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:43.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:43 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/1170147752' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:21:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:43 smithi151 ceph-mon[35013]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:43 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/1170147752' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:21:44.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.193+0000 7f7c6d800640 1 -- 172.21.15.12:0/2255358826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c68103ff0 msgr2=0x7f7c681043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:44.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.193+0000 7f7c6d800640 1 --2- 172.21.15.12:0/2255358826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c68103ff0 0x7f7c681043d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009900 tx=0x7f7c5802a3f0 comp rx=0 tx=0).stop 2024-09-05T01:21:44.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.194+0000 7f7c6d800640 1 -- 172.21.15.12:0/2255358826 shutdown_connections 2024-09-05T01:21:44.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.194+0000 7f7c6d800640 1 --2- 172.21.15.12:0/2255358826 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c68109120 0x7f7c68110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:44.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.194+0000 7f7c6d800640 1 --2- 172.21.15.12:0/2255358826 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c681049a0 0x7f7c681089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:44.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.194+0000 7f7c6d800640 1 --2- 172.21.15.12:0/2255358826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c68103ff0 0x7f7c681043d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:44.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.194+0000 7f7c6d800640 1 -- 172.21.15.12:0/2255358826 >> 172.21.15.12:0/2255358826 conn(0x7f7c680ffa90 msgr2=0x7f7c68101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:21:44.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.194+0000 7f7c6d800640 1 -- 172.21.15.12:0/2255358826 shutdown_connections 2024-09-05T01:21:44.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.194+0000 7f7c6d800640 1 -- 172.21.15.12:0/2255358826 wait complete. 2024-09-05T01:21:44.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.195+0000 7f7c6d800640 1 Processor -- start 2024-09-05T01:21:44.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.195+0000 7f7c6d800640 1 -- start start 2024-09-05T01:21:44.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.195+0000 7f7c6d800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c68103ff0 0x7f7c6819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:44.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.195+0000 7f7c6d800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c681049a0 0x7f7c6819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:44.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.195+0000 7f7c6d800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c68109120 0x7f7c6819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:44.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.195+0000 7f7c6d800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7c68114190 con 0x7f7c68109120 2024-09-05T01:21:44.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.195+0000 7f7c6d800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7c68114010 con 0x7f7c681049a0 2024-09-05T01:21:44.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.195+0000 7f7c6d800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7c68114310 con 0x7f7c68103ff0 2024-09-05T01:21:44.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.196+0000 7f7c67400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c68109120 0x7f7c6819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:44.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.196+0000 7f7c67400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c68109120 0x7f7c6819eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33334/0 (socket says 172.21.15.12:33334) 2024-09-05T01:21:44.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.196+0000 7f7c67400640 1 -- 172.21.15.12:0/3976087342 learned_addr learned my addr 172.21.15.12:0/3976087342 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:21:44.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.196+0000 7f7c66a00640 1 --2- 172.21.15.12:0/3976087342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c68103ff0 0x7f7c6819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:44.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.196+0000 7f7c5e000640 1 --2- 172.21.15.12:0/3976087342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c681049a0 0x7f7c6819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:44.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.196+0000 7f7c67400640 1 -- 172.21.15.12:0/3976087342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c68103ff0 msgr2=0x7f7c6819a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:44.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.196+0000 7f7c67400640 1 --2- 172.21.15.12:0/3976087342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c68103ff0 0x7f7c6819a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:44.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.196+0000 7f7c67400640 1 -- 172.21.15.12:0/3976087342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c681049a0 msgr2=0x7f7c6819ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:44.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.196+0000 7f7c67400640 1 --2- 172.21.15.12:0/3976087342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c681049a0 0x7f7c6819ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:44.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.196+0000 7f7c67400640 1 -- 172.21.15.12:0/3976087342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6819f5c0 con 0x7f7c68109120 2024-09-05T01:21:44.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.196+0000 7f7c67400640 1 --2- 172.21.15.12:0/3976087342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c68109120 0x7f7c6819eee0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7c60009fd0 tx=0x7f7c6000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:21:44.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.197+0000 7f7c5fe00640 1 -- 172.21.15.12:0/3976087342 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c60017070 con 0x7f7c68109120 2024-09-05T01:21:44.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.197+0000 7f7c5fe00640 1 -- 172.21.15.12:0/3976087342 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c60003e50 con 0x7f7c68109120 2024-09-05T01:21:44.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.197+0000 7f7c6d800640 1 -- 172.21.15.12:0/3976087342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c6819f8b0 con 0x7f7c68109120 2024-09-05T01:21:44.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.197+0000 7f7c5fe00640 1 -- 172.21.15.12:0/3976087342 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c600106c0 con 0x7f7c68109120 2024-09-05T01:21:44.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.197+0000 7f7c6d800640 1 -- 172.21.15.12:0/3976087342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c681a7190 con 0x7f7c68109120 2024-09-05T01:21:44.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.198+0000 7f7c6d800640 1 -- 172.21.15.12:0/3976087342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c681043d0 con 0x7f7c68109120 2024-09-05T01:21:44.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.200+0000 7f7c5fe00640 1 -- 172.21.15.12:0/3976087342 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7c60003970 con 0x7f7c68109120 2024-09-05T01:21:44.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.201+0000 7f7c5fe00640 1 --2- 172.21.15.12:0/3976087342 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f7c4c0a2b80 0x7f7c4c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:44.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.201+0000 7f7c5fe00640 1 -- 172.21.15.12:0/3976087342 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f7c600ce900 con 0x7f7c68109120 2024-09-05T01:21:44.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.201+0000 7f7c66a00640 1 --2- 172.21.15.12:0/3976087342 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f7c4c0a2b80 0x7f7c4c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:44.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.202+0000 7f7c66a00640 1 --2- 172.21.15.12:0/3976087342 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f7c4c0a2b80 0x7f7c4c0a5040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7c58000c00 tx=0x7f7c58005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:21:44.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.205+0000 7f7c5fe00640 1 -- 172.21.15.12:0/3976087342 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c6009b610 con 0x7f7c68109120 2024-09-05T01:21:44.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.390+0000 7f7c6d800640 1 -- 172.21.15.12:0/3976087342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7c6810c360 con 0x7f7c68109120 2024-09-05T01:21:44.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.390+0000 7f7c5fe00640 1 -- 172.21.15.12:0/3976087342 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7f7c6009f910 con 0x7f7c68109120 2024-09-05T01:21:44.391 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-09-05T01:21:44.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.393+0000 7f7c6d800640 1 -- 172.21.15.12:0/3976087342 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f7c4c0a2b80 msgr2=0x7f7c4c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:44.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.393+0000 7f7c6d800640 1 --2- 172.21.15.12:0/3976087342 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f7c4c0a2b80 0x7f7c4c0a5040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7c58000c00 tx=0x7f7c58005b50 comp rx=0 tx=0).stop 2024-09-05T01:21:44.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.393+0000 7f7c6d800640 1 -- 172.21.15.12:0/3976087342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c68109120 msgr2=0x7f7c6819eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:44.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.393+0000 7f7c6d800640 1 --2- 172.21.15.12:0/3976087342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c68109120 0x7f7c6819eee0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7c60009fd0 tx=0x7f7c6000b260 comp rx=0 tx=0).stop 2024-09-05T01:21:44.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.393+0000 7f7c6d800640 1 -- 172.21.15.12:0/3976087342 shutdown_connections 2024-09-05T01:21:44.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.393+0000 7f7c6d800640 1 --2- 172.21.15.12:0/3976087342 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f7c4c0a2b80 0x7f7c4c0a5040 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:44.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.393+0000 7f7c6d800640 1 --2- 172.21.15.12:0/3976087342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c68109120 0x7f7c6819eee0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.393+0000 7f7c6d800640 1 --2- 172.21.15.12:0/3976087342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7c681049a0 0x7f7c6819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.393+0000 7f7c6d800640 1 --2- 172.21.15.12:0/3976087342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c68103ff0 0x7f7c6819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.393+0000 7f7c6d800640 1 -- 172.21.15.12:0/3976087342 >> 172.21.15.12:0/3976087342 conn(0x7f7c680ffa90 msgr2=0x7f7c68100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:21:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.393+0000 7f7c6d800640 1 -- 172.21.15.12:0/3976087342 shutdown_connections 2024-09-05T01:21:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:44.393+0000 7f7c6d800640 1 -- 172.21.15.12:0/3976087342 wait complete. 2024-09-05T01:21:45.189 INFO:tasks.cephadm:Adding mds.a on smithi012 2024-09-05T01:21:45.189 INFO:tasks.cephadm:Adding mds.d on smithi012 2024-09-05T01:21:45.189 INFO:tasks.cephadm:Adding mds.g on smithi012 2024-09-05T01:21:45.189 INFO:tasks.cephadm:Adding mds.j on smithi012 2024-09-05T01:21:45.189 INFO:tasks.cephadm:Adding mds.b on smithi145 2024-09-05T01:21:45.189 INFO:tasks.cephadm:Adding mds.e on smithi145 2024-09-05T01:21:45.190 INFO:tasks.cephadm:Adding mds.h on smithi145 2024-09-05T01:21:45.190 INFO:tasks.cephadm:Adding mds.k on smithi145 2024-09-05T01:21:45.190 INFO:tasks.cephadm:Adding mds.c on smithi151 2024-09-05T01:21:45.190 INFO:tasks.cephadm:Adding mds.f on smithi151 2024-09-05T01:21:45.190 INFO:tasks.cephadm:Adding mds.i on smithi151 2024-09-05T01:21:45.190 INFO:tasks.cephadm:Adding mds.l on smithi151 2024-09-05T01:21:45.190 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph orch apply mds all '12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi145=b;smithi145=e;smithi145=h;smithi145=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l' 2024-09-05T01:21:45.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:45 smithi151 ceph-mon[35013]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:45.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:45 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3976087342' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-05T01:21:45.449 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T01:21:45.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:45 smithi012 ceph-mon[29942]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:45.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:45 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3976087342' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-05T01:21:45.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:45 smithi145 ceph-mon[34376]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:45.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:45 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3976087342' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-05T01:21:45.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.877+0000 7f7b3b779640 1 -- 172.21.15.151:0/2830511870 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b341026a0 msgr2=0x7f7b34104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:45.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.877+0000 7f7b3b779640 1 --2- 172.21.15.151:0/2830511870 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b341026a0 0x7f7b34104a90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009900 tx=0x7f7b3002a410 comp rx=0 tx=0).stop 2024-09-05T01:21:45.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.877+0000 7f7b3b779640 1 -- 172.21.15.151:0/2830511870 shutdown_connections 2024-09-05T01:21:45.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.878+0000 7f7b3b779640 1 --2- 172.21.15.151:0/2830511870 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b34107900 0x7f7b34109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:45.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.878+0000 7f7b3b779640 1 --2- 172.21.15.151:0/2830511870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b34104fd0 0x7f7b341073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:45.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.878+0000 7f7b3b779640 1 --2- 172.21.15.151:0/2830511870 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b341026a0 0x7f7b34104a90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:45.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.878+0000 7f7b3b779640 1 -- 172.21.15.151:0/2830511870 >> 172.21.15.151:0/2830511870 conn(0x7f7b340fc280 msgr2=0x7f7b340fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:21:45.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.878+0000 7f7b3b779640 1 -- 172.21.15.151:0/2830511870 shutdown_connections 2024-09-05T01:21:45.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.878+0000 7f7b3b779640 1 -- 172.21.15.151:0/2830511870 wait complete. 2024-09-05T01:21:45.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.878+0000 7f7b3b779640 1 Processor -- start 2024-09-05T01:21:45.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.878+0000 7f7b3b779640 1 -- start start 2024-09-05T01:21:45.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.878+0000 7f7b3b779640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b341026a0 0x7f7b34102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:45.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.878+0000 7f7b3b779640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b34104fd0 0x7f7b34100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:45.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.878+0000 7f7b3b779640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b34107900 0x7f7b34100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:45.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.879+0000 7f7b3b779640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3410d900 con 0x7f7b34107900 2024-09-05T01:21:45.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.879+0000 7f7b3b779640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3410d780 con 0x7f7b341026a0 2024-09-05T01:21:45.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.879+0000 7f7b3b779640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3410da80 con 0x7f7b34104fd0 2024-09-05T01:21:45.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.879+0000 7f7b38d14640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b34104fd0 0x7f7b34100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:45.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.879+0000 7f7b38d14640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b34104fd0 0x7f7b34100650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59112/0 (socket says 172.21.15.151:59112) 2024-09-05T01:21:45.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.879+0000 7f7b38d14640 1 -- 172.21.15.151:0/2617736944 learned_addr learned my addr 172.21.15.151:0/2617736944 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-05T01:21:45.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.879+0000 7f7b39515640 1 --2- 172.21.15.151:0/2617736944 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b341026a0 0x7f7b34102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:45.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.879+0000 7f7b39d16640 1 --2- 172.21.15.151:0/2617736944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b34107900 0x7f7b34100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:45.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.879+0000 7f7b38d14640 1 -- 172.21.15.151:0/2617736944 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b341026a0 msgr2=0x7f7b34102000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:45.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.879+0000 7f7b38d14640 1 --2- 172.21.15.151:0/2617736944 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b341026a0 0x7f7b34102000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:45.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.879+0000 7f7b38d14640 1 -- 172.21.15.151:0/2617736944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b34107900 msgr2=0x7f7b34100b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:45.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.879+0000 7f7b38d14640 1 --2- 172.21.15.151:0/2617736944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b34107900 0x7f7b34100b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:45.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.879+0000 7f7b38d14640 1 -- 172.21.15.151:0/2617736944 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b34101450 con 0x7f7b34104fd0 2024-09-05T01:21:45.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.879+0000 7f7b38d14640 1 --2- 172.21.15.151:0/2617736944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b34104fd0 0x7f7b34100650 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400b450 tx=0x7f7b2400b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:21:45.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.879+0000 7f7b2a7fc640 1 -- 172.21.15.151:0/2617736944 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b24015020 con 0x7f7b34104fd0 2024-09-05T01:21:45.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.879+0000 7f7b2a7fc640 1 -- 172.21.15.151:0/2617736944 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b24011d70 con 0x7f7b34104fd0 2024-09-05T01:21:45.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.879+0000 7f7b3b779640 1 -- 172.21.15.151:0/2617736944 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b341a2120 con 0x7f7b34104fd0 2024-09-05T01:21:45.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.879+0000 7f7b2a7fc640 1 -- 172.21.15.151:0/2617736944 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b2400f340 con 0x7f7b34104fd0 2024-09-05T01:21:45.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.880+0000 7f7b3b779640 1 -- 172.21.15.151:0/2617736944 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b341a26b0 con 0x7f7b34104fd0 2024-09-05T01:21:45.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.881+0000 7f7b3b779640 1 -- 172.21.15.151:0/2617736944 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b341053b0 con 0x7f7b34104fd0 2024-09-05T01:21:45.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.882+0000 7f7b2a7fc640 1 -- 172.21.15.151:0/2617736944 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7b24018020 con 0x7f7b34104fd0 2024-09-05T01:21:45.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.882+0000 7f7b2a7fc640 1 --2- 172.21.15.151:0/2617736944 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f7b200a2b80 0x7f7b200a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:45.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.883+0000 7f7b2a7fc640 1 -- 172.21.15.151:0/2617736944 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f7b240ce660 con 0x7f7b34104fd0 2024-09-05T01:21:45.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.883+0000 7f7b39515640 1 --2- 172.21.15.151:0/2617736944 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f7b200a2b80 0x7f7b200a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:45.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.883+0000 7f7b39515640 1 --2- 172.21.15.151:0/2617736944 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f7b200a2b80 0x7f7b200a5040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7b300314e0 tx=0x7f7b30000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:21:45.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:45.887+0000 7f7b2a7fc640 1 -- 172.21.15.151:0/2617736944 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7b2401f020 con 0x7f7b34104fd0 2024-09-05T01:21:46.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:46.067+0000 7f7b3b779640 1 -- 172.21.15.151:0/2617736944 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi145=b;smithi145=e;smithi145=h;smithi145=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l", "target": ["mon-mgr", ""]}) -- 0x7f7b34062830 con 0x7f7b200a2b80 2024-09-05T01:21:46.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:46.076+0000 7f7b2a7fc640 1 -- 172.21.15.151:0/2617736944 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f7b34062830 con 0x7f7b200a2b80 2024-09-05T01:21:46.076 INFO:teuthology.orchestra.run.smithi151.stdout:Scheduled mds.all update... 2024-09-05T01:21:46.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:46.078+0000 7f7b3b779640 1 -- 172.21.15.151:0/2617736944 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f7b200a2b80 msgr2=0x7f7b200a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:46.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:46.078+0000 7f7b3b779640 1 --2- 172.21.15.151:0/2617736944 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f7b200a2b80 0x7f7b200a5040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7b300314e0 tx=0x7f7b30000bc0 comp rx=0 tx=0).stop 2024-09-05T01:21:46.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:46.078+0000 7f7b3b779640 1 -- 172.21.15.151:0/2617736944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b34104fd0 msgr2=0x7f7b34100650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:46.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:46.078+0000 7f7b3b779640 1 --2- 172.21.15.151:0/2617736944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b34104fd0 0x7f7b34100650 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400b450 tx=0x7f7b2400b910 comp rx=0 tx=0).stop 2024-09-05T01:21:46.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:46.078+0000 7f7b3b779640 1 -- 172.21.15.151:0/2617736944 shutdown_connections 2024-09-05T01:21:46.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:46.078+0000 7f7b3b779640 1 --2- 172.21.15.151:0/2617736944 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f7b200a2b80 0x7f7b200a5040 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:46.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:46.078+0000 7f7b3b779640 1 --2- 172.21.15.151:0/2617736944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b34107900 0x7f7b34100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:46.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:46.078+0000 7f7b3b779640 1 --2- 172.21.15.151:0/2617736944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b34104fd0 0x7f7b34100650 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:46.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:46.078+0000 7f7b3b779640 1 --2- 172.21.15.151:0/2617736944 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b341026a0 0x7f7b34102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:46.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:46.078+0000 7f7b3b779640 1 -- 172.21.15.151:0/2617736944 >> 172.21.15.151:0/2617736944 conn(0x7f7b340fc280 msgr2=0x7f7b34103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:21:46.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:46.078+0000 7f7b3b779640 1 -- 172.21.15.151:0/2617736944 shutdown_connections 2024-09-05T01:21:46.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-05T01:21:46.078+0000 7f7b3b779640 1 -- 172.21.15.151:0/2617736944 wait complete. 2024-09-05T01:21:46.797 DEBUG:teuthology.orchestra.run.smithi012:mds.a> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.a.service 2024-09-05T01:21:46.802 DEBUG:teuthology.orchestra.run.smithi012:mds.d> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.d.service 2024-09-05T01:21:46.846 DEBUG:teuthology.orchestra.run.smithi012:mds.g> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.g.service 2024-09-05T01:21:46.891 DEBUG:teuthology.orchestra.run.smithi012:mds.j> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.j.service 2024-09-05T01:21:46.936 DEBUG:teuthology.orchestra.run.smithi145:mds.b> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.b.service 2024-09-05T01:21:46.939 DEBUG:teuthology.orchestra.run.smithi145:mds.e> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.e.service 2024-09-05T01:21:46.982 DEBUG:teuthology.orchestra.run.smithi145:mds.h> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.h.service 2024-09-05T01:21:47.024 DEBUG:teuthology.orchestra.run.smithi145:mds.k> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.k.service 2024-09-05T01:21:47.067 DEBUG:teuthology.orchestra.run.smithi151:mds.c> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.c.service 2024-09-05T01:21:47.070 DEBUG:teuthology.orchestra.run.smithi151:mds.f> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.f.service 2024-09-05T01:21:47.113 DEBUG:teuthology.orchestra.run.smithi151:mds.i> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.i.service 2024-09-05T01:21:47.155 DEBUG:teuthology.orchestra.run.smithi151:mds.l> sudo journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.l.service 2024-09-05T01:21:47.198 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-05T01:21:47.199 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:21:47.217 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:47 smithi151 ceph-mon[35013]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi145=b;smithi145=e;smithi145=h;smithi145=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:21:47.217 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:47 smithi151 ceph-mon[35013]: Saving service mds.all spec with placement smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi145=b;smithi145=e;smithi145=h;smithi145=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l;count:12 2024-09-05T01:21:47.217 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:47 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:47.217 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:47 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:21:47.217 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:47 smithi151 ceph-mon[35013]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:47.218 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:47 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:47.218 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:47 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:21:47.218 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:47 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:47.218 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:47 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:21:47.218 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:47 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:21:47.218 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:47 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:47.223 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:47 smithi145 ceph-mon[34376]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi145=b;smithi145=e;smithi145=h;smithi145=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:21:47.223 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:47 smithi145 ceph-mon[34376]: Saving service mds.all spec with placement smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi145=b;smithi145=e;smithi145=h;smithi145=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l;count:12 2024-09-05T01:21:47.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:47 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:47.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:47 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:21:47.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:47 smithi145 ceph-mon[34376]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:47.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:47 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:47.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:47 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:21:47.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:47 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:47.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:47 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:21:47.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:47 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:21:47.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:47 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:47.248 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:47 smithi012 ceph-mon[29942]: from='client.24448 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi145=b;smithi145=e;smithi145=h;smithi145=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:21:47.248 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:47 smithi012 ceph-mon[29942]: Saving service mds.all spec with placement smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi145=b;smithi145=e;smithi145=h;smithi145=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l;count:12 2024-09-05T01:21:47.248 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:47 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:47.248 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:47 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:21:47.248 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:47 smithi012 ceph-mon[29942]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:47.248 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:47 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:47.248 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:47 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:21:47.249 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:47 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:47.249 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:47 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:21:47.249 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:47 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:21:47.249 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:47 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:47.568 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:21:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.064+0000 7fc75fa00640 1 -- 172.21.15.12:0/2549681012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc758109120 msgr2=0x7fc758110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.064+0000 7fc75fa00640 1 --2- 172.21.15.12:0/2549681012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc758109120 0x7fc758110ca0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc750009ca0 tx=0x7fc75002a8c0 comp rx=0 tx=0).stop 2024-09-05T01:21:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.064+0000 7fc75fa00640 1 -- 172.21.15.12:0/2549681012 shutdown_connections 2024-09-05T01:21:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.064+0000 7fc75fa00640 1 --2- 172.21.15.12:0/2549681012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc758109120 0x7fc758110ca0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.064+0000 7fc75fa00640 1 --2- 172.21.15.12:0/2549681012 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc7581049a0 0x7fc7581089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.064+0000 7fc75fa00640 1 --2- 172.21.15.12:0/2549681012 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc758103ff0 0x7fc7581043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.064+0000 7fc75fa00640 1 -- 172.21.15.12:0/2549681012 >> 172.21.15.12:0/2549681012 conn(0x7fc7580ffa90 msgr2=0x7fc758101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:21:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.065+0000 7fc75fa00640 1 -- 172.21.15.12:0/2549681012 shutdown_connections 2024-09-05T01:21:48.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.065+0000 7fc75fa00640 1 -- 172.21.15.12:0/2549681012 wait complete. 2024-09-05T01:21:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.065+0000 7fc75fa00640 1 Processor -- start 2024-09-05T01:21:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.066+0000 7fc75fa00640 1 -- start start 2024-09-05T01:21:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.066+0000 7fc75fa00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc758103ff0 0x7fc75819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.066+0000 7fc75fa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7581049a0 0x7fc75819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.066+0000 7fc75fa00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc758109120 0x7fc75819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.066+0000 7fc75fa00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc758114180 con 0x7fc7581049a0 2024-09-05T01:21:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.066+0000 7fc75fa00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc758114000 con 0x7fc758103ff0 2024-09-05T01:21:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.066+0000 7fc75fa00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc758114300 con 0x7fc758109120 2024-09-05T01:21:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.066+0000 7fc74fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7581049a0 0x7fc75819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.066+0000 7fc74fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7581049a0 0x7fc75819ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53924/0 (socket says 172.21.15.12:53924) 2024-09-05T01:21:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.066+0000 7fc74fe00640 1 -- 172.21.15.12:0/2122452308 learned_addr learned my addr 172.21.15.12:0/2122452308 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:21:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.066+0000 7fc75d000640 1 --2- 172.21.15.12:0/2122452308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc758103ff0 0x7fc75819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.066+0000 7fc75da00640 1 --2- 172.21.15.12:0/2122452308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc758109120 0x7fc75819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:48.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.067+0000 7fc74fe00640 1 -- 172.21.15.12:0/2122452308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc758109120 msgr2=0x7fc75819ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.067+0000 7fc74fe00640 1 --2- 172.21.15.12:0/2122452308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc758109120 0x7fc75819ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.067+0000 7fc74fe00640 1 -- 172.21.15.12:0/2122452308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc758103ff0 msgr2=0x7fc75819a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.067+0000 7fc74fe00640 1 --2- 172.21.15.12:0/2122452308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc758103ff0 0x7fc75819a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.067+0000 7fc74fe00640 1 -- 172.21.15.12:0/2122452308 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75819f5f0 con 0x7fc7581049a0 2024-09-05T01:21:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.067+0000 7fc74fe00640 1 --2- 172.21.15.12:0/2122452308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7581049a0 0x7fc75819ab80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc74000e9f0 tx=0x7fc74000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:21:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.067+0000 7fc756000640 1 -- 172.21.15.12:0/2122452308 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74000cd80 con 0x7fc7581049a0 2024-09-05T01:21:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.067+0000 7fc756000640 1 -- 172.21.15.12:0/2122452308 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc740010910 con 0x7fc7581049a0 2024-09-05T01:21:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.067+0000 7fc75fa00640 1 -- 172.21.15.12:0/2122452308 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc75819f8e0 con 0x7fc7581049a0 2024-09-05T01:21:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.067+0000 7fc756000640 1 -- 172.21.15.12:0/2122452308 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc740018990 con 0x7fc7581049a0 2024-09-05T01:21:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.068+0000 7fc75fa00640 1 -- 172.21.15.12:0/2122452308 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7581a71c0 con 0x7fc7581049a0 2024-09-05T01:21:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.069+0000 7fc75fa00640 1 -- 172.21.15.12:0/2122452308 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7581043d0 con 0x7fc7581049a0 2024-09-05T01:21:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.070+0000 7fc756000640 1 -- 172.21.15.12:0/2122452308 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc740010ac0 con 0x7fc7581049a0 2024-09-05T01:21:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.072+0000 7fc756000640 1 --2- 172.21.15.12:0/2122452308 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc73c0a2c00 0x7fc73c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:48.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.072+0000 7fc756000640 1 -- 172.21.15.12:0/2122452308 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fc7400cee10 con 0x7fc7581049a0 2024-09-05T01:21:48.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.072+0000 7fc75d000640 1 --2- 172.21.15.12:0/2122452308 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc73c0a2c00 0x7fc73c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:48.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.072+0000 7fc75d000640 1 --2- 172.21.15.12:0/2122452308 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc73c0a2c00 0x7fc73c0a50c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc748005d00 tx=0x7fc74800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:21:48.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.076+0000 7fc756000640 1 -- 172.21.15.12:0/2122452308 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc7400d2030 con 0x7fc7581049a0 2024-09-05T01:21:48.271 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:48 smithi151 ceph-mon[35013]: Deploying daemon mds.l on smithi151 2024-09-05T01:21:48.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.298+0000 7fc75fa00640 1 -- 172.21.15.12:0/2122452308 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7581a7420 con 0x7fc7581049a0 2024-09-05T01:21:48.300 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:48 smithi012 ceph-mon[29942]: Deploying daemon mds.l on smithi151 2024-09-05T01:21:48.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.299+0000 7fc756000640 1 -- 172.21.15.12:0/2122452308 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fc74009bb20 con 0x7fc7581049a0 2024-09-05T01:21:48.301 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:21:48.301 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":1,"btime":"2024-09-05T01:14:21:162585+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-05T01:21:48.301 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 1 2024-09-05T01:21:48.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.302+0000 7fc75fa00640 1 -- 172.21.15.12:0/2122452308 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc73c0a2c00 msgr2=0x7fc73c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:48.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.302+0000 7fc75fa00640 1 --2- 172.21.15.12:0/2122452308 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc73c0a2c00 0x7fc73c0a50c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc748005d00 tx=0x7fc74800b410 comp rx=0 tx=0).stop 2024-09-05T01:21:48.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.302+0000 7fc75fa00640 1 -- 172.21.15.12:0/2122452308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7581049a0 msgr2=0x7fc75819ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:48.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.302+0000 7fc75fa00640 1 --2- 172.21.15.12:0/2122452308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7581049a0 0x7fc75819ab80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc74000e9f0 tx=0x7fc74000eeb0 comp rx=0 tx=0).stop 2024-09-05T01:21:48.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.302+0000 7fc75fa00640 1 -- 172.21.15.12:0/2122452308 shutdown_connections 2024-09-05T01:21:48.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.302+0000 7fc75fa00640 1 --2- 172.21.15.12:0/2122452308 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc73c0a2c00 0x7fc73c0a50c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:48.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.302+0000 7fc75fa00640 1 --2- 172.21.15.12:0/2122452308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc758109120 0x7fc75819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:48.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.302+0000 7fc75fa00640 1 --2- 172.21.15.12:0/2122452308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7581049a0 0x7fc75819ab80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:48.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.302+0000 7fc75fa00640 1 --2- 172.21.15.12:0/2122452308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc758103ff0 0x7fc75819a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:48.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.302+0000 7fc75fa00640 1 -- 172.21.15.12:0/2122452308 >> 172.21.15.12:0/2122452308 conn(0x7fc7580ffa90 msgr2=0x7fc758100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:21:48.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.302+0000 7fc75fa00640 1 -- 172.21.15.12:0/2122452308 shutdown_connections 2024-09-05T01:21:48.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:48.302+0000 7fc75fa00640 1 -- 172.21.15.12:0/2122452308 wait complete. 2024-09-05T01:21:48.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:48 smithi145 ceph-mon[34376]: Deploying daemon mds.l on smithi151 2024-09-05T01:21:48.604 INFO:journalctl@ceph.mds.l.smithi151.stdout:Sep 05 01:21:48 smithi151 systemd[1]: Starting Ceph mds.l for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:21:48.927 INFO:journalctl@ceph.mds.l.smithi151.stdout:Sep 05 01:21:48 smithi151 podman[63959]: 2024-09-05 01:21:48.564995688 +0000 UTC m=+0.015924946 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:21:48.928 INFO:journalctl@ceph.mds.l.smithi151.stdout:Sep 05 01:21:48 smithi151 podman[63959]: 2024-09-05 01:21:48.674242904 +0000 UTC m=+0.125172195 container create fd55372d0e466f1ff63371f0e228760a01349db0ffac08055f7a940dec75d70f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T01:21:48.928 INFO:journalctl@ceph.mds.l.smithi151.stdout:Sep 05 01:21:48 smithi151 podman[63959]: 2024-09-05 01:21:48.901535082 +0000 UTC m=+0.352464330 container init fd55372d0e466f1ff63371f0e228760a01349db0ffac08055f7a940dec75d70f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-l, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-05T01:21:48.928 INFO:journalctl@ceph.mds.l.smithi151.stdout:Sep 05 01:21:48 smithi151 podman[63959]: 2024-09-05 01:21:48.904266893 +0000 UTC m=+0.355196149 container start fd55372d0e466f1ff63371f0e228760a01349db0ffac08055f7a940dec75d70f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-l, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-91c8a7e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-05T01:21:49.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:49 smithi012 ceph-mon[29942]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:49.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:49 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2122452308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:21:49.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:49 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] up:boot 2024-09-05T01:21:49.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:49 smithi012 ceph-mon[29942]: fsmap 1 up:standby 2024-09-05T01:21:49.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:49 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-05T01:21:49.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:49 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:49.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:49 smithi151 ceph-mon[35013]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:49.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:49 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/2122452308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:21:49.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:49 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] up:boot 2024-09-05T01:21:49.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:49 smithi151 ceph-mon[35013]: fsmap 1 up:standby 2024-09-05T01:21:49.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:49 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-05T01:21:49.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:49 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:49.354 INFO:journalctl@ceph.mds.l.smithi151.stdout:Sep 05 01:21:48 smithi151 ceph-mds[63978]: -- 172.21.15.151:0/2206853806 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5646dc3c5860 con 0x5646dc3a2800 2024-09-05T01:21:49.355 INFO:journalctl@ceph.mds.l.smithi151.stdout:Sep 05 01:21:48 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-l[63974]: starting mds.l at 2024-09-05T01:21:49.355 INFO:journalctl@ceph.mds.l.smithi151.stdout:Sep 05 01:21:49 smithi151 bash[63959]: fd55372d0e466f1ff63371f0e228760a01349db0ffac08055f7a940dec75d70f 2024-09-05T01:21:49.355 INFO:journalctl@ceph.mds.l.smithi151.stdout:Sep 05 01:21:49 smithi151 systemd[1]: Started Ceph mds.l for 0d44cd7e-6b24-11ef-bcd6-c7b262605968. 2024-09-05T01:21:49.509 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:49 smithi145 ceph-mon[34376]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:49.509 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:49 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/2122452308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:21:49.509 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:49 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] up:boot 2024-09-05T01:21:49.510 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:49 smithi145 ceph-mon[34376]: fsmap 1 up:standby 2024-09-05T01:21:49.510 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:49 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-05T01:21:49.510 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:49 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:50.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:50 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:50.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:50 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:50.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:50 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:21:50.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:50 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:21:50.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:50 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:50.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:50 smithi151 ceph-mon[35013]: Deploying daemon mds.k on smithi145 2024-09-05T01:21:50.542 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:50 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:50.542 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:50 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:50.542 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:50 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:21:50.542 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:50 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:21:50.542 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:50 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:50.542 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:50 smithi145 ceph-mon[34376]: Deploying daemon mds.k on smithi145 2024-09-05T01:21:50.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:50.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:50.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:21:50.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:21:50.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:50 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:50.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:50 smithi012 ceph-mon[29942]: Deploying daemon mds.k on smithi145 2024-09-05T01:21:50.989 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:21:51.306 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:51 smithi145 ceph-mon[34376]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:51.306 INFO:journalctl@ceph.mds.k.smithi145.stdout:Sep 05 01:21:51 smithi145 systemd[1]: Starting Ceph mds.k for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:21:51.311 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:51 smithi012 ceph-mon[29942]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:51.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:51 smithi151 ceph-mon[35013]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:51.375 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:21:51.584 INFO:journalctl@ceph.mds.k.smithi145.stdout:Sep 05 01:21:51 smithi145 podman[64063]: 2024-09-05 01:21:51.305535472 +0000 UTC m=+0.100953218 container create 0809dfc6ee30bc4a24ddb13cfe0b8baa9fef496634deafae1fa38a296039ce8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-k, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-05T01:21:51.584 INFO:journalctl@ceph.mds.k.smithi145.stdout:Sep 05 01:21:51 smithi145 podman[64063]: 2024-09-05 01:21:51.220415824 +0000 UTC m=+0.015833574 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:21:51.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.908+0000 7fda33200640 1 -- 172.21.15.12:0/187198651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda34112870 msgr2=0x7fda34114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:51.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.908+0000 7fda33200640 1 --2- 172.21.15.12:0/187198651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda34112870 0x7fda34114c60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fda2c009ca0 tx=0x7fda2c02a8c0 comp rx=0 tx=0).stop 2024-09-05T01:21:51.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.908+0000 7fda33200640 1 -- 172.21.15.12:0/187198651 shutdown_connections 2024-09-05T01:21:51.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.908+0000 7fda33200640 1 --2- 172.21.15.12:0/187198651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda34112870 0x7fda34114c60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:51.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.908+0000 7fda33200640 1 --2- 172.21.15.12:0/187198651 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda34077040 0x7fda34112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:51.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.908+0000 7fda33200640 1 --2- 172.21.15.12:0/187198651 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda34076720 0x7fda34076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:51.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.908+0000 7fda33200640 1 -- 172.21.15.12:0/187198651 >> 172.21.15.12:0/187198651 conn(0x7fda340ff910 msgr2=0x7fda34101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:21:51.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.908+0000 7fda33200640 1 -- 172.21.15.12:0/187198651 shutdown_connections 2024-09-05T01:21:51.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.908+0000 7fda33200640 1 -- 172.21.15.12:0/187198651 wait complete. 2024-09-05T01:21:51.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.909+0000 7fda33200640 1 Processor -- start 2024-09-05T01:21:51.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.909+0000 7fda33200640 1 -- start start 2024-09-05T01:21:51.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.909+0000 7fda33200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda34076720 0x7fda341a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:51.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.909+0000 7fda33200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda34077040 0x7fda341a4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:51.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.909+0000 7fda33200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda34112870 0x7fda3419e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:51.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.909+0000 7fda33200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fda341183c0 con 0x7fda34076720 2024-09-05T01:21:51.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.909+0000 7fda33200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fda34118240 con 0x7fda34112870 2024-09-05T01:21:51.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.909+0000 7fda33200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fda34118540 con 0x7fda34077040 2024-09-05T01:21:51.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.910+0000 7fda31e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda34076720 0x7fda341a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:51.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.910+0000 7fda31400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda34077040 0x7fda341a4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:51.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.910+0000 7fda32800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda34112870 0x7fda3419e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:51.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.910+0000 7fda31e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda34076720 0x7fda341a4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53954/0 (socket says 172.21.15.12:53954) 2024-09-05T01:21:51.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.910+0000 7fda31400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda34077040 0x7fda341a4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:35402/0 (socket says 172.21.15.12:35402) 2024-09-05T01:21:51.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.910+0000 7fda31e00640 1 -- 172.21.15.12:0/483836593 learned_addr learned my addr 172.21.15.12:0/483836593 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:21:51.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.910+0000 7fda31400640 1 -- 172.21.15.12:0/483836593 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda34112870 msgr2=0x7fda3419e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:51.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.910+0000 7fda31400640 1 --2- 172.21.15.12:0/483836593 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda34112870 0x7fda3419e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:51.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.910+0000 7fda31400640 1 -- 172.21.15.12:0/483836593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda34076720 msgr2=0x7fda341a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:51.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.910+0000 7fda31400640 1 --2- 172.21.15.12:0/483836593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda34076720 0x7fda341a4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:51.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.910+0000 7fda31400640 1 -- 172.21.15.12:0/483836593 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3419ef40 con 0x7fda34077040 2024-09-05T01:21:51.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.910+0000 7fda31e00640 1 --2- 172.21.15.12:0/483836593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda34076720 0x7fda341a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:21:51.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.910+0000 7fda31400640 1 --2- 172.21.15.12:0/483836593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda34077040 0x7fda341a4b40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fda2000e9f0 tx=0x7fda2000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:21:51.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.911+0000 7fda2aa00640 1 -- 172.21.15.12:0/483836593 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2000ccc0 con 0x7fda34077040 2024-09-05T01:21:51.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.911+0000 7fda33200640 1 -- 172.21.15.12:0/483836593 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda3419f230 con 0x7fda34077040 2024-09-05T01:21:51.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.911+0000 7fda2aa00640 1 -- 172.21.15.12:0/483836593 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda20010910 con 0x7fda34077040 2024-09-05T01:21:51.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.911+0000 7fda2aa00640 1 -- 172.21.15.12:0/483836593 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20018960 con 0x7fda34077040 2024-09-05T01:21:51.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.911+0000 7fda33200640 1 -- 172.21.15.12:0/483836593 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda341ab580 con 0x7fda34077040 2024-09-05T01:21:51.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.912+0000 7fda33200640 1 -- 172.21.15.12:0/483836593 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda3419f5a0 con 0x7fda34077040 2024-09-05T01:21:51.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.914+0000 7fda2aa00640 1 -- 172.21.15.12:0/483836593 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fda20010ac0 con 0x7fda34077040 2024-09-05T01:21:51.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.915+0000 7fda2aa00640 1 --2- 172.21.15.12:0/483836593 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fda180a2b80 0x7fda180a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:51.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.915+0000 7fda2aa00640 1 -- 172.21.15.12:0/483836593 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fda200cef60 con 0x7fda34077040 2024-09-05T01:21:51.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.915+0000 7fda31e00640 1 --2- 172.21.15.12:0/483836593 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fda180a2b80 0x7fda180a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:51.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.916+0000 7fda31e00640 1 --2- 172.21.15.12:0/483836593 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fda180a2b80 0x7fda180a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fda24011500 tx=0x7fda24005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:21:51.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:51.919+0000 7fda2aa00640 1 -- 172.21.15.12:0/483836593 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fda2009bc70 con 0x7fda34077040 2024-09-05T01:21:52.084 INFO:journalctl@ceph.mds.k.smithi145.stdout:Sep 05 01:21:51 smithi145 podman[64063]: 2024-09-05 01:21:51.6332893 +0000 UTC m=+0.428707042 container init 0809dfc6ee30bc4a24ddb13cfe0b8baa9fef496634deafae1fa38a296039ce8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-k, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T01:21:52.084 INFO:journalctl@ceph.mds.k.smithi145.stdout:Sep 05 01:21:51 smithi145 podman[64063]: 2024-09-05 01:21:51.636327482 +0000 UTC m=+0.431745235 container start 0809dfc6ee30bc4a24ddb13cfe0b8baa9fef496634deafae1fa38a296039ce8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-k, org.label-schema.schema-version=1.0, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T01:21:52.084 INFO:journalctl@ceph.mds.k.smithi145.stdout:Sep 05 01:21:51 smithi145 ceph-mds[64082]: -- 172.21.15.145:0/2476077122 <== mon.2 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555b9817d860 con 0x555b9815b000 2024-09-05T01:21:52.084 INFO:journalctl@ceph.mds.k.smithi145.stdout:Sep 05 01:21:51 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-k[64078]: starting mds.k at 2024-09-05T01:21:52.084 INFO:journalctl@ceph.mds.k.smithi145.stdout:Sep 05 01:21:51 smithi145 bash[64063]: 0809dfc6ee30bc4a24ddb13cfe0b8baa9fef496634deafae1fa38a296039ce8f 2024-09-05T01:21:52.084 INFO:journalctl@ceph.mds.k.smithi145.stdout:Sep 05 01:21:51 smithi145 systemd[1]: Started Ceph mds.k for 0d44cd7e-6b24-11ef-bcd6-c7b262605968. 2024-09-05T01:21:52.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:52.149+0000 7fda33200640 1 -- 172.21.15.12:0/483836593 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda3410da00 con 0x7fda34077040 2024-09-05T01:21:52.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:52.149+0000 7fda2aa00640 1 -- 172.21.15.12:0/483836593 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2266 (secure 0 0 0) 0x7fda2009ff70 con 0x7fda34077040 2024-09-05T01:21:52.150 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:21:52.151 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":3,"btime":"2024-09-05T01:21:52:091745+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-05T01:21:52.151 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 3 2024-09-05T01:21:52.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:52.152+0000 7fda33200640 1 -- 172.21.15.12:0/483836593 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fda180a2b80 msgr2=0x7fda180a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:52.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:52.152+0000 7fda33200640 1 --2- 172.21.15.12:0/483836593 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fda180a2b80 0x7fda180a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fda24011500 tx=0x7fda24005f90 comp rx=0 tx=0).stop 2024-09-05T01:21:52.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:52.152+0000 7fda33200640 1 -- 172.21.15.12:0/483836593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda34077040 msgr2=0x7fda341a4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:52.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:52.152+0000 7fda33200640 1 --2- 172.21.15.12:0/483836593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda34077040 0x7fda341a4b40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fda2000e9f0 tx=0x7fda2000eeb0 comp rx=0 tx=0).stop 2024-09-05T01:21:52.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:52.152+0000 7fda33200640 1 -- 172.21.15.12:0/483836593 shutdown_connections 2024-09-05T01:21:52.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:52.152+0000 7fda33200640 1 --2- 172.21.15.12:0/483836593 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fda180a2b80 0x7fda180a5040 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:52.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:52.152+0000 7fda33200640 1 --2- 172.21.15.12:0/483836593 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda34112870 0x7fda3419e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:52.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:52.152+0000 7fda33200640 1 --2- 172.21.15.12:0/483836593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda34077040 0x7fda341a4b40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:52.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:52.152+0000 7fda33200640 1 --2- 172.21.15.12:0/483836593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda34076720 0x7fda341a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:52.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:52.152+0000 7fda33200640 1 -- 172.21.15.12:0/483836593 >> 172.21.15.12:0/483836593 conn(0x7fda340ff910 msgr2=0x7fda34101d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:21:52.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:52.152+0000 7fda33200640 1 -- 172.21.15.12:0/483836593 shutdown_connections 2024-09-05T01:21:52.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:52.152+0000 7fda33200640 1 -- 172.21.15.12:0/483836593 wait complete. 2024-09-05T01:21:53.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:52 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:53.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:52 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:53.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:52 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:53.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:52 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:21:53.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:52 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:21:53.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:52 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:53.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:52 smithi012 ceph-mon[29942]: Deploying daemon mds.j on smithi012 2024-09-05T01:21:53.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:52 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.145:6832/2656226932,v1:172.21.15.145:6833/2656226932] up:boot 2024-09-05T01:21:53.029 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:52 smithi012 ceph-mon[29942]: fsmap 2 up:standby 2024-09-05T01:21:53.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:52 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-05T01:21:53.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:52 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/483836593' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:21:53.030 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:52 smithi012 ceph-mon[29942]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:53.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:52 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:53.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:52 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:53.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:52 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:53.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:52 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:21:53.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:52 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:21:53.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:52 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:53.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:52 smithi145 ceph-mon[34376]: Deploying daemon mds.j on smithi012 2024-09-05T01:21:53.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:52 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.145:6832/2656226932,v1:172.21.15.145:6833/2656226932] up:boot 2024-09-05T01:21:53.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:52 smithi145 ceph-mon[34376]: fsmap 2 up:standby 2024-09-05T01:21:53.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:52 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-05T01:21:53.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:52 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/483836593' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:21:53.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:52 smithi145 ceph-mon[34376]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:53.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:52 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:53.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:52 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:53.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:52 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:53.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:52 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:21:53.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:52 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:21:53.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:52 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:53.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:52 smithi151 ceph-mon[35013]: Deploying daemon mds.j on smithi012 2024-09-05T01:21:53.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:52 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.145:6832/2656226932,v1:172.21.15.145:6833/2656226932] up:boot 2024-09-05T01:21:53.105 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:52 smithi151 ceph-mon[35013]: fsmap 2 up:standby 2024-09-05T01:21:53.105 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:52 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-05T01:21:53.105 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:52 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/483836593' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:21:53.105 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:52 smithi151 ceph-mon[35013]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:54.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:54 smithi145 ceph-mon[34376]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:54.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:54 smithi012 ceph-mon[29942]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:54.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:54 smithi151 ceph-mon[35013]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:55.061 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:21:55.112 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 05 01:21:54 smithi012 systemd[1]: Starting Ceph mds.j for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:21:55.460 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 05 01:21:55 smithi012 podman[69353]: 2024-09-05 01:21:55.066610457 +0000 UTC m=+0.027631969 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:21:55.460 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 05 01:21:55 smithi012 podman[69353]: 2024-09-05 01:21:55.19928122 +0000 UTC m=+0.160302732 container create f40bb22e13e18f70d18929e28615100796a9533a7c6497de4a4ea5f0ead22672 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T01:21:55.461 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 05 01:21:55 smithi012 podman[69353]: 2024-09-05 01:21:55.460313233 +0000 UTC m=+0.421334769 container init f40bb22e13e18f70d18929e28615100796a9533a7c6497de4a4ea5f0ead22672 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-j, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-05T01:21:55.777 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:21:55.812 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 05 01:21:55 smithi012 podman[69353]: 2024-09-05 01:21:55.466867586 +0000 UTC m=+0.427889099 container start f40bb22e13e18f70d18929e28615100796a9533a7c6497de4a4ea5f0ead22672 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-91c8a7e, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T01:21:55.812 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 05 01:21:55 smithi012 ceph-mds[69401]: -- 172.21.15.12:0/1458079131 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564e5fddfc20 con 0x564e5fdbd400 2024-09-05T01:21:55.812 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 05 01:21:55 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-j[69388]: starting mds.j at 2024-09-05T01:21:55.812 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 05 01:21:55 smithi012 bash[69353]: f40bb22e13e18f70d18929e28615100796a9533a7c6497de4a4ea5f0ead22672 2024-09-05T01:21:55.812 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 05 01:21:55 smithi012 systemd[1]: Started Ceph mds.j for 0d44cd7e-6b24-11ef-bcd6-c7b262605968. 2024-09-05T01:21:56.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.304+0000 7fb49f200640 1 -- 172.21.15.12:0/537316891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb498102360 msgr2=0x7fb49810e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:56.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.304+0000 7fb49f200640 1 --2- 172.21.15.12:0/537316891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb498102360 0x7fb49810e890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb494009cd0 tx=0x7fb49402a8e0 comp rx=0 tx=0).stop 2024-09-05T01:21:56.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.305+0000 7fb49f200640 1 -- 172.21.15.12:0/537316891 shutdown_connections 2024-09-05T01:21:56.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.305+0000 7fb49f200640 1 --2- 172.21.15.12:0/537316891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb498102360 0x7fb49810e890 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:56.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.305+0000 7fb49f200640 1 --2- 172.21.15.12:0/537316891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4981019c0 0x7fb498101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:56.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.305+0000 7fb49f200640 1 --2- 172.21.15.12:0/537316891 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4981079c0 0x7fb498107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:56.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.305+0000 7fb49f200640 1 -- 172.21.15.12:0/537316891 >> 172.21.15.12:0/537316891 conn(0x7fb4980fd6e0 msgr2=0x7fb4980ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:21:56.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.305+0000 7fb49f200640 1 -- 172.21.15.12:0/537316891 shutdown_connections 2024-09-05T01:21:56.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.305+0000 7fb49f200640 1 -- 172.21.15.12:0/537316891 wait complete. 2024-09-05T01:21:56.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.306+0000 7fb49f200640 1 Processor -- start 2024-09-05T01:21:56.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.306+0000 7fb49f200640 1 -- start start 2024-09-05T01:21:56.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.306+0000 7fb49f200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4981019c0 0x7fb49819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:56.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.306+0000 7fb49f200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb498102360 0x7fb49819a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:56.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.306+0000 7fb49f200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4981079c0 0x7fb49819ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:56.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.306+0000 7fb49f200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb498111e10 con 0x7fb4981079c0 2024-09-05T01:21:56.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.306+0000 7fb49f200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb498111c90 con 0x7fb4981019c0 2024-09-05T01:21:56.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.306+0000 7fb49f200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb498111f90 con 0x7fb498102360 2024-09-05T01:21:56.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.306+0000 7fb49d400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb498102360 0x7fb49819a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:56.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.306+0000 7fb49d400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb498102360 0x7fb49819a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:35442/0 (socket says 172.21.15.12:35442) 2024-09-05T01:21:56.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.306+0000 7fb49d400640 1 -- 172.21.15.12:0/3842456486 learned_addr learned my addr 172.21.15.12:0/3842456486 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:21:56.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.306+0000 7fb49de00640 1 --2- 172.21.15.12:0/3842456486 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4981019c0 0x7fb49819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:56.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.307+0000 7fb49e800640 1 --2- 172.21.15.12:0/3842456486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4981079c0 0x7fb49819ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:56.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.307+0000 7fb49de00640 1 -- 172.21.15.12:0/3842456486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb498102360 msgr2=0x7fb49819a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:56.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.307+0000 7fb49de00640 1 --2- 172.21.15.12:0/3842456486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb498102360 0x7fb49819a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:56.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.307+0000 7fb49de00640 1 -- 172.21.15.12:0/3842456486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4981079c0 msgr2=0x7fb49819ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:56.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.307+0000 7fb49de00640 1 --2- 172.21.15.12:0/3842456486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4981079c0 0x7fb49819ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:56.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.307+0000 7fb49de00640 1 -- 172.21.15.12:0/3842456486 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb49819f3f0 con 0x7fb4981019c0 2024-09-05T01:21:56.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.307+0000 7fb49de00640 1 --2- 172.21.15.12:0/3842456486 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4981019c0 0x7fb49819a440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00e9f0 tx=0x7fb48c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:21:56.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.308+0000 7fb492a00640 1 -- 172.21.15.12:0/3842456486 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48c00ccc0 con 0x7fb4981019c0 2024-09-05T01:21:56.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.308+0000 7fb492a00640 1 -- 172.21.15.12:0/3842456486 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb48c010910 con 0x7fb4981019c0 2024-09-05T01:21:56.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.308+0000 7fb49f200640 1 -- 172.21.15.12:0/3842456486 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb49819f6e0 con 0x7fb4981019c0 2024-09-05T01:21:56.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.308+0000 7fb492a00640 1 -- 172.21.15.12:0/3842456486 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48c018960 con 0x7fb4981019c0 2024-09-05T01:21:56.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.308+0000 7fb49f200640 1 -- 172.21.15.12:0/3842456486 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4981a6fc0 con 0x7fb4981019c0 2024-09-05T01:21:56.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.309+0000 7fb49f200640 1 -- 172.21.15.12:0/3842456486 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb498101e20 con 0x7fb4981019c0 2024-09-05T01:21:56.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.311+0000 7fb492a00640 1 -- 172.21.15.12:0/3842456486 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb48c010ac0 con 0x7fb4981019c0 2024-09-05T01:21:56.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.312+0000 7fb492a00640 1 --2- 172.21.15.12:0/3842456486 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb4800a2c00 0x7fb4800a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:21:56.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.312+0000 7fb492a00640 1 -- 172.21.15.12:0/3842456486 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fb48c0ceed0 con 0x7fb4981019c0 2024-09-05T01:21:56.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.312+0000 7fb49d400640 1 --2- 172.21.15.12:0/3842456486 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb4800a2c00 0x7fb4800a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:21:56.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.313+0000 7fb49d400640 1 --2- 172.21.15.12:0/3842456486 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb4800a2c00 0x7fb4800a50c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb49810ecb0 tx=0x7fb48800b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:21:56.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.316+0000 7fb492a00640 1 -- 172.21.15.12:0/3842456486 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb48c09bbe0 con 0x7fb4981019c0 2024-09-05T01:21:56.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.549+0000 7fb49f200640 1 -- 172.21.15.12:0/3842456486 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb49819b7a0 con 0x7fb4981019c0 2024-09-05T01:21:56.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.549+0000 7fb492a00640 1 -- 172.21.15.12:0/3842456486 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7fb48c09fee0 con 0x7fb4981019c0 2024-09-05T01:21:56.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:21:56.550 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":4,"btime":"2024-09-05T01:21:55:564064+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24473,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[]} 2024-09-05T01:21:56.551 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 4 2024-09-05T01:21:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.553+0000 7fb49f200640 1 -- 172.21.15.12:0/3842456486 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb4800a2c00 msgr2=0x7fb4800a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.553+0000 7fb49f200640 1 --2- 172.21.15.12:0/3842456486 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb4800a2c00 0x7fb4800a50c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb49810ecb0 tx=0x7fb48800b4a0 comp rx=0 tx=0).stop 2024-09-05T01:21:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.553+0000 7fb49f200640 1 -- 172.21.15.12:0/3842456486 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4981019c0 msgr2=0x7fb49819a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:21:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.553+0000 7fb49f200640 1 --2- 172.21.15.12:0/3842456486 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4981019c0 0x7fb49819a440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00e9f0 tx=0x7fb48c00eeb0 comp rx=0 tx=0).stop 2024-09-05T01:21:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.553+0000 7fb49f200640 1 -- 172.21.15.12:0/3842456486 shutdown_connections 2024-09-05T01:21:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.553+0000 7fb49f200640 1 --2- 172.21.15.12:0/3842456486 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb4800a2c00 0x7fb4800a50c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.553+0000 7fb49f200640 1 --2- 172.21.15.12:0/3842456486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4981079c0 0x7fb49819ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.553+0000 7fb49f200640 1 --2- 172.21.15.12:0/3842456486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb498102360 0x7fb49819a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.553+0000 7fb49f200640 1 --2- 172.21.15.12:0/3842456486 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4981019c0 0x7fb49819a440 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:21:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.554+0000 7fb49f200640 1 -- 172.21.15.12:0/3842456486 >> 172.21.15.12:0/3842456486 conn(0x7fb4980fd6e0 msgr2=0x7fb4980fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:21:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.554+0000 7fb49f200640 1 -- 172.21.15.12:0/3842456486 shutdown_connections 2024-09-05T01:21:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:21:56.554+0000 7fb49f200640 1 -- 172.21.15.12:0/3842456486 wait complete. 2024-09-05T01:21:56.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:56 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.12:6834/544280854,v1:172.21.15.12:6835/544280854] up:boot 2024-09-05T01:21:56.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:56 smithi012 ceph-mon[29942]: fsmap 3 up:standby 2024-09-05T01:21:56.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-05T01:21:56.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:56.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:56.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:56.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:21:56.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:21:56.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:56 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:56.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:56 smithi012 ceph-mon[29942]: Deploying daemon mds.d on smithi012 2024-09-05T01:21:56.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:56 smithi012 ceph-mon[29942]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:56.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:56 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3842456486' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:21:56.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:56 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.12:6834/544280854,v1:172.21.15.12:6835/544280854] up:boot 2024-09-05T01:21:56.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:56 smithi145 ceph-mon[34376]: fsmap 3 up:standby 2024-09-05T01:21:56.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:56 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-05T01:21:56.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:56 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:56.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:56 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:56.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:56 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:56.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:56 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:21:56.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:56 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:21:56.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:56 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:56.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:56 smithi145 ceph-mon[34376]: Deploying daemon mds.d on smithi012 2024-09-05T01:21:56.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:56 smithi145 ceph-mon[34376]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:56.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:56 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3842456486' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:21:56.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:56 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.12:6834/544280854,v1:172.21.15.12:6835/544280854] up:boot 2024-09-05T01:21:56.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:56 smithi151 ceph-mon[35013]: fsmap 3 up:standby 2024-09-05T01:21:56.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:56 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-05T01:21:56.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:56 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:56.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:56 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:56.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:56 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:21:56.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:56 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:21:56.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:56 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:21:56.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:56 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:21:56.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:56 smithi151 ceph-mon[35013]: Deploying daemon mds.d on smithi012 2024-09-05T01:21:56.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:56 smithi151 ceph-mon[35013]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:56.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:56 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3842456486' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:21:58.494 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:21:58 smithi012 ceph-mon[29942]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:58.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:21:58 smithi145 ceph-mon[34376]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:58.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:21:58 smithi151 ceph-mon[35013]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:21:58.812 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 05 01:21:58 smithi012 systemd[1]: Starting Ceph mds.d for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:21:59.123 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 05 01:21:58 smithi012 podman[69762]: 2024-09-05 01:21:58.829262692 +0000 UTC m=+0.120534081 container create aa64d64fa9db86edd877ab398df2f85b50bb15595406991c6b5b3ff9df9c6805 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-d, RELEASE=squid-91c8a7e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-05T01:21:59.124 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 05 01:21:58 smithi012 podman[69762]: 2024-09-05 01:21:58.73641813 +0000 UTC m=+0.027689525 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:21:59.124 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 05 01:21:59 smithi012 podman[69762]: 2024-09-05 01:21:59.023729015 +0000 UTC m=+0.315000407 container init aa64d64fa9db86edd877ab398df2f85b50bb15595406991c6b5b3ff9df9c6805 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T01:21:59.124 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 05 01:21:59 smithi012 podman[69762]: 2024-09-05 01:21:59.030549857 +0000 UTC m=+0.321821259 container start aa64d64fa9db86edd877ab398df2f85b50bb15595406991c6b5b3ff9df9c6805 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-d, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-05T01:21:59.124 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 05 01:21:59 smithi012 ceph-mds[69781]: -- 172.21.15.12:0/1902008189 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5603756e5c20 con 0x5603756c3400 2024-09-05T01:21:59.124 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 05 01:21:59 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-d[69777]: starting mds.d at 2024-09-05T01:21:59.124 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 05 01:21:59 smithi012 bash[69762]: aa64d64fa9db86edd877ab398df2f85b50bb15595406991c6b5b3ff9df9c6805 2024-09-05T01:21:59.562 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 05 01:21:59 smithi012 systemd[1]: Started Ceph mds.d for 0d44cd7e-6b24-11ef-bcd6-c7b262605968. 2024-09-05T01:22:00.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:00 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:00.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:00 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:00.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:00 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:00.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:00 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:22:00.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:00 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:22:00.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:00 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:00.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:00 smithi145 ceph-mon[34376]: Deploying daemon mds.e on smithi145 2024-09-05T01:22:00.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:00 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.12:6836/2004256626,v1:172.21.15.12:6837/2004256626] up:boot 2024-09-05T01:22:00.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:00 smithi145 ceph-mon[34376]: fsmap 4 up:standby 2024-09-05T01:22:00.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:00 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-05T01:22:00.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:00 smithi145 ceph-mon[34376]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:00.356 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:22:00.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:00 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:00.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:00 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:00.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:00 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:00.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:00 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:22:00.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:00 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:22:00.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:00 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:00.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:00 smithi012 ceph-mon[29942]: Deploying daemon mds.e on smithi145 2024-09-05T01:22:00.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:00 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.12:6836/2004256626,v1:172.21.15.12:6837/2004256626] up:boot 2024-09-05T01:22:00.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:00 smithi012 ceph-mon[29942]: fsmap 4 up:standby 2024-09-05T01:22:00.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:00 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-05T01:22:00.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:00 smithi012 ceph-mon[29942]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:00.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:00.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:00.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:00.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:22:00.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:22:00.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:00.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:00 smithi151 ceph-mon[35013]: Deploying daemon mds.e on smithi145 2024-09-05T01:22:00.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:00 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.12:6836/2004256626,v1:172.21.15.12:6837/2004256626] up:boot 2024-09-05T01:22:00.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:00 smithi151 ceph-mon[35013]: fsmap 4 up:standby 2024-09-05T01:22:00.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:00 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-05T01:22:00.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:00 smithi151 ceph-mon[35013]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:00.744 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:22:01.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.306+0000 7f45f7e00640 1 -- 172.21.15.12:0/957810588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45f8103e30 msgr2=0x7f45f8104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:01.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.306+0000 7f45f7e00640 1 --2- 172.21.15.12:0/957810588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45f8103e30 0x7f45f8104210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f45e8009900 tx=0x7f45e802a3f0 comp rx=0 tx=0).stop 2024-09-05T01:22:01.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.306+0000 7f45f7e00640 1 -- 172.21.15.12:0/957810588 shutdown_connections 2024-09-05T01:22:01.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.306+0000 7f45f7e00640 1 --2- 172.21.15.12:0/957810588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45f8108f60 0x7f45f8110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:01.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.306+0000 7f45f7e00640 1 --2- 172.21.15.12:0/957810588 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45f81047e0 0x7f45f8108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:01.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.306+0000 7f45f7e00640 1 --2- 172.21.15.12:0/957810588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45f8103e30 0x7f45f8104210 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:01.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.306+0000 7f45f7e00640 1 -- 172.21.15.12:0/957810588 >> 172.21.15.12:0/957810588 conn(0x7f45f80ff8d0 msgr2=0x7f45f8101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:01.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.306+0000 7f45f7e00640 1 -- 172.21.15.12:0/957810588 shutdown_connections 2024-09-05T01:22:01.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.306+0000 7f45f7e00640 1 -- 172.21.15.12:0/957810588 wait complete. 2024-09-05T01:22:01.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.307+0000 7f45f7e00640 1 Processor -- start 2024-09-05T01:22:01.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.307+0000 7f45f7e00640 1 -- start start 2024-09-05T01:22:01.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.308+0000 7f45f7e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45f8103e30 0x7f45f819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:01.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.308+0000 7f45f7e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45f81047e0 0x7f45f819a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:01.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.308+0000 7f45f7e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45f8108f60 0x7f45f819ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:01.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.308+0000 7f45f7e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f45f8113fc0 con 0x7f45f81047e0 2024-09-05T01:22:01.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.308+0000 7f45f7e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f45f8113e40 con 0x7f45f8108f60 2024-09-05T01:22:01.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.308+0000 7f45f7e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f45f8114140 con 0x7f45f8103e30 2024-09-05T01:22:01.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.308+0000 7f45ee000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45f81047e0 0x7f45f819a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:01.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.308+0000 7f45ee000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45f81047e0 0x7f45f819a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53814/0 (socket says 172.21.15.12:53814) 2024-09-05T01:22:01.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.308+0000 7f45ee000640 1 -- 172.21.15.12:0/1461874291 learned_addr learned my addr 172.21.15.12:0/1461874291 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:22:01.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.308+0000 7f45f6a00640 1 --2- 172.21.15.12:0/1461874291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45f8103e30 0x7f45f819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:01.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.308+0000 7f45f7400640 1 --2- 172.21.15.12:0/1461874291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45f8108f60 0x7f45f819ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:01.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.308+0000 7f45f6a00640 1 -- 172.21.15.12:0/1461874291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45f8108f60 msgr2=0x7f45f819ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:01.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.309+0000 7f45f6a00640 1 --2- 172.21.15.12:0/1461874291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45f8108f60 0x7f45f819ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:01.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.309+0000 7f45f6a00640 1 -- 172.21.15.12:0/1461874291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45f81047e0 msgr2=0x7f45f819a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:01.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.309+0000 7f45f6a00640 1 --2- 172.21.15.12:0/1461874291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45f81047e0 0x7f45f819a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:01.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.309+0000 7f45f6a00640 1 -- 172.21.15.12:0/1461874291 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f819f430 con 0x7f45f8103e30 2024-09-05T01:22:01.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.309+0000 7f45ee000640 1 --2- 172.21.15.12:0/1461874291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45f81047e0 0x7f45f819a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:22:01.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.309+0000 7f45f6a00640 1 --2- 172.21.15.12:0/1461874291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45f8103e30 0x7f45f819a480 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f45e8005940 tx=0x7f45e80040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:01.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.309+0000 7f45efe00640 1 -- 172.21.15.12:0/1461874291 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e803f030 con 0x7f45f8103e30 2024-09-05T01:22:01.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.309+0000 7f45f7e00640 1 -- 172.21.15.12:0/1461874291 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f819f6c0 con 0x7f45f8103e30 2024-09-05T01:22:01.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.309+0000 7f45efe00640 1 -- 172.21.15.12:0/1461874291 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45e80044c0 con 0x7f45f8103e30 2024-09-05T01:22:01.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.309+0000 7f45efe00640 1 -- 172.21.15.12:0/1461874291 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e8035070 con 0x7f45f8103e30 2024-09-05T01:22:01.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.309+0000 7f45f7e00640 1 -- 172.21.15.12:0/1461874291 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f81a7000 con 0x7f45f8103e30 2024-09-05T01:22:01.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.310+0000 7f45f7e00640 1 -- 172.21.15.12:0/1461874291 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f8105310 con 0x7f45f8103e30 2024-09-05T01:22:01.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.312+0000 7f45efe00640 1 -- 172.21.15.12:0/1461874291 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f45e8042030 con 0x7f45f8103e30 2024-09-05T01:22:01.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.314+0000 7f45efe00640 1 --2- 172.21.15.12:0/1461874291 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f45dc0a2b80 0x7f45dc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:01.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.314+0000 7f45efe00640 1 -- 172.21.15.12:0/1461874291 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f45e80ef150 con 0x7f45f8103e30 2024-09-05T01:22:01.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.314+0000 7f45ee000640 1 --2- 172.21.15.12:0/1461874291 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f45dc0a2b80 0x7f45dc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:01.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.315+0000 7f45ee000640 1 --2- 172.21.15.12:0/1461874291 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f45dc0a2b80 0x7f45dc0a5040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f45f80ffd60 tx=0x7f45e0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:01.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.316+0000 7f45efe00640 1 -- 172.21.15.12:0/1461874291 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f45e80bc4b0 con 0x7f45f8103e30 2024-09-05T01:22:01.333 INFO:journalctl@ceph.mds.e.smithi145.stdout:Sep 05 01:22:01 smithi145 systemd[1]: Starting Ceph mds.e for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:22:01.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.538+0000 7f45f7e00640 1 -- 172.21.15.12:0/1461874291 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45f8104210 con 0x7f45f8103e30 2024-09-05T01:22:01.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.539+0000 7f45efe00640 1 -- 172.21.15.12:0/1461874291 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7f45f8104210 con 0x7f45f8103e30 2024-09-05T01:22:01.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:22:01.540 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":5,"btime":"2024-09-05T01:21:59:247471+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24473,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[]} 2024-09-05T01:22:01.540 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 5 2024-09-05T01:22:01.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.542+0000 7f45f7e00640 1 -- 172.21.15.12:0/1461874291 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f45dc0a2b80 msgr2=0x7f45dc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:01.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.542+0000 7f45f7e00640 1 --2- 172.21.15.12:0/1461874291 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f45dc0a2b80 0x7f45dc0a5040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f45f80ffd60 tx=0x7f45e0005f90 comp rx=0 tx=0).stop 2024-09-05T01:22:01.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.542+0000 7f45f7e00640 1 -- 172.21.15.12:0/1461874291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45f8103e30 msgr2=0x7f45f819a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:01.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.542+0000 7f45f7e00640 1 --2- 172.21.15.12:0/1461874291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45f8103e30 0x7f45f819a480 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f45e8005940 tx=0x7f45e80040c0 comp rx=0 tx=0).stop 2024-09-05T01:22:01.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.542+0000 7f45f7e00640 1 -- 172.21.15.12:0/1461874291 shutdown_connections 2024-09-05T01:22:01.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.542+0000 7f45f7e00640 1 --2- 172.21.15.12:0/1461874291 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f45dc0a2b80 0x7f45dc0a5040 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:01.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.542+0000 7f45f7e00640 1 --2- 172.21.15.12:0/1461874291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45f8108f60 0x7f45f819ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:01.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.542+0000 7f45f7e00640 1 --2- 172.21.15.12:0/1461874291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45f81047e0 0x7f45f819a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:01.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.542+0000 7f45f7e00640 1 --2- 172.21.15.12:0/1461874291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45f8103e30 0x7f45f819a480 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:01.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.542+0000 7f45f7e00640 1 -- 172.21.15.12:0/1461874291 >> 172.21.15.12:0/1461874291 conn(0x7f45f80ff8d0 msgr2=0x7f45f8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:01.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.542+0000 7f45f7e00640 1 -- 172.21.15.12:0/1461874291 shutdown_connections 2024-09-05T01:22:01.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:01.542+0000 7f45f7e00640 1 -- 172.21.15.12:0/1461874291 wait complete. 2024-09-05T01:22:01.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:01 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/1461874291' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:22:01.621 INFO:journalctl@ceph.mds.e.smithi145.stdout:Sep 05 01:22:01 smithi145 podman[64381]: 2024-09-05 01:22:01.251635949 +0000 UTC m=+0.015791268 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:22:01.621 INFO:journalctl@ceph.mds.e.smithi145.stdout:Sep 05 01:22:01 smithi145 podman[64381]: 2024-09-05 01:22:01.383867693 +0000 UTC m=+0.148023011 container create bdcecdf76fa2914beda5e523c1c9f0f1c61358ca877db5bb9a23d18b2220214e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T01:22:01.621 INFO:journalctl@ceph.mds.e.smithi145.stdout:Sep 05 01:22:01 smithi145 podman[64381]: 2024-09-05 01:22:01.594374755 +0000 UTC m=+0.358530074 container init bdcecdf76fa2914beda5e523c1c9f0f1c61358ca877db5bb9a23d18b2220214e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-e, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-05T01:22:01.621 INFO:journalctl@ceph.mds.e.smithi145.stdout:Sep 05 01:22:01 smithi145 podman[64381]: 2024-09-05 01:22:01.597638964 +0000 UTC m=+0.361794292 container start bdcecdf76fa2914beda5e523c1c9f0f1c61358ca877db5bb9a23d18b2220214e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-e, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-91c8a7e, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-05T01:22:01.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:01 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/1461874291' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:22:01.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:01 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/1461874291' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:22:02.083 INFO:journalctl@ceph.mds.e.smithi145.stdout:Sep 05 01:22:01 smithi145 ceph-mds[64400]: -- 172.21.15.145:0/2194341163 <== mon.2 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564191d75860 con 0x564191d52800 2024-09-05T01:22:02.083 INFO:journalctl@ceph.mds.e.smithi145.stdout:Sep 05 01:22:01 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-e[64396]: starting mds.e at 2024-09-05T01:22:02.084 INFO:journalctl@ceph.mds.e.smithi145.stdout:Sep 05 01:22:01 smithi145 bash[64381]: bdcecdf76fa2914beda5e523c1c9f0f1c61358ca877db5bb9a23d18b2220214e 2024-09-05T01:22:02.084 INFO:journalctl@ceph.mds.e.smithi145.stdout:Sep 05 01:22:01 smithi145 systemd[1]: Started Ceph mds.e for 0d44cd7e-6b24-11ef-bcd6-c7b262605968. 2024-09-05T01:22:03.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:02 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:03.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:02 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:03.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:02 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:03.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:02 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:22:03.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:02 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:22:03.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:02 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:03.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:02 smithi012 ceph-mon[29942]: Deploying daemon mds.f on smithi151 2024-09-05T01:22:03.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:02 smithi012 ceph-mon[29942]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:03.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:02 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.145:6834/397717562,v1:172.21.15.145:6835/397717562] up:boot 2024-09-05T01:22:03.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:02 smithi012 ceph-mon[29942]: fsmap 5 up:standby 2024-09-05T01:22:03.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:02 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-05T01:22:03.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:02 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:03.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:02 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:03.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:02 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:03.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:02 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:22:03.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:02 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:22:03.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:02 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:03.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:02 smithi145 ceph-mon[34376]: Deploying daemon mds.f on smithi151 2024-09-05T01:22:03.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:02 smithi145 ceph-mon[34376]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:03.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:02 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.145:6834/397717562,v1:172.21.15.145:6835/397717562] up:boot 2024-09-05T01:22:03.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:02 smithi145 ceph-mon[34376]: fsmap 5 up:standby 2024-09-05T01:22:03.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:02 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-05T01:22:03.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:02 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:03.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:02 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:03.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:02 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:03.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:02 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:22:03.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:02 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:22:03.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:02 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:03.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:02 smithi151 ceph-mon[35013]: Deploying daemon mds.f on smithi151 2024-09-05T01:22:03.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:02 smithi151 ceph-mon[35013]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:03.105 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:02 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.145:6834/397717562,v1:172.21.15.145:6835/397717562] up:boot 2024-09-05T01:22:03.105 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:02 smithi151 ceph-mon[35013]: fsmap 5 up:standby 2024-09-05T01:22:03.105 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:02 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-05T01:22:03.854 INFO:journalctl@ceph.mds.f.smithi151.stdout:Sep 05 01:22:03 smithi151 systemd[1]: Starting Ceph mds.f for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:22:04.270 INFO:journalctl@ceph.mds.f.smithi151.stdout:Sep 05 01:22:03 smithi151 podman[64264]: 2024-09-05 01:22:03.805547697 +0000 UTC m=+0.015987827 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:22:04.271 INFO:journalctl@ceph.mds.f.smithi151.stdout:Sep 05 01:22:03 smithi151 podman[64264]: 2024-09-05 01:22:03.920332918 +0000 UTC m=+0.130773041 container create 547cb7b9ff22093387a6c2dfe0e55d683620ff77ebb6a6acfcf312bab722c7cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-f, RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-05T01:22:04.271 INFO:journalctl@ceph.mds.f.smithi151.stdout:Sep 05 01:22:04 smithi151 podman[64264]: 2024-09-05 01:22:04.102457337 +0000 UTC m=+0.312897460 container init 547cb7b9ff22093387a6c2dfe0e55d683620ff77ebb6a6acfcf312bab722c7cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-f, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-05T01:22:04.271 INFO:journalctl@ceph.mds.f.smithi151.stdout:Sep 05 01:22:04 smithi151 podman[64264]: 2024-09-05 01:22:04.105516512 +0000 UTC m=+0.315956640 container start 547cb7b9ff22093387a6c2dfe0e55d683620ff77ebb6a6acfcf312bab722c7cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-91c8a7e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0) 2024-09-05T01:22:04.271 INFO:journalctl@ceph.mds.f.smithi151.stdout:Sep 05 01:22:04 smithi151 ceph-mds[64284]: -- 172.21.15.151:0/4137584983 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55938961b860 con 0x5593895f9400 2024-09-05T01:22:04.271 INFO:journalctl@ceph.mds.f.smithi151.stdout:Sep 05 01:22:04 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-f[64279]: starting mds.f at 2024-09-05T01:22:04.318 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:22:04.604 INFO:journalctl@ceph.mds.f.smithi151.stdout:Sep 05 01:22:04 smithi151 bash[64264]: 547cb7b9ff22093387a6c2dfe0e55d683620ff77ebb6a6acfcf312bab722c7cc 2024-09-05T01:22:04.604 INFO:journalctl@ceph.mds.f.smithi151.stdout:Sep 05 01:22:04 smithi151 systemd[1]: Started Ceph mds.f for 0d44cd7e-6b24-11ef-bcd6-c7b262605968. 2024-09-05T01:22:04.710 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:22:05.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:05 smithi145 ceph-mon[34376]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:05.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:05 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.151:6834/309674660,v1:172.21.15.151:6835/309674660] up:boot 2024-09-05T01:22:05.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:05 smithi145 ceph-mon[34376]: fsmap 6 up:standby 2024-09-05T01:22:05.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:05 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-05T01:22:05.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:05 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:05.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:05 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:05.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:05 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:05.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:05 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:22:05.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:05 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:22:05.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:05 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:05.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.333+0000 7fc979400640 1 -- 172.21.15.12:0/1706751377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc974109120 msgr2=0x7fc974110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:05.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.333+0000 7fc979400640 1 --2- 172.21.15.12:0/1706751377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc974109120 0x7fc974110ca0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009860 tx=0x7fc96c02a340 comp rx=0 tx=0).stop 2024-09-05T01:22:05.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.333+0000 7fc979400640 1 -- 172.21.15.12:0/1706751377 shutdown_connections 2024-09-05T01:22:05.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.333+0000 7fc979400640 1 --2- 172.21.15.12:0/1706751377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc974109120 0x7fc974110ca0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:05.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.333+0000 7fc979400640 1 --2- 172.21.15.12:0/1706751377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9741049a0 0x7fc9741089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:05.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.333+0000 7fc979400640 1 --2- 172.21.15.12:0/1706751377 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc974103ff0 0x7fc9741043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:05.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.333+0000 7fc979400640 1 -- 172.21.15.12:0/1706751377 >> 172.21.15.12:0/1706751377 conn(0x7fc9740ffa90 msgr2=0x7fc974101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:05.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.333+0000 7fc979400640 1 -- 172.21.15.12:0/1706751377 shutdown_connections 2024-09-05T01:22:05.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.334+0000 7fc979400640 1 -- 172.21.15.12:0/1706751377 wait complete. 2024-09-05T01:22:05.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.334+0000 7fc979400640 1 Processor -- start 2024-09-05T01:22:05.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.335+0000 7fc979400640 1 -- start start 2024-09-05T01:22:05.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.335+0000 7fc979400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc974103ff0 0x7fc97419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:05.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.335+0000 7fc979400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9741049a0 0x7fc97419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:05.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.335+0000 7fc979400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc974109120 0x7fc97419ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:05.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.335+0000 7fc979400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc974114130 con 0x7fc974103ff0 2024-09-05T01:22:05.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.335+0000 7fc979400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc974113fb0 con 0x7fc974109120 2024-09-05T01:22:05.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.335+0000 7fc979400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc9741142b0 con 0x7fc9741049a0 2024-09-05T01:22:05.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.335+0000 7fc972800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc974103ff0 0x7fc97419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:05.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.335+0000 7fc972800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc974103ff0 0x7fc97419a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53824/0 (socket says 172.21.15.12:53824) 2024-09-05T01:22:05.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.335+0000 7fc972800640 1 -- 172.21.15.12:0/1317891351 learned_addr learned my addr 172.21.15.12:0/1317891351 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:22:05.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.335+0000 7fc973200640 1 --2- 172.21.15.12:0/1317891351 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc974109120 0x7fc97419ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:05.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.335+0000 7fc969e00640 1 --2- 172.21.15.12:0/1317891351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9741049a0 0x7fc97419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:05.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.336+0000 7fc972800640 1 -- 172.21.15.12:0/1317891351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9741049a0 msgr2=0x7fc97419aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:05.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.336+0000 7fc972800640 1 --2- 172.21.15.12:0/1317891351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9741049a0 0x7fc97419aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:05.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.336+0000 7fc972800640 1 -- 172.21.15.12:0/1317891351 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc974109120 msgr2=0x7fc97419ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:05.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.336+0000 7fc972800640 1 --2- 172.21.15.12:0/1317891351 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc974109120 0x7fc97419ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:05.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.336+0000 7fc972800640 1 -- 172.21.15.12:0/1317891351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97419f540 con 0x7fc974103ff0 2024-09-05T01:22:05.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.336+0000 7fc973200640 1 --2- 172.21.15.12:0/1317891351 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc974109120 0x7fc97419ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:22:05.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.336+0000 7fc972800640 1 --2- 172.21.15.12:0/1317891351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc974103ff0 0x7fc97419a590 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc964009d50 tx=0x7fc96400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:05.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.336+0000 7fc96be00640 1 -- 172.21.15.12:0/1317891351 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc964003b70 con 0x7fc974103ff0 2024-09-05T01:22:05.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.336+0000 7fc96be00640 1 -- 172.21.15.12:0/1317891351 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc964003d10 con 0x7fc974103ff0 2024-09-05T01:22:05.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.336+0000 7fc979400640 1 -- 172.21.15.12:0/1317891351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97419f830 con 0x7fc974103ff0 2024-09-05T01:22:05.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.337+0000 7fc96be00640 1 -- 172.21.15.12:0/1317891351 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc964010a20 con 0x7fc974103ff0 2024-09-05T01:22:05.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.337+0000 7fc979400640 1 -- 172.21.15.12:0/1317891351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9741a7110 con 0x7fc974103ff0 2024-09-05T01:22:05.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.338+0000 7fc979400640 1 -- 172.21.15.12:0/1317891351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9741043d0 con 0x7fc974103ff0 2024-09-05T01:22:05.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.341+0000 7fc96be00640 1 -- 172.21.15.12:0/1317891351 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc964010bc0 con 0x7fc974103ff0 2024-09-05T01:22:05.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.342+0000 7fc96be00640 1 --2- 172.21.15.12:0/1317891351 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc9580a2c00 0x7fc9580a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:05.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.343+0000 7fc96be00640 1 -- 172.21.15.12:0/1317891351 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fc9640cf2f0 con 0x7fc974103ff0 2024-09-05T01:22:05.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.343+0000 7fc969e00640 1 --2- 172.21.15.12:0/1317891351 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc9580a2c00 0x7fc9580a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:05.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.343+0000 7fc969e00640 1 --2- 172.21.15.12:0/1317891351 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc9580a2c00 0x7fc9580a50c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0096c0 tx=0x7fc95c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:05.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.345+0000 7fc96be00640 1 -- 172.21.15.12:0/1317891351 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc96409c6e0 con 0x7fc974103ff0 2024-09-05T01:22:05.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:05 smithi151 ceph-mon[35013]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:05.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:05 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.151:6834/309674660,v1:172.21.15.151:6835/309674660] up:boot 2024-09-05T01:22:05.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:05 smithi151 ceph-mon[35013]: fsmap 6 up:standby 2024-09-05T01:22:05.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-05T01:22:05.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:05.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:05.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:05.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:22:05.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:22:05.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:05 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:05.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:05 smithi012 ceph-mon[29942]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:05.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:05 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.151:6834/309674660,v1:172.21.15.151:6835/309674660] up:boot 2024-09-05T01:22:05.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:05 smithi012 ceph-mon[29942]: fsmap 6 up:standby 2024-09-05T01:22:05.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-05T01:22:05.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:05.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:05.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:05.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:22:05.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:22:05.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:05 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:05.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.568+0000 7fc979400640 1 -- 172.21.15.12:0/1317891351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc97419b8f0 con 0x7fc974103ff0 2024-09-05T01:22:05.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.568+0000 7fc96be00640 1 -- 172.21.15.12:0/1317891351 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5563 (secure 0 0 0) 0x7fc96409bfe0 con 0x7fc974103ff0 2024-09-05T01:22:05.569 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:22:05.569 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"btime":"2024-09-05T01:22:04:185964+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24473,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24505,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-05T01:22:05.570 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2024-09-05T01:22:05.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.570+0000 7fc979400640 1 -- 172.21.15.12:0/1317891351 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc9580a2c00 msgr2=0x7fc9580a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:05.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.570+0000 7fc979400640 1 --2- 172.21.15.12:0/1317891351 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc9580a2c00 0x7fc9580a50c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0096c0 tx=0x7fc95c009260 comp rx=0 tx=0).stop 2024-09-05T01:22:05.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.570+0000 7fc979400640 1 -- 172.21.15.12:0/1317891351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc974103ff0 msgr2=0x7fc97419a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:05.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.570+0000 7fc979400640 1 --2- 172.21.15.12:0/1317891351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc974103ff0 0x7fc97419a590 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc964009d50 tx=0x7fc96400c6a0 comp rx=0 tx=0).stop 2024-09-05T01:22:05.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.571+0000 7fc979400640 1 -- 172.21.15.12:0/1317891351 shutdown_connections 2024-09-05T01:22:05.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.571+0000 7fc979400640 1 --2- 172.21.15.12:0/1317891351 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc9580a2c00 0x7fc9580a50c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:05.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.571+0000 7fc979400640 1 --2- 172.21.15.12:0/1317891351 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc974109120 0x7fc97419ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:05.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.571+0000 7fc979400640 1 --2- 172.21.15.12:0/1317891351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9741049a0 0x7fc97419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:05.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.571+0000 7fc979400640 1 --2- 172.21.15.12:0/1317891351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc974103ff0 0x7fc97419a590 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:05.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.571+0000 7fc979400640 1 -- 172.21.15.12:0/1317891351 >> 172.21.15.12:0/1317891351 conn(0x7fc9740ffa90 msgr2=0x7fc974101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:05.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.571+0000 7fc979400640 1 -- 172.21.15.12:0/1317891351 shutdown_connections 2024-09-05T01:22:05.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:05.571+0000 7fc979400640 1 -- 172.21.15.12:0/1317891351 wait complete. 2024-09-05T01:22:06.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:06 smithi145 ceph-mon[34376]: Deploying daemon mds.c on smithi151 2024-09-05T01:22:06.503 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:06 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/1317891351' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:22:06.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:06 smithi012 ceph-mon[29942]: Deploying daemon mds.c on smithi151 2024-09-05T01:22:06.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:06 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/1317891351' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:22:06.565 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:06 smithi151 ceph-mon[35013]: Deploying daemon mds.c on smithi151 2024-09-05T01:22:06.565 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:06 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/1317891351' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:22:06.565 INFO:journalctl@ceph.mds.c.smithi151.stdout:Sep 05 01:22:06 smithi151 systemd[1]: Starting Ceph mds.c for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:22:06.817 INFO:journalctl@ceph.mds.c.smithi151.stdout:Sep 05 01:22:06 smithi151 podman[64578]: 2024-09-05 01:22:06.46746559 +0000 UTC m=+0.015873650 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:22:06.817 INFO:journalctl@ceph.mds.c.smithi151.stdout:Sep 05 01:22:06 smithi151 podman[64578]: 2024-09-05 01:22:06.581357399 +0000 UTC m=+0.129765498 container create 9209fcf9f5013ba8af19740a9d9c5d3d4e40c6e3303e9b0e97c78cbea0896946 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-05T01:22:06.817 INFO:journalctl@ceph.mds.c.smithi151.stdout:Sep 05 01:22:06 smithi151 podman[64578]: 2024-09-05 01:22:06.81727519 +0000 UTC m=+0.365683244 container init 9209fcf9f5013ba8af19740a9d9c5d3d4e40c6e3303e9b0e97c78cbea0896946 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T01:22:07.104 INFO:journalctl@ceph.mds.c.smithi151.stdout:Sep 05 01:22:06 smithi151 podman[64578]: 2024-09-05 01:22:06.820244815 +0000 UTC m=+0.368652868 container start 9209fcf9f5013ba8af19740a9d9c5d3d4e40c6e3303e9b0e97c78cbea0896946 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-c, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-91c8a7e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-05T01:22:07.104 INFO:journalctl@ceph.mds.c.smithi151.stdout:Sep 05 01:22:06 smithi151 ceph-mds[64597]: -- 172.21.15.151:0/3536974187 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558873f6d860 con 0x558873f4b000 2024-09-05T01:22:07.104 INFO:journalctl@ceph.mds.c.smithi151.stdout:Sep 05 01:22:06 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-c[64593]: starting mds.c at 2024-09-05T01:22:07.104 INFO:journalctl@ceph.mds.c.smithi151.stdout:Sep 05 01:22:06 smithi151 bash[64578]: 9209fcf9f5013ba8af19740a9d9c5d3d4e40c6e3303e9b0e97c78cbea0896946 2024-09-05T01:22:07.104 INFO:journalctl@ceph.mds.c.smithi151.stdout:Sep 05 01:22:06 smithi151 systemd[1]: Started Ceph mds.c for 0d44cd7e-6b24-11ef-bcd6-c7b262605968. 2024-09-05T01:22:07.485 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:07 smithi145 ceph-mon[34376]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:07.485 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:07 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:07.485 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:07 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:07.485 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:07 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:07.485 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:07 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:22:07.485 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:07 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:22:07.485 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:07 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:07.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:07 smithi012 ceph-mon[29942]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:07.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:07 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:07.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:07 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:07.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:07 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:07.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:07 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:22:07.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:07 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:22:07.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:07 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:07.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:07 smithi151 ceph-mon[35013]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:07.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:07 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:07.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:07 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:07.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:07 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:07.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:07 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:22:07.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:07 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:22:07.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:07 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:08.270 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:22:08.493 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:08 smithi145 ceph-mon[34376]: Deploying daemon mds.h on smithi145 2024-09-05T01:22:08.493 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:08 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] up:boot 2024-09-05T01:22:08.493 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:08 smithi145 ceph-mon[34376]: fsmap 7 up:standby 2024-09-05T01:22:08.494 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:08 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T01:22:08.494 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:08 smithi145 ceph-mon[34376]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:08.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:08 smithi012 ceph-mon[29942]: Deploying daemon mds.h on smithi145 2024-09-05T01:22:08.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:08 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] up:boot 2024-09-05T01:22:08.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:08 smithi012 ceph-mon[29942]: fsmap 7 up:standby 2024-09-05T01:22:08.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:08 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T01:22:08.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:08 smithi012 ceph-mon[29942]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:08.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:08 smithi151 ceph-mon[35013]: Deploying daemon mds.h on smithi145 2024-09-05T01:22:08.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:08 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] up:boot 2024-09-05T01:22:08.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:08 smithi151 ceph-mon[35013]: fsmap 7 up:standby 2024-09-05T01:22:08.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:08 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T01:22:08.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:08 smithi151 ceph-mon[35013]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:08.653 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:22:09.084 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:22:08 smithi145 systemd[1]: Starting Ceph mds.h for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:22:09.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.237+0000 7f42f3e00640 1 -- 172.21.15.12:0/248483619 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42f4103e30 msgr2=0x7f42f4104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:09.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.237+0000 7f42f3e00640 1 --2- 172.21.15.12:0/248483619 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42f4103e30 0x7f42f4104210 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009900 tx=0x7f42e402a3f0 comp rx=0 tx=0).stop 2024-09-05T01:22:09.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.237+0000 7f42f3e00640 1 -- 172.21.15.12:0/248483619 shutdown_connections 2024-09-05T01:22:09.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.237+0000 7f42f3e00640 1 --2- 172.21.15.12:0/248483619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42f4108f60 0x7f42f4110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:09.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.237+0000 7f42f3e00640 1 --2- 172.21.15.12:0/248483619 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42f41047e0 0x7f42f4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:09.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.237+0000 7f42f3e00640 1 --2- 172.21.15.12:0/248483619 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42f4103e30 0x7f42f4104210 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:09.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.237+0000 7f42f3e00640 1 -- 172.21.15.12:0/248483619 >> 172.21.15.12:0/248483619 conn(0x7f42f40ff910 msgr2=0x7f42f4101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:09.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.237+0000 7f42f3e00640 1 -- 172.21.15.12:0/248483619 shutdown_connections 2024-09-05T01:22:09.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.237+0000 7f42f3e00640 1 -- 172.21.15.12:0/248483619 wait complete. 2024-09-05T01:22:09.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.238+0000 7f42f3e00640 1 Processor -- start 2024-09-05T01:22:09.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.238+0000 7f42f3e00640 1 -- start start 2024-09-05T01:22:09.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.239+0000 7f42f3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42f4103e30 0x7f42f4076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:09.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.239+0000 7f42f3e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42f41047e0 0x7f42f4076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:09.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.239+0000 7f42f3e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42f4108f60 0x7f42f4077180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:09.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.239+0000 7f42f3e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f42f4113fc0 con 0x7f42f4103e30 2024-09-05T01:22:09.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.239+0000 7f42f3e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f42f4113e40 con 0x7f42f41047e0 2024-09-05T01:22:09.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.239+0000 7f42f3e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f42f4114140 con 0x7f42f4108f60 2024-09-05T01:22:09.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.239+0000 7f42f2a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42f4103e30 0x7f42f4076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:09.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.239+0000 7f42f2000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42f41047e0 0x7f42f4076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:09.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.239+0000 7f42f2000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42f41047e0 0x7f42f4076c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:40424/0 (socket says 172.21.15.12:40424) 2024-09-05T01:22:09.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.239+0000 7f42f2000640 1 -- 172.21.15.12:0/667510754 learned_addr learned my addr 172.21.15.12:0/667510754 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:22:09.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.239+0000 7f42f3400640 1 --2- 172.21.15.12:0/667510754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42f4108f60 0x7f42f4077180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:09.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.240+0000 7f42f2000640 1 -- 172.21.15.12:0/667510754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42f4108f60 msgr2=0x7f42f4077180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:09.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.240+0000 7f42f2000640 1 --2- 172.21.15.12:0/667510754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42f4108f60 0x7f42f4077180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:09.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.240+0000 7f42f2000640 1 -- 172.21.15.12:0/667510754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42f4103e30 msgr2=0x7f42f4076700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:09.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.240+0000 7f42f2000640 1 --2- 172.21.15.12:0/667510754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42f4103e30 0x7f42f4076700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:09.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.240+0000 7f42f2000640 1 -- 172.21.15.12:0/667510754 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f41aab60 con 0x7f42f41047e0 2024-09-05T01:22:09.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.240+0000 7f42f2a00640 1 --2- 172.21.15.12:0/667510754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42f4103e30 0x7f42f4076700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:22:09.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.240+0000 7f42f2000640 1 --2- 172.21.15.12:0/667510754 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42f41047e0 0x7f42f4076c40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f42e000ea50 tx=0x7f42e000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:09.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.240+0000 7f42eb400640 1 -- 172.21.15.12:0/667510754 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e000cd60 con 0x7f42f41047e0 2024-09-05T01:22:09.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.240+0000 7f42f3e00640 1 -- 172.21.15.12:0/667510754 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f41aae50 con 0x7f42f41047e0 2024-09-05T01:22:09.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.240+0000 7f42eb400640 1 -- 172.21.15.12:0/667510754 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42e0010910 con 0x7f42f41047e0 2024-09-05T01:22:09.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.240+0000 7f42eb400640 1 -- 172.21.15.12:0/667510754 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e0018950 con 0x7f42f41047e0 2024-09-05T01:22:09.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.240+0000 7f42f3e00640 1 -- 172.21.15.12:0/667510754 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f41ab300 con 0x7f42f41047e0 2024-09-05T01:22:09.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.241+0000 7f42f3e00640 1 -- 172.21.15.12:0/667510754 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f4105310 con 0x7f42f41047e0 2024-09-05T01:22:09.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.243+0000 7f42eb400640 1 -- 172.21.15.12:0/667510754 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f42e0010ac0 con 0x7f42f41047e0 2024-09-05T01:22:09.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.244+0000 7f42eb400640 1 --2- 172.21.15.12:0/667510754 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f42d80a2b80 0x7f42d80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:09.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.245+0000 7f42eb400640 1 -- 172.21.15.12:0/667510754 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f42e00cef00 con 0x7f42f41047e0 2024-09-05T01:22:09.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.245+0000 7f42f2a00640 1 --2- 172.21.15.12:0/667510754 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f42d80a2b80 0x7f42d80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:09.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.245+0000 7f42f2a00640 1 --2- 172.21.15.12:0/667510754 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f42d80a2b80 0x7f42d80a5040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009230 tx=0x7f42e40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:09.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.249+0000 7f42eb400640 1 -- 172.21.15.12:0/667510754 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f42e009bc10 con 0x7f42f41047e0 2024-09-05T01:22:09.473 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:22:09 smithi145 podman[64693]: 2024-09-05 01:22:09.092629623 +0000 UTC m=+0.015523465 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:22:09.473 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:22:09 smithi145 podman[64693]: 2024-09-05 01:22:09.195509111 +0000 UTC m=+0.118402945 container create 9eafb72706375af105b87377488d176d052f24b384d773751cfb9c2e6b13a10a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-05T01:22:09.473 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:22:09 smithi145 podman[64693]: 2024-09-05 01:22:09.473188898 +0000 UTC m=+0.396082744 container init 9eafb72706375af105b87377488d176d052f24b384d773751cfb9c2e6b13a10a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-05T01:22:09.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.475+0000 7f42f3e00640 1 -- 172.21.15.12:0/667510754 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42f402d7c0 con 0x7f42f41047e0 2024-09-05T01:22:09.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.475+0000 7f42eb400640 1 -- 172.21.15.12:0/667510754 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6391 (secure 0 0 0) 0x7f42e009ff10 con 0x7f42f41047e0 2024-09-05T01:22:09.477 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:22:09.477 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":8,"btime":"2024-09-05T01:22:07:197387+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24473,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24505,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24517,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-05T01:22:09.477 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 8 2024-09-05T01:22:09.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.478+0000 7f42f3e00640 1 -- 172.21.15.12:0/667510754 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f42d80a2b80 msgr2=0x7f42d80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:09.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.478+0000 7f42f3e00640 1 --2- 172.21.15.12:0/667510754 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f42d80a2b80 0x7f42d80a5040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009230 tx=0x7f42e40058d0 comp rx=0 tx=0).stop 2024-09-05T01:22:09.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.478+0000 7f42f3e00640 1 -- 172.21.15.12:0/667510754 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42f41047e0 msgr2=0x7f42f4076c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:09.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.478+0000 7f42f3e00640 1 --2- 172.21.15.12:0/667510754 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42f41047e0 0x7f42f4076c40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f42e000ea50 tx=0x7f42e000ef10 comp rx=0 tx=0).stop 2024-09-05T01:22:09.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.478+0000 7f42f3e00640 1 -- 172.21.15.12:0/667510754 shutdown_connections 2024-09-05T01:22:09.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.478+0000 7f42f3e00640 1 --2- 172.21.15.12:0/667510754 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f42d80a2b80 0x7f42d80a5040 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:09.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.478+0000 7f42f3e00640 1 --2- 172.21.15.12:0/667510754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42f4108f60 0x7f42f4077180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:09.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.478+0000 7f42f3e00640 1 --2- 172.21.15.12:0/667510754 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f42f41047e0 0x7f42f4076c40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:09.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.478+0000 7f42f3e00640 1 --2- 172.21.15.12:0/667510754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42f4103e30 0x7f42f4076700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:09.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.478+0000 7f42f3e00640 1 -- 172.21.15.12:0/667510754 >> 172.21.15.12:0/667510754 conn(0x7f42f40ff910 msgr2=0x7f42f4100c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:09.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.478+0000 7f42f3e00640 1 -- 172.21.15.12:0/667510754 shutdown_connections 2024-09-05T01:22:09.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:09.478+0000 7f42f3e00640 1 -- 172.21.15.12:0/667510754 wait complete. 2024-09-05T01:22:09.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:09 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/667510754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:22:09.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:09 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/667510754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:22:09.833 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:22:09 smithi145 podman[64693]: 2024-09-05 01:22:09.47604761 +0000 UTC m=+0.398941442 container start 9eafb72706375af105b87377488d176d052f24b384d773751cfb9c2e6b13a10a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True) 2024-09-05T01:22:09.833 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:22:09 smithi145 ceph-mds[64712]: -- 172.21.15.145:0/1645565498 <== mon.2 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c52ab13860 con 0x55c52aaf1400 2024-09-05T01:22:09.834 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:22:09 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: starting mds.h at 2024-09-05T01:22:09.834 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:22:09 smithi145 bash[64693]: 9eafb72706375af105b87377488d176d052f24b384d773751cfb9c2e6b13a10a 2024-09-05T01:22:09.834 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:22:09 smithi145 systemd[1]: Started Ceph mds.h for 0d44cd7e-6b24-11ef-bcd6-c7b262605968. 2024-09-05T01:22:09.853 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:09 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/667510754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:22:10.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:10 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] up:boot 2024-09-05T01:22:10.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:10 smithi012 ceph-mon[29942]: fsmap 8 up:standby 2024-09-05T01:22:10.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:10 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-05T01:22:10.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:10 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:10.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:10 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:10.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:10 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:10.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:10 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:22:10.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:10 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:22:10.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:10 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:10.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:10 smithi012 ceph-mon[29942]: Deploying daemon mds.i on smithi151 2024-09-05T01:22:10.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:10 smithi012 ceph-mon[29942]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:10.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:10 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] up:boot 2024-09-05T01:22:10.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:10 smithi145 ceph-mon[34376]: fsmap 8 up:standby 2024-09-05T01:22:10.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:10 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-05T01:22:10.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:10 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:10.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:10 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:10.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:10 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:10.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:10 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:22:10.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:10 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:22:10.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:10 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:10.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:10 smithi145 ceph-mon[34376]: Deploying daemon mds.i on smithi151 2024-09-05T01:22:10.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:10 smithi145 ceph-mon[34376]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:10.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:10 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] up:boot 2024-09-05T01:22:10.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:10 smithi151 ceph-mon[35013]: fsmap 8 up:standby 2024-09-05T01:22:10.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:10 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-05T01:22:10.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:10 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:10.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:10 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:10.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:10 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:10.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:10 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:22:10.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:10 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:22:10.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:10 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:10.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:10 smithi151 ceph-mon[35013]: Deploying daemon mds.i on smithi151 2024-09-05T01:22:10.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:10 smithi151 ceph-mon[35013]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:11.604 INFO:journalctl@ceph.mds.i.smithi151.stdout:Sep 05 01:22:11 smithi151 systemd[1]: Starting Ceph mds.i for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:22:11.938 INFO:journalctl@ceph.mds.i.smithi151.stdout:Sep 05 01:22:11 smithi151 podman[64879]: 2024-09-05 01:22:11.578353444 +0000 UTC m=+0.016137881 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:22:11.938 INFO:journalctl@ceph.mds.i.smithi151.stdout:Sep 05 01:22:11 smithi151 podman[64879]: 2024-09-05 01:22:11.700852552 +0000 UTC m=+0.138637022 container create 6f3865ede7957b91a562b832176c5766d0b9247f935756ce6ee32be40fb467b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-i, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-05T01:22:11.938 INFO:journalctl@ceph.mds.i.smithi151.stdout:Sep 05 01:22:11 smithi151 podman[64879]: 2024-09-05 01:22:11.911362595 +0000 UTC m=+0.349147019 container init 6f3865ede7957b91a562b832176c5766d0b9247f935756ce6ee32be40fb467b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-i, RELEASE=squid-91c8a7e, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=) 2024-09-05T01:22:11.938 INFO:journalctl@ceph.mds.i.smithi151.stdout:Sep 05 01:22:11 smithi151 podman[64879]: 2024-09-05 01:22:11.914349347 +0000 UTC m=+0.352133781 container start 6f3865ede7957b91a562b832176c5766d0b9247f935756ce6ee32be40fb467b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T01:22:12.158 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:22:12.354 INFO:journalctl@ceph.mds.i.smithi151.stdout:Sep 05 01:22:11 smithi151 ceph-mds[64899]: -- 172.21.15.151:0/3011514424 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556d72185860 con 0x556d72162800 2024-09-05T01:22:12.354 INFO:journalctl@ceph.mds.i.smithi151.stdout:Sep 05 01:22:11 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-i[64895]: starting mds.i at 2024-09-05T01:22:12.354 INFO:journalctl@ceph.mds.i.smithi151.stdout:Sep 05 01:22:12 smithi151 bash[64879]: 6f3865ede7957b91a562b832176c5766d0b9247f935756ce6ee32be40fb467b0 2024-09-05T01:22:12.354 INFO:journalctl@ceph.mds.i.smithi151.stdout:Sep 05 01:22:12 smithi151 systemd[1]: Started Ceph mds.i for 0d44cd7e-6b24-11ef-bcd6-c7b262605968. 2024-09-05T01:22:12.542 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:22:13.267 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:12 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] up:boot 2024-09-05T01:22:13.267 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:12 smithi012 ceph-mon[29942]: fsmap 9 up:standby 2024-09-05T01:22:13.267 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:12 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-05T01:22:13.267 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:12 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:13.267 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:12 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:13.267 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:12 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:13.268 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:12 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:22:13.268 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:12 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:22:13.268 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:12 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:13.268 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:12 smithi012 ceph-mon[29942]: Deploying daemon mds.g on smithi012 2024-09-05T01:22:13.268 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:12 smithi012 ceph-mon[29942]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:12 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] up:boot 2024-09-05T01:22:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:12 smithi145 ceph-mon[34376]: fsmap 9 up:standby 2024-09-05T01:22:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-05T01:22:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:22:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:22:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:12 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:13.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:12 smithi145 ceph-mon[34376]: Deploying daemon mds.g on smithi012 2024-09-05T01:22:13.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:12 smithi145 ceph-mon[34376]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:13.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:12 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] up:boot 2024-09-05T01:22:13.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:12 smithi151 ceph-mon[35013]: fsmap 9 up:standby 2024-09-05T01:22:13.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-05T01:22:13.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:13.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:13.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:13.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:22:13.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:22:13.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:12 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:13.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:12 smithi151 ceph-mon[35013]: Deploying daemon mds.g on smithi012 2024-09-05T01:22:13.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:12 smithi151 ceph-mon[35013]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:14.398 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:14 smithi012 ceph-mon[29942]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:14.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.429+0000 7f677be00640 1 -- 172.21.15.12:0/2117841416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6774109120 msgr2=0x7f6774110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:14.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.429+0000 7f677be00640 1 --2- 172.21.15.12:0/2117841416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6774109120 0x7f6774110ca0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f676c009ca0 tx=0x7f676c02a8c0 comp rx=0 tx=0).stop 2024-09-05T01:22:14.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.429+0000 7f677be00640 1 -- 172.21.15.12:0/2117841416 shutdown_connections 2024-09-05T01:22:14.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.429+0000 7f677be00640 1 --2- 172.21.15.12:0/2117841416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6774109120 0x7f6774110ca0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:14.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.429+0000 7f677be00640 1 --2- 172.21.15.12:0/2117841416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67741049a0 0x7f67741089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:14.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.429+0000 7f677be00640 1 --2- 172.21.15.12:0/2117841416 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6774103ff0 0x7f67741043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:14.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.429+0000 7f677be00640 1 -- 172.21.15.12:0/2117841416 >> 172.21.15.12:0/2117841416 conn(0x7f67740ffa90 msgr2=0x7f6774101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:14.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.430+0000 7f677be00640 1 -- 172.21.15.12:0/2117841416 shutdown_connections 2024-09-05T01:22:14.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.430+0000 7f677be00640 1 -- 172.21.15.12:0/2117841416 wait complete. 2024-09-05T01:22:14.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.430+0000 7f677be00640 1 Processor -- start 2024-09-05T01:22:14.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.431+0000 7f677be00640 1 -- start start 2024-09-05T01:22:14.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.431+0000 7f677be00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6774103ff0 0x7f677419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:14.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.431+0000 7f677be00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67741049a0 0x7f677419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:14.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.431+0000 7f677be00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6774109120 0x7f677419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:14.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.431+0000 7f677be00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6774114180 con 0x7f67741049a0 2024-09-05T01:22:14.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.431+0000 7f677be00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6774114000 con 0x7f6774109120 2024-09-05T01:22:14.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.431+0000 7f677be00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6774114300 con 0x7f6774103ff0 2024-09-05T01:22:14.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.431+0000 7f6778a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67741049a0 0x7f677419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:14.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.431+0000 7f6779400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6774103ff0 0x7f677419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:14.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.431+0000 7f6778a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67741049a0 0x7f677419ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60484/0 (socket says 172.21.15.12:60484) 2024-09-05T01:22:14.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.431+0000 7f6778a00640 1 -- 172.21.15.12:0/4180354815 learned_addr learned my addr 172.21.15.12:0/4180354815 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:22:14.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.431+0000 7f6779e00640 1 --2- 172.21.15.12:0/4180354815 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6774109120 0x7f677419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:14.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.432+0000 7f6779400640 1 -- 172.21.15.12:0/4180354815 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6774109120 msgr2=0x7f677419eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:14.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.432+0000 7f6779400640 1 --2- 172.21.15.12:0/4180354815 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6774109120 0x7f677419eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:14.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.432+0000 7f6779400640 1 -- 172.21.15.12:0/4180354815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67741049a0 msgr2=0x7f677419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:14.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.432+0000 7f6779400640 1 --2- 172.21.15.12:0/4180354815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67741049a0 0x7f677419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:14.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.432+0000 7f6779400640 1 -- 172.21.15.12:0/4180354815 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f677419f5d0 con 0x7f6774103ff0 2024-09-05T01:22:14.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.432+0000 7f6778a00640 1 --2- 172.21.15.12:0/4180354815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67741049a0 0x7f677419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:22:14.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.432+0000 7f6779400640 1 --2- 172.21.15.12:0/4180354815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6774103ff0 0x7f677419a620 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f676800e9f0 tx=0x7f676800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:14.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.432+0000 7f6772000640 1 -- 172.21.15.12:0/4180354815 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676800ccc0 con 0x7f6774103ff0 2024-09-05T01:22:14.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.433+0000 7f677be00640 1 -- 172.21.15.12:0/4180354815 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f677419f8c0 con 0x7f6774103ff0 2024-09-05T01:22:14.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.433+0000 7f6772000640 1 -- 172.21.15.12:0/4180354815 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6768010910 con 0x7f6774103ff0 2024-09-05T01:22:14.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.433+0000 7f6772000640 1 -- 172.21.15.12:0/4180354815 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6768018960 con 0x7f6774103ff0 2024-09-05T01:22:14.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.433+0000 7f677be00640 1 -- 172.21.15.12:0/4180354815 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67741a71a0 con 0x7f6774103ff0 2024-09-05T01:22:14.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.434+0000 7f677be00640 1 -- 172.21.15.12:0/4180354815 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67741043d0 con 0x7f6774103ff0 2024-09-05T01:22:14.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.436+0000 7f6772000640 1 -- 172.21.15.12:0/4180354815 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6768010ac0 con 0x7f6774103ff0 2024-09-05T01:22:14.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.437+0000 7f6772000640 1 --2- 172.21.15.12:0/4180354815 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f675c0a2b80 0x7f675c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:14.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.437+0000 7f6772000640 1 -- 172.21.15.12:0/4180354815 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f67680cf540 con 0x7f6774103ff0 2024-09-05T01:22:14.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.437+0000 7f6778a00640 1 --2- 172.21.15.12:0/4180354815 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f675c0a2b80 0x7f675c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:14.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.438+0000 7f6778a00640 1 --2- 172.21.15.12:0/4180354815 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f675c0a2b80 0x7f675c0a5040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f67600095f0 tx=0x7f6760005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:14.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.439+0000 7f6772000640 1 -- 172.21.15.12:0/4180354815 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f676809c8a0 con 0x7f6774103ff0 2024-09-05T01:22:14.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:14 smithi145 ceph-mon[34376]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:14.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:14 smithi151 ceph-mon[35013]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:14.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.664+0000 7f677be00640 1 -- 172.21.15.12:0/4180354815 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67741a73a0 con 0x7f6774103ff0 2024-09-05T01:22:14.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.666+0000 7f6772000640 1 -- 172.21.15.12:0/4180354815 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8049 (secure 0 0 0) 0x7f676809c1a0 con 0x7f6774103ff0 2024-09-05T01:22:14.671 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:22:14.671 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":10,"btime":"2024-09-05T01:22:11:992978+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24473,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24505,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24517,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24524,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24529,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-05T01:22:14.672 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 10 2024-09-05T01:22:14.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.670+0000 7f677be00640 1 -- 172.21.15.12:0/4180354815 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f675c0a2b80 msgr2=0x7f675c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:14.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.671+0000 7f677be00640 1 --2- 172.21.15.12:0/4180354815 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f675c0a2b80 0x7f675c0a5040 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f67600095f0 tx=0x7f6760005f90 comp rx=0 tx=0).stop 2024-09-05T01:22:14.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.671+0000 7f677be00640 1 -- 172.21.15.12:0/4180354815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6774103ff0 msgr2=0x7f677419a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:14.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.671+0000 7f677be00640 1 --2- 172.21.15.12:0/4180354815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6774103ff0 0x7f677419a620 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f676800e9f0 tx=0x7f676800eeb0 comp rx=0 tx=0).stop 2024-09-05T01:22:14.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.674+0000 7f677be00640 1 -- 172.21.15.12:0/4180354815 shutdown_connections 2024-09-05T01:22:14.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.674+0000 7f677be00640 1 --2- 172.21.15.12:0/4180354815 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f675c0a2b80 0x7f675c0a5040 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:14.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.674+0000 7f677be00640 1 --2- 172.21.15.12:0/4180354815 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6774109120 0x7f677419eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:14.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.674+0000 7f677be00640 1 --2- 172.21.15.12:0/4180354815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67741049a0 0x7f677419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:14.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.674+0000 7f677be00640 1 --2- 172.21.15.12:0/4180354815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6774103ff0 0x7f677419a620 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:14.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.674+0000 7f677be00640 1 -- 172.21.15.12:0/4180354815 >> 172.21.15.12:0/4180354815 conn(0x7f67740ffa90 msgr2=0x7f6774100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:14.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.675+0000 7f677be00640 1 -- 172.21.15.12:0/4180354815 shutdown_connections 2024-09-05T01:22:14.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:14.675+0000 7f677be00640 1 -- 172.21.15.12:0/4180354815 wait complete. 2024-09-05T01:22:14.961 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 05 01:22:14 smithi012 systemd[1]: Starting Ceph mds.g for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:22:15.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:15 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/4180354815' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:22:15.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:15 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/4180354815' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:22:15.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:15 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/4180354815' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:22:15.880 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 05 01:22:15 smithi012 podman[70528]: 2024-09-05 01:22:15.488708676 +0000 UTC m=+0.027843244 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:22:15.880 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 05 01:22:15 smithi012 podman[70528]: 2024-09-05 01:22:15.644273821 +0000 UTC m=+0.183408388 container create a364cf5ba0471318fa5a0bc6b1114b8963cc6b1588b60554ad9ff3634b9c61a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-g, RELEASE=squid-91c8a7e, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-05T01:22:15.881 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 05 01:22:15 smithi012 podman[70528]: 2024-09-05 01:22:15.880251875 +0000 UTC m=+0.419386444 container init a364cf5ba0471318fa5a0bc6b1114b8963cc6b1588b60554ad9ff3634b9c61a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-g, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-05T01:22:16.312 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 05 01:22:15 smithi012 podman[70528]: 2024-09-05 01:22:15.886413594 +0000 UTC m=+0.425548163 container start a364cf5ba0471318fa5a0bc6b1114b8963cc6b1588b60554ad9ff3634b9c61a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-05T01:22:16.312 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 05 01:22:15 smithi012 ceph-mds[70547]: -- 172.21.15.12:0/116707243 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e5a5141c20 con 0x55e5a511e800 2024-09-05T01:22:16.312 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 05 01:22:15 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-g[70543]: starting mds.g at 2024-09-05T01:22:16.312 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 05 01:22:15 smithi012 bash[70528]: a364cf5ba0471318fa5a0bc6b1114b8963cc6b1588b60554ad9ff3634b9c61a2 2024-09-05T01:22:16.312 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 05 01:22:15 smithi012 systemd[1]: Started Ceph mds.g for 0d44cd7e-6b24-11ef-bcd6-c7b262605968. 2024-09-05T01:22:17.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:17 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:17.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:17 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:17.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:17 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:17.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:17 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:22:17.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:17 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:22:17.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:17 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:17.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:17 smithi012 ceph-mon[29942]: Deploying daemon mds.a on smithi012 2024-09-05T01:22:17.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:17 smithi012 ceph-mon[29942]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:17.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:17 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.12:6838/2949711075,v1:172.21.15.12:6839/2949711075] up:boot 2024-09-05T01:22:17.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:17 smithi012 ceph-mon[29942]: fsmap 10 up:standby 2024-09-05T01:22:17.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:17 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-05T01:22:17.325 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:22:17.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:17 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:17.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:17 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:17.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:17 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:17.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:17 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:22:17.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:17 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:22:17.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:17 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:17.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:17 smithi145 ceph-mon[34376]: Deploying daemon mds.a on smithi012 2024-09-05T01:22:17.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:17 smithi145 ceph-mon[34376]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:17.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:17 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.12:6838/2949711075,v1:172.21.15.12:6839/2949711075] up:boot 2024-09-05T01:22:17.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:17 smithi145 ceph-mon[34376]: fsmap 10 up:standby 2024-09-05T01:22:17.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:17 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-05T01:22:17.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:17 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:17.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:17 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:17.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:17 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:17.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:17 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:22:17.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:17 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:22:17.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:17 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:17.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:17 smithi151 ceph-mon[35013]: Deploying daemon mds.a on smithi012 2024-09-05T01:22:17.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:17 smithi151 ceph-mon[35013]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:17.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:17 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.12:6838/2949711075,v1:172.21.15.12:6839/2949711075] up:boot 2024-09-05T01:22:17.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:17 smithi151 ceph-mon[35013]: fsmap 10 up:standby 2024-09-05T01:22:17.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:17 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-05T01:22:17.808 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:22:18.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.414+0000 7f3e8be00640 1 -- 172.21.15.12:0/3597171244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e8c074f40 msgr2=0x7f3e8c10dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:18.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.414+0000 7f3e8be00640 1 --2- 172.21.15.12:0/3597171244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e8c074f40 0x7f3e8c10dcd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3e78009900 tx=0x7f3e7802a480 comp rx=0 tx=0).stop 2024-09-05T01:22:18.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.414+0000 7f3e8be00640 1 -- 172.21.15.12:0/3597171244 shutdown_connections 2024-09-05T01:22:18.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.414+0000 7f3e8be00640 1 --2- 172.21.15.12:0/3597171244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e8c10e210 0x7f3e8c110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:18.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.414+0000 7f3e8be00640 1 --2- 172.21.15.12:0/3597171244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e8c074f40 0x7f3e8c10dcd0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:18.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.414+0000 7f3e8be00640 1 --2- 172.21.15.12:0/3597171244 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e8c074620 0x7f3e8c074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:18.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.414+0000 7f3e8be00640 1 -- 172.21.15.12:0/3597171244 >> 172.21.15.12:0/3597171244 conn(0x7f3e8c0fd710 msgr2=0x7f3e8c0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:18.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.414+0000 7f3e8be00640 1 -- 172.21.15.12:0/3597171244 shutdown_connections 2024-09-05T01:22:18.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.414+0000 7f3e8be00640 1 -- 172.21.15.12:0/3597171244 wait complete. 2024-09-05T01:22:18.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.415+0000 7f3e8be00640 1 Processor -- start 2024-09-05T01:22:18.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.415+0000 7f3e8be00640 1 -- start start 2024-09-05T01:22:18.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.416+0000 7f3e8be00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e8c074620 0x7f3e8c101930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:18.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.416+0000 7f3e8be00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e8c074f40 0x7f3e8c101e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:18.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.416+0000 7f3e8be00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e8c10e210 0x7f3e8c1023b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:18.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.416+0000 7f3e8be00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8c114010 con 0x7f3e8c074f40 2024-09-05T01:22:18.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.416+0000 7f3e8be00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8c113e90 con 0x7f3e8c074620 2024-09-05T01:22:18.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.416+0000 7f3e8be00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8c114190 con 0x7f3e8c10e210 2024-09-05T01:22:18.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.416+0000 7f3e8a000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e8c074f40 0x7f3e8c101e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:18.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.416+0000 7f3e8aa00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e8c074620 0x7f3e8c101930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:18.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.416+0000 7f3e8a000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e8c074f40 0x7f3e8c101e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55942/0 (socket says 172.21.15.12:55942) 2024-09-05T01:22:18.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.416+0000 7f3e8a000640 1 -- 172.21.15.12:0/4085025432 learned_addr learned my addr 172.21.15.12:0/4085025432 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:22:18.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.416+0000 7f3e8b400640 1 --2- 172.21.15.12:0/4085025432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e8c10e210 0x7f3e8c1023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:18.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.417+0000 7f3e8aa00640 1 -- 172.21.15.12:0/4085025432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e8c10e210 msgr2=0x7f3e8c1023b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:18.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.417+0000 7f3e8aa00640 1 --2- 172.21.15.12:0/4085025432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e8c10e210 0x7f3e8c1023b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:18.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.417+0000 7f3e8aa00640 1 -- 172.21.15.12:0/4085025432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e8c074f40 msgr2=0x7f3e8c101e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:18.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.417+0000 7f3e8aa00640 1 --2- 172.21.15.12:0/4085025432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e8c074f40 0x7f3e8c101e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:18.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.417+0000 7f3e8aa00640 1 -- 172.21.15.12:0/4085025432 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e8c1aab70 con 0x7f3e8c074620 2024-09-05T01:22:18.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.417+0000 7f3e8b400640 1 --2- 172.21.15.12:0/4085025432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e8c10e210 0x7f3e8c1023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:22:18.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.417+0000 7f3e8aa00640 1 --2- 172.21.15.12:0/4085025432 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e8c074620 0x7f3e8c101930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c00d980 tx=0x7f3e7c00de40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:18.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.417+0000 7f3e83400640 1 -- 172.21.15.12:0/4085025432 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c009c30 con 0x7f3e8c074620 2024-09-05T01:22:18.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.417+0000 7f3e83400640 1 -- 172.21.15.12:0/4085025432 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e7c009dd0 con 0x7f3e8c074620 2024-09-05T01:22:18.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.417+0000 7f3e8be00640 1 -- 172.21.15.12:0/4085025432 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e8c1aae60 con 0x7f3e8c074620 2024-09-05T01:22:18.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.417+0000 7f3e83400640 1 -- 172.21.15.12:0/4085025432 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c010460 con 0x7f3e8c074620 2024-09-05T01:22:18.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.417+0000 7f3e8be00640 1 -- 172.21.15.12:0/4085025432 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e8c1ab360 con 0x7f3e8c074620 2024-09-05T01:22:18.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.419+0000 7f3e8be00640 1 -- 172.21.15.12:0/4085025432 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e8c075cd0 con 0x7f3e8c074620 2024-09-05T01:22:18.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.420+0000 7f3e83400640 1 -- 172.21.15.12:0/4085025432 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3e7c003ed0 con 0x7f3e8c074620 2024-09-05T01:22:18.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.423+0000 7f3e83400640 1 --2- 172.21.15.12:0/4085025432 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3e700a2c00 0x7f3e700a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:18.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.423+0000 7f3e83400640 1 -- 172.21.15.12:0/4085025432 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f3e7c0ce6a0 con 0x7f3e8c074620 2024-09-05T01:22:18.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.423+0000 7f3e8a000640 1 --2- 172.21.15.12:0/4085025432 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3e700a2c00 0x7f3e700a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:18.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.424+0000 7f3e8a000640 1 --2- 172.21.15.12:0/4085025432 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3e700a2c00 0x7f3e700a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c1030f0 tx=0x7f3e780046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:18.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.426+0000 7f3e83400640 1 -- 172.21.15.12:0/4085025432 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e7c017020 con 0x7f3e8c074620 2024-09-05T01:22:18.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:18 smithi012 ceph-mon[29942]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:18.562 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 05 01:22:18 smithi012 systemd[1]: Starting Ceph mds.a for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:22:18.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:18 smithi145 ceph-mon[34376]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:18.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:18 smithi151 ceph-mon[35013]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:18.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.665+0000 7f3e8be00640 1 -- 172.21.15.12:0/4085025432 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e8c02d7c0 con 0x7f3e8c074620 2024-09-05T01:22:18.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.666+0000 7f3e83400640 1 -- 172.21.15.12:0/4085025432 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8875 (secure 0 0 0) 0x7f3e7c09b3b0 con 0x7f3e8c074620 2024-09-05T01:22:18.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:22:18.667 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":11,"btime":"2024-09-05T01:22:16:250924+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14532,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/2949711075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":2949711075},{"type":"v1","addr":"172.21.15.12:6839","nonce":2949711075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24473,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24505,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24517,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24524,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24529,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-05T01:22:18.667 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 11 2024-09-05T01:22:18.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.668+0000 7f3e8be00640 1 -- 172.21.15.12:0/4085025432 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3e700a2c00 msgr2=0x7f3e700a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:18.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.668+0000 7f3e8be00640 1 --2- 172.21.15.12:0/4085025432 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3e700a2c00 0x7f3e700a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c1030f0 tx=0x7f3e780046c0 comp rx=0 tx=0).stop 2024-09-05T01:22:18.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.668+0000 7f3e8be00640 1 -- 172.21.15.12:0/4085025432 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e8c074620 msgr2=0x7f3e8c101930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:18.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.668+0000 7f3e8be00640 1 --2- 172.21.15.12:0/4085025432 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e8c074620 0x7f3e8c101930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c00d980 tx=0x7f3e7c00de40 comp rx=0 tx=0).stop 2024-09-05T01:22:18.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.668+0000 7f3e8be00640 1 -- 172.21.15.12:0/4085025432 shutdown_connections 2024-09-05T01:22:18.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.668+0000 7f3e8be00640 1 --2- 172.21.15.12:0/4085025432 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3e700a2c00 0x7f3e700a50c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:18.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.668+0000 7f3e8be00640 1 --2- 172.21.15.12:0/4085025432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e8c10e210 0x7f3e8c1023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:18.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.668+0000 7f3e8be00640 1 --2- 172.21.15.12:0/4085025432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e8c074f40 0x7f3e8c101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:18.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.668+0000 7f3e8be00640 1 --2- 172.21.15.12:0/4085025432 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3e8c074620 0x7f3e8c101930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:18.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.668+0000 7f3e8be00640 1 -- 172.21.15.12:0/4085025432 >> 172.21.15.12:0/4085025432 conn(0x7f3e8c0fd710 msgr2=0x7f3e8c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:18.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.668+0000 7f3e8be00640 1 -- 172.21.15.12:0/4085025432 shutdown_connections 2024-09-05T01:22:18.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:18.668+0000 7f3e8be00640 1 -- 172.21.15.12:0/4085025432 wait complete. 2024-09-05T01:22:18.932 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 05 01:22:18 smithi012 podman[70921]: 2024-09-05 01:22:18.681830137 +0000 UTC m=+0.027868978 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:22:18.932 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 05 01:22:18 smithi012 podman[70921]: 2024-09-05 01:22:18.792009114 +0000 UTC m=+0.138047947 container create 438915eed20df073fbd3c4c6e1c242dfc39642cd3f86a5f847944534fd784f83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-a, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e) 2024-09-05T01:22:19.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:19 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/4085025432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:22:19.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:19 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/4085025432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:22:19.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:19 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/4085025432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:22:19.807 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 05 01:22:19 smithi012 podman[70921]: 2024-09-05 01:22:19.682215929 +0000 UTC m=+1.028254763 container init 438915eed20df073fbd3c4c6e1c242dfc39642cd3f86a5f847944534fd784f83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-a, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-91c8a7e, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-05T01:22:19.807 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 05 01:22:19 smithi012 podman[70921]: 2024-09-05 01:22:19.688678364 +0000 UTC m=+1.034717198 container start 438915eed20df073fbd3c4c6e1c242dfc39642cd3f86a5f847944534fd784f83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-05T01:22:19.807 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 05 01:22:19 smithi012 ceph-mds[70956]: -- 172.21.15.12:0/3151767937 <== mon.0 v2:172.21.15.12:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ad5f367860 con 0x55ad5f344800 2024-09-05T01:22:19.807 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 05 01:22:19 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-a[70949]: starting mds.a at 2024-09-05T01:22:20.062 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 05 01:22:19 smithi012 bash[70921]: 438915eed20df073fbd3c4c6e1c242dfc39642cd3f86a5f847944534fd784f83 2024-09-05T01:22:20.062 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 05 01:22:19 smithi012 systemd[1]: Started Ceph mds.a for 0d44cd7e-6b24-11ef-bcd6-c7b262605968. 2024-09-05T01:22:21.219 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:20 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:21.219 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:20 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:21.219 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:20 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:21.219 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:20 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:22:21.219 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:20 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:22:21.220 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:20 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:21.220 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:20 smithi012 ceph-mon[29942]: Deploying daemon mds.b on smithi145 2024-09-05T01:22:21.220 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:20 smithi012 ceph-mon[29942]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:21.220 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:20 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.12:6840/497406458,v1:172.21.15.12:6841/497406458] up:boot 2024-09-05T01:22:21.220 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:20 smithi012 ceph-mon[29942]: fsmap 11 up:standby 2024-09-05T01:22:21.220 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:20 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-05T01:22:21.326 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:20 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:21.327 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:20 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:21.327 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:20 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:21.327 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:20 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:22:21.327 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:20 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:22:21.327 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:20 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:21.327 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:20 smithi145 ceph-mon[34376]: Deploying daemon mds.b on smithi145 2024-09-05T01:22:21.327 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:20 smithi145 ceph-mon[34376]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:21.327 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:20 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.12:6840/497406458,v1:172.21.15.12:6841/497406458] up:boot 2024-09-05T01:22:21.327 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:20 smithi145 ceph-mon[34376]: fsmap 11 up:standby 2024-09-05T01:22:21.327 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:20 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-05T01:22:21.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:20 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:21.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:20 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:21.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:20 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:21.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:20 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-05T01:22:21.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:20 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-05T01:22:21.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:20 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:21.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:20 smithi151 ceph-mon[35013]: Deploying daemon mds.b on smithi145 2024-09-05T01:22:21.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:20 smithi151 ceph-mon[35013]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:21.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:20 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.12:6840/497406458,v1:172.21.15.12:6841/497406458] up:boot 2024-09-05T01:22:21.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:20 smithi151 ceph-mon[35013]: fsmap 11 up:standby 2024-09-05T01:22:21.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:20 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-05T01:22:21.579 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:22:21.966 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:22:22.084 INFO:journalctl@ceph.mds.b.smithi145.stdout:Sep 05 01:22:21 smithi145 systemd[1]: Starting Ceph mds.b for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:22:22.361 INFO:journalctl@ceph.mds.b.smithi145.stdout:Sep 05 01:22:22 smithi145 podman[64994]: 2024-09-05 01:22:21.992551534 +0000 UTC m=+0.016064359 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:22:22.361 INFO:journalctl@ceph.mds.b.smithi145.stdout:Sep 05 01:22:22 smithi145 podman[64994]: 2024-09-05 01:22:22.10714165 +0000 UTC m=+0.130654468 container create 6163f51c3a258a6f7b9988189e7fad8b46c5cffe81f2377cea7a7ff7413514ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-b, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True) 2024-09-05T01:22:22.361 INFO:journalctl@ceph.mds.b.smithi145.stdout:Sep 05 01:22:22 smithi145 podman[64994]: 2024-09-05 01:22:22.334451967 +0000 UTC m=+0.357964782 container init 6163f51c3a258a6f7b9988189e7fad8b46c5cffe81f2377cea7a7ff7413514ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-05T01:22:22.361 INFO:journalctl@ceph.mds.b.smithi145.stdout:Sep 05 01:22:22 smithi145 podman[64994]: 2024-09-05 01:22:22.337306107 +0000 UTC m=+0.360818924 container start 6163f51c3a258a6f7b9988189e7fad8b46c5cffe81f2377cea7a7ff7413514ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-05T01:22:22.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.539+0000 7f76a5200640 1 -- 172.21.15.12:0/2523256459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a00745c0 msgr2=0x7f76a00749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:22.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.539+0000 7f76a5200640 1 --2- 172.21.15.12:0/2523256459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a00745c0 0x7f76a00749a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7690009900 tx=0x7f769002a480 comp rx=0 tx=0).stop 2024-09-05T01:22:22.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.539+0000 7f76a5200640 1 -- 172.21.15.12:0/2523256459 shutdown_connections 2024-09-05T01:22:22.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.539+0000 7f76a5200640 1 --2- 172.21.15.12:0/2523256459 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76a010e430 0x7f76a0110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:22.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.539+0000 7f76a5200640 1 --2- 172.21.15.12:0/2523256459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76a0074ee0 0x7f76a010def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:22.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.539+0000 7f76a5200640 1 --2- 172.21.15.12:0/2523256459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a00745c0 0x7f76a00749a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:22.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.539+0000 7f76a5200640 1 -- 172.21.15.12:0/2523256459 >> 172.21.15.12:0/2523256459 conn(0x7f76a00fd8b0 msgr2=0x7f76a00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:22.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.539+0000 7f76a5200640 1 -- 172.21.15.12:0/2523256459 shutdown_connections 2024-09-05T01:22:22.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.539+0000 7f76a5200640 1 -- 172.21.15.12:0/2523256459 wait complete. 2024-09-05T01:22:22.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.540+0000 7f76a5200640 1 Processor -- start 2024-09-05T01:22:22.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.540+0000 7f76a5200640 1 -- start start 2024-09-05T01:22:22.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.540+0000 7f76a5200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76a00745c0 0x7f76a019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:22.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.541+0000 7f76a5200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76a0074ee0 0x7f76a019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:22.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.541+0000 7f76a5200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a010e430 0x7f76a019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:22.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.541+0000 7f76a5200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f76a01141d0 con 0x7f76a010e430 2024-09-05T01:22:22.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.541+0000 7f76a5200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f76a0114050 con 0x7f76a00745c0 2024-09-05T01:22:22.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.541+0000 7f76a5200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f76a0114350 con 0x7f76a0074ee0 2024-09-05T01:22:22.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.541+0000 7f769e800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a010e430 0x7f76a019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:22.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.541+0000 7f769e800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a010e430 0x7f76a019ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55974/0 (socket says 172.21.15.12:55974) 2024-09-05T01:22:22.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.541+0000 7f769e800640 1 -- 172.21.15.12:0/894593773 learned_addr learned my addr 172.21.15.12:0/894593773 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:22:22.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.541+0000 7f769d400640 1 --2- 172.21.15.12:0/894593773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76a0074ee0 0x7f76a019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:22.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.541+0000 7f769de00640 1 --2- 172.21.15.12:0/894593773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76a00745c0 0x7f76a019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:22.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.541+0000 7f769e800640 1 -- 172.21.15.12:0/894593773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76a0074ee0 msgr2=0x7f76a019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:22.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.541+0000 7f769e800640 1 --2- 172.21.15.12:0/894593773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76a0074ee0 0x7f76a019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:22.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.541+0000 7f769e800640 1 -- 172.21.15.12:0/894593773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76a00745c0 msgr2=0x7f76a019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:22.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.541+0000 7f769e800640 1 --2- 172.21.15.12:0/894593773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76a00745c0 0x7f76a019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:22.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.541+0000 7f769e800640 1 -- 172.21.15.12:0/894593773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a019f5f0 con 0x7f76a010e430 2024-09-05T01:22:22.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.542+0000 7f769de00640 1 --2- 172.21.15.12:0/894593773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76a00745c0 0x7f76a019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:22:22.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.542+0000 7f769e800640 1 --2- 172.21.15.12:0/894593773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a010e430 0x7f76a019ef10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f769800eb40 tx=0x7f769800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:22.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.542+0000 7f7696a00640 1 -- 172.21.15.12:0/894593773 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7698004b20 con 0x7f76a010e430 2024-09-05T01:22:22.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.542+0000 7f7696a00640 1 -- 172.21.15.12:0/894593773 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7698004cc0 con 0x7f76a010e430 2024-09-05T01:22:22.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.542+0000 7f76a5200640 1 -- 172.21.15.12:0/894593773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76a019f8e0 con 0x7f76a010e430 2024-09-05T01:22:22.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.542+0000 7f7696a00640 1 -- 172.21.15.12:0/894593773 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7698010850 con 0x7f76a010e430 2024-09-05T01:22:22.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.542+0000 7f76a5200640 1 -- 172.21.15.12:0/894593773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76a01a71c0 con 0x7f76a010e430 2024-09-05T01:22:22.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.544+0000 7f76a5200640 1 -- 172.21.15.12:0/894593773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76a00749a0 con 0x7f76a010e430 2024-09-05T01:22:22.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.545+0000 7f7696a00640 1 -- 172.21.15.12:0/894593773 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7698005020 con 0x7f76a010e430 2024-09-05T01:22:22.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.547+0000 7f7696a00640 1 --2- 172.21.15.12:0/894593773 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f76840a2c00 0x7f76840a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:22.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.547+0000 7f7696a00640 1 -- 172.21.15.12:0/894593773 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f76980cf340 con 0x7f76a010e430 2024-09-05T01:22:22.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.547+0000 7f769de00640 1 --2- 172.21.15.12:0/894593773 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f76840a2c00 0x7f76840a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:22.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.548+0000 7f769de00640 1 --2- 172.21.15.12:0/894593773 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f76840a2c00 0x7f76840a50c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7690000c00 tx=0x7f7690031510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:22.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.551+0000 7f7696a00640 1 -- 172.21.15.12:0/894593773 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f769809c6a0 con 0x7f76a010e430 2024-09-05T01:22:22.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.824+0000 7f76a5200640 1 -- 172.21.15.12:0/894593773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76a002d7c0 con 0x7f76a010e430 2024-09-05T01:22:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.825+0000 7f7696a00640 1 -- 172.21.15.12:0/894593773 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9698 (secure 0 0 0) 0x7f769809bfa0 con 0x7f76a010e430 2024-09-05T01:22:22.826 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:22:22.826 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":12,"btime":"2024-09-05T01:22:20:253201+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14532,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/2949711075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":2949711075},{"type":"v1","addr":"172.21.15.12:6839","nonce":2949711075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14544,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/497406458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":497406458},{"type":"v1","addr":"172.21.15.12:6841","nonce":497406458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24473,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24505,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24517,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24524,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24529,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-05T01:22:22.827 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 12 2024-09-05T01:22:22.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.827+0000 7f76a5200640 1 -- 172.21.15.12:0/894593773 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f76840a2c00 msgr2=0x7f76840a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:22.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.827+0000 7f76a5200640 1 --2- 172.21.15.12:0/894593773 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f76840a2c00 0x7f76840a50c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7690000c00 tx=0x7f7690031510 comp rx=0 tx=0).stop 2024-09-05T01:22:22.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.827+0000 7f76a5200640 1 -- 172.21.15.12:0/894593773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a010e430 msgr2=0x7f76a019ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:22.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.827+0000 7f76a5200640 1 --2- 172.21.15.12:0/894593773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a010e430 0x7f76a019ef10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f769800eb40 tx=0x7f769800c2d0 comp rx=0 tx=0).stop 2024-09-05T01:22:22.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.827+0000 7f76a5200640 1 -- 172.21.15.12:0/894593773 shutdown_connections 2024-09-05T01:22:22.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.827+0000 7f76a5200640 1 --2- 172.21.15.12:0/894593773 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f76840a2c00 0x7f76840a50c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:22.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.827+0000 7f76a5200640 1 --2- 172.21.15.12:0/894593773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76a010e430 0x7f76a019ef10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:22.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.827+0000 7f76a5200640 1 --2- 172.21.15.12:0/894593773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76a0074ee0 0x7f76a019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:22.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.827+0000 7f76a5200640 1 --2- 172.21.15.12:0/894593773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f76a00745c0 0x7f76a019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:22.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.827+0000 7f76a5200640 1 -- 172.21.15.12:0/894593773 >> 172.21.15.12:0/894593773 conn(0x7f76a00fd8b0 msgr2=0x7f76a00fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:22.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.828+0000 7f76a5200640 1 -- 172.21.15.12:0/894593773 shutdown_connections 2024-09-05T01:22:22.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:22.828+0000 7f76a5200640 1 -- 172.21.15.12:0/894593773 wait complete. 2024-09-05T01:22:22.833 INFO:journalctl@ceph.mds.b.smithi145.stdout:Sep 05 01:22:22 smithi145 ceph-mds[65013]: -- 172.21.15.145:0/1629085402 <== mon.2 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560c0fc2f860 con 0x560c0fc0c800 2024-09-05T01:22:22.833 INFO:journalctl@ceph.mds.b.smithi145.stdout:Sep 05 01:22:22 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-b[65009]: starting mds.b at 2024-09-05T01:22:22.833 INFO:journalctl@ceph.mds.b.smithi145.stdout:Sep 05 01:22:22 smithi145 bash[64994]: 6163f51c3a258a6f7b9988189e7fad8b46c5cffe81f2377cea7a7ff7413514ad 2024-09-05T01:22:22.834 INFO:journalctl@ceph.mds.b.smithi145.stdout:Sep 05 01:22:22 smithi145 systemd[1]: Started Ceph mds.b for 0d44cd7e-6b24-11ef-bcd6-c7b262605968. 2024-09-05T01:22:23.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:22 smithi151 ceph-mon[35013]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:23.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:22 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:23.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:22 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:23.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:22 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:23.105 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:22 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:23.105 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:22 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:23.105 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:22 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:22:23.105 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:22 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/894593773' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:22:23.174 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:22 smithi012 ceph-mon[29942]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:23.174 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:23.174 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:23.174 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:23.174 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:23.174 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:23.174 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:22:23.174 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:22 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/894593773' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:22:23.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:22 smithi145 ceph-mon[34376]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:23.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:22 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:23.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:22 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:23.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:22 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:23.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:22 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:23.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:22 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:23.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:22 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:22:23.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:22 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/894593773' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:22:24.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:23 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] up:boot 2024-09-05T01:22:24.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:23 smithi145 ceph-mon[34376]: fsmap 12 up:standby 2024-09-05T01:22:24.033 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:23 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-05T01:22:24.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:23 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] up:boot 2024-09-05T01:22:24.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:23 smithi012 ceph-mon[29942]: fsmap 12 up:standby 2024-09-05T01:22:24.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:23 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-05T01:22:24.353 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:23 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] up:boot 2024-09-05T01:22:24.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:23 smithi151 ceph-mon[35013]: fsmap 12 up:standby 2024-09-05T01:22:24.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:23 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-05T01:22:25.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:25 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:25.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:25 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:25.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:25 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:25.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:25 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:25.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:25 smithi145 ceph-mon[34376]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:25.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:25 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:25.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:25 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:25.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:25 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:25.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:25 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:22:25.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:25 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:25.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:25 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:25.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:25 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:25.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:25 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:25.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:25 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:25.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:25 smithi151 ceph-mon[35013]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:25.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:25 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:25.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:25 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:25.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:25 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:25.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:25 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:22:25.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:25 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:25.512 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:22:25.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:25 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:25.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:25 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:25.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:25 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:25.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:25 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:25.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:25 smithi012 ceph-mon[29942]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:25.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:25 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:25.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:25 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:25.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:25 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:25.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:25 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:22:25.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:25 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:26.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:26 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:22:26.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:26 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:22:26.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:26 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:22:26.606 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:22:27.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.121+0000 7f8806a00640 1 -- 172.21.15.12:0/2889361530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88001019c0 msgr2=0x7f8800101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:27.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.121+0000 7f8806a00640 1 --2- 172.21.15.12:0/2889361530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88001019c0 0x7f8800101e20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f87ec009930 tx=0x7f87ec02a420 comp rx=0 tx=0).stop 2024-09-05T01:22:27.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.121+0000 7f8806a00640 1 -- 172.21.15.12:0/2889361530 shutdown_connections 2024-09-05T01:22:27.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.121+0000 7f8806a00640 1 --2- 172.21.15.12:0/2889361530 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8800102360 0x7f880010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:27.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.121+0000 7f8806a00640 1 --2- 172.21.15.12:0/2889361530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88001019c0 0x7f8800101e20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:27.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.121+0000 7f8806a00640 1 --2- 172.21.15.12:0/2889361530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88001079c0 0x7f8800107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:27.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.121+0000 7f8806a00640 1 -- 172.21.15.12:0/2889361530 >> 172.21.15.12:0/2889361530 conn(0x7f88000fd740 msgr2=0x7f88000ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:27.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.121+0000 7f8806a00640 1 -- 172.21.15.12:0/2889361530 shutdown_connections 2024-09-05T01:22:27.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.121+0000 7f8806a00640 1 -- 172.21.15.12:0/2889361530 wait complete. 2024-09-05T01:22:27.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.122+0000 7f8806a00640 1 Processor -- start 2024-09-05T01:22:27.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.122+0000 7f8806a00640 1 -- start start 2024-09-05T01:22:27.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.122+0000 7f8806a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88001019c0 0x7f880019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:27.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.122+0000 7f8806a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8800102360 0x7f880019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:27.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.122+0000 7f8806a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88001079c0 0x7f880019eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:27.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.122+0000 7f8806a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8800111dd0 con 0x7f88001079c0 2024-09-05T01:22:27.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.122+0000 7f8806a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8800111c50 con 0x7f8800102360 2024-09-05T01:22:27.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.122+0000 7f8806a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8800111f50 con 0x7f88001019c0 2024-09-05T01:22:27.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.123+0000 7f8804c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8800102360 0x7f880019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:27.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.123+0000 7f8805600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88001019c0 0x7f880019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:27.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.123+0000 7f8804c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8800102360 0x7f880019aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:52652/0 (socket says 172.21.15.12:52652) 2024-09-05T01:22:27.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.123+0000 7f8806000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88001079c0 0x7f880019eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:27.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.123+0000 7f8804c00640 1 -- 172.21.15.12:0/1077877075 learned_addr learned my addr 172.21.15.12:0/1077877075 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:22:27.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.123+0000 7f8805600640 1 -- 172.21.15.12:0/1077877075 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8800102360 msgr2=0x7f880019aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:27.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.123+0000 7f8805600640 1 --2- 172.21.15.12:0/1077877075 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8800102360 0x7f880019aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:27.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.123+0000 7f8805600640 1 -- 172.21.15.12:0/1077877075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88001079c0 msgr2=0x7f880019eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:27.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.123+0000 7f8805600640 1 --2- 172.21.15.12:0/1077877075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88001079c0 0x7f880019eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:27.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.123+0000 7f8805600640 1 -- 172.21.15.12:0/1077877075 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f880019f480 con 0x7f88001019c0 2024-09-05T01:22:27.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.123+0000 7f8805600640 1 --2- 172.21.15.12:0/1077877075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88001019c0 0x7f880019a4d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f87f400e9f0 tx=0x7f87f400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:27.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.124+0000 7f87fe000640 1 -- 172.21.15.12:0/1077877075 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f400cd80 con 0x7f88001019c0 2024-09-05T01:22:27.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.124+0000 7f87fe000640 1 -- 172.21.15.12:0/1077877075 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87f40035f0 con 0x7f88001019c0 2024-09-05T01:22:27.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.124+0000 7f87fe000640 1 -- 172.21.15.12:0/1077877075 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f4010690 con 0x7f88001019c0 2024-09-05T01:22:27.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.124+0000 7f8806a00640 1 -- 172.21.15.12:0/1077877075 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f880019f770 con 0x7f88001019c0 2024-09-05T01:22:27.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.124+0000 7f8806a00640 1 -- 172.21.15.12:0/1077877075 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88001a7050 con 0x7f88001019c0 2024-09-05T01:22:27.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.125+0000 7f8806a00640 1 -- 172.21.15.12:0/1077877075 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8800101e20 con 0x7f88001019c0 2024-09-05T01:22:27.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.126+0000 7f87fe000640 1 -- 172.21.15.12:0/1077877075 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f87f4003b30 con 0x7f88001019c0 2024-09-05T01:22:27.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.128+0000 7f87fe000640 1 --2- 172.21.15.12:0/1077877075 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f87e80a2c00 0x7f87e80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:27.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.128+0000 7f87fe000640 1 -- 172.21.15.12:0/1077877075 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f87f40cee20 con 0x7f88001019c0 2024-09-05T01:22:27.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.128+0000 7f8804c00640 1 --2- 172.21.15.12:0/1077877075 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f87e80a2c00 0x7f87e80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:27.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.129+0000 7f8804c00640 1 --2- 172.21.15.12:0/1077877075 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f87e80a2c00 0x7f87e80a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f87ec005c40 tx=0x7f87ec005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:27.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.131+0000 7f87fe000640 1 -- 172.21.15.12:0/1077877075 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f87f409c180 con 0x7f88001019c0 2024-09-05T01:22:27.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:27 smithi012 ceph-mon[29942]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:27.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:27 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:27.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:27 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:27.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:27 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:27.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:27 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:27.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.377+0000 7f8806a00640 1 -- 172.21.15.12:0/1077877075 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88001a7280 con 0x7f88001019c0 2024-09-05T01:22:27.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.378+0000 7f87fe000640 1 -- 172.21.15.12:0/1077877075 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10527 (secure 0 0 0) 0x7f87f409ba80 con 0x7f88001019c0 2024-09-05T01:22:27.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:22:27.380 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":13,"btime":"2024-09-05T01:22:22:845360+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14532,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/2949711075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":2949711075},{"type":"v1","addr":"172.21.15.12:6839","nonce":2949711075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14544,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6841/497406458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":497406458},{"type":"v1","addr":"172.21.15.12:6841","nonce":497406458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24460,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24461,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24473,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24505,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24517,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24524,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24529,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.145:6839/1706431882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":1706431882},{"type":"v1","addr":"172.21.15.145:6839","nonce":1706431882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-05T01:22:27.380 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 13 2024-09-05T01:22:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.381+0000 7f8806a00640 1 -- 172.21.15.12:0/1077877075 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f87e80a2c00 msgr2=0x7f87e80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.381+0000 7f8806a00640 1 --2- 172.21.15.12:0/1077877075 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f87e80a2c00 0x7f87e80a50c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f87ec005c40 tx=0x7f87ec005b50 comp rx=0 tx=0).stop 2024-09-05T01:22:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.381+0000 7f8806a00640 1 -- 172.21.15.12:0/1077877075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88001019c0 msgr2=0x7f880019a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:27.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.381+0000 7f8806a00640 1 --2- 172.21.15.12:0/1077877075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88001019c0 0x7f880019a4d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f87f400e9f0 tx=0x7f87f400eeb0 comp rx=0 tx=0).stop 2024-09-05T01:22:27.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.381+0000 7f8806a00640 1 -- 172.21.15.12:0/1077877075 shutdown_connections 2024-09-05T01:22:27.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.381+0000 7f8806a00640 1 --2- 172.21.15.12:0/1077877075 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f87e80a2c00 0x7f87e80a50c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:27.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.381+0000 7f8806a00640 1 --2- 172.21.15.12:0/1077877075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88001079c0 0x7f880019eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:27.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.381+0000 7f8806a00640 1 --2- 172.21.15.12:0/1077877075 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8800102360 0x7f880019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:27.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.381+0000 7f8806a00640 1 --2- 172.21.15.12:0/1077877075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88001019c0 0x7f880019a4d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:27.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.381+0000 7f8806a00640 1 -- 172.21.15.12:0/1077877075 >> 172.21.15.12:0/1077877075 conn(0x7f88000fd740 msgr2=0x7f880010d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:27.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.381+0000 7f8806a00640 1 -- 172.21.15.12:0/1077877075 shutdown_connections 2024-09-05T01:22:27.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:27.381+0000 7f8806a00640 1 -- 172.21.15.12:0/1077877075 wait complete. 2024-09-05T01:22:27.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:27 smithi145 ceph-mon[34376]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:27.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:27 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:27.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:27 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:27.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:27 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:27.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:27 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:27.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:27 smithi151 ceph-mon[35013]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:27.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:27 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:27.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:27 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:27.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:27 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:27.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:27 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:28.227 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-05T01:22:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:28 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:28 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/1077877075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:22:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:28 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:28 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:28 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:28 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:22:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:28 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:28.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:28 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:28.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:28 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/1077877075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:22:28.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:28 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:28.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:28 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:28.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:28 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:28.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:28 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:22:28.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:28 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:28.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:28 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:28.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:28 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/1077877075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:22:28.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:28 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:28.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:28 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:28.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:28 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:22:28.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:28 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:22:28.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:28 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:22:28.605 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:22:29.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.062+0000 7fa697c00640 1 -- 172.21.15.12:0/110758207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa690109120 msgr2=0x7fa690110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:29.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.062+0000 7fa697c00640 1 --2- 172.21.15.12:0/110758207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa690109120 0x7fa690110ca0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa688009ca0 tx=0x7fa68802a8c0 comp rx=0 tx=0).stop 2024-09-05T01:22:29.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.062+0000 7fa697c00640 1 -- 172.21.15.12:0/110758207 shutdown_connections 2024-09-05T01:22:29.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.062+0000 7fa697c00640 1 --2- 172.21.15.12:0/110758207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa690109120 0x7fa690110ca0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:29.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.062+0000 7fa697c00640 1 --2- 172.21.15.12:0/110758207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6901049a0 0x7fa6901089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:29.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.062+0000 7fa697c00640 1 --2- 172.21.15.12:0/110758207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa690103ff0 0x7fa6901043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:29.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.062+0000 7fa697c00640 1 -- 172.21.15.12:0/110758207 >> 172.21.15.12:0/110758207 conn(0x7fa6900ffa90 msgr2=0x7fa690101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:29.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.062+0000 7fa697c00640 1 -- 172.21.15.12:0/110758207 shutdown_connections 2024-09-05T01:22:29.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.063+0000 7fa697c00640 1 -- 172.21.15.12:0/110758207 wait complete. 2024-09-05T01:22:29.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.064+0000 7fa697c00640 1 Processor -- start 2024-09-05T01:22:29.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.064+0000 7fa697c00640 1 -- start start 2024-09-05T01:22:29.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.064+0000 7fa697c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa690103ff0 0x7fa69019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:29.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.064+0000 7fa697c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6901049a0 0x7fa69019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:29.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.064+0000 7fa697c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa690109120 0x7fa69019eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:29.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.064+0000 7fa697c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa6901141a0 con 0x7fa690103ff0 2024-09-05T01:22:29.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.064+0000 7fa697c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa690114020 con 0x7fa690109120 2024-09-05T01:22:29.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.064+0000 7fa697c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa690114320 con 0x7fa6901049a0 2024-09-05T01:22:29.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.065+0000 7fa695200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa690103ff0 0x7fa69019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:29.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.065+0000 7fa695200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa690103ff0 0x7fa69019a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49618/0 (socket says 172.21.15.12:49618) 2024-09-05T01:22:29.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.065+0000 7fa695200640 1 -- 172.21.15.12:0/230864534 learned_addr learned my addr 172.21.15.12:0/230864534 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:22:29.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.065+0000 7fa687e00640 1 --2- 172.21.15.12:0/230864534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6901049a0 0x7fa69019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:29.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.065+0000 7fa695c00640 1 --2- 172.21.15.12:0/230864534 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa690109120 0x7fa69019eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:29.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.065+0000 7fa687e00640 1 -- 172.21.15.12:0/230864534 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa690109120 msgr2=0x7fa69019eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:29.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.065+0000 7fa687e00640 1 --2- 172.21.15.12:0/230864534 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa690109120 0x7fa69019eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:29.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.065+0000 7fa687e00640 1 -- 172.21.15.12:0/230864534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa690103ff0 msgr2=0x7fa69019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:29.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.065+0000 7fa687e00640 1 --2- 172.21.15.12:0/230864534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa690103ff0 0x7fa69019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:29.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.065+0000 7fa687e00640 1 -- 172.21.15.12:0/230864534 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69019f590 con 0x7fa6901049a0 2024-09-05T01:22:29.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.065+0000 7fa695200640 1 --2- 172.21.15.12:0/230864534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa690103ff0 0x7fa69019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:22:29.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.066+0000 7fa687e00640 1 --2- 172.21.15.12:0/230864534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6901049a0 0x7fa69019ab20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa67800e9f0 tx=0x7fa67800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:29.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.066+0000 7fa68e000640 1 -- 172.21.15.12:0/230864534 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67800ccc0 con 0x7fa6901049a0 2024-09-05T01:22:29.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.066+0000 7fa697c00640 1 -- 172.21.15.12:0/230864534 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa69019f880 con 0x7fa6901049a0 2024-09-05T01:22:29.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.066+0000 7fa68e000640 1 -- 172.21.15.12:0/230864534 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa678005020 con 0x7fa6901049a0 2024-09-05T01:22:29.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.066+0000 7fa68e000640 1 -- 172.21.15.12:0/230864534 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6780049e0 con 0x7fa6901049a0 2024-09-05T01:22:29.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.066+0000 7fa697c00640 1 -- 172.21.15.12:0/230864534 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6901a7160 con 0x7fa6901049a0 2024-09-05T01:22:29.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.067+0000 7fa697c00640 1 -- 172.21.15.12:0/230864534 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6901043d0 con 0x7fa6901049a0 2024-09-05T01:22:29.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.069+0000 7fa68e000640 1 -- 172.21.15.12:0/230864534 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa678005560 con 0x7fa6901049a0 2024-09-05T01:22:29.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.070+0000 7fa68e000640 1 --2- 172.21.15.12:0/230864534 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa6740a2b80 0x7fa6740a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:29.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.070+0000 7fa68e000640 1 -- 172.21.15.12:0/230864534 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fa6780ceb10 con 0x7fa6901049a0 2024-09-05T01:22:29.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.071+0000 7fa695200640 1 --2- 172.21.15.12:0/230864534 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa6740a2b80 0x7fa6740a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:29.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.071+0000 7fa695200640 1 --2- 172.21.15.12:0/230864534 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa6740a2b80 0x7fa6740a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa680011550 tx=0x7fa680005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:29.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.072+0000 7fa68e000640 1 -- 172.21.15.12:0/230864534 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa6780051d0 con 0x7fa6901049a0 2024-09-05T01:22:29.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.259+0000 7fa697c00640 1 -- 172.21.15.12:0/230864534 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa69019b940 con 0x7fa6901049a0 2024-09-05T01:22:29.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.260+0000 7fa68e000640 1 -- 172.21.15.12:0/230864534 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) ==== 84+0+65 (secure 0 0 0) 0x7fa69019b940 con 0x7fa6901049a0 2024-09-05T01:22:29.261 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:22:29.261 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2024-09-05T01:22:29.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:22:29.261 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2024-09-05T01:22:29.261 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2024-09-05T01:22:29.261 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:22:29.261 INFO:teuthology.orchestra.run.smithi012.stdout:] 2024-09-05T01:22:29.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.262+0000 7fa697c00640 1 -- 172.21.15.12:0/230864534 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa6740a2b80 msgr2=0x7fa6740a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:29.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.262+0000 7fa697c00640 1 --2- 172.21.15.12:0/230864534 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa6740a2b80 0x7fa6740a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa680011550 tx=0x7fa680005f90 comp rx=0 tx=0).stop 2024-09-05T01:22:29.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.262+0000 7fa697c00640 1 -- 172.21.15.12:0/230864534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6901049a0 msgr2=0x7fa69019ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:29.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.262+0000 7fa697c00640 1 --2- 172.21.15.12:0/230864534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6901049a0 0x7fa69019ab20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa67800e9f0 tx=0x7fa67800eeb0 comp rx=0 tx=0).stop 2024-09-05T01:22:29.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.262+0000 7fa697c00640 1 -- 172.21.15.12:0/230864534 shutdown_connections 2024-09-05T01:22:29.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.262+0000 7fa697c00640 1 --2- 172.21.15.12:0/230864534 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa6740a2b80 0x7fa6740a5040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:29.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.262+0000 7fa697c00640 1 --2- 172.21.15.12:0/230864534 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa690109120 0x7fa69019eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:29.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.262+0000 7fa697c00640 1 --2- 172.21.15.12:0/230864534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6901049a0 0x7fa69019ab20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:29.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.262+0000 7fa697c00640 1 --2- 172.21.15.12:0/230864534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa690103ff0 0x7fa69019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:29.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.262+0000 7fa697c00640 1 -- 172.21.15.12:0/230864534 >> 172.21.15.12:0/230864534 conn(0x7fa6900ffa90 msgr2=0x7fa6901005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:29.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.262+0000 7fa697c00640 1 -- 172.21.15.12:0/230864534 shutdown_connections 2024-09-05T01:22:29.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:29.262+0000 7fa697c00640 1 -- 172.21.15.12:0/230864534 wait complete. 2024-09-05T01:22:29.311 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:29 smithi012 ceph-mon[29942]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:29.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:29 smithi145 ceph-mon[34376]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:29.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:29 smithi151 ceph-mon[35013]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:29.923 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-05T01:22:29.923 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-05T01:22:30.301 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:22:30.440 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:30 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/230864534' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-05T01:22:30.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:30 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/230864534' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-05T01:22:30.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:30 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/230864534' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-05T01:22:30.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.813+0000 7fc738a00640 1 -- 172.21.15.12:0/1852051605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc734112a30 msgr2=0x7fc734114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:30.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.813+0000 7fc738a00640 1 --2- 172.21.15.12:0/1852051605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc734112a30 0x7fc734114e20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc72c009ca0 tx=0x7fc72c02a8c0 comp rx=0 tx=0).stop 2024-09-05T01:22:30.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.813+0000 7fc738a00640 1 -- 172.21.15.12:0/1852051605 shutdown_connections 2024-09-05T01:22:30.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.813+0000 7fc738a00640 1 --2- 172.21.15.12:0/1852051605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc734112a30 0x7fc734114e20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:30.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.813+0000 7fc738a00640 1 --2- 172.21.15.12:0/1852051605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc734077040 0x7fc7341124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:30.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.813+0000 7fc738a00640 1 --2- 172.21.15.12:0/1852051605 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc734076720 0x7fc734076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:30.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.813+0000 7fc738a00640 1 -- 172.21.15.12:0/1852051605 >> 172.21.15.12:0/1852051605 conn(0x7fc7340ffa90 msgr2=0x7fc734101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:30.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.813+0000 7fc738a00640 1 -- 172.21.15.12:0/1852051605 shutdown_connections 2024-09-05T01:22:30.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.813+0000 7fc738a00640 1 -- 172.21.15.12:0/1852051605 wait complete. 2024-09-05T01:22:30.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.814+0000 7fc738a00640 1 Processor -- start 2024-09-05T01:22:30.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.814+0000 7fc738a00640 1 -- start start 2024-09-05T01:22:30.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.815+0000 7fc738a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc734076720 0x7fc7341a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:30.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.815+0000 7fc738a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc734077040 0x7fc7341a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:30.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.815+0000 7fc738a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc734112a30 0x7fc73419e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:30.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.815+0000 7fc738a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc7341185c0 con 0x7fc734077040 2024-09-05T01:22:30.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.815+0000 7fc738a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc734118440 con 0x7fc734076720 2024-09-05T01:22:30.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.815+0000 7fc738a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc734118740 con 0x7fc734112a30 2024-09-05T01:22:30.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.815+0000 7fc731400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc734077040 0x7fc7341a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:30.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.815+0000 7fc731400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc734077040 0x7fc7341a4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49636/0 (socket says 172.21.15.12:49636) 2024-09-05T01:22:30.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.815+0000 7fc731400640 1 -- 172.21.15.12:0/2971631137 learned_addr learned my addr 172.21.15.12:0/2971631137 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:22:30.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.815+0000 7fc731e00640 1 --2- 172.21.15.12:0/2971631137 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc734076720 0x7fc7341a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:30.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.815+0000 7fc732800640 1 --2- 172.21.15.12:0/2971631137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc734112a30 0x7fc73419e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:30.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.816+0000 7fc731400640 1 -- 172.21.15.12:0/2971631137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc734112a30 msgr2=0x7fc73419e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:30.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.816+0000 7fc731400640 1 --2- 172.21.15.12:0/2971631137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc734112a30 0x7fc73419e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:30.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.816+0000 7fc731400640 1 -- 172.21.15.12:0/2971631137 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc734076720 msgr2=0x7fc7341a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:30.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.816+0000 7fc731400640 1 --2- 172.21.15.12:0/2971631137 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc734076720 0x7fc7341a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:30.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.816+0000 7fc731400640 1 -- 172.21.15.12:0/2971631137 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc73419efd0 con 0x7fc734077040 2024-09-05T01:22:30.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.816+0000 7fc731400640 1 --2- 172.21.15.12:0/2971631137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc734077040 0x7fc7341a4bf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc72000d950 tx=0x7fc72000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:30.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.816+0000 7fc72aa00640 1 -- 172.21.15.12:0/2971631137 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc720017030 con 0x7fc734077040 2024-09-05T01:22:30.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.816+0000 7fc72aa00640 1 -- 172.21.15.12:0/2971631137 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc720004020 con 0x7fc734077040 2024-09-05T01:22:30.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.816+0000 7fc738a00640 1 -- 172.21.15.12:0/2971631137 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc73419f2c0 con 0x7fc734077040 2024-09-05T01:22:30.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.816+0000 7fc72aa00640 1 -- 172.21.15.12:0/2971631137 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7200047a0 con 0x7fc734077040 2024-09-05T01:22:30.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.816+0000 7fc738a00640 1 -- 172.21.15.12:0/2971631137 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7341ab510 con 0x7fc734077040 2024-09-05T01:22:30.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.818+0000 7fc738a00640 1 -- 172.21.15.12:0/2971631137 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc734077e60 con 0x7fc734077040 2024-09-05T01:22:30.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.819+0000 7fc72aa00640 1 -- 172.21.15.12:0/2971631137 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fc7200041d0 con 0x7fc734077040 2024-09-05T01:22:30.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.823+0000 7fc72aa00640 1 --2- 172.21.15.12:0/2971631137 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc7180a2b80 0x7fc7180a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:30.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.823+0000 7fc72aa00640 1 -- 172.21.15.12:0/2971631137 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fc7200ce530 con 0x7fc734077040 2024-09-05T01:22:30.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.823+0000 7fc731e00640 1 --2- 172.21.15.12:0/2971631137 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc7180a2b80 0x7fc7180a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:30.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.824+0000 7fc731e00640 1 --2- 172.21.15.12:0/2971631137 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc7180a2b80 0x7fc7180a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc72400bbe0 tx=0x7fc72400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:30.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:30.827+0000 7fc72aa00640 1 -- 172.21.15.12:0/2971631137 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc72009b890 con 0x7fc734077040 2024-09-05T01:22:31.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:31.012+0000 7fc738a00640 1 -- 172.21.15.12:0/2971631137 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc7341ab740 con 0x7fc734077040 2024-09-05T01:22:31.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:31.591+0000 7fc72aa00640 1 -- 172.21.15.12:0/2971631137 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) ==== 138+0+0 (secure 0 0 0) 0x7fc72009b190 con 0x7fc734077040 2024-09-05T01:22:31.593 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2024-09-05T01:22:31.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:31.594+0000 7fc738a00640 1 -- 172.21.15.12:0/2971631137 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc7180a2b80 msgr2=0x7fc7180a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:31.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:31.594+0000 7fc738a00640 1 --2- 172.21.15.12:0/2971631137 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc7180a2b80 0x7fc7180a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc72400bbe0 tx=0x7fc72400b390 comp rx=0 tx=0).stop 2024-09-05T01:22:31.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:31.594+0000 7fc738a00640 1 -- 172.21.15.12:0/2971631137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc734077040 msgr2=0x7fc7341a4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:31.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:31.594+0000 7fc738a00640 1 --2- 172.21.15.12:0/2971631137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc734077040 0x7fc7341a4bf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc72000d950 tx=0x7fc72000de10 comp rx=0 tx=0).stop 2024-09-05T01:22:31.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:31.594+0000 7fc738a00640 1 -- 172.21.15.12:0/2971631137 shutdown_connections 2024-09-05T01:22:31.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:31.594+0000 7fc738a00640 1 --2- 172.21.15.12:0/2971631137 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc7180a2b80 0x7fc7180a5040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:31.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:31.594+0000 7fc738a00640 1 --2- 172.21.15.12:0/2971631137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc734112a30 0x7fc73419e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:31.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:31.594+0000 7fc738a00640 1 --2- 172.21.15.12:0/2971631137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc734077040 0x7fc7341a4bf0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:31.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:31.594+0000 7fc738a00640 1 --2- 172.21.15.12:0/2971631137 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc734076720 0x7fc7341a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:31.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:31.594+0000 7fc738a00640 1 -- 172.21.15.12:0/2971631137 >> 172.21.15.12:0/2971631137 conn(0x7fc7340ffa90 msgr2=0x7fc734101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:31.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:31.594+0000 7fc738a00640 1 -- 172.21.15.12:0/2971631137 shutdown_connections 2024-09-05T01:22:31.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:31.594+0000 7fc738a00640 1 -- 172.21.15.12:0/2971631137 wait complete. 2024-09-05T01:22:31.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:31 smithi012 ceph-mon[29942]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:31.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:31 smithi145 ceph-mon[34376]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:31.853 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:31 smithi151 ceph-mon[35013]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:32.331 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-05T01:22:32.716 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:22:32.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:32 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2971631137' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-05T01:22:32.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:32 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2971631137' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-05T01:22:32.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:32 smithi012 ceph-mon[29942]: osdmap e77: 12 total, 12 up, 12 in 2024-09-05T01:22:32.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:32 smithi012 ceph-mon[29942]: pgmap v282: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:32.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:32 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/2971631137' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-05T01:22:32.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:32 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/2971631137' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-05T01:22:32.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:32 smithi145 ceph-mon[34376]: osdmap e77: 12 total, 12 up, 12 in 2024-09-05T01:22:32.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:32 smithi145 ceph-mon[34376]: pgmap v282: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:32.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:32 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/2971631137' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-05T01:22:32.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:32 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/2971631137' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-05T01:22:32.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:32 smithi151 ceph-mon[35013]: osdmap e77: 12 total, 12 up, 12 in 2024-09-05T01:22:32.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:32 smithi151 ceph-mon[35013]: pgmap v282: 33 pgs: 5 creating+peering, 27 unknown, 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:33.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.274+0000 7fd335200640 1 -- 172.21.15.12:0/1952181602 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd330103e30 msgr2=0x7fd330104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:33.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.274+0000 7fd335200640 1 --2- 172.21.15.12:0/1952181602 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd330103e30 0x7fd330104210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd320009900 tx=0x7fd32002a3f0 comp rx=0 tx=0).stop 2024-09-05T01:22:33.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.274+0000 7fd335200640 1 -- 172.21.15.12:0/1952181602 shutdown_connections 2024-09-05T01:22:33.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.274+0000 7fd335200640 1 --2- 172.21.15.12:0/1952181602 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd330108f60 0x7fd330110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:33.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.274+0000 7fd335200640 1 --2- 172.21.15.12:0/1952181602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3301047e0 0x7fd330108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:33.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.274+0000 7fd335200640 1 --2- 172.21.15.12:0/1952181602 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd330103e30 0x7fd330104210 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:33.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.274+0000 7fd335200640 1 -- 172.21.15.12:0/1952181602 >> 172.21.15.12:0/1952181602 conn(0x7fd3300ff910 msgr2=0x7fd330101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:33.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.274+0000 7fd335200640 1 -- 172.21.15.12:0/1952181602 shutdown_connections 2024-09-05T01:22:33.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.274+0000 7fd335200640 1 -- 172.21.15.12:0/1952181602 wait complete. 2024-09-05T01:22:33.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.275+0000 7fd335200640 1 Processor -- start 2024-09-05T01:22:33.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.275+0000 7fd335200640 1 -- start start 2024-09-05T01:22:33.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.275+0000 7fd335200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd330103e30 0x7fd33019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:33.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.276+0000 7fd335200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3301047e0 0x7fd33019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:33.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.276+0000 7fd335200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd330108f60 0x7fd33019ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:33.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.276+0000 7fd335200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd330113fc0 con 0x7fd330108f60 2024-09-05T01:22:33.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.276+0000 7fd335200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd330113e40 con 0x7fd3301047e0 2024-09-05T01:22:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.276+0000 7fd335200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd330114140 con 0x7fd330103e30 2024-09-05T01:22:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.276+0000 7fd32f400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd330103e30 0x7fd33019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.276+0000 7fd32f400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd330103e30 0x7fd33019a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:51874/0 (socket says 172.21.15.12:51874) 2024-09-05T01:22:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.276+0000 7fd32f400640 1 -- 172.21.15.12:0/2256506193 learned_addr learned my addr 172.21.15.12:0/2256506193 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:22:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.276+0000 7fd32fe00640 1 --2- 172.21.15.12:0/2256506193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd330108f60 0x7fd33019ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.276+0000 7fd32ea00640 1 --2- 172.21.15.12:0/2256506193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3301047e0 0x7fd33019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.276+0000 7fd32f400640 1 -- 172.21.15.12:0/2256506193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3301047e0 msgr2=0x7fd33019a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.276+0000 7fd32f400640 1 --2- 172.21.15.12:0/2256506193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3301047e0 0x7fd33019a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.276+0000 7fd32f400640 1 -- 172.21.15.12:0/2256506193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd330108f60 msgr2=0x7fd33019ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.276+0000 7fd32f400640 1 --2- 172.21.15.12:0/2256506193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd330108f60 0x7fd33019ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.276+0000 7fd32f400640 1 -- 172.21.15.12:0/2256506193 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd33019f450 con 0x7fd330103e30 2024-09-05T01:22:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.277+0000 7fd32f400640 1 --2- 172.21.15.12:0/2256506193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd330103e30 0x7fd33019a4a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd320006010 tx=0x7fd320004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.277+0000 7fd327e00640 1 -- 172.21.15.12:0/2256506193 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32003f030 con 0x7fd330103e30 2024-09-05T01:22:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.277+0000 7fd327e00640 1 -- 172.21.15.12:0/2256506193 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd320004440 con 0x7fd330103e30 2024-09-05T01:22:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.277+0000 7fd327e00640 1 -- 172.21.15.12:0/2256506193 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd320035070 con 0x7fd330103e30 2024-09-05T01:22:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.277+0000 7fd335200640 1 -- 172.21.15.12:0/2256506193 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd33019f6e0 con 0x7fd330103e30 2024-09-05T01:22:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.277+0000 7fd335200640 1 -- 172.21.15.12:0/2256506193 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3301a7020 con 0x7fd330103e30 2024-09-05T01:22:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.278+0000 7fd335200640 1 -- 172.21.15.12:0/2256506193 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd330105310 con 0x7fd330103e30 2024-09-05T01:22:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.280+0000 7fd327e00640 1 -- 172.21.15.12:0/2256506193 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd320042030 con 0x7fd330103e30 2024-09-05T01:22:33.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.281+0000 7fd327e00640 1 --2- 172.21.15.12:0/2256506193 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd3140a2c00 0x7fd3140a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:33.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.281+0000 7fd327e00640 1 -- 172.21.15.12:0/2256506193 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7497+0+0 (secure 0 0 0) 0x7fd3200ef080 con 0x7fd330103e30 2024-09-05T01:22:33.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.281+0000 7fd32ea00640 1 --2- 172.21.15.12:0/2256506193 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd3140a2c00 0x7fd3140a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:33.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.282+0000 7fd32ea00640 1 --2- 172.21.15.12:0/2256506193 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd3140a2c00 0x7fd3140a50c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd3300ffda0 tx=0x7fd31c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:33.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.285+0000 7fd327e00640 1 -- 172.21.15.12:0/2256506193 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd3200bbc20 con 0x7fd330103e30 2024-09-05T01:22:33.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:33.470+0000 7fd335200640 1 -- 172.21.15.12:0/2256506193 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd330104210 con 0x7fd330103e30 2024-09-05T01:22:34.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:34.010+0000 7fd327e00640 1 -- 172.21.15.12:0/2256506193 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) ==== 170+0+0 (secure 0 0 0) 0x7fd3200bff20 con 0x7fd330103e30 2024-09-05T01:22:34.011 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2024-09-05T01:22:34.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:34.016+0000 7fd335200640 1 -- 172.21.15.12:0/2256506193 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd3140a2c00 msgr2=0x7fd3140a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:34.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:34.016+0000 7fd335200640 1 --2- 172.21.15.12:0/2256506193 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd3140a2c00 0x7fd3140a50c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd3300ffda0 tx=0x7fd31c005f90 comp rx=0 tx=0).stop 2024-09-05T01:22:34.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:34.016+0000 7fd335200640 1 -- 172.21.15.12:0/2256506193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd330103e30 msgr2=0x7fd33019a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:34.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:34.016+0000 7fd335200640 1 --2- 172.21.15.12:0/2256506193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd330103e30 0x7fd33019a4a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd320006010 tx=0x7fd320004040 comp rx=0 tx=0).stop 2024-09-05T01:22:34.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:34.016+0000 7fd335200640 1 -- 172.21.15.12:0/2256506193 shutdown_connections 2024-09-05T01:22:34.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:34.016+0000 7fd335200640 1 --2- 172.21.15.12:0/2256506193 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd3140a2c00 0x7fd3140a50c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:34.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:34.016+0000 7fd335200640 1 --2- 172.21.15.12:0/2256506193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd330108f60 0x7fd33019ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:34.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:34.016+0000 7fd335200640 1 --2- 172.21.15.12:0/2256506193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd3301047e0 0x7fd33019a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:34.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:34.016+0000 7fd335200640 1 --2- 172.21.15.12:0/2256506193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd330103e30 0x7fd33019a4a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:34.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:34.016+0000 7fd335200640 1 -- 172.21.15.12:0/2256506193 >> 172.21.15.12:0/2256506193 conn(0x7fd3300ff910 msgr2=0x7fd330100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:34.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:34.017+0000 7fd335200640 1 -- 172.21.15.12:0/2256506193 shutdown_connections 2024-09-05T01:22:34.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:34.017+0000 7fd335200640 1 -- 172.21.15.12:0/2256506193 wait complete. 2024-09-05T01:22:34.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:34 smithi012 ceph-mon[29942]: osdmap e78: 12 total, 12 up, 12 in 2024-09-05T01:22:34.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:34 smithi012 ceph-mon[29942]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-05T01:22:34.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:34 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2256506193' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-05T01:22:34.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:34 smithi012 ceph-mon[29942]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-05T01:22:34.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:34 smithi145 ceph-mon[34376]: osdmap e78: 12 total, 12 up, 12 in 2024-09-05T01:22:34.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:34 smithi145 ceph-mon[34376]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-05T01:22:34.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:34 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/2256506193' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-05T01:22:34.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:34 smithi145 ceph-mon[34376]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-05T01:22:34.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:34 smithi151 ceph-mon[35013]: osdmap e78: 12 total, 12 up, 12 in 2024-09-05T01:22:34.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:34 smithi151 ceph-mon[35013]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-05T01:22:34.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:34 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/2256506193' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-05T01:22:34.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:34 smithi151 ceph-mon[35013]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-05T01:22:34.763 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-05T01:22:35.162 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:22:35.301 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:35 smithi012 ceph-mon[29942]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-05T01:22:35.301 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:35 smithi012 ceph-mon[29942]: osdmap e79: 12 total, 12 up, 12 in 2024-09-05T01:22:35.301 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:35 smithi012 ceph-mon[29942]: pgmap v285: 97 pgs: 12 creating+peering, 78 unknown, 7 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:35.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:35 smithi145 ceph-mon[34376]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-05T01:22:35.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:35 smithi145 ceph-mon[34376]: osdmap e79: 12 total, 12 up, 12 in 2024-09-05T01:22:35.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:35 smithi145 ceph-mon[34376]: pgmap v285: 97 pgs: 12 creating+peering, 78 unknown, 7 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:35.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:35 smithi151 ceph-mon[35013]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-05T01:22:35.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:35 smithi151 ceph-mon[35013]: osdmap e79: 12 total, 12 up, 12 in 2024-09-05T01:22:35.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:35 smithi151 ceph-mon[35013]: pgmap v285: 97 pgs: 12 creating+peering, 78 unknown, 7 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:35.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.743+0000 7f8bb7600640 1 -- 172.21.15.12:0/3391463078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bb0102790 msgr2=0x7f8bb01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:35.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.743+0000 7f8bb7600640 1 --2- 172.21.15.12:0/3391463078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bb0102790 0x7f8bb01067e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c009900 tx=0x7f8b9c02a3f0 comp rx=0 tx=0).stop 2024-09-05T01:22:35.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.744+0000 7f8bb7600640 1 -- 172.21.15.12:0/3391463078 shutdown_connections 2024-09-05T01:22:35.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.744+0000 7f8bb7600640 1 --2- 172.21.15.12:0/3391463078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8bb0106f10 0x7f8bb010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:35.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.744+0000 7f8bb7600640 1 --2- 172.21.15.12:0/3391463078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bb0102790 0x7f8bb01067e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:35.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.744+0000 7f8bb7600640 1 --2- 172.21.15.12:0/3391463078 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8bb0101de0 0x7f8bb01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:35.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.744+0000 7f8bb7600640 1 -- 172.21.15.12:0/3391463078 >> 172.21.15.12:0/3391463078 conn(0x7f8bb00fd8c0 msgr2=0x7f8bb00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:35.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.744+0000 7f8bb7600640 1 -- 172.21.15.12:0/3391463078 shutdown_connections 2024-09-05T01:22:35.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.744+0000 7f8bb7600640 1 -- 172.21.15.12:0/3391463078 wait complete. 2024-09-05T01:22:35.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.745+0000 7f8bb7600640 1 Processor -- start 2024-09-05T01:22:35.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.745+0000 7f8bb7600640 1 -- start start 2024-09-05T01:22:35.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.745+0000 7f8bb7600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bb0101de0 0x7f8bb00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:35.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.745+0000 7f8bb7600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8bb0102790 0x7f8bb0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:35.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.745+0000 7f8bb7600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8bb0106f10 0x7f8bb0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:35.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.745+0000 7f8bb7600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb0111fc0 con 0x7f8bb0101de0 2024-09-05T01:22:35.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.745+0000 7f8bb7600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb0111e40 con 0x7f8bb0102790 2024-09-05T01:22:35.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.745+0000 7f8bb7600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb0112140 con 0x7f8bb0106f10 2024-09-05T01:22:35.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.745+0000 7f8bb4c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bb0101de0 0x7f8bb00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:35.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.745+0000 7f8bb4c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bb0101de0 0x7f8bb00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49674/0 (socket says 172.21.15.12:49674) 2024-09-05T01:22:35.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.745+0000 7f8bb4c00640 1 -- 172.21.15.12:0/924855230 learned_addr learned my addr 172.21.15.12:0/924855230 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:22:35.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.746+0000 7f8bb5600640 1 --2- 172.21.15.12:0/924855230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8bb0106f10 0x7f8bb0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:35.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.746+0000 7f8bafe00640 1 --2- 172.21.15.12:0/924855230 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8bb0102790 0x7f8bb0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:35.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.746+0000 7f8bb4c00640 1 -- 172.21.15.12:0/924855230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8bb0106f10 msgr2=0x7f8bb0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:35.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.746+0000 7f8bb4c00640 1 --2- 172.21.15.12:0/924855230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8bb0106f10 0x7f8bb0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:35.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.746+0000 7f8bb4c00640 1 -- 172.21.15.12:0/924855230 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8bb0102790 msgr2=0x7f8bb0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:35.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.746+0000 7f8bb4c00640 1 --2- 172.21.15.12:0/924855230 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8bb0102790 0x7f8bb0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:35.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.746+0000 7f8bb4c00640 1 -- 172.21.15.12:0/924855230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb01a6920 con 0x7f8bb0101de0 2024-09-05T01:22:35.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.746+0000 7f8bb5600640 1 --2- 172.21.15.12:0/924855230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8bb0106f10 0x7f8bb0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:22:35.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.746+0000 7f8bb4c00640 1 --2- 172.21.15.12:0/924855230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bb0101de0 0x7f8bb00744f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400d950 tx=0x7f8ba400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:35.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.747+0000 7f8bad600640 1 -- 172.21.15.12:0/924855230 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4017070 con 0x7f8bb0101de0 2024-09-05T01:22:35.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.747+0000 7f8bb7600640 1 -- 172.21.15.12:0/924855230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb01a6c10 con 0x7f8bb0101de0 2024-09-05T01:22:35.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.747+0000 7f8bad600640 1 -- 172.21.15.12:0/924855230 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ba4009c30 con 0x7f8bb0101de0 2024-09-05T01:22:35.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.747+0000 7f8bad600640 1 -- 172.21.15.12:0/924855230 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba400f6b0 con 0x7f8bb0101de0 2024-09-05T01:22:35.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.747+0000 7f8bb7600640 1 -- 172.21.15.12:0/924855230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb01a7120 con 0x7f8bb0101de0 2024-09-05T01:22:35.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.748+0000 7f8bb7600640 1 -- 172.21.15.12:0/924855230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bb01021c0 con 0x7f8bb0101de0 2024-09-05T01:22:35.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.750+0000 7f8bad600640 1 -- 172.21.15.12:0/924855230 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8ba40109d0 con 0x7f8bb0101de0 2024-09-05T01:22:35.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.751+0000 7f8bad600640 1 --2- 172.21.15.12:0/924855230 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8b980a2b80 0x7f8b980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:35.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.751+0000 7f8bad600640 1 -- 172.21.15.12:0/924855230 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7879+0+0 (secure 0 0 0) 0x7f8ba40ceaa0 con 0x7f8bb0101de0 2024-09-05T01:22:35.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.751+0000 7f8bafe00640 1 --2- 172.21.15.12:0/924855230 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8b980a2b80 0x7f8b980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:35.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.752+0000 7f8bafe00640 1 --2- 172.21.15.12:0/924855230 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8b980a2b80 0x7f8b980a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c000c00 tx=0x7f8b9c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:35.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.754+0000 7f8bad600640 1 -- 172.21.15.12:0/924855230 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8ba4009de0 con 0x7f8bb0101de0 2024-09-05T01:22:35.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:35.977+0000 7f8bb7600640 1 -- 172.21.15.12:0/924855230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8bb0075a20 con 0x7f8bb0101de0 2024-09-05T01:22:36.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:36.023+0000 7f8bad600640 1 -- 172.21.15.12:0/924855230 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f8bb0075a20 con 0x7f8bb0101de0 2024-09-05T01:22:36.024 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 2 and data pool 3 2024-09-05T01:22:36.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:36.027+0000 7f8bb7600640 1 -- 172.21.15.12:0/924855230 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8b980a2b80 msgr2=0x7f8b980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:36.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:36.027+0000 7f8bb7600640 1 --2- 172.21.15.12:0/924855230 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8b980a2b80 0x7f8b980a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c000c00 tx=0x7f8b9c005b50 comp rx=0 tx=0).stop 2024-09-05T01:22:36.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:36.027+0000 7f8bb7600640 1 -- 172.21.15.12:0/924855230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bb0101de0 msgr2=0x7f8bb00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:36.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:36.027+0000 7f8bb7600640 1 --2- 172.21.15.12:0/924855230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bb0101de0 0x7f8bb00744f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400d950 tx=0x7f8ba400de10 comp rx=0 tx=0).stop 2024-09-05T01:22:36.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:36.027+0000 7f8bb7600640 1 -- 172.21.15.12:0/924855230 shutdown_connections 2024-09-05T01:22:36.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:36.027+0000 7f8bb7600640 1 --2- 172.21.15.12:0/924855230 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8b980a2b80 0x7f8b980a5040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:36.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:36.027+0000 7f8bb7600640 1 --2- 172.21.15.12:0/924855230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8bb0106f10 0x7f8bb0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:36.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:36.027+0000 7f8bb7600640 1 --2- 172.21.15.12:0/924855230 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8bb0102790 0x7f8bb0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:36.027+0000 7f8bb7600640 1 --2- 172.21.15.12:0/924855230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bb0101de0 0x7f8bb00744f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:36.027+0000 7f8bb7600640 1 -- 172.21.15.12:0/924855230 >> 172.21.15.12:0/924855230 conn(0x7f8bb00fd8c0 msgr2=0x7f8bb00fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:36.027+0000 7f8bb7600640 1 -- 172.21.15.12:0/924855230 shutdown_connections 2024-09-05T01:22:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:36.027+0000 7f8bb7600640 1 -- 172.21.15.12:0/924855230 wait complete. 2024-09-05T01:22:36.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:36 smithi012 ceph-mon[29942]: osdmap e80: 12 total, 12 up, 12 in 2024-09-05T01:22:36.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:36 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/924855230' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-05T01:22:36.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:36 smithi012 ceph-mon[29942]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-05T01:22:36.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:36 smithi145 ceph-mon[34376]: osdmap e80: 12 total, 12 up, 12 in 2024-09-05T01:22:36.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:36 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/924855230' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-05T01:22:36.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:36 smithi145 ceph-mon[34376]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-05T01:22:36.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:36 smithi151 ceph-mon[35013]: osdmap e80: 12 total, 12 up, 12 in 2024-09-05T01:22:36.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:36 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/924855230' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-05T01:22:36.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:36 smithi151 ceph-mon[35013]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-05T01:22:36.719 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T01:22:37.098 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:22:37.275 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:37 smithi012 ceph-mon[29942]: osdmap e81: 12 total, 12 up, 12 in 2024-09-05T01:22:37.275 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:37 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/924855230' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-05T01:22:37.275 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:37 smithi012 ceph-mon[29942]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-05T01:22:37.275 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:37 smithi012 ceph-mon[29942]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-05T01:22:37.275 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:37 smithi012 ceph-mon[29942]: pgmap v288: 97 pgs: 24 creating+peering, 39 unknown, 34 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:37.276 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:37 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] up:active 2024-09-05T01:22:37.276 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:37 smithi012 ceph-mon[29942]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T01:22:37.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:37 smithi145 ceph-mon[34376]: osdmap e81: 12 total, 12 up, 12 in 2024-09-05T01:22:37.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:37 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/924855230' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-05T01:22:37.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:37 smithi145 ceph-mon[34376]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-05T01:22:37.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:37 smithi145 ceph-mon[34376]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-05T01:22:37.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:37 smithi145 ceph-mon[34376]: pgmap v288: 97 pgs: 24 creating+peering, 39 unknown, 34 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:37.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:37 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] up:active 2024-09-05T01:22:37.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:37 smithi145 ceph-mon[34376]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T01:22:37.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:37 smithi151 ceph-mon[35013]: osdmap e81: 12 total, 12 up, 12 in 2024-09-05T01:22:37.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:37 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/924855230' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-05T01:22:37.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:37 smithi151 ceph-mon[35013]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-05T01:22:37.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:37 smithi151 ceph-mon[35013]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-05T01:22:37.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:37 smithi151 ceph-mon[35013]: pgmap v288: 97 pgs: 24 creating+peering, 39 unknown, 34 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:22:37.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:37 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] up:active 2024-09-05T01:22:37.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:37 smithi151 ceph-mon[35013]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T01:22:37.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.649+0000 7f23ac600640 1 -- 172.21.15.12:0/1664185530 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23a4106f10 msgr2=0x7f23a410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:37.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.649+0000 7f23ac600640 1 --2- 172.21.15.12:0/1664185530 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23a4106f10 0x7f23a410ea90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f239c009be0 tx=0x7f239c02a6c0 comp rx=0 tx=0).stop 2024-09-05T01:22:37.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.649+0000 7f23ac600640 1 -- 172.21.15.12:0/1664185530 shutdown_connections 2024-09-05T01:22:37.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.649+0000 7f23ac600640 1 --2- 172.21.15.12:0/1664185530 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23a4106f10 0x7f23a410ea90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:37.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.649+0000 7f23ac600640 1 --2- 172.21.15.12:0/1664185530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23a4102790 0x7f23a41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:37.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.649+0000 7f23ac600640 1 --2- 172.21.15.12:0/1664185530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23a4101de0 0x7f23a41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:37.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.649+0000 7f23ac600640 1 -- 172.21.15.12:0/1664185530 >> 172.21.15.12:0/1664185530 conn(0x7f23a40fd8c0 msgr2=0x7f23a40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:37.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.649+0000 7f23ac600640 1 -- 172.21.15.12:0/1664185530 shutdown_connections 2024-09-05T01:22:37.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.649+0000 7f23ac600640 1 -- 172.21.15.12:0/1664185530 wait complete. 2024-09-05T01:22:37.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.650+0000 7f23ac600640 1 Processor -- start 2024-09-05T01:22:37.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.650+0000 7f23ac600640 1 -- start start 2024-09-05T01:22:37.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.651+0000 7f23ac600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23a4101de0 0x7f23a419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:37.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.651+0000 7f23ac600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23a4102790 0x7f23a419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:37.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.651+0000 7f23ac600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23a4106f10 0x7f23a419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:37.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.651+0000 7f23ac600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f23a4111f20 con 0x7f23a4102790 2024-09-05T01:22:37.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.651+0000 7f23ac600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f23a4111da0 con 0x7f23a4101de0 2024-09-05T01:22:37.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.651+0000 7f23ac600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f23a41120a0 con 0x7f23a4106f10 2024-09-05T01:22:37.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.651+0000 7f23a9200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23a4102790 0x7f23a419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:37.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.651+0000 7f23a9c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23a4101de0 0x7f23a419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:37.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.651+0000 7f23a9200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23a4102790 0x7f23a419ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56244/0 (socket says 172.21.15.12:56244) 2024-09-05T01:22:37.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.651+0000 7f23a9200640 1 -- 172.21.15.12:0/641506796 learned_addr learned my addr 172.21.15.12:0/641506796 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:22:37.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.651+0000 7f23aa600640 1 --2- 172.21.15.12:0/641506796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23a4106f10 0x7f23a419eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:37.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.652+0000 7f23a9c00640 1 -- 172.21.15.12:0/641506796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23a4106f10 msgr2=0x7f23a419eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:37.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.652+0000 7f23a9c00640 1 --2- 172.21.15.12:0/641506796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23a4106f10 0x7f23a419eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:37.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.652+0000 7f23a9c00640 1 -- 172.21.15.12:0/641506796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23a4102790 msgr2=0x7f23a419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:37.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.652+0000 7f23a9c00640 1 --2- 172.21.15.12:0/641506796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23a4102790 0x7f23a419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:37.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.652+0000 7f23a9c00640 1 -- 172.21.15.12:0/641506796 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a419f590 con 0x7f23a4101de0 2024-09-05T01:22:37.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.652+0000 7f23aa600640 1 --2- 172.21.15.12:0/641506796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23a4106f10 0x7f23a419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:22:37.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.652+0000 7f23a9200640 1 --2- 172.21.15.12:0/641506796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23a4102790 0x7f23a419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:22:37.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.652+0000 7f23a9c00640 1 --2- 172.21.15.12:0/641506796 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23a4101de0 0x7f23a419a5e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2398005fd0 tx=0x7f239800ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:37.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.652+0000 7f23a2000640 1 -- 172.21.15.12:0/641506796 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239800cd00 con 0x7f23a4101de0 2024-09-05T01:22:37.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.652+0000 7f23a2000640 1 -- 172.21.15.12:0/641506796 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23980035f0 con 0x7f23a4101de0 2024-09-05T01:22:37.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.652+0000 7f23a2000640 1 -- 172.21.15.12:0/641506796 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2398010690 con 0x7f23a4101de0 2024-09-05T01:22:37.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.652+0000 7f23ac600640 1 -- 172.21.15.12:0/641506796 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a419f880 con 0x7f23a4101de0 2024-09-05T01:22:37.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.652+0000 7f23ac600640 1 -- 172.21.15.12:0/641506796 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a41a7160 con 0x7f23a4101de0 2024-09-05T01:22:37.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.653+0000 7f23ac600640 1 -- 172.21.15.12:0/641506796 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23a41021c0 con 0x7f23a4101de0 2024-09-05T01:22:37.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.655+0000 7f23a2000640 1 -- 172.21.15.12:0/641506796 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f23980037a0 con 0x7f23a4101de0 2024-09-05T01:22:37.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.657+0000 7f23a2000640 1 --2- 172.21.15.12:0/641506796 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f238c0a2c00 0x7f238c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:37.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.657+0000 7f23a2000640 1 -- 172.21.15.12:0/641506796 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f23980cf210 con 0x7f23a4101de0 2024-09-05T01:22:37.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.657+0000 7f23a9200640 1 --2- 172.21.15.12:0/641506796 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f238c0a2c00 0x7f238c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:37.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.657+0000 7f23a9200640 1 --2- 172.21.15.12:0/641506796 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f238c0a2c00 0x7f238c0a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f23a410eee0 tx=0x7f2390005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:37.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.661+0000 7f23a2000640 1 -- 172.21.15.12:0/641506796 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f239809c220 con 0x7f23a4101de0 2024-09-05T01:22:37.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.848+0000 7f23ac600640 1 -- 172.21.15.12:0/641506796 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23a41a73f0 con 0x7f23a4101de0 2024-09-05T01:22:37.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.850+0000 7f23a2000640 1 -- 172.21.15.12:0/641506796 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22315 (secure 0 0 0) 0x7f239809bb20 con 0x7f23a4101de0 2024-09-05T01:22:37.851 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:22:37.851 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":81,"fsid":"0d44cd7e-6b24-11ef-bcd6-c7b262605968","created":"2024-09-05T01:14:21.162850+0000","modified":"2024-09-05T01:22:35.979069+0000","last_up_change":"2024-09-05T01:21:37.145073+0000","last_in_change":"2024-09-05T01:21:15.076991+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T01:17:44.744065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T01:22:31.540178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T01:22:33.999318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b74ac640-b680-46e2-9106-d24168e685e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6803","nonce":2090563987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6805","nonce":2090563987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6809","nonce":2090563987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6807","nonce":2090563987}]},"public_addr":"172.21.15.12:6803/2090563987","cluster_addr":"172.21.15.12:6805/2090563987","heartbeat_back_addr":"172.21.15.12:6809/2090563987","heartbeat_front_addr":"172.21.15.12:6807/2090563987","state":["exists","up"]},{"osd":1,"uuid":"efca1216-8d85-4e6a-8c49-0afb511ece59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6801","nonce":2639126629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6803","nonce":2639126629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6807","nonce":2639126629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6805","nonce":2639126629}]},"public_addr":"172.21.15.145:6801/2639126629","cluster_addr":"172.21.15.145:6803/2639126629","heartbeat_back_addr":"172.21.15.145:6807/2639126629","heartbeat_front_addr":"172.21.15.145:6805/2639126629","state":["exists","up"]},{"osd":2,"uuid":"4d5699b2-646a-4ab6-94a5-ad223aa27ac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6801","nonce":3753171761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6803","nonce":3753171761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6807","nonce":3753171761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6805","nonce":3753171761}]},"public_addr":"172.21.15.151:6801/3753171761","cluster_addr":"172.21.15.151:6803/3753171761","heartbeat_back_addr":"172.21.15.151:6807/3753171761","heartbeat_front_addr":"172.21.15.151:6805/3753171761","state":["exists","up"]},{"osd":3,"uuid":"275ad2ad-93e6-4a68-8784-8f8dcb620f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6811","nonce":2231650146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6813","nonce":2231650146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6817","nonce":2231650146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6815","nonce":2231650146}]},"public_addr":"172.21.15.12:6811/2231650146","cluster_addr":"172.21.15.12:6813/2231650146","heartbeat_back_addr":"172.21.15.12:6817/2231650146","heartbeat_front_addr":"172.21.15.12:6815/2231650146","state":["exists","up"]},{"osd":4,"uuid":"21a0c5b4-4e0e-4fb6-8be6-a300cb811cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6809","nonce":1828591275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6811","nonce":1828591275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6815","nonce":1828591275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6813","nonce":1828591275}]},"public_addr":"172.21.15.145:6809/1828591275","cluster_addr":"172.21.15.145:6811/1828591275","heartbeat_back_addr":"172.21.15.145:6815/1828591275","heartbeat_front_addr":"172.21.15.145:6813/1828591275","state":["exists","up"]},{"osd":5,"uuid":"e2c7e6fb-5dea-459f-8d7a-7ae5b1936218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6809","nonce":3888870109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6811","nonce":3888870109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6815","nonce":3888870109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6813","nonce":3888870109}]},"public_addr":"172.21.15.151:6809/3888870109","cluster_addr":"172.21.15.151:6811/3888870109","heartbeat_back_addr":"172.21.15.151:6815/3888870109","heartbeat_front_addr":"172.21.15.151:6813/3888870109","state":["exists","up"]},{"osd":6,"uuid":"0df0a29c-3404-4ff5-ae48-78b69b77cbd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6819","nonce":3084810269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6821","nonce":3084810269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6825","nonce":3084810269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6823","nonce":3084810269}]},"public_addr":"172.21.15.12:6819/3084810269","cluster_addr":"172.21.15.12:6821/3084810269","heartbeat_back_addr":"172.21.15.12:6825/3084810269","heartbeat_front_addr":"172.21.15.12:6823/3084810269","state":["exists","up"]},{"osd":7,"uuid":"c7b3ad7c-a566-435c-9ef8-837bb764acb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6817","nonce":3058588721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6819","nonce":3058588721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6823","nonce":3058588721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6821","nonce":3058588721}]},"public_addr":"172.21.15.145:6817/3058588721","cluster_addr":"172.21.15.145:6819/3058588721","heartbeat_back_addr":"172.21.15.145:6823/3058588721","heartbeat_front_addr":"172.21.15.145:6821/3058588721","state":["exists","up"]},{"osd":8,"uuid":"8018a468-fbc5-4667-a53c-2e97c08713bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6817","nonce":905705309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6819","nonce":905705309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6823","nonce":905705309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6821","nonce":905705309}]},"public_addr":"172.21.15.151:6817/905705309","cluster_addr":"172.21.15.151:6819/905705309","heartbeat_back_addr":"172.21.15.151:6823/905705309","heartbeat_front_addr":"172.21.15.151:6821/905705309","state":["exists","up"]},{"osd":9,"uuid":"dcf3b524-c8b8-4ab6-83c6-fc52c776d72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6827","nonce":1193852496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6829","nonce":1193852496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6833","nonce":1193852496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6831","nonce":1193852496}]},"public_addr":"172.21.15.12:6827/1193852496","cluster_addr":"172.21.15.12:6829/1193852496","heartbeat_back_addr":"172.21.15.12:6833/1193852496","heartbeat_front_addr":"172.21.15.12:6831/1193852496","state":["exists","up"]},{"osd":10,"uuid":"7b5b34c3-8814-4d16-80ce-0b0c9be07cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6825","nonce":1296813755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6827","nonce":1296813755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6831","nonce":1296813755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6829","nonce":1296813755}]},"public_addr":"172.21.15.145:6825/1296813755","cluster_addr":"172.21.15.145:6827/1296813755","heartbeat_back_addr":"172.21.15.145:6831/1296813755","heartbeat_front_addr":"172.21.15.145:6829/1296813755","state":["exists","up"]},{"osd":11,"uuid":"157ee32a-43f0-4e5a-8dac-fce53c1efdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6825","nonce":2855185758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6827","nonce":2855185758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6831","nonce":2855185758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6829","nonce":2855185758}]},"public_addr":"172.21.15.151:6825/2855185758","cluster_addr":"172.21.15.151:6827/2855185758","heartbeat_back_addr":"172.21.15.151:6831/2855185758","heartbeat_front_addr":"172.21.15.151:6829/2855185758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:16:52.947222+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:17:17.845611+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:17:41.769521+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:10.848974+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:35.471340+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:59.554980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:19:28.908089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:19:53.540000+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:20:17.764886+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:20:46.835859+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:21:12.186176+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:21:35.863935+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/1132389058":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6801/4067110310":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/1040591124":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/1171838695":"2024-09-06T01:14:54.625209+0000","172.21.15.12:6800/4067110310":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/784506983":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/992405704":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6801/3541208629":"2024-09-06T01:14:54.625209+0000","172.21.15.12:6800/3541208629":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/1532325396":"2024-09-06T01:14:54.625209+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T01:22:37.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.852+0000 7f23ac600640 1 -- 172.21.15.12:0/641506796 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f238c0a2c00 msgr2=0x7f238c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:37.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.852+0000 7f23ac600640 1 --2- 172.21.15.12:0/641506796 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f238c0a2c00 0x7f238c0a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f23a410eee0 tx=0x7f2390005f90 comp rx=0 tx=0).stop 2024-09-05T01:22:37.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.852+0000 7f23ac600640 1 -- 172.21.15.12:0/641506796 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23a4101de0 msgr2=0x7f23a419a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:37.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.852+0000 7f23ac600640 1 --2- 172.21.15.12:0/641506796 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23a4101de0 0x7f23a419a5e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2398005fd0 tx=0x7f239800ee50 comp rx=0 tx=0).stop 2024-09-05T01:22:37.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.852+0000 7f23ac600640 1 -- 172.21.15.12:0/641506796 shutdown_connections 2024-09-05T01:22:37.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.852+0000 7f23ac600640 1 --2- 172.21.15.12:0/641506796 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f238c0a2c00 0x7f238c0a50c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:37.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.852+0000 7f23ac600640 1 --2- 172.21.15.12:0/641506796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23a4106f10 0x7f23a419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:37.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.852+0000 7f23ac600640 1 --2- 172.21.15.12:0/641506796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23a4102790 0x7f23a419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:37.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.852+0000 7f23ac600640 1 --2- 172.21.15.12:0/641506796 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f23a4101de0 0x7f23a419a5e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:37.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.852+0000 7f23ac600640 1 -- 172.21.15.12:0/641506796 >> 172.21.15.12:0/641506796 conn(0x7f23a40fd8c0 msgr2=0x7f23a40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:37.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.852+0000 7f23ac600640 1 -- 172.21.15.12:0/641506796 shutdown_connections 2024-09-05T01:22:37.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:37.853+0000 7f23ac600640 1 -- 172.21.15.12:0/641506796 wait complete. 2024-09-05T01:22:38.198 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:38 smithi012 ceph-mon[29942]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-05T01:22:38.198 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:38 smithi012 ceph-mon[29942]: Cluster is now healthy 2024-09-05T01:22:38.198 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:38 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/641506796' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:22:38.333 INFO:journalctl@ceph.mds.b.smithi145.stdout:Sep 05 01:22:37 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-b[65009]: 2024-09-05T01:22:37.861+0000 7ffa5100f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-05T01:22:38.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:38 smithi145 ceph-mon[34376]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-05T01:22:38.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:38 smithi145 ceph-mon[34376]: Cluster is now healthy 2024-09-05T01:22:38.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:38 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/641506796' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:22:38.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:38 smithi151 ceph-mon[35013]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-05T01:22:38.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:38 smithi151 ceph-mon[35013]: Cluster is now healthy 2024-09-05T01:22:38.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:38 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/641506796' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:22:38.595 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T01:22:38.987 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:22:39.268 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:39 smithi012 ceph-mon[29942]: pgmap v289: 97 pgs: 14 creating+peering, 2 unknown, 81 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 366 B/s wr, 1 op/s 2024-09-05T01:22:39.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:39 smithi145 ceph-mon[34376]: pgmap v289: 97 pgs: 14 creating+peering, 2 unknown, 81 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 366 B/s wr, 1 op/s 2024-09-05T01:22:39.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:39 smithi151 ceph-mon[35013]: pgmap v289: 97 pgs: 14 creating+peering, 2 unknown, 81 active+clean; 577 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 366 B/s wr, 1 op/s 2024-09-05T01:22:39.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.541+0000 7fd765c00640 1 -- 172.21.15.12:0/950102993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd760077040 msgr2=0x7fd7601124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:39.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.541+0000 7fd765c00640 1 --2- 172.21.15.12:0/950102993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd760077040 0x7fd7601124f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd748009900 tx=0x7fd74802a3f0 comp rx=0 tx=0).stop 2024-09-05T01:22:39.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.541+0000 7fd765c00640 1 -- 172.21.15.12:0/950102993 shutdown_connections 2024-09-05T01:22:39.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.541+0000 7fd765c00640 1 --2- 172.21.15.12:0/950102993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd760112a30 0x7fd760114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:39.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.541+0000 7fd765c00640 1 --2- 172.21.15.12:0/950102993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd760077040 0x7fd7601124f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:39.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.541+0000 7fd765c00640 1 --2- 172.21.15.12:0/950102993 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd760076720 0x7fd760076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:39.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.541+0000 7fd765c00640 1 -- 172.21.15.12:0/950102993 >> 172.21.15.12:0/950102993 conn(0x7fd7600ffa90 msgr2=0x7fd760101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:39.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.541+0000 7fd765c00640 1 -- 172.21.15.12:0/950102993 shutdown_connections 2024-09-05T01:22:39.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.541+0000 7fd765c00640 1 -- 172.21.15.12:0/950102993 wait complete. 2024-09-05T01:22:39.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.542+0000 7fd765c00640 1 Processor -- start 2024-09-05T01:22:39.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.542+0000 7fd765c00640 1 -- start start 2024-09-05T01:22:39.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.543+0000 7fd765c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd760076720 0x7fd7601a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:39.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.543+0000 7fd765c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd760077040 0x7fd7601a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:39.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.543+0000 7fd765c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd760112a30 0x7fd76019e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:39.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.543+0000 7fd765c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd760118610 con 0x7fd760076720 2024-09-05T01:22:39.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.543+0000 7fd765c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd760118490 con 0x7fd760112a30 2024-09-05T01:22:39.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.543+0000 7fd765c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd760118790 con 0x7fd760077040 2024-09-05T01:22:39.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.543+0000 7fd75ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd760076720 0x7fd7601a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:39.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.543+0000 7fd757e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd760077040 0x7fd7601a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:39.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.543+0000 7fd75ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd760076720 0x7fd7601a4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56258/0 (socket says 172.21.15.12:56258) 2024-09-05T01:22:39.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.543+0000 7fd75ea00640 1 -- 172.21.15.12:0/1263100875 learned_addr learned my addr 172.21.15.12:0/1263100875 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:22:39.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.543+0000 7fd75f400640 1 --2- 172.21.15.12:0/1263100875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd760112a30 0x7fd76019e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:39.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.544+0000 7fd75ea00640 1 -- 172.21.15.12:0/1263100875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd760077040 msgr2=0x7fd7601a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:39.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.544+0000 7fd75ea00640 1 --2- 172.21.15.12:0/1263100875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd760077040 0x7fd7601a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:39.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.544+0000 7fd75ea00640 1 -- 172.21.15.12:0/1263100875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd760112a30 msgr2=0x7fd76019e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:39.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.544+0000 7fd75ea00640 1 --2- 172.21.15.12:0/1263100875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd760112a30 0x7fd76019e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:39.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.544+0000 7fd75ea00640 1 -- 172.21.15.12:0/1263100875 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76019eff0 con 0x7fd760076720 2024-09-05T01:22:39.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.544+0000 7fd75ea00640 1 --2- 172.21.15.12:0/1263100875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd760076720 0x7fd7601a4700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd75000e9f0 tx=0x7fd75000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:39.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.544+0000 7fd757400640 1 -- 172.21.15.12:0/1263100875 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75000cd80 con 0x7fd760076720 2024-09-05T01:22:39.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.544+0000 7fd765c00640 1 -- 172.21.15.12:0/1263100875 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd76019f2e0 con 0x7fd760076720 2024-09-05T01:22:39.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.544+0000 7fd757400640 1 -- 172.21.15.12:0/1263100875 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd750005500 con 0x7fd760076720 2024-09-05T01:22:39.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.544+0000 7fd757400640 1 -- 172.21.15.12:0/1263100875 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd750010690 con 0x7fd760076720 2024-09-05T01:22:39.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.544+0000 7fd765c00640 1 -- 172.21.15.12:0/1263100875 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7601ab5d0 con 0x7fd760076720 2024-09-05T01:22:39.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.546+0000 7fd765c00640 1 -- 172.21.15.12:0/1263100875 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd760076b00 con 0x7fd760076720 2024-09-05T01:22:39.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.549+0000 7fd757400640 1 -- 172.21.15.12:0/1263100875 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd7500046c0 con 0x7fd760076720 2024-09-05T01:22:39.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.550+0000 7fd757400640 1 --2- 172.21.15.12:0/1263100875 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd7440a2b80 0x7fd7440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:39.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.551+0000 7fd757400640 1 -- 172.21.15.12:0/1263100875 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fd7500cf370 con 0x7fd760076720 2024-09-05T01:22:39.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.551+0000 7fd757e00640 1 --2- 172.21.15.12:0/1263100875 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd7440a2b80 0x7fd7440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:39.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.552+0000 7fd757e00640 1 --2- 172.21.15.12:0/1263100875 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd7440a2b80 0x7fd7440a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd748000c00 tx=0x7fd748005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:39.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.555+0000 7fd757400640 1 -- 172.21.15.12:0/1263100875 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd75009c380 con 0x7fd760076720 2024-09-05T01:22:39.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.744+0000 7fd765c00640 1 -- 172.21.15.12:0/1263100875 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd76019fdf0 con 0x7fd760076720 2024-09-05T01:22:39.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.746+0000 7fd757400640 1 -- 172.21.15.12:0/1263100875 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22315 (secure 0 0 0) 0x7fd75009bc80 con 0x7fd760076720 2024-09-05T01:22:39.747 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:22:39.747 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":81,"fsid":"0d44cd7e-6b24-11ef-bcd6-c7b262605968","created":"2024-09-05T01:14:21.162850+0000","modified":"2024-09-05T01:22:35.979069+0000","last_up_change":"2024-09-05T01:21:37.145073+0000","last_in_change":"2024-09-05T01:21:15.076991+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T01:17:44.744065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T01:22:31.540178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T01:22:33.999318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b74ac640-b680-46e2-9106-d24168e685e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6803","nonce":2090563987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6805","nonce":2090563987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6809","nonce":2090563987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6807","nonce":2090563987}]},"public_addr":"172.21.15.12:6803/2090563987","cluster_addr":"172.21.15.12:6805/2090563987","heartbeat_back_addr":"172.21.15.12:6809/2090563987","heartbeat_front_addr":"172.21.15.12:6807/2090563987","state":["exists","up"]},{"osd":1,"uuid":"efca1216-8d85-4e6a-8c49-0afb511ece59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6801","nonce":2639126629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6803","nonce":2639126629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6807","nonce":2639126629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6805","nonce":2639126629}]},"public_addr":"172.21.15.145:6801/2639126629","cluster_addr":"172.21.15.145:6803/2639126629","heartbeat_back_addr":"172.21.15.145:6807/2639126629","heartbeat_front_addr":"172.21.15.145:6805/2639126629","state":["exists","up"]},{"osd":2,"uuid":"4d5699b2-646a-4ab6-94a5-ad223aa27ac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6801","nonce":3753171761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6803","nonce":3753171761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6807","nonce":3753171761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6805","nonce":3753171761}]},"public_addr":"172.21.15.151:6801/3753171761","cluster_addr":"172.21.15.151:6803/3753171761","heartbeat_back_addr":"172.21.15.151:6807/3753171761","heartbeat_front_addr":"172.21.15.151:6805/3753171761","state":["exists","up"]},{"osd":3,"uuid":"275ad2ad-93e6-4a68-8784-8f8dcb620f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6811","nonce":2231650146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6813","nonce":2231650146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6817","nonce":2231650146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6815","nonce":2231650146}]},"public_addr":"172.21.15.12:6811/2231650146","cluster_addr":"172.21.15.12:6813/2231650146","heartbeat_back_addr":"172.21.15.12:6817/2231650146","heartbeat_front_addr":"172.21.15.12:6815/2231650146","state":["exists","up"]},{"osd":4,"uuid":"21a0c5b4-4e0e-4fb6-8be6-a300cb811cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6809","nonce":1828591275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6811","nonce":1828591275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6815","nonce":1828591275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6813","nonce":1828591275}]},"public_addr":"172.21.15.145:6809/1828591275","cluster_addr":"172.21.15.145:6811/1828591275","heartbeat_back_addr":"172.21.15.145:6815/1828591275","heartbeat_front_addr":"172.21.15.145:6813/1828591275","state":["exists","up"]},{"osd":5,"uuid":"e2c7e6fb-5dea-459f-8d7a-7ae5b1936218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6809","nonce":3888870109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6811","nonce":3888870109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6815","nonce":3888870109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6813","nonce":3888870109}]},"public_addr":"172.21.15.151:6809/3888870109","cluster_addr":"172.21.15.151:6811/3888870109","heartbeat_back_addr":"172.21.15.151:6815/3888870109","heartbeat_front_addr":"172.21.15.151:6813/3888870109","state":["exists","up"]},{"osd":6,"uuid":"0df0a29c-3404-4ff5-ae48-78b69b77cbd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6819","nonce":3084810269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6821","nonce":3084810269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6825","nonce":3084810269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6823","nonce":3084810269}]},"public_addr":"172.21.15.12:6819/3084810269","cluster_addr":"172.21.15.12:6821/3084810269","heartbeat_back_addr":"172.21.15.12:6825/3084810269","heartbeat_front_addr":"172.21.15.12:6823/3084810269","state":["exists","up"]},{"osd":7,"uuid":"c7b3ad7c-a566-435c-9ef8-837bb764acb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6817","nonce":3058588721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6819","nonce":3058588721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6823","nonce":3058588721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6821","nonce":3058588721}]},"public_addr":"172.21.15.145:6817/3058588721","cluster_addr":"172.21.15.145:6819/3058588721","heartbeat_back_addr":"172.21.15.145:6823/3058588721","heartbeat_front_addr":"172.21.15.145:6821/3058588721","state":["exists","up"]},{"osd":8,"uuid":"8018a468-fbc5-4667-a53c-2e97c08713bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6817","nonce":905705309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6819","nonce":905705309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6823","nonce":905705309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6821","nonce":905705309}]},"public_addr":"172.21.15.151:6817/905705309","cluster_addr":"172.21.15.151:6819/905705309","heartbeat_back_addr":"172.21.15.151:6823/905705309","heartbeat_front_addr":"172.21.15.151:6821/905705309","state":["exists","up"]},{"osd":9,"uuid":"dcf3b524-c8b8-4ab6-83c6-fc52c776d72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6827","nonce":1193852496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6829","nonce":1193852496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6833","nonce":1193852496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6831","nonce":1193852496}]},"public_addr":"172.21.15.12:6827/1193852496","cluster_addr":"172.21.15.12:6829/1193852496","heartbeat_back_addr":"172.21.15.12:6833/1193852496","heartbeat_front_addr":"172.21.15.12:6831/1193852496","state":["exists","up"]},{"osd":10,"uuid":"7b5b34c3-8814-4d16-80ce-0b0c9be07cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6825","nonce":1296813755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6827","nonce":1296813755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6831","nonce":1296813755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6829","nonce":1296813755}]},"public_addr":"172.21.15.145:6825/1296813755","cluster_addr":"172.21.15.145:6827/1296813755","heartbeat_back_addr":"172.21.15.145:6831/1296813755","heartbeat_front_addr":"172.21.15.145:6829/1296813755","state":["exists","up"]},{"osd":11,"uuid":"157ee32a-43f0-4e5a-8dac-fce53c1efdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6825","nonce":2855185758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6827","nonce":2855185758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6831","nonce":2855185758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6829","nonce":2855185758}]},"public_addr":"172.21.15.151:6825/2855185758","cluster_addr":"172.21.15.151:6827/2855185758","heartbeat_back_addr":"172.21.15.151:6831/2855185758","heartbeat_front_addr":"172.21.15.151:6829/2855185758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:16:52.947222+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:17:17.845611+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:17:41.769521+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:10.848974+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:35.471340+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:59.554980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:19:28.908089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:19:53.540000+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:20:17.764886+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:20:46.835859+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:21:12.186176+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:21:35.863935+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/1132389058":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6801/4067110310":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/1040591124":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/1171838695":"2024-09-06T01:14:54.625209+0000","172.21.15.12:6800/4067110310":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/784506983":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/992405704":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6801/3541208629":"2024-09-06T01:14:54.625209+0000","172.21.15.12:6800/3541208629":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/1532325396":"2024-09-06T01:14:54.625209+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T01:22:39.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.748+0000 7fd765c00640 1 -- 172.21.15.12:0/1263100875 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd7440a2b80 msgr2=0x7fd7440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:39.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.748+0000 7fd765c00640 1 --2- 172.21.15.12:0/1263100875 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd7440a2b80 0x7fd7440a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd748000c00 tx=0x7fd748005b50 comp rx=0 tx=0).stop 2024-09-05T01:22:39.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.748+0000 7fd765c00640 1 -- 172.21.15.12:0/1263100875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd760076720 msgr2=0x7fd7601a4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:39.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.748+0000 7fd765c00640 1 --2- 172.21.15.12:0/1263100875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd760076720 0x7fd7601a4700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd75000e9f0 tx=0x7fd75000edf0 comp rx=0 tx=0).stop 2024-09-05T01:22:39.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.748+0000 7fd765c00640 1 -- 172.21.15.12:0/1263100875 shutdown_connections 2024-09-05T01:22:39.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.748+0000 7fd765c00640 1 --2- 172.21.15.12:0/1263100875 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd7440a2b80 0x7fd7440a5040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:39.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.748+0000 7fd765c00640 1 --2- 172.21.15.12:0/1263100875 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd760112a30 0x7fd76019e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:39.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.748+0000 7fd765c00640 1 --2- 172.21.15.12:0/1263100875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd760077040 0x7fd7601a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:39.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.748+0000 7fd765c00640 1 --2- 172.21.15.12:0/1263100875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd760076720 0x7fd7601a4700 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:39.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.748+0000 7fd765c00640 1 -- 172.21.15.12:0/1263100875 >> 172.21.15.12:0/1263100875 conn(0x7fd7600ffa90 msgr2=0x7fd760101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:39.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.749+0000 7fd765c00640 1 -- 172.21.15.12:0/1263100875 shutdown_connections 2024-09-05T01:22:39.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:39.749+0000 7fd765c00640 1 -- 172.21.15.12:0/1263100875 wait complete. 2024-09-05T01:22:40.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:40 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/1263100875' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:22:40.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:40 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/1263100875' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:22:40.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:40 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/1263100875' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:22:40.630 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-05T01:22:41.015 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:22:41.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:41 smithi012 ceph-mon[29942]: pgmap v290: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-05T01:22:41.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:41 smithi145 ceph-mon[34376]: pgmap v290: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-05T01:22:41.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:41 smithi151 ceph-mon[35013]: pgmap v290: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-05T01:22:41.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.616+0000 7f845b800640 1 -- 172.21.15.12:0/3378063137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8454106f20 msgr2=0x7f845410eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:41.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.616+0000 7f845b800640 1 --2- 172.21.15.12:0/3378063137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8454106f20 0x7f845410eaa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f844c009ca0 tx=0x7f844c02a8c0 comp rx=0 tx=0).stop 2024-09-05T01:22:41.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.617+0000 7f845b800640 1 -- 172.21.15.12:0/3378063137 shutdown_connections 2024-09-05T01:22:41.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.617+0000 7f845b800640 1 --2- 172.21.15.12:0/3378063137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8454106f20 0x7f845410eaa0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:41.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.617+0000 7f845b800640 1 --2- 172.21.15.12:0/3378063137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84541027a0 0x7f84541067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:41.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.617+0000 7f845b800640 1 --2- 172.21.15.12:0/3378063137 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8454101df0 0x7f84541021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:41.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.617+0000 7f845b800640 1 -- 172.21.15.12:0/3378063137 >> 172.21.15.12:0/3378063137 conn(0x7f84540fd8b0 msgr2=0x7f84540ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:41.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.617+0000 7f845b800640 1 -- 172.21.15.12:0/3378063137 shutdown_connections 2024-09-05T01:22:41.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.617+0000 7f845b800640 1 -- 172.21.15.12:0/3378063137 wait complete. 2024-09-05T01:22:41.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.618+0000 7f845b800640 1 Processor -- start 2024-09-05T01:22:41.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.618+0000 7f845b800640 1 -- start start 2024-09-05T01:22:41.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.619+0000 7f845b800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8454101df0 0x7f845419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:41.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.619+0000 7f845b800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f84541027a0 0x7f845419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:41.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.619+0000 7f845b800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8454106f20 0x7f845419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:41.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.619+0000 7f845b800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8454111fd0 con 0x7f8454106f20 2024-09-05T01:22:41.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.619+0000 7f845b800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8454111e50 con 0x7f84541027a0 2024-09-05T01:22:41.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.619+0000 7f845b800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8454112150 con 0x7f8454101df0 2024-09-05T01:22:41.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.619+0000 7f8458e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8454101df0 0x7f845419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:41.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.619+0000 7f8453e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f84541027a0 0x7f845419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:41.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.619+0000 7f8458e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8454101df0 0x7f845419a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:45658/0 (socket says 172.21.15.12:45658) 2024-09-05T01:22:41.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.619+0000 7f8458e00640 1 -- 172.21.15.12:0/229292618 learned_addr learned my addr 172.21.15.12:0/229292618 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:22:41.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.619+0000 7f8459800640 1 --2- 172.21.15.12:0/229292618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8454106f20 0x7f845419eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:41.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.619+0000 7f8458e00640 1 -- 172.21.15.12:0/229292618 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f84541027a0 msgr2=0x7f845419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:41.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.619+0000 7f8458e00640 1 --2- 172.21.15.12:0/229292618 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f84541027a0 0x7f845419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:41.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.619+0000 7f8458e00640 1 -- 172.21.15.12:0/229292618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8454106f20 msgr2=0x7f845419eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:41.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.619+0000 7f8458e00640 1 --2- 172.21.15.12:0/229292618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8454106f20 0x7f845419eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:41.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.619+0000 7f8458e00640 1 -- 172.21.15.12:0/229292618 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845419f590 con 0x7f8454101df0 2024-09-05T01:22:41.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.620+0000 7f8459800640 1 --2- 172.21.15.12:0/229292618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8454106f20 0x7f845419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:22:41.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.620+0000 7f8458e00640 1 --2- 172.21.15.12:0/229292618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8454101df0 0x7f845419a5e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f844800e9f0 tx=0x7f844800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:41.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.620+0000 7f8451600640 1 -- 172.21.15.12:0/229292618 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844800cd80 con 0x7f8454101df0 2024-09-05T01:22:41.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.620+0000 7f845b800640 1 -- 172.21.15.12:0/229292618 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f845419f880 con 0x7f8454101df0 2024-09-05T01:22:41.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.620+0000 7f8451600640 1 -- 172.21.15.12:0/229292618 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8448010910 con 0x7f8454101df0 2024-09-05T01:22:41.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.620+0000 7f8451600640 1 -- 172.21.15.12:0/229292618 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84480188f0 con 0x7f8454101df0 2024-09-05T01:22:41.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.620+0000 7f845b800640 1 -- 172.21.15.12:0/229292618 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84541a7160 con 0x7f8454101df0 2024-09-05T01:22:41.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.621+0000 7f845b800640 1 -- 172.21.15.12:0/229292618 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84541021d0 con 0x7f8454101df0 2024-09-05T01:22:41.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.623+0000 7f8451600640 1 -- 172.21.15.12:0/229292618 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8448010ac0 con 0x7f8454101df0 2024-09-05T01:22:41.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.625+0000 7f8451600640 1 --2- 172.21.15.12:0/229292618 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f843c0a2b80 0x7f843c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:41.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.625+0000 7f8451600640 1 -- 172.21.15.12:0/229292618 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f84480cf7a0 con 0x7f8454101df0 2024-09-05T01:22:41.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.625+0000 7f8453e00640 1 --2- 172.21.15.12:0/229292618 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f843c0a2b80 0x7f843c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:41.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.626+0000 7f8453e00640 1 --2- 172.21.15.12:0/229292618 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f843c0a2b80 0x7f843c0a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f84540ff610 tx=0x7f8440005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:41.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.627+0000 7f8451600640 1 -- 172.21.15.12:0/229292618 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f844809c7b0 con 0x7f8454101df0 2024-09-05T01:22:41.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:41.854+0000 7f845b800640 1 -- 172.21.15.12:0/229292618 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f845419b940 con 0x7f8454101df0 2024-09-05T01:22:42.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:42.046+0000 7f8451600640 1 -- 172.21.15.12:0/229292618 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f845419b940 con 0x7f8454101df0 2024-09-05T01:22:42.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:42.048+0000 7f845b800640 1 -- 172.21.15.12:0/229292618 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f843c0a2b80 msgr2=0x7f843c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:42.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:42.048+0000 7f845b800640 1 --2- 172.21.15.12:0/229292618 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f843c0a2b80 0x7f843c0a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f84540ff610 tx=0x7f8440005f90 comp rx=0 tx=0).stop 2024-09-05T01:22:42.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:42.048+0000 7f845b800640 1 -- 172.21.15.12:0/229292618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8454101df0 msgr2=0x7f845419a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:42.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:42.048+0000 7f845b800640 1 --2- 172.21.15.12:0/229292618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8454101df0 0x7f845419a5e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f844800e9f0 tx=0x7f844800eeb0 comp rx=0 tx=0).stop 2024-09-05T01:22:42.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:42.049+0000 7f845b800640 1 -- 172.21.15.12:0/229292618 shutdown_connections 2024-09-05T01:22:42.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:42.049+0000 7f845b800640 1 --2- 172.21.15.12:0/229292618 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f843c0a2b80 0x7f843c0a5040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:42.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:42.049+0000 7f845b800640 1 --2- 172.21.15.12:0/229292618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8454106f20 0x7f845419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:42.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:42.049+0000 7f845b800640 1 --2- 172.21.15.12:0/229292618 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f84541027a0 0x7f845419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:42.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:42.049+0000 7f845b800640 1 --2- 172.21.15.12:0/229292618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8454101df0 0x7f845419a5e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:42.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:42.049+0000 7f845b800640 1 -- 172.21.15.12:0/229292618 >> 172.21.15.12:0/229292618 conn(0x7f84540fd8b0 msgr2=0x7f84540fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:42.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:42.049+0000 7f845b800640 1 -- 172.21.15.12:0/229292618 shutdown_connections 2024-09-05T01:22:42.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:42.049+0000 7f845b800640 1 -- 172.21.15.12:0/229292618 wait complete. 2024-09-05T01:22:42.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:42 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/229292618' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-05T01:22:42.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:42 smithi012 ceph-mon[29942]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-05T01:22:42.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:42 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/229292618' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-05T01:22:42.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:42 smithi145 ceph-mon[34376]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-05T01:22:42.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:42 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/229292618' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-05T01:22:42.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:42 smithi151 ceph-mon[35013]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-05T01:22:42.842 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-05T01:22:42.843 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-05T01:22:43.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:43 smithi012 ceph-mon[29942]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-05T01:22:43.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:43 smithi012 ceph-mon[29942]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T01:22:43.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:43 smithi012 ceph-mon[29942]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-05T01:22:43.227 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:22:43.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:43 smithi145 ceph-mon[34376]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-05T01:22:43.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:43 smithi145 ceph-mon[34376]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T01:22:43.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:43 smithi145 ceph-mon[34376]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-05T01:22:43.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:43 smithi151 ceph-mon[35013]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-05T01:22:43.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:43 smithi151 ceph-mon[35013]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T01:22:43.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:43 smithi151 ceph-mon[35013]: pgmap v291: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-05T01:22:43.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.756+0000 7f8e76a00640 1 -- 172.21.15.12:0/2902996493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e70101de0 msgr2=0x7f8e701021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:43.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.756+0000 7f8e76a00640 1 --2- 172.21.15.12:0/2902996493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e70101de0 0x7f8e701021c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009900 tx=0x7f8e6002a3f0 comp rx=0 tx=0).stop 2024-09-05T01:22:43.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.756+0000 7f8e76a00640 1 -- 172.21.15.12:0/2902996493 shutdown_connections 2024-09-05T01:22:43.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.756+0000 7f8e76a00640 1 --2- 172.21.15.12:0/2902996493 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e70106f10 0x7f8e7010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:43.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.756+0000 7f8e76a00640 1 --2- 172.21.15.12:0/2902996493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e70102790 0x7f8e701067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:43.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.756+0000 7f8e76a00640 1 --2- 172.21.15.12:0/2902996493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e70101de0 0x7f8e701021c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:43.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.756+0000 7f8e76a00640 1 -- 172.21.15.12:0/2902996493 >> 172.21.15.12:0/2902996493 conn(0x7f8e700fd8c0 msgr2=0x7f8e700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:43.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.756+0000 7f8e76a00640 1 -- 172.21.15.12:0/2902996493 shutdown_connections 2024-09-05T01:22:43.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.756+0000 7f8e76a00640 1 -- 172.21.15.12:0/2902996493 wait complete. 2024-09-05T01:22:43.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.757+0000 7f8e76a00640 1 Processor -- start 2024-09-05T01:22:43.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.757+0000 7f8e76a00640 1 -- start start 2024-09-05T01:22:43.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.758+0000 7f8e76a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e70101de0 0x7f8e70198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:43.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.758+0000 7f8e76a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e70102790 0x7f8e70198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:43.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.758+0000 7f8e76a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e70106f10 0x7f8e7019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:43.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.758+0000 7f8e76a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8e70111fc0 con 0x7f8e70101de0 2024-09-05T01:22:43.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.758+0000 7f8e76a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8e70111e40 con 0x7f8e70106f10 2024-09-05T01:22:43.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.758+0000 7f8e76a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8e70112140 con 0x7f8e70102790 2024-09-05T01:22:43.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.758+0000 7f8e6fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e70101de0 0x7f8e70198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:43.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.758+0000 7f8e6fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e70101de0 0x7f8e70198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56288/0 (socket says 172.21.15.12:56288) 2024-09-05T01:22:43.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.758+0000 7f8e6fe00640 1 -- 172.21.15.12:0/2565220614 learned_addr learned my addr 172.21.15.12:0/2565220614 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:22:43.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.758+0000 7f8e6f400640 1 --2- 172.21.15.12:0/2565220614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e70102790 0x7f8e70198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:43.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.758+0000 7f8e74a00640 1 --2- 172.21.15.12:0/2565220614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e70106f10 0x7f8e7019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:43.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.759+0000 7f8e6fe00640 1 -- 172.21.15.12:0/2565220614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e70102790 msgr2=0x7f8e70198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:43.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.759+0000 7f8e6fe00640 1 --2- 172.21.15.12:0/2565220614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e70102790 0x7f8e70198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:43.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.759+0000 7f8e6fe00640 1 -- 172.21.15.12:0/2565220614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e70106f10 msgr2=0x7f8e7019ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:43.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.759+0000 7f8e6fe00640 1 --2- 172.21.15.12:0/2565220614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e70106f10 0x7f8e7019ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:43.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.759+0000 7f8e6fe00640 1 -- 172.21.15.12:0/2565220614 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e7019d3d0 con 0x7f8e70101de0 2024-09-05T01:22:43.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.759+0000 7f8e6fe00640 1 --2- 172.21.15.12:0/2565220614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e70101de0 0x7f8e70198420 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8e60004770 tx=0x7f8e60003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:43.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.759+0000 7f8e6cc00640 1 -- 172.21.15.12:0/2565220614 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6003f070 con 0x7f8e70101de0 2024-09-05T01:22:43.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.759+0000 7f8e6cc00640 1 -- 172.21.15.12:0/2565220614 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e60031ca0 con 0x7f8e70101de0 2024-09-05T01:22:43.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.759+0000 7f8e76a00640 1 -- 172.21.15.12:0/2565220614 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e7019d660 con 0x7f8e70101de0 2024-09-05T01:22:43.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.759+0000 7f8e6cc00640 1 -- 172.21.15.12:0/2565220614 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e60035030 con 0x7f8e70101de0 2024-09-05T01:22:43.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.759+0000 7f8e76a00640 1 -- 172.21.15.12:0/2565220614 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e701a4fa0 con 0x7f8e70101de0 2024-09-05T01:22:43.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.761+0000 7f8e76a00640 1 -- 172.21.15.12:0/2565220614 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e701032c0 con 0x7f8e70101de0 2024-09-05T01:22:43.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.763+0000 7f8e6cc00640 1 -- 172.21.15.12:0/2565220614 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8e60042070 con 0x7f8e70101de0 2024-09-05T01:22:43.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.764+0000 7f8e6cc00640 1 --2- 172.21.15.12:0/2565220614 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8e540a2b80 0x7f8e540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:43.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.764+0000 7f8e6cc00640 1 -- 172.21.15.12:0/2565220614 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f8e600ef720 con 0x7f8e70101de0 2024-09-05T01:22:43.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.764+0000 7f8e6f400640 1 --2- 172.21.15.12:0/2565220614 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8e540a2b80 0x7f8e540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:43.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.765+0000 7f8e6f400640 1 --2- 172.21.15.12:0/2565220614 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8e540a2b80 0x7f8e540a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8e700fdce0 tx=0x7f8e5c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:43.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.768+0000 7f8e6cc00640 1 -- 172.21.15.12:0/2565220614 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8e600bc0e0 con 0x7f8e70101de0 2024-09-05T01:22:43.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:43.993+0000 7f8e76a00640 1 -- 172.21.15.12:0/2565220614 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f8e7010a0f0 con 0x7f8e70101de0 2024-09-05T01:22:44.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:44.060+0000 7f8e6cc00640 1 -- 172.21.15.12:0/2565220614 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v17) ==== 105+0+0 (secure 0 0 0) 0x7f8e600c03e0 con 0x7f8e70101de0 2024-09-05T01:22:44.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:44.062+0000 7f8e76a00640 1 -- 172.21.15.12:0/2565220614 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8e540a2b80 msgr2=0x7f8e540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:44.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:44.062+0000 7f8e76a00640 1 --2- 172.21.15.12:0/2565220614 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8e540a2b80 0x7f8e540a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8e700fdce0 tx=0x7f8e5c00b410 comp rx=0 tx=0).stop 2024-09-05T01:22:44.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:44.062+0000 7f8e76a00640 1 -- 172.21.15.12:0/2565220614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e70101de0 msgr2=0x7f8e70198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:44.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:44.062+0000 7f8e76a00640 1 --2- 172.21.15.12:0/2565220614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e70101de0 0x7f8e70198420 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8e60004770 tx=0x7f8e60003c10 comp rx=0 tx=0).stop 2024-09-05T01:22:44.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:44.062+0000 7f8e76a00640 1 -- 172.21.15.12:0/2565220614 shutdown_connections 2024-09-05T01:22:44.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:44.062+0000 7f8e76a00640 1 --2- 172.21.15.12:0/2565220614 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8e540a2b80 0x7f8e540a5040 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:44.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:44.062+0000 7f8e76a00640 1 --2- 172.21.15.12:0/2565220614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e70106f10 0x7f8e7019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:44.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:44.062+0000 7f8e76a00640 1 --2- 172.21.15.12:0/2565220614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e70102790 0x7f8e70198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:44.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:44.062+0000 7f8e76a00640 1 --2- 172.21.15.12:0/2565220614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e70101de0 0x7f8e70198420 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:44.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:44.062+0000 7f8e76a00640 1 -- 172.21.15.12:0/2565220614 >> 172.21.15.12:0/2565220614 conn(0x7f8e700fd8c0 msgr2=0x7f8e700fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:44.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:44.063+0000 7f8e76a00640 1 -- 172.21.15.12:0/2565220614 shutdown_connections 2024-09-05T01:22:44.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:44.063+0000 7f8e76a00640 1 -- 172.21.15.12:0/2565220614 wait complete. 2024-09-05T01:22:44.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:44 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2565220614' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-05T01:22:44.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:44 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/2565220614' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-05T01:22:44.353 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:44 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/2565220614' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-05T01:22:44.792 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-05T01:22:45.175 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:22:45.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:45 smithi012 ceph-mon[29942]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-05T01:22:45.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:45 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2565220614' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-05T01:22:45.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:45 smithi012 ceph-mon[29942]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-05T01:22:45.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:45 smithi012 ceph-mon[29942]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T01:22:45.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:45 smithi012 ceph-mon[29942]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-05T01:22:45.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:45 smithi012 ceph-mon[29942]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-05T01:22:45.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:45 smithi012 ceph-mon[29942]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-05T01:22:45.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:45 smithi145 ceph-mon[34376]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-05T01:22:45.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:45 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/2565220614' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-05T01:22:45.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:45 smithi145 ceph-mon[34376]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-05T01:22:45.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:45 smithi145 ceph-mon[34376]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T01:22:45.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:45 smithi145 ceph-mon[34376]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-05T01:22:45.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:45 smithi145 ceph-mon[34376]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-05T01:22:45.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:45 smithi145 ceph-mon[34376]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-05T01:22:45.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:45 smithi151 ceph-mon[35013]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-05T01:22:45.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:45 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/2565220614' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-05T01:22:45.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:45 smithi151 ceph-mon[35013]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-05T01:22:45.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:45 smithi151 ceph-mon[35013]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-05T01:22:45.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:45 smithi151 ceph-mon[35013]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-05T01:22:45.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:45 smithi151 ceph-mon[35013]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-05T01:22:45.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:45 smithi151 ceph-mon[35013]: pgmap v292: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-05T01:22:45.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.740+0000 7f2a4de00640 1 -- 172.21.15.12:0/2582860684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a4810e3c0 msgr2=0x7f2a48110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:45.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.740+0000 7f2a4de00640 1 --2- 172.21.15.12:0/2582860684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a4810e3c0 0x7f2a48110810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009ca0 tx=0x7f2a4002a950 comp rx=0 tx=0).stop 2024-09-05T01:22:45.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.741+0000 7f2a4de00640 1 -- 172.21.15.12:0/2582860684 shutdown_connections 2024-09-05T01:22:45.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.741+0000 7f2a4de00640 1 --2- 172.21.15.12:0/2582860684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a4810e3c0 0x7f2a48110810 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:45.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.741+0000 7f2a4de00640 1 --2- 172.21.15.12:0/2582860684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a48074f40 0x7f2a4810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:45.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.741+0000 7f2a4de00640 1 --2- 172.21.15.12:0/2582860684 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a48074620 0x7f2a48074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:45.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.741+0000 7f2a4de00640 1 -- 172.21.15.12:0/2582860684 >> 172.21.15.12:0/2582860684 conn(0x7f2a480fd8c0 msgr2=0x7f2a480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:45.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.741+0000 7f2a4de00640 1 -- 172.21.15.12:0/2582860684 shutdown_connections 2024-09-05T01:22:45.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.741+0000 7f2a4de00640 1 -- 172.21.15.12:0/2582860684 wait complete. 2024-09-05T01:22:45.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.742+0000 7f2a4de00640 1 Processor -- start 2024-09-05T01:22:45.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.742+0000 7f2a4de00640 1 -- start start 2024-09-05T01:22:45.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.742+0000 7f2a4de00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a48074620 0x7f2a4819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:45.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.742+0000 7f2a4de00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a48074f40 0x7f2a4819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:45.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.742+0000 7f2a4de00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a4810e3c0 0x7f2a4819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:45.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.742+0000 7f2a4de00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2a481141a0 con 0x7f2a4810e3c0 2024-09-05T01:22:45.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.742+0000 7f2a4de00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2a48114020 con 0x7f2a48074620 2024-09-05T01:22:45.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.742+0000 7f2a4de00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2a48114320 con 0x7f2a48074f40 2024-09-05T01:22:45.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.743+0000 7f2a47400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a4810e3c0 0x7f2a4819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:45.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.743+0000 7f2a47400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a4810e3c0 0x7f2a4819eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56308/0 (socket says 172.21.15.12:56308) 2024-09-05T01:22:45.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.743+0000 7f2a47400640 1 -- 172.21.15.12:0/539963375 learned_addr learned my addr 172.21.15.12:0/539963375 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:22:45.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.743+0000 7f2a3e000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a48074f40 0x7f2a4819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:45.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.743+0000 7f2a46a00640 1 --2- 172.21.15.12:0/539963375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a48074620 0x7f2a4819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:45.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.743+0000 7f2a47400640 1 -- 172.21.15.12:0/539963375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a48074f40 msgr2=0x7f2a4819ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:45.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.743+0000 7f2a47400640 1 --2- 172.21.15.12:0/539963375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a48074f40 0x7f2a4819ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:45.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.743+0000 7f2a47400640 1 -- 172.21.15.12:0/539963375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a48074620 msgr2=0x7f2a4819a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:45.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.743+0000 7f2a47400640 1 --2- 172.21.15.12:0/539963375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a48074620 0x7f2a4819a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:45.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.743+0000 7f2a47400640 1 -- 172.21.15.12:0/539963375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4819f5c0 con 0x7f2a4810e3c0 2024-09-05T01:22:45.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.743+0000 7f2a47400640 1 --2- 172.21.15.12:0/539963375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a4810e3c0 0x7f2a4819eee0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2a4002af40 tx=0x7f2a40003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:45.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.744+0000 7f2a4ca00640 1 -- 172.21.15.12:0/539963375 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a40034040 con 0x7f2a4810e3c0 2024-09-05T01:22:45.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.744+0000 7f2a4ca00640 1 -- 172.21.15.12:0/539963375 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a4002fe20 con 0x7f2a4810e3c0 2024-09-05T01:22:45.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.744+0000 7f2a4ca00640 1 -- 172.21.15.12:0/539963375 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a400046e0 con 0x7f2a4810e3c0 2024-09-05T01:22:45.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.744+0000 7f2a4de00640 1 -- 172.21.15.12:0/539963375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a4819f850 con 0x7f2a4810e3c0 2024-09-05T01:22:45.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.744+0000 7f2a4de00640 1 -- 172.21.15.12:0/539963375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a481a7190 con 0x7f2a4810e3c0 2024-09-05T01:22:45.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.745+0000 7f2a4de00640 1 -- 172.21.15.12:0/539963375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a48074a00 con 0x7f2a4810e3c0 2024-09-05T01:22:45.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.747+0000 7f2a4ca00640 1 -- 172.21.15.12:0/539963375 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2a40037020 con 0x7f2a4810e3c0 2024-09-05T01:22:45.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.748+0000 7f2a4ca00640 1 --2- 172.21.15.12:0/539963375 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f2a2c0a2c00 0x7f2a2c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:45.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.748+0000 7f2a4ca00640 1 -- 172.21.15.12:0/539963375 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f2a400efdc0 con 0x7f2a4810e3c0 2024-09-05T01:22:45.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.748+0000 7f2a46a00640 1 --2- 172.21.15.12:0/539963375 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f2a2c0a2c00 0x7f2a2c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:45.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.749+0000 7f2a46a00640 1 --2- 172.21.15.12:0/539963375 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f2a2c0a2c00 0x7f2a2c0a50c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2a38009bd0 tx=0x7f2a38005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:45.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.752+0000 7f2a4ca00640 1 -- 172.21.15.12:0/539963375 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2a400bcdd0 con 0x7f2a4810e3c0 2024-09-05T01:22:45.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:45.977+0000 7f2a4de00640 1 -- 172.21.15.12:0/539963375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f2a4819b970 con 0x7f2a4810e3c0 2024-09-05T01:22:46.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:46.079+0000 7f2a4ca00640 1 -- 172.21.15.12:0/539963375 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7f2a4819b970 con 0x7f2a4810e3c0 2024-09-05T01:22:46.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:46.081+0000 7f2a4de00640 1 -- 172.21.15.12:0/539963375 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f2a2c0a2c00 msgr2=0x7f2a2c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:46.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:46.081+0000 7f2a4de00640 1 --2- 172.21.15.12:0/539963375 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f2a2c0a2c00 0x7f2a2c0a50c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2a38009bd0 tx=0x7f2a38005f90 comp rx=0 tx=0).stop 2024-09-05T01:22:46.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:46.081+0000 7f2a4de00640 1 -- 172.21.15.12:0/539963375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a4810e3c0 msgr2=0x7f2a4819eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:46.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:46.081+0000 7f2a4de00640 1 --2- 172.21.15.12:0/539963375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a4810e3c0 0x7f2a4819eee0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2a4002af40 tx=0x7f2a40003c10 comp rx=0 tx=0).stop 2024-09-05T01:22:46.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:46.082+0000 7f2a4de00640 1 -- 172.21.15.12:0/539963375 shutdown_connections 2024-09-05T01:22:46.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:46.082+0000 7f2a4de00640 1 --2- 172.21.15.12:0/539963375 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f2a2c0a2c00 0x7f2a2c0a50c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:46.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:46.082+0000 7f2a4de00640 1 --2- 172.21.15.12:0/539963375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a4810e3c0 0x7f2a4819eee0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:46.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:46.082+0000 7f2a4de00640 1 --2- 172.21.15.12:0/539963375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a48074f40 0x7f2a4819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:46.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:46.082+0000 7f2a4de00640 1 --2- 172.21.15.12:0/539963375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2a48074620 0x7f2a4819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:46.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:46.082+0000 7f2a4de00640 1 -- 172.21.15.12:0/539963375 >> 172.21.15.12:0/539963375 conn(0x7f2a480fd8c0 msgr2=0x7f2a480fe500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:46.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:46.082+0000 7f2a4de00640 1 -- 172.21.15.12:0/539963375 shutdown_connections 2024-09-05T01:22:46.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:46.082+0000 7f2a4de00640 1 -- 172.21.15.12:0/539963375 wait complete. 2024-09-05T01:22:46.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:46 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] up:active 2024-09-05T01:22:46.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:46 smithi012 ceph-mon[29942]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-05T01:22:46.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:46 smithi012 ceph-mon[29942]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-05T01:22:46.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:46 smithi012 ceph-mon[29942]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-05T01:22:46.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:46 smithi012 ceph-mon[29942]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-05T01:22:46.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:46 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/539963375' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-05T01:22:46.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:46 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] up:active 2024-09-05T01:22:46.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:46 smithi145 ceph-mon[34376]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-05T01:22:46.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:46 smithi145 ceph-mon[34376]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-05T01:22:46.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:46 smithi145 ceph-mon[34376]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-05T01:22:46.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:46 smithi145 ceph-mon[34376]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-05T01:22:46.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:46 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/539963375' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-05T01:22:46.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:46 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] up:active 2024-09-05T01:22:46.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:46 smithi151 ceph-mon[35013]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-05T01:22:46.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:46 smithi151 ceph-mon[35013]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-05T01:22:46.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:46 smithi151 ceph-mon[35013]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-05T01:22:46.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:46 smithi151 ceph-mon[35013]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-05T01:22:46.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:46 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/539963375' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-05T01:22:46.773 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-05T01:22:47.156 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:22:47.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:47 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/539963375' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-05T01:22:47.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:47 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] up:active 2024-09-05T01:22:47.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:47 smithi145 ceph-mon[34376]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-05T01:22:47.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:47 smithi145 ceph-mon[34376]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-05T01:22:47.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:47 smithi145 ceph-mon[34376]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-05T01:22:47.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:47 smithi145 ceph-mon[34376]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-05T01:22:47.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:47 smithi145 ceph-mon[34376]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 6 op/s 2024-09-05T01:22:47.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:47 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] up:active 2024-09-05T01:22:47.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:47 smithi145 ceph-mon[34376]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-05T01:22:47.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:47 smithi145 ceph-mon[34376]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-05T01:22:47.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:47 smithi145 ceph-mon[34376]: Cluster is now healthy 2024-09-05T01:22:47.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:47 smithi145 ceph-mon[34376]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 4 up:standby-replay 4 up:standby 2024-09-05T01:22:47.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:47 smithi145 ceph-mon[34376]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-09-05T01:22:47.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:47 smithi145 ceph-mon[34376]: daemon mds.l is now active in filesystem cephfs as rank 4 2024-09-05T01:22:47.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:47 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/539963375' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-05T01:22:47.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:47 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] up:active 2024-09-05T01:22:47.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:47 smithi151 ceph-mon[35013]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-05T01:22:47.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:47 smithi151 ceph-mon[35013]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-05T01:22:47.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:47 smithi151 ceph-mon[35013]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-05T01:22:47.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:47 smithi151 ceph-mon[35013]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-05T01:22:47.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:47 smithi151 ceph-mon[35013]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 6 op/s 2024-09-05T01:22:47.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:47 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] up:active 2024-09-05T01:22:47.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:47 smithi151 ceph-mon[35013]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-05T01:22:47.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:47 smithi151 ceph-mon[35013]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-05T01:22:47.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:47 smithi151 ceph-mon[35013]: Cluster is now healthy 2024-09-05T01:22:47.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:47 smithi151 ceph-mon[35013]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 4 up:standby-replay 4 up:standby 2024-09-05T01:22:47.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:47 smithi151 ceph-mon[35013]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-09-05T01:22:47.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:47 smithi151 ceph-mon[35013]: daemon mds.l is now active in filesystem cephfs as rank 4 2024-09-05T01:22:47.428 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:47 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/539963375' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-05T01:22:47.429 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:47 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] up:active 2024-09-05T01:22:47.429 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:47 smithi012 ceph-mon[29942]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-05T01:22:47.429 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:47 smithi012 ceph-mon[29942]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-05T01:22:47.429 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:47 smithi012 ceph-mon[29942]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-05T01:22:47.429 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:47 smithi012 ceph-mon[29942]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-05T01:22:47.429 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:47 smithi012 ceph-mon[29942]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 6 op/s 2024-09-05T01:22:47.429 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:47 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] up:active 2024-09-05T01:22:47.429 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:47 smithi012 ceph-mon[29942]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-05T01:22:47.429 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:47 smithi012 ceph-mon[29942]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-05T01:22:47.429 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:47 smithi012 ceph-mon[29942]: Cluster is now healthy 2024-09-05T01:22:47.429 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:47 smithi012 ceph-mon[29942]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 4 up:standby-replay 4 up:standby 2024-09-05T01:22:47.429 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:47 smithi012 ceph-mon[29942]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-09-05T01:22:47.430 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:47 smithi012 ceph-mon[29942]: daemon mds.l is now active in filesystem cephfs as rank 4 2024-09-05T01:22:47.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.679+0000 7f5788800640 1 -- 172.21.15.12:0/561246884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5780109120 msgr2=0x7f5780110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:47.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.679+0000 7f5788800640 1 --2- 172.21.15.12:0/561246884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5780109120 0x7f5780110ca0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f577c009ca0 tx=0x7f577c02a8c0 comp rx=0 tx=0).stop 2024-09-05T01:22:47.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.679+0000 7f5788800640 1 -- 172.21.15.12:0/561246884 shutdown_connections 2024-09-05T01:22:47.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.679+0000 7f5788800640 1 --2- 172.21.15.12:0/561246884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5780109120 0x7f5780110ca0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:47.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.679+0000 7f5788800640 1 --2- 172.21.15.12:0/561246884 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57801049a0 0x7f57801089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:47.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.679+0000 7f5788800640 1 --2- 172.21.15.12:0/561246884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5780103ff0 0x7f57801043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:47.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.679+0000 7f5788800640 1 -- 172.21.15.12:0/561246884 >> 172.21.15.12:0/561246884 conn(0x7f57800ffa90 msgr2=0x7f5780101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:47.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.679+0000 7f5788800640 1 -- 172.21.15.12:0/561246884 shutdown_connections 2024-09-05T01:22:47.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.679+0000 7f5788800640 1 -- 172.21.15.12:0/561246884 wait complete. 2024-09-05T01:22:47.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.680+0000 7f5788800640 1 Processor -- start 2024-09-05T01:22:47.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.680+0000 7f5788800640 1 -- start start 2024-09-05T01:22:47.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.681+0000 7f5788800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5780103ff0 0x7f578019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:47.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.681+0000 7f5788800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57801049a0 0x7f578019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:47.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.681+0000 7f5788800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5780109120 0x7f578019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:47.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.681+0000 7f5788800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f57801141a0 con 0x7f57801049a0 2024-09-05T01:22:47.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.681+0000 7f5788800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5780114020 con 0x7f5780103ff0 2024-09-05T01:22:47.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.681+0000 7f5788800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5780114320 con 0x7f5780109120 2024-09-05T01:22:47.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.681+0000 7f5785400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57801049a0 0x7f578019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:47.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.681+0000 7f5785400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57801049a0 0x7f578019aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56678/0 (socket says 172.21.15.12:56678) 2024-09-05T01:22:47.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.681+0000 7f5785400640 1 -- 172.21.15.12:0/128258929 learned_addr learned my addr 172.21.15.12:0/128258929 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:22:47.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.681+0000 7f5786800640 1 --2- 172.21.15.12:0/128258929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5780109120 0x7f578019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:47.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.681+0000 7f5785e00640 1 --2- 172.21.15.12:0/128258929 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5780103ff0 0x7f578019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:47.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.681+0000 7f5785400640 1 -- 172.21.15.12:0/128258929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5780109120 msgr2=0x7f578019ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:47.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.681+0000 7f5785400640 1 --2- 172.21.15.12:0/128258929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5780109120 0x7f578019ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:47.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.681+0000 7f5785400640 1 -- 172.21.15.12:0/128258929 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5780103ff0 msgr2=0x7f578019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:47.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.681+0000 7f5785400640 1 --2- 172.21.15.12:0/128258929 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5780103ff0 0x7f578019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:47.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.681+0000 7f5785400640 1 -- 172.21.15.12:0/128258929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578019f610 con 0x7f57801049a0 2024-09-05T01:22:47.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.682+0000 7f5785400640 1 --2- 172.21.15.12:0/128258929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57801049a0 0x7f578019aba0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f577000e9f0 tx=0x7f577000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:47.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.682+0000 7f577aa00640 1 -- 172.21.15.12:0/128258929 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577000cd80 con 0x7f57801049a0 2024-09-05T01:22:47.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.682+0000 7f5788800640 1 -- 172.21.15.12:0/128258929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f578019f900 con 0x7f57801049a0 2024-09-05T01:22:47.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.682+0000 7f577aa00640 1 -- 172.21.15.12:0/128258929 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5770010910 con 0x7f57801049a0 2024-09-05T01:22:47.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.682+0000 7f577aa00640 1 -- 172.21.15.12:0/128258929 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57700188f0 con 0x7f57801049a0 2024-09-05T01:22:47.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.682+0000 7f5788800640 1 -- 172.21.15.12:0/128258929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57801a71e0 con 0x7f57801049a0 2024-09-05T01:22:47.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.683+0000 7f5788800640 1 -- 172.21.15.12:0/128258929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57801043d0 con 0x7f57801049a0 2024-09-05T01:22:47.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.686+0000 7f577aa00640 1 -- 172.21.15.12:0/128258929 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5770010ac0 con 0x7f57801049a0 2024-09-05T01:22:47.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.687+0000 7f577aa00640 1 --2- 172.21.15.12:0/128258929 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f57680a2c00 0x7f57680a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:47.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.687+0000 7f577aa00640 1 -- 172.21.15.12:0/128258929 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f57700cf600 con 0x7f57801049a0 2024-09-05T01:22:47.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.687+0000 7f5785e00640 1 --2- 172.21.15.12:0/128258929 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f57680a2c00 0x7f57680a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:47.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.688+0000 7f5785e00640 1 --2- 172.21.15.12:0/128258929 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f57680a2c00 0x7f57680a50c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5774005fd0 tx=0x7f577400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:47.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.689+0000 7f577aa00640 1 -- 172.21.15.12:0/128258929 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f577009bfc0 con 0x7f57801049a0 2024-09-05T01:22:47.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:47.914+0000 7f5788800640 1 -- 172.21.15.12:0/128258929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f578019b9c0 con 0x7f57801049a0 2024-09-05T01:22:48.333 INFO:journalctl@ceph.mds.b.smithi145.stdout:Sep 05 01:22:47 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-b[65009]: 2024-09-05T01:22:47.861+0000 7ffa5100f640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-05T01:22:48.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:48.873+0000 7f577aa00640 1 -- 172.21.15.12:0/128258929 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v27) ==== 115+0+0 (secure 0 0 0) 0x7f57700a02c0 con 0x7f57801049a0 2024-09-05T01:22:48.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:48.876+0000 7f5788800640 1 -- 172.21.15.12:0/128258929 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f57680a2c00 msgr2=0x7f57680a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:48.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:48.876+0000 7f5788800640 1 --2- 172.21.15.12:0/128258929 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f57680a2c00 0x7f57680a50c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5774005fd0 tx=0x7f577400b390 comp rx=0 tx=0).stop 2024-09-05T01:22:48.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:48.876+0000 7f5788800640 1 -- 172.21.15.12:0/128258929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57801049a0 msgr2=0x7f578019aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:48.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:48.876+0000 7f5788800640 1 --2- 172.21.15.12:0/128258929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57801049a0 0x7f578019aba0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f577000e9f0 tx=0x7f577000eeb0 comp rx=0 tx=0).stop 2024-09-05T01:22:48.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:48.876+0000 7f5788800640 1 -- 172.21.15.12:0/128258929 shutdown_connections 2024-09-05T01:22:48.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:48.876+0000 7f5788800640 1 --2- 172.21.15.12:0/128258929 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f57680a2c00 0x7f57680a50c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:48.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:48.876+0000 7f5788800640 1 --2- 172.21.15.12:0/128258929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5780109120 0x7f578019ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:48.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:48.876+0000 7f5788800640 1 --2- 172.21.15.12:0/128258929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57801049a0 0x7f578019aba0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:48.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:48.877+0000 7f5788800640 1 --2- 172.21.15.12:0/128258929 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5780103ff0 0x7f578019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:48.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:48.877+0000 7f5788800640 1 -- 172.21.15.12:0/128258929 >> 172.21.15.12:0/128258929 conn(0x7f57800ffa90 msgr2=0x7f5780100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:48.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:48.877+0000 7f5788800640 1 -- 172.21.15.12:0/128258929 shutdown_connections 2024-09-05T01:22:48.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:48.877+0000 7f5788800640 1 -- 172.21.15.12:0/128258929 wait complete. 2024-09-05T01:22:49.253 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:48 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] up:active 2024-09-05T01:22:49.253 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:48 smithi012 ceph-mon[29942]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-05T01:22:49.254 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:48 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:22:49.254 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:48 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/128258929' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-05T01:22:49.254 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:48 smithi012 ceph-mon[29942]: pgmap v294: 97 pgs: 97 active+clean; 581 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 3.0 KiB/s wr, 9 op/s 2024-09-05T01:22:49.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:48 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] up:active 2024-09-05T01:22:49.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:48 smithi145 ceph-mon[34376]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-05T01:22:49.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:48 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:22:49.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:48 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/128258929' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-05T01:22:49.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:48 smithi145 ceph-mon[34376]: pgmap v294: 97 pgs: 97 active+clean; 581 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 3.0 KiB/s wr, 9 op/s 2024-09-05T01:22:49.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:48 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] up:active 2024-09-05T01:22:49.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:48 smithi151 ceph-mon[35013]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-05T01:22:49.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:48 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:22:49.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:48 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/128258929' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-05T01:22:49.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:48 smithi151 ceph-mon[35013]: pgmap v294: 97 pgs: 97 active+clean; 581 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 3.0 KiB/s wr, 9 op/s 2024-09-05T01:22:49.598 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-09-05T01:22:49.598 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-05T01:22:49.981 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:22:50.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:49 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/128258929' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-05T01:22:50.128 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:49 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:22:50.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:49 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/128258929' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-05T01:22:50.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:49 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:22:50.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:49 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/128258929' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-05T01:22:50.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:49 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:22:50.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.503+0000 7f7913600640 1 -- 172.21.15.12:0/3079097969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f790c103ff0 msgr2=0x7f790c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:50.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.503+0000 7f7913600640 1 --2- 172.21.15.12:0/3079097969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f790c103ff0 0x7f790c1043d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f78fc009900 tx=0x7f78fc02a410 comp rx=0 tx=0).stop 2024-09-05T01:22:50.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.503+0000 7f7913600640 1 -- 172.21.15.12:0/3079097969 shutdown_connections 2024-09-05T01:22:50.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.503+0000 7f7913600640 1 --2- 172.21.15.12:0/3079097969 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f790c109120 0x7f790c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:50.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.503+0000 7f7913600640 1 --2- 172.21.15.12:0/3079097969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f790c1049a0 0x7f790c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:50.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.503+0000 7f7913600640 1 --2- 172.21.15.12:0/3079097969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f790c103ff0 0x7f790c1043d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:50.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.503+0000 7f7913600640 1 -- 172.21.15.12:0/3079097969 >> 172.21.15.12:0/3079097969 conn(0x7f790c0ffa90 msgr2=0x7f790c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:50.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.503+0000 7f7913600640 1 -- 172.21.15.12:0/3079097969 shutdown_connections 2024-09-05T01:22:50.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.503+0000 7f7913600640 1 -- 172.21.15.12:0/3079097969 wait complete. 2024-09-05T01:22:50.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.504+0000 7f7913600640 1 Processor -- start 2024-09-05T01:22:50.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.504+0000 7f7913600640 1 -- start start 2024-09-05T01:22:50.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.505+0000 7f7913600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f790c103ff0 0x7f790c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:50.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.505+0000 7f7913600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f790c1049a0 0x7f790c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:50.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.505+0000 7f7913600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f790c109120 0x7f790c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:50.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.505+0000 7f7913600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f790c114140 con 0x7f790c103ff0 2024-09-05T01:22:50.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.505+0000 7f7913600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f790c113fc0 con 0x7f790c109120 2024-09-05T01:22:50.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.505+0000 7f7913600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f790c1142c0 con 0x7f790c1049a0 2024-09-05T01:22:50.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.505+0000 7f7910c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f790c103ff0 0x7f790c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:50.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.505+0000 7f7910c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f790c103ff0 0x7f790c19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56704/0 (socket says 172.21.15.12:56704) 2024-09-05T01:22:50.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.505+0000 7f7910c00640 1 -- 172.21.15.12:0/4157915756 learned_addr learned my addr 172.21.15.12:0/4157915756 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:22:50.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.505+0000 7f7903e00640 1 --2- 172.21.15.12:0/4157915756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f790c1049a0 0x7f790c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:50.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.505+0000 7f7911600640 1 --2- 172.21.15.12:0/4157915756 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f790c109120 0x7f790c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:50.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.506+0000 7f7910c00640 1 -- 172.21.15.12:0/4157915756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f790c1049a0 msgr2=0x7f790c19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:50.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.506+0000 7f7910c00640 1 --2- 172.21.15.12:0/4157915756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f790c1049a0 0x7f790c19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:50.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.506+0000 7f7910c00640 1 -- 172.21.15.12:0/4157915756 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f790c109120 msgr2=0x7f790c19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:50.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.506+0000 7f7910c00640 1 --2- 172.21.15.12:0/4157915756 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f790c109120 0x7f790c19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:50.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.506+0000 7f7910c00640 1 -- 172.21.15.12:0/4157915756 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790c19f5b0 con 0x7f790c103ff0 2024-09-05T01:22:50.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.506+0000 7f7911600640 1 --2- 172.21.15.12:0/4157915756 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f790c109120 0x7f790c19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:22:50.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.506+0000 7f7910c00640 1 --2- 172.21.15.12:0/4157915756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f790c103ff0 0x7f790c19a600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f78fc006010 tx=0x7f78fc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:50.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.506+0000 7f790a000640 1 -- 172.21.15.12:0/4157915756 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc03f030 con 0x7f790c103ff0 2024-09-05T01:22:50.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.506+0000 7f790a000640 1 -- 172.21.15.12:0/4157915756 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78fc003ce0 con 0x7f790c103ff0 2024-09-05T01:22:50.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.506+0000 7f7913600640 1 -- 172.21.15.12:0/4157915756 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f790c19f840 con 0x7f790c103ff0 2024-09-05T01:22:50.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.506+0000 7f790a000640 1 -- 172.21.15.12:0/4157915756 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc035070 con 0x7f790c103ff0 2024-09-05T01:22:50.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.506+0000 7f7913600640 1 -- 172.21.15.12:0/4157915756 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f790c1a7180 con 0x7f790c103ff0 2024-09-05T01:22:50.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.508+0000 7f7913600640 1 -- 172.21.15.12:0/4157915756 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f790c1054d0 con 0x7f790c103ff0 2024-09-05T01:22:50.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.509+0000 7f790a000640 1 -- 172.21.15.12:0/4157915756 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f78fc042030 con 0x7f790c103ff0 2024-09-05T01:22:50.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.511+0000 7f790a000640 1 --2- 172.21.15.12:0/4157915756 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f78f00a2b80 0x7f78f00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:50.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.511+0000 7f790a000640 1 -- 172.21.15.12:0/4157915756 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f78fc0ef570 con 0x7f790c103ff0 2024-09-05T01:22:50.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.511+0000 7f7903e00640 1 --2- 172.21.15.12:0/4157915756 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f78f00a2b80 0x7f78f00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:50.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.512+0000 7f7903e00640 1 --2- 172.21.15.12:0/4157915756 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f78f00a2b80 0x7f78f00a5040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f790c0fff20 tx=0x7f78f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:50.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.515+0000 7f790a000640 1 -- 172.21.15.12:0/4157915756 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f78fc0bc640 con 0x7f790c103ff0 2024-09-05T01:22:50.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.724+0000 7f7913600640 1 -- 172.21.15.12:0/4157915756 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f790c062630 con 0x7f78f00a2b80 2024-09-05T01:22:50.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.758+0000 7f790a000640 1 -- 172.21.15.12:0/4157915756 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f790c062630 con 0x7f78f00a2b80 2024-09-05T01:22:50.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.760+0000 7f7913600640 1 -- 172.21.15.12:0/4157915756 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f78f00a2b80 msgr2=0x7f78f00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:50.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.760+0000 7f7913600640 1 --2- 172.21.15.12:0/4157915756 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f78f00a2b80 0x7f78f00a5040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f790c0fff20 tx=0x7f78f4005f90 comp rx=0 tx=0).stop 2024-09-05T01:22:50.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.760+0000 7f7913600640 1 -- 172.21.15.12:0/4157915756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f790c103ff0 msgr2=0x7f790c19a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:50.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.760+0000 7f7913600640 1 --2- 172.21.15.12:0/4157915756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f790c103ff0 0x7f790c19a600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f78fc006010 tx=0x7f78fc0042f0 comp rx=0 tx=0).stop 2024-09-05T01:22:50.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.760+0000 7f7913600640 1 -- 172.21.15.12:0/4157915756 shutdown_connections 2024-09-05T01:22:50.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.760+0000 7f7913600640 1 --2- 172.21.15.12:0/4157915756 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f78f00a2b80 0x7f78f00a5040 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:50.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.760+0000 7f7913600640 1 --2- 172.21.15.12:0/4157915756 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f790c109120 0x7f790c19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:50.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.760+0000 7f7913600640 1 --2- 172.21.15.12:0/4157915756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f790c1049a0 0x7f790c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:50.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.760+0000 7f7913600640 1 --2- 172.21.15.12:0/4157915756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f790c103ff0 0x7f790c19a600 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:50.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.760+0000 7f7913600640 1 -- 172.21.15.12:0/4157915756 >> 172.21.15.12:0/4157915756 conn(0x7f790c0ffa90 msgr2=0x7f790c100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:50.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.760+0000 7f7913600640 1 -- 172.21.15.12:0/4157915756 shutdown_connections 2024-09-05T01:22:50.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:50.761+0000 7f7913600640 1 -- 172.21.15.12:0/4157915756 wait complete. 2024-09-05T01:22:51.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:50 smithi012 ceph-mon[29942]: pgmap v295: 97 pgs: 97 active+clean; 584 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 4.9 KiB/s wr, 19 op/s 2024-09-05T01:22:51.062 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:22:50 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:22:50.731+0000 7f3112c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T01:22:51.062 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:22:50 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:22:50.731+0000 7f3112c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T01:22:51.062 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:22:50 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:22:50.731+0000 7f3112c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T01:22:51.062 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:22:50 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:22:50.731+0000 7f3112c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T01:22:51.063 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:22:50 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:22:50.731+0000 7f3112c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T01:22:51.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:50 smithi145 ceph-mon[34376]: pgmap v295: 97 pgs: 97 active+clean; 584 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 4.9 KiB/s wr, 19 op/s 2024-09-05T01:22:51.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:50 smithi151 ceph-mon[35013]: pgmap v295: 97 pgs: 97 active+clean; 584 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 4.9 KiB/s wr, 19 op/s 2024-09-05T01:22:51.424 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-05T01:22:51.805 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:22:52.139 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:51 smithi012 ceph-mon[29942]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:22:52.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:51 smithi145 ceph-mon[34376]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:22:52.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:51 smithi151 ceph-mon[35013]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:22:52.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.356+0000 7f3d1ae00640 1 -- 172.21.15.12:0/874340002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d141047e0 msgr2=0x7f3d14108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:52.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.356+0000 7f3d1ae00640 1 --2- 172.21.15.12:0/874340002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d141047e0 0x7f3d14108830 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009900 tx=0x7f3d0002a410 comp rx=0 tx=0).stop 2024-09-05T01:22:52.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.356+0000 7f3d1ae00640 1 -- 172.21.15.12:0/874340002 shutdown_connections 2024-09-05T01:22:52.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.356+0000 7f3d1ae00640 1 --2- 172.21.15.12:0/874340002 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d14108f60 0x7f3d14110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:52.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.356+0000 7f3d1ae00640 1 --2- 172.21.15.12:0/874340002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d141047e0 0x7f3d14108830 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:52.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.356+0000 7f3d1ae00640 1 --2- 172.21.15.12:0/874340002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d14103e30 0x7f3d14104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:52.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.356+0000 7f3d1ae00640 1 -- 172.21.15.12:0/874340002 >> 172.21.15.12:0/874340002 conn(0x7f3d140ff8d0 msgr2=0x7f3d14101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:52.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.357+0000 7f3d1ae00640 1 -- 172.21.15.12:0/874340002 shutdown_connections 2024-09-05T01:22:52.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.357+0000 7f3d1ae00640 1 -- 172.21.15.12:0/874340002 wait complete. 2024-09-05T01:22:52.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.357+0000 7f3d1ae00640 1 Processor -- start 2024-09-05T01:22:52.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.358+0000 7f3d1ae00640 1 -- start start 2024-09-05T01:22:52.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.358+0000 7f3d1ae00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d14103e30 0x7f3d1419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:52.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.358+0000 7f3d1ae00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d141047e0 0x7f3d1419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:52.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.358+0000 7f3d1ae00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d14108f60 0x7f3d1419ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:52.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.358+0000 7f3d1ae00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3d14113fc0 con 0x7f3d14103e30 2024-09-05T01:22:52.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.358+0000 7f3d1ae00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3d14113e40 con 0x7f3d141047e0 2024-09-05T01:22:52.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.358+0000 7f3d1ae00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3d14114140 con 0x7f3d14108f60 2024-09-05T01:22:52.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.358+0000 7f3d19a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d14103e30 0x7f3d1419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:52.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.358+0000 7f3d19a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d14103e30 0x7f3d1419a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56734/0 (socket says 172.21.15.12:56734) 2024-09-05T01:22:52.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.358+0000 7f3d19a00640 1 -- 172.21.15.12:0/3780976372 learned_addr learned my addr 172.21.15.12:0/3780976372 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:22:52.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.358+0000 7f3d19000640 1 --2- 172.21.15.12:0/3780976372 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d141047e0 0x7f3d1419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:52.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.359+0000 7f3d1a400640 1 --2- 172.21.15.12:0/3780976372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d14108f60 0x7f3d1419ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:52.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.359+0000 7f3d19a00640 1 -- 172.21.15.12:0/3780976372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d14108f60 msgr2=0x7f3d1419ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:52.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.359+0000 7f3d19a00640 1 --2- 172.21.15.12:0/3780976372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d14108f60 0x7f3d1419ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:52.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.359+0000 7f3d19a00640 1 -- 172.21.15.12:0/3780976372 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d141047e0 msgr2=0x7f3d1419a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:52.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.359+0000 7f3d19a00640 1 --2- 172.21.15.12:0/3780976372 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d141047e0 0x7f3d1419a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:52.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.359+0000 7f3d19a00640 1 -- 172.21.15.12:0/3780976372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d1419f430 con 0x7f3d14103e30 2024-09-05T01:22:52.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.359+0000 7f3d19000640 1 --2- 172.21.15.12:0/3780976372 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d141047e0 0x7f3d1419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:22:52.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.359+0000 7f3d19a00640 1 --2- 172.21.15.12:0/3780976372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d14103e30 0x7f3d1419a480 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800e9f0 tx=0x7f3d0800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:52.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.360+0000 7f3d12000640 1 -- 172.21.15.12:0/3780976372 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0800cd80 con 0x7f3d14103e30 2024-09-05T01:22:52.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.360+0000 7f3d12000640 1 -- 172.21.15.12:0/3780976372 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d08005500 con 0x7f3d14103e30 2024-09-05T01:22:52.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.360+0000 7f3d12000640 1 -- 172.21.15.12:0/3780976372 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d08010690 con 0x7f3d14103e30 2024-09-05T01:22:52.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.360+0000 7f3d1ae00640 1 -- 172.21.15.12:0/3780976372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d1419f720 con 0x7f3d14103e30 2024-09-05T01:22:52.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.360+0000 7f3d1ae00640 1 -- 172.21.15.12:0/3780976372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d141a7000 con 0x7f3d14103e30 2024-09-05T01:22:52.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.361+0000 7f3d1ae00640 1 -- 172.21.15.12:0/3780976372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d14104210 con 0x7f3d14103e30 2024-09-05T01:22:52.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.363+0000 7f3d12000640 1 -- 172.21.15.12:0/3780976372 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3d080046c0 con 0x7f3d14103e30 2024-09-05T01:22:52.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.364+0000 7f3d12000640 1 --2- 172.21.15.12:0/3780976372 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3cfc0a2c00 0x7f3cfc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:52.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.364+0000 7f3d12000640 1 -- 172.21.15.12:0/3780976372 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f3d080cf450 con 0x7f3d14103e30 2024-09-05T01:22:52.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.364+0000 7f3d19000640 1 --2- 172.21.15.12:0/3780976372 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3cfc0a2c00 0x7f3cfc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:52.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.365+0000 7f3d19000640 1 --2- 172.21.15.12:0/3780976372 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3cfc0a2c00 0x7f3cfc0a50c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009230 tx=0x7f3d000058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:52.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.366+0000 7f3d12000640 1 -- 172.21.15.12:0/3780976372 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3d080541b0 con 0x7f3d14103e30 2024-09-05T01:22:52.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.584+0000 7f3d1ae00640 1 -- 172.21.15.12:0/3780976372 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3d14062630 con 0x7f3cfc0a2c00 2024-09-05T01:22:52.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.610+0000 7f3d12000640 1 -- 172.21.15.12:0/3780976372 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3d14062630 con 0x7f3cfc0a2c00 2024-09-05T01:22:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.613+0000 7f3d1ae00640 1 -- 172.21.15.12:0/3780976372 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3cfc0a2c00 msgr2=0x7f3cfc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.613+0000 7f3d1ae00640 1 --2- 172.21.15.12:0/3780976372 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3cfc0a2c00 0x7f3cfc0a50c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009230 tx=0x7f3d000058d0 comp rx=0 tx=0).stop 2024-09-05T01:22:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.613+0000 7f3d1ae00640 1 -- 172.21.15.12:0/3780976372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d14103e30 msgr2=0x7f3d1419a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.613+0000 7f3d1ae00640 1 --2- 172.21.15.12:0/3780976372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d14103e30 0x7f3d1419a480 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800e9f0 tx=0x7f3d0800edf0 comp rx=0 tx=0).stop 2024-09-05T01:22:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.613+0000 7f3d1ae00640 1 -- 172.21.15.12:0/3780976372 shutdown_connections 2024-09-05T01:22:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.613+0000 7f3d1ae00640 1 --2- 172.21.15.12:0/3780976372 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3cfc0a2c00 0x7f3cfc0a50c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.613+0000 7f3d1ae00640 1 --2- 172.21.15.12:0/3780976372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d14108f60 0x7f3d1419ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.613+0000 7f3d1ae00640 1 --2- 172.21.15.12:0/3780976372 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d141047e0 0x7f3d1419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.613+0000 7f3d1ae00640 1 --2- 172.21.15.12:0/3780976372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d14103e30 0x7f3d1419a480 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.613+0000 7f3d1ae00640 1 -- 172.21.15.12:0/3780976372 >> 172.21.15.12:0/3780976372 conn(0x7f3d140ff8d0 msgr2=0x7f3d14100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.613+0000 7f3d1ae00640 1 -- 172.21.15.12:0/3780976372 shutdown_connections 2024-09-05T01:22:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:52.613+0000 7f3d1ae00640 1 -- 172.21.15.12:0/3780976372 wait complete. 2024-09-05T01:22:53.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:52 smithi012 ceph-mon[29942]: pgmap v296: 97 pgs: 97 active+clean; 585 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.1 KiB/s wr, 18 op/s 2024-09-05T01:22:53.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:52 smithi145 ceph-mon[34376]: pgmap v296: 97 pgs: 97 active+clean; 585 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.1 KiB/s wr, 18 op/s 2024-09-05T01:22:53.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:52 smithi151 ceph-mon[35013]: pgmap v296: 97 pgs: 97 active+clean; 585 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.1 KiB/s wr, 18 op/s 2024-09-05T01:22:53.440 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-05T01:22:53.816 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:22:54.150 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:53 smithi012 ceph-mon[29942]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:22:54.151 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:53 smithi012 ceph-mon[29942]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-05T01:22:54.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:53 smithi145 ceph-mon[34376]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:22:54.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:53 smithi145 ceph-mon[34376]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-05T01:22:54.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:53 smithi151 ceph-mon[35013]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:22:54.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:53 smithi151 ceph-mon[35013]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-05T01:22:54.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.379+0000 7f2d71a00640 1 -- 172.21.15.12:0/2652675338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d6c101de0 msgr2=0x7f2d6c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:54.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.379+0000 7f2d71a00640 1 --2- 172.21.15.12:0/2652675338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d6c101de0 0x7f2d6c1021c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c009900 tx=0x7f2d5c02a410 comp rx=0 tx=0).stop 2024-09-05T01:22:54.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.379+0000 7f2d71a00640 1 -- 172.21.15.12:0/2652675338 shutdown_connections 2024-09-05T01:22:54.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.379+0000 7f2d71a00640 1 --2- 172.21.15.12:0/2652675338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d6c106f10 0x7f2d6c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:54.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.379+0000 7f2d71a00640 1 --2- 172.21.15.12:0/2652675338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d6c102790 0x7f2d6c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:54.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.379+0000 7f2d71a00640 1 --2- 172.21.15.12:0/2652675338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d6c101de0 0x7f2d6c1021c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:54.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.379+0000 7f2d71a00640 1 -- 172.21.15.12:0/2652675338 >> 172.21.15.12:0/2652675338 conn(0x7f2d6c0fd8c0 msgr2=0x7f2d6c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:54.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.379+0000 7f2d71a00640 1 -- 172.21.15.12:0/2652675338 shutdown_connections 2024-09-05T01:22:54.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.379+0000 7f2d71a00640 1 -- 172.21.15.12:0/2652675338 wait complete. 2024-09-05T01:22:54.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.380+0000 7f2d71a00640 1 Processor -- start 2024-09-05T01:22:54.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.380+0000 7f2d71a00640 1 -- start start 2024-09-05T01:22:54.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.381+0000 7f2d71a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d6c101de0 0x7f2d6c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:54.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.381+0000 7f2d71a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d6c102790 0x7f2d6c198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:54.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.381+0000 7f2d71a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d6c106f10 0x7f2d6c19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:54.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.381+0000 7f2d71a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c111fc0 con 0x7f2d6c106f10 2024-09-05T01:22:54.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.381+0000 7f2d71a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c111e40 con 0x7f2d6c102790 2024-09-05T01:22:54.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.381+0000 7f2d71a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c112140 con 0x7f2d6c101de0 2024-09-05T01:22:54.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.381+0000 7f2d6aa00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d6c101de0 0x7f2d6c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:54.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.381+0000 7f2d6b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d6c106f10 0x7f2d6c19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:54.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.381+0000 7f2d6aa00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d6c101de0 0x7f2d6c198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:42522/0 (socket says 172.21.15.12:42522) 2024-09-05T01:22:54.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.381+0000 7f2d63e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d6c102790 0x7f2d6c198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:54.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.381+0000 7f2d6aa00640 1 -- 172.21.15.12:0/2537236258 learned_addr learned my addr 172.21.15.12:0/2537236258 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:22:54.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.381+0000 7f2d6b400640 1 --2- 172.21.15.12:0/2537236258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d6c106f10 0x7f2d6c19ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56762/0 (socket says 172.21.15.12:56762) 2024-09-05T01:22:54.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.381+0000 7f2d6b400640 1 -- 172.21.15.12:0/2537236258 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d6c101de0 msgr2=0x7f2d6c198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:54.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.381+0000 7f2d6b400640 1 --2- 172.21.15.12:0/2537236258 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d6c101de0 0x7f2d6c198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:54.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.381+0000 7f2d6b400640 1 -- 172.21.15.12:0/2537236258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d6c102790 msgr2=0x7f2d6c198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:54.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.382+0000 7f2d6b400640 1 --2- 172.21.15.12:0/2537236258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d6c102790 0x7f2d6c198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:54.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.382+0000 7f2d6b400640 1 -- 172.21.15.12:0/2537236258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6c19d3d0 con 0x7f2d6c106f10 2024-09-05T01:22:54.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.382+0000 7f2d63e00640 1 --2- 172.21.15.12:0/2537236258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d6c102790 0x7f2d6c198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:22:54.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.382+0000 7f2d6aa00640 1 --2- 172.21.15.12:0/2537236258 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d6c101de0 0x7f2d6c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:22:54.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.382+0000 7f2d6b400640 1 --2- 172.21.15.12:0/2537236258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d6c106f10 0x7f2d6c19ccf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2d64009fd0 tx=0x7f2d6400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:54.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.382+0000 7f2d63400640 1 -- 172.21.15.12:0/2537236258 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6400ce20 con 0x7f2d6c106f10 2024-09-05T01:22:54.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.382+0000 7f2d63400640 1 -- 172.21.15.12:0/2537236258 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d64005020 con 0x7f2d6c106f10 2024-09-05T01:22:54.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.382+0000 7f2d63400640 1 -- 172.21.15.12:0/2537236258 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d64010720 con 0x7f2d6c106f10 2024-09-05T01:22:54.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.382+0000 7f2d71a00640 1 -- 172.21.15.12:0/2537236258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d6c19d6c0 con 0x7f2d6c106f10 2024-09-05T01:22:54.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.382+0000 7f2d71a00640 1 -- 172.21.15.12:0/2537236258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d6c1a4fa0 con 0x7f2d6c106f10 2024-09-05T01:22:54.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.383+0000 7f2d71a00640 1 -- 172.21.15.12:0/2537236258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d6c1021c0 con 0x7f2d6c106f10 2024-09-05T01:22:54.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.385+0000 7f2d63400640 1 -- 172.21.15.12:0/2537236258 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2d64005540 con 0x7f2d6c106f10 2024-09-05T01:22:54.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.387+0000 7f2d63400640 1 --2- 172.21.15.12:0/2537236258 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f2d500a2c90 0x7f2d500a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:54.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.387+0000 7f2d63400640 1 -- 172.21.15.12:0/2537236258 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f2d640cf510 con 0x7f2d6c106f10 2024-09-05T01:22:54.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.387+0000 7f2d6aa00640 1 --2- 172.21.15.12:0/2537236258 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f2d500a2c90 0x7f2d500a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:54.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.388+0000 7f2d6aa00640 1 --2- 172.21.15.12:0/2537236258 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f2d500a2c90 0x7f2d500a5150 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c0096c0 tx=0x7f2d5c0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:54.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.391+0000 7f2d63400640 1 -- 172.21.15.12:0/2537236258 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2d6409c4c0 con 0x7f2d6c106f10 2024-09-05T01:22:54.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.604+0000 7f2d71a00640 1 -- 172.21.15.12:0/2537236258 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f2d6c062630 con 0x7f2d500a2c90 2024-09-05T01:22:54.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.609+0000 7f2d63400640 1 -- 172.21.15.12:0/2537236258 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f2d6c062630 con 0x7f2d500a2c90 2024-09-05T01:22:54.610 INFO:teuthology.orchestra.run.smithi012.stdout:/volumes/qa/sv_0/7019fde9-5fb4-4485-8694-40e945e0f9b5 2024-09-05T01:22:54.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.612+0000 7f2d71a00640 1 -- 172.21.15.12:0/2537236258 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f2d500a2c90 msgr2=0x7f2d500a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:54.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.612+0000 7f2d71a00640 1 --2- 172.21.15.12:0/2537236258 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f2d500a2c90 0x7f2d500a5150 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c0096c0 tx=0x7f2d5c0046c0 comp rx=0 tx=0).stop 2024-09-05T01:22:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.612+0000 7f2d71a00640 1 -- 172.21.15.12:0/2537236258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d6c106f10 msgr2=0x7f2d6c19ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.612+0000 7f2d71a00640 1 --2- 172.21.15.12:0/2537236258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d6c106f10 0x7f2d6c19ccf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2d64009fd0 tx=0x7f2d6400ef10 comp rx=0 tx=0).stop 2024-09-05T01:22:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.612+0000 7f2d71a00640 1 -- 172.21.15.12:0/2537236258 shutdown_connections 2024-09-05T01:22:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.612+0000 7f2d71a00640 1 --2- 172.21.15.12:0/2537236258 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f2d500a2c90 0x7f2d500a5150 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.612+0000 7f2d71a00640 1 --2- 172.21.15.12:0/2537236258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d6c106f10 0x7f2d6c19ccf0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:54.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.612+0000 7f2d71a00640 1 --2- 172.21.15.12:0/2537236258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d6c102790 0x7f2d6c198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:54.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.612+0000 7f2d71a00640 1 --2- 172.21.15.12:0/2537236258 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d6c101de0 0x7f2d6c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:54.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.612+0000 7f2d71a00640 1 -- 172.21.15.12:0/2537236258 >> 172.21.15.12:0/2537236258 conn(0x7f2d6c0fd8c0 msgr2=0x7f2d6c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:54.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.612+0000 7f2d71a00640 1 -- 172.21.15.12:0/2537236258 shutdown_connections 2024-09-05T01:22:54.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:54.612+0000 7f2d71a00640 1 -- 172.21.15.12:0/2537236258 wait complete. 2024-09-05T01:22:55.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:54 smithi012 ceph-mon[29942]: pgmap v297: 97 pgs: 97 active+clean; 586 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.4 KiB/s wr, 20 op/s 2024-09-05T01:22:55.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:54 smithi145 ceph-mon[34376]: pgmap v297: 97 pgs: 97 active+clean; 586 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.4 KiB/s wr, 20 op/s 2024-09-05T01:22:55.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:54 smithi151 ceph-mon[35013]: pgmap v297: 97 pgs: 97 active+clean; 586 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.4 KiB/s wr, 20 op/s 2024-09-05T01:22:55.380 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-05T01:22:55.757 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:22:56.179 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:55 smithi012 ceph-mon[29942]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:22:56.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.298+0000 7f6da1000640 1 -- 172.21.15.12:0/2149718503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d9c074510 msgr2=0x7f6d9c0748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:56.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.298+0000 7f6da1000640 1 --2- 172.21.15.12:0/2149718503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d9c074510 0x7f6d9c0748f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c009860 tx=0x7f6d8c02a3d0 comp rx=0 tx=0).stop 2024-09-05T01:22:56.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.298+0000 7f6da1000640 1 -- 172.21.15.12:0/2149718503 shutdown_connections 2024-09-05T01:22:56.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.298+0000 7f6da1000640 1 --2- 172.21.15.12:0/2149718503 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d9c10e450 0x7f6d9c110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:56.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.298+0000 7f6da1000640 1 --2- 172.21.15.12:0/2149718503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c074e30 0x7f6d9c10df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:56.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.298+0000 7f6da1000640 1 --2- 172.21.15.12:0/2149718503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d9c074510 0x7f6d9c0748f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:56.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.298+0000 7f6da1000640 1 -- 172.21.15.12:0/2149718503 >> 172.21.15.12:0/2149718503 conn(0x7f6d9c0fd8b0 msgr2=0x7f6d9c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:56.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.298+0000 7f6da1000640 1 -- 172.21.15.12:0/2149718503 shutdown_connections 2024-09-05T01:22:56.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.299+0000 7f6da1000640 1 -- 172.21.15.12:0/2149718503 wait complete. 2024-09-05T01:22:56.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.300+0000 7f6da1000640 1 Processor -- start 2024-09-05T01:22:56.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.300+0000 7f6da1000640 1 -- start start 2024-09-05T01:22:56.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.300+0000 7f6da1000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d9c074510 0x7f6d9c19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:56.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.300+0000 7f6da1000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c074e30 0x7f6d9c19abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:56.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.300+0000 7f6da1000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d9c10e450 0x7f6d9c19ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:56.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.300+0000 7f6da1000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9c114180 con 0x7f6d9c074e30 2024-09-05T01:22:56.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.300+0000 7f6da1000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9c114000 con 0x7f6d9c074510 2024-09-05T01:22:56.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.300+0000 7f6da1000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9c114300 con 0x7f6d9c10e450 2024-09-05T01:22:56.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.301+0000 7f6d93e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c074e30 0x7f6d9c19abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:56.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.301+0000 7f6d99e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d9c074510 0x7f6d9c19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:56.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.301+0000 7f6d93e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c074e30 0x7f6d9c19abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56774/0 (socket says 172.21.15.12:56774) 2024-09-05T01:22:56.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.301+0000 7f6d93e00640 1 -- 172.21.15.12:0/3337850092 learned_addr learned my addr 172.21.15.12:0/3337850092 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:22:56.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.301+0000 7f6d9a800640 1 --2- 172.21.15.12:0/3337850092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d9c10e450 0x7f6d9c19ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:56.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.301+0000 7f6d93e00640 1 -- 172.21.15.12:0/3337850092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d9c10e450 msgr2=0x7f6d9c19ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:56.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.301+0000 7f6d93e00640 1 --2- 172.21.15.12:0/3337850092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d9c10e450 0x7f6d9c19ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:56.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.301+0000 7f6d93e00640 1 -- 172.21.15.12:0/3337850092 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d9c074510 msgr2=0x7f6d9c19a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:56.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.301+0000 7f6d93e00640 1 --2- 172.21.15.12:0/3337850092 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d9c074510 0x7f6d9c19a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:56.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.301+0000 7f6d93e00640 1 -- 172.21.15.12:0/3337850092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d9c19f640 con 0x7f6d9c074e30 2024-09-05T01:22:56.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.301+0000 7f6d93e00640 1 --2- 172.21.15.12:0/3337850092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c074e30 0x7f6d9c19abd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400e9c0 tx=0x7f6d8400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:56.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.302+0000 7f6d92a00640 1 -- 172.21.15.12:0/3337850092 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8400ccc0 con 0x7f6d9c074e30 2024-09-05T01:22:56.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.302+0000 7f6d92a00640 1 -- 172.21.15.12:0/3337850092 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d84005500 con 0x7f6d9c074e30 2024-09-05T01:22:56.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.302+0000 7f6da1000640 1 -- 172.21.15.12:0/3337850092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d9c19f930 con 0x7f6d9c074e30 2024-09-05T01:22:56.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.302+0000 7f6d92a00640 1 -- 172.21.15.12:0/3337850092 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d84010430 con 0x7f6d9c074e30 2024-09-05T01:22:56.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.302+0000 7f6da1000640 1 -- 172.21.15.12:0/3337850092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d9c1a7210 con 0x7f6d9c074e30 2024-09-05T01:22:56.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.303+0000 7f6da1000640 1 -- 172.21.15.12:0/3337850092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d9c0748f0 con 0x7f6d9c074e30 2024-09-05T01:22:56.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.305+0000 7f6d92a00640 1 -- 172.21.15.12:0/3337850092 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6d840046c0 con 0x7f6d9c074e30 2024-09-05T01:22:56.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.307+0000 7f6d92a00640 1 --2- 172.21.15.12:0/3337850092 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6d800a2c10 0x7f6d800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:56.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.307+0000 7f6d92a00640 1 -- 172.21.15.12:0/3337850092 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f6d840cf400 con 0x7f6d9c074e30 2024-09-05T01:22:56.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.307+0000 7f6d99e00640 1 --2- 172.21.15.12:0/3337850092 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6d800a2c10 0x7f6d800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:56.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.308+0000 7f6d99e00640 1 --2- 172.21.15.12:0/3337850092 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6d800a2c10 0x7f6d800a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c009830 tx=0x7f6d8c0094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:56.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.310+0000 7f6d92a00640 1 -- 172.21.15.12:0/3337850092 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6d8409c2b0 con 0x7f6d9c074e30 2024-09-05T01:22:56.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:55 smithi145 ceph-mon[34376]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:22:56.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:55 smithi151 ceph-mon[35013]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:22:56.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.519+0000 7f6da1000640 1 -- 172.21.15.12:0/3337850092 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f6d9c062630 con 0x7f6d800a2c10 2024-09-05T01:22:56.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.544+0000 7f6d92a00640 1 -- 172.21.15.12:0/3337850092 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6d9c062630 con 0x7f6d800a2c10 2024-09-05T01:22:56.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.547+0000 7f6da1000640 1 -- 172.21.15.12:0/3337850092 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6d800a2c10 msgr2=0x7f6d800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:56.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.547+0000 7f6da1000640 1 --2- 172.21.15.12:0/3337850092 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6d800a2c10 0x7f6d800a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c009830 tx=0x7f6d8c0094d0 comp rx=0 tx=0).stop 2024-09-05T01:22:56.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.547+0000 7f6da1000640 1 -- 172.21.15.12:0/3337850092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c074e30 msgr2=0x7f6d9c19abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:56.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.547+0000 7f6da1000640 1 --2- 172.21.15.12:0/3337850092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c074e30 0x7f6d9c19abd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6d8400e9c0 tx=0x7f6d8400ee80 comp rx=0 tx=0).stop 2024-09-05T01:22:56.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.547+0000 7f6da1000640 1 -- 172.21.15.12:0/3337850092 shutdown_connections 2024-09-05T01:22:56.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.547+0000 7f6da1000640 1 --2- 172.21.15.12:0/3337850092 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6d800a2c10 0x7f6d800a50d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:56.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.547+0000 7f6da1000640 1 --2- 172.21.15.12:0/3337850092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d9c10e450 0x7f6d9c19ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:56.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.547+0000 7f6da1000640 1 --2- 172.21.15.12:0/3337850092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c074e30 0x7f6d9c19abd0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:56.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.547+0000 7f6da1000640 1 --2- 172.21.15.12:0/3337850092 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d9c074510 0x7f6d9c19a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:56.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.547+0000 7f6da1000640 1 -- 172.21.15.12:0/3337850092 >> 172.21.15.12:0/3337850092 conn(0x7f6d9c0fd8b0 msgr2=0x7f6d9c0ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:56.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.547+0000 7f6da1000640 1 -- 172.21.15.12:0/3337850092 shutdown_connections 2024-09-05T01:22:56.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:56.547+0000 7f6da1000640 1 -- 172.21.15.12:0/3337850092 wait complete. 2024-09-05T01:22:57.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:56 smithi012 ceph-mon[29942]: pgmap v298: 97 pgs: 97 active+clean; 606 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.4 KiB/s wr, 23 op/s 2024-09-05T01:22:57.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:56 smithi145 ceph-mon[34376]: pgmap v298: 97 pgs: 97 active+clean; 606 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.4 KiB/s wr, 23 op/s 2024-09-05T01:22:57.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:56 smithi151 ceph-mon[35013]: pgmap v298: 97 pgs: 97 active+clean; 606 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.4 KiB/s wr, 23 op/s 2024-09-05T01:22:57.447 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-05T01:22:57.826 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:22:58.237 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:57 smithi012 ceph-mon[29942]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:22:58.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:57 smithi145 ceph-mon[34376]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:22:58.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:57 smithi151 ceph-mon[35013]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:22:58.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.354+0000 7fd539a00640 1 -- 172.21.15.12:0/2304743867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd53410e280 msgr2=0x7fd534110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:58.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.354+0000 7fd539a00640 1 --2- 172.21.15.12:0/2304743867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd53410e280 0x7fd534110670 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd52c009ca0 tx=0x7fd52c02a950 comp rx=0 tx=0).stop 2024-09-05T01:22:58.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.354+0000 7fd539a00640 1 -- 172.21.15.12:0/2304743867 shutdown_connections 2024-09-05T01:22:58.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.354+0000 7fd539a00640 1 --2- 172.21.15.12:0/2304743867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd53410e280 0x7fd534110670 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:58.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.354+0000 7fd539a00640 1 --2- 172.21.15.12:0/2304743867 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd534074e30 0x7fd53410dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:58.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.354+0000 7fd539a00640 1 --2- 172.21.15.12:0/2304743867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd534074510 0x7fd5340748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:58.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.354+0000 7fd539a00640 1 -- 172.21.15.12:0/2304743867 >> 172.21.15.12:0/2304743867 conn(0x7fd5340fd740 msgr2=0x7fd5340ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:58.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.354+0000 7fd539a00640 1 -- 172.21.15.12:0/2304743867 shutdown_connections 2024-09-05T01:22:58.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.354+0000 7fd539a00640 1 -- 172.21.15.12:0/2304743867 wait complete. 2024-09-05T01:22:58.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.355+0000 7fd539a00640 1 Processor -- start 2024-09-05T01:22:58.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.355+0000 7fd539a00640 1 -- start start 2024-09-05T01:22:58.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.356+0000 7fd539a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd534074510 0x7fd53419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:58.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.356+0000 7fd539a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd534074e30 0x7fd53419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:58.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.356+0000 7fd539a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd53410e280 0x7fd53419edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:58.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.356+0000 7fd539a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd534113fb0 con 0x7fd534074510 2024-09-05T01:22:58.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.356+0000 7fd539a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd534113e30 con 0x7fd534074e30 2024-09-05T01:22:58.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.356+0000 7fd539a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd534114130 con 0x7fd53410e280 2024-09-05T01:22:58.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.356+0000 7fd533e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd534074510 0x7fd53419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.356+0000 7fd533e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd534074510 0x7fd53419a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56088/0 (socket says 172.21.15.12:56088) 2024-09-05T01:22:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.356+0000 7fd533e00640 1 -- 172.21.15.12:0/3514480673 learned_addr learned my addr 172.21.15.12:0/3514480673 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:22:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.356+0000 7fd539000640 1 --2- 172.21.15.12:0/3514480673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd53410e280 0x7fd53419edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.356+0000 7fd52b400640 1 --2- 172.21.15.12:0/3514480673 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd534074e30 0x7fd53419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.356+0000 7fd533e00640 1 -- 172.21.15.12:0/3514480673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd53410e280 msgr2=0x7fd53419edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.356+0000 7fd533e00640 1 --2- 172.21.15.12:0/3514480673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd53410e280 0x7fd53419edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.356+0000 7fd533e00640 1 -- 172.21.15.12:0/3514480673 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd534074e30 msgr2=0x7fd53419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.356+0000 7fd533e00640 1 --2- 172.21.15.12:0/3514480673 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd534074e30 0x7fd53419aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.356+0000 7fd533e00640 1 -- 172.21.15.12:0/3514480673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd53419f4a0 con 0x7fd534074510 2024-09-05T01:22:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.357+0000 7fd533e00640 1 --2- 172.21.15.12:0/3514480673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd534074510 0x7fd53419a4f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd52400e9f0 tx=0x7fd52400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.357+0000 7fd531600640 1 -- 172.21.15.12:0/3514480673 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52400cd80 con 0x7fd534074510 2024-09-05T01:22:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.357+0000 7fd531600640 1 -- 172.21.15.12:0/3514480673 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd524005500 con 0x7fd534074510 2024-09-05T01:22:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.357+0000 7fd539a00640 1 -- 172.21.15.12:0/3514480673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd53419f790 con 0x7fd534074510 2024-09-05T01:22:58.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.357+0000 7fd531600640 1 -- 172.21.15.12:0/3514480673 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd524010690 con 0x7fd534074510 2024-09-05T01:22:58.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.357+0000 7fd539a00640 1 -- 172.21.15.12:0/3514480673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5341a7070 con 0x7fd534074510 2024-09-05T01:22:58.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.358+0000 7fd539a00640 1 -- 172.21.15.12:0/3514480673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5340748f0 con 0x7fd534074510 2024-09-05T01:22:58.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.360+0000 7fd531600640 1 -- 172.21.15.12:0/3514480673 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd5240046c0 con 0x7fd534074510 2024-09-05T01:22:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.362+0000 7fd531600640 1 --2- 172.21.15.12:0/3514480673 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd5180a2c10 0x7fd5180a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:22:58.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.362+0000 7fd531600640 1 -- 172.21.15.12:0/3514480673 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fd5240cf500 con 0x7fd534074510 2024-09-05T01:22:58.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.362+0000 7fd52b400640 1 --2- 172.21.15.12:0/3514480673 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd5180a2c10 0x7fd5180a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:22:58.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.363+0000 7fd52b400640 1 --2- 172.21.15.12:0/3514480673 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd5180a2c10 0x7fd5180a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd5340ffcf0 tx=0x7fd51c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:22:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.366+0000 7fd531600640 1 -- 172.21.15.12:0/3514480673 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd52409c3b0 con 0x7fd534074510 2024-09-05T01:22:58.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.582+0000 7fd539a00640 1 -- 172.21.15.12:0/3514480673 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fd534062630 con 0x7fd5180a2c10 2024-09-05T01:22:58.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.587+0000 7fd531600640 1 -- 172.21.15.12:0/3514480673 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fd534062630 con 0x7fd5180a2c10 2024-09-05T01:22:58.588 INFO:teuthology.orchestra.run.smithi012.stdout:/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491 2024-09-05T01:22:58.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.589+0000 7fd539a00640 1 -- 172.21.15.12:0/3514480673 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd5180a2c10 msgr2=0x7fd5180a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:58.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.589+0000 7fd539a00640 1 --2- 172.21.15.12:0/3514480673 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd5180a2c10 0x7fd5180a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd5340ffcf0 tx=0x7fd51c00b410 comp rx=0 tx=0).stop 2024-09-05T01:22:58.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.589+0000 7fd539a00640 1 -- 172.21.15.12:0/3514480673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd534074510 msgr2=0x7fd53419a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:22:58.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.589+0000 7fd539a00640 1 --2- 172.21.15.12:0/3514480673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd534074510 0x7fd53419a4f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd52400e9f0 tx=0x7fd52400edf0 comp rx=0 tx=0).stop 2024-09-05T01:22:58.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.589+0000 7fd539a00640 1 -- 172.21.15.12:0/3514480673 shutdown_connections 2024-09-05T01:22:58.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.589+0000 7fd539a00640 1 --2- 172.21.15.12:0/3514480673 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd5180a2c10 0x7fd5180a50d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:58.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.589+0000 7fd539a00640 1 --2- 172.21.15.12:0/3514480673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd53410e280 0x7fd53419edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:58.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.589+0000 7fd539a00640 1 --2- 172.21.15.12:0/3514480673 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd534074e30 0x7fd53419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:58.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.589+0000 7fd539a00640 1 --2- 172.21.15.12:0/3514480673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd534074510 0x7fd53419a4f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:22:58.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.589+0000 7fd539a00640 1 -- 172.21.15.12:0/3514480673 >> 172.21.15.12:0/3514480673 conn(0x7fd5340fd740 msgr2=0x7fd5340fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:22:58.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.590+0000 7fd539a00640 1 -- 172.21.15.12:0/3514480673 shutdown_connections 2024-09-05T01:22:58.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:22:58.590+0000 7fd539a00640 1 -- 172.21.15.12:0/3514480673 wait complete. 2024-09-05T01:22:59.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:58 smithi012 ceph-mon[29942]: pgmap v299: 97 pgs: 97 active+clean; 606 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.2 KiB/s wr, 23 op/s 2024-09-05T01:22:59.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:58 smithi145 ceph-mon[34376]: pgmap v299: 97 pgs: 97 active+clean; 606 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.2 KiB/s wr, 23 op/s 2024-09-05T01:22:59.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:58 smithi151 ceph-mon[35013]: pgmap v299: 97 pgs: 97 active+clean; 606 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.2 KiB/s wr, 23 op/s 2024-09-05T01:22:59.491 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:22:59.869 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:00.189 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:22:59 smithi012 ceph-mon[29942]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:23:00.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:22:59 smithi145 ceph-mon[34376]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:23:00.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:22:59 smithi151 ceph-mon[35013]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:23:00.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.407+0000 7fb019800640 1 -- 172.21.15.12:0/2633211722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0141049a0 msgr2=0x7fb0141089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:00.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.408+0000 7fb019800640 1 --2- 172.21.15.12:0/2633211722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0141049a0 0x7fb0141089f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faffc009900 tx=0x7faffc02a3f0 comp rx=0 tx=0).stop 2024-09-05T01:23:00.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.408+0000 7fb019800640 1 -- 172.21.15.12:0/2633211722 shutdown_connections 2024-09-05T01:23:00.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.408+0000 7fb019800640 1 --2- 172.21.15.12:0/2633211722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb014109120 0x7fb014110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:00.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.408+0000 7fb019800640 1 --2- 172.21.15.12:0/2633211722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0141049a0 0x7fb0141089f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:00.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.408+0000 7fb019800640 1 --2- 172.21.15.12:0/2633211722 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb014103ff0 0x7fb0141043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:00.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.408+0000 7fb019800640 1 -- 172.21.15.12:0/2633211722 >> 172.21.15.12:0/2633211722 conn(0x7fb0140ffa90 msgr2=0x7fb014101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:00.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.408+0000 7fb019800640 1 -- 172.21.15.12:0/2633211722 shutdown_connections 2024-09-05T01:23:00.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.408+0000 7fb019800640 1 -- 172.21.15.12:0/2633211722 wait complete. 2024-09-05T01:23:00.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.409+0000 7fb019800640 1 Processor -- start 2024-09-05T01:23:00.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.409+0000 7fb019800640 1 -- start start 2024-09-05T01:23:00.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.409+0000 7fb019800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb014103ff0 0x7fb01419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:00.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.409+0000 7fb019800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0141049a0 0x7fb01419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:00.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.409+0000 7fb019800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb014109120 0x7fb01419eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:00.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.409+0000 7fb019800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb014114190 con 0x7fb0141049a0 2024-09-05T01:23:00.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.409+0000 7fb019800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb014114010 con 0x7fb014103ff0 2024-09-05T01:23:00.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.409+0000 7fb019800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb014114310 con 0x7fb014109120 2024-09-05T01:23:00.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.409+0000 7fb00a000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0141049a0 0x7fb01419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:00.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.409+0000 7fb00a000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0141049a0 0x7fb01419ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56100/0 (socket says 172.21.15.12:56100) 2024-09-05T01:23:00.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.409+0000 7fb00a000640 1 -- 172.21.15.12:0/2883495659 learned_addr learned my addr 172.21.15.12:0/2883495659 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:00.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.409+0000 7fb013400640 1 --2- 172.21.15.12:0/2883495659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb014109120 0x7fb01419eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:00.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.409+0000 7fb012a00640 1 --2- 172.21.15.12:0/2883495659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb014103ff0 0x7fb01419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:00.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.410+0000 7fb00a000640 1 -- 172.21.15.12:0/2883495659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb014109120 msgr2=0x7fb01419eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:00.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.410+0000 7fb00a000640 1 --2- 172.21.15.12:0/2883495659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb014109120 0x7fb01419eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:00.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.410+0000 7fb00a000640 1 -- 172.21.15.12:0/2883495659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb014103ff0 msgr2=0x7fb01419a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:00.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.410+0000 7fb00a000640 1 --2- 172.21.15.12:0/2883495659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb014103ff0 0x7fb01419a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:00.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.410+0000 7fb00a000640 1 -- 172.21.15.12:0/2883495659 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01419f5a0 con 0x7fb0141049a0 2024-09-05T01:23:00.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.410+0000 7fb00a000640 1 --2- 172.21.15.12:0/2883495659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0141049a0 0x7fb01419ab30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faffc004770 tx=0x7faffc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:00.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.410+0000 7fb00be00640 1 -- 172.21.15.12:0/2883495659 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faffc03f070 con 0x7fb0141049a0 2024-09-05T01:23:00.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.411+0000 7fb00be00640 1 -- 172.21.15.12:0/2883495659 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faffc031ca0 con 0x7fb0141049a0 2024-09-05T01:23:00.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.411+0000 7fb019800640 1 -- 172.21.15.12:0/2883495659 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb01419f830 con 0x7fb0141049a0 2024-09-05T01:23:00.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.411+0000 7fb00be00640 1 -- 172.21.15.12:0/2883495659 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faffc035030 con 0x7fb0141049a0 2024-09-05T01:23:00.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.411+0000 7fb019800640 1 -- 172.21.15.12:0/2883495659 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0141a7170 con 0x7fb0141049a0 2024-09-05T01:23:00.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.412+0000 7fb019800640 1 -- 172.21.15.12:0/2883495659 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0141054d0 con 0x7fb0141049a0 2024-09-05T01:23:00.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.414+0000 7fb00be00640 1 -- 172.21.15.12:0/2883495659 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7faffc042070 con 0x7fb0141049a0 2024-09-05T01:23:00.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.415+0000 7fb00be00640 1 --2- 172.21.15.12:0/2883495659 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7faff80a2c10 0x7faff80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:00.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.415+0000 7fb00be00640 1 -- 172.21.15.12:0/2883495659 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7faffc0ef700 con 0x7fb0141049a0 2024-09-05T01:23:00.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.415+0000 7fb012a00640 1 --2- 172.21.15.12:0/2883495659 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7faff80a2c10 0x7faff80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:00.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.416+0000 7fb012a00640 1 --2- 172.21.15.12:0/2883495659 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7faff80a2c10 0x7faff80a50d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb0040095f0 tx=0x7fb004005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:00.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.419+0000 7fb00be00640 1 -- 172.21.15.12:0/2883495659 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faffc0bc020 con 0x7fb0141049a0 2024-09-05T01:23:00.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.641+0000 7fb019800640 1 -- 172.21.15.12:0/2883495659 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0141a7340 con 0x7fb0141049a0 2024-09-05T01:23:00.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.642+0000 7fb00be00640 1 -- 172.21.15.12:0/2883495659 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11979 (secure 0 0 0) 0x7faffc0c0320 con 0x7fb0141049a0 2024-09-05T01:23:00.643 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:23:00.643 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":27,"btime":"2024-09-05T01:22:48:868154+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14532,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/2949711075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":2949711075},{"type":"v1","addr":"172.21.15.12:6839","nonce":2949711075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T01:22:35.979384+0000","modified":"2024-09-05T01:22:47.915851+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24529,"mds_2":24524,"mds_3":24517,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/497406458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":497406458},{"type":"v1","addr":"172.21.15.12:6841","nonce":497406458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":10,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.145:6839/1706431882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":1706431882},{"type":"v1","addr":"172.21.15.145:6839","nonce":1706431882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24460,24517,24524,24529,24560]},"id":1}]} 2024-09-05T01:23:00.643 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 27 2024-09-05T01:23:00.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.644+0000 7fb019800640 1 -- 172.21.15.12:0/2883495659 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7faff80a2c10 msgr2=0x7faff80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:00.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.644+0000 7fb019800640 1 --2- 172.21.15.12:0/2883495659 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7faff80a2c10 0x7faff80a50d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb0040095f0 tx=0x7fb004005f90 comp rx=0 tx=0).stop 2024-09-05T01:23:00.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.644+0000 7fb019800640 1 -- 172.21.15.12:0/2883495659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0141049a0 msgr2=0x7fb01419ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:00.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.644+0000 7fb019800640 1 --2- 172.21.15.12:0/2883495659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0141049a0 0x7fb01419ab30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faffc004770 tx=0x7faffc003c10 comp rx=0 tx=0).stop 2024-09-05T01:23:00.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.644+0000 7fb019800640 1 -- 172.21.15.12:0/2883495659 shutdown_connections 2024-09-05T01:23:00.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.644+0000 7fb019800640 1 --2- 172.21.15.12:0/2883495659 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7faff80a2c10 0x7faff80a50d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:00.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.644+0000 7fb019800640 1 --2- 172.21.15.12:0/2883495659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb014109120 0x7fb01419eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:00.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.644+0000 7fb019800640 1 --2- 172.21.15.12:0/2883495659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0141049a0 0x7fb01419ab30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:00.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.644+0000 7fb019800640 1 --2- 172.21.15.12:0/2883495659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb014103ff0 0x7fb01419a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:00.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.644+0000 7fb019800640 1 -- 172.21.15.12:0/2883495659 >> 172.21.15.12:0/2883495659 conn(0x7fb0140ffa90 msgr2=0x7fb014101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:00.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.644+0000 7fb019800640 1 -- 172.21.15.12:0/2883495659 shutdown_connections 2024-09-05T01:23:00.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:00.645+0000 7fb019800640 1 -- 172.21.15.12:0/2883495659 wait complete. 2024-09-05T01:23:01.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:00 smithi012 ceph-mon[29942]: pgmap v300: 97 pgs: 97 active+clean; 630 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 KiB/s wr, 23 op/s 2024-09-05T01:23:01.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:00 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2883495659' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:23:01.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:00 smithi145 ceph-mon[34376]: pgmap v300: 97 pgs: 97 active+clean; 630 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 KiB/s wr, 23 op/s 2024-09-05T01:23:01.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:00 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/2883495659' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:23:01.354 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T01:23:01.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:00 smithi151 ceph-mon[35013]: pgmap v300: 97 pgs: 97 active+clean; 630 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 KiB/s wr, 23 op/s 2024-09-05T01:23:01.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:00 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/2883495659' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:23:01.730 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:02.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.262+0000 7f29a7e00640 1 -- 172.21.15.12:0/3935747781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a81079c0 msgr2=0x7f29a8107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.262+0000 7f29a7e00640 1 --2- 172.21.15.12:0/3935747781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a81079c0 0x7f29a8107da0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2998009930 tx=0x7f299802a420 comp rx=0 tx=0).stop 2024-09-05T01:23:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.262+0000 7f29a7e00640 1 -- 172.21.15.12:0/3935747781 shutdown_connections 2024-09-05T01:23:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.262+0000 7f29a7e00640 1 --2- 172.21.15.12:0/3935747781 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f29a8102360 0x7f29a810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.262+0000 7f29a7e00640 1 --2- 172.21.15.12:0/3935747781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29a81019c0 0x7f29a8101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.262+0000 7f29a7e00640 1 --2- 172.21.15.12:0/3935747781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a81079c0 0x7f29a8107da0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.262+0000 7f29a7e00640 1 -- 172.21.15.12:0/3935747781 >> 172.21.15.12:0/3935747781 conn(0x7f29a80fd740 msgr2=0x7f29a80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.262+0000 7f29a7e00640 1 -- 172.21.15.12:0/3935747781 shutdown_connections 2024-09-05T01:23:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.262+0000 7f29a7e00640 1 -- 172.21.15.12:0/3935747781 wait complete. 2024-09-05T01:23:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.263+0000 7f29a7e00640 1 Processor -- start 2024-09-05T01:23:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.263+0000 7f29a7e00640 1 -- start start 2024-09-05T01:23:02.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.264+0000 7f29a7e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a81019c0 0x7f29a80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:02.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.264+0000 7f29a7e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29a8102360 0x7f29a8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:02.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.264+0000 7f29a7e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f29a81079c0 0x7f29a8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:02.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.264+0000 7f29a7e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f29a8111dd0 con 0x7f29a81019c0 2024-09-05T01:23:02.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.264+0000 7f29a7e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f29a8111c50 con 0x7f29a81079c0 2024-09-05T01:23:02.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.264+0000 7f29a7e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f29a8111f50 con 0x7f29a8102360 2024-09-05T01:23:02.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.264+0000 7f29a6a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a81019c0 0x7f29a80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:02.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.264+0000 7f29a6a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a81019c0 0x7f29a80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56112/0 (socket says 172.21.15.12:56112) 2024-09-05T01:23:02.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.264+0000 7f29a6a00640 1 -- 172.21.15.12:0/1780765458 learned_addr learned my addr 172.21.15.12:0/1780765458 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:02.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.264+0000 7f29a6000640 1 --2- 172.21.15.12:0/1780765458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29a8102360 0x7f29a8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:02.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.264+0000 7f29a7400640 1 --2- 172.21.15.12:0/1780765458 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f29a81079c0 0x7f29a8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:02.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.265+0000 7f29a6a00640 1 -- 172.21.15.12:0/1780765458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29a8102360 msgr2=0x7f29a8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:02.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.265+0000 7f29a6a00640 1 --2- 172.21.15.12:0/1780765458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29a8102360 0x7f29a8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:02.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.265+0000 7f29a6a00640 1 -- 172.21.15.12:0/1780765458 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f29a81079c0 msgr2=0x7f29a8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:02.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.265+0000 7f29a6a00640 1 --2- 172.21.15.12:0/1780765458 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f29a81079c0 0x7f29a8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:02.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.265+0000 7f29a6a00640 1 -- 172.21.15.12:0/1780765458 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a81a6790 con 0x7f29a81019c0 2024-09-05T01:23:02.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.265+0000 7f29a7400640 1 --2- 172.21.15.12:0/1780765458 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f29a81079c0 0x7f29a8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:23:02.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.265+0000 7f29a6a00640 1 --2- 172.21.15.12:0/1780765458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a81019c0 0x7f29a80744f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f299802a940 tx=0x7f2998003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:02.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.265+0000 7f299f400640 1 -- 172.21.15.12:0/1780765458 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299803f070 con 0x7f29a81019c0 2024-09-05T01:23:02.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.265+0000 7f299f400640 1 -- 172.21.15.12:0/1780765458 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2998031c90 con 0x7f29a81019c0 2024-09-05T01:23:02.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.265+0000 7f299f400640 1 -- 172.21.15.12:0/1780765458 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2998035030 con 0x7f29a81019c0 2024-09-05T01:23:02.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.265+0000 7f29a7e00640 1 -- 172.21.15.12:0/1780765458 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29a81a6a20 con 0x7f29a81019c0 2024-09-05T01:23:02.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.266+0000 7f29a7e00640 1 -- 172.21.15.12:0/1780765458 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29a81a6eb0 con 0x7f29a81019c0 2024-09-05T01:23:02.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.267+0000 7f29a7e00640 1 -- 172.21.15.12:0/1780765458 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29a8101e20 con 0x7f29a81019c0 2024-09-05T01:23:02.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.268+0000 7f299f400640 1 -- 172.21.15.12:0/1780765458 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2998042070 con 0x7f29a81019c0 2024-09-05T01:23:02.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.270+0000 7f299f400640 1 --2- 172.21.15.12:0/1780765458 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f298c0a2c90 0x7f298c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:02.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.270+0000 7f299f400640 1 -- 172.21.15.12:0/1780765458 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f29980ef7e0 con 0x7f29a81019c0 2024-09-05T01:23:02.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.270+0000 7f29a6000640 1 --2- 172.21.15.12:0/1780765458 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f298c0a2c90 0x7f298c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:02.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.271+0000 7f29a6000640 1 --2- 172.21.15.12:0/1780765458 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f298c0a2c90 0x7f298c0a5150 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f29a8075f80 tx=0x7f2994005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:02.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.274+0000 7f299f400640 1 -- 172.21.15.12:0/1780765458 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f29980bc690 con 0x7f29a81019c0 2024-09-05T01:23:02.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.460+0000 7f29a7e00640 1 -- 172.21.15.12:0/1780765458 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29a802d7c0 con 0x7f29a81019c0 2024-09-05T01:23:02.462 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:02 smithi012 ceph-mon[29942]: pgmap v301: 97 pgs: 97 active+clean; 630 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.9 KiB/s wr, 12 op/s 2024-09-05T01:23:02.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.462+0000 7f299f400640 1 -- 172.21.15.12:0/1780765458 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22315 (secure 0 0 0) 0x7f29980bbf90 con 0x7f29a81019c0 2024-09-05T01:23:02.464 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:23:02.464 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":81,"fsid":"0d44cd7e-6b24-11ef-bcd6-c7b262605968","created":"2024-09-05T01:14:21.162850+0000","modified":"2024-09-05T01:22:35.979069+0000","last_up_change":"2024-09-05T01:21:37.145073+0000","last_in_change":"2024-09-05T01:21:15.076991+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T01:17:44.744065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T01:22:31.540178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T01:22:33.999318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b74ac640-b680-46e2-9106-d24168e685e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6803","nonce":2090563987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6805","nonce":2090563987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6809","nonce":2090563987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6807","nonce":2090563987}]},"public_addr":"172.21.15.12:6803/2090563987","cluster_addr":"172.21.15.12:6805/2090563987","heartbeat_back_addr":"172.21.15.12:6809/2090563987","heartbeat_front_addr":"172.21.15.12:6807/2090563987","state":["exists","up"]},{"osd":1,"uuid":"efca1216-8d85-4e6a-8c49-0afb511ece59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6801","nonce":2639126629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6803","nonce":2639126629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6807","nonce":2639126629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6805","nonce":2639126629}]},"public_addr":"172.21.15.145:6801/2639126629","cluster_addr":"172.21.15.145:6803/2639126629","heartbeat_back_addr":"172.21.15.145:6807/2639126629","heartbeat_front_addr":"172.21.15.145:6805/2639126629","state":["exists","up"]},{"osd":2,"uuid":"4d5699b2-646a-4ab6-94a5-ad223aa27ac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6801","nonce":3753171761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6803","nonce":3753171761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6807","nonce":3753171761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6805","nonce":3753171761}]},"public_addr":"172.21.15.151:6801/3753171761","cluster_addr":"172.21.15.151:6803/3753171761","heartbeat_back_addr":"172.21.15.151:6807/3753171761","heartbeat_front_addr":"172.21.15.151:6805/3753171761","state":["exists","up"]},{"osd":3,"uuid":"275ad2ad-93e6-4a68-8784-8f8dcb620f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6811","nonce":2231650146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6813","nonce":2231650146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6817","nonce":2231650146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6815","nonce":2231650146}]},"public_addr":"172.21.15.12:6811/2231650146","cluster_addr":"172.21.15.12:6813/2231650146","heartbeat_back_addr":"172.21.15.12:6817/2231650146","heartbeat_front_addr":"172.21.15.12:6815/2231650146","state":["exists","up"]},{"osd":4,"uuid":"21a0c5b4-4e0e-4fb6-8be6-a300cb811cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6809","nonce":1828591275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6811","nonce":1828591275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6815","nonce":1828591275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6813","nonce":1828591275}]},"public_addr":"172.21.15.145:6809/1828591275","cluster_addr":"172.21.15.145:6811/1828591275","heartbeat_back_addr":"172.21.15.145:6815/1828591275","heartbeat_front_addr":"172.21.15.145:6813/1828591275","state":["exists","up"]},{"osd":5,"uuid":"e2c7e6fb-5dea-459f-8d7a-7ae5b1936218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6809","nonce":3888870109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6811","nonce":3888870109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6815","nonce":3888870109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6813","nonce":3888870109}]},"public_addr":"172.21.15.151:6809/3888870109","cluster_addr":"172.21.15.151:6811/3888870109","heartbeat_back_addr":"172.21.15.151:6815/3888870109","heartbeat_front_addr":"172.21.15.151:6813/3888870109","state":["exists","up"]},{"osd":6,"uuid":"0df0a29c-3404-4ff5-ae48-78b69b77cbd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6819","nonce":3084810269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6821","nonce":3084810269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6825","nonce":3084810269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6823","nonce":3084810269}]},"public_addr":"172.21.15.12:6819/3084810269","cluster_addr":"172.21.15.12:6821/3084810269","heartbeat_back_addr":"172.21.15.12:6825/3084810269","heartbeat_front_addr":"172.21.15.12:6823/3084810269","state":["exists","up"]},{"osd":7,"uuid":"c7b3ad7c-a566-435c-9ef8-837bb764acb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6817","nonce":3058588721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6819","nonce":3058588721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6823","nonce":3058588721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6821","nonce":3058588721}]},"public_addr":"172.21.15.145:6817/3058588721","cluster_addr":"172.21.15.145:6819/3058588721","heartbeat_back_addr":"172.21.15.145:6823/3058588721","heartbeat_front_addr":"172.21.15.145:6821/3058588721","state":["exists","up"]},{"osd":8,"uuid":"8018a468-fbc5-4667-a53c-2e97c08713bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6817","nonce":905705309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6819","nonce":905705309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6823","nonce":905705309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6821","nonce":905705309}]},"public_addr":"172.21.15.151:6817/905705309","cluster_addr":"172.21.15.151:6819/905705309","heartbeat_back_addr":"172.21.15.151:6823/905705309","heartbeat_front_addr":"172.21.15.151:6821/905705309","state":["exists","up"]},{"osd":9,"uuid":"dcf3b524-c8b8-4ab6-83c6-fc52c776d72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6827","nonce":1193852496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6829","nonce":1193852496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6833","nonce":1193852496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6831","nonce":1193852496}]},"public_addr":"172.21.15.12:6827/1193852496","cluster_addr":"172.21.15.12:6829/1193852496","heartbeat_back_addr":"172.21.15.12:6833/1193852496","heartbeat_front_addr":"172.21.15.12:6831/1193852496","state":["exists","up"]},{"osd":10,"uuid":"7b5b34c3-8814-4d16-80ce-0b0c9be07cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6825","nonce":1296813755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6827","nonce":1296813755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6831","nonce":1296813755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6829","nonce":1296813755}]},"public_addr":"172.21.15.145:6825/1296813755","cluster_addr":"172.21.15.145:6827/1296813755","heartbeat_back_addr":"172.21.15.145:6831/1296813755","heartbeat_front_addr":"172.21.15.145:6829/1296813755","state":["exists","up"]},{"osd":11,"uuid":"157ee32a-43f0-4e5a-8dac-fce53c1efdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6825","nonce":2855185758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6827","nonce":2855185758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6831","nonce":2855185758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6829","nonce":2855185758}]},"public_addr":"172.21.15.151:6825/2855185758","cluster_addr":"172.21.15.151:6827/2855185758","heartbeat_back_addr":"172.21.15.151:6831/2855185758","heartbeat_front_addr":"172.21.15.151:6829/2855185758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:16:52.947222+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:17:17.845611+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:17:41.769521+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:10.848974+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:35.471340+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:59.554980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:19:28.908089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:19:53.540000+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:20:17.764886+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:20:46.835859+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:21:12.186176+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:21:35.863935+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/1132389058":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6801/4067110310":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/1040591124":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/1171838695":"2024-09-06T01:14:54.625209+0000","172.21.15.12:6800/4067110310":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/784506983":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/992405704":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6801/3541208629":"2024-09-06T01:14:54.625209+0000","172.21.15.12:6800/3541208629":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/1532325396":"2024-09-06T01:14:54.625209+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T01:23:02.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.465+0000 7f29a7e00640 1 -- 172.21.15.12:0/1780765458 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f298c0a2c90 msgr2=0x7f298c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:02.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.465+0000 7f29a7e00640 1 --2- 172.21.15.12:0/1780765458 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f298c0a2c90 0x7f298c0a5150 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f29a8075f80 tx=0x7f2994005f90 comp rx=0 tx=0).stop 2024-09-05T01:23:02.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.465+0000 7f29a7e00640 1 -- 172.21.15.12:0/1780765458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a81019c0 msgr2=0x7f29a80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:02.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.465+0000 7f29a7e00640 1 --2- 172.21.15.12:0/1780765458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a81019c0 0x7f29a80744f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f299802a940 tx=0x7f2998003b90 comp rx=0 tx=0).stop 2024-09-05T01:23:02.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.465+0000 7f29a7e00640 1 -- 172.21.15.12:0/1780765458 shutdown_connections 2024-09-05T01:23:02.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.465+0000 7f29a7e00640 1 --2- 172.21.15.12:0/1780765458 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f298c0a2c90 0x7f298c0a5150 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:02.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.465+0000 7f29a7e00640 1 --2- 172.21.15.12:0/1780765458 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f29a81079c0 0x7f29a8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:02.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.465+0000 7f29a7e00640 1 --2- 172.21.15.12:0/1780765458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29a8102360 0x7f29a8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:02.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.465+0000 7f29a7e00640 1 --2- 172.21.15.12:0/1780765458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29a81019c0 0x7f29a80744f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:02.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.465+0000 7f29a7e00640 1 -- 172.21.15.12:0/1780765458 >> 172.21.15.12:0/1780765458 conn(0x7f29a80fd740 msgr2=0x7f29a80fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:02.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.465+0000 7f29a7e00640 1 -- 172.21.15.12:0/1780765458 shutdown_connections 2024-09-05T01:23:02.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:02.465+0000 7f29a7e00640 1 -- 172.21.15.12:0/1780765458 wait complete. 2024-09-05T01:23:02.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:02 smithi145 ceph-mon[34376]: pgmap v301: 97 pgs: 97 active+clean; 630 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.9 KiB/s wr, 12 op/s 2024-09-05T01:23:02.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:02 smithi151 ceph-mon[35013]: pgmap v301: 97 pgs: 97 active+clean; 630 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.9 KiB/s wr, 12 op/s 2024-09-05T01:23:03.218 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-05T01:23:03.218 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph pg dump --format=json 2024-09-05T01:23:03.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:03 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/1780765458' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:23:03.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:03 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/1780765458' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:23:03.596 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:03.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:03 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/1780765458' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:23:04.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.293+0000 7f9862600640 1 -- 172.21.15.12:0/3400600865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f985c112a50 msgr2=0x7f985c114e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:04.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.293+0000 7f9862600640 1 --2- 172.21.15.12:0/3400600865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f985c112a50 0x7f985c114e40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9854009ca0 tx=0x7f985402a8c0 comp rx=0 tx=0).stop 2024-09-05T01:23:04.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.293+0000 7f9862600640 1 -- 172.21.15.12:0/3400600865 shutdown_connections 2024-09-05T01:23:04.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.293+0000 7f9862600640 1 --2- 172.21.15.12:0/3400600865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f985c112a50 0x7f985c114e40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:04.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.293+0000 7f9862600640 1 --2- 172.21.15.12:0/3400600865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f985c077040 0x7f985c112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:04.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.293+0000 7f9862600640 1 --2- 172.21.15.12:0/3400600865 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f985c076720 0x7f985c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.293+0000 7f9862600640 1 -- 172.21.15.12:0/3400600865 >> 172.21.15.12:0/3400600865 conn(0x7f985c0ffa50 msgr2=0x7f985c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.293+0000 7f9862600640 1 -- 172.21.15.12:0/3400600865 shutdown_connections 2024-09-05T01:23:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.294+0000 7f9862600640 1 -- 172.21.15.12:0/3400600865 wait complete. 2024-09-05T01:23:04.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.294+0000 7f9862600640 1 Processor -- start 2024-09-05T01:23:04.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.295+0000 7f9862600640 1 -- start start 2024-09-05T01:23:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.295+0000 7f9862600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f985c076720 0x7f985c19eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.295+0000 7f9862600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f985c077040 0x7f985c19f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.295+0000 7f9862600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f985c112a50 0x7f985c1a3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.295+0000 7f9862600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f985c118600 con 0x7f985c112a50 2024-09-05T01:23:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.295+0000 7f9862600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f985c118480 con 0x7f985c076720 2024-09-05T01:23:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.295+0000 7f9862600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f985c118780 con 0x7f985c077040 2024-09-05T01:23:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.295+0000 7f985be00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f985c112a50 0x7f985c1a3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.295+0000 7f985be00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f985c112a50 0x7f985c1a3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56130/0 (socket says 172.21.15.12:56130) 2024-09-05T01:23:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.295+0000 7f985be00640 1 -- 172.21.15.12:0/2074032055 learned_addr learned my addr 172.21.15.12:0/2074032055 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.295+0000 7f985b400640 1 --2- 172.21.15.12:0/2074032055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f985c076720 0x7f985c19eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.295+0000 7f9852a00640 1 --2- 172.21.15.12:0/2074032055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f985c077040 0x7f985c19f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:04.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.296+0000 7f9852a00640 1 -- 172.21.15.12:0/2074032055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f985c076720 msgr2=0x7f985c19eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:04.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.296+0000 7f9852a00640 1 --2- 172.21.15.12:0/2074032055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f985c076720 0x7f985c19eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:04.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.296+0000 7f9852a00640 1 -- 172.21.15.12:0/2074032055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f985c112a50 msgr2=0x7f985c1a3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:04.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.296+0000 7f9852a00640 1 --2- 172.21.15.12:0/2074032055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f985c112a50 0x7f985c1a3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:04.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.296+0000 7f9852a00640 1 -- 172.21.15.12:0/2074032055 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985c1a3b90 con 0x7f985c077040 2024-09-05T01:23:04.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.296+0000 7f985be00640 1 --2- 172.21.15.12:0/2074032055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f985c112a50 0x7f985c1a3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:23:04.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.296+0000 7f985b400640 1 --2- 172.21.15.12:0/2074032055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f985c076720 0x7f985c19eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:23:04.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.296+0000 7f9852a00640 1 --2- 172.21.15.12:0/2074032055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f985c077040 0x7f985c19f0a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f984400d720 tx=0x7f984400dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:04.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.296+0000 7f9858c00640 1 -- 172.21.15.12:0/2074032055 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9844017070 con 0x7f985c077040 2024-09-05T01:23:04.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.296+0000 7f9858c00640 1 -- 172.21.15.12:0/2074032055 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f984400de30 con 0x7f985c077040 2024-09-05T01:23:04.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.296+0000 7f9858c00640 1 -- 172.21.15.12:0/2074032055 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9844004dd0 con 0x7f985c077040 2024-09-05T01:23:04.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.297+0000 7f9862600640 1 -- 172.21.15.12:0/2074032055 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f985c1a3e80 con 0x7f985c077040 2024-09-05T01:23:04.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.297+0000 7f9862600640 1 -- 172.21.15.12:0/2074032055 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f985c1ab710 con 0x7f985c077040 2024-09-05T01:23:04.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.298+0000 7f9862600640 1 -- 172.21.15.12:0/2074032055 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f985c076b00 con 0x7f985c077040 2024-09-05T01:23:04.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.300+0000 7f9858c00640 1 -- 172.21.15.12:0/2074032055 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9844004f70 con 0x7f985c077040 2024-09-05T01:23:04.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.301+0000 7f9858c00640 1 --2- 172.21.15.12:0/2074032055 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f98400a2c90 0x7f98400a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:04.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.302+0000 7f9858c00640 1 -- 172.21.15.12:0/2074032055 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f98440ce8d0 con 0x7f985c077040 2024-09-05T01:23:04.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.302+0000 7f985b400640 1 --2- 172.21.15.12:0/2074032055 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f98400a2c90 0x7f98400a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:04.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.302+0000 7f985b400640 1 --2- 172.21.15.12:0/2074032055 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f98400a2c90 0x7f98400a5150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f984c00bfd0 tx=0x7f984c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:04.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.306+0000 7f9858c00640 1 -- 172.21.15.12:0/2074032055 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f984409b130 con 0x7f985c077040 2024-09-05T01:23:04.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.489+0000 7f9862600640 1 -- 172.21.15.12:0/2074032055 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f985c1146c0 con 0x7f98400a2c90 2024-09-05T01:23:04.491 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:04 smithi012 ceph-mon[29942]: pgmap v302: 97 pgs: 97 active+clean; 630 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.7 KiB/s wr, 12 op/s 2024-09-05T01:23:04.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.497+0000 7f9858c00640 1 -- 172.21.15.12:0/2074032055 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258750 (secure 0 0 0) 0x7f985c1146c0 con 0x7f98400a2c90 2024-09-05T01:23:04.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:23:04.505 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-05T01:23:04.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.502+0000 7f9862600640 1 -- 172.21.15.12:0/2074032055 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f98400a2c90 msgr2=0x7f98400a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:04.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.502+0000 7f9862600640 1 --2- 172.21.15.12:0/2074032055 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f98400a2c90 0x7f98400a5150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f984c00bfd0 tx=0x7f984c00b390 comp rx=0 tx=0).stop 2024-09-05T01:23:04.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.502+0000 7f9862600640 1 -- 172.21.15.12:0/2074032055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f985c077040 msgr2=0x7f985c19f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:04.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.502+0000 7f9862600640 1 --2- 172.21.15.12:0/2074032055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f985c077040 0x7f985c19f0a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f984400d720 tx=0x7f984400dbe0 comp rx=0 tx=0).stop 2024-09-05T01:23:04.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.502+0000 7f9862600640 1 -- 172.21.15.12:0/2074032055 shutdown_connections 2024-09-05T01:23:04.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.502+0000 7f9862600640 1 --2- 172.21.15.12:0/2074032055 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f98400a2c90 0x7f98400a5150 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:04.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.502+0000 7f9862600640 1 --2- 172.21.15.12:0/2074032055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f985c112a50 0x7f985c1a3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:04.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.502+0000 7f9862600640 1 --2- 172.21.15.12:0/2074032055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f985c077040 0x7f985c19f0a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:04.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.502+0000 7f9862600640 1 --2- 172.21.15.12:0/2074032055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f985c076720 0x7f985c19eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:04.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.502+0000 7f9862600640 1 -- 172.21.15.12:0/2074032055 >> 172.21.15.12:0/2074032055 conn(0x7f985c0ffa50 msgr2=0x7f985c101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:04.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.502+0000 7f9862600640 1 -- 172.21.15.12:0/2074032055 shutdown_connections 2024-09-05T01:23:04.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:04.502+0000 7f9862600640 1 -- 172.21.15.12:0/2074032055 wait complete. 2024-09-05T01:23:04.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:04 smithi145 ceph-mon[34376]: pgmap v302: 97 pgs: 97 active+clean; 630 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.7 KiB/s wr, 12 op/s 2024-09-05T01:23:04.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:04 smithi151 ceph-mon[35013]: pgmap v302: 97 pgs: 97 active+clean; 630 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.7 KiB/s wr, 12 op/s 2024-09-05T01:23:05.321 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":302,"stamp":"2024-09-05T01:23:04.187575+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":645005,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":320,"num_read_kb":272,"num_write":418,"num_write_kb":3058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":341,"ondisk_log_size":341,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370024,"kb_used_data":12456,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571800,"statfs":{"total":1151940427776,"available":1151561523200,"internally_reserved":0,"allocated":12754944,"data_stored":6970671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46210,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":105,"num_write":31,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003001"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.020299+0000","last_change":"2024-09-05T01:22:35.038389+0000","last_active":"2024-09-05T01:22:36.020299+0000","last_peered":"2024-09-05T01:22:36.020299+0000","last_clean":"2024-09-05T01:22:36.020299+0000","last_became_active":"2024-09-05T01:22:35.037982+0000","last_became_peered":"2024-09-05T01:22:35.037982+0000","last_unstale":"2024-09-05T01:22:36.020299+0000","last_undegraded":"2024-09-05T01:22:36.020299+0000","last_fullsized":"2024-09-05T01:22:36.020299+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:23:33.802592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.037848+0000","last_change":"2024-09-05T01:22:35.035340+0000","last_active":"2024-09-05T01:22:36.037848+0000","last_peered":"2024-09-05T01:22:36.037848+0000","last_clean":"2024-09-05T01:22:36.037848+0000","last_became_active":"2024-09-05T01:22:35.032871+0000","last_became_peered":"2024-09-05T01:22:35.032871+0000","last_unstale":"2024-09-05T01:22:36.037848+0000","last_undegraded":"2024-09-05T01:22:36.037848+0000","last_fullsized":"2024-09-05T01:22:36.037848+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:51:07.235915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.037774+0000","last_change":"2024-09-05T01:22:35.045443+0000","last_active":"2024-09-05T01:22:36.037774+0000","last_peered":"2024-09-05T01:22:36.037774+0000","last_clean":"2024-09-05T01:22:36.037774+0000","last_became_active":"2024-09-05T01:22:35.042342+0000","last_became_peered":"2024-09-05T01:22:35.042342+0000","last_unstale":"2024-09-05T01:22:36.037774+0000","last_undegraded":"2024-09-05T01:22:36.037774+0000","last_fullsized":"2024-09-05T01:22:36.037774+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:42:46.878959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034099+0000","last_change":"2024-09-05T01:22:35.041527+0000","last_active":"2024-09-05T01:22:36.034099+0000","last_peered":"2024-09-05T01:22:36.034099+0000","last_clean":"2024-09-05T01:22:36.034099+0000","last_became_active":"2024-09-05T01:22:35.041210+0000","last_became_peered":"2024-09-05T01:22:35.041210+0000","last_unstale":"2024-09-05T01:22:36.034099+0000","last_undegraded":"2024-09-05T01:22:36.034099+0000","last_fullsized":"2024-09-05T01:22:36.034099+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:22:28.770307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.033454+0000","last_change":"2024-09-05T01:22:35.036810+0000","last_active":"2024-09-05T01:22:36.033454+0000","last_peered":"2024-09-05T01:22:36.033454+0000","last_clean":"2024-09-05T01:22:36.033454+0000","last_became_active":"2024-09-05T01:22:35.036435+0000","last_became_peered":"2024-09-05T01:22:35.036435+0000","last_unstale":"2024-09-05T01:22:36.033454+0000","last_undegraded":"2024-09-05T01:22:36.033454+0000","last_fullsized":"2024-09-05T01:22:36.033454+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:41:43.649178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.021028+0000","last_change":"2024-09-05T01:22:35.039198+0000","last_active":"2024-09-05T01:22:36.021028+0000","last_peered":"2024-09-05T01:22:36.021028+0000","last_clean":"2024-09-05T01:22:36.021028+0000","last_became_active":"2024-09-05T01:22:35.038822+0000","last_became_peered":"2024-09-05T01:22:35.038822+0000","last_unstale":"2024-09-05T01:22:36.021028+0000","last_undegraded":"2024-09-05T01:22:36.021028+0000","last_fullsized":"2024-09-05T01:22:36.021028+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:22:08.600927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.037330+0000","last_change":"2024-09-05T01:22:35.034687+0000","last_active":"2024-09-05T01:22:36.037330+0000","last_peered":"2024-09-05T01:22:36.037330+0000","last_clean":"2024-09-05T01:22:36.037330+0000","last_became_active":"2024-09-05T01:22:35.034351+0000","last_became_peered":"2024-09-05T01:22:35.034351+0000","last_unstale":"2024-09-05T01:22:36.037330+0000","last_undegraded":"2024-09-05T01:22:36.037330+0000","last_fullsized":"2024-09-05T01:22:36.037330+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:38:27.311348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.033911+0000","last_change":"2024-09-05T01:22:35.039919+0000","last_active":"2024-09-05T01:22:36.033911+0000","last_peered":"2024-09-05T01:22:36.033911+0000","last_clean":"2024-09-05T01:22:36.033911+0000","last_became_active":"2024-09-05T01:22:35.038939+0000","last_became_peered":"2024-09-05T01:22:35.038939+0000","last_unstale":"2024-09-05T01:22:36.033911+0000","last_undegraded":"2024-09-05T01:22:36.033911+0000","last_fullsized":"2024-09-05T01:22:36.033911+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:19:40.304016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034216+0000","last_change":"2024-09-05T01:22:35.036394+0000","last_active":"2024-09-05T01:22:36.034216+0000","last_peered":"2024-09-05T01:22:36.034216+0000","last_clean":"2024-09-05T01:22:36.034216+0000","last_became_active":"2024-09-05T01:22:35.035990+0000","last_became_peered":"2024-09-05T01:22:35.035990+0000","last_unstale":"2024-09-05T01:22:36.034216+0000","last_undegraded":"2024-09-05T01:22:36.034216+0000","last_fullsized":"2024-09-05T01:22:36.034216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:42:18.870263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.021488+0000","last_change":"2024-09-05T01:22:35.033389+0000","last_active":"2024-09-05T01:22:36.021488+0000","last_peered":"2024-09-05T01:22:36.021488+0000","last_clean":"2024-09-05T01:22:36.021488+0000","last_became_active":"2024-09-05T01:22:35.033081+0000","last_became_peered":"2024-09-05T01:22:35.033081+0000","last_unstale":"2024-09-05T01:22:36.021488+0000","last_undegraded":"2024-09-05T01:22:36.021488+0000","last_fullsized":"2024-09-05T01:22:36.021488+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:53:08.266905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.038780+0000","last_change":"2024-09-05T01:22:35.035768+0000","last_active":"2024-09-05T01:22:36.038780+0000","last_peered":"2024-09-05T01:22:36.038780+0000","last_clean":"2024-09-05T01:22:36.038780+0000","last_became_active":"2024-09-05T01:22:35.035456+0000","last_became_peered":"2024-09-05T01:22:35.035456+0000","last_unstale":"2024-09-05T01:22:36.038780+0000","last_undegraded":"2024-09-05T01:22:36.038780+0000","last_fullsized":"2024-09-05T01:22:36.038780+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:15:48.723816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034266+0000","last_change":"2024-09-05T01:22:35.040720+0000","last_active":"2024-09-05T01:22:36.034266+0000","last_peered":"2024-09-05T01:22:36.034266+0000","last_clean":"2024-09-05T01:22:36.034266+0000","last_became_active":"2024-09-05T01:22:35.039617+0000","last_became_peered":"2024-09-05T01:22:35.039617+0000","last_unstale":"2024-09-05T01:22:36.034266+0000","last_undegraded":"2024-09-05T01:22:36.034266+0000","last_fullsized":"2024-09-05T01:22:36.034266+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:23:11.633617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.019057+0000","last_change":"2024-09-05T01:22:35.022096+0000","last_active":"2024-09-05T01:22:36.019057+0000","last_peered":"2024-09-05T01:22:36.019057+0000","last_clean":"2024-09-05T01:22:36.019057+0000","last_became_active":"2024-09-05T01:22:35.021707+0000","last_became_peered":"2024-09-05T01:22:35.021707+0000","last_unstale":"2024-09-05T01:22:36.019057+0000","last_undegraded":"2024-09-05T01:22:36.019057+0000","last_fullsized":"2024-09-05T01:22:36.019057+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:50:35.035386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.037289+0000","last_change":"2024-09-05T01:22:35.034481+0000","last_active":"2024-09-05T01:22:36.037289+0000","last_peered":"2024-09-05T01:22:36.037289+0000","last_clean":"2024-09-05T01:22:36.037289+0000","last_became_active":"2024-09-05T01:22:35.034145+0000","last_became_peered":"2024-09-05T01:22:35.034145+0000","last_unstale":"2024-09-05T01:22:36.037289+0000","last_undegraded":"2024-09-05T01:22:36.037289+0000","last_fullsized":"2024-09-05T01:22:36.037289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:19:33.386981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.037163+0000","last_change":"2024-09-05T01:22:35.040970+0000","last_active":"2024-09-05T01:22:36.037163+0000","last_peered":"2024-09-05T01:22:36.037163+0000","last_clean":"2024-09-05T01:22:36.037163+0000","last_became_active":"2024-09-05T01:22:35.039024+0000","last_became_peered":"2024-09-05T01:22:35.039024+0000","last_unstale":"2024-09-05T01:22:36.037163+0000","last_undegraded":"2024-09-05T01:22:36.037163+0000","last_fullsized":"2024-09-05T01:22:36.037163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:44:08.608295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.033309+0000","last_change":"2024-09-05T01:22:35.046517+0000","last_active":"2024-09-05T01:22:36.033309+0000","last_peered":"2024-09-05T01:22:36.033309+0000","last_clean":"2024-09-05T01:22:36.033309+0000","last_became_active":"2024-09-05T01:22:35.046230+0000","last_became_peered":"2024-09-05T01:22:35.046230+0000","last_unstale":"2024-09-05T01:22:36.033309+0000","last_undegraded":"2024-09-05T01:22:36.033309+0000","last_fullsized":"2024-09-05T01:22:36.033309+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:16:49.672039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.020269+0000","last_change":"2024-09-05T01:22:35.041140+0000","last_active":"2024-09-05T01:22:36.020269+0000","last_peered":"2024-09-05T01:22:36.020269+0000","last_clean":"2024-09-05T01:22:36.020269+0000","last_became_active":"2024-09-05T01:22:35.040838+0000","last_became_peered":"2024-09-05T01:22:35.040838+0000","last_unstale":"2024-09-05T01:22:36.020269+0000","last_undegraded":"2024-09-05T01:22:36.020269+0000","last_fullsized":"2024-09-05T01:22:36.020269+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:47:55.730240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034643+0000","last_change":"2024-09-05T01:22:35.036830+0000","last_active":"2024-09-05T01:22:36.034643+0000","last_peered":"2024-09-05T01:22:36.034643+0000","last_clean":"2024-09-05T01:22:36.034643+0000","last_became_active":"2024-09-05T01:22:35.036356+0000","last_became_peered":"2024-09-05T01:22:35.036356+0000","last_unstale":"2024-09-05T01:22:36.034643+0000","last_undegraded":"2024-09-05T01:22:36.034643+0000","last_fullsized":"2024-09-05T01:22:36.034643+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:19:01.736301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034148+0000","last_change":"2024-09-05T01:22:35.036386+0000","last_active":"2024-09-05T01:22:36.034148+0000","last_peered":"2024-09-05T01:22:36.034148+0000","last_clean":"2024-09-05T01:22:36.034148+0000","last_became_active":"2024-09-05T01:22:35.036046+0000","last_became_peered":"2024-09-05T01:22:35.036046+0000","last_unstale":"2024-09-05T01:22:36.034148+0000","last_undegraded":"2024-09-05T01:22:36.034148+0000","last_fullsized":"2024-09-05T01:22:36.034148+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:19:37.861719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.019980+0000","last_change":"2024-09-05T01:22:35.041077+0000","last_active":"2024-09-05T01:22:36.019980+0000","last_peered":"2024-09-05T01:22:36.019980+0000","last_clean":"2024-09-05T01:22:36.019980+0000","last_became_active":"2024-09-05T01:22:35.040736+0000","last_became_peered":"2024-09-05T01:22:35.040736+0000","last_unstale":"2024-09-05T01:22:36.019980+0000","last_undegraded":"2024-09-05T01:22:36.019980+0000","last_fullsized":"2024-09-05T01:22:36.019980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:30:54.670559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.019036+0000","last_change":"2024-09-05T01:22:35.047774+0000","last_active":"2024-09-05T01:22:36.019036+0000","last_peered":"2024-09-05T01:22:36.019036+0000","last_clean":"2024-09-05T01:22:36.019036+0000","last_became_active":"2024-09-05T01:22:35.047153+0000","last_became_peered":"2024-09-05T01:22:35.047153+0000","last_unstale":"2024-09-05T01:22:36.019036+0000","last_undegraded":"2024-09-05T01:22:36.019036+0000","last_fullsized":"2024-09-05T01:22:36.019036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:07:02.189116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.033431+0000","last_change":"2024-09-05T01:22:35.041346+0000","last_active":"2024-09-05T01:22:36.033431+0000","last_peered":"2024-09-05T01:22:36.033431+0000","last_clean":"2024-09-05T01:22:36.033431+0000","last_became_active":"2024-09-05T01:22:35.040282+0000","last_became_peered":"2024-09-05T01:22:35.040282+0000","last_unstale":"2024-09-05T01:22:36.033431+0000","last_undegraded":"2024-09-05T01:22:36.033431+0000","last_fullsized":"2024-09-05T01:22:36.033431+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:19:38.203479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034008+0000","last_change":"2024-09-05T01:22:35.041780+0000","last_active":"2024-09-05T01:22:36.034008+0000","last_peered":"2024-09-05T01:22:36.034008+0000","last_clean":"2024-09-05T01:22:36.034008+0000","last_became_active":"2024-09-05T01:22:35.038453+0000","last_became_peered":"2024-09-05T01:22:35.038453+0000","last_unstale":"2024-09-05T01:22:36.034008+0000","last_undegraded":"2024-09-05T01:22:36.034008+0000","last_fullsized":"2024-09-05T01:22:36.034008+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:17:56.453627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.037436+0000","last_change":"2024-09-05T01:22:35.038699+0000","last_active":"2024-09-05T01:22:36.037436+0000","last_peered":"2024-09-05T01:22:36.037436+0000","last_clean":"2024-09-05T01:22:36.037436+0000","last_became_active":"2024-09-05T01:22:35.038349+0000","last_became_peered":"2024-09-05T01:22:35.038349+0000","last_unstale":"2024-09-05T01:22:36.037436+0000","last_undegraded":"2024-09-05T01:22:36.037436+0000","last_fullsized":"2024-09-05T01:22:36.037436+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:17:18.175643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034696+0000","last_change":"2024-09-05T01:22:35.048281+0000","last_active":"2024-09-05T01:22:36.034696+0000","last_peered":"2024-09-05T01:22:36.034696+0000","last_clean":"2024-09-05T01:22:36.034696+0000","last_became_active":"2024-09-05T01:22:35.047211+0000","last_became_peered":"2024-09-05T01:22:35.047211+0000","last_unstale":"2024-09-05T01:22:36.034696+0000","last_undegraded":"2024-09-05T01:22:36.034696+0000","last_fullsized":"2024-09-05T01:22:36.034696+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:40:43.196562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.035439+0000","last_change":"2024-09-05T01:22:35.041215+0000","last_active":"2024-09-05T01:22:36.035439+0000","last_peered":"2024-09-05T01:22:36.035439+0000","last_clean":"2024-09-05T01:22:36.035439+0000","last_became_active":"2024-09-05T01:22:35.040156+0000","last_became_peered":"2024-09-05T01:22:35.040156+0000","last_unstale":"2024-09-05T01:22:36.035439+0000","last_undegraded":"2024-09-05T01:22:36.035439+0000","last_fullsized":"2024-09-05T01:22:36.035439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:39:01.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.020170+0000","last_change":"2024-09-05T01:22:35.035089+0000","last_active":"2024-09-05T01:22:36.020170+0000","last_peered":"2024-09-05T01:22:36.020170+0000","last_clean":"2024-09-05T01:22:36.020170+0000","last_became_active":"2024-09-05T01:22:35.034781+0000","last_became_peered":"2024-09-05T01:22:35.034781+0000","last_unstale":"2024-09-05T01:22:36.020170+0000","last_undegraded":"2024-09-05T01:22:36.020170+0000","last_fullsized":"2024-09-05T01:22:36.020170+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:31:02.766395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.019043+0000","last_change":"2024-09-05T01:22:35.038147+0000","last_active":"2024-09-05T01:22:36.019043+0000","last_peered":"2024-09-05T01:22:36.019043+0000","last_clean":"2024-09-05T01:22:36.019043+0000","last_became_active":"2024-09-05T01:22:35.037772+0000","last_became_peered":"2024-09-05T01:22:35.037772+0000","last_unstale":"2024-09-05T01:22:36.019043+0000","last_undegraded":"2024-09-05T01:22:36.019043+0000","last_fullsized":"2024-09-05T01:22:36.019043+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:40:01.786788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.037679+0000","last_change":"2024-09-05T01:22:35.049040+0000","last_active":"2024-09-05T01:22:36.037679+0000","last_peered":"2024-09-05T01:22:36.037679+0000","last_clean":"2024-09-05T01:22:36.037679+0000","last_became_active":"2024-09-05T01:22:35.048373+0000","last_became_peered":"2024-09-05T01:22:35.048373+0000","last_unstale":"2024-09-05T01:22:36.037679+0000","last_undegraded":"2024-09-05T01:22:36.037679+0000","last_fullsized":"2024-09-05T01:22:36.037679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:32:17.316513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.033853+0000","last_change":"2024-09-05T01:22:35.043531+0000","last_active":"2024-09-05T01:22:36.033853+0000","last_peered":"2024-09-05T01:22:36.033853+0000","last_clean":"2024-09-05T01:22:36.033853+0000","last_became_active":"2024-09-05T01:22:35.043145+0000","last_became_peered":"2024-09-05T01:22:35.043145+0000","last_unstale":"2024-09-05T01:22:36.033853+0000","last_undegraded":"2024-09-05T01:22:36.033853+0000","last_fullsized":"2024-09-05T01:22:36.033853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:04:41.902738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.033942+0000","last_change":"2024-09-05T01:22:35.037684+0000","last_active":"2024-09-05T01:22:36.033942+0000","last_peered":"2024-09-05T01:22:36.033942+0000","last_clean":"2024-09-05T01:22:36.033942+0000","last_became_active":"2024-09-05T01:22:35.037392+0000","last_became_peered":"2024-09-05T01:22:35.037392+0000","last_unstale":"2024-09-05T01:22:36.033942+0000","last_undegraded":"2024-09-05T01:22:36.033942+0000","last_fullsized":"2024-09-05T01:22:36.033942+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:12:37.705198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.020209+0000","last_change":"2024-09-05T01:22:35.036917+0000","last_active":"2024-09-05T01:22:36.020209+0000","last_peered":"2024-09-05T01:22:36.020209+0000","last_clean":"2024-09-05T01:22:36.020209+0000","last_became_active":"2024-09-05T01:22:35.036597+0000","last_became_peered":"2024-09-05T01:22:35.036597+0000","last_unstale":"2024-09-05T01:22:36.020209+0000","last_undegraded":"2024-09-05T01:22:36.020209+0000","last_fullsized":"2024-09-05T01:22:36.020209+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:25:46.472325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.033577+0000","last_change":"2024-09-05T01:22:35.035858+0000","last_active":"2024-09-05T01:22:36.033577+0000","last_peered":"2024-09-05T01:22:36.033577+0000","last_clean":"2024-09-05T01:22:36.033577+0000","last_became_active":"2024-09-05T01:22:35.035075+0000","last_became_peered":"2024-09-05T01:22:35.035075+0000","last_unstale":"2024-09-05T01:22:36.033577+0000","last_undegraded":"2024-09-05T01:22:36.033577+0000","last_fullsized":"2024-09-05T01:22:36.033577+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:49:42.487427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'6","reported_seq":43,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:23:00.885378+0000","last_change":"2024-09-05T01:22:32.615444+0000","last_active":"2024-09-05T01:23:00.885378+0000","last_peered":"2024-09-05T01:23:00.885378+0000","last_clean":"2024-09-05T01:23:00.885378+0000","last_became_active":"2024-09-05T01:22:32.615026+0000","last_became_peered":"2024-09-05T01:22:32.615026+0000","last_unstale":"2024-09-05T01:23:00.885378+0000","last_undegraded":"2024-09-05T01:23:00.885378+0000","last_fullsized":"2024-09-05T01:23:00.885378+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:52:51.410953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.035132+0000","last_change":"2024-09-05T01:22:35.039341+0000","last_active":"2024-09-05T01:22:36.035132+0000","last_peered":"2024-09-05T01:22:36.035132+0000","last_clean":"2024-09-05T01:22:36.035132+0000","last_became_active":"2024-09-05T01:22:35.038911+0000","last_became_peered":"2024-09-05T01:22:35.038911+0000","last_unstale":"2024-09-05T01:22:36.035132+0000","last_undegraded":"2024-09-05T01:22:36.035132+0000","last_fullsized":"2024-09-05T01:22:36.035132+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:18:41.735302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'7","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.097949+0000","last_change":"2024-09-05T01:22:32.610256+0000","last_active":"2024-09-05T01:22:46.097949+0000","last_peered":"2024-09-05T01:22:46.097949+0000","last_clean":"2024-09-05T01:22:46.097949+0000","last_became_active":"2024-09-05T01:22:32.609430+0000","last_became_peered":"2024-09-05T01:22:32.609430+0000","last_unstale":"2024-09-05T01:22:46.097949+0000","last_undegraded":"2024-09-05T01:22:46.097949+0000","last_fullsized":"2024-09-05T01:22:46.097949+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:00:13.171249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:45.088868+0000","last_change":"2024-09-05T01:22:32.609238+0000","last_active":"2024-09-05T01:22:45.088868+0000","last_peered":"2024-09-05T01:22:45.088868+0000","last_clean":"2024-09-05T01:22:45.088868+0000","last_became_active":"2024-09-05T01:22:32.608789+0000","last_became_peered":"2024-09-05T01:22:32.608789+0000","last_unstale":"2024-09-05T01:22:45.088868+0000","last_undegraded":"2024-09-05T01:22:45.088868+0000","last_fullsized":"2024-09-05T01:22:45.088868+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:01:55.536313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034034+0000","last_change":"2024-09-05T01:22:35.048262+0000","last_active":"2024-09-05T01:22:36.034034+0000","last_peered":"2024-09-05T01:22:36.034034+0000","last_clean":"2024-09-05T01:22:36.034034+0000","last_became_active":"2024-09-05T01:22:35.046404+0000","last_became_peered":"2024-09-05T01:22:35.046404+0000","last_unstale":"2024-09-05T01:22:36.034034+0000","last_undegraded":"2024-09-05T01:22:36.034034+0000","last_fullsized":"2024-09-05T01:22:36.034034+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:29:04.310095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.864880+0000","last_change":"2024-09-05T01:22:32.612116+0000","last_active":"2024-09-05T01:22:46.864880+0000","last_peered":"2024-09-05T01:22:46.864880+0000","last_clean":"2024-09-05T01:22:46.864880+0000","last_became_active":"2024-09-05T01:22:32.611794+0000","last_became_peered":"2024-09-05T01:22:32.611794+0000","last_unstale":"2024-09-05T01:22:46.864880+0000","last_undegraded":"2024-09-05T01:22:46.864880+0000","last_fullsized":"2024-09-05T01:22:46.864880+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:59:55.360151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.033421+0000","last_change":"2024-09-05T01:22:35.038895+0000","last_active":"2024-09-05T01:22:36.033421+0000","last_peered":"2024-09-05T01:22:36.033421+0000","last_clean":"2024-09-05T01:22:36.033421+0000","last_became_active":"2024-09-05T01:22:35.038535+0000","last_became_peered":"2024-09-05T01:22:35.038535+0000","last_unstale":"2024-09-05T01:22:36.033421+0000","last_undegraded":"2024-09-05T01:22:36.033421+0000","last_fullsized":"2024-09-05T01:22:36.033421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:49:03.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'4","reported_seq":48,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:58.881558+0000","last_change":"2024-09-05T01:22:32.611558+0000","last_active":"2024-09-05T01:22:58.881558+0000","last_peered":"2024-09-05T01:22:58.881558+0000","last_clean":"2024-09-05T01:22:58.881558+0000","last_became_active":"2024-09-05T01:22:32.611194+0000","last_became_peered":"2024-09-05T01:22:32.611194+0000","last_unstale":"2024-09-05T01:22:58.881558+0000","last_undegraded":"2024-09-05T01:22:58.881558+0000","last_fullsized":"2024-09-05T01:22:58.881558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:47:30.586224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034299+0000","last_change":"2024-09-05T01:22:35.042010+0000","last_active":"2024-09-05T01:22:36.034299+0000","last_peered":"2024-09-05T01:22:36.034299+0000","last_clean":"2024-09-05T01:22:36.034299+0000","last_became_active":"2024-09-05T01:22:35.041451+0000","last_became_peered":"2024-09-05T01:22:35.041451+0000","last_unstale":"2024-09-05T01:22:36.034299+0000","last_undegraded":"2024-09-05T01:22:36.034299+0000","last_fullsized":"2024-09-05T01:22:36.034299+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:12:15.429065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.869499+0000","last_change":"2024-09-05T01:22:32.612131+0000","last_active":"2024-09-05T01:22:46.869499+0000","last_peered":"2024-09-05T01:22:46.869499+0000","last_clean":"2024-09-05T01:22:46.869499+0000","last_became_active":"2024-09-05T01:22:32.611778+0000","last_became_peered":"2024-09-05T01:22:32.611778+0000","last_unstale":"2024-09-05T01:22:46.869499+0000","last_undegraded":"2024-09-05T01:22:46.869499+0000","last_fullsized":"2024-09-05T01:22:46.869499+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:18:21.930485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.038263+0000","last_change":"2024-09-05T01:22:35.047663+0000","last_active":"2024-09-05T01:22:36.038263+0000","last_peered":"2024-09-05T01:22:36.038263+0000","last_clean":"2024-09-05T01:22:36.038263+0000","last_became_active":"2024-09-05T01:22:35.047078+0000","last_became_peered":"2024-09-05T01:22:35.047078+0000","last_unstale":"2024-09-05T01:22:36.038263+0000","last_undegraded":"2024-09-05T01:22:36.038263+0000","last_fullsized":"2024-09-05T01:22:36.038263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:44.992459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.098351+0000","last_change":"2024-09-05T01:22:33.064617+0000","last_active":"2024-09-05T01:22:46.098351+0000","last_peered":"2024-09-05T01:22:46.098351+0000","last_clean":"2024-09-05T01:22:46.098351+0000","last_became_active":"2024-09-05T01:22:33.064265+0000","last_became_peered":"2024-09-05T01:22:33.064265+0000","last_unstale":"2024-09-05T01:22:46.098351+0000","last_undegraded":"2024-09-05T01:22:46.098351+0000","last_fullsized":"2024-09-05T01:22:46.098351+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:43:57.315764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034104+0000","last_change":"2024-09-05T01:22:35.047109+0000","last_active":"2024-09-05T01:22:36.034104+0000","last_peered":"2024-09-05T01:22:36.034104+0000","last_clean":"2024-09-05T01:22:36.034104+0000","last_became_active":"2024-09-05T01:22:35.046806+0000","last_became_peered":"2024-09-05T01:22:35.046806+0000","last_unstale":"2024-09-05T01:22:36.034104+0000","last_undegraded":"2024-09-05T01:22:36.034104+0000","last_fullsized":"2024-09-05T01:22:36.034104+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:19:42.743038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'24","reported_seq":74,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:58.888244+0000","last_change":"2024-09-05T01:22:32.610883+0000","last_active":"2024-09-05T01:22:58.888244+0000","last_peered":"2024-09-05T01:22:58.888244+0000","last_clean":"2024-09-05T01:22:58.888244+0000","last_became_active":"2024-09-05T01:22:32.610530+0000","last_became_peered":"2024-09-05T01:22:32.610530+0000","last_unstale":"2024-09-05T01:22:58.888244+0000","last_undegraded":"2024-09-05T01:22:58.888244+0000","last_fullsized":"2024-09-05T01:22:58.888244+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:51:01.111529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":61,"num_write":26,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034451+0000","last_change":"2024-09-05T01:22:35.032397+0000","last_active":"2024-09-05T01:22:36.034451+0000","last_peered":"2024-09-05T01:22:36.034451+0000","last_clean":"2024-09-05T01:22:36.034451+0000","last_became_active":"2024-09-05T01:22:35.032073+0000","last_became_peered":"2024-09-05T01:22:35.032073+0000","last_unstale":"2024-09-05T01:22:36.034451+0000","last_undegraded":"2024-09-05T01:22:36.034451+0000","last_fullsized":"2024-09-05T01:22:36.034451+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:36:02.866390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.871501+0000","last_change":"2024-09-05T01:22:32.610247+0000","last_active":"2024-09-05T01:22:46.871501+0000","last_peered":"2024-09-05T01:22:46.871501+0000","last_clean":"2024-09-05T01:22:46.871501+0000","last_became_active":"2024-09-05T01:22:32.609881+0000","last_became_peered":"2024-09-05T01:22:32.609881+0000","last_unstale":"2024-09-05T01:22:46.871501+0000","last_undegraded":"2024-09-05T01:22:46.871501+0000","last_fullsized":"2024-09-05T01:22:46.871501+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:40:39.835208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.018832+0000","last_change":"2024-09-05T01:22:35.041923+0000","last_active":"2024-09-05T01:22:36.018832+0000","last_peered":"2024-09-05T01:22:36.018832+0000","last_clean":"2024-09-05T01:22:36.018832+0000","last_became_active":"2024-09-05T01:22:35.041439+0000","last_became_peered":"2024-09-05T01:22:35.041439+0000","last_unstale":"2024-09-05T01:22:36.018832+0000","last_undegraded":"2024-09-05T01:22:36.018832+0000","last_fullsized":"2024-09-05T01:22:36.018832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:36:56.545466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.871258+0000","last_change":"2024-09-05T01:22:32.611274+0000","last_active":"2024-09-05T01:22:46.871258+0000","last_peered":"2024-09-05T01:22:46.871258+0000","last_clean":"2024-09-05T01:22:46.871258+0000","last_became_active":"2024-09-05T01:22:32.610853+0000","last_became_peered":"2024-09-05T01:22:32.610853+0000","last_unstale":"2024-09-05T01:22:46.871258+0000","last_undegraded":"2024-09-05T01:22:46.871258+0000","last_fullsized":"2024-09-05T01:22:46.871258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:01:38.058836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.038612+0000","last_change":"2024-09-05T01:22:35.040116+0000","last_active":"2024-09-05T01:22:36.038612+0000","last_peered":"2024-09-05T01:22:36.038612+0000","last_clean":"2024-09-05T01:22:36.038612+0000","last_became_active":"2024-09-05T01:22:35.037663+0000","last_became_peered":"2024-09-05T01:22:35.037663+0000","last_unstale":"2024-09-05T01:22:36.038612+0000","last_undegraded":"2024-09-05T01:22:36.038612+0000","last_fullsized":"2024-09-05T01:22:36.038612+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:16:37.309205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'6","reported_seq":44,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:23:01.887396+0000","last_change":"2024-09-05T01:22:32.612334+0000","last_active":"2024-09-05T01:23:01.887396+0000","last_peered":"2024-09-05T01:23:01.887396+0000","last_clean":"2024-09-05T01:23:01.887396+0000","last_became_active":"2024-09-05T01:22:32.612008+0000","last_became_peered":"2024-09-05T01:22:32.612008+0000","last_unstale":"2024-09-05T01:23:01.887396+0000","last_undegraded":"2024-09-05T01:23:01.887396+0000","last_fullsized":"2024-09-05T01:23:01.887396+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:31:05.580219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.037447+0000","last_change":"2024-09-05T01:22:35.037034+0000","last_active":"2024-09-05T01:22:36.037447+0000","last_peered":"2024-09-05T01:22:36.037447+0000","last_clean":"2024-09-05T01:22:36.037447+0000","last_became_active":"2024-09-05T01:22:35.036643+0000","last_became_peered":"2024-09-05T01:22:35.036643+0000","last_unstale":"2024-09-05T01:22:36.037447+0000","last_undegraded":"2024-09-05T01:22:36.037447+0000","last_fullsized":"2024-09-05T01:22:36.037447+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:41:24.073298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.861407+0000","last_change":"2024-09-05T01:22:33.064918+0000","last_active":"2024-09-05T01:22:46.861407+0000","last_peered":"2024-09-05T01:22:46.861407+0000","last_clean":"2024-09-05T01:22:46.861407+0000","last_became_active":"2024-09-05T01:22:33.064611+0000","last_became_peered":"2024-09-05T01:22:33.064611+0000","last_unstale":"2024-09-05T01:22:46.861407+0000","last_undegraded":"2024-09-05T01:22:46.861407+0000","last_fullsized":"2024-09-05T01:22:46.861407+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:25:37.129263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034840+0000","last_change":"2024-09-05T01:22:35.039866+0000","last_active":"2024-09-05T01:22:36.034840+0000","last_peered":"2024-09-05T01:22:36.034840+0000","last_clean":"2024-09-05T01:22:36.034840+0000","last_became_active":"2024-09-05T01:22:35.039493+0000","last_became_peered":"2024-09-05T01:22:35.039493+0000","last_unstale":"2024-09-05T01:22:36.034840+0000","last_undegraded":"2024-09-05T01:22:36.034840+0000","last_fullsized":"2024-09-05T01:22:36.034840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:39:20.036455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.083237+0000","last_change":"2024-09-05T01:22:32.610948+0000","last_active":"2024-09-05T01:22:46.083237+0000","last_peered":"2024-09-05T01:22:46.083237+0000","last_clean":"2024-09-05T01:22:46.083237+0000","last_became_active":"2024-09-05T01:22:32.610596+0000","last_became_peered":"2024-09-05T01:22:32.610596+0000","last_unstale":"2024-09-05T01:22:46.083237+0000","last_undegraded":"2024-09-05T01:22:46.083237+0000","last_fullsized":"2024-09-05T01:22:46.083237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:36:25.589705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.020167+0000","last_change":"2024-09-05T01:22:35.038595+0000","last_active":"2024-09-05T01:22:36.020167+0000","last_peered":"2024-09-05T01:22:36.020167+0000","last_clean":"2024-09-05T01:22:36.020167+0000","last_became_active":"2024-09-05T01:22:35.038271+0000","last_became_peered":"2024-09-05T01:22:35.038271+0000","last_unstale":"2024-09-05T01:22:36.020167+0000","last_undegraded":"2024-09-05T01:22:36.020167+0000","last_fullsized":"2024-09-05T01:22:36.020167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:51:17.652270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.873116+0000","last_change":"2024-09-05T01:22:32.609555+0000","last_active":"2024-09-05T01:22:46.873116+0000","last_peered":"2024-09-05T01:22:46.873116+0000","last_clean":"2024-09-05T01:22:46.873116+0000","last_became_active":"2024-09-05T01:22:32.608448+0000","last_became_peered":"2024-09-05T01:22:32.608448+0000","last_unstale":"2024-09-05T01:22:46.873116+0000","last_undegraded":"2024-09-05T01:22:46.873116+0000","last_fullsized":"2024-09-05T01:22:46.873116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:13:27.724664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.039045+0000","last_change":"2024-09-05T01:22:35.033418+0000","last_active":"2024-09-05T01:22:36.039045+0000","last_peered":"2024-09-05T01:22:36.039045+0000","last_clean":"2024-09-05T01:22:36.039045+0000","last_became_active":"2024-09-05T01:22:35.033096+0000","last_became_peered":"2024-09-05T01:22:35.033096+0000","last_unstale":"2024-09-05T01:22:36.039045+0000","last_undegraded":"2024-09-05T01:22:36.039045+0000","last_fullsized":"2024-09-05T01:22:36.039045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:09:06.723427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.861635+0000","last_change":"2024-09-05T01:22:32.609821+0000","last_active":"2024-09-05T01:22:46.861635+0000","last_peered":"2024-09-05T01:22:46.861635+0000","last_clean":"2024-09-05T01:22:46.861635+0000","last_became_active":"2024-09-05T01:22:32.608932+0000","last_became_peered":"2024-09-05T01:22:32.608932+0000","last_unstale":"2024-09-05T01:22:46.861635+0000","last_undegraded":"2024-09-05T01:22:46.861635+0000","last_fullsized":"2024-09-05T01:22:46.861635+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:45:19.964263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.207481+0000","last_change":"2024-09-05T01:22:35.037965+0000","last_active":"2024-09-05T01:22:36.207481+0000","last_peered":"2024-09-05T01:22:36.207481+0000","last_clean":"2024-09-05T01:22:36.207481+0000","last_became_active":"2024-09-05T01:22:35.037541+0000","last_became_peered":"2024-09-05T01:22:35.037541+0000","last_unstale":"2024-09-05T01:22:36.207481+0000","last_undegraded":"2024-09-05T01:22:36.207481+0000","last_fullsized":"2024-09-05T01:22:36.207481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:43:29.098517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'5","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:57.880773+0000","last_change":"2024-09-05T01:22:33.064771+0000","last_active":"2024-09-05T01:22:57.880773+0000","last_peered":"2024-09-05T01:22:57.880773+0000","last_clean":"2024-09-05T01:22:57.880773+0000","last_became_active":"2024-09-05T01:22:33.064320+0000","last_became_peered":"2024-09-05T01:22:33.064320+0000","last_unstale":"2024-09-05T01:22:57.880773+0000","last_undegraded":"2024-09-05T01:22:57.880773+0000","last_fullsized":"2024-09-05T01:22:57.880773+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:59:41.612210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.038395+0000","last_change":"2024-09-05T01:22:35.035868+0000","last_active":"2024-09-05T01:22:36.038395+0000","last_peered":"2024-09-05T01:22:36.038395+0000","last_clean":"2024-09-05T01:22:36.038395+0000","last_became_active":"2024-09-05T01:22:35.035495+0000","last_became_peered":"2024-09-05T01:22:35.035495+0000","last_unstale":"2024-09-05T01:22:36.038395+0000","last_undegraded":"2024-09-05T01:22:36.038395+0000","last_fullsized":"2024-09-05T01:22:36.038395+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:13:25.679973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":340,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.038625+0000","last_change":"2024-09-05T01:21:17.107509+0000","last_active":"2024-09-05T01:22:36.038625+0000","last_peered":"2024-09-05T01:22:36.038625+0000","last_clean":"2024-09-05T01:22:36.038625+0000","last_became_active":"2024-09-05T01:21:17.107063+0000","last_became_peered":"2024-09-05T01:21:17.107063+0000","last_unstale":"2024-09-05T01:22:36.038625+0000","last_undegraded":"2024-09-05T01:22:36.038625+0000","last_fullsized":"2024-09-05T01:22:36.038625+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:17:44.744654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:17:44.744654+0000","last_clean_scrub_stamp":"2024-09-05T01:17:44.744654+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:14:18.603051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.872019+0000","last_change":"2024-09-05T01:22:32.610686+0000","last_active":"2024-09-05T01:22:46.872019+0000","last_peered":"2024-09-05T01:22:46.872019+0000","last_clean":"2024-09-05T01:22:46.872019+0000","last_became_active":"2024-09-05T01:22:32.610248+0000","last_became_peered":"2024-09-05T01:22:32.610248+0000","last_unstale":"2024-09-05T01:22:46.872019+0000","last_undegraded":"2024-09-05T01:22:46.872019+0000","last_fullsized":"2024-09-05T01:22:46.872019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:14:09.468772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034214+0000","last_change":"2024-09-05T01:22:35.044346+0000","last_active":"2024-09-05T01:22:36.034214+0000","last_peered":"2024-09-05T01:22:36.034214+0000","last_clean":"2024-09-05T01:22:36.034214+0000","last_became_active":"2024-09-05T01:22:35.043977+0000","last_became_peered":"2024-09-05T01:22:35.043977+0000","last_unstale":"2024-09-05T01:22:36.034214+0000","last_undegraded":"2024-09-05T01:22:36.034214+0000","last_fullsized":"2024-09-05T01:22:36.034214+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:03:33.007905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:45.086975+0000","last_change":"2024-09-05T01:22:32.615120+0000","last_active":"2024-09-05T01:22:45.086975+0000","last_peered":"2024-09-05T01:22:45.086975+0000","last_clean":"2024-09-05T01:22:45.086975+0000","last_became_active":"2024-09-05T01:22:32.614671+0000","last_became_peered":"2024-09-05T01:22:32.614671+0000","last_unstale":"2024-09-05T01:22:45.086975+0000","last_undegraded":"2024-09-05T01:22:45.086975+0000","last_fullsized":"2024-09-05T01:22:45.086975+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:00:00.134610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.018808+0000","last_change":"2024-09-05T01:22:35.035840+0000","last_active":"2024-09-05T01:22:36.018808+0000","last_peered":"2024-09-05T01:22:36.018808+0000","last_clean":"2024-09-05T01:22:36.018808+0000","last_became_active":"2024-09-05T01:22:35.035511+0000","last_became_peered":"2024-09-05T01:22:35.035511+0000","last_unstale":"2024-09-05T01:22:36.018808+0000","last_undegraded":"2024-09-05T01:22:36.018808+0000","last_fullsized":"2024-09-05T01:22:36.018808+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:30:01.929816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:23:00.885596+0000","last_change":"2024-09-05T01:22:33.064281+0000","last_active":"2024-09-05T01:23:00.885596+0000","last_peered":"2024-09-05T01:23:00.885596+0000","last_clean":"2024-09-05T01:23:00.885596+0000","last_became_active":"2024-09-05T01:22:33.063792+0000","last_became_peered":"2024-09-05T01:22:33.063792+0000","last_unstale":"2024-09-05T01:23:00.885596+0000","last_undegraded":"2024-09-05T01:23:00.885596+0000","last_fullsized":"2024-09-05T01:23:00.885596+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:44:19.558140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.037590+0000","last_change":"2024-09-05T01:22:35.035336+0000","last_active":"2024-09-05T01:22:36.037590+0000","last_peered":"2024-09-05T01:22:36.037590+0000","last_clean":"2024-09-05T01:22:36.037590+0000","last_became_active":"2024-09-05T01:22:35.034976+0000","last_became_peered":"2024-09-05T01:22:35.034976+0000","last_unstale":"2024-09-05T01:22:36.037590+0000","last_undegraded":"2024-09-05T01:22:36.037590+0000","last_fullsized":"2024-09-05T01:22:36.037590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:51:57.850225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"81'6","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:59.892818+0000","last_change":"2024-09-05T01:22:32.614203+0000","last_active":"2024-09-05T01:22:59.892818+0000","last_peered":"2024-09-05T01:22:59.892818+0000","last_clean":"2024-09-05T01:22:59.892818+0000","last_became_active":"2024-09-05T01:22:32.613774+0000","last_became_peered":"2024-09-05T01:22:32.613774+0000","last_unstale":"2024-09-05T01:22:59.892818+0000","last_undegraded":"2024-09-05T01:22:59.892818+0000","last_fullsized":"2024-09-05T01:22:59.892818+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:52:05.383835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.021545+0000","last_change":"2024-09-05T01:22:35.042770+0000","last_active":"2024-09-05T01:22:36.021545+0000","last_peered":"2024-09-05T01:22:36.021545+0000","last_clean":"2024-09-05T01:22:36.021545+0000","last_became_active":"2024-09-05T01:22:35.042338+0000","last_became_peered":"2024-09-05T01:22:35.042338+0000","last_unstale":"2024-09-05T01:22:36.021545+0000","last_undegraded":"2024-09-05T01:22:36.021545+0000","last_fullsized":"2024-09-05T01:22:36.021545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:02:35.669717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034432+0000","last_change":"2024-09-05T01:22:33.065134+0000","last_active":"2024-09-05T01:22:36.034432+0000","last_peered":"2024-09-05T01:22:36.034432+0000","last_clean":"2024-09-05T01:22:36.034432+0000","last_became_active":"2024-09-05T01:22:33.064685+0000","last_became_peered":"2024-09-05T01:22:33.064685+0000","last_unstale":"2024-09-05T01:22:36.034432+0000","last_undegraded":"2024-09-05T01:22:36.034432+0000","last_fullsized":"2024-09-05T01:22:36.034432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:03:00.976350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.021517+0000","last_change":"2024-09-05T01:22:35.035940+0000","last_active":"2024-09-05T01:22:36.021517+0000","last_peered":"2024-09-05T01:22:36.021517+0000","last_clean":"2024-09-05T01:22:36.021517+0000","last_became_active":"2024-09-05T01:22:35.035582+0000","last_became_peered":"2024-09-05T01:22:35.035582+0000","last_unstale":"2024-09-05T01:22:36.021517+0000","last_undegraded":"2024-09-05T01:22:36.021517+0000","last_fullsized":"2024-09-05T01:22:36.021517+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:37:06.621512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.861711+0000","last_change":"2024-09-05T01:22:33.064003+0000","last_active":"2024-09-05T01:22:46.861711+0000","last_peered":"2024-09-05T01:22:46.861711+0000","last_clean":"2024-09-05T01:22:46.861711+0000","last_became_active":"2024-09-05T01:22:33.063685+0000","last_became_peered":"2024-09-05T01:22:33.063685+0000","last_unstale":"2024-09-05T01:22:46.861711+0000","last_undegraded":"2024-09-05T01:22:46.861711+0000","last_fullsized":"2024-09-05T01:22:46.861711+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:49:03.742215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.019253+0000","last_change":"2024-09-05T01:22:35.034912+0000","last_active":"2024-09-05T01:22:36.019253+0000","last_peered":"2024-09-05T01:22:36.019253+0000","last_clean":"2024-09-05T01:22:36.019253+0000","last_became_active":"2024-09-05T01:22:35.034526+0000","last_became_peered":"2024-09-05T01:22:35.034526+0000","last_unstale":"2024-09-05T01:22:36.019253+0000","last_undegraded":"2024-09-05T01:22:36.019253+0000","last_fullsized":"2024-09-05T01:22:36.019253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:06:00.000162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'13","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:23:00.035541+0000","last_change":"2024-09-05T01:22:32.610123+0000","last_active":"2024-09-05T01:23:00.035541+0000","last_peered":"2024-09-05T01:23:00.035541+0000","last_clean":"2024-09-05T01:23:00.035541+0000","last_became_active":"2024-09-05T01:22:32.608901+0000","last_became_peered":"2024-09-05T01:22:32.608901+0000","last_unstale":"2024-09-05T01:23:00.035541+0000","last_undegraded":"2024-09-05T01:23:00.035541+0000","last_fullsized":"2024-09-05T01:23:00.035541+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:13:10.691546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034916+0000","last_change":"2024-09-05T01:22:35.038184+0000","last_active":"2024-09-05T01:22:36.034916+0000","last_peered":"2024-09-05T01:22:36.034916+0000","last_clean":"2024-09-05T01:22:36.034916+0000","last_became_active":"2024-09-05T01:22:35.036702+0000","last_became_peered":"2024-09-05T01:22:35.036702+0000","last_unstale":"2024-09-05T01:22:36.034916+0000","last_undegraded":"2024-09-05T01:22:36.034916+0000","last_fullsized":"2024-09-05T01:22:36.034916+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:43:53.813358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.872684+0000","last_change":"2024-09-05T01:22:32.663209+0000","last_active":"2024-09-05T01:22:46.872684+0000","last_peered":"2024-09-05T01:22:46.872684+0000","last_clean":"2024-09-05T01:22:46.872684+0000","last_became_active":"2024-09-05T01:22:32.662928+0000","last_became_peered":"2024-09-05T01:22:32.662928+0000","last_unstale":"2024-09-05T01:22:46.872684+0000","last_undegraded":"2024-09-05T01:22:46.872684+0000","last_fullsized":"2024-09-05T01:22:46.872684+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:10:57.677344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.038158+0000","last_change":"2024-09-05T01:22:35.046550+0000","last_active":"2024-09-05T01:22:36.038158+0000","last_peered":"2024-09-05T01:22:36.038158+0000","last_clean":"2024-09-05T01:22:36.038158+0000","last_became_active":"2024-09-05T01:22:35.046247+0000","last_became_peered":"2024-09-05T01:22:35.046247+0000","last_unstale":"2024-09-05T01:22:36.038158+0000","last_undegraded":"2024-09-05T01:22:36.038158+0000","last_fullsized":"2024-09-05T01:22:36.038158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:00:45.859788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:44.076803+0000","last_change":"2024-09-05T01:22:33.064832+0000","last_active":"2024-09-05T01:22:44.076803+0000","last_peered":"2024-09-05T01:22:44.076803+0000","last_clean":"2024-09-05T01:22:44.076803+0000","last_became_active":"2024-09-05T01:22:33.064405+0000","last_became_peered":"2024-09-05T01:22:33.064405+0000","last_unstale":"2024-09-05T01:22:44.076803+0000","last_undegraded":"2024-09-05T01:22:44.076803+0000","last_fullsized":"2024-09-05T01:22:44.076803+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:48:43.093325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.033404+0000","last_change":"2024-09-05T01:22:35.030670+0000","last_active":"2024-09-05T01:22:36.033404+0000","last_peered":"2024-09-05T01:22:36.033404+0000","last_clean":"2024-09-05T01:22:36.033404+0000","last_became_active":"2024-09-05T01:22:35.030338+0000","last_became_peered":"2024-09-05T01:22:35.030338+0000","last_unstale":"2024-09-05T01:22:36.033404+0000","last_undegraded":"2024-09-05T01:22:36.033404+0000","last_fullsized":"2024-09-05T01:22:36.033404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:22:51.832965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.872270+0000","last_change":"2024-09-05T01:22:32.612040+0000","last_active":"2024-09-05T01:22:46.872270+0000","last_peered":"2024-09-05T01:22:46.872270+0000","last_clean":"2024-09-05T01:22:46.872270+0000","last_became_active":"2024-09-05T01:22:32.610597+0000","last_became_peered":"2024-09-05T01:22:32.610597+0000","last_unstale":"2024-09-05T01:22:46.872270+0000","last_undegraded":"2024-09-05T01:22:46.872270+0000","last_fullsized":"2024-09-05T01:22:46.872270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:06:31.624775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.020150+0000","last_change":"2024-09-05T01:22:35.036220+0000","last_active":"2024-09-05T01:22:36.020150+0000","last_peered":"2024-09-05T01:22:36.020150+0000","last_clean":"2024-09-05T01:22:36.020150+0000","last_became_active":"2024-09-05T01:22:35.035881+0000","last_became_peered":"2024-09-05T01:22:35.035881+0000","last_unstale":"2024-09-05T01:22:36.020150+0000","last_undegraded":"2024-09-05T01:22:36.020150+0000","last_fullsized":"2024-09-05T01:22:36.020150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:12:03.104075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.097709+0000","last_change":"2024-09-05T01:22:32.608922+0000","last_active":"2024-09-05T01:22:46.097709+0000","last_peered":"2024-09-05T01:22:46.097709+0000","last_clean":"2024-09-05T01:22:46.097709+0000","last_became_active":"2024-09-05T01:22:32.608453+0000","last_became_peered":"2024-09-05T01:22:32.608453+0000","last_unstale":"2024-09-05T01:22:46.097709+0000","last_undegraded":"2024-09-05T01:22:46.097709+0000","last_fullsized":"2024-09-05T01:22:46.097709+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:03:41.947264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034392+0000","last_change":"2024-09-05T01:22:35.047556+0000","last_active":"2024-09-05T01:22:36.034392+0000","last_peered":"2024-09-05T01:22:36.034392+0000","last_clean":"2024-09-05T01:22:36.034392+0000","last_became_active":"2024-09-05T01:22:35.046260+0000","last_became_peered":"2024-09-05T01:22:35.046260+0000","last_unstale":"2024-09-05T01:22:36.034392+0000","last_undegraded":"2024-09-05T01:22:36.034392+0000","last_fullsized":"2024-09-05T01:22:36.034392+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:13:09.379906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:44.076525+0000","last_change":"2024-09-05T01:22:32.612948+0000","last_active":"2024-09-05T01:22:44.076525+0000","last_peered":"2024-09-05T01:22:44.076525+0000","last_clean":"2024-09-05T01:22:44.076525+0000","last_became_active":"2024-09-05T01:22:32.612319+0000","last_became_peered":"2024-09-05T01:22:32.612319+0000","last_unstale":"2024-09-05T01:22:44.076525+0000","last_undegraded":"2024-09-05T01:22:44.076525+0000","last_fullsized":"2024-09-05T01:22:44.076525+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:17:56.068106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.038502+0000","last_change":"2024-09-05T01:22:35.036218+0000","last_active":"2024-09-05T01:22:36.038502+0000","last_peered":"2024-09-05T01:22:36.038502+0000","last_clean":"2024-09-05T01:22:36.038502+0000","last_became_active":"2024-09-05T01:22:35.035180+0000","last_became_peered":"2024-09-05T01:22:35.035180+0000","last_unstale":"2024-09-05T01:22:36.038502+0000","last_undegraded":"2024-09-05T01:22:36.038502+0000","last_fullsized":"2024-09-05T01:22:36.038502+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:37:13.936829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.038015+0000","last_change":"2024-09-05T01:22:35.039616+0000","last_active":"2024-09-05T01:22:36.038015+0000","last_peered":"2024-09-05T01:22:36.038015+0000","last_clean":"2024-09-05T01:22:36.038015+0000","last_became_active":"2024-09-05T01:22:35.039297+0000","last_became_peered":"2024-09-05T01:22:35.039297+0000","last_unstale":"2024-09-05T01:22:36.038015+0000","last_undegraded":"2024-09-05T01:22:36.038015+0000","last_fullsized":"2024-09-05T01:22:36.038015+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:24:44.703168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.873041+0000","last_change":"2024-09-05T01:22:32.609792+0000","last_active":"2024-09-05T01:22:46.873041+0000","last_peered":"2024-09-05T01:22:46.873041+0000","last_clean":"2024-09-05T01:22:46.873041+0000","last_became_active":"2024-09-05T01:22:32.609361+0000","last_became_peered":"2024-09-05T01:22:32.609361+0000","last_unstale":"2024-09-05T01:22:46.873041+0000","last_undegraded":"2024-09-05T01:22:46.873041+0000","last_fullsized":"2024-09-05T01:22:46.873041+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:05:15.105759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034323+0000","last_change":"2024-09-05T01:22:35.038792+0000","last_active":"2024-09-05T01:22:36.034323+0000","last_peered":"2024-09-05T01:22:36.034323+0000","last_clean":"2024-09-05T01:22:36.034323+0000","last_became_active":"2024-09-05T01:22:35.038129+0000","last_became_peered":"2024-09-05T01:22:35.038129+0000","last_unstale":"2024-09-05T01:22:36.034323+0000","last_undegraded":"2024-09-05T01:22:36.034323+0000","last_fullsized":"2024-09-05T01:22:36.034323+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:39:31.020488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'12","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.873427+0000","last_change":"2024-09-05T01:22:32.613600+0000","last_active":"2024-09-05T01:22:46.873427+0000","last_peered":"2024-09-05T01:22:46.873427+0000","last_clean":"2024-09-05T01:22:46.873427+0000","last_became_active":"2024-09-05T01:22:32.613186+0000","last_became_peered":"2024-09-05T01:22:32.613186+0000","last_unstale":"2024-09-05T01:22:46.873427+0000","last_undegraded":"2024-09-05T01:22:46.873427+0000","last_fullsized":"2024-09-05T01:22:46.873427+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:36:57.833008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.038125+0000","last_change":"2024-09-05T01:22:35.045174+0000","last_active":"2024-09-05T01:22:36.038125+0000","last_peered":"2024-09-05T01:22:36.038125+0000","last_clean":"2024-09-05T01:22:36.038125+0000","last_became_active":"2024-09-05T01:22:35.041750+0000","last_became_peered":"2024-09-05T01:22:35.041750+0000","last_unstale":"2024-09-05T01:22:36.038125+0000","last_undegraded":"2024-09-05T01:22:36.038125+0000","last_fullsized":"2024-09-05T01:22:36.038125+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:34:00.174324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.038554+0000","last_change":"2024-09-05T01:22:33.065150+0000","last_active":"2024-09-05T01:22:36.038554+0000","last_peered":"2024-09-05T01:22:36.038554+0000","last_clean":"2024-09-05T01:22:36.038554+0000","last_became_active":"2024-09-05T01:22:33.064456+0000","last_became_peered":"2024-09-05T01:22:33.064456+0000","last_unstale":"2024-09-05T01:22:36.038554+0000","last_undegraded":"2024-09-05T01:22:36.038554+0000","last_fullsized":"2024-09-05T01:22:36.038554+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:16:20.879893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034838+0000","last_change":"2024-09-05T01:22:35.043158+0000","last_active":"2024-09-05T01:22:36.034838+0000","last_peered":"2024-09-05T01:22:36.034838+0000","last_clean":"2024-09-05T01:22:36.034838+0000","last_became_active":"2024-09-05T01:22:35.038666+0000","last_became_peered":"2024-09-05T01:22:35.038666+0000","last_unstale":"2024-09-05T01:22:36.034838+0000","last_undegraded":"2024-09-05T01:22:36.034838+0000","last_fullsized":"2024-09-05T01:22:36.034838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:44:18.551980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'13","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:23:02.895939+0000","last_change":"2024-09-05T01:22:32.613713+0000","last_active":"2024-09-05T01:23:02.895939+0000","last_peered":"2024-09-05T01:23:02.895939+0000","last_clean":"2024-09-05T01:23:02.895939+0000","last_became_active":"2024-09-05T01:22:32.613284+0000","last_became_peered":"2024-09-05T01:22:32.613284+0000","last_unstale":"2024-09-05T01:23:02.895939+0000","last_undegraded":"2024-09-05T01:23:02.895939+0000","last_fullsized":"2024-09-05T01:23:02.895939+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:39:46.881635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54403,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":184,"num_read_kb":153,"num_write":235,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":163209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547219,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":420830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776151,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32716,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712436,"statfs":{"total":95995035648,"available":95961534464,"internally_reserved":0,"allocated":1568768,"data_stored":1059054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939677,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":905216,"data_stored":420760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168610,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":421138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397544,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1014444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561069,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":888832,"data_stored":420870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790002,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1511424,"data_stored":1013336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953528,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":420731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182460,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":420302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411394,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":468805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":468585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738445,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":421816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":48947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":49167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":48931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T01:23:05.325 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph pg dump --format=json 2024-09-05T01:23:05.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:05 smithi012 ceph-mon[29942]: from='client.24679 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T01:23:05.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:05 smithi145 ceph-mon[34376]: from='client.24679 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T01:23:05.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:05 smithi151 ceph-mon[35013]: from='client.24679 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T01:23:05.702 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:06.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.198+0000 7f8de7200640 1 -- 172.21.15.12:0/2371292127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8de01049a0 msgr2=0x7f8de01089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:06.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.198+0000 7f8de7200640 1 --2- 172.21.15.12:0/2371292127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8de01049a0 0x7f8de01089f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8009900 tx=0x7f8dc802a410 comp rx=0 tx=0).stop 2024-09-05T01:23:06.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.199+0000 7f8de7200640 1 -- 172.21.15.12:0/2371292127 shutdown_connections 2024-09-05T01:23:06.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.199+0000 7f8de7200640 1 --2- 172.21.15.12:0/2371292127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8de0109120 0x7f8de0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:06.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.199+0000 7f8de7200640 1 --2- 172.21.15.12:0/2371292127 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8de01049a0 0x7f8de01089f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:06.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.199+0000 7f8de7200640 1 --2- 172.21.15.12:0/2371292127 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8de0103ff0 0x7f8de01043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:06.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.199+0000 7f8de7200640 1 -- 172.21.15.12:0/2371292127 >> 172.21.15.12:0/2371292127 conn(0x7f8de00ffa90 msgr2=0x7f8de0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:06.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.199+0000 7f8de7200640 1 -- 172.21.15.12:0/2371292127 shutdown_connections 2024-09-05T01:23:06.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.199+0000 7f8de7200640 1 -- 172.21.15.12:0/2371292127 wait complete. 2024-09-05T01:23:06.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.200+0000 7f8de7200640 1 Processor -- start 2024-09-05T01:23:06.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.200+0000 7f8de7200640 1 -- start start 2024-09-05T01:23:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.200+0000 7f8de7200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8de0103ff0 0x7f8de019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.200+0000 7f8de7200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8de01049a0 0x7f8de019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.200+0000 7f8de7200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8de0109120 0x7f8de019eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.200+0000 7f8de7200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8de0114190 con 0x7f8de0103ff0 2024-09-05T01:23:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.200+0000 7f8de7200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8de0114010 con 0x7f8de01049a0 2024-09-05T01:23:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.200+0000 7f8de7200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8de0114310 con 0x7f8de0109120 2024-09-05T01:23:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.200+0000 7f8de5200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8de0109120 0x7f8de019eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.200+0000 7f8ddfe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8de0103ff0 0x7f8de019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.200+0000 7f8de5200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8de0109120 0x7f8de019eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:49222/0 (socket says 172.21.15.12:49222) 2024-09-05T01:23:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.200+0000 7f8de5200640 1 -- 172.21.15.12:0/181091774 learned_addr learned my addr 172.21.15.12:0/181091774 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.201+0000 7f8dd7400640 1 --2- 172.21.15.12:0/181091774 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8de01049a0 0x7f8de019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.201+0000 7f8de5200640 1 -- 172.21.15.12:0/181091774 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8de01049a0 msgr2=0x7f8de019ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.201+0000 7f8de5200640 1 --2- 172.21.15.12:0/181091774 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8de01049a0 0x7f8de019ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.201+0000 7f8de5200640 1 -- 172.21.15.12:0/181091774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8de0103ff0 msgr2=0x7f8de019a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.201+0000 7f8de5200640 1 --2- 172.21.15.12:0/181091774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8de0103ff0 0x7f8de019a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.201+0000 7f8de5200640 1 -- 172.21.15.12:0/181091774 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de019f5a0 con 0x7f8de0109120 2024-09-05T01:23:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.201+0000 7f8de5200640 1 --2- 172.21.15.12:0/181091774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8de0109120 0x7f8de019eec0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800e970 tx=0x7f8dd800ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:06.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.201+0000 7f8ddd600640 1 -- 172.21.15.12:0/181091774 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd800ccc0 con 0x7f8de0109120 2024-09-05T01:23:06.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.201+0000 7f8de7200640 1 -- 172.21.15.12:0/181091774 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de019f890 con 0x7f8de0109120 2024-09-05T01:23:06.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.201+0000 7f8ddd600640 1 -- 172.21.15.12:0/181091774 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dd800ce60 con 0x7f8de0109120 2024-09-05T01:23:06.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.201+0000 7f8ddd600640 1 -- 172.21.15.12:0/181091774 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8010490 con 0x7f8de0109120 2024-09-05T01:23:06.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.202+0000 7f8de7200640 1 -- 172.21.15.12:0/181091774 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de01a7170 con 0x7f8de0109120 2024-09-05T01:23:06.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.203+0000 7f8de7200640 1 -- 172.21.15.12:0/181091774 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8de01043d0 con 0x7f8de0109120 2024-09-05T01:23:06.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.205+0000 7f8ddd600640 1 -- 172.21.15.12:0/181091774 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8dd8044b60 con 0x7f8de0109120 2024-09-05T01:23:06.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.206+0000 7f8ddd600640 1 --2- 172.21.15.12:0/181091774 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8dc40a2c10 0x7f8dc40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:06.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.206+0000 7f8ddd600640 1 -- 172.21.15.12:0/181091774 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f8dd80cf560 con 0x7f8de0109120 2024-09-05T01:23:06.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.206+0000 7f8ddfe00640 1 --2- 172.21.15.12:0/181091774 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8dc40a2c10 0x7f8dc40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:06.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.207+0000 7f8ddfe00640 1 --2- 172.21.15.12:0/181091774 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8dc40a2c10 0x7f8dc40a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0005fd0 tx=0x7f8dd0009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:06.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.208+0000 7f8ddd600640 1 -- 172.21.15.12:0/181091774 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8dd809c410 con 0x7f8de0109120 2024-09-05T01:23:06.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.390+0000 7f8de7200640 1 -- 172.21.15.12:0/181091774 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8de0100da0 con 0x7f8dc40a2c10 2024-09-05T01:23:06.391 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:06 smithi012 ceph-mon[29942]: pgmap v303: 97 pgs: 97 active+clean; 640 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.4 KiB/s wr, 13 op/s 2024-09-05T01:23:06.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.400+0000 7f8ddd600640 1 -- 172.21.15.12:0/181091774 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258750 (secure 0 0 0) 0x7f8de0100da0 con 0x7f8dc40a2c10 2024-09-05T01:23:06.404 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:23:06.405 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-05T01:23:06.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.404+0000 7f8de7200640 1 -- 172.21.15.12:0/181091774 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8dc40a2c10 msgr2=0x7f8dc40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:06.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.404+0000 7f8de7200640 1 --2- 172.21.15.12:0/181091774 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8dc40a2c10 0x7f8dc40a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0005fd0 tx=0x7f8dd0009760 comp rx=0 tx=0).stop 2024-09-05T01:23:06.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.404+0000 7f8de7200640 1 -- 172.21.15.12:0/181091774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8de0109120 msgr2=0x7f8de019eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:06.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.404+0000 7f8de7200640 1 --2- 172.21.15.12:0/181091774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8de0109120 0x7f8de019eec0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8dd800e970 tx=0x7f8dd800ed70 comp rx=0 tx=0).stop 2024-09-05T01:23:06.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.404+0000 7f8de7200640 1 -- 172.21.15.12:0/181091774 shutdown_connections 2024-09-05T01:23:06.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.404+0000 7f8de7200640 1 --2- 172.21.15.12:0/181091774 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8dc40a2c10 0x7f8dc40a50d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:06.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.404+0000 7f8de7200640 1 --2- 172.21.15.12:0/181091774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8de0109120 0x7f8de019eec0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:06.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.404+0000 7f8de7200640 1 --2- 172.21.15.12:0/181091774 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8de01049a0 0x7f8de019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:06.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.404+0000 7f8de7200640 1 --2- 172.21.15.12:0/181091774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8de0103ff0 0x7f8de019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:06.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.404+0000 7f8de7200640 1 -- 172.21.15.12:0/181091774 >> 172.21.15.12:0/181091774 conn(0x7f8de00ffa90 msgr2=0x7f8de0101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:06.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.404+0000 7f8de7200640 1 -- 172.21.15.12:0/181091774 shutdown_connections 2024-09-05T01:23:06.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:06.404+0000 7f8de7200640 1 -- 172.21.15.12:0/181091774 wait complete. 2024-09-05T01:23:06.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:06 smithi145 ceph-mon[34376]: pgmap v303: 97 pgs: 97 active+clean; 640 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.4 KiB/s wr, 13 op/s 2024-09-05T01:23:06.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:06 smithi151 ceph-mon[35013]: pgmap v303: 97 pgs: 97 active+clean; 640 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.4 KiB/s wr, 13 op/s 2024-09-05T01:23:07.065 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-09-05T01:23:06.188118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655145,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":346,"num_read_kb":297,"num_write":422,"num_write_kb":3070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":345,"ondisk_log_size":345,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370048,"kb_used_data":12480,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571776,"statfs":{"total":1151940427776,"available":1151561498624,"internally_reserved":0,"allocated":12779520,"data_stored":7001091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":55564,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":130,"num_read_kb":121,"num_write":29,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002966"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.020299+0000","last_change":"2024-09-05T01:22:35.038389+0000","last_active":"2024-09-05T01:22:36.020299+0000","last_peered":"2024-09-05T01:22:36.020299+0000","last_clean":"2024-09-05T01:22:36.020299+0000","last_became_active":"2024-09-05T01:22:35.037982+0000","last_became_peered":"2024-09-05T01:22:35.037982+0000","last_unstale":"2024-09-05T01:22:36.020299+0000","last_undegraded":"2024-09-05T01:22:36.020299+0000","last_fullsized":"2024-09-05T01:22:36.020299+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:23:33.802592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.037848+0000","last_change":"2024-09-05T01:22:35.035340+0000","last_active":"2024-09-05T01:22:36.037848+0000","last_peered":"2024-09-05T01:22:36.037848+0000","last_clean":"2024-09-05T01:22:36.037848+0000","last_became_active":"2024-09-05T01:22:35.032871+0000","last_became_peered":"2024-09-05T01:22:35.032871+0000","last_unstale":"2024-09-05T01:22:36.037848+0000","last_undegraded":"2024-09-05T01:22:36.037848+0000","last_fullsized":"2024-09-05T01:22:36.037848+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:51:07.235915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.037774+0000","last_change":"2024-09-05T01:22:35.045443+0000","last_active":"2024-09-05T01:22:36.037774+0000","last_peered":"2024-09-05T01:22:36.037774+0000","last_clean":"2024-09-05T01:22:36.037774+0000","last_became_active":"2024-09-05T01:22:35.042342+0000","last_became_peered":"2024-09-05T01:22:35.042342+0000","last_unstale":"2024-09-05T01:22:36.037774+0000","last_undegraded":"2024-09-05T01:22:36.037774+0000","last_fullsized":"2024-09-05T01:22:36.037774+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:42:46.878959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034099+0000","last_change":"2024-09-05T01:22:35.041527+0000","last_active":"2024-09-05T01:22:36.034099+0000","last_peered":"2024-09-05T01:22:36.034099+0000","last_clean":"2024-09-05T01:22:36.034099+0000","last_became_active":"2024-09-05T01:22:35.041210+0000","last_became_peered":"2024-09-05T01:22:35.041210+0000","last_unstale":"2024-09-05T01:22:36.034099+0000","last_undegraded":"2024-09-05T01:22:36.034099+0000","last_fullsized":"2024-09-05T01:22:36.034099+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:22:28.770307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.033454+0000","last_change":"2024-09-05T01:22:35.036810+0000","last_active":"2024-09-05T01:22:36.033454+0000","last_peered":"2024-09-05T01:22:36.033454+0000","last_clean":"2024-09-05T01:22:36.033454+0000","last_became_active":"2024-09-05T01:22:35.036435+0000","last_became_peered":"2024-09-05T01:22:35.036435+0000","last_unstale":"2024-09-05T01:22:36.033454+0000","last_undegraded":"2024-09-05T01:22:36.033454+0000","last_fullsized":"2024-09-05T01:22:36.033454+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:41:43.649178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.021028+0000","last_change":"2024-09-05T01:22:35.039198+0000","last_active":"2024-09-05T01:22:36.021028+0000","last_peered":"2024-09-05T01:22:36.021028+0000","last_clean":"2024-09-05T01:22:36.021028+0000","last_became_active":"2024-09-05T01:22:35.038822+0000","last_became_peered":"2024-09-05T01:22:35.038822+0000","last_unstale":"2024-09-05T01:22:36.021028+0000","last_undegraded":"2024-09-05T01:22:36.021028+0000","last_fullsized":"2024-09-05T01:22:36.021028+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:22:08.600927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.037330+0000","last_change":"2024-09-05T01:22:35.034687+0000","last_active":"2024-09-05T01:22:36.037330+0000","last_peered":"2024-09-05T01:22:36.037330+0000","last_clean":"2024-09-05T01:22:36.037330+0000","last_became_active":"2024-09-05T01:22:35.034351+0000","last_became_peered":"2024-09-05T01:22:35.034351+0000","last_unstale":"2024-09-05T01:22:36.037330+0000","last_undegraded":"2024-09-05T01:22:36.037330+0000","last_fullsized":"2024-09-05T01:22:36.037330+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:38:27.311348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.033911+0000","last_change":"2024-09-05T01:22:35.039919+0000","last_active":"2024-09-05T01:22:36.033911+0000","last_peered":"2024-09-05T01:22:36.033911+0000","last_clean":"2024-09-05T01:22:36.033911+0000","last_became_active":"2024-09-05T01:22:35.038939+0000","last_became_peered":"2024-09-05T01:22:35.038939+0000","last_unstale":"2024-09-05T01:22:36.033911+0000","last_undegraded":"2024-09-05T01:22:36.033911+0000","last_fullsized":"2024-09-05T01:22:36.033911+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:19:40.304016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034216+0000","last_change":"2024-09-05T01:22:35.036394+0000","last_active":"2024-09-05T01:22:36.034216+0000","last_peered":"2024-09-05T01:22:36.034216+0000","last_clean":"2024-09-05T01:22:36.034216+0000","last_became_active":"2024-09-05T01:22:35.035990+0000","last_became_peered":"2024-09-05T01:22:35.035990+0000","last_unstale":"2024-09-05T01:22:36.034216+0000","last_undegraded":"2024-09-05T01:22:36.034216+0000","last_fullsized":"2024-09-05T01:22:36.034216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:42:18.870263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.021488+0000","last_change":"2024-09-05T01:22:35.033389+0000","last_active":"2024-09-05T01:22:36.021488+0000","last_peered":"2024-09-05T01:22:36.021488+0000","last_clean":"2024-09-05T01:22:36.021488+0000","last_became_active":"2024-09-05T01:22:35.033081+0000","last_became_peered":"2024-09-05T01:22:35.033081+0000","last_unstale":"2024-09-05T01:22:36.021488+0000","last_undegraded":"2024-09-05T01:22:36.021488+0000","last_fullsized":"2024-09-05T01:22:36.021488+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:53:08.266905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.038780+0000","last_change":"2024-09-05T01:22:35.035768+0000","last_active":"2024-09-05T01:22:36.038780+0000","last_peered":"2024-09-05T01:22:36.038780+0000","last_clean":"2024-09-05T01:22:36.038780+0000","last_became_active":"2024-09-05T01:22:35.035456+0000","last_became_peered":"2024-09-05T01:22:35.035456+0000","last_unstale":"2024-09-05T01:22:36.038780+0000","last_undegraded":"2024-09-05T01:22:36.038780+0000","last_fullsized":"2024-09-05T01:22:36.038780+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:15:48.723816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034266+0000","last_change":"2024-09-05T01:22:35.040720+0000","last_active":"2024-09-05T01:22:36.034266+0000","last_peered":"2024-09-05T01:22:36.034266+0000","last_clean":"2024-09-05T01:22:36.034266+0000","last_became_active":"2024-09-05T01:22:35.039617+0000","last_became_peered":"2024-09-05T01:22:35.039617+0000","last_unstale":"2024-09-05T01:22:36.034266+0000","last_undegraded":"2024-09-05T01:22:36.034266+0000","last_fullsized":"2024-09-05T01:22:36.034266+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:23:11.633617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.019057+0000","last_change":"2024-09-05T01:22:35.022096+0000","last_active":"2024-09-05T01:22:36.019057+0000","last_peered":"2024-09-05T01:22:36.019057+0000","last_clean":"2024-09-05T01:22:36.019057+0000","last_became_active":"2024-09-05T01:22:35.021707+0000","last_became_peered":"2024-09-05T01:22:35.021707+0000","last_unstale":"2024-09-05T01:22:36.019057+0000","last_undegraded":"2024-09-05T01:22:36.019057+0000","last_fullsized":"2024-09-05T01:22:36.019057+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:50:35.035386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.037289+0000","last_change":"2024-09-05T01:22:35.034481+0000","last_active":"2024-09-05T01:22:36.037289+0000","last_peered":"2024-09-05T01:22:36.037289+0000","last_clean":"2024-09-05T01:22:36.037289+0000","last_became_active":"2024-09-05T01:22:35.034145+0000","last_became_peered":"2024-09-05T01:22:35.034145+0000","last_unstale":"2024-09-05T01:22:36.037289+0000","last_undegraded":"2024-09-05T01:22:36.037289+0000","last_fullsized":"2024-09-05T01:22:36.037289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:19:33.386981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.037163+0000","last_change":"2024-09-05T01:22:35.040970+0000","last_active":"2024-09-05T01:22:36.037163+0000","last_peered":"2024-09-05T01:22:36.037163+0000","last_clean":"2024-09-05T01:22:36.037163+0000","last_became_active":"2024-09-05T01:22:35.039024+0000","last_became_peered":"2024-09-05T01:22:35.039024+0000","last_unstale":"2024-09-05T01:22:36.037163+0000","last_undegraded":"2024-09-05T01:22:36.037163+0000","last_fullsized":"2024-09-05T01:22:36.037163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:44:08.608295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.033309+0000","last_change":"2024-09-05T01:22:35.046517+0000","last_active":"2024-09-05T01:22:36.033309+0000","last_peered":"2024-09-05T01:22:36.033309+0000","last_clean":"2024-09-05T01:22:36.033309+0000","last_became_active":"2024-09-05T01:22:35.046230+0000","last_became_peered":"2024-09-05T01:22:35.046230+0000","last_unstale":"2024-09-05T01:22:36.033309+0000","last_undegraded":"2024-09-05T01:22:36.033309+0000","last_fullsized":"2024-09-05T01:22:36.033309+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:16:49.672039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.020269+0000","last_change":"2024-09-05T01:22:35.041140+0000","last_active":"2024-09-05T01:22:36.020269+0000","last_peered":"2024-09-05T01:22:36.020269+0000","last_clean":"2024-09-05T01:22:36.020269+0000","last_became_active":"2024-09-05T01:22:35.040838+0000","last_became_peered":"2024-09-05T01:22:35.040838+0000","last_unstale":"2024-09-05T01:22:36.020269+0000","last_undegraded":"2024-09-05T01:22:36.020269+0000","last_fullsized":"2024-09-05T01:22:36.020269+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:47:55.730240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034643+0000","last_change":"2024-09-05T01:22:35.036830+0000","last_active":"2024-09-05T01:22:36.034643+0000","last_peered":"2024-09-05T01:22:36.034643+0000","last_clean":"2024-09-05T01:22:36.034643+0000","last_became_active":"2024-09-05T01:22:35.036356+0000","last_became_peered":"2024-09-05T01:22:35.036356+0000","last_unstale":"2024-09-05T01:22:36.034643+0000","last_undegraded":"2024-09-05T01:22:36.034643+0000","last_fullsized":"2024-09-05T01:22:36.034643+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:19:01.736301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034148+0000","last_change":"2024-09-05T01:22:35.036386+0000","last_active":"2024-09-05T01:22:36.034148+0000","last_peered":"2024-09-05T01:22:36.034148+0000","last_clean":"2024-09-05T01:22:36.034148+0000","last_became_active":"2024-09-05T01:22:35.036046+0000","last_became_peered":"2024-09-05T01:22:35.036046+0000","last_unstale":"2024-09-05T01:22:36.034148+0000","last_undegraded":"2024-09-05T01:22:36.034148+0000","last_fullsized":"2024-09-05T01:22:36.034148+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:19:37.861719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.019980+0000","last_change":"2024-09-05T01:22:35.041077+0000","last_active":"2024-09-05T01:22:36.019980+0000","last_peered":"2024-09-05T01:22:36.019980+0000","last_clean":"2024-09-05T01:22:36.019980+0000","last_became_active":"2024-09-05T01:22:35.040736+0000","last_became_peered":"2024-09-05T01:22:35.040736+0000","last_unstale":"2024-09-05T01:22:36.019980+0000","last_undegraded":"2024-09-05T01:22:36.019980+0000","last_fullsized":"2024-09-05T01:22:36.019980+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:30:54.670559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.019036+0000","last_change":"2024-09-05T01:22:35.047774+0000","last_active":"2024-09-05T01:22:36.019036+0000","last_peered":"2024-09-05T01:22:36.019036+0000","last_clean":"2024-09-05T01:22:36.019036+0000","last_became_active":"2024-09-05T01:22:35.047153+0000","last_became_peered":"2024-09-05T01:22:35.047153+0000","last_unstale":"2024-09-05T01:22:36.019036+0000","last_undegraded":"2024-09-05T01:22:36.019036+0000","last_fullsized":"2024-09-05T01:22:36.019036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:07:02.189116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.033431+0000","last_change":"2024-09-05T01:22:35.041346+0000","last_active":"2024-09-05T01:22:36.033431+0000","last_peered":"2024-09-05T01:22:36.033431+0000","last_clean":"2024-09-05T01:22:36.033431+0000","last_became_active":"2024-09-05T01:22:35.040282+0000","last_became_peered":"2024-09-05T01:22:35.040282+0000","last_unstale":"2024-09-05T01:22:36.033431+0000","last_undegraded":"2024-09-05T01:22:36.033431+0000","last_fullsized":"2024-09-05T01:22:36.033431+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:19:38.203479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034008+0000","last_change":"2024-09-05T01:22:35.041780+0000","last_active":"2024-09-05T01:22:36.034008+0000","last_peered":"2024-09-05T01:22:36.034008+0000","last_clean":"2024-09-05T01:22:36.034008+0000","last_became_active":"2024-09-05T01:22:35.038453+0000","last_became_peered":"2024-09-05T01:22:35.038453+0000","last_unstale":"2024-09-05T01:22:36.034008+0000","last_undegraded":"2024-09-05T01:22:36.034008+0000","last_fullsized":"2024-09-05T01:22:36.034008+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:17:56.453627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.037436+0000","last_change":"2024-09-05T01:22:35.038699+0000","last_active":"2024-09-05T01:22:36.037436+0000","last_peered":"2024-09-05T01:22:36.037436+0000","last_clean":"2024-09-05T01:22:36.037436+0000","last_became_active":"2024-09-05T01:22:35.038349+0000","last_became_peered":"2024-09-05T01:22:35.038349+0000","last_unstale":"2024-09-05T01:22:36.037436+0000","last_undegraded":"2024-09-05T01:22:36.037436+0000","last_fullsized":"2024-09-05T01:22:36.037436+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:17:18.175643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034696+0000","last_change":"2024-09-05T01:22:35.048281+0000","last_active":"2024-09-05T01:22:36.034696+0000","last_peered":"2024-09-05T01:22:36.034696+0000","last_clean":"2024-09-05T01:22:36.034696+0000","last_became_active":"2024-09-05T01:22:35.047211+0000","last_became_peered":"2024-09-05T01:22:35.047211+0000","last_unstale":"2024-09-05T01:22:36.034696+0000","last_undegraded":"2024-09-05T01:22:36.034696+0000","last_fullsized":"2024-09-05T01:22:36.034696+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:40:43.196562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.035439+0000","last_change":"2024-09-05T01:22:35.041215+0000","last_active":"2024-09-05T01:22:36.035439+0000","last_peered":"2024-09-05T01:22:36.035439+0000","last_clean":"2024-09-05T01:22:36.035439+0000","last_became_active":"2024-09-05T01:22:35.040156+0000","last_became_peered":"2024-09-05T01:22:35.040156+0000","last_unstale":"2024-09-05T01:22:36.035439+0000","last_undegraded":"2024-09-05T01:22:36.035439+0000","last_fullsized":"2024-09-05T01:22:36.035439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:39:01.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.020170+0000","last_change":"2024-09-05T01:22:35.035089+0000","last_active":"2024-09-05T01:22:36.020170+0000","last_peered":"2024-09-05T01:22:36.020170+0000","last_clean":"2024-09-05T01:22:36.020170+0000","last_became_active":"2024-09-05T01:22:35.034781+0000","last_became_peered":"2024-09-05T01:22:35.034781+0000","last_unstale":"2024-09-05T01:22:36.020170+0000","last_undegraded":"2024-09-05T01:22:36.020170+0000","last_fullsized":"2024-09-05T01:22:36.020170+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:31:02.766395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.019043+0000","last_change":"2024-09-05T01:22:35.038147+0000","last_active":"2024-09-05T01:22:36.019043+0000","last_peered":"2024-09-05T01:22:36.019043+0000","last_clean":"2024-09-05T01:22:36.019043+0000","last_became_active":"2024-09-05T01:22:35.037772+0000","last_became_peered":"2024-09-05T01:22:35.037772+0000","last_unstale":"2024-09-05T01:22:36.019043+0000","last_undegraded":"2024-09-05T01:22:36.019043+0000","last_fullsized":"2024-09-05T01:22:36.019043+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:40:01.786788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.037679+0000","last_change":"2024-09-05T01:22:35.049040+0000","last_active":"2024-09-05T01:22:36.037679+0000","last_peered":"2024-09-05T01:22:36.037679+0000","last_clean":"2024-09-05T01:22:36.037679+0000","last_became_active":"2024-09-05T01:22:35.048373+0000","last_became_peered":"2024-09-05T01:22:35.048373+0000","last_unstale":"2024-09-05T01:22:36.037679+0000","last_undegraded":"2024-09-05T01:22:36.037679+0000","last_fullsized":"2024-09-05T01:22:36.037679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:32:17.316513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.033853+0000","last_change":"2024-09-05T01:22:35.043531+0000","last_active":"2024-09-05T01:22:36.033853+0000","last_peered":"2024-09-05T01:22:36.033853+0000","last_clean":"2024-09-05T01:22:36.033853+0000","last_became_active":"2024-09-05T01:22:35.043145+0000","last_became_peered":"2024-09-05T01:22:35.043145+0000","last_unstale":"2024-09-05T01:22:36.033853+0000","last_undegraded":"2024-09-05T01:22:36.033853+0000","last_fullsized":"2024-09-05T01:22:36.033853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:04:41.902738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.033942+0000","last_change":"2024-09-05T01:22:35.037684+0000","last_active":"2024-09-05T01:22:36.033942+0000","last_peered":"2024-09-05T01:22:36.033942+0000","last_clean":"2024-09-05T01:22:36.033942+0000","last_became_active":"2024-09-05T01:22:35.037392+0000","last_became_peered":"2024-09-05T01:22:35.037392+0000","last_unstale":"2024-09-05T01:22:36.033942+0000","last_undegraded":"2024-09-05T01:22:36.033942+0000","last_fullsized":"2024-09-05T01:22:36.033942+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:12:37.705198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.020209+0000","last_change":"2024-09-05T01:22:35.036917+0000","last_active":"2024-09-05T01:22:36.020209+0000","last_peered":"2024-09-05T01:22:36.020209+0000","last_clean":"2024-09-05T01:22:36.020209+0000","last_became_active":"2024-09-05T01:22:35.036597+0000","last_became_peered":"2024-09-05T01:22:35.036597+0000","last_unstale":"2024-09-05T01:22:36.020209+0000","last_undegraded":"2024-09-05T01:22:36.020209+0000","last_fullsized":"2024-09-05T01:22:36.020209+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:25:46.472325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.033577+0000","last_change":"2024-09-05T01:22:35.035858+0000","last_active":"2024-09-05T01:22:36.033577+0000","last_peered":"2024-09-05T01:22:36.033577+0000","last_clean":"2024-09-05T01:22:36.033577+0000","last_became_active":"2024-09-05T01:22:35.035075+0000","last_became_peered":"2024-09-05T01:22:35.035075+0000","last_unstale":"2024-09-05T01:22:36.033577+0000","last_undegraded":"2024-09-05T01:22:36.033577+0000","last_fullsized":"2024-09-05T01:22:36.033577+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:49:42.487427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'6","reported_seq":43,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:23:00.885378+0000","last_change":"2024-09-05T01:22:32.615444+0000","last_active":"2024-09-05T01:23:00.885378+0000","last_peered":"2024-09-05T01:23:00.885378+0000","last_clean":"2024-09-05T01:23:00.885378+0000","last_became_active":"2024-09-05T01:22:32.615026+0000","last_became_peered":"2024-09-05T01:22:32.615026+0000","last_unstale":"2024-09-05T01:23:00.885378+0000","last_undegraded":"2024-09-05T01:23:00.885378+0000","last_fullsized":"2024-09-05T01:23:00.885378+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:52:51.410953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.035132+0000","last_change":"2024-09-05T01:22:35.039341+0000","last_active":"2024-09-05T01:22:36.035132+0000","last_peered":"2024-09-05T01:22:36.035132+0000","last_clean":"2024-09-05T01:22:36.035132+0000","last_became_active":"2024-09-05T01:22:35.038911+0000","last_became_peered":"2024-09-05T01:22:35.038911+0000","last_unstale":"2024-09-05T01:22:36.035132+0000","last_undegraded":"2024-09-05T01:22:36.035132+0000","last_fullsized":"2024-09-05T01:22:36.035132+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:18:41.735302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'7","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.097949+0000","last_change":"2024-09-05T01:22:32.610256+0000","last_active":"2024-09-05T01:22:46.097949+0000","last_peered":"2024-09-05T01:22:46.097949+0000","last_clean":"2024-09-05T01:22:46.097949+0000","last_became_active":"2024-09-05T01:22:32.609430+0000","last_became_peered":"2024-09-05T01:22:32.609430+0000","last_unstale":"2024-09-05T01:22:46.097949+0000","last_undegraded":"2024-09-05T01:22:46.097949+0000","last_fullsized":"2024-09-05T01:22:46.097949+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:00:13.171249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:45.088868+0000","last_change":"2024-09-05T01:22:32.609238+0000","last_active":"2024-09-05T01:22:45.088868+0000","last_peered":"2024-09-05T01:22:45.088868+0000","last_clean":"2024-09-05T01:22:45.088868+0000","last_became_active":"2024-09-05T01:22:32.608789+0000","last_became_peered":"2024-09-05T01:22:32.608789+0000","last_unstale":"2024-09-05T01:22:45.088868+0000","last_undegraded":"2024-09-05T01:22:45.088868+0000","last_fullsized":"2024-09-05T01:22:45.088868+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:01:55.536313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034034+0000","last_change":"2024-09-05T01:22:35.048262+0000","last_active":"2024-09-05T01:22:36.034034+0000","last_peered":"2024-09-05T01:22:36.034034+0000","last_clean":"2024-09-05T01:22:36.034034+0000","last_became_active":"2024-09-05T01:22:35.046404+0000","last_became_peered":"2024-09-05T01:22:35.046404+0000","last_unstale":"2024-09-05T01:22:36.034034+0000","last_undegraded":"2024-09-05T01:22:36.034034+0000","last_fullsized":"2024-09-05T01:22:36.034034+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:29:04.310095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.864880+0000","last_change":"2024-09-05T01:22:32.612116+0000","last_active":"2024-09-05T01:22:46.864880+0000","last_peered":"2024-09-05T01:22:46.864880+0000","last_clean":"2024-09-05T01:22:46.864880+0000","last_became_active":"2024-09-05T01:22:32.611794+0000","last_became_peered":"2024-09-05T01:22:32.611794+0000","last_unstale":"2024-09-05T01:22:46.864880+0000","last_undegraded":"2024-09-05T01:22:46.864880+0000","last_fullsized":"2024-09-05T01:22:46.864880+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:59:55.360151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.033421+0000","last_change":"2024-09-05T01:22:35.038895+0000","last_active":"2024-09-05T01:22:36.033421+0000","last_peered":"2024-09-05T01:22:36.033421+0000","last_clean":"2024-09-05T01:22:36.033421+0000","last_became_active":"2024-09-05T01:22:35.038535+0000","last_became_peered":"2024-09-05T01:22:35.038535+0000","last_unstale":"2024-09-05T01:22:36.033421+0000","last_undegraded":"2024-09-05T01:22:36.033421+0000","last_fullsized":"2024-09-05T01:22:36.033421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:49:03.010085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'4","reported_seq":58,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:23:03.889198+0000","last_change":"2024-09-05T01:22:32.611558+0000","last_active":"2024-09-05T01:23:03.889198+0000","last_peered":"2024-09-05T01:23:03.889198+0000","last_clean":"2024-09-05T01:23:03.889198+0000","last_became_active":"2024-09-05T01:22:32.611194+0000","last_became_peered":"2024-09-05T01:22:32.611194+0000","last_unstale":"2024-09-05T01:23:03.889198+0000","last_undegraded":"2024-09-05T01:23:03.889198+0000","last_fullsized":"2024-09-05T01:23:03.889198+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:47:30.586224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034299+0000","last_change":"2024-09-05T01:22:35.042010+0000","last_active":"2024-09-05T01:22:36.034299+0000","last_peered":"2024-09-05T01:22:36.034299+0000","last_clean":"2024-09-05T01:22:36.034299+0000","last_became_active":"2024-09-05T01:22:35.041451+0000","last_became_peered":"2024-09-05T01:22:35.041451+0000","last_unstale":"2024-09-05T01:22:36.034299+0000","last_undegraded":"2024-09-05T01:22:36.034299+0000","last_fullsized":"2024-09-05T01:22:36.034299+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:12:15.429065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.869499+0000","last_change":"2024-09-05T01:22:32.612131+0000","last_active":"2024-09-05T01:22:46.869499+0000","last_peered":"2024-09-05T01:22:46.869499+0000","last_clean":"2024-09-05T01:22:46.869499+0000","last_became_active":"2024-09-05T01:22:32.611778+0000","last_became_peered":"2024-09-05T01:22:32.611778+0000","last_unstale":"2024-09-05T01:22:46.869499+0000","last_undegraded":"2024-09-05T01:22:46.869499+0000","last_fullsized":"2024-09-05T01:22:46.869499+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:18:21.930485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.038263+0000","last_change":"2024-09-05T01:22:35.047663+0000","last_active":"2024-09-05T01:22:36.038263+0000","last_peered":"2024-09-05T01:22:36.038263+0000","last_clean":"2024-09-05T01:22:36.038263+0000","last_became_active":"2024-09-05T01:22:35.047078+0000","last_became_peered":"2024-09-05T01:22:35.047078+0000","last_unstale":"2024-09-05T01:22:36.038263+0000","last_undegraded":"2024-09-05T01:22:36.038263+0000","last_fullsized":"2024-09-05T01:22:36.038263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:44.992459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.098351+0000","last_change":"2024-09-05T01:22:33.064617+0000","last_active":"2024-09-05T01:22:46.098351+0000","last_peered":"2024-09-05T01:22:46.098351+0000","last_clean":"2024-09-05T01:22:46.098351+0000","last_became_active":"2024-09-05T01:22:33.064265+0000","last_became_peered":"2024-09-05T01:22:33.064265+0000","last_unstale":"2024-09-05T01:22:46.098351+0000","last_undegraded":"2024-09-05T01:22:46.098351+0000","last_fullsized":"2024-09-05T01:22:46.098351+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:43:57.315764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034104+0000","last_change":"2024-09-05T01:22:35.047109+0000","last_active":"2024-09-05T01:22:36.034104+0000","last_peered":"2024-09-05T01:22:36.034104+0000","last_clean":"2024-09-05T01:22:36.034104+0000","last_became_active":"2024-09-05T01:22:35.046806+0000","last_became_peered":"2024-09-05T01:22:35.046806+0000","last_unstale":"2024-09-05T01:22:36.034104+0000","last_undegraded":"2024-09-05T01:22:36.034104+0000","last_fullsized":"2024-09-05T01:22:36.034104+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:19:42.743038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'28","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:23:03.896030+0000","last_change":"2024-09-05T01:22:32.610883+0000","last_active":"2024-09-05T01:23:03.896030+0000","last_peered":"2024-09-05T01:23:03.896030+0000","last_clean":"2024-09-05T01:23:03.896030+0000","last_became_active":"2024-09-05T01:22:32.610530+0000","last_became_peered":"2024-09-05T01:22:32.610530+0000","last_unstale":"2024-09-05T01:23:03.896030+0000","last_undegraded":"2024-09-05T01:23:03.896030+0000","last_fullsized":"2024-09-05T01:23:03.896030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:51:01.111529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56942,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":43,"num_read_kb":76,"num_write":30,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034451+0000","last_change":"2024-09-05T01:22:35.032397+0000","last_active":"2024-09-05T01:22:36.034451+0000","last_peered":"2024-09-05T01:22:36.034451+0000","last_clean":"2024-09-05T01:22:36.034451+0000","last_became_active":"2024-09-05T01:22:35.032073+0000","last_became_peered":"2024-09-05T01:22:35.032073+0000","last_unstale":"2024-09-05T01:22:36.034451+0000","last_undegraded":"2024-09-05T01:22:36.034451+0000","last_fullsized":"2024-09-05T01:22:36.034451+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:36:02.866390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.871501+0000","last_change":"2024-09-05T01:22:32.610247+0000","last_active":"2024-09-05T01:22:46.871501+0000","last_peered":"2024-09-05T01:22:46.871501+0000","last_clean":"2024-09-05T01:22:46.871501+0000","last_became_active":"2024-09-05T01:22:32.609881+0000","last_became_peered":"2024-09-05T01:22:32.609881+0000","last_unstale":"2024-09-05T01:22:46.871501+0000","last_undegraded":"2024-09-05T01:22:46.871501+0000","last_fullsized":"2024-09-05T01:22:46.871501+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:40:39.835208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.018832+0000","last_change":"2024-09-05T01:22:35.041923+0000","last_active":"2024-09-05T01:22:36.018832+0000","last_peered":"2024-09-05T01:22:36.018832+0000","last_clean":"2024-09-05T01:22:36.018832+0000","last_became_active":"2024-09-05T01:22:35.041439+0000","last_became_peered":"2024-09-05T01:22:35.041439+0000","last_unstale":"2024-09-05T01:22:36.018832+0000","last_undegraded":"2024-09-05T01:22:36.018832+0000","last_fullsized":"2024-09-05T01:22:36.018832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:36:56.545466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.871258+0000","last_change":"2024-09-05T01:22:32.611274+0000","last_active":"2024-09-05T01:22:46.871258+0000","last_peered":"2024-09-05T01:22:46.871258+0000","last_clean":"2024-09-05T01:22:46.871258+0000","last_became_active":"2024-09-05T01:22:32.610853+0000","last_became_peered":"2024-09-05T01:22:32.610853+0000","last_unstale":"2024-09-05T01:22:46.871258+0000","last_undegraded":"2024-09-05T01:22:46.871258+0000","last_fullsized":"2024-09-05T01:22:46.871258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:01:38.058836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.038612+0000","last_change":"2024-09-05T01:22:35.040116+0000","last_active":"2024-09-05T01:22:36.038612+0000","last_peered":"2024-09-05T01:22:36.038612+0000","last_clean":"2024-09-05T01:22:36.038612+0000","last_became_active":"2024-09-05T01:22:35.037663+0000","last_became_peered":"2024-09-05T01:22:35.037663+0000","last_unstale":"2024-09-05T01:22:36.038612+0000","last_undegraded":"2024-09-05T01:22:36.038612+0000","last_fullsized":"2024-09-05T01:22:36.038612+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:16:37.309205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'6","reported_seq":44,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:23:01.887396+0000","last_change":"2024-09-05T01:22:32.612334+0000","last_active":"2024-09-05T01:23:01.887396+0000","last_peered":"2024-09-05T01:23:01.887396+0000","last_clean":"2024-09-05T01:23:01.887396+0000","last_became_active":"2024-09-05T01:22:32.612008+0000","last_became_peered":"2024-09-05T01:22:32.612008+0000","last_unstale":"2024-09-05T01:23:01.887396+0000","last_undegraded":"2024-09-05T01:23:01.887396+0000","last_fullsized":"2024-09-05T01:23:01.887396+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:31:05.580219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.037447+0000","last_change":"2024-09-05T01:22:35.037034+0000","last_active":"2024-09-05T01:22:36.037447+0000","last_peered":"2024-09-05T01:22:36.037447+0000","last_clean":"2024-09-05T01:22:36.037447+0000","last_became_active":"2024-09-05T01:22:35.036643+0000","last_became_peered":"2024-09-05T01:22:35.036643+0000","last_unstale":"2024-09-05T01:22:36.037447+0000","last_undegraded":"2024-09-05T01:22:36.037447+0000","last_fullsized":"2024-09-05T01:22:36.037447+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:41:24.073298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.861407+0000","last_change":"2024-09-05T01:22:33.064918+0000","last_active":"2024-09-05T01:22:46.861407+0000","last_peered":"2024-09-05T01:22:46.861407+0000","last_clean":"2024-09-05T01:22:46.861407+0000","last_became_active":"2024-09-05T01:22:33.064611+0000","last_became_peered":"2024-09-05T01:22:33.064611+0000","last_unstale":"2024-09-05T01:22:46.861407+0000","last_undegraded":"2024-09-05T01:22:46.861407+0000","last_fullsized":"2024-09-05T01:22:46.861407+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:25:37.129263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034840+0000","last_change":"2024-09-05T01:22:35.039866+0000","last_active":"2024-09-05T01:22:36.034840+0000","last_peered":"2024-09-05T01:22:36.034840+0000","last_clean":"2024-09-05T01:22:36.034840+0000","last_became_active":"2024-09-05T01:22:35.039493+0000","last_became_peered":"2024-09-05T01:22:35.039493+0000","last_unstale":"2024-09-05T01:22:36.034840+0000","last_undegraded":"2024-09-05T01:22:36.034840+0000","last_fullsized":"2024-09-05T01:22:36.034840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:39:20.036455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.083237+0000","last_change":"2024-09-05T01:22:32.610948+0000","last_active":"2024-09-05T01:22:46.083237+0000","last_peered":"2024-09-05T01:22:46.083237+0000","last_clean":"2024-09-05T01:22:46.083237+0000","last_became_active":"2024-09-05T01:22:32.610596+0000","last_became_peered":"2024-09-05T01:22:32.610596+0000","last_unstale":"2024-09-05T01:22:46.083237+0000","last_undegraded":"2024-09-05T01:22:46.083237+0000","last_fullsized":"2024-09-05T01:22:46.083237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:36:25.589705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.020167+0000","last_change":"2024-09-05T01:22:35.038595+0000","last_active":"2024-09-05T01:22:36.020167+0000","last_peered":"2024-09-05T01:22:36.020167+0000","last_clean":"2024-09-05T01:22:36.020167+0000","last_became_active":"2024-09-05T01:22:35.038271+0000","last_became_peered":"2024-09-05T01:22:35.038271+0000","last_unstale":"2024-09-05T01:22:36.020167+0000","last_undegraded":"2024-09-05T01:22:36.020167+0000","last_fullsized":"2024-09-05T01:22:36.020167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:51:17.652270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.873116+0000","last_change":"2024-09-05T01:22:32.609555+0000","last_active":"2024-09-05T01:22:46.873116+0000","last_peered":"2024-09-05T01:22:46.873116+0000","last_clean":"2024-09-05T01:22:46.873116+0000","last_became_active":"2024-09-05T01:22:32.608448+0000","last_became_peered":"2024-09-05T01:22:32.608448+0000","last_unstale":"2024-09-05T01:22:46.873116+0000","last_undegraded":"2024-09-05T01:22:46.873116+0000","last_fullsized":"2024-09-05T01:22:46.873116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:13:27.724664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.039045+0000","last_change":"2024-09-05T01:22:35.033418+0000","last_active":"2024-09-05T01:22:36.039045+0000","last_peered":"2024-09-05T01:22:36.039045+0000","last_clean":"2024-09-05T01:22:36.039045+0000","last_became_active":"2024-09-05T01:22:35.033096+0000","last_became_peered":"2024-09-05T01:22:35.033096+0000","last_unstale":"2024-09-05T01:22:36.039045+0000","last_undegraded":"2024-09-05T01:22:36.039045+0000","last_fullsized":"2024-09-05T01:22:36.039045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:09:06.723427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.861635+0000","last_change":"2024-09-05T01:22:32.609821+0000","last_active":"2024-09-05T01:22:46.861635+0000","last_peered":"2024-09-05T01:22:46.861635+0000","last_clean":"2024-09-05T01:22:46.861635+0000","last_became_active":"2024-09-05T01:22:32.608932+0000","last_became_peered":"2024-09-05T01:22:32.608932+0000","last_unstale":"2024-09-05T01:22:46.861635+0000","last_undegraded":"2024-09-05T01:22:46.861635+0000","last_fullsized":"2024-09-05T01:22:46.861635+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:45:19.964263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.207481+0000","last_change":"2024-09-05T01:22:35.037965+0000","last_active":"2024-09-05T01:22:36.207481+0000","last_peered":"2024-09-05T01:22:36.207481+0000","last_clean":"2024-09-05T01:22:36.207481+0000","last_became_active":"2024-09-05T01:22:35.037541+0000","last_became_peered":"2024-09-05T01:22:35.037541+0000","last_unstale":"2024-09-05T01:22:36.207481+0000","last_undegraded":"2024-09-05T01:22:36.207481+0000","last_fullsized":"2024-09-05T01:22:36.207481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:43:29.098517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'5","reported_seq":43,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:23:02.888308+0000","last_change":"2024-09-05T01:22:33.064771+0000","last_active":"2024-09-05T01:23:02.888308+0000","last_peered":"2024-09-05T01:23:02.888308+0000","last_clean":"2024-09-05T01:23:02.888308+0000","last_became_active":"2024-09-05T01:22:33.064320+0000","last_became_peered":"2024-09-05T01:22:33.064320+0000","last_unstale":"2024-09-05T01:23:02.888308+0000","last_undegraded":"2024-09-05T01:23:02.888308+0000","last_fullsized":"2024-09-05T01:23:02.888308+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:59:41.612210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.038395+0000","last_change":"2024-09-05T01:22:35.035868+0000","last_active":"2024-09-05T01:22:36.038395+0000","last_peered":"2024-09-05T01:22:36.038395+0000","last_clean":"2024-09-05T01:22:36.038395+0000","last_became_active":"2024-09-05T01:22:35.035495+0000","last_became_peered":"2024-09-05T01:22:35.035495+0000","last_unstale":"2024-09-05T01:22:36.038395+0000","last_undegraded":"2024-09-05T01:22:36.038395+0000","last_fullsized":"2024-09-05T01:22:36.038395+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:13:25.679973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":340,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.038625+0000","last_change":"2024-09-05T01:21:17.107509+0000","last_active":"2024-09-05T01:22:36.038625+0000","last_peered":"2024-09-05T01:22:36.038625+0000","last_clean":"2024-09-05T01:22:36.038625+0000","last_became_active":"2024-09-05T01:21:17.107063+0000","last_became_peered":"2024-09-05T01:21:17.107063+0000","last_unstale":"2024-09-05T01:22:36.038625+0000","last_undegraded":"2024-09-05T01:22:36.038625+0000","last_fullsized":"2024-09-05T01:22:36.038625+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:17:44.744654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:17:44.744654+0000","last_clean_scrub_stamp":"2024-09-05T01:17:44.744654+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:14:18.603051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.872019+0000","last_change":"2024-09-05T01:22:32.610686+0000","last_active":"2024-09-05T01:22:46.872019+0000","last_peered":"2024-09-05T01:22:46.872019+0000","last_clean":"2024-09-05T01:22:46.872019+0000","last_became_active":"2024-09-05T01:22:32.610248+0000","last_became_peered":"2024-09-05T01:22:32.610248+0000","last_unstale":"2024-09-05T01:22:46.872019+0000","last_undegraded":"2024-09-05T01:22:46.872019+0000","last_fullsized":"2024-09-05T01:22:46.872019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:14:09.468772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034214+0000","last_change":"2024-09-05T01:22:35.044346+0000","last_active":"2024-09-05T01:22:36.034214+0000","last_peered":"2024-09-05T01:22:36.034214+0000","last_clean":"2024-09-05T01:22:36.034214+0000","last_became_active":"2024-09-05T01:22:35.043977+0000","last_became_peered":"2024-09-05T01:22:35.043977+0000","last_unstale":"2024-09-05T01:22:36.034214+0000","last_undegraded":"2024-09-05T01:22:36.034214+0000","last_fullsized":"2024-09-05T01:22:36.034214+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:03:33.007905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:45.086975+0000","last_change":"2024-09-05T01:22:32.615120+0000","last_active":"2024-09-05T01:22:45.086975+0000","last_peered":"2024-09-05T01:22:45.086975+0000","last_clean":"2024-09-05T01:22:45.086975+0000","last_became_active":"2024-09-05T01:22:32.614671+0000","last_became_peered":"2024-09-05T01:22:32.614671+0000","last_unstale":"2024-09-05T01:22:45.086975+0000","last_undegraded":"2024-09-05T01:22:45.086975+0000","last_fullsized":"2024-09-05T01:22:45.086975+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:00:00.134610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.018808+0000","last_change":"2024-09-05T01:22:35.035840+0000","last_active":"2024-09-05T01:22:36.018808+0000","last_peered":"2024-09-05T01:22:36.018808+0000","last_clean":"2024-09-05T01:22:36.018808+0000","last_became_active":"2024-09-05T01:22:35.035511+0000","last_became_peered":"2024-09-05T01:22:35.035511+0000","last_unstale":"2024-09-05T01:22:36.018808+0000","last_undegraded":"2024-09-05T01:22:36.018808+0000","last_fullsized":"2024-09-05T01:22:36.018808+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:30:01.929816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:23:00.885596+0000","last_change":"2024-09-05T01:22:33.064281+0000","last_active":"2024-09-05T01:23:00.885596+0000","last_peered":"2024-09-05T01:23:00.885596+0000","last_clean":"2024-09-05T01:23:00.885596+0000","last_became_active":"2024-09-05T01:22:33.063792+0000","last_became_peered":"2024-09-05T01:22:33.063792+0000","last_unstale":"2024-09-05T01:23:00.885596+0000","last_undegraded":"2024-09-05T01:23:00.885596+0000","last_fullsized":"2024-09-05T01:23:00.885596+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:44:19.558140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.037590+0000","last_change":"2024-09-05T01:22:35.035336+0000","last_active":"2024-09-05T01:22:36.037590+0000","last_peered":"2024-09-05T01:22:36.037590+0000","last_clean":"2024-09-05T01:22:36.037590+0000","last_became_active":"2024-09-05T01:22:35.034976+0000","last_became_peered":"2024-09-05T01:22:35.034976+0000","last_unstale":"2024-09-05T01:22:36.037590+0000","last_undegraded":"2024-09-05T01:22:36.037590+0000","last_fullsized":"2024-09-05T01:22:36.037590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:51:57.850225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"81'6","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:59.892818+0000","last_change":"2024-09-05T01:22:32.614203+0000","last_active":"2024-09-05T01:22:59.892818+0000","last_peered":"2024-09-05T01:22:59.892818+0000","last_clean":"2024-09-05T01:22:59.892818+0000","last_became_active":"2024-09-05T01:22:32.613774+0000","last_became_peered":"2024-09-05T01:22:32.613774+0000","last_unstale":"2024-09-05T01:22:59.892818+0000","last_undegraded":"2024-09-05T01:22:59.892818+0000","last_fullsized":"2024-09-05T01:22:59.892818+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:52:05.383835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.021545+0000","last_change":"2024-09-05T01:22:35.042770+0000","last_active":"2024-09-05T01:22:36.021545+0000","last_peered":"2024-09-05T01:22:36.021545+0000","last_clean":"2024-09-05T01:22:36.021545+0000","last_became_active":"2024-09-05T01:22:35.042338+0000","last_became_peered":"2024-09-05T01:22:35.042338+0000","last_unstale":"2024-09-05T01:22:36.021545+0000","last_undegraded":"2024-09-05T01:22:36.021545+0000","last_fullsized":"2024-09-05T01:22:36.021545+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:02:35.669717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034432+0000","last_change":"2024-09-05T01:22:33.065134+0000","last_active":"2024-09-05T01:22:36.034432+0000","last_peered":"2024-09-05T01:22:36.034432+0000","last_clean":"2024-09-05T01:22:36.034432+0000","last_became_active":"2024-09-05T01:22:33.064685+0000","last_became_peered":"2024-09-05T01:22:33.064685+0000","last_unstale":"2024-09-05T01:22:36.034432+0000","last_undegraded":"2024-09-05T01:22:36.034432+0000","last_fullsized":"2024-09-05T01:22:36.034432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:03:00.976350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.021517+0000","last_change":"2024-09-05T01:22:35.035940+0000","last_active":"2024-09-05T01:22:36.021517+0000","last_peered":"2024-09-05T01:22:36.021517+0000","last_clean":"2024-09-05T01:22:36.021517+0000","last_became_active":"2024-09-05T01:22:35.035582+0000","last_became_peered":"2024-09-05T01:22:35.035582+0000","last_unstale":"2024-09-05T01:22:36.021517+0000","last_undegraded":"2024-09-05T01:22:36.021517+0000","last_fullsized":"2024-09-05T01:22:36.021517+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:37:06.621512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.861711+0000","last_change":"2024-09-05T01:22:33.064003+0000","last_active":"2024-09-05T01:22:46.861711+0000","last_peered":"2024-09-05T01:22:46.861711+0000","last_clean":"2024-09-05T01:22:46.861711+0000","last_became_active":"2024-09-05T01:22:33.063685+0000","last_became_peered":"2024-09-05T01:22:33.063685+0000","last_unstale":"2024-09-05T01:22:46.861711+0000","last_undegraded":"2024-09-05T01:22:46.861711+0000","last_fullsized":"2024-09-05T01:22:46.861711+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:49:03.742215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.019253+0000","last_change":"2024-09-05T01:22:35.034912+0000","last_active":"2024-09-05T01:22:36.019253+0000","last_peered":"2024-09-05T01:22:36.019253+0000","last_clean":"2024-09-05T01:22:36.019253+0000","last_became_active":"2024-09-05T01:22:35.034526+0000","last_became_peered":"2024-09-05T01:22:35.034526+0000","last_unstale":"2024-09-05T01:22:36.019253+0000","last_undegraded":"2024-09-05T01:22:36.019253+0000","last_fullsized":"2024-09-05T01:22:36.019253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:06:00.000162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'13","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:23:00.035541+0000","last_change":"2024-09-05T01:22:32.610123+0000","last_active":"2024-09-05T01:23:00.035541+0000","last_peered":"2024-09-05T01:23:00.035541+0000","last_clean":"2024-09-05T01:23:00.035541+0000","last_became_active":"2024-09-05T01:22:32.608901+0000","last_became_peered":"2024-09-05T01:22:32.608901+0000","last_unstale":"2024-09-05T01:23:00.035541+0000","last_undegraded":"2024-09-05T01:23:00.035541+0000","last_fullsized":"2024-09-05T01:23:00.035541+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:13:10.691546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034916+0000","last_change":"2024-09-05T01:22:35.038184+0000","last_active":"2024-09-05T01:22:36.034916+0000","last_peered":"2024-09-05T01:22:36.034916+0000","last_clean":"2024-09-05T01:22:36.034916+0000","last_became_active":"2024-09-05T01:22:35.036702+0000","last_became_peered":"2024-09-05T01:22:35.036702+0000","last_unstale":"2024-09-05T01:22:36.034916+0000","last_undegraded":"2024-09-05T01:22:36.034916+0000","last_fullsized":"2024-09-05T01:22:36.034916+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:43:53.813358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.872684+0000","last_change":"2024-09-05T01:22:32.663209+0000","last_active":"2024-09-05T01:22:46.872684+0000","last_peered":"2024-09-05T01:22:46.872684+0000","last_clean":"2024-09-05T01:22:46.872684+0000","last_became_active":"2024-09-05T01:22:32.662928+0000","last_became_peered":"2024-09-05T01:22:32.662928+0000","last_unstale":"2024-09-05T01:22:46.872684+0000","last_undegraded":"2024-09-05T01:22:46.872684+0000","last_fullsized":"2024-09-05T01:22:46.872684+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:10:57.677344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.038158+0000","last_change":"2024-09-05T01:22:35.046550+0000","last_active":"2024-09-05T01:22:36.038158+0000","last_peered":"2024-09-05T01:22:36.038158+0000","last_clean":"2024-09-05T01:22:36.038158+0000","last_became_active":"2024-09-05T01:22:35.046247+0000","last_became_peered":"2024-09-05T01:22:35.046247+0000","last_unstale":"2024-09-05T01:22:36.038158+0000","last_undegraded":"2024-09-05T01:22:36.038158+0000","last_fullsized":"2024-09-05T01:22:36.038158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:00:45.859788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:44.076803+0000","last_change":"2024-09-05T01:22:33.064832+0000","last_active":"2024-09-05T01:22:44.076803+0000","last_peered":"2024-09-05T01:22:44.076803+0000","last_clean":"2024-09-05T01:22:44.076803+0000","last_became_active":"2024-09-05T01:22:33.064405+0000","last_became_peered":"2024-09-05T01:22:33.064405+0000","last_unstale":"2024-09-05T01:22:44.076803+0000","last_undegraded":"2024-09-05T01:22:44.076803+0000","last_fullsized":"2024-09-05T01:22:44.076803+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:48:43.093325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.033404+0000","last_change":"2024-09-05T01:22:35.030670+0000","last_active":"2024-09-05T01:22:36.033404+0000","last_peered":"2024-09-05T01:22:36.033404+0000","last_clean":"2024-09-05T01:22:36.033404+0000","last_became_active":"2024-09-05T01:22:35.030338+0000","last_became_peered":"2024-09-05T01:22:35.030338+0000","last_unstale":"2024-09-05T01:22:36.033404+0000","last_undegraded":"2024-09-05T01:22:36.033404+0000","last_fullsized":"2024-09-05T01:22:36.033404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:22:51.832965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.872270+0000","last_change":"2024-09-05T01:22:32.612040+0000","last_active":"2024-09-05T01:22:46.872270+0000","last_peered":"2024-09-05T01:22:46.872270+0000","last_clean":"2024-09-05T01:22:46.872270+0000","last_became_active":"2024-09-05T01:22:32.610597+0000","last_became_peered":"2024-09-05T01:22:32.610597+0000","last_unstale":"2024-09-05T01:22:46.872270+0000","last_undegraded":"2024-09-05T01:22:46.872270+0000","last_fullsized":"2024-09-05T01:22:46.872270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:06:31.624775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.020150+0000","last_change":"2024-09-05T01:22:35.036220+0000","last_active":"2024-09-05T01:22:36.020150+0000","last_peered":"2024-09-05T01:22:36.020150+0000","last_clean":"2024-09-05T01:22:36.020150+0000","last_became_active":"2024-09-05T01:22:35.035881+0000","last_became_peered":"2024-09-05T01:22:35.035881+0000","last_unstale":"2024-09-05T01:22:36.020150+0000","last_undegraded":"2024-09-05T01:22:36.020150+0000","last_fullsized":"2024-09-05T01:22:36.020150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:12:03.104075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.097709+0000","last_change":"2024-09-05T01:22:32.608922+0000","last_active":"2024-09-05T01:22:46.097709+0000","last_peered":"2024-09-05T01:22:46.097709+0000","last_clean":"2024-09-05T01:22:46.097709+0000","last_became_active":"2024-09-05T01:22:32.608453+0000","last_became_peered":"2024-09-05T01:22:32.608453+0000","last_unstale":"2024-09-05T01:22:46.097709+0000","last_undegraded":"2024-09-05T01:22:46.097709+0000","last_fullsized":"2024-09-05T01:22:46.097709+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:03:41.947264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034392+0000","last_change":"2024-09-05T01:22:35.047556+0000","last_active":"2024-09-05T01:22:36.034392+0000","last_peered":"2024-09-05T01:22:36.034392+0000","last_clean":"2024-09-05T01:22:36.034392+0000","last_became_active":"2024-09-05T01:22:35.046260+0000","last_became_peered":"2024-09-05T01:22:35.046260+0000","last_unstale":"2024-09-05T01:22:36.034392+0000","last_undegraded":"2024-09-05T01:22:36.034392+0000","last_fullsized":"2024-09-05T01:22:36.034392+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:13:09.379906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:44.076525+0000","last_change":"2024-09-05T01:22:32.612948+0000","last_active":"2024-09-05T01:22:44.076525+0000","last_peered":"2024-09-05T01:22:44.076525+0000","last_clean":"2024-09-05T01:22:44.076525+0000","last_became_active":"2024-09-05T01:22:32.612319+0000","last_became_peered":"2024-09-05T01:22:32.612319+0000","last_unstale":"2024-09-05T01:22:44.076525+0000","last_undegraded":"2024-09-05T01:22:44.076525+0000","last_fullsized":"2024-09-05T01:22:44.076525+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:17:56.068106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.038502+0000","last_change":"2024-09-05T01:22:35.036218+0000","last_active":"2024-09-05T01:22:36.038502+0000","last_peered":"2024-09-05T01:22:36.038502+0000","last_clean":"2024-09-05T01:22:36.038502+0000","last_became_active":"2024-09-05T01:22:35.035180+0000","last_became_peered":"2024-09-05T01:22:35.035180+0000","last_unstale":"2024-09-05T01:22:36.038502+0000","last_undegraded":"2024-09-05T01:22:36.038502+0000","last_fullsized":"2024-09-05T01:22:36.038502+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:37:13.936829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.038015+0000","last_change":"2024-09-05T01:22:35.039616+0000","last_active":"2024-09-05T01:22:36.038015+0000","last_peered":"2024-09-05T01:22:36.038015+0000","last_clean":"2024-09-05T01:22:36.038015+0000","last_became_active":"2024-09-05T01:22:35.039297+0000","last_became_peered":"2024-09-05T01:22:35.039297+0000","last_unstale":"2024-09-05T01:22:36.038015+0000","last_undegraded":"2024-09-05T01:22:36.038015+0000","last_fullsized":"2024-09-05T01:22:36.038015+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:24:44.703168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.873041+0000","last_change":"2024-09-05T01:22:32.609792+0000","last_active":"2024-09-05T01:22:46.873041+0000","last_peered":"2024-09-05T01:22:46.873041+0000","last_clean":"2024-09-05T01:22:46.873041+0000","last_became_active":"2024-09-05T01:22:32.609361+0000","last_became_peered":"2024-09-05T01:22:32.609361+0000","last_unstale":"2024-09-05T01:22:46.873041+0000","last_undegraded":"2024-09-05T01:22:46.873041+0000","last_fullsized":"2024-09-05T01:22:46.873041+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:05:15.105759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034323+0000","last_change":"2024-09-05T01:22:35.038792+0000","last_active":"2024-09-05T01:22:36.034323+0000","last_peered":"2024-09-05T01:22:36.034323+0000","last_clean":"2024-09-05T01:22:36.034323+0000","last_became_active":"2024-09-05T01:22:35.038129+0000","last_became_peered":"2024-09-05T01:22:35.038129+0000","last_unstale":"2024-09-05T01:22:36.034323+0000","last_undegraded":"2024-09-05T01:22:36.034323+0000","last_fullsized":"2024-09-05T01:22:36.034323+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:39:31.020488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'12","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:46.873427+0000","last_change":"2024-09-05T01:22:32.613600+0000","last_active":"2024-09-05T01:22:46.873427+0000","last_peered":"2024-09-05T01:22:46.873427+0000","last_clean":"2024-09-05T01:22:46.873427+0000","last_became_active":"2024-09-05T01:22:32.613186+0000","last_became_peered":"2024-09-05T01:22:32.613186+0000","last_unstale":"2024-09-05T01:22:46.873427+0000","last_undegraded":"2024-09-05T01:22:46.873427+0000","last_fullsized":"2024-09-05T01:22:46.873427+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:36:57.833008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.038125+0000","last_change":"2024-09-05T01:22:35.045174+0000","last_active":"2024-09-05T01:22:36.038125+0000","last_peered":"2024-09-05T01:22:36.038125+0000","last_clean":"2024-09-05T01:22:36.038125+0000","last_became_active":"2024-09-05T01:22:35.041750+0000","last_became_peered":"2024-09-05T01:22:35.041750+0000","last_unstale":"2024-09-05T01:22:36.038125+0000","last_undegraded":"2024-09-05T01:22:36.038125+0000","last_fullsized":"2024-09-05T01:22:36.038125+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:34:00.174324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.038554+0000","last_change":"2024-09-05T01:22:33.065150+0000","last_active":"2024-09-05T01:22:36.038554+0000","last_peered":"2024-09-05T01:22:36.038554+0000","last_clean":"2024-09-05T01:22:36.038554+0000","last_became_active":"2024-09-05T01:22:33.064456+0000","last_became_peered":"2024-09-05T01:22:33.064456+0000","last_unstale":"2024-09-05T01:22:36.038554+0000","last_undegraded":"2024-09-05T01:22:36.038554+0000","last_fullsized":"2024-09-05T01:22:36.038554+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:16:20.879893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:22:36.034838+0000","last_change":"2024-09-05T01:22:35.043158+0000","last_active":"2024-09-05T01:22:36.034838+0000","last_peered":"2024-09-05T01:22:36.034838+0000","last_clean":"2024-09-05T01:22:36.034838+0000","last_became_active":"2024-09-05T01:22:35.038666+0000","last_became_peered":"2024-09-05T01:22:35.038666+0000","last_unstale":"2024-09-05T01:22:36.034838+0000","last_undegraded":"2024-09-05T01:22:36.034838+0000","last_fullsized":"2024-09-05T01:22:36.034838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:44:18.551980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'13","reported_seq":49,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-05T01:23:02.895939+0000","last_change":"2024-09-05T01:22:32.613713+0000","last_active":"2024-09-05T01:23:02.895939+0000","last_peered":"2024-09-05T01:23:02.895939+0000","last_clean":"2024-09-05T01:23:02.895939+0000","last_became_active":"2024-09-05T01:22:32.613284+0000","last_became_peered":"2024-09-05T01:22:32.613284+0000","last_unstale":"2024-09-05T01:23:02.895939+0000","last_undegraded":"2024-09-05T01:23:02.895939+0000","last_fullsized":"2024-09-05T01:23:02.895939+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:39:46.881635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64543,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":210,"num_read_kb":178,"num_write":239,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":193629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547219,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":420830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776152,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32724,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712428,"statfs":{"total":95995035648,"available":95961526272,"internally_reserved":0,"allocated":1576960,"data_stored":1069194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939677,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":905216,"data_stored":420760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168611,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":421138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397544,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28488,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716664,"statfs":{"total":95995035648,"available":95965863936,"internally_reserved":0,"allocated":1499136,"data_stored":1014444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561069,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":888832,"data_stored":420870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790002,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1511424,"data_stored":1013336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953528,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":420731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182460,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":420302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411395,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":478945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":478725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":421816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":59087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":59307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":59071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T01:23:07.069 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-05T01:23:07.069 INFO:tasks.cephadm:Setting up client nodes... 2024-09-05T01:23:07.070 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-05T01:23:07.445 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:07.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:07 smithi012 ceph-mon[29942]: from='client.24685 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T01:23:07.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:07 smithi145 ceph-mon[34376]: from='client.24685 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T01:23:07.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:07 smithi151 ceph-mon[35013]: from='client.24685 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T01:23:08.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.008+0000 7fdfbec00640 1 -- 172.21.15.12:0/3123893995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfb8103e00 msgr2=0x7fdfb8104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:08.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.008+0000 7fdfbec00640 1 --2- 172.21.15.12:0/3123893995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfb8103e00 0x7fdfb8104200 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009900 tx=0x7fdfa802a410 comp rx=0 tx=0).stop 2024-09-05T01:23:08.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.008+0000 7fdfbec00640 1 -- 172.21.15.12:0/3123893995 shutdown_connections 2024-09-05T01:23:08.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.008+0000 7fdfbec00640 1 --2- 172.21.15.12:0/3123893995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb8105920 0x7fdfb810c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:08.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.008+0000 7fdfbec00640 1 --2- 172.21.15.12:0/3123893995 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfb8104f60 0x7fdfb81053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:08.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.008+0000 7fdfbec00640 1 --2- 172.21.15.12:0/3123893995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfb8103e00 0x7fdfb8104200 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:08.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.008+0000 7fdfbec00640 1 -- 172.21.15.12:0/3123893995 >> 172.21.15.12:0/3123893995 conn(0x7fdfb80ff5b0 msgr2=0x7fdfb81019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:08.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.008+0000 7fdfbec00640 1 -- 172.21.15.12:0/3123893995 shutdown_connections 2024-09-05T01:23:08.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.008+0000 7fdfbec00640 1 -- 172.21.15.12:0/3123893995 wait complete. 2024-09-05T01:23:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.009+0000 7fdfbec00640 1 Processor -- start 2024-09-05T01:23:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.009+0000 7fdfbec00640 1 -- start start 2024-09-05T01:23:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.010+0000 7fdfbec00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfb8103e00 0x7fdfb819a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.010+0000 7fdfbec00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb8104f60 0x7fdfb819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.010+0000 7fdfbec00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfb8105920 0x7fdfb81a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.010+0000 7fdfbec00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb810fab0 con 0x7fdfb8105920 2024-09-05T01:23:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.010+0000 7fdfbec00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb810f930 con 0x7fdfb8103e00 2024-09-05T01:23:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.010+0000 7fdfbec00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb810fc30 con 0x7fdfb8104f60 2024-09-05T01:23:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.010+0000 7fdfb7400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb8104f60 0x7fdfb819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.010+0000 7fdfb7e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfb8103e00 0x7fdfb819a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.010+0000 7fdfbcc00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfb8105920 0x7fdfb81a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.010+0000 7fdfb7400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb8104f60 0x7fdfb819a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:56194/0 (socket says 172.21.15.12:56194) 2024-09-05T01:23:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.010+0000 7fdfb7400640 1 -- 172.21.15.12:0/2852477943 learned_addr learned my addr 172.21.15.12:0/2852477943 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.011+0000 7fdfb7400640 1 -- 172.21.15.12:0/2852477943 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfb8103e00 msgr2=0x7fdfb819a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.011+0000 7fdfb7400640 1 --2- 172.21.15.12:0/2852477943 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfb8103e00 0x7fdfb819a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.011+0000 7fdfb7400640 1 -- 172.21.15.12:0/2852477943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfb8105920 msgr2=0x7fdfb81a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.011+0000 7fdfb7400640 1 --2- 172.21.15.12:0/2852477943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfb8105920 0x7fdfb81a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.011+0000 7fdfb7400640 1 -- 172.21.15.12:0/2852477943 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb81a1ce0 con 0x7fdfb8104f60 2024-09-05T01:23:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.011+0000 7fdfbcc00640 1 --2- 172.21.15.12:0/2852477943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfb8105920 0x7fdfb81a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:23:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.011+0000 7fdfb7400640 1 --2- 172.21.15.12:0/2852477943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb8104f60 0x7fdfb819a5f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdfa400e9c0 tx=0x7fdfa400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.011+0000 7fdfb4c00640 1 -- 172.21.15.12:0/2852477943 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa400cd80 con 0x7fdfb8104f60 2024-09-05T01:23:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.011+0000 7fdfbec00640 1 -- 172.21.15.12:0/2852477943 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb81a1fd0 con 0x7fdfb8104f60 2024-09-05T01:23:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.012+0000 7fdfb4c00640 1 -- 172.21.15.12:0/2852477943 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfa40035f0 con 0x7fdfb8104f60 2024-09-05T01:23:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.012+0000 7fdfb4c00640 1 -- 172.21.15.12:0/2852477943 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4010690 con 0x7fdfb8104f60 2024-09-05T01:23:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.012+0000 7fdfbec00640 1 -- 172.21.15.12:0/2852477943 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb81a24d0 con 0x7fdfb8104f60 2024-09-05T01:23:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.013+0000 7fdfbec00640 1 -- 172.21.15.12:0/2852477943 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb810b1a0 con 0x7fdfb8104f60 2024-09-05T01:23:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.015+0000 7fdfb4c00640 1 -- 172.21.15.12:0/2852477943 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdfa40037a0 con 0x7fdfb8104f60 2024-09-05T01:23:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.017+0000 7fdfb4c00640 1 --2- 172.21.15.12:0/2852477943 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fdf9c0a2c40 0x7fdf9c0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.017+0000 7fdfb4c00640 1 -- 172.21.15.12:0/2852477943 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fdfa40cf400 con 0x7fdfb8104f60 2024-09-05T01:23:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.017+0000 7fdfb7e00640 1 --2- 172.21.15.12:0/2852477943 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fdf9c0a2c40 0x7fdf9c0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.017+0000 7fdfb7e00640 1 --2- 172.21.15.12:0/2852477943 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fdf9c0a2c40 0x7fdf9c0a5100 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80314e0 tx=0x7fdfa8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.018+0000 7fdfb4c00640 1 -- 172.21.15.12:0/2852477943 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdfa409c2b0 con 0x7fdfb8104f60 2024-09-05T01:23:08.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.277+0000 7fdfbec00640 1 -- 172.21.15.12:0/2852477943 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fdfb802d9c0 con 0x7fdfb8104f60 2024-09-05T01:23:08.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.296+0000 7fdfb4c00640 1 -- 172.21.15.12:0/2852477943 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fdfa409bbb0 con 0x7fdfb8104f60 2024-09-05T01:23:08.300 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2024-09-05T01:23:08.300 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD8B9lmGdX8EBAAye44YZ7t8IcQi8wMtN1KsQ== 2024-09-05T01:23:08.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.298+0000 7fdfbec00640 1 -- 172.21.15.12:0/2852477943 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fdf9c0a2c40 msgr2=0x7fdf9c0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:08.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.298+0000 7fdfbec00640 1 --2- 172.21.15.12:0/2852477943 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fdf9c0a2c40 0x7fdf9c0a5100 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80314e0 tx=0x7fdfa8000bc0 comp rx=0 tx=0).stop 2024-09-05T01:23:08.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.298+0000 7fdfbec00640 1 -- 172.21.15.12:0/2852477943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb8104f60 msgr2=0x7fdfb819a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:08.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.298+0000 7fdfbec00640 1 --2- 172.21.15.12:0/2852477943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb8104f60 0x7fdfb819a5f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdfa400e9c0 tx=0x7fdfa400ee80 comp rx=0 tx=0).stop 2024-09-05T01:23:08.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.298+0000 7fdfbec00640 1 -- 172.21.15.12:0/2852477943 shutdown_connections 2024-09-05T01:23:08.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.298+0000 7fdfbec00640 1 --2- 172.21.15.12:0/2852477943 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fdf9c0a2c40 0x7fdf9c0a5100 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:08.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.298+0000 7fdfbec00640 1 --2- 172.21.15.12:0/2852477943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfb8105920 0x7fdfb81a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:08.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.298+0000 7fdfbec00640 1 --2- 172.21.15.12:0/2852477943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb8104f60 0x7fdfb819a5f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:08.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.298+0000 7fdfbec00640 1 --2- 172.21.15.12:0/2852477943 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdfb8103e00 0x7fdfb819a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:08.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.298+0000 7fdfbec00640 1 -- 172.21.15.12:0/2852477943 >> 172.21.15.12:0/2852477943 conn(0x7fdfb80ff5b0 msgr2=0x7fdfb8108370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:08.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.299+0000 7fdfbec00640 1 -- 172.21.15.12:0/2852477943 shutdown_connections 2024-09-05T01:23:08.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:08.299+0000 7fdfbec00640 1 -- 172.21.15.12:0/2852477943 wait complete. 2024-09-05T01:23:08.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:08 smithi012 ceph-mon[29942]: pgmap v304: 97 pgs: 97 active+clean; 640 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.4 KiB/s wr, 11 op/s 2024-09-05T01:23:08.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:08 smithi145 ceph-mon[34376]: pgmap v304: 97 pgs: 97 active+clean; 640 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.4 KiB/s wr, 11 op/s 2024-09-05T01:23:08.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:08 smithi151 ceph-mon[35013]: pgmap v304: 97 pgs: 97 active+clean; 640 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.4 KiB/s wr, 11 op/s 2024-09-05T01:23:09.098 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-05T01:23:09.098 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-05T01:23:09.098 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-05T01:23:09.181 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-05T01:23:09.181 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-05T01:23:09.182 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph mgr dump --format=json 2024-09-05T01:23:09.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:09 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2852477943' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-05T01:23:09.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:09 smithi012 ceph-mon[29942]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-05T01:23:09.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:09 smithi012 ceph-mon[29942]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-05T01:23:09.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:09 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/2852477943' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-05T01:23:09.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:09 smithi145 ceph-mon[34376]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-05T01:23:09.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:09 smithi145 ceph-mon[34376]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-05T01:23:09.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:09 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/2852477943' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-05T01:23:09.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:09 smithi151 ceph-mon[35013]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-05T01:23:09.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:09 smithi151 ceph-mon[35013]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-05T01:23:09.605 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:10.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.156+0000 7f281f000640 1 -- 172.21.15.12:0/2925409483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2818109140 msgr2=0x7f2818110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:10.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.156+0000 7f281f000640 1 --2- 172.21.15.12:0/2925409483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2818109140 0x7f2818110cc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2810009ca0 tx=0x7f281002a8c0 comp rx=0 tx=0).stop 2024-09-05T01:23:10.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.157+0000 7f281f000640 1 -- 172.21.15.12:0/2925409483 shutdown_connections 2024-09-05T01:23:10.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.157+0000 7f281f000640 1 --2- 172.21.15.12:0/2925409483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2818109140 0x7f2818110cc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:10.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.157+0000 7f281f000640 1 --2- 172.21.15.12:0/2925409483 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f28181049c0 0x7f2818108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:10.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.157+0000 7f281f000640 1 --2- 172.21.15.12:0/2925409483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2818104010 0x7f28181043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:10.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.157+0000 7f281f000640 1 -- 172.21.15.12:0/2925409483 >> 172.21.15.12:0/2925409483 conn(0x7f28180ffa50 msgr2=0x7f2818101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:10.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.157+0000 7f281f000640 1 -- 172.21.15.12:0/2925409483 shutdown_connections 2024-09-05T01:23:10.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.157+0000 7f281f000640 1 -- 172.21.15.12:0/2925409483 wait complete. 2024-09-05T01:23:10.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.158+0000 7f281f000640 1 Processor -- start 2024-09-05T01:23:10.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.158+0000 7f281f000640 1 -- start start 2024-09-05T01:23:10.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.158+0000 7f281f000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2818104010 0x7f281819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:10.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.158+0000 7f281f000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28181049c0 0x7f281819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:10.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.158+0000 7f281f000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2818109140 0x7f281819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:10.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.158+0000 7f281f000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f28181141a0 con 0x7f2818109140 2024-09-05T01:23:10.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.158+0000 7f281f000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2818114020 con 0x7f2818104010 2024-09-05T01:23:10.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.158+0000 7f281f000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2818114320 con 0x7f28181049c0 2024-09-05T01:23:10.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.158+0000 7f281d000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2818109140 0x7f281819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:10.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.158+0000 7f2817e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2818104010 0x7f281819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:10.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.158+0000 7f281d000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2818109140 0x7f281819ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33994/0 (socket says 172.21.15.12:33994) 2024-09-05T01:23:10.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.158+0000 7f281d000640 1 -- 172.21.15.12:0/3003400538 learned_addr learned my addr 172.21.15.12:0/3003400538 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:10.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.158+0000 7f280f400640 1 --2- 172.21.15.12:0/3003400538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28181049c0 0x7f281819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:10.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.159+0000 7f2817e00640 1 -- 172.21.15.12:0/3003400538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28181049c0 msgr2=0x7f281819abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:10.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.159+0000 7f2817e00640 1 --2- 172.21.15.12:0/3003400538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28181049c0 0x7f281819abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:10.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.159+0000 7f2817e00640 1 -- 172.21.15.12:0/3003400538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2818109140 msgr2=0x7f281819ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:10.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.159+0000 7f2817e00640 1 --2- 172.21.15.12:0/3003400538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2818109140 0x7f281819ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:10.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.159+0000 7f2817e00640 1 -- 172.21.15.12:0/3003400538 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f281819f650 con 0x7f2818104010 2024-09-05T01:23:10.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.159+0000 7f2817e00640 1 --2- 172.21.15.12:0/3003400538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2818104010 0x7f281819a6a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2808005fd0 tx=0x7f280800dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:10.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.159+0000 7f2815600640 1 -- 172.21.15.12:0/3003400538 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2808009c30 con 0x7f2818104010 2024-09-05T01:23:10.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.160+0000 7f281f000640 1 -- 172.21.15.12:0/3003400538 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f281819f940 con 0x7f2818104010 2024-09-05T01:23:10.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.160+0000 7f2815600640 1 -- 172.21.15.12:0/3003400538 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2808009dd0 con 0x7f2818104010 2024-09-05T01:23:10.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.160+0000 7f2815600640 1 -- 172.21.15.12:0/3003400538 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2808010460 con 0x7f2818104010 2024-09-05T01:23:10.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.160+0000 7f281f000640 1 -- 172.21.15.12:0/3003400538 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28181a7220 con 0x7f2818104010 2024-09-05T01:23:10.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.161+0000 7f281f000640 1 -- 172.21.15.12:0/3003400538 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28181043f0 con 0x7f2818104010 2024-09-05T01:23:10.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.163+0000 7f2815600640 1 -- 172.21.15.12:0/3003400538 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2808003ef0 con 0x7f2818104010 2024-09-05T01:23:10.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.164+0000 7f2815600640 1 --2- 172.21.15.12:0/3003400538 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f27fc0a2c10 0x7f27fc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:10.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.164+0000 7f2815600640 1 -- 172.21.15.12:0/3003400538 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f28080cebe0 con 0x7f2818104010 2024-09-05T01:23:10.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.164+0000 7f280f400640 1 --2- 172.21.15.12:0/3003400538 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f27fc0a2c10 0x7f27fc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:10.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.165+0000 7f280f400640 1 --2- 172.21.15.12:0/3003400538 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f27fc0a2c10 0x7f27fc0a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f281810aab0 tx=0x7f280000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:10.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.166+0000 7f2815600640 1 -- 172.21.15.12:0/3003400538 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2808017020 con 0x7f2818104010 2024-09-05T01:23:10.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.407+0000 7f281f000640 1 -- 172.21.15.12:0/3003400538 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f281810c380 con 0x7f2818104010 2024-09-05T01:23:10.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.413+0000 7f2815600640 1 -- 172.21.15.12:0/3003400538 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263200 (secure 0 0 0) 0x7f280809b440 con 0x7f2818104010 2024-09-05T01:23:10.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:23:10.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.416+0000 7f281f000640 1 -- 172.21.15.12:0/3003400538 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f27fc0a2c10 msgr2=0x7f27fc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:10.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.416+0000 7f281f000640 1 --2- 172.21.15.12:0/3003400538 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f27fc0a2c10 0x7f27fc0a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f281810aab0 tx=0x7f280000b410 comp rx=0 tx=0).stop 2024-09-05T01:23:10.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.416+0000 7f281f000640 1 -- 172.21.15.12:0/3003400538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2818104010 msgr2=0x7f281819a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:10.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.416+0000 7f281f000640 1 --2- 172.21.15.12:0/3003400538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2818104010 0x7f281819a6a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2808005fd0 tx=0x7f280800dde0 comp rx=0 tx=0).stop 2024-09-05T01:23:10.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.416+0000 7f281f000640 1 -- 172.21.15.12:0/3003400538 shutdown_connections 2024-09-05T01:23:10.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.416+0000 7f281f000640 1 --2- 172.21.15.12:0/3003400538 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f27fc0a2c10 0x7f27fc0a50d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:10.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.416+0000 7f281f000640 1 --2- 172.21.15.12:0/3003400538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2818109140 0x7f281819ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:10.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.416+0000 7f281f000640 1 --2- 172.21.15.12:0/3003400538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28181049c0 0x7f281819abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:10.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.416+0000 7f281f000640 1 --2- 172.21.15.12:0/3003400538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2818104010 0x7f281819a6a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:10.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.416+0000 7f281f000640 1 -- 172.21.15.12:0/3003400538 >> 172.21.15.12:0/3003400538 conn(0x7f28180ffa50 msgr2=0x7f2818100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:10.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.417+0000 7f281f000640 1 -- 172.21.15.12:0/3003400538 shutdown_connections 2024-09-05T01:23:10.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:10.417+0000 7f281f000640 1 -- 172.21.15.12:0/3003400538 wait complete. 2024-09-05T01:23:10.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:10 smithi012 ceph-mon[29942]: pgmap v305: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.8 KiB/s wr, 13 op/s 2024-09-05T01:23:10.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:10 smithi145 ceph-mon[34376]: pgmap v305: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.8 KiB/s wr, 13 op/s 2024-09-05T01:23:10.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:10 smithi151 ceph-mon[35013]: pgmap v305: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.8 KiB/s wr, 13 op/s 2024-09-05T01:23:11.245 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":2664180840},{"type":"v1","addr":"172.21.15.12:6801","nonce":2664180840}]},"active_addr":"172.21.15.12:6801/2664180840","active_change":"2024-09-05T01:15:22.093558+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.12:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":2280578773}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":1815886492}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":3089660384}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":1385871202}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":144504048}]}]} 2024-09-05T01:23:11.251 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-05T01:23:11.252 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-05T01:23:11.252 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T01:23:11.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:11 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3003400538' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-05T01:23:11.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:11 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3003400538' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-05T01:23:11.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:11 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3003400538' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-05T01:23:11.629 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:12.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.157+0000 7f4534600640 1 -- 172.21.15.12:0/3434386458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f452c109140 msgr2=0x7f452c110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:12.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.157+0000 7f4534600640 1 --2- 172.21.15.12:0/3434386458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f452c109140 0x7f452c110cc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4524009ca0 tx=0x7f452402a8c0 comp rx=0 tx=0).stop 2024-09-05T01:23:12.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.158+0000 7f4534600640 1 -- 172.21.15.12:0/3434386458 shutdown_connections 2024-09-05T01:23:12.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.158+0000 7f4534600640 1 --2- 172.21.15.12:0/3434386458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f452c109140 0x7f452c110cc0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:12.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.158+0000 7f4534600640 1 --2- 172.21.15.12:0/3434386458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f452c1049c0 0x7f452c108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:12.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.158+0000 7f4534600640 1 --2- 172.21.15.12:0/3434386458 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f452c104010 0x7f452c1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:12.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.158+0000 7f4534600640 1 -- 172.21.15.12:0/3434386458 >> 172.21.15.12:0/3434386458 conn(0x7f452c0ffa50 msgr2=0x7f452c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:12.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.158+0000 7f4534600640 1 -- 172.21.15.12:0/3434386458 shutdown_connections 2024-09-05T01:23:12.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.158+0000 7f4534600640 1 -- 172.21.15.12:0/3434386458 wait complete. 2024-09-05T01:23:12.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.159+0000 7f4534600640 1 Processor -- start 2024-09-05T01:23:12.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.159+0000 7f4534600640 1 -- start start 2024-09-05T01:23:12.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.160+0000 7f4534600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f452c104010 0x7f452c19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:12.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.160+0000 7f4534600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f452c1049c0 0x7f452c19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:12.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.160+0000 7f4534600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f452c109140 0x7f452c19ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:12.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.160+0000 7f4534600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f452c1141a0 con 0x7f452c109140 2024-09-05T01:23:12.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.160+0000 7f4534600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f452c114020 con 0x7f452c1049c0 2024-09-05T01:23:12.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.160+0000 7f4534600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f452c114320 con 0x7f452c104010 2024-09-05T01:23:12.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.160+0000 7f4532600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f452c109140 0x7f452c19ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:12.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.160+0000 7f4531c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f452c104010 0x7f452c19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:12.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.160+0000 7f4532600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f452c109140 0x7f452c19ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34020/0 (socket says 172.21.15.12:34020) 2024-09-05T01:23:12.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.160+0000 7f4532600640 1 -- 172.21.15.12:0/3943044610 learned_addr learned my addr 172.21.15.12:0/3943044610 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:12.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.160+0000 7f4531200640 1 --2- 172.21.15.12:0/3943044610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f452c1049c0 0x7f452c19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:12.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.161+0000 7f4531c00640 1 -- 172.21.15.12:0/3943044610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f452c1049c0 msgr2=0x7f452c19abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:12.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.161+0000 7f4531c00640 1 --2- 172.21.15.12:0/3943044610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f452c1049c0 0x7f452c19abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:12.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.161+0000 7f4531c00640 1 -- 172.21.15.12:0/3943044610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f452c109140 msgr2=0x7f452c19ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:12.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.161+0000 7f4531c00640 1 --2- 172.21.15.12:0/3943044610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f452c109140 0x7f452c19ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:12.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.161+0000 7f4531c00640 1 -- 172.21.15.12:0/3943044610 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f452c19f650 con 0x7f452c104010 2024-09-05T01:23:12.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.161+0000 7f4532600640 1 --2- 172.21.15.12:0/3943044610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f452c109140 0x7f452c19ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:23:12.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.161+0000 7f4531c00640 1 --2- 172.21.15.12:0/3943044610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f452c104010 0x7f452c19a6a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f452000d6d0 tx=0x7f452000db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:12.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.161+0000 7f452a000640 1 -- 172.21.15.12:0/3943044610 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4520017070 con 0x7f452c104010 2024-09-05T01:23:12.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.161+0000 7f4534600640 1 -- 172.21.15.12:0/3943044610 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f452c19f940 con 0x7f452c104010 2024-09-05T01:23:12.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.161+0000 7f4534600640 1 -- 172.21.15.12:0/3943044610 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f452c1a7220 con 0x7f452c104010 2024-09-05T01:23:12.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.161+0000 7f452a000640 1 -- 172.21.15.12:0/3943044610 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4520009820 con 0x7f452c104010 2024-09-05T01:23:12.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.161+0000 7f452a000640 1 -- 172.21.15.12:0/3943044610 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4520020060 con 0x7f452c104010 2024-09-05T01:23:12.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.161+0000 7f4534600640 1 -- 172.21.15.12:0/3943044610 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f450c005290 con 0x7f452c104010 2024-09-05T01:23:12.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.164+0000 7f452a000640 1 -- 172.21.15.12:0/3943044610 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4520005220 con 0x7f452c104010 2024-09-05T01:23:12.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.165+0000 7f452a000640 1 --2- 172.21.15.12:0/3943044610 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f45140a2c90 0x7f45140a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:12.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.165+0000 7f452a000640 1 -- 172.21.15.12:0/3943044610 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f45200cee70 con 0x7f452c104010 2024-09-05T01:23:12.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.165+0000 7f4531200640 1 --2- 172.21.15.12:0/3943044610 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f45140a2c90 0x7f45140a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:12.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.166+0000 7f4531200640 1 --2- 172.21.15.12:0/3943044610 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f45140a2c90 0x7f45140a5150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f452c10aab0 tx=0x7f451800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:12.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.168+0000 7f452a000640 1 -- 172.21.15.12:0/3943044610 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f452009b750 con 0x7f452c104010 2024-09-05T01:23:12.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.356+0000 7f4534600640 1 -- 172.21.15.12:0/3943044610 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f450c005850 con 0x7f452c104010 2024-09-05T01:23:12.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.358+0000 7f452a000640 1 -- 172.21.15.12:0/3943044610 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22315 (secure 0 0 0) 0x7f452009fa50 con 0x7f452c104010 2024-09-05T01:23:12.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:23:12.358 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":81,"fsid":"0d44cd7e-6b24-11ef-bcd6-c7b262605968","created":"2024-09-05T01:14:21.162850+0000","modified":"2024-09-05T01:22:35.979069+0000","last_up_change":"2024-09-05T01:21:37.145073+0000","last_in_change":"2024-09-05T01:21:15.076991+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T01:17:44.744065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T01:22:31.540178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T01:22:33.999318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b74ac640-b680-46e2-9106-d24168e685e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6803","nonce":2090563987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6805","nonce":2090563987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6809","nonce":2090563987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6807","nonce":2090563987}]},"public_addr":"172.21.15.12:6803/2090563987","cluster_addr":"172.21.15.12:6805/2090563987","heartbeat_back_addr":"172.21.15.12:6809/2090563987","heartbeat_front_addr":"172.21.15.12:6807/2090563987","state":["exists","up"]},{"osd":1,"uuid":"efca1216-8d85-4e6a-8c49-0afb511ece59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6801","nonce":2639126629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6803","nonce":2639126629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6807","nonce":2639126629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6805","nonce":2639126629}]},"public_addr":"172.21.15.145:6801/2639126629","cluster_addr":"172.21.15.145:6803/2639126629","heartbeat_back_addr":"172.21.15.145:6807/2639126629","heartbeat_front_addr":"172.21.15.145:6805/2639126629","state":["exists","up"]},{"osd":2,"uuid":"4d5699b2-646a-4ab6-94a5-ad223aa27ac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6801","nonce":3753171761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6803","nonce":3753171761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6807","nonce":3753171761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6805","nonce":3753171761}]},"public_addr":"172.21.15.151:6801/3753171761","cluster_addr":"172.21.15.151:6803/3753171761","heartbeat_back_addr":"172.21.15.151:6807/3753171761","heartbeat_front_addr":"172.21.15.151:6805/3753171761","state":["exists","up"]},{"osd":3,"uuid":"275ad2ad-93e6-4a68-8784-8f8dcb620f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6811","nonce":2231650146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6813","nonce":2231650146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6817","nonce":2231650146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6815","nonce":2231650146}]},"public_addr":"172.21.15.12:6811/2231650146","cluster_addr":"172.21.15.12:6813/2231650146","heartbeat_back_addr":"172.21.15.12:6817/2231650146","heartbeat_front_addr":"172.21.15.12:6815/2231650146","state":["exists","up"]},{"osd":4,"uuid":"21a0c5b4-4e0e-4fb6-8be6-a300cb811cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6809","nonce":1828591275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6811","nonce":1828591275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6815","nonce":1828591275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6813","nonce":1828591275}]},"public_addr":"172.21.15.145:6809/1828591275","cluster_addr":"172.21.15.145:6811/1828591275","heartbeat_back_addr":"172.21.15.145:6815/1828591275","heartbeat_front_addr":"172.21.15.145:6813/1828591275","state":["exists","up"]},{"osd":5,"uuid":"e2c7e6fb-5dea-459f-8d7a-7ae5b1936218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6809","nonce":3888870109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6811","nonce":3888870109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6815","nonce":3888870109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6813","nonce":3888870109}]},"public_addr":"172.21.15.151:6809/3888870109","cluster_addr":"172.21.15.151:6811/3888870109","heartbeat_back_addr":"172.21.15.151:6815/3888870109","heartbeat_front_addr":"172.21.15.151:6813/3888870109","state":["exists","up"]},{"osd":6,"uuid":"0df0a29c-3404-4ff5-ae48-78b69b77cbd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6819","nonce":3084810269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6821","nonce":3084810269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6825","nonce":3084810269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6823","nonce":3084810269}]},"public_addr":"172.21.15.12:6819/3084810269","cluster_addr":"172.21.15.12:6821/3084810269","heartbeat_back_addr":"172.21.15.12:6825/3084810269","heartbeat_front_addr":"172.21.15.12:6823/3084810269","state":["exists","up"]},{"osd":7,"uuid":"c7b3ad7c-a566-435c-9ef8-837bb764acb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6817","nonce":3058588721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6819","nonce":3058588721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6823","nonce":3058588721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6821","nonce":3058588721}]},"public_addr":"172.21.15.145:6817/3058588721","cluster_addr":"172.21.15.145:6819/3058588721","heartbeat_back_addr":"172.21.15.145:6823/3058588721","heartbeat_front_addr":"172.21.15.145:6821/3058588721","state":["exists","up"]},{"osd":8,"uuid":"8018a468-fbc5-4667-a53c-2e97c08713bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6817","nonce":905705309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6819","nonce":905705309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6823","nonce":905705309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6821","nonce":905705309}]},"public_addr":"172.21.15.151:6817/905705309","cluster_addr":"172.21.15.151:6819/905705309","heartbeat_back_addr":"172.21.15.151:6823/905705309","heartbeat_front_addr":"172.21.15.151:6821/905705309","state":["exists","up"]},{"osd":9,"uuid":"dcf3b524-c8b8-4ab6-83c6-fc52c776d72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6827","nonce":1193852496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6829","nonce":1193852496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6833","nonce":1193852496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6831","nonce":1193852496}]},"public_addr":"172.21.15.12:6827/1193852496","cluster_addr":"172.21.15.12:6829/1193852496","heartbeat_back_addr":"172.21.15.12:6833/1193852496","heartbeat_front_addr":"172.21.15.12:6831/1193852496","state":["exists","up"]},{"osd":10,"uuid":"7b5b34c3-8814-4d16-80ce-0b0c9be07cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6825","nonce":1296813755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6827","nonce":1296813755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6831","nonce":1296813755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6829","nonce":1296813755}]},"public_addr":"172.21.15.145:6825/1296813755","cluster_addr":"172.21.15.145:6827/1296813755","heartbeat_back_addr":"172.21.15.145:6831/1296813755","heartbeat_front_addr":"172.21.15.145:6829/1296813755","state":["exists","up"]},{"osd":11,"uuid":"157ee32a-43f0-4e5a-8dac-fce53c1efdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6825","nonce":2855185758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6827","nonce":2855185758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6831","nonce":2855185758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6829","nonce":2855185758}]},"public_addr":"172.21.15.151:6825/2855185758","cluster_addr":"172.21.15.151:6827/2855185758","heartbeat_back_addr":"172.21.15.151:6831/2855185758","heartbeat_front_addr":"172.21.15.151:6829/2855185758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:16:52.947222+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:17:17.845611+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:17:41.769521+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:10.848974+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:35.471340+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:59.554980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:19:28.908089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:19:53.540000+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:20:17.764886+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:20:46.835859+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:21:12.186176+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:21:35.863935+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/1132389058":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6801/4067110310":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/1040591124":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/1171838695":"2024-09-06T01:14:54.625209+0000","172.21.15.12:6800/4067110310":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/784506983":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/992405704":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6801/3541208629":"2024-09-06T01:14:54.625209+0000","172.21.15.12:6800/3541208629":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/1532325396":"2024-09-06T01:14:54.625209+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T01:23:12.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.360+0000 7f4534600640 1 -- 172.21.15.12:0/3943044610 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f45140a2c90 msgr2=0x7f45140a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:12.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.360+0000 7f4534600640 1 --2- 172.21.15.12:0/3943044610 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f45140a2c90 0x7f45140a5150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f452c10aab0 tx=0x7f451800b390 comp rx=0 tx=0).stop 2024-09-05T01:23:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.360+0000 7f4534600640 1 -- 172.21.15.12:0/3943044610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f452c104010 msgr2=0x7f452c19a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.360+0000 7f4534600640 1 --2- 172.21.15.12:0/3943044610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f452c104010 0x7f452c19a6a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f452000d6d0 tx=0x7f452000db90 comp rx=0 tx=0).stop 2024-09-05T01:23:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.360+0000 7f4534600640 1 -- 172.21.15.12:0/3943044610 shutdown_connections 2024-09-05T01:23:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.360+0000 7f4534600640 1 --2- 172.21.15.12:0/3943044610 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f45140a2c90 0x7f45140a5150 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.360+0000 7f4534600640 1 --2- 172.21.15.12:0/3943044610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f452c109140 0x7f452c19ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.360+0000 7f4534600640 1 --2- 172.21.15.12:0/3943044610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f452c1049c0 0x7f452c19abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.360+0000 7f4534600640 1 --2- 172.21.15.12:0/3943044610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f452c104010 0x7f452c19a6a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.360+0000 7f4534600640 1 -- 172.21.15.12:0/3943044610 >> 172.21.15.12:0/3943044610 conn(0x7f452c0ffa50 msgr2=0x7f452c100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.361+0000 7f4534600640 1 -- 172.21.15.12:0/3943044610 shutdown_connections 2024-09-05T01:23:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:12.361+0000 7f4534600640 1 -- 172.21.15.12:0/3943044610 wait complete. 2024-09-05T01:23:12.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:12 smithi012 ceph-mon[29942]: pgmap v306: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-05T01:23:12.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:12 smithi145 ceph-mon[34376]: pgmap v306: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-05T01:23:12.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:12 smithi151 ceph-mon[35013]: pgmap v306: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-05T01:23:13.153 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-05T01:23:13.153 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T01:23:13.532 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:13.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:13 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3943044610' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:23:13.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:13 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3943044610' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:23:13.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:13 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3943044610' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:23:14.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.097+0000 7fb0e6600640 1 -- 172.21.15.12:0/746019828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0e0103ff0 msgr2=0x7fb0e01043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:14.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.097+0000 7fb0e6600640 1 --2- 172.21.15.12:0/746019828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0e0103ff0 0x7fb0e01043d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0009900 tx=0x7fb0d002a3f0 comp rx=0 tx=0).stop 2024-09-05T01:23:14.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.097+0000 7fb0e6600640 1 -- 172.21.15.12:0/746019828 shutdown_connections 2024-09-05T01:23:14.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.097+0000 7fb0e6600640 1 --2- 172.21.15.12:0/746019828 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb0e0109120 0x7fb0e0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:14.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.097+0000 7fb0e6600640 1 --2- 172.21.15.12:0/746019828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0e01049a0 0x7fb0e01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:14.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.097+0000 7fb0e6600640 1 --2- 172.21.15.12:0/746019828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0e0103ff0 0x7fb0e01043d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:14.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.097+0000 7fb0e6600640 1 -- 172.21.15.12:0/746019828 >> 172.21.15.12:0/746019828 conn(0x7fb0e00ffa90 msgr2=0x7fb0e0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:14.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.097+0000 7fb0e6600640 1 -- 172.21.15.12:0/746019828 shutdown_connections 2024-09-05T01:23:14.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.097+0000 7fb0e6600640 1 -- 172.21.15.12:0/746019828 wait complete. 2024-09-05T01:23:14.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.098+0000 7fb0e6600640 1 Processor -- start 2024-09-05T01:23:14.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.098+0000 7fb0e6600640 1 -- start start 2024-09-05T01:23:14.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.099+0000 7fb0e6600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0e0103ff0 0x7fb0e019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:14.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.099+0000 7fb0e6600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb0e01049a0 0x7fb0e019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:14.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.099+0000 7fb0e6600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0e0109120 0x7fb0e019eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:14.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.099+0000 7fb0e6600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e0114190 con 0x7fb0e0103ff0 2024-09-05T01:23:14.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.099+0000 7fb0e6600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e0114010 con 0x7fb0e01049a0 2024-09-05T01:23:14.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.099+0000 7fb0e6600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e0114310 con 0x7fb0e0109120 2024-09-05T01:23:14.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.099+0000 7fb0df400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0e0103ff0 0x7fb0e019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:14.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.099+0000 7fb0df400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0e0103ff0 0x7fb0e019a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34034/0 (socket says 172.21.15.12:34034) 2024-09-05T01:23:14.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.099+0000 7fb0df400640 1 -- 172.21.15.12:0/1550046538 learned_addr learned my addr 172.21.15.12:0/1550046538 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:14.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.099+0000 7fb0dfe00640 1 --2- 172.21.15.12:0/1550046538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0e0109120 0x7fb0e019eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:14.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.099+0000 7fb0dea00640 1 --2- 172.21.15.12:0/1550046538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb0e01049a0 0x7fb0e019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:14.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.100+0000 7fb0df400640 1 -- 172.21.15.12:0/1550046538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0e0109120 msgr2=0x7fb0e019eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:14.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.100+0000 7fb0df400640 1 --2- 172.21.15.12:0/1550046538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0e0109120 0x7fb0e019eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:14.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.100+0000 7fb0df400640 1 -- 172.21.15.12:0/1550046538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb0e01049a0 msgr2=0x7fb0e019ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:14.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.100+0000 7fb0df400640 1 --2- 172.21.15.12:0/1550046538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb0e01049a0 0x7fb0e019ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:14.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.100+0000 7fb0df400640 1 -- 172.21.15.12:0/1550046538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e019f5c0 con 0x7fb0e0103ff0 2024-09-05T01:23:14.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.100+0000 7fb0dfe00640 1 --2- 172.21.15.12:0/1550046538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0e0109120 0x7fb0e019eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:23:14.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.100+0000 7fb0df400640 1 --2- 172.21.15.12:0/1550046538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0e0103ff0 0x7fb0e019a610 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0004770 tx=0x7fb0d0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:14.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.100+0000 7fb0d7e00640 1 -- 172.21.15.12:0/1550046538 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d003f070 con 0x7fb0e0103ff0 2024-09-05T01:23:14.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.100+0000 7fb0d7e00640 1 -- 172.21.15.12:0/1550046538 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0d0031ca0 con 0x7fb0e0103ff0 2024-09-05T01:23:14.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.100+0000 7fb0e6600640 1 -- 172.21.15.12:0/1550046538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0e019f850 con 0x7fb0e0103ff0 2024-09-05T01:23:14.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.100+0000 7fb0d7e00640 1 -- 172.21.15.12:0/1550046538 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0035030 con 0x7fb0e0103ff0 2024-09-05T01:23:14.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.100+0000 7fb0e6600640 1 -- 172.21.15.12:0/1550046538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0e01a7190 con 0x7fb0e0103ff0 2024-09-05T01:23:14.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.101+0000 7fb0e6600640 1 -- 172.21.15.12:0/1550046538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0e01054d0 con 0x7fb0e0103ff0 2024-09-05T01:23:14.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.103+0000 7fb0d7e00640 1 -- 172.21.15.12:0/1550046538 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb0d0042070 con 0x7fb0e0103ff0 2024-09-05T01:23:14.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.105+0000 7fb0d7e00640 1 --2- 172.21.15.12:0/1550046538 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb0c40a2c10 0x7fb0c40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:14.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.105+0000 7fb0d7e00640 1 -- 172.21.15.12:0/1550046538 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fb0d00efdb0 con 0x7fb0e0103ff0 2024-09-05T01:23:14.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.105+0000 7fb0dea00640 1 --2- 172.21.15.12:0/1550046538 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb0c40a2c10 0x7fb0c40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:14.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.106+0000 7fb0dea00640 1 --2- 172.21.15.12:0/1550046538 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb0c40a2c10 0x7fb0c40a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb0e00fff20 tx=0x7fb0cc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:14.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.107+0000 7fb0d7e00640 1 -- 172.21.15.12:0/1550046538 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb0d00bc610 con 0x7fb0e0103ff0 2024-09-05T01:23:14.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.294+0000 7fb0e6600640 1 -- 172.21.15.12:0/1550046538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0e010c300 con 0x7fb0e0103ff0 2024-09-05T01:23:14.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.296+0000 7fb0d7e00640 1 -- 172.21.15.12:0/1550046538 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22315 (secure 0 0 0) 0x7fb0d00c0910 con 0x7fb0e0103ff0 2024-09-05T01:23:14.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:23:14.296 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":81,"fsid":"0d44cd7e-6b24-11ef-bcd6-c7b262605968","created":"2024-09-05T01:14:21.162850+0000","modified":"2024-09-05T01:22:35.979069+0000","last_up_change":"2024-09-05T01:21:37.145073+0000","last_in_change":"2024-09-05T01:21:15.076991+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T01:17:44.744065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T01:22:31.540178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T01:22:33.999318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b74ac640-b680-46e2-9106-d24168e685e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6803","nonce":2090563987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6805","nonce":2090563987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6809","nonce":2090563987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6807","nonce":2090563987}]},"public_addr":"172.21.15.12:6803/2090563987","cluster_addr":"172.21.15.12:6805/2090563987","heartbeat_back_addr":"172.21.15.12:6809/2090563987","heartbeat_front_addr":"172.21.15.12:6807/2090563987","state":["exists","up"]},{"osd":1,"uuid":"efca1216-8d85-4e6a-8c49-0afb511ece59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6801","nonce":2639126629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6803","nonce":2639126629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6807","nonce":2639126629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6805","nonce":2639126629}]},"public_addr":"172.21.15.145:6801/2639126629","cluster_addr":"172.21.15.145:6803/2639126629","heartbeat_back_addr":"172.21.15.145:6807/2639126629","heartbeat_front_addr":"172.21.15.145:6805/2639126629","state":["exists","up"]},{"osd":2,"uuid":"4d5699b2-646a-4ab6-94a5-ad223aa27ac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6801","nonce":3753171761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6803","nonce":3753171761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6807","nonce":3753171761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6805","nonce":3753171761}]},"public_addr":"172.21.15.151:6801/3753171761","cluster_addr":"172.21.15.151:6803/3753171761","heartbeat_back_addr":"172.21.15.151:6807/3753171761","heartbeat_front_addr":"172.21.15.151:6805/3753171761","state":["exists","up"]},{"osd":3,"uuid":"275ad2ad-93e6-4a68-8784-8f8dcb620f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6811","nonce":2231650146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6813","nonce":2231650146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6817","nonce":2231650146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6815","nonce":2231650146}]},"public_addr":"172.21.15.12:6811/2231650146","cluster_addr":"172.21.15.12:6813/2231650146","heartbeat_back_addr":"172.21.15.12:6817/2231650146","heartbeat_front_addr":"172.21.15.12:6815/2231650146","state":["exists","up"]},{"osd":4,"uuid":"21a0c5b4-4e0e-4fb6-8be6-a300cb811cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6809","nonce":1828591275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6811","nonce":1828591275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6815","nonce":1828591275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6813","nonce":1828591275}]},"public_addr":"172.21.15.145:6809/1828591275","cluster_addr":"172.21.15.145:6811/1828591275","heartbeat_back_addr":"172.21.15.145:6815/1828591275","heartbeat_front_addr":"172.21.15.145:6813/1828591275","state":["exists","up"]},{"osd":5,"uuid":"e2c7e6fb-5dea-459f-8d7a-7ae5b1936218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6809","nonce":3888870109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6811","nonce":3888870109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6815","nonce":3888870109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6813","nonce":3888870109}]},"public_addr":"172.21.15.151:6809/3888870109","cluster_addr":"172.21.15.151:6811/3888870109","heartbeat_back_addr":"172.21.15.151:6815/3888870109","heartbeat_front_addr":"172.21.15.151:6813/3888870109","state":["exists","up"]},{"osd":6,"uuid":"0df0a29c-3404-4ff5-ae48-78b69b77cbd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6819","nonce":3084810269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6821","nonce":3084810269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6825","nonce":3084810269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6823","nonce":3084810269}]},"public_addr":"172.21.15.12:6819/3084810269","cluster_addr":"172.21.15.12:6821/3084810269","heartbeat_back_addr":"172.21.15.12:6825/3084810269","heartbeat_front_addr":"172.21.15.12:6823/3084810269","state":["exists","up"]},{"osd":7,"uuid":"c7b3ad7c-a566-435c-9ef8-837bb764acb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6817","nonce":3058588721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6819","nonce":3058588721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6823","nonce":3058588721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6821","nonce":3058588721}]},"public_addr":"172.21.15.145:6817/3058588721","cluster_addr":"172.21.15.145:6819/3058588721","heartbeat_back_addr":"172.21.15.145:6823/3058588721","heartbeat_front_addr":"172.21.15.145:6821/3058588721","state":["exists","up"]},{"osd":8,"uuid":"8018a468-fbc5-4667-a53c-2e97c08713bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6817","nonce":905705309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6819","nonce":905705309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6823","nonce":905705309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6821","nonce":905705309}]},"public_addr":"172.21.15.151:6817/905705309","cluster_addr":"172.21.15.151:6819/905705309","heartbeat_back_addr":"172.21.15.151:6823/905705309","heartbeat_front_addr":"172.21.15.151:6821/905705309","state":["exists","up"]},{"osd":9,"uuid":"dcf3b524-c8b8-4ab6-83c6-fc52c776d72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6827","nonce":1193852496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6829","nonce":1193852496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6833","nonce":1193852496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6831","nonce":1193852496}]},"public_addr":"172.21.15.12:6827/1193852496","cluster_addr":"172.21.15.12:6829/1193852496","heartbeat_back_addr":"172.21.15.12:6833/1193852496","heartbeat_front_addr":"172.21.15.12:6831/1193852496","state":["exists","up"]},{"osd":10,"uuid":"7b5b34c3-8814-4d16-80ce-0b0c9be07cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6825","nonce":1296813755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6827","nonce":1296813755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6831","nonce":1296813755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6829","nonce":1296813755}]},"public_addr":"172.21.15.145:6825/1296813755","cluster_addr":"172.21.15.145:6827/1296813755","heartbeat_back_addr":"172.21.15.145:6831/1296813755","heartbeat_front_addr":"172.21.15.145:6829/1296813755","state":["exists","up"]},{"osd":11,"uuid":"157ee32a-43f0-4e5a-8dac-fce53c1efdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6825","nonce":2855185758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6827","nonce":2855185758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6831","nonce":2855185758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6829","nonce":2855185758}]},"public_addr":"172.21.15.151:6825/2855185758","cluster_addr":"172.21.15.151:6827/2855185758","heartbeat_back_addr":"172.21.15.151:6831/2855185758","heartbeat_front_addr":"172.21.15.151:6829/2855185758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:16:52.947222+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:17:17.845611+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:17:41.769521+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:10.848974+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:35.471340+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:59.554980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:19:28.908089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:19:53.540000+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:20:17.764886+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:20:46.835859+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:21:12.186176+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:21:35.863935+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/1132389058":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6801/4067110310":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/1040591124":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/1171838695":"2024-09-06T01:14:54.625209+0000","172.21.15.12:6800/4067110310":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/784506983":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/992405704":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6801/3541208629":"2024-09-06T01:14:54.625209+0000","172.21.15.12:6800/3541208629":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/1532325396":"2024-09-06T01:14:54.625209+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T01:23:14.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.298+0000 7fb0e6600640 1 -- 172.21.15.12:0/1550046538 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb0c40a2c10 msgr2=0x7fb0c40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:14.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.298+0000 7fb0e6600640 1 --2- 172.21.15.12:0/1550046538 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb0c40a2c10 0x7fb0c40a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb0e00fff20 tx=0x7fb0cc005f90 comp rx=0 tx=0).stop 2024-09-05T01:23:14.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.298+0000 7fb0e6600640 1 -- 172.21.15.12:0/1550046538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0e0103ff0 msgr2=0x7fb0e019a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:14.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.298+0000 7fb0e6600640 1 --2- 172.21.15.12:0/1550046538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0e0103ff0 0x7fb0e019a610 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0004770 tx=0x7fb0d0003c10 comp rx=0 tx=0).stop 2024-09-05T01:23:14.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.299+0000 7fb0e6600640 1 -- 172.21.15.12:0/1550046538 shutdown_connections 2024-09-05T01:23:14.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.299+0000 7fb0e6600640 1 --2- 172.21.15.12:0/1550046538 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb0c40a2c10 0x7fb0c40a50d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:14.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.299+0000 7fb0e6600640 1 --2- 172.21.15.12:0/1550046538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0e0109120 0x7fb0e019eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:14.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.299+0000 7fb0e6600640 1 --2- 172.21.15.12:0/1550046538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb0e01049a0 0x7fb0e019ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:14.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.299+0000 7fb0e6600640 1 --2- 172.21.15.12:0/1550046538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0e0103ff0 0x7fb0e019a610 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:14.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.299+0000 7fb0e6600640 1 -- 172.21.15.12:0/1550046538 >> 172.21.15.12:0/1550046538 conn(0x7fb0e00ffa90 msgr2=0x7fb0e0100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:14.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.299+0000 7fb0e6600640 1 -- 172.21.15.12:0/1550046538 shutdown_connections 2024-09-05T01:23:14.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:14.299+0000 7fb0e6600640 1 -- 172.21.15.12:0/1550046538 wait complete. 2024-09-05T01:23:14.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:14 smithi012 ceph-mon[29942]: pgmap v307: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-05T01:23:14.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:14 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/1550046538' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:23:14.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:14 smithi145 ceph-mon[34376]: pgmap v307: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-05T01:23:14.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:14 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/1550046538' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:23:14.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:14 smithi151 ceph-mon[35013]: pgmap v307: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-05T01:23:14.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:14 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/1550046538' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:23:15.034 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-05T01:23:15.035 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-05T01:23:15.035 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-05T01:23:15.036 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-05T01:23:15.036 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-05T01:23:15.037 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-05T01:23:15.037 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-05T01:23:15.037 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-05T01:23:15.038 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-05T01:23:15.039 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-05T01:23:15.039 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-05T01:23:15.040 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-05T01:23:16.046 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:16.052 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:16.135 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:16.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:16 smithi012 ceph-mon[29942]: pgmap v308: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-05T01:23:16.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:16 smithi145 ceph-mon[34376]: pgmap v308: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-05T01:23:16.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:16 smithi151 ceph-mon[35013]: pgmap v308: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-05T01:23:16.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.773+0000 7fdc05600640 1 -- 172.21.15.12:0/3286776651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc001049a0 msgr2=0x7fdc001089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:16.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.773+0000 7fdc05600640 1 --2- 172.21.15.12:0/3286776651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc001049a0 0x7fdc001089f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdbec009900 tx=0x7fdbec02a410 comp rx=0 tx=0).stop 2024-09-05T01:23:16.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.773+0000 7fdc05600640 1 -- 172.21.15.12:0/3286776651 shutdown_connections 2024-09-05T01:23:16.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.773+0000 7fdc05600640 1 --2- 172.21.15.12:0/3286776651 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc00109120 0x7fdc00110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:16.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.773+0000 7fdc05600640 1 --2- 172.21.15.12:0/3286776651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc001049a0 0x7fdc001089f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:16.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.773+0000 7fdc05600640 1 --2- 172.21.15.12:0/3286776651 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc00103ff0 0x7fdc001043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:16.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.773+0000 7fdc05600640 1 -- 172.21.15.12:0/3286776651 >> 172.21.15.12:0/3286776651 conn(0x7fdc000ffa90 msgr2=0x7fdc00101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:16.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.773+0000 7fdc05600640 1 -- 172.21.15.12:0/3286776651 shutdown_connections 2024-09-05T01:23:16.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.773+0000 7fdc05600640 1 -- 172.21.15.12:0/3286776651 wait complete. 2024-09-05T01:23:16.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.775+0000 7fdc05600640 1 Processor -- start 2024-09-05T01:23:16.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.775+0000 7fdc05600640 1 -- start start 2024-09-05T01:23:16.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.775+0000 7fdc05600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc00103ff0 0x7fdc0019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:16.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.775+0000 7fdc05600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc001049a0 0x7fdc0019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:16.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.775+0000 7fdc05600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc00109120 0x7fdc0019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.775+0000 7fdc05600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdc00114170 con 0x7fdc00103ff0 2024-09-05T01:23:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.775+0000 7fdc05600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdc00113ff0 con 0x7fdc001049a0 2024-09-05T01:23:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.775+0000 7fdc05600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdc001142f0 con 0x7fdc00109120 2024-09-05T01:23:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.775+0000 7fdbfea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc00103ff0 0x7fdc0019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.776+0000 7fdbfe000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc001049a0 0x7fdc0019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.775+0000 7fdbfea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc00103ff0 0x7fdc0019a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34050/0 (socket says 172.21.15.12:34050) 2024-09-05T01:23:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.776+0000 7fdbfea00640 1 -- 172.21.15.12:0/175993940 learned_addr learned my addr 172.21.15.12:0/175993940 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.776+0000 7fdbfe000640 1 --2- 172.21.15.12:0/175993940 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc001049a0 0x7fdc0019ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:44650/0 (socket says 172.21.15.12:44650) 2024-09-05T01:23:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.776+0000 7fdbff400640 1 --2- 172.21.15.12:0/175993940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc00109120 0x7fdc0019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.776+0000 7fdbfe000640 1 -- 172.21.15.12:0/175993940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc00109120 msgr2=0x7fdc0019ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.776+0000 7fdbfe000640 1 --2- 172.21.15.12:0/175993940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc00109120 0x7fdc0019ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.776+0000 7fdbfe000640 1 -- 172.21.15.12:0/175993940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc00103ff0 msgr2=0x7fdc0019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:16.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.776+0000 7fdbfe000640 1 --2- 172.21.15.12:0/175993940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc00103ff0 0x7fdc0019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:16.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.776+0000 7fdbfe000640 1 -- 172.21.15.12:0/175993940 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0019f5e0 con 0x7fdc001049a0 2024-09-05T01:23:16.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.776+0000 7fdbfe000640 1 --2- 172.21.15.12:0/175993940 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc001049a0 0x7fdc0019ab70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdbec02a930 tx=0x7fdbec003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:16.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.777+0000 7fdbf7400640 1 -- 172.21.15.12:0/175993940 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec03f070 con 0x7fdc001049a0 2024-09-05T01:23:16.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.777+0000 7fdc05600640 1 -- 172.21.15.12:0/175993940 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc0019f870 con 0x7fdc001049a0 2024-09-05T01:23:16.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.777+0000 7fdbf7400640 1 -- 172.21.15.12:0/175993940 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbec031c90 con 0x7fdc001049a0 2024-09-05T01:23:16.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.777+0000 7fdbf7400640 1 -- 172.21.15.12:0/175993940 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec035030 con 0x7fdc001049a0 2024-09-05T01:23:16.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.777+0000 7fdc05600640 1 -- 172.21.15.12:0/175993940 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc001a71b0 con 0x7fdc001049a0 2024-09-05T01:23:16.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.778+0000 7fdc05600640 1 -- 172.21.15.12:0/175993940 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdc00062980 con 0x7fdc001049a0 2024-09-05T01:23:16.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.780+0000 7fdbf7400640 1 -- 172.21.15.12:0/175993940 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdbec042070 con 0x7fdc001049a0 2024-09-05T01:23:16.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.781+0000 7fdbf7400640 1 --2- 172.21.15.12:0/175993940 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fdbe40a2c10 0x7fdbe40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:16.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.781+0000 7fdbf7400640 1 -- 172.21.15.12:0/175993940 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fdbec0efff0 con 0x7fdc001049a0 2024-09-05T01:23:16.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.782+0000 7fdbf7400640 1 --2- 172.21.15.12:0/175993940 >> [v2:172.21.15.12:6810/2231650146,v1:172.21.15.12:6811/2231650146] conn(0x7fdbe40ac460 0x7fdbe40ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:16.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.782+0000 7fdbf7400640 1 -- 172.21.15.12:0/175993940 --> [v2:172.21.15.12:6810/2231650146,v1:172.21.15.12:6811/2231650146] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdbec00b0b0 con 0x7fdbe40ac460 2024-09-05T01:23:16.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.782+0000 7fdbf7400640 1 -- 172.21.15.12:0/175993940 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fdbec0f03a0 con 0x7fdc001049a0 2024-09-05T01:23:16.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.782+0000 7fdbfea00640 1 --2- 172.21.15.12:0/175993940 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fdbe40a2c10 0x7fdbe40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:16.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.782+0000 7fdbff400640 1 --2- 172.21.15.12:0/175993940 >> [v2:172.21.15.12:6810/2231650146,v1:172.21.15.12:6811/2231650146] conn(0x7fdbe40ac460 0x7fdbe40ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:16.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.782+0000 7fdbfea00640 1 --2- 172.21.15.12:0/175993940 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fdbe40a2c10 0x7fdbe40a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0009c90 tx=0x7fdbf0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:16.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.782+0000 7fdbff400640 1 --2- 172.21.15.12:0/175993940 >> [v2:172.21.15.12:6810/2231650146,v1:172.21.15.12:6811/2231650146] conn(0x7fdbe40ac460 0x7fdbe40ae880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:16.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.783+0000 7fdbf7400640 1 -- 172.21.15.12:0/175993940 <== osd.3 v2:172.21.15.12:6810/2231650146 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdbec00b0b0 con 0x7fdbe40ac460 2024-09-05T01:23:16.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.798+0000 7fdc05600640 1 -- 172.21.15.12:0/175993940 --> [v2:172.21.15.12:6810/2231650146,v1:172.21.15.12:6811/2231650146] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdc00062d80 con 0x7fdbe40ac460 2024-09-05T01:23:16.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.798+0000 7fdbf7400640 1 -- 172.21.15.12:0/175993940 <== osd.3 v2:172.21.15.12:6810/2231650146 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdc00062d80 con 0x7fdbe40ac460 2024-09-05T01:23:16.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.799+0000 7fdc05600640 1 -- 172.21.15.12:0/175993940 >> [v2:172.21.15.12:6810/2231650146,v1:172.21.15.12:6811/2231650146] conn(0x7fdbe40ac460 msgr2=0x7fdbe40ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:16.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.799+0000 7fdc05600640 1 --2- 172.21.15.12:0/175993940 >> [v2:172.21.15.12:6810/2231650146,v1:172.21.15.12:6811/2231650146] conn(0x7fdbe40ac460 0x7fdbe40ae880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:16.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.799+0000 7fdc05600640 1 -- 172.21.15.12:0/175993940 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fdbe40a2c10 msgr2=0x7fdbe40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:16.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.799+0000 7fdc05600640 1 --2- 172.21.15.12:0/175993940 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fdbe40a2c10 0x7fdbe40a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0009c90 tx=0x7fdbf0005f90 comp rx=0 tx=0).stop 2024-09-05T01:23:16.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.799+0000 7fdc05600640 1 -- 172.21.15.12:0/175993940 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc001049a0 msgr2=0x7fdc0019ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:16.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.799+0000 7fdc05600640 1 --2- 172.21.15.12:0/175993940 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdc001049a0 0x7fdc0019ab70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdbec02a930 tx=0x7fdbec003b20 comp rx=0 tx=0).stop 2024-09-05T01:23:16.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.799+0000 7fdbff400640 1 -- 172.21.15.12:0/175993940 reap_dead start 2024-09-05T01:23:16.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.799+0000 7fdc05600640 1 -- 172.21.15.12:0/175993940 shutdown_connections 2024-09-05T01:23:16.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.799+0000 7fdc05600640 1 -- 172.21.15.12:0/175993940 >> 172.21.15.12:0/175993940 conn(0x7fdc000ffa90 msgr2=0x7fdc00100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:16.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.799+0000 7fdc05600640 1 -- 172.21.15.12:0/175993940 shutdown_connections 2024-09-05T01:23:16.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:16.799+0000 7fdc05600640 1 -- 172.21.15.12:0/175993940 wait complete. 2024-09-05T01:23:17.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.253+0000 7f3417400640 1 -- 172.21.15.12:0/1101660479 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3410103ff0 msgr2=0x7f34101043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:17.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.253+0000 7f3417400640 1 --2- 172.21.15.12:0/1101660479 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3410103ff0 0x7f34101043d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3404009900 tx=0x7f340402a400 comp rx=0 tx=0).stop 2024-09-05T01:23:17.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.253+0000 7f3417400640 1 -- 172.21.15.12:0/1101660479 shutdown_connections 2024-09-05T01:23:17.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.253+0000 7f3417400640 1 --2- 172.21.15.12:0/1101660479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3410109120 0x7f3410110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:17.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.253+0000 7f3417400640 1 --2- 172.21.15.12:0/1101660479 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34101049a0 0x7f34101089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:17.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.253+0000 7f3417400640 1 --2- 172.21.15.12:0/1101660479 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3410103ff0 0x7f34101043d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:17.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.253+0000 7f3417400640 1 -- 172.21.15.12:0/1101660479 >> 172.21.15.12:0/1101660479 conn(0x7f34100ffa90 msgr2=0x7f3410101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:17.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.253+0000 7f3417400640 1 -- 172.21.15.12:0/1101660479 shutdown_connections 2024-09-05T01:23:17.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.253+0000 7f3417400640 1 -- 172.21.15.12:0/1101660479 wait complete. 2024-09-05T01:23:17.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.254+0000 7f3417400640 1 Processor -- start 2024-09-05T01:23:17.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.254+0000 7f3417400640 1 -- start start 2024-09-05T01:23:17.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.255+0000 7f3417400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3410103ff0 0x7f341019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:17.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.255+0000 7f3417400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34101049a0 0x7f341019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:17.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.255+0000 7f3417400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3410109120 0x7f341019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:17.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.255+0000 7f3417400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3410114170 con 0x7f3410103ff0 2024-09-05T01:23:17.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.255+0000 7f3417400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3410113ff0 con 0x7f34101049a0 2024-09-05T01:23:17.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.255+0000 7f3417400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f34101142f0 con 0x7f3410109120 2024-09-05T01:23:17.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.255+0000 7f3414a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3410103ff0 0x7f341019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:17.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.255+0000 7f3414a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3410103ff0 0x7f341019a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42766/0 (socket says 172.21.15.12:42766) 2024-09-05T01:23:17.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.255+0000 7f3414a00640 1 -- 172.21.15.12:0/3592995678 learned_addr learned my addr 172.21.15.12:0/3592995678 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:17.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.255+0000 7f340fe00640 1 --2- 172.21.15.12:0/3592995678 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34101049a0 0x7f341019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:17.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.255+0000 7f3415400640 1 --2- 172.21.15.12:0/3592995678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3410109120 0x7f341019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:17.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.255+0000 7f3414a00640 1 -- 172.21.15.12:0/3592995678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3410109120 msgr2=0x7f341019eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:17.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.255+0000 7f3414a00640 1 --2- 172.21.15.12:0/3592995678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3410109120 0x7f341019eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:17.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.255+0000 7f3414a00640 1 -- 172.21.15.12:0/3592995678 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34101049a0 msgr2=0x7f341019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:17.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.255+0000 7f3414a00640 1 --2- 172.21.15.12:0/3592995678 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34101049a0 0x7f341019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:17.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.255+0000 7f3414a00640 1 -- 172.21.15.12:0/3592995678 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341019f5b0 con 0x7f3410103ff0 2024-09-05T01:23:17.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.256+0000 7f340fe00640 1 --2- 172.21.15.12:0/3592995678 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f34101049a0 0x7f341019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:23:17.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.256+0000 7f3415400640 1 --2- 172.21.15.12:0/3592995678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3410109120 0x7f341019eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:23:17.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.256+0000 7f3414a00640 1 --2- 172.21.15.12:0/3592995678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3410103ff0 0x7f341019a600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3404004770 tx=0x7f3404003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:17.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.256+0000 7f340d600640 1 -- 172.21.15.12:0/3592995678 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340403f070 con 0x7f3410103ff0 2024-09-05T01:23:17.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.256+0000 7f340d600640 1 -- 172.21.15.12:0/3592995678 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3404031ca0 con 0x7f3410103ff0 2024-09-05T01:23:17.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.256+0000 7f3417400640 1 -- 172.21.15.12:0/3592995678 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f341019f840 con 0x7f3410103ff0 2024-09-05T01:23:17.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.256+0000 7f340d600640 1 -- 172.21.15.12:0/3592995678 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3404035030 con 0x7f3410103ff0 2024-09-05T01:23:17.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.256+0000 7f3417400640 1 -- 172.21.15.12:0/3592995678 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34101a7180 con 0x7f3410103ff0 2024-09-05T01:23:17.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.257+0000 7f3417400640 1 -- 172.21.15.12:0/3592995678 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3410062980 con 0x7f3410103ff0 2024-09-05T01:23:17.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.259+0000 7f340d600640 1 -- 172.21.15.12:0/3592995678 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3404042070 con 0x7f3410103ff0 2024-09-05T01:23:17.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.261+0000 7f340d600640 1 --2- 172.21.15.12:0/3592995678 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f33f80a2c10 0x7f33f80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:17.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.261+0000 7f340d600640 1 -- 172.21.15.12:0/3592995678 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f34040efeb0 con 0x7f3410103ff0 2024-09-05T01:23:17.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.261+0000 7f340fe00640 1 --2- 172.21.15.12:0/3592995678 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f33f80a2c10 0x7f33f80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:17.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.261+0000 7f340d600640 1 --2- 172.21.15.12:0/3592995678 >> [v2:172.21.15.145:6824/1296813755,v1:172.21.15.145:6825/1296813755] conn(0x7f33f80ac460 0x7f33f80ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:17.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.261+0000 7f340d600640 1 -- 172.21.15.12:0/3592995678 --> [v2:172.21.15.145:6824/1296813755,v1:172.21.15.145:6825/1296813755] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3404038e90 con 0x7f33f80ac460 2024-09-05T01:23:17.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.261+0000 7f340d600640 1 -- 172.21.15.12:0/3592995678 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f34040f0260 con 0x7f3410103ff0 2024-09-05T01:23:17.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.261+0000 7f340fe00640 1 --2- 172.21.15.12:0/3592995678 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f33f80a2c10 0x7f33f80a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0058c0 tx=0x7f33fc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:17.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.262+0000 7f3415400640 1 --2- 172.21.15.12:0/3592995678 >> [v2:172.21.15.145:6824/1296813755,v1:172.21.15.145:6825/1296813755] conn(0x7f33f80ac460 0x7f33f80ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:17.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.262+0000 7f3415400640 1 --2- 172.21.15.12:0/3592995678 >> [v2:172.21.15.145:6824/1296813755,v1:172.21.15.145:6825/1296813755] conn(0x7f33f80ac460 0x7f33f80ae880 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:17.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.263+0000 7f340d600640 1 -- 172.21.15.12:0/3592995678 <== osd.10 v2:172.21.15.145:6824/1296813755 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3404038e90 con 0x7f33f80ac460 2024-09-05T01:23:17.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.278+0000 7f3417400640 1 -- 172.21.15.12:0/3592995678 --> [v2:172.21.15.145:6824/1296813755,v1:172.21.15.145:6825/1296813755] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3410062e00 con 0x7f33f80ac460 2024-09-05T01:23:17.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.279+0000 7f340d600640 1 -- 172.21.15.12:0/3592995678 <== osd.10 v2:172.21.15.145:6824/1296813755 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3410062e00 con 0x7f33f80ac460 2024-09-05T01:23:17.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.279+0000 7f3417400640 1 -- 172.21.15.12:0/3592995678 >> [v2:172.21.15.145:6824/1296813755,v1:172.21.15.145:6825/1296813755] conn(0x7f33f80ac460 msgr2=0x7f33f80ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:17.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.279+0000 7f3417400640 1 --2- 172.21.15.12:0/3592995678 >> [v2:172.21.15.145:6824/1296813755,v1:172.21.15.145:6825/1296813755] conn(0x7f33f80ac460 0x7f33f80ae880 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:17.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.279+0000 7f3417400640 1 -- 172.21.15.12:0/3592995678 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f33f80a2c10 msgr2=0x7f33f80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:17.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.279+0000 7f3417400640 1 --2- 172.21.15.12:0/3592995678 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f33f80a2c10 0x7f33f80a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f33fc0058c0 tx=0x7f33fc005850 comp rx=0 tx=0).stop 2024-09-05T01:23:17.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.279+0000 7f3417400640 1 -- 172.21.15.12:0/3592995678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3410103ff0 msgr2=0x7f341019a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:17.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.279+0000 7f3417400640 1 --2- 172.21.15.12:0/3592995678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3410103ff0 0x7f341019a600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3404004770 tx=0x7f3404003c10 comp rx=0 tx=0).stop 2024-09-05T01:23:17.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.279+0000 7f3415400640 1 -- 172.21.15.12:0/3592995678 reap_dead start 2024-09-05T01:23:17.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.279+0000 7f3417400640 1 -- 172.21.15.12:0/3592995678 shutdown_connections 2024-09-05T01:23:17.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.279+0000 7f3417400640 1 -- 172.21.15.12:0/3592995678 >> 172.21.15.12:0/3592995678 conn(0x7f34100ffa90 msgr2=0x7f3410100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:17.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.279+0000 7f3417400640 1 -- 172.21.15.12:0/3592995678 shutdown_connections 2024-09-05T01:23:17.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:17.279+0000 7f3417400640 1 -- 172.21.15.12:0/3592995678 wait complete. 2024-09-05T01:23:17.611 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:17.613 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:17.613 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:17.613 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:17.619 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:17.620 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:17.622 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:18.169 INFO:teuthology.orchestra.run.smithi012.stdout:292057776155 2024-09-05T01:23:18.169 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-05T01:23:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.364+0000 7f6d6fe00640 1 -- 172.21.15.12:0/1143016613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d70102c50 msgr2=0x7f6d70103030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:18.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.364+0000 7f6d6fe00640 1 --2- 172.21.15.12:0/1143016613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d70102c50 0x7f6d70103030 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6d60009900 tx=0x7f6d6002a480 comp rx=0 tx=0).stop 2024-09-05T01:23:18.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.364+0000 7f6d6fe00640 1 -- 172.21.15.12:0/1143016613 shutdown_connections 2024-09-05T01:23:18.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.364+0000 7f6d6fe00640 1 --2- 172.21.15.12:0/1143016613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d7010bff0 0x7f6d7010e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:18.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.364+0000 7f6d6fe00640 1 --2- 172.21.15.12:0/1143016613 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d70103570 0x7f6d7010ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:18.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.364+0000 7f6d6fe00640 1 --2- 172.21.15.12:0/1143016613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d70102c50 0x7f6d70103030 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:18.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.364+0000 7f6d6fe00640 1 -- 172.21.15.12:0/1143016613 >> 172.21.15.12:0/1143016613 conn(0x7f6d700fc610 msgr2=0x7f6d700fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:18.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.364+0000 7f6d6fe00640 1 -- 172.21.15.12:0/1143016613 shutdown_connections 2024-09-05T01:23:18.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.364+0000 7f6d6fe00640 1 -- 172.21.15.12:0/1143016613 wait complete. 2024-09-05T01:23:18.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.365+0000 7f6d6fe00640 1 Processor -- start 2024-09-05T01:23:18.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.365+0000 7f6d6fe00640 1 -- start start 2024-09-05T01:23:18.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.366+0000 7f6d6fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d70103570 0x7f6d70198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:18.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.366+0000 7f6d6fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d7010bff0 0x7f6d701989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:18.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.366+0000 7f6d6fe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d7019cd60 0x7f6d7019d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:18.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.366+0000 7f6d6fe00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6d70111dc0 con 0x7f6d7010bff0 2024-09-05T01:23:18.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.366+0000 7f6d6fe00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6d70111c40 con 0x7f6d7019cd60 2024-09-05T01:23:18.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.366+0000 7f6d6fe00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6d70111f40 con 0x7f6d70103570 2024-09-05T01:23:18.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.366+0000 7f6d6e000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d7010bff0 0x7f6d701989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:18.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.366+0000 7f6d6ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d70103570 0x7f6d70198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:18.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.366+0000 7f6d6ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d70103570 0x7f6d70198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:58582/0 (socket says 172.21.15.12:58582) 2024-09-05T01:23:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.366+0000 7f6d6ea00640 1 -- 172.21.15.12:0/3449951104 learned_addr learned my addr 172.21.15.12:0/3449951104 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.366+0000 7f6d6e000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d7010bff0 0x7f6d701989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42774/0 (socket says 172.21.15.12:42774) 2024-09-05T01:23:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.366+0000 7f6d6f400640 1 --2- 172.21.15.12:0/3449951104 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d7019cd60 0x7f6d7019d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.367+0000 7f6d6ea00640 1 -- 172.21.15.12:0/3449951104 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d7019cd60 msgr2=0x7f6d7019d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.367+0000 7f6d6ea00640 1 --2- 172.21.15.12:0/3449951104 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d7019cd60 0x7f6d7019d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.367+0000 7f6d6ea00640 1 -- 172.21.15.12:0/3449951104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d7010bff0 msgr2=0x7f6d701989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.367+0000 7f6d6ea00640 1 --2- 172.21.15.12:0/3449951104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d7010bff0 0x7f6d701989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.367+0000 7f6d6ea00640 1 -- 172.21.15.12:0/3449951104 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d7019d820 con 0x7f6d70103570 2024-09-05T01:23:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.367+0000 7f6d6f400640 1 --2- 172.21.15.12:0/3449951104 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6d7019cd60 0x7f6d7019d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:23:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.367+0000 7f6d6e000640 1 --2- 172.21.15.12:0/3449951104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d7010bff0 0x7f6d701989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:23:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.367+0000 7f6d6ea00640 1 --2- 172.21.15.12:0/3449951104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d70103570 0x7f6d70198490 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6d60005940 tx=0x7f6d60004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:18.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.367+0000 7f6d67400640 1 -- 172.21.15.12:0/3449951104 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6003f030 con 0x7f6d70103570 2024-09-05T01:23:18.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.367+0000 7f6d67400640 1 -- 172.21.15.12:0/3449951104 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d60004440 con 0x7f6d70103570 2024-09-05T01:23:18.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.367+0000 7f6d6fe00640 1 -- 172.21.15.12:0/3449951104 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d7019dab0 con 0x7f6d70103570 2024-09-05T01:23:18.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.367+0000 7f6d67400640 1 -- 172.21.15.12:0/3449951104 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d60035070 con 0x7f6d70103570 2024-09-05T01:23:18.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.368+0000 7f6d6fe00640 1 -- 172.21.15.12:0/3449951104 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d701a51e0 con 0x7f6d70103570 2024-09-05T01:23:18.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.368+0000 7f6d6fe00640 1 -- 172.21.15.12:0/3449951104 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6d70062980 con 0x7f6d70103570 2024-09-05T01:23:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.370+0000 7f6d67400640 1 -- 172.21.15.12:0/3449951104 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6d60042030 con 0x7f6d70103570 2024-09-05T01:23:18.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.372+0000 7f6d67400640 1 --2- 172.21.15.12:0/3449951104 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6d540a2c10 0x7f6d540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:18.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.372+0000 7f6d67400640 1 -- 172.21.15.12:0/3449951104 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f6d600efc40 con 0x7f6d70103570 2024-09-05T01:23:18.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.372+0000 7f6d6e000640 1 --2- 172.21.15.12:0/3449951104 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6d540a2c10 0x7f6d540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:18.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.372+0000 7f6d67400640 1 --2- 172.21.15.12:0/3449951104 >> [v2:172.21.15.151:6816/905705309,v1:172.21.15.151:6817/905705309] conn(0x7f6d540ac460 0x7f6d540ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:18.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.372+0000 7f6d67400640 1 -- 172.21.15.12:0/3449951104 --> [v2:172.21.15.151:6816/905705309,v1:172.21.15.151:6817/905705309] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6d540aef30 con 0x7f6d540ac460 2024-09-05T01:23:18.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.372+0000 7f6d67400640 1 -- 172.21.15.12:0/3449951104 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f6d600efff0 con 0x7f6d70103570 2024-09-05T01:23:18.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.373+0000 7f6d6f400640 1 --2- 172.21.15.12:0/3449951104 >> [v2:172.21.15.151:6816/905705309,v1:172.21.15.151:6817/905705309] conn(0x7f6d540ac460 0x7f6d540ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:18.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.373+0000 7f6d6e000640 1 --2- 172.21.15.12:0/3449951104 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6d540a2c10 0x7f6d540a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6d700fec80 tx=0x7f6d5c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:18.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.373+0000 7f6d6f400640 1 --2- 172.21.15.12:0/3449951104 >> [v2:172.21.15.151:6816/905705309,v1:172.21.15.151:6817/905705309] conn(0x7f6d540ac460 0x7f6d540ae880 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:18.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.374+0000 7f6d67400640 1 -- 172.21.15.12:0/3449951104 <== osd.8 v2:172.21.15.151:6816/905705309 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6d540aef30 con 0x7f6d540ac460 2024-09-05T01:23:18.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.388+0000 7f6d6fe00640 1 -- 172.21.15.12:0/3449951104 --> [v2:172.21.15.151:6816/905705309,v1:172.21.15.151:6817/905705309] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6d70062e00 con 0x7f6d540ac460 2024-09-05T01:23:18.389 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:18 smithi012 ceph-mon[29942]: pgmap v309: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-05T01:23:18.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.389+0000 7f6d67400640 1 -- 172.21.15.12:0/3449951104 <== osd.8 v2:172.21.15.151:6816/905705309 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6d70062e00 con 0x7f6d540ac460 2024-09-05T01:23:18.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.390+0000 7f6d6fe00640 1 -- 172.21.15.12:0/3449951104 >> [v2:172.21.15.151:6816/905705309,v1:172.21.15.151:6817/905705309] conn(0x7f6d540ac460 msgr2=0x7f6d540ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:18.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.390+0000 7f6d6fe00640 1 --2- 172.21.15.12:0/3449951104 >> [v2:172.21.15.151:6816/905705309,v1:172.21.15.151:6817/905705309] conn(0x7f6d540ac460 0x7f6d540ae880 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:18.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.390+0000 7f6d6fe00640 1 -- 172.21.15.12:0/3449951104 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6d540a2c10 msgr2=0x7f6d540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:18.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.390+0000 7f6d6fe00640 1 --2- 172.21.15.12:0/3449951104 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6d540a2c10 0x7f6d540a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6d700fec80 tx=0x7f6d5c005f90 comp rx=0 tx=0).stop 2024-09-05T01:23:18.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.390+0000 7f6d6fe00640 1 -- 172.21.15.12:0/3449951104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d70103570 msgr2=0x7f6d70198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:18.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.390+0000 7f6d6fe00640 1 --2- 172.21.15.12:0/3449951104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d70103570 0x7f6d70198490 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6d60005940 tx=0x7f6d60004040 comp rx=0 tx=0).stop 2024-09-05T01:23:18.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.390+0000 7f6d6f400640 1 -- 172.21.15.12:0/3449951104 reap_dead start 2024-09-05T01:23:18.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.390+0000 7f6d6fe00640 1 -- 172.21.15.12:0/3449951104 shutdown_connections 2024-09-05T01:23:18.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.390+0000 7f6d6fe00640 1 -- 172.21.15.12:0/3449951104 >> 172.21.15.12:0/3449951104 conn(0x7f6d700fc610 msgr2=0x7f6d700fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:18.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.390+0000 7f6d6fe00640 1 -- 172.21.15.12:0/3449951104 shutdown_connections 2024-09-05T01:23:18.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:18.390+0000 7f6d6fe00640 1 -- 172.21.15.12:0/3449951104 wait complete. 2024-09-05T01:23:18.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:18 smithi145 ceph-mon[34376]: pgmap v309: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-05T01:23:18.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:18 smithi151 ceph-mon[35013]: pgmap v309: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-05T01:23:18.739 INFO:teuthology.orchestra.run.smithi012.stdout:107374182463 2024-09-05T01:23:18.739 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-05T01:23:19.680 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:20.159 INFO:teuthology.orchestra.run.smithi012.stdout:240518168614 2024-09-05T01:23:20.159 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-05T01:23:20.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.338+0000 7f363e200640 1 -- 172.21.15.12:0/2936005624 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3638103ff0 msgr2=0x7f36381043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:20.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.338+0000 7f363e200640 1 --2- 172.21.15.12:0/2936005624 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3638103ff0 0x7f36381043d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3628009900 tx=0x7f362802a3f0 comp rx=0 tx=0).stop 2024-09-05T01:23:20.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.339+0000 7f363e200640 1 -- 172.21.15.12:0/2936005624 shutdown_connections 2024-09-05T01:23:20.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.339+0000 7f363e200640 1 --2- 172.21.15.12:0/2936005624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3638109120 0x7f3638110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:20.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.339+0000 7f363e200640 1 --2- 172.21.15.12:0/2936005624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36381049a0 0x7f36381089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:20.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.339+0000 7f363e200640 1 --2- 172.21.15.12:0/2936005624 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3638103ff0 0x7f36381043d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:20.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.339+0000 7f363e200640 1 -- 172.21.15.12:0/2936005624 >> 172.21.15.12:0/2936005624 conn(0x7f36380ffa90 msgr2=0x7f3638101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:20.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.339+0000 7f363e200640 1 -- 172.21.15.12:0/2936005624 shutdown_connections 2024-09-05T01:23:20.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.339+0000 7f363e200640 1 -- 172.21.15.12:0/2936005624 wait complete. 2024-09-05T01:23:20.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.340+0000 7f363e200640 1 Processor -- start 2024-09-05T01:23:20.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.340+0000 7f363e200640 1 -- start start 2024-09-05T01:23:20.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.341+0000 7f363e200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3638103ff0 0x7f363819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:20.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.341+0000 7f363e200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36381049a0 0x7f363819ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:20.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.341+0000 7f363e200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3638109120 0x7f363819efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:20.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.341+0000 7f363e200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3638114120 con 0x7f3638109120 2024-09-05T01:23:20.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.341+0000 7f363e200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3638113fa0 con 0x7f3638103ff0 2024-09-05T01:23:20.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.341+0000 7f363e200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f36381142a0 con 0x7f36381049a0 2024-09-05T01:23:20.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.341+0000 7f3637400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3638103ff0 0x7f363819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:20.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.341+0000 7f3637e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3638109120 0x7f363819efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:20.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.341+0000 7f3637400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3638103ff0 0x7f363819a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:58458/0 (socket says 172.21.15.12:58458) 2024-09-05T01:23:20.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.341+0000 7f3637400640 1 -- 172.21.15.12:0/2624511964 learned_addr learned my addr 172.21.15.12:0/2624511964 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:20.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.341+0000 7f3636a00640 1 --2- 172.21.15.12:0/2624511964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36381049a0 0x7f363819ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:20.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.342+0000 7f3637400640 1 -- 172.21.15.12:0/2624511964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36381049a0 msgr2=0x7f363819ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:20.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.342+0000 7f3637400640 1 --2- 172.21.15.12:0/2624511964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36381049a0 0x7f363819ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:20.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.342+0000 7f3637400640 1 -- 172.21.15.12:0/2624511964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3638109120 msgr2=0x7f363819efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:20.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.342+0000 7f3637400640 1 --2- 172.21.15.12:0/2624511964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3638109120 0x7f363819efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:20.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.342+0000 7f3637400640 1 -- 172.21.15.12:0/2624511964 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f363819f6b0 con 0x7f3638103ff0 2024-09-05T01:23:20.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.342+0000 7f3636a00640 1 --2- 172.21.15.12:0/2624511964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36381049a0 0x7f363819ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:23:20.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.342+0000 7f3637400640 1 --2- 172.21.15.12:0/2624511964 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3638103ff0 0x7f363819a700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3628006010 tx=0x7f3628004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:20.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.342+0000 7f362fe00640 1 -- 172.21.15.12:0/2624511964 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362803f030 con 0x7f3638103ff0 2024-09-05T01:23:20.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.342+0000 7f362fe00640 1 -- 172.21.15.12:0/2624511964 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3628004440 con 0x7f3638103ff0 2024-09-05T01:23:20.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.342+0000 7f363e200640 1 -- 172.21.15.12:0/2624511964 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f363819f940 con 0x7f3638103ff0 2024-09-05T01:23:20.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.342+0000 7f362fe00640 1 -- 172.21.15.12:0/2624511964 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3628035070 con 0x7f3638103ff0 2024-09-05T01:23:20.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.343+0000 7f363e200640 1 -- 172.21.15.12:0/2624511964 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36381a7280 con 0x7f3638103ff0 2024-09-05T01:23:20.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.343+0000 7f363e200640 1 -- 172.21.15.12:0/2624511964 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3638062900 con 0x7f3638103ff0 2024-09-05T01:23:20.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.346+0000 7f362fe00640 1 -- 172.21.15.12:0/2624511964 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3628042030 con 0x7f3638103ff0 2024-09-05T01:23:20.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.347+0000 7f362fe00640 1 --2- 172.21.15.12:0/2624511964 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f361c0a2c90 0x7f361c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:20.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.347+0000 7f362fe00640 1 -- 172.21.15.12:0/2624511964 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f36280efa90 con 0x7f3638103ff0 2024-09-05T01:23:20.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.347+0000 7f3636a00640 1 --2- 172.21.15.12:0/2624511964 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f361c0a2c90 0x7f361c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:20.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.348+0000 7f362fe00640 1 --2- 172.21.15.12:0/2624511964 >> [v2:172.21.15.145:6800/2639126629,v1:172.21.15.145:6801/2639126629] conn(0x7f361c0ac4e0 0x7f361c0ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:20.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.348+0000 7f362fe00640 1 -- 172.21.15.12:0/2624511964 --> [v2:172.21.15.145:6800/2639126629,v1:172.21.15.145:6801/2639126629] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f362803ce50 con 0x7f361c0ac4e0 2024-09-05T01:23:20.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.348+0000 7f362fe00640 1 -- 172.21.15.12:0/2624511964 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f36280efe40 con 0x7f3638103ff0 2024-09-05T01:23:20.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.348+0000 7f3637e00640 1 --2- 172.21.15.12:0/2624511964 >> [v2:172.21.15.145:6800/2639126629,v1:172.21.15.145:6801/2639126629] conn(0x7f361c0ac4e0 0x7f361c0ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:20.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.349+0000 7f3636a00640 1 --2- 172.21.15.12:0/2624511964 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f361c0a2c90 0x7f361c0a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f36380ffff0 tx=0x7f3624005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:20.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.349+0000 7f3637e00640 1 --2- 172.21.15.12:0/2624511964 >> [v2:172.21.15.145:6800/2639126629,v1:172.21.15.145:6801/2639126629] conn(0x7f361c0ac4e0 0x7f361c0ae900 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:20.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.350+0000 7f362fe00640 1 -- 172.21.15.12:0/2624511964 <== osd.1 v2:172.21.15.145:6800/2639126629 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f362803ce50 con 0x7f361c0ac4e0 2024-09-05T01:23:20.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.364+0000 7f363e200640 1 -- 172.21.15.12:0/2624511964 --> [v2:172.21.15.145:6800/2639126629,v1:172.21.15.145:6801/2639126629] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3638062d00 con 0x7f361c0ac4e0 2024-09-05T01:23:20.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.365+0000 7f362fe00640 1 -- 172.21.15.12:0/2624511964 <== osd.1 v2:172.21.15.145:6800/2639126629 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3638062d00 con 0x7f361c0ac4e0 2024-09-05T01:23:20.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.366+0000 7f363e200640 1 -- 172.21.15.12:0/2624511964 >> [v2:172.21.15.145:6800/2639126629,v1:172.21.15.145:6801/2639126629] conn(0x7f361c0ac4e0 msgr2=0x7f361c0ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:20.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.366+0000 7f363e200640 1 --2- 172.21.15.12:0/2624511964 >> [v2:172.21.15.145:6800/2639126629,v1:172.21.15.145:6801/2639126629] conn(0x7f361c0ac4e0 0x7f361c0ae900 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:20.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.366+0000 7f363e200640 1 -- 172.21.15.12:0/2624511964 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f361c0a2c90 msgr2=0x7f361c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:20.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.366+0000 7f363e200640 1 --2- 172.21.15.12:0/2624511964 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f361c0a2c90 0x7f361c0a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f36380ffff0 tx=0x7f3624005f90 comp rx=0 tx=0).stop 2024-09-05T01:23:20.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.366+0000 7f363e200640 1 -- 172.21.15.12:0/2624511964 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3638103ff0 msgr2=0x7f363819a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:20.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.366+0000 7f363e200640 1 --2- 172.21.15.12:0/2624511964 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3638103ff0 0x7f363819a700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3628006010 tx=0x7f3628004040 comp rx=0 tx=0).stop 2024-09-05T01:23:20.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.366+0000 7f3637e00640 1 -- 172.21.15.12:0/2624511964 reap_dead start 2024-09-05T01:23:20.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.366+0000 7f363e200640 1 -- 172.21.15.12:0/2624511964 shutdown_connections 2024-09-05T01:23:20.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.366+0000 7f363e200640 1 -- 172.21.15.12:0/2624511964 >> 172.21.15.12:0/2624511964 conn(0x7f36380ffa90 msgr2=0x7f3638100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:20.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.366+0000 7f363e200640 1 -- 172.21.15.12:0/2624511964 shutdown_connections 2024-09-05T01:23:20.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:20.366+0000 7f363e200640 1 -- 172.21.15.12:0/2624511964 wait complete. 2024-09-05T01:23:20.380 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:20 smithi012 ceph-mon[29942]: pgmap v310: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-05T01:23:20.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:20 smithi145 ceph-mon[34376]: pgmap v310: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-05T01:23:20.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:20 smithi151 ceph-mon[35013]: pgmap v310: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-05T01:23:21.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.089+0000 7fece5c00640 1 -- 172.21.15.12:0/1247540247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fece0109140 msgr2=0x7fece0110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:21.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.089+0000 7fece5c00640 1 --2- 172.21.15.12:0/1247540247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fece0109140 0x7fece0110cc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fecd8009be0 tx=0x7fecd802a6c0 comp rx=0 tx=0).stop 2024-09-05T01:23:21.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.089+0000 7fece5c00640 1 -- 172.21.15.12:0/1247540247 shutdown_connections 2024-09-05T01:23:21.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.089+0000 7fece5c00640 1 --2- 172.21.15.12:0/1247540247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fece0109140 0x7fece0110cc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:21.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.089+0000 7fece5c00640 1 --2- 172.21.15.12:0/1247540247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fece01049c0 0x7fece0108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:21.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.089+0000 7fece5c00640 1 --2- 172.21.15.12:0/1247540247 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fece0104010 0x7fece01043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:21.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.089+0000 7fece5c00640 1 -- 172.21.15.12:0/1247540247 >> 172.21.15.12:0/1247540247 conn(0x7fece00ffa50 msgr2=0x7fece0101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:21.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.090+0000 7fece5c00640 1 -- 172.21.15.12:0/1247540247 shutdown_connections 2024-09-05T01:23:21.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.090+0000 7fece5c00640 1 -- 172.21.15.12:0/1247540247 wait complete. 2024-09-05T01:23:21.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.091+0000 7fece5c00640 1 Processor -- start 2024-09-05T01:23:21.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.091+0000 7fece5c00640 1 -- start start 2024-09-05T01:23:21.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.091+0000 7fece5c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fece0104010 0x7fece019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:21.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.091+0000 7fece5c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fece01049c0 0x7fece019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:21.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.091+0000 7fece5c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fece0109140 0x7fece019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:21.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.091+0000 7fece5c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fece0114170 con 0x7fece0109140 2024-09-05T01:23:21.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.091+0000 7fece5c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fece0113ff0 con 0x7fece0104010 2024-09-05T01:23:21.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.091+0000 7fece5c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fece01142f0 con 0x7fece01049c0 2024-09-05T01:23:21.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.091+0000 7fecde000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fece01049c0 0x7fece019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:21.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.091+0000 7fecdf400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fece0109140 0x7fece019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:21.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.091+0000 7fecdea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fece0104010 0x7fece019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:21.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.091+0000 7fecde000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fece01049c0 0x7fece019ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:58616/0 (socket says 172.21.15.12:58616) 2024-09-05T01:23:21.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.091+0000 7fecdea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fece0104010 0x7fece019a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:58476/0 (socket says 172.21.15.12:58476) 2024-09-05T01:23:21.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.092+0000 7fecde000640 1 -- 172.21.15.12:0/2188050418 learned_addr learned my addr 172.21.15.12:0/2188050418 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:21.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.092+0000 7fecde000640 1 -- 172.21.15.12:0/2188050418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fece0104010 msgr2=0x7fece019a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:21.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.092+0000 7fecde000640 1 --2- 172.21.15.12:0/2188050418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fece0104010 0x7fece019a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:21.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.092+0000 7fecde000640 1 -- 172.21.15.12:0/2188050418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fece0109140 msgr2=0x7fece019ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:21.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.092+0000 7fecde000640 1 --2- 172.21.15.12:0/2188050418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fece0109140 0x7fece019ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:21.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.092+0000 7fecde000640 1 -- 172.21.15.12:0/2188050418 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece019f600 con 0x7fece01049c0 2024-09-05T01:23:21.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.092+0000 7fecde000640 1 --2- 172.21.15.12:0/2188050418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fece01049c0 0x7fece019ab90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feccc00e9c0 tx=0x7feccc00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:21.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.092+0000 7fecd7400640 1 -- 172.21.15.12:0/2188050418 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feccc00ccc0 con 0x7fece01049c0 2024-09-05T01:23:21.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.093+0000 7fece5c00640 1 -- 172.21.15.12:0/2188050418 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fece019f8f0 con 0x7fece01049c0 2024-09-05T01:23:21.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.093+0000 7fecd7400640 1 -- 172.21.15.12:0/2188050418 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feccc005500 con 0x7fece01049c0 2024-09-05T01:23:21.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.093+0000 7fecd7400640 1 -- 172.21.15.12:0/2188050418 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feccc010430 con 0x7fece01049c0 2024-09-05T01:23:21.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.093+0000 7fece5c00640 1 -- 172.21.15.12:0/2188050418 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fece01a71d0 con 0x7fece01049c0 2024-09-05T01:23:21.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.094+0000 7fece5c00640 1 -- 172.21.15.12:0/2188050418 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fece0062980 con 0x7fece01049c0 2024-09-05T01:23:21.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.099+0000 7fecd7400640 1 -- 172.21.15.12:0/2188050418 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7feccc0046c0 con 0x7fece01049c0 2024-09-05T01:23:21.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.100+0000 7fecd7400640 1 --2- 172.21.15.12:0/2188050418 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fecc40a2c10 0x7fecc40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:21.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.100+0000 7fecd7400640 1 -- 172.21.15.12:0/2188050418 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7feccc0cf7a0 con 0x7fece01049c0 2024-09-05T01:23:21.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.100+0000 7fecdea00640 1 --2- 172.21.15.12:0/2188050418 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fecc40a2c10 0x7fecc40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:21.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.100+0000 7fecd7400640 1 --2- 172.21.15.12:0/2188050418 >> [v2:172.21.15.145:6808/1828591275,v1:172.21.15.145:6809/1828591275] conn(0x7fecc40ac460 0x7fecc40ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:21.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.100+0000 7fecd7400640 1 -- 172.21.15.12:0/2188050418 --> [v2:172.21.15.145:6808/1828591275,v1:172.21.15.145:6809/1828591275] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feccc015e80 con 0x7fecc40ac460 2024-09-05T01:23:21.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.100+0000 7fecd7400640 1 -- 172.21.15.12:0/2188050418 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7feccc0cfb50 con 0x7fece01049c0 2024-09-05T01:23:21.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.101+0000 7fecdf400640 1 --2- 172.21.15.12:0/2188050418 >> [v2:172.21.15.145:6808/1828591275,v1:172.21.15.145:6809/1828591275] conn(0x7fecc40ac460 0x7fecc40ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:21.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.101+0000 7fecdea00640 1 --2- 172.21.15.12:0/2188050418 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fecc40a2c10 0x7fecc40a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009bd0 tx=0x7fecd0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:21.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.101+0000 7fecdf400640 1 --2- 172.21.15.12:0/2188050418 >> [v2:172.21.15.145:6808/1828591275,v1:172.21.15.145:6809/1828591275] conn(0x7fecc40ac460 0x7fecc40ae880 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:21.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.102+0000 7fecd7400640 1 -- 172.21.15.12:0/2188050418 <== osd.4 v2:172.21.15.145:6808/1828591275 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feccc015e80 con 0x7fecc40ac460 2024-09-05T01:23:21.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.117+0000 7fece5c00640 1 -- 172.21.15.12:0/2188050418 --> [v2:172.21.15.145:6808/1828591275,v1:172.21.15.145:6809/1828591275] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fece0062e00 con 0x7fecc40ac460 2024-09-05T01:23:21.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.117+0000 7fecd7400640 1 -- 172.21.15.12:0/2188050418 <== osd.4 v2:172.21.15.145:6808/1828591275 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fece0062e00 con 0x7fecc40ac460 2024-09-05T01:23:21.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.118+0000 7fece5c00640 1 -- 172.21.15.12:0/2188050418 >> [v2:172.21.15.145:6808/1828591275,v1:172.21.15.145:6809/1828591275] conn(0x7fecc40ac460 msgr2=0x7fecc40ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:21.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.118+0000 7fece5c00640 1 --2- 172.21.15.12:0/2188050418 >> [v2:172.21.15.145:6808/1828591275,v1:172.21.15.145:6809/1828591275] conn(0x7fecc40ac460 0x7fecc40ae880 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:21.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.118+0000 7fece5c00640 1 -- 172.21.15.12:0/2188050418 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fecc40a2c10 msgr2=0x7fecc40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:21.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.118+0000 7fece5c00640 1 --2- 172.21.15.12:0/2188050418 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fecc40a2c10 0x7fecc40a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009bd0 tx=0x7fecd0005f90 comp rx=0 tx=0).stop 2024-09-05T01:23:21.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.118+0000 7fece5c00640 1 -- 172.21.15.12:0/2188050418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fece01049c0 msgr2=0x7fece019ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:21.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.118+0000 7fece5c00640 1 --2- 172.21.15.12:0/2188050418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fece01049c0 0x7fece019ab90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feccc00e9c0 tx=0x7feccc00ee80 comp rx=0 tx=0).stop 2024-09-05T01:23:21.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.118+0000 7fecdf400640 1 -- 172.21.15.12:0/2188050418 reap_dead start 2024-09-05T01:23:21.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.118+0000 7fece5c00640 1 -- 172.21.15.12:0/2188050418 shutdown_connections 2024-09-05T01:23:21.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.118+0000 7fece5c00640 1 -- 172.21.15.12:0/2188050418 >> 172.21.15.12:0/2188050418 conn(0x7fece00ffa50 msgr2=0x7fece0100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:21.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.118+0000 7fece5c00640 1 -- 172.21.15.12:0/2188050418 shutdown_connections 2024-09-05T01:23:21.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.118+0000 7fece5c00640 1 -- 172.21.15.12:0/2188050418 wait complete. 2024-09-05T01:23:21.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.653+0000 7ff0f6400640 1 -- 172.21.15.12:0/1912032829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0f0104010 msgr2=0x7ff0f01043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:21.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.653+0000 7ff0f6400640 1 --2- 172.21.15.12:0/1912032829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0f0104010 0x7ff0f01043f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0009900 tx=0x7ff0e002a3f0 comp rx=0 tx=0).stop 2024-09-05T01:23:21.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.653+0000 7ff0f6400640 1 -- 172.21.15.12:0/1912032829 shutdown_connections 2024-09-05T01:23:21.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.653+0000 7ff0f6400640 1 --2- 172.21.15.12:0/1912032829 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0f0109140 0x7ff0f0110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:21.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.653+0000 7ff0f6400640 1 --2- 172.21.15.12:0/1912032829 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff0f01049c0 0x7ff0f0108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:21.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.653+0000 7ff0f6400640 1 --2- 172.21.15.12:0/1912032829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0f0104010 0x7ff0f01043f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:21.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.653+0000 7ff0f6400640 1 -- 172.21.15.12:0/1912032829 >> 172.21.15.12:0/1912032829 conn(0x7ff0f00ffa50 msgr2=0x7ff0f0101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:21.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.653+0000 7ff0f6400640 1 -- 172.21.15.12:0/1912032829 shutdown_connections 2024-09-05T01:23:21.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.653+0000 7ff0f6400640 1 -- 172.21.15.12:0/1912032829 wait complete. 2024-09-05T01:23:21.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.654+0000 7ff0f6400640 1 Processor -- start 2024-09-05T01:23:21.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.654+0000 7ff0f6400640 1 -- start start 2024-09-05T01:23:21.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.654+0000 7ff0f6400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0f0104010 0x7ff0f019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:21.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.654+0000 7ff0f6400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff0f01049c0 0x7ff0f019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:21.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.654+0000 7ff0f6400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0f0109140 0x7ff0f019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:21.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.654+0000 7ff0f6400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f0114140 con 0x7ff0f0104010 2024-09-05T01:23:21.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.654+0000 7ff0f6400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f0113fc0 con 0x7ff0f01049c0 2024-09-05T01:23:21.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.654+0000 7ff0f6400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f01142c0 con 0x7ff0f0109140 2024-09-05T01:23:21.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.655+0000 7ff0ef400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0f0104010 0x7ff0f019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:21.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.655+0000 7ff0ef400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0f0104010 0x7ff0f019a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42832/0 (socket says 172.21.15.12:42832) 2024-09-05T01:23:21.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.655+0000 7ff0ef400640 1 -- 172.21.15.12:0/2728150210 learned_addr learned my addr 172.21.15.12:0/2728150210 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:21.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.655+0000 7ff0eea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff0f01049c0 0x7ff0f019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:21.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.655+0000 7ff0efe00640 1 --2- 172.21.15.12:0/2728150210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0f0109140 0x7ff0f019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:21.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.655+0000 7ff0ef400640 1 -- 172.21.15.12:0/2728150210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0f0109140 msgr2=0x7ff0f019eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:21.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.655+0000 7ff0ef400640 1 --2- 172.21.15.12:0/2728150210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0f0109140 0x7ff0f019eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:21.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.655+0000 7ff0ef400640 1 -- 172.21.15.12:0/2728150210 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff0f01049c0 msgr2=0x7ff0f019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:21.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.655+0000 7ff0ef400640 1 --2- 172.21.15.12:0/2728150210 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff0f01049c0 0x7ff0f019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:21.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.655+0000 7ff0ef400640 1 -- 172.21.15.12:0/2728150210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f019f5b0 con 0x7ff0f0104010 2024-09-05T01:23:21.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.655+0000 7ff0eea00640 1 --2- 172.21.15.12:0/2728150210 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff0f01049c0 0x7ff0f019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:23:21.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.655+0000 7ff0ef400640 1 --2- 172.21.15.12:0/2728150210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0f0104010 0x7ff0f019a600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0006010 tx=0x7ff0e0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:21.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.656+0000 7ff0e7e00640 1 -- 172.21.15.12:0/2728150210 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e003f030 con 0x7ff0f0104010 2024-09-05T01:23:21.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.656+0000 7ff0f6400640 1 -- 172.21.15.12:0/2728150210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f019f840 con 0x7ff0f0104010 2024-09-05T01:23:21.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.656+0000 7ff0e7e00640 1 -- 172.21.15.12:0/2728150210 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0e0004440 con 0x7ff0f0104010 2024-09-05T01:23:21.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.656+0000 7ff0e7e00640 1 -- 172.21.15.12:0/2728150210 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0035070 con 0x7ff0f0104010 2024-09-05T01:23:21.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.656+0000 7ff0f6400640 1 -- 172.21.15.12:0/2728150210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0f01a7180 con 0x7ff0f0104010 2024-09-05T01:23:21.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.657+0000 7ff0f6400640 1 -- 172.21.15.12:0/2728150210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff0f0062980 con 0x7ff0f0104010 2024-09-05T01:23:21.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.659+0000 7ff0e7e00640 1 -- 172.21.15.12:0/2728150210 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff0e0042030 con 0x7ff0f0104010 2024-09-05T01:23:21.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.660+0000 7ff0e7e00640 1 --2- 172.21.15.12:0/2728150210 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7ff0d40a2c90 0x7ff0d40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:21.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.660+0000 7ff0e7e00640 1 -- 172.21.15.12:0/2728150210 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7ff0e00efab0 con 0x7ff0f0104010 2024-09-05T01:23:21.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.660+0000 7ff0eea00640 1 --2- 172.21.15.12:0/2728150210 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7ff0d40a2c90 0x7ff0d40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:21.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.661+0000 7ff0e7e00640 1 --2- 172.21.15.12:0/2728150210 >> [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987] conn(0x7ff0d40ac4e0 0x7ff0d40ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:21.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.661+0000 7ff0e7e00640 1 -- 172.21.15.12:0/2728150210 --> [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff0e0001d30 con 0x7ff0d40ac4e0 2024-09-05T01:23:21.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.661+0000 7ff0e7e00640 1 -- 172.21.15.12:0/2728150210 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7ff0e00efe60 con 0x7ff0f0104010 2024-09-05T01:23:21.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.661+0000 7ff0efe00640 1 --2- 172.21.15.12:0/2728150210 >> [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987] conn(0x7ff0d40ac4e0 0x7ff0d40ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:21.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.661+0000 7ff0eea00640 1 --2- 172.21.15.12:0/2728150210 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7ff0d40a2c90 0x7ff0d40a5150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00ffe70 tx=0x7ff0dc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:21.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.662+0000 7ff0efe00640 1 --2- 172.21.15.12:0/2728150210 >> [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987] conn(0x7ff0d40ac4e0 0x7ff0d40ae900 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:21.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.662+0000 7ff0e7e00640 1 -- 172.21.15.12:0/2728150210 <== osd.0 v2:172.21.15.12:6802/2090563987 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff0e0001d30 con 0x7ff0d40ac4e0 2024-09-05T01:23:21.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.677+0000 7ff0f6400640 1 -- 172.21.15.12:0/2728150210 --> [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff0f0062d80 con 0x7ff0d40ac4e0 2024-09-05T01:23:21.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.678+0000 7ff0e7e00640 1 -- 172.21.15.12:0/2728150210 <== osd.0 v2:172.21.15.12:6802/2090563987 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff0f0062d80 con 0x7ff0d40ac4e0 2024-09-05T01:23:21.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.678+0000 7ff0f6400640 1 -- 172.21.15.12:0/2728150210 >> [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987] conn(0x7ff0d40ac4e0 msgr2=0x7ff0d40ae900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:21.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.678+0000 7ff0f6400640 1 --2- 172.21.15.12:0/2728150210 >> [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987] conn(0x7ff0d40ac4e0 0x7ff0d40ae900 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:21.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.678+0000 7ff0f6400640 1 -- 172.21.15.12:0/2728150210 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7ff0d40a2c90 msgr2=0x7ff0d40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:21.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.678+0000 7ff0f6400640 1 --2- 172.21.15.12:0/2728150210 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7ff0d40a2c90 0x7ff0d40a5150 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00ffe70 tx=0x7ff0dc005f90 comp rx=0 tx=0).stop 2024-09-05T01:23:21.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.678+0000 7ff0f6400640 1 -- 172.21.15.12:0/2728150210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0f0104010 msgr2=0x7ff0f019a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:21.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.678+0000 7ff0f6400640 1 --2- 172.21.15.12:0/2728150210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0f0104010 0x7ff0f019a600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff0e0006010 tx=0x7ff0e0004040 comp rx=0 tx=0).stop 2024-09-05T01:23:21.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.678+0000 7ff0efe00640 1 -- 172.21.15.12:0/2728150210 reap_dead start 2024-09-05T01:23:21.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.678+0000 7ff0f6400640 1 -- 172.21.15.12:0/2728150210 shutdown_connections 2024-09-05T01:23:21.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.678+0000 7ff0f6400640 1 -- 172.21.15.12:0/2728150210 >> 172.21.15.12:0/2728150210 conn(0x7ff0f00ffa50 msgr2=0x7ff0f0100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:21.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.679+0000 7ff0f6400640 1 -- 172.21.15.12:0/2728150210 shutdown_connections 2024-09-05T01:23:21.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.679+0000 7ff0f6400640 1 -- 172.21.15.12:0/2728150210 wait complete. 2024-09-05T01:23:22.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.325+0000 7f7762200640 1 -- 172.21.15.12:0/3298344623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f775c1079c0 msgr2=0x7f775c107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:22.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.325+0000 7f7762200640 1 --2- 172.21.15.12:0/3298344623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f775c1079c0 0x7f775c107da0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7750009930 tx=0x7f775002a440 comp rx=0 tx=0).stop 2024-09-05T01:23:22.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.325+0000 7f7762200640 1 -- 172.21.15.12:0/3298344623 shutdown_connections 2024-09-05T01:23:22.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.325+0000 7f7762200640 1 --2- 172.21.15.12:0/3298344623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f775c102360 0x7f775c10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:22.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.325+0000 7f7762200640 1 --2- 172.21.15.12:0/3298344623 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f775c1019c0 0x7f775c101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:22.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.325+0000 7f7762200640 1 --2- 172.21.15.12:0/3298344623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f775c1079c0 0x7f775c107da0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:22.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.325+0000 7f7762200640 1 -- 172.21.15.12:0/3298344623 >> 172.21.15.12:0/3298344623 conn(0x7f775c0fd740 msgr2=0x7f775c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:22.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.325+0000 7f7762200640 1 -- 172.21.15.12:0/3298344623 shutdown_connections 2024-09-05T01:23:22.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.325+0000 7f7762200640 1 -- 172.21.15.12:0/3298344623 wait complete. 2024-09-05T01:23:22.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.326+0000 7f7762200640 1 Processor -- start 2024-09-05T01:23:22.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.326+0000 7f7762200640 1 -- start start 2024-09-05T01:23:22.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.327+0000 7f7762200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f775c1019c0 0x7f775c19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:22.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.327+0000 7f7762200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f775c102360 0x7f775c19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:22.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.327+0000 7f7762200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f775c1079c0 0x7f775c19ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:22.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.327+0000 7f7762200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f775c111dd0 con 0x7f775c1079c0 2024-09-05T01:23:22.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.327+0000 7f7762200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f775c111c50 con 0x7f775c102360 2024-09-05T01:23:22.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.327+0000 7f7762200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f775c111f50 con 0x7f775c1019c0 2024-09-05T01:23:22.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.327+0000 7f7761800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f775c1079c0 0x7f775c19ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:22.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.327+0000 7f7761800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f775c1079c0 0x7f775c19ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42850/0 (socket says 172.21.15.12:42850) 2024-09-05T01:23:22.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.327+0000 7f7761800640 1 -- 172.21.15.12:0/2755077956 learned_addr learned my addr 172.21.15.12:0/2755077956 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:22.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.327+0000 7f7760e00640 1 --2- 172.21.15.12:0/2755077956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f775c1019c0 0x7f775c19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:22.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.328+0000 7f775be00640 1 --2- 172.21.15.12:0/2755077956 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f775c102360 0x7f775c19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:22.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.328+0000 7f7760e00640 1 -- 172.21.15.12:0/2755077956 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f775c102360 msgr2=0x7f775c19aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:22.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.328+0000 7f7760e00640 1 --2- 172.21.15.12:0/2755077956 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f775c102360 0x7f775c19aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:22.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.328+0000 7f7760e00640 1 -- 172.21.15.12:0/2755077956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f775c1079c0 msgr2=0x7f775c19ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:22.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.328+0000 7f7760e00640 1 --2- 172.21.15.12:0/2755077956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f775c1079c0 0x7f775c19ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:22.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.328+0000 7f7760e00640 1 -- 172.21.15.12:0/2755077956 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775c19f4c0 con 0x7f775c1019c0 2024-09-05T01:23:22.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.329+0000 7f7760e00640 1 --2- 172.21.15.12:0/2755077956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f775c1019c0 0x7f775c19a510 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f775002a960 tx=0x7f7750003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:22.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.329+0000 7f7759600640 1 -- 172.21.15.12:0/2755077956 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775003f070 con 0x7f775c1019c0 2024-09-05T01:23:22.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.329+0000 7f7759600640 1 -- 172.21.15.12:0/2755077956 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7750031c90 con 0x7f775c1019c0 2024-09-05T01:23:22.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.329+0000 7f7759600640 1 -- 172.21.15.12:0/2755077956 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7750035030 con 0x7f775c1019c0 2024-09-05T01:23:22.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.329+0000 7f7762200640 1 -- 172.21.15.12:0/2755077956 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f775c19f750 con 0x7f775c1019c0 2024-09-05T01:23:22.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.329+0000 7f7762200640 1 -- 172.21.15.12:0/2755077956 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f775c19fbe0 con 0x7f775c1019c0 2024-09-05T01:23:22.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.330+0000 7f7762200640 1 -- 172.21.15.12:0/2755077956 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f775c0fe8d0 con 0x7f775c1019c0 2024-09-05T01:23:22.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.333+0000 7f7759600640 1 -- 172.21.15.12:0/2755077956 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7750042070 con 0x7f775c1019c0 2024-09-05T01:23:22.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.335+0000 7f7759600640 1 --2- 172.21.15.12:0/2755077956 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f77440a2c90 0x7f77440a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:22.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.335+0000 7f7759600640 1 -- 172.21.15.12:0/2755077956 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8248+0+0 (secure 0 0 0) 0x7f77500f0480 con 0x7f775c1019c0 2024-09-05T01:23:22.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.335+0000 7f775be00640 1 --2- 172.21.15.12:0/2755077956 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f77440a2c90 0x7f77440a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:22.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.335+0000 7f7759600640 1 --2- 172.21.15.12:0/2755077956 >> [v2:172.21.15.151:6824/2855185758,v1:172.21.15.151:6825/2855185758] conn(0x7f77440ac8c0 0x7f77440aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:22.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.335+0000 7f7759600640 1 -- 172.21.15.12:0/2755077956 --> [v2:172.21.15.151:6824/2855185758,v1:172.21.15.151:6825/2855185758] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7750038e90 con 0x7f77440ac8c0 2024-09-05T01:23:22.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.335+0000 7f7759600640 1 -- 172.21.15.12:0/2755077956 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f77500f0830 con 0x7f775c1019c0 2024-09-05T01:23:22.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.335+0000 7f7761800640 1 --2- 172.21.15.12:0/2755077956 >> [v2:172.21.15.151:6824/2855185758,v1:172.21.15.151:6825/2855185758] conn(0x7f77440ac8c0 0x7f77440aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:22.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.336+0000 7f775be00640 1 --2- 172.21.15.12:0/2755077956 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f77440a2c90 0x7f77440a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f775c10ec90 tx=0x7f7748005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:22.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.336+0000 7f7761800640 1 --2- 172.21.15.12:0/2755077956 >> [v2:172.21.15.151:6824/2855185758,v1:172.21.15.151:6825/2855185758] conn(0x7f77440ac8c0 0x7f77440aed60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:22.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.337+0000 7f7759600640 1 -- 172.21.15.12:0/2755077956 <== osd.11 v2:172.21.15.151:6824/2855185758 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7750038e90 con 0x7f77440ac8c0 2024-09-05T01:23:22.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.363+0000 7f7762200640 1 -- 172.21.15.12:0/2755077956 --> [v2:172.21.15.151:6824/2855185758,v1:172.21.15.151:6825/2855185758] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f775c103100 con 0x7f77440ac8c0 2024-09-05T01:23:22.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.364+0000 7f7759600640 1 -- 172.21.15.12:0/2755077956 <== osd.11 v2:172.21.15.151:6824/2855185758 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f775c103100 con 0x7f77440ac8c0 2024-09-05T01:23:22.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.364+0000 7f7762200640 1 -- 172.21.15.12:0/2755077956 >> [v2:172.21.15.151:6824/2855185758,v1:172.21.15.151:6825/2855185758] conn(0x7f77440ac8c0 msgr2=0x7f77440aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:22.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.364+0000 7f7762200640 1 --2- 172.21.15.12:0/2755077956 >> [v2:172.21.15.151:6824/2855185758,v1:172.21.15.151:6825/2855185758] conn(0x7f77440ac8c0 0x7f77440aed60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:22.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.364+0000 7f7762200640 1 -- 172.21.15.12:0/2755077956 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f77440a2c90 msgr2=0x7f77440a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:22.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.364+0000 7f7762200640 1 --2- 172.21.15.12:0/2755077956 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f77440a2c90 0x7f77440a5150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f775c10ec90 tx=0x7f7748005f90 comp rx=0 tx=0).stop 2024-09-05T01:23:22.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.364+0000 7f7762200640 1 -- 172.21.15.12:0/2755077956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f775c1019c0 msgr2=0x7f775c19a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:22.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.364+0000 7f7762200640 1 --2- 172.21.15.12:0/2755077956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f775c1019c0 0x7f775c19a510 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f775002a960 tx=0x7f7750003b20 comp rx=0 tx=0).stop 2024-09-05T01:23:22.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.365+0000 7f7761800640 1 -- 172.21.15.12:0/2755077956 reap_dead start 2024-09-05T01:23:22.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.365+0000 7f7762200640 1 -- 172.21.15.12:0/2755077956 shutdown_connections 2024-09-05T01:23:22.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.365+0000 7f7762200640 1 -- 172.21.15.12:0/2755077956 >> 172.21.15.12:0/2755077956 conn(0x7f775c0fd740 msgr2=0x7f775c0fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:22.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.365+0000 7f7762200640 1 -- 172.21.15.12:0/2755077956 shutdown_connections 2024-09-05T01:23:22.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:22.365+0000 7f7762200640 1 -- 172.21.15.12:0/2755077956 wait complete. 2024-09-05T01:23:22.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-05T01:23:22.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-05T01:23:22.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]: dispatch 2024-09-05T01:23:22.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-05T01:23:22.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9, 4, 7]}]: dispatch 2024-09-05T01:23:22.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 8]}]: dispatch 2024-09-05T01:23:22.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-09-05T01:23:22.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-09-05T01:23:22.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-09-05T01:23:22.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:22 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-05T01:23:22.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:22 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-05T01:23:22.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:22 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]: dispatch 2024-09-05T01:23:22.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:22 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-05T01:23:22.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:22 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9, 4, 7]}]: dispatch 2024-09-05T01:23:22.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:22 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 8]}]: dispatch 2024-09-05T01:23:22.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:22 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-09-05T01:23:22.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:22 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-09-05T01:23:22.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:22 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-09-05T01:23:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:22 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-09-05T01:23:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:22 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-05T01:23:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:22 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]: dispatch 2024-09-05T01:23:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:22 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-05T01:23:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:22 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9, 4, 7]}]: dispatch 2024-09-05T01:23:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:22 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 8]}]: dispatch 2024-09-05T01:23:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:22 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-09-05T01:23:22.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:22 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-09-05T01:23:22.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:22 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-09-05T01:23:23.204 INFO:teuthology.orchestra.run.smithi012.stdout:322122547223 2024-09-05T01:23:23.204 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-05T01:23:23.329 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:23 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-05T01:23:23.329 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:23 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-05T01:23:23.329 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:23 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-09-05T01:23:23.329 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:23 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-05T01:23:23.329 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:23 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9, 4, 7]}]': finished 2024-09-05T01:23:23.329 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:23 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 8]}]': finished 2024-09-05T01:23:23.329 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:23 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-05T01:23:23.329 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:23 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-05T01:23:23.329 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:23 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-05T01:23:23.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:23 smithi012 ceph-mon[29942]: osdmap e82: 12 total, 12 up, 12 in 2024-09-05T01:23:23.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:23 smithi012 ceph-mon[29942]: pgmap v312: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-05T01:23:23.330 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:23 smithi012 ceph-mon[29942]: osdmap e83: 12 total, 12 up, 12 in 2024-09-05T01:23:23.489 INFO:teuthology.orchestra.run.smithi012.stdout:34359738450 2024-09-05T01:23:23.489 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-05T01:23:23.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:23 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-05T01:23:23.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:23 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-05T01:23:23.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:23 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-09-05T01:23:23.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:23 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-05T01:23:23.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:23 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9, 4, 7]}]': finished 2024-09-05T01:23:23.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:23 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 8]}]': finished 2024-09-05T01:23:23.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:23 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-05T01:23:23.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:23 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-05T01:23:23.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:23 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-05T01:23:23.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:23 smithi145 ceph-mon[34376]: osdmap e82: 12 total, 12 up, 12 in 2024-09-05T01:23:23.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:23 smithi145 ceph-mon[34376]: pgmap v312: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-05T01:23:23.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:23 smithi145 ceph-mon[34376]: osdmap e83: 12 total, 12 up, 12 in 2024-09-05T01:23:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:23 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-05T01:23:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:23 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-05T01:23:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:23 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 1]}]': finished 2024-09-05T01:23:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:23 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-05T01:23:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:23 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9, 4, 7]}]': finished 2024-09-05T01:23:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:23 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 8]}]': finished 2024-09-05T01:23:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:23 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-05T01:23:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:23 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-05T01:23:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:23 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-05T01:23:23.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:23 smithi151 ceph-mon[35013]: osdmap e82: 12 total, 12 up, 12 in 2024-09-05T01:23:23.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:23 smithi151 ceph-mon[35013]: pgmap v312: 97 pgs: 97 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-05T01:23:23.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:23 smithi151 ceph-mon[35013]: osdmap e83: 12 total, 12 up, 12 in 2024-09-05T01:23:23.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.178+0000 7fdb22000640 1 -- 172.21.15.12:0/3790073056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb1c106f10 msgr2=0x7fdb1c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:23.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.178+0000 7fdb22000640 1 --2- 172.21.15.12:0/3790073056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb1c106f10 0x7fdb1c10ea90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdb14009ca0 tx=0x7fdb1402a8c0 comp rx=0 tx=0).stop 2024-09-05T01:23:23.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.178+0000 7fdb22000640 1 -- 172.21.15.12:0/3790073056 shutdown_connections 2024-09-05T01:23:23.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.178+0000 7fdb22000640 1 --2- 172.21.15.12:0/3790073056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb1c106f10 0x7fdb1c10ea90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:23.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.178+0000 7fdb22000640 1 --2- 172.21.15.12:0/3790073056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb1c102790 0x7fdb1c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:23.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.178+0000 7fdb22000640 1 --2- 172.21.15.12:0/3790073056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb1c101de0 0x7fdb1c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:23.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.178+0000 7fdb22000640 1 -- 172.21.15.12:0/3790073056 >> 172.21.15.12:0/3790073056 conn(0x7fdb1c0fd8c0 msgr2=0x7fdb1c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:23.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.178+0000 7fdb22000640 1 -- 172.21.15.12:0/3790073056 shutdown_connections 2024-09-05T01:23:23.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.178+0000 7fdb22000640 1 -- 172.21.15.12:0/3790073056 wait complete. 2024-09-05T01:23:23.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.179+0000 7fdb22000640 1 Processor -- start 2024-09-05T01:23:23.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.179+0000 7fdb22000640 1 -- start start 2024-09-05T01:23:23.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.179+0000 7fdb22000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb1c101de0 0x7fdb1c108ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:23.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.179+0000 7fdb22000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb1c102790 0x7fdb1c108ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:23.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.179+0000 7fdb22000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb1c106f10 0x7fdb1c109530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:23.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.179+0000 7fdb22000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c111fc0 con 0x7fdb1c101de0 2024-09-05T01:23:23.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.179+0000 7fdb22000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c111e40 con 0x7fdb1c106f10 2024-09-05T01:23:23.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.179+0000 7fdb22000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c112140 con 0x7fdb1c102790 2024-09-05T01:23:23.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.179+0000 7fdb1b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb1c101de0 0x7fdb1c108ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:23.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.180+0000 7fdb1b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb1c101de0 0x7fdb1c108ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42828/0 (socket says 172.21.15.12:42828) 2024-09-05T01:23:23.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.180+0000 7fdb1b400640 1 -- 172.21.15.12:0/2861214786 learned_addr learned my addr 172.21.15.12:0/2861214786 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:23.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.180+0000 7fdb12a00640 1 --2- 172.21.15.12:0/2861214786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb1c102790 0x7fdb1c108ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:23.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.180+0000 7fdb1be00640 1 --2- 172.21.15.12:0/2861214786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb1c106f10 0x7fdb1c109530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:23.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.180+0000 7fdb1b400640 1 -- 172.21.15.12:0/2861214786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb1c102790 msgr2=0x7fdb1c108ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:23.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.180+0000 7fdb1b400640 1 --2- 172.21.15.12:0/2861214786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb1c102790 0x7fdb1c108ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:23.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.180+0000 7fdb1b400640 1 -- 172.21.15.12:0/2861214786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb1c106f10 msgr2=0x7fdb1c109530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:23.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.180+0000 7fdb1b400640 1 --2- 172.21.15.12:0/2861214786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb1c106f10 0x7fdb1c109530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:23.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.180+0000 7fdb1b400640 1 -- 172.21.15.12:0/2861214786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb1c1aac70 con 0x7fdb1c101de0 2024-09-05T01:23:23.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.180+0000 7fdb12a00640 1 --2- 172.21.15.12:0/2861214786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb1c102790 0x7fdb1c108ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:23:23.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.180+0000 7fdb1be00640 1 --2- 172.21.15.12:0/2861214786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdb1c106f10 0x7fdb1c109530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:23:23.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.180+0000 7fdb1b400640 1 --2- 172.21.15.12:0/2861214786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb1c101de0 0x7fdb1c108ab0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00d980 tx=0x7fdb0c00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:23.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.181+0000 7fdb18c00640 1 -- 172.21.15.12:0/2861214786 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c017070 con 0x7fdb1c101de0 2024-09-05T01:23:23.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.181+0000 7fdb18c00640 1 -- 172.21.15.12:0/2861214786 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb0c009c30 con 0x7fdb1c101de0 2024-09-05T01:23:23.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.181+0000 7fdb22000640 1 -- 172.21.15.12:0/2861214786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb1c1aaf60 con 0x7fdb1c101de0 2024-09-05T01:23:23.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.181+0000 7fdb18c00640 1 -- 172.21.15.12:0/2861214786 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c00f620 con 0x7fdb1c101de0 2024-09-05T01:23:23.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.181+0000 7fdb22000640 1 -- 172.21.15.12:0/2861214786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb1c1ab410 con 0x7fdb1c101de0 2024-09-05T01:23:23.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.182+0000 7fdb22000640 1 -- 172.21.15.12:0/2861214786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdb1c075780 con 0x7fdb1c101de0 2024-09-05T01:23:23.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.184+0000 7fdb18c00640 1 -- 172.21.15.12:0/2861214786 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdb0c010460 con 0x7fdb1c101de0 2024-09-05T01:23:23.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.185+0000 7fdb18c00640 1 --2- 172.21.15.12:0/2861214786 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fdb000a2c10 0x7fdb000a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:23.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.185+0000 7fdb18c00640 1 -- 172.21.15.12:0/2861214786 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fdb0c0cf250 con 0x7fdb1c101de0 2024-09-05T01:23:23.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.185+0000 7fdb12a00640 1 --2- 172.21.15.12:0/2861214786 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fdb000a2c10 0x7fdb000a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:23.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.185+0000 7fdb18c00640 1 --2- 172.21.15.12:0/2861214786 >> [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496] conn(0x7fdb000ac460 0x7fdb000ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:23.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.185+0000 7fdb18c00640 1 -- 172.21.15.12:0/2861214786 --> [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdb0c016ec0 con 0x7fdb000ac460 2024-09-05T01:23:23.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.185+0000 7fdb18c00640 1 -- 172.21.15.12:0/2861214786 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fdb0c0cf600 con 0x7fdb1c101de0 2024-09-05T01:23:23.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.186+0000 7fdb1be00640 1 --2- 172.21.15.12:0/2861214786 >> [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496] conn(0x7fdb000ac460 0x7fdb000ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:23.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.186+0000 7fdb12a00640 1 --2- 172.21.15.12:0/2861214786 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fdb000a2c10 0x7fdb000a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c10a270 tx=0x7fdb04005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:23.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.186+0000 7fdb1be00640 1 --2- 172.21.15.12:0/2861214786 >> [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496] conn(0x7fdb000ac460 0x7fdb000ae880 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:23.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.187+0000 7fdb18c00640 1 -- 172.21.15.12:0/2861214786 <== osd.9 v2:172.21.15.12:6826/1193852496 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdb0c016ec0 con 0x7fdb000ac460 2024-09-05T01:23:23.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.202+0000 7fdb22000640 1 -- 172.21.15.12:0/2861214786 --> [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdb1c1032c0 con 0x7fdb000ac460 2024-09-05T01:23:23.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.202+0000 7fdb18c00640 1 -- 172.21.15.12:0/2861214786 <== osd.9 v2:172.21.15.12:6826/1193852496 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdb1c1032c0 con 0x7fdb000ac460 2024-09-05T01:23:23.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.202+0000 7fdb22000640 1 -- 172.21.15.12:0/2861214786 >> [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496] conn(0x7fdb000ac460 msgr2=0x7fdb000ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:23.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.202+0000 7fdb22000640 1 --2- 172.21.15.12:0/2861214786 >> [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496] conn(0x7fdb000ac460 0x7fdb000ae880 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:23.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.202+0000 7fdb22000640 1 -- 172.21.15.12:0/2861214786 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fdb000a2c10 msgr2=0x7fdb000a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:23.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.202+0000 7fdb22000640 1 --2- 172.21.15.12:0/2861214786 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fdb000a2c10 0x7fdb000a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c10a270 tx=0x7fdb04005f90 comp rx=0 tx=0).stop 2024-09-05T01:23:23.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.203+0000 7fdb22000640 1 -- 172.21.15.12:0/2861214786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb1c101de0 msgr2=0x7fdb1c108ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:23.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.203+0000 7fdb22000640 1 --2- 172.21.15.12:0/2861214786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb1c101de0 0x7fdb1c108ab0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00d980 tx=0x7fdb0c00de40 comp rx=0 tx=0).stop 2024-09-05T01:23:23.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.203+0000 7fdb1be00640 1 -- 172.21.15.12:0/2861214786 reap_dead start 2024-09-05T01:23:23.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.203+0000 7fdb22000640 1 -- 172.21.15.12:0/2861214786 shutdown_connections 2024-09-05T01:23:23.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.203+0000 7fdb22000640 1 -- 172.21.15.12:0/2861214786 >> 172.21.15.12:0/2861214786 conn(0x7fdb1c0fd8c0 msgr2=0x7fdb1c0fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:23.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.203+0000 7fdb22000640 1 -- 172.21.15.12:0/2861214786 shutdown_connections 2024-09-05T01:23:23.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:21.203+0000 7fdb22000640 1 -- 172.21.15.12:0/2861214786 wait complete. 2024-09-05T01:23:24.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.378+0000 7f6212600640 1 -- 172.21.15.12:0/3665186868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f620c1019c0 msgr2=0x7f620c101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:24.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.378+0000 7f6212600640 1 --2- 172.21.15.12:0/3665186868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f620c1019c0 0x7f620c101e20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f61f8009930 tx=0x7f61f802a420 comp rx=0 tx=0).stop 2024-09-05T01:23:24.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.378+0000 7f6212600640 1 -- 172.21.15.12:0/3665186868 shutdown_connections 2024-09-05T01:23:24.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.378+0000 7f6212600640 1 --2- 172.21.15.12:0/3665186868 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f620c102360 0x7f620c10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:24.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.378+0000 7f6212600640 1 --2- 172.21.15.12:0/3665186868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f620c1019c0 0x7f620c101e20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:24.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.378+0000 7f6212600640 1 --2- 172.21.15.12:0/3665186868 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f620c1079c0 0x7f620c107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:24.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.378+0000 7f6212600640 1 -- 172.21.15.12:0/3665186868 >> 172.21.15.12:0/3665186868 conn(0x7f620c0fd740 msgr2=0x7f620c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:24.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.378+0000 7f6212600640 1 -- 172.21.15.12:0/3665186868 shutdown_connections 2024-09-05T01:23:24.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.378+0000 7f6212600640 1 -- 172.21.15.12:0/3665186868 wait complete. 2024-09-05T01:23:24.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.379+0000 7f6212600640 1 Processor -- start 2024-09-05T01:23:24.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.379+0000 7f6212600640 1 -- start start 2024-09-05T01:23:24.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.380+0000 7f6212600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f620c1019c0 0x7f620c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:24.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.380+0000 7f6212600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f620c102360 0x7f620c19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:24.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.380+0000 7f6212600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f620c1079c0 0x7f620c19ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:24.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.380+0000 7f6212600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f620c111dd0 con 0x7f620c102360 2024-09-05T01:23:24.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.380+0000 7f6212600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f620c111c50 con 0x7f620c1019c0 2024-09-05T01:23:24.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.380+0000 7f6212600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f620c111f50 con 0x7f620c1079c0 2024-09-05T01:23:24.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.380+0000 7f620be00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f620c102360 0x7f620c19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:24.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.380+0000 7f620be00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f620c102360 0x7f620c19a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42868/0 (socket says 172.21.15.12:42868) 2024-09-05T01:23:24.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.380+0000 7f620be00640 1 -- 172.21.15.12:0/2599442122 learned_addr learned my addr 172.21.15.12:0/2599442122 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:24.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.380+0000 7f6211200640 1 --2- 172.21.15.12:0/2599442122 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f620c1019c0 0x7f620c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:24.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.380+0000 7f6211c00640 1 --2- 172.21.15.12:0/2599442122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f620c1079c0 0x7f620c19ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:24.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.380+0000 7f620be00640 1 -- 172.21.15.12:0/2599442122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f620c1079c0 msgr2=0x7f620c19ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:24.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.380+0000 7f620be00640 1 --2- 172.21.15.12:0/2599442122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f620c1079c0 0x7f620c19ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:24.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.380+0000 7f620be00640 1 -- 172.21.15.12:0/2599442122 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f620c1019c0 msgr2=0x7f620c19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:24.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.380+0000 7f620be00640 1 --2- 172.21.15.12:0/2599442122 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f620c1019c0 0x7f620c19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:24.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.380+0000 7f620be00640 1 -- 172.21.15.12:0/2599442122 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f620c19f460 con 0x7f620c102360 2024-09-05T01:23:24.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.381+0000 7f620be00640 1 --2- 172.21.15.12:0/2599442122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f620c102360 0x7f620c19a9f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f61f802a940 tx=0x7f61f8003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.381+0000 7f6209600640 1 -- 172.21.15.12:0/2599442122 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f803f070 con 0x7f620c102360 2024-09-05T01:23:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.381+0000 7f6212600640 1 -- 172.21.15.12:0/2599442122 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f620c19f6f0 con 0x7f620c102360 2024-09-05T01:23:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.381+0000 7f6209600640 1 -- 172.21.15.12:0/2599442122 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61f8031c90 con 0x7f620c102360 2024-09-05T01:23:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.381+0000 7f6209600640 1 -- 172.21.15.12:0/2599442122 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f8035030 con 0x7f620c102360 2024-09-05T01:23:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.381+0000 7f6212600640 1 -- 172.21.15.12:0/2599442122 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f620c1a7030 con 0x7f620c102360 2024-09-05T01:23:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.382+0000 7f6212600640 1 -- 172.21.15.12:0/2599442122 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f620c0fe7f0 con 0x7f620c102360 2024-09-05T01:23:24.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.384+0000 7f6209600640 1 -- 172.21.15.12:0/2599442122 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f61f8042070 con 0x7f620c102360 2024-09-05T01:23:24.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.385+0000 7f6209600640 1 --2- 172.21.15.12:0/2599442122 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f61f40a2c10 0x7f61f40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:24.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.386+0000 7f6209600640 1 -- 172.21.15.12:0/2599442122 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f61f80effe0 con 0x7f620c102360 2024-09-05T01:23:24.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.386+0000 7f6211200640 1 --2- 172.21.15.12:0/2599442122 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f61f40a2c10 0x7f61f40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:24.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.386+0000 7f6209600640 1 --2- 172.21.15.12:0/2599442122 >> [v2:172.21.15.145:6816/3058588721,v1:172.21.15.145:6817/3058588721] conn(0x7f61f40ac840 0x7f61f40aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:24.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.386+0000 7f6209600640 1 -- 172.21.15.12:0/2599442122 --> [v2:172.21.15.145:6816/3058588721,v1:172.21.15.145:6817/3058588721] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f61f8038e90 con 0x7f61f40ac840 2024-09-05T01:23:24.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.386+0000 7f6209600640 1 -- 172.21.15.12:0/2599442122 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f61f80f0390 con 0x7f620c102360 2024-09-05T01:23:24.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.386+0000 7f6211c00640 1 --2- 172.21.15.12:0/2599442122 >> [v2:172.21.15.145:6816/3058588721,v1:172.21.15.145:6817/3058588721] conn(0x7f61f40ac840 0x7f61f40aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:24.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.386+0000 7f6211200640 1 --2- 172.21.15.12:0/2599442122 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f61f40a2c10 0x7f61f40a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6200005d00 tx=0x7f620000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:24.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.387+0000 7f6211c00640 1 --2- 172.21.15.12:0/2599442122 >> [v2:172.21.15.145:6816/3058588721,v1:172.21.15.145:6817/3058588721] conn(0x7f61f40ac840 0x7f61f40aece0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:24.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.388+0000 7f6209600640 1 -- 172.21.15.12:0/2599442122 <== osd.7 v2:172.21.15.145:6816/3058588721 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f61f8038e90 con 0x7f61f40ac840 2024-09-05T01:23:24.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.402+0000 7f6212600640 1 -- 172.21.15.12:0/2599442122 --> [v2:172.21.15.145:6816/3058588721,v1:172.21.15.145:6817/3058588721] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f620c103100 con 0x7f61f40ac840 2024-09-05T01:23:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.403+0000 7f6209600640 1 -- 172.21.15.12:0/2599442122 <== osd.7 v2:172.21.15.145:6816/3058588721 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f620c103100 con 0x7f61f40ac840 2024-09-05T01:23:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.403+0000 7f6212600640 1 -- 172.21.15.12:0/2599442122 >> [v2:172.21.15.145:6816/3058588721,v1:172.21.15.145:6817/3058588721] conn(0x7f61f40ac840 msgr2=0x7f61f40aece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.403+0000 7f6212600640 1 --2- 172.21.15.12:0/2599442122 >> [v2:172.21.15.145:6816/3058588721,v1:172.21.15.145:6817/3058588721] conn(0x7f61f40ac840 0x7f61f40aece0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.404+0000 7f6212600640 1 -- 172.21.15.12:0/2599442122 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f61f40a2c10 msgr2=0x7f61f40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.404+0000 7f6212600640 1 --2- 172.21.15.12:0/2599442122 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f61f40a2c10 0x7f61f40a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6200005d00 tx=0x7f620000b410 comp rx=0 tx=0).stop 2024-09-05T01:23:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.404+0000 7f6212600640 1 -- 172.21.15.12:0/2599442122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f620c102360 msgr2=0x7f620c19a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.404+0000 7f6212600640 1 --2- 172.21.15.12:0/2599442122 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f620c102360 0x7f620c19a9f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f61f802a940 tx=0x7f61f8003b90 comp rx=0 tx=0).stop 2024-09-05T01:23:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.404+0000 7f6211c00640 1 -- 172.21.15.12:0/2599442122 reap_dead start 2024-09-05T01:23:24.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.404+0000 7f6212600640 1 -- 172.21.15.12:0/2599442122 shutdown_connections 2024-09-05T01:23:24.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.404+0000 7f6212600640 1 -- 172.21.15.12:0/2599442122 >> 172.21.15.12:0/2599442122 conn(0x7f620c0fd740 msgr2=0x7f620c0fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:24.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.404+0000 7f6212600640 1 -- 172.21.15.12:0/2599442122 shutdown_connections 2024-09-05T01:23:24.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:24.404+0000 7f6212600640 1 -- 172.21.15.12:0/2599442122 wait complete. 2024-09-05T01:23:24.613 INFO:teuthology.orchestra.run.smithi012.stdout:270582939681 2024-09-05T01:23:24.613 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-05T01:23:25.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.328+0000 7ff1d1c00640 1 -- 172.21.15.12:0/2581249308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1cc1049a0 msgr2=0x7ff1cc1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:25.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.328+0000 7ff1d1c00640 1 --2- 172.21.15.12:0/2581249308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1cc1049a0 0x7ff1cc1089f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009900 tx=0x7ff1b402a3f0 comp rx=0 tx=0).stop 2024-09-05T01:23:25.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.328+0000 7ff1d1c00640 1 -- 172.21.15.12:0/2581249308 shutdown_connections 2024-09-05T01:23:25.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.328+0000 7ff1d1c00640 1 --2- 172.21.15.12:0/2581249308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1cc109120 0x7ff1cc110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:25.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.328+0000 7ff1d1c00640 1 --2- 172.21.15.12:0/2581249308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1cc1049a0 0x7ff1cc1089f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:25.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.328+0000 7ff1d1c00640 1 --2- 172.21.15.12:0/2581249308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1cc103ff0 0x7ff1cc1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:25.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.328+0000 7ff1d1c00640 1 -- 172.21.15.12:0/2581249308 >> 172.21.15.12:0/2581249308 conn(0x7ff1cc0ffa90 msgr2=0x7ff1cc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:25.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.328+0000 7ff1d1c00640 1 -- 172.21.15.12:0/2581249308 shutdown_connections 2024-09-05T01:23:25.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.328+0000 7ff1d1c00640 1 -- 172.21.15.12:0/2581249308 wait complete. 2024-09-05T01:23:25.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.329+0000 7ff1d1c00640 1 Processor -- start 2024-09-05T01:23:25.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.329+0000 7ff1d1c00640 1 -- start start 2024-09-05T01:23:25.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.329+0000 7ff1d1c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1cc103ff0 0x7ff1cc19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:25.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.329+0000 7ff1d1c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1cc1049a0 0x7ff1cc19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:25.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.329+0000 7ff1d1c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1cc109120 0x7ff1cc19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:25.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.329+0000 7ff1d1c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc114190 con 0x7ff1cc103ff0 2024-09-05T01:23:25.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.329+0000 7ff1d1c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc114010 con 0x7ff1cc1049a0 2024-09-05T01:23:25.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.329+0000 7ff1d1c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc114310 con 0x7ff1cc109120 2024-09-05T01:23:25.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.330+0000 7ff1caa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1cc103ff0 0x7ff1cc19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:25.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.330+0000 7ff1cb400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1cc109120 0x7ff1cc19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:25.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.330+0000 7ff1caa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1cc103ff0 0x7ff1cc19a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42884/0 (socket says 172.21.15.12:42884) 2024-09-05T01:23:25.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.330+0000 7ff1caa00640 1 -- 172.21.15.12:0/3180408988 learned_addr learned my addr 172.21.15.12:0/3180408988 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:25.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.330+0000 7ff1c3e00640 1 --2- 172.21.15.12:0/3180408988 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1cc1049a0 0x7ff1cc19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:25.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.330+0000 7ff1cb400640 1 -- 172.21.15.12:0/3180408988 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1cc1049a0 msgr2=0x7ff1cc19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:25.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.330+0000 7ff1cb400640 1 --2- 172.21.15.12:0/3180408988 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1cc1049a0 0x7ff1cc19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:25.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.330+0000 7ff1cb400640 1 -- 172.21.15.12:0/3180408988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1cc103ff0 msgr2=0x7ff1cc19a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:25.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.330+0000 7ff1cb400640 1 --2- 172.21.15.12:0/3180408988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1cc103ff0 0x7ff1cc19a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:25.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.330+0000 7ff1cb400640 1 -- 172.21.15.12:0/3180408988 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1cc19f620 con 0x7ff1cc109120 2024-09-05T01:23:25.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.331+0000 7ff1cb400640 1 --2- 172.21.15.12:0/3180408988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1cc109120 0x7ff1cc19ef40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4009fd0 tx=0x7ff1c400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:25.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.331+0000 7ff1c3400640 1 -- 172.21.15.12:0/3180408988 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c400ce20 con 0x7ff1cc109120 2024-09-05T01:23:25.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.331+0000 7ff1c3400640 1 -- 172.21.15.12:0/3180408988 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1c4005020 con 0x7ff1cc109120 2024-09-05T01:23:25.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.331+0000 7ff1c3400640 1 -- 172.21.15.12:0/3180408988 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4010720 con 0x7ff1cc109120 2024-09-05T01:23:25.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.331+0000 7ff1d1c00640 1 -- 172.21.15.12:0/3180408988 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1cc19f910 con 0x7ff1cc109120 2024-09-05T01:23:25.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.331+0000 7ff1d1c00640 1 -- 172.21.15.12:0/3180408988 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1cc1a71f0 con 0x7ff1cc109120 2024-09-05T01:23:25.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.332+0000 7ff1d1c00640 1 -- 172.21.15.12:0/3180408988 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff1cc062900 con 0x7ff1cc109120 2024-09-05T01:23:25.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.334+0000 7ff1c3400640 1 -- 172.21.15.12:0/3180408988 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff1c4005540 con 0x7ff1cc109120 2024-09-05T01:23:25.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.335+0000 7ff1c3400640 1 --2- 172.21.15.12:0/3180408988 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7ff1b00a2c90 0x7ff1b00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:25.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.335+0000 7ff1c3400640 1 -- 172.21.15.12:0/3180408988 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7ff1c40cf9f0 con 0x7ff1cc109120 2024-09-05T01:23:25.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.335+0000 7ff1caa00640 1 --2- 172.21.15.12:0/3180408988 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7ff1b00a2c90 0x7ff1b00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:25.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.336+0000 7ff1c3400640 1 --2- 172.21.15.12:0/3180408988 >> [v2:172.21.15.151:6808/3888870109,v1:172.21.15.151:6809/3888870109] conn(0x7ff1b00ac8c0 0x7ff1b00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:25.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.336+0000 7ff1c3400640 1 -- 172.21.15.12:0/3180408988 --> [v2:172.21.15.151:6808/3888870109,v1:172.21.15.151:6809/3888870109] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff1c401ee50 con 0x7ff1b00ac8c0 2024-09-05T01:23:25.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.336+0000 7ff1c3400640 1 -- 172.21.15.12:0/3180408988 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7ff1c40cfda0 con 0x7ff1cc109120 2024-09-05T01:23:25.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.336+0000 7ff1c3e00640 1 --2- 172.21.15.12:0/3180408988 >> [v2:172.21.15.151:6808/3888870109,v1:172.21.15.151:6809/3888870109] conn(0x7ff1b00ac8c0 0x7ff1b00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:25.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.336+0000 7ff1caa00640 1 --2- 172.21.15.12:0/3180408988 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7ff1b00a2c90 0x7ff1b00a5150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009c90 tx=0x7ff1bc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:25.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.336+0000 7ff1c3e00640 1 --2- 172.21.15.12:0/3180408988 >> [v2:172.21.15.151:6808/3888870109,v1:172.21.15.151:6809/3888870109] conn(0x7ff1b00ac8c0 0x7ff1b00aed60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:25.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.337+0000 7ff1c3400640 1 -- 172.21.15.12:0/3180408988 <== osd.5 v2:172.21.15.151:6808/3888870109 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff1c401ee50 con 0x7ff1b00ac8c0 2024-09-05T01:23:25.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.352+0000 7ff1d1c00640 1 -- 172.21.15.12:0/3180408988 --> [v2:172.21.15.151:6808/3888870109,v1:172.21.15.151:6809/3888870109] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff1cc062dd0 con 0x7ff1b00ac8c0 2024-09-05T01:23:25.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.352+0000 7ff1c3400640 1 -- 172.21.15.12:0/3180408988 <== osd.5 v2:172.21.15.151:6808/3888870109 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff1cc062dd0 con 0x7ff1b00ac8c0 2024-09-05T01:23:25.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.353+0000 7ff1d1c00640 1 -- 172.21.15.12:0/3180408988 >> [v2:172.21.15.151:6808/3888870109,v1:172.21.15.151:6809/3888870109] conn(0x7ff1b00ac8c0 msgr2=0x7ff1b00aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:25.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.353+0000 7ff1d1c00640 1 --2- 172.21.15.12:0/3180408988 >> [v2:172.21.15.151:6808/3888870109,v1:172.21.15.151:6809/3888870109] conn(0x7ff1b00ac8c0 0x7ff1b00aed60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:25.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.353+0000 7ff1d1c00640 1 -- 172.21.15.12:0/3180408988 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7ff1b00a2c90 msgr2=0x7ff1b00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:25.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.353+0000 7ff1d1c00640 1 --2- 172.21.15.12:0/3180408988 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7ff1b00a2c90 0x7ff1b00a5150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc009c90 tx=0x7ff1bc005f90 comp rx=0 tx=0).stop 2024-09-05T01:23:25.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.353+0000 7ff1d1c00640 1 -- 172.21.15.12:0/3180408988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1cc109120 msgr2=0x7ff1cc19ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:25.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.353+0000 7ff1d1c00640 1 --2- 172.21.15.12:0/3180408988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1cc109120 0x7ff1cc19ef40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4009fd0 tx=0x7ff1c400ef10 comp rx=0 tx=0).stop 2024-09-05T01:23:25.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.353+0000 7ff1cb400640 1 -- 172.21.15.12:0/3180408988 reap_dead start 2024-09-05T01:23:25.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.353+0000 7ff1d1c00640 1 -- 172.21.15.12:0/3180408988 shutdown_connections 2024-09-05T01:23:25.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.353+0000 7ff1d1c00640 1 -- 172.21.15.12:0/3180408988 >> 172.21.15.12:0/3180408988 conn(0x7ff1cc0ffa90 msgr2=0x7ff1cc100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:25.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.353+0000 7ff1d1c00640 1 -- 172.21.15.12:0/3180408988 shutdown_connections 2024-09-05T01:23:25.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:25.353+0000 7ff1d1c00640 1 -- 172.21.15.12:0/3180408988 wait complete. 2024-09-05T01:23:25.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:25 smithi012 ceph-mon[29942]: pgmap v314: 97 pgs: 2 peering, 95 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 5 op/s; 146 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T01:23:25.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:25 smithi145 ceph-mon[34376]: pgmap v314: 97 pgs: 2 peering, 95 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 5 op/s; 146 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T01:23:25.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:25 smithi151 ceph-mon[35013]: pgmap v314: 97 pgs: 2 peering, 95 active+clean; 644 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 5 op/s; 146 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T01:23:25.748 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:25.748 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:25.786 INFO:teuthology.orchestra.run.smithi012.stdout:55834574923 2024-09-05T01:23:25.786 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-05T01:23:26.108 INFO:teuthology.orchestra.run.smithi012.stdout:210453397549 2024-09-05T01:23:26.108 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-05T01:23:27.080 INFO:teuthology.orchestra.run.smithi012.stdout:158913790007 2024-09-05T01:23:27.080 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-05T01:23:27.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:27 smithi012 ceph-mon[29942]: pgmap v315: 97 pgs: 2 peering, 95 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4 op/s; 146 B/s, 2 keys/s, 1 objects/s recovering 2024-09-05T01:23:27.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:27 smithi145 ceph-mon[34376]: pgmap v315: 97 pgs: 2 peering, 95 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4 op/s; 146 B/s, 2 keys/s, 1 objects/s recovering 2024-09-05T01:23:27.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:27 smithi151 ceph-mon[35013]: pgmap v315: 97 pgs: 2 peering, 95 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4 op/s; 146 B/s, 2 keys/s, 1 objects/s recovering 2024-09-05T01:23:27.686 INFO:teuthology.orchestra.run.smithi012.stdout:137438953532 2024-09-05T01:23:27.687 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-05T01:23:27.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.872+0000 7fa2b5c00640 1 -- 172.21.15.12:0/1475050848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2b01079d0 msgr2=0x7fa2b0107db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:27.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.872+0000 7fa2b5c00640 1 --2- 172.21.15.12:0/1475050848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2b01079d0 0x7fa2b0107db0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0009930 tx=0x7fa2a002a420 comp rx=0 tx=0).stop 2024-09-05T01:23:27.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.873+0000 7fa2b5c00640 1 -- 172.21.15.12:0/1475050848 shutdown_connections 2024-09-05T01:23:27.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.873+0000 7fa2b5c00640 1 --2- 172.21.15.12:0/1475050848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2b0102370 0x7fa2b010e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:27.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.873+0000 7fa2b5c00640 1 --2- 172.21.15.12:0/1475050848 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2b01019d0 0x7fa2b0101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:27.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.873+0000 7fa2b5c00640 1 --2- 172.21.15.12:0/1475050848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2b01079d0 0x7fa2b0107db0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:27.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.873+0000 7fa2b5c00640 1 -- 172.21.15.12:0/1475050848 >> 172.21.15.12:0/1475050848 conn(0x7fa2b00fd710 msgr2=0x7fa2b00ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:27.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.873+0000 7fa2b5c00640 1 -- 172.21.15.12:0/1475050848 shutdown_connections 2024-09-05T01:23:27.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.873+0000 7fa2b5c00640 1 -- 172.21.15.12:0/1475050848 wait complete. 2024-09-05T01:23:27.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.874+0000 7fa2b5c00640 1 Processor -- start 2024-09-05T01:23:27.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.874+0000 7fa2b5c00640 1 -- start start 2024-09-05T01:23:27.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.874+0000 7fa2b5c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2b01019d0 0x7fa2b00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:27.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.874+0000 7fa2b5c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2b0102370 0x7fa2b0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:27.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.874+0000 7fa2b5c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2b01079d0 0x7fa2b0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:27.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.874+0000 7fa2b5c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b0111de0 con 0x7fa2b01019d0 2024-09-05T01:23:27.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.874+0000 7fa2b5c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b0111c60 con 0x7fa2b0102370 2024-09-05T01:23:27.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.874+0000 7fa2b5c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b0111f60 con 0x7fa2b01079d0 2024-09-05T01:23:27.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.875+0000 7fa2afe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2b01019d0 0x7fa2b00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:27.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.875+0000 7fa2afe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2b01019d0 0x7fa2b00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52928/0 (socket says 172.21.15.12:52928) 2024-09-05T01:23:27.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.875+0000 7fa2afe00640 1 -- 172.21.15.12:0/1505480027 learned_addr learned my addr 172.21.15.12:0/1505480027 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:27.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.875+0000 7fa2b5200640 1 --2- 172.21.15.12:0/1505480027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2b01079d0 0x7fa2b0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:27.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.875+0000 7fa2a7e00640 1 --2- 172.21.15.12:0/1505480027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2b0102370 0x7fa2b0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:27.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.875+0000 7fa2afe00640 1 -- 172.21.15.12:0/1505480027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2b01079d0 msgr2=0x7fa2b0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:27.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.875+0000 7fa2afe00640 1 --2- 172.21.15.12:0/1505480027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2b01079d0 0x7fa2b0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:27.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.875+0000 7fa2afe00640 1 -- 172.21.15.12:0/1505480027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2b0102370 msgr2=0x7fa2b0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:27.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.875+0000 7fa2afe00640 1 --2- 172.21.15.12:0/1505480027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2b0102370 0x7fa2b0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:27.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.875+0000 7fa2afe00640 1 -- 172.21.15.12:0/1505480027 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b01a67b0 con 0x7fa2b01019d0 2024-09-05T01:23:27.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.875+0000 7fa2a7e00640 1 --2- 172.21.15.12:0/1505480027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2b0102370 0x7fa2b0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:23:27.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.876+0000 7fa2afe00640 1 --2- 172.21.15.12:0/1505480027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2b01019d0 0x7fa2b00744f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa2a002a940 tx=0x7fa2a0003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:27.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.876+0000 7fa2ad600640 1 -- 172.21.15.12:0/1505480027 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a003f070 con 0x7fa2b01019d0 2024-09-05T01:23:27.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.876+0000 7fa2b5c00640 1 -- 172.21.15.12:0/1505480027 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2b01a6a40 con 0x7fa2b01019d0 2024-09-05T01:23:27.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.876+0000 7fa2ad600640 1 -- 172.21.15.12:0/1505480027 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2a0031c90 con 0x7fa2b01019d0 2024-09-05T01:23:27.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.876+0000 7fa2ad600640 1 -- 172.21.15.12:0/1505480027 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0035030 con 0x7fa2b01019d0 2024-09-05T01:23:27.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.876+0000 7fa2b5c00640 1 -- 172.21.15.12:0/1505480027 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2b01a6f70 con 0x7fa2b01019d0 2024-09-05T01:23:27.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.877+0000 7fa2b5c00640 1 -- 172.21.15.12:0/1505480027 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa2b0062900 con 0x7fa2b01019d0 2024-09-05T01:23:27.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.879+0000 7fa2ad600640 1 -- 172.21.15.12:0/1505480027 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa2a0042070 con 0x7fa2b01019d0 2024-09-05T01:23:27.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.880+0000 7fa2ad600640 1 --2- 172.21.15.12:0/1505480027 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa2940a2c90 0x7fa2940a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:27.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.881+0000 7fa2ad600640 1 -- 172.21.15.12:0/1505480027 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7fa2a00ef990 con 0x7fa2b01019d0 2024-09-05T01:23:27.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.881+0000 7fa2a7e00640 1 --2- 172.21.15.12:0/1505480027 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa2940a2c90 0x7fa2940a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:27.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.881+0000 7fa2ad600640 1 --2- 172.21.15.12:0/1505480027 >> [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269] conn(0x7fa2940ac8c0 0x7fa2940aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:27.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.881+0000 7fa2ad600640 1 -- 172.21.15.12:0/1505480027 --> [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2a0001d30 con 0x7fa2940ac8c0 2024-09-05T01:23:27.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.881+0000 7fa2ad600640 1 -- 172.21.15.12:0/1505480027 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fa2a00efd40 con 0x7fa2b01019d0 2024-09-05T01:23:27.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.881+0000 7fa2b5200640 1 --2- 172.21.15.12:0/1505480027 >> [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269] conn(0x7fa2940ac8c0 0x7fa2940aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:27.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.882+0000 7fa2a7e00640 1 --2- 172.21.15.12:0/1505480027 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa2940a2c90 0x7fa2940a5150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00ffb50 tx=0x7fa298005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:27.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.882+0000 7fa2b5200640 1 --2- 172.21.15.12:0/1505480027 >> [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269] conn(0x7fa2940ac8c0 0x7fa2940aed60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:27.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.883+0000 7fa2ad600640 1 -- 172.21.15.12:0/1505480027 <== osd.6 v2:172.21.15.12:6818/3084810269 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa2a0001d30 con 0x7fa2940ac8c0 2024-09-05T01:23:27.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.900+0000 7fa2b5c00640 1 -- 172.21.15.12:0/1505480027 --> [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa2b0062d00 con 0x7fa2940ac8c0 2024-09-05T01:23:27.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.900+0000 7fa2ad600640 1 -- 172.21.15.12:0/1505480027 <== osd.6 v2:172.21.15.12:6818/3084810269 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa2b0062d00 con 0x7fa2940ac8c0 2024-09-05T01:23:27.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.900+0000 7fa2b5c00640 1 -- 172.21.15.12:0/1505480027 >> [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269] conn(0x7fa2940ac8c0 msgr2=0x7fa2940aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:27.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.900+0000 7fa2b5c00640 1 --2- 172.21.15.12:0/1505480027 >> [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269] conn(0x7fa2940ac8c0 0x7fa2940aed60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:27.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.901+0000 7fa2b5c00640 1 -- 172.21.15.12:0/1505480027 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa2940a2c90 msgr2=0x7fa2940a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:27.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.901+0000 7fa2b5c00640 1 --2- 172.21.15.12:0/1505480027 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa2940a2c90 0x7fa2940a5150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa2b00ffb50 tx=0x7fa298005e50 comp rx=0 tx=0).stop 2024-09-05T01:23:27.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.901+0000 7fa2b5c00640 1 -- 172.21.15.12:0/1505480027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2b01019d0 msgr2=0x7fa2b00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:27.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.901+0000 7fa2b5c00640 1 --2- 172.21.15.12:0/1505480027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2b01019d0 0x7fa2b00744f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa2a002a940 tx=0x7fa2a0003b90 comp rx=0 tx=0).stop 2024-09-05T01:23:27.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.901+0000 7fa2b5200640 1 -- 172.21.15.12:0/1505480027 reap_dead start 2024-09-05T01:23:27.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.901+0000 7fa2b5c00640 1 -- 172.21.15.12:0/1505480027 shutdown_connections 2024-09-05T01:23:27.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.901+0000 7fa2b5c00640 1 -- 172.21.15.12:0/1505480027 >> 172.21.15.12:0/1505480027 conn(0x7fa2b00fd710 msgr2=0x7fa2b00fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:27.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.901+0000 7fa2b5c00640 1 -- 172.21.15.12:0/1505480027 shutdown_connections 2024-09-05T01:23:27.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:27.901+0000 7fa2b5c00640 1 -- 172.21.15.12:0/1505480027 wait complete. 2024-09-05T01:23:28.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.235+0000 7f711ce00640 1 -- 172.21.15.12:0/4183729905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7118102360 msgr2=0x7f711810e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:28.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.235+0000 7f711ce00640 1 --2- 172.21.15.12:0/4183729905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7118102360 0x7f711810e890 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7110009cd0 tx=0x7f711002a8f0 comp rx=0 tx=0).stop 2024-09-05T01:23:28.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.235+0000 7f711ce00640 1 -- 172.21.15.12:0/4183729905 shutdown_connections 2024-09-05T01:23:28.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.235+0000 7f711ce00640 1 --2- 172.21.15.12:0/4183729905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7118102360 0x7f711810e890 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:28.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.235+0000 7f711ce00640 1 --2- 172.21.15.12:0/4183729905 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71181019c0 0x7f7118101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:28.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.235+0000 7f711ce00640 1 --2- 172.21.15.12:0/4183729905 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71181079c0 0x7f7118107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:28.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.235+0000 7f711ce00640 1 -- 172.21.15.12:0/4183729905 >> 172.21.15.12:0/4183729905 conn(0x7f71180fd740 msgr2=0x7f71180ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:28.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.235+0000 7f711ce00640 1 -- 172.21.15.12:0/4183729905 shutdown_connections 2024-09-05T01:23:28.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.235+0000 7f711ce00640 1 -- 172.21.15.12:0/4183729905 wait complete. 2024-09-05T01:23:28.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.236+0000 7f711ce00640 1 Processor -- start 2024-09-05T01:23:28.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.236+0000 7f711ce00640 1 -- start start 2024-09-05T01:23:28.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.237+0000 7f711ce00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71181019c0 0x7f711819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:28.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.237+0000 7f711ce00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7118102360 0x7f711819a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:28.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.237+0000 7f711ce00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71181079c0 0x7f711819ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:28.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.237+0000 7f711ce00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7118111e10 con 0x7f7118102360 2024-09-05T01:23:28.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.237+0000 7f711ce00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7118111c90 con 0x7f71181079c0 2024-09-05T01:23:28.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.237+0000 7f711ce00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7118111f90 con 0x7f71181019c0 2024-09-05T01:23:28.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.237+0000 7f7116a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7118102360 0x7f711819a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:28.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.237+0000 7f7117400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71181019c0 0x7f711819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:28.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.237+0000 7f7117400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71181019c0 0x7f711819a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:59862/0 (socket says 172.21.15.12:59862) 2024-09-05T01:23:28.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.237+0000 7f7117400640 1 -- 172.21.15.12:0/3291796542 learned_addr learned my addr 172.21.15.12:0/3291796542 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:28.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.237+0000 7f7117e00640 1 --2- 172.21.15.12:0/3291796542 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71181079c0 0x7f711819ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:28.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.238+0000 7f7117400640 1 -- 172.21.15.12:0/3291796542 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71181079c0 msgr2=0x7f711819ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:28.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.238+0000 7f7117400640 1 --2- 172.21.15.12:0/3291796542 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71181079c0 0x7f711819ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:28.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.238+0000 7f7117400640 1 -- 172.21.15.12:0/3291796542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7118102360 msgr2=0x7f711819a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:28.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.238+0000 7f7117400640 1 --2- 172.21.15.12:0/3291796542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7118102360 0x7f711819a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:28.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.238+0000 7f7117400640 1 -- 172.21.15.12:0/3291796542 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f711819f430 con 0x7f71181019c0 2024-09-05T01:23:28.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.238+0000 7f7116a00640 1 --2- 172.21.15.12:0/3291796542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7118102360 0x7f711819a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:23:28.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.238+0000 7f7117400640 1 --2- 172.21.15.12:0/3291796542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71181019c0 0x7f711819a480 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f710800e9f0 tx=0x7f710800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:28.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.238+0000 7f710fe00640 1 -- 172.21.15.12:0/3291796542 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f710800cd80 con 0x7f71181019c0 2024-09-05T01:23:28.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.238+0000 7f710fe00640 1 -- 172.21.15.12:0/3291796542 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7108005500 con 0x7f71181019c0 2024-09-05T01:23:28.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.238+0000 7f710fe00640 1 -- 172.21.15.12:0/3291796542 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7108010690 con 0x7f71181019c0 2024-09-05T01:23:28.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.238+0000 7f711ce00640 1 -- 172.21.15.12:0/3291796542 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f711819f720 con 0x7f71181019c0 2024-09-05T01:23:28.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.239+0000 7f711ce00640 1 -- 172.21.15.12:0/3291796542 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71181a7000 con 0x7f71181019c0 2024-09-05T01:23:28.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.240+0000 7f711ce00640 1 -- 172.21.15.12:0/3291796542 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7118101e20 con 0x7f71181019c0 2024-09-05T01:23:28.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.241+0000 7f710fe00640 1 -- 172.21.15.12:0/3291796542 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f71080046c0 con 0x7f71181019c0 2024-09-05T01:23:28.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.243+0000 7f710fe00640 1 --2- 172.21.15.12:0/3291796542 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f70fc0a2c90 0x7f70fc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:28.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.243+0000 7f710fe00640 1 -- 172.21.15.12:0/3291796542 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f71080cf580 con 0x7f71181019c0 2024-09-05T01:23:28.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.243+0000 7f7116a00640 1 --2- 172.21.15.12:0/3291796542 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f70fc0a2c90 0x7f70fc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:28.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.244+0000 7f7116a00640 1 --2- 172.21.15.12:0/3291796542 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f70fc0a2c90 0x7f70fc0a5150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f71040095f0 tx=0x7f7104005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:28.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.245+0000 7f710fe00640 1 -- 172.21.15.12:0/3291796542 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f710809c310 con 0x7f71181019c0 2024-09-05T01:23:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.433+0000 7f711ce00640 1 -- 172.21.15.12:0/3291796542 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f711819b7e0 con 0x7f71181019c0 2024-09-05T01:23:28.435 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:28 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:23:28.435 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:28 smithi012 ceph-mon[29942]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 3 op/s; 146 B/s, 2 keys/s, 1 objects/s recovering 2024-09-05T01:23:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.434+0000 7f710fe00640 1 -- 172.21.15.12:0/3291796542 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f710809bc10 con 0x7f71181019c0 2024-09-05T01:23:28.436 INFO:teuthology.orchestra.run.smithi012.stdout:292057776157 2024-09-05T01:23:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.437+0000 7f711ce00640 1 -- 172.21.15.12:0/3291796542 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f70fc0a2c90 msgr2=0x7f70fc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.437+0000 7f711ce00640 1 --2- 172.21.15.12:0/3291796542 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f70fc0a2c90 0x7f70fc0a5150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f71040095f0 tx=0x7f7104005f90 comp rx=0 tx=0).stop 2024-09-05T01:23:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.437+0000 7f711ce00640 1 -- 172.21.15.12:0/3291796542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71181019c0 msgr2=0x7f711819a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.437+0000 7f711ce00640 1 --2- 172.21.15.12:0/3291796542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71181019c0 0x7f711819a480 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f710800e9f0 tx=0x7f710800edf0 comp rx=0 tx=0).stop 2024-09-05T01:23:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.437+0000 7f711ce00640 1 -- 172.21.15.12:0/3291796542 shutdown_connections 2024-09-05T01:23:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.437+0000 7f711ce00640 1 --2- 172.21.15.12:0/3291796542 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f70fc0a2c90 0x7f70fc0a5150 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.437+0000 7f711ce00640 1 --2- 172.21.15.12:0/3291796542 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71181079c0 0x7f711819ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.437+0000 7f711ce00640 1 --2- 172.21.15.12:0/3291796542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7118102360 0x7f711819a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.437+0000 7f711ce00640 1 --2- 172.21.15.12:0/3291796542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71181019c0 0x7f711819a480 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.437+0000 7f711ce00640 1 -- 172.21.15.12:0/3291796542 >> 172.21.15.12:0/3291796542 conn(0x7f71180fd740 msgr2=0x7f71180fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.437+0000 7f711ce00640 1 -- 172.21.15.12:0/3291796542 shutdown_connections 2024-09-05T01:23:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:28.437+0000 7f711ce00640 1 -- 172.21.15.12:0/3291796542 wait complete. 2024-09-05T01:23:28.582 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:28 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:23:28.583 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:28 smithi151 ceph-mon[35013]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 3 op/s; 146 B/s, 2 keys/s, 1 objects/s recovering 2024-09-05T01:23:28.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:28 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:23:28.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:28 smithi145 ceph-mon[34376]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 3 op/s; 146 B/s, 2 keys/s, 1 objects/s recovering 2024-09-05T01:23:29.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.130+0000 7f5674e00640 1 -- 172.21.15.12:0/3106076321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5670102b90 msgr2=0x7f5670102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:29.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.130+0000 7f5674e00640 1 --2- 172.21.15.12:0/3106076321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5670102b90 0x7f5670102f70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5660009900 tx=0x7f566002a480 comp rx=0 tx=0).stop 2024-09-05T01:23:29.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.130+0000 7f5674e00640 1 -- 172.21.15.12:0/3106076321 shutdown_connections 2024-09-05T01:23:29.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.130+0000 7f5674e00640 1 --2- 172.21.15.12:0/3106076321 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f567010bfc0 0x7f567010e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:29.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.130+0000 7f5674e00640 1 --2- 172.21.15.12:0/3106076321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56701034b0 0x7f567010b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:29.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.130+0000 7f5674e00640 1 --2- 172.21.15.12:0/3106076321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5670102b90 0x7f5670102f70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:29.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.130+0000 7f5674e00640 1 -- 172.21.15.12:0/3106076321 >> 172.21.15.12:0/3106076321 conn(0x7f56700fc610 msgr2=0x7f56700fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:29.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.130+0000 7f5674e00640 1 -- 172.21.15.12:0/3106076321 shutdown_connections 2024-09-05T01:23:29.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.130+0000 7f5674e00640 1 -- 172.21.15.12:0/3106076321 wait complete. 2024-09-05T01:23:29.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.132+0000 7f5674e00640 1 Processor -- start 2024-09-05T01:23:29.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.132+0000 7f5674e00640 1 -- start start 2024-09-05T01:23:29.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.132+0000 7f5674e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5670102b90 0x7f56701982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:29.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.132+0000 7f5674e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56701034b0 0x7f5670198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:29.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.132+0000 7f5674e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f567010bfc0 0x7f567019cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:29.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.132+0000 7f5674e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5670111dc0 con 0x7f56701034b0 2024-09-05T01:23:29.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.132+0000 7f5674e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5670111c40 con 0x7f5670102b90 2024-09-05T01:23:29.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.132+0000 7f5674e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5670111f40 con 0x7f567010bfc0 2024-09-05T01:23:29.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.133+0000 7f566f400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5670102b90 0x7f56701982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:29.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.133+0000 7f566f400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5670102b90 0x7f56701982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:47054/0 (socket says 172.21.15.12:47054) 2024-09-05T01:23:29.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.133+0000 7f566f400640 1 -- 172.21.15.12:0/3726990580 learned_addr learned my addr 172.21.15.12:0/3726990580 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:29.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.133+0000 7f566fe00640 1 --2- 172.21.15.12:0/3726990580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f567010bfc0 0x7f567019cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:29.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.133+0000 7f566ea00640 1 --2- 172.21.15.12:0/3726990580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56701034b0 0x7f5670198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:29.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.133+0000 7f566f400640 1 -- 172.21.15.12:0/3726990580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f567010bfc0 msgr2=0x7f567019cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:29.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.133+0000 7f566f400640 1 --2- 172.21.15.12:0/3726990580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f567010bfc0 0x7f567019cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:29.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.133+0000 7f566f400640 1 -- 172.21.15.12:0/3726990580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56701034b0 msgr2=0x7f5670198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:29.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.133+0000 7f566f400640 1 --2- 172.21.15.12:0/3726990580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56701034b0 0x7f5670198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:29.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.133+0000 7f566f400640 1 -- 172.21.15.12:0/3726990580 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f567019d270 con 0x7f5670102b90 2024-09-05T01:23:29.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.133+0000 7f566ea00640 1 --2- 172.21.15.12:0/3726990580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56701034b0 0x7f5670198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:23:29.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.134+0000 7f566f400640 1 --2- 172.21.15.12:0/3726990580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5670102b90 0x7f56701982c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5660006010 tx=0x7f5660004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:29.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.134+0000 7f5667e00640 1 -- 172.21.15.12:0/3726990580 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566003f030 con 0x7f5670102b90 2024-09-05T01:23:29.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.134+0000 7f5667e00640 1 -- 172.21.15.12:0/3726990580 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5660004440 con 0x7f5670102b90 2024-09-05T01:23:29.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.134+0000 7f5667e00640 1 -- 172.21.15.12:0/3726990580 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5660035070 con 0x7f5670102b90 2024-09-05T01:23:29.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.134+0000 7f5674e00640 1 -- 172.21.15.12:0/3726990580 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f567019d500 con 0x7f5670102b90 2024-09-05T01:23:29.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.135+0000 7f5674e00640 1 -- 172.21.15.12:0/3726990580 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f567019d990 con 0x7f5670102b90 2024-09-05T01:23:29.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.138+0000 7f5665600640 1 -- 172.21.15.12:0/3726990580 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5648001030 con 0x7f5670102b90 2024-09-05T01:23:29.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.140+0000 7f5667e00640 1 -- 172.21.15.12:0/3726990580 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5660042030 con 0x7f5670102b90 2024-09-05T01:23:29.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.141+0000 7f5667e00640 1 --2- 172.21.15.12:0/3726990580 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f56540a2c90 0x7f56540a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:29.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.142+0000 7f5667e00640 1 -- 172.21.15.12:0/3726990580 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f56600ef500 con 0x7f5670102b90 2024-09-05T01:23:29.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.142+0000 7f566ea00640 1 --2- 172.21.15.12:0/3726990580 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f56540a2c90 0x7f56540a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:29.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.142+0000 7f5667e00640 1 --2- 172.21.15.12:0/3726990580 >> [v2:172.21.15.151:6800/3753171761,v1:172.21.15.151:6801/3753171761] conn(0x7f56540ac8c0 0x7f56540aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:29.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.142+0000 7f5667e00640 1 -- 172.21.15.12:0/3726990580 --> [v2:172.21.15.151:6800/3753171761,v1:172.21.15.151:6801/3753171761] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f56540af430 con 0x7f56540ac8c0 2024-09-05T01:23:29.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.142+0000 7f5667e00640 1 -- 172.21.15.12:0/3726990580 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f56600f6050 con 0x7f5670102b90 2024-09-05T01:23:29.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.142+0000 7f566fe00640 1 --2- 172.21.15.12:0/3726990580 >> [v2:172.21.15.151:6800/3753171761,v1:172.21.15.151:6801/3753171761] conn(0x7f56540ac8c0 0x7f56540aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:29.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.143+0000 7f566ea00640 1 --2- 172.21.15.12:0/3726990580 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f56540a2c90 0x7f56540a5150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f56700fec10 tx=0x7f565c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:29.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.143+0000 7f566fe00640 1 --2- 172.21.15.12:0/3726990580 >> [v2:172.21.15.151:6800/3753171761,v1:172.21.15.151:6801/3753171761] conn(0x7f56540ac8c0 0x7f56540aed60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:29.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.144+0000 7f5667e00640 1 -- 172.21.15.12:0/3726990580 <== osd.2 v2:172.21.15.151:6800/3753171761 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f56540af430 con 0x7f56540ac8c0 2024-09-05T01:23:29.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.158+0000 7f5665600640 1 -- 172.21.15.12:0/3726990580 --> [v2:172.21.15.151:6800/3753171761,v1:172.21.15.151:6801/3753171761] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5648002dd0 con 0x7f56540ac8c0 2024-09-05T01:23:29.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.159+0000 7f5667e00640 1 -- 172.21.15.12:0/3726990580 <== osd.2 v2:172.21.15.151:6800/3753171761 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5648002dd0 con 0x7f56540ac8c0 2024-09-05T01:23:29.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.159+0000 7f5665600640 1 -- 172.21.15.12:0/3726990580 >> [v2:172.21.15.151:6800/3753171761,v1:172.21.15.151:6801/3753171761] conn(0x7f56540ac8c0 msgr2=0x7f56540aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:29.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.159+0000 7f5665600640 1 --2- 172.21.15.12:0/3726990580 >> [v2:172.21.15.151:6800/3753171761,v1:172.21.15.151:6801/3753171761] conn(0x7f56540ac8c0 0x7f56540aed60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:29.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.160+0000 7f5665600640 1 -- 172.21.15.12:0/3726990580 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f56540a2c90 msgr2=0x7f56540a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:29.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.160+0000 7f5665600640 1 --2- 172.21.15.12:0/3726990580 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f56540a2c90 0x7f56540a5150 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f56700fec10 tx=0x7f565c005f90 comp rx=0 tx=0).stop 2024-09-05T01:23:29.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.160+0000 7f5665600640 1 -- 172.21.15.12:0/3726990580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5670102b90 msgr2=0x7f56701982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:29.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.160+0000 7f5665600640 1 --2- 172.21.15.12:0/3726990580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5670102b90 0x7f56701982c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5660006010 tx=0x7f5660004040 comp rx=0 tx=0).stop 2024-09-05T01:23:29.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.160+0000 7f566fe00640 1 -- 172.21.15.12:0/3726990580 reap_dead start 2024-09-05T01:23:29.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.160+0000 7f5665600640 1 -- 172.21.15.12:0/3726990580 shutdown_connections 2024-09-05T01:23:29.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.160+0000 7f5665600640 1 -- 172.21.15.12:0/3726990580 >> 172.21.15.12:0/3726990580 conn(0x7f56700fc610 msgr2=0x7f56700fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:29.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.160+0000 7f5665600640 1 -- 172.21.15.12:0/3726990580 shutdown_connections 2024-09-05T01:23:29.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:29.160+0000 7f5665600640 1 -- 172.21.15.12:0/3726990580 wait complete. 2024-09-05T01:23:29.443 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:29 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3291796542' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-05T01:23:29.485 INFO:teuthology.orchestra.run.smithi012.stdout:188978561075 2024-09-05T01:23:29.486 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-05T01:23:29.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:29 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3291796542' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-05T01:23:29.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:29 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3291796542' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-05T01:23:29.794 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776155 got 292057776157 for osd.10 2024-09-05T01:23:29.794 DEBUG:teuthology.parallel:result is None 2024-09-05T01:23:30.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:30 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:23:30.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:30 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:23:30.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:30 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:23:30.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:30 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:23:30.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:30 smithi012 ceph-mon[29942]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 5 op/s; 146 B/s, 2 keys/s, 1 objects/s recovering 2024-09-05T01:23:30.582 INFO:teuthology.orchestra.run.smithi012.stdout:77309411400 2024-09-05T01:23:30.583 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-05T01:23:30.643 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:30.649 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:30.655 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:30.663 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:30.663 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:30.666 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:30.674 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:30.801 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:30.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:30 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:23:30.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:30 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:23:30.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:30 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:23:30.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:30 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:23:30.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:30 smithi145 ceph-mon[34376]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 5 op/s; 146 B/s, 2 keys/s, 1 objects/s recovering 2024-09-05T01:23:30.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:30 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:23:30.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:30 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:23:30.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:30 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:23:30.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:30 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:23:30.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:30 smithi151 ceph-mon[35013]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 5 op/s; 146 B/s, 2 keys/s, 1 objects/s recovering 2024-09-05T01:23:31.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.569+0000 7fd8c9a00640 1 -- 172.21.15.12:0/2255554203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8c40745c0 msgr2=0x7fd8c40749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:31.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.569+0000 7fd8c9a00640 1 --2- 172.21.15.12:0/2255554203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8c40745c0 0x7fd8c40749a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4009900 tx=0x7fd8b402a480 comp rx=0 tx=0).stop 2024-09-05T01:23:31.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.569+0000 7fd8c9a00640 1 -- 172.21.15.12:0/2255554203 shutdown_connections 2024-09-05T01:23:31.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.569+0000 7fd8c9a00640 1 --2- 172.21.15.12:0/2255554203 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8c410e430 0x7fd8c4110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:31.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.569+0000 7fd8c9a00640 1 --2- 172.21.15.12:0/2255554203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8c4074ee0 0x7fd8c410def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:31.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.569+0000 7fd8c9a00640 1 --2- 172.21.15.12:0/2255554203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8c40745c0 0x7fd8c40749a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:31.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.569+0000 7fd8c9a00640 1 -- 172.21.15.12:0/2255554203 >> 172.21.15.12:0/2255554203 conn(0x7fd8c40fd8b0 msgr2=0x7fd8c40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:31.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.569+0000 7fd8c9a00640 1 -- 172.21.15.12:0/2255554203 shutdown_connections 2024-09-05T01:23:31.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.570+0000 7fd8c9a00640 1 -- 172.21.15.12:0/2255554203 wait complete. 2024-09-05T01:23:31.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.570+0000 7fd8c9a00640 1 Processor -- start 2024-09-05T01:23:31.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.571+0000 7fd8c9a00640 1 -- start start 2024-09-05T01:23:31.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.571+0000 7fd8c9a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8c40745c0 0x7fd8c419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:31.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.571+0000 7fd8c9a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8c4074ee0 0x7fd8c419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:31.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.571+0000 7fd8c9a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8c410e430 0x7fd8c419ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:31.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.571+0000 7fd8c9a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c41141d0 con 0x7fd8c40745c0 2024-09-05T01:23:31.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.571+0000 7fd8c9a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c4114050 con 0x7fd8c4074ee0 2024-09-05T01:23:31.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.571+0000 7fd8c9a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c4114350 con 0x7fd8c410e430 2024-09-05T01:23:31.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.571+0000 7fd8c2a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8c40745c0 0x7fd8c419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:31.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.571+0000 7fd8c2a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8c40745c0 0x7fd8c419a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52970/0 (socket says 172.21.15.12:52970) 2024-09-05T01:23:31.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.571+0000 7fd8c2a00640 1 -- 172.21.15.12:0/41576176 learned_addr learned my addr 172.21.15.12:0/41576176 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:31.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.571+0000 7fd8c2000640 1 --2- 172.21.15.12:0/41576176 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8c4074ee0 0x7fd8c419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:31.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.572+0000 7fd8c3400640 1 --2- 172.21.15.12:0/41576176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8c410e430 0x7fd8c419ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:31.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.572+0000 7fd8c2a00640 1 -- 172.21.15.12:0/41576176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8c410e430 msgr2=0x7fd8c419ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:31.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.572+0000 7fd8c2a00640 1 --2- 172.21.15.12:0/41576176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8c410e430 0x7fd8c419ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:31.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.572+0000 7fd8c2a00640 1 -- 172.21.15.12:0/41576176 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8c4074ee0 msgr2=0x7fd8c419abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:31.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.572+0000 7fd8c2a00640 1 --2- 172.21.15.12:0/41576176 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8c4074ee0 0x7fd8c419abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:31.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.572+0000 7fd8c2a00640 1 -- 172.21.15.12:0/41576176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c419f620 con 0x7fd8c40745c0 2024-09-05T01:23:31.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.572+0000 7fd8c3400640 1 --2- 172.21.15.12:0/41576176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8c410e430 0x7fd8c419ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:23:31.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.572+0000 7fd8c2a00640 1 --2- 172.21.15.12:0/41576176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8c40745c0 0x7fd8c419a670 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4004770 tx=0x7fd8b4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:31.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.572+0000 7fd8bb400640 1 -- 172.21.15.12:0/41576176 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b403f070 con 0x7fd8c40745c0 2024-09-05T01:23:31.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.572+0000 7fd8bb400640 1 -- 172.21.15.12:0/41576176 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8b4031ca0 con 0x7fd8c40745c0 2024-09-05T01:23:31.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.572+0000 7fd8bb400640 1 -- 172.21.15.12:0/41576176 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4035030 con 0x7fd8c40745c0 2024-09-05T01:23:31.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.572+0000 7fd8c9a00640 1 -- 172.21.15.12:0/41576176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8c419f8b0 con 0x7fd8c40745c0 2024-09-05T01:23:31.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.573+0000 7fd8c9a00640 1 -- 172.21.15.12:0/41576176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8c41a71f0 con 0x7fd8c40745c0 2024-09-05T01:23:31.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.574+0000 7fd8c9a00640 1 -- 172.21.15.12:0/41576176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8c40749a0 con 0x7fd8c40745c0 2024-09-05T01:23:31.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.576+0000 7fd8bb400640 1 -- 172.21.15.12:0/41576176 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd8b4042070 con 0x7fd8c40745c0 2024-09-05T01:23:31.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.577+0000 7fd8bb400640 1 --2- 172.21.15.12:0/41576176 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd8a80a2c10 0x7fd8a80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:31.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.577+0000 7fd8bb400640 1 -- 172.21.15.12:0/41576176 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7fd8b40efa80 con 0x7fd8c40745c0 2024-09-05T01:23:31.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.577+0000 7fd8c2000640 1 --2- 172.21.15.12:0/41576176 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd8a80a2c10 0x7fd8a80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:31.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.578+0000 7fd8c2000640 1 --2- 172.21.15.12:0/41576176 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd8a80a2c10 0x7fd8a80a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd8c410f750 tx=0x7fd8b000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:31.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.581+0000 7fd8bb400640 1 -- 172.21.15.12:0/41576176 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd8b40f1e20 con 0x7fd8c40745c0 2024-09-05T01:23:31.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.776+0000 7fd8c9a00640 1 -- 172.21.15.12:0/41576176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fd8c41095b0 con 0x7fd8c40745c0 2024-09-05T01:23:31.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.776+0000 7fd8bb400640 1 -- 172.21.15.12:0/41576176 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd8b40bc810 con 0x7fd8c40745c0 2024-09-05T01:23:31.778 INFO:teuthology.orchestra.run.smithi012.stdout:137438953534 2024-09-05T01:23:31.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.779+0000 7fd8c9a00640 1 -- 172.21.15.12:0/41576176 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd8a80a2c10 msgr2=0x7fd8a80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:31.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.779+0000 7fd8c9a00640 1 --2- 172.21.15.12:0/41576176 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd8a80a2c10 0x7fd8a80a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd8c410f750 tx=0x7fd8b000b410 comp rx=0 tx=0).stop 2024-09-05T01:23:31.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.779+0000 7fd8c9a00640 1 -- 172.21.15.12:0/41576176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8c40745c0 msgr2=0x7fd8c419a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:31.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.779+0000 7fd8c9a00640 1 --2- 172.21.15.12:0/41576176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8c40745c0 0x7fd8c419a670 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4004770 tx=0x7fd8b4003c10 comp rx=0 tx=0).stop 2024-09-05T01:23:31.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.779+0000 7fd8c9a00640 1 -- 172.21.15.12:0/41576176 shutdown_connections 2024-09-05T01:23:31.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.779+0000 7fd8c9a00640 1 --2- 172.21.15.12:0/41576176 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd8a80a2c10 0x7fd8a80a50d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:31.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.779+0000 7fd8c9a00640 1 --2- 172.21.15.12:0/41576176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8c410e430 0x7fd8c419ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:31.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.779+0000 7fd8c9a00640 1 --2- 172.21.15.12:0/41576176 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd8c4074ee0 0x7fd8c419abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:31.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.779+0000 7fd8c9a00640 1 --2- 172.21.15.12:0/41576176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8c40745c0 0x7fd8c419a670 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:31.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.779+0000 7fd8c9a00640 1 -- 172.21.15.12:0/41576176 >> 172.21.15.12:0/41576176 conn(0x7fd8c40fd8b0 msgr2=0x7fd8c40fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:31.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.779+0000 7fd8c9a00640 1 -- 172.21.15.12:0/41576176 shutdown_connections 2024-09-05T01:23:31.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.779+0000 7fd8c9a00640 1 -- 172.21.15.12:0/41576176 wait complete. 2024-09-05T01:23:32.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:31 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/41576176' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-05T01:23:32.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:31 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/41576176' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-05T01:23:32.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:31 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/41576176' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-05T01:23:32.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.655+0000 7f5b36600640 1 -- 172.21.15.12:0/1045130168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b30109120 msgr2=0x7f5b30110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:32.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.655+0000 7f5b36600640 1 --2- 172.21.15.12:0/1045130168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b30109120 0x7f5b30110ca0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009ca0 tx=0x7f5b2802a8c0 comp rx=0 tx=0).stop 2024-09-05T01:23:32.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.655+0000 7f5b36600640 1 -- 172.21.15.12:0/1045130168 shutdown_connections 2024-09-05T01:23:32.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.655+0000 7f5b36600640 1 --2- 172.21.15.12:0/1045130168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b30109120 0x7f5b30110ca0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:32.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.655+0000 7f5b36600640 1 --2- 172.21.15.12:0/1045130168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b301049a0 0x7f5b301089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:32.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.655+0000 7f5b36600640 1 --2- 172.21.15.12:0/1045130168 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b30103ff0 0x7f5b301043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:32.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.655+0000 7f5b36600640 1 -- 172.21.15.12:0/1045130168 >> 172.21.15.12:0/1045130168 conn(0x7f5b300ffa90 msgr2=0x7f5b30101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:32.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.655+0000 7f5b36600640 1 -- 172.21.15.12:0/1045130168 shutdown_connections 2024-09-05T01:23:32.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.656+0000 7f5b36600640 1 -- 172.21.15.12:0/1045130168 wait complete. 2024-09-05T01:23:32.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.657+0000 7f5b36600640 1 Processor -- start 2024-09-05T01:23:32.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.657+0000 7f5b36600640 1 -- start start 2024-09-05T01:23:32.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.657+0000 7f5b36600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b30103ff0 0x7f5b3019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:32.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.657+0000 7f5b36600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b301049a0 0x7f5b3019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:32.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.657+0000 7f5b36600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b30109120 0x7f5b3019ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:32.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.657+0000 7f5b36600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5b30114180 con 0x7f5b301049a0 2024-09-05T01:23:32.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.657+0000 7f5b36600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5b30114000 con 0x7f5b30103ff0 2024-09-05T01:23:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.657+0000 7f5b36600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5b30114300 con 0x7f5b30109120 2024-09-05T01:23:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.657+0000 7f5b2fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b30109120 0x7f5b3019ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.657+0000 7f5b2ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b301049a0 0x7f5b3019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.657+0000 7f5b2fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b30109120 0x7f5b3019ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:59910/0 (socket says 172.21.15.12:59910) 2024-09-05T01:23:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.657+0000 7f5b2fe00640 1 -- 172.21.15.12:0/3755765718 learned_addr learned my addr 172.21.15.12:0/3755765718 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.658+0000 7f5b2f400640 1 --2- 172.21.15.12:0/3755765718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b30103ff0 0x7f5b3019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.658+0000 7f5b2fe00640 1 -- 172.21.15.12:0/3755765718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b30103ff0 msgr2=0x7f5b3019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.658+0000 7f5b2fe00640 1 --2- 172.21.15.12:0/3755765718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b30103ff0 0x7f5b3019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.658+0000 7f5b2fe00640 1 -- 172.21.15.12:0/3755765718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b301049a0 msgr2=0x7f5b3019ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.658+0000 7f5b2fe00640 1 --2- 172.21.15.12:0/3755765718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b301049a0 0x7f5b3019ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.658+0000 7f5b2fe00640 1 -- 172.21.15.12:0/3755765718 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b3019f570 con 0x7f5b30109120 2024-09-05T01:23:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.658+0000 7f5b2fe00640 1 --2- 172.21.15.12:0/3755765718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b30109120 0x7f5b3019ee90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5b28033040 tx=0x7f5b28003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:32.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.659+0000 7f5b27e00640 1 -- 172.21.15.12:0/3755765718 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b28031650 con 0x7f5b30109120 2024-09-05T01:23:32.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.659+0000 7f5b27e00640 1 -- 172.21.15.12:0/3755765718 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b280317f0 con 0x7f5b30109120 2024-09-05T01:23:32.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.659+0000 7f5b27e00640 1 -- 172.21.15.12:0/3755765718 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b2802fa40 con 0x7f5b30109120 2024-09-05T01:23:32.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.659+0000 7f5b36600640 1 -- 172.21.15.12:0/3755765718 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b3019f800 con 0x7f5b30109120 2024-09-05T01:23:32.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.659+0000 7f5b36600640 1 -- 172.21.15.12:0/3755765718 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b301a7140 con 0x7f5b30109120 2024-09-05T01:23:32.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.660+0000 7f5b36600640 1 -- 172.21.15.12:0/3755765718 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b301043d0 con 0x7f5b30109120 2024-09-05T01:23:32.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.662+0000 7f5b27e00640 1 -- 172.21.15.12:0/3755765718 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5b2802fc80 con 0x7f5b30109120 2024-09-05T01:23:32.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.663+0000 7f5b27e00640 1 --2- 172.21.15.12:0/3755765718 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f5b140a2c90 0x7f5b140a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:32.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.663+0000 7f5b27e00640 1 -- 172.21.15.12:0/3755765718 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f5b280f0520 con 0x7f5b30109120 2024-09-05T01:23:32.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.663+0000 7f5b2f400640 1 --2- 172.21.15.12:0/3755765718 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f5b140a2c90 0x7f5b140a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:32.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.664+0000 7f5b2f400640 1 --2- 172.21.15.12:0/3755765718 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f5b140a2c90 0x7f5b140a5150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5b2000bbe0 tx=0x7f5b2000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:32.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.667+0000 7f5b27e00640 1 -- 172.21.15.12:0/3755765718 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5b280bd3c0 con 0x7f5b30109120 2024-09-05T01:23:32.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.731+0000 7f248ac00640 1 -- 172.21.15.12:0/3351754767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24841049a0 msgr2=0x7f24841089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:32.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.731+0000 7f248ac00640 1 --2- 172.21.15.12:0/3351754767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24841049a0 0x7f24841089f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f246c009900 tx=0x7f246c02a410 comp rx=0 tx=0).stop 2024-09-05T01:23:32.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.732+0000 7f248ac00640 1 -- 172.21.15.12:0/3351754767 shutdown_connections 2024-09-05T01:23:32.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.732+0000 7f248ac00640 1 --2- 172.21.15.12:0/3351754767 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2484109120 0x7f2484110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:32.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.732+0000 7f248ac00640 1 --2- 172.21.15.12:0/3351754767 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24841049a0 0x7f24841089f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:32.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.732+0000 7f248ac00640 1 --2- 172.21.15.12:0/3351754767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2484103ff0 0x7f24841043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:32.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.732+0000 7f248ac00640 1 -- 172.21.15.12:0/3351754767 >> 172.21.15.12:0/3351754767 conn(0x7f24840ffa90 msgr2=0x7f2484101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:32.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.732+0000 7f248ac00640 1 -- 172.21.15.12:0/3351754767 shutdown_connections 2024-09-05T01:23:32.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.732+0000 7f248ac00640 1 -- 172.21.15.12:0/3351754767 wait complete. 2024-09-05T01:23:32.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.733+0000 7f248ac00640 1 Processor -- start 2024-09-05T01:23:32.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.733+0000 7f248ac00640 1 -- start start 2024-09-05T01:23:32.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.733+0000 7f248ac00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2484103ff0 0x7f248419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:32.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.733+0000 7f248ac00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24841049a0 0x7f248419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:32.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.733+0000 7f248ac00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2484109120 0x7f248419ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:32.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.733+0000 7f248ac00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2484114120 con 0x7f24841049a0 2024-09-05T01:23:32.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.733+0000 7f248ac00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2484113fa0 con 0x7f2484103ff0 2024-09-05T01:23:32.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.733+0000 7f248ac00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f24841142a0 con 0x7f2484109120 2024-09-05T01:23:32.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.734+0000 7f247be00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24841049a0 0x7f248419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:32.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.734+0000 7f247be00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24841049a0 0x7f248419abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52994/0 (socket says 172.21.15.12:52994) 2024-09-05T01:23:32.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.734+0000 7f247be00640 1 -- 172.21.15.12:0/213368003 learned_addr learned my addr 172.21.15.12:0/213368003 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:32.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.734+0000 7f2488c00640 1 --2- 172.21.15.12:0/213368003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2484109120 0x7f248419ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:32.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.734+0000 7f2483e00640 1 --2- 172.21.15.12:0/213368003 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2484103ff0 0x7f248419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:32.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.734+0000 7f247be00640 1 -- 172.21.15.12:0/213368003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2484109120 msgr2=0x7f248419ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:32.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.734+0000 7f247be00640 1 --2- 172.21.15.12:0/213368003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2484109120 0x7f248419ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:32.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.734+0000 7f247be00640 1 -- 172.21.15.12:0/213368003 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2484103ff0 msgr2=0x7f248419a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:32.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.734+0000 7f247be00640 1 --2- 172.21.15.12:0/213368003 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2484103ff0 0x7f248419a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:32.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.734+0000 7f247be00640 1 -- 172.21.15.12:0/213368003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248419f650 con 0x7f24841049a0 2024-09-05T01:23:32.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.735+0000 7f247be00640 1 --2- 172.21.15.12:0/213368003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24841049a0 0x7f248419abe0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f246c006010 tx=0x7f246c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:32.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.735+0000 7f2481600640 1 -- 172.21.15.12:0/213368003 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c03f030 con 0x7f24841049a0 2024-09-05T01:23:32.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.735+0000 7f2481600640 1 -- 172.21.15.12:0/213368003 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f246c003ce0 con 0x7f24841049a0 2024-09-05T01:23:32.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.735+0000 7f2481600640 1 -- 172.21.15.12:0/213368003 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c035070 con 0x7f24841049a0 2024-09-05T01:23:32.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.735+0000 7f248ac00640 1 -- 172.21.15.12:0/213368003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f248419f8e0 con 0x7f24841049a0 2024-09-05T01:23:32.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.735+0000 7f248ac00640 1 -- 172.21.15.12:0/213368003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f248419fd70 con 0x7f24841049a0 2024-09-05T01:23:32.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.736+0000 7f248ac00640 1 -- 172.21.15.12:0/213368003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24841043d0 con 0x7f24841049a0 2024-09-05T01:23:32.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.738+0000 7f2481600640 1 -- 172.21.15.12:0/213368003 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f246c042030 con 0x7f24841049a0 2024-09-05T01:23:32.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.739+0000 7f2481600640 1 --2- 172.21.15.12:0/213368003 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f24680a2c10 0x7f24680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:32.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.740+0000 7f2481600640 1 -- 172.21.15.12:0/213368003 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f246c0ef750 con 0x7f24841049a0 2024-09-05T01:23:32.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.740+0000 7f2483e00640 1 --2- 172.21.15.12:0/213368003 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f24680a2c10 0x7f24680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:32.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.741+0000 7f2483e00640 1 --2- 172.21.15.12:0/213368003 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f24680a2c10 0x7f24680a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2474005fd0 tx=0x7f247400b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:32.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.744+0000 7f2481600640 1 -- 172.21.15.12:0/213368003 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f246c0bc5a0 con 0x7f24841049a0 2024-09-05T01:23:32.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.945+0000 7f248ac00640 1 -- 172.21.15.12:0/213368003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f248410bdd0 con 0x7f24841049a0 2024-09-05T01:23:32.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.945+0000 7f2481600640 1 -- 172.21.15.12:0/213368003 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f246c0bbea0 con 0x7f24841049a0 2024-09-05T01:23:32.765 INFO:teuthology.orchestra.run.smithi012.stdout:34359738451 2024-09-05T01:23:32.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.948+0000 7f248ac00640 1 -- 172.21.15.12:0/213368003 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f24680a2c10 msgr2=0x7f24680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:32.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.948+0000 7f248ac00640 1 --2- 172.21.15.12:0/213368003 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f24680a2c10 0x7f24680a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2474005fd0 tx=0x7f247400b590 comp rx=0 tx=0).stop 2024-09-05T01:23:32.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.948+0000 7f248ac00640 1 -- 172.21.15.12:0/213368003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24841049a0 msgr2=0x7f248419abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:32.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.948+0000 7f248ac00640 1 --2- 172.21.15.12:0/213368003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24841049a0 0x7f248419abe0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f246c006010 tx=0x7f246c0042f0 comp rx=0 tx=0).stop 2024-09-05T01:23:32.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.948+0000 7f248ac00640 1 -- 172.21.15.12:0/213368003 shutdown_connections 2024-09-05T01:23:32.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.948+0000 7f248ac00640 1 --2- 172.21.15.12:0/213368003 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f24680a2c10 0x7f24680a50d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:32.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.948+0000 7f248ac00640 1 --2- 172.21.15.12:0/213368003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2484109120 0x7f248419ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:32.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.948+0000 7f248ac00640 1 --2- 172.21.15.12:0/213368003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24841049a0 0x7f248419abe0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:32.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.948+0000 7f248ac00640 1 --2- 172.21.15.12:0/213368003 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2484103ff0 0x7f248419a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:32.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.948+0000 7f248ac00640 1 -- 172.21.15.12:0/213368003 >> 172.21.15.12:0/213368003 conn(0x7f24840ffa90 msgr2=0x7f2484100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:32.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.948+0000 7f248ac00640 1 -- 172.21.15.12:0/213368003 shutdown_connections 2024-09-05T01:23:32.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:31.948+0000 7f248ac00640 1 -- 172.21.15.12:0/213368003 wait complete. 2024-09-05T01:23:32.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.862+0000 7f5b36600640 1 -- 172.21.15.12:0/3755765718 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f5b301a7420 con 0x7f5b30109120 2024-09-05T01:23:32.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.863+0000 7f5b27e00640 1 -- 172.21.15.12:0/3755765718 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5b280bccc0 con 0x7f5b30109120 2024-09-05T01:23:32.864 INFO:teuthology.orchestra.run.smithi012.stdout:240518168617 2024-09-05T01:23:32.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.865+0000 7f5b36600640 1 -- 172.21.15.12:0/3755765718 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f5b140a2c90 msgr2=0x7f5b140a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:32.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.865+0000 7f5b36600640 1 --2- 172.21.15.12:0/3755765718 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f5b140a2c90 0x7f5b140a5150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5b2000bbe0 tx=0x7f5b2000b390 comp rx=0 tx=0).stop 2024-09-05T01:23:32.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.865+0000 7f5b36600640 1 -- 172.21.15.12:0/3755765718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b30109120 msgr2=0x7f5b3019ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:32.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.865+0000 7f5b36600640 1 --2- 172.21.15.12:0/3755765718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b30109120 0x7f5b3019ee90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5b28033040 tx=0x7f5b28003f10 comp rx=0 tx=0).stop 2024-09-05T01:23:32.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.865+0000 7f5b36600640 1 -- 172.21.15.12:0/3755765718 shutdown_connections 2024-09-05T01:23:32.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.865+0000 7f5b36600640 1 --2- 172.21.15.12:0/3755765718 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f5b140a2c90 0x7f5b140a5150 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:32.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.865+0000 7f5b36600640 1 --2- 172.21.15.12:0/3755765718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b30109120 0x7f5b3019ee90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:32.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.865+0000 7f5b36600640 1 --2- 172.21.15.12:0/3755765718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b301049a0 0x7f5b3019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:32.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.865+0000 7f5b36600640 1 --2- 172.21.15.12:0/3755765718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b30103ff0 0x7f5b3019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:32.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.865+0000 7f5b36600640 1 -- 172.21.15.12:0/3755765718 >> 172.21.15.12:0/3755765718 conn(0x7f5b300ffa90 msgr2=0x7f5b301004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:32.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.865+0000 7f5b36600640 1 -- 172.21.15.12:0/3755765718 shutdown_connections 2024-09-05T01:23:32.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:32.865+0000 7f5b36600640 1 -- 172.21.15.12:0/3755765718 wait complete. 2024-09-05T01:23:33.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:32 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/213368003' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-05T01:23:33.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:32 smithi012 ceph-mon[29942]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5 op/s; 116 B/s, 1 keys/s, 1 objects/s recovering 2024-09-05T01:23:33.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:32 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/213368003' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-05T01:23:33.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:32 smithi151 ceph-mon[35013]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5 op/s; 116 B/s, 1 keys/s, 1 objects/s recovering 2024-09-05T01:23:33.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:32 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/213368003' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-05T01:23:33.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:32 smithi145 ceph-mon[34376]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 5 op/s; 116 B/s, 1 keys/s, 1 objects/s recovering 2024-09-05T01:23:33.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.783+0000 7fac9f800640 1 -- 172.21.15.12:0/677819406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac98104010 msgr2=0x7fac981043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:33.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.783+0000 7fac9f800640 1 --2- 172.21.15.12:0/677819406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac98104010 0x7fac981043f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fac8c009900 tx=0x7fac8c02a410 comp rx=0 tx=0).stop 2024-09-05T01:23:33.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.783+0000 7fac9f800640 1 -- 172.21.15.12:0/677819406 shutdown_connections 2024-09-05T01:23:33.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.783+0000 7fac9f800640 1 --2- 172.21.15.12:0/677819406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac98109140 0x7fac98110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:33.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.783+0000 7fac9f800640 1 --2- 172.21.15.12:0/677819406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac981049c0 0x7fac98108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:33.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.783+0000 7fac9f800640 1 --2- 172.21.15.12:0/677819406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac98104010 0x7fac981043f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:33.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.783+0000 7fac9f800640 1 -- 172.21.15.12:0/677819406 >> 172.21.15.12:0/677819406 conn(0x7fac980ffa50 msgr2=0x7fac98101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:33.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.783+0000 7fac9f800640 1 -- 172.21.15.12:0/677819406 shutdown_connections 2024-09-05T01:23:33.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.783+0000 7fac9f800640 1 -- 172.21.15.12:0/677819406 wait complete. 2024-09-05T01:23:33.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.784+0000 7fac9f800640 1 Processor -- start 2024-09-05T01:23:33.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.784+0000 7fac9f800640 1 -- start start 2024-09-05T01:23:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.784+0000 7fac9f800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac98104010 0x7fac9819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.785+0000 7fac9f800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac981049c0 0x7fac9819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.785+0000 7fac9f800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac98109140 0x7fac9819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.785+0000 7fac9f800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fac981141c0 con 0x7fac981049c0 2024-09-05T01:23:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.785+0000 7fac9f800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fac98114040 con 0x7fac98104010 2024-09-05T01:23:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.785+0000 7fac9f800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fac98114340 con 0x7fac98109140 2024-09-05T01:23:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.785+0000 7fac97e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac981049c0 0x7fac9819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.785+0000 7fac9ce00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac98104010 0x7fac9819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.785+0000 7fac97e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac981049c0 0x7fac9819ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53038/0 (socket says 172.21.15.12:53038) 2024-09-05T01:23:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.785+0000 7fac97e00640 1 -- 172.21.15.12:0/1700716257 learned_addr learned my addr 172.21.15.12:0/1700716257 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.785+0000 7fac9d800640 1 --2- 172.21.15.12:0/1700716257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac98109140 0x7fac9819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.785+0000 7fac97e00640 1 -- 172.21.15.12:0/1700716257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac98109140 msgr2=0x7fac9819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.785+0000 7fac97e00640 1 --2- 172.21.15.12:0/1700716257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac98109140 0x7fac9819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.785+0000 7fac97e00640 1 -- 172.21.15.12:0/1700716257 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac98104010 msgr2=0x7fac9819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.785+0000 7fac97e00640 1 --2- 172.21.15.12:0/1700716257 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac98104010 0x7fac9819a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.785+0000 7fac97e00640 1 -- 172.21.15.12:0/1700716257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac9819f5d0 con 0x7fac981049c0 2024-09-05T01:23:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.785+0000 7fac9d800640 1 --2- 172.21.15.12:0/1700716257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac98109140 0x7fac9819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:23:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.786+0000 7fac97e00640 1 --2- 172.21.15.12:0/1700716257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac981049c0 0x7fac9819ab60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fac8400d950 tx=0x7fac8400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:33.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.786+0000 7fac95600640 1 -- 172.21.15.12:0/1700716257 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac84017030 con 0x7fac981049c0 2024-09-05T01:23:33.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.786+0000 7fac95600640 1 -- 172.21.15.12:0/1700716257 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac84004020 con 0x7fac981049c0 2024-09-05T01:23:33.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.786+0000 7fac95600640 1 -- 172.21.15.12:0/1700716257 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac840047a0 con 0x7fac981049c0 2024-09-05T01:23:33.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.786+0000 7fac9f800640 1 -- 172.21.15.12:0/1700716257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac9819f8c0 con 0x7fac981049c0 2024-09-05T01:23:33.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.786+0000 7fac9f800640 1 -- 172.21.15.12:0/1700716257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac981a71a0 con 0x7fac981049c0 2024-09-05T01:23:33.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.787+0000 7fac9f800640 1 -- 172.21.15.12:0/1700716257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac981043f0 con 0x7fac981049c0 2024-09-05T01:23:33.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.789+0000 7fac95600640 1 -- 172.21.15.12:0/1700716257 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fac840041d0 con 0x7fac981049c0 2024-09-05T01:23:33.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.792+0000 7fac95600640 1 --2- 172.21.15.12:0/1700716257 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fac800a2c90 0x7fac800a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:33.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.793+0000 7fac95600640 1 -- 172.21.15.12:0/1700716257 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7fac840cebb0 con 0x7fac981049c0 2024-09-05T01:23:33.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.793+0000 7fac9ce00640 1 --2- 172.21.15.12:0/1700716257 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fac800a2c90 0x7fac800a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:33.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.793+0000 7fac9ce00640 1 --2- 172.21.15.12:0/1700716257 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fac800a2c90 0x7fac800a5150 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fac8c000c00 tx=0x7fac8c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:33.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.797+0000 7fac95600640 1 -- 172.21.15.12:0/1700716257 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac8409b940 con 0x7fac981049c0 2024-09-05T01:23:33.920 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:33 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3755765718' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-05T01:23:33.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.992+0000 7fac9f800640 1 -- 172.21.15.12:0/1700716257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fac9802d7c0 con 0x7fac981049c0 2024-09-05T01:23:33.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.992+0000 7fac95600640 1 -- 172.21.15.12:0/1700716257 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fac8409b240 con 0x7fac981049c0 2024-09-05T01:23:33.994 INFO:teuthology.orchestra.run.smithi012.stdout:210453397551 2024-09-05T01:23:33.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.995+0000 7fac9f800640 1 -- 172.21.15.12:0/1700716257 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fac800a2c90 msgr2=0x7fac800a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:33.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.995+0000 7fac9f800640 1 --2- 172.21.15.12:0/1700716257 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fac800a2c90 0x7fac800a5150 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fac8c000c00 tx=0x7fac8c005b50 comp rx=0 tx=0).stop 2024-09-05T01:23:33.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.995+0000 7fac9f800640 1 -- 172.21.15.12:0/1700716257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac981049c0 msgr2=0x7fac9819ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:33.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.995+0000 7fac9f800640 1 --2- 172.21.15.12:0/1700716257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac981049c0 0x7fac9819ab60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fac8400d950 tx=0x7fac8400de10 comp rx=0 tx=0).stop 2024-09-05T01:23:33.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.995+0000 7fac9f800640 1 -- 172.21.15.12:0/1700716257 shutdown_connections 2024-09-05T01:23:33.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.995+0000 7fac9f800640 1 --2- 172.21.15.12:0/1700716257 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fac800a2c90 0x7fac800a5150 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:33.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.995+0000 7fac9f800640 1 --2- 172.21.15.12:0/1700716257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac98109140 0x7fac9819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:33.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.995+0000 7fac9f800640 1 --2- 172.21.15.12:0/1700716257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac981049c0 0x7fac9819ab60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:33.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.995+0000 7fac9f800640 1 --2- 172.21.15.12:0/1700716257 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fac98104010 0x7fac9819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:33.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.995+0000 7fac9f800640 1 -- 172.21.15.12:0/1700716257 >> 172.21.15.12:0/1700716257 conn(0x7fac980ffa50 msgr2=0x7fac98100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:33.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.995+0000 7fac9f800640 1 -- 172.21.15.12:0/1700716257 shutdown_connections 2024-09-05T01:23:33.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:33.995+0000 7fac9f800640 1 -- 172.21.15.12:0/1700716257 wait complete. 2024-09-05T01:23:34.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:33 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3755765718' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-05T01:23:34.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.155+0000 7f845fe00640 1 -- 172.21.15.12:0/3153609953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8460100780 msgr2=0x7f8460100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:34.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.155+0000 7f845fe00640 1 --2- 172.21.15.12:0/3153609953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8460100780 0x7f8460100b60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8450009860 tx=0x7f845002a340 comp rx=0 tx=0).stop 2024-09-05T01:23:34.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.155+0000 7f845fe00640 1 -- 172.21.15.12:0/3153609953 shutdown_connections 2024-09-05T01:23:34.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.155+0000 7f845fe00640 1 --2- 172.21.15.12:0/3153609953 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f846010e330 0x7f8460110720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:34.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.155+0000 7f845fe00640 1 --2- 172.21.15.12:0/3153609953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8460101130 0x7f846010ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:34.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.155+0000 7f845fe00640 1 --2- 172.21.15.12:0/3153609953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8460100780 0x7f8460100b60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:34.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.155+0000 7f845fe00640 1 -- 172.21.15.12:0/3153609953 >> 172.21.15.12:0/3153609953 conn(0x7f84600fc610 msgr2=0x7f84600fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:34.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.155+0000 7f845fe00640 1 -- 172.21.15.12:0/3153609953 shutdown_connections 2024-09-05T01:23:34.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.155+0000 7f845fe00640 1 -- 172.21.15.12:0/3153609953 wait complete. 2024-09-05T01:23:34.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.156+0000 7f845fe00640 1 Processor -- start 2024-09-05T01:23:34.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.156+0000 7f845fe00640 1 -- start start 2024-09-05T01:23:34.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.157+0000 7f845fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8460100780 0x7f846019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:34.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.157+0000 7f845fe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8460101130 0x7f846019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:34.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.157+0000 7f845fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f846010e330 0x7f846019ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:34.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.157+0000 7f845fe00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8460113fe0 con 0x7f8460100780 2024-09-05T01:23:34.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.157+0000 7f845fe00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8460113e60 con 0x7f8460101130 2024-09-05T01:23:34.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.157+0000 7f845fe00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8460114160 con 0x7f846010e330 2024-09-05T01:23:34.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.157+0000 7f845ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8460100780 0x7f846019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:34.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.157+0000 7f845f400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f846010e330 0x7f846019ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:34.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.157+0000 7f845ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8460100780 0x7f846019a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53078/0 (socket says 172.21.15.12:53078) 2024-09-05T01:23:34.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.157+0000 7f845ea00640 1 -- 172.21.15.12:0/601185389 learned_addr learned my addr 172.21.15.12:0/601185389 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:34.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.157+0000 7f845f400640 1 --2- 172.21.15.12:0/601185389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f846010e330 0x7f846019ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:59980/0 (socket says 172.21.15.12:59980) 2024-09-05T01:23:34.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.157+0000 7f845e000640 1 --2- 172.21.15.12:0/601185389 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8460101130 0x7f846019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:34.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.158+0000 7f845f400640 1 -- 172.21.15.12:0/601185389 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8460101130 msgr2=0x7f846019a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:34.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.158+0000 7f845f400640 1 --2- 172.21.15.12:0/601185389 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8460101130 0x7f846019a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:34.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.158+0000 7f845f400640 1 -- 172.21.15.12:0/601185389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8460100780 msgr2=0x7f846019a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:34.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.158+0000 7f845f400640 1 --2- 172.21.15.12:0/601185389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8460100780 0x7f846019a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:34.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.158+0000 7f845f400640 1 -- 172.21.15.12:0/601185389 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846019f450 con 0x7f846010e330 2024-09-05T01:23:34.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.158+0000 7f845ea00640 1 --2- 172.21.15.12:0/601185389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8460100780 0x7f846019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:23:34.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.158+0000 7f845f400640 1 --2- 172.21.15.12:0/601185389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f846010e330 0x7f846019ed70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8458005fd0 tx=0x7f845800c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:34.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.158+0000 7f8457400640 1 -- 172.21.15.12:0/601185389 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8458004b20 con 0x7f846010e330 2024-09-05T01:23:34.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.158+0000 7f8457400640 1 -- 172.21.15.12:0/601185389 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8458003e50 con 0x7f846010e330 2024-09-05T01:23:34.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.158+0000 7f845fe00640 1 -- 172.21.15.12:0/601185389 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f846019f740 con 0x7f846010e330 2024-09-05T01:23:34.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.158+0000 7f8457400640 1 -- 172.21.15.12:0/601185389 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845800b570 con 0x7f846010e330 2024-09-05T01:23:34.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.158+0000 7f845fe00640 1 -- 172.21.15.12:0/601185389 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84601a7020 con 0x7f846010e330 2024-09-05T01:23:34.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.160+0000 7f845fe00640 1 -- 172.21.15.12:0/601185389 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8460100b60 con 0x7f846010e330 2024-09-05T01:23:34.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.161+0000 7f8457400640 1 -- 172.21.15.12:0/601185389 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f845801d020 con 0x7f846010e330 2024-09-05T01:23:34.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.163+0000 7f8457400640 1 --2- 172.21.15.12:0/601185389 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f84440a2c90 0x7f84440a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:34.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.163+0000 7f8457400640 1 -- 172.21.15.12:0/601185389 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f84580cefc0 con 0x7f846010e330 2024-09-05T01:23:34.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.163+0000 7f845ea00640 1 --2- 172.21.15.12:0/601185389 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f84440a2c90 0x7f84440a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:34.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.164+0000 7f845ea00640 1 --2- 172.21.15.12:0/601185389 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f84440a2c90 0x7f84440a5150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f84500095f0 tx=0x7f84500056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:34.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.167+0000 7f8457400640 1 -- 172.21.15.12:0/601185389 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f845809bd50 con 0x7f846010e330 2024-09-05T01:23:34.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:33 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3755765718' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-05T01:23:34.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.360+0000 7f845fe00640 1 -- 172.21.15.12:0/601185389 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8460108f30 con 0x7f846010e330 2024-09-05T01:23:34.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.360+0000 7f8457400640 1 -- 172.21.15.12:0/601185389 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f845809b650 con 0x7f846010e330 2024-09-05T01:23:34.361 INFO:teuthology.orchestra.run.smithi012.stdout:107374182467 2024-09-05T01:23:34.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.363+0000 7f845fe00640 1 -- 172.21.15.12:0/601185389 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f84440a2c90 msgr2=0x7f84440a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:34.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.363+0000 7f845fe00640 1 --2- 172.21.15.12:0/601185389 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f84440a2c90 0x7f84440a5150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f84500095f0 tx=0x7f84500056d0 comp rx=0 tx=0).stop 2024-09-05T01:23:34.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.363+0000 7f845fe00640 1 -- 172.21.15.12:0/601185389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f846010e330 msgr2=0x7f846019ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:34.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.363+0000 7f845fe00640 1 --2- 172.21.15.12:0/601185389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f846010e330 0x7f846019ed70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8458005fd0 tx=0x7f845800c740 comp rx=0 tx=0).stop 2024-09-05T01:23:34.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.363+0000 7f845fe00640 1 -- 172.21.15.12:0/601185389 shutdown_connections 2024-09-05T01:23:34.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.363+0000 7f845fe00640 1 --2- 172.21.15.12:0/601185389 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f84440a2c90 0x7f84440a5150 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:34.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.363+0000 7f845fe00640 1 --2- 172.21.15.12:0/601185389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f846010e330 0x7f846019ed70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:34.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.363+0000 7f845fe00640 1 --2- 172.21.15.12:0/601185389 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8460101130 0x7f846019a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:34.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.363+0000 7f845fe00640 1 --2- 172.21.15.12:0/601185389 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8460100780 0x7f846019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:34.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.363+0000 7f845fe00640 1 -- 172.21.15.12:0/601185389 >> 172.21.15.12:0/601185389 conn(0x7f84600fc610 msgr2=0x7f84600fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:34.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.363+0000 7f845fe00640 1 -- 172.21.15.12:0/601185389 shutdown_connections 2024-09-05T01:23:34.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.363+0000 7f845fe00640 1 -- 172.21.15.12:0/601185389 wait complete. 2024-09-05T01:23:34.490 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953532 got 137438953534 for osd.4 2024-09-05T01:23:34.490 DEBUG:teuthology.parallel:result is None 2024-09-05T01:23:35.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:34 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/1700716257' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-05T01:23:35.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:34 smithi151 ceph-mon[35013]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 6 op/s; 106 B/s, 1 keys/s, 1 objects/s recovering 2024-09-05T01:23:35.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:34 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/4248335577' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-05T01:23:35.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:34 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/601185389' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-05T01:23:35.266 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:34 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/1700716257' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-05T01:23:35.266 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:34 smithi012 ceph-mon[29942]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 6 op/s; 106 B/s, 1 keys/s, 1 objects/s recovering 2024-09-05T01:23:35.267 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:34 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/4248335577' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-05T01:23:35.267 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:34 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/601185389' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-05T01:23:35.302 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397549 got 210453397551 for osd.7 2024-09-05T01:23:35.302 DEBUG:teuthology.parallel:result is None 2024-09-05T01:23:35.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:34 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/1700716257' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-05T01:23:35.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:34 smithi145 ceph-mon[34376]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 6 op/s; 106 B/s, 1 keys/s, 1 objects/s recovering 2024-09-05T01:23:35.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:34 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/4248335577' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-05T01:23:35.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:34 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/601185389' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-05T01:23:35.496 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:36.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.081+0000 7f6f35600640 1 -- 172.21.15.12:0/3482681465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f30074e30 msgr2=0x7f6f3010dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:36.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.081+0000 7f6f35600640 1 --2- 172.21.15.12:0/3482681465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f30074e30 0x7f6f3010dd40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009900 tx=0x7f6f1802a480 comp rx=0 tx=0).stop 2024-09-05T01:23:36.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.081+0000 7f6f35600640 1 -- 172.21.15.12:0/3482681465 shutdown_connections 2024-09-05T01:23:36.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.081+0000 7f6f35600640 1 --2- 172.21.15.12:0/3482681465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f3010e280 0x7f6f30110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.081+0000 7f6f35600640 1 --2- 172.21.15.12:0/3482681465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f30074e30 0x7f6f3010dd40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.081+0000 7f6f35600640 1 --2- 172.21.15.12:0/3482681465 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f30074510 0x7f6f300748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.081+0000 7f6f35600640 1 -- 172.21.15.12:0/3482681465 >> 172.21.15.12:0/3482681465 conn(0x7f6f300fd740 msgr2=0x7f6f300ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:36.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.081+0000 7f6f35600640 1 -- 172.21.15.12:0/3482681465 shutdown_connections 2024-09-05T01:23:36.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.081+0000 7f6f35600640 1 -- 172.21.15.12:0/3482681465 wait complete. 2024-09-05T01:23:36.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.082+0000 7f6f35600640 1 Processor -- start 2024-09-05T01:23:36.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.082+0000 7f6f35600640 1 -- start start 2024-09-05T01:23:36.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.083+0000 7f6f35600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f30074510 0x7f6f3019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:36.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.083+0000 7f6f35600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f30074e30 0x7f6f3019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:36.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.083+0000 7f6f35600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f3010e280 0x7f6f3019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:36.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.083+0000 7f6f35600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6f30113fb0 con 0x7f6f30074510 2024-09-05T01:23:36.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.083+0000 7f6f35600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6f30113e30 con 0x7f6f30074e30 2024-09-05T01:23:36.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.083+0000 7f6f35600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6f30114130 con 0x7f6f3010e280 2024-09-05T01:23:36.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.083+0000 7f6f2fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f30074510 0x7f6f3019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:36.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.083+0000 7f6f2fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f30074510 0x7f6f3019a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53100/0 (socket says 172.21.15.12:53100) 2024-09-05T01:23:36.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.083+0000 7f6f27e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f30074e30 0x7f6f3019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:36.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.083+0000 7f6f2fe00640 1 -- 172.21.15.12:0/2522773769 learned_addr learned my addr 172.21.15.12:0/2522773769 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:36.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.083+0000 7f6f34c00640 1 --2- 172.21.15.12:0/2522773769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f3010e280 0x7f6f3019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:36.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.083+0000 7f6f2fe00640 1 -- 172.21.15.12:0/2522773769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f3010e280 msgr2=0x7f6f3019ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:36.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.083+0000 7f6f2fe00640 1 --2- 172.21.15.12:0/2522773769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f3010e280 0x7f6f3019ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.083+0000 7f6f2fe00640 1 -- 172.21.15.12:0/2522773769 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f30074e30 msgr2=0x7f6f3019aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:36.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.083+0000 7f6f2fe00640 1 --2- 172.21.15.12:0/2522773769 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f30074e30 0x7f6f3019aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.084+0000 7f6f2fe00640 1 -- 172.21.15.12:0/2522773769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f3019f540 con 0x7f6f30074510 2024-09-05T01:23:36.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.084+0000 7f6f2fe00640 1 --2- 172.21.15.12:0/2522773769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f30074510 0x7f6f3019a590 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000ea60 tx=0x7f6f2000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:36.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.084+0000 7f6f2d600640 1 -- 172.21.15.12:0/2522773769 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2000cde0 con 0x7f6f30074510 2024-09-05T01:23:36.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.084+0000 7f6f2d600640 1 -- 172.21.15.12:0/2522773769 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f200035f0 con 0x7f6f30074510 2024-09-05T01:23:36.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.084+0000 7f6f2d600640 1 -- 172.21.15.12:0/2522773769 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20010670 con 0x7f6f30074510 2024-09-05T01:23:36.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.084+0000 7f6f35600640 1 -- 172.21.15.12:0/2522773769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f3019f830 con 0x7f6f30074510 2024-09-05T01:23:36.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.084+0000 7f6f35600640 1 -- 172.21.15.12:0/2522773769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f301a7110 con 0x7f6f30074510 2024-09-05T01:23:36.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.085+0000 7f6f35600640 1 -- 172.21.15.12:0/2522773769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f300748f0 con 0x7f6f30074510 2024-09-05T01:23:36.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.087+0000 7f6f2d600640 1 -- 172.21.15.12:0/2522773769 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6f200037a0 con 0x7f6f30074510 2024-09-05T01:23:36.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.089+0000 7f6f2d600640 1 --2- 172.21.15.12:0/2522773769 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6f140a2c90 0x7f6f140a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:36.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.089+0000 7f6f2d600640 1 -- 172.21.15.12:0/2522773769 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f6f200cf4d0 con 0x7f6f30074510 2024-09-05T01:23:36.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.089+0000 7f6f27e00640 1 --2- 172.21.15.12:0/2522773769 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6f140a2c90 0x7f6f140a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:36.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.090+0000 7f6f27e00640 1 --2- 172.21.15.12:0/2522773769 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6f140a2c90 0x7f6f140a5150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009230 tx=0x7f6f180058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:36.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.093+0000 7f6f2d600640 1 -- 172.21.15.12:0/2522773769 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6f2009c260 con 0x7f6f30074510 2024-09-05T01:23:36.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.977+0000 7f95e6600640 1 -- 172.21.15.12:0/3408623359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95e01019c0 msgr2=0x7f95e0101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:36.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.977+0000 7f95e6600640 1 --2- 172.21.15.12:0/3408623359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95e01019c0 0x7f95e0101e20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f95cc009930 tx=0x7f95cc02a440 comp rx=0 tx=0).stop 2024-09-05T01:23:36.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.978+0000 7f95e6600640 1 -- 172.21.15.12:0/3408623359 shutdown_connections 2024-09-05T01:23:36.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.978+0000 7f95e6600640 1 --2- 172.21.15.12:0/3408623359 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f95e0102360 0x7f95e010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.978+0000 7f95e6600640 1 --2- 172.21.15.12:0/3408623359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95e01019c0 0x7f95e0101e20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.978+0000 7f95e6600640 1 --2- 172.21.15.12:0/3408623359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95e01079c0 0x7f95e0107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.978+0000 7f95e6600640 1 -- 172.21.15.12:0/3408623359 >> 172.21.15.12:0/3408623359 conn(0x7f95e00fd740 msgr2=0x7f95e00ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:36.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.978+0000 7f95e6600640 1 -- 172.21.15.12:0/3408623359 shutdown_connections 2024-09-05T01:23:36.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.978+0000 7f95e6600640 1 -- 172.21.15.12:0/3408623359 wait complete. 2024-09-05T01:23:36.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.979+0000 7f95e6600640 1 Processor -- start 2024-09-05T01:23:36.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.979+0000 7f95e6600640 1 -- start start 2024-09-05T01:23:36.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.980+0000 7f95e6600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95e01019c0 0x7f95e0198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:36.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.980+0000 7f95e6600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95e0102360 0x7f95e0198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:36.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.980+0000 7f95e6600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f95e01079c0 0x7f95e019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:36.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.980+0000 7f95e6600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f95e0111dd0 con 0x7f95e0102360 2024-09-05T01:23:36.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.980+0000 7f95e6600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f95e0111c50 con 0x7f95e01079c0 2024-09-05T01:23:36.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.980+0000 7f95e6600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f95e0111f50 con 0x7f95e01019c0 2024-09-05T01:23:36.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.980+0000 7f95dfe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95e0102360 0x7f95e0198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:36.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.980+0000 7f95e5200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95e01019c0 0x7f95e0198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:36.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.980+0000 7f95e5200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95e01019c0 0x7f95e0198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:59990/0 (socket says 172.21.15.12:59990) 2024-09-05T01:23:36.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.980+0000 7f95e5200640 1 -- 172.21.15.12:0/2854062155 learned_addr learned my addr 172.21.15.12:0/2854062155 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:36.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.980+0000 7f95e5c00640 1 --2- 172.21.15.12:0/2854062155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f95e01079c0 0x7f95e019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:36.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.981+0000 7f95dfe00640 1 -- 172.21.15.12:0/2854062155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95e01019c0 msgr2=0x7f95e0198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:36.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.981+0000 7f95dfe00640 1 --2- 172.21.15.12:0/2854062155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95e01019c0 0x7f95e0198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.981+0000 7f95dfe00640 1 -- 172.21.15.12:0/2854062155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f95e01079c0 msgr2=0x7f95e019cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:36.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.981+0000 7f95dfe00640 1 --2- 172.21.15.12:0/2854062155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f95e01079c0 0x7f95e019cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.981+0000 7f95dfe00640 1 -- 172.21.15.12:0/2854062155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e019d2c0 con 0x7f95e0102360 2024-09-05T01:23:36.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.981+0000 7f95e5c00640 1 --2- 172.21.15.12:0/2854062155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f95e01079c0 0x7f95e019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:23:36.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.981+0000 7f95dfe00640 1 --2- 172.21.15.12:0/2854062155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95e0102360 0x7f95e0198850 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f95cc02a960 tx=0x7f95cc003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:36.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.981+0000 7f95dd600640 1 -- 172.21.15.12:0/2854062155 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc03f070 con 0x7f95e0102360 2024-09-05T01:23:36.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.981+0000 7f95dd600640 1 -- 172.21.15.12:0/2854062155 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95cc031c90 con 0x7f95e0102360 2024-09-05T01:23:36.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.981+0000 7f95dd600640 1 -- 172.21.15.12:0/2854062155 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc035030 con 0x7f95e0102360 2024-09-05T01:23:36.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.981+0000 7f95e6600640 1 -- 172.21.15.12:0/2854062155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e019d550 con 0x7f95e0102360 2024-09-05T01:23:36.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.982+0000 7f95e6600640 1 -- 172.21.15.12:0/2854062155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e019d9e0 con 0x7f95e0102360 2024-09-05T01:23:36.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.983+0000 7f95e6600640 1 -- 172.21.15.12:0/2854062155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95e0101e20 con 0x7f95e0102360 2024-09-05T01:23:36.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.984+0000 7f95dd600640 1 -- 172.21.15.12:0/2854062155 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f95cc042070 con 0x7f95e0102360 2024-09-05T01:23:36.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.986+0000 7f95dd600640 1 --2- 172.21.15.12:0/2854062155 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f95c80a2c90 0x7f95c80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:36.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.986+0000 7f95dd600640 1 -- 172.21.15.12:0/2854062155 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f95cc0ef910 con 0x7f95e0102360 2024-09-05T01:23:36.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.986+0000 7f95e5200640 1 --2- 172.21.15.12:0/2854062155 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f95c80a2c90 0x7f95c80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:36.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.987+0000 7f95e5200640 1 --2- 172.21.15.12:0/2854062155 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f95c80a2c90 0x7f95c80a5150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f95d4005fd0 tx=0x7f95d400b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:36.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:35.990+0000 7f95dd600640 1 -- 172.21.15.12:0/2854062155 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f95cc0bc6a0 con 0x7f95e0102360 2024-09-05T01:23:36.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.186+0000 7f95e6600640 1 -- 172.21.15.12:0/2854062155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f95e002d7c0 con 0x7f95e0102360 2024-09-05T01:23:36.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.187+0000 7f95dd600640 1 -- 172.21.15.12:0/2854062155 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f95cc0bbfa0 con 0x7f95e0102360 2024-09-05T01:23:36.188 INFO:teuthology.orchestra.run.smithi012.stdout:270582939684 2024-09-05T01:23:36.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.189+0000 7f95e6600640 1 -- 172.21.15.12:0/2854062155 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f95c80a2c90 msgr2=0x7f95c80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:36.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.189+0000 7f95e6600640 1 --2- 172.21.15.12:0/2854062155 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f95c80a2c90 0x7f95c80a5150 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f95d4005fd0 tx=0x7f95d400b4a0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.189+0000 7f95e6600640 1 -- 172.21.15.12:0/2854062155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95e0102360 msgr2=0x7f95e0198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:36.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.189+0000 7f95e6600640 1 --2- 172.21.15.12:0/2854062155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95e0102360 0x7f95e0198850 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f95cc02a960 tx=0x7f95cc003b90 comp rx=0 tx=0).stop 2024-09-05T01:23:36.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.189+0000 7f95e6600640 1 -- 172.21.15.12:0/2854062155 shutdown_connections 2024-09-05T01:23:36.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.189+0000 7f95e6600640 1 --2- 172.21.15.12:0/2854062155 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f95c80a2c90 0x7f95c80a5150 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.189+0000 7f95e6600640 1 --2- 172.21.15.12:0/2854062155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f95e01079c0 0x7f95e019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.189+0000 7f95e6600640 1 --2- 172.21.15.12:0/2854062155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95e0102360 0x7f95e0198850 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.189+0000 7f95e6600640 1 --2- 172.21.15.12:0/2854062155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95e01019c0 0x7f95e0198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.189+0000 7f95e6600640 1 -- 172.21.15.12:0/2854062155 >> 172.21.15.12:0/2854062155 conn(0x7f95e00fd740 msgr2=0x7f95e00fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:36.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.189+0000 7f95e6600640 1 -- 172.21.15.12:0/2854062155 shutdown_connections 2024-09-05T01:23:36.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.189+0000 7f95e6600640 1 -- 172.21.15.12:0/2854062155 wait complete. 2024-09-05T01:23:36.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.282+0000 7f6f35600640 1 -- 172.21.15.12:0/2522773769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f6f3019b8f0 con 0x7f6f30074510 2024-09-05T01:23:36.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.283+0000 7f6f2d600640 1 -- 172.21.15.12:0/2522773769 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6f2009bb60 con 0x7f6f30074510 2024-09-05T01:23:36.285 INFO:teuthology.orchestra.run.smithi012.stdout:158913790009 2024-09-05T01:23:36.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.285+0000 7f6f35600640 1 -- 172.21.15.12:0/2522773769 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6f140a2c90 msgr2=0x7f6f140a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:36.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.285+0000 7f6f35600640 1 --2- 172.21.15.12:0/2522773769 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6f140a2c90 0x7f6f140a5150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009230 tx=0x7f6f180058d0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.285+0000 7f6f35600640 1 -- 172.21.15.12:0/2522773769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f30074510 msgr2=0x7f6f3019a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:36.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.285+0000 7f6f35600640 1 --2- 172.21.15.12:0/2522773769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f30074510 0x7f6f3019a590 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000ea60 tx=0x7f6f2000ef20 comp rx=0 tx=0).stop 2024-09-05T01:23:36.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.285+0000 7f6f35600640 1 -- 172.21.15.12:0/2522773769 shutdown_connections 2024-09-05T01:23:36.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.285+0000 7f6f35600640 1 --2- 172.21.15.12:0/2522773769 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6f140a2c90 0x7f6f140a5150 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.285+0000 7f6f35600640 1 --2- 172.21.15.12:0/2522773769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f3010e280 0x7f6f3019ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.285+0000 7f6f35600640 1 --2- 172.21.15.12:0/2522773769 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f30074e30 0x7f6f3019aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.285+0000 7f6f35600640 1 --2- 172.21.15.12:0/2522773769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f30074510 0x7f6f3019a590 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.285+0000 7f6f35600640 1 -- 172.21.15.12:0/2522773769 >> 172.21.15.12:0/2522773769 conn(0x7f6f300fd740 msgr2=0x7f6f300fef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:36.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.285+0000 7f6f35600640 1 -- 172.21.15.12:0/2522773769 shutdown_connections 2024-09-05T01:23:36.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:36.286+0000 7f6f35600640 1 -- 172.21.15.12:0/2522773769 wait complete. 2024-09-05T01:23:36.429 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:36 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2854062155' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-05T01:23:36.430 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:36 smithi012 ceph-mon[29942]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T01:23:36.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:36 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/2854062155' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-05T01:23:36.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:36 smithi145 ceph-mon[34376]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T01:23:36.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:36 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/2854062155' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-05T01:23:36.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:36 smithi151 ceph-mon[35013]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-05T01:23:36.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.028+0000 7f0034a00640 1 -- 172.21.15.12:0/2520347007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00301049a0 msgr2=0x7f00301089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:36.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.028+0000 7f0034a00640 1 --2- 172.21.15.12:0/2520347007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00301049a0 0x7f00301089f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f001c009900 tx=0x7f001c02a410 comp rx=0 tx=0).stop 2024-09-05T01:23:36.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.028+0000 7f0034a00640 1 -- 172.21.15.12:0/2520347007 shutdown_connections 2024-09-05T01:23:36.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.028+0000 7f0034a00640 1 --2- 172.21.15.12:0/2520347007 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0030109120 0x7f0030110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.028+0000 7f0034a00640 1 --2- 172.21.15.12:0/2520347007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00301049a0 0x7f00301089f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.028+0000 7f0034a00640 1 --2- 172.21.15.12:0/2520347007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0030103ff0 0x7f00301043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.028+0000 7f0034a00640 1 -- 172.21.15.12:0/2520347007 >> 172.21.15.12:0/2520347007 conn(0x7f00300ffa90 msgr2=0x7f0030101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:36.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.028+0000 7f0034a00640 1 -- 172.21.15.12:0/2520347007 shutdown_connections 2024-09-05T01:23:36.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.028+0000 7f0034a00640 1 -- 172.21.15.12:0/2520347007 wait complete. 2024-09-05T01:23:36.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.030+0000 7f0034a00640 1 Processor -- start 2024-09-05T01:23:36.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.030+0000 7f0034a00640 1 -- start start 2024-09-05T01:23:36.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.030+0000 7f0034a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0030103ff0 0x7f003019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:36.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.030+0000 7f0034a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00301049a0 0x7f003019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:36.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.030+0000 7f0034a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0030109120 0x7f003019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:36.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.031+0000 7f0034a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0030114190 con 0x7f0030109120 2024-09-05T01:23:36.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.031+0000 7f0034a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0030114010 con 0x7f00301049a0 2024-09-05T01:23:36.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.031+0000 7f0034a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0030114310 con 0x7f0030103ff0 2024-09-05T01:23:36.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.031+0000 7f002de00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0030103ff0 0x7f003019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:36.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.031+0000 7f002de00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0030103ff0 0x7f003019a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:59962/0 (socket says 172.21.15.12:59962) 2024-09-05T01:23:36.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.031+0000 7f002de00640 1 -- 172.21.15.12:0/4248335577 learned_addr learned my addr 172.21.15.12:0/4248335577 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:36.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.031+0000 7f002d400640 1 --2- 172.21.15.12:0/4248335577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00301049a0 0x7f003019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:36.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.031+0000 7f002e800640 1 --2- 172.21.15.12:0/4248335577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0030109120 0x7f003019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:36.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.031+0000 7f002de00640 1 -- 172.21.15.12:0/4248335577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00301049a0 msgr2=0x7f003019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:36.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.031+0000 7f002de00640 1 --2- 172.21.15.12:0/4248335577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00301049a0 0x7f003019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.031+0000 7f002de00640 1 -- 172.21.15.12:0/4248335577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0030109120 msgr2=0x7f003019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:36.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.031+0000 7f002de00640 1 --2- 172.21.15.12:0/4248335577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0030109120 0x7f003019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.031+0000 7f002de00640 1 -- 172.21.15.12:0/4248335577 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003019f620 con 0x7f0030103ff0 2024-09-05T01:23:36.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.031+0000 7f002e800640 1 --2- 172.21.15.12:0/4248335577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0030109120 0x7f003019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:23:36.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.031+0000 7f002de00640 1 --2- 172.21.15.12:0/4248335577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0030103ff0 0x7f003019a670 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f002000e9f0 tx=0x7f002000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:36.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.032+0000 7f0026a00640 1 -- 172.21.15.12:0/4248335577 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002000cd80 con 0x7f0030103ff0 2024-09-05T01:23:36.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.032+0000 7f0026a00640 1 -- 172.21.15.12:0/4248335577 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0020005500 con 0x7f0030103ff0 2024-09-05T01:23:36.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.032+0000 7f0026a00640 1 -- 172.21.15.12:0/4248335577 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0020010690 con 0x7f0030103ff0 2024-09-05T01:23:36.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.032+0000 7f0034a00640 1 -- 172.21.15.12:0/4248335577 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f003019f910 con 0x7f0030103ff0 2024-09-05T01:23:36.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.032+0000 7f0034a00640 1 -- 172.21.15.12:0/4248335577 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00301a71f0 con 0x7f0030103ff0 2024-09-05T01:23:36.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.033+0000 7f0034a00640 1 -- 172.21.15.12:0/4248335577 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00301043d0 con 0x7f0030103ff0 2024-09-05T01:23:36.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.037+0000 7f0026a00640 1 -- 172.21.15.12:0/4248335577 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f00200046c0 con 0x7f0030103ff0 2024-09-05T01:23:36.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.039+0000 7f0026a00640 1 --2- 172.21.15.12:0/4248335577 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f00140a2c90 0x7f00140a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:36.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.039+0000 7f0026a00640 1 -- 172.21.15.12:0/4248335577 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f00200cf620 con 0x7f0030103ff0 2024-09-05T01:23:36.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.039+0000 7f002d400640 1 --2- 172.21.15.12:0/4248335577 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f00140a2c90 0x7f00140a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:36.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.039+0000 7f0026a00640 1 -- 172.21.15.12:0/4248335577 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0020098380 con 0x7f0030103ff0 2024-09-05T01:23:36.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.040+0000 7f002d400640 1 --2- 172.21.15.12:0/4248335577 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f00140a2c90 0x7f00140a5150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f001c000c00 tx=0x7f001c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:36.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.241+0000 7f0034a00640 1 -- 172.21.15.12:0/4248335577 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f003010c3c0 con 0x7f0030103ff0 2024-09-05T01:23:36.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.242+0000 7f0026a00640 1 -- 172.21.15.12:0/4248335577 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f002009c410 con 0x7f0030103ff0 2024-09-05T01:23:36.757 INFO:teuthology.orchestra.run.smithi012.stdout:322122547225 2024-09-05T01:23:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.244+0000 7f0034a00640 1 -- 172.21.15.12:0/4248335577 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f00140a2c90 msgr2=0x7f00140a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.244+0000 7f0034a00640 1 --2- 172.21.15.12:0/4248335577 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f00140a2c90 0x7f00140a5150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f001c000c00 tx=0x7f001c005b50 comp rx=0 tx=0).stop 2024-09-05T01:23:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.244+0000 7f0034a00640 1 -- 172.21.15.12:0/4248335577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0030103ff0 msgr2=0x7f003019a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.244+0000 7f0034a00640 1 --2- 172.21.15.12:0/4248335577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0030103ff0 0x7f003019a670 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f002000e9f0 tx=0x7f002000edf0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.244+0000 7f0034a00640 1 -- 172.21.15.12:0/4248335577 shutdown_connections 2024-09-05T01:23:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.244+0000 7f0034a00640 1 --2- 172.21.15.12:0/4248335577 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f00140a2c90 0x7f00140a5150 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.244+0000 7f0034a00640 1 --2- 172.21.15.12:0/4248335577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0030109120 0x7f003019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.244+0000 7f0034a00640 1 --2- 172.21.15.12:0/4248335577 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f00301049a0 0x7f003019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.244+0000 7f0034a00640 1 --2- 172.21.15.12:0/4248335577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0030103ff0 0x7f003019a670 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.244+0000 7f0034a00640 1 -- 172.21.15.12:0/4248335577 >> 172.21.15.12:0/4248335577 conn(0x7f00300ffa90 msgr2=0x7f0030100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.244+0000 7f0034a00640 1 -- 172.21.15.12:0/4248335577 shutdown_connections 2024-09-05T01:23:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:34.245+0000 7f0034a00640 1 -- 172.21.15.12:0/4248335577 wait complete. 2024-09-05T01:23:37.437 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:37 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2522773769' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-05T01:23:37.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:37 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/2522773769' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-05T01:23:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:37 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/2522773769' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-05T01:23:37.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.473+0000 7fa132e00640 1 -- 172.21.15.12:0/2450687678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa12c103ff0 msgr2=0x7fa12c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:37.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.473+0000 7fa132e00640 1 --2- 172.21.15.12:0/2450687678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa12c103ff0 0x7fa12c1043d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa11c009900 tx=0x7fa11c02a3f0 comp rx=0 tx=0).stop 2024-09-05T01:23:37.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.473+0000 7fa132e00640 1 -- 172.21.15.12:0/2450687678 shutdown_connections 2024-09-05T01:23:37.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.473+0000 7fa132e00640 1 --2- 172.21.15.12:0/2450687678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa12c109120 0x7fa12c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:37.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.473+0000 7fa132e00640 1 --2- 172.21.15.12:0/2450687678 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa12c1049a0 0x7fa12c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:37.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.473+0000 7fa132e00640 1 --2- 172.21.15.12:0/2450687678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa12c103ff0 0x7fa12c1043d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:37.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.473+0000 7fa132e00640 1 -- 172.21.15.12:0/2450687678 >> 172.21.15.12:0/2450687678 conn(0x7fa12c0ffa90 msgr2=0x7fa12c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:37.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.473+0000 7fa132e00640 1 -- 172.21.15.12:0/2450687678 shutdown_connections 2024-09-05T01:23:37.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.473+0000 7fa132e00640 1 -- 172.21.15.12:0/2450687678 wait complete. 2024-09-05T01:23:37.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.474+0000 7fa132e00640 1 Processor -- start 2024-09-05T01:23:37.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.474+0000 7fa132e00640 1 -- start start 2024-09-05T01:23:37.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.475+0000 7fa132e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa12c103ff0 0x7fa12c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:37.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.475+0000 7fa132e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa12c1049a0 0x7fa12c19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:37.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.475+0000 7fa132e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa12c109120 0x7fa12c19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:37.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.475+0000 7fa132e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c1141a0 con 0x7fa12c109120 2024-09-05T01:23:37.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.475+0000 7fa132e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c114020 con 0x7fa12c103ff0 2024-09-05T01:23:37.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.475+0000 7fa132e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c114320 con 0x7fa12c1049a0 2024-09-05T01:23:37.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.475+0000 7fa130e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa12c109120 0x7fa12c19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:37.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.475+0000 7fa130e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa12c109120 0x7fa12c19eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41470/0 (socket says 172.21.15.12:41470) 2024-09-05T01:23:37.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.475+0000 7fa130e00640 1 -- 172.21.15.12:0/526886379 learned_addr learned my addr 172.21.15.12:0/526886379 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:37.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.475+0000 7fa12be00640 1 --2- 172.21.15.12:0/526886379 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa12c103ff0 0x7fa12c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:37.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.475+0000 7fa123e00640 1 --2- 172.21.15.12:0/526886379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa12c1049a0 0x7fa12c19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:37.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.475+0000 7fa130e00640 1 -- 172.21.15.12:0/526886379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa12c1049a0 msgr2=0x7fa12c19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:37.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.475+0000 7fa130e00640 1 --2- 172.21.15.12:0/526886379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa12c1049a0 0x7fa12c19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:37.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.475+0000 7fa130e00640 1 -- 172.21.15.12:0/526886379 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa12c103ff0 msgr2=0x7fa12c19a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:37.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.475+0000 7fa130e00640 1 --2- 172.21.15.12:0/526886379 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa12c103ff0 0x7fa12c19a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:37.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.475+0000 7fa130e00640 1 -- 172.21.15.12:0/526886379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa12c19f5d0 con 0x7fa12c109120 2024-09-05T01:23:37.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.475+0000 7fa123e00640 1 --2- 172.21.15.12:0/526886379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa12c1049a0 0x7fa12c19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:23:37.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.476+0000 7fa130e00640 1 --2- 172.21.15.12:0/526886379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa12c109120 0x7fa12c19eef0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa12400eb10 tx=0x7fa12400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:37.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.476+0000 7fa129600640 1 -- 172.21.15.12:0/526886379 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa124004b20 con 0x7fa12c109120 2024-09-05T01:23:37.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.476+0000 7fa129600640 1 -- 172.21.15.12:0/526886379 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa124004cc0 con 0x7fa12c109120 2024-09-05T01:23:37.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.476+0000 7fa132e00640 1 -- 172.21.15.12:0/526886379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa12c19f8c0 con 0x7fa12c109120 2024-09-05T01:23:37.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.476+0000 7fa129600640 1 -- 172.21.15.12:0/526886379 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa124010760 con 0x7fa12c109120 2024-09-05T01:23:37.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.476+0000 7fa132e00640 1 -- 172.21.15.12:0/526886379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa12c1a71a0 con 0x7fa12c109120 2024-09-05T01:23:37.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.477+0000 7fa132e00640 1 -- 172.21.15.12:0/526886379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa12c1043d0 con 0x7fa12c109120 2024-09-05T01:23:37.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.479+0000 7fa129600640 1 -- 172.21.15.12:0/526886379 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa124005020 con 0x7fa12c109120 2024-09-05T01:23:37.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.482+0000 7fa129600640 1 --2- 172.21.15.12:0/526886379 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa1100a2c10 0x7fa1100a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:37.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.482+0000 7fa129600640 1 -- 172.21.15.12:0/526886379 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7fa1240cf930 con 0x7fa12c109120 2024-09-05T01:23:37.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.482+0000 7fa12be00640 1 --2- 172.21.15.12:0/526886379 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa1100a2c10 0x7fa1100a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:37.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.482+0000 7fa12be00640 1 --2- 172.21.15.12:0/526886379 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa1100a2c10 0x7fa1100a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa11c000c00 tx=0x7fa11c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:37.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.486+0000 7fa129600640 1 -- 172.21.15.12:0/526886379 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa12409c6c0 con 0x7fa12c109120 2024-09-05T01:23:37.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.673+0000 7fa132e00640 1 -- 172.21.15.12:0/526886379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fa12c02d7c0 con 0x7fa12c109120 2024-09-05T01:23:37.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.673+0000 7fa129600640 1 -- 172.21.15.12:0/526886379 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa12409bfc0 con 0x7fa12c109120 2024-09-05T01:23:37.808 INFO:teuthology.orchestra.run.smithi012.stdout:55834574926 2024-09-05T01:23:37.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.675+0000 7fa132e00640 1 -- 172.21.15.12:0/526886379 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa1100a2c10 msgr2=0x7fa1100a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:37.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.675+0000 7fa132e00640 1 --2- 172.21.15.12:0/526886379 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa1100a2c10 0x7fa1100a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa11c000c00 tx=0x7fa11c005b50 comp rx=0 tx=0).stop 2024-09-05T01:23:37.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.675+0000 7fa132e00640 1 -- 172.21.15.12:0/526886379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa12c109120 msgr2=0x7fa12c19eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:37.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.675+0000 7fa132e00640 1 --2- 172.21.15.12:0/526886379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa12c109120 0x7fa12c19eef0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa12400eb10 tx=0x7fa12400c2d0 comp rx=0 tx=0).stop 2024-09-05T01:23:37.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.675+0000 7fa132e00640 1 -- 172.21.15.12:0/526886379 shutdown_connections 2024-09-05T01:23:37.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.675+0000 7fa132e00640 1 --2- 172.21.15.12:0/526886379 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa1100a2c10 0x7fa1100a50d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:37.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.675+0000 7fa132e00640 1 --2- 172.21.15.12:0/526886379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa12c109120 0x7fa12c19eef0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:37.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.675+0000 7fa132e00640 1 --2- 172.21.15.12:0/526886379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa12c1049a0 0x7fa12c19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:37.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.675+0000 7fa132e00640 1 --2- 172.21.15.12:0/526886379 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa12c103ff0 0x7fa12c19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:37.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.675+0000 7fa132e00640 1 -- 172.21.15.12:0/526886379 >> 172.21.15.12:0/526886379 conn(0x7fa12c0ffa90 msgr2=0x7fa12c100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:37.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.675+0000 7fa132e00640 1 -- 172.21.15.12:0/526886379 shutdown_connections 2024-09-05T01:23:37.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:37.675+0000 7fa132e00640 1 -- 172.21.15.12:0/526886379 wait complete. 2024-09-05T01:23:38.375 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:38 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/526886379' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-05T01:23:38.375 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:38 smithi012 ceph-mon[29942]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:23:38.378 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939681 got 270582939684 for osd.9 2024-09-05T01:23:38.378 DEBUG:teuthology.parallel:result is None 2024-09-05T01:23:38.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:38 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/526886379' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-05T01:23:38.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:38 smithi145 ceph-mon[34376]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:23:38.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:38 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/526886379' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-05T01:23:38.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:38 smithi151 ceph-mon[35013]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:23:38.681 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738450 got 34359738451 for osd.0 2024-09-05T01:23:38.681 DEBUG:teuthology.parallel:result is None 2024-09-05T01:23:38.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.892+0000 7f6fafe00640 1 -- 172.21.15.12:0/349603965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fb0102b90 msgr2=0x7f6fb0102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:38.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.892+0000 7f6fafe00640 1 --2- 172.21.15.12:0/349603965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fb0102b90 0x7f6fb0102f70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0009900 tx=0x7f6fa002a480 comp rx=0 tx=0).stop 2024-09-05T01:23:38.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.892+0000 7f6fafe00640 1 -- 172.21.15.12:0/349603965 shutdown_connections 2024-09-05T01:23:38.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.892+0000 7f6fafe00640 1 --2- 172.21.15.12:0/349603965 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6fb010bfc0 0x7f6fb010e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:38.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.892+0000 7f6fafe00640 1 --2- 172.21.15.12:0/349603965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fb01034b0 0x7f6fb010b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:38.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.892+0000 7f6fafe00640 1 --2- 172.21.15.12:0/349603965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fb0102b90 0x7f6fb0102f70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:38.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.892+0000 7f6fafe00640 1 -- 172.21.15.12:0/349603965 >> 172.21.15.12:0/349603965 conn(0x7f6fb00fc610 msgr2=0x7f6fb00fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:38.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.893+0000 7f6fafe00640 1 -- 172.21.15.12:0/349603965 shutdown_connections 2024-09-05T01:23:38.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.893+0000 7f6fafe00640 1 -- 172.21.15.12:0/349603965 wait complete. 2024-09-05T01:23:38.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.894+0000 7f6fafe00640 1 Processor -- start 2024-09-05T01:23:38.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.894+0000 7f6fafe00640 1 -- start start 2024-09-05T01:23:38.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.894+0000 7f6fafe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6fb0102b90 0x7f6fb019eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:38.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.895+0000 7f6fafe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fb01034b0 0x7f6fb019f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:38.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.895+0000 7f6fafe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fb010bfc0 0x7f6fb010abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:38.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.895+0000 7f6fafe00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb0111dc0 con 0x7f6fb010bfc0 2024-09-05T01:23:38.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.895+0000 7f6fafe00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb0111c40 con 0x7f6fb0102b90 2024-09-05T01:23:38.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.895+0000 7f6fafe00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb0111f40 con 0x7f6fb01034b0 2024-09-05T01:23:38.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.895+0000 7f6faf400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fb010bfc0 0x7f6fb010abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:38.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.895+0000 7f6faf400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fb010bfc0 0x7f6fb010abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41498/0 (socket says 172.21.15.12:41498) 2024-09-05T01:23:38.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.895+0000 7f6faf400640 1 -- 172.21.15.12:0/912223731 learned_addr learned my addr 172.21.15.12:0/912223731 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:38.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.895+0000 7f6fa7e00640 1 --2- 172.21.15.12:0/912223731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fb01034b0 0x7f6fb019f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:38.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.895+0000 7f6faf400640 1 -- 172.21.15.12:0/912223731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fb01034b0 msgr2=0x7f6fb019f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:38.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.895+0000 7f6faf400640 1 --2- 172.21.15.12:0/912223731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fb01034b0 0x7f6fb019f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:38.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.895+0000 7f6faf400640 1 -- 172.21.15.12:0/912223731 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6fb0102b90 msgr2=0x7f6fb019eee0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-05T01:23:38.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.895+0000 7f6faf400640 1 --2- 172.21.15.12:0/912223731 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6fb0102b90 0x7f6fb019eee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:38.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.895+0000 7f6faf400640 1 -- 172.21.15.12:0/912223731 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb010b480 con 0x7f6fb010bfc0 2024-09-05T01:23:38.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.896+0000 7f6faf400640 1 --2- 172.21.15.12:0/912223731 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fb010bfc0 0x7f6fb010abc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800eb10 tx=0x7f6fa800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:38.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.896+0000 7f6fa7400640 1 -- 172.21.15.12:0/912223731 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8004b20 con 0x7f6fb010bfc0 2024-09-05T01:23:38.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.896+0000 7f6fa7400640 1 -- 172.21.15.12:0/912223731 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6fa8004cc0 con 0x7f6fb010bfc0 2024-09-05T01:23:38.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.896+0000 7f6fa7400640 1 -- 172.21.15.12:0/912223731 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8010760 con 0x7f6fb010bfc0 2024-09-05T01:23:38.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.896+0000 7f6fafe00640 1 -- 172.21.15.12:0/912223731 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fb010b770 con 0x7f6fb010bfc0 2024-09-05T01:23:38.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.897+0000 7f6fafe00640 1 -- 172.21.15.12:0/912223731 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fb019ab00 con 0x7f6fb010bfc0 2024-09-05T01:23:38.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.898+0000 7f6fafe00640 1 -- 172.21.15.12:0/912223731 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fb006a850 con 0x7f6fb010bfc0 2024-09-05T01:23:38.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.902+0000 7f6fa7400640 1 -- 172.21.15.12:0/912223731 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6fa8005000 con 0x7f6fb010bfc0 2024-09-05T01:23:38.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.905+0000 7f6fa7400640 1 --2- 172.21.15.12:0/912223731 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6f940a2c10 0x7f6f940a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:38.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.905+0000 7f6fa7400640 1 -- 172.21.15.12:0/912223731 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f6fa80d0080 con 0x7f6fb010bfc0 2024-09-05T01:23:38.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.905+0000 7f6faea00640 1 --2- 172.21.15.12:0/912223731 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6f940a2c10 0x7f6f940a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:38.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.906+0000 7f6fa7400640 1 -- 172.21.15.12:0/912223731 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6fa809ce10 con 0x7f6fb010bfc0 2024-09-05T01:23:38.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:38.906+0000 7f6faea00640 1 --2- 172.21.15.12:0/912223731 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6f940a2c10 0x7f6f940a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6fa002a9a0 tx=0x7f6fa0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:39.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:39.104+0000 7f6fafe00640 1 -- 172.21.15.12:0/912223731 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f6fb0102f70 con 0x7f6fb010bfc0 2024-09-05T01:23:39.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:39.105+0000 7f6fa7400640 1 -- 172.21.15.12:0/912223731 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6fb0102f70 con 0x7f6fb010bfc0 2024-09-05T01:23:39.106 INFO:teuthology.orchestra.run.smithi012.stdout:188978561077 2024-09-05T01:23:39.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:39.107+0000 7f6fafe00640 1 -- 172.21.15.12:0/912223731 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6f940a2c10 msgr2=0x7f6f940a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:39.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:39.107+0000 7f6fafe00640 1 --2- 172.21.15.12:0/912223731 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6f940a2c10 0x7f6f940a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6fa002a9a0 tx=0x7f6fa0000bc0 comp rx=0 tx=0).stop 2024-09-05T01:23:39.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:39.107+0000 7f6fafe00640 1 -- 172.21.15.12:0/912223731 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fb010bfc0 msgr2=0x7f6fb010abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:39.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:39.107+0000 7f6fafe00640 1 --2- 172.21.15.12:0/912223731 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fb010bfc0 0x7f6fb010abc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800eb10 tx=0x7f6fa800c2d0 comp rx=0 tx=0).stop 2024-09-05T01:23:39.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:39.107+0000 7f6fafe00640 1 -- 172.21.15.12:0/912223731 shutdown_connections 2024-09-05T01:23:39.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:39.107+0000 7f6fafe00640 1 --2- 172.21.15.12:0/912223731 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6f940a2c10 0x7f6f940a50d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:39.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:39.107+0000 7f6fafe00640 1 --2- 172.21.15.12:0/912223731 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fb010bfc0 0x7f6fb010abc0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:39.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:39.107+0000 7f6fafe00640 1 --2- 172.21.15.12:0/912223731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fb01034b0 0x7f6fb019f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:39.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:39.107+0000 7f6fafe00640 1 --2- 172.21.15.12:0/912223731 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6fb0102b90 0x7f6fb019eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:39.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:39.107+0000 7f6fafe00640 1 -- 172.21.15.12:0/912223731 >> 172.21.15.12:0/912223731 conn(0x7f6fb00fc610 msgr2=0x7f6fb010d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:39.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:39.108+0000 7f6fafe00640 1 -- 172.21.15.12:0/912223731 shutdown_connections 2024-09-05T01:23:39.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:39.108+0000 7f6fafe00640 1 -- 172.21.15.12:0/912223731 wait complete. 2024-09-05T01:23:39.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:39 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/912223731' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-05T01:23:39.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:39 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/912223731' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-05T01:23:39.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:39 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/912223731' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-05T01:23:39.713 INFO:tasks.cephadm.ceph_manager.ceph:need seq 322122547223 got 322122547225 for osd.11 2024-09-05T01:23:39.713 DEBUG:teuthology.parallel:result is None 2024-09-05T01:23:39.936 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168614 got 240518168617 for osd.8 2024-09-05T01:23:39.937 DEBUG:teuthology.parallel:result is None 2024-09-05T01:23:40.220 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790007 got 158913790009 for osd.5 2024-09-05T01:23:40.220 DEBUG:teuthology.parallel:result is None 2024-09-05T01:23:40.438 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:40 smithi012 ceph-mon[29942]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T01:23:40.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:40 smithi145 ceph-mon[34376]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T01:23:40.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:40 smithi151 ceph-mon[35013]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T01:23:41.497 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574923 got 55834574926 for osd.1 2024-09-05T01:23:41.497 DEBUG:teuthology.parallel:result is None 2024-09-05T01:23:42.067 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182463 got 107374182467 for osd.3 2024-09-05T01:23:42.068 DEBUG:teuthology.parallel:result is None 2024-09-05T01:23:42.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:42 smithi012 ceph-mon[29942]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:23:42.462 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:42.496 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561075 got 188978561077 for osd.6 2024-09-05T01:23:42.497 DEBUG:teuthology.parallel:result is None 2024-09-05T01:23:42.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:42 smithi145 ceph-mon[34376]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:23:42.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:42 smithi151 ceph-mon[35013]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:23:43.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:42.998+0000 7f527ea00640 1 -- 172.21.15.12:0/472025921 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52780745c0 msgr2=0x7f52780749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:43.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:42.998+0000 7f527ea00640 1 --2- 172.21.15.12:0/472025921 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52780745c0 0x7f52780749a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f526c009900 tx=0x7f526c02a480 comp rx=0 tx=0).stop 2024-09-05T01:23:43.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:42.998+0000 7f527ea00640 1 -- 172.21.15.12:0/472025921 shutdown_connections 2024-09-05T01:23:43.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:42.998+0000 7f527ea00640 1 --2- 172.21.15.12:0/472025921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f527810e260 0x7f5278110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:43.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:42.998+0000 7f527ea00640 1 --2- 172.21.15.12:0/472025921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5278074ee0 0x7f527810dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:43.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:42.998+0000 7f527ea00640 1 --2- 172.21.15.12:0/472025921 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52780745c0 0x7f52780749a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:43.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:42.998+0000 7f527ea00640 1 -- 172.21.15.12:0/472025921 >> 172.21.15.12:0/472025921 conn(0x7f52780fd740 msgr2=0x7f52780ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:43.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:42.998+0000 7f527ea00640 1 -- 172.21.15.12:0/472025921 shutdown_connections 2024-09-05T01:23:43.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:42.998+0000 7f527ea00640 1 -- 172.21.15.12:0/472025921 wait complete. 2024-09-05T01:23:43.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:42.999+0000 7f527ea00640 1 Processor -- start 2024-09-05T01:23:43.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.000+0000 7f527ea00640 1 -- start start 2024-09-05T01:23:43.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.000+0000 7f527ea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52780745c0 0x7f527819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:43.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.000+0000 7f527ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5278074ee0 0x7f527819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:43.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.000+0000 7f527ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f527810e260 0x7f527819ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:43.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.000+0000 7f527ea00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5278113fb0 con 0x7f5278074ee0 2024-09-05T01:23:43.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.000+0000 7f527ea00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5278113e30 con 0x7f52780745c0 2024-09-05T01:23:43.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.000+0000 7f527ea00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5278114130 con 0x7f527810e260 2024-09-05T01:23:43.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.000+0000 7f527cc00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5278074ee0 0x7f527819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:43.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.000+0000 7f527cc00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5278074ee0 0x7f527819a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41518/0 (socket says 172.21.15.12:41518) 2024-09-05T01:23:43.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.000+0000 7f527cc00640 1 -- 172.21.15.12:0/2837178954 learned_addr learned my addr 172.21.15.12:0/2837178954 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:43.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.000+0000 7f527d600640 1 --2- 172.21.15.12:0/2837178954 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52780745c0 0x7f527819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:43.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.000+0000 7f527e000640 1 --2- 172.21.15.12:0/2837178954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f527810e260 0x7f527819ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:43.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.001+0000 7f527cc00640 1 -- 172.21.15.12:0/2837178954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f527810e260 msgr2=0x7f527819ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:43.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.001+0000 7f527cc00640 1 --2- 172.21.15.12:0/2837178954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f527810e260 0x7f527819ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:43.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.001+0000 7f527cc00640 1 -- 172.21.15.12:0/2837178954 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52780745c0 msgr2=0x7f527819a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:43.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.001+0000 7f527cc00640 1 --2- 172.21.15.12:0/2837178954 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52780745c0 0x7f527819a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:43.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.001+0000 7f527cc00640 1 -- 172.21.15.12:0/2837178954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f527819f420 con 0x7f5278074ee0 2024-09-05T01:23:43.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.001+0000 7f527cc00640 1 --2- 172.21.15.12:0/2837178954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5278074ee0 0x7f527819a9b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f526400e9f0 tx=0x7f526400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:43.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.001+0000 7f5276000640 1 -- 172.21.15.12:0/2837178954 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526400cd80 con 0x7f5278074ee0 2024-09-05T01:23:43.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.001+0000 7f527ea00640 1 -- 172.21.15.12:0/2837178954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f527819f710 con 0x7f5278074ee0 2024-09-05T01:23:43.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.001+0000 7f5276000640 1 -- 172.21.15.12:0/2837178954 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5264010910 con 0x7f5278074ee0 2024-09-05T01:23:43.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.001+0000 7f5276000640 1 -- 172.21.15.12:0/2837178954 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52640188f0 con 0x7f5278074ee0 2024-09-05T01:23:43.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.002+0000 7f527ea00640 1 -- 172.21.15.12:0/2837178954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52781a6ff0 con 0x7f5278074ee0 2024-09-05T01:23:43.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.003+0000 7f527ea00640 1 -- 172.21.15.12:0/2837178954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52780749a0 con 0x7f5278074ee0 2024-09-05T01:23:43.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.004+0000 7f5276000640 1 -- 172.21.15.12:0/2837178954 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5264010ac0 con 0x7f5278074ee0 2024-09-05T01:23:43.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.006+0000 7f5276000640 1 --2- 172.21.15.12:0/2837178954 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f52600a2c90 0x7f52600a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:43.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.006+0000 7f5276000640 1 -- 172.21.15.12:0/2837178954 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f52640cf580 con 0x7f5278074ee0 2024-09-05T01:23:43.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.007+0000 7f527d600640 1 --2- 172.21.15.12:0/2837178954 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f52600a2c90 0x7f52600a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:43.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.007+0000 7f527d600640 1 --2- 172.21.15.12:0/2837178954 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f52600a2c90 0x7f52600a5150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f526c009230 tx=0x7f526c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:43.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.010+0000 7f5276000640 1 -- 172.21.15.12:0/2837178954 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f526409bcc0 con 0x7f5278074ee0 2024-09-05T01:23:43.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.221+0000 7f527ea00640 1 -- 172.21.15.12:0/2837178954 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5278108e50 con 0x7f5278074ee0 2024-09-05T01:23:43.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.221+0000 7f5276000640 1 -- 172.21.15.12:0/2837178954 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f526409ffc0 con 0x7f5278074ee0 2024-09-05T01:23:43.222 INFO:teuthology.orchestra.run.smithi012.stdout:77309411403 2024-09-05T01:23:43.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.224+0000 7f527ea00640 1 -- 172.21.15.12:0/2837178954 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f52600a2c90 msgr2=0x7f52600a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:43.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.224+0000 7f527ea00640 1 --2- 172.21.15.12:0/2837178954 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f52600a2c90 0x7f52600a5150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f526c009230 tx=0x7f526c0058d0 comp rx=0 tx=0).stop 2024-09-05T01:23:43.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.224+0000 7f527ea00640 1 -- 172.21.15.12:0/2837178954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5278074ee0 msgr2=0x7f527819a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:43.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.224+0000 7f527ea00640 1 --2- 172.21.15.12:0/2837178954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5278074ee0 0x7f527819a9b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f526400e9f0 tx=0x7f526400eeb0 comp rx=0 tx=0).stop 2024-09-05T01:23:43.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.224+0000 7f527ea00640 1 -- 172.21.15.12:0/2837178954 shutdown_connections 2024-09-05T01:23:43.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.224+0000 7f527ea00640 1 --2- 172.21.15.12:0/2837178954 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f52600a2c90 0x7f52600a5150 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:43.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.224+0000 7f527ea00640 1 --2- 172.21.15.12:0/2837178954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f527810e260 0x7f527819ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:43.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.224+0000 7f527ea00640 1 --2- 172.21.15.12:0/2837178954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5278074ee0 0x7f527819a9b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:43.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.224+0000 7f527ea00640 1 --2- 172.21.15.12:0/2837178954 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f52780745c0 0x7f527819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:43.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.224+0000 7f527ea00640 1 -- 172.21.15.12:0/2837178954 >> 172.21.15.12:0/2837178954 conn(0x7f52780fd740 msgr2=0x7f52780fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:43.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.225+0000 7f527ea00640 1 -- 172.21.15.12:0/2837178954 shutdown_connections 2024-09-05T01:23:43.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:43.225+0000 7f527ea00640 1 -- 172.21.15.12:0/2837178954 wait complete. 2024-09-05T01:23:43.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:43 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2837178954' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-05T01:23:43.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:43 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/2837178954' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-05T01:23:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:43 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/2837178954' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-05T01:23:43.915 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411400 got 77309411403 for osd.2 2024-09-05T01:23:43.915 DEBUG:teuthology.parallel:result is None 2024-09-05T01:23:43.916 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-05T01:23:43.916 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph pg dump --format=json 2024-09-05T01:23:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:44.779 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:44 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:23:44.779 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:44 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:23:44.779 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:44 smithi012 ceph-mon[29942]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:23:44.779 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:44 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:23:44.779 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:44 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:23:44.779 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:44 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:23:44.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.890+0000 7fa1f1400640 1 -- 172.21.15.12:0/2650421800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1ec076720 msgr2=0x7fa1ec076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:44.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.890+0000 7fa1f1400640 1 --2- 172.21.15.12:0/2650421800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1ec076720 0x7fa1ec076b00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc009900 tx=0x7fa1dc02a3f0 comp rx=0 tx=0).stop 2024-09-05T01:23:44.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.890+0000 7fa1f1400640 1 -- 172.21.15.12:0/2650421800 shutdown_connections 2024-09-05T01:23:44.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.890+0000 7fa1f1400640 1 --2- 172.21.15.12:0/2650421800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1ec112a30 0x7fa1ec114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:44.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.890+0000 7fa1f1400640 1 --2- 172.21.15.12:0/2650421800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa1ec077040 0x7fa1ec1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:44.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.890+0000 7fa1f1400640 1 --2- 172.21.15.12:0/2650421800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1ec076720 0x7fa1ec076b00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:44.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.890+0000 7fa1f1400640 1 -- 172.21.15.12:0/2650421800 >> 172.21.15.12:0/2650421800 conn(0x7fa1ec0ffa90 msgr2=0x7fa1ec101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:44.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.890+0000 7fa1f1400640 1 -- 172.21.15.12:0/2650421800 shutdown_connections 2024-09-05T01:23:44.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.890+0000 7fa1f1400640 1 -- 172.21.15.12:0/2650421800 wait complete. 2024-09-05T01:23:44.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.891+0000 7fa1f1400640 1 Processor -- start 2024-09-05T01:23:44.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.891+0000 7fa1f1400640 1 -- start start 2024-09-05T01:23:44.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.892+0000 7fa1f1400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa1ec076720 0x7fa1ec1a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:44.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.892+0000 7fa1f1400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1ec077040 0x7fa1ec1a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:44.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.892+0000 7fa1f1400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1ec112a30 0x7fa1ec19e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:44.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.892+0000 7fa1f1400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ec1185c0 con 0x7fa1ec112a30 2024-09-05T01:23:44.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.892+0000 7fa1f1400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ec118440 con 0x7fa1ec076720 2024-09-05T01:23:44.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.892+0000 7fa1f1400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ec118740 con 0x7fa1ec077040 2024-09-05T01:23:44.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.892+0000 7fa1eb200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1ec112a30 0x7fa1ec19e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:44.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.892+0000 7fa1e9e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1ec077040 0x7fa1ec1a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:44.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.892+0000 7fa1ea800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa1ec076720 0x7fa1ec1a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:44.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.892+0000 7fa1e9e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1ec077040 0x7fa1ec1a4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:33176/0 (socket says 172.21.15.12:33176) 2024-09-05T01:23:44.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.892+0000 7fa1e9e00640 1 -- 172.21.15.12:0/1305901953 learned_addr learned my addr 172.21.15.12:0/1305901953 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:44.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.893+0000 7fa1e9e00640 1 -- 172.21.15.12:0/1305901953 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa1ec076720 msgr2=0x7fa1ec1a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:44.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.893+0000 7fa1e9e00640 1 --2- 172.21.15.12:0/1305901953 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa1ec076720 0x7fa1ec1a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:44.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.893+0000 7fa1e9e00640 1 -- 172.21.15.12:0/1305901953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1ec112a30 msgr2=0x7fa1ec19e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:44.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.893+0000 7fa1e9e00640 1 --2- 172.21.15.12:0/1305901953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1ec112a30 0x7fa1ec19e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:44.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.893+0000 7fa1e9e00640 1 -- 172.21.15.12:0/1305901953 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1ec19efc0 con 0x7fa1ec077040 2024-09-05T01:23:44.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.893+0000 7fa1e9e00640 1 --2- 172.21.15.12:0/1305901953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1ec077040 0x7fa1ec1a4c10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800e9f0 tx=0x7fa1d800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:44.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.893+0000 7fa1e3400640 1 -- 172.21.15.12:0/1305901953 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d800cd80 con 0x7fa1ec077040 2024-09-05T01:23:44.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.893+0000 7fa1e3400640 1 -- 172.21.15.12:0/1305901953 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1d8010910 con 0x7fa1ec077040 2024-09-05T01:23:44.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.893+0000 7fa1f1400640 1 -- 172.21.15.12:0/1305901953 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1ec19f2b0 con 0x7fa1ec077040 2024-09-05T01:23:44.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.893+0000 7fa1e3400640 1 -- 172.21.15.12:0/1305901953 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8018990 con 0x7fa1ec077040 2024-09-05T01:23:44.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.893+0000 7fa1f1400640 1 -- 172.21.15.12:0/1305901953 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1ec1ab5a0 con 0x7fa1ec077040 2024-09-05T01:23:44.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.894+0000 7fa1f1400640 1 -- 172.21.15.12:0/1305901953 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1ec076b00 con 0x7fa1ec077040 2024-09-05T01:23:44.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.897+0000 7fa1e3400640 1 -- 172.21.15.12:0/1305901953 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa1d8010ac0 con 0x7fa1ec077040 2024-09-05T01:23:44.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.898+0000 7fa1e3400640 1 --2- 172.21.15.12:0/1305901953 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa1d00a2c10 0x7fa1d00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:44.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.898+0000 7fa1e3400640 1 -- 172.21.15.12:0/1305901953 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7fa1d80cf550 con 0x7fa1ec077040 2024-09-05T01:23:44.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.898+0000 7fa1ea800640 1 --2- 172.21.15.12:0/1305901953 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa1d00a2c10 0x7fa1d00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:44.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.899+0000 7fa1ea800640 1 --2- 172.21.15.12:0/1305901953 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa1d00a2c10 0x7fa1d00a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec19f9d0 tx=0x7fa1dc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:44.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:44.902+0000 7fa1e3400640 1 -- 172.21.15.12:0/1305901953 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa1d809bc90 con 0x7fa1ec077040 2024-09-05T01:23:45.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:44 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:23:45.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:44 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:23:45.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:44 smithi145 ceph-mon[34376]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:23:45.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:44 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:23:45.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:44 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:23:45.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:44 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:23:45.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:45.090+0000 7fa1f1400640 1 -- 172.21.15.12:0/1305901953 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa1ec1146a0 con 0x7fa1d00a2c10 2024-09-05T01:23:45.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:45.097+0000 7fa1e3400640 1 -- 172.21.15.12:0/1305901953 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258763 (secure 0 0 0) 0x7fa1ec1146a0 con 0x7fa1d00a2c10 2024-09-05T01:23:45.102 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:23:45.103 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-05T01:23:45.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:45.101+0000 7fa1f1400640 1 -- 172.21.15.12:0/1305901953 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa1d00a2c10 msgr2=0x7fa1d00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:45.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:45.101+0000 7fa1f1400640 1 --2- 172.21.15.12:0/1305901953 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa1d00a2c10 0x7fa1d00a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec19f9d0 tx=0x7fa1dc0058d0 comp rx=0 tx=0).stop 2024-09-05T01:23:45.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:45.101+0000 7fa1f1400640 1 -- 172.21.15.12:0/1305901953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1ec077040 msgr2=0x7fa1ec1a4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:45.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:45.101+0000 7fa1f1400640 1 --2- 172.21.15.12:0/1305901953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1ec077040 0x7fa1ec1a4c10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800e9f0 tx=0x7fa1d800eeb0 comp rx=0 tx=0).stop 2024-09-05T01:23:45.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:45.101+0000 7fa1f1400640 1 -- 172.21.15.12:0/1305901953 shutdown_connections 2024-09-05T01:23:45.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:45.101+0000 7fa1f1400640 1 --2- 172.21.15.12:0/1305901953 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa1d00a2c10 0x7fa1d00a50d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:45.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:45.101+0000 7fa1f1400640 1 --2- 172.21.15.12:0/1305901953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1ec112a30 0x7fa1ec19e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:45.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:45.101+0000 7fa1f1400640 1 --2- 172.21.15.12:0/1305901953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1ec077040 0x7fa1ec1a4c10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:45.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:45.101+0000 7fa1f1400640 1 --2- 172.21.15.12:0/1305901953 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa1ec076720 0x7fa1ec1a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:45.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:45.101+0000 7fa1f1400640 1 -- 172.21.15.12:0/1305901953 >> 172.21.15.12:0/1305901953 conn(0x7fa1ec0ffa90 msgr2=0x7fa1ec101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:45.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:45.101+0000 7fa1f1400640 1 -- 172.21.15.12:0/1305901953 shutdown_connections 2024-09-05T01:23:45.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:45.102+0000 7fa1f1400640 1 -- 172.21.15.12:0/1305901953 wait complete. 2024-09-05T01:23:45.108 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:44 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:23:45.108 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:44 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:23:45.108 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:44 smithi151 ceph-mon[35013]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:23:45.108 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:44 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:23:45.108 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:44 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:23:45.108 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:44 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' 2024-09-05T01:23:45.791 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:45 smithi012 ceph-mon[29942]: from='client.24859 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T01:23:45.829 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2024-09-05T01:23:44.197913+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659402,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":688,"num_read_kb":485,"num_write":425,"num_write_kb":3075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1181906,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":347,"ondisk_log_size":347,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370508,"kb_used_data":12876,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571316,"statfs":{"total":1151940427776,"available":1151561027584,"internally_reserved":0,"allocated":13185024,"data_stored":7220322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002989"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.193533+0000","last_change":"2024-09-05T01:22:35.038389+0000","last_active":"2024-09-05T01:23:23.193533+0000","last_peered":"2024-09-05T01:23:23.193533+0000","last_clean":"2024-09-05T01:23:23.193533+0000","last_became_active":"2024-09-05T01:22:35.037982+0000","last_became_peered":"2024-09-05T01:22:35.037982+0000","last_unstale":"2024-09-05T01:23:23.193533+0000","last_undegraded":"2024-09-05T01:23:23.193533+0000","last_fullsized":"2024-09-05T01:23:23.193533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:23:33.802592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192317+0000","last_change":"2024-09-05T01:22:35.035340+0000","last_active":"2024-09-05T01:23:23.192317+0000","last_peered":"2024-09-05T01:23:23.192317+0000","last_clean":"2024-09-05T01:23:23.192317+0000","last_became_active":"2024-09-05T01:22:35.032871+0000","last_became_peered":"2024-09-05T01:22:35.032871+0000","last_unstale":"2024-09-05T01:23:23.192317+0000","last_undegraded":"2024-09-05T01:23:23.192317+0000","last_fullsized":"2024-09-05T01:23:23.192317+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:51:07.235915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.191075+0000","last_change":"2024-09-05T01:22:35.045443+0000","last_active":"2024-09-05T01:23:23.191075+0000","last_peered":"2024-09-05T01:23:23.191075+0000","last_clean":"2024-09-05T01:23:23.191075+0000","last_became_active":"2024-09-05T01:22:35.042342+0000","last_became_peered":"2024-09-05T01:22:35.042342+0000","last_unstale":"2024-09-05T01:23:23.191075+0000","last_undegraded":"2024-09-05T01:23:23.191075+0000","last_fullsized":"2024-09-05T01:23:23.191075+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:42:46.878959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.190993+0000","last_change":"2024-09-05T01:22:35.041527+0000","last_active":"2024-09-05T01:23:23.190993+0000","last_peered":"2024-09-05T01:23:23.190993+0000","last_clean":"2024-09-05T01:23:23.190993+0000","last_became_active":"2024-09-05T01:22:35.041210+0000","last_became_peered":"2024-09-05T01:22:35.041210+0000","last_unstale":"2024-09-05T01:23:23.190993+0000","last_undegraded":"2024-09-05T01:23:23.190993+0000","last_fullsized":"2024-09-05T01:23:23.190993+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:22:28.770307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.190958+0000","last_change":"2024-09-05T01:22:35.036810+0000","last_active":"2024-09-05T01:23:23.190958+0000","last_peered":"2024-09-05T01:23:23.190958+0000","last_clean":"2024-09-05T01:23:23.190958+0000","last_became_active":"2024-09-05T01:22:35.036435+0000","last_became_peered":"2024-09-05T01:22:35.036435+0000","last_unstale":"2024-09-05T01:23:23.190958+0000","last_undegraded":"2024-09-05T01:23:23.190958+0000","last_fullsized":"2024-09-05T01:23:23.190958+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:41:43.649178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248372+0000","last_change":"2024-09-05T01:22:35.039198+0000","last_active":"2024-09-05T01:23:23.248372+0000","last_peered":"2024-09-05T01:23:23.248372+0000","last_clean":"2024-09-05T01:23:23.248372+0000","last_became_active":"2024-09-05T01:22:35.038822+0000","last_became_peered":"2024-09-05T01:22:35.038822+0000","last_unstale":"2024-09-05T01:23:23.248372+0000","last_undegraded":"2024-09-05T01:23:23.248372+0000","last_fullsized":"2024-09-05T01:23:23.248372+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:22:08.600927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.193045+0000","last_change":"2024-09-05T01:22:35.034687+0000","last_active":"2024-09-05T01:23:23.193045+0000","last_peered":"2024-09-05T01:23:23.193045+0000","last_clean":"2024-09-05T01:23:23.193045+0000","last_became_active":"2024-09-05T01:22:35.034351+0000","last_became_peered":"2024-09-05T01:22:35.034351+0000","last_unstale":"2024-09-05T01:23:23.193045+0000","last_undegraded":"2024-09-05T01:23:23.193045+0000","last_fullsized":"2024-09-05T01:23:23.193045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:38:27.311348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.251054+0000","last_change":"2024-09-05T01:23:23.250016+0000","last_active":"2024-09-05T01:23:23.251054+0000","last_peered":"2024-09-05T01:23:23.251054+0000","last_clean":"2024-09-05T01:23:23.251054+0000","last_became_active":"2024-09-05T01:23:23.249553+0000","last_became_peered":"2024-09-05T01:23:23.249553+0000","last_unstale":"2024-09-05T01:23:23.251054+0000","last_undegraded":"2024-09-05T01:23:23.251054+0000","last_fullsized":"2024-09-05T01:23:23.251054+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:06:32.460400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.186568+0000","last_change":"2024-09-05T01:22:35.036394+0000","last_active":"2024-09-05T01:23:23.186568+0000","last_peered":"2024-09-05T01:23:23.186568+0000","last_clean":"2024-09-05T01:23:23.186568+0000","last_became_active":"2024-09-05T01:22:35.035990+0000","last_became_peered":"2024-09-05T01:22:35.035990+0000","last_unstale":"2024-09-05T01:23:23.186568+0000","last_undegraded":"2024-09-05T01:23:23.186568+0000","last_fullsized":"2024-09-05T01:23:23.186568+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:42:18.870263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248937+0000","last_change":"2024-09-05T01:22:35.033389+0000","last_active":"2024-09-05T01:23:23.248937+0000","last_peered":"2024-09-05T01:23:23.248937+0000","last_clean":"2024-09-05T01:23:23.248937+0000","last_became_active":"2024-09-05T01:22:35.033081+0000","last_became_peered":"2024-09-05T01:22:35.033081+0000","last_unstale":"2024-09-05T01:23:23.248937+0000","last_undegraded":"2024-09-05T01:23:23.248937+0000","last_fullsized":"2024-09-05T01:23:23.248937+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:53:08.266905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.193290+0000","last_change":"2024-09-05T01:22:35.035768+0000","last_active":"2024-09-05T01:23:23.193290+0000","last_peered":"2024-09-05T01:23:23.193290+0000","last_clean":"2024-09-05T01:23:23.193290+0000","last_became_active":"2024-09-05T01:22:35.035456+0000","last_became_peered":"2024-09-05T01:22:35.035456+0000","last_unstale":"2024-09-05T01:23:23.193290+0000","last_undegraded":"2024-09-05T01:23:23.193290+0000","last_fullsized":"2024-09-05T01:23:23.193290+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:15:48.723816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.190996+0000","last_change":"2024-09-05T01:22:35.040720+0000","last_active":"2024-09-05T01:23:23.190996+0000","last_peered":"2024-09-05T01:23:23.190996+0000","last_clean":"2024-09-05T01:23:23.190996+0000","last_became_active":"2024-09-05T01:22:35.039617+0000","last_became_peered":"2024-09-05T01:22:35.039617+0000","last_unstale":"2024-09-05T01:23:23.190996+0000","last_undegraded":"2024-09-05T01:23:23.190996+0000","last_fullsized":"2024-09-05T01:23:23.190996+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:23:11.633617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248643+0000","last_change":"2024-09-05T01:22:35.022096+0000","last_active":"2024-09-05T01:23:23.248643+0000","last_peered":"2024-09-05T01:23:23.248643+0000","last_clean":"2024-09-05T01:23:23.248643+0000","last_became_active":"2024-09-05T01:22:35.021707+0000","last_became_peered":"2024-09-05T01:22:35.021707+0000","last_unstale":"2024-09-05T01:23:23.248643+0000","last_undegraded":"2024-09-05T01:23:23.248643+0000","last_fullsized":"2024-09-05T01:23:23.248643+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:50:35.035386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.190882+0000","last_change":"2024-09-05T01:22:35.034481+0000","last_active":"2024-09-05T01:23:23.190882+0000","last_peered":"2024-09-05T01:23:23.190882+0000","last_clean":"2024-09-05T01:23:23.190882+0000","last_became_active":"2024-09-05T01:22:35.034145+0000","last_became_peered":"2024-09-05T01:22:35.034145+0000","last_unstale":"2024-09-05T01:23:23.190882+0000","last_undegraded":"2024-09-05T01:23:23.190882+0000","last_fullsized":"2024-09-05T01:23:23.190882+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:19:33.386981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.195234+0000","last_change":"2024-09-05T01:23:23.195234+0000","last_active":"2024-09-05T01:23:23.195234+0000","last_peered":"2024-09-05T01:23:23.195234+0000","last_clean":"2024-09-05T01:23:23.195234+0000","last_became_active":"2024-09-05T01:23:23.194014+0000","last_became_peered":"2024-09-05T01:23:23.194014+0000","last_unstale":"2024-09-05T01:23:23.195234+0000","last_undegraded":"2024-09-05T01:23:23.195234+0000","last_fullsized":"2024-09-05T01:23:23.195234+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:05:38.517017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.186024+0000","last_change":"2024-09-05T01:22:35.046517+0000","last_active":"2024-09-05T01:23:23.186024+0000","last_peered":"2024-09-05T01:23:23.186024+0000","last_clean":"2024-09-05T01:23:23.186024+0000","last_became_active":"2024-09-05T01:22:35.046230+0000","last_became_peered":"2024-09-05T01:22:35.046230+0000","last_unstale":"2024-09-05T01:23:23.186024+0000","last_undegraded":"2024-09-05T01:23:23.186024+0000","last_fullsized":"2024-09-05T01:23:23.186024+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:16:49.672039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.193555+0000","last_change":"2024-09-05T01:22:35.041140+0000","last_active":"2024-09-05T01:23:23.193555+0000","last_peered":"2024-09-05T01:23:23.193555+0000","last_clean":"2024-09-05T01:23:23.193555+0000","last_became_active":"2024-09-05T01:22:35.040838+0000","last_became_peered":"2024-09-05T01:22:35.040838+0000","last_unstale":"2024-09-05T01:23:23.193555+0000","last_undegraded":"2024-09-05T01:23:23.193555+0000","last_fullsized":"2024-09-05T01:23:23.193555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:47:55.730240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.188558+0000","last_change":"2024-09-05T01:22:35.036830+0000","last_active":"2024-09-05T01:23:23.188558+0000","last_peered":"2024-09-05T01:23:23.188558+0000","last_clean":"2024-09-05T01:23:23.188558+0000","last_became_active":"2024-09-05T01:22:35.036356+0000","last_became_peered":"2024-09-05T01:22:35.036356+0000","last_unstale":"2024-09-05T01:23:23.188558+0000","last_undegraded":"2024-09-05T01:23:23.188558+0000","last_fullsized":"2024-09-05T01:23:23.188558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:19:01.736301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.188570+0000","last_change":"2024-09-05T01:22:35.036386+0000","last_active":"2024-09-05T01:23:23.188570+0000","last_peered":"2024-09-05T01:23:23.188570+0000","last_clean":"2024-09-05T01:23:23.188570+0000","last_became_active":"2024-09-05T01:22:35.036046+0000","last_became_peered":"2024-09-05T01:22:35.036046+0000","last_unstale":"2024-09-05T01:23:23.188570+0000","last_undegraded":"2024-09-05T01:23:23.188570+0000","last_fullsized":"2024-09-05T01:23:23.188570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:19:37.861719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192734+0000","last_change":"2024-09-05T01:22:35.041077+0000","last_active":"2024-09-05T01:23:23.192734+0000","last_peered":"2024-09-05T01:23:23.192734+0000","last_clean":"2024-09-05T01:23:23.192734+0000","last_became_active":"2024-09-05T01:22:35.040736+0000","last_became_peered":"2024-09-05T01:22:35.040736+0000","last_unstale":"2024-09-05T01:23:23.192734+0000","last_undegraded":"2024-09-05T01:23:23.192734+0000","last_fullsized":"2024-09-05T01:23:23.192734+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:30:54.670559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248663+0000","last_change":"2024-09-05T01:22:35.047774+0000","last_active":"2024-09-05T01:23:23.248663+0000","last_peered":"2024-09-05T01:23:23.248663+0000","last_clean":"2024-09-05T01:23:23.248663+0000","last_became_active":"2024-09-05T01:22:35.047153+0000","last_became_peered":"2024-09-05T01:22:35.047153+0000","last_unstale":"2024-09-05T01:23:23.248663+0000","last_undegraded":"2024-09-05T01:23:23.248663+0000","last_fullsized":"2024-09-05T01:23:23.248663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:07:02.189116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.186196+0000","last_change":"2024-09-05T01:22:35.041346+0000","last_active":"2024-09-05T01:23:23.186196+0000","last_peered":"2024-09-05T01:23:23.186196+0000","last_clean":"2024-09-05T01:23:23.186196+0000","last_became_active":"2024-09-05T01:22:35.040282+0000","last_became_peered":"2024-09-05T01:22:35.040282+0000","last_unstale":"2024-09-05T01:23:23.186196+0000","last_undegraded":"2024-09-05T01:23:23.186196+0000","last_fullsized":"2024-09-05T01:23:23.186196+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:19:38.203479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192064+0000","last_change":"2024-09-05T01:22:35.041780+0000","last_active":"2024-09-05T01:23:23.192064+0000","last_peered":"2024-09-05T01:23:23.192064+0000","last_clean":"2024-09-05T01:23:23.192064+0000","last_became_active":"2024-09-05T01:22:35.038453+0000","last_became_peered":"2024-09-05T01:22:35.038453+0000","last_unstale":"2024-09-05T01:23:23.192064+0000","last_undegraded":"2024-09-05T01:23:23.192064+0000","last_fullsized":"2024-09-05T01:23:23.192064+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:17:56.453627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.189593+0000","last_change":"2024-09-05T01:22:35.038699+0000","last_active":"2024-09-05T01:23:23.189593+0000","last_peered":"2024-09-05T01:23:23.189593+0000","last_clean":"2024-09-05T01:23:23.189593+0000","last_became_active":"2024-09-05T01:22:35.038349+0000","last_became_peered":"2024-09-05T01:22:35.038349+0000","last_unstale":"2024-09-05T01:23:23.189593+0000","last_undegraded":"2024-09-05T01:23:23.189593+0000","last_fullsized":"2024-09-05T01:23:23.189593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:17:18.175643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192883+0000","last_change":"2024-09-05T01:22:35.048281+0000","last_active":"2024-09-05T01:23:23.192883+0000","last_peered":"2024-09-05T01:23:23.192883+0000","last_clean":"2024-09-05T01:23:23.192883+0000","last_became_active":"2024-09-05T01:22:35.047211+0000","last_became_peered":"2024-09-05T01:22:35.047211+0000","last_unstale":"2024-09-05T01:23:23.192883+0000","last_undegraded":"2024-09-05T01:23:23.192883+0000","last_fullsized":"2024-09-05T01:23:23.192883+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:40:43.196562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.188857+0000","last_change":"2024-09-05T01:22:35.041215+0000","last_active":"2024-09-05T01:23:23.188857+0000","last_peered":"2024-09-05T01:23:23.188857+0000","last_clean":"2024-09-05T01:23:23.188857+0000","last_became_active":"2024-09-05T01:22:35.040156+0000","last_became_peered":"2024-09-05T01:22:35.040156+0000","last_unstale":"2024-09-05T01:23:23.188857+0000","last_undegraded":"2024-09-05T01:23:23.188857+0000","last_fullsized":"2024-09-05T01:23:23.188857+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:39:01.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.197568+0000","last_change":"2024-09-05T01:23:23.197568+0000","last_active":"2024-09-05T01:23:23.197568+0000","last_peered":"2024-09-05T01:23:23.197568+0000","last_clean":"2024-09-05T01:23:23.197568+0000","last_became_active":"2024-09-05T01:23:23.197132+0000","last_became_peered":"2024-09-05T01:23:23.197132+0000","last_unstale":"2024-09-05T01:23:23.197568+0000","last_undegraded":"2024-09-05T01:23:23.197568+0000","last_fullsized":"2024-09-05T01:23:23.197568+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:55.524687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248641+0000","last_change":"2024-09-05T01:22:35.038147+0000","last_active":"2024-09-05T01:23:23.248641+0000","last_peered":"2024-09-05T01:23:23.248641+0000","last_clean":"2024-09-05T01:23:23.248641+0000","last_became_active":"2024-09-05T01:22:35.037772+0000","last_became_peered":"2024-09-05T01:22:35.037772+0000","last_unstale":"2024-09-05T01:23:23.248641+0000","last_undegraded":"2024-09-05T01:23:23.248641+0000","last_fullsized":"2024-09-05T01:23:23.248641+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:40:01.786788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.190988+0000","last_change":"2024-09-05T01:22:35.049040+0000","last_active":"2024-09-05T01:23:23.190988+0000","last_peered":"2024-09-05T01:23:23.190988+0000","last_clean":"2024-09-05T01:23:23.190988+0000","last_became_active":"2024-09-05T01:22:35.048373+0000","last_became_peered":"2024-09-05T01:22:35.048373+0000","last_unstale":"2024-09-05T01:23:23.190988+0000","last_undegraded":"2024-09-05T01:23:23.190988+0000","last_fullsized":"2024-09-05T01:23:23.190988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:32:17.316513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.188253+0000","last_change":"2024-09-05T01:22:35.043531+0000","last_active":"2024-09-05T01:23:23.188253+0000","last_peered":"2024-09-05T01:23:23.188253+0000","last_clean":"2024-09-05T01:23:23.188253+0000","last_became_active":"2024-09-05T01:22:35.043145+0000","last_became_peered":"2024-09-05T01:22:35.043145+0000","last_unstale":"2024-09-05T01:23:23.188253+0000","last_undegraded":"2024-09-05T01:23:23.188253+0000","last_fullsized":"2024-09-05T01:23:23.188253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:04:41.902738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.188662+0000","last_change":"2024-09-05T01:22:35.037684+0000","last_active":"2024-09-05T01:23:23.188662+0000","last_peered":"2024-09-05T01:23:23.188662+0000","last_clean":"2024-09-05T01:23:23.188662+0000","last_became_active":"2024-09-05T01:22:35.037392+0000","last_became_peered":"2024-09-05T01:22:35.037392+0000","last_unstale":"2024-09-05T01:23:23.188662+0000","last_undegraded":"2024-09-05T01:23:23.188662+0000","last_fullsized":"2024-09-05T01:23:23.188662+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:12:37.705198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192343+0000","last_change":"2024-09-05T01:22:35.036917+0000","last_active":"2024-09-05T01:23:23.192343+0000","last_peered":"2024-09-05T01:23:23.192343+0000","last_clean":"2024-09-05T01:23:23.192343+0000","last_became_active":"2024-09-05T01:22:35.036597+0000","last_became_peered":"2024-09-05T01:22:35.036597+0000","last_unstale":"2024-09-05T01:23:23.192343+0000","last_undegraded":"2024-09-05T01:23:23.192343+0000","last_fullsized":"2024-09-05T01:23:23.192343+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:25:46.472325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.191250+0000","last_change":"2024-09-05T01:22:35.035858+0000","last_active":"2024-09-05T01:23:23.191250+0000","last_peered":"2024-09-05T01:23:23.191250+0000","last_clean":"2024-09-05T01:23:23.191250+0000","last_became_active":"2024-09-05T01:22:35.035075+0000","last_became_peered":"2024-09-05T01:22:35.035075+0000","last_unstale":"2024-09-05T01:23:23.191250+0000","last_undegraded":"2024-09-05T01:23:23.191250+0000","last_fullsized":"2024-09-05T01:23:23.191250+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:49:42.487427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'6","reported_seq":87,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:40.944801+0000","last_change":"2024-09-05T01:22:32.615444+0000","last_active":"2024-09-05T01:23:40.944801+0000","last_peered":"2024-09-05T01:23:40.944801+0000","last_clean":"2024-09-05T01:23:40.944801+0000","last_became_active":"2024-09-05T01:22:32.615026+0000","last_became_peered":"2024-09-05T01:22:32.615026+0000","last_unstale":"2024-09-05T01:23:40.944801+0000","last_undegraded":"2024-09-05T01:23:40.944801+0000","last_fullsized":"2024-09-05T01:23:40.944801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:52:51.410953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.189651+0000","last_change":"2024-09-05T01:22:35.039341+0000","last_active":"2024-09-05T01:23:23.189651+0000","last_peered":"2024-09-05T01:23:23.189651+0000","last_clean":"2024-09-05T01:23:23.189651+0000","last_became_active":"2024-09-05T01:22:35.038911+0000","last_became_peered":"2024-09-05T01:22:35.038911+0000","last_unstale":"2024-09-05T01:23:23.189651+0000","last_undegraded":"2024-09-05T01:23:23.189651+0000","last_fullsized":"2024-09-05T01:23:23.189651+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:18:41.735302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248449+0000","last_change":"2024-09-05T01:22:32.610256+0000","last_active":"2024-09-05T01:23:23.248449+0000","last_peered":"2024-09-05T01:23:23.248449+0000","last_clean":"2024-09-05T01:23:23.248449+0000","last_became_active":"2024-09-05T01:22:32.609430+0000","last_became_peered":"2024-09-05T01:22:32.609430+0000","last_unstale":"2024-09-05T01:23:23.248449+0000","last_undegraded":"2024-09-05T01:23:23.248449+0000","last_fullsized":"2024-09-05T01:23:23.248449+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:00:13.171249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248379+0000","last_change":"2024-09-05T01:22:32.609238+0000","last_active":"2024-09-05T01:23:23.248379+0000","last_peered":"2024-09-05T01:23:23.248379+0000","last_clean":"2024-09-05T01:23:23.248379+0000","last_became_active":"2024-09-05T01:22:32.608789+0000","last_became_peered":"2024-09-05T01:22:32.608789+0000","last_unstale":"2024-09-05T01:23:23.248379+0000","last_undegraded":"2024-09-05T01:23:23.248379+0000","last_fullsized":"2024-09-05T01:23:23.248379+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:01:55.536313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192061+0000","last_change":"2024-09-05T01:22:35.048262+0000","last_active":"2024-09-05T01:23:23.192061+0000","last_peered":"2024-09-05T01:23:23.192061+0000","last_clean":"2024-09-05T01:23:23.192061+0000","last_became_active":"2024-09-05T01:22:35.046404+0000","last_became_peered":"2024-09-05T01:22:35.046404+0000","last_unstale":"2024-09-05T01:23:23.192061+0000","last_undegraded":"2024-09-05T01:23:23.192061+0000","last_fullsized":"2024-09-05T01:23:23.192061+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:29:04.310095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.189804+0000","last_change":"2024-09-05T01:22:32.612116+0000","last_active":"2024-09-05T01:23:23.189804+0000","last_peered":"2024-09-05T01:23:23.189804+0000","last_clean":"2024-09-05T01:23:23.189804+0000","last_became_active":"2024-09-05T01:22:32.611794+0000","last_became_peered":"2024-09-05T01:22:32.611794+0000","last_unstale":"2024-09-05T01:23:23.189804+0000","last_undegraded":"2024-09-05T01:23:23.189804+0000","last_fullsized":"2024-09-05T01:23:23.189804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:59:55.360151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.250108+0000","last_change":"2024-09-05T01:23:23.250108+0000","last_active":"2024-09-05T01:23:23.250108+0000","last_peered":"2024-09-05T01:23:23.250108+0000","last_clean":"2024-09-05T01:23:23.250108+0000","last_became_active":"2024-09-05T01:23:23.249698+0000","last_became_peered":"2024-09-05T01:23:23.249698+0000","last_unstale":"2024-09-05T01:23:23.250108+0000","last_undegraded":"2024-09-05T01:23:23.250108+0000","last_fullsized":"2024-09-05T01:23:23.250108+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:55:45.998595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,10],"acting":[9,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'4","reported_seq":132,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:38.941260+0000","last_change":"2024-09-05T01:22:32.611558+0000","last_active":"2024-09-05T01:23:38.941260+0000","last_peered":"2024-09-05T01:23:38.941260+0000","last_clean":"2024-09-05T01:23:38.941260+0000","last_became_active":"2024-09-05T01:22:32.611194+0000","last_became_peered":"2024-09-05T01:22:32.611194+0000","last_unstale":"2024-09-05T01:23:38.941260+0000","last_undegraded":"2024-09-05T01:23:38.941260+0000","last_fullsized":"2024-09-05T01:23:38.941260+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:47:30.586224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.186555+0000","last_change":"2024-09-05T01:22:35.042010+0000","last_active":"2024-09-05T01:23:23.186555+0000","last_peered":"2024-09-05T01:23:23.186555+0000","last_clean":"2024-09-05T01:23:23.186555+0000","last_became_active":"2024-09-05T01:22:35.041451+0000","last_became_peered":"2024-09-05T01:22:35.041451+0000","last_unstale":"2024-09-05T01:23:23.186555+0000","last_undegraded":"2024-09-05T01:23:23.186555+0000","last_fullsized":"2024-09-05T01:23:23.186555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:12:15.429065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.193714+0000","last_change":"2024-09-05T01:22:32.612131+0000","last_active":"2024-09-05T01:23:23.193714+0000","last_peered":"2024-09-05T01:23:23.193714+0000","last_clean":"2024-09-05T01:23:23.193714+0000","last_became_active":"2024-09-05T01:22:32.611778+0000","last_became_peered":"2024-09-05T01:22:32.611778+0000","last_unstale":"2024-09-05T01:23:23.193714+0000","last_undegraded":"2024-09-05T01:23:23.193714+0000","last_fullsized":"2024-09-05T01:23:23.193714+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:18:21.930485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.191647+0000","last_change":"2024-09-05T01:22:35.047663+0000","last_active":"2024-09-05T01:23:23.191647+0000","last_peered":"2024-09-05T01:23:23.191647+0000","last_clean":"2024-09-05T01:23:23.191647+0000","last_became_active":"2024-09-05T01:22:35.047078+0000","last_became_peered":"2024-09-05T01:22:35.047078+0000","last_unstale":"2024-09-05T01:23:23.191647+0000","last_undegraded":"2024-09-05T01:23:23.191647+0000","last_fullsized":"2024-09-05T01:23:23.191647+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:44.992459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.189958+0000","last_change":"2024-09-05T01:22:33.064617+0000","last_active":"2024-09-05T01:23:23.189958+0000","last_peered":"2024-09-05T01:23:23.189958+0000","last_clean":"2024-09-05T01:23:23.189958+0000","last_became_active":"2024-09-05T01:22:33.064265+0000","last_became_peered":"2024-09-05T01:22:33.064265+0000","last_unstale":"2024-09-05T01:23:23.189958+0000","last_undegraded":"2024-09-05T01:23:23.189958+0000","last_fullsized":"2024-09-05T01:23:23.189958+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:43:57.315764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.186255+0000","last_change":"2024-09-05T01:22:35.047109+0000","last_active":"2024-09-05T01:23:23.186255+0000","last_peered":"2024-09-05T01:23:23.186255+0000","last_clean":"2024-09-05T01:23:23.186255+0000","last_became_active":"2024-09-05T01:22:35.046806+0000","last_became_peered":"2024-09-05T01:22:35.046806+0000","last_unstale":"2024-09-05T01:23:23.186255+0000","last_undegraded":"2024-09-05T01:23:23.186255+0000","last_fullsized":"2024-09-05T01:23:23.186255+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:19:42.743038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'29","reported_seq":165,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:38.944726+0000","last_change":"2024-09-05T01:22:32.610883+0000","last_active":"2024-09-05T01:23:38.944726+0000","last_peered":"2024-09-05T01:23:38.944726+0000","last_clean":"2024-09-05T01:23:38.944726+0000","last_became_active":"2024-09-05T01:22:32.610530+0000","last_became_peered":"2024-09-05T01:22:32.610530+0000","last_unstale":"2024-09-05T01:23:38.944726+0000","last_undegraded":"2024-09-05T01:23:38.944726+0000","last_fullsized":"2024-09-05T01:23:38.944726+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:51:01.111529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61199,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":116,"num_write":31,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.191844+0000","last_change":"2024-09-05T01:22:35.032397+0000","last_active":"2024-09-05T01:23:23.191844+0000","last_peered":"2024-09-05T01:23:23.191844+0000","last_clean":"2024-09-05T01:23:23.191844+0000","last_became_active":"2024-09-05T01:22:35.032073+0000","last_became_peered":"2024-09-05T01:22:35.032073+0000","last_unstale":"2024-09-05T01:23:23.191844+0000","last_undegraded":"2024-09-05T01:23:23.191844+0000","last_fullsized":"2024-09-05T01:23:23.191844+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:36:02.866390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.188372+0000","last_change":"2024-09-05T01:22:32.610247+0000","last_active":"2024-09-05T01:23:23.188372+0000","last_peered":"2024-09-05T01:23:23.188372+0000","last_clean":"2024-09-05T01:23:23.188372+0000","last_became_active":"2024-09-05T01:22:32.609881+0000","last_became_peered":"2024-09-05T01:22:32.609881+0000","last_unstale":"2024-09-05T01:23:23.188372+0000","last_undegraded":"2024-09-05T01:23:23.188372+0000","last_fullsized":"2024-09-05T01:23:23.188372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:40:39.835208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248486+0000","last_change":"2024-09-05T01:22:35.041923+0000","last_active":"2024-09-05T01:23:23.248486+0000","last_peered":"2024-09-05T01:23:23.248486+0000","last_clean":"2024-09-05T01:23:23.248486+0000","last_became_active":"2024-09-05T01:22:35.041439+0000","last_became_peered":"2024-09-05T01:22:35.041439+0000","last_unstale":"2024-09-05T01:23:23.248486+0000","last_undegraded":"2024-09-05T01:23:23.248486+0000","last_fullsized":"2024-09-05T01:23:23.248486+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:36:56.545466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.189621+0000","last_change":"2024-09-05T01:22:32.611274+0000","last_active":"2024-09-05T01:23:23.189621+0000","last_peered":"2024-09-05T01:23:23.189621+0000","last_clean":"2024-09-05T01:23:23.189621+0000","last_became_active":"2024-09-05T01:22:32.610853+0000","last_became_peered":"2024-09-05T01:22:32.610853+0000","last_unstale":"2024-09-05T01:23:23.189621+0000","last_undegraded":"2024-09-05T01:23:23.189621+0000","last_fullsized":"2024-09-05T01:23:23.189621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:01:38.058836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.193300+0000","last_change":"2024-09-05T01:22:35.040116+0000","last_active":"2024-09-05T01:23:23.193300+0000","last_peered":"2024-09-05T01:23:23.193300+0000","last_clean":"2024-09-05T01:23:23.193300+0000","last_became_active":"2024-09-05T01:22:35.037663+0000","last_became_peered":"2024-09-05T01:22:35.037663+0000","last_unstale":"2024-09-05T01:23:23.193300+0000","last_undegraded":"2024-09-05T01:23:23.193300+0000","last_fullsized":"2024-09-05T01:23:23.193300+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:16:37.309205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'6","reported_seq":88,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:41.945786+0000","last_change":"2024-09-05T01:22:32.612334+0000","last_active":"2024-09-05T01:23:41.945786+0000","last_peered":"2024-09-05T01:23:41.945786+0000","last_clean":"2024-09-05T01:23:41.945786+0000","last_became_active":"2024-09-05T01:22:32.612008+0000","last_became_peered":"2024-09-05T01:22:32.612008+0000","last_unstale":"2024-09-05T01:23:41.945786+0000","last_undegraded":"2024-09-05T01:23:41.945786+0000","last_fullsized":"2024-09-05T01:23:41.945786+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:31:05.580219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":61,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192812+0000","last_change":"2024-09-05T01:22:35.037034+0000","last_active":"2024-09-05T01:23:23.192812+0000","last_peered":"2024-09-05T01:23:23.192812+0000","last_clean":"2024-09-05T01:23:23.192812+0000","last_became_active":"2024-09-05T01:22:35.036643+0000","last_became_peered":"2024-09-05T01:22:35.036643+0000","last_unstale":"2024-09-05T01:23:23.192812+0000","last_undegraded":"2024-09-05T01:23:23.192812+0000","last_fullsized":"2024-09-05T01:23:23.192812+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:41:24.073298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.190957+0000","last_change":"2024-09-05T01:22:33.064918+0000","last_active":"2024-09-05T01:23:23.190957+0000","last_peered":"2024-09-05T01:23:23.190957+0000","last_clean":"2024-09-05T01:23:23.190957+0000","last_became_active":"2024-09-05T01:22:33.064611+0000","last_became_peered":"2024-09-05T01:22:33.064611+0000","last_unstale":"2024-09-05T01:23:23.190957+0000","last_undegraded":"2024-09-05T01:23:23.190957+0000","last_fullsized":"2024-09-05T01:23:23.190957+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:25:37.129263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.189433+0000","last_change":"2024-09-05T01:22:35.039866+0000","last_active":"2024-09-05T01:23:23.189433+0000","last_peered":"2024-09-05T01:23:23.189433+0000","last_clean":"2024-09-05T01:23:23.189433+0000","last_became_active":"2024-09-05T01:22:35.039493+0000","last_became_peered":"2024-09-05T01:22:35.039493+0000","last_unstale":"2024-09-05T01:23:23.189433+0000","last_undegraded":"2024-09-05T01:23:23.189433+0000","last_fullsized":"2024-09-05T01:23:23.189433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:39:20.036455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192342+0000","last_change":"2024-09-05T01:22:32.610948+0000","last_active":"2024-09-05T01:23:23.192342+0000","last_peered":"2024-09-05T01:23:23.192342+0000","last_clean":"2024-09-05T01:23:23.192342+0000","last_became_active":"2024-09-05T01:22:32.610596+0000","last_became_peered":"2024-09-05T01:22:32.610596+0000","last_unstale":"2024-09-05T01:23:23.192342+0000","last_undegraded":"2024-09-05T01:23:23.192342+0000","last_fullsized":"2024-09-05T01:23:23.192342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:36:25.589705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.196770+0000","last_change":"2024-09-05T01:23:23.196770+0000","last_active":"2024-09-05T01:23:23.196770+0000","last_peered":"2024-09-05T01:23:23.196770+0000","last_clean":"2024-09-05T01:23:23.196770+0000","last_became_active":"2024-09-05T01:23:23.196495+0000","last_became_peered":"2024-09-05T01:23:23.196495+0000","last_unstale":"2024-09-05T01:23:23.196770+0000","last_undegraded":"2024-09-05T01:23:23.196770+0000","last_fullsized":"2024-09-05T01:23:23.196770+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:11:35.195038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7],"acting":[11,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248809+0000","last_change":"2024-09-05T01:22:32.609555+0000","last_active":"2024-09-05T01:23:23.248809+0000","last_peered":"2024-09-05T01:23:23.248809+0000","last_clean":"2024-09-05T01:23:23.248809+0000","last_became_active":"2024-09-05T01:22:32.608448+0000","last_became_peered":"2024-09-05T01:22:32.608448+0000","last_unstale":"2024-09-05T01:23:23.248809+0000","last_undegraded":"2024-09-05T01:23:23.248809+0000","last_fullsized":"2024-09-05T01:23:23.248809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:13:27.724664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.193862+0000","last_change":"2024-09-05T01:22:35.033418+0000","last_active":"2024-09-05T01:23:23.193862+0000","last_peered":"2024-09-05T01:23:23.193862+0000","last_clean":"2024-09-05T01:23:23.193862+0000","last_became_active":"2024-09-05T01:22:35.033096+0000","last_became_peered":"2024-09-05T01:22:35.033096+0000","last_unstale":"2024-09-05T01:23:23.193862+0000","last_undegraded":"2024-09-05T01:23:23.193862+0000","last_fullsized":"2024-09-05T01:23:23.193862+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:09:06.723427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.190075+0000","last_change":"2024-09-05T01:22:32.609821+0000","last_active":"2024-09-05T01:23:23.190075+0000","last_peered":"2024-09-05T01:23:23.190075+0000","last_clean":"2024-09-05T01:23:23.190075+0000","last_became_active":"2024-09-05T01:22:32.608932+0000","last_became_peered":"2024-09-05T01:22:32.608932+0000","last_unstale":"2024-09-05T01:23:23.190075+0000","last_undegraded":"2024-09-05T01:23:23.190075+0000","last_fullsized":"2024-09-05T01:23:23.190075+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:45:19.964263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.193207+0000","last_change":"2024-09-05T01:22:35.037965+0000","last_active":"2024-09-05T01:23:23.193207+0000","last_peered":"2024-09-05T01:23:23.193207+0000","last_clean":"2024-09-05T01:23:23.193207+0000","last_became_active":"2024-09-05T01:22:35.037541+0000","last_became_peered":"2024-09-05T01:22:35.037541+0000","last_unstale":"2024-09-05T01:23:23.193207+0000","last_undegraded":"2024-09-05T01:23:23.193207+0000","last_fullsized":"2024-09-05T01:23:23.193207+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:43:29.098517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'5","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:42.219251+0000","last_change":"2024-09-05T01:23:23.200721+0000","last_active":"2024-09-05T01:23:42.219251+0000","last_peered":"2024-09-05T01:23:42.219251+0000","last_clean":"2024-09-05T01:23:42.219251+0000","last_became_active":"2024-09-05T01:23:23.193780+0000","last_became_peered":"2024-09-05T01:23:23.193780+0000","last_unstale":"2024-09-05T01:23:42.219251+0000","last_undegraded":"2024-09-05T01:23:42.219251+0000","last_fullsized":"2024-09-05T01:23:42.219251+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:47:56.617158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1170,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.193418+0000","last_change":"2024-09-05T01:22:35.035868+0000","last_active":"2024-09-05T01:23:23.193418+0000","last_peered":"2024-09-05T01:23:23.193418+0000","last_clean":"2024-09-05T01:23:23.193418+0000","last_became_active":"2024-09-05T01:22:35.035495+0000","last_became_peered":"2024-09-05T01:22:35.035495+0000","last_unstale":"2024-09-05T01:23:23.193418+0000","last_undegraded":"2024-09-05T01:23:23.193418+0000","last_fullsized":"2024-09-05T01:23:23.193418+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:13:25.679973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":344,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.193021+0000","last_change":"2024-09-05T01:21:17.107509+0000","last_active":"2024-09-05T01:23:23.193021+0000","last_peered":"2024-09-05T01:23:23.193021+0000","last_clean":"2024-09-05T01:23:23.193021+0000","last_became_active":"2024-09-05T01:21:17.107063+0000","last_became_peered":"2024-09-05T01:21:17.107063+0000","last_unstale":"2024-09-05T01:23:23.193021+0000","last_undegraded":"2024-09-05T01:23:23.193021+0000","last_fullsized":"2024-09-05T01:23:23.193021+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:17:44.744654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:17:44.744654+0000","last_clean_scrub_stamp":"2024-09-05T01:17:44.744654+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:14:18.603051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.190420+0000","last_change":"2024-09-05T01:22:32.610686+0000","last_active":"2024-09-05T01:23:23.190420+0000","last_peered":"2024-09-05T01:23:23.190420+0000","last_clean":"2024-09-05T01:23:23.190420+0000","last_became_active":"2024-09-05T01:22:32.610248+0000","last_became_peered":"2024-09-05T01:22:32.610248+0000","last_unstale":"2024-09-05T01:23:23.190420+0000","last_undegraded":"2024-09-05T01:23:23.190420+0000","last_fullsized":"2024-09-05T01:23:23.190420+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:14:09.468772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192444+0000","last_change":"2024-09-05T01:22:35.044346+0000","last_active":"2024-09-05T01:23:23.192444+0000","last_peered":"2024-09-05T01:23:23.192444+0000","last_clean":"2024-09-05T01:23:23.192444+0000","last_became_active":"2024-09-05T01:22:35.043977+0000","last_became_peered":"2024-09-05T01:22:35.043977+0000","last_unstale":"2024-09-05T01:23:23.192444+0000","last_undegraded":"2024-09-05T01:23:23.192444+0000","last_fullsized":"2024-09-05T01:23:23.192444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:03:33.007905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192980+0000","last_change":"2024-09-05T01:22:32.615120+0000","last_active":"2024-09-05T01:23:23.192980+0000","last_peered":"2024-09-05T01:23:23.192980+0000","last_clean":"2024-09-05T01:23:23.192980+0000","last_became_active":"2024-09-05T01:22:32.614671+0000","last_became_peered":"2024-09-05T01:22:32.614671+0000","last_unstale":"2024-09-05T01:23:23.192980+0000","last_undegraded":"2024-09-05T01:23:23.192980+0000","last_fullsized":"2024-09-05T01:23:23.192980+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:00:00.134610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248378+0000","last_change":"2024-09-05T01:22:35.035840+0000","last_active":"2024-09-05T01:23:23.248378+0000","last_peered":"2024-09-05T01:23:23.248378+0000","last_clean":"2024-09-05T01:23:23.248378+0000","last_became_active":"2024-09-05T01:22:35.035511+0000","last_became_peered":"2024-09-05T01:22:35.035511+0000","last_unstale":"2024-09-05T01:23:23.248378+0000","last_undegraded":"2024-09-05T01:23:23.248378+0000","last_fullsized":"2024-09-05T01:23:23.248378+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:30:01.929816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":84,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:40.943547+0000","last_change":"2024-09-05T01:22:33.064281+0000","last_active":"2024-09-05T01:23:40.943547+0000","last_peered":"2024-09-05T01:23:40.943547+0000","last_clean":"2024-09-05T01:23:40.943547+0000","last_became_active":"2024-09-05T01:22:33.063792+0000","last_became_peered":"2024-09-05T01:22:33.063792+0000","last_unstale":"2024-09-05T01:23:40.943547+0000","last_undegraded":"2024-09-05T01:23:40.943547+0000","last_fullsized":"2024-09-05T01:23:40.943547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:44:19.558140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.189672+0000","last_change":"2024-09-05T01:22:35.035336+0000","last_active":"2024-09-05T01:23:23.189672+0000","last_peered":"2024-09-05T01:23:23.189672+0000","last_clean":"2024-09-05T01:23:23.189672+0000","last_became_active":"2024-09-05T01:22:35.034976+0000","last_became_peered":"2024-09-05T01:22:35.034976+0000","last_unstale":"2024-09-05T01:23:23.189672+0000","last_undegraded":"2024-09-05T01:23:23.189672+0000","last_fullsized":"2024-09-05T01:23:23.189672+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:51:57.850225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"81'6","reported_seq":84,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:39.946134+0000","last_change":"2024-09-05T01:22:32.614203+0000","last_active":"2024-09-05T01:23:39.946134+0000","last_peered":"2024-09-05T01:23:39.946134+0000","last_clean":"2024-09-05T01:23:39.946134+0000","last_became_active":"2024-09-05T01:22:32.613774+0000","last_became_peered":"2024-09-05T01:22:32.613774+0000","last_unstale":"2024-09-05T01:23:39.946134+0000","last_undegraded":"2024-09-05T01:23:39.946134+0000","last_fullsized":"2024-09-05T01:23:39.946134+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:52:05.383835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248507+0000","last_change":"2024-09-05T01:22:35.042770+0000","last_active":"2024-09-05T01:23:23.248507+0000","last_peered":"2024-09-05T01:23:23.248507+0000","last_clean":"2024-09-05T01:23:23.248507+0000","last_became_active":"2024-09-05T01:22:35.042338+0000","last_became_peered":"2024-09-05T01:22:35.042338+0000","last_unstale":"2024-09-05T01:23:23.248507+0000","last_undegraded":"2024-09-05T01:23:23.248507+0000","last_fullsized":"2024-09-05T01:23:23.248507+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:02:35.669717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.188513+0000","last_change":"2024-09-05T01:22:33.065134+0000","last_active":"2024-09-05T01:23:23.188513+0000","last_peered":"2024-09-05T01:23:23.188513+0000","last_clean":"2024-09-05T01:23:23.188513+0000","last_became_active":"2024-09-05T01:22:33.064685+0000","last_became_peered":"2024-09-05T01:22:33.064685+0000","last_unstale":"2024-09-05T01:23:23.188513+0000","last_undegraded":"2024-09-05T01:23:23.188513+0000","last_fullsized":"2024-09-05T01:23:23.188513+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:03:00.976350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248551+0000","last_change":"2024-09-05T01:22:35.035940+0000","last_active":"2024-09-05T01:23:23.248551+0000","last_peered":"2024-09-05T01:23:23.248551+0000","last_clean":"2024-09-05T01:23:23.248551+0000","last_became_active":"2024-09-05T01:22:35.035582+0000","last_became_peered":"2024-09-05T01:22:35.035582+0000","last_unstale":"2024-09-05T01:23:23.248551+0000","last_undegraded":"2024-09-05T01:23:23.248551+0000","last_fullsized":"2024-09-05T01:23:23.248551+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:37:06.621512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.191881+0000","last_change":"2024-09-05T01:22:33.064003+0000","last_active":"2024-09-05T01:23:23.191881+0000","last_peered":"2024-09-05T01:23:23.191881+0000","last_clean":"2024-09-05T01:23:23.191881+0000","last_became_active":"2024-09-05T01:22:33.063685+0000","last_became_peered":"2024-09-05T01:22:33.063685+0000","last_unstale":"2024-09-05T01:23:23.191881+0000","last_undegraded":"2024-09-05T01:23:23.191881+0000","last_fullsized":"2024-09-05T01:23:23.191881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:49:03.742215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248694+0000","last_change":"2024-09-05T01:22:35.034912+0000","last_active":"2024-09-05T01:23:23.248694+0000","last_peered":"2024-09-05T01:23:23.248694+0000","last_clean":"2024-09-05T01:23:23.248694+0000","last_became_active":"2024-09-05T01:22:35.034526+0000","last_became_peered":"2024-09-05T01:22:35.034526+0000","last_unstale":"2024-09-05T01:23:23.248694+0000","last_undegraded":"2024-09-05T01:23:23.248694+0000","last_fullsized":"2024-09-05T01:23:23.248694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:06:00.000162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'14","reported_seq":52,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.206601+0000","last_change":"2024-09-05T01:23:23.206601+0000","last_active":"2024-09-05T01:23:23.206601+0000","last_peered":"2024-09-05T01:23:23.206601+0000","last_clean":"2024-09-05T01:23:23.206601+0000","last_became_active":"2024-09-05T01:23:23.195519+0000","last_became_peered":"2024-09-05T01:23:23.195519+0000","last_unstale":"2024-09-05T01:23:23.206601+0000","last_undegraded":"2024-09-05T01:23:23.206601+0000","last_fullsized":"2024-09-05T01:23:23.206601+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:16:51.359980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192917+0000","last_change":"2024-09-05T01:22:35.038184+0000","last_active":"2024-09-05T01:23:23.192917+0000","last_peered":"2024-09-05T01:23:23.192917+0000","last_clean":"2024-09-05T01:23:23.192917+0000","last_became_active":"2024-09-05T01:22:35.036702+0000","last_became_peered":"2024-09-05T01:22:35.036702+0000","last_unstale":"2024-09-05T01:23:23.192917+0000","last_undegraded":"2024-09-05T01:23:23.192917+0000","last_fullsized":"2024-09-05T01:23:23.192917+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:43:53.813358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.190601+0000","last_change":"2024-09-05T01:22:32.663209+0000","last_active":"2024-09-05T01:23:23.190601+0000","last_peered":"2024-09-05T01:23:23.190601+0000","last_clean":"2024-09-05T01:23:23.190601+0000","last_became_active":"2024-09-05T01:22:32.662928+0000","last_became_peered":"2024-09-05T01:22:32.662928+0000","last_unstale":"2024-09-05T01:23:23.190601+0000","last_undegraded":"2024-09-05T01:23:23.190601+0000","last_fullsized":"2024-09-05T01:23:23.190601+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:10:57.677344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.250471+0000","last_change":"2024-09-05T01:23:23.250471+0000","last_active":"2024-09-05T01:23:23.250471+0000","last_peered":"2024-09-05T01:23:23.250471+0000","last_clean":"2024-09-05T01:23:23.250471+0000","last_became_active":"2024-09-05T01:23:23.250020+0000","last_became_peered":"2024-09-05T01:23:23.250020+0000","last_unstale":"2024-09-05T01:23:23.250471+0000","last_undegraded":"2024-09-05T01:23:23.250471+0000","last_fullsized":"2024-09-05T01:23:23.250471+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:22:52.762922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.186129+0000","last_change":"2024-09-05T01:22:33.064832+0000","last_active":"2024-09-05T01:23:23.186129+0000","last_peered":"2024-09-05T01:23:23.186129+0000","last_clean":"2024-09-05T01:23:23.186129+0000","last_became_active":"2024-09-05T01:22:33.064405+0000","last_became_peered":"2024-09-05T01:22:33.064405+0000","last_unstale":"2024-09-05T01:23:23.186129+0000","last_undegraded":"2024-09-05T01:23:23.186129+0000","last_fullsized":"2024-09-05T01:23:23.186129+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:48:43.093325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.191544+0000","last_change":"2024-09-05T01:22:35.030670+0000","last_active":"2024-09-05T01:23:23.191544+0000","last_peered":"2024-09-05T01:23:23.191544+0000","last_clean":"2024-09-05T01:23:23.191544+0000","last_became_active":"2024-09-05T01:22:35.030338+0000","last_became_peered":"2024-09-05T01:22:35.030338+0000","last_unstale":"2024-09-05T01:23:23.191544+0000","last_undegraded":"2024-09-05T01:23:23.191544+0000","last_fullsized":"2024-09-05T01:23:23.191544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:22:51.832965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192241+0000","last_change":"2024-09-05T01:22:32.612040+0000","last_active":"2024-09-05T01:23:23.192241+0000","last_peered":"2024-09-05T01:23:23.192241+0000","last_clean":"2024-09-05T01:23:23.192241+0000","last_became_active":"2024-09-05T01:22:32.610597+0000","last_became_peered":"2024-09-05T01:22:32.610597+0000","last_unstale":"2024-09-05T01:23:23.192241+0000","last_undegraded":"2024-09-05T01:23:23.192241+0000","last_fullsized":"2024-09-05T01:23:23.192241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:06:31.624775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192448+0000","last_change":"2024-09-05T01:22:35.036220+0000","last_active":"2024-09-05T01:23:23.192448+0000","last_peered":"2024-09-05T01:23:23.192448+0000","last_clean":"2024-09-05T01:23:23.192448+0000","last_became_active":"2024-09-05T01:22:35.035881+0000","last_became_peered":"2024-09-05T01:22:35.035881+0000","last_unstale":"2024-09-05T01:23:23.192448+0000","last_undegraded":"2024-09-05T01:23:23.192448+0000","last_fullsized":"2024-09-05T01:23:23.192448+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:12:03.104075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.188372+0000","last_change":"2024-09-05T01:22:32.608922+0000","last_active":"2024-09-05T01:23:23.188372+0000","last_peered":"2024-09-05T01:23:23.188372+0000","last_clean":"2024-09-05T01:23:23.188372+0000","last_became_active":"2024-09-05T01:22:32.608453+0000","last_became_peered":"2024-09-05T01:22:32.608453+0000","last_unstale":"2024-09-05T01:23:23.188372+0000","last_undegraded":"2024-09-05T01:23:23.188372+0000","last_fullsized":"2024-09-05T01:23:23.188372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:03:41.947264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192554+0000","last_change":"2024-09-05T01:22:35.047556+0000","last_active":"2024-09-05T01:23:23.192554+0000","last_peered":"2024-09-05T01:23:23.192554+0000","last_clean":"2024-09-05T01:23:23.192554+0000","last_became_active":"2024-09-05T01:22:35.046260+0000","last_became_peered":"2024-09-05T01:22:35.046260+0000","last_unstale":"2024-09-05T01:23:23.192554+0000","last_undegraded":"2024-09-05T01:23:23.192554+0000","last_fullsized":"2024-09-05T01:23:23.192554+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:13:09.379906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.191445+0000","last_change":"2024-09-05T01:22:32.612948+0000","last_active":"2024-09-05T01:23:23.191445+0000","last_peered":"2024-09-05T01:23:23.191445+0000","last_clean":"2024-09-05T01:23:23.191445+0000","last_became_active":"2024-09-05T01:22:32.612319+0000","last_became_peered":"2024-09-05T01:22:32.612319+0000","last_unstale":"2024-09-05T01:23:23.191445+0000","last_undegraded":"2024-09-05T01:23:23.191445+0000","last_fullsized":"2024-09-05T01:23:23.191445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:17:56.068106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.193303+0000","last_change":"2024-09-05T01:22:35.036218+0000","last_active":"2024-09-05T01:23:23.193303+0000","last_peered":"2024-09-05T01:23:23.193303+0000","last_clean":"2024-09-05T01:23:23.193303+0000","last_became_active":"2024-09-05T01:22:35.035180+0000","last_became_peered":"2024-09-05T01:22:35.035180+0000","last_unstale":"2024-09-05T01:23:23.193303+0000","last_undegraded":"2024-09-05T01:23:23.193303+0000","last_fullsized":"2024-09-05T01:23:23.193303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:37:13.936829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.189788+0000","last_change":"2024-09-05T01:22:35.039616+0000","last_active":"2024-09-05T01:23:23.189788+0000","last_peered":"2024-09-05T01:23:23.189788+0000","last_clean":"2024-09-05T01:23:23.189788+0000","last_became_active":"2024-09-05T01:22:35.039297+0000","last_became_peered":"2024-09-05T01:22:35.039297+0000","last_unstale":"2024-09-05T01:23:23.189788+0000","last_undegraded":"2024-09-05T01:23:23.189788+0000","last_fullsized":"2024-09-05T01:23:23.189788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:24:44.703168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.191554+0000","last_change":"2024-09-05T01:22:32.609792+0000","last_active":"2024-09-05T01:23:23.191554+0000","last_peered":"2024-09-05T01:23:23.191554+0000","last_clean":"2024-09-05T01:23:23.191554+0000","last_became_active":"2024-09-05T01:22:32.609361+0000","last_became_peered":"2024-09-05T01:22:32.609361+0000","last_unstale":"2024-09-05T01:23:23.191554+0000","last_undegraded":"2024-09-05T01:23:23.191554+0000","last_fullsized":"2024-09-05T01:23:23.191554+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:05:15.105759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.186234+0000","last_change":"2024-09-05T01:22:35.038792+0000","last_active":"2024-09-05T01:23:23.186234+0000","last_peered":"2024-09-05T01:23:23.186234+0000","last_clean":"2024-09-05T01:23:23.186234+0000","last_became_active":"2024-09-05T01:22:35.038129+0000","last_became_peered":"2024-09-05T01:22:35.038129+0000","last_unstale":"2024-09-05T01:23:23.186234+0000","last_undegraded":"2024-09-05T01:23:23.186234+0000","last_fullsized":"2024-09-05T01:23:23.186234+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:39:31.020488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'12","reported_seq":57,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.208083+0000","last_change":"2024-09-05T01:23:23.208083+0000","last_active":"2024-09-05T01:23:23.208083+0000","last_peered":"2024-09-05T01:23:23.208083+0000","last_clean":"2024-09-05T01:23:23.208083+0000","last_became_active":"2024-09-05T01:23:23.194847+0000","last_became_peered":"2024-09-05T01:23:23.194847+0000","last_unstale":"2024-09-05T01:23:23.208083+0000","last_undegraded":"2024-09-05T01:23:23.208083+0000","last_fullsized":"2024-09-05T01:23:23.208083+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:09:16.923894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.191643+0000","last_change":"2024-09-05T01:22:35.045174+0000","last_active":"2024-09-05T01:23:23.191643+0000","last_peered":"2024-09-05T01:23:23.191643+0000","last_clean":"2024-09-05T01:23:23.191643+0000","last_became_active":"2024-09-05T01:22:35.041750+0000","last_became_peered":"2024-09-05T01:22:35.041750+0000","last_unstale":"2024-09-05T01:23:23.191643+0000","last_undegraded":"2024-09-05T01:23:23.191643+0000","last_fullsized":"2024-09-05T01:23:23.191643+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:34:00.174324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.193161+0000","last_change":"2024-09-05T01:22:33.065150+0000","last_active":"2024-09-05T01:23:23.193161+0000","last_peered":"2024-09-05T01:23:23.193161+0000","last_clean":"2024-09-05T01:23:23.193161+0000","last_became_active":"2024-09-05T01:22:33.064456+0000","last_became_peered":"2024-09-05T01:22:33.064456+0000","last_unstale":"2024-09-05T01:23:23.193161+0000","last_undegraded":"2024-09-05T01:23:23.193161+0000","last_fullsized":"2024-09-05T01:23:23.193161+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:16:20.879893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192953+0000","last_change":"2024-09-05T01:22:35.043158+0000","last_active":"2024-09-05T01:23:23.192953+0000","last_peered":"2024-09-05T01:23:23.192953+0000","last_clean":"2024-09-05T01:23:23.192953+0000","last_became_active":"2024-09-05T01:22:35.038666+0000","last_became_peered":"2024-09-05T01:22:35.038666+0000","last_unstale":"2024-09-05T01:23:23.192953+0000","last_undegraded":"2024-09-05T01:23:23.192953+0000","last_fullsized":"2024-09-05T01:23:23.192953+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:44:18.551980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'13","reported_seq":93,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:42.949816+0000","last_change":"2024-09-05T01:22:32.613713+0000","last_active":"2024-09-05T01:23:42.949816+0000","last_peered":"2024-09-05T01:23:42.949816+0000","last_clean":"2024-09-05T01:23:42.949816+0000","last_became_active":"2024-09-05T01:22:32.613284+0000","last_became_peered":"2024-09-05T01:22:32.613284+0000","last_unstale":"2024-09-05T01:23:42.949816+0000","last_undegraded":"2024-09-05T01:23:42.949816+0000","last_fullsized":"2024-09-05T01:23:42.949816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:39:46.881635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68800,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":552,"num_read_kb":366,"num_write":242,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1170,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":206400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547228,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":438035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776160,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32764,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712388,"statfs":{"total":95995035648,"available":95961485312,"internally_reserved":0,"allocated":1613824,"data_stored":1090656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939686,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":937984,"data_stored":437965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168619,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":933888,"data_stored":438343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397553,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1531904,"data_stored":1031649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561078,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":921600,"data_stored":438075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790011,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28540,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716612,"statfs":{"total":95995035648,"available":95965810688,"internally_reserved":0,"allocated":1544192,"data_stored":1030541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953537,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":439106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182469,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":937984,"data_stored":437507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411403,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":995328,"data_stored":499237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":983040,"data_stored":500187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":942080,"data_stored":439021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T01:23:45.834 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph pg dump --format=json 2024-09-05T01:23:46.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:45 smithi145 ceph-mon[34376]: from='client.24859 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T01:23:46.103 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:45 smithi151 ceph-mon[35013]: from='client.24859 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T01:23:46.211 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:46.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.740+0000 7fb4f5200640 1 -- 172.21.15.12:0/2557086460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4f0106f10 msgr2=0x7fb4f010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:46.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.740+0000 7fb4f5200640 1 --2- 172.21.15.12:0/2557086460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4f0106f10 0x7fb4f010ea90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8009be0 tx=0x7fb4e802a6c0 comp rx=0 tx=0).stop 2024-09-05T01:23:46.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.740+0000 7fb4f5200640 1 -- 172.21.15.12:0/2557086460 shutdown_connections 2024-09-05T01:23:46.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.740+0000 7fb4f5200640 1 --2- 172.21.15.12:0/2557086460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4f0106f10 0x7fb4f010ea90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:46.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.740+0000 7fb4f5200640 1 --2- 172.21.15.12:0/2557086460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4f0102790 0x7fb4f01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:46.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.740+0000 7fb4f5200640 1 --2- 172.21.15.12:0/2557086460 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4f0101de0 0x7fb4f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:46.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.740+0000 7fb4f5200640 1 -- 172.21.15.12:0/2557086460 >> 172.21.15.12:0/2557086460 conn(0x7fb4f00fd8c0 msgr2=0x7fb4f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:46.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.740+0000 7fb4f5200640 1 -- 172.21.15.12:0/2557086460 shutdown_connections 2024-09-05T01:23:46.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.740+0000 7fb4f5200640 1 -- 172.21.15.12:0/2557086460 wait complete. 2024-09-05T01:23:46.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.741+0000 7fb4f5200640 1 Processor -- start 2024-09-05T01:23:46.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.741+0000 7fb4f5200640 1 -- start start 2024-09-05T01:23:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.742+0000 7fb4f5200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4f0101de0 0x7fb4f019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.742+0000 7fb4f5200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4f0102790 0x7fb4f019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.742+0000 7fb4f5200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4f0106f10 0x7fb4f019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.742+0000 7fb4f5200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f0111f20 con 0x7fb4f0106f10 2024-09-05T01:23:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.742+0000 7fb4f5200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f0111da0 con 0x7fb4f0101de0 2024-09-05T01:23:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.742+0000 7fb4f5200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f01120a0 con 0x7fb4f0102790 2024-09-05T01:23:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.742+0000 7fb4ee800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4f0106f10 0x7fb4f019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.742+0000 7fb4ee800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4f0106f10 0x7fb4f019ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41556/0 (socket says 172.21.15.12:41556) 2024-09-05T01:23:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.742+0000 7fb4ee800640 1 -- 172.21.15.12:0/857214904 learned_addr learned my addr 172.21.15.12:0/857214904 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.742+0000 7fb4ede00640 1 --2- 172.21.15.12:0/857214904 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4f0101de0 0x7fb4f019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.742+0000 7fb4e7e00640 1 --2- 172.21.15.12:0/857214904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4f0102790 0x7fb4f019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.743+0000 7fb4ee800640 1 -- 172.21.15.12:0/857214904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4f0102790 msgr2=0x7fb4f019aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:46.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.743+0000 7fb4ee800640 1 --2- 172.21.15.12:0/857214904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4f0102790 0x7fb4f019aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:46.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.743+0000 7fb4ee800640 1 -- 172.21.15.12:0/857214904 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4f0101de0 msgr2=0x7fb4f019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:46.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.743+0000 7fb4ee800640 1 --2- 172.21.15.12:0/857214904 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4f0101de0 0x7fb4f019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:46.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.743+0000 7fb4ee800640 1 -- 172.21.15.12:0/857214904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f019f540 con 0x7fb4f0106f10 2024-09-05T01:23:46.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.743+0000 7fb4ee800640 1 --2- 172.21.15.12:0/857214904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4f0106f10 0x7fb4f019ee60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8034040 tx=0x7fb4e80305b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:46.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.743+0000 7fb4e6a00640 1 -- 172.21.15.12:0/857214904 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8041020 con 0x7fb4f0106f10 2024-09-05T01:23:46.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.743+0000 7fb4e6a00640 1 -- 172.21.15.12:0/857214904 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4e8037040 con 0x7fb4f0106f10 2024-09-05T01:23:46.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.743+0000 7fb4e6a00640 1 -- 172.21.15.12:0/857214904 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8036070 con 0x7fb4f0106f10 2024-09-05T01:23:46.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.743+0000 7fb4f5200640 1 -- 172.21.15.12:0/857214904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4f019f7d0 con 0x7fb4f0106f10 2024-09-05T01:23:46.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.743+0000 7fb4f5200640 1 -- 172.21.15.12:0/857214904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4f019fc60 con 0x7fb4f0106f10 2024-09-05T01:23:46.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.745+0000 7fb4f5200640 1 -- 172.21.15.12:0/857214904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4f01021c0 con 0x7fb4f0106f10 2024-09-05T01:23:46.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.747+0000 7fb4e6a00640 1 -- 172.21.15.12:0/857214904 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb4e8044020 con 0x7fb4f0106f10 2024-09-05T01:23:46.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.748+0000 7fb4e6a00640 1 --2- 172.21.15.12:0/857214904 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb4d40a2c10 0x7fb4d40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:46.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.748+0000 7fb4e6a00640 1 -- 172.21.15.12:0/857214904 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7fb4e80efc30 con 0x7fb4f0106f10 2024-09-05T01:23:46.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.748+0000 7fb4ede00640 1 --2- 172.21.15.12:0/857214904 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb4d40a2c10 0x7fb4d40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:46.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.749+0000 7fb4ede00640 1 --2- 172.21.15.12:0/857214904 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb4d40a2c10 0x7fb4d40a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0009bd0 tx=0x7fb4e0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:46.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.752+0000 7fb4e6a00640 1 -- 172.21.15.12:0/857214904 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb4e804b020 con 0x7fb4f0106f10 2024-09-05T01:23:46.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.935+0000 7fb4f5200640 1 -- 172.21.15.12:0/857214904 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb4f010de00 con 0x7fb4d40a2c10 2024-09-05T01:23:46.936 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:46 smithi012 ceph-mon[29942]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-05T01:23:46.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.943+0000 7fb4e6a00640 1 -- 172.21.15.12:0/857214904 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258763 (secure 0 0 0) 0x7fb4f010de00 con 0x7fb4d40a2c10 2024-09-05T01:23:46.947 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:23:46.948 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-05T01:23:46.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.947+0000 7fb4f5200640 1 -- 172.21.15.12:0/857214904 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb4d40a2c10 msgr2=0x7fb4d40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:46.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.947+0000 7fb4f5200640 1 --2- 172.21.15.12:0/857214904 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb4d40a2c10 0x7fb4d40a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0009bd0 tx=0x7fb4e0005f90 comp rx=0 tx=0).stop 2024-09-05T01:23:46.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.947+0000 7fb4f5200640 1 -- 172.21.15.12:0/857214904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4f0106f10 msgr2=0x7fb4f019ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:46.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.947+0000 7fb4f5200640 1 --2- 172.21.15.12:0/857214904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4f0106f10 0x7fb4f019ee60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8034040 tx=0x7fb4e80305b0 comp rx=0 tx=0).stop 2024-09-05T01:23:46.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.947+0000 7fb4f5200640 1 -- 172.21.15.12:0/857214904 shutdown_connections 2024-09-05T01:23:46.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.947+0000 7fb4f5200640 1 --2- 172.21.15.12:0/857214904 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb4d40a2c10 0x7fb4d40a50d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:46.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.947+0000 7fb4f5200640 1 --2- 172.21.15.12:0/857214904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4f0106f10 0x7fb4f019ee60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:46.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.947+0000 7fb4f5200640 1 --2- 172.21.15.12:0/857214904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4f0102790 0x7fb4f019aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:46.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.947+0000 7fb4f5200640 1 --2- 172.21.15.12:0/857214904 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb4f0101de0 0x7fb4f019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:46.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.947+0000 7fb4f5200640 1 -- 172.21.15.12:0/857214904 >> 172.21.15.12:0/857214904 conn(0x7fb4f00fd8c0 msgr2=0x7fb4f00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:46.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.947+0000 7fb4f5200640 1 -- 172.21.15.12:0/857214904 shutdown_connections 2024-09-05T01:23:46.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:46.947+0000 7fb4f5200640 1 -- 172.21.15.12:0/857214904 wait complete. 2024-09-05T01:23:47.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:46 smithi145 ceph-mon[34376]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-05T01:23:47.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:46 smithi151 ceph-mon[35013]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-05T01:23:47.753 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":325,"stamp":"2024-09-05T01:23:46.198366+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659402,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":708,"num_read_kb":500,"num_write":425,"num_write_kb":3075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1181906,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":347,"ondisk_log_size":347,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":370508,"kb_used_data":12876,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124571316,"statfs":{"total":1151940427776,"available":1151561027584,"internally_reserved":0,"allocated":13185024,"data_stored":7220322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":65,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002972"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.193533+0000","last_change":"2024-09-05T01:22:35.038389+0000","last_active":"2024-09-05T01:23:23.193533+0000","last_peered":"2024-09-05T01:23:23.193533+0000","last_clean":"2024-09-05T01:23:23.193533+0000","last_became_active":"2024-09-05T01:22:35.037982+0000","last_became_peered":"2024-09-05T01:22:35.037982+0000","last_unstale":"2024-09-05T01:23:23.193533+0000","last_undegraded":"2024-09-05T01:23:23.193533+0000","last_fullsized":"2024-09-05T01:23:23.193533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:23:33.802592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192317+0000","last_change":"2024-09-05T01:22:35.035340+0000","last_active":"2024-09-05T01:23:23.192317+0000","last_peered":"2024-09-05T01:23:23.192317+0000","last_clean":"2024-09-05T01:23:23.192317+0000","last_became_active":"2024-09-05T01:22:35.032871+0000","last_became_peered":"2024-09-05T01:22:35.032871+0000","last_unstale":"2024-09-05T01:23:23.192317+0000","last_undegraded":"2024-09-05T01:23:23.192317+0000","last_fullsized":"2024-09-05T01:23:23.192317+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:51:07.235915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.191075+0000","last_change":"2024-09-05T01:22:35.045443+0000","last_active":"2024-09-05T01:23:23.191075+0000","last_peered":"2024-09-05T01:23:23.191075+0000","last_clean":"2024-09-05T01:23:23.191075+0000","last_became_active":"2024-09-05T01:22:35.042342+0000","last_became_peered":"2024-09-05T01:22:35.042342+0000","last_unstale":"2024-09-05T01:23:23.191075+0000","last_undegraded":"2024-09-05T01:23:23.191075+0000","last_fullsized":"2024-09-05T01:23:23.191075+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:42:46.878959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.190993+0000","last_change":"2024-09-05T01:22:35.041527+0000","last_active":"2024-09-05T01:23:23.190993+0000","last_peered":"2024-09-05T01:23:23.190993+0000","last_clean":"2024-09-05T01:23:23.190993+0000","last_became_active":"2024-09-05T01:22:35.041210+0000","last_became_peered":"2024-09-05T01:22:35.041210+0000","last_unstale":"2024-09-05T01:23:23.190993+0000","last_undegraded":"2024-09-05T01:23:23.190993+0000","last_fullsized":"2024-09-05T01:23:23.190993+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:22:28.770307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.190958+0000","last_change":"2024-09-05T01:22:35.036810+0000","last_active":"2024-09-05T01:23:23.190958+0000","last_peered":"2024-09-05T01:23:23.190958+0000","last_clean":"2024-09-05T01:23:23.190958+0000","last_became_active":"2024-09-05T01:22:35.036435+0000","last_became_peered":"2024-09-05T01:22:35.036435+0000","last_unstale":"2024-09-05T01:23:23.190958+0000","last_undegraded":"2024-09-05T01:23:23.190958+0000","last_fullsized":"2024-09-05T01:23:23.190958+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:41:43.649178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248372+0000","last_change":"2024-09-05T01:22:35.039198+0000","last_active":"2024-09-05T01:23:23.248372+0000","last_peered":"2024-09-05T01:23:23.248372+0000","last_clean":"2024-09-05T01:23:23.248372+0000","last_became_active":"2024-09-05T01:22:35.038822+0000","last_became_peered":"2024-09-05T01:22:35.038822+0000","last_unstale":"2024-09-05T01:23:23.248372+0000","last_undegraded":"2024-09-05T01:23:23.248372+0000","last_fullsized":"2024-09-05T01:23:23.248372+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:22:08.600927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.193045+0000","last_change":"2024-09-05T01:22:35.034687+0000","last_active":"2024-09-05T01:23:23.193045+0000","last_peered":"2024-09-05T01:23:23.193045+0000","last_clean":"2024-09-05T01:23:23.193045+0000","last_became_active":"2024-09-05T01:22:35.034351+0000","last_became_peered":"2024-09-05T01:22:35.034351+0000","last_unstale":"2024-09-05T01:23:23.193045+0000","last_undegraded":"2024-09-05T01:23:23.193045+0000","last_fullsized":"2024-09-05T01:23:23.193045+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:38:27.311348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.251054+0000","last_change":"2024-09-05T01:23:23.250016+0000","last_active":"2024-09-05T01:23:23.251054+0000","last_peered":"2024-09-05T01:23:23.251054+0000","last_clean":"2024-09-05T01:23:23.251054+0000","last_became_active":"2024-09-05T01:23:23.249553+0000","last_became_peered":"2024-09-05T01:23:23.249553+0000","last_unstale":"2024-09-05T01:23:23.251054+0000","last_undegraded":"2024-09-05T01:23:23.251054+0000","last_fullsized":"2024-09-05T01:23:23.251054+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:06:32.460400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.186568+0000","last_change":"2024-09-05T01:22:35.036394+0000","last_active":"2024-09-05T01:23:23.186568+0000","last_peered":"2024-09-05T01:23:23.186568+0000","last_clean":"2024-09-05T01:23:23.186568+0000","last_became_active":"2024-09-05T01:22:35.035990+0000","last_became_peered":"2024-09-05T01:22:35.035990+0000","last_unstale":"2024-09-05T01:23:23.186568+0000","last_undegraded":"2024-09-05T01:23:23.186568+0000","last_fullsized":"2024-09-05T01:23:23.186568+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:42:18.870263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248937+0000","last_change":"2024-09-05T01:22:35.033389+0000","last_active":"2024-09-05T01:23:23.248937+0000","last_peered":"2024-09-05T01:23:23.248937+0000","last_clean":"2024-09-05T01:23:23.248937+0000","last_became_active":"2024-09-05T01:22:35.033081+0000","last_became_peered":"2024-09-05T01:22:35.033081+0000","last_unstale":"2024-09-05T01:23:23.248937+0000","last_undegraded":"2024-09-05T01:23:23.248937+0000","last_fullsized":"2024-09-05T01:23:23.248937+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:53:08.266905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.193290+0000","last_change":"2024-09-05T01:22:35.035768+0000","last_active":"2024-09-05T01:23:23.193290+0000","last_peered":"2024-09-05T01:23:23.193290+0000","last_clean":"2024-09-05T01:23:23.193290+0000","last_became_active":"2024-09-05T01:22:35.035456+0000","last_became_peered":"2024-09-05T01:22:35.035456+0000","last_unstale":"2024-09-05T01:23:23.193290+0000","last_undegraded":"2024-09-05T01:23:23.193290+0000","last_fullsized":"2024-09-05T01:23:23.193290+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:15:48.723816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.190996+0000","last_change":"2024-09-05T01:22:35.040720+0000","last_active":"2024-09-05T01:23:23.190996+0000","last_peered":"2024-09-05T01:23:23.190996+0000","last_clean":"2024-09-05T01:23:23.190996+0000","last_became_active":"2024-09-05T01:22:35.039617+0000","last_became_peered":"2024-09-05T01:22:35.039617+0000","last_unstale":"2024-09-05T01:23:23.190996+0000","last_undegraded":"2024-09-05T01:23:23.190996+0000","last_fullsized":"2024-09-05T01:23:23.190996+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:23:11.633617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248643+0000","last_change":"2024-09-05T01:22:35.022096+0000","last_active":"2024-09-05T01:23:23.248643+0000","last_peered":"2024-09-05T01:23:23.248643+0000","last_clean":"2024-09-05T01:23:23.248643+0000","last_became_active":"2024-09-05T01:22:35.021707+0000","last_became_peered":"2024-09-05T01:22:35.021707+0000","last_unstale":"2024-09-05T01:23:23.248643+0000","last_undegraded":"2024-09-05T01:23:23.248643+0000","last_fullsized":"2024-09-05T01:23:23.248643+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:50:35.035386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.190882+0000","last_change":"2024-09-05T01:22:35.034481+0000","last_active":"2024-09-05T01:23:23.190882+0000","last_peered":"2024-09-05T01:23:23.190882+0000","last_clean":"2024-09-05T01:23:23.190882+0000","last_became_active":"2024-09-05T01:22:35.034145+0000","last_became_peered":"2024-09-05T01:22:35.034145+0000","last_unstale":"2024-09-05T01:23:23.190882+0000","last_undegraded":"2024-09-05T01:23:23.190882+0000","last_fullsized":"2024-09-05T01:23:23.190882+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:19:33.386981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.195234+0000","last_change":"2024-09-05T01:23:23.195234+0000","last_active":"2024-09-05T01:23:23.195234+0000","last_peered":"2024-09-05T01:23:23.195234+0000","last_clean":"2024-09-05T01:23:23.195234+0000","last_became_active":"2024-09-05T01:23:23.194014+0000","last_became_peered":"2024-09-05T01:23:23.194014+0000","last_unstale":"2024-09-05T01:23:23.195234+0000","last_undegraded":"2024-09-05T01:23:23.195234+0000","last_fullsized":"2024-09-05T01:23:23.195234+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:05:38.517017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.186024+0000","last_change":"2024-09-05T01:22:35.046517+0000","last_active":"2024-09-05T01:23:23.186024+0000","last_peered":"2024-09-05T01:23:23.186024+0000","last_clean":"2024-09-05T01:23:23.186024+0000","last_became_active":"2024-09-05T01:22:35.046230+0000","last_became_peered":"2024-09-05T01:22:35.046230+0000","last_unstale":"2024-09-05T01:23:23.186024+0000","last_undegraded":"2024-09-05T01:23:23.186024+0000","last_fullsized":"2024-09-05T01:23:23.186024+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:16:49.672039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.193555+0000","last_change":"2024-09-05T01:22:35.041140+0000","last_active":"2024-09-05T01:23:23.193555+0000","last_peered":"2024-09-05T01:23:23.193555+0000","last_clean":"2024-09-05T01:23:23.193555+0000","last_became_active":"2024-09-05T01:22:35.040838+0000","last_became_peered":"2024-09-05T01:22:35.040838+0000","last_unstale":"2024-09-05T01:23:23.193555+0000","last_undegraded":"2024-09-05T01:23:23.193555+0000","last_fullsized":"2024-09-05T01:23:23.193555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:47:55.730240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.188558+0000","last_change":"2024-09-05T01:22:35.036830+0000","last_active":"2024-09-05T01:23:23.188558+0000","last_peered":"2024-09-05T01:23:23.188558+0000","last_clean":"2024-09-05T01:23:23.188558+0000","last_became_active":"2024-09-05T01:22:35.036356+0000","last_became_peered":"2024-09-05T01:22:35.036356+0000","last_unstale":"2024-09-05T01:23:23.188558+0000","last_undegraded":"2024-09-05T01:23:23.188558+0000","last_fullsized":"2024-09-05T01:23:23.188558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:19:01.736301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.188570+0000","last_change":"2024-09-05T01:22:35.036386+0000","last_active":"2024-09-05T01:23:23.188570+0000","last_peered":"2024-09-05T01:23:23.188570+0000","last_clean":"2024-09-05T01:23:23.188570+0000","last_became_active":"2024-09-05T01:22:35.036046+0000","last_became_peered":"2024-09-05T01:22:35.036046+0000","last_unstale":"2024-09-05T01:23:23.188570+0000","last_undegraded":"2024-09-05T01:23:23.188570+0000","last_fullsized":"2024-09-05T01:23:23.188570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:19:37.861719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192734+0000","last_change":"2024-09-05T01:22:35.041077+0000","last_active":"2024-09-05T01:23:23.192734+0000","last_peered":"2024-09-05T01:23:23.192734+0000","last_clean":"2024-09-05T01:23:23.192734+0000","last_became_active":"2024-09-05T01:22:35.040736+0000","last_became_peered":"2024-09-05T01:22:35.040736+0000","last_unstale":"2024-09-05T01:23:23.192734+0000","last_undegraded":"2024-09-05T01:23:23.192734+0000","last_fullsized":"2024-09-05T01:23:23.192734+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:30:54.670559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248663+0000","last_change":"2024-09-05T01:22:35.047774+0000","last_active":"2024-09-05T01:23:23.248663+0000","last_peered":"2024-09-05T01:23:23.248663+0000","last_clean":"2024-09-05T01:23:23.248663+0000","last_became_active":"2024-09-05T01:22:35.047153+0000","last_became_peered":"2024-09-05T01:22:35.047153+0000","last_unstale":"2024-09-05T01:23:23.248663+0000","last_undegraded":"2024-09-05T01:23:23.248663+0000","last_fullsized":"2024-09-05T01:23:23.248663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:07:02.189116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.186196+0000","last_change":"2024-09-05T01:22:35.041346+0000","last_active":"2024-09-05T01:23:23.186196+0000","last_peered":"2024-09-05T01:23:23.186196+0000","last_clean":"2024-09-05T01:23:23.186196+0000","last_became_active":"2024-09-05T01:22:35.040282+0000","last_became_peered":"2024-09-05T01:22:35.040282+0000","last_unstale":"2024-09-05T01:23:23.186196+0000","last_undegraded":"2024-09-05T01:23:23.186196+0000","last_fullsized":"2024-09-05T01:23:23.186196+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:19:38.203479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192064+0000","last_change":"2024-09-05T01:22:35.041780+0000","last_active":"2024-09-05T01:23:23.192064+0000","last_peered":"2024-09-05T01:23:23.192064+0000","last_clean":"2024-09-05T01:23:23.192064+0000","last_became_active":"2024-09-05T01:22:35.038453+0000","last_became_peered":"2024-09-05T01:22:35.038453+0000","last_unstale":"2024-09-05T01:23:23.192064+0000","last_undegraded":"2024-09-05T01:23:23.192064+0000","last_fullsized":"2024-09-05T01:23:23.192064+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:17:56.453627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.189593+0000","last_change":"2024-09-05T01:22:35.038699+0000","last_active":"2024-09-05T01:23:23.189593+0000","last_peered":"2024-09-05T01:23:23.189593+0000","last_clean":"2024-09-05T01:23:23.189593+0000","last_became_active":"2024-09-05T01:22:35.038349+0000","last_became_peered":"2024-09-05T01:22:35.038349+0000","last_unstale":"2024-09-05T01:23:23.189593+0000","last_undegraded":"2024-09-05T01:23:23.189593+0000","last_fullsized":"2024-09-05T01:23:23.189593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:17:18.175643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192883+0000","last_change":"2024-09-05T01:22:35.048281+0000","last_active":"2024-09-05T01:23:23.192883+0000","last_peered":"2024-09-05T01:23:23.192883+0000","last_clean":"2024-09-05T01:23:23.192883+0000","last_became_active":"2024-09-05T01:22:35.047211+0000","last_became_peered":"2024-09-05T01:22:35.047211+0000","last_unstale":"2024-09-05T01:23:23.192883+0000","last_undegraded":"2024-09-05T01:23:23.192883+0000","last_fullsized":"2024-09-05T01:23:23.192883+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:40:43.196562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.188857+0000","last_change":"2024-09-05T01:22:35.041215+0000","last_active":"2024-09-05T01:23:23.188857+0000","last_peered":"2024-09-05T01:23:23.188857+0000","last_clean":"2024-09-05T01:23:23.188857+0000","last_became_active":"2024-09-05T01:22:35.040156+0000","last_became_peered":"2024-09-05T01:22:35.040156+0000","last_unstale":"2024-09-05T01:23:23.188857+0000","last_undegraded":"2024-09-05T01:23:23.188857+0000","last_fullsized":"2024-09-05T01:23:23.188857+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:39:01.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.197568+0000","last_change":"2024-09-05T01:23:23.197568+0000","last_active":"2024-09-05T01:23:23.197568+0000","last_peered":"2024-09-05T01:23:23.197568+0000","last_clean":"2024-09-05T01:23:23.197568+0000","last_became_active":"2024-09-05T01:23:23.197132+0000","last_became_peered":"2024-09-05T01:23:23.197132+0000","last_unstale":"2024-09-05T01:23:23.197568+0000","last_undegraded":"2024-09-05T01:23:23.197568+0000","last_fullsized":"2024-09-05T01:23:23.197568+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:55.524687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248641+0000","last_change":"2024-09-05T01:22:35.038147+0000","last_active":"2024-09-05T01:23:23.248641+0000","last_peered":"2024-09-05T01:23:23.248641+0000","last_clean":"2024-09-05T01:23:23.248641+0000","last_became_active":"2024-09-05T01:22:35.037772+0000","last_became_peered":"2024-09-05T01:22:35.037772+0000","last_unstale":"2024-09-05T01:23:23.248641+0000","last_undegraded":"2024-09-05T01:23:23.248641+0000","last_fullsized":"2024-09-05T01:23:23.248641+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:40:01.786788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.190988+0000","last_change":"2024-09-05T01:22:35.049040+0000","last_active":"2024-09-05T01:23:23.190988+0000","last_peered":"2024-09-05T01:23:23.190988+0000","last_clean":"2024-09-05T01:23:23.190988+0000","last_became_active":"2024-09-05T01:22:35.048373+0000","last_became_peered":"2024-09-05T01:22:35.048373+0000","last_unstale":"2024-09-05T01:23:23.190988+0000","last_undegraded":"2024-09-05T01:23:23.190988+0000","last_fullsized":"2024-09-05T01:23:23.190988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:32:17.316513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.188253+0000","last_change":"2024-09-05T01:22:35.043531+0000","last_active":"2024-09-05T01:23:23.188253+0000","last_peered":"2024-09-05T01:23:23.188253+0000","last_clean":"2024-09-05T01:23:23.188253+0000","last_became_active":"2024-09-05T01:22:35.043145+0000","last_became_peered":"2024-09-05T01:22:35.043145+0000","last_unstale":"2024-09-05T01:23:23.188253+0000","last_undegraded":"2024-09-05T01:23:23.188253+0000","last_fullsized":"2024-09-05T01:23:23.188253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:04:41.902738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.188662+0000","last_change":"2024-09-05T01:22:35.037684+0000","last_active":"2024-09-05T01:23:23.188662+0000","last_peered":"2024-09-05T01:23:23.188662+0000","last_clean":"2024-09-05T01:23:23.188662+0000","last_became_active":"2024-09-05T01:22:35.037392+0000","last_became_peered":"2024-09-05T01:22:35.037392+0000","last_unstale":"2024-09-05T01:23:23.188662+0000","last_undegraded":"2024-09-05T01:23:23.188662+0000","last_fullsized":"2024-09-05T01:23:23.188662+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:12:37.705198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192343+0000","last_change":"2024-09-05T01:22:35.036917+0000","last_active":"2024-09-05T01:23:23.192343+0000","last_peered":"2024-09-05T01:23:23.192343+0000","last_clean":"2024-09-05T01:23:23.192343+0000","last_became_active":"2024-09-05T01:22:35.036597+0000","last_became_peered":"2024-09-05T01:22:35.036597+0000","last_unstale":"2024-09-05T01:23:23.192343+0000","last_undegraded":"2024-09-05T01:23:23.192343+0000","last_fullsized":"2024-09-05T01:23:23.192343+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:25:46.472325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.191250+0000","last_change":"2024-09-05T01:22:35.035858+0000","last_active":"2024-09-05T01:23:23.191250+0000","last_peered":"2024-09-05T01:23:23.191250+0000","last_clean":"2024-09-05T01:23:23.191250+0000","last_became_active":"2024-09-05T01:22:35.035075+0000","last_became_peered":"2024-09-05T01:22:35.035075+0000","last_unstale":"2024-09-05T01:23:23.191250+0000","last_undegraded":"2024-09-05T01:23:23.191250+0000","last_fullsized":"2024-09-05T01:23:23.191250+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:49:42.487427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'6","reported_seq":87,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:40.944801+0000","last_change":"2024-09-05T01:22:32.615444+0000","last_active":"2024-09-05T01:23:40.944801+0000","last_peered":"2024-09-05T01:23:40.944801+0000","last_clean":"2024-09-05T01:23:40.944801+0000","last_became_active":"2024-09-05T01:22:32.615026+0000","last_became_peered":"2024-09-05T01:22:32.615026+0000","last_unstale":"2024-09-05T01:23:40.944801+0000","last_undegraded":"2024-09-05T01:23:40.944801+0000","last_fullsized":"2024-09-05T01:23:40.944801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:52:51.410953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.189651+0000","last_change":"2024-09-05T01:22:35.039341+0000","last_active":"2024-09-05T01:23:23.189651+0000","last_peered":"2024-09-05T01:23:23.189651+0000","last_clean":"2024-09-05T01:23:23.189651+0000","last_became_active":"2024-09-05T01:22:35.038911+0000","last_became_peered":"2024-09-05T01:22:35.038911+0000","last_unstale":"2024-09-05T01:23:23.189651+0000","last_undegraded":"2024-09-05T01:23:23.189651+0000","last_fullsized":"2024-09-05T01:23:23.189651+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:18:41.735302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248449+0000","last_change":"2024-09-05T01:22:32.610256+0000","last_active":"2024-09-05T01:23:23.248449+0000","last_peered":"2024-09-05T01:23:23.248449+0000","last_clean":"2024-09-05T01:23:23.248449+0000","last_became_active":"2024-09-05T01:22:32.609430+0000","last_became_peered":"2024-09-05T01:22:32.609430+0000","last_unstale":"2024-09-05T01:23:23.248449+0000","last_undegraded":"2024-09-05T01:23:23.248449+0000","last_fullsized":"2024-09-05T01:23:23.248449+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:00:13.171249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248379+0000","last_change":"2024-09-05T01:22:32.609238+0000","last_active":"2024-09-05T01:23:23.248379+0000","last_peered":"2024-09-05T01:23:23.248379+0000","last_clean":"2024-09-05T01:23:23.248379+0000","last_became_active":"2024-09-05T01:22:32.608789+0000","last_became_peered":"2024-09-05T01:22:32.608789+0000","last_unstale":"2024-09-05T01:23:23.248379+0000","last_undegraded":"2024-09-05T01:23:23.248379+0000","last_fullsized":"2024-09-05T01:23:23.248379+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:01:55.536313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192061+0000","last_change":"2024-09-05T01:22:35.048262+0000","last_active":"2024-09-05T01:23:23.192061+0000","last_peered":"2024-09-05T01:23:23.192061+0000","last_clean":"2024-09-05T01:23:23.192061+0000","last_became_active":"2024-09-05T01:22:35.046404+0000","last_became_peered":"2024-09-05T01:22:35.046404+0000","last_unstale":"2024-09-05T01:23:23.192061+0000","last_undegraded":"2024-09-05T01:23:23.192061+0000","last_fullsized":"2024-09-05T01:23:23.192061+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:29:04.310095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.189804+0000","last_change":"2024-09-05T01:22:32.612116+0000","last_active":"2024-09-05T01:23:23.189804+0000","last_peered":"2024-09-05T01:23:23.189804+0000","last_clean":"2024-09-05T01:23:23.189804+0000","last_became_active":"2024-09-05T01:22:32.611794+0000","last_became_peered":"2024-09-05T01:22:32.611794+0000","last_unstale":"2024-09-05T01:23:23.189804+0000","last_undegraded":"2024-09-05T01:23:23.189804+0000","last_fullsized":"2024-09-05T01:23:23.189804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:59:55.360151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.250108+0000","last_change":"2024-09-05T01:23:23.250108+0000","last_active":"2024-09-05T01:23:23.250108+0000","last_peered":"2024-09-05T01:23:23.250108+0000","last_clean":"2024-09-05T01:23:23.250108+0000","last_became_active":"2024-09-05T01:23:23.249698+0000","last_became_peered":"2024-09-05T01:23:23.249698+0000","last_unstale":"2024-09-05T01:23:23.250108+0000","last_undegraded":"2024-09-05T01:23:23.250108+0000","last_fullsized":"2024-09-05T01:23:23.250108+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:55:45.998595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,10],"acting":[9,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'4","reported_seq":142,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:43.948680+0000","last_change":"2024-09-05T01:22:32.611558+0000","last_active":"2024-09-05T01:23:43.948680+0000","last_peered":"2024-09-05T01:23:43.948680+0000","last_clean":"2024-09-05T01:23:43.948680+0000","last_became_active":"2024-09-05T01:22:32.611194+0000","last_became_peered":"2024-09-05T01:22:32.611194+0000","last_unstale":"2024-09-05T01:23:43.948680+0000","last_undegraded":"2024-09-05T01:23:43.948680+0000","last_fullsized":"2024-09-05T01:23:43.948680+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:47:30.586224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.186555+0000","last_change":"2024-09-05T01:22:35.042010+0000","last_active":"2024-09-05T01:23:23.186555+0000","last_peered":"2024-09-05T01:23:23.186555+0000","last_clean":"2024-09-05T01:23:23.186555+0000","last_became_active":"2024-09-05T01:22:35.041451+0000","last_became_peered":"2024-09-05T01:22:35.041451+0000","last_unstale":"2024-09-05T01:23:23.186555+0000","last_undegraded":"2024-09-05T01:23:23.186555+0000","last_fullsized":"2024-09-05T01:23:23.186555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:12:15.429065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.193714+0000","last_change":"2024-09-05T01:22:32.612131+0000","last_active":"2024-09-05T01:23:23.193714+0000","last_peered":"2024-09-05T01:23:23.193714+0000","last_clean":"2024-09-05T01:23:23.193714+0000","last_became_active":"2024-09-05T01:22:32.611778+0000","last_became_peered":"2024-09-05T01:22:32.611778+0000","last_unstale":"2024-09-05T01:23:23.193714+0000","last_undegraded":"2024-09-05T01:23:23.193714+0000","last_fullsized":"2024-09-05T01:23:23.193714+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:18:21.930485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.191647+0000","last_change":"2024-09-05T01:22:35.047663+0000","last_active":"2024-09-05T01:23:23.191647+0000","last_peered":"2024-09-05T01:23:23.191647+0000","last_clean":"2024-09-05T01:23:23.191647+0000","last_became_active":"2024-09-05T01:22:35.047078+0000","last_became_peered":"2024-09-05T01:22:35.047078+0000","last_unstale":"2024-09-05T01:23:23.191647+0000","last_undegraded":"2024-09-05T01:23:23.191647+0000","last_fullsized":"2024-09-05T01:23:23.191647+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:44.992459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.189958+0000","last_change":"2024-09-05T01:22:33.064617+0000","last_active":"2024-09-05T01:23:23.189958+0000","last_peered":"2024-09-05T01:23:23.189958+0000","last_clean":"2024-09-05T01:23:23.189958+0000","last_became_active":"2024-09-05T01:22:33.064265+0000","last_became_peered":"2024-09-05T01:22:33.064265+0000","last_unstale":"2024-09-05T01:23:23.189958+0000","last_undegraded":"2024-09-05T01:23:23.189958+0000","last_fullsized":"2024-09-05T01:23:23.189958+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:43:57.315764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.186255+0000","last_change":"2024-09-05T01:22:35.047109+0000","last_active":"2024-09-05T01:23:23.186255+0000","last_peered":"2024-09-05T01:23:23.186255+0000","last_clean":"2024-09-05T01:23:23.186255+0000","last_became_active":"2024-09-05T01:22:35.046806+0000","last_became_peered":"2024-09-05T01:22:35.046806+0000","last_unstale":"2024-09-05T01:23:23.186255+0000","last_undegraded":"2024-09-05T01:23:23.186255+0000","last_fullsized":"2024-09-05T01:23:23.186255+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:19:42.743038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'29","reported_seq":175,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:43.951487+0000","last_change":"2024-09-05T01:22:32.610883+0000","last_active":"2024-09-05T01:23:43.951487+0000","last_peered":"2024-09-05T01:23:43.951487+0000","last_clean":"2024-09-05T01:23:43.951487+0000","last_became_active":"2024-09-05T01:22:32.610530+0000","last_became_peered":"2024-09-05T01:22:32.610530+0000","last_unstale":"2024-09-05T01:23:43.951487+0000","last_undegraded":"2024-09-05T01:23:43.951487+0000","last_fullsized":"2024-09-05T01:23:43.951487+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:51:01.111529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61199,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":124,"num_read_kb":121,"num_write":31,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.191844+0000","last_change":"2024-09-05T01:22:35.032397+0000","last_active":"2024-09-05T01:23:23.191844+0000","last_peered":"2024-09-05T01:23:23.191844+0000","last_clean":"2024-09-05T01:23:23.191844+0000","last_became_active":"2024-09-05T01:22:35.032073+0000","last_became_peered":"2024-09-05T01:22:35.032073+0000","last_unstale":"2024-09-05T01:23:23.191844+0000","last_undegraded":"2024-09-05T01:23:23.191844+0000","last_fullsized":"2024-09-05T01:23:23.191844+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:36:02.866390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.188372+0000","last_change":"2024-09-05T01:22:32.610247+0000","last_active":"2024-09-05T01:23:23.188372+0000","last_peered":"2024-09-05T01:23:23.188372+0000","last_clean":"2024-09-05T01:23:23.188372+0000","last_became_active":"2024-09-05T01:22:32.609881+0000","last_became_peered":"2024-09-05T01:22:32.609881+0000","last_unstale":"2024-09-05T01:23:23.188372+0000","last_undegraded":"2024-09-05T01:23:23.188372+0000","last_fullsized":"2024-09-05T01:23:23.188372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:40:39.835208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248486+0000","last_change":"2024-09-05T01:22:35.041923+0000","last_active":"2024-09-05T01:23:23.248486+0000","last_peered":"2024-09-05T01:23:23.248486+0000","last_clean":"2024-09-05T01:23:23.248486+0000","last_became_active":"2024-09-05T01:22:35.041439+0000","last_became_peered":"2024-09-05T01:22:35.041439+0000","last_unstale":"2024-09-05T01:23:23.248486+0000","last_undegraded":"2024-09-05T01:23:23.248486+0000","last_fullsized":"2024-09-05T01:23:23.248486+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:36:56.545466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.189621+0000","last_change":"2024-09-05T01:22:32.611274+0000","last_active":"2024-09-05T01:23:23.189621+0000","last_peered":"2024-09-05T01:23:23.189621+0000","last_clean":"2024-09-05T01:23:23.189621+0000","last_became_active":"2024-09-05T01:22:32.610853+0000","last_became_peered":"2024-09-05T01:22:32.610853+0000","last_unstale":"2024-09-05T01:23:23.189621+0000","last_undegraded":"2024-09-05T01:23:23.189621+0000","last_fullsized":"2024-09-05T01:23:23.189621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:01:38.058836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.193300+0000","last_change":"2024-09-05T01:22:35.040116+0000","last_active":"2024-09-05T01:23:23.193300+0000","last_peered":"2024-09-05T01:23:23.193300+0000","last_clean":"2024-09-05T01:23:23.193300+0000","last_became_active":"2024-09-05T01:22:35.037663+0000","last_became_peered":"2024-09-05T01:22:35.037663+0000","last_unstale":"2024-09-05T01:23:23.193300+0000","last_undegraded":"2024-09-05T01:23:23.193300+0000","last_fullsized":"2024-09-05T01:23:23.193300+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:16:37.309205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'6","reported_seq":88,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:41.945786+0000","last_change":"2024-09-05T01:22:32.612334+0000","last_active":"2024-09-05T01:23:41.945786+0000","last_peered":"2024-09-05T01:23:41.945786+0000","last_clean":"2024-09-05T01:23:41.945786+0000","last_became_active":"2024-09-05T01:22:32.612008+0000","last_became_peered":"2024-09-05T01:22:32.612008+0000","last_unstale":"2024-09-05T01:23:41.945786+0000","last_undegraded":"2024-09-05T01:23:41.945786+0000","last_fullsized":"2024-09-05T01:23:41.945786+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:31:05.580219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":61,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192812+0000","last_change":"2024-09-05T01:22:35.037034+0000","last_active":"2024-09-05T01:23:23.192812+0000","last_peered":"2024-09-05T01:23:23.192812+0000","last_clean":"2024-09-05T01:23:23.192812+0000","last_became_active":"2024-09-05T01:22:35.036643+0000","last_became_peered":"2024-09-05T01:22:35.036643+0000","last_unstale":"2024-09-05T01:23:23.192812+0000","last_undegraded":"2024-09-05T01:23:23.192812+0000","last_fullsized":"2024-09-05T01:23:23.192812+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:41:24.073298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.190957+0000","last_change":"2024-09-05T01:22:33.064918+0000","last_active":"2024-09-05T01:23:23.190957+0000","last_peered":"2024-09-05T01:23:23.190957+0000","last_clean":"2024-09-05T01:23:23.190957+0000","last_became_active":"2024-09-05T01:22:33.064611+0000","last_became_peered":"2024-09-05T01:22:33.064611+0000","last_unstale":"2024-09-05T01:23:23.190957+0000","last_undegraded":"2024-09-05T01:23:23.190957+0000","last_fullsized":"2024-09-05T01:23:23.190957+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:25:37.129263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.189433+0000","last_change":"2024-09-05T01:22:35.039866+0000","last_active":"2024-09-05T01:23:23.189433+0000","last_peered":"2024-09-05T01:23:23.189433+0000","last_clean":"2024-09-05T01:23:23.189433+0000","last_became_active":"2024-09-05T01:22:35.039493+0000","last_became_peered":"2024-09-05T01:22:35.039493+0000","last_unstale":"2024-09-05T01:23:23.189433+0000","last_undegraded":"2024-09-05T01:23:23.189433+0000","last_fullsized":"2024-09-05T01:23:23.189433+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:39:20.036455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192342+0000","last_change":"2024-09-05T01:22:32.610948+0000","last_active":"2024-09-05T01:23:23.192342+0000","last_peered":"2024-09-05T01:23:23.192342+0000","last_clean":"2024-09-05T01:23:23.192342+0000","last_became_active":"2024-09-05T01:22:32.610596+0000","last_became_peered":"2024-09-05T01:22:32.610596+0000","last_unstale":"2024-09-05T01:23:23.192342+0000","last_undegraded":"2024-09-05T01:23:23.192342+0000","last_fullsized":"2024-09-05T01:23:23.192342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:36:25.589705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.196770+0000","last_change":"2024-09-05T01:23:23.196770+0000","last_active":"2024-09-05T01:23:23.196770+0000","last_peered":"2024-09-05T01:23:23.196770+0000","last_clean":"2024-09-05T01:23:23.196770+0000","last_became_active":"2024-09-05T01:23:23.196495+0000","last_became_peered":"2024-09-05T01:23:23.196495+0000","last_unstale":"2024-09-05T01:23:23.196770+0000","last_undegraded":"2024-09-05T01:23:23.196770+0000","last_fullsized":"2024-09-05T01:23:23.196770+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:11:35.195038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7],"acting":[11,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248809+0000","last_change":"2024-09-05T01:22:32.609555+0000","last_active":"2024-09-05T01:23:23.248809+0000","last_peered":"2024-09-05T01:23:23.248809+0000","last_clean":"2024-09-05T01:23:23.248809+0000","last_became_active":"2024-09-05T01:22:32.608448+0000","last_became_peered":"2024-09-05T01:22:32.608448+0000","last_unstale":"2024-09-05T01:23:23.248809+0000","last_undegraded":"2024-09-05T01:23:23.248809+0000","last_fullsized":"2024-09-05T01:23:23.248809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:13:27.724664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.193862+0000","last_change":"2024-09-05T01:22:35.033418+0000","last_active":"2024-09-05T01:23:23.193862+0000","last_peered":"2024-09-05T01:23:23.193862+0000","last_clean":"2024-09-05T01:23:23.193862+0000","last_became_active":"2024-09-05T01:22:35.033096+0000","last_became_peered":"2024-09-05T01:22:35.033096+0000","last_unstale":"2024-09-05T01:23:23.193862+0000","last_undegraded":"2024-09-05T01:23:23.193862+0000","last_fullsized":"2024-09-05T01:23:23.193862+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:09:06.723427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.190075+0000","last_change":"2024-09-05T01:22:32.609821+0000","last_active":"2024-09-05T01:23:23.190075+0000","last_peered":"2024-09-05T01:23:23.190075+0000","last_clean":"2024-09-05T01:23:23.190075+0000","last_became_active":"2024-09-05T01:22:32.608932+0000","last_became_peered":"2024-09-05T01:22:32.608932+0000","last_unstale":"2024-09-05T01:23:23.190075+0000","last_undegraded":"2024-09-05T01:23:23.190075+0000","last_fullsized":"2024-09-05T01:23:23.190075+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:45:19.964263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.193207+0000","last_change":"2024-09-05T01:22:35.037965+0000","last_active":"2024-09-05T01:23:23.193207+0000","last_peered":"2024-09-05T01:23:23.193207+0000","last_clean":"2024-09-05T01:23:23.193207+0000","last_became_active":"2024-09-05T01:22:35.037541+0000","last_became_peered":"2024-09-05T01:22:35.037541+0000","last_unstale":"2024-09-05T01:23:23.193207+0000","last_undegraded":"2024-09-05T01:23:23.193207+0000","last_fullsized":"2024-09-05T01:23:23.193207+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:43:29.098517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'5","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:42.219251+0000","last_change":"2024-09-05T01:23:23.200721+0000","last_active":"2024-09-05T01:23:42.219251+0000","last_peered":"2024-09-05T01:23:42.219251+0000","last_clean":"2024-09-05T01:23:42.219251+0000","last_became_active":"2024-09-05T01:23:23.193780+0000","last_became_peered":"2024-09-05T01:23:23.193780+0000","last_unstale":"2024-09-05T01:23:42.219251+0000","last_undegraded":"2024-09-05T01:23:42.219251+0000","last_fullsized":"2024-09-05T01:23:42.219251+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:47:56.617158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1170,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.193418+0000","last_change":"2024-09-05T01:22:35.035868+0000","last_active":"2024-09-05T01:23:23.193418+0000","last_peered":"2024-09-05T01:23:23.193418+0000","last_clean":"2024-09-05T01:23:23.193418+0000","last_became_active":"2024-09-05T01:22:35.035495+0000","last_became_peered":"2024-09-05T01:22:35.035495+0000","last_unstale":"2024-09-05T01:23:23.193418+0000","last_undegraded":"2024-09-05T01:23:23.193418+0000","last_fullsized":"2024-09-05T01:23:23.193418+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:13:25.679973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":344,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.193021+0000","last_change":"2024-09-05T01:21:17.107509+0000","last_active":"2024-09-05T01:23:23.193021+0000","last_peered":"2024-09-05T01:23:23.193021+0000","last_clean":"2024-09-05T01:23:23.193021+0000","last_became_active":"2024-09-05T01:21:17.107063+0000","last_became_peered":"2024-09-05T01:21:17.107063+0000","last_unstale":"2024-09-05T01:23:23.193021+0000","last_undegraded":"2024-09-05T01:23:23.193021+0000","last_fullsized":"2024-09-05T01:23:23.193021+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:17:44.744654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:17:44.744654+0000","last_clean_scrub_stamp":"2024-09-05T01:17:44.744654+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:14:18.603051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.190420+0000","last_change":"2024-09-05T01:22:32.610686+0000","last_active":"2024-09-05T01:23:23.190420+0000","last_peered":"2024-09-05T01:23:23.190420+0000","last_clean":"2024-09-05T01:23:23.190420+0000","last_became_active":"2024-09-05T01:22:32.610248+0000","last_became_peered":"2024-09-05T01:22:32.610248+0000","last_unstale":"2024-09-05T01:23:23.190420+0000","last_undegraded":"2024-09-05T01:23:23.190420+0000","last_fullsized":"2024-09-05T01:23:23.190420+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:14:09.468772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192444+0000","last_change":"2024-09-05T01:22:35.044346+0000","last_active":"2024-09-05T01:23:23.192444+0000","last_peered":"2024-09-05T01:23:23.192444+0000","last_clean":"2024-09-05T01:23:23.192444+0000","last_became_active":"2024-09-05T01:22:35.043977+0000","last_became_peered":"2024-09-05T01:22:35.043977+0000","last_unstale":"2024-09-05T01:23:23.192444+0000","last_undegraded":"2024-09-05T01:23:23.192444+0000","last_fullsized":"2024-09-05T01:23:23.192444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:03:33.007905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192980+0000","last_change":"2024-09-05T01:22:32.615120+0000","last_active":"2024-09-05T01:23:23.192980+0000","last_peered":"2024-09-05T01:23:23.192980+0000","last_clean":"2024-09-05T01:23:23.192980+0000","last_became_active":"2024-09-05T01:22:32.614671+0000","last_became_peered":"2024-09-05T01:22:32.614671+0000","last_unstale":"2024-09-05T01:23:23.192980+0000","last_undegraded":"2024-09-05T01:23:23.192980+0000","last_fullsized":"2024-09-05T01:23:23.192980+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:00:00.134610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248378+0000","last_change":"2024-09-05T01:22:35.035840+0000","last_active":"2024-09-05T01:23:23.248378+0000","last_peered":"2024-09-05T01:23:23.248378+0000","last_clean":"2024-09-05T01:23:23.248378+0000","last_became_active":"2024-09-05T01:22:35.035511+0000","last_became_peered":"2024-09-05T01:22:35.035511+0000","last_unstale":"2024-09-05T01:23:23.248378+0000","last_undegraded":"2024-09-05T01:23:23.248378+0000","last_fullsized":"2024-09-05T01:23:23.248378+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:30:01.929816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'5","reported_seq":84,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:40.943547+0000","last_change":"2024-09-05T01:22:33.064281+0000","last_active":"2024-09-05T01:23:40.943547+0000","last_peered":"2024-09-05T01:23:40.943547+0000","last_clean":"2024-09-05T01:23:40.943547+0000","last_became_active":"2024-09-05T01:22:33.063792+0000","last_became_peered":"2024-09-05T01:22:33.063792+0000","last_unstale":"2024-09-05T01:23:40.943547+0000","last_undegraded":"2024-09-05T01:23:40.943547+0000","last_fullsized":"2024-09-05T01:23:40.943547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:44:19.558140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.189672+0000","last_change":"2024-09-05T01:22:35.035336+0000","last_active":"2024-09-05T01:23:23.189672+0000","last_peered":"2024-09-05T01:23:23.189672+0000","last_clean":"2024-09-05T01:23:23.189672+0000","last_became_active":"2024-09-05T01:22:35.034976+0000","last_became_peered":"2024-09-05T01:22:35.034976+0000","last_unstale":"2024-09-05T01:23:23.189672+0000","last_undegraded":"2024-09-05T01:23:23.189672+0000","last_fullsized":"2024-09-05T01:23:23.189672+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:51:57.850225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"81'6","reported_seq":84,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:39.946134+0000","last_change":"2024-09-05T01:22:32.614203+0000","last_active":"2024-09-05T01:23:39.946134+0000","last_peered":"2024-09-05T01:23:39.946134+0000","last_clean":"2024-09-05T01:23:39.946134+0000","last_became_active":"2024-09-05T01:22:32.613774+0000","last_became_peered":"2024-09-05T01:22:32.613774+0000","last_unstale":"2024-09-05T01:23:39.946134+0000","last_undegraded":"2024-09-05T01:23:39.946134+0000","last_fullsized":"2024-09-05T01:23:39.946134+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:52:05.383835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248507+0000","last_change":"2024-09-05T01:22:35.042770+0000","last_active":"2024-09-05T01:23:23.248507+0000","last_peered":"2024-09-05T01:23:23.248507+0000","last_clean":"2024-09-05T01:23:23.248507+0000","last_became_active":"2024-09-05T01:22:35.042338+0000","last_became_peered":"2024-09-05T01:22:35.042338+0000","last_unstale":"2024-09-05T01:23:23.248507+0000","last_undegraded":"2024-09-05T01:23:23.248507+0000","last_fullsized":"2024-09-05T01:23:23.248507+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:02:35.669717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.188513+0000","last_change":"2024-09-05T01:22:33.065134+0000","last_active":"2024-09-05T01:23:23.188513+0000","last_peered":"2024-09-05T01:23:23.188513+0000","last_clean":"2024-09-05T01:23:23.188513+0000","last_became_active":"2024-09-05T01:22:33.064685+0000","last_became_peered":"2024-09-05T01:22:33.064685+0000","last_unstale":"2024-09-05T01:23:23.188513+0000","last_undegraded":"2024-09-05T01:23:23.188513+0000","last_fullsized":"2024-09-05T01:23:23.188513+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:03:00.976350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248551+0000","last_change":"2024-09-05T01:22:35.035940+0000","last_active":"2024-09-05T01:23:23.248551+0000","last_peered":"2024-09-05T01:23:23.248551+0000","last_clean":"2024-09-05T01:23:23.248551+0000","last_became_active":"2024-09-05T01:22:35.035582+0000","last_became_peered":"2024-09-05T01:22:35.035582+0000","last_unstale":"2024-09-05T01:23:23.248551+0000","last_undegraded":"2024-09-05T01:23:23.248551+0000","last_fullsized":"2024-09-05T01:23:23.248551+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:37:06.621512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.191881+0000","last_change":"2024-09-05T01:22:33.064003+0000","last_active":"2024-09-05T01:23:23.191881+0000","last_peered":"2024-09-05T01:23:23.191881+0000","last_clean":"2024-09-05T01:23:23.191881+0000","last_became_active":"2024-09-05T01:22:33.063685+0000","last_became_peered":"2024-09-05T01:22:33.063685+0000","last_unstale":"2024-09-05T01:23:23.191881+0000","last_undegraded":"2024-09-05T01:23:23.191881+0000","last_fullsized":"2024-09-05T01:23:23.191881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:49:03.742215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.248694+0000","last_change":"2024-09-05T01:22:35.034912+0000","last_active":"2024-09-05T01:23:23.248694+0000","last_peered":"2024-09-05T01:23:23.248694+0000","last_clean":"2024-09-05T01:23:23.248694+0000","last_became_active":"2024-09-05T01:22:35.034526+0000","last_became_peered":"2024-09-05T01:22:35.034526+0000","last_unstale":"2024-09-05T01:23:23.248694+0000","last_undegraded":"2024-09-05T01:23:23.248694+0000","last_fullsized":"2024-09-05T01:23:23.248694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:06:00.000162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'14","reported_seq":52,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.206601+0000","last_change":"2024-09-05T01:23:23.206601+0000","last_active":"2024-09-05T01:23:23.206601+0000","last_peered":"2024-09-05T01:23:23.206601+0000","last_clean":"2024-09-05T01:23:23.206601+0000","last_became_active":"2024-09-05T01:23:23.195519+0000","last_became_peered":"2024-09-05T01:23:23.195519+0000","last_unstale":"2024-09-05T01:23:23.206601+0000","last_undegraded":"2024-09-05T01:23:23.206601+0000","last_fullsized":"2024-09-05T01:23:23.206601+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:16:51.359980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192917+0000","last_change":"2024-09-05T01:22:35.038184+0000","last_active":"2024-09-05T01:23:23.192917+0000","last_peered":"2024-09-05T01:23:23.192917+0000","last_clean":"2024-09-05T01:23:23.192917+0000","last_became_active":"2024-09-05T01:22:35.036702+0000","last_became_peered":"2024-09-05T01:22:35.036702+0000","last_unstale":"2024-09-05T01:23:23.192917+0000","last_undegraded":"2024-09-05T01:23:23.192917+0000","last_fullsized":"2024-09-05T01:23:23.192917+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:43:53.813358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.190601+0000","last_change":"2024-09-05T01:22:32.663209+0000","last_active":"2024-09-05T01:23:23.190601+0000","last_peered":"2024-09-05T01:23:23.190601+0000","last_clean":"2024-09-05T01:23:23.190601+0000","last_became_active":"2024-09-05T01:22:32.662928+0000","last_became_peered":"2024-09-05T01:22:32.662928+0000","last_unstale":"2024-09-05T01:23:23.190601+0000","last_undegraded":"2024-09-05T01:23:23.190601+0000","last_fullsized":"2024-09-05T01:23:23.190601+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:10:57.677344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.250471+0000","last_change":"2024-09-05T01:23:23.250471+0000","last_active":"2024-09-05T01:23:23.250471+0000","last_peered":"2024-09-05T01:23:23.250471+0000","last_clean":"2024-09-05T01:23:23.250471+0000","last_became_active":"2024-09-05T01:23:23.250020+0000","last_became_peered":"2024-09-05T01:23:23.250020+0000","last_unstale":"2024-09-05T01:23:23.250471+0000","last_undegraded":"2024-09-05T01:23:23.250471+0000","last_fullsized":"2024-09-05T01:23:23.250471+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:22:52.762922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.186129+0000","last_change":"2024-09-05T01:22:33.064832+0000","last_active":"2024-09-05T01:23:23.186129+0000","last_peered":"2024-09-05T01:23:23.186129+0000","last_clean":"2024-09-05T01:23:23.186129+0000","last_became_active":"2024-09-05T01:22:33.064405+0000","last_became_peered":"2024-09-05T01:22:33.064405+0000","last_unstale":"2024-09-05T01:23:23.186129+0000","last_undegraded":"2024-09-05T01:23:23.186129+0000","last_fullsized":"2024-09-05T01:23:23.186129+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:48:43.093325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.191544+0000","last_change":"2024-09-05T01:22:35.030670+0000","last_active":"2024-09-05T01:23:23.191544+0000","last_peered":"2024-09-05T01:23:23.191544+0000","last_clean":"2024-09-05T01:23:23.191544+0000","last_became_active":"2024-09-05T01:22:35.030338+0000","last_became_peered":"2024-09-05T01:22:35.030338+0000","last_unstale":"2024-09-05T01:23:23.191544+0000","last_undegraded":"2024-09-05T01:23:23.191544+0000","last_fullsized":"2024-09-05T01:23:23.191544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:22:51.832965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192241+0000","last_change":"2024-09-05T01:22:32.612040+0000","last_active":"2024-09-05T01:23:23.192241+0000","last_peered":"2024-09-05T01:23:23.192241+0000","last_clean":"2024-09-05T01:23:23.192241+0000","last_became_active":"2024-09-05T01:22:32.610597+0000","last_became_peered":"2024-09-05T01:22:32.610597+0000","last_unstale":"2024-09-05T01:23:23.192241+0000","last_undegraded":"2024-09-05T01:23:23.192241+0000","last_fullsized":"2024-09-05T01:23:23.192241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:06:31.624775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192448+0000","last_change":"2024-09-05T01:22:35.036220+0000","last_active":"2024-09-05T01:23:23.192448+0000","last_peered":"2024-09-05T01:23:23.192448+0000","last_clean":"2024-09-05T01:23:23.192448+0000","last_became_active":"2024-09-05T01:22:35.035881+0000","last_became_peered":"2024-09-05T01:22:35.035881+0000","last_unstale":"2024-09-05T01:23:23.192448+0000","last_undegraded":"2024-09-05T01:23:23.192448+0000","last_fullsized":"2024-09-05T01:23:23.192448+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:12:03.104075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.188372+0000","last_change":"2024-09-05T01:22:32.608922+0000","last_active":"2024-09-05T01:23:23.188372+0000","last_peered":"2024-09-05T01:23:23.188372+0000","last_clean":"2024-09-05T01:23:23.188372+0000","last_became_active":"2024-09-05T01:22:32.608453+0000","last_became_peered":"2024-09-05T01:22:32.608453+0000","last_unstale":"2024-09-05T01:23:23.188372+0000","last_undegraded":"2024-09-05T01:23:23.188372+0000","last_fullsized":"2024-09-05T01:23:23.188372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:03:41.947264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192554+0000","last_change":"2024-09-05T01:22:35.047556+0000","last_active":"2024-09-05T01:23:23.192554+0000","last_peered":"2024-09-05T01:23:23.192554+0000","last_clean":"2024-09-05T01:23:23.192554+0000","last_became_active":"2024-09-05T01:22:35.046260+0000","last_became_peered":"2024-09-05T01:22:35.046260+0000","last_unstale":"2024-09-05T01:23:23.192554+0000","last_undegraded":"2024-09-05T01:23:23.192554+0000","last_fullsized":"2024-09-05T01:23:23.192554+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:13:09.379906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.191445+0000","last_change":"2024-09-05T01:22:32.612948+0000","last_active":"2024-09-05T01:23:23.191445+0000","last_peered":"2024-09-05T01:23:23.191445+0000","last_clean":"2024-09-05T01:23:23.191445+0000","last_became_active":"2024-09-05T01:22:32.612319+0000","last_became_peered":"2024-09-05T01:22:32.612319+0000","last_unstale":"2024-09-05T01:23:23.191445+0000","last_undegraded":"2024-09-05T01:23:23.191445+0000","last_fullsized":"2024-09-05T01:23:23.191445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:17:56.068106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.193303+0000","last_change":"2024-09-05T01:22:35.036218+0000","last_active":"2024-09-05T01:23:23.193303+0000","last_peered":"2024-09-05T01:23:23.193303+0000","last_clean":"2024-09-05T01:23:23.193303+0000","last_became_active":"2024-09-05T01:22:35.035180+0000","last_became_peered":"2024-09-05T01:22:35.035180+0000","last_unstale":"2024-09-05T01:23:23.193303+0000","last_undegraded":"2024-09-05T01:23:23.193303+0000","last_fullsized":"2024-09-05T01:23:23.193303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:37:13.936829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.189788+0000","last_change":"2024-09-05T01:22:35.039616+0000","last_active":"2024-09-05T01:23:23.189788+0000","last_peered":"2024-09-05T01:23:23.189788+0000","last_clean":"2024-09-05T01:23:23.189788+0000","last_became_active":"2024-09-05T01:22:35.039297+0000","last_became_peered":"2024-09-05T01:22:35.039297+0000","last_unstale":"2024-09-05T01:23:23.189788+0000","last_undegraded":"2024-09-05T01:23:23.189788+0000","last_fullsized":"2024-09-05T01:23:23.189788+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:24:44.703168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.191554+0000","last_change":"2024-09-05T01:22:32.609792+0000","last_active":"2024-09-05T01:23:23.191554+0000","last_peered":"2024-09-05T01:23:23.191554+0000","last_clean":"2024-09-05T01:23:23.191554+0000","last_became_active":"2024-09-05T01:22:32.609361+0000","last_became_peered":"2024-09-05T01:22:32.609361+0000","last_unstale":"2024-09-05T01:23:23.191554+0000","last_undegraded":"2024-09-05T01:23:23.191554+0000","last_fullsized":"2024-09-05T01:23:23.191554+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:05:15.105759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.186234+0000","last_change":"2024-09-05T01:22:35.038792+0000","last_active":"2024-09-05T01:23:23.186234+0000","last_peered":"2024-09-05T01:23:23.186234+0000","last_clean":"2024-09-05T01:23:23.186234+0000","last_became_active":"2024-09-05T01:22:35.038129+0000","last_became_peered":"2024-09-05T01:22:35.038129+0000","last_unstale":"2024-09-05T01:23:23.186234+0000","last_undegraded":"2024-09-05T01:23:23.186234+0000","last_fullsized":"2024-09-05T01:23:23.186234+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:39:31.020488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'12","reported_seq":57,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.208083+0000","last_change":"2024-09-05T01:23:23.208083+0000","last_active":"2024-09-05T01:23:23.208083+0000","last_peered":"2024-09-05T01:23:23.208083+0000","last_clean":"2024-09-05T01:23:23.208083+0000","last_became_active":"2024-09-05T01:23:23.194847+0000","last_became_peered":"2024-09-05T01:23:23.194847+0000","last_unstale":"2024-09-05T01:23:23.208083+0000","last_undegraded":"2024-09-05T01:23:23.208083+0000","last_fullsized":"2024-09-05T01:23:23.208083+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:09:16.923894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.191643+0000","last_change":"2024-09-05T01:22:35.045174+0000","last_active":"2024-09-05T01:23:23.191643+0000","last_peered":"2024-09-05T01:23:23.191643+0000","last_clean":"2024-09-05T01:23:23.191643+0000","last_became_active":"2024-09-05T01:22:35.041750+0000","last_became_peered":"2024-09-05T01:22:35.041750+0000","last_unstale":"2024-09-05T01:23:23.191643+0000","last_undegraded":"2024-09-05T01:23:23.191643+0000","last_fullsized":"2024-09-05T01:23:23.191643+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:34:00.174324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.193161+0000","last_change":"2024-09-05T01:22:33.065150+0000","last_active":"2024-09-05T01:23:23.193161+0000","last_peered":"2024-09-05T01:23:23.193161+0000","last_clean":"2024-09-05T01:23:23.193161+0000","last_became_active":"2024-09-05T01:22:33.064456+0000","last_became_peered":"2024-09-05T01:22:33.064456+0000","last_unstale":"2024-09-05T01:23:23.193161+0000","last_undegraded":"2024-09-05T01:23:23.193161+0000","last_fullsized":"2024-09-05T01:23:23.193161+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:16:20.879893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:23.192953+0000","last_change":"2024-09-05T01:22:35.043158+0000","last_active":"2024-09-05T01:23:23.192953+0000","last_peered":"2024-09-05T01:23:23.192953+0000","last_clean":"2024-09-05T01:23:23.192953+0000","last_became_active":"2024-09-05T01:22:35.038666+0000","last_became_peered":"2024-09-05T01:22:35.038666+0000","last_unstale":"2024-09-05T01:23:23.192953+0000","last_undegraded":"2024-09-05T01:23:23.192953+0000","last_fullsized":"2024-09-05T01:23:23.192953+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:44:18.551980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'13","reported_seq":93,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-05T01:23:42.949816+0000","last_change":"2024-09-05T01:22:32.613713+0000","last_active":"2024-09-05T01:23:42.949816+0000","last_peered":"2024-09-05T01:23:42.949816+0000","last_clean":"2024-09-05T01:23:42.949816+0000","last_became_active":"2024-09-05T01:22:32.613284+0000","last_became_peered":"2024-09-05T01:22:32.613284+0000","last_unstale":"2024-09-05T01:23:42.949816+0000","last_undegraded":"2024-09-05T01:23:42.949816+0000","last_fullsized":"2024-09-05T01:23:42.949816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:39:46.881635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68800,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":572,"num_read_kb":381,"num_write":242,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1170,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":206400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547228,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":438035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776161,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32764,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712388,"statfs":{"total":95995035648,"available":95961485312,"internally_reserved":0,"allocated":1613824,"data_stored":1090656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939686,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":937984,"data_stored":437965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168620,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":933888,"data_stored":438343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397553,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1531904,"data_stored":1031649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561078,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":921600,"data_stored":438075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790011,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28540,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716612,"statfs":{"total":95995035648,"available":95965810688,"internally_reserved":0,"allocated":1544192,"data_stored":1030541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953537,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":439106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182469,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":937984,"data_stored":437507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":995328,"data_stored":499237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":983040,"data_stored":500187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":942080,"data_stored":439021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":63344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":63328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T01:23:47.757 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-05T01:23:47.757 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-05T01:23:47.758 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-05T01:23:47.758 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph health --format=json 2024-09-05T01:23:48.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:47 smithi012 ceph-mon[29942]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T01:23:48.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:47 smithi145 ceph-mon[34376]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T01:23:48.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:47 smithi151 ceph-mon[35013]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T01:23:48.138 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:48.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.749+0000 7f8f8cc00640 1 -- 172.21.15.12:0/964428354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f881047e0 msgr2=0x7f8f88108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:48.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.749+0000 7f8f8cc00640 1 --2- 172.21.15.12:0/964428354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f881047e0 0x7f8f88108830 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009900 tx=0x7f8f7402a410 comp rx=0 tx=0).stop 2024-09-05T01:23:48.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.749+0000 7f8f8cc00640 1 -- 172.21.15.12:0/964428354 shutdown_connections 2024-09-05T01:23:48.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.749+0000 7f8f8cc00640 1 --2- 172.21.15.12:0/964428354 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8f88108f60 0x7f8f88110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:48.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.749+0000 7f8f8cc00640 1 --2- 172.21.15.12:0/964428354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f881047e0 0x7f8f88108830 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:48.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.749+0000 7f8f8cc00640 1 --2- 172.21.15.12:0/964428354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f88103e30 0x7f8f88104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:48.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.749+0000 7f8f8cc00640 1 -- 172.21.15.12:0/964428354 >> 172.21.15.12:0/964428354 conn(0x7f8f880ff910 msgr2=0x7f8f88101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:48.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.749+0000 7f8f8cc00640 1 -- 172.21.15.12:0/964428354 shutdown_connections 2024-09-05T01:23:48.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.749+0000 7f8f8cc00640 1 -- 172.21.15.12:0/964428354 wait complete. 2024-09-05T01:23:48.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.750+0000 7f8f8cc00640 1 Processor -- start 2024-09-05T01:23:48.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.750+0000 7f8f8cc00640 1 -- start start 2024-09-05T01:23:48.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.751+0000 7f8f8cc00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8f88103e30 0x7f8f8819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:48.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.751+0000 7f8f8cc00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f881047e0 0x7f8f8819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:48.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.751+0000 7f8f8cc00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f88108f60 0x7f8f8819edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:48.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.751+0000 7f8f8cc00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8f88113fc0 con 0x7f8f881047e0 2024-09-05T01:23:48.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.751+0000 7f8f8cc00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8f88113e40 con 0x7f8f88103e30 2024-09-05T01:23:48.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.751+0000 7f8f8cc00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8f88114140 con 0x7f8f88108f60 2024-09-05T01:23:48.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.751+0000 7f8f86a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f881047e0 0x7f8f8819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:48.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.751+0000 7f8f86a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f881047e0 0x7f8f8819aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53740/0 (socket says 172.21.15.12:53740) 2024-09-05T01:23:48.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.751+0000 7f8f86a00640 1 -- 172.21.15.12:0/3488723839 learned_addr learned my addr 172.21.15.12:0/3488723839 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:48.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.751+0000 7f8f87400640 1 --2- 172.21.15.12:0/3488723839 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8f88103e30 0x7f8f8819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:48.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.751+0000 7f8f87e00640 1 --2- 172.21.15.12:0/3488723839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f88108f60 0x7f8f8819edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:48.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.751+0000 7f8f87400640 1 -- 172.21.15.12:0/3488723839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f88108f60 msgr2=0x7f8f8819edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:48.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.751+0000 7f8f87400640 1 --2- 172.21.15.12:0/3488723839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f88108f60 0x7f8f8819edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:48.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.752+0000 7f8f87400640 1 -- 172.21.15.12:0/3488723839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f881047e0 msgr2=0x7f8f8819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:48.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.752+0000 7f8f87400640 1 --2- 172.21.15.12:0/3488723839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f881047e0 0x7f8f8819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:48.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.752+0000 7f8f87400640 1 -- 172.21.15.12:0/3488723839 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8819f4a0 con 0x7f8f88103e30 2024-09-05T01:23:48.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.752+0000 7f8f86a00640 1 --2- 172.21.15.12:0/3488723839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f881047e0 0x7f8f8819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:23:48.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.752+0000 7f8f87400640 1 --2- 172.21.15.12:0/3488723839 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8f88103e30 0x7f8f8819a4f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8f7800e9f0 tx=0x7f8f7800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:48.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.752+0000 7f8f7fe00640 1 -- 172.21.15.12:0/3488723839 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7800ccc0 con 0x7f8f88103e30 2024-09-05T01:23:48.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.752+0000 7f8f8cc00640 1 -- 172.21.15.12:0/3488723839 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f8819f790 con 0x7f8f88103e30 2024-09-05T01:23:48.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.752+0000 7f8f7fe00640 1 -- 172.21.15.12:0/3488723839 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f78005020 con 0x7f8f88103e30 2024-09-05T01:23:48.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.752+0000 7f8f7fe00640 1 -- 172.21.15.12:0/3488723839 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f780049e0 con 0x7f8f88103e30 2024-09-05T01:23:48.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.752+0000 7f8f8cc00640 1 -- 172.21.15.12:0/3488723839 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f881a7070 con 0x7f8f88103e30 2024-09-05T01:23:48.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.753+0000 7f8f8cc00640 1 -- 172.21.15.12:0/3488723839 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f88105310 con 0x7f8f88103e30 2024-09-05T01:23:48.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.755+0000 7f8f7fe00640 1 -- 172.21.15.12:0/3488723839 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8f78005560 con 0x7f8f88103e30 2024-09-05T01:23:48.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.757+0000 7f8f7fe00640 1 --2- 172.21.15.12:0/3488723839 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8f6c0a2c90 0x7f8f6c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:48.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.757+0000 7f8f7fe00640 1 -- 172.21.15.12:0/3488723839 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f8f780cf0b0 con 0x7f8f88103e30 2024-09-05T01:23:48.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.757+0000 7f8f86a00640 1 --2- 172.21.15.12:0/3488723839 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8f6c0a2c90 0x7f8f6c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:48.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.757+0000 7f8f86a00640 1 --2- 172.21.15.12:0/3488723839 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8f6c0a2c90 0x7f8f6c0a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8f74031550 tx=0x7f8f74005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:48.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.761+0000 7f8f7fe00640 1 -- 172.21.15.12:0/3488723839 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8f780051d0 con 0x7f8f88103e30 2024-09-05T01:23:48.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.986+0000 7f8f8cc00640 1 -- 172.21.15.12:0/3488723839 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8f8810c200 con 0x7f8f88103e30 2024-09-05T01:23:48.988 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:48 smithi012 ceph-mon[29942]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:23:48.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.987+0000 7f8f7fe00640 1 -- 172.21.15.12:0/3488723839 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f8f7809bea0 con 0x7f8f88103e30 2024-09-05T01:23:48.988 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:23:48.989 INFO:teuthology.orchestra.run.smithi012.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-05T01:23:48.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.989+0000 7f8f8cc00640 1 -- 172.21.15.12:0/3488723839 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8f6c0a2c90 msgr2=0x7f8f6c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:48.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.989+0000 7f8f8cc00640 1 --2- 172.21.15.12:0/3488723839 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8f6c0a2c90 0x7f8f6c0a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8f74031550 tx=0x7f8f74005a20 comp rx=0 tx=0).stop 2024-09-05T01:23:48.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.989+0000 7f8f8cc00640 1 -- 172.21.15.12:0/3488723839 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8f88103e30 msgr2=0x7f8f8819a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:48.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.989+0000 7f8f8cc00640 1 --2- 172.21.15.12:0/3488723839 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8f88103e30 0x7f8f8819a4f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8f7800e9f0 tx=0x7f8f7800eeb0 comp rx=0 tx=0).stop 2024-09-05T01:23:48.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.989+0000 7f8f8cc00640 1 -- 172.21.15.12:0/3488723839 shutdown_connections 2024-09-05T01:23:48.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.989+0000 7f8f8cc00640 1 --2- 172.21.15.12:0/3488723839 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8f6c0a2c90 0x7f8f6c0a5150 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:48.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.989+0000 7f8f8cc00640 1 --2- 172.21.15.12:0/3488723839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f88108f60 0x7f8f8819edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:48.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.989+0000 7f8f8cc00640 1 --2- 172.21.15.12:0/3488723839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f881047e0 0x7f8f8819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:48.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.989+0000 7f8f8cc00640 1 --2- 172.21.15.12:0/3488723839 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8f88103e30 0x7f8f8819a4f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:48.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.989+0000 7f8f8cc00640 1 -- 172.21.15.12:0/3488723839 >> 172.21.15.12:0/3488723839 conn(0x7f8f880ff910 msgr2=0x7f8f88100cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:48.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.990+0000 7f8f8cc00640 1 -- 172.21.15.12:0/3488723839 shutdown_connections 2024-09-05T01:23:48.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:48.990+0000 7f8f8cc00640 1 -- 172.21.15.12:0/3488723839 wait complete. 2024-09-05T01:23:49.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:48 smithi145 ceph-mon[34376]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:23:49.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:48 smithi151 ceph-mon[35013]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:23:49.720 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-05T01:23:49.721 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:23:50.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:49 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3488723839' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-05T01:23:50.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:49 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3488723839' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-05T01:23:50.097 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:50.103 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:49 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3488723839' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-05T01:23:50.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.649+0000 7f80b7e00640 1 -- 172.21.15.12:0/4238361057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80b8074510 msgr2=0x7f80b80748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:50.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.649+0000 7f80b7e00640 1 --2- 172.21.15.12:0/4238361057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80b8074510 0x7f80b80748f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009900 tx=0x7f80a802a480 comp rx=0 tx=0).stop 2024-09-05T01:23:50.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.649+0000 7f80b7e00640 1 -- 172.21.15.12:0/4238361057 shutdown_connections 2024-09-05T01:23:50.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.649+0000 7f80b7e00640 1 --2- 172.21.15.12:0/4238361057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80b810e280 0x7f80b8110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:50.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.649+0000 7f80b7e00640 1 --2- 172.21.15.12:0/4238361057 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80b8074e30 0x7f80b810dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:50.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.649+0000 7f80b7e00640 1 --2- 172.21.15.12:0/4238361057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80b8074510 0x7f80b80748f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:50.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.649+0000 7f80b7e00640 1 -- 172.21.15.12:0/4238361057 >> 172.21.15.12:0/4238361057 conn(0x7f80b80fd740 msgr2=0x7f80b80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:50.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.649+0000 7f80b7e00640 1 -- 172.21.15.12:0/4238361057 shutdown_connections 2024-09-05T01:23:50.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.649+0000 7f80b7e00640 1 -- 172.21.15.12:0/4238361057 wait complete. 2024-09-05T01:23:50.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.650+0000 7f80b7e00640 1 Processor -- start 2024-09-05T01:23:50.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.650+0000 7f80b7e00640 1 -- start start 2024-09-05T01:23:50.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.651+0000 7f80b7e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80b8074510 0x7f80b819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:50.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.651+0000 7f80b7e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80b8074e30 0x7f80b819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:50.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.651+0000 7f80b7e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80b810e280 0x7f80b819ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:50.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.651+0000 7f80b7e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f80b8113fc0 con 0x7f80b8074e30 2024-09-05T01:23:50.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.651+0000 7f80b7e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f80b8113e40 con 0x7f80b810e280 2024-09-05T01:23:50.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.651+0000 7f80b7e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f80b8114140 con 0x7f80b8074510 2024-09-05T01:23:50.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.651+0000 7f80b6000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80b8074e30 0x7f80b819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:50.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.651+0000 7f80b6000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80b8074e30 0x7f80b819aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53762/0 (socket says 172.21.15.12:53762) 2024-09-05T01:23:50.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.651+0000 7f80b7400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80b810e280 0x7f80b819ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:50.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.651+0000 7f80b6000640 1 -- 172.21.15.12:0/4069287751 learned_addr learned my addr 172.21.15.12:0/4069287751 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:50.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.651+0000 7f80b6a00640 1 --2- 172.21.15.12:0/4069287751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80b8074510 0x7f80b819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:50.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.652+0000 7f80b6000640 1 -- 172.21.15.12:0/4069287751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80b8074510 msgr2=0x7f80b819a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:50.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.652+0000 7f80b6000640 1 --2- 172.21.15.12:0/4069287751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80b8074510 0x7f80b819a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:50.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.652+0000 7f80b6000640 1 -- 172.21.15.12:0/4069287751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80b810e280 msgr2=0x7f80b819ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:50.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.652+0000 7f80b6000640 1 --2- 172.21.15.12:0/4069287751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80b810e280 0x7f80b819ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:50.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.652+0000 7f80b6000640 1 -- 172.21.15.12:0/4069287751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b819f4f0 con 0x7f80b8074e30 2024-09-05T01:23:50.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.652+0000 7f80b7400640 1 --2- 172.21.15.12:0/4069287751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80b810e280 0x7f80b819ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:23:50.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.652+0000 7f80b6000640 1 --2- 172.21.15.12:0/4069287751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80b8074e30 0x7f80b819aa80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f80a400e9f0 tx=0x7f80a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:50.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.652+0000 7f80af400640 1 -- 172.21.15.12:0/4069287751 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a400cd80 con 0x7f80b8074e30 2024-09-05T01:23:50.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.652+0000 7f80af400640 1 -- 172.21.15.12:0/4069287751 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80a4010910 con 0x7f80b8074e30 2024-09-05T01:23:50.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.652+0000 7f80b7e00640 1 -- 172.21.15.12:0/4069287751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80b819f7e0 con 0x7f80b8074e30 2024-09-05T01:23:50.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.652+0000 7f80af400640 1 -- 172.21.15.12:0/4069287751 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80a4018990 con 0x7f80b8074e30 2024-09-05T01:23:50.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.652+0000 7f80b7e00640 1 -- 172.21.15.12:0/4069287751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80b81a70c0 con 0x7f80b8074e30 2024-09-05T01:23:50.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.654+0000 7f80b7e00640 1 -- 172.21.15.12:0/4069287751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80b80748f0 con 0x7f80b8074e30 2024-09-05T01:23:50.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.656+0000 7f80af400640 1 -- 172.21.15.12:0/4069287751 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f80a4010ac0 con 0x7f80b8074e30 2024-09-05T01:23:50.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.658+0000 7f80af400640 1 --2- 172.21.15.12:0/4069287751 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f809c0a2c90 0x7f809c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:50.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.658+0000 7f80af400640 1 -- 172.21.15.12:0/4069287751 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f80a40cf4b0 con 0x7f80b8074e30 2024-09-05T01:23:50.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.658+0000 7f80b6a00640 1 --2- 172.21.15.12:0/4069287751 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f809c0a2c90 0x7f809c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:50.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.659+0000 7f80b6a00640 1 --2- 172.21.15.12:0/4069287751 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f809c0a2c90 0x7f809c0a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f80a8000c00 tx=0x7f80a8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:50.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.663+0000 7f80af400640 1 -- 172.21.15.12:0/4069287751 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f80a409bbf0 con 0x7f80b8074e30 2024-09-05T01:23:50.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:50 smithi012 ceph-mon[29942]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T01:23:50.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.884+0000 7f80b7e00640 1 -- 172.21.15.12:0/4069287751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80b8108e70 con 0x7f80b8074e30 2024-09-05T01:23:50.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.885+0000 7f80af400640 1 -- 172.21.15.12:0/4069287751 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11979 (secure 0 0 0) 0x7f80a409fef0 con 0x7f80b8074e30 2024-09-05T01:23:50.886 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:23:50.886 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":27,"btime":"2024-09-05T01:22:48:868154+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14532,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/2949711075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":2949711075},{"type":"v1","addr":"172.21.15.12:6839","nonce":2949711075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T01:22:35.979384+0000","modified":"2024-09-05T01:22:47.915851+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24529,"mds_2":24524,"mds_3":24517,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/497406458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":497406458},{"type":"v1","addr":"172.21.15.12:6841","nonce":497406458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":10,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.145:6839/1706431882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":1706431882},{"type":"v1","addr":"172.21.15.145:6839","nonce":1706431882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24460,24517,24524,24529,24560]},"id":1}]} 2024-09-05T01:23:50.886 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 27 2024-09-05T01:23:50.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.887+0000 7f80b7e00640 1 -- 172.21.15.12:0/4069287751 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f809c0a2c90 msgr2=0x7f809c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:50.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.887+0000 7f80b7e00640 1 --2- 172.21.15.12:0/4069287751 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f809c0a2c90 0x7f809c0a5150 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f80a8000c00 tx=0x7f80a8005b50 comp rx=0 tx=0).stop 2024-09-05T01:23:50.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.887+0000 7f80b7e00640 1 -- 172.21.15.12:0/4069287751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80b8074e30 msgr2=0x7f80b819aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:50.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.887+0000 7f80b7e00640 1 --2- 172.21.15.12:0/4069287751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80b8074e30 0x7f80b819aa80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f80a400e9f0 tx=0x7f80a400eeb0 comp rx=0 tx=0).stop 2024-09-05T01:23:50.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.887+0000 7f80b7e00640 1 -- 172.21.15.12:0/4069287751 shutdown_connections 2024-09-05T01:23:50.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.887+0000 7f80b7e00640 1 --2- 172.21.15.12:0/4069287751 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f809c0a2c90 0x7f809c0a5150 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:50.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.887+0000 7f80b7e00640 1 --2- 172.21.15.12:0/4069287751 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f80b810e280 0x7f80b819ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:50.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.887+0000 7f80b7e00640 1 --2- 172.21.15.12:0/4069287751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80b8074e30 0x7f80b819aa80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:50.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.887+0000 7f80b7e00640 1 --2- 172.21.15.12:0/4069287751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80b8074510 0x7f80b819a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:50.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.887+0000 7f80b7e00640 1 -- 172.21.15.12:0/4069287751 >> 172.21.15.12:0/4069287751 conn(0x7f80b80fd740 msgr2=0x7f80b80fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:50.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.888+0000 7f80b7e00640 1 -- 172.21.15.12:0/4069287751 shutdown_connections 2024-09-05T01:23:50.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:50.888+0000 7f80b7e00640 1 -- 172.21.15.12:0/4069287751 wait complete. 2024-09-05T01:23:51.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:50 smithi145 ceph-mon[34376]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T01:23:51.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:50 smithi151 ceph-mon[35013]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T01:23:51.610 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:23:51.986 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:52.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:51 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/4069287751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:23:52.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:51 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/4069287751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:23:52.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:51 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/4069287751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:23:52.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.581+0000 7f9f7b800640 1 -- 172.21.15.12:0/844536846 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f74077040 msgr2=0x7f9f741124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:52.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.581+0000 7f9f7b800640 1 --2- 172.21.15.12:0/844536846 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f74077040 0x7f9f741124f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9f60009860 tx=0x7f9f6002a340 comp rx=0 tx=0).stop 2024-09-05T01:23:52.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.581+0000 7f9f7b800640 1 -- 172.21.15.12:0/844536846 shutdown_connections 2024-09-05T01:23:52.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.581+0000 7f9f7b800640 1 --2- 172.21.15.12:0/844536846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f74112a30 0x7f9f74114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:52.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.581+0000 7f9f7b800640 1 --2- 172.21.15.12:0/844536846 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f74077040 0x7f9f741124f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:52.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.581+0000 7f9f7b800640 1 --2- 172.21.15.12:0/844536846 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f74076720 0x7f9f74076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:52.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.581+0000 7f9f7b800640 1 -- 172.21.15.12:0/844536846 >> 172.21.15.12:0/844536846 conn(0x7f9f740ffa90 msgr2=0x7f9f74101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:52.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.582+0000 7f9f7b800640 1 -- 172.21.15.12:0/844536846 shutdown_connections 2024-09-05T01:23:52.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.582+0000 7f9f7b800640 1 -- 172.21.15.12:0/844536846 wait complete. 2024-09-05T01:23:52.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.582+0000 7f9f7b800640 1 Processor -- start 2024-09-05T01:23:52.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.582+0000 7f9f7b800640 1 -- start start 2024-09-05T01:23:52.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.583+0000 7f9f7b800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f74076720 0x7f9f741a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:52.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.583+0000 7f9f7b800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f74077040 0x7f9f741a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:52.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.583+0000 7f9f7b800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f74112a30 0x7f9f7419e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:52.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.583+0000 7f9f7b800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9f741185c0 con 0x7f9f74076720 2024-09-05T01:23:52.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.583+0000 7f9f7b800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9f74118440 con 0x7f9f74112a30 2024-09-05T01:23:52.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.583+0000 7f9f7b800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9f74118740 con 0x7f9f74077040 2024-09-05T01:23:52.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.583+0000 7f9f78e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f74076720 0x7f9f741a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:52.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.583+0000 7f9f78e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f74076720 0x7f9f741a46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53782/0 (socket says 172.21.15.12:53782) 2024-09-05T01:23:52.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.583+0000 7f9f78e00640 1 -- 172.21.15.12:0/2300715062 learned_addr learned my addr 172.21.15.12:0/2300715062 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:52.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.583+0000 7f9f79800640 1 --2- 172.21.15.12:0/2300715062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f74112a30 0x7f9f7419e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:52.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.583+0000 7f9f73e00640 1 --2- 172.21.15.12:0/2300715062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f74077040 0x7f9f741a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:52.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.584+0000 7f9f78e00640 1 -- 172.21.15.12:0/2300715062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f74077040 msgr2=0x7f9f741a4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:52.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.584+0000 7f9f78e00640 1 --2- 172.21.15.12:0/2300715062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f74077040 0x7f9f741a4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:52.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.584+0000 7f9f78e00640 1 -- 172.21.15.12:0/2300715062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f74112a30 msgr2=0x7f9f7419e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:52.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.584+0000 7f9f78e00640 1 --2- 172.21.15.12:0/2300715062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f74112a30 0x7f9f7419e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:52.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.584+0000 7f9f78e00640 1 -- 172.21.15.12:0/2300715062 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7419efd0 con 0x7f9f74076720 2024-09-05T01:23:52.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.584+0000 7f9f79800640 1 --2- 172.21.15.12:0/2300715062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f74112a30 0x7f9f7419e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:23:52.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.584+0000 7f9f78e00640 1 --2- 172.21.15.12:0/2300715062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f74076720 0x7f9f741a46e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9f6800e9f0 tx=0x7f9f6800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:52.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.584+0000 7f9f71600640 1 -- 172.21.15.12:0/2300715062 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6800cd80 con 0x7f9f74076720 2024-09-05T01:23:52.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.584+0000 7f9f71600640 1 -- 172.21.15.12:0/2300715062 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f68005500 con 0x7f9f74076720 2024-09-05T01:23:52.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.584+0000 7f9f71600640 1 -- 172.21.15.12:0/2300715062 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f68010690 con 0x7f9f74076720 2024-09-05T01:23:52.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.584+0000 7f9f7b800640 1 -- 172.21.15.12:0/2300715062 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f7419f2c0 con 0x7f9f74076720 2024-09-05T01:23:52.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.585+0000 7f9f7b800640 1 -- 172.21.15.12:0/2300715062 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f741ab5b0 con 0x7f9f74076720 2024-09-05T01:23:52.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.586+0000 7f9f7b800640 1 -- 172.21.15.12:0/2300715062 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f74076b00 con 0x7f9f74076720 2024-09-05T01:23:52.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.588+0000 7f9f71600640 1 -- 172.21.15.12:0/2300715062 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9f680046c0 con 0x7f9f74076720 2024-09-05T01:23:52.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.589+0000 7f9f71600640 1 --2- 172.21.15.12:0/2300715062 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f9f5c0a2c90 0x7f9f5c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:52.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.589+0000 7f9f71600640 1 -- 172.21.15.12:0/2300715062 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f9f680cf5c0 con 0x7f9f74076720 2024-09-05T01:23:52.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.589+0000 7f9f73e00640 1 --2- 172.21.15.12:0/2300715062 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f9f5c0a2c90 0x7f9f5c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:52.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.590+0000 7f9f73e00640 1 --2- 172.21.15.12:0/2300715062 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f9f5c0a2c90 0x7f9f5c0a5150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9f6002a930 tx=0x7f9f600058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:52.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.593+0000 7f9f71600640 1 -- 172.21.15.12:0/2300715062 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9f6809c350 con 0x7f9f74076720 2024-09-05T01:23:52.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:52 smithi012 ceph-mon[29942]: pgmap v328: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:23:52.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.818+0000 7f9f7b800640 1 -- 172.21.15.12:0/2300715062 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f741ab8e0 con 0x7f9f74076720 2024-09-05T01:23:52.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.819+0000 7f9f71600640 1 -- 172.21.15.12:0/2300715062 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11979 (secure 0 0 0) 0x7f9f6809bc50 con 0x7f9f74076720 2024-09-05T01:23:52.821 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:23:52.821 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":27,"btime":"2024-09-05T01:22:48:868154+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14532,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/2949711075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":2949711075},{"type":"v1","addr":"172.21.15.12:6839","nonce":2949711075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T01:22:35.979384+0000","modified":"2024-09-05T01:22:47.915851+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24529,"mds_2":24524,"mds_3":24517,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/497406458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":497406458},{"type":"v1","addr":"172.21.15.12:6841","nonce":497406458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":10,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.145:6839/1706431882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":1706431882},{"type":"v1","addr":"172.21.15.145:6839","nonce":1706431882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24460,24517,24524,24529,24560]},"id":1}]} 2024-09-05T01:23:52.821 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 27 2024-09-05T01:23:52.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.822+0000 7f9f7b800640 1 -- 172.21.15.12:0/2300715062 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f9f5c0a2c90 msgr2=0x7f9f5c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:52.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.822+0000 7f9f7b800640 1 --2- 172.21.15.12:0/2300715062 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f9f5c0a2c90 0x7f9f5c0a5150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9f6002a930 tx=0x7f9f600058d0 comp rx=0 tx=0).stop 2024-09-05T01:23:52.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.822+0000 7f9f7b800640 1 -- 172.21.15.12:0/2300715062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f74076720 msgr2=0x7f9f741a46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:52.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.822+0000 7f9f7b800640 1 --2- 172.21.15.12:0/2300715062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f74076720 0x7f9f741a46e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9f6800e9f0 tx=0x7f9f6800edf0 comp rx=0 tx=0).stop 2024-09-05T01:23:52.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.822+0000 7f9f7b800640 1 -- 172.21.15.12:0/2300715062 shutdown_connections 2024-09-05T01:23:52.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.822+0000 7f9f7b800640 1 --2- 172.21.15.12:0/2300715062 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f9f5c0a2c90 0x7f9f5c0a5150 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:52.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.822+0000 7f9f7b800640 1 --2- 172.21.15.12:0/2300715062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9f74112a30 0x7f9f7419e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:52.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.822+0000 7f9f7b800640 1 --2- 172.21.15.12:0/2300715062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f74077040 0x7f9f741a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:52.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.822+0000 7f9f7b800640 1 --2- 172.21.15.12:0/2300715062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f74076720 0x7f9f741a46e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:52.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.822+0000 7f9f7b800640 1 -- 172.21.15.12:0/2300715062 >> 172.21.15.12:0/2300715062 conn(0x7f9f740ffa90 msgr2=0x7f9f74101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:52.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.822+0000 7f9f7b800640 1 -- 172.21.15.12:0/2300715062 shutdown_connections 2024-09-05T01:23:52.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:52.822+0000 7f9f7b800640 1 -- 172.21.15.12:0/2300715062 wait complete. 2024-09-05T01:23:53.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:52 smithi145 ceph-mon[34376]: pgmap v328: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:23:53.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:52 smithi151 ceph-mon[35013]: pgmap v328: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:23:53.576 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T01:23:53.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:53 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2300715062' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:23:53.953 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:54.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:53 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/2300715062' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:23:54.103 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:53 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/2300715062' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:23:54.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.504+0000 7f3c75a00640 1 -- 172.21.15.12:0/2960109728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c70077040 msgr2=0x7f3c70112510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:54.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.504+0000 7f3c75a00640 1 --2- 172.21.15.12:0/2960109728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c70077040 0x7f3c70112510 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3c58009900 tx=0x7f3c5802a3f0 comp rx=0 tx=0).stop 2024-09-05T01:23:54.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.504+0000 7f3c75a00640 1 -- 172.21.15.12:0/2960109728 shutdown_connections 2024-09-05T01:23:54.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.504+0000 7f3c75a00640 1 --2- 172.21.15.12:0/2960109728 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c70112a50 0x7f3c70114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:54.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.504+0000 7f3c75a00640 1 --2- 172.21.15.12:0/2960109728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c70077040 0x7f3c70112510 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:54.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.504+0000 7f3c75a00640 1 --2- 172.21.15.12:0/2960109728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c70076720 0x7f3c70076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:54.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.504+0000 7f3c75a00640 1 -- 172.21.15.12:0/2960109728 >> 172.21.15.12:0/2960109728 conn(0x7f3c700ffa50 msgr2=0x7f3c70101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:54.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.504+0000 7f3c75a00640 1 -- 172.21.15.12:0/2960109728 shutdown_connections 2024-09-05T01:23:54.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.504+0000 7f3c75a00640 1 -- 172.21.15.12:0/2960109728 wait complete. 2024-09-05T01:23:54.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.505+0000 7f3c75a00640 1 Processor -- start 2024-09-05T01:23:54.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.505+0000 7f3c75a00640 1 -- start start 2024-09-05T01:23:54.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.506+0000 7f3c75a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c70076720 0x7f3c701a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:54.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.506+0000 7f3c75a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c70077040 0x7f3c701a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:54.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.506+0000 7f3c75a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c70112a50 0x7f3c7019e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:54.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.506+0000 7f3c75a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3c70118630 con 0x7f3c70076720 2024-09-05T01:23:54.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.506+0000 7f3c75a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3c701184b0 con 0x7f3c70112a50 2024-09-05T01:23:54.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.506+0000 7f3c75a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3c701187b0 con 0x7f3c70077040 2024-09-05T01:23:54.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.506+0000 7f3c6ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c70076720 0x7f3c701a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:54.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.506+0000 7f3c6ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c70076720 0x7f3c701a4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53794/0 (socket says 172.21.15.12:53794) 2024-09-05T01:23:54.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.506+0000 7f3c6ea00640 1 -- 172.21.15.12:0/3582876790 learned_addr learned my addr 172.21.15.12:0/3582876790 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:54.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.506+0000 7f3c66000640 1 --2- 172.21.15.12:0/3582876790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c70077040 0x7f3c701a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:54.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.506+0000 7f3c6f400640 1 --2- 172.21.15.12:0/3582876790 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c70112a50 0x7f3c7019e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:54.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.506+0000 7f3c6ea00640 1 -- 172.21.15.12:0/3582876790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c70077040 msgr2=0x7f3c701a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:54.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.506+0000 7f3c6ea00640 1 --2- 172.21.15.12:0/3582876790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c70077040 0x7f3c701a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:54.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.506+0000 7f3c6ea00640 1 -- 172.21.15.12:0/3582876790 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c70112a50 msgr2=0x7f3c7019e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:54.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.506+0000 7f3c6ea00640 1 --2- 172.21.15.12:0/3582876790 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c70112a50 0x7f3c7019e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:54.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.506+0000 7f3c6ea00640 1 -- 172.21.15.12:0/3582876790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c7019f070 con 0x7f3c70076720 2024-09-05T01:23:54.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.507+0000 7f3c6ea00640 1 --2- 172.21.15.12:0/3582876790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c70076720 0x7f3c701a4780 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3c6000d770 tx=0x7f3c6000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:54.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.507+0000 7f3c67e00640 1 -- 172.21.15.12:0/3582876790 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c60017070 con 0x7f3c70076720 2024-09-05T01:23:54.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.507+0000 7f3c67e00640 1 -- 172.21.15.12:0/3582876790 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c60005500 con 0x7f3c70076720 2024-09-05T01:23:54.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.507+0000 7f3c75a00640 1 -- 172.21.15.12:0/3582876790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c7019f360 con 0x7f3c70076720 2024-09-05T01:23:54.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.507+0000 7f3c67e00640 1 -- 172.21.15.12:0/3582876790 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c60004e00 con 0x7f3c70076720 2024-09-05T01:23:54.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.507+0000 7f3c75a00640 1 -- 172.21.15.12:0/3582876790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c701ab650 con 0x7f3c70076720 2024-09-05T01:23:54.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.508+0000 7f3c75a00640 1 -- 172.21.15.12:0/3582876790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c70076b00 con 0x7f3c70076720 2024-09-05T01:23:54.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.510+0000 7f3c67e00640 1 -- 172.21.15.12:0/3582876790 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f3c60004fa0 con 0x7f3c70076720 2024-09-05T01:23:54.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.511+0000 7f3c67e00640 1 --2- 172.21.15.12:0/3582876790 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3c540a2c90 0x7f3c540a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:54.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.511+0000 7f3c67e00640 1 -- 172.21.15.12:0/3582876790 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f3c600ceb60 con 0x7f3c70076720 2024-09-05T01:23:54.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.512+0000 7f3c66000640 1 --2- 172.21.15.12:0/3582876790 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3c540a2c90 0x7f3c540a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:54.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.512+0000 7f3c66000640 1 --2- 172.21.15.12:0/3582876790 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3c540a2c90 0x7f3c540a5150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3c58000c00 tx=0x7f3c58005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:54.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.515+0000 7f3c67e00640 1 -- 172.21.15.12:0/3582876790 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3c6009b2a0 con 0x7f3c70076720 2024-09-05T01:23:54.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.704+0000 7f3c75a00640 1 -- 172.21.15.12:0/3582876790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3c701ab820 con 0x7f3c70076720 2024-09-05T01:23:54.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.705+0000 7f3c67e00640 1 -- 172.21.15.12:0/3582876790 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22755 (secure 0 0 0) 0x7f3c6009f5a0 con 0x7f3c70076720 2024-09-05T01:23:54.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:23:54.707 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":83,"fsid":"0d44cd7e-6b24-11ef-bcd6-c7b262605968","created":"2024-09-05T01:14:21.162850+0000","modified":"2024-09-05T01:23:23.181930+0000","last_up_change":"2024-09-05T01:21:37.145073+0000","last_in_change":"2024-09-05T01:21:15.076991+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T01:17:44.744065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T01:22:31.540178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T01:22:33.999318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b74ac640-b680-46e2-9106-d24168e685e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6803","nonce":2090563987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6805","nonce":2090563987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6809","nonce":2090563987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6807","nonce":2090563987}]},"public_addr":"172.21.15.12:6803/2090563987","cluster_addr":"172.21.15.12:6805/2090563987","heartbeat_back_addr":"172.21.15.12:6809/2090563987","heartbeat_front_addr":"172.21.15.12:6807/2090563987","state":["exists","up"]},{"osd":1,"uuid":"efca1216-8d85-4e6a-8c49-0afb511ece59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6801","nonce":2639126629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6803","nonce":2639126629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6807","nonce":2639126629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6805","nonce":2639126629}]},"public_addr":"172.21.15.145:6801/2639126629","cluster_addr":"172.21.15.145:6803/2639126629","heartbeat_back_addr":"172.21.15.145:6807/2639126629","heartbeat_front_addr":"172.21.15.145:6805/2639126629","state":["exists","up"]},{"osd":2,"uuid":"4d5699b2-646a-4ab6-94a5-ad223aa27ac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6801","nonce":3753171761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6803","nonce":3753171761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6807","nonce":3753171761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6805","nonce":3753171761}]},"public_addr":"172.21.15.151:6801/3753171761","cluster_addr":"172.21.15.151:6803/3753171761","heartbeat_back_addr":"172.21.15.151:6807/3753171761","heartbeat_front_addr":"172.21.15.151:6805/3753171761","state":["exists","up"]},{"osd":3,"uuid":"275ad2ad-93e6-4a68-8784-8f8dcb620f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6811","nonce":2231650146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6813","nonce":2231650146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6817","nonce":2231650146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6815","nonce":2231650146}]},"public_addr":"172.21.15.12:6811/2231650146","cluster_addr":"172.21.15.12:6813/2231650146","heartbeat_back_addr":"172.21.15.12:6817/2231650146","heartbeat_front_addr":"172.21.15.12:6815/2231650146","state":["exists","up"]},{"osd":4,"uuid":"21a0c5b4-4e0e-4fb6-8be6-a300cb811cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6809","nonce":1828591275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6811","nonce":1828591275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6815","nonce":1828591275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6813","nonce":1828591275}]},"public_addr":"172.21.15.145:6809/1828591275","cluster_addr":"172.21.15.145:6811/1828591275","heartbeat_back_addr":"172.21.15.145:6815/1828591275","heartbeat_front_addr":"172.21.15.145:6813/1828591275","state":["exists","up"]},{"osd":5,"uuid":"e2c7e6fb-5dea-459f-8d7a-7ae5b1936218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6809","nonce":3888870109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6811","nonce":3888870109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6815","nonce":3888870109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6813","nonce":3888870109}]},"public_addr":"172.21.15.151:6809/3888870109","cluster_addr":"172.21.15.151:6811/3888870109","heartbeat_back_addr":"172.21.15.151:6815/3888870109","heartbeat_front_addr":"172.21.15.151:6813/3888870109","state":["exists","up"]},{"osd":6,"uuid":"0df0a29c-3404-4ff5-ae48-78b69b77cbd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6819","nonce":3084810269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6821","nonce":3084810269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6825","nonce":3084810269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6823","nonce":3084810269}]},"public_addr":"172.21.15.12:6819/3084810269","cluster_addr":"172.21.15.12:6821/3084810269","heartbeat_back_addr":"172.21.15.12:6825/3084810269","heartbeat_front_addr":"172.21.15.12:6823/3084810269","state":["exists","up"]},{"osd":7,"uuid":"c7b3ad7c-a566-435c-9ef8-837bb764acb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6817","nonce":3058588721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6819","nonce":3058588721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6823","nonce":3058588721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6821","nonce":3058588721}]},"public_addr":"172.21.15.145:6817/3058588721","cluster_addr":"172.21.15.145:6819/3058588721","heartbeat_back_addr":"172.21.15.145:6823/3058588721","heartbeat_front_addr":"172.21.15.145:6821/3058588721","state":["exists","up"]},{"osd":8,"uuid":"8018a468-fbc5-4667-a53c-2e97c08713bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6817","nonce":905705309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6819","nonce":905705309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6823","nonce":905705309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6821","nonce":905705309}]},"public_addr":"172.21.15.151:6817/905705309","cluster_addr":"172.21.15.151:6819/905705309","heartbeat_back_addr":"172.21.15.151:6823/905705309","heartbeat_front_addr":"172.21.15.151:6821/905705309","state":["exists","up"]},{"osd":9,"uuid":"dcf3b524-c8b8-4ab6-83c6-fc52c776d72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6827","nonce":1193852496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6829","nonce":1193852496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6833","nonce":1193852496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6831","nonce":1193852496}]},"public_addr":"172.21.15.12:6827/1193852496","cluster_addr":"172.21.15.12:6829/1193852496","heartbeat_back_addr":"172.21.15.12:6833/1193852496","heartbeat_front_addr":"172.21.15.12:6831/1193852496","state":["exists","up"]},{"osd":10,"uuid":"7b5b34c3-8814-4d16-80ce-0b0c9be07cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6825","nonce":1296813755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6827","nonce":1296813755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6831","nonce":1296813755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6829","nonce":1296813755}]},"public_addr":"172.21.15.145:6825/1296813755","cluster_addr":"172.21.15.145:6827/1296813755","heartbeat_back_addr":"172.21.15.145:6831/1296813755","heartbeat_front_addr":"172.21.15.145:6829/1296813755","state":["exists","up"]},{"osd":11,"uuid":"157ee32a-43f0-4e5a-8dac-fce53c1efdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6825","nonce":2855185758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6827","nonce":2855185758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6831","nonce":2855185758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6829","nonce":2855185758}]},"public_addr":"172.21.15.151:6825/2855185758","cluster_addr":"172.21.15.151:6827/2855185758","heartbeat_back_addr":"172.21.15.151:6831/2855185758","heartbeat_front_addr":"172.21.15.151:6829/2855185758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:16:52.947222+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:17:17.845611+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:17:41.769521+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:10.848974+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:35.471340+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:59.554980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:19:28.908089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:19:53.540000+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:20:17.764886+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:20:46.835859+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:21:12.186176+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:21:35.863935+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9},{"from":4,"to":7}]},{"pgid":"3.19","mappings":[{"from":3,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/1132389058":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6801/4067110310":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/1040591124":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/1171838695":"2024-09-06T01:14:54.625209+0000","172.21.15.12:6800/4067110310":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/784506983":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/992405704":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6801/3541208629":"2024-09-06T01:14:54.625209+0000","172.21.15.12:6800/3541208629":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/1532325396":"2024-09-06T01:14:54.625209+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T01:23:54.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.708+0000 7f3c75a00640 1 -- 172.21.15.12:0/3582876790 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3c540a2c90 msgr2=0x7f3c540a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:54.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.708+0000 7f3c75a00640 1 --2- 172.21.15.12:0/3582876790 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3c540a2c90 0x7f3c540a5150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3c58000c00 tx=0x7f3c58005b50 comp rx=0 tx=0).stop 2024-09-05T01:23:54.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.708+0000 7f3c75a00640 1 -- 172.21.15.12:0/3582876790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c70076720 msgr2=0x7f3c701a4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:54.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.708+0000 7f3c75a00640 1 --2- 172.21.15.12:0/3582876790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c70076720 0x7f3c701a4780 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3c6000d770 tx=0x7f3c6000dc30 comp rx=0 tx=0).stop 2024-09-05T01:23:54.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.708+0000 7f3c75a00640 1 -- 172.21.15.12:0/3582876790 shutdown_connections 2024-09-05T01:23:54.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.708+0000 7f3c75a00640 1 --2- 172.21.15.12:0/3582876790 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3c540a2c90 0x7f3c540a5150 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:54.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.708+0000 7f3c75a00640 1 --2- 172.21.15.12:0/3582876790 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c70112a50 0x7f3c7019e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:54.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.708+0000 7f3c75a00640 1 --2- 172.21.15.12:0/3582876790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c70077040 0x7f3c701a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:54.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.708+0000 7f3c75a00640 1 --2- 172.21.15.12:0/3582876790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c70076720 0x7f3c701a4780 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:54.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.708+0000 7f3c75a00640 1 -- 172.21.15.12:0/3582876790 >> 172.21.15.12:0/3582876790 conn(0x7f3c700ffa50 msgr2=0x7f3c70101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:54.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.708+0000 7f3c75a00640 1 -- 172.21.15.12:0/3582876790 shutdown_connections 2024-09-05T01:23:54.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:54.709+0000 7f3c75a00640 1 -- 172.21.15.12:0/3582876790 wait complete. 2024-09-05T01:23:55.053 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:54 smithi012 ceph-mon[29942]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:23:55.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:54 smithi145 ceph-mon[34376]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:23:55.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:54 smithi151 ceph-mon[35013]: pgmap v329: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:23:55.421 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:23:55.798 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:55.937 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:55 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3582876790' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:23:56.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:55 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3582876790' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:23:56.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:55 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3582876790' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:23:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.346+0000 7fc6afe00640 1 -- 172.21.15.12:0/1595694045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6b010bfc0 msgr2=0x7fc6b010e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.346+0000 7fc6afe00640 1 --2- 172.21.15.12:0/1595694045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6b010bfc0 0x7fc6b010e460 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009ca0 tx=0x7fc6a802a950 comp rx=0 tx=0).stop 2024-09-05T01:23:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.347+0000 7fc6afe00640 1 -- 172.21.15.12:0/1595694045 shutdown_connections 2024-09-05T01:23:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.347+0000 7fc6afe00640 1 --2- 172.21.15.12:0/1595694045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6b010bfc0 0x7fc6b010e460 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.347+0000 7fc6afe00640 1 --2- 172.21.15.12:0/1595694045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6b01034b0 0x7fc6b010b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.347+0000 7fc6afe00640 1 --2- 172.21.15.12:0/1595694045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6b0102b90 0x7fc6b0102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:56.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.347+0000 7fc6afe00640 1 -- 172.21.15.12:0/1595694045 >> 172.21.15.12:0/1595694045 conn(0x7fc6b00fc610 msgr2=0x7fc6b00fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:56.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.347+0000 7fc6afe00640 1 -- 172.21.15.12:0/1595694045 shutdown_connections 2024-09-05T01:23:56.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.347+0000 7fc6afe00640 1 -- 172.21.15.12:0/1595694045 wait complete. 2024-09-05T01:23:56.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.348+0000 7fc6afe00640 1 Processor -- start 2024-09-05T01:23:56.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.348+0000 7fc6afe00640 1 -- start start 2024-09-05T01:23:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.349+0000 7fc6afe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6b0102b90 0x7fc6b01007f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.349+0000 7fc6afe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6b01034b0 0x7fc6b0100d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.349+0000 7fc6afe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6b010bfc0 0x7fc6b0101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.349+0000 7fc6afe00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b0111dc0 con 0x7fc6b0102b90 2024-09-05T01:23:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.349+0000 7fc6afe00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b0111c40 con 0x7fc6b010bfc0 2024-09-05T01:23:56.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.349+0000 7fc6afe00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b0111f40 con 0x7fc6b01034b0 2024-09-05T01:23:56.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.349+0000 7fc6a7e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6b01034b0 0x7fc6b0100d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:56.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.349+0000 7fc6aea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6b0102b90 0x7fc6b01007f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:56.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.349+0000 7fc6a7e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6b01034b0 0x7fc6b0100d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:49140/0 (socket says 172.21.15.12:49140) 2024-09-05T01:23:56.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.349+0000 7fc6a7e00640 1 -- 172.21.15.12:0/898606671 learned_addr learned my addr 172.21.15.12:0/898606671 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.349+0000 7fc6af400640 1 --2- 172.21.15.12:0/898606671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6b010bfc0 0x7fc6b0101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.349+0000 7fc6a7e00640 1 -- 172.21.15.12:0/898606671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6b010bfc0 msgr2=0x7fc6b0101270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.349+0000 7fc6a7e00640 1 --2- 172.21.15.12:0/898606671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6b010bfc0 0x7fc6b0101270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.349+0000 7fc6a7e00640 1 -- 172.21.15.12:0/898606671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6b0102b90 msgr2=0x7fc6b01007f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.349+0000 7fc6a7e00640 1 --2- 172.21.15.12:0/898606671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6b0102b90 0x7fc6b01007f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.349+0000 7fc6a7e00640 1 -- 172.21.15.12:0/898606671 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b01a66e0 con 0x7fc6b01034b0 2024-09-05T01:23:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.350+0000 7fc6a7e00640 1 --2- 172.21.15.12:0/898606671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6b01034b0 0x7fc6b0100d30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc69800d740 tx=0x7fc69800dc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.350+0000 7fc6b4a00640 1 -- 172.21.15.12:0/898606671 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc698017070 con 0x7fc6b01034b0 2024-09-05T01:23:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.350+0000 7fc6afe00640 1 -- 172.21.15.12:0/898606671 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b01a69d0 con 0x7fc6b01034b0 2024-09-05T01:23:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.350+0000 7fc6b4a00640 1 -- 172.21.15.12:0/898606671 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc69800de50 con 0x7fc6b01034b0 2024-09-05T01:23:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.350+0000 7fc6b4a00640 1 -- 172.21.15.12:0/898606671 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc69800f620 con 0x7fc6b01034b0 2024-09-05T01:23:56.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.350+0000 7fc6afe00640 1 -- 172.21.15.12:0/898606671 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b01a6f10 con 0x7fc6b01034b0 2024-09-05T01:23:56.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.351+0000 7fc6afe00640 1 -- 172.21.15.12:0/898606671 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6b0102f70 con 0x7fc6b01034b0 2024-09-05T01:23:56.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.354+0000 7fc6b4a00640 1 -- 172.21.15.12:0/898606671 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc698009c30 con 0x7fc6b01034b0 2024-09-05T01:23:56.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.355+0000 7fc6b4a00640 1 --2- 172.21.15.12:0/898606671 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc6940a2c10 0x7fc6940a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:56.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.355+0000 7fc6b4a00640 1 -- 172.21.15.12:0/898606671 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7fc6980cece0 con 0x7fc6b01034b0 2024-09-05T01:23:56.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.355+0000 7fc6aea00640 1 --2- 172.21.15.12:0/898606671 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc6940a2c10 0x7fc6940a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:56.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.356+0000 7fc6aea00640 1 --2- 172.21.15.12:0/898606671 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc6940a2c10 0x7fc6940a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009bd0 tx=0x7fc6a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:56.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.357+0000 7fc6b4a00640 1 -- 172.21.15.12:0/898606671 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc69809b420 con 0x7fc6b01034b0 2024-09-05T01:23:56.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.578+0000 7fc6afe00640 1 -- 172.21.15.12:0/898606671 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6b0101d20 con 0x7fc6b01034b0 2024-09-05T01:23:56.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.579+0000 7fc6b4a00640 1 -- 172.21.15.12:0/898606671 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11979 (secure 0 0 0) 0x7fc6b0101d20 con 0x7fc6b01034b0 2024-09-05T01:23:56.580 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:23:56.580 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":27,"btime":"2024-09-05T01:22:48:868154+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14532,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/2949711075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":2949711075},{"type":"v1","addr":"172.21.15.12:6839","nonce":2949711075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T01:22:35.979384+0000","modified":"2024-09-05T01:22:47.915851+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24529,"mds_2":24524,"mds_3":24517,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/497406458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":497406458},{"type":"v1","addr":"172.21.15.12:6841","nonce":497406458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":10,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.145:6839/1706431882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":1706431882},{"type":"v1","addr":"172.21.15.145:6839","nonce":1706431882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24460,24517,24524,24529,24560]},"id":1}]} 2024-09-05T01:23:56.580 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 27 2024-09-05T01:23:56.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.581+0000 7fc6afe00640 1 -- 172.21.15.12:0/898606671 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc6940a2c10 msgr2=0x7fc6940a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:56.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.581+0000 7fc6afe00640 1 --2- 172.21.15.12:0/898606671 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc6940a2c10 0x7fc6940a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009bd0 tx=0x7fc6a0005f90 comp rx=0 tx=0).stop 2024-09-05T01:23:56.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.581+0000 7fc6afe00640 1 -- 172.21.15.12:0/898606671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6b01034b0 msgr2=0x7fc6b0100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:56.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.581+0000 7fc6afe00640 1 --2- 172.21.15.12:0/898606671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6b01034b0 0x7fc6b0100d30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc69800d740 tx=0x7fc69800dc00 comp rx=0 tx=0).stop 2024-09-05T01:23:56.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.581+0000 7fc6afe00640 1 -- 172.21.15.12:0/898606671 shutdown_connections 2024-09-05T01:23:56.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.581+0000 7fc6afe00640 1 --2- 172.21.15.12:0/898606671 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fc6940a2c10 0x7fc6940a50d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:56.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.581+0000 7fc6afe00640 1 --2- 172.21.15.12:0/898606671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc6b010bfc0 0x7fc6b0101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:56.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.581+0000 7fc6afe00640 1 --2- 172.21.15.12:0/898606671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6b01034b0 0x7fc6b0100d30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:56.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.581+0000 7fc6afe00640 1 --2- 172.21.15.12:0/898606671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6b0102b90 0x7fc6b01007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:56.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.581+0000 7fc6afe00640 1 -- 172.21.15.12:0/898606671 >> 172.21.15.12:0/898606671 conn(0x7fc6b00fc610 msgr2=0x7fc6b00fd270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:56.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.581+0000 7fc6afe00640 1 -- 172.21.15.12:0/898606671 shutdown_connections 2024-09-05T01:23:56.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:56.582+0000 7fc6afe00640 1 -- 172.21.15.12:0/898606671 wait complete. 2024-09-05T01:23:56.905 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:56 smithi012 ceph-mon[29942]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-05T01:23:56.906 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:56 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/898606671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:23:57.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:56 smithi145 ceph-mon[34376]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-05T01:23:57.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:56 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/898606671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:23:57.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:56 smithi151 ceph-mon[35013]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-05T01:23:57.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:56 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/898606671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:23:57.354 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-05T01:22:35.979384+0000', 'modified': '2024-09-05T01:22:47.915851+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24560, 'mds_1': 24529, 'mds_2': 24524, 'mds_3': 24517, 'mds_4': 24460}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14544': {'gid': 14544, 'name': 'a', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.12:6841/497406458', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6840', 'nonce': 497406458}, {'type': 'v1', 'addr': '172.21.15.12:6841', 'nonce': 497406458}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24460': {'gid': 24460, 'name': 'l', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.151:6833/1259141438', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6832', 'nonce': 1259141438}, {'type': 'v1', 'addr': '172.21.15.151:6833', 'nonce': 1259141438}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.145:6833/2656226932', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6832', 'nonce': 2656226932}, {'type': 'v1', 'addr': '172.21.15.145:6833', 'nonce': 2656226932}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24473': {'gid': 24473, 'name': 'j', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.12:6835/544280854', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 544280854}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 544280854}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.145:6835/397717562', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6834', 'nonce': 397717562}, {'type': 'v1', 'addr': '172.21.15.145:6835', 'nonce': 397717562}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24505': {'gid': 24505, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.151:6835/309674660', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6834', 'nonce': 309674660}, {'type': 'v1', 'addr': '172.21.15.151:6835', 'nonce': 309674660}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24517': {'gid': 24517, 'name': 'c', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.151:6837/3977122893', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6836', 'nonce': 3977122893}, {'type': 'v1', 'addr': '172.21.15.151:6837', 'nonce': 3977122893}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24524': {'gid': 24524, 'name': 'h', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.145:6837/3765112395', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6836', 'nonce': 3765112395}, {'type': 'v1', 'addr': '172.21.15.145:6837', 'nonce': 3765112395}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24529': {'gid': 24529, 'name': 'i', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.151:6839/2331000490', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6838', 'nonce': 2331000490}, {'type': 'v1', 'addr': '172.21.15.151:6839', 'nonce': 2331000490}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24560': {'gid': 24560, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.145:6839/1706431882', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6838', 'nonce': 1706431882}, {'type': 'v1', 'addr': '172.21.15.145:6839', 'nonce': 1706431882}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24560, 'qdb_cluster': [24460, 24517, 24524, 24529, 24560]} 2024-09-05T01:23:57.354 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-05T01:23:57.354 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.l status 2024-09-05T01:23:57.728 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:58.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.306+0000 7f68a7200640 1 -- 172.21.15.12:0/4278264403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68a81047e0 msgr2=0x7f68a8108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:58.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.306+0000 7f68a7200640 1 --2- 172.21.15.12:0/4278264403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68a81047e0 0x7f68a8108830 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6890009900 tx=0x7f689002a3f0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.306+0000 7f68a7200640 1 -- 172.21.15.12:0/4278264403 shutdown_connections 2024-09-05T01:23:58.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.306+0000 7f68a7200640 1 --2- 172.21.15.12:0/4278264403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68a8108f60 0x7f68a8110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.306+0000 7f68a7200640 1 --2- 172.21.15.12:0/4278264403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68a81047e0 0x7f68a8108830 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.306+0000 7f68a7200640 1 --2- 172.21.15.12:0/4278264403 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f68a8103e30 0x7f68a8104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.306+0000 7f68a7200640 1 -- 172.21.15.12:0/4278264403 >> 172.21.15.12:0/4278264403 conn(0x7f68a80ff8d0 msgr2=0x7f68a8101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:58.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.306+0000 7f68a7200640 1 -- 172.21.15.12:0/4278264403 shutdown_connections 2024-09-05T01:23:58.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.306+0000 7f68a7200640 1 -- 172.21.15.12:0/4278264403 wait complete. 2024-09-05T01:23:58.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.307+0000 7f68a7200640 1 Processor -- start 2024-09-05T01:23:58.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.307+0000 7f68a7200640 1 -- start start 2024-09-05T01:23:58.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.307+0000 7f68a7200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68a8103e30 0x7f68a819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:58.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.308+0000 7f68a7200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f68a81047e0 0x7f68a819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:58.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.308+0000 7f68a7200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68a8108f60 0x7f68a819ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:58.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.308+0000 7f68a7200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f68a8114010 con 0x7f68a8108f60 2024-09-05T01:23:58.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.308+0000 7f68a7200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f68a8113e90 con 0x7f68a81047e0 2024-09-05T01:23:58.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.308+0000 7f68a7200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f68a8114190 con 0x7f68a8103e30 2024-09-05T01:23:58.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.308+0000 7f68a6800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68a8108f60 0x7f68a819ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:58.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.308+0000 7f68a6800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68a8108f60 0x7f68a819ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44786/0 (socket says 172.21.15.12:44786) 2024-09-05T01:23:58.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.308+0000 7f68a6800640 1 -- 172.21.15.12:0/2856747355 learned_addr learned my addr 172.21.15.12:0/2856747355 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:58.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.308+0000 7f68a5e00640 1 --2- 172.21.15.12:0/2856747355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68a8103e30 0x7f68a819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:58.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.308+0000 7f689d400640 1 --2- 172.21.15.12:0/2856747355 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f68a81047e0 0x7f68a819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:58.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.308+0000 7f68a6800640 1 -- 172.21.15.12:0/2856747355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68a8103e30 msgr2=0x7f68a819a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:58.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.308+0000 7f68a6800640 1 --2- 172.21.15.12:0/2856747355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68a8103e30 0x7f68a819a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.308+0000 7f68a6800640 1 -- 172.21.15.12:0/2856747355 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f68a81047e0 msgr2=0x7f68a819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:58.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.308+0000 7f68a6800640 1 --2- 172.21.15.12:0/2856747355 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f68a81047e0 0x7f68a819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.308+0000 7f68a6800640 1 -- 172.21.15.12:0/2856747355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a819f440 con 0x7f68a8108f60 2024-09-05T01:23:58.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.308+0000 7f68a5e00640 1 --2- 172.21.15.12:0/2856747355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68a8103e30 0x7f68a819a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:23:58.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.309+0000 7f68a6800640 1 --2- 172.21.15.12:0/2856747355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68a8108f60 0x7f68a819ed60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f68a000eb10 tx=0x7f68a000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:58.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.309+0000 7f689f400640 1 -- 172.21.15.12:0/2856747355 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a0004b20 con 0x7f68a8108f60 2024-09-05T01:23:58.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.309+0000 7f689f400640 1 -- 172.21.15.12:0/2856747355 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68a0004cc0 con 0x7f68a8108f60 2024-09-05T01:23:58.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.309+0000 7f689f400640 1 -- 172.21.15.12:0/2856747355 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a0010760 con 0x7f68a8108f60 2024-09-05T01:23:58.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.309+0000 7f68a7200640 1 -- 172.21.15.12:0/2856747355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68a819f730 con 0x7f68a8108f60 2024-09-05T01:23:58.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.309+0000 7f68a7200640 1 -- 172.21.15.12:0/2856747355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68a81a7010 con 0x7f68a8108f60 2024-09-05T01:23:58.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.312+0000 7f68af83c740 1 Processor -- start 2024-09-05T01:23:58.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.312+0000 7f689f400640 1 -- 172.21.15.12:0/2856747355 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f68a0005020 con 0x7f68a8108f60 2024-09-05T01:23:58.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.313+0000 7f68af83c740 1 -- start start 2024-09-05T01:23:58.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.313+0000 7f68af83c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5585cbb994e0 0x5585cbb998c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:58.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.313+0000 7f68af83c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb99e00 0x5585cbba4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:58.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.313+0000 7f68af83c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585cbba46c0 0x5585cbba6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:58.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.313+0000 7f68af83c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5585cbaff0b0 con 0x5585cbb99e00 2024-09-05T01:23:58.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.313+0000 7f68af83c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5585cbaa6ab0 con 0x5585cbb994e0 2024-09-05T01:23:58.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.313+0000 7f68af83c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5585cbafb070 con 0x5585cbba46c0 2024-09-05T01:23:58.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.313+0000 7f68a5e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb99e00 0x5585cbba4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:58.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.313+0000 7f68a5e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb99e00 0x5585cbba4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44802/0 (socket says 172.21.15.12:44802) 2024-09-05T01:23:58.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.313+0000 7f68a5e00640 1 -- 172.21.15.12:0/1441401773 learned_addr learned my addr 172.21.15.12:0/1441401773 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:58.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.313+0000 7f689d400640 1 --2- 172.21.15.12:0/1441401773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5585cbb994e0 0x5585cbb998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:58.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.313+0000 7f689d400640 1 --2- 172.21.15.12:0/1441401773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585cbba46c0 0x5585cbba6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:58.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.314+0000 7f68a5e00640 1 -- 172.21.15.12:0/1441401773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585cbba46c0 msgr2=0x5585cbba6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:23:58.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.314+0000 7f68a5e00640 1 --2- 172.21.15.12:0/1441401773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585cbba46c0 0x5585cbba6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.314+0000 7f68a5e00640 1 -- 172.21.15.12:0/1441401773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5585cbb994e0 msgr2=0x5585cbb998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:23:58.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.314+0000 7f68a5e00640 1 --2- 172.21.15.12:0/1441401773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5585cbb994e0 0x5585cbb998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.314+0000 7f68a5e00640 1 -- 172.21.15.12:0/1441401773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585cbab34a0 con 0x5585cbb99e00 2024-09-05T01:23:58.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.314+0000 7f689f400640 1 --2- 172.21.15.12:0/2856747355 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f688c0a2c90 0x7f688c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:58.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.314+0000 7f68a5e00640 1 --2- 172.21.15.12:0/1441401773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb99e00 0x5585cbba4180 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6898010480 tx=0x7f6898010940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85001a5d7f87484 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:58.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.314+0000 7f689f400640 1 -- 172.21.15.12:0/2856747355 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f68a00cf7f0 con 0x7f68a8108f60 2024-09-05T01:23:58.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.314+0000 7f689d400640 1 --2- 172.21.15.12:0/2856747355 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f688c0a2c90 0x7f688c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:58.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.314+0000 7f6897400640 1 -- 172.21.15.12:0/1441401773 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6898011760 con 0x5585cbb99e00 2024-09-05T01:23:58.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.315+0000 7f6897400640 1 -- 172.21.15.12:0/1441401773 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6898011de0 con 0x5585cbb99e00 2024-09-05T01:23:58.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.315+0000 7f6897400640 1 -- 172.21.15.12:0/1441401773 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68980193d0 con 0x5585cbb99e00 2024-09-05T01:23:58.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.315+0000 7f68af83c740 1 -- 172.21.15.12:0/1441401773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb99e00 msgr2=0x5585cbba4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:58.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.315+0000 7f68af83c740 1 --2- 172.21.15.12:0/1441401773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb99e00 0x5585cbba4180 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6898010480 tx=0x7f6898010940 comp rx=0 tx=0).stop 2024-09-05T01:23:58.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.315+0000 7f689d400640 1 --2- 172.21.15.12:0/2856747355 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f688c0a2c90 0x7f688c0a5150 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6890000c00 tx=0x7f6890041040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:58.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.315+0000 7f68af83c740 1 -- 172.21.15.12:0/1441401773 shutdown_connections 2024-09-05T01:23:58.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.315+0000 7f68af83c740 1 --2- 172.21.15.12:0/1441401773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585cbba46c0 0x5585cbba6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.315+0000 7f68af83c740 1 --2- 172.21.15.12:0/1441401773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb99e00 0x5585cbba4180 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.315+0000 7f68af83c740 1 --2- 172.21.15.12:0/1441401773 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5585cbb994e0 0x5585cbb998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.315+0000 7f68af83c740 1 -- 172.21.15.12:0/1441401773 >> 172.21.15.12:0/1441401773 conn(0x5585cbb95a70 msgr2=0x5585cbb95e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:58.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.316+0000 7f68af83c740 1 -- 172.21.15.12:0/1441401773 shutdown_connections 2024-09-05T01:23:58.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.316+0000 7f68af83c740 1 -- 172.21.15.12:0/1441401773 wait complete. 2024-09-05T01:23:58.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.316+0000 7f68af83c740 1 -- start start 2024-09-05T01:23:58.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.316+0000 7f68af83c740 1 Processor -- start 2024-09-05T01:23:58.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.317+0000 7f68af83c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb994e0 0x5585cbba1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:58.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.317+0000 7f68af83c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5585cbb99e00 0x5585cbba1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:58.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.317+0000 7f68af83c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585cbba46c0 0x5585cbba1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:58.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.317+0000 7f68af83c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5585cbba7330 con 0x5585cbb994e0 2024-09-05T01:23:58.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.317+0000 7f68af83c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5585cba87920 con 0x5585cbb99e00 2024-09-05T01:23:58.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.317+0000 7f68af83c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5585cbba74b0 con 0x5585cbba46c0 2024-09-05T01:23:58.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.317+0000 7f68af83c740 10 client.0 _ll_register_callbacks cb 0x5585cbaab8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:23:58.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.317+0000 7f68a5e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb994e0 0x5585cbba1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:58.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.317+0000 7f689d400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5585cbb99e00 0x5585cbba1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:58.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.317+0000 7f68a5e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb994e0 0x5585cbba1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44810/0 (socket says 172.21.15.12:44810) 2024-09-05T01:23:58.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.317+0000 7f68a5e00640 1 -- 172.21.15.12:0/3267788589 learned_addr learned my addr 172.21.15.12:0/3267788589 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:58.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.317+0000 7f68a6800640 1 --2- 172.21.15.12:0/3267788589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585cbba46c0 0x5585cbba1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:58.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.317+0000 7f68a5e00640 1 -- 172.21.15.12:0/3267788589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585cbba46c0 msgr2=0x5585cbba1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:23:58.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.317+0000 7f68a5e00640 1 --2- 172.21.15.12:0/3267788589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585cbba46c0 0x5585cbba1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.317+0000 7f68a5e00640 1 -- 172.21.15.12:0/3267788589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5585cbb99e00 msgr2=0x5585cbba1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:23:58.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.317+0000 7f68a5e00640 1 --2- 172.21.15.12:0/3267788589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5585cbb99e00 0x5585cbba1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.317+0000 7f68a5e00640 1 -- 172.21.15.12:0/3267788589 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585cb8702b0 con 0x5585cbb994e0 2024-09-05T01:23:58.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.317+0000 7f68a6800640 1 --2- 172.21.15.12:0/3267788589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585cbba46c0 0x5585cbba1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:23:58.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.318+0000 7f68a5e00640 1 --2- 172.21.15.12:0/3267788589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb994e0 0x5585cbba1560 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6898000c00 tx=0x7f689800bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52931996249e82a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:58.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.318+0000 7f688be00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:23:58.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.318+0000 7f688be00640 1 -- 172.21.15.12:0/3267788589 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689800edc0 con 0x5585cbb994e0 2024-09-05T01:23:58.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.318+0000 7f688be00640 1 -- 172.21.15.12:0/3267788589 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f689800e3d0 con 0x5585cbb994e0 2024-09-05T01:23:58.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.318+0000 7f68af83c740 1 -- 172.21.15.12:0/3267788589 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6898011de0 con 0x5585cbb994e0 2024-09-05T01:23:58.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.318+0000 7f688be00640 1 -- 172.21.15.12:0/3267788589 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f689800e5d0 con 0x5585cbb994e0 2024-09-05T01:23:58.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.318+0000 7f68af83c740 10 client.14895 fetch_fsmap learned FSMap version 27 2024-09-05T01:23:58.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.319+0000 7f68af83c740 1 -- 172.21.15.12:0/3267788589 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5585cbbb2f90 con 0x5585cbb994e0 2024-09-05T01:23:58.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.319+0000 7f688be00640 1 -- 172.21.15.12:0/3267788589 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6898011de0 con 0x5585cbb994e0 2024-09-05T01:23:58.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.319+0000 7f688be00640 1 -- 172.21.15.12:0/3267788589 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f6898011900 con 0x5585cbb994e0 2024-09-05T01:23:58.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.319+0000 7f68af83c740 10 client.14895 fetch_fsmap finished waiting for FSMap version 27 2024-09-05T01:23:58.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.319+0000 7f68af83c740 10 client.14895 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-05T01:23:58.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.319+0000 7f68af83c740 20 client.14895 populate_metadata read hostname 'smithi012' 2024-09-05T01:23:58.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.319+0000 7f68af83c740 1 --2- 172.21.15.12:0/3267788589 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5585cbbb52a0 0x5585cbbb6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:58.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.319+0000 7f68af83c740 4 client.14895 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:23:58.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.319+0000 7f68af83c740 1 -- 172.21.15.12:0/3267788589 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585cbb0c620 con 0x5585cbbb52a0 2024-09-05T01:23:58.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.320+0000 7f689d400640 1 --2- 172.21.15.12:0/3267788589 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5585cbbb52a0 0x5585cbbb6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:58.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.320+0000 7f689d400640 1 --2- 172.21.15.12:0/3267788589 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5585cbbb52a0 0x5585cbbb6710 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7defd359207badcc server_cookie=fc468c8e06551ff4 in_seq=0 out_seq=0 2024-09-05T01:23:58.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.320+0000 7f688be00640 10 client.14895 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:23:58.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.321+0000 7f688be00640 1 -- 172.21.15.12:0/3267788589 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5585cbb0c620 con 0x5585cbbb52a0 2024-09-05T01:23:58.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.321+0000 7f688be00640 10 client.14895 handle_command_reply: tid=0 2024-09-05T01:23:58.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.321+0000 7f68af83c740 1 client.14895 shutdown 2024-09-05T01:23:58.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.321+0000 7f68af83c740 1 -- 172.21.15.12:0/3267788589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb994e0 msgr2=0x5585cbba1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:58.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.321+0000 7f68af83c740 1 --2- 172.21.15.12:0/3267788589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb994e0 0x5585cbba1560 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6898000c00 tx=0x7f689800bd60 comp rx=0 tx=0).stop 2024-09-05T01:23:58.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.322+0000 7f68af83c740 1 -- 172.21.15.12:0/3267788589 shutdown_connections 2024-09-05T01:23:58.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.322+0000 7f68af83c740 1 --2- 172.21.15.12:0/3267788589 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5585cbbb52a0 0x5585cbbb6710 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.322+0000 7f68af83c740 1 --2- 172.21.15.12:0/3267788589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585cbba46c0 0x5585cbba1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.322+0000 7f68af83c740 1 --2- 172.21.15.12:0/3267788589 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5585cbb99e00 0x5585cbba1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.322+0000 7f68af83c740 1 --2- 172.21.15.12:0/3267788589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb994e0 0x5585cbba1560 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.322+0000 7f68af83c740 1 -- 172.21.15.12:0/3267788589 >> 172.21.15.12:0/3267788589 conn(0x5585cbb95a70 msgr2=0x5585cbb9b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:58.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.322+0000 7f688be00640 0 client.14895 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:23:58.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.322+0000 7f68af83c740 1 -- 172.21.15.12:0/3267788589 shutdown_connections 2024-09-05T01:23:58.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.322+0000 7f68af83c740 1 -- 172.21.15.12:0/3267788589 wait complete. 2024-09-05T01:23:58.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.322+0000 7f68af83c740 20 client.14895 trim_cache size 0 max 16384 2024-09-05T01:23:58.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.341+0000 7f68af83c740 1 Processor -- start 2024-09-05T01:23:58.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.341+0000 7f68af83c740 1 -- start start 2024-09-05T01:23:58.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.341+0000 7f68af83c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb994e0 0x5585cbbb6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:58.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.341+0000 7f68af83c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5585cbb99e00 0x5585cbb9bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:58.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.341+0000 7f68af83c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585cbba46c0 0x5585cbba34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:58.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.341+0000 7f68af83c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5585cbbb4a50 con 0x5585cbb994e0 2024-09-05T01:23:58.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.341+0000 7f68af83c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5585cbbb5120 con 0x5585cbb99e00 2024-09-05T01:23:58.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.341+0000 7f68af83c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5585cbbb57f0 con 0x5585cbba46c0 2024-09-05T01:23:58.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.341+0000 7f68a5e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb994e0 0x5585cbbb6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:58.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.341+0000 7f68a5e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb994e0 0x5585cbbb6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44818/0 (socket says 172.21.15.12:44818) 2024-09-05T01:23:58.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.341+0000 7f68a6800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585cbba46c0 0x5585cbba34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:58.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.341+0000 7f68a5e00640 1 -- 172.21.15.12:0/36575748 learned_addr learned my addr 172.21.15.12:0/36575748 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:58.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.341+0000 7f689d400640 1 --2- 172.21.15.12:0/36575748 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5585cbb99e00 0x5585cbb9bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:58.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.342+0000 7f68a6800640 1 -- 172.21.15.12:0/36575748 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5585cbb99e00 msgr2=0x5585cbb9bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:23:58.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.342+0000 7f68a6800640 1 --2- 172.21.15.12:0/36575748 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5585cbb99e00 0x5585cbb9bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.342+0000 7f68a6800640 1 -- 172.21.15.12:0/36575748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb994e0 msgr2=0x5585cbbb6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:23:58.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.342+0000 7f68a6800640 1 --2- 172.21.15.12:0/36575748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb994e0 0x5585cbbb6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.342+0000 7f68a6800640 1 -- 172.21.15.12:0/36575748 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585cbba0510 con 0x5585cbba46c0 2024-09-05T01:23:58.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.342+0000 7f68a5e00640 1 --2- 172.21.15.12:0/36575748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb994e0 0x5585cbbb6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:23:58.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.342+0000 7f689d400640 1 --2- 172.21.15.12:0/36575748 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5585cbb99e00 0x5585cbb9bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:23:58.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.342+0000 7f68a6800640 1 --2- 172.21.15.12:0/36575748 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585cbba46c0 0x5585cbba34d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f68a00cd100 tx=0x7f68a009bc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4d791e015f89170 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:58.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.342+0000 7f6896a00640 1 -- 172.21.15.12:0/36575748 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a009c580 con 0x5585cbba46c0 2024-09-05T01:23:58.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.342+0000 7f6896a00640 1 -- 172.21.15.12:0/36575748 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68a009be80 con 0x5585cbba46c0 2024-09-05T01:23:58.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.342+0000 7f6896a00640 1 -- 172.21.15.12:0/36575748 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a0005570 con 0x5585cbba46c0 2024-09-05T01:23:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.343+0000 7f68af83c740 1 -- 172.21.15.12:0/36575748 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585cbba46c0 msgr2=0x5585cbba34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.343+0000 7f68af83c740 1 --2- 172.21.15.12:0/36575748 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585cbba46c0 0x5585cbba34d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f68a00cd100 tx=0x7f68a009bc50 comp rx=0 tx=0).stop 2024-09-05T01:23:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.343+0000 7f68af83c740 1 -- 172.21.15.12:0/36575748 shutdown_connections 2024-09-05T01:23:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.343+0000 7f68af83c740 1 --2- 172.21.15.12:0/36575748 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585cbba46c0 0x5585cbba34d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.343+0000 7f68af83c740 1 --2- 172.21.15.12:0/36575748 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5585cbb99e00 0x5585cbb9bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.343+0000 7f68af83c740 1 --2- 172.21.15.12:0/36575748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb994e0 0x5585cbbb6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.343+0000 7f68af83c740 1 -- 172.21.15.12:0/36575748 >> 172.21.15.12:0/36575748 conn(0x5585cbb95a70 msgr2=0x5585cbba2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.343+0000 7f68af83c740 1 -- 172.21.15.12:0/36575748 shutdown_connections 2024-09-05T01:23:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.343+0000 7f68af83c740 1 -- 172.21.15.12:0/36575748 wait complete. 2024-09-05T01:23:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.343+0000 7f68af83c740 1 -- start start 2024-09-05T01:23:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.344+0000 7f68af83c740 1 Processor -- start 2024-09-05T01:23:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.344+0000 7f68af83c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb994e0 0x5585cbbbf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.344+0000 7f68af83c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585cbb99e00 0x5585cbbb8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.344+0000 7f68af83c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5585cbba46c0 0x5585cbbb88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.344+0000 7f68af83c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5585cbbb6590 con 0x5585cbb994e0 2024-09-05T01:23:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.344+0000 7f68af83c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5585cbbb5ec0 con 0x5585cbba46c0 2024-09-05T01:23:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.344+0000 7f68af83c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5585cbbb6c60 con 0x5585cbb99e00 2024-09-05T01:23:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.344+0000 7f68af83c740 10 client.0 _ll_register_callbacks cb 0x7f689800e910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:23:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.344+0000 7f68a5e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb994e0 0x5585cbbbf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.345+0000 7f68a5e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb994e0 0x5585cbbbf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44820/0 (socket says 172.21.15.12:44820) 2024-09-05T01:23:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.345+0000 7f689d400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585cbb99e00 0x5585cbbb8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.345+0000 7f68a5e00640 1 -- 172.21.15.12:0/2306478474 learned_addr learned my addr 172.21.15.12:0/2306478474 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:23:58.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.345+0000 7f68a6800640 1 --2- 172.21.15.12:0/2306478474 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5585cbba46c0 0x5585cbbb88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:58.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.345+0000 7f68a5e00640 1 -- 172.21.15.12:0/2306478474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585cbb99e00 msgr2=0x5585cbbb8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:23:58.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.345+0000 7f68a5e00640 1 --2- 172.21.15.12:0/2306478474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585cbb99e00 0x5585cbbb8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.345+0000 7f68a5e00640 1 -- 172.21.15.12:0/2306478474 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5585cbba46c0 msgr2=0x5585cbbb88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:23:58.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.345+0000 7f68a5e00640 1 --2- 172.21.15.12:0/2306478474 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5585cbba46c0 0x5585cbbb88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.345+0000 7f68a5e00640 1 -- 172.21.15.12:0/2306478474 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585cbbb8fd0 con 0x5585cbb994e0 2024-09-05T01:23:58.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.345+0000 7f689d400640 1 --2- 172.21.15.12:0/2306478474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585cbb99e00 0x5585cbbb8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:23:58.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.345+0000 7f68a6800640 1 --2- 172.21.15.12:0/2306478474 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5585cbba46c0 0x5585cbbb88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:23:58.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.345+0000 7f68a5e00640 1 --2- 172.21.15.12:0/2306478474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb994e0 0x5585cbbbf050 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6898011ca0 tx=0x7f689800e770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319251b9341e009f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:23:58.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.345+0000 7f688be00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:23:58.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.346+0000 7f688be00640 1 -- 172.21.15.12:0/2306478474 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689801f040 con 0x5585cbb994e0 2024-09-05T01:23:58.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.346+0000 7f68af83c740 1 -- 172.21.15.12:0/2306478474 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68a009be80 con 0x5585cbb994e0 2024-09-05T01:23:58.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.346+0000 7f688be00640 1 -- 172.21.15.12:0/2306478474 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f689800e350 con 0x5585cbb994e0 2024-09-05T01:23:58.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.346+0000 7f688be00640 1 -- 172.21.15.12:0/2306478474 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f689800e9c0 con 0x5585cbb994e0 2024-09-05T01:23:58.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.346+0000 7f68af83c740 10 client.14901 fetch_fsmap learned FSMap version 27 2024-09-05T01:23:58.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.346+0000 7f68af83c740 1 -- 172.21.15.12:0/2306478474 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5585cbc1f9b0 con 0x5585cbb994e0 2024-09-05T01:23:58.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.346+0000 7f688be00640 1 -- 172.21.15.12:0/2306478474 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68a009be80 con 0x5585cbb994e0 2024-09-05T01:23:58.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.346+0000 7f688be00640 1 -- 172.21.15.12:0/2306478474 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f689803e030 con 0x5585cbb994e0 2024-09-05T01:23:58.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.347+0000 7f68af83c740 10 client.14901 fetch_fsmap finished waiting for FSMap version 27 2024-09-05T01:23:58.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.347+0000 7f68af83c740 10 client.14901 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-05T01:23:58.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.347+0000 7f68af83c740 20 client.14901 populate_metadata read hostname 'smithi012' 2024-09-05T01:23:58.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.347+0000 7f68af83c740 1 --2- 172.21.15.12:0/2306478474 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5585cbc24430 0x5585cbc23140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:23:58.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.347+0000 7f68af83c740 4 client.14901 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T01:23:58.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.347+0000 7f68af83c740 1 -- 172.21.15.12:0/2306478474 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "status"}) -- 0x5585cbb06b30 con 0x5585cbc24430 2024-09-05T01:23:58.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.347+0000 7f689d400640 1 --2- 172.21.15.12:0/2306478474 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5585cbc24430 0x5585cbc23140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:23:58.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.347+0000 7f689d400640 1 --2- 172.21.15.12:0/2306478474 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5585cbc24430 0x5585cbc23140 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3d14ac99bc4d7478 server_cookie=4a4fadfcc111d34f in_seq=0 out_seq=0 2024-09-05T01:23:58.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.347+0000 7f688be00640 10 client.14901 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:23:58.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.348+0000 7f688be00640 1 -- 172.21.15.12:0/2306478474 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5585cbb06b30 con 0x5585cbc24430 2024-09-05T01:23:58.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.348+0000 7f688be00640 10 client.14901 handle_command_reply: tid=0 2024-09-05T01:23:58.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.348+0000 7f68af83c740 1 client.14901 shutdown 2024-09-05T01:23:58.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.348+0000 7f68af83c740 1 -- 172.21.15.12:0/2306478474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb994e0 msgr2=0x5585cbbbf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:58.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.348+0000 7f68af83c740 1 --2- 172.21.15.12:0/2306478474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb994e0 0x5585cbbbf050 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6898011ca0 tx=0x7f689800e770 comp rx=0 tx=0).stop 2024-09-05T01:23:58.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.348+0000 7f68af83c740 1 -- 172.21.15.12:0/2306478474 shutdown_connections 2024-09-05T01:23:58.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.348+0000 7f68af83c740 1 --2- 172.21.15.12:0/2306478474 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5585cbc24430 0x5585cbc23140 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.348+0000 7f68af83c740 1 --2- 172.21.15.12:0/2306478474 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5585cbba46c0 0x5585cbbb88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.348+0000 7f68af83c740 1 --2- 172.21.15.12:0/2306478474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585cbb99e00 0x5585cbbb8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.348+0000 7f68af83c740 1 --2- 172.21.15.12:0/2306478474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5585cbb994e0 0x5585cbbbf050 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.348+0000 7f68af83c740 1 -- 172.21.15.12:0/2306478474 >> 172.21.15.12:0/2306478474 conn(0x5585cbb95a70 msgr2=0x5585cbbaff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:58.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.348+0000 7f688be00640 0 client.14901 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:23:58.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.348+0000 7f68af83c740 1 -- 172.21.15.12:0/2306478474 shutdown_connections 2024-09-05T01:23:58.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.348+0000 7f68af83c740 1 -- 172.21.15.12:0/2306478474 wait complete. 2024-09-05T01:23:58.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.348+0000 7f68af83c740 20 client.14901 trim_cache size 0 max 16384 2024-09-05T01:23:58.353 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:23:58.353 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "0d44cd7e-6b24-11ef-bcd6-c7b262605968", 2024-09-05T01:23:58.353 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 4, 2024-09-05T01:23:58.354 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24460, 2024-09-05T01:23:58.354 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-05T01:23:58.354 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-05T01:23:58.354 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-05T01:23:58.354 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 71.487651362999998, 2024-09-05T01:23:58.354 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 27, 2024-09-05T01:23:58.354 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 83, 2024-09-05T01:23:58.354 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 81, 2024-09-05T01:23:58.354 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 129.41920217200001 2024-09-05T01:23:58.354 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:23:58.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.349+0000 7f68a7200640 1 -- 172.21.15.12:0/2856747355 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f688c0a2c90 msgr2=0x7f688c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:58.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.349+0000 7f68a7200640 1 --2- 172.21.15.12:0/2856747355 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f688c0a2c90 0x7f688c0a5150 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6890000c00 tx=0x7f6890041040 comp rx=0 tx=0).stop 2024-09-05T01:23:58.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.349+0000 7f68a7200640 1 -- 172.21.15.12:0/2856747355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68a8108f60 msgr2=0x7f68a819ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:58.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.349+0000 7f68a7200640 1 --2- 172.21.15.12:0/2856747355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68a8108f60 0x7f68a819ed60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f68a000eb10 tx=0x7f68a000c2d0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.349+0000 7f68a7200640 1 -- 172.21.15.12:0/2856747355 shutdown_connections 2024-09-05T01:23:58.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.349+0000 7f68a7200640 1 --2- 172.21.15.12:0/2856747355 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f688c0a2c90 0x7f688c0a5150 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.349+0000 7f68a7200640 1 --2- 172.21.15.12:0/2856747355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68a8108f60 0x7f68a819ed60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.349+0000 7f68a7200640 1 --2- 172.21.15.12:0/2856747355 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f68a81047e0 0x7f68a819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.349+0000 7f68a7200640 1 --2- 172.21.15.12:0/2856747355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68a8103e30 0x7f68a819a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:58.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.349+0000 7f68a7200640 1 -- 172.21.15.12:0/2856747355 >> 172.21.15.12:0/2856747355 conn(0x7f68a80ff8d0 msgr2=0x7f68a8100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:58.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.349+0000 7f68a7200640 1 -- 172.21.15.12:0/2856747355 shutdown_connections 2024-09-05T01:23:58.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:58.349+0000 7f68a7200640 1 -- 172.21.15.12:0/2856747355 wait complete. 2024-09-05T01:23:58.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:23:58 smithi012 ceph-mon[29942]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:23:58.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:23:58 smithi145 ceph-mon[34376]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:23:58.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:23:58 smithi151 ceph-mon[35013]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:23:59.077 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.c status 2024-09-05T01:23:59.452 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:23:59.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.997+0000 7f9108600640 1 -- 172.21.15.12:0/2611759138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91001027a0 msgr2=0x7f91001067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:23:59.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.997+0000 7f9108600640 1 --2- 172.21.15.12:0/2611759138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91001027a0 0x7f91001067f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009900 tx=0x7f90ec02a410 comp rx=0 tx=0).stop 2024-09-05T01:23:59.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.997+0000 7f9108600640 1 -- 172.21.15.12:0/2611759138 shutdown_connections 2024-09-05T01:23:59.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.997+0000 7f9108600640 1 --2- 172.21.15.12:0/2611759138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9100106f20 0x7f910010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:59.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.997+0000 7f9108600640 1 --2- 172.21.15.12:0/2611759138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91001027a0 0x7f91001067f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:59.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.997+0000 7f9108600640 1 --2- 172.21.15.12:0/2611759138 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9100101df0 0x7f91001021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:23:59.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.997+0000 7f9108600640 1 -- 172.21.15.12:0/2611759138 >> 172.21.15.12:0/2611759138 conn(0x7f91000fd8b0 msgr2=0x7f91000ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:23:59.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.997+0000 7f9108600640 1 -- 172.21.15.12:0/2611759138 shutdown_connections 2024-09-05T01:23:59.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.997+0000 7f9108600640 1 -- 172.21.15.12:0/2611759138 wait complete. 2024-09-05T01:24:00.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.998+0000 7f9108600640 1 Processor -- start 2024-09-05T01:24:00.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.998+0000 7f9108600640 1 -- start start 2024-09-05T01:24:00.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.998+0000 7f9108600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9100101df0 0x7f910019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:00.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.998+0000 7f9108600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91001027a0 0x7f910019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:00.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.998+0000 7f9108600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9100106f20 0x7f910019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:00.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.998+0000 7f9108600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9100111fd0 con 0x7f91001027a0 2024-09-05T01:24:00.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.998+0000 7f9108600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9100111e50 con 0x7f9100101df0 2024-09-05T01:24:00.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.998+0000 7f9108600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9100112150 con 0x7f9100106f20 2024-09-05T01:24:00.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.999+0000 7f9105200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91001027a0 0x7f910019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:00.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.999+0000 7f9105c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9100101df0 0x7f910019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:00.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.999+0000 7f9105c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9100101df0 0x7f910019a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:59924/0 (socket says 172.21.15.12:59924) 2024-09-05T01:24:00.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.999+0000 7f9105200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91001027a0 0x7f910019ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44846/0 (socket says 172.21.15.12:44846) 2024-09-05T01:24:00.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.999+0000 7f9105c00640 1 -- 172.21.15.12:0/876729596 learned_addr learned my addr 172.21.15.12:0/876729596 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:00.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.999+0000 7f9106600640 1 --2- 172.21.15.12:0/876729596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9100106f20 0x7f910019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:00.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.999+0000 7f9105c00640 1 -- 172.21.15.12:0/876729596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9100106f20 msgr2=0x7f910019ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:00.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.999+0000 7f9105c00640 1 --2- 172.21.15.12:0/876729596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9100106f20 0x7f910019ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.999+0000 7f9105c00640 1 -- 172.21.15.12:0/876729596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91001027a0 msgr2=0x7f910019ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:00.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.999+0000 7f9105c00640 1 --2- 172.21.15.12:0/876729596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91001027a0 0x7f910019ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.999+0000 7f9105c00640 1 -- 172.21.15.12:0/876729596 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f910019f5e0 con 0x7f9100101df0 2024-09-05T01:24:00.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:23:59.999+0000 7f9105c00640 1 --2- 172.21.15.12:0/876729596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9100101df0 0x7f910019a630 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f90f400e9f0 tx=0x7f90f400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.000+0000 7f90fe000640 1 -- 172.21.15.12:0/876729596 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f400cd80 con 0x7f9100101df0 2024-09-05T01:24:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.000+0000 7f9108600640 1 -- 172.21.15.12:0/876729596 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f910019f8d0 con 0x7f9100101df0 2024-09-05T01:24:00.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.000+0000 7f90fe000640 1 -- 172.21.15.12:0/876729596 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90f4010910 con 0x7f9100101df0 2024-09-05T01:24:00.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.000+0000 7f90fe000640 1 -- 172.21.15.12:0/876729596 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f40188f0 con 0x7f9100101df0 2024-09-05T01:24:00.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.000+0000 7f9108600640 1 -- 172.21.15.12:0/876729596 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91001a71b0 con 0x7f9100101df0 2024-09-05T01:24:00.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.003+0000 7f910afed740 1 Processor -- start 2024-09-05T01:24:00.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.003+0000 7f910afed740 1 -- start start 2024-09-05T01:24:00.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.003+0000 7f90fe000640 1 -- 172.21.15.12:0/876729596 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f90f4010ac0 con 0x7f9100101df0 2024-09-05T01:24:00.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.003+0000 7f910afed740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555a8ca8f330 0x555a8ca8f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:00.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.003+0000 7f910afed740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555a8ca8fc50 0x555a8ca99fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:00.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.003+0000 7f910afed740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca9a510 0x555a8ca9c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:00.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.003+0000 7f910afed740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555a8c9f50b0 con 0x555a8ca8fc50 2024-09-05T01:24:00.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.003+0000 7f910afed740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555a8c99cab0 con 0x555a8ca8f330 2024-09-05T01:24:00.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.003+0000 7f910afed740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555a8c9f1070 con 0x555a8ca9a510 2024-09-05T01:24:00.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.004+0000 7f9105c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555a8ca8fc50 0x555a8ca99fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:00.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.004+0000 7f9105200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca9a510 0x555a8ca9c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:00.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.004+0000 7f9106600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555a8ca8f330 0x555a8ca8f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:00.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.004+0000 7f9105200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca9a510 0x555a8ca9c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:49954/0 (socket says 172.21.15.12:49954) 2024-09-05T01:24:00.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.004+0000 7f9105200640 1 -- 172.21.15.12:0/130704580 learned_addr learned my addr 172.21.15.12:0/130704580 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:00.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.004+0000 7f9105200640 1 -- 172.21.15.12:0/130704580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555a8ca8f330 msgr2=0x555a8ca8f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:00.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.004+0000 7f9105200640 1 --2- 172.21.15.12:0/130704580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555a8ca8f330 0x555a8ca8f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.004+0000 7f9105200640 1 -- 172.21.15.12:0/130704580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555a8ca8fc50 msgr2=0x555a8ca99fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:00.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.004+0000 7f9105200640 1 --2- 172.21.15.12:0/130704580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555a8ca8fc50 0x555a8ca99fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.004+0000 7f9105200640 1 -- 172.21.15.12:0/130704580 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a8c9a94a0 con 0x555a8ca9a510 2024-09-05T01:24:00.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.005+0000 7f9105200640 1 --2- 172.21.15.12:0/130704580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca9a510 0x555a8ca9c900 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009900 tx=0x7f90ec005de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd727511950180d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:00.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.005+0000 7f90f2a00640 1 -- 172.21.15.12:0/130704580 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ec035040 con 0x555a8ca9a510 2024-09-05T01:24:00.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.005+0000 7f90fe000640 1 --2- 172.21.15.12:0/876729596 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f90e80a2c10 0x7f90e80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:00.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.005+0000 7f90f2a00640 1 -- 172.21.15.12:0/130704580 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90ec004400 con 0x555a8ca9a510 2024-09-05T01:24:00.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.005+0000 7f90f2a00640 1 -- 172.21.15.12:0/130704580 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ec0035f0 con 0x555a8ca9a510 2024-09-05T01:24:00.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.005+0000 7f90fe000640 1 -- 172.21.15.12:0/876729596 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f90f40cf5d0 con 0x7f9100101df0 2024-09-05T01:24:00.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.005+0000 7f9106600640 1 --2- 172.21.15.12:0/876729596 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f90e80a2c10 0x7f90e80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:00.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.006+0000 7f910afed740 1 -- 172.21.15.12:0/130704580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca9a510 msgr2=0x555a8ca9c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:00.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.006+0000 7f910afed740 1 --2- 172.21.15.12:0/130704580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca9a510 0x555a8ca9c900 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f90ec009900 tx=0x7f90ec005de0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.006+0000 7f9106600640 1 --2- 172.21.15.12:0/876729596 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f90e80a2c10 0x7f90e80a50d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f90f8005fd0 tx=0x7f90f8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:00.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.006+0000 7f910afed740 1 -- 172.21.15.12:0/130704580 shutdown_connections 2024-09-05T01:24:00.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.006+0000 7f910afed740 1 --2- 172.21.15.12:0/130704580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca9a510 0x555a8ca9c900 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.006+0000 7f910afed740 1 --2- 172.21.15.12:0/130704580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555a8ca8fc50 0x555a8ca99fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.006+0000 7f910afed740 1 --2- 172.21.15.12:0/130704580 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555a8ca8f330 0x555a8ca8f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.006+0000 7f910afed740 1 -- 172.21.15.12:0/130704580 >> 172.21.15.12:0/130704580 conn(0x555a8ca8b8c0 msgr2=0x555a8ca8bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:00.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.006+0000 7f910afed740 1 -- 172.21.15.12:0/130704580 shutdown_connections 2024-09-05T01:24:00.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.006+0000 7f910afed740 1 -- 172.21.15.12:0/130704580 wait complete. 2024-09-05T01:24:00.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.007+0000 7f910afed740 1 -- start start 2024-09-05T01:24:00.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.007+0000 7f910afed740 1 Processor -- start 2024-09-05T01:24:00.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.007+0000 7f910afed740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555a8ca8f330 0x555a8ca975a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:00.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.007+0000 7f910afed740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca8fc50 0x555a8ca97ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:00.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.007+0000 7f910afed740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555a8ca9a510 0x555a8ca98020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:00.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.007+0000 7f910afed740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555a8ca9d060 con 0x555a8ca8f330 2024-09-05T01:24:00.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.007+0000 7f910afed740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555a8c97d920 con 0x555a8ca9a510 2024-09-05T01:24:00.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.007+0000 7f910afed740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555a8ca9d1e0 con 0x555a8ca8fc50 2024-09-05T01:24:00.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.007+0000 7f910afed740 10 client.0 _ll_register_callbacks cb 0x555a8c9a18a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:24:00.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.008+0000 7f9105200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca8fc50 0x555a8ca97ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:00.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.008+0000 7f9105200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca8fc50 0x555a8ca97ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:49960/0 (socket says 172.21.15.12:49960) 2024-09-05T01:24:00.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.008+0000 7f9105200640 1 -- 172.21.15.12:0/3280627397 learned_addr learned my addr 172.21.15.12:0/3280627397 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:00.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.008+0000 7f9105c00640 1 --2- 172.21.15.12:0/3280627397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555a8ca8f330 0x555a8ca975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:00.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.008+0000 7f9106600640 1 --2- 172.21.15.12:0/3280627397 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555a8ca9a510 0x555a8ca98020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:00.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.008+0000 7f9105200640 1 -- 172.21.15.12:0/3280627397 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555a8ca9a510 msgr2=0x555a8ca98020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:00.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.008+0000 7f9105200640 1 --2- 172.21.15.12:0/3280627397 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555a8ca9a510 0x555a8ca98020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.008+0000 7f9105200640 1 -- 172.21.15.12:0/3280627397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555a8ca8f330 msgr2=0x555a8ca975a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:00.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.008+0000 7f9105200640 1 --2- 172.21.15.12:0/3280627397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555a8ca8f330 0x555a8ca975a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.008+0000 7f9105200640 1 -- 172.21.15.12:0/3280627397 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a8c7662b0 con 0x555a8ca8fc50 2024-09-05T01:24:00.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.008+0000 7f9106600640 1 --2- 172.21.15.12:0/3280627397 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555a8ca9a510 0x555a8ca98020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:24:00.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.008+0000 7f9105200640 1 --2- 172.21.15.12:0/3280627397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca8fc50 0x555a8ca97ae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f90ec031550 tx=0x7f90ec02a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c27f572b6273b30 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:00.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.008+0000 7f90e7400640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:24:00.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.009+0000 7f90e7400640 1 -- 172.21.15.12:0/3280627397 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ec052060 con 0x555a8ca8fc50 2024-09-05T01:24:00.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.009+0000 7f910afed740 1 -- 172.21.15.12:0/3280627397 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90ec004400 con 0x555a8ca8fc50 2024-09-05T01:24:00.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.009+0000 7f90e7400640 1 -- 172.21.15.12:0/3280627397 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f90ec004200 con 0x555a8ca8fc50 2024-09-05T01:24:00.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.009+0000 7f90e7400640 1 -- 172.21.15.12:0/3280627397 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f90ec035070 con 0x555a8ca8fc50 2024-09-05T01:24:00.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.009+0000 7f910afed740 10 client.24925 fetch_fsmap learned FSMap version 27 2024-09-05T01:24:00.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.009+0000 7f910afed740 1 -- 172.21.15.12:0/3280627397 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555a8ca9d060 con 0x555a8ca8fc50 2024-09-05T01:24:00.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.010+0000 7f90e7400640 1 -- 172.21.15.12:0/3280627397 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90ec004400 con 0x555a8ca8fc50 2024-09-05T01:24:00.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.010+0000 7f90e7400640 1 -- 172.21.15.12:0/3280627397 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f90ec0318e0 con 0x555a8ca8fc50 2024-09-05T01:24:00.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.010+0000 7f910afed740 10 client.24925 fetch_fsmap finished waiting for FSMap version 27 2024-09-05T01:24:00.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.010+0000 7f910afed740 10 client.24925 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-05T01:24:00.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.010+0000 7f910afed740 20 client.24925 populate_metadata read hostname 'smithi012' 2024-09-05T01:24:00.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.010+0000 7f910afed740 1 --2- 172.21.15.12:0/3280627397 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x555a8caaaff0 0x555a8caac460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:00.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.010+0000 7f910afed740 4 client.24925 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:24:00.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.010+0000 7f910afed740 1 -- 172.21.15.12:0/3280627397 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a8ca02620 con 0x555a8caaaff0 2024-09-05T01:24:00.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.010+0000 7f9105c00640 1 --2- 172.21.15.12:0/3280627397 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x555a8caaaff0 0x555a8caac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:00.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.011+0000 7f9105c00640 1 --2- 172.21.15.12:0/3280627397 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x555a8caaaff0 0x555a8caac460 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9b7ed12857b29a40 server_cookie=a5d0c57fc36c0ca1 in_seq=0 out_seq=0 2024-09-05T01:24:00.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.011+0000 7f90e7400640 10 client.24925 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:24:00.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.012+0000 7f90e7400640 1 -- 172.21.15.12:0/3280627397 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555a8ca02620 con 0x555a8caaaff0 2024-09-05T01:24:00.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.012+0000 7f90e7400640 10 client.24925 handle_command_reply: tid=0 2024-09-05T01:24:00.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.012+0000 7f910afed740 1 client.24925 shutdown 2024-09-05T01:24:00.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.012+0000 7f910afed740 1 -- 172.21.15.12:0/3280627397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca8fc50 msgr2=0x555a8ca97ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:00.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.012+0000 7f910afed740 1 --2- 172.21.15.12:0/3280627397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca8fc50 0x555a8ca97ae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f90ec031550 tx=0x7f90ec02a410 comp rx=0 tx=0).stop 2024-09-05T01:24:00.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.012+0000 7f910afed740 1 -- 172.21.15.12:0/3280627397 shutdown_connections 2024-09-05T01:24:00.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.012+0000 7f910afed740 1 --2- 172.21.15.12:0/3280627397 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x555a8caaaff0 0x555a8caac460 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.012+0000 7f910afed740 1 --2- 172.21.15.12:0/3280627397 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555a8ca9a510 0x555a8ca98020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.012+0000 7f910afed740 1 --2- 172.21.15.12:0/3280627397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca8fc50 0x555a8ca97ae0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.012+0000 7f910afed740 1 --2- 172.21.15.12:0/3280627397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555a8ca8f330 0x555a8ca975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.012+0000 7f90e7400640 0 client.24925 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:24:00.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.012+0000 7f910afed740 1 -- 172.21.15.12:0/3280627397 >> 172.21.15.12:0/3280627397 conn(0x555a8ca8b8c0 msgr2=0x555a8ca915f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:00.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.012+0000 7f910afed740 1 -- 172.21.15.12:0/3280627397 shutdown_connections 2024-09-05T01:24:00.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.012+0000 7f910afed740 1 -- 172.21.15.12:0/3280627397 wait complete. 2024-09-05T01:24:00.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.013+0000 7f910afed740 20 client.24925 trim_cache size 0 max 16384 2024-09-05T01:24:00.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.031+0000 7f910afed740 1 Processor -- start 2024-09-05T01:24:00.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.031+0000 7f910afed740 1 -- start start 2024-09-05T01:24:00.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.032+0000 7f910afed740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555a8ca8f330 0x555a8ca99620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:00.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.032+0000 7f910afed740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca8fc50 0x555a8ca97e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:00.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.032+0000 7f910afed740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555a8ca9a510 0x555a8ca94860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:00.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.032+0000 7f910afed740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555a8caaa7a0 con 0x555a8ca9a510 2024-09-05T01:24:00.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.032+0000 7f910afed740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555a8caaae70 con 0x555a8ca8f330 2024-09-05T01:24:00.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.032+0000 7f910afed740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555a8caab540 con 0x555a8ca8fc50 2024-09-05T01:24:00.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.032+0000 7f9106600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555a8ca9a510 0x555a8ca94860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:00.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.032+0000 7f9106600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555a8ca9a510 0x555a8ca94860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44872/0 (socket says 172.21.15.12:44872) 2024-09-05T01:24:00.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.032+0000 7f9106600640 1 -- 172.21.15.12:0/2721281849 learned_addr learned my addr 172.21.15.12:0/2721281849 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:00.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.032+0000 7f9105200640 1 --2- 172.21.15.12:0/2721281849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca8fc50 0x555a8ca97e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:00.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.032+0000 7f9105c00640 1 --2- 172.21.15.12:0/2721281849 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555a8ca8f330 0x555a8ca99620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:00.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.032+0000 7f9106600640 1 -- 172.21.15.12:0/2721281849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca8fc50 msgr2=0x555a8ca97e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:00.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.032+0000 7f9106600640 1 --2- 172.21.15.12:0/2721281849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca8fc50 0x555a8ca97e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.032+0000 7f9106600640 1 -- 172.21.15.12:0/2721281849 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555a8ca8f330 msgr2=0x555a8ca99620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:00.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.032+0000 7f9106600640 1 --2- 172.21.15.12:0/2721281849 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555a8ca8f330 0x555a8ca99620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.033+0000 7f9106600640 1 -- 172.21.15.12:0/2721281849 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a8ca8fa80 con 0x555a8ca9a510 2024-09-05T01:24:00.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.033+0000 7f9106600640 1 --2- 172.21.15.12:0/2721281849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555a8ca9a510 0x555a8ca94860 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f90f8003d20 tx=0x7f90f8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91fe9f2a7f0f2315 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:00.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.033+0000 7f90f2000640 1 -- 172.21.15.12:0/2721281849 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f80045c0 con 0x555a8ca9a510 2024-09-05T01:24:00.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.033+0000 7f90f2000640 1 -- 172.21.15.12:0/2721281849 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90f8004760 con 0x555a8ca9a510 2024-09-05T01:24:00.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.033+0000 7f90f2000640 1 -- 172.21.15.12:0/2721281849 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f801e630 con 0x555a8ca9a510 2024-09-05T01:24:00.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.034+0000 7f910afed740 1 -- 172.21.15.12:0/2721281849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555a8ca9a510 msgr2=0x555a8ca94860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:00.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.034+0000 7f910afed740 1 --2- 172.21.15.12:0/2721281849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555a8ca9a510 0x555a8ca94860 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f90f8003d20 tx=0x7f90f8016000 comp rx=0 tx=0).stop 2024-09-05T01:24:00.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.034+0000 7f910afed740 1 -- 172.21.15.12:0/2721281849 shutdown_connections 2024-09-05T01:24:00.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.034+0000 7f910afed740 1 --2- 172.21.15.12:0/2721281849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555a8ca9a510 0x555a8ca94860 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.034+0000 7f910afed740 1 --2- 172.21.15.12:0/2721281849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca8fc50 0x555a8ca97e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.034+0000 7f910afed740 1 --2- 172.21.15.12:0/2721281849 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555a8ca8f330 0x555a8ca99620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.034+0000 7f910afed740 1 -- 172.21.15.12:0/2721281849 >> 172.21.15.12:0/2721281849 conn(0x555a8ca8b8c0 msgr2=0x555a8caaa000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:00.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.034+0000 7f910afed740 1 -- 172.21.15.12:0/2721281849 shutdown_connections 2024-09-05T01:24:00.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.034+0000 7f910afed740 1 -- 172.21.15.12:0/2721281849 wait complete. 2024-09-05T01:24:00.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.034+0000 7f910afed740 1 -- start start 2024-09-05T01:24:00.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.034+0000 7f910afed740 1 Processor -- start 2024-09-05T01:24:00.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.035+0000 7f910afed740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555a8ca8f330 0x555a8cab4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:00.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.035+0000 7f910afed740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca8fc50 0x555a8cab4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:00.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.035+0000 7f910afed740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555a8ca9a510 0x555a8caaf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:00.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.035+0000 7f910afed740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555a8caac2e0 con 0x555a8ca9a510 2024-09-05T01:24:00.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.035+0000 7f910afed740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555a8caabc10 con 0x555a8ca8f330 2024-09-05T01:24:00.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.035+0000 7f910afed740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555a8caac9b0 con 0x555a8ca8fc50 2024-09-05T01:24:00.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.035+0000 7f910afed740 10 client.0 _ll_register_callbacks cb 0x7f90ec009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:24:00.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.035+0000 7f9106600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555a8ca9a510 0x555a8caaf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:00.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.035+0000 7f9106600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555a8ca9a510 0x555a8caaf6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44888/0 (socket says 172.21.15.12:44888) 2024-09-05T01:24:00.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.035+0000 7f9105c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555a8ca8f330 0x555a8cab4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:00.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.035+0000 7f9106600640 1 -- 172.21.15.12:0/1591473378 learned_addr learned my addr 172.21.15.12:0/1591473378 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:00.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.035+0000 7f9105200640 1 --2- 172.21.15.12:0/1591473378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca8fc50 0x555a8cab4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:00.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.036+0000 7f9106600640 1 -- 172.21.15.12:0/1591473378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca8fc50 msgr2=0x555a8cab4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:00.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.036+0000 7f9106600640 1 --2- 172.21.15.12:0/1591473378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca8fc50 0x555a8cab4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.036+0000 7f9106600640 1 -- 172.21.15.12:0/1591473378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555a8ca8f330 msgr2=0x555a8cab4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.036+0000 7f9106600640 1 --2- 172.21.15.12:0/1591473378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555a8ca8f330 0x555a8cab4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.036+0000 7f9106600640 1 -- 172.21.15.12:0/1591473378 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a8caafee0 con 0x555a8ca9a510 2024-09-05T01:24:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.036+0000 7f9105c00640 1 --2- 172.21.15.12:0/1591473378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555a8ca8f330 0x555a8cab4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.036+0000 7f9105200640 1 --2- 172.21.15.12:0/1591473378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca8fc50 0x555a8cab4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.036+0000 7f9106600640 1 --2- 172.21.15.12:0/1591473378 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555a8ca9a510 0x555a8caaf6e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f90f8004410 tx=0x7f90f8004f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85850c372db80166 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.036+0000 7f90e7400640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:24:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.036+0000 7f90e7400640 1 -- 172.21.15.12:0/1591473378 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f80045c0 con 0x555a8ca9a510 2024-09-05T01:24:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.036+0000 7f910afed740 1 -- 172.21.15.12:0/1591473378 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90f8004760 con 0x555a8ca9a510 2024-09-05T01:24:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.036+0000 7f90e7400640 1 -- 172.21.15.12:0/1591473378 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f90f8025040 con 0x555a8ca9a510 2024-09-05T01:24:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.037+0000 7f90e7400640 1 -- 172.21.15.12:0/1591473378 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f90f800f690 con 0x555a8ca9a510 2024-09-05T01:24:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.037+0000 7f910afed740 10 client.14919 fetch_fsmap learned FSMap version 27 2024-09-05T01:24:00.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.037+0000 7f910afed740 1 -- 172.21.15.12:0/1591473378 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555a8cb161a0 con 0x555a8ca9a510 2024-09-05T01:24:00.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.037+0000 7f90e7400640 1 -- 172.21.15.12:0/1591473378 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f90f8004760 con 0x555a8ca9a510 2024-09-05T01:24:00.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.037+0000 7f90e7400640 1 -- 172.21.15.12:0/1591473378 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f90f8039030 con 0x555a8ca9a510 2024-09-05T01:24:00.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.037+0000 7f910afed740 10 client.14919 fetch_fsmap finished waiting for FSMap version 27 2024-09-05T01:24:00.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.037+0000 7f910afed740 10 client.14919 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-05T01:24:00.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.037+0000 7f910afed740 20 client.14919 populate_metadata read hostname 'smithi012' 2024-09-05T01:24:00.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.037+0000 7f910afed740 1 --2- 172.21.15.12:0/1591473378 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x555a8cb1aa30 0x555a8cb19740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:00.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.037+0000 7f910afed740 4 client.14919 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T01:24:00.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.037+0000 7f910afed740 1 -- 172.21.15.12:0/1591473378 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "status"}) -- 0x555a8c9fcb30 con 0x555a8cb1aa30 2024-09-05T01:24:00.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.038+0000 7f9105c00640 1 --2- 172.21.15.12:0/1591473378 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x555a8cb1aa30 0x555a8cb19740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:00.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.038+0000 7f9105c00640 1 --2- 172.21.15.12:0/1591473378 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x555a8cb1aa30 0x555a8cb19740 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=38fc7337a7efb3f1 server_cookie=50f6cafcb1373c22 in_seq=0 out_seq=0 2024-09-05T01:24:00.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.038+0000 7f90e7400640 10 client.14919 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:24:00.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.038+0000 7f90e7400640 1 -- 172.21.15.12:0/1591473378 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x555a8c9fcb30 con 0x555a8cb1aa30 2024-09-05T01:24:00.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.038+0000 7f90e7400640 10 client.14919 handle_command_reply: tid=0 2024-09-05T01:24:00.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.038+0000 7f910afed740 1 client.14919 shutdown 2024-09-05T01:24:00.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.038+0000 7f910afed740 1 -- 172.21.15.12:0/1591473378 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555a8ca9a510 msgr2=0x555a8caaf6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:00.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.038+0000 7f910afed740 1 --2- 172.21.15.12:0/1591473378 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555a8ca9a510 0x555a8caaf6e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f90f8004410 tx=0x7f90f8004f30 comp rx=0 tx=0).stop 2024-09-05T01:24:00.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.039+0000 7f910afed740 1 -- 172.21.15.12:0/1591473378 shutdown_connections 2024-09-05T01:24:00.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.039+0000 7f910afed740 1 --2- 172.21.15.12:0/1591473378 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x555a8cb1aa30 0x555a8cb19740 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.039+0000 7f910afed740 1 --2- 172.21.15.12:0/1591473378 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555a8ca9a510 0x555a8caaf6e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.039+0000 7f910afed740 1 --2- 172.21.15.12:0/1591473378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555a8ca8fc50 0x555a8cab4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.039+0000 7f910afed740 1 --2- 172.21.15.12:0/1591473378 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555a8ca8f330 0x555a8cab4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.039+0000 7f910afed740 1 -- 172.21.15.12:0/1591473378 >> 172.21.15.12:0/1591473378 conn(0x555a8ca8b8c0 msgr2=0x555a8ca8aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:00.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.039+0000 7f90e7400640 0 client.14919 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:24:00.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.039+0000 7f910afed740 1 -- 172.21.15.12:0/1591473378 shutdown_connections 2024-09-05T01:24:00.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.039+0000 7f910afed740 1 -- 172.21.15.12:0/1591473378 wait complete. 2024-09-05T01:24:00.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.039+0000 7f910afed740 20 client.14919 trim_cache size 0 max 16384 2024-09-05T01:24:00.045 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:24:00.046 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "0d44cd7e-6b24-11ef-bcd6-c7b262605968", 2024-09-05T01:24:00.046 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 3, 2024-09-05T01:24:00.046 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24517, 2024-09-05T01:24:00.046 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-05T01:24:00.046 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-05T01:24:00.047 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-05T01:24:00.047 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 73.951094646000001, 2024-09-05T01:24:00.047 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 27, 2024-09-05T01:24:00.047 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 83, 2024-09-05T01:24:00.047 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 81, 2024-09-05T01:24:00.047 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 113.193956235 2024-09-05T01:24:00.048 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:24:00.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.039+0000 7f9108600640 1 -- 172.21.15.12:0/876729596 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f90e80a2c10 msgr2=0x7f90e80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:00.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.039+0000 7f9108600640 1 --2- 172.21.15.12:0/876729596 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f90e80a2c10 0x7f90e80a50d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f90f8005fd0 tx=0x7f90f8009500 comp rx=0 tx=0).stop 2024-09-05T01:24:00.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.040+0000 7f9108600640 1 -- 172.21.15.12:0/876729596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9100101df0 msgr2=0x7f910019a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:00.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.040+0000 7f9108600640 1 --2- 172.21.15.12:0/876729596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9100101df0 0x7f910019a630 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f90f400e9f0 tx=0x7f90f400eeb0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.040+0000 7f9108600640 1 -- 172.21.15.12:0/876729596 shutdown_connections 2024-09-05T01:24:00.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.040+0000 7f9108600640 1 --2- 172.21.15.12:0/876729596 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f90e80a2c10 0x7f90e80a50d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.040+0000 7f9108600640 1 --2- 172.21.15.12:0/876729596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9100106f20 0x7f910019ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.040+0000 7f9108600640 1 --2- 172.21.15.12:0/876729596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91001027a0 0x7f910019ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.040+0000 7f9108600640 1 --2- 172.21.15.12:0/876729596 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9100101df0 0x7f910019a630 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:00.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.040+0000 7f9108600640 1 -- 172.21.15.12:0/876729596 >> 172.21.15.12:0/876729596 conn(0x7f91000fd8b0 msgr2=0x7f91000feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:00.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.040+0000 7f9108600640 1 -- 172.21.15.12:0/876729596 shutdown_connections 2024-09-05T01:24:00.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:00.040+0000 7f9108600640 1 -- 172.21.15.12:0/876729596 wait complete. 2024-09-05T01:24:00.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:00 smithi012 ceph-mon[29942]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T01:24:00.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:00 smithi145 ceph-mon[34376]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T01:24:00.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:00 smithi151 ceph-mon[35013]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T01:24:01.063 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.h status 2024-09-05T01:24:01.443 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:24:02.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.025+0000 7f9d2d600640 1 -- 172.21.15.12:0/3472006899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d28074ee0 msgr2=0x7f9d2810def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:02.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.025+0000 7f9d2d600640 1 --2- 172.21.15.12:0/3472006899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d28074ee0 0x7f9d2810def0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9d10009900 tx=0x7f9d1002a480 comp rx=0 tx=0).stop 2024-09-05T01:24:02.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.025+0000 7f9d2d600640 1 -- 172.21.15.12:0/3472006899 shutdown_connections 2024-09-05T01:24:02.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.025+0000 7f9d2d600640 1 --2- 172.21.15.12:0/3472006899 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d2810e430 0x7f9d28110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.025+0000 7f9d2d600640 1 --2- 172.21.15.12:0/3472006899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d28074ee0 0x7f9d2810def0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.025+0000 7f9d2d600640 1 --2- 172.21.15.12:0/3472006899 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d280745c0 0x7f9d280749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.025+0000 7f9d2d600640 1 -- 172.21.15.12:0/3472006899 >> 172.21.15.12:0/3472006899 conn(0x7f9d280fd8b0 msgr2=0x7f9d280ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:02.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.025+0000 7f9d2d600640 1 -- 172.21.15.12:0/3472006899 shutdown_connections 2024-09-05T01:24:02.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.025+0000 7f9d2d600640 1 -- 172.21.15.12:0/3472006899 wait complete. 2024-09-05T01:24:02.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.026+0000 7f9d2d600640 1 Processor -- start 2024-09-05T01:24:02.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.026+0000 7f9d2d600640 1 -- start start 2024-09-05T01:24:02.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.026+0000 7f9d2d600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d280745c0 0x7f9d2819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:02.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.026+0000 7f9d2d600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d28074ee0 0x7f9d2819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:02.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.026+0000 7f9d2d600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d2810e430 0x7f9d2819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:02.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.026+0000 7f9d2d600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9d28114180 con 0x7f9d2810e430 2024-09-05T01:24:02.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.026+0000 7f9d2d600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9d28114000 con 0x7f9d28074ee0 2024-09-05T01:24:02.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.026+0000 7f9d2d600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9d28114300 con 0x7f9d280745c0 2024-09-05T01:24:02.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.027+0000 7f9d27400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d2810e430 0x7f9d2819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:02.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.027+0000 7f9d27400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d2810e430 0x7f9d2819ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44912/0 (socket says 172.21.15.12:44912) 2024-09-05T01:24:02.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.027+0000 7f9d27400640 1 -- 172.21.15.12:0/853584207 learned_addr learned my addr 172.21.15.12:0/853584207 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:02.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.027+0000 7f9d26a00640 1 --2- 172.21.15.12:0/853584207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d280745c0 0x7f9d2819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:02.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.027+0000 7f9d27400640 1 -- 172.21.15.12:0/853584207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d280745c0 msgr2=0x7f9d2819a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:02.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.027+0000 7f9d27400640 1 --2- 172.21.15.12:0/853584207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d280745c0 0x7f9d2819a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.027+0000 7f9d27400640 1 -- 172.21.15.12:0/853584207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d28074ee0 msgr2=0x7f9d2819ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:02.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.027+0000 7f9d27400640 1 --2- 172.21.15.12:0/853584207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d28074ee0 0x7f9d2819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.027+0000 7f9d27400640 1 -- 172.21.15.12:0/853584207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2819f5f0 con 0x7f9d2810e430 2024-09-05T01:24:02.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.028+0000 7f9d27400640 1 --2- 172.21.15.12:0/853584207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d2810e430 0x7f9d2819ef10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9d2000eb40 tx=0x7f9d2000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:02.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.028+0000 7f9d1f400640 1 -- 172.21.15.12:0/853584207 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d20004b20 con 0x7f9d2810e430 2024-09-05T01:24:02.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.028+0000 7f9d2d600640 1 -- 172.21.15.12:0/853584207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d2819f8e0 con 0x7f9d2810e430 2024-09-05T01:24:02.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.028+0000 7f9d1f400640 1 -- 172.21.15.12:0/853584207 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d20004cc0 con 0x7f9d2810e430 2024-09-05T01:24:02.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.028+0000 7f9d1f400640 1 -- 172.21.15.12:0/853584207 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d20010850 con 0x7f9d2810e430 2024-09-05T01:24:02.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.028+0000 7f9d2d600640 1 -- 172.21.15.12:0/853584207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d281a71c0 con 0x7f9d2810e430 2024-09-05T01:24:02.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.031+0000 7f9d3008e740 1 Processor -- start 2024-09-05T01:24:02.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.031+0000 7f9d1f400640 1 -- 172.21.15.12:0/853584207 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9d20005020 con 0x7f9d2810e430 2024-09-05T01:24:02.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.031+0000 7f9d3008e740 1 -- start start 2024-09-05T01:24:02.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.032+0000 7f9d3008e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a42330 0x564930a42710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:02.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.032+0000 7f9d3008e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564930a42c50 0x564930a4cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:02.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.032+0000 7f9d3008e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564930a4d510 0x564930a4f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:02.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.032+0000 7f9d3008e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5649309a80b0 con 0x564930a42330 2024-09-05T01:24:02.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.032+0000 7f9d3008e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56493094fab0 con 0x564930a4d510 2024-09-05T01:24:02.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.032+0000 7f9d3008e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5649309a4070 con 0x564930a42c50 2024-09-05T01:24:02.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.032+0000 7f9d1fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a42330 0x564930a42710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:02.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.032+0000 7f9d1fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a42330 0x564930a42710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44914/0 (socket says 172.21.15.12:44914) 2024-09-05T01:24:02.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.032+0000 7f9d1fe00640 1 -- 172.21.15.12:0/2440910458 learned_addr learned my addr 172.21.15.12:0/2440910458 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:02.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.032+0000 7f9d26a00640 1 --2- 172.21.15.12:0/2440910458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564930a42c50 0x564930a4cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:02.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.032+0000 7f9d1fe00640 1 --2- 172.21.15.12:0/2440910458 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564930a4d510 0x564930a4f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:02.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.033+0000 7f9d26a00640 1 -- 172.21.15.12:0/2440910458 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564930a4d510 msgr2=0x564930a4f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:02.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.033+0000 7f9d26a00640 1 --2- 172.21.15.12:0/2440910458 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564930a4d510 0x564930a4f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.033+0000 7f9d26a00640 1 -- 172.21.15.12:0/2440910458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a42330 msgr2=0x564930a42710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:02.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.033+0000 7f9d26a00640 1 --2- 172.21.15.12:0/2440910458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a42330 0x564930a42710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.033+0000 7f9d26a00640 1 -- 172.21.15.12:0/2440910458 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56493095c4a0 con 0x564930a42c50 2024-09-05T01:24:02.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.033+0000 7f9d1fe00640 1 --2- 172.21.15.12:0/2440910458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a42330 0x564930a42710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:02.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.033+0000 7f9d26a00640 1 --2- 172.21.15.12:0/2440910458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564930a42c50 0x564930a4cfd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009b70 tx=0x7f9d180117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2237d02673dd243 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:02.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.033+0000 7f9d1f400640 1 --2- 172.21.15.12:0/853584207 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f9d0c0a2c90 0x7f9d0c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:02.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.033+0000 7f9d17400640 1 -- 172.21.15.12:0/2440910458 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18009e60 con 0x564930a42c50 2024-09-05T01:24:02.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.034+0000 7f9d1f400640 1 -- 172.21.15.12:0/853584207 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f9d200cf990 con 0x7f9d2810e430 2024-09-05T01:24:02.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.034+0000 7f9d17400640 1 -- 172.21.15.12:0/2440910458 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d18012930 con 0x564930a42c50 2024-09-05T01:24:02.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.034+0000 7f9d17400640 1 -- 172.21.15.12:0/2440910458 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1800fb90 con 0x564930a42c50 2024-09-05T01:24:02.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.034+0000 7f9d1fe00640 1 --2- 172.21.15.12:0/853584207 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f9d0c0a2c90 0x7f9d0c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:02.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.034+0000 7f9d3008e740 1 -- 172.21.15.12:0/2440910458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564930a42c50 msgr2=0x564930a4cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:02.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.034+0000 7f9d1fe00640 1 --2- 172.21.15.12:0/853584207 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f9d0c0a2c90 0x7f9d0c0a5150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9d100057c0 tx=0x7f9d10005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:02.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.034+0000 7f9d3008e740 1 --2- 172.21.15.12:0/2440910458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564930a42c50 0x564930a4cfd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9d18009b70 tx=0x7f9d180117b0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.034+0000 7f9d3008e740 1 -- 172.21.15.12:0/2440910458 shutdown_connections 2024-09-05T01:24:02.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.034+0000 7f9d3008e740 1 --2- 172.21.15.12:0/2440910458 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564930a4d510 0x564930a4f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.035+0000 7f9d3008e740 1 --2- 172.21.15.12:0/2440910458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564930a42c50 0x564930a4cfd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.035+0000 7f9d3008e740 1 --2- 172.21.15.12:0/2440910458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a42330 0x564930a42710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.035+0000 7f9d3008e740 1 -- 172.21.15.12:0/2440910458 >> 172.21.15.12:0/2440910458 conn(0x564930a3e8c0 msgr2=0x564930a3eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:02.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.035+0000 7f9d3008e740 1 -- 172.21.15.12:0/2440910458 shutdown_connections 2024-09-05T01:24:02.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.035+0000 7f9d3008e740 1 -- 172.21.15.12:0/2440910458 wait complete. 2024-09-05T01:24:02.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.035+0000 7f9d3008e740 1 -- start start 2024-09-05T01:24:02.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.036+0000 7f9d3008e740 1 Processor -- start 2024-09-05T01:24:02.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.036+0000 7f9d3008e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564930a42330 0x564930a4a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:02.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.036+0000 7f9d3008e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564930a42c50 0x564930a4aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:02.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.036+0000 7f9d3008e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a4d510 0x564930a4b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:02.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.036+0000 7f9d3008e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564930a50060 con 0x564930a4d510 2024-09-05T01:24:02.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.036+0000 7f9d3008e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x564930930920 con 0x564930a42330 2024-09-05T01:24:02.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.036+0000 7f9d3008e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564930a501e0 con 0x564930a42c50 2024-09-05T01:24:02.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.036+0000 7f9d3008e740 10 client.0 _ll_register_callbacks cb 0x5649309548a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:24:02.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.036+0000 7f9d27400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a4d510 0x564930a4b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:02.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.036+0000 7f9d26a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564930a42330 0x564930a4a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:02.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.037+0000 7f9d1fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564930a42c50 0x564930a4aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:02.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.037+0000 7f9d26a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564930a42330 0x564930a4a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:60008/0 (socket says 172.21.15.12:60008) 2024-09-05T01:24:02.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.037+0000 7f9d26a00640 1 -- 172.21.15.12:0/3864397155 learned_addr learned my addr 172.21.15.12:0/3864397155 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:02.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.037+0000 7f9d26a00640 1 -- 172.21.15.12:0/3864397155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564930a42c50 msgr2=0x564930a4aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:02.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.037+0000 7f9d26a00640 1 --2- 172.21.15.12:0/3864397155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564930a42c50 0x564930a4aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.037+0000 7f9d26a00640 1 -- 172.21.15.12:0/3864397155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a4d510 msgr2=0x564930a4b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:02.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.037+0000 7f9d26a00640 1 --2- 172.21.15.12:0/3864397155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a4d510 0x564930a4b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.037+0000 7f9d26a00640 1 -- 172.21.15.12:0/3864397155 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649307192b0 con 0x564930a42330 2024-09-05T01:24:02.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.037+0000 7f9d27400640 1 --2- 172.21.15.12:0/3864397155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a4d510 0x564930a4b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:02.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.037+0000 7f9d26a00640 1 --2- 172.21.15.12:0/3864397155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564930a42330 0x564930a4a590 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9d1801c040 tx=0x7f9d18012700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9f8acd2e254a988 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:02.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.037+0000 7f9d0be00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:24:02.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.038+0000 7f9d0be00640 1 -- 172.21.15.12:0/3864397155 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18028070 con 0x564930a42330 2024-09-05T01:24:02.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.038+0000 7f9d0be00640 1 -- 172.21.15.12:0/3864397155 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f9d18005040 con 0x564930a42330 2024-09-05T01:24:02.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.038+0000 7f9d3008e740 1 -- 172.21.15.12:0/3864397155 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d18012930 con 0x564930a42330 2024-09-05T01:24:02.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.038+0000 7f9d0be00640 1 -- 172.21.15.12:0/3864397155 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9d18034050 con 0x564930a42330 2024-09-05T01:24:02.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.038+0000 7f9d3008e740 10 client.24941 fetch_fsmap learned FSMap version 27 2024-09-05T01:24:02.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.038+0000 7f9d3008e740 1 -- 172.21.15.12:0/3864397155 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564930a5be10 con 0x564930a42330 2024-09-05T01:24:02.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.038+0000 7f9d0be00640 1 -- 172.21.15.12:0/3864397155 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d18012930 con 0x564930a42330 2024-09-05T01:24:02.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.038+0000 7f9d0be00640 1 -- 172.21.15.12:0/3864397155 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9d180046c0 con 0x564930a42330 2024-09-05T01:24:02.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.039+0000 7f9d3008e740 10 client.24941 fetch_fsmap finished waiting for FSMap version 27 2024-09-05T01:24:02.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.039+0000 7f9d3008e740 10 client.24941 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-05T01:24:02.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.039+0000 7f9d3008e740 20 client.24941 populate_metadata read hostname 'smithi012' 2024-09-05T01:24:02.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.039+0000 7f9d3008e740 1 --2- 172.21.15.12:0/3864397155 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x564930a5e070 0x564930a5f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:02.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.039+0000 7f9d3008e740 4 client.24941 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:24:02.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.039+0000 7f9d3008e740 1 -- 172.21.15.12:0/3864397155 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649309b5620 con 0x564930a5e070 2024-09-05T01:24:02.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.039+0000 7f9d1fe00640 1 --2- 172.21.15.12:0/3864397155 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x564930a5e070 0x564930a5f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:02.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.039+0000 7f9d1fe00640 1 --2- 172.21.15.12:0/3864397155 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x564930a5e070 0x564930a5f4e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8d4aef29b00dbaf8 server_cookie=8d48f7ce2de86803 in_seq=0 out_seq=0 2024-09-05T01:24:02.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.039+0000 7f9d0be00640 10 client.24941 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:24:02.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.040+0000 7f9d0be00640 1 -- 172.21.15.12:0/3864397155 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5649309b5620 con 0x564930a5e070 2024-09-05T01:24:02.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.040+0000 7f9d0be00640 10 client.24941 handle_command_reply: tid=0 2024-09-05T01:24:02.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.040+0000 7f9d3008e740 1 client.24941 shutdown 2024-09-05T01:24:02.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.041+0000 7f9d3008e740 1 -- 172.21.15.12:0/3864397155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564930a42330 msgr2=0x564930a4a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:02.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.041+0000 7f9d3008e740 1 --2- 172.21.15.12:0/3864397155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564930a42330 0x564930a4a590 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9d1801c040 tx=0x7f9d18012700 comp rx=0 tx=0).stop 2024-09-05T01:24:02.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.041+0000 7f9d3008e740 1 -- 172.21.15.12:0/3864397155 shutdown_connections 2024-09-05T01:24:02.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.041+0000 7f9d3008e740 1 --2- 172.21.15.12:0/3864397155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a4d510 0x564930a4b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.041+0000 7f9d3008e740 1 --2- 172.21.15.12:0/3864397155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564930a42c50 0x564930a4aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.041+0000 7f9d3008e740 1 --2- 172.21.15.12:0/3864397155 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x564930a5e070 0x564930a5f4e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.041+0000 7f9d3008e740 1 --2- 172.21.15.12:0/3864397155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564930a42330 0x564930a4a590 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.041+0000 7f9d3008e740 1 -- 172.21.15.12:0/3864397155 >> 172.21.15.12:0/3864397155 conn(0x564930a3e8c0 msgr2=0x564930a445f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:02.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.041+0000 7f9d0be00640 0 client.24941 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:24:02.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.041+0000 7f9d3008e740 1 -- 172.21.15.12:0/3864397155 shutdown_connections 2024-09-05T01:24:02.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.041+0000 7f9d3008e740 1 -- 172.21.15.12:0/3864397155 wait complete. 2024-09-05T01:24:02.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.041+0000 7f9d3008e740 20 client.24941 trim_cache size 0 max 16384 2024-09-05T01:24:02.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.060+0000 7f9d3008e740 1 Processor -- start 2024-09-05T01:24:02.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.060+0000 7f9d3008e740 1 -- start start 2024-09-05T01:24:02.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.060+0000 7f9d3008e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564930a42330 0x564930a5d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:02.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.060+0000 7f9d3008e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564930a42c50 0x564930a44d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:02.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.060+0000 7f9d3008e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a4d510 0x564930a4c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:02.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.060+0000 7f9d3008e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564930a5d820 con 0x564930a4d510 2024-09-05T01:24:02.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.060+0000 7f9d3008e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x564930a5def0 con 0x564930a42c50 2024-09-05T01:24:02.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.060+0000 7f9d3008e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564930a5e5c0 con 0x564930a42330 2024-09-05T01:24:02.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.061+0000 7f9d26a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564930a42330 0x564930a5d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:02.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.061+0000 7f9d27400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a4d510 0x564930a4c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:02.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.061+0000 7f9d26a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564930a42330 0x564930a5d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:50034/0 (socket says 172.21.15.12:50034) 2024-09-05T01:24:02.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.061+0000 7f9d26a00640 1 -- 172.21.15.12:0/271718517 learned_addr learned my addr 172.21.15.12:0/271718517 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:02.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.061+0000 7f9d27400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a4d510 0x564930a4c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44922/0 (socket says 172.21.15.12:44922) 2024-09-05T01:24:02.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.061+0000 7f9d1fe00640 1 --2- 172.21.15.12:0/271718517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564930a42c50 0x564930a44d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:02.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.061+0000 7f9d26a00640 1 -- 172.21.15.12:0/271718517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564930a42c50 msgr2=0x564930a44d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:02.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.061+0000 7f9d26a00640 1 --2- 172.21.15.12:0/271718517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564930a42c50 0x564930a44d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.061+0000 7f9d26a00640 1 -- 172.21.15.12:0/271718517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a4d510 msgr2=0x564930a4c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:02.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.061+0000 7f9d26a00640 1 --2- 172.21.15.12:0/271718517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a4d510 0x564930a4c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.061+0000 7f9d26a00640 1 -- 172.21.15.12:0/271718517 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564930a4fb30 con 0x564930a42330 2024-09-05T01:24:02.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.061+0000 7f9d27400640 1 --2- 172.21.15.12:0/271718517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a4d510 0x564930a4c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:02.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.061+0000 7f9d26a00640 1 --2- 172.21.15.12:0/271718517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564930a42330 0x564930a5d9a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9d18000c00 tx=0x7f9d18005a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83b79df008e7ca07 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:02.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.062+0000 7f9d16a00640 1 -- 172.21.15.12:0/271718517 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1803d070 con 0x564930a42330 2024-09-05T01:24:02.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.062+0000 7f9d16a00640 1 -- 172.21.15.12:0/271718517 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d18011cb0 con 0x564930a42330 2024-09-05T01:24:02.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.062+0000 7f9d16a00640 1 -- 172.21.15.12:0/271718517 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18028040 con 0x564930a42330 2024-09-05T01:24:02.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.062+0000 7f9d3008e740 1 -- 172.21.15.12:0/271718517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564930a42330 msgr2=0x564930a5d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:02.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.062+0000 7f9d3008e740 1 --2- 172.21.15.12:0/271718517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564930a42330 0x564930a5d9a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9d18000c00 tx=0x7f9d18005a70 comp rx=0 tx=0).stop 2024-09-05T01:24:02.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.062+0000 7f9d3008e740 1 -- 172.21.15.12:0/271718517 shutdown_connections 2024-09-05T01:24:02.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.062+0000 7f9d3008e740 1 --2- 172.21.15.12:0/271718517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a4d510 0x564930a4c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.062+0000 7f9d3008e740 1 --2- 172.21.15.12:0/271718517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564930a42c50 0x564930a44d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.062+0000 7f9d3008e740 1 --2- 172.21.15.12:0/271718517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564930a42330 0x564930a5d9a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.062+0000 7f9d3008e740 1 -- 172.21.15.12:0/271718517 >> 172.21.15.12:0/271718517 conn(0x564930a3e8c0 msgr2=0x564930a4bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:02.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.062+0000 7f9d3008e740 1 -- 172.21.15.12:0/271718517 shutdown_connections 2024-09-05T01:24:02.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.062+0000 7f9d3008e740 1 -- 172.21.15.12:0/271718517 wait complete. 2024-09-05T01:24:02.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.063+0000 7f9d3008e740 1 -- start start 2024-09-05T01:24:02.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.063+0000 7f9d3008e740 1 Processor -- start 2024-09-05T01:24:02.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.063+0000 7f9d3008e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564930a42330 0x564930a61520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:02.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.063+0000 7f9d3008e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564930a42c50 0x564930a61a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:02.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.063+0000 7f9d3008e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a4d510 0x564930a61fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:02.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.063+0000 7f9d3008e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564930a5f360 con 0x564930a4d510 2024-09-05T01:24:02.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.063+0000 7f9d3008e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x564930a5ec90 con 0x564930a42c50 2024-09-05T01:24:02.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.063+0000 7f9d3008e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564930a5fa30 con 0x564930a42330 2024-09-05T01:24:02.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.063+0000 7f9d3008e740 10 client.0 _ll_register_callbacks cb 0x7f9d18009f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:24:02.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.063+0000 7f9d26a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564930a42330 0x564930a61520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:02.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.064+0000 7f9d27400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a4d510 0x564930a61fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:02.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.064+0000 7f9d1fe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564930a42c50 0x564930a61a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:02.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.064+0000 7f9d26a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564930a42330 0x564930a61520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:50038/0 (socket says 172.21.15.12:50038) 2024-09-05T01:24:02.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.064+0000 7f9d26a00640 1 -- 172.21.15.12:0/2255952373 learned_addr learned my addr 172.21.15.12:0/2255952373 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:02.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.064+0000 7f9d1fe00640 1 -- 172.21.15.12:0/2255952373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564930a42330 msgr2=0x564930a61520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:02.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.064+0000 7f9d1fe00640 1 --2- 172.21.15.12:0/2255952373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564930a42330 0x564930a61520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.064+0000 7f9d1fe00640 1 -- 172.21.15.12:0/2255952373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a4d510 msgr2=0x564930a61fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:02.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.064+0000 7f9d1fe00640 1 --2- 172.21.15.12:0/2255952373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a4d510 0x564930a61fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.064+0000 7f9d1fe00640 1 -- 172.21.15.12:0/2255952373 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564930a65c70 con 0x564930a42c50 2024-09-05T01:24:02.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.064+0000 7f9d27400640 1 --2- 172.21.15.12:0/2255952373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a4d510 0x564930a61fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:02.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.064+0000 7f9d1fe00640 1 --2- 172.21.15.12:0/2255952373 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564930a42c50 0x564930a61a60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x564930a3fc40 tx=0x7f9d10009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=237a4e71d7823b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:02.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.064+0000 7f9d0be00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:24:02.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.065+0000 7f9d0be00640 1 -- 172.21.15.12:0/2255952373 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d10035040 con 0x564930a42c50 2024-09-05T01:24:02.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.065+0000 7f9d3008e740 1 -- 172.21.15.12:0/2255952373 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d18011cb0 con 0x564930a42c50 2024-09-05T01:24:02.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.065+0000 7f9d0be00640 1 -- 172.21.15.12:0/2255952373 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f9d10004300 con 0x564930a42c50 2024-09-05T01:24:02.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.065+0000 7f9d0be00640 1 -- 172.21.15.12:0/2255952373 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9d100035f0 con 0x564930a42c50 2024-09-05T01:24:02.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.065+0000 7f9d3008e740 10 client.24947 fetch_fsmap learned FSMap version 27 2024-09-05T01:24:02.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.065+0000 7f9d3008e740 1 -- 172.21.15.12:0/2255952373 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564930ac8a50 con 0x564930a42c50 2024-09-05T01:24:02.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.065+0000 7f9d0be00640 1 -- 172.21.15.12:0/2255952373 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d18011cb0 con 0x564930a42c50 2024-09-05T01:24:02.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.065+0000 7f9d0be00640 1 -- 172.21.15.12:0/2255952373 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f9d10065050 con 0x564930a42c50 2024-09-05T01:24:02.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.065+0000 7f9d3008e740 10 client.24947 fetch_fsmap finished waiting for FSMap version 27 2024-09-05T01:24:02.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.065+0000 7f9d3008e740 10 client.24947 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-05T01:24:02.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.065+0000 7f9d3008e740 20 client.24947 populate_metadata read hostname 'smithi012' 2024-09-05T01:24:02.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.065+0000 7f9d3008e740 1 --2- 172.21.15.12:0/2255952373 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x564930acd620 0x564930acc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:02.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.065+0000 7f9d3008e740 4 client.24947 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T01:24:02.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.065+0000 7f9d3008e740 1 -- 172.21.15.12:0/2255952373 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "status"}) -- 0x5649309afb30 con 0x564930acd620 2024-09-05T01:24:02.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.066+0000 7f9d26a00640 1 --2- 172.21.15.12:0/2255952373 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x564930acd620 0x564930acc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:02.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.066+0000 7f9d26a00640 1 --2- 172.21.15.12:0/2255952373 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x564930acd620 0x564930acc330 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7680f983c0f86df5 server_cookie=aadec989e58a9c5a in_seq=0 out_seq=0 2024-09-05T01:24:02.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.066+0000 7f9d0be00640 10 client.24947 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:24:02.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.067+0000 7f9d0be00640 1 -- 172.21.15.12:0/2255952373 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5649309afb30 con 0x564930acd620 2024-09-05T01:24:02.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.067+0000 7f9d0be00640 10 client.24947 handle_command_reply: tid=0 2024-09-05T01:24:02.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.067+0000 7f9d3008e740 1 client.24947 shutdown 2024-09-05T01:24:02.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.067+0000 7f9d3008e740 1 -- 172.21.15.12:0/2255952373 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564930a42c50 msgr2=0x564930a61a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:02.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.067+0000 7f9d3008e740 1 --2- 172.21.15.12:0/2255952373 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564930a42c50 0x564930a61a60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x564930a3fc40 tx=0x7f9d10009260 comp rx=0 tx=0).stop 2024-09-05T01:24:02.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.067+0000 7f9d3008e740 1 -- 172.21.15.12:0/2255952373 shutdown_connections 2024-09-05T01:24:02.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.067+0000 7f9d3008e740 1 --2- 172.21.15.12:0/2255952373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564930a4d510 0x564930a61fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.067+0000 7f9d3008e740 1 --2- 172.21.15.12:0/2255952373 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x564930acd620 0x564930acc330 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.067+0000 7f9d3008e740 1 --2- 172.21.15.12:0/2255952373 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564930a42c50 0x564930a61a60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.067+0000 7f9d3008e740 1 --2- 172.21.15.12:0/2255952373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564930a42330 0x564930a61520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.067+0000 7f9d0be00640 0 client.24947 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:24:02.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.067+0000 7f9d3008e740 1 -- 172.21.15.12:0/2255952373 >> 172.21.15.12:0/2255952373 conn(0x564930a3e8c0 msgr2=0x564930a48a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:02.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.067+0000 7f9d3008e740 1 -- 172.21.15.12:0/2255952373 shutdown_connections 2024-09-05T01:24:02.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.067+0000 7f9d3008e740 1 -- 172.21.15.12:0/2255952373 wait complete. 2024-09-05T01:24:02.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.067+0000 7f9d3008e740 20 client.24947 trim_cache size 0 max 16384 2024-09-05T01:24:02.073 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:24:02.073 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "0d44cd7e-6b24-11ef-bcd6-c7b262605968", 2024-09-05T01:24:02.073 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 2, 2024-09-05T01:24:02.073 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24524, 2024-09-05T01:24:02.073 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-05T01:24:02.073 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-05T01:24:02.073 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-05T01:24:02.073 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 76.989232586, 2024-09-05T01:24:02.073 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 27, 2024-09-05T01:24:02.073 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 83, 2024-09-05T01:24:02.073 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 81, 2024-09-05T01:24:02.073 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 112.56598071800001 2024-09-05T01:24:02.074 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:24:02.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.068+0000 7f9d2d600640 1 -- 172.21.15.12:0/853584207 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f9d0c0a2c90 msgr2=0x7f9d0c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:02.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.068+0000 7f9d2d600640 1 --2- 172.21.15.12:0/853584207 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f9d0c0a2c90 0x7f9d0c0a5150 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9d100057c0 tx=0x7f9d10005b50 comp rx=0 tx=0).stop 2024-09-05T01:24:02.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.068+0000 7f9d2d600640 1 -- 172.21.15.12:0/853584207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d2810e430 msgr2=0x7f9d2819ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:02.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.068+0000 7f9d2d600640 1 --2- 172.21.15.12:0/853584207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d2810e430 0x7f9d2819ef10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9d2000eb40 tx=0x7f9d2000c2d0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.068+0000 7f9d2d600640 1 -- 172.21.15.12:0/853584207 shutdown_connections 2024-09-05T01:24:02.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.068+0000 7f9d2d600640 1 --2- 172.21.15.12:0/853584207 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f9d0c0a2c90 0x7f9d0c0a5150 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.068+0000 7f9d2d600640 1 --2- 172.21.15.12:0/853584207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d2810e430 0x7f9d2819ef10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.068+0000 7f9d2d600640 1 --2- 172.21.15.12:0/853584207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9d28074ee0 0x7f9d2819ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.068+0000 7f9d2d600640 1 --2- 172.21.15.12:0/853584207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d280745c0 0x7f9d2819a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:02.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.068+0000 7f9d2d600640 1 -- 172.21.15.12:0/853584207 >> 172.21.15.12:0/853584207 conn(0x7f9d280fd8b0 msgr2=0x7f9d280fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:02.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.068+0000 7f9d2d600640 1 -- 172.21.15.12:0/853584207 shutdown_connections 2024-09-05T01:24:02.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:02.068+0000 7f9d2d600640 1 -- 172.21.15.12:0/853584207 wait complete. 2024-09-05T01:24:02.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:02 smithi012 ceph-mon[29942]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-05T01:24:02.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:02 smithi145 ceph-mon[34376]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-05T01:24:02.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:02 smithi151 ceph-mon[35013]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-05T01:24:02.835 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.i status 2024-09-05T01:24:03.217 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:24:03.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.757+0000 7efd9fe00640 1 -- 172.21.15.12:0/609615998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efda01079c0 msgr2=0x7efda0107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:03.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.757+0000 7efd9fe00640 1 --2- 172.21.15.12:0/609615998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efda01079c0 0x7efda0107da0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efd90009930 tx=0x7efd9002a420 comp rx=0 tx=0).stop 2024-09-05T01:24:03.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.757+0000 7efd9fe00640 1 -- 172.21.15.12:0/609615998 shutdown_connections 2024-09-05T01:24:03.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.757+0000 7efd9fe00640 1 --2- 172.21.15.12:0/609615998 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efda0102360 0x7efda010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.757+0000 7efd9fe00640 1 --2- 172.21.15.12:0/609615998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efda01019c0 0x7efda0101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.757+0000 7efd9fe00640 1 --2- 172.21.15.12:0/609615998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efda01079c0 0x7efda0107da0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.757+0000 7efd9fe00640 1 -- 172.21.15.12:0/609615998 >> 172.21.15.12:0/609615998 conn(0x7efda00fd740 msgr2=0x7efda00ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:03.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.757+0000 7efd9fe00640 1 -- 172.21.15.12:0/609615998 shutdown_connections 2024-09-05T01:24:03.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.757+0000 7efd9fe00640 1 -- 172.21.15.12:0/609615998 wait complete. 2024-09-05T01:24:03.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.758+0000 7efd9fe00640 1 Processor -- start 2024-09-05T01:24:03.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.758+0000 7efd9fe00640 1 -- start start 2024-09-05T01:24:03.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.758+0000 7efd9fe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efda01019c0 0x7efda0198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:03.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.758+0000 7efd9fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efda0102360 0x7efda0198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:03.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.758+0000 7efd9fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efda01079c0 0x7efda019cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:03.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.758+0000 7efd9fe00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efda0111e10 con 0x7efda0102360 2024-09-05T01:24:03.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.758+0000 7efd9fe00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7efda0111c90 con 0x7efda01019c0 2024-09-05T01:24:03.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.758+0000 7efd9fe00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7efda0111f90 con 0x7efda01079c0 2024-09-05T01:24:03.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.759+0000 7efd96000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efda0102360 0x7efda0198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:03.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.759+0000 7efd96000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efda0102360 0x7efda0198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44952/0 (socket says 172.21.15.12:44952) 2024-09-05T01:24:03.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.759+0000 7efd96000640 1 -- 172.21.15.12:0/108243481 learned_addr learned my addr 172.21.15.12:0/108243481 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:03.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.759+0000 7efd9ea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efda01019c0 0x7efda0198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:03.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.759+0000 7efd9f400640 1 --2- 172.21.15.12:0/108243481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efda01079c0 0x7efda019cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:03.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.759+0000 7efd9ea00640 1 -- 172.21.15.12:0/108243481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efda01079c0 msgr2=0x7efda019cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:03.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.759+0000 7efd9ea00640 1 --2- 172.21.15.12:0/108243481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efda01079c0 0x7efda019cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.759+0000 7efd9ea00640 1 -- 172.21.15.12:0/108243481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efda0102360 msgr2=0x7efda0198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:03.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.759+0000 7efd9ea00640 1 --2- 172.21.15.12:0/108243481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efda0102360 0x7efda0198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.759+0000 7efd9ea00640 1 -- 172.21.15.12:0/108243481 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda019d2e0 con 0x7efda01019c0 2024-09-05T01:24:03.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.759+0000 7efd96000640 1 --2- 172.21.15.12:0/108243481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efda0102360 0x7efda0198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:03.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.759+0000 7efd9f400640 1 --2- 172.21.15.12:0/108243481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efda01079c0 0x7efda019cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:03.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.760+0000 7efd9ea00640 1 --2- 172.21.15.12:0/108243481 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efda01019c0 0x7efda0198330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efd9002a940 tx=0x7efd90003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:03.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.760+0000 7efd97e00640 1 -- 172.21.15.12:0/108243481 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9003f070 con 0x7efda01019c0 2024-09-05T01:24:03.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.760+0000 7efd9fe00640 1 -- 172.21.15.12:0/108243481 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efda019d570 con 0x7efda01019c0 2024-09-05T01:24:03.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.760+0000 7efd97e00640 1 -- 172.21.15.12:0/108243481 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd90031c90 con 0x7efda01019c0 2024-09-05T01:24:03.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.760+0000 7efd97e00640 1 -- 172.21.15.12:0/108243481 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90035030 con 0x7efda01019c0 2024-09-05T01:24:03.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.760+0000 7efd9fe00640 1 -- 172.21.15.12:0/108243481 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efda01a4eb0 con 0x7efda01019c0 2024-09-05T01:24:03.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.764+0000 7efda808f740 1 Processor -- start 2024-09-05T01:24:03.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.764+0000 7efda808f740 1 -- start start 2024-09-05T01:24:03.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.765+0000 7efda808f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a056823c0 0x561a056827a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:03.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.765+0000 7efda808f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a05682ce0 0x561a05691590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:03.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.765+0000 7efda808f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a05691ad0 0x561a05693ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:03.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.765+0000 7efda808f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561a055e80b0 con 0x561a056823c0 2024-09-05T01:24:03.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.765+0000 7efda808f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x561a0558fab0 con 0x561a05691ad0 2024-09-05T01:24:03.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.765+0000 7efda808f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561a055e4070 con 0x561a05682ce0 2024-09-05T01:24:03.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.765+0000 7efd97e00640 1 -- 172.21.15.12:0/108243481 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7efd90042070 con 0x7efda01019c0 2024-09-05T01:24:03.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.765+0000 7efd9f400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a056823c0 0x561a056827a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:03.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.765+0000 7efd9f400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a056823c0 0x561a056827a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44958/0 (socket says 172.21.15.12:44958) 2024-09-05T01:24:03.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.765+0000 7efd9f400640 1 -- 172.21.15.12:0/4014331985 learned_addr learned my addr 172.21.15.12:0/4014331985 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:03.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.765+0000 7efd9ea00640 1 --2- 172.21.15.12:0/4014331985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a05682ce0 0x561a05691590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:03.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.766+0000 7efd9f400640 1 -- 172.21.15.12:0/4014331985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a05682ce0 msgr2=0x561a05691590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:03.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.766+0000 7efd9f400640 1 --2- 172.21.15.12:0/4014331985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a05682ce0 0x561a05691590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.766+0000 7efd9f400640 1 -- 172.21.15.12:0/4014331985 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a05691ad0 msgr2=0x561a05693ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:03.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.766+0000 7efd96000640 1 --2- 172.21.15.12:0/4014331985 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a05691ad0 0x561a05693ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.766+0000 7efd9f400640 1 --2- 172.21.15.12:0/4014331985 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a05691ad0 0x561a05693ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.766+0000 7efd9f400640 1 -- 172.21.15.12:0/4014331985 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a0559c4a0 con 0x561a056823c0 2024-09-05T01:24:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.766+0000 7efd9ea00640 1 --2- 172.21.15.12:0/4014331985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a05682ce0 0x561a05691590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:24:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.766+0000 7efd9f400640 1 --2- 172.21.15.12:0/4014331985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a056823c0 0x561a056827a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efd980107a0 tx=0x7efd98010c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8d58cc354dc68f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.766+0000 7efd8f400640 1 -- 172.21.15.12:0/4014331985 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98003b70 con 0x561a056823c0 2024-09-05T01:24:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.766+0000 7efd8f400640 1 -- 172.21.15.12:0/4014331985 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd98010e50 con 0x561a056823c0 2024-09-05T01:24:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.766+0000 7efd8f400640 1 -- 172.21.15.12:0/4014331985 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd980046d0 con 0x561a056823c0 2024-09-05T01:24:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.767+0000 7efda808f740 1 -- 172.21.15.12:0/4014331985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a056823c0 msgr2=0x561a056827a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.767+0000 7efda808f740 1 --2- 172.21.15.12:0/4014331985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a056823c0 0x561a056827a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efd980107a0 tx=0x7efd98010c60 comp rx=0 tx=0).stop 2024-09-05T01:24:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.767+0000 7efd97e00640 1 --2- 172.21.15.12:0/108243481 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7efd840a2c10 0x7efd840a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.767+0000 7efda808f740 1 -- 172.21.15.12:0/4014331985 shutdown_connections 2024-09-05T01:24:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.767+0000 7efda808f740 1 --2- 172.21.15.12:0/4014331985 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a05691ad0 0x561a05693ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.767+0000 7efda808f740 1 --2- 172.21.15.12:0/4014331985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a05682ce0 0x561a05691590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.767+0000 7efda808f740 1 --2- 172.21.15.12:0/4014331985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a056823c0 0x561a056827a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.767+0000 7efda808f740 1 -- 172.21.15.12:0/4014331985 >> 172.21.15.12:0/4014331985 conn(0x561a0567ea70 msgr2=0x561a0567ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:03.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.767+0000 7efd97e00640 1 -- 172.21.15.12:0/108243481 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7efd900ef7f0 con 0x7efda01019c0 2024-09-05T01:24:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.767+0000 7efd9f400640 1 --2- 172.21.15.12:0/108243481 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7efd840a2c10 0x7efd840a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.768+0000 7efda808f740 1 -- 172.21.15.12:0/4014331985 shutdown_connections 2024-09-05T01:24:03.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.768+0000 7efda808f740 1 -- 172.21.15.12:0/4014331985 wait complete. 2024-09-05T01:24:03.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.768+0000 7efda808f740 1 -- start start 2024-09-05T01:24:03.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.768+0000 7efd9f400640 1 --2- 172.21.15.12:0/108243481 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7efd840a2c10 0x7efd840a50d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efd98005fd0 tx=0x7efd98000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:03.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.768+0000 7efda808f740 1 Processor -- start 2024-09-05T01:24:03.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.769+0000 7efda808f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a056823c0 0x561a0568e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:03.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.769+0000 7efda808f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a05682ce0 0x561a0568ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:03.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.769+0000 7efda808f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a05691ad0 0x561a0568f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:03.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.769+0000 7efda808f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561a05694740 con 0x561a05691ad0 2024-09-05T01:24:03.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.769+0000 7efda808f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x561a05570920 con 0x561a056823c0 2024-09-05T01:24:03.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.769+0000 7efda808f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561a056948c0 con 0x561a05682ce0 2024-09-05T01:24:03.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.769+0000 7efda808f740 10 client.0 _ll_register_callbacks cb 0x561a055948a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:24:03.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.769+0000 7efd9f400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a05691ad0 0x561a0568f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:03.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.769+0000 7efd9ea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a056823c0 0x561a0568e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:03.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.769+0000 7efd9ea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a056823c0 0x561a0568e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:60050/0 (socket says 172.21.15.12:60050) 2024-09-05T01:24:03.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.769+0000 7efd9ea00640 1 -- 172.21.15.12:0/1410760019 learned_addr learned my addr 172.21.15.12:0/1410760019 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:03.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.769+0000 7efd96000640 1 --2- 172.21.15.12:0/1410760019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a05682ce0 0x561a0568ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:03.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.769+0000 7efd9ea00640 1 -- 172.21.15.12:0/1410760019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a05682ce0 msgr2=0x561a0568ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:03.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.769+0000 7efd9ea00640 1 --2- 172.21.15.12:0/1410760019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a05682ce0 0x561a0568ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.769+0000 7efd9ea00640 1 -- 172.21.15.12:0/1410760019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a05691ad0 msgr2=0x561a0568f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:03.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.769+0000 7efd9ea00640 1 --2- 172.21.15.12:0/1410760019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a05691ad0 0x561a0568f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.769+0000 7efd9ea00640 1 -- 172.21.15.12:0/1410760019 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a053592b0 con 0x561a056823c0 2024-09-05T01:24:03.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.770+0000 7efd9ea00640 1 --2- 172.21.15.12:0/1410760019 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a056823c0 0x561a0568e9d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efd900ed160 tx=0x7efd90003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adc761f8c2c73ac6 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:03.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.770+0000 7efd83e00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:24:03.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.770+0000 7efd83e00640 1 -- 172.21.15.12:0/1410760019 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90049070 con 0x561a056823c0 2024-09-05T01:24:03.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.770+0000 7efd83e00640 1 -- 172.21.15.12:0/1410760019 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7efd900ed380 con 0x561a056823c0 2024-09-05T01:24:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.770+0000 7efda808f740 1 -- 172.21.15.12:0/1410760019 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd98010e50 con 0x561a056823c0 2024-09-05T01:24:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.770+0000 7efd83e00640 1 -- 172.21.15.12:0/1410760019 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efd900bbf30 con 0x561a056823c0 2024-09-05T01:24:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.770+0000 7efda808f740 10 client.24956 fetch_fsmap learned FSMap version 27 2024-09-05T01:24:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.770+0000 7efda808f740 1 -- 172.21.15.12:0/1410760019 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561a056a03e0 con 0x561a056823c0 2024-09-05T01:24:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.771+0000 7efd83e00640 1 -- 172.21.15.12:0/1410760019 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd98010e50 con 0x561a056823c0 2024-09-05T01:24:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.771+0000 7efd83e00640 1 -- 172.21.15.12:0/1410760019 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7efd900bc190 con 0x561a056823c0 2024-09-05T01:24:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.771+0000 7efda808f740 10 client.24956 fetch_fsmap finished waiting for FSMap version 27 2024-09-05T01:24:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.771+0000 7efda808f740 10 client.24956 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-05T01:24:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.771+0000 7efda808f740 20 client.24956 populate_metadata read hostname 'smithi012' 2024-09-05T01:24:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.771+0000 7efda808f740 1 --2- 172.21.15.12:0/1410760019 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x561a056a2a90 0x561a056a3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.771+0000 7efda808f740 4 client.24956 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:24:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.771+0000 7efda808f740 1 -- 172.21.15.12:0/1410760019 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a055f5620 con 0x561a056a2a90 2024-09-05T01:24:03.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.771+0000 7efd96000640 1 --2- 172.21.15.12:0/1410760019 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x561a056a2a90 0x561a056a3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:03.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.772+0000 7efd96000640 1 --2- 172.21.15.12:0/1410760019 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x561a056a2a90 0x561a056a3f00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=26aaba1b0a9647c4 server_cookie=cd9081bb5e2bd60c in_seq=0 out_seq=0 2024-09-05T01:24:03.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.772+0000 7efd83e00640 10 client.24956 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:24:03.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.773+0000 7efd83e00640 1 -- 172.21.15.12:0/1410760019 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561a055f5620 con 0x561a056a2a90 2024-09-05T01:24:03.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.773+0000 7efd83e00640 10 client.24956 handle_command_reply: tid=0 2024-09-05T01:24:03.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.773+0000 7efda808f740 1 client.24956 shutdown 2024-09-05T01:24:03.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.773+0000 7efda808f740 1 -- 172.21.15.12:0/1410760019 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a056823c0 msgr2=0x561a0568e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:03.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.773+0000 7efda808f740 1 --2- 172.21.15.12:0/1410760019 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a056823c0 0x561a0568e9d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efd900ed160 tx=0x7efd90003f90 comp rx=0 tx=0).stop 2024-09-05T01:24:03.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.773+0000 7efda808f740 1 -- 172.21.15.12:0/1410760019 shutdown_connections 2024-09-05T01:24:03.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.773+0000 7efda808f740 1 --2- 172.21.15.12:0/1410760019 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x561a056a2a90 0x561a056a3f00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.773+0000 7efda808f740 1 --2- 172.21.15.12:0/1410760019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a05691ad0 0x561a0568f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.773+0000 7efd83e00640 0 client.24956 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:24:03.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.773+0000 7efda808f740 1 --2- 172.21.15.12:0/1410760019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a05682ce0 0x561a0568ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.773+0000 7efda808f740 1 --2- 172.21.15.12:0/1410760019 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a056823c0 0x561a0568e9d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.773+0000 7efda808f740 1 -- 172.21.15.12:0/1410760019 >> 172.21.15.12:0/1410760019 conn(0x561a0567ea70 msgr2=0x561a056847d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:03.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.773+0000 7efda808f740 1 -- 172.21.15.12:0/1410760019 shutdown_connections 2024-09-05T01:24:03.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.773+0000 7efda808f740 1 -- 172.21.15.12:0/1410760019 wait complete. 2024-09-05T01:24:03.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.774+0000 7efda808f740 20 client.24956 trim_cache size 0 max 16384 2024-09-05T01:24:03.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.792+0000 7efda808f740 1 Processor -- start 2024-09-05T01:24:03.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.792+0000 7efda808f740 1 -- start start 2024-09-05T01:24:03.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.793+0000 7efda808f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a056823c0 0x561a0567ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:03.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.793+0000 7efda808f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a05682ce0 0x561a0568bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:03.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.793+0000 7efda808f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a05691ad0 0x561a0568c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:03.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.793+0000 7efda808f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561a056a2240 con 0x561a056823c0 2024-09-05T01:24:03.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.793+0000 7efda808f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x561a056a2910 con 0x561a05682ce0 2024-09-05T01:24:03.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.793+0000 7efda808f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561a056a2fe0 con 0x561a05691ad0 2024-09-05T01:24:03.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.793+0000 7efd9ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a056823c0 0x561a0567ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:03.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.793+0000 7efd9ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a056823c0 0x561a0567ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44966/0 (socket says 172.21.15.12:44966) 2024-09-05T01:24:03.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.793+0000 7efd9ea00640 1 -- 172.21.15.12:0/922452098 learned_addr learned my addr 172.21.15.12:0/922452098 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:03.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.793+0000 7efd9f400640 1 --2- 172.21.15.12:0/922452098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a05691ad0 0x561a0568c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:03.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.793+0000 7efd96000640 1 --2- 172.21.15.12:0/922452098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a05682ce0 0x561a0568bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:03.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.793+0000 7efd9ea00640 1 -- 172.21.15.12:0/922452098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a05691ad0 msgr2=0x561a0568c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:03.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.793+0000 7efd9ea00640 1 --2- 172.21.15.12:0/922452098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a05691ad0 0x561a0568c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.793+0000 7efd9ea00640 1 -- 172.21.15.12:0/922452098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a05682ce0 msgr2=0x561a0568bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:03.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.793+0000 7efd9ea00640 1 --2- 172.21.15.12:0/922452098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a05682ce0 0x561a0568bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.793+0000 7efd9ea00640 1 -- 172.21.15.12:0/922452098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a0567e510 con 0x561a056823c0 2024-09-05T01:24:03.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.794+0000 7efd9ea00640 1 --2- 172.21.15.12:0/922452098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a056823c0 0x561a0567ee50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efd900bbec0 tx=0x7efd9003b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1c8320cb5931ac server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:03.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.794+0000 7efd8ea00640 1 -- 172.21.15.12:0/922452098 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90049030 con 0x561a056823c0 2024-09-05T01:24:03.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.794+0000 7efd8ea00640 1 -- 172.21.15.12:0/922452098 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd900c0230 con 0x561a056823c0 2024-09-05T01:24:03.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.794+0000 7efd8ea00640 1 -- 172.21.15.12:0/922452098 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd900ed380 con 0x561a056823c0 2024-09-05T01:24:03.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.794+0000 7efda808f740 1 -- 172.21.15.12:0/922452098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a056823c0 msgr2=0x561a0567ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:03.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.795+0000 7efda808f740 1 --2- 172.21.15.12:0/922452098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a056823c0 0x561a0567ee50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efd900bbec0 tx=0x7efd9003b790 comp rx=0 tx=0).stop 2024-09-05T01:24:03.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.795+0000 7efda808f740 1 -- 172.21.15.12:0/922452098 shutdown_connections 2024-09-05T01:24:03.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.795+0000 7efda808f740 1 --2- 172.21.15.12:0/922452098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a05691ad0 0x561a0568c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.795+0000 7efda808f740 1 --2- 172.21.15.12:0/922452098 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a05682ce0 0x561a0568bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.795+0000 7efda808f740 1 --2- 172.21.15.12:0/922452098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a056823c0 0x561a0567ee50 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.795+0000 7efda808f740 1 -- 172.21.15.12:0/922452098 >> 172.21.15.12:0/922452098 conn(0x561a0567ea70 msgr2=0x561a0568d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:03.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.795+0000 7efda808f740 1 -- 172.21.15.12:0/922452098 shutdown_connections 2024-09-05T01:24:03.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.795+0000 7efda808f740 1 -- 172.21.15.12:0/922452098 wait complete. 2024-09-05T01:24:03.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.795+0000 7efda808f740 1 -- start start 2024-09-05T01:24:03.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.796+0000 7efda808f740 1 Processor -- start 2024-09-05T01:24:03.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.796+0000 7efda808f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a056823c0 0x561a056aca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:03.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.796+0000 7efda808f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a05682ce0 0x561a056a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:03.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.796+0000 7efda808f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a05691ad0 0x561a056a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:03.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.796+0000 7efda808f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561a056a3d80 con 0x561a056823c0 2024-09-05T01:24:03.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.796+0000 7efda808f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x561a056a36b0 con 0x561a05682ce0 2024-09-05T01:24:03.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.796+0000 7efda808f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561a056a4450 con 0x561a05691ad0 2024-09-05T01:24:03.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.796+0000 7efda808f740 10 client.0 _ll_register_callbacks cb 0x7efd900b82a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:24:03.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.796+0000 7efd9ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a056823c0 0x561a056aca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:03.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.796+0000 7efd9ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a056823c0 0x561a056aca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44974/0 (socket says 172.21.15.12:44974) 2024-09-05T01:24:03.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.796+0000 7efd9ea00640 1 -- 172.21.15.12:0/445739703 learned_addr learned my addr 172.21.15.12:0/445739703 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:03.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.796+0000 7efd96000640 1 --2- 172.21.15.12:0/445739703 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a05682ce0 0x561a056a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:03.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.796+0000 7efd9f400640 1 --2- 172.21.15.12:0/445739703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a05691ad0 0x561a056a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:03.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.797+0000 7efd96000640 1 -- 172.21.15.12:0/445739703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a05691ad0 msgr2=0x561a056a63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:03.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.797+0000 7efd96000640 1 --2- 172.21.15.12:0/445739703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a05691ad0 0x561a056a63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.797+0000 7efd96000640 1 -- 172.21.15.12:0/445739703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a056823c0 msgr2=0x561a056aca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:03.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.797+0000 7efd96000640 1 --2- 172.21.15.12:0/445739703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a056823c0 0x561a056aca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.797+0000 7efd96000640 1 -- 172.21.15.12:0/445739703 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a056aa550 con 0x561a05682ce0 2024-09-05T01:24:03.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.797+0000 7efd96000640 1 --2- 172.21.15.12:0/445739703 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a05682ce0 0x561a056a5d60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x561a05690010 tx=0x7efd88013a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cfca8ab8b59d9a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:03.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.797+0000 7efd83e00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:24:03.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.797+0000 7efd83e00640 1 -- 172.21.15.12:0/445739703 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd88024070 con 0x561a05682ce0 2024-09-05T01:24:03.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.797+0000 7efda808f740 1 -- 172.21.15.12:0/445739703 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd900c0230 con 0x561a05682ce0 2024-09-05T01:24:03.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.797+0000 7efd83e00640 1 -- 172.21.15.12:0/445739703 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7efd880207d0 con 0x561a05682ce0 2024-09-05T01:24:03.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.798+0000 7efd83e00640 1 -- 172.21.15.12:0/445739703 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efd880209f0 con 0x561a05682ce0 2024-09-05T01:24:03.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.798+0000 7efda808f740 10 client.24962 fetch_fsmap learned FSMap version 27 2024-09-05T01:24:03.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.798+0000 7efda808f740 1 -- 172.21.15.12:0/445739703 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561a0570d3f0 con 0x561a05682ce0 2024-09-05T01:24:03.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.798+0000 7efd83e00640 1 -- 172.21.15.12:0/445739703 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd900c0230 con 0x561a05682ce0 2024-09-05T01:24:03.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.798+0000 7efd83e00640 1 -- 172.21.15.12:0/445739703 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7efd88010430 con 0x561a05682ce0 2024-09-05T01:24:03.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.798+0000 7efda808f740 10 client.24962 fetch_fsmap finished waiting for FSMap version 27 2024-09-05T01:24:03.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.798+0000 7efda808f740 10 client.24962 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-05T01:24:03.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.798+0000 7efda808f740 20 client.24962 populate_metadata read hostname 'smithi012' 2024-09-05T01:24:03.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.798+0000 7efda808f740 1 --2- 172.21.15.12:0/445739703 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x561a05711f70 0x561a05710c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:03.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.798+0000 7efda808f740 4 client.24962 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T01:24:03.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.798+0000 7efda808f740 1 -- 172.21.15.12:0/445739703 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "status"}) -- 0x561a055efb30 con 0x561a05711f70 2024-09-05T01:24:03.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.799+0000 7efd9ea00640 1 --2- 172.21.15.12:0/445739703 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x561a05711f70 0x561a05710c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:03.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.799+0000 7efd9ea00640 1 --2- 172.21.15.12:0/445739703 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x561a05711f70 0x561a05710c80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=95f88391852d6be server_cookie=a29a2da965f161d4 in_seq=0 out_seq=0 2024-09-05T01:24:03.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.799+0000 7efd83e00640 10 client.24962 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:24:03.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.800+0000 7efd83e00640 1 -- 172.21.15.12:0/445739703 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x561a055efb30 con 0x561a05711f70 2024-09-05T01:24:03.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.800+0000 7efd83e00640 10 client.24962 handle_command_reply: tid=0 2024-09-05T01:24:03.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.800+0000 7efda808f740 1 client.24962 shutdown 2024-09-05T01:24:03.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.800+0000 7efda808f740 1 -- 172.21.15.12:0/445739703 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a05682ce0 msgr2=0x561a056a5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:03.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.800+0000 7efda808f740 1 --2- 172.21.15.12:0/445739703 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a05682ce0 0x561a056a5d60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x561a05690010 tx=0x7efd88013a50 comp rx=0 tx=0).stop 2024-09-05T01:24:03.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.800+0000 7efda808f740 1 -- 172.21.15.12:0/445739703 shutdown_connections 2024-09-05T01:24:03.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.800+0000 7efda808f740 1 --2- 172.21.15.12:0/445739703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a05691ad0 0x561a056a63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.800+0000 7efda808f740 1 --2- 172.21.15.12:0/445739703 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a05682ce0 0x561a056a5d60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.800+0000 7efda808f740 1 --2- 172.21.15.12:0/445739703 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x561a05711f70 0x561a05710c80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.800+0000 7efda808f740 1 --2- 172.21.15.12:0/445739703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a056823c0 0x561a056aca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.800+0000 7efda808f740 1 -- 172.21.15.12:0/445739703 >> 172.21.15.12:0/445739703 conn(0x561a0567ea70 msgr2=0x561a0567d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:03.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.800+0000 7efd83e00640 0 client.24962 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:24:03.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.800+0000 7efda808f740 1 -- 172.21.15.12:0/445739703 shutdown_connections 2024-09-05T01:24:03.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.800+0000 7efda808f740 1 -- 172.21.15.12:0/445739703 wait complete. 2024-09-05T01:24:03.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.800+0000 7efda808f740 20 client.24962 trim_cache size 0 max 16384 2024-09-05T01:24:03.805 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:24:03.805 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "0d44cd7e-6b24-11ef-bcd6-c7b262605968", 2024-09-05T01:24:03.805 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 1, 2024-09-05T01:24:03.805 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24529, 2024-09-05T01:24:03.805 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-05T01:24:03.805 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-05T01:24:03.805 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-05T01:24:03.805 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 79.732259628999998, 2024-09-05T01:24:03.805 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 27, 2024-09-05T01:24:03.805 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 83, 2024-09-05T01:24:03.805 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 81, 2024-09-05T01:24:03.805 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 111.860589348 2024-09-05T01:24:03.806 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:24:03.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.801+0000 7efd9fe00640 1 -- 172.21.15.12:0/108243481 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7efd840a2c10 msgr2=0x7efd840a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:03.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.801+0000 7efd9fe00640 1 --2- 172.21.15.12:0/108243481 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7efd840a2c10 0x7efd840a50d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efd98005fd0 tx=0x7efd98000f40 comp rx=0 tx=0).stop 2024-09-05T01:24:03.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.801+0000 7efd9fe00640 1 -- 172.21.15.12:0/108243481 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efda01019c0 msgr2=0x7efda0198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:03.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.801+0000 7efd9fe00640 1 --2- 172.21.15.12:0/108243481 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efda01019c0 0x7efda0198330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efd9002a940 tx=0x7efd90003b90 comp rx=0 tx=0).stop 2024-09-05T01:24:03.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.801+0000 7efd9fe00640 1 -- 172.21.15.12:0/108243481 shutdown_connections 2024-09-05T01:24:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.801+0000 7efd9fe00640 1 --2- 172.21.15.12:0/108243481 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7efd840a2c10 0x7efd840a50d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.801+0000 7efd9fe00640 1 --2- 172.21.15.12:0/108243481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efda01079c0 0x7efda019cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.801+0000 7efd9fe00640 1 --2- 172.21.15.12:0/108243481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efda0102360 0x7efda0198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.801+0000 7efd9fe00640 1 --2- 172.21.15.12:0/108243481 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efda01019c0 0x7efda0198330 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.801+0000 7efd9fe00640 1 -- 172.21.15.12:0/108243481 >> 172.21.15.12:0/108243481 conn(0x7efda00fd740 msgr2=0x7efda00fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.801+0000 7efd9fe00640 1 -- 172.21.15.12:0/108243481 shutdown_connections 2024-09-05T01:24:03.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:03.801+0000 7efd9fe00640 1 -- 172.21.15.12:0/108243481 wait complete. 2024-09-05T01:24:04.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:04 smithi012 ceph-mon[29942]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-05T01:24:04.549 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.b status 2024-09-05T01:24:04.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:04 smithi145 ceph-mon[34376]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-05T01:24:04.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:04 smithi151 ceph-mon[35013]: pgmap v334: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-05T01:24:04.922 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:24:05.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.443+0000 7f6603200640 1 -- 172.21.15.12:0/3168047375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6604103e30 msgr2=0x7f6604104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:05.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.443+0000 7f6603200640 1 --2- 172.21.15.12:0/3168047375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6604103e30 0x7f6604104210 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f65f4009900 tx=0x7f65f402a3f0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.443+0000 7f6603200640 1 -- 172.21.15.12:0/3168047375 shutdown_connections 2024-09-05T01:24:05.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.443+0000 7f6603200640 1 --2- 172.21.15.12:0/3168047375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6604108f60 0x7f6604110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.443+0000 7f6603200640 1 --2- 172.21.15.12:0/3168047375 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f66041047e0 0x7f6604108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.443+0000 7f6603200640 1 --2- 172.21.15.12:0/3168047375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6604103e30 0x7f6604104210 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.443+0000 7f6603200640 1 -- 172.21.15.12:0/3168047375 >> 172.21.15.12:0/3168047375 conn(0x7f66040ff910 msgr2=0x7f6604101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:05.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.443+0000 7f6603200640 1 -- 172.21.15.12:0/3168047375 shutdown_connections 2024-09-05T01:24:05.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.443+0000 7f6603200640 1 -- 172.21.15.12:0/3168047375 wait complete. 2024-09-05T01:24:05.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.444+0000 7f6603200640 1 Processor -- start 2024-09-05T01:24:05.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.444+0000 7f6603200640 1 -- start start 2024-09-05T01:24:05.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.445+0000 7f6603200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6604103e30 0x7f660419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:05.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.445+0000 7f6603200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66041047e0 0x7f660419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:05.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.445+0000 7f6603200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6604108f60 0x7f660419ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:05.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.445+0000 7f6603200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6604113f80 con 0x7f66041047e0 2024-09-05T01:24:05.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.445+0000 7f6603200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6604113e00 con 0x7f6604103e30 2024-09-05T01:24:05.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.445+0000 7f6603200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6604114100 con 0x7f6604108f60 2024-09-05T01:24:05.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.445+0000 7f65fbe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66041047e0 0x7f660419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:05.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.445+0000 7f65fbe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66041047e0 0x7f660419a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44998/0 (socket says 172.21.15.12:44998) 2024-09-05T01:24:05.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.445+0000 7f65fbe00640 1 -- 172.21.15.12:0/438829070 learned_addr learned my addr 172.21.15.12:0/438829070 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:05.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.445+0000 7f6601e00640 1 --2- 172.21.15.12:0/438829070 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6604103e30 0x7f660419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:05.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.445+0000 7f6602800640 1 --2- 172.21.15.12:0/438829070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6604108f60 0x7f660419ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:05.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.445+0000 7f65fbe00640 1 -- 172.21.15.12:0/438829070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6604108f60 msgr2=0x7f660419ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:05.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.445+0000 7f65fbe00640 1 --2- 172.21.15.12:0/438829070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6604108f60 0x7f660419ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.445+0000 7f65fbe00640 1 -- 172.21.15.12:0/438829070 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6604103e30 msgr2=0x7f660419a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:05.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.445+0000 7f65fbe00640 1 --2- 172.21.15.12:0/438829070 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6604103e30 0x7f660419a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.446+0000 7f65fbe00640 1 -- 172.21.15.12:0/438829070 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f660419f410 con 0x7f66041047e0 2024-09-05T01:24:05.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.446+0000 7f6602800640 1 --2- 172.21.15.12:0/438829070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6604108f60 0x7f660419ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:24:05.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.446+0000 7f65fbe00640 1 --2- 172.21.15.12:0/438829070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66041047e0 0x7f660419a9a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f65ec00e9f0 tx=0x7f65ec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:05.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.446+0000 7f65faa00640 1 -- 172.21.15.12:0/438829070 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec00cd80 con 0x7f66041047e0 2024-09-05T01:24:05.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.446+0000 7f65faa00640 1 -- 172.21.15.12:0/438829070 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65ec010910 con 0x7f66041047e0 2024-09-05T01:24:05.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.446+0000 7f65faa00640 1 -- 172.21.15.12:0/438829070 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec018990 con 0x7f66041047e0 2024-09-05T01:24:05.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.446+0000 7f6603200640 1 -- 172.21.15.12:0/438829070 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f660419f700 con 0x7f66041047e0 2024-09-05T01:24:05.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.446+0000 7f6603200640 1 -- 172.21.15.12:0/438829070 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66041a6fe0 con 0x7f66041047e0 2024-09-05T01:24:05.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.449+0000 7f65faa00640 1 -- 172.21.15.12:0/438829070 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f65ec010ac0 con 0x7f66041047e0 2024-09-05T01:24:05.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.449+0000 7f660bc4c740 1 Processor -- start 2024-09-05T01:24:05.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.450+0000 7f660bc4c740 1 -- start start 2024-09-05T01:24:05.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.450+0000 7f660bc4c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b41d1f4e0 0x558b41d1f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:05.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.450+0000 7f660bc4c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d1fe00 0x558b41d2a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:05.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.450+0000 7f660bc4c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b41d2a6c0 0x558b41d2cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:05.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.450+0000 7f660bc4c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558b41c850b0 con 0x558b41d1fe00 2024-09-05T01:24:05.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.450+0000 7f660bc4c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x558b41c2cab0 con 0x558b41d2a6c0 2024-09-05T01:24:05.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.450+0000 7f660bc4c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558b41c81070 con 0x558b41d1f4e0 2024-09-05T01:24:05.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.450+0000 7f6601e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d1fe00 0x558b41d2a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:05.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.450+0000 7f6601e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d1fe00 0x558b41d2a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45012/0 (socket says 172.21.15.12:45012) 2024-09-05T01:24:05.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.450+0000 7f6601e00640 1 -- 172.21.15.12:0/1263942558 learned_addr learned my addr 172.21.15.12:0/1263942558 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:05.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.450+0000 7f6602800640 1 --2- 172.21.15.12:0/1263942558 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b41d1f4e0 0x558b41d1f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:05.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.451+0000 7f65fbe00640 1 --2- 172.21.15.12:0/1263942558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b41d2a6c0 0x558b41d2cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:05.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.451+0000 7f6602800640 1 -- 172.21.15.12:0/1263942558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b41d2a6c0 msgr2=0x558b41d2cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:05.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.451+0000 7f6602800640 1 --2- 172.21.15.12:0/1263942558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b41d2a6c0 0x558b41d2cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.451+0000 7f6602800640 1 -- 172.21.15.12:0/1263942558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d1fe00 msgr2=0x558b41d2a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:05.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.451+0000 7f6602800640 1 --2- 172.21.15.12:0/1263942558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d1fe00 0x558b41d2a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.451+0000 7f6602800640 1 -- 172.21.15.12:0/1263942558 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b41c394a0 con 0x558b41d1f4e0 2024-09-05T01:24:05.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.451+0000 7f6602800640 1 --2- 172.21.15.12:0/1263942558 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b41d1f4e0 0x558b41d1f8c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f65fc009f10 tx=0x7f65fc0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74f97c5dfac3cd67 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:05.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.451+0000 7f65faa00640 1 --2- 172.21.15.12:0/438829070 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f65e80a2c90 0x7f65e80a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:05.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.451+0000 7f65f3400640 1 -- 172.21.15.12:0/1263942558 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc01c680 con 0x558b41d1f4e0 2024-09-05T01:24:05.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.452+0000 7f65f3400640 1 -- 172.21.15.12:0/1263942558 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65fc01cd00 con 0x558b41d1f4e0 2024-09-05T01:24:05.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.452+0000 7f65f3400640 1 -- 172.21.15.12:0/1263942558 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc011e30 con 0x558b41d1f4e0 2024-09-05T01:24:05.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.452+0000 7f65faa00640 1 -- 172.21.15.12:0/438829070 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f65ec0cf560 con 0x7f66041047e0 2024-09-05T01:24:05.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.452+0000 7f6601e00640 1 --2- 172.21.15.12:0/438829070 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f65e80a2c90 0x7f65e80a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:05.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.452+0000 7f660bc4c740 1 -- 172.21.15.12:0/1263942558 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b41d1f4e0 msgr2=0x558b41d1f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:05.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.452+0000 7f660bc4c740 1 --2- 172.21.15.12:0/1263942558 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b41d1f4e0 0x558b41d1f8c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f65fc009f10 tx=0x7f65fc0107a0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.452+0000 7f660bc4c740 1 -- 172.21.15.12:0/1263942558 shutdown_connections 2024-09-05T01:24:05.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.452+0000 7f660bc4c740 1 --2- 172.21.15.12:0/1263942558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b41d2a6c0 0x558b41d2cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.452+0000 7f660bc4c740 1 --2- 172.21.15.12:0/1263942558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d1fe00 0x558b41d2a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.452+0000 7f660bc4c740 1 --2- 172.21.15.12:0/1263942558 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b41d1f4e0 0x558b41d1f8c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.452+0000 7f6601e00640 1 --2- 172.21.15.12:0/438829070 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f65e80a2c90 0x7f65e80a5150 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f65f40096c0 tx=0x7f65f40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:05.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.452+0000 7f660bc4c740 1 -- 172.21.15.12:0/1263942558 >> 172.21.15.12:0/1263942558 conn(0x558b41d1ba70 msgr2=0x558b41d1be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:05.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.453+0000 7f660bc4c740 1 -- 172.21.15.12:0/1263942558 shutdown_connections 2024-09-05T01:24:05.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.453+0000 7f660bc4c740 1 -- 172.21.15.12:0/1263942558 wait complete. 2024-09-05T01:24:05.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.453+0000 7f660bc4c740 1 -- start start 2024-09-05T01:24:05.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.453+0000 7f660bc4c740 1 Processor -- start 2024-09-05T01:24:05.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.454+0000 7f660bc4c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b41d1f4e0 0x558b41d27560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:05.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.454+0000 7f660bc4c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b41d1fe00 0x558b41d27aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:05.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.454+0000 7f660bc4c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d2a6c0 0x558b41d27fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:05.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.454+0000 7f660bc4c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558b41d2d330 con 0x558b41d2a6c0 2024-09-05T01:24:05.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.454+0000 7f660bc4c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x558b41c0d920 con 0x558b41d1f4e0 2024-09-05T01:24:05.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.454+0000 7f660bc4c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558b41d2d4b0 con 0x558b41d1fe00 2024-09-05T01:24:05.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.454+0000 7f660bc4c740 10 client.0 _ll_register_callbacks cb 0x558b41c318a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:24:05.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.454+0000 7f6602800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d2a6c0 0x558b41d27fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:05.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.454+0000 7f65fbe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b41d1fe00 0x558b41d27aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:05.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.454+0000 7f6602800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d2a6c0 0x558b41d27fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45014/0 (socket says 172.21.15.12:45014) 2024-09-05T01:24:05.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.454+0000 7f6602800640 1 -- 172.21.15.12:0/2738103402 learned_addr learned my addr 172.21.15.12:0/2738103402 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:05.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.454+0000 7f65fbe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b41d1fe00 0x558b41d27aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:50134/0 (socket says 172.21.15.12:50134) 2024-09-05T01:24:05.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.454+0000 7f6601e00640 1 --2- 172.21.15.12:0/2738103402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b41d1f4e0 0x558b41d27560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:05.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.454+0000 7f65fbe00640 1 -- 172.21.15.12:0/2738103402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b41d1f4e0 msgr2=0x558b41d27560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:05.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.454+0000 7f65fbe00640 1 --2- 172.21.15.12:0/2738103402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b41d1f4e0 0x558b41d27560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.454+0000 7f65fbe00640 1 -- 172.21.15.12:0/2738103402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d2a6c0 msgr2=0x558b41d27fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:05.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.454+0000 7f65fbe00640 1 --2- 172.21.15.12:0/2738103402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d2a6c0 0x558b41d27fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.454+0000 7f65fbe00640 1 -- 172.21.15.12:0/2738103402 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b419f62b0 con 0x558b41d1fe00 2024-09-05T01:24:05.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.455+0000 7f65fbe00640 1 --2- 172.21.15.12:0/2738103402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b41d1fe00 0x558b41d27aa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f65ec0ccea0 tx=0x7f65ec09b550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c81049bc2a88e94 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:05.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.455+0000 7f65e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:24:05.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.455+0000 7f65e7e00640 1 -- 172.21.15.12:0/2738103402 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec09ffa0 con 0x558b41d1fe00 2024-09-05T01:24:05.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.455+0000 7f65e7e00640 1 -- 172.21.15.12:0/2738103402 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f65ec0cf070 con 0x558b41d1fe00 2024-09-05T01:24:05.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.455+0000 7f660bc4c740 1 -- 172.21.15.12:0/2738103402 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65fc01cd00 con 0x558b41d1fe00 2024-09-05T01:24:05.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.455+0000 7f65e7e00640 1 -- 172.21.15.12:0/2738103402 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f65ec0b2070 con 0x558b41d1fe00 2024-09-05T01:24:05.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.455+0000 7f660bc4c740 10 client.24976 fetch_fsmap learned FSMap version 27 2024-09-05T01:24:05.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.455+0000 7f660bc4c740 1 -- 172.21.15.12:0/2738103402 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558b41d39020 con 0x558b41d1fe00 2024-09-05T01:24:05.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.455+0000 7f65e7e00640 1 -- 172.21.15.12:0/2738103402 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65fc01cd00 con 0x558b41d1fe00 2024-09-05T01:24:05.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.456+0000 7f65e7e00640 1 -- 172.21.15.12:0/2738103402 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f65ec018cc0 con 0x558b41d1fe00 2024-09-05T01:24:05.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.456+0000 7f660bc4c740 10 client.24976 fetch_fsmap finished waiting for FSMap version 27 2024-09-05T01:24:05.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.456+0000 7f660bc4c740 10 client.24976 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-05T01:24:05.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.456+0000 7f660bc4c740 20 client.24976 populate_metadata read hostname 'smithi012' 2024-09-05T01:24:05.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.456+0000 7f660bc4c740 1 --2- 172.21.15.12:0/2738103402 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558b41d3b5e0 0x558b41d3ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:05.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.456+0000 7f660bc4c740 4 client.24976 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:24:05.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.456+0000 7f660bc4c740 1 -- 172.21.15.12:0/2738103402 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b41c92620 con 0x558b41d3b5e0 2024-09-05T01:24:05.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.456+0000 7f6601e00640 1 --2- 172.21.15.12:0/2738103402 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558b41d3b5e0 0x558b41d3ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:05.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.457+0000 7f6601e00640 1 --2- 172.21.15.12:0/2738103402 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558b41d3b5e0 0x558b41d3ca50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=309504474c44884d server_cookie=b4f75a2962a61350 in_seq=0 out_seq=0 2024-09-05T01:24:05.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.457+0000 7f65e7e00640 10 client.24976 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:24:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.458+0000 7f65e7e00640 1 -- 172.21.15.12:0/2738103402 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558b41c92620 con 0x558b41d3b5e0 2024-09-05T01:24:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.458+0000 7f65e7e00640 10 client.24976 handle_command_reply: tid=0 2024-09-05T01:24:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.458+0000 7f660bc4c740 1 client.24976 shutdown 2024-09-05T01:24:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.458+0000 7f660bc4c740 1 -- 172.21.15.12:0/2738103402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b41d1fe00 msgr2=0x558b41d27aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.458+0000 7f660bc4c740 1 --2- 172.21.15.12:0/2738103402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b41d1fe00 0x558b41d27aa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f65ec0ccea0 tx=0x7f65ec09b550 comp rx=0 tx=0).stop 2024-09-05T01:24:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.458+0000 7f660bc4c740 1 -- 172.21.15.12:0/2738103402 shutdown_connections 2024-09-05T01:24:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.458+0000 7f660bc4c740 1 --2- 172.21.15.12:0/2738103402 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558b41d3b5e0 0x558b41d3ca50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.458+0000 7f660bc4c740 1 --2- 172.21.15.12:0/2738103402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d2a6c0 0x558b41d27fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.458+0000 7f660bc4c740 1 --2- 172.21.15.12:0/2738103402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b41d1fe00 0x558b41d27aa0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.458+0000 7f660bc4c740 1 --2- 172.21.15.12:0/2738103402 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b41d1f4e0 0x558b41d27560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.458+0000 7f65e7e00640 0 client.24976 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:24:05.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.458+0000 7f660bc4c740 1 -- 172.21.15.12:0/2738103402 >> 172.21.15.12:0/2738103402 conn(0x558b41d1ba70 msgr2=0x558b41d1abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:05.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.459+0000 7f660bc4c740 1 -- 172.21.15.12:0/2738103402 shutdown_connections 2024-09-05T01:24:05.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.459+0000 7f660bc4c740 1 -- 172.21.15.12:0/2738103402 wait complete. 2024-09-05T01:24:05.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.459+0000 7f660bc4c740 20 client.24976 trim_cache size 0 max 16384 2024-09-05T01:24:05.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.477+0000 7f660bc4c740 1 Processor -- start 2024-09-05T01:24:05.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.477+0000 7f660bc4c740 1 -- start start 2024-09-05T01:24:05.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.478+0000 7f660bc4c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b41d1f4e0 0x558b41d21f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:05.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.478+0000 7f660bc4c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b41d1fe00 0x558b41d25e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:05.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.478+0000 7f660bc4c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d2a6c0 0x558b41d26370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:05.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.478+0000 7f660bc4c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558b41d3ad90 con 0x558b41d2a6c0 2024-09-05T01:24:05.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.478+0000 7f660bc4c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x558b41d3b460 con 0x558b41d1f4e0 2024-09-05T01:24:05.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.478+0000 7f660bc4c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558b41d3bb30 con 0x558b41d1fe00 2024-09-05T01:24:05.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.478+0000 7f6602800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d2a6c0 0x558b41d26370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:05.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.478+0000 7f6602800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d2a6c0 0x558b41d26370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45022/0 (socket says 172.21.15.12:45022) 2024-09-05T01:24:05.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.478+0000 7f6602800640 1 -- 172.21.15.12:0/1584616717 learned_addr learned my addr 172.21.15.12:0/1584616717 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:05.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.478+0000 7f65fbe00640 1 --2- 172.21.15.12:0/1584616717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b41d1fe00 0x558b41d25e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:05.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.478+0000 7f6601e00640 1 --2- 172.21.15.12:0/1584616717 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b41d1f4e0 0x558b41d21f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:05.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.478+0000 7f6602800640 1 -- 172.21.15.12:0/1584616717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b41d1fe00 msgr2=0x558b41d25e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:05.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.478+0000 7f6602800640 1 --2- 172.21.15.12:0/1584616717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b41d1fe00 0x558b41d25e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.478+0000 7f6602800640 1 -- 172.21.15.12:0/1584616717 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b41d1f4e0 msgr2=0x558b41d21f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:05.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.478+0000 7f6602800640 1 --2- 172.21.15.12:0/1584616717 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b41d1f4e0 0x558b41d21f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.478+0000 7f6602800640 1 -- 172.21.15.12:0/1584616717 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b41d20a30 con 0x558b41d2a6c0 2024-09-05T01:24:05.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.479+0000 7f6602800640 1 --2- 172.21.15.12:0/1584616717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d2a6c0 0x558b41d26370 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f65fc009e60 tx=0x7f65fc0114f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba24d3caa70f90b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:05.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.479+0000 7f65f2a00640 1 -- 172.21.15.12:0/1584616717 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc011ab0 con 0x558b41d2a6c0 2024-09-05T01:24:05.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.479+0000 7f65f2a00640 1 -- 172.21.15.12:0/1584616717 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65fc011c50 con 0x558b41d2a6c0 2024-09-05T01:24:05.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.479+0000 7f65f2a00640 1 -- 172.21.15.12:0/1584616717 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc01cc10 con 0x558b41d2a6c0 2024-09-05T01:24:05.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.480+0000 7f660bc4c740 1 -- 172.21.15.12:0/1584616717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d2a6c0 msgr2=0x558b41d26370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:05.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.480+0000 7f660bc4c740 1 --2- 172.21.15.12:0/1584616717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d2a6c0 0x558b41d26370 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f65fc009e60 tx=0x7f65fc0114f0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.480+0000 7f660bc4c740 1 -- 172.21.15.12:0/1584616717 shutdown_connections 2024-09-05T01:24:05.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.480+0000 7f660bc4c740 1 --2- 172.21.15.12:0/1584616717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d2a6c0 0x558b41d26370 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.480+0000 7f660bc4c740 1 --2- 172.21.15.12:0/1584616717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b41d1fe00 0x558b41d25e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.480+0000 7f660bc4c740 1 --2- 172.21.15.12:0/1584616717 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b41d1f4e0 0x558b41d21f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.480+0000 7f660bc4c740 1 -- 172.21.15.12:0/1584616717 >> 172.21.15.12:0/1584616717 conn(0x558b41d1ba70 msgr2=0x558b41d22860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:05.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.480+0000 7f660bc4c740 1 -- 172.21.15.12:0/1584616717 shutdown_connections 2024-09-05T01:24:05.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.480+0000 7f660bc4c740 1 -- 172.21.15.12:0/1584616717 wait complete. 2024-09-05T01:24:05.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.481+0000 7f660bc4c740 1 -- start start 2024-09-05T01:24:05.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.481+0000 7f660bc4c740 1 Processor -- start 2024-09-05T01:24:05.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.481+0000 7f660bc4c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b41d1f4e0 0x558b41d453e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:05.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.481+0000 7f660bc4c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b41d1fe00 0x558b41d3e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:05.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.481+0000 7f660bc4c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d2a6c0 0x558b41d3ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:05.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.481+0000 7f660bc4c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558b41d3c8d0 con 0x558b41d2a6c0 2024-09-05T01:24:05.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.481+0000 7f660bc4c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x558b41d3c200 con 0x558b41d1fe00 2024-09-05T01:24:05.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.481+0000 7f660bc4c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558b41d3cfa0 con 0x558b41d1f4e0 2024-09-05T01:24:05.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.481+0000 7f660bc4c740 10 client.0 _ll_register_callbacks cb 0x7f65ec09b9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:24:05.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.481+0000 7f6602800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d2a6c0 0x558b41d3ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:05.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.481+0000 7f6601e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b41d1f4e0 0x558b41d453e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:05.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.482+0000 7f6602800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d2a6c0 0x558b41d3ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45028/0 (socket says 172.21.15.12:45028) 2024-09-05T01:24:05.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.482+0000 7f65fbe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b41d1fe00 0x558b41d3e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:05.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.482+0000 7f6602800640 1 -- 172.21.15.12:0/1439546241 learned_addr learned my addr 172.21.15.12:0/1439546241 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:05.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.482+0000 7f6602800640 1 -- 172.21.15.12:0/1439546241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b41d1f4e0 msgr2=0x558b41d453e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:05.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.482+0000 7f6602800640 1 --2- 172.21.15.12:0/1439546241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b41d1f4e0 0x558b41d453e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.482+0000 7f6602800640 1 -- 172.21.15.12:0/1439546241 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b41d1fe00 msgr2=0x558b41d3e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:05.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.482+0000 7f6602800640 1 --2- 172.21.15.12:0/1439546241 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b41d1fe00 0x558b41d3e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.482+0000 7f6602800640 1 -- 172.21.15.12:0/1439546241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b41d3f480 con 0x558b41d2a6c0 2024-09-05T01:24:05.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.482+0000 7f6601e00640 1 --2- 172.21.15.12:0/1439546241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b41d1f4e0 0x558b41d453e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:05.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.482+0000 7f6602800640 1 --2- 172.21.15.12:0/1439546241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d2a6c0 0x558b41d3ec50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f65fc01c830 tx=0x7f65fc011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f918e1c9bce5a9b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:05.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.482+0000 7f65e7e00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:24:05.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.482+0000 7f65e7e00640 1 -- 172.21.15.12:0/1439546241 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65fc034020 con 0x558b41d2a6c0 2024-09-05T01:24:05.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.483+0000 7f65e7e00640 1 -- 172.21.15.12:0/1439546241 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f65fc01c990 con 0x558b41d2a6c0 2024-09-05T01:24:05.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.483+0000 7f660bc4c740 1 -- 172.21.15.12:0/1439546241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65fc011c50 con 0x558b41d2a6c0 2024-09-05T01:24:05.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.483+0000 7f65e7e00640 1 -- 172.21.15.12:0/1439546241 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f65fc03f050 con 0x558b41d2a6c0 2024-09-05T01:24:05.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.483+0000 7f660bc4c740 10 client.14973 fetch_fsmap learned FSMap version 27 2024-09-05T01:24:05.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.483+0000 7f660bc4c740 1 -- 172.21.15.12:0/1439546241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558b41da5cf0 con 0x558b41d2a6c0 2024-09-05T01:24:05.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.483+0000 7f65e7e00640 1 -- 172.21.15.12:0/1439546241 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65fc011c50 con 0x558b41d2a6c0 2024-09-05T01:24:05.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.483+0000 7f65e7e00640 1 -- 172.21.15.12:0/1439546241 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f65fc02f030 con 0x558b41d2a6c0 2024-09-05T01:24:05.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.483+0000 7f660bc4c740 10 client.14973 fetch_fsmap finished waiting for FSMap version 27 2024-09-05T01:24:05.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.483+0000 7f660bc4c740 10 client.14973 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-05T01:24:05.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.483+0000 7f660bc4c740 20 client.14973 populate_metadata read hostname 'smithi012' 2024-09-05T01:24:05.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.483+0000 7f660bc4c740 1 --2- 172.21.15.12:0/1439546241 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558b41daa0c0 0x558b41da8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:05.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.483+0000 7f660bc4c740 4 client.14973 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T01:24:05.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.483+0000 7f660bc4c740 1 -- 172.21.15.12:0/1439546241 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "status"}) -- 0x558b41c8cb30 con 0x558b41daa0c0 2024-09-05T01:24:05.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.484+0000 7f6601e00640 1 --2- 172.21.15.12:0/1439546241 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558b41daa0c0 0x558b41da8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:05.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.484+0000 7f6601e00640 1 --2- 172.21.15.12:0/1439546241 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558b41daa0c0 0x558b41da8dd0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f9b5a2fa20f03f3 server_cookie=f031839e44adefd5 in_seq=0 out_seq=0 2024-09-05T01:24:05.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.484+0000 7f65e7e00640 10 client.14973 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:24:05.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.485+0000 7f65e7e00640 1 -- 172.21.15.12:0/1439546241 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x558b41c8cb30 con 0x558b41daa0c0 2024-09-05T01:24:05.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.485+0000 7f65e7e00640 10 client.14973 handle_command_reply: tid=0 2024-09-05T01:24:05.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.485+0000 7f660bc4c740 1 client.14973 shutdown 2024-09-05T01:24:05.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.485+0000 7f660bc4c740 1 -- 172.21.15.12:0/1439546241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d2a6c0 msgr2=0x558b41d3ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:05.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.485+0000 7f660bc4c740 1 --2- 172.21.15.12:0/1439546241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d2a6c0 0x558b41d3ec50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f65fc01c830 tx=0x7f65fc011b30 comp rx=0 tx=0).stop 2024-09-05T01:24:05.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.485+0000 7f660bc4c740 1 -- 172.21.15.12:0/1439546241 shutdown_connections 2024-09-05T01:24:05.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.485+0000 7f660bc4c740 1 --2- 172.21.15.12:0/1439546241 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558b41daa0c0 0x558b41da8dd0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.485+0000 7f660bc4c740 1 --2- 172.21.15.12:0/1439546241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b41d2a6c0 0x558b41d3ec50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.485+0000 7f660bc4c740 1 --2- 172.21.15.12:0/1439546241 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b41d1fe00 0x558b41d3e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.485+0000 7f660bc4c740 1 --2- 172.21.15.12:0/1439546241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b41d1f4e0 0x558b41d453e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.485+0000 7f65e7e00640 0 client.14973 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:24:05.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.485+0000 7f660bc4c740 1 -- 172.21.15.12:0/1439546241 >> 172.21.15.12:0/1439546241 conn(0x558b41d1ba70 msgr2=0x558b41d1a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:05.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.485+0000 7f660bc4c740 1 -- 172.21.15.12:0/1439546241 shutdown_connections 2024-09-05T01:24:05.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.485+0000 7f660bc4c740 1 -- 172.21.15.12:0/1439546241 wait complete. 2024-09-05T01:24:05.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.485+0000 7f660bc4c740 20 client.14973 trim_cache size 0 max 16384 2024-09-05T01:24:05.491 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:24:05.491 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "0d44cd7e-6b24-11ef-bcd6-c7b262605968", 2024-09-05T01:24:05.491 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-09-05T01:24:05.492 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24560, 2024-09-05T01:24:05.492 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-05T01:24:05.492 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-05T01:24:05.492 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-05T01:24:05.492 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 89.459661808000007, 2024-09-05T01:24:05.492 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 27, 2024-09-05T01:24:05.492 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 83, 2024-09-05T01:24:05.492 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 81, 2024-09-05T01:24:05.492 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 103.122274154 2024-09-05T01:24:05.492 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:24:05.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.486+0000 7f6603200640 1 -- 172.21.15.12:0/438829070 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f65e80a2c90 msgr2=0x7f65e80a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:05.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.486+0000 7f6603200640 1 --2- 172.21.15.12:0/438829070 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f65e80a2c90 0x7f65e80a5150 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f65f40096c0 tx=0x7f65f40058d0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.486+0000 7f6603200640 1 -- 172.21.15.12:0/438829070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66041047e0 msgr2=0x7f660419a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:05.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.486+0000 7f6603200640 1 --2- 172.21.15.12:0/438829070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66041047e0 0x7f660419a9a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f65ec00e9f0 tx=0x7f65ec00eeb0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.486+0000 7f6603200640 1 -- 172.21.15.12:0/438829070 shutdown_connections 2024-09-05T01:24:05.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.486+0000 7f6603200640 1 --2- 172.21.15.12:0/438829070 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f65e80a2c90 0x7f65e80a5150 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.486+0000 7f6603200640 1 --2- 172.21.15.12:0/438829070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6604108f60 0x7f660419ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.486+0000 7f6603200640 1 --2- 172.21.15.12:0/438829070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66041047e0 0x7f660419a9a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.486+0000 7f6603200640 1 --2- 172.21.15.12:0/438829070 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6604103e30 0x7f660419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:05.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.486+0000 7f6603200640 1 -- 172.21.15.12:0/438829070 >> 172.21.15.12:0/438829070 conn(0x7f66040ff910 msgr2=0x7f6604100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:05.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.486+0000 7f6603200640 1 -- 172.21.15.12:0/438829070 shutdown_connections 2024-09-05T01:24:05.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:05.486+0000 7f6603200640 1 -- 172.21.15.12:0/438829070 wait complete. 2024-09-05T01:24:06.188 INFO:tasks.cephadm:Setup complete, yielding 2024-09-05T01:24:06.188 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-05T01:24:06.202 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi012.front.sepia.ceph.com 2024-09-05T01:24:06.202 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- bash -c 'ceph orch status' 2024-09-05T01:24:06.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:06 smithi012 ceph-mon[29942]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-09-05T01:24:06.581 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:24:06.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:06 smithi145 ceph-mon[34376]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-09-05T01:24:06.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:06 smithi151 ceph-mon[35013]: pgmap v335: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-09-05T01:24:07.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.133+0000 7f2d8ee00640 1 -- 172.21.15.12:0/4064551793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d88076ba0 msgr2=0x7f2d88076fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:07.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.133+0000 7f2d8ee00640 1 --2- 172.21.15.12:0/4064551793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d88076ba0 0x7f2d88076fa0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c009900 tx=0x7f2d7c02a3f0 comp rx=0 tx=0).stop 2024-09-05T01:24:07.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.133+0000 7f2d8ee00640 1 -- 172.21.15.12:0/4064551793 shutdown_connections 2024-09-05T01:24:07.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.133+0000 7f2d8ee00640 1 --2- 172.21.15.12:0/4064551793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d88078790 0x7f2d88079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:07.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.133+0000 7f2d8ee00640 1 --2- 172.21.15.12:0/4064551793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d88077df0 0x7f2d88078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:07.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.133+0000 7f2d8ee00640 1 --2- 172.21.15.12:0/4064551793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d88076ba0 0x7f2d88076fa0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:07.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.133+0000 7f2d8ee00640 1 -- 172.21.15.12:0/4064551793 >> 172.21.15.12:0/4064551793 conn(0x7f2d880ff3d0 msgr2=0x7f2d88101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:07.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.133+0000 7f2d8ee00640 1 -- 172.21.15.12:0/4064551793 shutdown_connections 2024-09-05T01:24:07.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.133+0000 7f2d8ee00640 1 -- 172.21.15.12:0/4064551793 wait complete. 2024-09-05T01:24:07.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.134+0000 7f2d8ee00640 1 Processor -- start 2024-09-05T01:24:07.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.134+0000 7f2d8ee00640 1 -- start start 2024-09-05T01:24:07.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.135+0000 7f2d8ee00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d88076ba0 0x7f2d8819e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:07.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.135+0000 7f2d8ee00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d88077df0 0x7f2d8819e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:07.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.135+0000 7f2d8ee00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d88078790 0x7f2d881a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:07.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.135+0000 7f2d8ee00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2d88113d50 con 0x7f2d88076ba0 2024-09-05T01:24:07.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.135+0000 7f2d8ee00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2d88113bd0 con 0x7f2d88078790 2024-09-05T01:24:07.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.135+0000 7f2d8ee00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2d88113ed0 con 0x7f2d88077df0 2024-09-05T01:24:07.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.135+0000 7f2d8da00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d88076ba0 0x7f2d8819e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:07.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.135+0000 7f2d8da00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d88076ba0 0x7f2d8819e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60074/0 (socket says 172.21.15.12:60074) 2024-09-05T01:24:07.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.135+0000 7f2d8da00640 1 -- 172.21.15.12:0/2326417193 learned_addr learned my addr 172.21.15.12:0/2326417193 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:07.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.135+0000 7f2d8d000640 1 --2- 172.21.15.12:0/2326417193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d88077df0 0x7f2d8819e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:07.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.136+0000 7f2d8e400640 1 --2- 172.21.15.12:0/2326417193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d88078790 0x7f2d881a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:07.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.136+0000 7f2d8da00640 1 -- 172.21.15.12:0/2326417193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d88077df0 msgr2=0x7f2d8819e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:07.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.136+0000 7f2d8da00640 1 --2- 172.21.15.12:0/2326417193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d88077df0 0x7f2d8819e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:07.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.136+0000 7f2d8da00640 1 -- 172.21.15.12:0/2326417193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d88078790 msgr2=0x7f2d881a58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:07.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.136+0000 7f2d8da00640 1 --2- 172.21.15.12:0/2326417193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d88078790 0x7f2d881a58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:07.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.136+0000 7f2d8da00640 1 -- 172.21.15.12:0/2326417193 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d881a5f20 con 0x7f2d88076ba0 2024-09-05T01:24:07.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.136+0000 7f2d8e400640 1 --2- 172.21.15.12:0/2326417193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d88078790 0x7f2d881a58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:24:07.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.136+0000 7f2d8da00640 1 --2- 172.21.15.12:0/2326417193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d88076ba0 0x7f2d8819e2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c031440 tx=0x7f2d7c032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:07.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.136+0000 7f2d86000640 1 -- 172.21.15.12:0/2326417193 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c03f030 con 0x7f2d88076ba0 2024-09-05T01:24:07.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.136+0000 7f2d86000640 1 -- 172.21.15.12:0/2326417193 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d7c003ce0 con 0x7f2d88076ba0 2024-09-05T01:24:07.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.136+0000 7f2d86000640 1 -- 172.21.15.12:0/2326417193 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c035070 con 0x7f2d88076ba0 2024-09-05T01:24:07.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.136+0000 7f2d8ee00640 1 -- 172.21.15.12:0/2326417193 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d881a61b0 con 0x7f2d88076ba0 2024-09-05T01:24:07.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.137+0000 7f2d8ee00640 1 -- 172.21.15.12:0/2326417193 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d881a6640 con 0x7f2d88076ba0 2024-09-05T01:24:07.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.138+0000 7f2d8ee00640 1 -- 172.21.15.12:0/2326417193 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d881105c0 con 0x7f2d88076ba0 2024-09-05T01:24:07.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.139+0000 7f2d86000640 1 -- 172.21.15.12:0/2326417193 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2d7c042030 con 0x7f2d88076ba0 2024-09-05T01:24:07.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.141+0000 7f2d86000640 1 --2- 172.21.15.12:0/2326417193 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f2d700a2cc0 0x7f2d700a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:07.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.141+0000 7f2d86000640 1 -- 172.21.15.12:0/2326417193 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f2d7c0ef800 con 0x7f2d88076ba0 2024-09-05T01:24:07.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.141+0000 7f2d8d000640 1 --2- 172.21.15.12:0/2326417193 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f2d700a2cc0 0x7f2d700a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:07.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.142+0000 7f2d8d000640 1 --2- 172.21.15.12:0/2326417193 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f2d700a2cc0 0x7f2d700a5180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2d8819f810 tx=0x7f2d7400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:07.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.145+0000 7f2d86000640 1 -- 172.21.15.12:0/2326417193 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2d7c0bc590 con 0x7f2d88076ba0 2024-09-05T01:24:07.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.349+0000 7f2d8ee00640 1 -- 172.21.15.12:0/2326417193 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f2d88062630 con 0x7f2d700a2cc0 2024-09-05T01:24:07.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.350+0000 7f2d86000640 1 -- 172.21.15.12:0/2326417193 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f2d88062630 con 0x7f2d700a2cc0 2024-09-05T01:24:07.351 INFO:teuthology.orchestra.run.smithi012.stdout:Backend: cephadm 2024-09-05T01:24:07.352 INFO:teuthology.orchestra.run.smithi012.stdout:Available: Yes 2024-09-05T01:24:07.352 INFO:teuthology.orchestra.run.smithi012.stdout:Paused: No 2024-09-05T01:24:07.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.353+0000 7f2d8ee00640 1 -- 172.21.15.12:0/2326417193 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f2d700a2cc0 msgr2=0x7f2d700a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:07.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.353+0000 7f2d8ee00640 1 --2- 172.21.15.12:0/2326417193 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f2d700a2cc0 0x7f2d700a5180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2d8819f810 tx=0x7f2d7400b390 comp rx=0 tx=0).stop 2024-09-05T01:24:07.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.353+0000 7f2d8ee00640 1 -- 172.21.15.12:0/2326417193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d88076ba0 msgr2=0x7f2d8819e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:07.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.353+0000 7f2d8ee00640 1 --2- 172.21.15.12:0/2326417193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d88076ba0 0x7f2d8819e2f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c031440 tx=0x7f2d7c032e20 comp rx=0 tx=0).stop 2024-09-05T01:24:07.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.353+0000 7f2d8ee00640 1 -- 172.21.15.12:0/2326417193 shutdown_connections 2024-09-05T01:24:07.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.353+0000 7f2d8ee00640 1 --2- 172.21.15.12:0/2326417193 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f2d700a2cc0 0x7f2d700a5180 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:07.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.353+0000 7f2d8ee00640 1 --2- 172.21.15.12:0/2326417193 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2d88078790 0x7f2d881a58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:07.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.353+0000 7f2d8ee00640 1 --2- 172.21.15.12:0/2326417193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d88077df0 0x7f2d8819e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:07.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.353+0000 7f2d8ee00640 1 --2- 172.21.15.12:0/2326417193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d88076ba0 0x7f2d8819e2f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:07.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.353+0000 7f2d8ee00640 1 -- 172.21.15.12:0/2326417193 >> 172.21.15.12:0/2326417193 conn(0x7f2d880ff3d0 msgr2=0x7f2d88100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:07.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.353+0000 7f2d8ee00640 1 -- 172.21.15.12:0/2326417193 shutdown_connections 2024-09-05T01:24:07.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:07.353+0000 7f2d8ee00640 1 -- 172.21.15.12:0/2326417193 wait complete. 2024-09-05T01:24:07.927 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-05T01:24:08.310 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:24:08.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:08 smithi012 ceph-mon[29942]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:08.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:08 smithi012 ceph-mon[29942]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-05T01:24:08.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:08 smithi145 ceph-mon[34376]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:08.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:08 smithi145 ceph-mon[34376]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-05T01:24:08.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:08 smithi151 ceph-mon[35013]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:08.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:08 smithi151 ceph-mon[35013]: pgmap v336: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-05T01:24:08.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.883+0000 7fbbf0e00640 1 -- 172.21.15.12:0/2488012258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec1035e0 msgr2=0x7fbbec109e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:08.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.883+0000 7fbbf0e00640 1 --2- 172.21.15.12:0/2488012258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec1035e0 0x7fbbec109e70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009ca0 tx=0x7fbbe402a8c0 comp rx=0 tx=0).stop 2024-09-05T01:24:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.883+0000 7fbbf0e00640 1 -- 172.21.15.12:0/2488012258 shutdown_connections 2024-09-05T01:24:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.883+0000 7fbbf0e00640 1 --2- 172.21.15.12:0/2488012258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec1035e0 0x7fbbec109e70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.883+0000 7fbbf0e00640 1 --2- 172.21.15.12:0/2488012258 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbec102c20 0x7fbbec1030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.883+0000 7fbbf0e00640 1 --2- 172.21.15.12:0/2488012258 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbec101a20 0x7fbbec101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.883+0000 7fbbf0e00640 1 -- 172.21.15.12:0/2488012258 >> 172.21.15.12:0/2488012258 conn(0x7fbbec0fd1d0 msgr2=0x7fbbec0ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.883+0000 7fbbf0e00640 1 -- 172.21.15.12:0/2488012258 shutdown_connections 2024-09-05T01:24:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.883+0000 7fbbf0e00640 1 -- 172.21.15.12:0/2488012258 wait complete. 2024-09-05T01:24:08.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.884+0000 7fbbf0e00640 1 Processor -- start 2024-09-05T01:24:08.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.884+0000 7fbbf0e00640 1 -- start start 2024-09-05T01:24:08.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.884+0000 7fbbf0e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbec101a20 0x7fbbec075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:08.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.884+0000 7fbbf0e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec102c20 0x7fbbec0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:08.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.884+0000 7fbbf0e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbec1035e0 0x7fbbec074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:08.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.884+0000 7fbbf0e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec10d6f0 con 0x7fbbec102c20 2024-09-05T01:24:08.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.884+0000 7fbbf0e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec10d570 con 0x7fbbec101a20 2024-09-05T01:24:08.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.884+0000 7fbbf0e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec10d870 con 0x7fbbec1035e0 2024-09-05T01:24:08.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.885+0000 7fbbeaa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec102c20 0x7fbbec0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:08.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.885+0000 7fbbeb400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbec101a20 0x7fbbec075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:08.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.885+0000 7fbbeaa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec102c20 0x7fbbec0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60084/0 (socket says 172.21.15.12:60084) 2024-09-05T01:24:08.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.885+0000 7fbbebe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbec1035e0 0x7fbbec074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:08.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.885+0000 7fbbeaa00640 1 -- 172.21.15.12:0/2834831948 learned_addr learned my addr 172.21.15.12:0/2834831948 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:08.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.885+0000 7fbbeb400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbec101a20 0x7fbbec075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:55278/0 (socket says 172.21.15.12:55278) 2024-09-05T01:24:08.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.885+0000 7fbbebe00640 1 -- 172.21.15.12:0/2834831948 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbec101a20 msgr2=0x7fbbec075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:08.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.885+0000 7fbbebe00640 1 --2- 172.21.15.12:0/2834831948 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbec101a20 0x7fbbec075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:08.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.885+0000 7fbbebe00640 1 -- 172.21.15.12:0/2834831948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec102c20 msgr2=0x7fbbec0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:08.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.885+0000 7fbbebe00640 1 --2- 172.21.15.12:0/2834831948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec102c20 0x7fbbec0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:08.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.885+0000 7fbbebe00640 1 -- 172.21.15.12:0/2834831948 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbec0753e0 con 0x7fbbec1035e0 2024-09-05T01:24:08.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.885+0000 7fbbeaa00640 1 --2- 172.21.15.12:0/2834831948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec102c20 0x7fbbec0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:08.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.886+0000 7fbbebe00640 1 --2- 172.21.15.12:0/2834831948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbec1035e0 0x7fbbec074b20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4031ae0 tx=0x7fbbe4031750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:08.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.886+0000 7fbbe3e00640 1 -- 172.21.15.12:0/2834831948 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4003b70 con 0x7fbbec1035e0 2024-09-05T01:24:08.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.886+0000 7fbbe3e00640 1 -- 172.21.15.12:0/2834831948 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbbe4003d10 con 0x7fbbec1035e0 2024-09-05T01:24:08.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.886+0000 7fbbe3e00640 1 -- 172.21.15.12:0/2834831948 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe402fb10 con 0x7fbbec1035e0 2024-09-05T01:24:08.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.886+0000 7fbbf0e00640 1 -- 172.21.15.12:0/2834831948 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbec1a1e20 con 0x7fbbec1035e0 2024-09-05T01:24:08.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.886+0000 7fbbf0e00640 1 -- 172.21.15.12:0/2834831948 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbec1a22d0 con 0x7fbbec1035e0 2024-09-05T01:24:08.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.887+0000 7fbbf0e00640 1 -- 172.21.15.12:0/2834831948 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbec108e20 con 0x7fbbec1035e0 2024-09-05T01:24:08.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.889+0000 7fbbe3e00640 1 -- 172.21.15.12:0/2834831948 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbbe402fcb0 con 0x7fbbec1035e0 2024-09-05T01:24:08.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.891+0000 7fbbe3e00640 1 --2- 172.21.15.12:0/2834831948 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fbbd00a2c10 0x7fbbd00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:08.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.891+0000 7fbbe3e00640 1 -- 172.21.15.12:0/2834831948 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7fbbe40f0560 con 0x7fbbec1035e0 2024-09-05T01:24:08.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.891+0000 7fbbeb400640 1 --2- 172.21.15.12:0/2834831948 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fbbd00a2c10 0x7fbbd00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:08.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.891+0000 7fbbeb400640 1 --2- 172.21.15.12:0/2834831948 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fbbd00a2c10 0x7fbbd00a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbbec102a80 tx=0x7fbbdc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:08.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:08.893+0000 7fbbe3e00640 1 -- 172.21.15.12:0/2834831948 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbbe40bd490 con 0x7fbbec1035e0 2024-09-05T01:24:09.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:09.087+0000 7fbbf0e00640 1 -- 172.21.15.12:0/2834831948 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fbbec062630 con 0x7fbbd00a2c10 2024-09-05T01:24:09.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:09.100+0000 7fbbe3e00640 1 -- 172.21.15.12:0/2834831948 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7fbbec062630 con 0x7fbbd00a2c10 2024-09-05T01:24:09.101 INFO:teuthology.orchestra.run.smithi012.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-05T01:24:09.101 INFO:teuthology.orchestra.run.smithi012.stdout:mds.a smithi012 running (110s) 25s ago 109s 15.1M - 19.1.1-259-g91c8a7e5 77770cf7e895 438915eed20d 2024-09-05T01:24:09.101 INFO:teuthology.orchestra.run.smithi012.stdout:mds.b smithi145 running (107s) 39s ago 106s 26.4M - 19.1.1-259-g91c8a7e5 77770cf7e895 6163f51c3a25 2024-09-05T01:24:09.101 INFO:teuthology.orchestra.run.smithi012.stdout:mds.c smithi151 running (2m) 39s ago 2m 17.7M - 19.1.1-259-g91c8a7e5 77770cf7e895 9209fcf9f501 2024-09-05T01:24:09.101 INFO:teuthology.orchestra.run.smithi012.stdout:mds.d smithi012 running (2m) 25s ago 2m 12.7M - 19.1.1-259-g91c8a7e5 77770cf7e895 aa64d64fa9db 2024-09-05T01:24:09.102 INFO:teuthology.orchestra.run.smithi012.stdout:mds.e smithi145 running (2m) 39s ago 2m 16.7M - 19.1.1-259-g91c8a7e5 77770cf7e895 bdcecdf76fa2 2024-09-05T01:24:09.102 INFO:teuthology.orchestra.run.smithi012.stdout:mds.f smithi151 running (2m) 39s ago 2m 20.4M - 19.1.1-259-g91c8a7e5 77770cf7e895 547cb7b9ff22 2024-09-05T01:24:09.102 INFO:teuthology.orchestra.run.smithi012.stdout:mds.g smithi012 running (113s) 25s ago 113s 12.7M - 19.1.1-259-g91c8a7e5 77770cf7e895 a364cf5ba047 2024-09-05T01:24:09.102 INFO:teuthology.orchestra.run.smithi012.stdout:mds.h smithi145 running (119s) 39s ago 119s 16.7M - 19.1.1-259-g91c8a7e5 77770cf7e895 9eafb7270637 2024-09-05T01:24:09.102 INFO:teuthology.orchestra.run.smithi012.stdout:mds.i smithi151 running (117s) 39s ago 117s 17.9M - 19.1.1-259-g91c8a7e5 77770cf7e895 6f3865ede795 2024-09-05T01:24:09.102 INFO:teuthology.orchestra.run.smithi012.stdout:mds.j smithi012 running (2m) 25s ago 2m 15.2M - 19.1.1-259-g91c8a7e5 77770cf7e895 f40bb22e13e1 2024-09-05T01:24:09.102 INFO:teuthology.orchestra.run.smithi012.stdout:mds.k smithi145 running (2m) 39s ago 2m 16.9M - 19.1.1-259-g91c8a7e5 77770cf7e895 0809dfc6ee30 2024-09-05T01:24:09.102 INFO:teuthology.orchestra.run.smithi012.stdout:mds.l smithi151 running (2m) 39s ago 2m 17.9M - 19.1.1-259-g91c8a7e5 77770cf7e895 fd55372d0e46 2024-09-05T01:24:09.103 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.x smithi012 *:9283,8765 running (9m) 25s ago 9m 508M - 19.1.1-259-g91c8a7e5 77770cf7e895 2b85e24fdb24 2024-09-05T01:24:09.103 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.y smithi145 *:8443,8765 running (7m) 39s ago 7m 442M - 19.1.1-259-g91c8a7e5 77770cf7e895 0007f54337ed 2024-09-05T01:24:09.103 INFO:teuthology.orchestra.run.smithi012.stdout:mgr.z smithi151 *:8443,8765 running (7m) 39s ago 7m 443M - 19.1.1-259-g91c8a7e5 77770cf7e895 075d33658ae8 2024-09-05T01:24:09.103 INFO:teuthology.orchestra.run.smithi012.stdout:mon.a smithi012 running (9m) 25s ago 9m 48.5M 2048M 19.1.1-259-g91c8a7e5 77770cf7e895 2b0036d96b7c 2024-09-05T01:24:09.103 INFO:teuthology.orchestra.run.smithi012.stdout:mon.b smithi145 running (7m) 39s ago 7m 41.7M 2048M 19.1.1-259-g91c8a7e5 77770cf7e895 9fe420c2f8a5 2024-09-05T01:24:09.103 INFO:teuthology.orchestra.run.smithi012.stdout:mon.c smithi151 running (8m) 39s ago 8m 41.6M 2048M 19.1.1-259-g91c8a7e5 77770cf7e895 28c7935e5f5c 2024-09-05T01:24:09.103 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 smithi012 running (7m) 25s ago 7m 54.6M 4273M 19.1.1-259-g91c8a7e5 77770cf7e895 0c25f19fab14 2024-09-05T01:24:09.104 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 smithi145 running (6m) 39s ago 6m 58.7M 4272M 19.1.1-259-g91c8a7e5 77770cf7e895 a46b5aeefb54 2024-09-05T01:24:09.104 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 smithi151 running (6m) 39s ago 6m 50.0M 4272M 19.1.1-259-g91c8a7e5 77770cf7e895 fbf38a77de19 2024-09-05T01:24:09.104 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 smithi012 running (6m) 25s ago 6m 45.0M 4273M 19.1.1-259-g91c8a7e5 77770cf7e895 cdc1450fd394 2024-09-05T01:24:09.104 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 smithi145 running (5m) 39s ago 5m 45.5M 4272M 19.1.1-259-g91c8a7e5 77770cf7e895 6f164d50ee15 2024-09-05T01:24:09.104 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 smithi151 running (5m) 39s ago 5m 46.3M 4272M 19.1.1-259-g91c8a7e5 77770cf7e895 b377bb0c1b54 2024-09-05T01:24:09.104 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 smithi012 running (4m) 25s ago 4m 50.1M 4273M 19.1.1-259-g91c8a7e5 77770cf7e895 1a8f7d749e69 2024-09-05T01:24:09.104 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 smithi145 running (4m) 39s ago 4m 48.3M 4272M 19.1.1-259-g91c8a7e5 77770cf7e895 b87719763462 2024-09-05T01:24:09.104 INFO:teuthology.orchestra.run.smithi012.stdout:osd.8 smithi151 running (3m) 39s ago 3m 54.3M 4272M 19.1.1-259-g91c8a7e5 77770cf7e895 d23737e9f63e 2024-09-05T01:24:09.104 INFO:teuthology.orchestra.run.smithi012.stdout:osd.9 smithi012 running (3m) 25s ago 3m 50.7M 4273M 19.1.1-259-g91c8a7e5 77770cf7e895 861c84b917b2 2024-09-05T01:24:09.104 INFO:teuthology.orchestra.run.smithi012.stdout:osd.10 smithi145 running (3m) 39s ago 3m 55.7M 4272M 19.1.1-259-g91c8a7e5 77770cf7e895 8db2d34d1030 2024-09-05T01:24:09.104 INFO:teuthology.orchestra.run.smithi012.stdout:osd.11 smithi151 running (2m) 39s ago 2m 43.4M 4272M 19.1.1-259-g91c8a7e5 77770cf7e895 460e3b3eba0b 2024-09-05T01:24:09.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:09.102+0000 7fbbf0e00640 1 -- 172.21.15.12:0/2834831948 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fbbd00a2c10 msgr2=0x7fbbd00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:09.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:09.102+0000 7fbbf0e00640 1 --2- 172.21.15.12:0/2834831948 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fbbd00a2c10 0x7fbbd00a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbbec102a80 tx=0x7fbbdc005f90 comp rx=0 tx=0).stop 2024-09-05T01:24:09.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:09.102+0000 7fbbf0e00640 1 -- 172.21.15.12:0/2834831948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbec1035e0 msgr2=0x7fbbec074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:09.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:09.102+0000 7fbbf0e00640 1 --2- 172.21.15.12:0/2834831948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbec1035e0 0x7fbbec074b20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4031ae0 tx=0x7fbbe4031750 comp rx=0 tx=0).stop 2024-09-05T01:24:09.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:09.102+0000 7fbbf0e00640 1 -- 172.21.15.12:0/2834831948 shutdown_connections 2024-09-05T01:24:09.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:09.102+0000 7fbbf0e00640 1 --2- 172.21.15.12:0/2834831948 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fbbd00a2c10 0x7fbbd00a50d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:09.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:09.102+0000 7fbbf0e00640 1 --2- 172.21.15.12:0/2834831948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbec1035e0 0x7fbbec074b20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:09.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:09.102+0000 7fbbf0e00640 1 --2- 172.21.15.12:0/2834831948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbec102c20 0x7fbbec0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:09.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:09.102+0000 7fbbf0e00640 1 --2- 172.21.15.12:0/2834831948 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbbec101a20 0x7fbbec075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:09.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:09.102+0000 7fbbf0e00640 1 -- 172.21.15.12:0/2834831948 >> 172.21.15.12:0/2834831948 conn(0x7fbbec0fd1d0 msgr2=0x7fbbec105ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:09.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:09.102+0000 7fbbf0e00640 1 -- 172.21.15.12:0/2834831948 shutdown_connections 2024-09-05T01:24:09.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:09.102+0000 7fbbf0e00640 1 -- 172.21.15.12:0/2834831948 wait complete. 2024-09-05T01:24:09.471 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:09 smithi012 ceph-mon[29942]: from='client.24994 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:09.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:09 smithi145 ceph-mon[34376]: from='client.24994 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:09.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:09 smithi151 ceph-mon[35013]: from='client.24994 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:09.863 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-05T01:24:10.259 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:24:10.400 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:10 smithi012 ceph-mon[29942]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-05T01:24:10.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:10 smithi145 ceph-mon[34376]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-05T01:24:10.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:10 smithi151 ceph-mon[35013]: pgmap v337: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-05T01:24:10.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.885+0000 7f9dab200640 1 -- 172.21.15.12:0/3600103289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9da41024e0 msgr2=0x7f9da41048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:10.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.885+0000 7f9dab200640 1 --2- 172.21.15.12:0/3600103289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9da41024e0 0x7f9da41048d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9d98009900 tx=0x7f9d9802a410 comp rx=0 tx=0).stop 2024-09-05T01:24:10.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.885+0000 7f9dab200640 1 -- 172.21.15.12:0/3600103289 shutdown_connections 2024-09-05T01:24:10.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.885+0000 7f9dab200640 1 --2- 172.21.15.12:0/3600103289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9da4107740 0x7f9da4109b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:10.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.885+0000 7f9dab200640 1 --2- 172.21.15.12:0/3600103289 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9da4104e10 0x7f9da4107200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:10.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.885+0000 7f9dab200640 1 --2- 172.21.15.12:0/3600103289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9da41024e0 0x7f9da41048d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:10.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.885+0000 7f9dab200640 1 -- 172.21.15.12:0/3600103289 >> 172.21.15.12:0/3600103289 conn(0x7f9da40fc0e0 msgr2=0x7f9da40fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:10.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.885+0000 7f9dab200640 1 -- 172.21.15.12:0/3600103289 shutdown_connections 2024-09-05T01:24:10.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.885+0000 7f9dab200640 1 -- 172.21.15.12:0/3600103289 wait complete. 2024-09-05T01:24:10.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.886+0000 7f9dab200640 1 Processor -- start 2024-09-05T01:24:10.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.886+0000 7f9dab200640 1 -- start start 2024-09-05T01:24:10.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.887+0000 7f9dab200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9da41024e0 0x7f9da419a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:10.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.887+0000 7f9dab200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9da4104e10 0x7f9da419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:10.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.887+0000 7f9dab200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9da4107740 0x7f9da41a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:10.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.887+0000 7f9dab200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9da410d710 con 0x7f9da41024e0 2024-09-05T01:24:10.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.887+0000 7f9dab200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9da410d590 con 0x7f9da4104e10 2024-09-05T01:24:10.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.887+0000 7f9dab200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9da410d890 con 0x7f9da4107740 2024-09-05T01:24:10.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.887+0000 7f9da9e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9da41024e0 0x7f9da419a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:10.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.887+0000 7f9da9e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9da41024e0 0x7f9da419a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60108/0 (socket says 172.21.15.12:60108) 2024-09-05T01:24:10.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.887+0000 7f9da9e00640 1 -- 172.21.15.12:0/234146965 learned_addr learned my addr 172.21.15.12:0/234146965 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:10.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.887+0000 7f9daa800640 1 --2- 172.21.15.12:0/234146965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9da4107740 0x7f9da41a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:10.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.887+0000 7f9da9400640 1 --2- 172.21.15.12:0/234146965 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9da4104e10 0x7f9da419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:10.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.887+0000 7f9da9e00640 1 -- 172.21.15.12:0/234146965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9da4107740 msgr2=0x7f9da41a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:10.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.887+0000 7f9da9e00640 1 --2- 172.21.15.12:0/234146965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9da4107740 0x7f9da41a15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:10.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.887+0000 7f9da9e00640 1 -- 172.21.15.12:0/234146965 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9da4104e10 msgr2=0x7f9da419a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:10.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.887+0000 7f9da9e00640 1 --2- 172.21.15.12:0/234146965 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9da4104e10 0x7f9da419a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:10.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.888+0000 7f9da9e00640 1 -- 172.21.15.12:0/234146965 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da41a1c30 con 0x7f9da41024e0 2024-09-05T01:24:10.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.888+0000 7f9da9e00640 1 --2- 172.21.15.12:0/234146965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9da41024e0 0x7f9da419a000 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9d98005940 tx=0x7f9d980042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:10.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.888+0000 7f9d9ea00640 1 -- 172.21.15.12:0/234146965 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9803f030 con 0x7f9da41024e0 2024-09-05T01:24:10.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.888+0000 7f9dab200640 1 -- 172.21.15.12:0/234146965 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9da41a1ec0 con 0x7f9da41024e0 2024-09-05T01:24:10.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.888+0000 7f9d9ea00640 1 -- 172.21.15.12:0/234146965 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d98003ce0 con 0x7f9da41024e0 2024-09-05T01:24:10.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.888+0000 7f9d9ea00640 1 -- 172.21.15.12:0/234146965 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d98035070 con 0x7f9da41024e0 2024-09-05T01:24:10.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.888+0000 7f9dab200640 1 -- 172.21.15.12:0/234146965 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9da41a2310 con 0x7f9da41024e0 2024-09-05T01:24:10.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.890+0000 7f9dab200640 1 -- 172.21.15.12:0/234146965 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9da4109290 con 0x7f9da41024e0 2024-09-05T01:24:10.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.891+0000 7f9d9ea00640 1 -- 172.21.15.12:0/234146965 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9d98042030 con 0x7f9da41024e0 2024-09-05T01:24:10.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.893+0000 7f9d9ea00640 1 --2- 172.21.15.12:0/234146965 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f9d8c0a2cc0 0x7f9d8c0a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:10.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.893+0000 7f9d9ea00640 1 -- 172.21.15.12:0/234146965 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f9d980ef220 con 0x7f9da41024e0 2024-09-05T01:24:10.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.893+0000 7f9da9400640 1 --2- 172.21.15.12:0/234146965 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f9d8c0a2cc0 0x7f9d8c0a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:10.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.893+0000 7f9da9400640 1 --2- 172.21.15.12:0/234146965 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f9d8c0a2cc0 0x7f9d8c0a5180 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9d940095f0 tx=0x7f9d94005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:10.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:10.897+0000 7f9d9ea00640 1 -- 172.21.15.12:0/234146965 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9d980bb960 con 0x7f9da41024e0 2024-09-05T01:24:11.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:11.093+0000 7f9dab200640 1 -- 172.21.15.12:0/234146965 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f9da4062630 con 0x7f9d8c0a2cc0 2024-09-05T01:24:11.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:11.098+0000 7f9d9ea00640 1 -- 172.21.15.12:0/234146965 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f9da4062630 con 0x7f9d8c0a2cc0 2024-09-05T01:24:11.099 INFO:teuthology.orchestra.run.smithi012.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-05T01:24:11.100 INFO:teuthology.orchestra.run.smithi012.stdout:mds.all 12/12 41s ago 2m smithi012=a;smithi012=d;smithi012=g;smithi012=j;smithi145=b;smithi145=e;smithi145=h;smithi145=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l;count:12 2024-09-05T01:24:11.100 INFO:teuthology.orchestra.run.smithi012.stdout:mgr 3/3 41s ago 7m smithi012=x;smithi145=y;smithi151=z;count:3 2024-09-05T01:24:11.100 INFO:teuthology.orchestra.run.smithi012.stdout:mon 3/3 41s ago 8m smithi012:172.21.15.12=a;smithi145:172.21.15.145=b;smithi151:172.21.15.151=c;count:3 2024-09-05T01:24:11.100 INFO:teuthology.orchestra.run.smithi012.stdout:osd 12 41s ago - 2024-09-05T01:24:11.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:11.100+0000 7f9dab200640 1 -- 172.21.15.12:0/234146965 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f9d8c0a2cc0 msgr2=0x7f9d8c0a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:11.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:11.100+0000 7f9dab200640 1 --2- 172.21.15.12:0/234146965 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f9d8c0a2cc0 0x7f9d8c0a5180 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9d940095f0 tx=0x7f9d94005f90 comp rx=0 tx=0).stop 2024-09-05T01:24:11.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:11.100+0000 7f9dab200640 1 -- 172.21.15.12:0/234146965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9da41024e0 msgr2=0x7f9da419a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:11.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:11.100+0000 7f9dab200640 1 --2- 172.21.15.12:0/234146965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9da41024e0 0x7f9da419a000 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9d98005940 tx=0x7f9d980042f0 comp rx=0 tx=0).stop 2024-09-05T01:24:11.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:11.101+0000 7f9dab200640 1 -- 172.21.15.12:0/234146965 shutdown_connections 2024-09-05T01:24:11.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:11.101+0000 7f9dab200640 1 --2- 172.21.15.12:0/234146965 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f9d8c0a2cc0 0x7f9d8c0a5180 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:11.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:11.101+0000 7f9dab200640 1 --2- 172.21.15.12:0/234146965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9da4107740 0x7f9da41a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:11.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:11.101+0000 7f9dab200640 1 --2- 172.21.15.12:0/234146965 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9da4104e10 0x7f9da419a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:11.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:11.101+0000 7f9dab200640 1 --2- 172.21.15.12:0/234146965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9da41024e0 0x7f9da419a000 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:11.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:11.101+0000 7f9dab200640 1 -- 172.21.15.12:0/234146965 >> 172.21.15.12:0/234146965 conn(0x7f9da40fc0e0 msgr2=0x7f9da4101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:11.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:11.101+0000 7f9dab200640 1 -- 172.21.15.12:0/234146965 shutdown_connections 2024-09-05T01:24:11.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:11.101+0000 7f9dab200640 1 -- 172.21.15.12:0/234146965 wait complete. 2024-09-05T01:24:11.480 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:11 smithi012 ceph-mon[29942]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:11.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:11 smithi145 ceph-mon[34376]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:11.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:11 smithi151 ceph-mon[35013]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:11.879 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-05T01:24:12.259 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:24:12.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:12 smithi012 ceph-mon[29942]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-05T01:24:12.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:12 smithi145 ceph-mon[34376]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-05T01:24:12.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:12 smithi151 ceph-mon[35013]: pgmap v338: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-05T01:24:12.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.848+0000 7fa2c0e00640 1 -- 172.21.15.12:0/601349960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2bc102c40 msgr2=0x7fa2bc1030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:12.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.848+0000 7fa2c0e00640 1 --2- 172.21.15.12:0/601349960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2bc102c40 0x7fa2bc1030c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8009900 tx=0x7fa2a802a410 comp rx=0 tx=0).stop 2024-09-05T01:24:12.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.848+0000 7fa2c0e00640 1 -- 172.21.15.12:0/601349960 shutdown_connections 2024-09-05T01:24:12.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.848+0000 7fa2c0e00640 1 --2- 172.21.15.12:0/601349960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2bc103600 0x7fa2bc109e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:12.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.848+0000 7fa2c0e00640 1 --2- 172.21.15.12:0/601349960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2bc102c40 0x7fa2bc1030c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:12.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.848+0000 7fa2c0e00640 1 --2- 172.21.15.12:0/601349960 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2bc101a40 0x7fa2bc101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:12.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.848+0000 7fa2c0e00640 1 -- 172.21.15.12:0/601349960 >> 172.21.15.12:0/601349960 conn(0x7fa2bc0fd1f0 msgr2=0x7fa2bc0ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:12.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.848+0000 7fa2c0e00640 1 -- 172.21.15.12:0/601349960 shutdown_connections 2024-09-05T01:24:12.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.848+0000 7fa2c0e00640 1 -- 172.21.15.12:0/601349960 wait complete. 2024-09-05T01:24:12.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.849+0000 7fa2c0e00640 1 Processor -- start 2024-09-05T01:24:12.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.850+0000 7fa2c0e00640 1 -- start start 2024-09-05T01:24:12.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.850+0000 7fa2c0e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2bc101a40 0x7fa2bc075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:12.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.850+0000 7fa2c0e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2bc102c40 0x7fa2bc0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:12.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.850+0000 7fa2c0e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2bc103600 0x7fa2bc074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:12.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.850+0000 7fa2c0e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc10d710 con 0x7fa2bc103600 2024-09-05T01:24:12.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.850+0000 7fa2c0e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc10d590 con 0x7fa2bc101a40 2024-09-05T01:24:12.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.850+0000 7fa2c0e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc10d890 con 0x7fa2bc102c40 2024-09-05T01:24:12.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.851+0000 7fa2bb400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2bc101a40 0x7fa2bc075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:12.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.851+0000 7fa2baa00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2bc102c40 0x7fa2bc0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:12.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.851+0000 7fa2bb400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2bc101a40 0x7fa2bc075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:55306/0 (socket says 172.21.15.12:55306) 2024-09-05T01:24:12.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.851+0000 7fa2bb400640 1 -- 172.21.15.12:0/3172525805 learned_addr learned my addr 172.21.15.12:0/3172525805 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:12.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.851+0000 7fa2bbe00640 1 --2- 172.21.15.12:0/3172525805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2bc103600 0x7fa2bc074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:12.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.851+0000 7fa2bb400640 1 -- 172.21.15.12:0/3172525805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2bc102c40 msgr2=0x7fa2bc0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:12.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.851+0000 7fa2bb400640 1 --2- 172.21.15.12:0/3172525805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2bc102c40 0x7fa2bc0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:12.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.851+0000 7fa2bb400640 1 -- 172.21.15.12:0/3172525805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2bc103600 msgr2=0x7fa2bc074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:12.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.851+0000 7fa2bb400640 1 --2- 172.21.15.12:0/3172525805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2bc103600 0x7fa2bc074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:12.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.851+0000 7fa2bb400640 1 -- 172.21.15.12:0/3172525805 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2bc0753e0 con 0x7fa2bc101a40 2024-09-05T01:24:12.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.851+0000 7fa2bb400640 1 --2- 172.21.15.12:0/3172525805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2bc101a40 0x7fa2bc075f90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac00e9c0 tx=0x7fa2ac00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:12.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.852+0000 7fa2b3e00640 1 -- 172.21.15.12:0/3172525805 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac00cd80 con 0x7fa2bc101a40 2024-09-05T01:24:12.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.852+0000 7fa2b3e00640 1 -- 172.21.15.12:0/3172525805 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2ac0035f0 con 0x7fa2bc101a40 2024-09-05T01:24:12.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.852+0000 7fa2c0e00640 1 -- 172.21.15.12:0/3172525805 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2bc1a1ec0 con 0x7fa2bc101a40 2024-09-05T01:24:12.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.852+0000 7fa2b3e00640 1 -- 172.21.15.12:0/3172525805 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac010690 con 0x7fa2bc101a40 2024-09-05T01:24:12.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.852+0000 7fa2c0e00640 1 -- 172.21.15.12:0/3172525805 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2bc1a22b0 con 0x7fa2bc101a40 2024-09-05T01:24:12.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.853+0000 7fa2c0e00640 1 -- 172.21.15.12:0/3172525805 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2bc101e40 con 0x7fa2bc101a40 2024-09-05T01:24:12.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.855+0000 7fa2b3e00640 1 -- 172.21.15.12:0/3172525805 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa2ac0037a0 con 0x7fa2bc101a40 2024-09-05T01:24:12.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.856+0000 7fa2b3e00640 1 --2- 172.21.15.12:0/3172525805 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa2a00a2c10 0x7fa2a00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:12.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.857+0000 7fa2b3e00640 1 -- 172.21.15.12:0/3172525805 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7fa2ac0cf610 con 0x7fa2bc101a40 2024-09-05T01:24:12.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.857+0000 7fa2baa00640 1 --2- 172.21.15.12:0/3172525805 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa2a00a2c10 0x7fa2a00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:12.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.857+0000 7fa2baa00640 1 --2- 172.21.15.12:0/3172525805 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa2a00a2c10 0x7fa2a00a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8031440 tx=0x7fa2a80315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:12.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:12.861+0000 7fa2b3e00640 1 -- 172.21.15.12:0/3172525805 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa2ac09c3a0 con 0x7fa2bc101a40 2024-09-05T01:24:13.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:13.052+0000 7fa2c0e00640 1 -- 172.21.15.12:0/3172525805 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fa2bc062630 con 0x7fa2a00a2c10 2024-09-05T01:24:13.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:13.054+0000 7fa2b3e00640 1 -- 172.21.15.12:0/3172525805 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fa2bc062630 con 0x7fa2a00a2c10 2024-09-05T01:24:13.055 INFO:teuthology.orchestra.run.smithi012.stdout:HOST ADDR LABELS STATUS 2024-09-05T01:24:13.055 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012 172.21.15.12 2024-09-05T01:24:13.055 INFO:teuthology.orchestra.run.smithi012.stdout:smithi145 172.21.15.145 2024-09-05T01:24:13.055 INFO:teuthology.orchestra.run.smithi012.stdout:smithi151 172.21.15.151 2024-09-05T01:24:13.055 INFO:teuthology.orchestra.run.smithi012.stdout:3 hosts in cluster 2024-09-05T01:24:13.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:13.056+0000 7fa2c0e00640 1 -- 172.21.15.12:0/3172525805 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa2a00a2c10 msgr2=0x7fa2a00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:13.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:13.056+0000 7fa2c0e00640 1 --2- 172.21.15.12:0/3172525805 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa2a00a2c10 0x7fa2a00a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8031440 tx=0x7fa2a80315b0 comp rx=0 tx=0).stop 2024-09-05T01:24:13.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:13.056+0000 7fa2c0e00640 1 -- 172.21.15.12:0/3172525805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2bc101a40 msgr2=0x7fa2bc075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:13.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:13.056+0000 7fa2c0e00640 1 --2- 172.21.15.12:0/3172525805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2bc101a40 0x7fa2bc075f90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac00e9c0 tx=0x7fa2ac00ee80 comp rx=0 tx=0).stop 2024-09-05T01:24:13.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:13.056+0000 7fa2c0e00640 1 -- 172.21.15.12:0/3172525805 shutdown_connections 2024-09-05T01:24:13.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:13.056+0000 7fa2c0e00640 1 --2- 172.21.15.12:0/3172525805 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fa2a00a2c10 0x7fa2a00a50d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:13.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:13.056+0000 7fa2c0e00640 1 --2- 172.21.15.12:0/3172525805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2bc103600 0x7fa2bc074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:13.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:13.056+0000 7fa2c0e00640 1 --2- 172.21.15.12:0/3172525805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2bc102c40 0x7fa2bc0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:13.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:13.056+0000 7fa2c0e00640 1 --2- 172.21.15.12:0/3172525805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa2bc101a40 0x7fa2bc075f90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:13.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:13.056+0000 7fa2c0e00640 1 -- 172.21.15.12:0/3172525805 >> 172.21.15.12:0/3172525805 conn(0x7fa2bc0fd1f0 msgr2=0x7fa2bc106010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:13.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:13.056+0000 7fa2c0e00640 1 -- 172.21.15.12:0/3172525805 shutdown_connections 2024-09-05T01:24:13.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:13.056+0000 7fa2c0e00640 1 -- 172.21.15.12:0/3172525805 wait complete. 2024-09-05T01:24:13.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:13 smithi012 ceph-mon[29942]: from='client.25004 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:13.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:13 smithi145 ceph-mon[34376]: from='client.25004 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:13.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:13 smithi151 ceph-mon[35013]: from='client.25004 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:13.827 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-05T01:24:14.207 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:24:14.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:14 smithi012 ceph-mon[29942]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:24:14.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:14 smithi145 ceph-mon[34376]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:24:14.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:14 smithi151 ceph-mon[35013]: pgmap v339: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:24:14.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.743+0000 7fe684a00640 1 -- 172.21.15.12:0/1449055308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe680078790 msgr2=0x7fe680079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:14.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.743+0000 7fe684a00640 1 --2- 172.21.15.12:0/1449055308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe680078790 0x7fe680079030 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe678009ca0 tx=0x7fe67802a8c0 comp rx=0 tx=0).stop 2024-09-05T01:24:14.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.743+0000 7fe684a00640 1 -- 172.21.15.12:0/1449055308 shutdown_connections 2024-09-05T01:24:14.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.743+0000 7fe684a00640 1 --2- 172.21.15.12:0/1449055308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe680078790 0x7fe680079030 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:14.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.743+0000 7fe684a00640 1 --2- 172.21.15.12:0/1449055308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe680077df0 0x7fe680078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:14.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.743+0000 7fe684a00640 1 --2- 172.21.15.12:0/1449055308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe680076ba0 0x7fe680076fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:14.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.743+0000 7fe684a00640 1 -- 172.21.15.12:0/1449055308 >> 172.21.15.12:0/1449055308 conn(0x7fe6800ff3e0 msgr2=0x7fe680101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:14.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.743+0000 7fe684a00640 1 -- 172.21.15.12:0/1449055308 shutdown_connections 2024-09-05T01:24:14.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.743+0000 7fe684a00640 1 -- 172.21.15.12:0/1449055308 wait complete. 2024-09-05T01:24:14.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.744+0000 7fe684a00640 1 Processor -- start 2024-09-05T01:24:14.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.744+0000 7fe684a00640 1 -- start start 2024-09-05T01:24:14.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.744+0000 7fe684a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe680076ba0 0x7fe68019e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:14.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.744+0000 7fe684a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe680077df0 0x7fe68019e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:14.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.744+0000 7fe684a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe680078790 0x7fe6801a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:14.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.744+0000 7fe684a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe680113d60 con 0x7fe680078790 2024-09-05T01:24:14.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.744+0000 7fe684a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe680113be0 con 0x7fe680076ba0 2024-09-05T01:24:14.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.744+0000 7fe684a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe680113ee0 con 0x7fe680077df0 2024-09-05T01:24:14.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.745+0000 7fe67f400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe680076ba0 0x7fe68019e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:14.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.745+0000 7fe67f400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe680076ba0 0x7fe68019e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:55316/0 (socket says 172.21.15.12:55316) 2024-09-05T01:24:14.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.745+0000 7fe67f400640 1 -- 172.21.15.12:0/170328121 learned_addr learned my addr 172.21.15.12:0/170328121 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:14.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.745+0000 7fe677e00640 1 --2- 172.21.15.12:0/170328121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe680077df0 0x7fe68019e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:14.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.745+0000 7fe67fe00640 1 --2- 172.21.15.12:0/170328121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe680078790 0x7fe6801a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:14.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.745+0000 7fe67f400640 1 -- 172.21.15.12:0/170328121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe680077df0 msgr2=0x7fe68019e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:14.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.745+0000 7fe67f400640 1 --2- 172.21.15.12:0/170328121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe680077df0 0x7fe68019e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:14.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.745+0000 7fe67f400640 1 -- 172.21.15.12:0/170328121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe680078790 msgr2=0x7fe6801a58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:14.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.745+0000 7fe67f400640 1 --2- 172.21.15.12:0/170328121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe680078790 0x7fe6801a58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:14.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.745+0000 7fe67f400640 1 -- 172.21.15.12:0/170328121 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6801a5f10 con 0x7fe680076ba0 2024-09-05T01:24:14.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.745+0000 7fe677e00640 1 --2- 172.21.15.12:0/170328121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe680077df0 0x7fe68019e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:24:14.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.745+0000 7fe67f400640 1 --2- 172.21.15.12:0/170328121 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe680076ba0 0x7fe68019e2e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe67000e9f0 tx=0x7fe67000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:14.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.746+0000 7fe67cc00640 1 -- 172.21.15.12:0/170328121 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67000cd80 con 0x7fe680076ba0 2024-09-05T01:24:14.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.746+0000 7fe684a00640 1 -- 172.21.15.12:0/170328121 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6801a6200 con 0x7fe680076ba0 2024-09-05T01:24:14.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.746+0000 7fe67cc00640 1 -- 172.21.15.12:0/170328121 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe670005500 con 0x7fe680076ba0 2024-09-05T01:24:14.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.746+0000 7fe67cc00640 1 -- 172.21.15.12:0/170328121 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe670010690 con 0x7fe680076ba0 2024-09-05T01:24:14.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.746+0000 7fe684a00640 1 -- 172.21.15.12:0/170328121 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6801a6740 con 0x7fe680076ba0 2024-09-05T01:24:14.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.747+0000 7fe684a00640 1 -- 172.21.15.12:0/170328121 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6801105d0 con 0x7fe680076ba0 2024-09-05T01:24:14.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.749+0000 7fe67cc00640 1 -- 172.21.15.12:0/170328121 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe6700046c0 con 0x7fe680076ba0 2024-09-05T01:24:14.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.750+0000 7fe67cc00640 1 --2- 172.21.15.12:0/170328121 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fe6640a2cc0 0x7fe6640a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:14.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.751+0000 7fe67cc00640 1 -- 172.21.15.12:0/170328121 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7fe6700cf790 con 0x7fe680076ba0 2024-09-05T01:24:14.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.751+0000 7fe677e00640 1 --2- 172.21.15.12:0/170328121 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fe6640a2cc0 0x7fe6640a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:14.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.751+0000 7fe677e00640 1 --2- 172.21.15.12:0/170328121 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fe6640a2cc0 0x7fe6640a5180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe68019f800 tx=0x7fe668005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:14.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.752+0000 7fe67cc00640 1 -- 172.21.15.12:0/170328121 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe6700541b0 con 0x7fe680076ba0 2024-09-05T01:24:14.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.947+0000 7fe684a00640 1 -- 172.21.15.12:0/170328121 --> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fe680062630 con 0x7fe6640a2cc0 2024-09-05T01:24:14.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.949+0000 7fe67cc00640 1 -- 172.21.15.12:0/170328121 <== mgr.14150 v2:172.21.15.12:6800/2664180840 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fe680062630 con 0x7fe6640a2cc0 2024-09-05T01:24:14.950 INFO:teuthology.orchestra.run.smithi012.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-05T01:24:14.950 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331005J400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-05T01:24:14.950 INFO:teuthology.orchestra.run.smithi012.stdout:smithi145 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500N9400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-05T01:24:14.950 INFO:teuthology.orchestra.run.smithi012.stdout:smithi151 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JJ400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-05T01:24:14.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.951+0000 7fe684a00640 1 -- 172.21.15.12:0/170328121 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fe6640a2cc0 msgr2=0x7fe6640a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:14.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.951+0000 7fe684a00640 1 --2- 172.21.15.12:0/170328121 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fe6640a2cc0 0x7fe6640a5180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe68019f800 tx=0x7fe668005f90 comp rx=0 tx=0).stop 2024-09-05T01:24:14.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.951+0000 7fe684a00640 1 -- 172.21.15.12:0/170328121 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe680076ba0 msgr2=0x7fe68019e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:14.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.951+0000 7fe684a00640 1 --2- 172.21.15.12:0/170328121 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe680076ba0 0x7fe68019e2e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe67000e9f0 tx=0x7fe67000edf0 comp rx=0 tx=0).stop 2024-09-05T01:24:14.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.951+0000 7fe684a00640 1 -- 172.21.15.12:0/170328121 shutdown_connections 2024-09-05T01:24:14.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.951+0000 7fe684a00640 1 --2- 172.21.15.12:0/170328121 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fe6640a2cc0 0x7fe6640a5180 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:14.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.951+0000 7fe684a00640 1 --2- 172.21.15.12:0/170328121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe680078790 0x7fe6801a58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:14.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.951+0000 7fe684a00640 1 --2- 172.21.15.12:0/170328121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe680077df0 0x7fe68019e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:14.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.951+0000 7fe684a00640 1 --2- 172.21.15.12:0/170328121 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe680076ba0 0x7fe68019e2e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:14.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.951+0000 7fe684a00640 1 -- 172.21.15.12:0/170328121 >> 172.21.15.12:0/170328121 conn(0x7fe6800ff3e0 msgr2=0x7fe680100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:14.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.952+0000 7fe684a00640 1 -- 172.21.15.12:0/170328121 shutdown_connections 2024-09-05T01:24:14.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:14.952+0000 7fe684a00640 1 -- 172.21.15.12:0/170328121 wait complete. 2024-09-05T01:24:15.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:15 smithi012 ceph-mon[29942]: from='client.25010 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:15.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:15 smithi145 ceph-mon[34376]: from='client.25010 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:15.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:15 smithi151 ceph-mon[35013]: from='client.25010 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:15.760 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-05T01:24:15.773 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi012.front.sepia.ceph.com 2024-09-05T01:24:15.774 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-05T01:24:16.153 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:24:16.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:16 smithi012 ceph-mon[29942]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-05T01:24:16.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:16 smithi145 ceph-mon[34376]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-05T01:24:16.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:16 smithi151 ceph-mon[35013]: pgmap v340: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-09-05T01:24:16.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.752+0000 7f57d8e00640 1 -- 172.21.15.12:0/1350739085 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57d4076220 msgr2=0x7f57d4074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:16.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.752+0000 7f57d8e00640 1 --2- 172.21.15.12:0/1350739085 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57d4076220 0x7f57d4074680 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f57c4009860 tx=0x7f57c402a340 comp rx=0 tx=0).stop 2024-09-05T01:24:16.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.752+0000 7f57d8e00640 1 -- 172.21.15.12:0/1350739085 shutdown_connections 2024-09-05T01:24:16.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.752+0000 7f57d8e00640 1 --2- 172.21.15.12:0/1350739085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d410e1e0 0x7f57d41105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:16.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.752+0000 7f57d8e00640 1 --2- 172.21.15.12:0/1350739085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57d4074c50 0x7f57d40750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:16.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.752+0000 7f57d8e00640 1 --2- 172.21.15.12:0/1350739085 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57d4076220 0x7f57d4074680 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:16.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.752+0000 7f57d8e00640 1 -- 172.21.15.12:0/1350739085 >> 172.21.15.12:0/1350739085 conn(0x7f57d40fd390 msgr2=0x7f57d40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.752+0000 7f57d8e00640 1 -- 172.21.15.12:0/1350739085 shutdown_connections 2024-09-05T01:24:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.752+0000 7f57d8e00640 1 -- 172.21.15.12:0/1350739085 wait complete. 2024-09-05T01:24:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.753+0000 7f57d8e00640 1 Processor -- start 2024-09-05T01:24:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.753+0000 7f57d8e00640 1 -- start start 2024-09-05T01:24:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.753+0000 7f57d8e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57d4074c50 0x7f57d419e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.753+0000 7f57d8e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57d4076220 0x7f57d419ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.754+0000 7f57d8e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d410e1e0 0x7f57d41a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.754+0000 7f57d8e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f57d4113ea0 con 0x7f57d410e1e0 2024-09-05T01:24:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.754+0000 7f57d8e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f57d4113d20 con 0x7f57d4076220 2024-09-05T01:24:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.754+0000 7f57d8e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f57d4114020 con 0x7f57d4074c50 2024-09-05T01:24:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.754+0000 7f57d2800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d410e1e0 0x7f57d41a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.754+0000 7f57d1e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57d4074c50 0x7f57d419e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:16.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.754+0000 7f57d2800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d410e1e0 0x7f57d41a5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60172/0 (socket says 172.21.15.12:60172) 2024-09-05T01:24:16.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.754+0000 7f57d2800640 1 -- 172.21.15.12:0/1503196005 learned_addr learned my addr 172.21.15.12:0/1503196005 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:16.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.754+0000 7f57d1e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57d4074c50 0x7f57d419e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:43516/0 (socket says 172.21.15.12:43516) 2024-09-05T01:24:16.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.754+0000 7f57d1400640 1 --2- 172.21.15.12:0/1503196005 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57d4076220 0x7f57d419ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:16.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.754+0000 7f57d2800640 1 -- 172.21.15.12:0/1503196005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57d4074c50 msgr2=0x7f57d419e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:16.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.754+0000 7f57d2800640 1 --2- 172.21.15.12:0/1503196005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57d4074c50 0x7f57d419e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:16.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.754+0000 7f57d2800640 1 -- 172.21.15.12:0/1503196005 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57d4076220 msgr2=0x7f57d419ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:16.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.754+0000 7f57d2800640 1 --2- 172.21.15.12:0/1503196005 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57d4076220 0x7f57d419ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:16.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.754+0000 7f57d2800640 1 -- 172.21.15.12:0/1503196005 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d41a6140 con 0x7f57d410e1e0 2024-09-05T01:24:16.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.755+0000 7f57d2800640 1 --2- 172.21.15.12:0/1503196005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d410e1e0 0x7f57d41a5ad0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f57cc009fd0 tx=0x7f57cc00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:16.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.755+0000 7f57caa00640 1 -- 172.21.15.12:0/1503196005 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57cc004b20 con 0x7f57d410e1e0 2024-09-05T01:24:16.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.755+0000 7f57caa00640 1 -- 172.21.15.12:0/1503196005 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57cc003e50 con 0x7f57d410e1e0 2024-09-05T01:24:16.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.755+0000 7f57d8e00640 1 -- 172.21.15.12:0/1503196005 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57d41a6430 con 0x7f57d410e1e0 2024-09-05T01:24:16.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.755+0000 7f57caa00640 1 -- 172.21.15.12:0/1503196005 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57cc00b630 con 0x7f57d410e1e0 2024-09-05T01:24:16.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.755+0000 7f57d8e00640 1 -- 172.21.15.12:0/1503196005 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57d41a6920 con 0x7f57d410e1e0 2024-09-05T01:24:16.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.756+0000 7f57d8e00640 1 -- 172.21.15.12:0/1503196005 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57d4103b80 con 0x7f57d410e1e0 2024-09-05T01:24:16.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.758+0000 7f57caa00640 1 -- 172.21.15.12:0/1503196005 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f57cc01d020 con 0x7f57d410e1e0 2024-09-05T01:24:16.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.759+0000 7f57caa00640 1 --2- 172.21.15.12:0/1503196005 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f57b80a2c40 0x7f57b80a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:16.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.759+0000 7f57caa00640 1 -- 172.21.15.12:0/1503196005 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f57cc0cfbc0 con 0x7f57d410e1e0 2024-09-05T01:24:16.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.760+0000 7f57d1e00640 1 --2- 172.21.15.12:0/1503196005 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f57b80a2c40 0x7f57b80a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:16.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.760+0000 7f57d1e00640 1 --2- 172.21.15.12:0/1503196005 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f57b80a2c40 0x7f57b80a5100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f57c4009830 tx=0x7f57c4030570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:16.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.762+0000 7f57caa00640 1 -- 172.21.15.12:0/1503196005 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f57cc024030 con 0x7f57d410e1e0 2024-09-05T01:24:16.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.984+0000 7f57d8e00640 1 -- 172.21.15.12:0/1503196005 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f57d402d7c0 con 0x7f57d410e1e0 2024-09-05T01:24:16.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.984+0000 7f57caa00640 1 -- 172.21.15.12:0/1503196005 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3132 (secure 0 0 0) 0x7f57cc09c950 con 0x7f57d410e1e0 2024-09-05T01:24:16.986 INFO:teuthology.orchestra.run.smithi012.stdout:e27 2024-09-05T01:24:16.986 INFO:teuthology.orchestra.run.smithi012.stdout:btime 2024-09-05T01:22:48:868154+0000 2024-09-05T01:24:16.986 INFO:teuthology.orchestra.run.smithi012.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-05T01:24:16.986 INFO:teuthology.orchestra.run.smithi012.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-05T01:24:16.987 INFO:teuthology.orchestra.run.smithi012.stdout:legacy client fscid: 1 2024-09-05T01:24:16.987 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:24:16.987 INFO:teuthology.orchestra.run.smithi012.stdout:Filesystem 'cephfs' (1) 2024-09-05T01:24:16.987 INFO:teuthology.orchestra.run.smithi012.stdout:fs_name cephfs 2024-09-05T01:24:16.987 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 27 2024-09-05T01:24:16.987 INFO:teuthology.orchestra.run.smithi012.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-05T01:24:16.987 INFO:teuthology.orchestra.run.smithi012.stdout:created 2024-09-05T01:22:35.979384+0000 2024-09-05T01:24:16.987 INFO:teuthology.orchestra.run.smithi012.stdout:modified 2024-09-05T01:22:47.915851+0000 2024-09-05T01:24:16.987 INFO:teuthology.orchestra.run.smithi012.stdout:tableserver 0 2024-09-05T01:24:16.988 INFO:teuthology.orchestra.run.smithi012.stdout:root 0 2024-09-05T01:24:16.988 INFO:teuthology.orchestra.run.smithi012.stdout:session_timeout 300 2024-09-05T01:24:16.988 INFO:teuthology.orchestra.run.smithi012.stdout:session_autoclose 300 2024-09-05T01:24:16.988 INFO:teuthology.orchestra.run.smithi012.stdout:max_file_size 1099511627776 2024-09-05T01:24:16.988 INFO:teuthology.orchestra.run.smithi012.stdout:max_xattr_size 65536 2024-09-05T01:24:16.988 INFO:teuthology.orchestra.run.smithi012.stdout:required_client_features {} 2024-09-05T01:24:16.988 INFO:teuthology.orchestra.run.smithi012.stdout:last_failure 0 2024-09-05T01:24:16.989 INFO:teuthology.orchestra.run.smithi012.stdout:last_failure_osd_epoch 0 2024-09-05T01:24:16.989 INFO:teuthology.orchestra.run.smithi012.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-05T01:24:16.989 INFO:teuthology.orchestra.run.smithi012.stdout:max_mds 5 2024-09-05T01:24:16.989 INFO:teuthology.orchestra.run.smithi012.stdout:in 0,1,2,3,4 2024-09-05T01:24:16.989 INFO:teuthology.orchestra.run.smithi012.stdout:up {0=24560,1=24529,2=24524,3=24517,4=24460} 2024-09-05T01:24:16.989 INFO:teuthology.orchestra.run.smithi012.stdout:failed 2024-09-05T01:24:16.989 INFO:teuthology.orchestra.run.smithi012.stdout:damaged 2024-09-05T01:24:16.989 INFO:teuthology.orchestra.run.smithi012.stdout:stopped 2024-09-05T01:24:16.989 INFO:teuthology.orchestra.run.smithi012.stdout:data_pools [3] 2024-09-05T01:24:16.990 INFO:teuthology.orchestra.run.smithi012.stdout:metadata_pool 2 2024-09-05T01:24:16.990 INFO:teuthology.orchestra.run.smithi012.stdout:inline_data disabled 2024-09-05T01:24:16.990 INFO:teuthology.orchestra.run.smithi012.stdout:balancer 2024-09-05T01:24:16.990 INFO:teuthology.orchestra.run.smithi012.stdout:bal_rank_mask -1 2024-09-05T01:24:16.990 INFO:teuthology.orchestra.run.smithi012.stdout:standby_count_wanted 0 2024-09-05T01:24:16.990 INFO:teuthology.orchestra.run.smithi012.stdout:qdb_cluster leader: 24560 members: 24460,24517,24524,24529,24560 2024-09-05T01:24:16.990 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b{0:24560} state up:active seq 5 addr [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T01:24:16.990 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.f{0:24505} state up:standby-replay seq 1 addr [v2:172.21.15.151:6834/309674660,v1:172.21.15.151:6835/309674660] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T01:24:16.990 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.i{1:24529} state up:active seq 10 addr [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T01:24:16.991 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.e{1:24497} state up:standby-replay seq 1 addr [v2:172.21.15.145:6834/397717562,v1:172.21.15.145:6835/397717562] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T01:24:16.991 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.h{2:24524} state up:active seq 10 addr [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T01:24:16.991 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.j{2:24473} state up:standby-replay seq 1 addr [v2:172.21.15.12:6834/544280854,v1:172.21.15.12:6835/544280854] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T01:24:16.991 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.c{3:24517} state up:active seq 11 addr [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T01:24:16.991 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.k{3:24461} state up:standby-replay seq 1 addr [v2:172.21.15.145:6832/2656226932,v1:172.21.15.145:6833/2656226932] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T01:24:16.991 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.l{4:24460} state up:active seq 16 addr [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T01:24:16.991 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a{4:14544} state up:standby-replay seq 1 addr [v2:172.21.15.12:6840/497406458,v1:172.21.15.12:6841/497406458] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T01:24:16.991 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:24:16.992 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:24:16.992 INFO:teuthology.orchestra.run.smithi012.stdout:Standby daemons: 2024-09-05T01:24:16.992 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:24:16.992 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.d{-1:14490} state up:standby seq 1 addr [v2:172.21.15.12:6836/2004256626,v1:172.21.15.12:6837/2004256626] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T01:24:16.992 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.g{-1:14532} state up:standby seq 1 addr [v2:172.21.15.12:6838/2949711075,v1:172.21.15.12:6839/2949711075] compat {c=[1],r=[1],i=[1fff]}] 2024-09-05T01:24:16.993 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 27 2024-09-05T01:24:16.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.987+0000 7f57d8e00640 1 -- 172.21.15.12:0/1503196005 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f57b80a2c40 msgr2=0x7f57b80a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:16.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.987+0000 7f57d8e00640 1 --2- 172.21.15.12:0/1503196005 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f57b80a2c40 0x7f57b80a5100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f57c4009830 tx=0x7f57c4030570 comp rx=0 tx=0).stop 2024-09-05T01:24:16.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.987+0000 7f57d8e00640 1 -- 172.21.15.12:0/1503196005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d410e1e0 msgr2=0x7f57d41a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:16.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.987+0000 7f57d8e00640 1 --2- 172.21.15.12:0/1503196005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d410e1e0 0x7f57d41a5ad0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f57cc009fd0 tx=0x7f57cc00c800 comp rx=0 tx=0).stop 2024-09-05T01:24:16.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.987+0000 7f57d8e00640 1 -- 172.21.15.12:0/1503196005 shutdown_connections 2024-09-05T01:24:16.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.987+0000 7f57d8e00640 1 --2- 172.21.15.12:0/1503196005 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f57b80a2c40 0x7f57b80a5100 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:16.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.987+0000 7f57d8e00640 1 --2- 172.21.15.12:0/1503196005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d410e1e0 0x7f57d41a5ad0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:16.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.987+0000 7f57d8e00640 1 --2- 172.21.15.12:0/1503196005 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57d4076220 0x7f57d419ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:16.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.987+0000 7f57d8e00640 1 --2- 172.21.15.12:0/1503196005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57d4074c50 0x7f57d419e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:16.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.987+0000 7f57d8e00640 1 -- 172.21.15.12:0/1503196005 >> 172.21.15.12:0/1503196005 conn(0x7f57d40fd390 msgr2=0x7f57d40ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:16.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.987+0000 7f57d8e00640 1 -- 172.21.15.12:0/1503196005 shutdown_connections 2024-09-05T01:24:16.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:16.987+0000 7f57d8e00640 1 -- 172.21.15.12:0/1503196005 wait complete. 2024-09-05T01:24:17.747 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-05T01:24:18.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:17 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/1503196005' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-05T01:24:18.126 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:24:18.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:17 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/1503196005' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-05T01:24:18.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:17 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/1503196005' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-05T01:24:18.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.669+0000 7f4ab2800640 1 -- 172.21.15.12:0/4040567894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aac1037c0 msgr2=0x7f4aac10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:18.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.669+0000 7f4ab2800640 1 --2- 172.21.15.12:0/4040567894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aac1037c0 0x7f4aac10a050 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4009ca0 tx=0x7f4aa402a8c0 comp rx=0 tx=0).stop 2024-09-05T01:24:18.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.669+0000 7f4ab2800640 1 -- 172.21.15.12:0/4040567894 shutdown_connections 2024-09-05T01:24:18.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.669+0000 7f4ab2800640 1 --2- 172.21.15.12:0/4040567894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aac1037c0 0x7f4aac10a050 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:18.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.669+0000 7f4ab2800640 1 --2- 172.21.15.12:0/4040567894 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4aac102e00 0x7f4aac103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:18.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.669+0000 7f4ab2800640 1 --2- 172.21.15.12:0/4040567894 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4aac101c00 0x7f4aac102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:18.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.669+0000 7f4ab2800640 1 -- 172.21.15.12:0/4040567894 >> 172.21.15.12:0/4040567894 conn(0x7f4aac0fd390 msgr2=0x7f4aac0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:18.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.669+0000 7f4ab2800640 1 -- 172.21.15.12:0/4040567894 shutdown_connections 2024-09-05T01:24:18.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.669+0000 7f4ab2800640 1 -- 172.21.15.12:0/4040567894 wait complete. 2024-09-05T01:24:18.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.670+0000 7f4ab2800640 1 Processor -- start 2024-09-05T01:24:18.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.670+0000 7f4ab2800640 1 -- start start 2024-09-05T01:24:18.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.671+0000 7f4ab2800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aac101c00 0x7f4aac19a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:18.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.671+0000 7f4ab2800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4aac102e00 0x7f4aac19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:18.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.671+0000 7f4ab2800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4aac1037c0 0x7f4aac1a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:18.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.671+0000 7f4ab2800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac10d860 con 0x7f4aac101c00 2024-09-05T01:24:18.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.671+0000 7f4ab2800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac10d6e0 con 0x7f4aac102e00 2024-09-05T01:24:18.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.671+0000 7f4ab2800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac10d9e0 con 0x7f4aac1037c0 2024-09-05T01:24:18.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.671+0000 7f4aab400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aac101c00 0x7f4aac19a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:18.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.671+0000 7f4aab400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aac101c00 0x7f4aac19a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37944/0 (socket says 172.21.15.12:37944) 2024-09-05T01:24:18.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.671+0000 7f4aab400640 1 -- 172.21.15.12:0/2378423200 learned_addr learned my addr 172.21.15.12:0/2378423200 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:18.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.671+0000 7f4aaaa00640 1 --2- 172.21.15.12:0/2378423200 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4aac102e00 0x7f4aac19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:18.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.671+0000 7f4aabe00640 1 --2- 172.21.15.12:0/2378423200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4aac1037c0 0x7f4aac1a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:18.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.671+0000 7f4aab400640 1 -- 172.21.15.12:0/2378423200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4aac1037c0 msgr2=0x7f4aac1a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:18.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.671+0000 7f4aab400640 1 --2- 172.21.15.12:0/2378423200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4aac1037c0 0x7f4aac1a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:18.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.671+0000 7f4aab400640 1 -- 172.21.15.12:0/2378423200 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4aac102e00 msgr2=0x7f4aac19a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:18.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.671+0000 7f4aab400640 1 --2- 172.21.15.12:0/2378423200 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4aac102e00 0x7f4aac19a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:18.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.671+0000 7f4aab400640 1 -- 172.21.15.12:0/2378423200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aac1a1ce0 con 0x7f4aac101c00 2024-09-05T01:24:18.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.672+0000 7f4aab400640 1 --2- 172.21.15.12:0/2378423200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aac101c00 0x7f4aac19a0b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c00e9c0 tx=0x7f4a9c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:18.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.672+0000 7f4aa3e00640 1 -- 172.21.15.12:0/2378423200 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c00cd80 con 0x7f4aac101c00 2024-09-05T01:24:18.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.672+0000 7f4ab2800640 1 -- 172.21.15.12:0/2378423200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aac1a1fd0 con 0x7f4aac101c00 2024-09-05T01:24:18.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.672+0000 7f4aa3e00640 1 -- 172.21.15.12:0/2378423200 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a9c0035f0 con 0x7f4aac101c00 2024-09-05T01:24:18.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.672+0000 7f4aa3e00640 1 -- 172.21.15.12:0/2378423200 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c010690 con 0x7f4aac101c00 2024-09-05T01:24:18.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.672+0000 7f4ab2800640 1 -- 172.21.15.12:0/2378423200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aac1a2480 con 0x7f4aac101c00 2024-09-05T01:24:18.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.673+0000 7f4ab2800640 1 -- 172.21.15.12:0/2378423200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aac1a2740 con 0x7f4aac101c00 2024-09-05T01:24:18.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.675+0000 7f4aa3e00640 1 -- 172.21.15.12:0/2378423200 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4a9c0037a0 con 0x7f4aac101c00 2024-09-05T01:24:18.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.676+0000 7f4aa3e00640 1 --2- 172.21.15.12:0/2378423200 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f4a900a2cc0 0x7f4a900a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:18.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.677+0000 7f4aa3e00640 1 -- 172.21.15.12:0/2378423200 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f4a9c0cf540 con 0x7f4aac101c00 2024-09-05T01:24:18.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.677+0000 7f4aaaa00640 1 --2- 172.21.15.12:0/2378423200 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f4a900a2cc0 0x7f4a900a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:18.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.677+0000 7f4aaaa00640 1 --2- 172.21.15.12:0/2378423200 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f4a900a2cc0 0x7f4a900a5180 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4aac19b5d0 tx=0x7f4a98005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:18.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.680+0000 7f4aa3e00640 1 -- 172.21.15.12:0/2378423200 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4a9c09c2d0 con 0x7f4aac101c00 2024-09-05T01:24:18.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.867+0000 7f4ab2800640 1 -- 172.21.15.12:0/2378423200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f4aac1a2910 con 0x7f4aac101c00 2024-09-05T01:24:18.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.868+0000 7f4aa3e00640 1 -- 172.21.15.12:0/2378423200 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v83) ==== 56+0+5319 (secure 0 0 0) 0x7f4a9c09bbd0 con 0x7f4aac101c00 2024-09-05T01:24:18.869 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 83 2024-09-05T01:24:18.869 INFO:teuthology.orchestra.run.smithi012.stdout:fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:24:18.869 INFO:teuthology.orchestra.run.smithi012.stdout:created 2024-09-05T01:14:21.162850+0000 2024-09-05T01:24:18.870 INFO:teuthology.orchestra.run.smithi012.stdout:modified 2024-09-05T01:23:23.181930+0000 2024-09-05T01:24:18.870 INFO:teuthology.orchestra.run.smithi012.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-05T01:24:18.870 INFO:teuthology.orchestra.run.smithi012.stdout:crush_version 26 2024-09-05T01:24:18.870 INFO:teuthology.orchestra.run.smithi012.stdout:full_ratio 0.95 2024-09-05T01:24:18.870 INFO:teuthology.orchestra.run.smithi012.stdout:backfillfull_ratio 0.9 2024-09-05T01:24:18.870 INFO:teuthology.orchestra.run.smithi012.stdout:nearfull_ratio 0.85 2024-09-05T01:24:18.870 INFO:teuthology.orchestra.run.smithi012.stdout:require_min_compat_client luminous 2024-09-05T01:24:18.870 INFO:teuthology.orchestra.run.smithi012.stdout:min_compat_client luminous 2024-09-05T01:24:18.870 INFO:teuthology.orchestra.run.smithi012.stdout:require_osd_release squid 2024-09-05T01:24:18.870 INFO:teuthology.orchestra.run.smithi012.stdout:stretch_mode_enabled false 2024-09-05T01:24:18.870 INFO:teuthology.orchestra.run.smithi012.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-05T01:24:18.870 INFO:teuthology.orchestra.run.smithi012.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-05T01:24:18.870 INFO:teuthology.orchestra.run.smithi012.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-05T01:24:18.871 INFO:teuthology.orchestra.run.smithi012.stdout:max_osd 12 2024-09-05T01:24:18.871 INFO:teuthology.orchestra.run.smithi012.stdout:osd.0 up in weight 1 up_from 8 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6802/2090563987,v1:172.21.15.12:6803/2090563987] [v2:172.21.15.12:6804/2090563987,v1:172.21.15.12:6805/2090563987] exists,up b74ac640-b680-46e2-9106-d24168e685e9 2024-09-05T01:24:18.871 INFO:teuthology.orchestra.run.smithi012.stdout:osd.1 up in weight 1 up_from 13 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.145:6800/2639126629,v1:172.21.15.145:6801/2639126629] [v2:172.21.15.145:6802/2639126629,v1:172.21.15.145:6803/2639126629] exists,up efca1216-8d85-4e6a-8c49-0afb511ece59 2024-09-05T01:24:18.871 INFO:teuthology.orchestra.run.smithi012.stdout:osd.2 up in weight 1 up_from 18 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6800/3753171761,v1:172.21.15.151:6801/3753171761] [v2:172.21.15.151:6802/3753171761,v1:172.21.15.151:6803/3753171761] exists,up 4d5699b2-646a-4ab6-94a5-ad223aa27ac2 2024-09-05T01:24:18.871 INFO:teuthology.orchestra.run.smithi012.stdout:osd.3 up in weight 1 up_from 25 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6810/2231650146,v1:172.21.15.12:6811/2231650146] [v2:172.21.15.12:6812/2231650146,v1:172.21.15.12:6813/2231650146] exists,up 275ad2ad-93e6-4a68-8784-8f8dcb620f45 2024-09-05T01:24:18.871 INFO:teuthology.orchestra.run.smithi012.stdout:osd.4 up in weight 1 up_from 32 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.145:6808/1828591275,v1:172.21.15.145:6809/1828591275] [v2:172.21.15.145:6810/1828591275,v1:172.21.15.145:6811/1828591275] exists,up 21a0c5b4-4e0e-4fb6-8be6-a300cb811cb7 2024-09-05T01:24:18.871 INFO:teuthology.orchestra.run.smithi012.stdout:osd.5 up in weight 1 up_from 37 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6808/3888870109,v1:172.21.15.151:6809/3888870109] [v2:172.21.15.151:6810/3888870109,v1:172.21.15.151:6811/3888870109] exists,up e2c7e6fb-5dea-459f-8d7a-7ae5b1936218 2024-09-05T01:24:18.871 INFO:teuthology.orchestra.run.smithi012.stdout:osd.6 up in weight 1 up_from 44 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6818/3084810269,v1:172.21.15.12:6819/3084810269] [v2:172.21.15.12:6820/3084810269,v1:172.21.15.12:6821/3084810269] exists,up 0df0a29c-3404-4ff5-ae48-78b69b77cbd6 2024-09-05T01:24:18.871 INFO:teuthology.orchestra.run.smithi012.stdout:osd.7 up in weight 1 up_from 49 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.145:6816/3058588721,v1:172.21.15.145:6817/3058588721] [v2:172.21.15.145:6818/3058588721,v1:172.21.15.145:6819/3058588721] exists,up c7b3ad7c-a566-435c-9ef8-837bb764acb3 2024-09-05T01:24:18.871 INFO:teuthology.orchestra.run.smithi012.stdout:osd.8 up in weight 1 up_from 56 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6816/905705309,v1:172.21.15.151:6817/905705309] [v2:172.21.15.151:6818/905705309,v1:172.21.15.151:6819/905705309] exists,up 8018a468-fbc5-4667-a53c-2e97c08713bb 2024-09-05T01:24:18.871 INFO:teuthology.orchestra.run.smithi012.stdout:osd.9 up in weight 1 up_from 63 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.12:6826/1193852496,v1:172.21.15.12:6827/1193852496] [v2:172.21.15.12:6828/1193852496,v1:172.21.15.12:6829/1193852496] exists,up dcf3b524-c8b8-4ab6-83c6-fc52c776d72b 2024-09-05T01:24:18.871 INFO:teuthology.orchestra.run.smithi012.stdout:osd.10 up in weight 1 up_from 68 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.145:6824/1296813755,v1:172.21.15.145:6825/1296813755] [v2:172.21.15.145:6826/1296813755,v1:172.21.15.145:6827/1296813755] exists,up 7b5b34c3-8814-4d16-80ce-0b0c9be07cf7 2024-09-05T01:24:18.872 INFO:teuthology.orchestra.run.smithi012.stdout:osd.11 up in weight 1 up_from 75 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6824/2855185758,v1:172.21.15.151:6825/2855185758] [v2:172.21.15.151:6826/2855185758,v1:172.21.15.151:6827/2855185758] exists,up 157ee32a-43f0-4e5a-8dac-fce53c1efdbf 2024-09-05T01:24:18.872 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 2.6 [8,11] 2024-09-05T01:24:18.872 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 2.c [2,4] 2024-09-05T01:24:18.872 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 2.1d [2,1] 2024-09-05T01:24:18.872 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.6 [4,6] 2024-09-05T01:24:18.872 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.e [5,9,4,7] 2024-09-05T01:24:18.872 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.19 [3,8] 2024-09-05T01:24:18.872 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.25 [5,9] 2024-09-05T01:24:18.872 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.31 [4,8] 2024-09-05T01:24:18.872 INFO:teuthology.orchestra.run.smithi012.stdout:pg_upmap_items 3.38 [3,9] 2024-09-05T01:24:18.872 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/1132389058 expires 2024-09-06T01:15:22.093410+0000 2024-09-05T01:24:18.872 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:6801/4067110310 expires 2024-09-06T01:15:22.093410+0000 2024-09-05T01:24:18.872 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/1040591124 expires 2024-09-06T01:15:22.093410+0000 2024-09-05T01:24:18.872 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/1171838695 expires 2024-09-06T01:14:54.625209+0000 2024-09-05T01:24:18.873 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:6800/4067110310 expires 2024-09-06T01:15:22.093410+0000 2024-09-05T01:24:18.873 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/784506983 expires 2024-09-06T01:14:54.625209+0000 2024-09-05T01:24:18.873 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/992405704 expires 2024-09-06T01:15:22.093410+0000 2024-09-05T01:24:18.873 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:6801/3541208629 expires 2024-09-06T01:14:54.625209+0000 2024-09-05T01:24:18.873 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:6800/3541208629 expires 2024-09-06T01:14:54.625209+0000 2024-09-05T01:24:18.873 INFO:teuthology.orchestra.run.smithi012.stdout:blocklist 172.21.15.12:0/1532325396 expires 2024-09-06T01:14:54.625209+0000 2024-09-05T01:24:18.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.870+0000 7f4ab2800640 1 -- 172.21.15.12:0/2378423200 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f4a900a2cc0 msgr2=0x7f4a900a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:18.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.870+0000 7f4ab2800640 1 --2- 172.21.15.12:0/2378423200 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f4a900a2cc0 0x7f4a900a5180 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4aac19b5d0 tx=0x7f4a98005f90 comp rx=0 tx=0).stop 2024-09-05T01:24:18.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.870+0000 7f4ab2800640 1 -- 172.21.15.12:0/2378423200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aac101c00 msgr2=0x7f4aac19a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:18.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.870+0000 7f4ab2800640 1 --2- 172.21.15.12:0/2378423200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aac101c00 0x7f4aac19a0b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c00e9c0 tx=0x7f4a9c00ee80 comp rx=0 tx=0).stop 2024-09-05T01:24:18.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.870+0000 7f4ab2800640 1 -- 172.21.15.12:0/2378423200 shutdown_connections 2024-09-05T01:24:18.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.870+0000 7f4ab2800640 1 --2- 172.21.15.12:0/2378423200 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f4a900a2cc0 0x7f4a900a5180 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:18.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.870+0000 7f4ab2800640 1 --2- 172.21.15.12:0/2378423200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4aac1037c0 0x7f4aac1a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:18.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.870+0000 7f4ab2800640 1 --2- 172.21.15.12:0/2378423200 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4aac102e00 0x7f4aac19a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:18.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.870+0000 7f4ab2800640 1 --2- 172.21.15.12:0/2378423200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4aac101c00 0x7f4aac19a0b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:18.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.870+0000 7f4ab2800640 1 -- 172.21.15.12:0/2378423200 >> 172.21.15.12:0/2378423200 conn(0x7f4aac0fd390 msgr2=0x7f4aac074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:18.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.871+0000 7f4ab2800640 1 -- 172.21.15.12:0/2378423200 shutdown_connections 2024-09-05T01:24:18.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:18.871+0000 7f4ab2800640 1 -- 172.21.15.12:0/2378423200 wait complete. 2024-09-05T01:24:19.211 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:18 smithi012 ceph-mon[29942]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:24:19.211 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:18 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2378423200' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-05T01:24:19.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:18 smithi145 ceph-mon[34376]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:24:19.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:18 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/2378423200' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-05T01:24:19.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:18 smithi151 ceph-mon[35013]: pgmap v341: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:24:19.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:18 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/2378423200' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-05T01:24:19.727 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-05T01:24:19.743 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:24:20.120 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:24:20.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:20 smithi012 ceph-mon[29942]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T01:24:20.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:20 smithi145 ceph-mon[34376]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T01:24:20.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.600+0000 7f8827200640 1 -- 172.21.15.12:0/3125862229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8820103e30 msgr2=0x7f8820104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:20.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.600+0000 7f8827200640 1 --2- 172.21.15.12:0/3125862229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8820103e30 0x7f8820104210 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8814009900 tx=0x7f881402a3f0 comp rx=0 tx=0).stop 2024-09-05T01:24:20.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.601+0000 7f8827200640 1 -- 172.21.15.12:0/3125862229 shutdown_connections 2024-09-05T01:24:20.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.601+0000 7f8827200640 1 --2- 172.21.15.12:0/3125862229 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8820108f60 0x7f8820110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:20.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.601+0000 7f8827200640 1 --2- 172.21.15.12:0/3125862229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88201047e0 0x7f8820108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:20.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.601+0000 7f8827200640 1 --2- 172.21.15.12:0/3125862229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8820103e30 0x7f8820104210 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:20.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.601+0000 7f8827200640 1 -- 172.21.15.12:0/3125862229 >> 172.21.15.12:0/3125862229 conn(0x7f88200ff8d0 msgr2=0x7f8820101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:20.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.601+0000 7f8827200640 1 -- 172.21.15.12:0/3125862229 shutdown_connections 2024-09-05T01:24:20.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.601+0000 7f8827200640 1 -- 172.21.15.12:0/3125862229 wait complete. 2024-09-05T01:24:20.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.602+0000 7f8827200640 1 Processor -- start 2024-09-05T01:24:20.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.602+0000 7f8827200640 1 -- start start 2024-09-05T01:24:20.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.603+0000 7f8827200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8820103e30 0x7f882019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:20.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.603+0000 7f8827200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88201047e0 0x7f882019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.603+0000 7f8827200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8820108f60 0x7f882019ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.603+0000 7f8827200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8820113fd0 con 0x7f8820108f60 2024-09-05T01:24:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.603+0000 7f8827200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8820113e50 con 0x7f88201047e0 2024-09-05T01:24:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.603+0000 7f8827200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8820114150 con 0x7f8820103e30 2024-09-05T01:24:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.603+0000 7f8826800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8820108f60 0x7f882019ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.603+0000 7f8825400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88201047e0 0x7f882019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.603+0000 7f8825400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88201047e0 0x7f882019a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:49154/0 (socket says 172.21.15.12:49154) 2024-09-05T01:24:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.603+0000 7f8826800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8820108f60 0x7f882019ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37972/0 (socket says 172.21.15.12:37972) 2024-09-05T01:24:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.603+0000 7f8825400640 1 -- 172.21.15.12:0/792789104 learned_addr learned my addr 172.21.15.12:0/792789104 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.603+0000 7f8825e00640 1 --2- 172.21.15.12:0/792789104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8820103e30 0x7f882019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.604+0000 7f8825400640 1 -- 172.21.15.12:0/792789104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8820103e30 msgr2=0x7f882019a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.604+0000 7f8825400640 1 --2- 172.21.15.12:0/792789104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8820103e30 0x7f882019a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:20.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.604+0000 7f8825400640 1 -- 172.21.15.12:0/792789104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8820108f60 msgr2=0x7f882019ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:20.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.604+0000 7f8825400640 1 --2- 172.21.15.12:0/792789104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8820108f60 0x7f882019ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:20.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.604+0000 7f8825400640 1 -- 172.21.15.12:0/792789104 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882019f460 con 0x7f88201047e0 2024-09-05T01:24:20.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.604+0000 7f8826800640 1 --2- 172.21.15.12:0/792789104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8820108f60 0x7f882019ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:20.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:20 smithi151 ceph-mon[35013]: pgmap v342: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-05T01:24:20.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.604+0000 7f8825400640 1 --2- 172.21.15.12:0/792789104 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88201047e0 0x7f882019a9f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f881000d950 tx=0x7f881000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:20.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.604+0000 7f881aa00640 1 -- 172.21.15.12:0/792789104 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8810017070 con 0x7f88201047e0 2024-09-05T01:24:20.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.604+0000 7f881aa00640 1 -- 172.21.15.12:0/792789104 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8810009c30 con 0x7f88201047e0 2024-09-05T01:24:20.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.604+0000 7f881aa00640 1 -- 172.21.15.12:0/792789104 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f881000f6b0 con 0x7f88201047e0 2024-09-05T01:24:20.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.604+0000 7f8827200640 1 -- 172.21.15.12:0/792789104 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f882019f750 con 0x7f88201047e0 2024-09-05T01:24:20.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.604+0000 7f8827200640 1 -- 172.21.15.12:0/792789104 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88201a7030 con 0x7f88201047e0 2024-09-05T01:24:20.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.605+0000 7f8827200640 1 -- 172.21.15.12:0/792789104 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8820104210 con 0x7f88201047e0 2024-09-05T01:24:20.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.608+0000 7f881aa00640 1 -- 172.21.15.12:0/792789104 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f88100109d0 con 0x7f88201047e0 2024-09-05T01:24:20.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.609+0000 7f881aa00640 1 --2- 172.21.15.12:0/792789104 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f88080a2c90 0x7f88080a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:20.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.609+0000 7f881aa00640 1 -- 172.21.15.12:0/792789104 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8248+0+0 (secure 0 0 0) 0x7f88100ced60 con 0x7f88201047e0 2024-09-05T01:24:20.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.609+0000 7f8825e00640 1 --2- 172.21.15.12:0/792789104 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f88080a2c90 0x7f88080a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:20.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.610+0000 7f8825e00640 1 --2- 172.21.15.12:0/792789104 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f88080a2c90 0x7f88080a5150 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8814000c00 tx=0x7f8814005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:20.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.611+0000 7f881aa00640 1 -- 172.21.15.12:0/792789104 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8810009de0 con 0x7f88201047e0 2024-09-05T01:24:20.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.831+0000 7f8827200640 1 -- 172.21.15.12:0/792789104 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f882010bbb0 con 0x7f88201047e0 2024-09-05T01:24:20.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.832+0000 7f881aa00640 1 -- 172.21.15.12:0/792789104 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11979 (secure 0 0 0) 0x7f881009b520 con 0x7f88201047e0 2024-09-05T01:24:20.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:24:20.833 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":27,"btime":"2024-09-05T01:22:48:868154+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14532,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/2949711075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":2949711075},{"type":"v1","addr":"172.21.15.12:6839","nonce":2949711075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T01:22:35.979384+0000","modified":"2024-09-05T01:22:47.915851+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24529,"mds_2":24524,"mds_3":24517,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/497406458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":497406458},{"type":"v1","addr":"172.21.15.12:6841","nonce":497406458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":10,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.145:6839/1706431882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":1706431882},{"type":"v1","addr":"172.21.15.145:6839","nonce":1706431882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24460,24517,24524,24529,24560]},"id":1}]} 2024-09-05T01:24:20.834 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 27 2024-09-05T01:24:20.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.835+0000 7f8827200640 1 -- 172.21.15.12:0/792789104 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f88080a2c90 msgr2=0x7f88080a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:20.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.835+0000 7f8827200640 1 --2- 172.21.15.12:0/792789104 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f88080a2c90 0x7f88080a5150 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8814000c00 tx=0x7f8814005b50 comp rx=0 tx=0).stop 2024-09-05T01:24:20.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.835+0000 7f8827200640 1 -- 172.21.15.12:0/792789104 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88201047e0 msgr2=0x7f882019a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:20.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.835+0000 7f8827200640 1 --2- 172.21.15.12:0/792789104 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88201047e0 0x7f882019a9f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f881000d950 tx=0x7f881000de10 comp rx=0 tx=0).stop 2024-09-05T01:24:20.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.835+0000 7f8827200640 1 -- 172.21.15.12:0/792789104 shutdown_connections 2024-09-05T01:24:20.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.835+0000 7f8827200640 1 --2- 172.21.15.12:0/792789104 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f88080a2c90 0x7f88080a5150 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:20.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.835+0000 7f8827200640 1 --2- 172.21.15.12:0/792789104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8820108f60 0x7f882019ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:20.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.835+0000 7f8827200640 1 --2- 172.21.15.12:0/792789104 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f88201047e0 0x7f882019a9f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:20.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.835+0000 7f8827200640 1 --2- 172.21.15.12:0/792789104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8820103e30 0x7f882019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:20.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.835+0000 7f8827200640 1 -- 172.21.15.12:0/792789104 >> 172.21.15.12:0/792789104 conn(0x7f88200ff8d0 msgr2=0x7f8820100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:20.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.835+0000 7f8827200640 1 -- 172.21.15.12:0/792789104 shutdown_connections 2024-09-05T01:24:20.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:20.835+0000 7f8827200640 1 -- 172.21.15.12:0/792789104 wait complete. 2024-09-05T01:24:21.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:21 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/792789104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:24:21.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:21 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/792789104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:24:21.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:21 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/792789104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:24:21.651 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:24:22.028 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:24:22.477 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:22 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-09-05T01:24:22.477 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:22 smithi012 ceph-mon[29942]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:24:22.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:22 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-09-05T01:24:22.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:22 smithi145 ceph-mon[34376]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:24:22.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.589+0000 7fd55ac00640 1 -- 172.21.15.12:0/1574669234 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd554112b90 msgr2=0x7fd554114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:22.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.589+0000 7fd55ac00640 1 --2- 172.21.15.12:0/1574669234 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd554112b90 0x7fd554114f80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd54c009ca0 tx=0x7fd54c02a950 comp rx=0 tx=0).stop 2024-09-05T01:24:22.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.589+0000 7fd55ac00640 1 -- 172.21.15.12:0/1574669234 shutdown_connections 2024-09-05T01:24:22.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.589+0000 7fd55ac00640 1 --2- 172.21.15.12:0/1574669234 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd554112b90 0x7fd554114f80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:22.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.589+0000 7fd55ac00640 1 --2- 172.21.15.12:0/1574669234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd554074eb0 0x7fd554112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:22.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.589+0000 7fd55ac00640 1 --2- 172.21.15.12:0/1574669234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd554074590 0x7fd554074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:22.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.589+0000 7fd55ac00640 1 -- 172.21.15.12:0/1574669234 >> 172.21.15.12:0/1574669234 conn(0x7fd5540fd8c0 msgr2=0x7fd5540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:22.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.589+0000 7fd55ac00640 1 -- 172.21.15.12:0/1574669234 shutdown_connections 2024-09-05T01:24:22.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.589+0000 7fd55ac00640 1 -- 172.21.15.12:0/1574669234 wait complete. 2024-09-05T01:24:22.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.590+0000 7fd55ac00640 1 Processor -- start 2024-09-05T01:24:22.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.590+0000 7fd55ac00640 1 -- start start 2024-09-05T01:24:22.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.591+0000 7fd55ac00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd554074590 0x7fd55419eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:22.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.591+0000 7fd55ac00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd554074eb0 0x7fd55419f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:22.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.591+0000 7fd55ac00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd554112b90 0x7fd5541a33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:22.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.591+0000 7fd55ac00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd554118570 con 0x7fd554074590 2024-09-05T01:24:22.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.591+0000 7fd55ac00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd5541183f0 con 0x7fd554074eb0 2024-09-05T01:24:22.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.591+0000 7fd55ac00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd5541186f0 con 0x7fd554112b90 2024-09-05T01:24:22.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.591+0000 7fd553e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd554074590 0x7fd55419eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:22.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.591+0000 7fd553e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd554074590 0x7fd55419eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37978/0 (socket says 172.21.15.12:37978) 2024-09-05T01:24:22.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.591+0000 7fd553e00640 1 -- 172.21.15.12:0/705881445 learned_addr learned my addr 172.21.15.12:0/705881445 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:22.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.591+0000 7fd54b400640 1 --2- 172.21.15.12:0/705881445 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd554074eb0 0x7fd55419f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:22.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.591+0000 7fd558c00640 1 --2- 172.21.15.12:0/705881445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd554112b90 0x7fd5541a33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:22.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.592+0000 7fd553e00640 1 -- 172.21.15.12:0/705881445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd554112b90 msgr2=0x7fd5541a33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:22.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.592+0000 7fd553e00640 1 --2- 172.21.15.12:0/705881445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd554112b90 0x7fd5541a33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:22.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.592+0000 7fd553e00640 1 -- 172.21.15.12:0/705881445 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd554074eb0 msgr2=0x7fd55419f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:22.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.592+0000 7fd553e00640 1 --2- 172.21.15.12:0/705881445 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd554074eb0 0x7fd55419f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:22.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.592+0000 7fd553e00640 1 -- 172.21.15.12:0/705881445 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5541a3af0 con 0x7fd554074590 2024-09-05T01:24:22.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.592+0000 7fd54b400640 1 --2- 172.21.15.12:0/705881445 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd554074eb0 0x7fd55419f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:22.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.592+0000 7fd553e00640 1 --2- 172.21.15.12:0/705881445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd554074590 0x7fd55419eac0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd54400e9f0 tx=0x7fd54400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:22.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.592+0000 7fd551600640 1 -- 172.21.15.12:0/705881445 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54400cd80 con 0x7fd554074590 2024-09-05T01:24:22.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.592+0000 7fd551600640 1 -- 172.21.15.12:0/705881445 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd544010910 con 0x7fd554074590 2024-09-05T01:24:22.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.592+0000 7fd55ac00640 1 -- 172.21.15.12:0/705881445 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5541a3de0 con 0x7fd554074590 2024-09-05T01:24:22.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.592+0000 7fd551600640 1 -- 172.21.15.12:0/705881445 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544018990 con 0x7fd554074590 2024-09-05T01:24:22.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.592+0000 7fd55ac00640 1 -- 172.21.15.12:0/705881445 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5541ab670 con 0x7fd554074590 2024-09-05T01:24:22.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.593+0000 7fd55ac00640 1 -- 172.21.15.12:0/705881445 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd554074970 con 0x7fd554074590 2024-09-05T01:24:22.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.596+0000 7fd551600640 1 -- 172.21.15.12:0/705881445 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fd544010ac0 con 0x7fd554074590 2024-09-05T01:24:22.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.597+0000 7fd551600640 1 --2- 172.21.15.12:0/705881445 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd5380a2c10 0x7fd5380a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:22.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.597+0000 7fd551600640 1 -- 172.21.15.12:0/705881445 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8277+0+0 (secure 0 0 0) 0x7fd5440cf980 con 0x7fd554074590 2024-09-05T01:24:22.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.597+0000 7fd54b400640 1 --2- 172.21.15.12:0/705881445 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd5380a2c10 0x7fd5380a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:22.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.598+0000 7fd54b400640 1 --2- 172.21.15.12:0/705881445 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd5380a2c10 0x7fd5380a50d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd5540fecf0 tx=0x7fd53c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:22.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.600+0000 7fd551600640 1 -- 172.21.15.12:0/705881445 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd54409c0a0 con 0x7fd554074590 2024-09-05T01:24:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:22 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-09-05T01:24:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:22 smithi151 ceph-mon[35013]: pgmap v343: 97 pgs: 97 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-05T01:24:22.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.822+0000 7fd55ac00640 1 -- 172.21.15.12:0/705881445 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd55419fe20 con 0x7fd554074590 2024-09-05T01:24:22.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.822+0000 7fd551600640 1 -- 172.21.15.12:0/705881445 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11979 (secure 0 0 0) 0x7fd5440a03a0 con 0x7fd554074590 2024-09-05T01:24:22.824 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:24:22.824 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":27,"btime":"2024-09-05T01:22:48:868154+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14532,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/2949711075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":2949711075},{"type":"v1","addr":"172.21.15.12:6839","nonce":2949711075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T01:22:35.979384+0000","modified":"2024-09-05T01:22:47.915851+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24529,"mds_2":24524,"mds_3":24517,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/497406458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":497406458},{"type":"v1","addr":"172.21.15.12:6841","nonce":497406458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":10,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.145:6839/1706431882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":1706431882},{"type":"v1","addr":"172.21.15.145:6839","nonce":1706431882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24460,24517,24524,24529,24560]},"id":1}]} 2024-09-05T01:24:22.824 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 27 2024-09-05T01:24:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.825+0000 7fd55ac00640 1 -- 172.21.15.12:0/705881445 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd5380a2c10 msgr2=0x7fd5380a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.825+0000 7fd55ac00640 1 --2- 172.21.15.12:0/705881445 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd5380a2c10 0x7fd5380a50d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd5540fecf0 tx=0x7fd53c005f90 comp rx=0 tx=0).stop 2024-09-05T01:24:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.825+0000 7fd55ac00640 1 -- 172.21.15.12:0/705881445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd554074590 msgr2=0x7fd55419eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.825+0000 7fd55ac00640 1 --2- 172.21.15.12:0/705881445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd554074590 0x7fd55419eac0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd54400e9f0 tx=0x7fd54400eeb0 comp rx=0 tx=0).stop 2024-09-05T01:24:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.825+0000 7fd55ac00640 1 -- 172.21.15.12:0/705881445 shutdown_connections 2024-09-05T01:24:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.825+0000 7fd55ac00640 1 --2- 172.21.15.12:0/705881445 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fd5380a2c10 0x7fd5380a50d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.825+0000 7fd55ac00640 1 --2- 172.21.15.12:0/705881445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd554112b90 0x7fd5541a33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.825+0000 7fd55ac00640 1 --2- 172.21.15.12:0/705881445 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd554074eb0 0x7fd55419f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.825+0000 7fd55ac00640 1 --2- 172.21.15.12:0/705881445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd554074590 0x7fd55419eac0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:22.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.825+0000 7fd55ac00640 1 -- 172.21.15.12:0/705881445 >> 172.21.15.12:0/705881445 conn(0x7fd5540fd8c0 msgr2=0x7fd5540ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:22.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.825+0000 7fd55ac00640 1 -- 172.21.15.12:0/705881445 shutdown_connections 2024-09-05T01:24:22.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:22.825+0000 7fd55ac00640 1 -- 172.21.15.12:0/705881445 wait complete. 2024-09-05T01:24:23.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:23 smithi012 ceph-mon[29942]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-05T01:24:23.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:23 smithi012 ceph-mon[29942]: osdmap e84: 12 total, 12 up, 12 in 2024-09-05T01:24:23.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:23 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/705881445' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:24:23.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:23 smithi145 ceph-mon[34376]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-05T01:24:23.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:23 smithi145 ceph-mon[34376]: osdmap e84: 12 total, 12 up, 12 in 2024-09-05T01:24:23.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:23 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/705881445' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:24:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:23 smithi151 ceph-mon[35013]: from='mgr.14150 172.21.15.12:0/1596582397' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-05T01:24:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:23 smithi151 ceph-mon[35013]: osdmap e84: 12 total, 12 up, 12 in 2024-09-05T01:24:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:23 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/705881445' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:24:23.611 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T01:24:23.992 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:24:24.447 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:24 smithi012 ceph-mon[29942]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-05T01:24:24.447 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:24 smithi012 ceph-mon[29942]: osdmap e85: 12 total, 12 up, 12 in 2024-09-05T01:24:24.447 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:24 smithi012 ceph-mon[29942]: pgmap v346: 97 pgs: 1 peering, 96 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 383 B/s wr, 10 op/s 2024-09-05T01:24:24.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.557+0000 7f6e0da00640 1 -- 172.21.15.12:0/1796903998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e08105f30 msgr2=0x7f6e081063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:24.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.557+0000 7f6e0da00640 1 --2- 172.21.15.12:0/1796903998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e08105f30 0x7f6e081063c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009ca0 tx=0x7f6e0002a940 comp rx=0 tx=0).stop 2024-09-05T01:24:24.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.558+0000 7f6e0da00640 1 -- 172.21.15.12:0/1796903998 shutdown_connections 2024-09-05T01:24:24.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.558+0000 7f6e0da00640 1 --2- 172.21.15.12:0/1796903998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e08105f30 0x7f6e081063c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:24.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.558+0000 7f6e0da00640 1 --2- 172.21.15.12:0/1796903998 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e08101440 0x7f6e08105910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:24.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.558+0000 7f6e0da00640 1 --2- 172.21.15.12:0/1796903998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e08100b20 0x7f6e08100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:24.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.558+0000 7f6e0da00640 1 -- 172.21.15.12:0/1796903998 >> 172.21.15.12:0/1796903998 conn(0x7f6e080fc7d0 msgr2=0x7f6e080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:24.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.558+0000 7f6e0da00640 1 -- 172.21.15.12:0/1796903998 shutdown_connections 2024-09-05T01:24:24.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.558+0000 7f6e0da00640 1 -- 172.21.15.12:0/1796903998 wait complete. 2024-09-05T01:24:24.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.559+0000 7f6e0da00640 1 Processor -- start 2024-09-05T01:24:24.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.559+0000 7f6e0da00640 1 -- start start 2024-09-05T01:24:24.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.559+0000 7f6e0da00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e08100b20 0x7f6e081a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:24.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.559+0000 7f6e0da00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e08101440 0x7f6e081a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:24.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.559+0000 7f6e0da00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e08105f30 0x7f6e0819e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:24.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.559+0000 7f6e0da00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6e08118560 con 0x7f6e08101440 2024-09-05T01:24:24.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.559+0000 7f6e0da00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6e081183e0 con 0x7f6e08100b20 2024-09-05T01:24:24.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.559+0000 7f6e0da00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6e081186e0 con 0x7f6e08105f30 2024-09-05T01:24:24.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.559+0000 7f6dfe000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e08101440 0x7f6e081a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:24.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.559+0000 7f6e07400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e08105f30 0x7f6e0819e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:24.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.560+0000 7f6dfe000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e08101440 0x7f6e081a4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37986/0 (socket says 172.21.15.12:37986) 2024-09-05T01:24:24.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.560+0000 7f6dfe000640 1 -- 172.21.15.12:0/1683324027 learned_addr learned my addr 172.21.15.12:0/1683324027 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:24.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.560+0000 7f6e06a00640 1 --2- 172.21.15.12:0/1683324027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e08100b20 0x7f6e081a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:24.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.560+0000 7f6e07400640 1 -- 172.21.15.12:0/1683324027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e08100b20 msgr2=0x7f6e081a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:24.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.560+0000 7f6e07400640 1 --2- 172.21.15.12:0/1683324027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e08100b20 0x7f6e081a4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:24.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.560+0000 7f6e07400640 1 -- 172.21.15.12:0/1683324027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e08101440 msgr2=0x7f6e081a4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:24.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.560+0000 7f6e07400640 1 --2- 172.21.15.12:0/1683324027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e08101440 0x7f6e081a4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:24.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.560+0000 7f6e07400640 1 -- 172.21.15.12:0/1683324027 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e0819efb0 con 0x7f6e08105f30 2024-09-05T01:24:24.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.560+0000 7f6dfe000640 1 --2- 172.21.15.12:0/1683324027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e08101440 0x7f6e081a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:24.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.560+0000 7f6e07400640 1 --2- 172.21.15.12:0/1683324027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e08105f30 0x7f6e0819e810 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6e00006010 tx=0x7f6e0002f640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:24.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.560+0000 7f6dffe00640 1 -- 172.21.15.12:0/1683324027 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00034040 con 0x7f6e08105f30 2024-09-05T01:24:24.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.561+0000 7f6e0da00640 1 -- 172.21.15.12:0/1683324027 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e0819f240 con 0x7f6e08105f30 2024-09-05T01:24:24.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.561+0000 7f6dffe00640 1 -- 172.21.15.12:0/1683324027 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e00003e50 con 0x7f6e08105f30 2024-09-05T01:24:24.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.561+0000 7f6dffe00640 1 -- 172.21.15.12:0/1683324027 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e000046a0 con 0x7f6e08105f30 2024-09-05T01:24:24.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.561+0000 7f6e0da00640 1 -- 172.21.15.12:0/1683324027 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e081ab4f0 con 0x7f6e08105f30 2024-09-05T01:24:24.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.562+0000 7f6e0da00640 1 -- 172.21.15.12:0/1683324027 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e0806b070 con 0x7f6e08105f30 2024-09-05T01:24:24.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.563+0000 7f6dffe00640 1 -- 172.21.15.12:0/1683324027 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6e00037020 con 0x7f6e08105f30 2024-09-05T01:24:24.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.565+0000 7f6dffe00640 1 --2- 172.21.15.12:0/1683324027 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6dec0a2b80 0x7f6dec0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:24.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.565+0000 7f6dffe00640 1 -- 172.21.15.12:0/1683324027 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7f6e000f0160 con 0x7f6e08105f30 2024-09-05T01:24:24.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.565+0000 7f6e06a00640 1 --2- 172.21.15.12:0/1683324027 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6dec0a2b80 0x7f6dec0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:24.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.566+0000 7f6e06a00640 1 --2- 172.21.15.12:0/1683324027 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6dec0a2b80 0x7f6dec0a5040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6df8009bd0 tx=0x7f6df8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:24.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.567+0000 7f6dffe00640 1 -- 172.21.15.12:0/1683324027 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e000bd090 con 0x7f6e08105f30 2024-09-05T01:24:24.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:24 smithi145 ceph-mon[34376]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-05T01:24:24.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:24 smithi145 ceph-mon[34376]: osdmap e85: 12 total, 12 up, 12 in 2024-09-05T01:24:24.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:24 smithi145 ceph-mon[34376]: pgmap v346: 97 pgs: 1 peering, 96 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 383 B/s wr, 10 op/s 2024-09-05T01:24:24.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:24 smithi151 ceph-mon[35013]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-05T01:24:24.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:24 smithi151 ceph-mon[35013]: osdmap e85: 12 total, 12 up, 12 in 2024-09-05T01:24:24.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:24 smithi151 ceph-mon[35013]: pgmap v346: 97 pgs: 1 peering, 96 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 383 B/s wr, 10 op/s 2024-09-05T01:24:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.759+0000 7f6e0da00640 1 -- 172.21.15.12:0/1683324027 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e081ab6c0 con 0x7f6e08105f30 2024-09-05T01:24:24.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.761+0000 7f6dffe00640 1 -- 172.21.15.12:0/1683324027 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22859 (secure 0 0 0) 0x7f6e000bc990 con 0x7f6e08105f30 2024-09-05T01:24:24.762 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:24:24.763 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":85,"fsid":"0d44cd7e-6b24-11ef-bcd6-c7b262605968","created":"2024-09-05T01:14:21.162850+0000","modified":"2024-09-05T01:24:23.274328+0000","last_up_change":"2024-09-05T01:21:37.145073+0000","last_in_change":"2024-09-05T01:21:15.076991+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T01:17:44.744065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T01:22:31.540178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T01:22:33.999318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b74ac640-b680-46e2-9106-d24168e685e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6803","nonce":2090563987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6805","nonce":2090563987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6809","nonce":2090563987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6807","nonce":2090563987}]},"public_addr":"172.21.15.12:6803/2090563987","cluster_addr":"172.21.15.12:6805/2090563987","heartbeat_back_addr":"172.21.15.12:6809/2090563987","heartbeat_front_addr":"172.21.15.12:6807/2090563987","state":["exists","up"]},{"osd":1,"uuid":"efca1216-8d85-4e6a-8c49-0afb511ece59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6801","nonce":2639126629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6803","nonce":2639126629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6807","nonce":2639126629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6805","nonce":2639126629}]},"public_addr":"172.21.15.145:6801/2639126629","cluster_addr":"172.21.15.145:6803/2639126629","heartbeat_back_addr":"172.21.15.145:6807/2639126629","heartbeat_front_addr":"172.21.15.145:6805/2639126629","state":["exists","up"]},{"osd":2,"uuid":"4d5699b2-646a-4ab6-94a5-ad223aa27ac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6801","nonce":3753171761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6803","nonce":3753171761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6807","nonce":3753171761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6805","nonce":3753171761}]},"public_addr":"172.21.15.151:6801/3753171761","cluster_addr":"172.21.15.151:6803/3753171761","heartbeat_back_addr":"172.21.15.151:6807/3753171761","heartbeat_front_addr":"172.21.15.151:6805/3753171761","state":["exists","up"]},{"osd":3,"uuid":"275ad2ad-93e6-4a68-8784-8f8dcb620f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6811","nonce":2231650146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6813","nonce":2231650146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6817","nonce":2231650146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6815","nonce":2231650146}]},"public_addr":"172.21.15.12:6811/2231650146","cluster_addr":"172.21.15.12:6813/2231650146","heartbeat_back_addr":"172.21.15.12:6817/2231650146","heartbeat_front_addr":"172.21.15.12:6815/2231650146","state":["exists","up"]},{"osd":4,"uuid":"21a0c5b4-4e0e-4fb6-8be6-a300cb811cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6809","nonce":1828591275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6811","nonce":1828591275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6815","nonce":1828591275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6813","nonce":1828591275}]},"public_addr":"172.21.15.145:6809/1828591275","cluster_addr":"172.21.15.145:6811/1828591275","heartbeat_back_addr":"172.21.15.145:6815/1828591275","heartbeat_front_addr":"172.21.15.145:6813/1828591275","state":["exists","up"]},{"osd":5,"uuid":"e2c7e6fb-5dea-459f-8d7a-7ae5b1936218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6809","nonce":3888870109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6811","nonce":3888870109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6815","nonce":3888870109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6813","nonce":3888870109}]},"public_addr":"172.21.15.151:6809/3888870109","cluster_addr":"172.21.15.151:6811/3888870109","heartbeat_back_addr":"172.21.15.151:6815/3888870109","heartbeat_front_addr":"172.21.15.151:6813/3888870109","state":["exists","up"]},{"osd":6,"uuid":"0df0a29c-3404-4ff5-ae48-78b69b77cbd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6819","nonce":3084810269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6821","nonce":3084810269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6825","nonce":3084810269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6823","nonce":3084810269}]},"public_addr":"172.21.15.12:6819/3084810269","cluster_addr":"172.21.15.12:6821/3084810269","heartbeat_back_addr":"172.21.15.12:6825/3084810269","heartbeat_front_addr":"172.21.15.12:6823/3084810269","state":["exists","up"]},{"osd":7,"uuid":"c7b3ad7c-a566-435c-9ef8-837bb764acb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6817","nonce":3058588721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6819","nonce":3058588721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6823","nonce":3058588721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6821","nonce":3058588721}]},"public_addr":"172.21.15.145:6817/3058588721","cluster_addr":"172.21.15.145:6819/3058588721","heartbeat_back_addr":"172.21.15.145:6823/3058588721","heartbeat_front_addr":"172.21.15.145:6821/3058588721","state":["exists","up"]},{"osd":8,"uuid":"8018a468-fbc5-4667-a53c-2e97c08713bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6817","nonce":905705309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6819","nonce":905705309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6823","nonce":905705309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6821","nonce":905705309}]},"public_addr":"172.21.15.151:6817/905705309","cluster_addr":"172.21.15.151:6819/905705309","heartbeat_back_addr":"172.21.15.151:6823/905705309","heartbeat_front_addr":"172.21.15.151:6821/905705309","state":["exists","up"]},{"osd":9,"uuid":"dcf3b524-c8b8-4ab6-83c6-fc52c776d72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6827","nonce":1193852496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6829","nonce":1193852496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6833","nonce":1193852496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6831","nonce":1193852496}]},"public_addr":"172.21.15.12:6827/1193852496","cluster_addr":"172.21.15.12:6829/1193852496","heartbeat_back_addr":"172.21.15.12:6833/1193852496","heartbeat_front_addr":"172.21.15.12:6831/1193852496","state":["exists","up"]},{"osd":10,"uuid":"7b5b34c3-8814-4d16-80ce-0b0c9be07cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6825","nonce":1296813755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6827","nonce":1296813755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6831","nonce":1296813755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6829","nonce":1296813755}]},"public_addr":"172.21.15.145:6825/1296813755","cluster_addr":"172.21.15.145:6827/1296813755","heartbeat_back_addr":"172.21.15.145:6831/1296813755","heartbeat_front_addr":"172.21.15.145:6829/1296813755","state":["exists","up"]},{"osd":11,"uuid":"157ee32a-43f0-4e5a-8dac-fce53c1efdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6825","nonce":2855185758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6827","nonce":2855185758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6831","nonce":2855185758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6829","nonce":2855185758}]},"public_addr":"172.21.15.151:6825/2855185758","cluster_addr":"172.21.15.151:6827/2855185758","heartbeat_back_addr":"172.21.15.151:6831/2855185758","heartbeat_front_addr":"172.21.15.151:6829/2855185758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:16:52.947222+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:17:17.845611+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:17:41.769521+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:10.848974+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:35.471340+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:59.554980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:19:28.908089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:19:53.540000+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:20:17.764886+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:20:46.835859+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:21:12.186176+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:21:35.863935+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9},{"from":4,"to":7}]},{"pgid":"3.19","mappings":[{"from":3,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/1132389058":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6801/4067110310":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/1040591124":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/1171838695":"2024-09-06T01:14:54.625209+0000","172.21.15.12:6800/4067110310":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/784506983":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/992405704":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6801/3541208629":"2024-09-06T01:14:54.625209+0000","172.21.15.12:6800/3541208629":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/1532325396":"2024-09-06T01:14:54.625209+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T01:24:24.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.763+0000 7f6e0da00640 1 -- 172.21.15.12:0/1683324027 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6dec0a2b80 msgr2=0x7f6dec0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:24.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.763+0000 7f6e0da00640 1 --2- 172.21.15.12:0/1683324027 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6dec0a2b80 0x7f6dec0a5040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6df8009bd0 tx=0x7f6df8005f90 comp rx=0 tx=0).stop 2024-09-05T01:24:24.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.763+0000 7f6e0da00640 1 -- 172.21.15.12:0/1683324027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e08105f30 msgr2=0x7f6e0819e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:24.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.763+0000 7f6e0da00640 1 --2- 172.21.15.12:0/1683324027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e08105f30 0x7f6e0819e810 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6e00006010 tx=0x7f6e0002f640 comp rx=0 tx=0).stop 2024-09-05T01:24:24.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.764+0000 7f6e0da00640 1 -- 172.21.15.12:0/1683324027 shutdown_connections 2024-09-05T01:24:24.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.764+0000 7f6e0da00640 1 --2- 172.21.15.12:0/1683324027 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6dec0a2b80 0x7f6dec0a5040 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:24.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.764+0000 7f6e0da00640 1 --2- 172.21.15.12:0/1683324027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e08105f30 0x7f6e0819e810 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:24.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.764+0000 7f6e0da00640 1 --2- 172.21.15.12:0/1683324027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e08101440 0x7f6e081a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:24.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.764+0000 7f6e0da00640 1 --2- 172.21.15.12:0/1683324027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e08100b20 0x7f6e081a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:24.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.764+0000 7f6e0da00640 1 -- 172.21.15.12:0/1683324027 >> 172.21.15.12:0/1683324027 conn(0x7f6e080fc7d0 msgr2=0x7f6e081038e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:24.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.764+0000 7f6e0da00640 1 -- 172.21.15.12:0/1683324027 shutdown_connections 2024-09-05T01:24:24.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:24.764+0000 7f6e0da00640 1 -- 172.21.15.12:0/1683324027 wait complete. 2024-09-05T01:24:25.493 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:25 smithi012 ceph-mon[29942]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-05T01:24:25.493 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:25 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/1683324027' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:24:25.531 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-05T01:22:35.979384+0000', 'modified': '2024-09-05T01:22:47.915851+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24560, 'mds_1': 24529, 'mds_2': 24524, 'mds_3': 24517, 'mds_4': 24460}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14544': {'gid': 14544, 'name': 'a', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.12:6841/497406458', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6840', 'nonce': 497406458}, {'type': 'v1', 'addr': '172.21.15.12:6841', 'nonce': 497406458}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24460': {'gid': 24460, 'name': 'l', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.151:6833/1259141438', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6832', 'nonce': 1259141438}, {'type': 'v1', 'addr': '172.21.15.151:6833', 'nonce': 1259141438}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24461': {'gid': 24461, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.145:6833/2656226932', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6832', 'nonce': 2656226932}, {'type': 'v1', 'addr': '172.21.15.145:6833', 'nonce': 2656226932}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24473': {'gid': 24473, 'name': 'j', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.12:6835/544280854', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 544280854}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 544280854}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.145:6835/397717562', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6834', 'nonce': 397717562}, {'type': 'v1', 'addr': '172.21.15.145:6835', 'nonce': 397717562}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24505': {'gid': 24505, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.151:6835/309674660', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6834', 'nonce': 309674660}, {'type': 'v1', 'addr': '172.21.15.151:6835', 'nonce': 309674660}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24517': {'gid': 24517, 'name': 'c', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.151:6837/3977122893', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6836', 'nonce': 3977122893}, {'type': 'v1', 'addr': '172.21.15.151:6837', 'nonce': 3977122893}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24524': {'gid': 24524, 'name': 'h', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.145:6837/3765112395', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6836', 'nonce': 3765112395}, {'type': 'v1', 'addr': '172.21.15.145:6837', 'nonce': 3765112395}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24529': {'gid': 24529, 'name': 'i', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.151:6839/2331000490', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6838', 'nonce': 2331000490}, {'type': 'v1', 'addr': '172.21.15.151:6839', 'nonce': 2331000490}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24560': {'gid': 24560, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.145:6839/1706431882', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.145:6838', 'nonce': 1706431882}, {'type': 'v1', 'addr': '172.21.15.145:6839', 'nonce': 1706431882}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24560, 'qdb_cluster': [24460, 24517, 24524, 24529, 24560]} 2024-09-05T01:24:25.531 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-05T01:24:25.531 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.l status 2024-09-05T01:24:25.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:25 smithi145 ceph-mon[34376]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-05T01:24:25.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:25 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/1683324027' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:24:25.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:25 smithi151 ceph-mon[35013]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-05T01:24:25.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:25 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/1683324027' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:24:25.909 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:24:26.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.492+0000 7f201d800640 1 -- 172.21.15.12:0/2079615858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2018102360 msgr2=0x7f201810e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:26.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.492+0000 7f201d800640 1 --2- 172.21.15.12:0/2079615858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2018102360 0x7f201810e890 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2010009cd0 tx=0x7f201002a8e0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.492+0000 7f201d800640 1 -- 172.21.15.12:0/2079615858 shutdown_connections 2024-09-05T01:24:26.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.492+0000 7f201d800640 1 --2- 172.21.15.12:0/2079615858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2018102360 0x7f201810e890 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.492+0000 7f201d800640 1 --2- 172.21.15.12:0/2079615858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20181019c0 0x7f2018101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.492+0000 7f201d800640 1 --2- 172.21.15.12:0/2079615858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20181079c0 0x7f2018107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.492+0000 7f201d800640 1 -- 172.21.15.12:0/2079615858 >> 172.21.15.12:0/2079615858 conn(0x7f20180fd740 msgr2=0x7f20180ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:26.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.492+0000 7f201d800640 1 -- 172.21.15.12:0/2079615858 shutdown_connections 2024-09-05T01:24:26.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.492+0000 7f201d800640 1 -- 172.21.15.12:0/2079615858 wait complete. 2024-09-05T01:24:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.493+0000 7f201d800640 1 Processor -- start 2024-09-05T01:24:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.493+0000 7f201d800640 1 -- start start 2024-09-05T01:24:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.494+0000 7f201d800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20181019c0 0x7f2018198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.494+0000 7f201d800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2018102360 0x7f20181987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.494+0000 7f201d800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20181079c0 0x7f201819cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.494+0000 7f201d800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2018111dc0 con 0x7f2018102360 2024-09-05T01:24:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.494+0000 7f201d800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2018111c40 con 0x7f20181079c0 2024-09-05T01:24:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.494+0000 7f201d800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2018111f40 con 0x7f20181019c0 2024-09-05T01:24:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.494+0000 7f2017400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2018102360 0x7f20181987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.494+0000 7f2017400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2018102360 0x7f20181987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38008/0 (socket says 172.21.15.12:38008) 2024-09-05T01:24:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.494+0000 7f2017400640 1 -- 172.21.15.12:0/849713118 learned_addr learned my addr 172.21.15.12:0/849713118 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.494+0000 7f2017e00640 1 --2- 172.21.15.12:0/849713118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20181019c0 0x7f2018198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.494+0000 7f201ce00640 1 --2- 172.21.15.12:0/849713118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20181079c0 0x7f201819cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.494+0000 7f2017e00640 1 -- 172.21.15.12:0/849713118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20181079c0 msgr2=0x7f201819cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.494+0000 7f2017e00640 1 --2- 172.21.15.12:0/849713118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20181079c0 0x7f201819cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.494+0000 7f2017e00640 1 -- 172.21.15.12:0/849713118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2018102360 msgr2=0x7f20181987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.494+0000 7f2017e00640 1 --2- 172.21.15.12:0/849713118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2018102360 0x7f20181987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.494+0000 7f2017e00640 1 -- 172.21.15.12:0/849713118 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f201819d230 con 0x7f20181019c0 2024-09-05T01:24:26.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.495+0000 7f2017400640 1 --2- 172.21.15.12:0/849713118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2018102360 0x7f20181987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:26.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.495+0000 7f2017e00640 1 --2- 172.21.15.12:0/849713118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20181019c0 0x7f2018198280 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f200800e9f0 tx=0x7f200800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:26.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.495+0000 7f2014c00640 1 -- 172.21.15.12:0/849713118 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200800ccc0 con 0x7f20181019c0 2024-09-05T01:24:26.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.495+0000 7f201d800640 1 -- 172.21.15.12:0/849713118 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f201819d520 con 0x7f20181019c0 2024-09-05T01:24:26.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.495+0000 7f2014c00640 1 -- 172.21.15.12:0/849713118 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2008005020 con 0x7f20181019c0 2024-09-05T01:24:26.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.495+0000 7f2014c00640 1 -- 172.21.15.12:0/849713118 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20080049e0 con 0x7f20181019c0 2024-09-05T01:24:26.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.495+0000 7f201d800640 1 -- 172.21.15.12:0/849713118 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20181a4e00 con 0x7f20181019c0 2024-09-05T01:24:26.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.498+0000 7f20219ce740 1 Processor -- start 2024-09-05T01:24:26.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.498+0000 7f2014c00640 1 -- 172.21.15.12:0/849713118 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f2008005560 con 0x7f20181019c0 2024-09-05T01:24:26.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.498+0000 7f20219ce740 1 -- start start 2024-09-05T01:24:26.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.499+0000 7f20219ce740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5571e64948f0 0x5571e6494cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:26.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.499+0000 7f20219ce740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571e6495210 0x5571e649f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:26.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.499+0000 7f20219ce740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571e649fad0 0x5571e64a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:26.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.499+0000 7f20219ce740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5571e63f60b0 con 0x5571e649fad0 2024-09-05T01:24:26.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.499+0000 7f20219ce740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5571e639dab0 con 0x5571e64948f0 2024-09-05T01:24:26.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.499+0000 7f20219ce740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5571e63f2070 con 0x5571e6495210 2024-09-05T01:24:26.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.499+0000 7f2017400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571e649fad0 0x5571e64a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:26.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.499+0000 7f201ce00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5571e64948f0 0x5571e6494cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:26.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.499+0000 7f2017400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571e649fad0 0x5571e64a1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38020/0 (socket says 172.21.15.12:38020) 2024-09-05T01:24:26.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.499+0000 7f2017400640 1 -- 172.21.15.12:0/2957244787 learned_addr learned my addr 172.21.15.12:0/2957244787 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:26.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.499+0000 7f2017e00640 1 --2- 172.21.15.12:0/2957244787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571e6495210 0x5571e649f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.500+0000 7f2017e00640 1 -- 172.21.15.12:0/2957244787 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5571e64948f0 msgr2=0x5571e6494cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.500+0000 7f2017e00640 1 --2- 172.21.15.12:0/2957244787 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5571e64948f0 0x5571e6494cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.500+0000 7f2017e00640 1 -- 172.21.15.12:0/2957244787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571e649fad0 msgr2=0x5571e64a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.500+0000 7f2017e00640 1 --2- 172.21.15.12:0/2957244787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571e649fad0 0x5571e64a1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.500+0000 7f2017e00640 1 -- 172.21.15.12:0/2957244787 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571e63aa4a0 con 0x5571e6495210 2024-09-05T01:24:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.500+0000 7f201ce00640 1 --2- 172.21.15.12:0/2957244787 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5571e64948f0 0x5571e6494cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.500+0000 7f2017e00640 1 --2- 172.21.15.12:0/2957244787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571e6495210 0x5571e649f590 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f20080cc9d0 tx=0x7f20080d7220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f20fcf100f9244e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.500+0000 7f2014c00640 1 --2- 172.21.15.12:0/849713118 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f1ffc0a2b80 0x7f1ffc0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.500+0000 7f200d600640 1 -- 172.21.15.12:0/2957244787 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20080e2070 con 0x5571e6495210 2024-09-05T01:24:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.500+0000 7f200d600640 1 -- 172.21.15.12:0/2957244787 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f200809be90 con 0x5571e6495210 2024-09-05T01:24:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.500+0000 7f200d600640 1 -- 172.21.15.12:0/2957244787 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2008083d30 con 0x5571e6495210 2024-09-05T01:24:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.501+0000 7f2014c00640 1 -- 172.21.15.12:0/849713118 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7f20080cefc0 con 0x7f20181019c0 2024-09-05T01:24:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.501+0000 7f201ce00640 1 --2- 172.21.15.12:0/849713118 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f1ffc0a2b80 0x7f1ffc0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.501+0000 7f20219ce740 1 -- 172.21.15.12:0/2957244787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571e6495210 msgr2=0x5571e649f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.501+0000 7f20219ce740 1 --2- 172.21.15.12:0/2957244787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571e6495210 0x5571e649f590 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f20080cc9d0 tx=0x7f20080d7220 comp rx=0 tx=0).stop 2024-09-05T01:24:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.501+0000 7f201ce00640 1 --2- 172.21.15.12:0/849713118 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f1ffc0a2b80 0x7f1ffc0a5040 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2010004ab0 tx=0x7f2010004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.501+0000 7f20219ce740 1 -- 172.21.15.12:0/2957244787 shutdown_connections 2024-09-05T01:24:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.501+0000 7f20219ce740 1 --2- 172.21.15.12:0/2957244787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571e649fad0 0x5571e64a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.501+0000 7f20219ce740 1 --2- 172.21.15.12:0/2957244787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571e6495210 0x5571e649f590 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.501+0000 7f20219ce740 1 --2- 172.21.15.12:0/2957244787 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5571e64948f0 0x5571e6494cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.501+0000 7f20219ce740 1 -- 172.21.15.12:0/2957244787 >> 172.21.15.12:0/2957244787 conn(0x5571e6490e80 msgr2=0x5571e6491260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.501+0000 7f20219ce740 1 -- 172.21.15.12:0/2957244787 shutdown_connections 2024-09-05T01:24:26.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.501+0000 7f20219ce740 1 -- 172.21.15.12:0/2957244787 wait complete. 2024-09-05T01:24:26.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.502+0000 7f20219ce740 1 -- start start 2024-09-05T01:24:26.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.502+0000 7f20219ce740 1 Processor -- start 2024-09-05T01:24:26.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.503+0000 7f20219ce740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571e64948f0 0x5571e649c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:26.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.503+0000 7f20219ce740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5571e6495210 0x5571e649ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:26.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.503+0000 7f20219ce740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571e649fad0 0x5571e649d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:26.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.503+0000 7f20219ce740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5571e64a2740 con 0x5571e649fad0 2024-09-05T01:24:26.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.503+0000 7f20219ce740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5571e637e920 con 0x5571e6495210 2024-09-05T01:24:26.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.503+0000 7f20219ce740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5571e64a28c0 con 0x5571e64948f0 2024-09-05T01:24:26.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.503+0000 7f20219ce740 10 client.0 _ll_register_callbacks cb 0x5571e63a28a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:24:26.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.503+0000 7f2017400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5571e6495210 0x5571e649ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:26.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.503+0000 7f2017400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5571e6495210 0x5571e649ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:49222/0 (socket says 172.21.15.12:49222) 2024-09-05T01:24:26.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.503+0000 7f2017400640 1 -- 172.21.15.12:0/1244481310 learned_addr learned my addr 172.21.15.12:0/1244481310 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:26.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.503+0000 7f2017e00640 1 --2- 172.21.15.12:0/1244481310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571e64948f0 0x5571e649c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:26.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.503+0000 7f201ce00640 1 --2- 172.21.15.12:0/1244481310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571e649fad0 0x5571e649d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:26.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.503+0000 7f2017400640 1 -- 172.21.15.12:0/1244481310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571e64948f0 msgr2=0x5571e649c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:26.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.503+0000 7f2017400640 1 --2- 172.21.15.12:0/1244481310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571e64948f0 0x5571e649c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.503+0000 7f2017400640 1 -- 172.21.15.12:0/1244481310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571e649fad0 msgr2=0x5571e649d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:26.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.503+0000 7f2017400640 1 --2- 172.21.15.12:0/1244481310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571e649fad0 0x5571e649d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.503+0000 7f2017400640 1 -- 172.21.15.12:0/1244481310 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571e61672b0 con 0x5571e6495210 2024-09-05T01:24:26.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.504+0000 7f2017400640 1 --2- 172.21.15.12:0/1244481310 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5571e6495210 0x5571e649ceb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2004012d50 tx=0x7f200400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf03ceaf29e05e5b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:26.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.504+0000 7f2002000640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:24:26.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.504+0000 7f2002000640 1 -- 172.21.15.12:0/1244481310 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2004004050 con 0x5571e6495210 2024-09-05T01:24:26.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.504+0000 7f2002000640 1 -- 172.21.15.12:0/1244481310 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7f20040041f0 con 0x5571e6495210 2024-09-05T01:24:26.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.504+0000 7f20219ce740 1 -- 172.21.15.12:0/1244481310 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f200809be90 con 0x5571e6495210 2024-09-05T01:24:26.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.504+0000 7f2002000640 1 -- 172.21.15.12:0/1244481310 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2004022030 con 0x5571e6495210 2024-09-05T01:24:26.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.504+0000 7f20219ce740 10 client.25052 fetch_fsmap learned FSMap version 27 2024-09-05T01:24:26.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.504+0000 7f20219ce740 1 -- 172.21.15.12:0/1244481310 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5571e64ae400 con 0x5571e6495210 2024-09-05T01:24:26.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.505+0000 7f2002000640 1 -- 172.21.15.12:0/1244481310 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f200809be90 con 0x5571e6495210 2024-09-05T01:24:26.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.505+0000 7f2002000640 1 -- 172.21.15.12:0/1244481310 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2004027450 con 0x5571e6495210 2024-09-05T01:24:26.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.505+0000 7f20219ce740 10 client.25052 fetch_fsmap finished waiting for FSMap version 27 2024-09-05T01:24:26.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.505+0000 7f20219ce740 10 client.25052 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-05T01:24:26.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.505+0000 7f20219ce740 20 client.25052 populate_metadata read hostname 'smithi012' 2024-09-05T01:24:26.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.505+0000 7f20219ce740 1 --2- 172.21.15.12:0/1244481310 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5571e64b0a70 0x5571e64b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:26.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.505+0000 7f20219ce740 4 client.25052 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:24:26.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.505+0000 7f20219ce740 1 -- 172.21.15.12:0/1244481310 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571e6403620 con 0x5571e64b0a70 2024-09-05T01:24:26.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.505+0000 7f2017e00640 1 --2- 172.21.15.12:0/1244481310 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5571e64b0a70 0x5571e64b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:26.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.506+0000 7f2017e00640 1 --2- 172.21.15.12:0/1244481310 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5571e64b0a70 0x5571e64b1ee0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=59296e7bf984c5e6 server_cookie=f985640d62c5a67c in_seq=0 out_seq=0 2024-09-05T01:24:26.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.506+0000 7f2002000640 10 client.25052 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:24:26.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.507+0000 7f2002000640 1 -- 172.21.15.12:0/1244481310 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5571e6403620 con 0x5571e64b0a70 2024-09-05T01:24:26.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.507+0000 7f2002000640 10 client.25052 handle_command_reply: tid=0 2024-09-05T01:24:26.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.507+0000 7f20219ce740 1 client.25052 shutdown 2024-09-05T01:24:26.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.507+0000 7f20219ce740 1 -- 172.21.15.12:0/1244481310 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5571e6495210 msgr2=0x5571e649ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:26.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.507+0000 7f20219ce740 1 --2- 172.21.15.12:0/1244481310 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5571e6495210 0x5571e649ceb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2004012d50 tx=0x7f200400f790 comp rx=0 tx=0).stop 2024-09-05T01:24:26.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.507+0000 7f20219ce740 1 -- 172.21.15.12:0/1244481310 shutdown_connections 2024-09-05T01:24:26.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.507+0000 7f20219ce740 1 --2- 172.21.15.12:0/1244481310 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5571e64b0a70 0x5571e64b1ee0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.507+0000 7f20219ce740 1 --2- 172.21.15.12:0/1244481310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571e649fad0 0x5571e649d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.507+0000 7f20219ce740 1 --2- 172.21.15.12:0/1244481310 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5571e6495210 0x5571e649ceb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.507+0000 7f20219ce740 1 --2- 172.21.15.12:0/1244481310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571e64948f0 0x5571e649c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.507+0000 7f2002000640 0 client.25052 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:24:26.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.507+0000 7f20219ce740 1 -- 172.21.15.12:0/1244481310 >> 172.21.15.12:0/1244481310 conn(0x5571e6490e80 msgr2=0x5571e648bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:26.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.507+0000 7f20219ce740 1 -- 172.21.15.12:0/1244481310 shutdown_connections 2024-09-05T01:24:26.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.507+0000 7f20219ce740 1 -- 172.21.15.12:0/1244481310 wait complete. 2024-09-05T01:24:26.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.508+0000 7f20219ce740 20 client.25052 trim_cache size 0 max 16384 2024-09-05T01:24:26.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.526+0000 7f20219ce740 1 Processor -- start 2024-09-05T01:24:26.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.526+0000 7f20219ce740 1 -- start start 2024-09-05T01:24:26.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.526+0000 7f20219ce740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571e64948f0 0x5571e64b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:26.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.526+0000 7f20219ce740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5571e6495210 0x5571e649d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:26.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.526+0000 7f20219ce740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571e649fad0 0x5571e648bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:26.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.527+0000 7f20219ce740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5571e64b0220 con 0x5571e64948f0 2024-09-05T01:24:26.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.527+0000 7f20219ce740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5571e64b08f0 con 0x5571e6495210 2024-09-05T01:24:26.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.527+0000 7f20219ce740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5571e64b0fc0 con 0x5571e649fad0 2024-09-05T01:24:26.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.527+0000 7f2017e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571e64948f0 0x5571e64b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:26.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.527+0000 7f201ce00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571e649fad0 0x5571e648bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:26.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.527+0000 7f2017e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571e64948f0 0x5571e64b1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38030/0 (socket says 172.21.15.12:38030) 2024-09-05T01:24:26.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.527+0000 7f201ce00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571e649fad0 0x5571e648bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:59896/0 (socket says 172.21.15.12:59896) 2024-09-05T01:24:26.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.527+0000 7f2017e00640 1 -- 172.21.15.12:0/1925409118 learned_addr learned my addr 172.21.15.12:0/1925409118 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:26.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.527+0000 7f2017400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5571e6495210 0x5571e649d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:26.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.527+0000 7f201ce00640 1 -- 172.21.15.12:0/1925409118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5571e6495210 msgr2=0x5571e649d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:26.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.527+0000 7f201ce00640 1 --2- 172.21.15.12:0/1925409118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5571e6495210 0x5571e649d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.527+0000 7f201ce00640 1 -- 172.21.15.12:0/1925409118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571e64948f0 msgr2=0x5571e64b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:26.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.527+0000 7f201ce00640 1 --2- 172.21.15.12:0/1925409118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571e64948f0 0x5571e64b1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.527+0000 7f201ce00640 1 -- 172.21.15.12:0/1925409118 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571e6495040 con 0x5571e649fad0 2024-09-05T01:24:26.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.528+0000 7f201ce00640 1 --2- 172.21.15.12:0/1925409118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571e649fad0 0x5571e648bac0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2010009ca0 tx=0x7f2010044000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc1353bcc172b9be server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:26.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.528+0000 7f200cc00640 1 -- 172.21.15.12:0/1925409118 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2010003bf0 con 0x5571e649fad0 2024-09-05T01:24:26.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.528+0000 7f200cc00640 1 -- 172.21.15.12:0/1925409118 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2010056070 con 0x5571e649fad0 2024-09-05T01:24:26.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.528+0000 7f200cc00640 1 -- 172.21.15.12:0/1925409118 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2010030990 con 0x5571e649fad0 2024-09-05T01:24:26.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.528+0000 7f20219ce740 1 -- 172.21.15.12:0/1925409118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571e649fad0 msgr2=0x5571e648bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:26.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.528+0000 7f20219ce740 1 --2- 172.21.15.12:0/1925409118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571e649fad0 0x5571e648bac0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2010009ca0 tx=0x7f2010044000 comp rx=0 tx=0).stop 2024-09-05T01:24:26.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.529+0000 7f20219ce740 1 -- 172.21.15.12:0/1925409118 shutdown_connections 2024-09-05T01:24:26.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.529+0000 7f20219ce740 1 --2- 172.21.15.12:0/1925409118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571e649fad0 0x5571e648bac0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.529+0000 7f20219ce740 1 --2- 172.21.15.12:0/1925409118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5571e6495210 0x5571e649d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.529+0000 7f20219ce740 1 --2- 172.21.15.12:0/1925409118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571e64948f0 0x5571e64b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.529+0000 7f20219ce740 1 -- 172.21.15.12:0/1925409118 >> 172.21.15.12:0/1925409118 conn(0x5571e6490e80 msgr2=0x5571e648b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:26.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.529+0000 7f20219ce740 1 -- 172.21.15.12:0/1925409118 shutdown_connections 2024-09-05T01:24:26.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.529+0000 7f20219ce740 1 -- 172.21.15.12:0/1925409118 wait complete. 2024-09-05T01:24:26.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.529+0000 7f20219ce740 1 -- start start 2024-09-05T01:24:26.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.529+0000 7f20219ce740 1 Processor -- start 2024-09-05T01:24:26.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.530+0000 7f20219ce740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571e64948f0 0x5571e64903b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:26.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.530+0000 7f20219ce740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5571e6495210 0x5571e64ba130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:26.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.530+0000 7f20219ce740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571e649fad0 0x5571e64ba8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:26.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.530+0000 7f20219ce740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5571e64b1d60 con 0x5571e64948f0 2024-09-05T01:24:26.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.530+0000 7f20219ce740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5571e64b1690 con 0x5571e6495210 2024-09-05T01:24:26.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.530+0000 7f20219ce740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5571e64b2430 con 0x5571e649fad0 2024-09-05T01:24:26.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.530+0000 7f20219ce740 10 client.0 _ll_register_callbacks cb 0x7f2004012930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:24:26.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.530+0000 7f2017e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571e64948f0 0x5571e64903b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:26.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.530+0000 7f2017e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571e64948f0 0x5571e64903b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38032/0 (socket says 172.21.15.12:38032) 2024-09-05T01:24:26.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.530+0000 7f2017e00640 1 -- 172.21.15.12:0/3636876908 learned_addr learned my addr 172.21.15.12:0/3636876908 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:26.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.530+0000 7f2017400640 1 --2- 172.21.15.12:0/3636876908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5571e6495210 0x5571e64ba130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:26.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.530+0000 7f201ce00640 1 --2- 172.21.15.12:0/3636876908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571e649fad0 0x5571e64ba8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:26.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.530+0000 7f2017e00640 1 -- 172.21.15.12:0/3636876908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571e649fad0 msgr2=0x5571e64ba8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:26.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.530+0000 7f2017e00640 1 --2- 172.21.15.12:0/3636876908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571e649fad0 0x5571e64ba8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.530+0000 7f2017e00640 1 -- 172.21.15.12:0/3636876908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5571e6495210 msgr2=0x5571e64ba130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:26.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.530+0000 7f2017e00640 1 --2- 172.21.15.12:0/3636876908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5571e6495210 0x5571e64ba130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.530+0000 7f2017e00640 1 -- 172.21.15.12:0/3636876908 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571e648d820 con 0x5571e64948f0 2024-09-05T01:24:26.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.531+0000 7f2017e00640 1 --2- 172.21.15.12:0/3636876908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571e64948f0 0x5571e64903b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2008082ea0 tx=0x7f20080054d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634c48c7bd4cce44 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:26.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.531+0000 7f2002000640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:24:26.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.531+0000 7f2002000640 1 -- 172.21.15.12:0/3636876908 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200801c040 con 0x5571e64948f0 2024-09-05T01:24:26.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.531+0000 7f2002000640 1 -- 172.21.15.12:0/3636876908 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7f2008099a90 con 0x5571e64948f0 2024-09-05T01:24:26.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.531+0000 7f20219ce740 1 -- 172.21.15.12:0/3636876908 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2010056070 con 0x5571e64948f0 2024-09-05T01:24:26.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.531+0000 7f2002000640 1 -- 172.21.15.12:0/3636876908 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f20080b9050 con 0x5571e64948f0 2024-09-05T01:24:26.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.531+0000 7f20219ce740 10 client.15051 fetch_fsmap learned FSMap version 27 2024-09-05T01:24:26.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.531+0000 7f20219ce740 1 -- 172.21.15.12:0/3636876908 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5571e651fc60 con 0x5571e64948f0 2024-09-05T01:24:26.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.531+0000 7f2002000640 1 -- 172.21.15.12:0/3636876908 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2010056070 con 0x5571e64948f0 2024-09-05T01:24:26.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.532+0000 7f2002000640 1 -- 172.21.15.12:0/3636876908 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f20080ccab0 con 0x5571e64948f0 2024-09-05T01:24:26.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.532+0000 7f20219ce740 10 client.15051 fetch_fsmap finished waiting for FSMap version 27 2024-09-05T01:24:26.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.532+0000 7f20219ce740 10 client.15051 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-05T01:24:26.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.532+0000 7f20219ce740 20 client.15051 populate_metadata read hostname 'smithi012' 2024-09-05T01:24:26.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.532+0000 7f20219ce740 1 --2- 172.21.15.12:0/3636876908 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5571e6524320 0x5571e6523030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:26.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.532+0000 7f20219ce740 4 client.15051 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T01:24:26.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.532+0000 7f20219ce740 1 -- 172.21.15.12:0/3636876908 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "status"}) -- 0x5571e63fdb30 con 0x5571e6524320 2024-09-05T01:24:26.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.532+0000 7f2017400640 1 --2- 172.21.15.12:0/3636876908 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5571e6524320 0x5571e6523030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:26.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.533+0000 7f2017400640 1 --2- 172.21.15.12:0/3636876908 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5571e6524320 0x5571e6523030 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b416041852787e7f server_cookie=476db0cfc7309a58 in_seq=0 out_seq=0 2024-09-05T01:24:26.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.533+0000 7f2002000640 10 client.15051 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:24:26.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.533+0000 7f2002000640 1 -- 172.21.15.12:0/3636876908 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5571e63fdb30 con 0x5571e6524320 2024-09-05T01:24:26.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.533+0000 7f2002000640 10 client.15051 handle_command_reply: tid=0 2024-09-05T01:24:26.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.533+0000 7f20219ce740 1 client.15051 shutdown 2024-09-05T01:24:26.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.533+0000 7f20219ce740 1 -- 172.21.15.12:0/3636876908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571e64948f0 msgr2=0x5571e64903b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:26.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.533+0000 7f20219ce740 1 --2- 172.21.15.12:0/3636876908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571e64948f0 0x5571e64903b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2008082ea0 tx=0x7f20080054d0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.533+0000 7f20219ce740 1 -- 172.21.15.12:0/3636876908 shutdown_connections 2024-09-05T01:24:26.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.533+0000 7f20219ce740 1 --2- 172.21.15.12:0/3636876908 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5571e6524320 0x5571e6523030 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.533+0000 7f20219ce740 1 --2- 172.21.15.12:0/3636876908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571e649fad0 0x5571e64ba8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.533+0000 7f20219ce740 1 --2- 172.21.15.12:0/3636876908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5571e6495210 0x5571e64ba130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.533+0000 7f20219ce740 1 --2- 172.21.15.12:0/3636876908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5571e64948f0 0x5571e64903b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.533+0000 7f20219ce740 1 -- 172.21.15.12:0/3636876908 >> 172.21.15.12:0/3636876908 conn(0x5571e6490e80 msgr2=0x5571e6496b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:26.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.533+0000 7f2002000640 0 client.15051 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:24:26.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.533+0000 7f20219ce740 1 -- 172.21.15.12:0/3636876908 shutdown_connections 2024-09-05T01:24:26.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.533+0000 7f20219ce740 1 -- 172.21.15.12:0/3636876908 wait complete. 2024-09-05T01:24:26.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.533+0000 7f20219ce740 20 client.15051 trim_cache size 0 max 16384 2024-09-05T01:24:26.539 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:24:26.539 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "0d44cd7e-6b24-11ef-bcd6-c7b262605968", 2024-09-05T01:24:26.539 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 4, 2024-09-05T01:24:26.539 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24460, 2024-09-05T01:24:26.539 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-05T01:24:26.539 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-05T01:24:26.539 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-05T01:24:26.539 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 99.672858559999995, 2024-09-05T01:24:26.539 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 27, 2024-09-05T01:24:26.539 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 85, 2024-09-05T01:24:26.539 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 81, 2024-09-05T01:24:26.539 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 157.604406173 2024-09-05T01:24:26.539 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:24:26.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.534+0000 7f201d800640 1 -- 172.21.15.12:0/849713118 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f1ffc0a2b80 msgr2=0x7f1ffc0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:26.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.534+0000 7f201d800640 1 --2- 172.21.15.12:0/849713118 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f1ffc0a2b80 0x7f1ffc0a5040 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2010004ab0 tx=0x7f2010004a40 comp rx=0 tx=0).stop 2024-09-05T01:24:26.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.534+0000 7f201d800640 1 -- 172.21.15.12:0/849713118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20181019c0 msgr2=0x7f2018198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:26.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.534+0000 7f201d800640 1 --2- 172.21.15.12:0/849713118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20181019c0 0x7f2018198280 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f200800e9f0 tx=0x7f200800eeb0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.534+0000 7f201d800640 1 -- 172.21.15.12:0/849713118 shutdown_connections 2024-09-05T01:24:26.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.534+0000 7f201d800640 1 --2- 172.21.15.12:0/849713118 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f1ffc0a2b80 0x7f1ffc0a5040 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.534+0000 7f201d800640 1 --2- 172.21.15.12:0/849713118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f20181079c0 0x7f201819cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.534+0000 7f201d800640 1 --2- 172.21.15.12:0/849713118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2018102360 0x7f20181987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.534+0000 7f201d800640 1 --2- 172.21.15.12:0/849713118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20181019c0 0x7f2018198280 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:26.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.534+0000 7f201d800640 1 -- 172.21.15.12:0/849713118 >> 172.21.15.12:0/849713118 conn(0x7f20180fd740 msgr2=0x7f20180fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:26.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.534+0000 7f201d800640 1 -- 172.21.15.12:0/849713118 shutdown_connections 2024-09-05T01:24:26.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:26.534+0000 7f201d800640 1 -- 172.21.15.12:0/849713118 wait complete. 2024-09-05T01:24:26.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:26 smithi012 ceph-mon[29942]: pgmap v347: 97 pgs: 1 peering, 96 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 895 B/s wr, 11 op/s 2024-09-05T01:24:26.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:26 smithi145 ceph-mon[34376]: pgmap v347: 97 pgs: 1 peering, 96 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 895 B/s wr, 11 op/s 2024-09-05T01:24:26.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:26 smithi151 ceph-mon[35013]: pgmap v347: 97 pgs: 1 peering, 96 active+clean; 644 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 895 B/s wr, 11 op/s 2024-09-05T01:24:27.482 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.c status 2024-09-05T01:24:27.856 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:24:28.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.529+0000 7f4814a00640 1 -- 172.21.15.12:0/1294400384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48101047e0 msgr2=0x7f4810108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:28.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.529+0000 7f4814a00640 1 --2- 172.21.15.12:0/1294400384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48101047e0 0x7f4810108830 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f47f8009900 tx=0x7f47f802a410 comp rx=0 tx=0).stop 2024-09-05T01:24:28.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.529+0000 7f4814a00640 1 -- 172.21.15.12:0/1294400384 shutdown_connections 2024-09-05T01:24:28.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.529+0000 7f4814a00640 1 --2- 172.21.15.12:0/1294400384 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4810108f60 0x7f4810110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.529+0000 7f4814a00640 1 --2- 172.21.15.12:0/1294400384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48101047e0 0x7f4810108830 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.529+0000 7f4814a00640 1 --2- 172.21.15.12:0/1294400384 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4810103e30 0x7f4810104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.529+0000 7f4814a00640 1 -- 172.21.15.12:0/1294400384 >> 172.21.15.12:0/1294400384 conn(0x7f48100ff910 msgr2=0x7f4810101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:28.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.529+0000 7f4814a00640 1 -- 172.21.15.12:0/1294400384 shutdown_connections 2024-09-05T01:24:28.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.529+0000 7f4814a00640 1 -- 172.21.15.12:0/1294400384 wait complete. 2024-09-05T01:24:28.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:28 smithi012 ceph-mon[29942]: pgmap v348: 97 pgs: 97 active+clean; 645 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.1 KiB/s wr, 9 op/s; 13 B/s, 0 objects/s recovering 2024-09-05T01:24:28.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:28 smithi012 ceph-mon[29942]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-05T01:24:28.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:28 smithi012 ceph-mon[29942]: Cluster is now healthy 2024-09-05T01:24:28.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.530+0000 7f4814a00640 1 Processor -- start 2024-09-05T01:24:28.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.530+0000 7f4814a00640 1 -- start start 2024-09-05T01:24:28.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.531+0000 7f4814a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4810103e30 0x7f481019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:28.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.531+0000 7f4814a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48101047e0 0x7f481019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:28.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.531+0000 7f4814a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4810108f60 0x7f481019ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:28.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.531+0000 7f4814a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4810114010 con 0x7f48101047e0 2024-09-05T01:24:28.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.531+0000 7f4814a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4810113e90 con 0x7f4810103e30 2024-09-05T01:24:28.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.531+0000 7f4814a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4810114190 con 0x7f4810108f60 2024-09-05T01:24:28.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.531+0000 7f4807e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48101047e0 0x7f481019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:28.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.531+0000 7f480e800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4810103e30 0x7f481019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:28.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.531+0000 7f4807e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48101047e0 0x7f481019a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56302/0 (socket says 172.21.15.12:56302) 2024-09-05T01:24:28.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.531+0000 7f4807e00640 1 -- 172.21.15.12:0/2342108578 learned_addr learned my addr 172.21.15.12:0/2342108578 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:28.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.531+0000 7f480f200640 1 --2- 172.21.15.12:0/2342108578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4810108f60 0x7f481019ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:28.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.531+0000 7f480f200640 1 -- 172.21.15.12:0/2342108578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4810103e30 msgr2=0x7f481019a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:28.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.531+0000 7f480f200640 1 --2- 172.21.15.12:0/2342108578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4810103e30 0x7f481019a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.531+0000 7f480f200640 1 -- 172.21.15.12:0/2342108578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48101047e0 msgr2=0x7f481019a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:28.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.531+0000 7f480f200640 1 --2- 172.21.15.12:0/2342108578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48101047e0 0x7f481019a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.532+0000 7f480f200640 1 -- 172.21.15.12:0/2342108578 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f481019f420 con 0x7f4810108f60 2024-09-05T01:24:28.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.532+0000 7f4807e00640 1 --2- 172.21.15.12:0/2342108578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48101047e0 0x7f481019a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:28.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.532+0000 7f480f200640 1 --2- 172.21.15.12:0/2342108578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4810108f60 0x7f481019ed40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4808009fd0 tx=0x7f480800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:28.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.532+0000 7f4807400640 1 -- 172.21.15.12:0/2342108578 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480800ce20 con 0x7f4810108f60 2024-09-05T01:24:28.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.532+0000 7f4814a00640 1 -- 172.21.15.12:0/2342108578 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f481019f710 con 0x7f4810108f60 2024-09-05T01:24:28.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.532+0000 7f4807400640 1 -- 172.21.15.12:0/2342108578 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4808005020 con 0x7f4810108f60 2024-09-05T01:24:28.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.532+0000 7f4807400640 1 -- 172.21.15.12:0/2342108578 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4808010720 con 0x7f4810108f60 2024-09-05T01:24:28.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.532+0000 7f4814a00640 1 -- 172.21.15.12:0/2342108578 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48101a6ff0 con 0x7f4810108f60 2024-09-05T01:24:28.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.535+0000 7f4817fea740 1 Processor -- start 2024-09-05T01:24:28.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.535+0000 7f4807400640 1 -- 172.21.15.12:0/2342108578 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4808005540 con 0x7f4810108f60 2024-09-05T01:24:28.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.536+0000 7f4817fea740 1 -- start start 2024-09-05T01:24:28.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.536+0000 7f4817fea740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb004e0 0x55803cb008c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.536+0000 7f4817fea740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55803cb00e00 0x55803cb0b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.536+0000 7f4817fea740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55803cb0b6c0 0x55803cb0dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.536+0000 7f4817fea740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55803ca660b0 con 0x55803cb0b6c0 2024-09-05T01:24:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.536+0000 7f4817fea740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55803ca0dab0 con 0x55803cb004e0 2024-09-05T01:24:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.536+0000 7f4817fea740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55803ca62070 con 0x55803cb00e00 2024-09-05T01:24:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.536+0000 7f480e800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55803cb00e00 0x55803cb0b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.536+0000 7f4807e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55803cb0b6c0 0x55803cb0dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.536+0000 7f4807e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb004e0 0x55803cb008c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.536+0000 7f480e800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55803cb00e00 0x55803cb0b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:53992/0 (socket says 172.21.15.12:53992) 2024-09-05T01:24:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.536+0000 7f480e800640 1 -- 172.21.15.12:0/2794804207 learned_addr learned my addr 172.21.15.12:0/2794804207 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.537+0000 7f480e800640 1 -- 172.21.15.12:0/2794804207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb004e0 msgr2=0x55803cb008c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.537+0000 7f480e800640 1 --2- 172.21.15.12:0/2794804207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb004e0 0x55803cb008c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.537+0000 7f480e800640 1 -- 172.21.15.12:0/2794804207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55803cb0b6c0 msgr2=0x55803cb0dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.537+0000 7f480e800640 1 --2- 172.21.15.12:0/2794804207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55803cb0b6c0 0x55803cb0dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.537+0000 7f480e800640 1 -- 172.21.15.12:0/2794804207 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55803ca1a4a0 con 0x55803cb00e00 2024-09-05T01:24:28.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.537+0000 7f4807e00640 1 --2- 172.21.15.12:0/2794804207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55803cb0b6c0 0x55803cb0dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:24:28.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.537+0000 7f480e800640 1 --2- 172.21.15.12:0/2794804207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55803cb00e00 0x55803cb0b180 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f480000bcd0 tx=0x7f48000107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f1166360256e7c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:28.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.537+0000 7f4807400640 1 --2- 172.21.15.12:0/2342108578 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f47f40a2b80 0x7f47f40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:28.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.537+0000 7f47ff400640 1 -- 172.21.15.12:0/2794804207 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4800005220 con 0x55803cb00e00 2024-09-05T01:24:28.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.537+0000 7f4807400640 1 -- 172.21.15.12:0/2342108578 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7f48080cf660 con 0x7f4810108f60 2024-09-05T01:24:28.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.538+0000 7f47ff400640 1 -- 172.21.15.12:0/2794804207 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4800004c80 con 0x55803cb00e00 2024-09-05T01:24:28.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.538+0000 7f47ff400640 1 -- 172.21.15.12:0/2794804207 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48000117a0 con 0x55803cb00e00 2024-09-05T01:24:28.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.538+0000 7f4807e00640 1 --2- 172.21.15.12:0/2342108578 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f47f40a2b80 0x7f47f40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:28.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.538+0000 7f4817fea740 1 -- 172.21.15.12:0/2794804207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55803cb00e00 msgr2=0x55803cb0b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:28.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.538+0000 7f4817fea740 1 --2- 172.21.15.12:0/2794804207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55803cb00e00 0x55803cb0b180 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f480000bcd0 tx=0x7f48000107a0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.538+0000 7f4807e00640 1 --2- 172.21.15.12:0/2342108578 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f47f40a2b80 0x7f47f40a5040 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f47f8031520 tx=0x7f47f80314b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:28.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.538+0000 7f4817fea740 1 -- 172.21.15.12:0/2794804207 shutdown_connections 2024-09-05T01:24:28.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.538+0000 7f4817fea740 1 --2- 172.21.15.12:0/2794804207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55803cb0b6c0 0x55803cb0dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.538+0000 7f4817fea740 1 --2- 172.21.15.12:0/2794804207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55803cb00e00 0x55803cb0b180 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.538+0000 7f4817fea740 1 --2- 172.21.15.12:0/2794804207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb004e0 0x55803cb008c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.538+0000 7f4817fea740 1 -- 172.21.15.12:0/2794804207 >> 172.21.15.12:0/2794804207 conn(0x55803cafca70 msgr2=0x55803cafce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:28.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.539+0000 7f4817fea740 1 -- 172.21.15.12:0/2794804207 shutdown_connections 2024-09-05T01:24:28.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.539+0000 7f4817fea740 1 -- 172.21.15.12:0/2794804207 wait complete. 2024-09-05T01:24:28.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.539+0000 7f4817fea740 1 -- start start 2024-09-05T01:24:28.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.539+0000 7f4817fea740 1 Processor -- start 2024-09-05T01:24:28.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.540+0000 7f4817fea740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55803cb004e0 0x55803cb085c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:28.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.540+0000 7f4817fea740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb00e00 0x55803cb08b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:28.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.540+0000 7f4817fea740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55803cb0b6c0 0x55803cb09040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:28.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.540+0000 7f4817fea740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55803cb0e330 con 0x55803cb004e0 2024-09-05T01:24:28.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.540+0000 7f4817fea740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55803c9ee920 con 0x55803cb00e00 2024-09-05T01:24:28.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.540+0000 7f4817fea740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55803cb0e4b0 con 0x55803cb0b6c0 2024-09-05T01:24:28.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.540+0000 7f4817fea740 10 client.0 _ll_register_callbacks cb 0x55803ca128a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:24:28.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.540+0000 7f4807e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb00e00 0x55803cb08b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:28.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.540+0000 7f4807e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb00e00 0x55803cb08b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:57024/0 (socket says 172.21.15.12:57024) 2024-09-05T01:24:28.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.540+0000 7f4807e00640 1 -- 172.21.15.12:0/456521061 learned_addr learned my addr 172.21.15.12:0/456521061 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:28.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.540+0000 7f480e800640 1 --2- 172.21.15.12:0/456521061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55803cb004e0 0x55803cb085c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:28.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.540+0000 7f480f200640 1 --2- 172.21.15.12:0/456521061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55803cb0b6c0 0x55803cb09040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:28.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.540+0000 7f4807e00640 1 -- 172.21.15.12:0/456521061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55803cb0b6c0 msgr2=0x55803cb09040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:28.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.540+0000 7f4807e00640 1 --2- 172.21.15.12:0/456521061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55803cb0b6c0 0x55803cb09040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.540+0000 7f4807e00640 1 -- 172.21.15.12:0/456521061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55803cb004e0 msgr2=0x55803cb085c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:28.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.540+0000 7f4807e00640 1 --2- 172.21.15.12:0/456521061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55803cb004e0 0x55803cb085c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.540+0000 7f4807e00640 1 -- 172.21.15.12:0/456521061 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55803c7d72b0 con 0x55803cb00e00 2024-09-05T01:24:28.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.541+0000 7f4807e00640 1 --2- 172.21.15.12:0/456521061 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb00e00 0x55803cb08b00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f47f8031b70 tx=0x7f47f802a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=240674feb7bcb551 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:28.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.541+0000 7f47f3e00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:24:28.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.541+0000 7f47f3e00640 1 -- 172.21.15.12:0/456521061 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f804e070 con 0x55803cb00e00 2024-09-05T01:24:28.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.541+0000 7f4817fea740 1 -- 172.21.15.12:0/456521061 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4800004c80 con 0x55803cb00e00 2024-09-05T01:24:28.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.541+0000 7f47f3e00640 1 -- 172.21.15.12:0/456521061 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7f47f8003a00 con 0x55803cb00e00 2024-09-05T01:24:28.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.541+0000 7f47f3e00640 1 -- 172.21.15.12:0/456521061 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f47f805a050 con 0x55803cb00e00 2024-09-05T01:24:28.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.541+0000 7f4817fea740 10 client.25070 fetch_fsmap learned FSMap version 27 2024-09-05T01:24:28.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.541+0000 7f4817fea740 1 -- 172.21.15.12:0/456521061 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55803cb1a040 con 0x55803cb00e00 2024-09-05T01:24:28.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.542+0000 7f47f3e00640 1 -- 172.21.15.12:0/456521061 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4800004c80 con 0x55803cb00e00 2024-09-05T01:24:28.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.542+0000 7f47f3e00640 1 -- 172.21.15.12:0/456521061 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f47f803c440 con 0x55803cb00e00 2024-09-05T01:24:28.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.542+0000 7f4817fea740 10 client.25070 fetch_fsmap finished waiting for FSMap version 27 2024-09-05T01:24:28.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.542+0000 7f4817fea740 10 client.25070 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-05T01:24:28.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.542+0000 7f4817fea740 20 client.25070 populate_metadata read hostname 'smithi012' 2024-09-05T01:24:28.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.542+0000 7f4817fea740 1 --2- 172.21.15.12:0/456521061 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55803cb1c680 0x55803cb1daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:28.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.542+0000 7f4817fea740 4 client.25070 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:24:28.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.542+0000 7f4817fea740 1 -- 172.21.15.12:0/456521061 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55803ca73620 con 0x55803cb1c680 2024-09-05T01:24:28.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.542+0000 7f480e800640 1 --2- 172.21.15.12:0/456521061 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55803cb1c680 0x55803cb1daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:28.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.543+0000 7f480e800640 1 --2- 172.21.15.12:0/456521061 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55803cb1c680 0x55803cb1daf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8248ba2460488b96 server_cookie=3aafd6237168d042 in_seq=0 out_seq=0 2024-09-05T01:24:28.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.543+0000 7f47f3e00640 10 client.25070 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:24:28.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.544+0000 7f47f3e00640 1 -- 172.21.15.12:0/456521061 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55803ca73620 con 0x55803cb1c680 2024-09-05T01:24:28.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.544+0000 7f47f3e00640 10 client.25070 handle_command_reply: tid=0 2024-09-05T01:24:28.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.544+0000 7f4817fea740 1 client.25070 shutdown 2024-09-05T01:24:28.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.544+0000 7f4817fea740 1 -- 172.21.15.12:0/456521061 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb00e00 msgr2=0x55803cb08b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:28.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.544+0000 7f4817fea740 1 --2- 172.21.15.12:0/456521061 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb00e00 0x55803cb08b00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f47f8031b70 tx=0x7f47f802a410 comp rx=0 tx=0).stop 2024-09-05T01:24:28.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.544+0000 7f4817fea740 1 -- 172.21.15.12:0/456521061 shutdown_connections 2024-09-05T01:24:28.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.544+0000 7f4817fea740 1 --2- 172.21.15.12:0/456521061 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55803cb1c680 0x55803cb1daf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.544+0000 7f4817fea740 1 --2- 172.21.15.12:0/456521061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55803cb0b6c0 0x55803cb09040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.544+0000 7f47f3e00640 0 client.25070 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:24:28.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.544+0000 7f4817fea740 1 --2- 172.21.15.12:0/456521061 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb00e00 0x55803cb08b00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.544+0000 7f4817fea740 1 --2- 172.21.15.12:0/456521061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55803cb004e0 0x55803cb085c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.544+0000 7f4817fea740 1 -- 172.21.15.12:0/456521061 >> 172.21.15.12:0/456521061 conn(0x55803cafca70 msgr2=0x55803cb02750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:28.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.544+0000 7f4817fea740 1 -- 172.21.15.12:0/456521061 shutdown_connections 2024-09-05T01:24:28.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.544+0000 7f4817fea740 1 -- 172.21.15.12:0/456521061 wait complete. 2024-09-05T01:24:28.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.544+0000 7f4817fea740 20 client.25070 trim_cache size 0 max 16384 2024-09-05T01:24:28.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.563+0000 7f4817fea740 1 Processor -- start 2024-09-05T01:24:28.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.563+0000 7f4817fea740 1 -- start start 2024-09-05T01:24:28.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.563+0000 7f4817fea740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55803cb004e0 0x55803caf7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:28.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.563+0000 7f4817fea740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55803cb00e00 0x55803cb06e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:28.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.563+0000 7f4817fea740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb0b6c0 0x55803cb073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:28.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.563+0000 7f4817fea740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55803cb1be30 con 0x55803cb00e00 2024-09-05T01:24:28.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.563+0000 7f4817fea740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55803cb1c500 con 0x55803cb0b6c0 2024-09-05T01:24:28.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.563+0000 7f4817fea740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55803cb1cbd0 con 0x55803cb004e0 2024-09-05T01:24:28.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.564+0000 7f4807e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55803cb00e00 0x55803cb06e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:28.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.564+0000 7f4807e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55803cb00e00 0x55803cb06e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56318/0 (socket says 172.21.15.12:56318) 2024-09-05T01:24:28.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.564+0000 7f4807e00640 1 -- 172.21.15.12:0/3452502617 learned_addr learned my addr 172.21.15.12:0/3452502617 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:28.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.564+0000 7f480f200640 1 --2- 172.21.15.12:0/3452502617 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb0b6c0 0x55803cb073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:28.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.564+0000 7f480e800640 1 --2- 172.21.15.12:0/3452502617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55803cb004e0 0x55803caf7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:28.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.564+0000 7f4807e00640 1 -- 172.21.15.12:0/3452502617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55803cb004e0 msgr2=0x55803caf7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:28.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.564+0000 7f4807e00640 1 --2- 172.21.15.12:0/3452502617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55803cb004e0 0x55803caf7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.564+0000 7f4807e00640 1 -- 172.21.15.12:0/3452502617 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb0b6c0 msgr2=0x55803cb073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:28.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.564+0000 7f4807e00640 1 --2- 172.21.15.12:0/3452502617 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb0b6c0 0x55803cb073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.564+0000 7f4807e00640 1 -- 172.21.15.12:0/3452502617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55803cafc8a0 con 0x55803cb00e00 2024-09-05T01:24:28.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.564+0000 7f480f200640 1 --2- 172.21.15.12:0/3452502617 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb0b6c0 0x55803cb073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:28.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.564+0000 7f4807e00640 1 --2- 172.21.15.12:0/3452502617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55803cb00e00 0x55803cb06e90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f47f8031fd0 tx=0x7f47f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e875df97838272d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:28.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.565+0000 7f47fea00640 1 -- 172.21.15.12:0/3452502617 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f804e070 con 0x55803cb00e00 2024-09-05T01:24:28.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.565+0000 7f47fea00640 1 -- 172.21.15.12:0/3452502617 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47f8031670 con 0x55803cb00e00 2024-09-05T01:24:28.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.565+0000 7f47fea00640 1 -- 172.21.15.12:0/3452502617 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f8035030 con 0x55803cb00e00 2024-09-05T01:24:28.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.565+0000 7f4817fea740 1 -- 172.21.15.12:0/3452502617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55803cb00e00 msgr2=0x55803cb06e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:28.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.565+0000 7f4817fea740 1 --2- 172.21.15.12:0/3452502617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55803cb00e00 0x55803cb06e90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f47f8031fd0 tx=0x7f47f80046c0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.565+0000 7f4817fea740 1 -- 172.21.15.12:0/3452502617 shutdown_connections 2024-09-05T01:24:28.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.565+0000 7f4817fea740 1 --2- 172.21.15.12:0/3452502617 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb0b6c0 0x55803cb073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.565+0000 7f4817fea740 1 --2- 172.21.15.12:0/3452502617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55803cb00e00 0x55803cb06e90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.565+0000 7f4817fea740 1 --2- 172.21.15.12:0/3452502617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55803cb004e0 0x55803caf7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.565+0000 7f4817fea740 1 -- 172.21.15.12:0/3452502617 >> 172.21.15.12:0/3452502617 conn(0x55803cafca70 msgr2=0x55803cb038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:28.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.565+0000 7f4817fea740 1 -- 172.21.15.12:0/3452502617 shutdown_connections 2024-09-05T01:24:28.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.565+0000 7f4817fea740 1 -- 172.21.15.12:0/3452502617 wait complete. 2024-09-05T01:24:28.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.566+0000 7f4817fea740 1 -- start start 2024-09-05T01:24:28.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.566+0000 7f4817fea740 1 Processor -- start 2024-09-05T01:24:28.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.566+0000 7f4817fea740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55803cb004e0 0x55803cb1ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:28.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.566+0000 7f4817fea740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb00e00 0x55803cb20520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:28.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.566+0000 7f4817fea740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55803cb0b6c0 0x55803cb25030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:28.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.566+0000 7f4817fea740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55803cb1d970 con 0x55803cb0b6c0 2024-09-05T01:24:28.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.566+0000 7f4817fea740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55803cb1d2a0 con 0x55803cb00e00 2024-09-05T01:24:28.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.566+0000 7f4817fea740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55803cb1e040 con 0x55803cb004e0 2024-09-05T01:24:28.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.567+0000 7f4817fea740 10 client.0 _ll_register_callbacks cb 0x7f47f8031820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:24:28.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.567+0000 7f4807e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb00e00 0x55803cb20520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:28.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.567+0000 7f480f200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55803cb0b6c0 0x55803cb25030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:28.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.567+0000 7f4807e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb00e00 0x55803cb20520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:57048/0 (socket says 172.21.15.12:57048) 2024-09-05T01:24:28.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.567+0000 7f4807e00640 1 -- 172.21.15.12:0/914540232 learned_addr learned my addr 172.21.15.12:0/914540232 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:28.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.567+0000 7f480e800640 1 --2- 172.21.15.12:0/914540232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55803cb004e0 0x55803cb1ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:28.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.567+0000 7f4807e00640 1 -- 172.21.15.12:0/914540232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55803cb004e0 msgr2=0x55803cb1ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:28.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.567+0000 7f4807e00640 1 --2- 172.21.15.12:0/914540232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55803cb004e0 0x55803cb1ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.567+0000 7f4807e00640 1 -- 172.21.15.12:0/914540232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55803cb0b6c0 msgr2=0x55803cb25030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:28.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.567+0000 7f4807e00640 1 --2- 172.21.15.12:0/914540232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55803cb0b6c0 0x55803cb25030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.567+0000 7f4807e00640 1 -- 172.21.15.12:0/914540232 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55803cb25570 con 0x55803cb00e00 2024-09-05T01:24:28.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.567+0000 7f480f200640 1 --2- 172.21.15.12:0/914540232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55803cb0b6c0 0x55803cb25030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:28.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.567+0000 7f480e800640 1 --2- 172.21.15.12:0/914540232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55803cb004e0 0x55803cb1ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:28.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.568+0000 7f4807e00640 1 --2- 172.21.15.12:0/914540232 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb00e00 0x55803cb20520 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f47f8004650 tx=0x7f47f803cf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ed2b308da871586 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:28.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.568+0000 7f47f3e00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:24:28.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.568+0000 7f47f3e00640 1 -- 172.21.15.12:0/914540232 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f804e050 con 0x55803cb00e00 2024-09-05T01:24:28.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.568+0000 7f47f3e00640 1 -- 172.21.15.12:0/914540232 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7f47f8003a00 con 0x55803cb00e00 2024-09-05T01:24:28.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.568+0000 7f4817fea740 1 -- 172.21.15.12:0/914540232 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47f8031670 con 0x55803cb00e00 2024-09-05T01:24:28.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.568+0000 7f47f3e00640 1 -- 172.21.15.12:0/914540232 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f47f8035040 con 0x55803cb00e00 2024-09-05T01:24:28.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.568+0000 7f4817fea740 10 client.25076 fetch_fsmap learned FSMap version 27 2024-09-05T01:24:28.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.568+0000 7f4817fea740 1 -- 172.21.15.12:0/914540232 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55803cb26870 con 0x55803cb00e00 2024-09-05T01:24:28.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.568+0000 7f47f3e00640 1 -- 172.21.15.12:0/914540232 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47f8031670 con 0x55803cb00e00 2024-09-05T01:24:28.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.568+0000 7f47f3e00640 1 -- 172.21.15.12:0/914540232 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f47f8053440 con 0x55803cb00e00 2024-09-05T01:24:28.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.569+0000 7f4817fea740 10 client.25076 fetch_fsmap finished waiting for FSMap version 27 2024-09-05T01:24:28.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.569+0000 7f4817fea740 10 client.25076 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-05T01:24:28.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.569+0000 7f4817fea740 20 client.25076 populate_metadata read hostname 'smithi012' 2024-09-05T01:24:28.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.569+0000 7f4817fea740 1 --2- 172.21.15.12:0/914540232 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55803cb8b1c0 0x55803cb89ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:28.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.569+0000 7f4817fea740 4 client.25076 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T01:24:28.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.569+0000 7f4817fea740 1 -- 172.21.15.12:0/914540232 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "status"}) -- 0x55803ca6db30 con 0x55803cb8b1c0 2024-09-05T01:24:28.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.569+0000 7f480e800640 1 --2- 172.21.15.12:0/914540232 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55803cb8b1c0 0x55803cb89ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:28.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.570+0000 7f480e800640 1 --2- 172.21.15.12:0/914540232 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55803cb8b1c0 0x55803cb89ed0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ca91d2822ce2bfda server_cookie=d35ca2297fc585ca in_seq=0 out_seq=0 2024-09-05T01:24:28.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.570+0000 7f47f3e00640 10 client.25076 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:24:28.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.570+0000 7f47f3e00640 1 -- 172.21.15.12:0/914540232 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55803ca6db30 con 0x55803cb8b1c0 2024-09-05T01:24:28.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.570+0000 7f47f3e00640 10 client.25076 handle_command_reply: tid=0 2024-09-05T01:24:28.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.570+0000 7f4817fea740 1 client.25076 shutdown 2024-09-05T01:24:28.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.570+0000 7f4817fea740 1 -- 172.21.15.12:0/914540232 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb00e00 msgr2=0x55803cb20520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:28.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.570+0000 7f4817fea740 1 --2- 172.21.15.12:0/914540232 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb00e00 0x55803cb20520 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f47f8004650 tx=0x7f47f803cf40 comp rx=0 tx=0).stop 2024-09-05T01:24:28.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.570+0000 7f4817fea740 1 -- 172.21.15.12:0/914540232 shutdown_connections 2024-09-05T01:24:28.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.570+0000 7f4817fea740 1 --2- 172.21.15.12:0/914540232 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55803cb8b1c0 0x55803cb89ed0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.570+0000 7f4817fea740 1 --2- 172.21.15.12:0/914540232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55803cb0b6c0 0x55803cb25030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.570+0000 7f47f3e00640 0 client.25076 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:24:28.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.570+0000 7f4817fea740 1 --2- 172.21.15.12:0/914540232 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55803cb00e00 0x55803cb20520 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.570+0000 7f4817fea740 1 --2- 172.21.15.12:0/914540232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55803cb004e0 0x55803cb1ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.570+0000 7f4817fea740 1 -- 172.21.15.12:0/914540232 >> 172.21.15.12:0/914540232 conn(0x55803cafca70 msgr2=0x55803cb038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:28.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.570+0000 7f4817fea740 1 -- 172.21.15.12:0/914540232 shutdown_connections 2024-09-05T01:24:28.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.570+0000 7f4817fea740 1 -- 172.21.15.12:0/914540232 wait complete. 2024-09-05T01:24:28.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.571+0000 7f4817fea740 20 client.25076 trim_cache size 0 max 16384 2024-09-05T01:24:28.576 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:24:28.576 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "0d44cd7e-6b24-11ef-bcd6-c7b262605968", 2024-09-05T01:24:28.576 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 3, 2024-09-05T01:24:28.576 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24517, 2024-09-05T01:24:28.576 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-05T01:24:28.576 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-05T01:24:28.576 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-05T01:24:28.576 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 102.48262897799999, 2024-09-05T01:24:28.576 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 27, 2024-09-05T01:24:28.576 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 85, 2024-09-05T01:24:28.576 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 81, 2024-09-05T01:24:28.577 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 141.725490667 2024-09-05T01:24:28.577 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:24:28.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.571+0000 7f4814a00640 1 -- 172.21.15.12:0/2342108578 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f47f40a2b80 msgr2=0x7f47f40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:28.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.571+0000 7f4814a00640 1 --2- 172.21.15.12:0/2342108578 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f47f40a2b80 0x7f47f40a5040 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f47f8031520 tx=0x7f47f80314b0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.571+0000 7f4814a00640 1 -- 172.21.15.12:0/2342108578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4810108f60 msgr2=0x7f481019ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:28.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.571+0000 7f4814a00640 1 --2- 172.21.15.12:0/2342108578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4810108f60 0x7f481019ed40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4808009fd0 tx=0x7f480800ef10 comp rx=0 tx=0).stop 2024-09-05T01:24:28.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.571+0000 7f4814a00640 1 -- 172.21.15.12:0/2342108578 shutdown_connections 2024-09-05T01:24:28.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.571+0000 7f4814a00640 1 --2- 172.21.15.12:0/2342108578 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f47f40a2b80 0x7f47f40a5040 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.571+0000 7f4814a00640 1 --2- 172.21.15.12:0/2342108578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4810108f60 0x7f481019ed40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.571+0000 7f4814a00640 1 --2- 172.21.15.12:0/2342108578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48101047e0 0x7f481019a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.571+0000 7f4814a00640 1 --2- 172.21.15.12:0/2342108578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4810103e30 0x7f481019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:28.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.571+0000 7f4814a00640 1 -- 172.21.15.12:0/2342108578 >> 172.21.15.12:0/2342108578 conn(0x7f48100ff910 msgr2=0x7f4810100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:28.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.571+0000 7f4814a00640 1 -- 172.21.15.12:0/2342108578 shutdown_connections 2024-09-05T01:24:28.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:28.571+0000 7f4814a00640 1 -- 172.21.15.12:0/2342108578 wait complete. 2024-09-05T01:24:28.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:28 smithi145 ceph-mon[34376]: pgmap v348: 97 pgs: 97 active+clean; 645 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.1 KiB/s wr, 9 op/s; 13 B/s, 0 objects/s recovering 2024-09-05T01:24:28.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:28 smithi145 ceph-mon[34376]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-05T01:24:28.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:28 smithi145 ceph-mon[34376]: Cluster is now healthy 2024-09-05T01:24:28.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:28 smithi151 ceph-mon[35013]: pgmap v348: 97 pgs: 97 active+clean; 645 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.1 KiB/s wr, 9 op/s; 13 B/s, 0 objects/s recovering 2024-09-05T01:24:28.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:28 smithi151 ceph-mon[35013]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-05T01:24:28.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:28 smithi151 ceph-mon[35013]: Cluster is now healthy 2024-09-05T01:24:29.333 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.h status 2024-09-05T01:24:29.708 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:24:30.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.328+0000 7f6c4b200640 1 -- 172.21.15.12:0/3205849925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c4c1019c0 msgr2=0x7f6c4c101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:30.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.328+0000 7f6c4b200640 1 --2- 172.21.15.12:0/3205849925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c4c1019c0 0x7f6c4c101e20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009930 tx=0x7f6c3402a420 comp rx=0 tx=0).stop 2024-09-05T01:24:30.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.328+0000 7f6c4b200640 1 -- 172.21.15.12:0/3205849925 shutdown_connections 2024-09-05T01:24:30.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.328+0000 7f6c4b200640 1 --2- 172.21.15.12:0/3205849925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c4c102360 0x7f6c4c10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.328+0000 7f6c4b200640 1 --2- 172.21.15.12:0/3205849925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c4c1019c0 0x7f6c4c101e20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.328+0000 7f6c4b200640 1 --2- 172.21.15.12:0/3205849925 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c4c1079c0 0x7f6c4c107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.328+0000 7f6c4b200640 1 -- 172.21.15.12:0/3205849925 >> 172.21.15.12:0/3205849925 conn(0x7f6c4c0fd740 msgr2=0x7f6c4c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:30.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.328+0000 7f6c4b200640 1 -- 172.21.15.12:0/3205849925 shutdown_connections 2024-09-05T01:24:30.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.328+0000 7f6c4b200640 1 -- 172.21.15.12:0/3205849925 wait complete. 2024-09-05T01:24:30.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.329+0000 7f6c4b200640 1 Processor -- start 2024-09-05T01:24:30.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.329+0000 7f6c4b200640 1 -- start start 2024-09-05T01:24:30.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.330+0000 7f6c4b200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c4c1019c0 0x7f6c4c19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:30.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.330+0000 7f6c4b200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c4c102360 0x7f6c4c19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:30.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.330+0000 7f6c4b200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c4c1079c0 0x7f6c4c19ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:30.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.330+0000 7f6c4b200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c111dc0 con 0x7f6c4c1019c0 2024-09-05T01:24:30.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.330+0000 7f6c4b200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c111c40 con 0x7f6c4c102360 2024-09-05T01:24:30.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.330+0000 7f6c4b200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c111f40 con 0x7f6c4c1079c0 2024-09-05T01:24:30.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.330+0000 7f6c49e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c4c1019c0 0x7f6c4c19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:30.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.330+0000 7f6c49e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c4c1019c0 0x7f6c4c19a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56350/0 (socket says 172.21.15.12:56350) 2024-09-05T01:24:30.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.330+0000 7f6c49e00640 1 -- 172.21.15.12:0/2575500451 learned_addr learned my addr 172.21.15.12:0/2575500451 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:30.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.330+0000 7f6c4a800640 1 --2- 172.21.15.12:0/2575500451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c4c1079c0 0x7f6c4c19ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:30.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.330+0000 7f6c43e00640 1 --2- 172.21.15.12:0/2575500451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c4c102360 0x7f6c4c19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:30.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.330+0000 7f6c4a800640 1 -- 172.21.15.12:0/2575500451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c4c102360 msgr2=0x7f6c4c19a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:30.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.330+0000 7f6c4a800640 1 --2- 172.21.15.12:0/2575500451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c4c102360 0x7f6c4c19a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.330+0000 7f6c4a800640 1 -- 172.21.15.12:0/2575500451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c4c1019c0 msgr2=0x7f6c4c19a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:30.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.330+0000 7f6c4a800640 1 --2- 172.21.15.12:0/2575500451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c4c1019c0 0x7f6c4c19a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.330+0000 7f6c4a800640 1 -- 172.21.15.12:0/2575500451 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c4c19f440 con 0x7f6c4c1079c0 2024-09-05T01:24:30.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.331+0000 7f6c4a800640 1 --2- 172.21.15.12:0/2575500451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c4c1079c0 0x7f6c4c19ed60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6c44009fd0 tx=0x7f6c4400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:30.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.331+0000 7f6c42a00640 1 -- 172.21.15.12:0/2575500451 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4400ce20 con 0x7f6c4c1079c0 2024-09-05T01:24:30.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.331+0000 7f6c4b200640 1 -- 172.21.15.12:0/2575500451 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c4c19f730 con 0x7f6c4c1079c0 2024-09-05T01:24:30.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.331+0000 7f6c42a00640 1 -- 172.21.15.12:0/2575500451 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c44005020 con 0x7f6c4c1079c0 2024-09-05T01:24:30.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.331+0000 7f6c42a00640 1 -- 172.21.15.12:0/2575500451 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c44010720 con 0x7f6c4c1079c0 2024-09-05T01:24:30.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.331+0000 7f6c4b200640 1 -- 172.21.15.12:0/2575500451 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c4c1a7010 con 0x7f6c4c1079c0 2024-09-05T01:24:30.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.335+0000 7f6c53e55740 1 Processor -- start 2024-09-05T01:24:30.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.335+0000 7f6c42a00640 1 -- 172.21.15.12:0/2575500451 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f6c44005540 con 0x7f6c4c1079c0 2024-09-05T01:24:30.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.336+0000 7f6c53e55740 1 -- start start 2024-09-05T01:24:30.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.336+0000 7f6c53e55740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559798c7e4e0 0x559798c7e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:30.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.336+0000 7f6c53e55740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559798c7ee00 0x559798c89180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:30.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.336+0000 7f6c53e55740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559798c896c0 0x559798c8bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:30.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.336+0000 7f6c53e55740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559798be40b0 con 0x559798c896c0 2024-09-05T01:24:30.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.336+0000 7f6c53e55740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x559798b8bab0 con 0x559798c7ee00 2024-09-05T01:24:30.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.336+0000 7f6c53e55740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559798be0070 con 0x559798c7e4e0 2024-09-05T01:24:30.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.336+0000 7f6c43e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559798c7e4e0 0x559798c7e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:30.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.336+0000 7f6c43e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559798c7e4e0 0x559798c7e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:54068/0 (socket says 172.21.15.12:54068) 2024-09-05T01:24:30.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.336+0000 7f6c43e00640 1 -- 172.21.15.12:0/1072219756 learned_addr learned my addr 172.21.15.12:0/1072219756 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:30.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.336+0000 7f6c43e00640 1 --2- 172.21.15.12:0/1072219756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559798c896c0 0x559798c8bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:30.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.336+0000 7f6c49e00640 1 --2- 172.21.15.12:0/1072219756 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559798c7ee00 0x559798c89180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:30.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.337+0000 7f6c49e00640 1 -- 172.21.15.12:0/1072219756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559798c7e4e0 msgr2=0x559798c7e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:30.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.337+0000 7f6c49e00640 1 --2- 172.21.15.12:0/1072219756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559798c7e4e0 0x559798c7e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.337+0000 7f6c49e00640 1 -- 172.21.15.12:0/1072219756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559798c896c0 msgr2=0x559798c8bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.337+0000 7f6c49e00640 1 --2- 172.21.15.12:0/1072219756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559798c896c0 0x559798c8bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.337+0000 7f6c49e00640 1 -- 172.21.15.12:0/1072219756 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559798b984a0 con 0x559798c7ee00 2024-09-05T01:24:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.337+0000 7f6c42a00640 1 --2- 172.21.15.12:0/2575500451 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6c300a2b80 0x7f6c300a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.337+0000 7f6c42a00640 1 -- 172.21.15.12:0/2575500451 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7f6c440cf6d0 con 0x7f6c4c1079c0 2024-09-05T01:24:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.337+0000 7f6c49e00640 1 --2- 172.21.15.12:0/1072219756 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559798c7ee00 0x559798c89180 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c009c30 tx=0x7f6c3c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=549750c36212c061 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.337+0000 7f6c43e00640 1 --2- 172.21.15.12:0/2575500451 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6c300a2b80 0x7f6c300a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.338+0000 7f6c3b400640 1 -- 172.21.15.12:0/1072219756 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c004230 con 0x559798c7ee00 2024-09-05T01:24:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.338+0000 7f6c3b400640 1 -- 172.21.15.12:0/1072219756 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c3c0043d0 con 0x559798c7ee00 2024-09-05T01:24:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.338+0000 7f6c3b400640 1 -- 172.21.15.12:0/1072219756 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c004d70 con 0x559798c7ee00 2024-09-05T01:24:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.338+0000 7f6c53e55740 1 -- 172.21.15.12:0/1072219756 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559798c7ee00 msgr2=0x559798c89180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.338+0000 7f6c43e00640 1 --2- 172.21.15.12:0/2575500451 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6c300a2b80 0x7f6c300a5040 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x559798c7bdf0 tx=0x7f6c3402a420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:30.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.338+0000 7f6c53e55740 1 --2- 172.21.15.12:0/1072219756 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559798c7ee00 0x559798c89180 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c009c30 tx=0x7f6c3c011810 comp rx=0 tx=0).stop 2024-09-05T01:24:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.338+0000 7f6c53e55740 1 -- 172.21.15.12:0/1072219756 shutdown_connections 2024-09-05T01:24:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.338+0000 7f6c53e55740 1 --2- 172.21.15.12:0/1072219756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559798c896c0 0x559798c8bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.338+0000 7f6c53e55740 1 --2- 172.21.15.12:0/1072219756 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559798c7ee00 0x559798c89180 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.338+0000 7f6c53e55740 1 --2- 172.21.15.12:0/1072219756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559798c7e4e0 0x559798c7e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.338+0000 7f6c53e55740 1 -- 172.21.15.12:0/1072219756 >> 172.21.15.12:0/1072219756 conn(0x559798c7aa70 msgr2=0x559798c7ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.338+0000 7f6c53e55740 1 -- 172.21.15.12:0/1072219756 shutdown_connections 2024-09-05T01:24:30.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.339+0000 7f6c53e55740 1 -- 172.21.15.12:0/1072219756 wait complete. 2024-09-05T01:24:30.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.339+0000 7f6c53e55740 1 -- start start 2024-09-05T01:24:30.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.339+0000 7f6c53e55740 1 Processor -- start 2024-09-05T01:24:30.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.340+0000 7f6c53e55740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559798c7e4e0 0x559798c864f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:30.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.340+0000 7f6c53e55740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559798c7ee00 0x559798c86a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:30.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.340+0000 7f6c53e55740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559798c896c0 0x559798c86f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:30.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.340+0000 7f6c53e55740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559798c8c330 con 0x559798c7e4e0 2024-09-05T01:24:30.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.340+0000 7f6c53e55740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x559798b6c920 con 0x559798c7ee00 2024-09-05T01:24:30.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.340+0000 7f6c53e55740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559798c8c4b0 con 0x559798c896c0 2024-09-05T01:24:30.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.340+0000 7f6c53e55740 10 client.0 _ll_register_callbacks cb 0x559798b908a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:24:30.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.340+0000 7f6c43e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559798c7ee00 0x559798c86a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:30.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.340+0000 7f6c43e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559798c7ee00 0x559798c86a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:57078/0 (socket says 172.21.15.12:57078) 2024-09-05T01:24:30.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.340+0000 7f6c43e00640 1 -- 172.21.15.12:0/228206075 learned_addr learned my addr 172.21.15.12:0/228206075 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:30.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.340+0000 7f6c49e00640 1 --2- 172.21.15.12:0/228206075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559798c7e4e0 0x559798c864f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:30.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.340+0000 7f6c4a800640 1 --2- 172.21.15.12:0/228206075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559798c896c0 0x559798c86f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:30.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.340+0000 7f6c43e00640 1 -- 172.21.15.12:0/228206075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559798c896c0 msgr2=0x559798c86f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:30.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.340+0000 7f6c43e00640 1 --2- 172.21.15.12:0/228206075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559798c896c0 0x559798c86f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.340+0000 7f6c43e00640 1 -- 172.21.15.12:0/228206075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559798c7e4e0 msgr2=0x559798c864f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.340+0000 7f6c43e00640 1 --2- 172.21.15.12:0/228206075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559798c7e4e0 0x559798c864f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.340+0000 7f6c43e00640 1 -- 172.21.15.12:0/228206075 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597989552b0 con 0x559798c7ee00 2024-09-05T01:24:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.341+0000 7f6c43e00640 1 --2- 172.21.15.12:0/228206075 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559798c7ee00 0x559798c86a30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6c34005940 tx=0x7f6c34009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3ea955c6c3ff5eb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.341+0000 7f6c2fe00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:24:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.341+0000 7f6c2fe00640 1 -- 172.21.15.12:0/228206075 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3404f030 con 0x559798c7ee00 2024-09-05T01:24:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.341+0000 7f6c53e55740 1 -- 172.21.15.12:0/228206075 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c3c0043d0 con 0x559798c7ee00 2024-09-05T01:24:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.341+0000 7f6c2fe00640 1 -- 172.21.15.12:0/228206075 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7f6c340054d0 con 0x559798c7ee00 2024-09-05T01:24:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.341+0000 7f6c2fe00640 1 -- 172.21.15.12:0/228206075 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6c34035040 con 0x559798c7ee00 2024-09-05T01:24:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.341+0000 7f6c53e55740 10 client.25088 fetch_fsmap learned FSMap version 27 2024-09-05T01:24:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.341+0000 7f6c53e55740 1 -- 172.21.15.12:0/228206075 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559798c97f80 con 0x559798c7ee00 2024-09-05T01:24:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.342+0000 7f6c2fe00640 1 -- 172.21.15.12:0/228206075 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c3c0043d0 con 0x559798c7ee00 2024-09-05T01:24:30.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.342+0000 7f6c2fe00640 1 -- 172.21.15.12:0/228206075 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f6c3405d070 con 0x559798c7ee00 2024-09-05T01:24:30.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.342+0000 7f6c53e55740 10 client.25088 fetch_fsmap finished waiting for FSMap version 27 2024-09-05T01:24:30.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.342+0000 7f6c53e55740 10 client.25088 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-05T01:24:30.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.342+0000 7f6c53e55740 20 client.25088 populate_metadata read hostname 'smithi012' 2024-09-05T01:24:30.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.342+0000 7f6c53e55740 1 --2- 172.21.15.12:0/228206075 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x559798c9a590 0x559798c9ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:30.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.342+0000 7f6c53e55740 4 client.25088 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:24:30.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.342+0000 7f6c53e55740 1 -- 172.21.15.12:0/228206075 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559798bf1620 con 0x559798c9a590 2024-09-05T01:24:30.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.343+0000 7f6c49e00640 1 --2- 172.21.15.12:0/228206075 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x559798c9a590 0x559798c9ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:30.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.343+0000 7f6c49e00640 1 --2- 172.21.15.12:0/228206075 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x559798c9a590 0x559798c9ba00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=13119d0a867419bf server_cookie=8a030d02f48ca4fa in_seq=0 out_seq=0 2024-09-05T01:24:30.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.343+0000 7f6c2fe00640 10 client.25088 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:24:30.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.344+0000 7f6c2fe00640 1 -- 172.21.15.12:0/228206075 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559798bf1620 con 0x559798c9a590 2024-09-05T01:24:30.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.344+0000 7f6c2fe00640 10 client.25088 handle_command_reply: tid=0 2024-09-05T01:24:30.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.344+0000 7f6c53e55740 1 client.25088 shutdown 2024-09-05T01:24:30.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.344+0000 7f6c53e55740 1 -- 172.21.15.12:0/228206075 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559798c7ee00 msgr2=0x559798c86a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:30.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.344+0000 7f6c53e55740 1 --2- 172.21.15.12:0/228206075 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559798c7ee00 0x559798c86a30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6c34005940 tx=0x7f6c34009260 comp rx=0 tx=0).stop 2024-09-05T01:24:30.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.344+0000 7f6c53e55740 1 -- 172.21.15.12:0/228206075 shutdown_connections 2024-09-05T01:24:30.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.344+0000 7f6c53e55740 1 --2- 172.21.15.12:0/228206075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559798c896c0 0x559798c86f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.344+0000 7f6c53e55740 1 --2- 172.21.15.12:0/228206075 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x559798c9a590 0x559798c9ba00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.344+0000 7f6c53e55740 1 --2- 172.21.15.12:0/228206075 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559798c7ee00 0x559798c86a30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.344+0000 7f6c53e55740 1 --2- 172.21.15.12:0/228206075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559798c7e4e0 0x559798c864f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.344+0000 7f6c2fe00640 0 client.25088 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:24:30.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.344+0000 7f6c53e55740 1 -- 172.21.15.12:0/228206075 >> 172.21.15.12:0/228206075 conn(0x559798c7aa70 msgr2=0x559798c80750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:30.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.344+0000 7f6c53e55740 1 -- 172.21.15.12:0/228206075 shutdown_connections 2024-09-05T01:24:30.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.344+0000 7f6c53e55740 1 -- 172.21.15.12:0/228206075 wait complete. 2024-09-05T01:24:30.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.345+0000 7f6c53e55740 20 client.25088 trim_cache size 0 max 16384 2024-09-05T01:24:30.349 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:30 smithi012 ceph-mon[29942]: pgmap v349: 97 pgs: 97 active+clean; 645 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.1 KiB/s wr, 12 op/s; 13 B/s, 0 objects/s recovering 2024-09-05T01:24:30.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.364+0000 7f6c53e55740 1 Processor -- start 2024-09-05T01:24:30.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.364+0000 7f6c53e55740 1 -- start start 2024-09-05T01:24:30.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.364+0000 7f6c53e55740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559798c7e4e0 0x559798c83790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:30.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.364+0000 7f6c53e55740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559798c7ee00 0x559798c83cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:30.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.364+0000 7f6c53e55740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559798c896c0 0x559798c84de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:30.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.364+0000 7f6c53e55740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559798c99d40 con 0x559798c7ee00 2024-09-05T01:24:30.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.364+0000 7f6c53e55740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x559798c9a410 con 0x559798c896c0 2024-09-05T01:24:30.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.364+0000 7f6c53e55740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559798c9aae0 con 0x559798c7e4e0 2024-09-05T01:24:30.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.364+0000 7f6c43e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559798c7ee00 0x559798c83cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:30.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.364+0000 7f6c43e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559798c7ee00 0x559798c83cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56392/0 (socket says 172.21.15.12:56392) 2024-09-05T01:24:30.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.364+0000 7f6c43e00640 1 -- 172.21.15.12:0/2156867583 learned_addr learned my addr 172.21.15.12:0/2156867583 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:30.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.364+0000 7f6c4a800640 1 --2- 172.21.15.12:0/2156867583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559798c896c0 0x559798c84de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:30.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.364+0000 7f6c49e00640 1 --2- 172.21.15.12:0/2156867583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559798c7e4e0 0x559798c83790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:30.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.365+0000 7f6c43e00640 1 -- 172.21.15.12:0/2156867583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559798c7e4e0 msgr2=0x559798c83790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:30.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.365+0000 7f6c43e00640 1 --2- 172.21.15.12:0/2156867583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559798c7e4e0 0x559798c83790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.365+0000 7f6c43e00640 1 -- 172.21.15.12:0/2156867583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559798c896c0 msgr2=0x559798c84de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:30.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.365+0000 7f6c43e00640 1 --2- 172.21.15.12:0/2156867583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559798c896c0 0x559798c84de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.365+0000 7f6c43e00640 1 -- 172.21.15.12:0/2156867583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559798c7a8a0 con 0x559798c7ee00 2024-09-05T01:24:30.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.365+0000 7f6c43e00640 1 --2- 172.21.15.12:0/2156867583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559798c7ee00 0x559798c83cd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009230 tx=0x7f6c34005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b69c8ad2644ca0da server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:30.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.365+0000 7f6c3aa00640 1 -- 172.21.15.12:0/2156867583 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c34063020 con 0x559798c7ee00 2024-09-05T01:24:30.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.365+0000 7f6c3aa00640 1 -- 172.21.15.12:0/2156867583 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c3405a070 con 0x559798c7ee00 2024-09-05T01:24:30.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.365+0000 7f6c3aa00640 1 -- 172.21.15.12:0/2156867583 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3404f040 con 0x559798c7ee00 2024-09-05T01:24:30.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.366+0000 7f6c53e55740 1 -- 172.21.15.12:0/2156867583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559798c7ee00 msgr2=0x559798c83cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:30.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.366+0000 7f6c53e55740 1 --2- 172.21.15.12:0/2156867583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559798c7ee00 0x559798c83cd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009230 tx=0x7f6c34005fd0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.366+0000 7f6c53e55740 1 -- 172.21.15.12:0/2156867583 shutdown_connections 2024-09-05T01:24:30.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.366+0000 7f6c53e55740 1 --2- 172.21.15.12:0/2156867583 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559798c896c0 0x559798c84de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.366+0000 7f6c53e55740 1 --2- 172.21.15.12:0/2156867583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559798c7ee00 0x559798c83cd0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.366+0000 7f6c53e55740 1 --2- 172.21.15.12:0/2156867583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559798c7e4e0 0x559798c83790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.366+0000 7f6c53e55740 1 -- 172.21.15.12:0/2156867583 >> 172.21.15.12:0/2156867583 conn(0x559798c7aa70 msgr2=0x559798c81860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:30.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.366+0000 7f6c53e55740 1 -- 172.21.15.12:0/2156867583 shutdown_connections 2024-09-05T01:24:30.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.366+0000 7f6c53e55740 1 -- 172.21.15.12:0/2156867583 wait complete. 2024-09-05T01:24:30.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.367+0000 7f6c53e55740 1 -- start start 2024-09-05T01:24:30.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.367+0000 7f6c53e55740 1 Processor -- start 2024-09-05T01:24:30.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.367+0000 7f6c53e55740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559798c7e4e0 0x559798ca4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:30.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.367+0000 7f6c53e55740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559798c7ee00 0x559798c793b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:30.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.367+0000 7f6c53e55740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559798c896c0 0x559798c798f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:30.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.367+0000 7f6c53e55740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559798c9b880 con 0x559798c896c0 2024-09-05T01:24:30.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.367+0000 7f6c53e55740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x559798c9b1b0 con 0x559798c7e4e0 2024-09-05T01:24:30.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.367+0000 7f6c53e55740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559798c9bf50 con 0x559798c7ee00 2024-09-05T01:24:30.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.367+0000 7f6c53e55740 10 client.0 _ll_register_callbacks cb 0x7f6c34032dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:24:30.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.368+0000 7f6c4a800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559798c896c0 0x559798c798f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:30.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.368+0000 7f6c4a800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559798c896c0 0x559798c798f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56404/0 (socket says 172.21.15.12:56404) 2024-09-05T01:24:30.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.368+0000 7f6c4a800640 1 -- 172.21.15.12:0/3580422273 learned_addr learned my addr 172.21.15.12:0/3580422273 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:30.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.368+0000 7f6c43e00640 1 --2- 172.21.15.12:0/3580422273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559798c7ee00 0x559798c793b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:30.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.368+0000 7f6c49e00640 1 --2- 172.21.15.12:0/3580422273 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559798c7e4e0 0x559798ca4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:30.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.368+0000 7f6c4a800640 1 -- 172.21.15.12:0/3580422273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559798c7ee00 msgr2=0x559798c793b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:30.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.368+0000 7f6c4a800640 1 --2- 172.21.15.12:0/3580422273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559798c7ee00 0x559798c793b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.368+0000 7f6c4a800640 1 -- 172.21.15.12:0/3580422273 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559798c7e4e0 msgr2=0x559798ca4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:30.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.368+0000 7f6c4a800640 1 --2- 172.21.15.12:0/3580422273 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559798c7e4e0 0x559798ca4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.368+0000 7f6c4a800640 1 -- 172.21.15.12:0/3580422273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559798c7a0d0 con 0x559798c896c0 2024-09-05T01:24:30.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.368+0000 7f6c43e00640 1 --2- 172.21.15.12:0/3580422273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559798c7ee00 0x559798c793b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:30.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.368+0000 7f6c4a800640 1 --2- 172.21.15.12:0/3580422273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559798c896c0 0x559798c798f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6c440a45e0 tx=0x7f6c4409bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14a53f94877b5ab server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:30.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.368+0000 7f6c2fe00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:24:30.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.369+0000 7f6c2fe00640 1 -- 172.21.15.12:0/3580422273 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4409a1a0 con 0x559798c896c0 2024-09-05T01:24:30.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.369+0000 7f6c2fe00640 1 -- 172.21.15.12:0/3580422273 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7f6c440051d0 con 0x559798c896c0 2024-09-05T01:24:30.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.369+0000 7f6c53e55740 1 -- 172.21.15.12:0/3580422273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c3405a070 con 0x559798c896c0 2024-09-05T01:24:30.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.369+0000 7f6c2fe00640 1 -- 172.21.15.12:0/3580422273 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6c440a4680 con 0x559798c896c0 2024-09-05T01:24:30.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.369+0000 7f6c53e55740 10 client.15087 fetch_fsmap learned FSMap version 27 2024-09-05T01:24:30.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.369+0000 7f6c53e55740 1 -- 172.21.15.12:0/3580422273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559798d04d00 con 0x559798c896c0 2024-09-05T01:24:30.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.369+0000 7f6c2fe00640 1 -- 172.21.15.12:0/3580422273 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c3405a070 con 0x559798c896c0 2024-09-05T01:24:30.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.369+0000 7f6c2fe00640 1 -- 172.21.15.12:0/3580422273 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f6c44097bf0 con 0x559798c896c0 2024-09-05T01:24:30.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.369+0000 7f6c53e55740 10 client.15087 fetch_fsmap finished waiting for FSMap version 27 2024-09-05T01:24:30.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.369+0000 7f6c53e55740 10 client.15087 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-05T01:24:30.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.369+0000 7f6c53e55740 20 client.15087 populate_metadata read hostname 'smithi012' 2024-09-05T01:24:30.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.369+0000 7f6c53e55740 1 --2- 172.21.15.12:0/3580422273 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x559798d09920 0x559798d08630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:30.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.369+0000 7f6c53e55740 4 client.15087 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T01:24:30.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.369+0000 7f6c53e55740 1 -- 172.21.15.12:0/3580422273 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "status"}) -- 0x559798bebb30 con 0x559798d09920 2024-09-05T01:24:30.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.370+0000 7f6c49e00640 1 --2- 172.21.15.12:0/3580422273 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x559798d09920 0x559798d08630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:30.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.370+0000 7f6c49e00640 1 --2- 172.21.15.12:0/3580422273 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x559798d09920 0x559798d08630 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9d62ede71e5b38f server_cookie=526b3b38b24e62f8 in_seq=0 out_seq=0 2024-09-05T01:24:30.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.370+0000 7f6c2fe00640 10 client.15087 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:24:30.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.370+0000 7f6c2fe00640 1 -- 172.21.15.12:0/3580422273 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x559798bebb30 con 0x559798d09920 2024-09-05T01:24:30.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.370+0000 7f6c2fe00640 10 client.15087 handle_command_reply: tid=0 2024-09-05T01:24:30.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.371+0000 7f6c53e55740 1 client.15087 shutdown 2024-09-05T01:24:30.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.371+0000 7f6c53e55740 1 -- 172.21.15.12:0/3580422273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559798c896c0 msgr2=0x559798c798f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:30.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.371+0000 7f6c53e55740 1 --2- 172.21.15.12:0/3580422273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559798c896c0 0x559798c798f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6c440a45e0 tx=0x7f6c4409bf60 comp rx=0 tx=0).stop 2024-09-05T01:24:30.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.371+0000 7f6c53e55740 1 -- 172.21.15.12:0/3580422273 shutdown_connections 2024-09-05T01:24:30.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.371+0000 7f6c53e55740 1 --2- 172.21.15.12:0/3580422273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559798c896c0 0x559798c798f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.371+0000 7f6c53e55740 1 --2- 172.21.15.12:0/3580422273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559798c7ee00 0x559798c793b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.371+0000 7f6c53e55740 1 --2- 172.21.15.12:0/3580422273 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x559798d09920 0x559798d08630 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.371+0000 7f6c53e55740 1 --2- 172.21.15.12:0/3580422273 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559798c7e4e0 0x559798ca4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.371+0000 7f6c2fe00640 0 client.15087 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:24:30.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.371+0000 7f6c53e55740 1 -- 172.21.15.12:0/3580422273 >> 172.21.15.12:0/3580422273 conn(0x559798c7aa70 msgr2=0x559798c84de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:30.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.371+0000 7f6c53e55740 1 -- 172.21.15.12:0/3580422273 shutdown_connections 2024-09-05T01:24:30.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.371+0000 7f6c53e55740 1 -- 172.21.15.12:0/3580422273 wait complete. 2024-09-05T01:24:30.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.371+0000 7f6c53e55740 20 client.15087 trim_cache size 0 max 16384 2024-09-05T01:24:30.376 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:24:30.377 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "0d44cd7e-6b24-11ef-bcd6-c7b262605968", 2024-09-05T01:24:30.377 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 2, 2024-09-05T01:24:30.377 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24524, 2024-09-05T01:24:30.377 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-05T01:24:30.377 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-05T01:24:30.377 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-05T01:24:30.377 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 105.293185218, 2024-09-05T01:24:30.377 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 27, 2024-09-05T01:24:30.377 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 85, 2024-09-05T01:24:30.377 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 81, 2024-09-05T01:24:30.377 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 140.86993402900001 2024-09-05T01:24:30.377 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:24:30.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.372+0000 7f6c4b200640 1 -- 172.21.15.12:0/2575500451 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6c300a2b80 msgr2=0x7f6c300a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:30.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.372+0000 7f6c4b200640 1 --2- 172.21.15.12:0/2575500451 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6c300a2b80 0x7f6c300a5040 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x559798c7bdf0 tx=0x7f6c3402a420 comp rx=0 tx=0).stop 2024-09-05T01:24:30.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.372+0000 7f6c4b200640 1 -- 172.21.15.12:0/2575500451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c4c1079c0 msgr2=0x7f6c4c19ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:30.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.372+0000 7f6c4b200640 1 --2- 172.21.15.12:0/2575500451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c4c1079c0 0x7f6c4c19ed60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6c44009fd0 tx=0x7f6c4400ef10 comp rx=0 tx=0).stop 2024-09-05T01:24:30.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.372+0000 7f6c4b200640 1 -- 172.21.15.12:0/2575500451 shutdown_connections 2024-09-05T01:24:30.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.372+0000 7f6c4b200640 1 --2- 172.21.15.12:0/2575500451 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f6c300a2b80 0x7f6c300a5040 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.372+0000 7f6c4b200640 1 --2- 172.21.15.12:0/2575500451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c4c1079c0 0x7f6c4c19ed60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.372+0000 7f6c4b200640 1 --2- 172.21.15.12:0/2575500451 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6c4c102360 0x7f6c4c19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.372+0000 7f6c4b200640 1 --2- 172.21.15.12:0/2575500451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c4c1019c0 0x7f6c4c19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:30.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.372+0000 7f6c4b200640 1 -- 172.21.15.12:0/2575500451 >> 172.21.15.12:0/2575500451 conn(0x7f6c4c0fd740 msgr2=0x7f6c4c10d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:30.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.372+0000 7f6c4b200640 1 -- 172.21.15.12:0/2575500451 shutdown_connections 2024-09-05T01:24:30.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:30.372+0000 7f6c4b200640 1 -- 172.21.15.12:0/2575500451 wait complete. 2024-09-05T01:24:30.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:30 smithi145 ceph-mon[34376]: pgmap v349: 97 pgs: 97 active+clean; 645 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.1 KiB/s wr, 12 op/s; 13 B/s, 0 objects/s recovering 2024-09-05T01:24:30.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:30 smithi151 ceph-mon[35013]: pgmap v349: 97 pgs: 97 active+clean; 645 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.1 KiB/s wr, 12 op/s; 13 B/s, 0 objects/s recovering 2024-09-05T01:24:31.023 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.i status 2024-09-05T01:24:31.401 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:24:31.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.917+0000 7fe29ca00640 1 -- 172.21.15.12:0/2818658437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe298074eb0 msgr2=0x7fe298112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:31.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.917+0000 7fe29ca00640 1 --2- 172.21.15.12:0/2818658437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe298074eb0 0x7fe298112650 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe284009900 tx=0x7fe28402a480 comp rx=0 tx=0).stop 2024-09-05T01:24:31.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.917+0000 7fe29ca00640 1 -- 172.21.15.12:0/2818658437 shutdown_connections 2024-09-05T01:24:31.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.917+0000 7fe29ca00640 1 --2- 172.21.15.12:0/2818658437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe298112b90 0x7fe298114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.917+0000 7fe29ca00640 1 --2- 172.21.15.12:0/2818658437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe298074eb0 0x7fe298112650 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.917+0000 7fe29ca00640 1 --2- 172.21.15.12:0/2818658437 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe298074590 0x7fe298074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.917+0000 7fe29ca00640 1 -- 172.21.15.12:0/2818658437 >> 172.21.15.12:0/2818658437 conn(0x7fe2980fd8c0 msgr2=0x7fe2980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:31.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.917+0000 7fe29ca00640 1 -- 172.21.15.12:0/2818658437 shutdown_connections 2024-09-05T01:24:31.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.917+0000 7fe29ca00640 1 -- 172.21.15.12:0/2818658437 wait complete. 2024-09-05T01:24:31.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.918+0000 7fe29ca00640 1 Processor -- start 2024-09-05T01:24:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.919+0000 7fe29ca00640 1 -- start start 2024-09-05T01:24:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.919+0000 7fe29ca00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe298074590 0x7fe2981a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.919+0000 7fe29ca00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe298074eb0 0x7fe2981a4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.919+0000 7fe29ca00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe298112b90 0x7fe29819e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.919+0000 7fe29ca00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe2981185b0 con 0x7fe298074590 2024-09-05T01:24:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.919+0000 7fe29ca00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe298118430 con 0x7fe298112b90 2024-09-05T01:24:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.919+0000 7fe29ca00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe298118730 con 0x7fe298074eb0 2024-09-05T01:24:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.919+0000 7fe295e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe298074590 0x7fe2981a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.919+0000 7fe295e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe298074590 0x7fe2981a4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56422/0 (socket says 172.21.15.12:56422) 2024-09-05T01:24:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.919+0000 7fe296800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe298112b90 0x7fe29819e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.919+0000 7fe295e00640 1 -- 172.21.15.12:0/1865431554 learned_addr learned my addr 172.21.15.12:0/1865431554 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.919+0000 7fe295400640 1 --2- 172.21.15.12:0/1865431554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe298074eb0 0x7fe2981a4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.920+0000 7fe295e00640 1 -- 172.21.15.12:0/1865431554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe298074eb0 msgr2=0x7fe2981a4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.920+0000 7fe295e00640 1 --2- 172.21.15.12:0/1865431554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe298074eb0 0x7fe2981a4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.920+0000 7fe295e00640 1 -- 172.21.15.12:0/1865431554 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe298112b90 msgr2=0x7fe29819e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.920+0000 7fe295e00640 1 --2- 172.21.15.12:0/1865431554 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe298112b90 0x7fe29819e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.920+0000 7fe295e00640 1 -- 172.21.15.12:0/1865431554 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe29819f030 con 0x7fe298074590 2024-09-05T01:24:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.920+0000 7fe295e00640 1 --2- 172.21.15.12:0/1865431554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe298074590 0x7fe2981a4740 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe28800d950 tx=0x7fe28800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.920+0000 7fe28ea00640 1 -- 172.21.15.12:0/1865431554 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe288017070 con 0x7fe298074590 2024-09-05T01:24:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.921+0000 7fe29ca00640 1 -- 172.21.15.12:0/1865431554 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe29819f320 con 0x7fe298074590 2024-09-05T01:24:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.921+0000 7fe28ea00640 1 -- 172.21.15.12:0/1865431554 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe288009c30 con 0x7fe298074590 2024-09-05T01:24:31.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.921+0000 7fe28ea00640 1 -- 172.21.15.12:0/1865431554 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28800f6b0 con 0x7fe298074590 2024-09-05T01:24:31.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.921+0000 7fe29ca00640 1 -- 172.21.15.12:0/1865431554 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2981ab610 con 0x7fe298074590 2024-09-05T01:24:31.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.924+0000 7fe29f62c740 1 Processor -- start 2024-09-05T01:24:31.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.924+0000 7fe28ea00640 1 -- 172.21.15.12:0/1865431554 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe2880109d0 con 0x7fe298074590 2024-09-05T01:24:31.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.924+0000 7fe29f62c740 1 -- start start 2024-09-05T01:24:31.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.924+0000 7fe29f62c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbc330 0x55c465bbc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:31.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.924+0000 7fe29f62c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c465bbcc50 0x55c465bc6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:31.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.924+0000 7fe29f62c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c465bc7510 0x55c465bc9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:31.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.924+0000 7fe29f62c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c465b220b0 con 0x55c465bbc330 2024-09-05T01:24:31.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.924+0000 7fe29f62c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c465ac9ab0 con 0x55c465bbcc50 2024-09-05T01:24:31.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.924+0000 7fe29f62c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c465b1e070 con 0x55c465bc7510 2024-09-05T01:24:31.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.924+0000 7fe296800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbc330 0x55c465bbc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:31.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.924+0000 7fe296800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbc330 0x55c465bbc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56432/0 (socket says 172.21.15.12:56432) 2024-09-05T01:24:31.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.925+0000 7fe296800640 1 -- 172.21.15.12:0/231283231 learned_addr learned my addr 172.21.15.12:0/231283231 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:31.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.925+0000 7fe295400640 1 --2- 172.21.15.12:0/231283231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c465bc7510 0x55c465bc9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:31.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.925+0000 7fe295e00640 1 --2- 172.21.15.12:0/231283231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c465bbcc50 0x55c465bc6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:31.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.925+0000 7fe296800640 1 -- 172.21.15.12:0/231283231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c465bc7510 msgr2=0x55c465bc9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:31.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.925+0000 7fe296800640 1 --2- 172.21.15.12:0/231283231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c465bc7510 0x55c465bc9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.925+0000 7fe296800640 1 -- 172.21.15.12:0/231283231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c465bbcc50 msgr2=0x55c465bc6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:31.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.925+0000 7fe296800640 1 --2- 172.21.15.12:0/231283231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c465bbcc50 0x55c465bc6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.925+0000 7fe296800640 1 -- 172.21.15.12:0/231283231 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c465ad64a0 con 0x55c465bbc330 2024-09-05T01:24:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.925+0000 7fe28ea00640 1 --2- 172.21.15.12:0/1865431554 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fe27c0a2b80 0x7fe27c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.925+0000 7fe296800640 1 --2- 172.21.15.12:0/231283231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbc330 0x55c465bbc710 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe290009f40 tx=0x7fe290010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16608ec5e0f8efd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.926+0000 7fe28ea00640 1 -- 172.21.15.12:0/1865431554 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7fe2880cecb0 con 0x7fe298074590 2024-09-05T01:24:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.926+0000 7fe283000640 1 -- 172.21.15.12:0/231283231 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290016070 con 0x55c465bbc330 2024-09-05T01:24:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.926+0000 7fe295e00640 1 --2- 172.21.15.12:0/1865431554 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fe27c0a2b80 0x7fe27c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.926+0000 7fe283000640 1 -- 172.21.15.12:0/231283231 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe290004d20 con 0x55c465bbc330 2024-09-05T01:24:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.926+0000 7fe283000640 1 -- 172.21.15.12:0/231283231 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290012850 con 0x55c465bbc330 2024-09-05T01:24:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.926+0000 7fe29f62c740 1 -- 172.21.15.12:0/231283231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbc330 msgr2=0x55c465bbc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.926+0000 7fe29f62c740 1 --2- 172.21.15.12:0/231283231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbc330 0x55c465bbc710 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe290009f40 tx=0x7fe290010800 comp rx=0 tx=0).stop 2024-09-05T01:24:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.926+0000 7fe295e00640 1 --2- 172.21.15.12:0/1865431554 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fe27c0a2b80 0x7fe27c0a5040 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe2880cef50 tx=0x7fe2880d26f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:31.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.927+0000 7fe29f62c740 1 -- 172.21.15.12:0/231283231 shutdown_connections 2024-09-05T01:24:31.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.927+0000 7fe29f62c740 1 --2- 172.21.15.12:0/231283231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c465bc7510 0x55c465bc9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.927+0000 7fe29f62c740 1 --2- 172.21.15.12:0/231283231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c465bbcc50 0x55c465bc6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.927+0000 7fe29f62c740 1 --2- 172.21.15.12:0/231283231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbc330 0x55c465bbc710 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.927+0000 7fe29f62c740 1 -- 172.21.15.12:0/231283231 >> 172.21.15.12:0/231283231 conn(0x55c465bb88c0 msgr2=0x55c465bb8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:31.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.927+0000 7fe29f62c740 1 -- 172.21.15.12:0/231283231 shutdown_connections 2024-09-05T01:24:31.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.927+0000 7fe29f62c740 1 -- 172.21.15.12:0/231283231 wait complete. 2024-09-05T01:24:31.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.927+0000 7fe29f62c740 1 -- start start 2024-09-05T01:24:31.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.927+0000 7fe29f62c740 1 Processor -- start 2024-09-05T01:24:31.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.928+0000 7fe29f62c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c465bbc330 0x55c465bc4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:31.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.928+0000 7fe29f62c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbcc50 0x55c465bc4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:31.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.928+0000 7fe29f62c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c465bc7510 0x55c465bc4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:31.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.928+0000 7fe29f62c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c465bca060 con 0x55c465bbcc50 2024-09-05T01:24:31.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.928+0000 7fe29f62c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c465aaa920 con 0x55c465bc7510 2024-09-05T01:24:31.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.928+0000 7fe29f62c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c465bca1e0 con 0x55c465bbc330 2024-09-05T01:24:31.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.928+0000 7fe29f62c740 10 client.0 _ll_register_callbacks cb 0x55c465ace8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:24:31.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.928+0000 7fe295400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbcc50 0x55c465bc4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:31.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.928+0000 7fe295400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbcc50 0x55c465bc4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56436/0 (socket says 172.21.15.12:56436) 2024-09-05T01:24:31.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.928+0000 7fe295400640 1 -- 172.21.15.12:0/1550504834 learned_addr learned my addr 172.21.15.12:0/1550504834 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:31.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.928+0000 7fe296800640 1 --2- 172.21.15.12:0/1550504834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c465bbc330 0x55c465bc4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:31.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.928+0000 7fe296800640 1 --2- 172.21.15.12:0/1550504834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c465bc7510 0x55c465bc4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:31.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.929+0000 7fe296800640 1 -- 172.21.15.12:0/1550504834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c465bc7510 msgr2=0x55c465bc4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:31.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.929+0000 7fe296800640 1 --2- 172.21.15.12:0/1550504834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c465bc7510 0x55c465bc4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.929+0000 7fe296800640 1 -- 172.21.15.12:0/1550504834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbcc50 msgr2=0x55c465bc4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:31.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.929+0000 7fe296800640 1 --2- 172.21.15.12:0/1550504834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbcc50 0x55c465bc4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.929+0000 7fe296800640 1 -- 172.21.15.12:0/1550504834 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4658932b0 con 0x55c465bbc330 2024-09-05T01:24:31.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.929+0000 7fe296800640 1 --2- 172.21.15.12:0/1550504834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c465bbc330 0x55c465bc4540 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe290009880 tx=0x7fe290012580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a3e8bc6b79cb01a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:31.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.929+0000 7fe277400640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:24:31.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.929+0000 7fe277400640 1 -- 172.21.15.12:0/1550504834 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290016030 con 0x55c465bbc330 2024-09-05T01:24:31.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.930+0000 7fe277400640 1 -- 172.21.15.12:0/1550504834 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7fe290012bd0 con 0x55c465bbc330 2024-09-05T01:24:31.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.930+0000 7fe29f62c740 1 -- 172.21.15.12:0/1550504834 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe290004d20 con 0x55c465bbc330 2024-09-05T01:24:31.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.930+0000 7fe277400640 1 -- 172.21.15.12:0/1550504834 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe290023040 con 0x55c465bbc330 2024-09-05T01:24:31.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.930+0000 7fe29f62c740 10 client.25108 fetch_fsmap learned FSMap version 27 2024-09-05T01:24:31.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.930+0000 7fe29f62c740 1 -- 172.21.15.12:0/1550504834 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c465bd5dd0 con 0x55c465bbc330 2024-09-05T01:24:31.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.930+0000 7fe277400640 1 -- 172.21.15.12:0/1550504834 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe290004d20 con 0x55c465bbc330 2024-09-05T01:24:31.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.931+0000 7fe277400640 1 -- 172.21.15.12:0/1550504834 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fe29000f040 con 0x55c465bbc330 2024-09-05T01:24:31.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.931+0000 7fe29f62c740 10 client.25108 fetch_fsmap finished waiting for FSMap version 27 2024-09-05T01:24:31.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.931+0000 7fe29f62c740 10 client.25108 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-05T01:24:31.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.931+0000 7fe29f62c740 20 client.25108 populate_metadata read hostname 'smithi012' 2024-09-05T01:24:31.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.931+0000 7fe29f62c740 1 --2- 172.21.15.12:0/1550504834 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55c465bd81a0 0x55c465bd9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:31.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.931+0000 7fe29f62c740 4 client.25108 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:24:31.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.931+0000 7fe29f62c740 1 -- 172.21.15.12:0/1550504834 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c465b2f620 con 0x55c465bd81a0 2024-09-05T01:24:31.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.931+0000 7fe295400640 1 --2- 172.21.15.12:0/1550504834 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55c465bd81a0 0x55c465bd9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:31.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.932+0000 7fe295400640 1 --2- 172.21.15.12:0/1550504834 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55c465bd81a0 0x55c465bd9610 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=99241e493ff2c660 server_cookie=7568541ed335eea3 in_seq=0 out_seq=0 2024-09-05T01:24:31.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.932+0000 7fe277400640 10 client.25108 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:24:31.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.933+0000 7fe277400640 1 -- 172.21.15.12:0/1550504834 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c465b2f620 con 0x55c465bd81a0 2024-09-05T01:24:31.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.933+0000 7fe277400640 10 client.25108 handle_command_reply: tid=0 2024-09-05T01:24:31.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.933+0000 7fe29f62c740 1 client.25108 shutdown 2024-09-05T01:24:31.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.933+0000 7fe29f62c740 1 -- 172.21.15.12:0/1550504834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c465bbc330 msgr2=0x55c465bc4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:31.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.933+0000 7fe29f62c740 1 --2- 172.21.15.12:0/1550504834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c465bbc330 0x55c465bc4540 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe290009880 tx=0x7fe290012580 comp rx=0 tx=0).stop 2024-09-05T01:24:31.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.933+0000 7fe29f62c740 1 -- 172.21.15.12:0/1550504834 shutdown_connections 2024-09-05T01:24:31.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.933+0000 7fe29f62c740 1 --2- 172.21.15.12:0/1550504834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c465bc7510 0x55c465bc4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.933+0000 7fe29f62c740 1 --2- 172.21.15.12:0/1550504834 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55c465bd81a0 0x55c465bd9610 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.933+0000 7fe29f62c740 1 --2- 172.21.15.12:0/1550504834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbcc50 0x55c465bc4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.933+0000 7fe29f62c740 1 --2- 172.21.15.12:0/1550504834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c465bbc330 0x55c465bc4540 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.933+0000 7fe29f62c740 1 -- 172.21.15.12:0/1550504834 >> 172.21.15.12:0/1550504834 conn(0x55c465bb88c0 msgr2=0x55c465bbe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:31.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.933+0000 7fe277400640 0 client.25108 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:24:31.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.933+0000 7fe29f62c740 1 -- 172.21.15.12:0/1550504834 shutdown_connections 2024-09-05T01:24:31.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.933+0000 7fe29f62c740 1 -- 172.21.15.12:0/1550504834 wait complete. 2024-09-05T01:24:31.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.933+0000 7fe29f62c740 20 client.25108 trim_cache size 0 max 16384 2024-09-05T01:24:31.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.953+0000 7fe29f62c740 1 Processor -- start 2024-09-05T01:24:31.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.953+0000 7fe29f62c740 1 -- start start 2024-09-05T01:24:31.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.953+0000 7fe29f62c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c465bbc330 0x55c465bc3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:31.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.953+0000 7fe29f62c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbcc50 0x55c465bc2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:31.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.953+0000 7fe29f62c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c465bc7510 0x55c465bc3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:31.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.953+0000 7fe29f62c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c465bd7950 con 0x55c465bbcc50 2024-09-05T01:24:31.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.953+0000 7fe29f62c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c465bd8020 con 0x55c465bbc330 2024-09-05T01:24:31.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.953+0000 7fe29f62c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c465bd86f0 con 0x55c465bc7510 2024-09-05T01:24:31.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.953+0000 7fe295400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbcc50 0x55c465bc2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:31.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.953+0000 7fe295400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbcc50 0x55c465bc2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56442/0 (socket says 172.21.15.12:56442) 2024-09-05T01:24:31.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.953+0000 7fe295400640 1 -- 172.21.15.12:0/1893006628 learned_addr learned my addr 172.21.15.12:0/1893006628 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:31.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.953+0000 7fe296800640 1 --2- 172.21.15.12:0/1893006628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c465bc7510 0x55c465bc3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:31.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.954+0000 7fe296800640 1 --2- 172.21.15.12:0/1893006628 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c465bbc330 0x55c465bc3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:31.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.954+0000 7fe295400640 1 -- 172.21.15.12:0/1893006628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c465bc7510 msgr2=0x55c465bc3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:31.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.954+0000 7fe295400640 1 --2- 172.21.15.12:0/1893006628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c465bc7510 0x55c465bc3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.954+0000 7fe295400640 1 -- 172.21.15.12:0/1893006628 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c465bbc330 msgr2=0x55c465bc3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:31.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.954+0000 7fe295400640 1 --2- 172.21.15.12:0/1893006628 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c465bbc330 0x55c465bc3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.954+0000 7fe295400640 1 -- 172.21.15.12:0/1893006628 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c465bb9550 con 0x55c465bbcc50 2024-09-05T01:24:31.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.954+0000 7fe296800640 1 --2- 172.21.15.12:0/1893006628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c465bc7510 0x55c465bc3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:31.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.954+0000 7fe295400640 1 --2- 172.21.15.12:0/1893006628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbcc50 0x55c465bc2e10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe284009230 tx=0x7fe284005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e95b5834328ddc88 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:31.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.954+0000 7fe282600640 1 -- 172.21.15.12:0/1893006628 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe284035040 con 0x55c465bbcc50 2024-09-05T01:24:31.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.954+0000 7fe282600640 1 -- 172.21.15.12:0/1893006628 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe28404b070 con 0x55c465bbcc50 2024-09-05T01:24:31.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.954+0000 7fe282600640 1 -- 172.21.15.12:0/1893006628 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe284031810 con 0x55c465bbcc50 2024-09-05T01:24:31.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.955+0000 7fe29f62c740 1 -- 172.21.15.12:0/1893006628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbcc50 msgr2=0x55c465bc2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:31.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.955+0000 7fe29f62c740 1 --2- 172.21.15.12:0/1893006628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbcc50 0x55c465bc2e10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe284009230 tx=0x7fe284005c00 comp rx=0 tx=0).stop 2024-09-05T01:24:31.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.955+0000 7fe29f62c740 1 -- 172.21.15.12:0/1893006628 shutdown_connections 2024-09-05T01:24:31.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.955+0000 7fe29f62c740 1 --2- 172.21.15.12:0/1893006628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c465bc7510 0x55c465bc3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.955+0000 7fe29f62c740 1 --2- 172.21.15.12:0/1893006628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbcc50 0x55c465bc2e10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.955+0000 7fe29f62c740 1 --2- 172.21.15.12:0/1893006628 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c465bbc330 0x55c465bc3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.955+0000 7fe29f62c740 1 -- 172.21.15.12:0/1893006628 >> 172.21.15.12:0/1893006628 conn(0x55c465bb88c0 msgr2=0x55c465bb3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:31.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.955+0000 7fe29f62c740 1 -- 172.21.15.12:0/1893006628 shutdown_connections 2024-09-05T01:24:31.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.955+0000 7fe29f62c740 1 -- 172.21.15.12:0/1893006628 wait complete. 2024-09-05T01:24:31.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.956+0000 7fe29f62c740 1 -- start start 2024-09-05T01:24:31.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.956+0000 7fe29f62c740 1 Processor -- start 2024-09-05T01:24:31.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.956+0000 7fe29f62c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c465bbc330 0x55c465be1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:31.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.956+0000 7fe29f62c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbcc50 0x55c465bc11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:31.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.956+0000 7fe29f62c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c465bc7510 0x55c465bc16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:31.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.956+0000 7fe29f62c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c465bd9490 con 0x55c465bbcc50 2024-09-05T01:24:31.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.956+0000 7fe29f62c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c465bd8dc0 con 0x55c465bbc330 2024-09-05T01:24:31.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.956+0000 7fe29f62c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c465bd9b60 con 0x55c465bc7510 2024-09-05T01:24:31.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.956+0000 7fe29f62c740 10 client.0 _ll_register_callbacks cb 0x7fe2900126d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:24:31.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.957+0000 7fe296800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c465bbc330 0x55c465be1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:31.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.957+0000 7fe295400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbcc50 0x55c465bc11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:31.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.957+0000 7fe296800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c465bbc330 0x55c465be1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:57144/0 (socket says 172.21.15.12:57144) 2024-09-05T01:24:31.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.957+0000 7fe296800640 1 -- 172.21.15.12:0/1622670578 learned_addr learned my addr 172.21.15.12:0/1622670578 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:31.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.957+0000 7fe296800640 1 --2- 172.21.15.12:0/1622670578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c465bc7510 0x55c465bc16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:31.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.957+0000 7fe296800640 1 -- 172.21.15.12:0/1622670578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c465bc7510 msgr2=0x55c465bc16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:31.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.957+0000 7fe296800640 1 --2- 172.21.15.12:0/1622670578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c465bc7510 0x55c465bc16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.957+0000 7fe296800640 1 -- 172.21.15.12:0/1622670578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbcc50 msgr2=0x55c465bc11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:31.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.957+0000 7fe296800640 1 --2- 172.21.15.12:0/1622670578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbcc50 0x55c465bc11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.957+0000 7fe296800640 1 -- 172.21.15.12:0/1622670578 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c465bc1ce0 con 0x55c465bbc330 2024-09-05T01:24:31.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.957+0000 7fe295400640 1 --2- 172.21.15.12:0/1622670578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbcc50 0x55c465bc11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:31.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.957+0000 7fe296800640 1 --2- 172.21.15.12:0/1622670578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c465bbc330 0x55c465be1e30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe290009cd0 tx=0x7fe2900124f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb34999be7d2fe7e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:31.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.957+0000 7fe277400640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:24:31.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.958+0000 7fe277400640 1 -- 172.21.15.12:0/1622670578 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290016070 con 0x55c465bbc330 2024-09-05T01:24:31.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.958+0000 7fe29f62c740 1 -- 172.21.15.12:0/1622670578 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe28404b070 con 0x55c465bbc330 2024-09-05T01:24:31.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.958+0000 7fe277400640 1 -- 172.21.15.12:0/1622670578 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7fe290002030 con 0x55c465bbc330 2024-09-05T01:24:31.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.958+0000 7fe277400640 1 -- 172.21.15.12:0/1622670578 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe290012bc0 con 0x55c465bbc330 2024-09-05T01:24:31.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.958+0000 7fe29f62c740 10 client.25112 fetch_fsmap learned FSMap version 27 2024-09-05T01:24:31.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.958+0000 7fe29f62c740 1 -- 172.21.15.12:0/1622670578 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c465be0700 con 0x55c465bbc330 2024-09-05T01:24:31.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.958+0000 7fe277400640 1 -- 172.21.15.12:0/1622670578 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe28404b070 con 0x55c465bbc330 2024-09-05T01:24:31.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.958+0000 7fe277400640 1 -- 172.21.15.12:0/1622670578 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fe290042950 con 0x55c465bbc330 2024-09-05T01:24:31.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.958+0000 7fe29f62c740 10 client.25112 fetch_fsmap finished waiting for FSMap version 27 2024-09-05T01:24:31.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.959+0000 7fe29f62c740 10 client.25112 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-05T01:24:31.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.959+0000 7fe29f62c740 20 client.25112 populate_metadata read hostname 'smithi012' 2024-09-05T01:24:31.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.959+0000 7fe29f62c740 1 --2- 172.21.15.12:0/1622670578 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55c465c47280 0x55c465c45f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:31.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.959+0000 7fe29f62c740 4 client.25112 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T01:24:31.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.959+0000 7fe29f62c740 1 -- 172.21.15.12:0/1622670578 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "status"}) -- 0x55c465b29b30 con 0x55c465c47280 2024-09-05T01:24:31.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.959+0000 7fe295400640 1 --2- 172.21.15.12:0/1622670578 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55c465c47280 0x55c465c45f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:31.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.959+0000 7fe295400640 1 --2- 172.21.15.12:0/1622670578 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55c465c47280 0x55c465c45f90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e6ef5e563e7b05e0 server_cookie=aa9f0b2db4b43fdb in_seq=0 out_seq=0 2024-09-05T01:24:31.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.959+0000 7fe277400640 10 client.25112 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:24:31.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.960+0000 7fe277400640 1 -- 172.21.15.12:0/1622670578 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55c465b29b30 con 0x55c465c47280 2024-09-05T01:24:31.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.960+0000 7fe277400640 10 client.25112 handle_command_reply: tid=0 2024-09-05T01:24:31.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.960+0000 7fe29f62c740 1 client.25112 shutdown 2024-09-05T01:24:31.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.960+0000 7fe29f62c740 1 -- 172.21.15.12:0/1622670578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c465bbc330 msgr2=0x55c465be1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:31.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.960+0000 7fe29f62c740 1 --2- 172.21.15.12:0/1622670578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c465bbc330 0x55c465be1e30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe290009cd0 tx=0x7fe2900124f0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.960+0000 7fe29f62c740 1 -- 172.21.15.12:0/1622670578 shutdown_connections 2024-09-05T01:24:31.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.960+0000 7fe29f62c740 1 --2- 172.21.15.12:0/1622670578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c465bc7510 0x55c465bc16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.960+0000 7fe29f62c740 1 --2- 172.21.15.12:0/1622670578 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55c465c47280 0x55c465c45f90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.960+0000 7fe29f62c740 1 --2- 172.21.15.12:0/1622670578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c465bbcc50 0x55c465bc11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.960+0000 7fe29f62c740 1 --2- 172.21.15.12:0/1622670578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c465bbc330 0x55c465be1e30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.960+0000 7fe277400640 0 client.25112 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:24:31.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.960+0000 7fe29f62c740 1 -- 172.21.15.12:0/1622670578 >> 172.21.15.12:0/1622670578 conn(0x55c465bb88c0 msgr2=0x55c465bc3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:31.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.960+0000 7fe29f62c740 1 -- 172.21.15.12:0/1622670578 shutdown_connections 2024-09-05T01:24:31.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.960+0000 7fe29f62c740 1 -- 172.21.15.12:0/1622670578 wait complete. 2024-09-05T01:24:31.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.960+0000 7fe29f62c740 20 client.25112 trim_cache size 0 max 16384 2024-09-05T01:24:31.966 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:24:31.966 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "0d44cd7e-6b24-11ef-bcd6-c7b262605968", 2024-09-05T01:24:31.966 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 1, 2024-09-05T01:24:31.966 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24529, 2024-09-05T01:24:31.966 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-05T01:24:31.966 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-05T01:24:31.966 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-05T01:24:31.966 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 107.892329894, 2024-09-05T01:24:31.967 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 27, 2024-09-05T01:24:31.967 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 85, 2024-09-05T01:24:31.967 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 81, 2024-09-05T01:24:31.967 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 140.02065618200001 2024-09-05T01:24:31.967 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:24:31.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.961+0000 7fe29ca00640 1 -- 172.21.15.12:0/1865431554 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fe27c0a2b80 msgr2=0x7fe27c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:31.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.961+0000 7fe29ca00640 1 --2- 172.21.15.12:0/1865431554 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fe27c0a2b80 0x7fe27c0a5040 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe2880cef50 tx=0x7fe2880d26f0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.961+0000 7fe29ca00640 1 -- 172.21.15.12:0/1865431554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe298074590 msgr2=0x7fe2981a4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:31.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.961+0000 7fe29ca00640 1 --2- 172.21.15.12:0/1865431554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe298074590 0x7fe2981a4740 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe28800d950 tx=0x7fe28800de10 comp rx=0 tx=0).stop 2024-09-05T01:24:31.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.961+0000 7fe29ca00640 1 -- 172.21.15.12:0/1865431554 shutdown_connections 2024-09-05T01:24:31.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.961+0000 7fe29ca00640 1 --2- 172.21.15.12:0/1865431554 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fe27c0a2b80 0x7fe27c0a5040 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.961+0000 7fe29ca00640 1 --2- 172.21.15.12:0/1865431554 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe298112b90 0x7fe29819e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.961+0000 7fe29ca00640 1 --2- 172.21.15.12:0/1865431554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe298074eb0 0x7fe2981a4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.961+0000 7fe29ca00640 1 --2- 172.21.15.12:0/1865431554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe298074590 0x7fe2981a4740 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:31.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.961+0000 7fe29ca00640 1 -- 172.21.15.12:0/1865431554 >> 172.21.15.12:0/1865431554 conn(0x7fe2980fd8c0 msgr2=0x7fe2980ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:31.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.961+0000 7fe29ca00640 1 -- 172.21.15.12:0/1865431554 shutdown_connections 2024-09-05T01:24:31.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:31.961+0000 7fe29ca00640 1 -- 172.21.15.12:0/1865431554 wait complete. 2024-09-05T01:24:32.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:32 smithi012 ceph-mon[29942]: pgmap v350: 97 pgs: 97 active+clean; 645 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 824 B/s wr, 10 op/s; 11 B/s, 0 objects/s recovering 2024-09-05T01:24:32.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:32 smithi145 ceph-mon[34376]: pgmap v350: 97 pgs: 97 active+clean; 645 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 824 B/s wr, 10 op/s; 11 B/s, 0 objects/s recovering 2024-09-05T01:24:32.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:32 smithi151 ceph-mon[35013]: pgmap v350: 97 pgs: 97 active+clean; 645 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 824 B/s wr, 10 op/s; 11 B/s, 0 objects/s recovering 2024-09-05T01:24:32.814 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.b status 2024-09-05T01:24:33.189 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:24:33.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.745+0000 7f8e79c00640 1 -- 172.21.15.12:0/3062705202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e74102790 msgr2=0x7f8e741067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:33.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.745+0000 7f8e79c00640 1 --2- 172.21.15.12:0/3062705202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e74102790 0x7f8e741067e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c009900 tx=0x7f8e5c02a410 comp rx=0 tx=0).stop 2024-09-05T01:24:33.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.745+0000 7f8e79c00640 1 -- 172.21.15.12:0/3062705202 shutdown_connections 2024-09-05T01:24:33.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.745+0000 7f8e79c00640 1 --2- 172.21.15.12:0/3062705202 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e74106f10 0x7f8e7410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.745+0000 7f8e79c00640 1 --2- 172.21.15.12:0/3062705202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e74102790 0x7f8e741067e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.745+0000 7f8e79c00640 1 --2- 172.21.15.12:0/3062705202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e74101de0 0x7f8e741021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.745+0000 7f8e79c00640 1 -- 172.21.15.12:0/3062705202 >> 172.21.15.12:0/3062705202 conn(0x7f8e740fd8c0 msgr2=0x7f8e740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:33.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.745+0000 7f8e79c00640 1 -- 172.21.15.12:0/3062705202 shutdown_connections 2024-09-05T01:24:33.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.745+0000 7f8e79c00640 1 -- 172.21.15.12:0/3062705202 wait complete. 2024-09-05T01:24:33.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.746+0000 7f8e79c00640 1 Processor -- start 2024-09-05T01:24:33.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.746+0000 7f8e79c00640 1 -- start start 2024-09-05T01:24:33.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.746+0000 7f8e79c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e74101de0 0x7f8e74198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:33.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.746+0000 7f8e79c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e74102790 0x7f8e74198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:33.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.746+0000 7f8e79c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e74106f10 0x7f8e7419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:33.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.747+0000 7f8e79c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8e74111f70 con 0x7f8e74101de0 2024-09-05T01:24:33.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.747+0000 7f8e79c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8e74111df0 con 0x7f8e74106f10 2024-09-05T01:24:33.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.747+0000 7f8e79c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8e741120f0 con 0x7f8e74102790 2024-09-05T01:24:33.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.747+0000 7f8e72a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e74101de0 0x7f8e74198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:33.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.747+0000 7f8e72a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e74101de0 0x7f8e74198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56476/0 (socket says 172.21.15.12:56476) 2024-09-05T01:24:33.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.747+0000 7f8e72a00640 1 -- 172.21.15.12:0/3605192022 learned_addr learned my addr 172.21.15.12:0/3605192022 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:33.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.747+0000 7f8e6a000640 1 --2- 172.21.15.12:0/3605192022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e74102790 0x7f8e74198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:33.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.747+0000 7f8e73400640 1 --2- 172.21.15.12:0/3605192022 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e74106f10 0x7f8e7419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:33.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.747+0000 7f8e72a00640 1 -- 172.21.15.12:0/3605192022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e74102790 msgr2=0x7f8e74198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:33.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.747+0000 7f8e72a00640 1 --2- 172.21.15.12:0/3605192022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e74102790 0x7f8e74198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.747+0000 7f8e72a00640 1 -- 172.21.15.12:0/3605192022 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e74106f10 msgr2=0x7f8e7419cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:33.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.747+0000 7f8e72a00640 1 --2- 172.21.15.12:0/3605192022 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e74106f10 0x7f8e7419cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.747+0000 7f8e72a00640 1 -- 172.21.15.12:0/3605192022 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e7419d3f0 con 0x7f8e74101de0 2024-09-05T01:24:33.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.748+0000 7f8e72a00640 1 --2- 172.21.15.12:0/3605192022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e74101de0 0x7f8e74198440 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8e6400e9f0 tx=0x7f8e6400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:33.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.748+0000 7f8e6be00640 1 -- 172.21.15.12:0/3605192022 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6400cd80 con 0x7f8e74101de0 2024-09-05T01:24:33.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.748+0000 7f8e6be00640 1 -- 172.21.15.12:0/3605192022 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e64005500 con 0x7f8e74101de0 2024-09-05T01:24:33.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.748+0000 7f8e79c00640 1 -- 172.21.15.12:0/3605192022 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e7419d6e0 con 0x7f8e74101de0 2024-09-05T01:24:33.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.748+0000 7f8e6be00640 1 -- 172.21.15.12:0/3605192022 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e64010690 con 0x7f8e74101de0 2024-09-05T01:24:33.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.748+0000 7f8e79c00640 1 -- 172.21.15.12:0/3605192022 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e741a4fc0 con 0x7f8e74101de0 2024-09-05T01:24:33.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.751+0000 7f8e6be00640 1 -- 172.21.15.12:0/3605192022 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f8e640046c0 con 0x7f8e74101de0 2024-09-05T01:24:33.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.751+0000 7f8e7c602740 1 Processor -- start 2024-09-05T01:24:33.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.751+0000 7f8e7c602740 1 -- start start 2024-09-05T01:24:33.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.752+0000 7f8e7c602740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317cd330 0x5575317cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:33.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.752+0000 7f8e7c602740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575317cdc50 0x5575317d7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:33.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.752+0000 7f8e7c602740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5575317d8510 0x5575317da900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:33.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.752+0000 7f8e7c602740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5575317330b0 con 0x5575317cd330 2024-09-05T01:24:33.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.752+0000 7f8e7c602740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5575316daab0 con 0x5575317cdc50 2024-09-05T01:24:33.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.752+0000 7f8e7c602740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55753172f070 con 0x5575317d8510 2024-09-05T01:24:33.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.752+0000 7f8e73400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317cd330 0x5575317cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:33.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.752+0000 7f8e73400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317cd330 0x5575317cd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56486/0 (socket says 172.21.15.12:56486) 2024-09-05T01:24:33.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.752+0000 7f8e73400640 1 -- 172.21.15.12:0/1189115963 learned_addr learned my addr 172.21.15.12:0/1189115963 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:33.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.752+0000 7f8e72a00640 1 --2- 172.21.15.12:0/1189115963 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575317cdc50 0x5575317d7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:33.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.752+0000 7f8e6a000640 1 --2- 172.21.15.12:0/1189115963 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5575317d8510 0x5575317da900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:33.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.753+0000 7f8e73400640 1 -- 172.21.15.12:0/1189115963 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5575317d8510 msgr2=0x5575317da900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:33.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.753+0000 7f8e73400640 1 --2- 172.21.15.12:0/1189115963 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5575317d8510 0x5575317da900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.753+0000 7f8e73400640 1 -- 172.21.15.12:0/1189115963 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575317cdc50 msgr2=0x5575317d7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:33.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.753+0000 7f8e73400640 1 --2- 172.21.15.12:0/1189115963 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575317cdc50 0x5575317d7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.753+0000 7f8e73400640 1 -- 172.21.15.12:0/1189115963 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575316e74a0 con 0x5575317cd330 2024-09-05T01:24:33.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.753+0000 7f8e6a000640 1 --2- 172.21.15.12:0/1189115963 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5575317d8510 0x5575317da900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:24:33.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.753+0000 7f8e72a00640 1 --2- 172.21.15.12:0/1189115963 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575317cdc50 0x5575317d7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:24:33.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.753+0000 7f8e73400640 1 --2- 172.21.15.12:0/1189115963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317cd330 0x5575317cd710 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c009f90 tx=0x7f8e6c010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2250ec51d452aa8e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:33.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.753+0000 7f8e6be00640 1 --2- 172.21.15.12:0/3605192022 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8e580a2b80 0x7f8e580a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:33.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.753+0000 7f8e63e00640 1 -- 172.21.15.12:0/1189115963 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c011700 con 0x5575317cd330 2024-09-05T01:24:33.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.753+0000 7f8e63e00640 1 -- 172.21.15.12:0/1189115963 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e6c011d80 con 0x5575317cd330 2024-09-05T01:24:33.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.753+0000 7f8e63e00640 1 -- 172.21.15.12:0/1189115963 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c018380 con 0x5575317cd330 2024-09-05T01:24:33.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.753+0000 7f8e6be00640 1 -- 172.21.15.12:0/3605192022 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7f8e640cf4b0 con 0x7f8e74101de0 2024-09-05T01:24:33.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.753+0000 7f8e72a00640 1 --2- 172.21.15.12:0/3605192022 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8e580a2b80 0x7f8e580a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:33.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.754+0000 7f8e7c602740 1 -- 172.21.15.12:0/1189115963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317cd330 msgr2=0x5575317cd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:33.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.754+0000 7f8e7c602740 1 --2- 172.21.15.12:0/1189115963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317cd330 0x5575317cd710 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c009f90 tx=0x7f8e6c010860 comp rx=0 tx=0).stop 2024-09-05T01:24:33.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.754+0000 7f8e72a00640 1 --2- 172.21.15.12:0/3605192022 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8e580a2b80 0x7f8e580a5040 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8e640980e0 tx=0x7f8e64004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:33.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.754+0000 7f8e7c602740 1 -- 172.21.15.12:0/1189115963 shutdown_connections 2024-09-05T01:24:33.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.754+0000 7f8e7c602740 1 --2- 172.21.15.12:0/1189115963 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5575317d8510 0x5575317da900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.754+0000 7f8e7c602740 1 --2- 172.21.15.12:0/1189115963 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575317cdc50 0x5575317d7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.754+0000 7f8e7c602740 1 --2- 172.21.15.12:0/1189115963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317cd330 0x5575317cd710 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.754+0000 7f8e7c602740 1 -- 172.21.15.12:0/1189115963 >> 172.21.15.12:0/1189115963 conn(0x5575317c98c0 msgr2=0x5575317c9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.754+0000 7f8e7c602740 1 -- 172.21.15.12:0/1189115963 shutdown_connections 2024-09-05T01:24:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.754+0000 7f8e7c602740 1 -- 172.21.15.12:0/1189115963 wait complete. 2024-09-05T01:24:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.755+0000 7f8e7c602740 1 -- start start 2024-09-05T01:24:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.755+0000 7f8e7c602740 1 Processor -- start 2024-09-05T01:24:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.756+0000 7f8e7c602740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5575317cd330 0x5575317dc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.756+0000 7f8e7c602740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575317cdc50 0x5575317dcf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.756+0000 7f8e7c602740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317d8510 0x5575317e10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.756+0000 7f8e7c602740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5575317db060 con 0x5575317d8510 2024-09-05T01:24:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.756+0000 7f8e7c602740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5575316bb920 con 0x5575317cdc50 2024-09-05T01:24:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.756+0000 7f8e7c602740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5575317db1e0 con 0x5575317cd330 2024-09-05T01:24:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.756+0000 7f8e7c602740 10 client.0 _ll_register_callbacks cb 0x5575316df8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:24:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.756+0000 7f8e73400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317d8510 0x5575317e10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.756+0000 7f8e6a000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575317cdc50 0x5575317dcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.756+0000 7f8e73400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5575317cd330 0x5575317dc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.756+0000 7f8e6a000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575317cdc50 0x5575317dcf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:57176/0 (socket says 172.21.15.12:57176) 2024-09-05T01:24:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.756+0000 7f8e6a000640 1 -- 172.21.15.12:0/80431843 learned_addr learned my addr 172.21.15.12:0/80431843 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.756+0000 7f8e6a000640 1 -- 172.21.15.12:0/80431843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5575317cd330 msgr2=0x5575317dc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.756+0000 7f8e6a000640 1 --2- 172.21.15.12:0/80431843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5575317cd330 0x5575317dc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.756+0000 7f8e6a000640 1 -- 172.21.15.12:0/80431843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317d8510 msgr2=0x5575317e10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.756+0000 7f8e6a000640 1 --2- 172.21.15.12:0/80431843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317d8510 0x5575317e10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.756+0000 7f8e6a000640 1 -- 172.21.15.12:0/80431843 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575314a42b0 con 0x5575317cdc50 2024-09-05T01:24:33.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.757+0000 7f8e6a000640 1 --2- 172.21.15.12:0/80431843 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575317cdc50 0x5575317dcf30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c02a930 tx=0x7f8e5c0318d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94b1b26f69af06cc server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:33.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.757+0000 7f8e60c00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:24:33.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.757+0000 7f8e60c00640 1 -- 172.21.15.12:0/80431843 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c035040 con 0x5575317cdc50 2024-09-05T01:24:33.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.757+0000 7f8e7c602740 1 -- 172.21.15.12:0/80431843 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e6c011d80 con 0x5575317cdc50 2024-09-05T01:24:33.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.757+0000 7f8e60c00640 1 -- 172.21.15.12:0/80431843 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7f8e5c004240 con 0x5575317cdc50 2024-09-05T01:24:33.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.757+0000 7f8e60c00640 1 -- 172.21.15.12:0/80431843 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8e5c04b030 con 0x5575317cdc50 2024-09-05T01:24:33.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.757+0000 7f8e7c602740 10 client.25124 fetch_fsmap learned FSMap version 27 2024-09-05T01:24:33.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.757+0000 7f8e7c602740 1 -- 172.21.15.12:0/80431843 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5575317eb1f0 con 0x5575317cdc50 2024-09-05T01:24:33.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.758+0000 7f8e60c00640 1 -- 172.21.15.12:0/80431843 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e6c011d80 con 0x5575317cdc50 2024-09-05T01:24:33.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.758+0000 7f8e60c00640 1 -- 172.21.15.12:0/80431843 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f8e5c045510 con 0x5575317cdc50 2024-09-05T01:24:33.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.758+0000 7f8e7c602740 10 client.25124 fetch_fsmap finished waiting for FSMap version 27 2024-09-05T01:24:33.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.758+0000 7f8e7c602740 10 client.25124 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-05T01:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.758+0000 7f8e7c602740 20 client.25124 populate_metadata read hostname 'smithi012' 2024-09-05T01:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.758+0000 7f8e7c602740 1 --2- 172.21.15.12:0/80431843 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5575317ed7a0 0x5575317eec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.758+0000 7f8e7c602740 4 client.25124 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.758+0000 7f8e7c602740 1 -- 172.21.15.12:0/80431843 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557531740620 con 0x5575317ed7a0 2024-09-05T01:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.759+0000 7f8e73400640 1 --2- 172.21.15.12:0/80431843 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5575317ed7a0 0x5575317eec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.759+0000 7f8e73400640 1 --2- 172.21.15.12:0/80431843 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5575317ed7a0 0x5575317eec10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d45b819035c3cf96 server_cookie=6ee1ea5e283d9327 in_seq=0 out_seq=0 2024-09-05T01:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.759+0000 7f8e60c00640 10 client.25124 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.760+0000 7f8e60c00640 1 -- 172.21.15.12:0/80431843 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557531740620 con 0x5575317ed7a0 2024-09-05T01:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.760+0000 7f8e60c00640 10 client.25124 handle_command_reply: tid=0 2024-09-05T01:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.760+0000 7f8e7c602740 1 client.25124 shutdown 2024-09-05T01:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.760+0000 7f8e7c602740 1 -- 172.21.15.12:0/80431843 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575317cdc50 msgr2=0x5575317dcf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.760+0000 7f8e7c602740 1 --2- 172.21.15.12:0/80431843 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575317cdc50 0x5575317dcf30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c02a930 tx=0x7f8e5c0318d0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.761+0000 7f8e7c602740 1 -- 172.21.15.12:0/80431843 shutdown_connections 2024-09-05T01:24:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.761+0000 7f8e7c602740 1 --2- 172.21.15.12:0/80431843 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5575317ed7a0 0x5575317eec10 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.761+0000 7f8e7c602740 1 --2- 172.21.15.12:0/80431843 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317d8510 0x5575317e10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.761+0000 7f8e7c602740 1 --2- 172.21.15.12:0/80431843 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575317cdc50 0x5575317dcf30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.761+0000 7f8e7c602740 1 --2- 172.21.15.12:0/80431843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5575317cd330 0x5575317dc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.761+0000 7f8e60c00640 0 client.25124 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:24:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.761+0000 7f8e7c602740 1 -- 172.21.15.12:0/80431843 >> 172.21.15.12:0/80431843 conn(0x5575317c98c0 msgr2=0x5575317cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.761+0000 7f8e7c602740 1 -- 172.21.15.12:0/80431843 shutdown_connections 2024-09-05T01:24:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.761+0000 7f8e7c602740 1 -- 172.21.15.12:0/80431843 wait complete. 2024-09-05T01:24:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.761+0000 7f8e7c602740 20 client.25124 trim_cache size 0 max 16384 2024-09-05T01:24:33.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.779+0000 7f8e7c602740 1 Processor -- start 2024-09-05T01:24:33.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.780+0000 7f8e7c602740 1 -- start start 2024-09-05T01:24:33.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.780+0000 7f8e7c602740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575317cd330 0x5575317e1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:33.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.780+0000 7f8e7c602740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5575317cdc50 0x5575317f6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:33.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.780+0000 7f8e7c602740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317d8510 0x5575317f7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:33.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.780+0000 7f8e7c602740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5575317ecf50 con 0x5575317d8510 2024-09-05T01:24:33.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.780+0000 7f8e7c602740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5575317ed620 con 0x5575317cd330 2024-09-05T01:24:33.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.780+0000 7f8e7c602740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5575317edcf0 con 0x5575317cdc50 2024-09-05T01:24:33.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.780+0000 7f8e73400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575317cd330 0x5575317e1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:33.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.780+0000 7f8e73400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317d8510 0x5575317f7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:33.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.780+0000 7f8e73400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317d8510 0x5575317f7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56510/0 (socket says 172.21.15.12:56510) 2024-09-05T01:24:33.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.780+0000 7f8e73400640 1 -- 172.21.15.12:0/1861285755 learned_addr learned my addr 172.21.15.12:0/1861285755 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:33.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.780+0000 7f8e6a000640 1 --2- 172.21.15.12:0/1861285755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5575317cdc50 0x5575317f6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:33.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.781+0000 7f8e73400640 1 -- 172.21.15.12:0/1861285755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5575317cdc50 msgr2=0x5575317f6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:33.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.781+0000 7f8e73400640 1 --2- 172.21.15.12:0/1861285755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5575317cdc50 0x5575317f6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.781+0000 7f8e73400640 1 -- 172.21.15.12:0/1861285755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575317cd330 msgr2=0x5575317e1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:33.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.781+0000 7f8e73400640 1 --2- 172.21.15.12:0/1861285755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575317cd330 0x5575317e1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.781+0000 7f8e73400640 1 -- 172.21.15.12:0/1861285755 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575317dac70 con 0x5575317d8510 2024-09-05T01:24:33.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.781+0000 7f8e73400640 1 --2- 172.21.15.12:0/1861285755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317d8510 0x5575317f7430 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c019aa0 tx=0x7f8e6c0096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0f393f70b3d361 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:33.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.781+0000 7f8e63400640 1 -- 172.21.15.12:0/1861285755 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c01f040 con 0x5575317d8510 2024-09-05T01:24:33.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.781+0000 7f8e63400640 1 -- 172.21.15.12:0/1861285755 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e6c003e50 con 0x5575317d8510 2024-09-05T01:24:33.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.781+0000 7f8e63400640 1 -- 172.21.15.12:0/1861285755 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c011760 con 0x5575317d8510 2024-09-05T01:24:33.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.782+0000 7f8e7c602740 1 -- 172.21.15.12:0/1861285755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317d8510 msgr2=0x5575317f7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:33.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.782+0000 7f8e7c602740 1 --2- 172.21.15.12:0/1861285755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317d8510 0x5575317f7430 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c019aa0 tx=0x7f8e6c0096a0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.782+0000 7f8e7c602740 1 -- 172.21.15.12:0/1861285755 shutdown_connections 2024-09-05T01:24:33.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.782+0000 7f8e7c602740 1 --2- 172.21.15.12:0/1861285755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317d8510 0x5575317f7430 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.782+0000 7f8e7c602740 1 --2- 172.21.15.12:0/1861285755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5575317cdc50 0x5575317f6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.782+0000 7f8e7c602740 1 --2- 172.21.15.12:0/1861285755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575317cd330 0x5575317e1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.782+0000 7f8e7c602740 1 -- 172.21.15.12:0/1861285755 >> 172.21.15.12:0/1861285755 conn(0x5575317c98c0 msgr2=0x5575317d4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:33.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.782+0000 7f8e7c602740 1 -- 172.21.15.12:0/1861285755 shutdown_connections 2024-09-05T01:24:33.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.782+0000 7f8e7c602740 1 -- 172.21.15.12:0/1861285755 wait complete. 2024-09-05T01:24:33.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.782+0000 7f8e7c602740 1 -- start start 2024-09-05T01:24:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.783+0000 7f8e7c602740 1 Processor -- start 2024-09-05T01:24:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.783+0000 7f8e7c602740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5575317cd330 0x5575317d62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.783+0000 7f8e7c602740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317cdc50 0x5575317d6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.783+0000 7f8e7c602740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575317d8510 0x5575317d6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.783+0000 7f8e7c602740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5575317eea90 con 0x5575317cdc50 2024-09-05T01:24:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.783+0000 7f8e7c602740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5575317ee3c0 con 0x5575317d8510 2024-09-05T01:24:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.783+0000 7f8e7c602740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5575317ef160 con 0x5575317cd330 2024-09-05T01:24:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.783+0000 7f8e7c602740 10 client.0 _ll_register_callbacks cb 0x7f8e5c005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:24:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.783+0000 7f8e6a000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317cdc50 0x5575317d6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.783+0000 7f8e73400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5575317cd330 0x5575317d62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.783+0000 7f8e6a000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317cdc50 0x5575317d6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56514/0 (socket says 172.21.15.12:56514) 2024-09-05T01:24:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.783+0000 7f8e6a000640 1 -- 172.21.15.12:0/1999454383 learned_addr learned my addr 172.21.15.12:0/1999454383 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:33.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.784+0000 7f8e73400640 1 --2- 172.21.15.12:0/1999454383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575317d8510 0x5575317d6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.784+0000 7f8e6a000640 1 -- 172.21.15.12:0/1999454383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5575317cd330 msgr2=0x5575317d62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.784+0000 7f8e6a000640 1 --2- 172.21.15.12:0/1999454383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5575317cd330 0x5575317d62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.784+0000 7f8e6a000640 1 -- 172.21.15.12:0/1999454383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575317d8510 msgr2=0x5575317d6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.784+0000 7f8e6a000640 1 --2- 172.21.15.12:0/1999454383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575317d8510 0x5575317d6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.784+0000 7f8e6a000640 1 -- 172.21.15.12:0/1999454383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575317e83c0 con 0x5575317cdc50 2024-09-05T01:24:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.784+0000 7f8e73400640 1 --2- 172.21.15.12:0/1999454383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575317d8510 0x5575317d6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:24:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.784+0000 7f8e6a000640 1 --2- 172.21.15.12:0/1999454383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317cdc50 0x5575317d6800 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x5575317dc0a0 tx=0x7f8e5c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f46fb53752099569 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.784+0000 7f8e60c00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:24:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.784+0000 7f8e60c00640 1 -- 172.21.15.12:0/1999454383 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c035050 con 0x5575317cdc50 2024-09-05T01:24:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.784+0000 7f8e7c602740 1 -- 172.21.15.12:0/1999454383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e6c003e50 con 0x5575317cdc50 2024-09-05T01:24:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.784+0000 7f8e60c00640 1 -- 172.21.15.12:0/1999454383 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7f8e5c045480 con 0x5575317cdc50 2024-09-05T01:24:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.785+0000 7f8e60c00640 1 -- 172.21.15.12:0/1999454383 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8e5c045d60 con 0x5575317cdc50 2024-09-05T01:24:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.785+0000 7f8e7c602740 10 client.15123 fetch_fsmap learned FSMap version 27 2024-09-05T01:24:33.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.785+0000 7f8e7c602740 1 -- 172.21.15.12:0/1999454383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557531858390 con 0x5575317cdc50 2024-09-05T01:24:33.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.785+0000 7f8e60c00640 1 -- 172.21.15.12:0/1999454383 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e6c003e50 con 0x5575317cdc50 2024-09-05T01:24:33.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.785+0000 7f8e60c00640 1 -- 172.21.15.12:0/1999454383 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f8e5c0046c0 con 0x5575317cdc50 2024-09-05T01:24:33.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.785+0000 7f8e7c602740 10 client.15123 fetch_fsmap finished waiting for FSMap version 27 2024-09-05T01:24:33.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.785+0000 7f8e7c602740 10 client.15123 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-05T01:24:33.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.785+0000 7f8e7c602740 20 client.15123 populate_metadata read hostname 'smithi012' 2024-09-05T01:24:33.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.785+0000 7f8e7c602740 1 --2- 172.21.15.12:0/1999454383 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55753185cf40 0x55753185bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:33.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.785+0000 7f8e7c602740 4 client.15123 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-05T01:24:33.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.785+0000 7f8e7c602740 1 -- 172.21.15.12:0/1999454383 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "status"}) -- 0x55753173ab30 con 0x55753185cf40 2024-09-05T01:24:33.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.786+0000 7f8e73400640 1 --2- 172.21.15.12:0/1999454383 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55753185cf40 0x55753185bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:33.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.786+0000 7f8e73400640 1 --2- 172.21.15.12:0/1999454383 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55753185cf40 0x55753185bc50 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d70e22ede5f94fe1 server_cookie=55bc8e4b455322de in_seq=0 out_seq=0 2024-09-05T01:24:33.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.786+0000 7f8e60c00640 10 client.15123 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:24:33.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.786+0000 7f8e60c00640 1 -- 172.21.15.12:0/1999454383 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55753173ab30 con 0x55753185cf40 2024-09-05T01:24:33.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.786+0000 7f8e60c00640 10 client.15123 handle_command_reply: tid=0 2024-09-05T01:24:33.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.786+0000 7f8e7c602740 1 client.15123 shutdown 2024-09-05T01:24:33.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.787+0000 7f8e7c602740 1 -- 172.21.15.12:0/1999454383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317cdc50 msgr2=0x5575317d6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:33.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.787+0000 7f8e7c602740 1 --2- 172.21.15.12:0/1999454383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317cdc50 0x5575317d6800 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x5575317dc0a0 tx=0x7f8e5c000bc0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.787+0000 7f8e7c602740 1 -- 172.21.15.12:0/1999454383 shutdown_connections 2024-09-05T01:24:33.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.787+0000 7f8e7c602740 1 --2- 172.21.15.12:0/1999454383 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55753185cf40 0x55753185bc50 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.787+0000 7f8e7c602740 1 --2- 172.21.15.12:0/1999454383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5575317d8510 0x5575317d6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.787+0000 7f8e7c602740 1 --2- 172.21.15.12:0/1999454383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575317cdc50 0x5575317d6800 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.787+0000 7f8e7c602740 1 --2- 172.21.15.12:0/1999454383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5575317cd330 0x5575317d62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.787+0000 7f8e7c602740 1 -- 172.21.15.12:0/1999454383 >> 172.21.15.12:0/1999454383 conn(0x5575317c98c0 msgr2=0x5575317c8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:33.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.787+0000 7f8e60c00640 0 client.15123 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:24:33.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.787+0000 7f8e7c602740 1 -- 172.21.15.12:0/1999454383 shutdown_connections 2024-09-05T01:24:33.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.787+0000 7f8e7c602740 1 -- 172.21.15.12:0/1999454383 wait complete. 2024-09-05T01:24:33.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.787+0000 7f8e7c602740 20 client.15123 trim_cache size 0 max 16384 2024-09-05T01:24:33.791 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:24:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "0d44cd7e-6b24-11ef-bcd6-c7b262605968", 2024-09-05T01:24:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-09-05T01:24:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 24560, 2024-09-05T01:24:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-09-05T01:24:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-09-05T01:24:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-09-05T01:24:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 117.7614667, 2024-09-05T01:24:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 27, 2024-09-05T01:24:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 85, 2024-09-05T01:24:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 81, 2024-09-05T01:24:33.792 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 131.42407959299999 2024-09-05T01:24:33.792 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:24:33.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.788+0000 7f8e79c00640 1 -- 172.21.15.12:0/3605192022 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8e580a2b80 msgr2=0x7f8e580a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:33.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.788+0000 7f8e79c00640 1 --2- 172.21.15.12:0/3605192022 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8e580a2b80 0x7f8e580a5040 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8e640980e0 tx=0x7f8e64004a40 comp rx=0 tx=0).stop 2024-09-05T01:24:33.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.788+0000 7f8e79c00640 1 -- 172.21.15.12:0/3605192022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e74101de0 msgr2=0x7f8e74198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:33.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.788+0000 7f8e79c00640 1 --2- 172.21.15.12:0/3605192022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e74101de0 0x7f8e74198440 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8e6400e9f0 tx=0x7f8e6400edf0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.788+0000 7f8e79c00640 1 -- 172.21.15.12:0/3605192022 shutdown_connections 2024-09-05T01:24:33.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.788+0000 7f8e79c00640 1 --2- 172.21.15.12:0/3605192022 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f8e580a2b80 0x7f8e580a5040 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.788+0000 7f8e79c00640 1 --2- 172.21.15.12:0/3605192022 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e74106f10 0x7f8e7419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.788+0000 7f8e79c00640 1 --2- 172.21.15.12:0/3605192022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e74102790 0x7f8e74198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.788+0000 7f8e79c00640 1 --2- 172.21.15.12:0/3605192022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e74101de0 0x7f8e74198440 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:33.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.788+0000 7f8e79c00640 1 -- 172.21.15.12:0/3605192022 >> 172.21.15.12:0/3605192022 conn(0x7f8e740fd8c0 msgr2=0x7f8e740fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:33.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.788+0000 7f8e79c00640 1 -- 172.21.15.12:0/3605192022 shutdown_connections 2024-09-05T01:24:33.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:33.788+0000 7f8e79c00640 1 -- 172.21.15.12:0/3605192022 wait complete. 2024-09-05T01:24:34.502 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:34 smithi012 ceph-mon[29942]: pgmap v351: 97 pgs: 97 active+clean; 645 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 656 B/s wr, 10 op/s; 10 B/s, 0 objects/s recovering 2024-09-05T01:24:34.538 INFO:teuthology.run_tasks:Running task sequential... 2024-09-05T01:24:34.548 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-05T01:24:34.548 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-05T01:24:34.548 INFO:teuthology.task.print:Enabling mgr modules 2024-09-05T01:24:34.548 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-05T01:24:34.549 INFO:teuthology.task.exec:Executing custom commands... 2024-09-05T01:24:34.549 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi012.front.sepia.ceph.com 2024-09-05T01:24:34.549 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-05T01:24:34.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:34 smithi145 ceph-mon[34376]: pgmap v351: 97 pgs: 97 active+clean; 645 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 656 B/s wr, 10 op/s; 10 B/s, 0 objects/s recovering 2024-09-05T01:24:34.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:34 smithi151 ceph-mon[35013]: pgmap v351: 97 pgs: 97 active+clean; 645 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 656 B/s wr, 10 op/s; 10 B/s, 0 objects/s recovering 2024-09-05T01:24:34.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.704+0000 7f3c27e00640 1 -- 172.21.15.12:0/886224851 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c28104cf0 msgr2=0x7f3c281070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:34.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.704+0000 7f3c27e00640 1 --2- 172.21.15.12:0/886224851 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c28104cf0 0x7f3c281070e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3c10009900 tx=0x7f3c1002a3f0 comp rx=0 tx=0).stop 2024-09-05T01:24:34.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.704+0000 7f3c27e00640 1 -- 172.21.15.12:0/886224851 shutdown_connections 2024-09-05T01:24:34.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.704+0000 7f3c27e00640 1 --2- 172.21.15.12:0/886224851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c28107620 0x7f3c28109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:34.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.704+0000 7f3c27e00640 1 --2- 172.21.15.12:0/886224851 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c28104cf0 0x7f3c281070e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:34.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.704+0000 7f3c27e00640 1 --2- 172.21.15.12:0/886224851 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c281023c0 0x7f3c281047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:34.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.704+0000 7f3c27e00640 1 -- 172.21.15.12:0/886224851 >> 172.21.15.12:0/886224851 conn(0x7f3c280fbfa0 msgr2=0x7f3c280fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:34.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.704+0000 7f3c27e00640 1 -- 172.21.15.12:0/886224851 shutdown_connections 2024-09-05T01:24:34.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.704+0000 7f3c27e00640 1 -- 172.21.15.12:0/886224851 wait complete. 2024-09-05T01:24:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.705+0000 7f3c27e00640 1 Processor -- start 2024-09-05T01:24:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.705+0000 7f3c27e00640 1 -- start start 2024-09-05T01:24:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.705+0000 7f3c27e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c281023c0 0x7f3c28197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.705+0000 7f3c27e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c28104cf0 0x7f3c28198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.705+0000 7f3c27e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c28107620 0x7f3c2819f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.706+0000 7f3c27e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2810d5d0 con 0x7f3c281023c0 2024-09-05T01:24:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.706+0000 7f3c27e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2810d450 con 0x7f3c28107620 2024-09-05T01:24:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.706+0000 7f3c27e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2810d750 con 0x7f3c28104cf0 2024-09-05T01:24:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.706+0000 7f3c26a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c281023c0 0x7f3c28197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.706+0000 7f3c26a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c281023c0 0x7f3c28197d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56532/0 (socket says 172.21.15.12:56532) 2024-09-05T01:24:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.706+0000 7f3c26a00640 1 -- 172.21.15.12:0/594106551 learned_addr learned my addr 172.21.15.12:0/594106551 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.706+0000 7f3c1fe00640 1 --2- 172.21.15.12:0/594106551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c28104cf0 0x7f3c28198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.706+0000 7f3c27400640 1 --2- 172.21.15.12:0/594106551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c28107620 0x7f3c2819f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.706+0000 7f3c26a00640 1 -- 172.21.15.12:0/594106551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c28104cf0 msgr2=0x7f3c28198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.706+0000 7f3c26a00640 1 --2- 172.21.15.12:0/594106551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c28104cf0 0x7f3c28198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.706+0000 7f3c26a00640 1 -- 172.21.15.12:0/594106551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c28107620 msgr2=0x7f3c2819f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.706+0000 7f3c26a00640 1 --2- 172.21.15.12:0/594106551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c28107620 0x7f3c2819f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.706+0000 7f3c26a00640 1 -- 172.21.15.12:0/594106551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2819f920 con 0x7f3c281023c0 2024-09-05T01:24:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.706+0000 7f3c27400640 1 --2- 172.21.15.12:0/594106551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c28107620 0x7f3c2819f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:24:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.706+0000 7f3c26a00640 1 --2- 172.21.15.12:0/594106551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c281023c0 0x7f3c28197d10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800e9f0 tx=0x7f3c1800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.707+0000 7f3c1f400640 1 -- 172.21.15.12:0/594106551 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1800cd80 con 0x7f3c281023c0 2024-09-05T01:24:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.707+0000 7f3c27e00640 1 -- 172.21.15.12:0/594106551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c2819fc10 con 0x7f3c281023c0 2024-09-05T01:24:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.707+0000 7f3c1f400640 1 -- 172.21.15.12:0/594106551 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c18010910 con 0x7f3c281023c0 2024-09-05T01:24:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.707+0000 7f3c1f400640 1 -- 172.21.15.12:0/594106551 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c180188f0 con 0x7f3c281023c0 2024-09-05T01:24:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.707+0000 7f3c27e00640 1 -- 172.21.15.12:0/594106551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c281a01b0 con 0x7f3c281023c0 2024-09-05T01:24:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.708+0000 7f3c27e00640 1 -- 172.21.15.12:0/594106551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c280fda90 con 0x7f3c281023c0 2024-09-05T01:24:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.710+0000 7f3c1f400640 1 -- 172.21.15.12:0/594106551 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3c18010ac0 con 0x7f3c281023c0 2024-09-05T01:24:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.711+0000 7f3c1f400640 1 --2- 172.21.15.12:0/594106551 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3c0c0a2b80 0x7f3c0c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.711+0000 7f3c1f400640 1 -- 172.21.15.12:0/594106551 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7f3c180cf5a0 con 0x7f3c281023c0 2024-09-05T01:24:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.711+0000 7f3c1fe00640 1 --2- 172.21.15.12:0/594106551 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3c0c0a2b80 0x7f3c0c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.712+0000 7f3c1fe00640 1 --2- 172.21.15.12:0/594106551 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3c0c0a2b80 0x7f3c0c0a5040 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3c10005ab0 tx=0x7f3c10000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:34.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.715+0000 7f3c1f400640 1 -- 172.21.15.12:0/594106551 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3c1809c470 con 0x7f3c281023c0 2024-09-05T01:24:34.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:34.948+0000 7f3c27e00640 1 -- 172.21.15.12:0/594106551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f3c28062e20 con 0x7f3c281023c0 2024-09-05T01:24:35.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:35.275+0000 7f3c1f400640 1 -- 172.21.15.12:0/594106551 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f3c1809bd70 con 0x7f3c281023c0 2024-09-05T01:24:35.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:35.277+0000 7f3c27e00640 1 -- 172.21.15.12:0/594106551 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3c0c0a2b80 msgr2=0x7f3c0c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:35.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:35.277+0000 7f3c27e00640 1 --2- 172.21.15.12:0/594106551 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3c0c0a2b80 0x7f3c0c0a5040 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3c10005ab0 tx=0x7f3c10000bc0 comp rx=0 tx=0).stop 2024-09-05T01:24:35.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:35.277+0000 7f3c27e00640 1 -- 172.21.15.12:0/594106551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c281023c0 msgr2=0x7f3c28197d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:35.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:35.277+0000 7f3c27e00640 1 --2- 172.21.15.12:0/594106551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c281023c0 0x7f3c28197d10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3c1800e9f0 tx=0x7f3c1800eeb0 comp rx=0 tx=0).stop 2024-09-05T01:24:35.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:35.277+0000 7f3c27e00640 1 -- 172.21.15.12:0/594106551 shutdown_connections 2024-09-05T01:24:35.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:35.277+0000 7f3c27e00640 1 --2- 172.21.15.12:0/594106551 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f3c0c0a2b80 0x7f3c0c0a5040 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:35.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:35.277+0000 7f3c27e00640 1 --2- 172.21.15.12:0/594106551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3c28107620 0x7f3c2819f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:35.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:35.277+0000 7f3c27e00640 1 --2- 172.21.15.12:0/594106551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c28104cf0 0x7f3c28198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:35.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:35.277+0000 7f3c27e00640 1 --2- 172.21.15.12:0/594106551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c281023c0 0x7f3c28197d10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:35.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:35.277+0000 7f3c27e00640 1 -- 172.21.15.12:0/594106551 >> 172.21.15.12:0/594106551 conn(0x7f3c280fbfa0 msgr2=0x7f3c28102c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:35.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:35.277+0000 7f3c27e00640 1 -- 172.21.15.12:0/594106551 shutdown_connections 2024-09-05T01:24:35.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:35.279+0000 7f3c27e00640 1 -- 172.21.15.12:0/594106551 wait complete. 2024-09-05T01:24:35.305 INFO:teuthology.run_tasks:Running task kclient... 2024-09-05T01:24:35.331 INFO:tasks.kclient:Mounting kernel clients... 2024-09-05T01:24:35.331 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-05T01:24:35.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T01:24:35.332 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-05T01:24:35.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T01:24:35.369 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2024-09-05T01:24:35.470 INFO:teuthology.orchestra.run.smithi012.stderr:Cannot find device "ceph-brx" 2024-09-05T01:24:35.473 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T01:24:35.473 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-05T01:24:35.474 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-05T01:24:35.474 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-05T01:24:35.474 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs ls 2024-09-05T01:24:35.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:35 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/594106551' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-05T01:24:35.524 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:35 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: ignoring --setuser ceph since I am not root 2024-09-05T01:24:35.524 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:35 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: ignoring --setgroup ceph since I am not root 2024-09-05T01:24:35.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:35 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/594106551' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-05T01:24:35.584 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:35 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: ignoring --setuser ceph since I am not root 2024-09-05T01:24:35.584 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:35 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: ignoring --setgroup ceph since I am not root 2024-09-05T01:24:35.584 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:35 smithi145 ceph-mgr[35743]: -- 172.21.15.145:0/3939371729 <== mon.2 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a9235af0e0 con 0x55a92358d000 2024-09-05T01:24:35.584 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:35 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:35.429+0000 7f415c25b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-05T01:24:35.584 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:35 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:35.486+0000 7f415c25b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-05T01:24:35.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:35 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/594106551' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-05T01:24:35.604 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:35 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: ignoring --setuser ceph since I am not root 2024-09-05T01:24:35.604 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:35 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: ignoring --setgroup ceph since I am not root 2024-09-05T01:24:35.604 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:35 smithi151 ceph-mgr[36832]: -- 172.21.15.151:0/2355462844 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a52adfd0e0 con 0x55a52adda800 2024-09-05T01:24:35.604 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:35 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:35.430+0000 7f00877e1040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-05T01:24:35.604 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:35 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:35.487+0000 7f00877e1040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-05T01:24:35.806 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:35 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:35.532+0000 7f2e5a5d4040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-05T01:24:35.806 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:35 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:35.606+0000 7f2e5a5d4040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-05T01:24:35.806 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:35 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:35.804+0000 7f2e5a5d4040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-05T01:24:35.862 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:24:35.985 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:35 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:35.633+0000 7f00877e1040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-05T01:24:35.985 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:35 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:35.698+0000 7f00877e1040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-05T01:24:35.985 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:35 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:35.842+0000 7f00877e1040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-05T01:24:35.986 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:35 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:35.634+0000 7f415c25b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-05T01:24:35.986 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:35 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:35.701+0000 7f415c25b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-05T01:24:35.986 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:35 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:35.845+0000 7f415c25b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-05T01:24:35.986 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:35 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:35.985+0000 7f415c25b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-05T01:24:36.062 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:35 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:35.891+0000 7f2e5a5d4040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-05T01:24:36.278 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:35 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:35.983+0000 7f00877e1040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-05T01:24:36.390 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:36 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:36.075+0000 7f2e5a5d4040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-05T01:24:36.390 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:36 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:36.250+0000 7f2e5a5d4040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-05T01:24:36.390 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:36 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/594106551' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-05T01:24:36.390 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:36 smithi012 ceph-mon[29942]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-05T01:24:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.421+0000 7f64a7200640 1 -- 172.21.15.12:0/1635908212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64a8102360 msgr2=0x7f64a810e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.421+0000 7f64a7200640 1 --2- 172.21.15.12:0/1635908212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64a8102360 0x7f64a810e890 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009be0 tx=0x7f64a002a6c0 comp rx=0 tx=0).stop 2024-09-05T01:24:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.421+0000 7f64a7200640 1 -- 172.21.15.12:0/1635908212 shutdown_connections 2024-09-05T01:24:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.421+0000 7f64a7200640 1 --2- 172.21.15.12:0/1635908212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64a8102360 0x7f64a810e890 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.421+0000 7f64a7200640 1 --2- 172.21.15.12:0/1635908212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64a81019c0 0x7f64a8101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.421+0000 7f64a7200640 1 --2- 172.21.15.12:0/1635908212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64a81079c0 0x7f64a8107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:36.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.421+0000 7f64a7200640 1 -- 172.21.15.12:0/1635908212 >> 172.21.15.12:0/1635908212 conn(0x7f64a80fd740 msgr2=0x7f64a80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:36.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.421+0000 7f64a7200640 1 -- 172.21.15.12:0/1635908212 shutdown_connections 2024-09-05T01:24:36.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.421+0000 7f64a7200640 1 -- 172.21.15.12:0/1635908212 wait complete. 2024-09-05T01:24:36.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.422+0000 7f64a7200640 1 Processor -- start 2024-09-05T01:24:36.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.422+0000 7f64a7200640 1 -- start start 2024-09-05T01:24:36.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.423+0000 7f64a7200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64a81019c0 0x7f64a8198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:36.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.423+0000 7f64a7200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64a8102360 0x7f64a81987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:36.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.423+0000 7f64a7200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64a81079c0 0x7f64a819cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:36.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.423+0000 7f64a7200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f64a8111dc0 con 0x7f64a8102360 2024-09-05T01:24:36.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.423+0000 7f64a7200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f64a8111c40 con 0x7f64a81079c0 2024-09-05T01:24:36.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.423+0000 7f64a7200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f64a8111f40 con 0x7f64a81019c0 2024-09-05T01:24:36.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.423+0000 7f64a5e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64a81019c0 0x7f64a8198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:36.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.423+0000 7f64a5e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64a81019c0 0x7f64a8198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:54204/0 (socket says 172.21.15.12:54204) 2024-09-05T01:24:36.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.423+0000 7f64a5e00640 1 -- 172.21.15.12:0/67186637 learned_addr learned my addr 172.21.15.12:0/67186637 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:36.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.423+0000 7f649fe00640 1 --2- 172.21.15.12:0/67186637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64a8102360 0x7f64a81987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:36.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.423+0000 7f64a6800640 1 --2- 172.21.15.12:0/67186637 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64a81079c0 0x7f64a819cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:36.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.423+0000 7f64a5e00640 1 -- 172.21.15.12:0/67186637 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64a81079c0 msgr2=0x7f64a819cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:36.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.423+0000 7f64a5e00640 1 --2- 172.21.15.12:0/67186637 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64a81079c0 0x7f64a819cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:36.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.423+0000 7f64a5e00640 1 -- 172.21.15.12:0/67186637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64a8102360 msgr2=0x7f64a81987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:36.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.423+0000 7f64a5e00640 1 --2- 172.21.15.12:0/67186637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64a8102360 0x7f64a81987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:36.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.423+0000 7f64a5e00640 1 -- 172.21.15.12:0/67186637 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a819d220 con 0x7f64a81019c0 2024-09-05T01:24:36.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.424+0000 7f64a5e00640 1 --2- 172.21.15.12:0/67186637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64a81019c0 0x7f64a8198270 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f649800e9f0 tx=0x7f649800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:36.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.424+0000 7f649ea00640 1 -- 172.21.15.12:0/67186637 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649800cd80 con 0x7f64a81019c0 2024-09-05T01:24:36.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.424+0000 7f649ea00640 1 -- 172.21.15.12:0/67186637 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6498005500 con 0x7f64a81019c0 2024-09-05T01:24:36.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.424+0000 7f64a7200640 1 -- 172.21.15.12:0/67186637 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a819d510 con 0x7f64a81019c0 2024-09-05T01:24:36.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.424+0000 7f649ea00640 1 -- 172.21.15.12:0/67186637 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6498010690 con 0x7f64a81019c0 2024-09-05T01:24:36.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.424+0000 7f64a7200640 1 -- 172.21.15.12:0/67186637 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a81a4df0 con 0x7f64a81019c0 2024-09-05T01:24:36.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.425+0000 7f64a7200640 1 -- 172.21.15.12:0/67186637 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64a8101e20 con 0x7f64a81019c0 2024-09-05T01:24:36.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.427+0000 7f649ea00640 1 -- 172.21.15.12:0/67186637 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f64980046c0 con 0x7f64a81019c0 2024-09-05T01:24:36.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.429+0000 7f649ea00640 1 --2- 172.21.15.12:0/67186637 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f648c0a2bd0 0x7f648c0a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:36.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.429+0000 7f649fe00640 1 -- 172.21.15.12:0/67186637 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f648c0a2bd0 msgr2=0x7f648c0a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/2664180840 2024-09-05T01:24:36.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.429+0000 7f649ea00640 1 -- 172.21.15.12:0/67186637 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7f64980cf4a0 con 0x7f64a81019c0 2024-09-05T01:24:36.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.429+0000 7f649fe00640 1 --2- 172.21.15.12:0/67186637 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f648c0a2bd0 0x7f648c0a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T01:24:36.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.431+0000 7f649ea00640 1 -- 172.21.15.12:0/67186637 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f649809c370 con 0x7f64a81019c0 2024-09-05T01:24:36.543 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:36 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/594106551' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-05T01:24:36.543 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:36 smithi145 ceph-mon[34376]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-05T01:24:36.543 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:36 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:36.298+0000 7f415c25b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-05T01:24:36.543 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:36 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:36.358+0000 7f415c25b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-05T01:24:36.543 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:36 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:36.542+0000 7f415c25b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-05T01:24:36.547 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:36 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/594106551' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-05T01:24:36.547 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:36 smithi151 ceph-mon[35013]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-05T01:24:36.547 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:36 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:36.298+0000 7f00877e1040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-05T01:24:36.547 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:36 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:36.358+0000 7f00877e1040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-05T01:24:36.547 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:36 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:36.545+0000 7f00877e1040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-05T01:24:36.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.630+0000 7f649fe00640 1 -- 172.21.15.12:0/67186637 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f648c0a2bd0 msgr2=0x7f648c0a5090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/2664180840 2024-09-05T01:24:36.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.630+0000 7f649fe00640 1 --2- 172.21.15.12:0/67186637 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f648c0a2bd0 0x7f648c0a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-05T01:24:36.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.653+0000 7f64a7200640 1 -- 172.21.15.12:0/67186637 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f64a802d7c0 con 0x7f64a81019c0 2024-09-05T01:24:36.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.654+0000 7f649ea00640 1 -- 172.21.15.12:0/67186637 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7f6498086070 con 0x7f64a81019c0 2024-09-05T01:24:36.655 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-05T01:24:36.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.656+0000 7f64a7200640 1 -- 172.21.15.12:0/67186637 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f648c0a2bd0 msgr2=0x7f648c0a5090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T01:24:36.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.656+0000 7f64a7200640 1 --2- 172.21.15.12:0/67186637 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f648c0a2bd0 0x7f648c0a5090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:36.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.656+0000 7f64a7200640 1 -- 172.21.15.12:0/67186637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64a81019c0 msgr2=0x7f64a8198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:36.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.656+0000 7f64a7200640 1 --2- 172.21.15.12:0/67186637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64a81019c0 0x7f64a8198270 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f649800e9f0 tx=0x7f649800edf0 comp rx=0 tx=0).stop 2024-09-05T01:24:36.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.656+0000 7f64a7200640 1 -- 172.21.15.12:0/67186637 shutdown_connections 2024-09-05T01:24:36.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.656+0000 7f64a7200640 1 --2- 172.21.15.12:0/67186637 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7f648c0a2bd0 0x7f648c0a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:36.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.656+0000 7f64a7200640 1 --2- 172.21.15.12:0/67186637 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f64a81079c0 0x7f64a819cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:36.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.656+0000 7f64a7200640 1 --2- 172.21.15.12:0/67186637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64a8102360 0x7f64a81987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:36.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.656+0000 7f64a7200640 1 --2- 172.21.15.12:0/67186637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64a81019c0 0x7f64a8198270 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:36.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.656+0000 7f64a7200640 1 -- 172.21.15.12:0/67186637 >> 172.21.15.12:0/67186637 conn(0x7f64a80fd740 msgr2=0x7f64a80fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:36.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.656+0000 7f64a7200640 1 -- 172.21.15.12:0/67186637 shutdown_connections 2024-09-05T01:24:36.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:36.656+0000 7f64a7200640 1 -- 172.21.15.12:0/67186637 wait complete. 2024-09-05T01:24:36.948 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:36 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:36.641+0000 7f2e5a5d4040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-05T01:24:36.948 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:36 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:36.724+0000 7f2e5a5d4040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-05T01:24:36.948 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:36 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:36.946+0000 7f2e5a5d4040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-05T01:24:37.368 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-05T01:24:37.368 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-05T01:24:37.368 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2024-09-05T01:24:37.368 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-05T01:24:37.368 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-05T01:24:37.368 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-05T01:24:37.368 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-05T01:24:37.368 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-05T01:24:37.368 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-05T01:24:37.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T01:24:37.369 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2024-09-05T01:24:37.405 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-05T01:24:37.406 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-05T01:24:37.406 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-09-05T01:24:37.406 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-05T01:24:37.406 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-09-05T01:24:37.406 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-05T01:24:37.406 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-05T01:24:37.406 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2024-09-05T01:24:37.406 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2024-09-05T01:24:37.406 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-05T01:24:37.406 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2024-09-05T01:24:37.406 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2024-09-05T01:24:37.406 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-05T01:24:37.406 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2024-09-05T01:24:37.407 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2024-09-05T01:24:37.407 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-05T01:24:37.407 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42120sec preferred_lft 42120sec 2024-09-05T01:24:37.407 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2024-09-05T01:24:37.407 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-09-05T01:24:37.407 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-05T01:24:37.407 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2024-09-05T01:24:37.407 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2024-09-05T01:24:37.407 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-05T01:24:37.408 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-05T01:24:37.408 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-05T01:24:37.408 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add name ceph-brx type bridge 2024-09-05T01:24:37.408 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr flush dev ceph-brx 2024-09-05T01:24:37.408 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set ceph-brx up 2024-09-05T01:24:37.408 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-05T01:24:37.408 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-05T01:24:37.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-05T01:24:37.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:37 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/67186637' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-05T01:24:37.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:37 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/67186637' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-05T01:24:37.584 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:37 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:37.421+0000 7f415c25b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-05T01:24:37.584 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:37 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:37.488+0000 7f415c25b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-05T01:24:37.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:37 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/67186637' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-05T01:24:37.604 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:37 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:37.424+0000 7f00877e1040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-05T01:24:37.604 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:37 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:37.492+0000 7f00877e1040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-05T01:24:37.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T01:24:37.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T01:24:37.828 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-05T01:24:37.887 INFO:teuthology.orchestra.run.smithi012.stdout:1 2024-09-05T01:24:37.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T01:24:37.891 DEBUG:teuthology.orchestra.run.smithi012:> route 2024-09-05T01:24:37.939 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2024-09-05T01:24:37.940 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-05T01:24:37.940 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-05T01:24:37.940 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-05T01:24:37.940 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-05T01:24:37.940 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-05T01:24:37.940 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-05T01:24:37.941 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-05T01:24:37.941 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-05T01:24:37.941 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-05T01:24:37.941 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-05T01:24:38.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-05T01:24:38.387 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:38 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:38.134+0000 7f2e5a5d4040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-05T01:24:38.388 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:38 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:38.221+0000 7f2e5a5d4040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-05T01:24:38.457 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:38 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:38.196+0000 7f415c25b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-05T01:24:38.457 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:38 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:38.311+0000 7f415c25b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-05T01:24:38.462 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:38 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:38.202+0000 7f00877e1040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-05T01:24:38.463 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:38 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:38.317+0000 7f00877e1040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-05T01:24:38.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T01:24:38.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T01:24:38.531 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-05T01:24:38.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T01:24:38.573 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list-id 2024-09-05T01:24:38.651 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-05T01:24:38.651 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-05T01:24:38.651 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-05T01:24:38.651 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-05T01:24:38.651 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-05T01:24:38.734 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:38 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:38.456+0000 7f415c25b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-05T01:24:38.735 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:38 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:38.518+0000 7f415c25b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-05T01:24:38.735 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:38 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:38.666+0000 7f415c25b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-05T01:24:38.735 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:38 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:38.733+0000 7f415c25b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-05T01:24:38.739 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:38 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:38.460+0000 7f00877e1040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-05T01:24:38.740 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:38 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:38.522+0000 7f00877e1040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-05T01:24:38.740 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:38 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:38.670+0000 7f00877e1040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-05T01:24:38.740 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:38 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:38.738+0000 7f00877e1040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-05T01:24:38.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-05T01:24:38.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T01:24:38.835 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-05T01:24:38.835 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-05T01:24:38.835 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-05T01:24:38.835 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-05T01:24:38.835 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-05T01:24:38.836 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-05T01:24:38.836 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-05T01:24:38.836 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-05T01:24:38.836 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-05T01:24:38.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-05T01:24:39.017 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:38 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:38.793+0000 7f415c25b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-05T01:24:39.017 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:38 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:38.950+0000 7f415c25b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-05T01:24:39.017 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:39 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:39.016+0000 7f415c25b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-05T01:24:39.023 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:38 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:38.797+0000 7f00877e1040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-05T01:24:39.023 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:38 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:38.956+0000 7f00877e1040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-05T01:24:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T01:24:39.100 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-05T01:24:39.100 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-09-05T01:24:39.100 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2024-09-05T01:24:39.100 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set dev brx.0 master ceph-brx 2024-09-05T01:24:39.101 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-09-05T01:24:39.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-05T01:24:39.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T01:24:39.275 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-05T01:24:39.275 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-05T01:24:39.284 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:39 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:39.083+0000 7f415c25b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-05T01:24:39.285 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:39 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:39.166+0000 7f415c25b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-05T01:24:39.285 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:39 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:39.225+0000 7f415c25b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-05T01:24:39.285 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:39 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:39.284+0000 7f415c25b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-05T01:24:39.290 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:39 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:39.021+0000 7f00877e1040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-05T01:24:39.290 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:39 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:39.088+0000 7f00877e1040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-05T01:24:39.290 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:39 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:39.170+0000 7f00877e1040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-05T01:24:39.290 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:39 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:39.230+0000 7f00877e1040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-05T01:24:39.291 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:39 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:39.288+0000 7f00877e1040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-05T01:24:39.312 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-05T01:24:39.312 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-05T01:24:39.312 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-05T01:24:39.387 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-05T01:24:39.387 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-05T01:24:39.387 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491 2024-09-05T01:24:39.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T01:24:39.387 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-05T01:24:39.476 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:39 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:39.236+0000 7f2e5a5d4040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-05T01:24:39.476 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:39 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:39.385+0000 7f2e5a5d4040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-05T01:24:39.537 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-05T01:24:39.538 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-05T01:24:39.761 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:39 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:39.562+0000 7f2e5a5d4040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-05T01:24:39.761 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:39 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:39.641+0000 7f2e5a5d4040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-05T01:24:40.137 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:39 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:39.825+0000 7f2e5a5d4040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-05T01:24:40.137 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:39 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:39.912+0000 7f2e5a5d4040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-05T01:24:40.137 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:39 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:39.988+0000 7f2e5a5d4040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-05T01:24:40.183 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-05T01:24:40.183 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-05T01:24:40.183 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.145:3300,172.21.15.151:3300" 2024-09-05T01:24:40.183 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with new device syntax: 0@0d44cd7e-6b24-11ef-bcd6-c7b262605968.cephfs=/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491 2024-09-05T01:24:40.183 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,name=0,key=0,mon_addr=172.21.15.12:3300/172.21.15.145:3300/172.21.15.151:3300" will pass to kernel 2024-09-05T01:24:40.185 INFO:teuthology.orchestra.run.smithi012.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-05T01:24:40.185 INFO:teuthology.orchestra.run.smithi012.stdout: You just mounted a file system that supports labels which does not 2024-09-05T01:24:40.185 INFO:teuthology.orchestra.run.smithi012.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-05T01:24:40.185 INFO:teuthology.orchestra.run.smithi012.stdout: applications will generate AVC messages and not be allowed access to 2024-09-05T01:24:40.186 INFO:teuthology.orchestra.run.smithi012.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-05T01:24:40.188 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-05T01:24:40.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T01:24:40.189 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-05T01:24:40.252 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-05T01:24:40.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-05T01:24:40.334 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:24:40 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y[35739]: 2024-09-05T01:24:40.069+0000 7f415c25b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-05T01:24:40.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:40 smithi145 ceph-mon[34376]: Standby manager daemon y restarted 2024-09-05T01:24:40.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:40 smithi145 ceph-mon[34376]: Standby manager daemon y started 2024-09-05T01:24:40.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:40 smithi145 ceph-mon[34376]: from='mgr.? 172.21.15.145:0/3108192599' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-05T01:24:40.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:40 smithi145 ceph-mon[34376]: from='mgr.? 172.21.15.145:0/3108192599' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-05T01:24:40.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:40 smithi145 ceph-mon[34376]: from='mgr.? 172.21.15.145:0/3108192599' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-05T01:24:40.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:40 smithi145 ceph-mon[34376]: from='mgr.? 172.21.15.145:0/3108192599' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-05T01:24:40.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:40 smithi145 ceph-mon[34376]: Standby manager daemon z restarted 2024-09-05T01:24:40.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:40 smithi145 ceph-mon[34376]: Standby manager daemon z started 2024-09-05T01:24:40.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:40 smithi145 ceph-mon[34376]: from='mgr.? 172.21.15.151:0/3967241420' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-05T01:24:40.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:40 smithi145 ceph-mon[34376]: from='mgr.? 172.21.15.151:0/3967241420' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-05T01:24:40.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:40 smithi145 ceph-mon[34376]: from='mgr.? 172.21.15.151:0/3967241420' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-05T01:24:40.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:40 smithi145 ceph-mon[34376]: from='mgr.? 172.21.15.151:0/3967241420' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-05T01:24:40.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T01:24:40.346 INFO:teuthology.orchestra.run.smithi012.stdout:client25157 2024-09-05T01:24:40.346 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-05T01:24:40.346 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-05T01:24:40.354 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:24:40 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z[36828]: 2024-09-05T01:24:40.078+0000 7f00877e1040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-05T01:24:40.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:40 smithi151 ceph-mon[35013]: Standby manager daemon y restarted 2024-09-05T01:24:40.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:40 smithi151 ceph-mon[35013]: Standby manager daemon y started 2024-09-05T01:24:40.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:40 smithi151 ceph-mon[35013]: from='mgr.? 172.21.15.145:0/3108192599' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-05T01:24:40.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:40 smithi151 ceph-mon[35013]: from='mgr.? 172.21.15.145:0/3108192599' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-05T01:24:40.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:40 smithi151 ceph-mon[35013]: from='mgr.? 172.21.15.145:0/3108192599' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-05T01:24:40.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:40 smithi151 ceph-mon[35013]: from='mgr.? 172.21.15.145:0/3108192599' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-05T01:24:40.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:40 smithi151 ceph-mon[35013]: Standby manager daemon z restarted 2024-09-05T01:24:40.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:40 smithi151 ceph-mon[35013]: Standby manager daemon z started 2024-09-05T01:24:40.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:40 smithi151 ceph-mon[35013]: from='mgr.? 172.21.15.151:0/3967241420' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-05T01:24:40.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:40 smithi151 ceph-mon[35013]: from='mgr.? 172.21.15.151:0/3967241420' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-05T01:24:40.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:40 smithi151 ceph-mon[35013]: from='mgr.? 172.21.15.151:0/3967241420' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-05T01:24:40.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:40 smithi151 ceph-mon[35013]: from='mgr.? 172.21.15.151:0/3967241420' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-05T01:24:40.383 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-05T01:24:40.462 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:40 smithi012 ceph-mon[29942]: Standby manager daemon y restarted 2024-09-05T01:24:40.462 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:40 smithi012 ceph-mon[29942]: Standby manager daemon y started 2024-09-05T01:24:40.462 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:40 smithi012 ceph-mon[29942]: from='mgr.? 172.21.15.145:0/3108192599' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-05T01:24:40.462 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:40 smithi012 ceph-mon[29942]: from='mgr.? 172.21.15.145:0/3108192599' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-05T01:24:40.463 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:40 smithi012 ceph-mon[29942]: from='mgr.? 172.21.15.145:0/3108192599' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-05T01:24:40.463 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:40 smithi012 ceph-mon[29942]: from='mgr.? 172.21.15.145:0/3108192599' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-05T01:24:40.463 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:40 smithi012 ceph-mon[29942]: Standby manager daemon z restarted 2024-09-05T01:24:40.463 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:40 smithi012 ceph-mon[29942]: Standby manager daemon z started 2024-09-05T01:24:40.463 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:40 smithi012 ceph-mon[29942]: from='mgr.? 172.21.15.151:0/3967241420' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-05T01:24:40.463 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:40 smithi012 ceph-mon[29942]: from='mgr.? 172.21.15.151:0/3967241420' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-05T01:24:40.463 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:40 smithi012 ceph-mon[29942]: from='mgr.? 172.21.15.151:0/3967241420' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-05T01:24:40.463 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:40 smithi012 ceph-mon[29942]: from='mgr.? 172.21.15.151:0/3967241420' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-05T01:24:40.463 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:40 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:40.187+0000 7f2e5a5d4040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-05T01:24:40.463 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:40 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:40.271+0000 7f2e5a5d4040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-05T01:24:40.463 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:40 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:40.356+0000 7f2e5a5d4040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-05T01:24:40.464 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:40 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:40.460+0000 7f2e5a5d4040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-05T01:24:40.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-05T01:24:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T01:24:40.515 INFO:teuthology.orchestra.run.smithi012.stdout:client25157 2024-09-05T01:24:40.515 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-05T01:24:40.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-05T01:24:40.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T01:24:40.649 INFO:teuthology.orchestra.run.smithi012.stdout:client25157 2024-09-05T01:24:40.649 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968.client25157/status') 2024-09-05T01:24:40.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-05T01:24:40.746 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:40 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:40.537+0000 7f2e5a5d4040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-05T01:24:40.746 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:40 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:40.613+0000 7f2e5a5d4040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-05T01:24:40.752 INFO:teuthology.orchestra.run.smithi012.stdout:instance: client.25157 (3)172.21.15.12:0/3915849784 2024-09-05T01:24:40.752 INFO:teuthology.orchestra.run.smithi012.stdout:blocklisted: false 2024-09-05T01:24:40.752 INFO:teuthology.orchestra.run.smithi012.stderr:0+1 records in 2024-09-05T01:24:40.752 INFO:teuthology.orchestra.run.smithi012.stderr:0+1 records out 2024-09-05T01:24:40.752 INFO:teuthology.orchestra.run.smithi012.stderr:71 bytes copied, 7.2755e-05 s, 976 kB/s 2024-09-05T01:24:40.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-05T01:24:40.763 INFO:teuthology.run_tasks:Running task exec... 2024-09-05T01:24:40.772 INFO:teuthology.task.exec:Executing custom commands... 2024-09-05T01:24:40.773 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi012.front.sepia.ceph.com 2024-09-05T01:24:40.773 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-05T01:24:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.929+0000 7fb926800640 1 -- 172.21.15.12:0/138703065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb920105910 msgr2=0x7fb92010c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.929+0000 7fb926800640 1 --2- 172.21.15.12:0/138703065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb920105910 0x7fb92010c1a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb918009ca0 tx=0x7fb91802a8c0 comp rx=0 tx=0).stop 2024-09-05T01:24:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.929+0000 7fb926800640 1 -- 172.21.15.12:0/138703065 shutdown_connections 2024-09-05T01:24:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.929+0000 7fb926800640 1 --2- 172.21.15.12:0/138703065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb920105910 0x7fb92010c1a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.929+0000 7fb926800640 1 --2- 172.21.15.12:0/138703065 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb920104f50 0x7fb9201053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.929+0000 7fb926800640 1 --2- 172.21.15.12:0/138703065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb920103d60 0x7fb920104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.929+0000 7fb926800640 1 -- 172.21.15.12:0/138703065 >> 172.21.15.12:0/138703065 conn(0x7fb9200ff4e0 msgr2=0x7fb920101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.930+0000 7fb926800640 1 -- 172.21.15.12:0/138703065 shutdown_connections 2024-09-05T01:24:40.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.930+0000 7fb926800640 1 -- 172.21.15.12:0/138703065 wait complete. 2024-09-05T01:24:40.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.930+0000 7fb926800640 1 Processor -- start 2024-09-05T01:24:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.931+0000 7fb926800640 1 -- start start 2024-09-05T01:24:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.931+0000 7fb926800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb920103d60 0x7fb920199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.931+0000 7fb926800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb920104f50 0x7fb92019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.931+0000 7fb926800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb920105910 0x7fb9201a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.931+0000 7fb926800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb92010f9e0 con 0x7fb920105910 2024-09-05T01:24:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.931+0000 7fb926800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb92010f860 con 0x7fb920103d60 2024-09-05T01:24:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.931+0000 7fb926800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb92010fb60 con 0x7fb920104f50 2024-09-05T01:24:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.931+0000 7fb91fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb920105910 0x7fb9201a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.931+0000 7fb91fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb920105910 0x7fb9201a1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51594/0 (socket says 172.21.15.12:51594) 2024-09-05T01:24:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.931+0000 7fb91fe00640 1 -- 172.21.15.12:0/3404044415 learned_addr learned my addr 172.21.15.12:0/3404044415 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.931+0000 7fb91f400640 1 --2- 172.21.15.12:0/3404044415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb920103d60 0x7fb920199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.931+0000 7fb91ea00640 1 --2- 172.21.15.12:0/3404044415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb920104f50 0x7fb92019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:40.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.932+0000 7fb91fe00640 1 -- 172.21.15.12:0/3404044415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb920104f50 msgr2=0x7fb92019a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:40.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.932+0000 7fb91fe00640 1 --2- 172.21.15.12:0/3404044415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb920104f50 0x7fb92019a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:40.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.932+0000 7fb91fe00640 1 -- 172.21.15.12:0/3404044415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb920103d60 msgr2=0x7fb920199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:40.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.932+0000 7fb91fe00640 1 --2- 172.21.15.12:0/3404044415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb920103d60 0x7fb920199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:40.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.932+0000 7fb91fe00640 1 -- 172.21.15.12:0/3404044415 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9201a1bf0 con 0x7fb920105910 2024-09-05T01:24:40.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.932+0000 7fb91fe00640 1 --2- 172.21.15.12:0/3404044415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb920105910 0x7fb9201a1580 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb918005e30 tx=0x7fb918031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:40.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.932+0000 7fb917e00640 1 -- 172.21.15.12:0/3404044415 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb918003b70 con 0x7fb920105910 2024-09-05T01:24:40.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.932+0000 7fb917e00640 1 -- 172.21.15.12:0/3404044415 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb918003d10 con 0x7fb920105910 2024-09-05T01:24:40.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.932+0000 7fb926800640 1 -- 172.21.15.12:0/3404044415 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9201a1e80 con 0x7fb920105910 2024-09-05T01:24:40.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.932+0000 7fb917e00640 1 -- 172.21.15.12:0/3404044415 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91802fb70 con 0x7fb920105910 2024-09-05T01:24:40.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.932+0000 7fb926800640 1 -- 172.21.15.12:0/3404044415 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9201a2340 con 0x7fb920105910 2024-09-05T01:24:40.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.934+0000 7fb926800640 1 -- 172.21.15.12:0/3404044415 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb92010b020 con 0x7fb920105910 2024-09-05T01:24:40.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.936+0000 7fb917e00640 1 -- 172.21.15.12:0/3404044415 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 20) ==== 137850+0+0 (secure 0 0 0) 0x7fb91802fd10 con 0x7fb920105910 2024-09-05T01:24:40.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.937+0000 7fb917e00640 1 --2- 172.21.15.12:0/3404044415 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb9040a2c80 0x7fb9040a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:40.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.937+0000 7fb91f400640 1 -- 172.21.15.12:0/3404044415 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb9040a2c80 msgr2=0x7fb9040a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/2664180840 2024-09-05T01:24:40.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.937+0000 7fb917e00640 1 -- 172.21.15.12:0/3404044415 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7fb9180f0390 con 0x7fb920105910 2024-09-05T01:24:40.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.937+0000 7fb91f400640 1 --2- 172.21.15.12:0/3404044415 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb9040a2c80 0x7fb9040a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-05T01:24:40.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:40.944+0000 7fb917e00640 1 -- 172.21.15.12:0/3404044415 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb9180bd260 con 0x7fb920105910 2024-09-05T01:24:41.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:41.138+0000 7fb91f400640 1 -- 172.21.15.12:0/3404044415 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb9040a2c80 msgr2=0x7fb9040a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/2664180840 2024-09-05T01:24:41.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:41.138+0000 7fb91f400640 1 --2- 172.21.15.12:0/3404044415 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb9040a2c80 0x7fb9040a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-05T01:24:41.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:41.172+0000 7fb926800640 1 -- 172.21.15.12:0/3404044415 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fb92002d7c0 con 0x7fb920105910 2024-09-05T01:24:41.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:41.539+0000 7fb91f400640 1 -- 172.21.15.12:0/3404044415 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb9040a2c80 msgr2=0x7fb9040a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6800/2664180840 2024-09-05T01:24:41.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:41.539+0000 7fb91f400640 1 --2- 172.21.15.12:0/3404044415 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb9040a2c80 0x7fb9040a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-05T01:24:41.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:41 smithi012 ceph-mon[29942]: mgrmap e20: x(active, since 9m), standbys: y, z 2024-09-05T01:24:41.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:41 smithi145 ceph-mon[34376]: mgrmap e20: x(active, since 9m), standbys: y, z 2024-09-05T01:24:41.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:41 smithi151 ceph-mon[35013]: mgrmap e20: x(active, since 9m), standbys: y, z 2024-09-05T01:24:41.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:41.604+0000 7fb917e00640 1 -- 172.21.15.12:0/3404044415 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 21) ==== 137518+0+0 (secure 0 0 0) 0x7fb9180b91d0 con 0x7fb920105910 2024-09-05T01:24:41.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:41.605+0000 7fb917e00640 1 -- 172.21.15.12:0/3404044415 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb9040a2c80 msgr2=0x7fb9040a5140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T01:24:41.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:41.605+0000 7fb917e00640 1 --2- 172.21.15.12:0/3404044415 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb9040a2c80 0x7fb9040a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:41.941 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:41 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:41.590+0000 7f2e5a5d4040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-05T01:24:42.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.146+0000 7fb917e00640 1 -- 172.21.15.12:0/3404044415 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v28) ==== 117+0+0 (secure 0 0 0) 0x7fb9180de180 con 0x7fb920105910 2024-09-05T01:24:42.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.148+0000 7fb926800640 1 -- 172.21.15.12:0/3404044415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb920105910 msgr2=0x7fb9201a1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:42.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.148+0000 7fb926800640 1 --2- 172.21.15.12:0/3404044415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb920105910 0x7fb9201a1580 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb918005e30 tx=0x7fb918031ee0 comp rx=0 tx=0).stop 2024-09-05T01:24:42.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.148+0000 7fb926800640 1 -- 172.21.15.12:0/3404044415 shutdown_connections 2024-09-05T01:24:42.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.148+0000 7fb926800640 1 --2- 172.21.15.12:0/3404044415 >> [v2:172.21.15.12:6800/2664180840,v1:172.21.15.12:6801/2664180840] conn(0x7fb9040a2c80 0x7fb9040a5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:42.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.148+0000 7fb926800640 1 --2- 172.21.15.12:0/3404044415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb920105910 0x7fb9201a1580 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:42.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.148+0000 7fb926800640 1 --2- 172.21.15.12:0/3404044415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb920104f50 0x7fb92019a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:42.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.148+0000 7fb926800640 1 --2- 172.21.15.12:0/3404044415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb920103d60 0x7fb920199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:42.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.148+0000 7fb926800640 1 -- 172.21.15.12:0/3404044415 >> 172.21.15.12:0/3404044415 conn(0x7fb9200ff4e0 msgr2=0x7fb9201081f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:42.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.148+0000 7fb926800640 1 -- 172.21.15.12:0/3404044415 shutdown_connections 2024-09-05T01:24:42.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.148+0000 7fb926800640 1 -- 172.21.15.12:0/3404044415 wait complete. 2024-09-05T01:24:42.168 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-05T01:24:42.180 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-05T01:24:42.225 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-05T01:24:42.226 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3404044415' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-05T01:24:42.226 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: Active manager daemon x restarted 2024-09-05T01:24:42.226 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: Activating manager daemon x 2024-09-05T01:24:42.226 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: osdmap e86: 12 total, 12 up, 12 in 2024-09-05T01:24:42.226 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: mgrmap e21: x(active, starting, since 0.012891s), standbys: y, z 2024-09-05T01:24:42.226 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T01:24:42.226 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:24:42.226 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:24:42.226 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-05T01:24:42.226 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-05T01:24:42.226 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-05T01:24:42.227 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-05T01:24:42.227 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-05T01:24:42.227 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-05T01:24:42.227 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-05T01:24:42.227 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-05T01:24:42.227 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T01:24:42.227 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-05T01:24:42.227 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-05T01:24:42.227 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-05T01:24:42.227 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-05T01:24:42.227 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-05T01:24:42.227 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-05T01:24:42.227 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T01:24:42.227 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T01:24:42.227 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T01:24:42.228 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T01:24:42.228 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:41 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:41.939+0000 7f2db6800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T01:24:42.228 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:41 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:41.939+0000 7f2db6800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T01:24:42.228 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:41 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:41.939+0000 7f2db6800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T01:24:42.228 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:41 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:41.939+0000 7f2db6800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T01:24:42.228 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:41 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:41.939+0000 7f2db6800640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T01:24:42.228 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:41 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:41.940+0000 7f2db2c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T01:24:42.228 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:41 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:41.940+0000 7f2db2c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T01:24:42.228 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:41 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:41.940+0000 7f2db2c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T01:24:42.228 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:41 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:41.940+0000 7f2db2c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T01:24:42.228 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:41 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:41.940+0000 7f2db2c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T01:24:42.229 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T01:24:42.229 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T01:24:42.229 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T01:24:42.229 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T01:24:42.229 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T01:24:42.229 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T01:24:42.229 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T01:24:42.229 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:24:42.229 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-05T01:24:42.229 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-05T01:24:42.230 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-05T01:24:42.230 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: Manager daemon x is now available 2024-09-05T01:24:42.230 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:24:42.230 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-05T01:24:42.230 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-05T01:24:42.230 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-05T01:24:42.230 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:42 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-05T01:24:42.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3404044415' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-05T01:24:42.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: Active manager daemon x restarted 2024-09-05T01:24:42.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: Activating manager daemon x 2024-09-05T01:24:42.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: osdmap e86: 12 total, 12 up, 12 in 2024-09-05T01:24:42.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: mgrmap e21: x(active, starting, since 0.012891s), standbys: y, z 2024-09-05T01:24:42.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T01:24:42.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:24:42.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:24:42.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-05T01:24:42.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-05T01:24:42.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-05T01:24:42.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-05T01:24:42.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-05T01:24:42.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-05T01:24:42.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-05T01:24:42.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-05T01:24:42.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T01:24:42.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-05T01:24:42.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-05T01:24:42.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-05T01:24:42.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-05T01:24:42.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-05T01:24:42.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-05T01:24:42.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T01:24:42.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T01:24:42.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T01:24:42.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T01:24:42.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T01:24:42.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T01:24:42.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T01:24:42.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T01:24:42.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T01:24:42.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T01:24:42.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T01:24:42.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:24:42.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-05T01:24:42.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-05T01:24:42.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-05T01:24:42.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: Manager daemon x is now available 2024-09-05T01:24:42.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:24:42.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-05T01:24:42.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-05T01:24:42.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-05T01:24:42.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:42 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-05T01:24:42.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3404044415' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-05T01:24:42.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: Active manager daemon x restarted 2024-09-05T01:24:42.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: Activating manager daemon x 2024-09-05T01:24:42.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: osdmap e86: 12 total, 12 up, 12 in 2024-09-05T01:24:42.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: mgrmap e21: x(active, starting, since 0.012891s), standbys: y, z 2024-09-05T01:24:42.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-05T01:24:42.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-05T01:24:42.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-05T01:24:42.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-05T01:24:42.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-05T01:24:42.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-05T01:24:42.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-05T01:24:42.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-05T01:24:42.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-05T01:24:42.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-05T01:24:42.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-05T01:24:42.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T01:24:42.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-05T01:24:42.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-05T01:24:42.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-05T01:24:42.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-05T01:24:42.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-05T01:24:42.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-05T01:24:42.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-05T01:24:42.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-05T01:24:42.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-05T01:24:42.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-05T01:24:42.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-05T01:24:42.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-05T01:24:42.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-05T01:24:42.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-05T01:24:42.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-05T01:24:42.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-05T01:24:42.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-05T01:24:42.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-05T01:24:42.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-05T01:24:42.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-05T01:24:42.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-05T01:24:42.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: Manager daemon x is now available 2024-09-05T01:24:42.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:24:42.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-05T01:24:42.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-05T01:24:42.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-05T01:24:42.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:42 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-05T01:24:42.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.393+0000 7f5dda400640 1 -- 172.21.15.12:0/327751112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dd40761b0 msgr2=0x7f5dd4074600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:42.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.393+0000 7f5dda400640 1 --2- 172.21.15.12:0/327751112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dd40761b0 0x7f5dd4074600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8009900 tx=0x7f5dc802a480 comp rx=0 tx=0).stop 2024-09-05T01:24:42.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.393+0000 7f5dda400640 1 -- 172.21.15.12:0/327751112 shutdown_connections 2024-09-05T01:24:42.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.393+0000 7f5dda400640 1 --2- 172.21.15.12:0/327751112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5dd4109820 0x7f5dd410bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:42.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.393+0000 7f5dda400640 1 --2- 172.21.15.12:0/327751112 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dd4074bd0 0x7f5dd4075030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:42.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.393+0000 7f5dda400640 1 --2- 172.21.15.12:0/327751112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dd40761b0 0x7f5dd4074600 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:42.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.393+0000 7f5dda400640 1 -- 172.21.15.12:0/327751112 >> 172.21.15.12:0/327751112 conn(0x7f5dd40fd110 msgr2=0x7f5dd40ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:42.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.393+0000 7f5dda400640 1 -- 172.21.15.12:0/327751112 shutdown_connections 2024-09-05T01:24:42.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.393+0000 7f5dda400640 1 -- 172.21.15.12:0/327751112 wait complete. 2024-09-05T01:24:42.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.394+0000 7f5dda400640 1 Processor -- start 2024-09-05T01:24:42.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.394+0000 7f5dda400640 1 -- start start 2024-09-05T01:24:42.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.395+0000 7f5dda400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dd4074bd0 0x7f5dd4199e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:42.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.395+0000 7f5dda400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5dd40761b0 0x7f5dd419a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:42.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.395+0000 7f5dda400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dd4109820 0x7f5dd41a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:42.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.395+0000 7f5dda400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd410f820 con 0x7f5dd40761b0 2024-09-05T01:24:42.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.395+0000 7f5dda400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd410f6a0 con 0x7f5dd4074bd0 2024-09-05T01:24:42.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.395+0000 7f5dda400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd410f9a0 con 0x7f5dd4109820 2024-09-05T01:24:42.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.395+0000 7f5dd9000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dd4074bd0 0x7f5dd4199e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:42.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.395+0000 7f5dd3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5dd40761b0 0x7f5dd419a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:42.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.395+0000 7f5dd9a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dd4109820 0x7f5dd41a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:42.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.395+0000 7f5dd9000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dd4074bd0 0x7f5dd4199e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:50784/0 (socket says 172.21.15.12:50784) 2024-09-05T01:24:42.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.395+0000 7f5dd9000640 1 -- 172.21.15.12:0/3378061315 learned_addr learned my addr 172.21.15.12:0/3378061315 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:42.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.395+0000 7f5dd9000640 1 -- 172.21.15.12:0/3378061315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dd4109820 msgr2=0x7f5dd41a1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:42.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.395+0000 7f5dd9000640 1 --2- 172.21.15.12:0/3378061315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dd4109820 0x7f5dd41a1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:42.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.395+0000 7f5dd9000640 1 -- 172.21.15.12:0/3378061315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5dd40761b0 msgr2=0x7f5dd419a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:42.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.395+0000 7f5dd9000640 1 --2- 172.21.15.12:0/3378061315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5dd40761b0 0x7f5dd419a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:42.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.395+0000 7f5dd9000640 1 -- 172.21.15.12:0/3378061315 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd41a1a90 con 0x7f5dd4074bd0 2024-09-05T01:24:42.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.396+0000 7f5dd3e00640 1 --2- 172.21.15.12:0/3378061315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5dd40761b0 0x7f5dd419a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:42.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.396+0000 7f5dd9000640 1 --2- 172.21.15.12:0/3378061315 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dd4074bd0 0x7f5dd4199e70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8031440 tx=0x7f5dc8032c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:42.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.396+0000 7f5dd1600640 1 -- 172.21.15.12:0/3378061315 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc803f030 con 0x7f5dd4074bd0 2024-09-05T01:24:42.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.396+0000 7f5dd1600640 1 -- 172.21.15.12:0/3378061315 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dc8003ad0 con 0x7f5dd4074bd0 2024-09-05T01:24:42.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.396+0000 7f5dda400640 1 -- 172.21.15.12:0/3378061315 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd41a1d20 con 0x7f5dd4074bd0 2024-09-05T01:24:42.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.396+0000 7f5dd1600640 1 -- 172.21.15.12:0/3378061315 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8035070 con 0x7f5dd4074bd0 2024-09-05T01:24:42.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.396+0000 7f5dda400640 1 -- 172.21.15.12:0/3378061315 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd41a21c0 con 0x7f5dd4074bd0 2024-09-05T01:24:42.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.397+0000 7f5dda400640 1 -- 172.21.15.12:0/3378061315 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dd41085e0 con 0x7f5dd4074bd0 2024-09-05T01:24:42.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.399+0000 7f5dd1600640 1 -- 172.21.15.12:0/3378061315 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 21) ==== 137518+0+0 (secure 0 0 0) 0x7f5dc8042030 con 0x7f5dd4074bd0 2024-09-05T01:24:42.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.401+0000 7f5dd1600640 1 -- 172.21.15.12:0/3378061315 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f5dc80ef120 con 0x7f5dd4074bd0 2024-09-05T01:24:42.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.404+0000 7f5dd1600640 1 -- 172.21.15.12:0/3378061315 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5dc80bbca0 con 0x7f5dd4074bd0 2024-09-05T01:24:42.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.593+0000 7f5dda400640 1 -- 172.21.15.12:0/3378061315 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5dd4062e90 con 0x7f5dd4074bd0 2024-09-05T01:24:42.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.595+0000 7f5dd1600640 1 -- 172.21.15.12:0/3378061315 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+23237 (secure 0 0 0) 0x7f5dc80bffa0 con 0x7f5dd4074bd0 2024-09-05T01:24:42.597 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:24:42.597 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":86,"fsid":"0d44cd7e-6b24-11ef-bcd6-c7b262605968","created":"2024-09-05T01:14:21.162850+0000","modified":"2024-09-05T01:24:41.593694+0000","last_up_change":"2024-09-05T01:21:37.145073+0000","last_in_change":"2024-09-05T01:21:15.076991+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T01:17:44.744065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T01:22:31.540178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T01:22:33.999318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b74ac640-b680-46e2-9106-d24168e685e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6803","nonce":2090563987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6805","nonce":2090563987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6809","nonce":2090563987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6807","nonce":2090563987}]},"public_addr":"172.21.15.12:6803/2090563987","cluster_addr":"172.21.15.12:6805/2090563987","heartbeat_back_addr":"172.21.15.12:6809/2090563987","heartbeat_front_addr":"172.21.15.12:6807/2090563987","state":["exists","up"]},{"osd":1,"uuid":"efca1216-8d85-4e6a-8c49-0afb511ece59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6801","nonce":2639126629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6803","nonce":2639126629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6807","nonce":2639126629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6805","nonce":2639126629}]},"public_addr":"172.21.15.145:6801/2639126629","cluster_addr":"172.21.15.145:6803/2639126629","heartbeat_back_addr":"172.21.15.145:6807/2639126629","heartbeat_front_addr":"172.21.15.145:6805/2639126629","state":["exists","up"]},{"osd":2,"uuid":"4d5699b2-646a-4ab6-94a5-ad223aa27ac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6801","nonce":3753171761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6803","nonce":3753171761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6807","nonce":3753171761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6805","nonce":3753171761}]},"public_addr":"172.21.15.151:6801/3753171761","cluster_addr":"172.21.15.151:6803/3753171761","heartbeat_back_addr":"172.21.15.151:6807/3753171761","heartbeat_front_addr":"172.21.15.151:6805/3753171761","state":["exists","up"]},{"osd":3,"uuid":"275ad2ad-93e6-4a68-8784-8f8dcb620f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6811","nonce":2231650146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6813","nonce":2231650146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6817","nonce":2231650146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6815","nonce":2231650146}]},"public_addr":"172.21.15.12:6811/2231650146","cluster_addr":"172.21.15.12:6813/2231650146","heartbeat_back_addr":"172.21.15.12:6817/2231650146","heartbeat_front_addr":"172.21.15.12:6815/2231650146","state":["exists","up"]},{"osd":4,"uuid":"21a0c5b4-4e0e-4fb6-8be6-a300cb811cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6809","nonce":1828591275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6811","nonce":1828591275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6815","nonce":1828591275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6813","nonce":1828591275}]},"public_addr":"172.21.15.145:6809/1828591275","cluster_addr":"172.21.15.145:6811/1828591275","heartbeat_back_addr":"172.21.15.145:6815/1828591275","heartbeat_front_addr":"172.21.15.145:6813/1828591275","state":["exists","up"]},{"osd":5,"uuid":"e2c7e6fb-5dea-459f-8d7a-7ae5b1936218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6809","nonce":3888870109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6811","nonce":3888870109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6815","nonce":3888870109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6813","nonce":3888870109}]},"public_addr":"172.21.15.151:6809/3888870109","cluster_addr":"172.21.15.151:6811/3888870109","heartbeat_back_addr":"172.21.15.151:6815/3888870109","heartbeat_front_addr":"172.21.15.151:6813/3888870109","state":["exists","up"]},{"osd":6,"uuid":"0df0a29c-3404-4ff5-ae48-78b69b77cbd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6819","nonce":3084810269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6821","nonce":3084810269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6825","nonce":3084810269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6823","nonce":3084810269}]},"public_addr":"172.21.15.12:6819/3084810269","cluster_addr":"172.21.15.12:6821/3084810269","heartbeat_back_addr":"172.21.15.12:6825/3084810269","heartbeat_front_addr":"172.21.15.12:6823/3084810269","state":["exists","up"]},{"osd":7,"uuid":"c7b3ad7c-a566-435c-9ef8-837bb764acb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6817","nonce":3058588721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6819","nonce":3058588721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6823","nonce":3058588721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6821","nonce":3058588721}]},"public_addr":"172.21.15.145:6817/3058588721","cluster_addr":"172.21.15.145:6819/3058588721","heartbeat_back_addr":"172.21.15.145:6823/3058588721","heartbeat_front_addr":"172.21.15.145:6821/3058588721","state":["exists","up"]},{"osd":8,"uuid":"8018a468-fbc5-4667-a53c-2e97c08713bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6817","nonce":905705309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6819","nonce":905705309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6823","nonce":905705309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6821","nonce":905705309}]},"public_addr":"172.21.15.151:6817/905705309","cluster_addr":"172.21.15.151:6819/905705309","heartbeat_back_addr":"172.21.15.151:6823/905705309","heartbeat_front_addr":"172.21.15.151:6821/905705309","state":["exists","up"]},{"osd":9,"uuid":"dcf3b524-c8b8-4ab6-83c6-fc52c776d72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6827","nonce":1193852496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6829","nonce":1193852496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6833","nonce":1193852496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6831","nonce":1193852496}]},"public_addr":"172.21.15.12:6827/1193852496","cluster_addr":"172.21.15.12:6829/1193852496","heartbeat_back_addr":"172.21.15.12:6833/1193852496","heartbeat_front_addr":"172.21.15.12:6831/1193852496","state":["exists","up"]},{"osd":10,"uuid":"7b5b34c3-8814-4d16-80ce-0b0c9be07cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6825","nonce":1296813755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6827","nonce":1296813755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6831","nonce":1296813755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6829","nonce":1296813755}]},"public_addr":"172.21.15.145:6825/1296813755","cluster_addr":"172.21.15.145:6827/1296813755","heartbeat_back_addr":"172.21.15.145:6831/1296813755","heartbeat_front_addr":"172.21.15.145:6829/1296813755","state":["exists","up"]},{"osd":11,"uuid":"157ee32a-43f0-4e5a-8dac-fce53c1efdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6825","nonce":2855185758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6827","nonce":2855185758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6831","nonce":2855185758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6829","nonce":2855185758}]},"public_addr":"172.21.15.151:6825/2855185758","cluster_addr":"172.21.15.151:6827/2855185758","heartbeat_back_addr":"172.21.15.151:6831/2855185758","heartbeat_front_addr":"172.21.15.151:6829/2855185758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:16:52.947222+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:17:17.845611+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:17:41.769521+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:10.848974+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:35.471340+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:59.554980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:19:28.908089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:19:53.540000+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:20:17.764886+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:20:46.835859+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:21:12.186176+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:21:35.863935+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9},{"from":4,"to":7}]},{"pgid":"3.19","mappings":[{"from":3,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3089660384":"2024-09-06T01:24:41.593667+0000","172.21.15.12:0/2280578773":"2024-09-06T01:24:41.593667+0000","172.21.15.12:0/1532325396":"2024-09-06T01:14:54.625209+0000","172.21.15.12:6800/3541208629":"2024-09-06T01:14:54.625209+0000","172.21.15.12:6801/3541208629":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/992405704":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/784506983":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/1815886492":"2024-09-06T01:24:41.593667+0000","172.21.15.12:6800/4067110310":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6801/2664180840":"2024-09-06T01:24:41.593667+0000","172.21.15.12:0/1171838695":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/1040591124":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6801/4067110310":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/1385871202":"2024-09-06T01:24:41.593667+0000","172.21.15.12:0/1132389058":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6800/2664180840":"2024-09-06T01:24:41.593667+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T01:24:42.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.597+0000 7f5dda400640 1 -- 172.21.15.12:0/3378061315 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dd4074bd0 msgr2=0x7f5dd4199e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:42.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.597+0000 7f5dda400640 1 --2- 172.21.15.12:0/3378061315 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dd4074bd0 0x7f5dd4199e70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8031440 tx=0x7f5dc8032c60 comp rx=0 tx=0).stop 2024-09-05T01:24:42.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.597+0000 7f5dda400640 1 -- 172.21.15.12:0/3378061315 shutdown_connections 2024-09-05T01:24:42.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.597+0000 7f5dda400640 1 --2- 172.21.15.12:0/3378061315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dd4109820 0x7f5dd41a1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:42.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.598+0000 7f5dda400640 1 --2- 172.21.15.12:0/3378061315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5dd40761b0 0x7f5dd419a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:42.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.598+0000 7f5dda400640 1 --2- 172.21.15.12:0/3378061315 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dd4074bd0 0x7f5dd4199e70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:42.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.598+0000 7f5dda400640 1 -- 172.21.15.12:0/3378061315 >> 172.21.15.12:0/3378061315 conn(0x7f5dd40fd110 msgr2=0x7f5dd41057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:42.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.598+0000 7f5dda400640 1 -- 172.21.15.12:0/3378061315 shutdown_connections 2024-09-05T01:24:42.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.598+0000 7f5dda400640 1 -- 172.21.15.12:0/3378061315 wait complete. 2024-09-05T01:24:42.632 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-05T01:17:44.744065+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-05T01:22:31.540178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-05T01:22:33.999318+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-05T01:24:42.633 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-05T01:24:42.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.816+0000 7f1b95600640 1 -- 172.21.15.12:0/3611654210 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b90104f20 msgr2=0x7f1b901053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:42.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.816+0000 7f1b95600640 1 --2- 172.21.15.12:0/3611654210 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b90104f20 0x7f1b901053a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009900 tx=0x7f1b7c02a410 comp rx=0 tx=0).stop 2024-09-05T01:24:42.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.816+0000 7f1b95600640 1 -- 172.21.15.12:0/3611654210 shutdown_connections 2024-09-05T01:24:42.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.816+0000 7f1b95600640 1 --2- 172.21.15.12:0/3611654210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b901058e0 0x7f1b9010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:42.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.816+0000 7f1b95600640 1 --2- 172.21.15.12:0/3611654210 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b90104f20 0x7f1b901053a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:42.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.816+0000 7f1b95600640 1 --2- 172.21.15.12:0/3611654210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b90103d30 0x7f1b90104130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:42.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.816+0000 7f1b95600640 1 -- 172.21.15.12:0/3611654210 >> 172.21.15.12:0/3611654210 conn(0x7f1b900ff470 msgr2=0x7f1b901018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:42.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.816+0000 7f1b95600640 1 -- 172.21.15.12:0/3611654210 shutdown_connections 2024-09-05T01:24:42.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.816+0000 7f1b95600640 1 -- 172.21.15.12:0/3611654210 wait complete. 2024-09-05T01:24:42.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.817+0000 7f1b95600640 1 Processor -- start 2024-09-05T01:24:42.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.817+0000 7f1b95600640 1 -- start start 2024-09-05T01:24:42.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.817+0000 7f1b95600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b90103d30 0x7f1b9019a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:42.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.817+0000 7f1b95600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b90104f20 0x7f1b9019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:42.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.817+0000 7f1b95600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b901058e0 0x7f1b901a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:42.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.817+0000 7f1b95600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9010f9e0 con 0x7f1b90103d30 2024-09-05T01:24:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.817+0000 7f1b95600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9010f860 con 0x7f1b90104f20 2024-09-05T01:24:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.817+0000 7f1b95600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9010fb60 con 0x7f1b901058e0 2024-09-05T01:24:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.818+0000 7f1b8ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b90103d30 0x7f1b9019a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.818+0000 7f1b8ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b90103d30 0x7f1b9019a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51734/0 (socket says 172.21.15.12:51734) 2024-09-05T01:24:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.818+0000 7f1b8ea00640 1 -- 172.21.15.12:0/4111170710 learned_addr learned my addr 172.21.15.12:0/4111170710 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.818+0000 7f1b8e000640 1 --2- 172.21.15.12:0/4111170710 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b90104f20 0x7f1b9019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.818+0000 7f1b8f400640 1 --2- 172.21.15.12:0/4111170710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b901058e0 0x7f1b901a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.818+0000 7f1b8ea00640 1 -- 172.21.15.12:0/4111170710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b901058e0 msgr2=0x7f1b901a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.818+0000 7f1b8ea00640 1 --2- 172.21.15.12:0/4111170710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b901058e0 0x7f1b901a1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.818+0000 7f1b8ea00640 1 -- 172.21.15.12:0/4111170710 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b90104f20 msgr2=0x7f1b9019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.818+0000 7f1b8ea00640 1 --2- 172.21.15.12:0/4111170710 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b90104f20 0x7f1b9019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.818+0000 7f1b8ea00640 1 -- 172.21.15.12:0/4111170710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b901a1c90 con 0x7f1b90103d30 2024-09-05T01:24:42.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.818+0000 7f1b8e000640 1 --2- 172.21.15.12:0/4111170710 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b90104f20 0x7f1b9019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:42.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.818+0000 7f1b8ea00640 1 --2- 172.21.15.12:0/4111170710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b90103d30 0x7f1b9019a070 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000e9c0 tx=0x7f1b8000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:42.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.819+0000 7f1b87400640 1 -- 172.21.15.12:0/4111170710 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8000cd80 con 0x7f1b90103d30 2024-09-05T01:24:42.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.819+0000 7f1b87400640 1 -- 172.21.15.12:0/4111170710 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b800035f0 con 0x7f1b90103d30 2024-09-05T01:24:42.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.819+0000 7f1b95600640 1 -- 172.21.15.12:0/4111170710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b901a1f80 con 0x7f1b90103d30 2024-09-05T01:24:42.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.819+0000 7f1b87400640 1 -- 172.21.15.12:0/4111170710 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b80010690 con 0x7f1b90103d30 2024-09-05T01:24:42.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.819+0000 7f1b95600640 1 -- 172.21.15.12:0/4111170710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b901a23e0 con 0x7f1b90103d30 2024-09-05T01:24:42.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.820+0000 7f1b95600640 1 -- 172.21.15.12:0/4111170710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b9010b1c0 con 0x7f1b90103d30 2024-09-05T01:24:42.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.822+0000 7f1b87400640 1 -- 172.21.15.12:0/4111170710 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7f1b800037a0 con 0x7f1b90103d30 2024-09-05T01:24:42.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.823+0000 7f1b87400640 1 --2- 172.21.15.12:0/4111170710 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1b740a2990 0x7f1b740a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:42.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.823+0000 7f1b87400640 1 -- 172.21.15.12:0/4111170710 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f1b800cf180 con 0x7f1b90103d30 2024-09-05T01:24:42.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.823+0000 7f1b8e000640 1 --2- 172.21.15.12:0/4111170710 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1b740a2990 0x7f1b740a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:42.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.824+0000 7f1b8e000640 1 --2- 172.21.15.12:0/4111170710 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1b740a2990 0x7f1b740a4e50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c031440 tx=0x7f1b7c0315b0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:42.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:42.828+0000 7f1b87400640 1 -- 172.21.15.12:0/4111170710 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1b8009c260 con 0x7f1b90103d30 2024-09-05T01:24:43.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.061+0000 7f1b95600640 1 -- 172.21.15.12:0/4111170710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1b9002d7c0 con 0x7f1b90103d30 2024-09-05T01:24:43.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.061+0000 7f1b87400640 1 -- 172.21.15.12:0/4111170710 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) ==== 93+0+10 (secure 0 0 0) 0x7f1b9002d7c0 con 0x7f1b90103d30 2024-09-05T01:24:43.062 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-09-05T01:24:43.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.064+0000 7f1b95600640 1 -- 172.21.15.12:0/4111170710 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1b740a2990 msgr2=0x7f1b740a4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:43.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.064+0000 7f1b95600640 1 --2- 172.21.15.12:0/4111170710 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1b740a2990 0x7f1b740a4e50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c031440 tx=0x7f1b7c0315b0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.064+0000 7f1b95600640 1 -- 172.21.15.12:0/4111170710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b90103d30 msgr2=0x7f1b9019a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:43.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.064+0000 7f1b95600640 1 --2- 172.21.15.12:0/4111170710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b90103d30 0x7f1b9019a070 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000e9c0 tx=0x7f1b8000ee80 comp rx=0 tx=0).stop 2024-09-05T01:24:43.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.064+0000 7f1b95600640 1 -- 172.21.15.12:0/4111170710 shutdown_connections 2024-09-05T01:24:43.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.064+0000 7f1b95600640 1 --2- 172.21.15.12:0/4111170710 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1b740a2990 0x7f1b740a4e50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.064+0000 7f1b95600640 1 --2- 172.21.15.12:0/4111170710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b901058e0 0x7f1b901a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.064+0000 7f1b95600640 1 --2- 172.21.15.12:0/4111170710 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b90104f20 0x7f1b9019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.064+0000 7f1b95600640 1 --2- 172.21.15.12:0/4111170710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b90103d30 0x7f1b9019a070 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.064+0000 7f1b95600640 1 -- 172.21.15.12:0/4111170710 >> 172.21.15.12:0/4111170710 conn(0x7f1b900ff470 msgr2=0x7f1b90108390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:43.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.064+0000 7f1b95600640 1 -- 172.21.15.12:0/4111170710 shutdown_connections 2024-09-05T01:24:43.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.064+0000 7f1b95600640 1 -- 172.21.15.12:0/4111170710 wait complete. 2024-09-05T01:24:43.080 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-05T01:24:43.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.243+0000 7f6a7b200640 1 -- 172.21.15.12:0/385639793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a7c1035a0 msgr2=0x7f6a7c109e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:43.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.243+0000 7f6a7b200640 1 --2- 172.21.15.12:0/385639793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a7c1035a0 0x7f6a7c109e30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6a74009ca0 tx=0x7f6a7402a8c0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.243+0000 7f6a7b200640 1 -- 172.21.15.12:0/385639793 shutdown_connections 2024-09-05T01:24:43.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.243+0000 7f6a7b200640 1 --2- 172.21.15.12:0/385639793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a7c1035a0 0x7f6a7c109e30 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.243+0000 7f6a7b200640 1 --2- 172.21.15.12:0/385639793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a7c102be0 0x7f6a7c103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.243+0000 7f6a7b200640 1 --2- 172.21.15.12:0/385639793 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a7c1019f0 0x7f6a7c101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.243+0000 7f6a7b200640 1 -- 172.21.15.12:0/385639793 >> 172.21.15.12:0/385639793 conn(0x7f6a7c0fd190 msgr2=0x7f6a7c0ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:43.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.243+0000 7f6a7b200640 1 -- 172.21.15.12:0/385639793 shutdown_connections 2024-09-05T01:24:43.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.243+0000 7f6a7b200640 1 -- 172.21.15.12:0/385639793 wait complete. 2024-09-05T01:24:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.244+0000 7f6a7b200640 1 Processor -- start 2024-09-05T01:24:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.244+0000 7f6a7b200640 1 -- start start 2024-09-05T01:24:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.245+0000 7f6a7b200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a7c1019f0 0x7f6a7c199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.245+0000 7f6a7b200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a7c102be0 0x7f6a7c19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.245+0000 7f6a7b200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a7c1035a0 0x7f6a7c1a1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.245+0000 7f6a7b200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7c10d650 con 0x7f6a7c1035a0 2024-09-05T01:24:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.245+0000 7f6a7b200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7c10d4d0 con 0x7f6a7c1019f0 2024-09-05T01:24:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.245+0000 7f6a7b200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7c10d7d0 con 0x7f6a7c102be0 2024-09-05T01:24:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.245+0000 7f6a79e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a7c1019f0 0x7f6a7c199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.245+0000 7f6a79e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a7c1019f0 0x7f6a7c199ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:50818/0 (socket says 172.21.15.12:50818) 2024-09-05T01:24:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.245+0000 7f6a79e00640 1 -- 172.21.15.12:0/768596549 learned_addr learned my addr 172.21.15.12:0/768596549 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.245+0000 7f6a7a800640 1 --2- 172.21.15.12:0/768596549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a7c1035a0 0x7f6a7c1a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.245+0000 7f6a73e00640 1 --2- 172.21.15.12:0/768596549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a7c102be0 0x7f6a7c19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.245+0000 7f6a79e00640 1 -- 172.21.15.12:0/768596549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a7c102be0 msgr2=0x7f6a7c19a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.245+0000 7f6a79e00640 1 --2- 172.21.15.12:0/768596549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a7c102be0 0x7f6a7c19a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.245+0000 7f6a79e00640 1 -- 172.21.15.12:0/768596549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a7c1035a0 msgr2=0x7f6a7c1a1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.245+0000 7f6a79e00640 1 --2- 172.21.15.12:0/768596549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a7c1035a0 0x7f6a7c1a1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.245+0000 7f6a79e00640 1 -- 172.21.15.12:0/768596549 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a7c1a1b00 con 0x7f6a7c1019f0 2024-09-05T01:24:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.246+0000 7f6a79e00640 1 --2- 172.21.15.12:0/768596549 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a7c1019f0 0x7f6a7c199ee0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00d950 tx=0x7f6a6c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.246+0000 7f6a72a00640 1 -- 172.21.15.12:0/768596549 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c017020 con 0x7f6a7c1019f0 2024-09-05T01:24:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.246+0000 7f6a7b200640 1 -- 172.21.15.12:0/768596549 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a7c1a1df0 con 0x7f6a7c1019f0 2024-09-05T01:24:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.246+0000 7f6a72a00640 1 -- 172.21.15.12:0/768596549 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a6c009c30 con 0x7f6a7c1019f0 2024-09-05T01:24:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.246+0000 7f6a72a00640 1 -- 172.21.15.12:0/768596549 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c00f740 con 0x7f6a7c1019f0 2024-09-05T01:24:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.246+0000 7f6a7b200640 1 -- 172.21.15.12:0/768596549 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a7c1a2260 con 0x7f6a7c1019f0 2024-09-05T01:24:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.247+0000 7f6a7b200640 1 -- 172.21.15.12:0/768596549 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a7c1a2520 con 0x7f6a7c1019f0 2024-09-05T01:24:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.250+0000 7f6a72a00640 1 -- 172.21.15.12:0/768596549 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7f6a6c01a020 con 0x7f6a7c1019f0 2024-09-05T01:24:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.252+0000 7f6a72a00640 1 --2- 172.21.15.12:0/768596549 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6a600a2990 0x7f6a600a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:43.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.252+0000 7f6a72a00640 1 -- 172.21.15.12:0/768596549 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f6a6c0cea30 con 0x7f6a7c1019f0 2024-09-05T01:24:43.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.252+0000 7f6a73e00640 1 --2- 172.21.15.12:0/768596549 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6a600a2990 0x7f6a600a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:43.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.253+0000 7f6a73e00640 1 --2- 172.21.15.12:0/768596549 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6a600a2990 0x7f6a600a4e50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c19b3f0 tx=0x7f6a64005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:43.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.253+0000 7f6a72a00640 1 -- 172.21.15.12:0/768596549 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6a6c021070 con 0x7f6a7c1019f0 2024-09-05T01:24:43.377 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:43 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3404044415' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-05T01:24:43.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:43 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:24:43.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:43 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3378061315' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:24:43.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:43 smithi012 ceph-mon[29942]: mgrmap e22: x(active, since 1.02107s), standbys: y, z 2024-09-05T01:24:43.378 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:43 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/4111170710' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-05T01:24:43.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.446+0000 7f6a7b200640 1 -- 172.21.15.12:0/768596549 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6a7c1a26f0 con 0x7f6a7c1019f0 2024-09-05T01:24:43.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.446+0000 7f6a72a00640 1 -- 172.21.15.12:0/768596549 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) ==== 104+0+11 (secure 0 0 0) 0x7f6a6c009de0 con 0x7f6a7c1019f0 2024-09-05T01:24:43.447 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2024-09-05T01:24:43.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.449+0000 7f6a7b200640 1 -- 172.21.15.12:0/768596549 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6a600a2990 msgr2=0x7f6a600a4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:43.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.449+0000 7f6a7b200640 1 --2- 172.21.15.12:0/768596549 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6a600a2990 0x7f6a600a4e50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c19b3f0 tx=0x7f6a64005f90 comp rx=0 tx=0).stop 2024-09-05T01:24:43.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.449+0000 7f6a7b200640 1 -- 172.21.15.12:0/768596549 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a7c1019f0 msgr2=0x7f6a7c199ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:43.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.449+0000 7f6a7b200640 1 --2- 172.21.15.12:0/768596549 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a7c1019f0 0x7f6a7c199ee0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00d950 tx=0x7f6a6c00de10 comp rx=0 tx=0).stop 2024-09-05T01:24:43.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.449+0000 7f6a7b200640 1 -- 172.21.15.12:0/768596549 shutdown_connections 2024-09-05T01:24:43.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.449+0000 7f6a7b200640 1 --2- 172.21.15.12:0/768596549 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6a600a2990 0x7f6a600a4e50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.449+0000 7f6a7b200640 1 --2- 172.21.15.12:0/768596549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a7c1035a0 0x7f6a7c1a1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.449+0000 7f6a7b200640 1 --2- 172.21.15.12:0/768596549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a7c102be0 0x7f6a7c19a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.449+0000 7f6a7b200640 1 --2- 172.21.15.12:0/768596549 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a7c1019f0 0x7f6a7c199ee0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.449+0000 7f6a7b200640 1 -- 172.21.15.12:0/768596549 >> 172.21.15.12:0/768596549 conn(0x7f6a7c0fd190 msgr2=0x7f6a7c074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:43.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.449+0000 7f6a7b200640 1 -- 172.21.15.12:0/768596549 shutdown_connections 2024-09-05T01:24:43.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.449+0000 7f6a7b200640 1 -- 172.21.15.12:0/768596549 wait complete. 2024-09-05T01:24:43.465 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-05T01:24:43.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:43 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3404044415' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-05T01:24:43.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:43 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:24:43.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:43 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3378061315' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:24:43.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:43 smithi145 ceph-mon[34376]: mgrmap e22: x(active, since 1.02107s), standbys: y, z 2024-09-05T01:24:43.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:43 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/4111170710' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-05T01:24:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:43 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3404044415' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-05T01:24:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:43 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:24:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:43 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3378061315' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:24:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:43 smithi151 ceph-mon[35013]: mgrmap e22: x(active, since 1.02107s), standbys: y, z 2024-09-05T01:24:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:43 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/4111170710' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-05T01:24:43.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.633+0000 7f1fcbe00640 1 -- 172.21.15.12:0/2036519146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fc4104f20 msgr2=0x7f1fc41053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:43.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.633+0000 7f1fcbe00640 1 --2- 172.21.15.12:0/2036519146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fc4104f20 0x7f1fc41053a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009900 tx=0x7f1fb002a410 comp rx=0 tx=0).stop 2024-09-05T01:24:43.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.633+0000 7f1fcbe00640 1 -- 172.21.15.12:0/2036519146 shutdown_connections 2024-09-05T01:24:43.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.633+0000 7f1fcbe00640 1 --2- 172.21.15.12:0/2036519146 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fc41058e0 0x7f1fc410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.633+0000 7f1fcbe00640 1 --2- 172.21.15.12:0/2036519146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fc4104f20 0x7f1fc41053a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.633+0000 7f1fcbe00640 1 --2- 172.21.15.12:0/2036519146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fc4103d30 0x7f1fc4104130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.633+0000 7f1fcbe00640 1 -- 172.21.15.12:0/2036519146 >> 172.21.15.12:0/2036519146 conn(0x7f1fc40ff470 msgr2=0x7f1fc41018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:43.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.633+0000 7f1fcbe00640 1 -- 172.21.15.12:0/2036519146 shutdown_connections 2024-09-05T01:24:43.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.633+0000 7f1fcbe00640 1 -- 172.21.15.12:0/2036519146 wait complete. 2024-09-05T01:24:43.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.634+0000 7f1fcbe00640 1 Processor -- start 2024-09-05T01:24:43.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.634+0000 7f1fcbe00640 1 -- start start 2024-09-05T01:24:43.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.634+0000 7f1fcbe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fc4103d30 0x7f1fc419a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:43.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.634+0000 7f1fcbe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fc4104f20 0x7f1fc419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:43.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.634+0000 7f1fcbe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fc41058e0 0x7f1fc41a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:43.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.634+0000 7f1fcbe00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc410fa00 con 0x7f1fc41058e0 2024-09-05T01:24:43.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.634+0000 7f1fcbe00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc410f880 con 0x7f1fc4103d30 2024-09-05T01:24:43.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.634+0000 7f1fcbe00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc410fb80 con 0x7f1fc4104f20 2024-09-05T01:24:43.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.635+0000 7f1fc9400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fc4103d30 0x7f1fc419a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:43.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.635+0000 7f1fc9e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fc41058e0 0x7f1fc41a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:43.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.635+0000 7f1fc9400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fc4103d30 0x7f1fc419a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:50842/0 (socket says 172.21.15.12:50842) 2024-09-05T01:24:43.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.635+0000 7f1fc8a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fc4104f20 0x7f1fc419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:43.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.635+0000 7f1fc9400640 1 -- 172.21.15.12:0/1962006970 learned_addr learned my addr 172.21.15.12:0/1962006970 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:43.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.635+0000 7f1fc9400640 1 -- 172.21.15.12:0/1962006970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fc4104f20 msgr2=0x7f1fc419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:43.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.635+0000 7f1fc9400640 1 --2- 172.21.15.12:0/1962006970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fc4104f20 0x7f1fc419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.635+0000 7f1fc9400640 1 -- 172.21.15.12:0/1962006970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fc41058e0 msgr2=0x7f1fc41a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:43.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.635+0000 7f1fc9400640 1 --2- 172.21.15.12:0/1962006970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fc41058e0 0x7f1fc41a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.635+0000 7f1fc9400640 1 -- 172.21.15.12:0/1962006970 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc41a1ca0 con 0x7f1fc4103d30 2024-09-05T01:24:43.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.635+0000 7f1fc9400640 1 --2- 172.21.15.12:0/1962006970 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fc4103d30 0x7f1fc419a080 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1fb800e9c0 tx=0x7f1fb800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:43.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.636+0000 7f1fc2000640 1 -- 172.21.15.12:0/1962006970 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb800cd80 con 0x7f1fc4103d30 2024-09-05T01:24:43.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.636+0000 7f1fc2000640 1 -- 172.21.15.12:0/1962006970 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fb80035f0 con 0x7f1fc4103d30 2024-09-05T01:24:43.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.636+0000 7f1fcbe00640 1 -- 172.21.15.12:0/1962006970 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fc41a1f90 con 0x7f1fc4103d30 2024-09-05T01:24:43.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.636+0000 7f1fc2000640 1 -- 172.21.15.12:0/1962006970 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8010690 con 0x7f1fc4103d30 2024-09-05T01:24:43.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.636+0000 7f1fcbe00640 1 -- 172.21.15.12:0/1962006970 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fc41a2400 con 0x7f1fc4103d30 2024-09-05T01:24:43.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.637+0000 7f1fcbe00640 1 -- 172.21.15.12:0/1962006970 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fc41a2690 con 0x7f1fc4103d30 2024-09-05T01:24:43.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.639+0000 7f1fc2000640 1 -- 172.21.15.12:0/1962006970 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7f1fb80037a0 con 0x7f1fc4103d30 2024-09-05T01:24:43.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.640+0000 7f1fc2000640 1 --2- 172.21.15.12:0/1962006970 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1fac0a2a10 0x7f1fac0a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:43.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.641+0000 7f1fc2000640 1 -- 172.21.15.12:0/1962006970 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f1fb80cf120 con 0x7f1fc4103d30 2024-09-05T01:24:43.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.641+0000 7f1fc8a00640 1 --2- 172.21.15.12:0/1962006970 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1fac0a2a10 0x7f1fac0a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:43.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.641+0000 7f1fc8a00640 1 --2- 172.21.15.12:0/1962006970 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1fac0a2a10 0x7f1fac0a4ed0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0031440 tx=0x7f1fb00315b0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:43.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.645+0000 7f1fc2000640 1 -- 172.21.15.12:0/1962006970 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1fb809c200 con 0x7f1fc4103d30 2024-09-05T01:24:43.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.904+0000 7f1fcbe00640 1 -- 172.21.15.12:0/1962006970 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1fc410ab10 con 0x7f1fc4103d30 2024-09-05T01:24:43.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.905+0000 7f1fc2000640 1 -- 172.21.15.12:0/1962006970 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) ==== 100+0+11 (secure 0 0 0) 0x7f1fb809bb00 con 0x7f1fc4103d30 2024-09-05T01:24:43.906 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2024-09-05T01:24:43.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.907+0000 7f1fcbe00640 1 -- 172.21.15.12:0/1962006970 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1fac0a2a10 msgr2=0x7f1fac0a4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:43.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.907+0000 7f1fcbe00640 1 --2- 172.21.15.12:0/1962006970 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1fac0a2a10 0x7f1fac0a4ed0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0031440 tx=0x7f1fb00315b0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.907+0000 7f1fcbe00640 1 -- 172.21.15.12:0/1962006970 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fc4103d30 msgr2=0x7f1fc419a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:43.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.907+0000 7f1fcbe00640 1 --2- 172.21.15.12:0/1962006970 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fc4103d30 0x7f1fc419a080 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1fb800e9c0 tx=0x7f1fb800ee80 comp rx=0 tx=0).stop 2024-09-05T01:24:43.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.907+0000 7f1fcbe00640 1 -- 172.21.15.12:0/1962006970 shutdown_connections 2024-09-05T01:24:43.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.907+0000 7f1fcbe00640 1 --2- 172.21.15.12:0/1962006970 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1fac0a2a10 0x7f1fac0a4ed0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.907+0000 7f1fcbe00640 1 --2- 172.21.15.12:0/1962006970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fc41058e0 0x7f1fc41a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.907+0000 7f1fcbe00640 1 --2- 172.21.15.12:0/1962006970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fc4104f20 0x7f1fc419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.907+0000 7f1fcbe00640 1 --2- 172.21.15.12:0/1962006970 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1fc4103d30 0x7f1fc419a080 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:43.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.907+0000 7f1fcbe00640 1 -- 172.21.15.12:0/1962006970 >> 172.21.15.12:0/1962006970 conn(0x7f1fc40ff470 msgr2=0x7f1fc41015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:43.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.907+0000 7f1fcbe00640 1 -- 172.21.15.12:0/1962006970 shutdown_connections 2024-09-05T01:24:43.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:43.907+0000 7f1fcbe00640 1 -- 172.21.15.12:0/1962006970 wait complete. 2024-09-05T01:24:43.925 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-05T01:24:43.926 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:24:44.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-mon[29942]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:24:44.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/768596549' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-05T01:24:44.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:44.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:44.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:44.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:44.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/1962006970' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-05T01:24:44.372 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:24:44.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:44 smithi145 ceph-mon[34376]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:24:44.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:44 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/768596549' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-05T01:24:44.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:44 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:44.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:44 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:44.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:44 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:44.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:44 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:44.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:44 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/1962006970' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-05T01:24:44.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:44 smithi151 ceph-mon[35013]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:24:44.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:44 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/768596549' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-05T01:24:44.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:44 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:44.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:44 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:44.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:44 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:44.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:44 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:44.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:44 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/1962006970' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-05T01:24:44.812 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:44.659+0000 7f2d95600640 -1 log_channel(cephadm) log [ERR] : [05/Sep/2024:01:24:44] ENGINE Error in HTTPServer.serve 2024-09-05T01:24:44.813 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: Traceback (most recent call last): 2024-09-05T01:24:44.813 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-05T01:24:44.813 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: self._connections.run(self.expiration_interval) 2024-09-05T01:24:44.813 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-05T01:24:44.813 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: self._run(expiration_interval) 2024-09-05T01:24:44.813 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-05T01:24:44.813 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: new_conn = self._from_server_socket(self.server.socket) 2024-09-05T01:24:44.813 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-05T01:24:44.813 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-05T01:24:44.813 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-05T01:24:44.813 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: s = self.context.wrap_socket( 2024-09-05T01:24:44.813 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-05T01:24:44.813 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: return self.sslsocket_class._create( 2024-09-05T01:24:44.813 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-05T01:24:44.814 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: self.do_handshake() 2024-09-05T01:24:44.814 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-05T01:24:44.814 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: self._sslobj.do_handshake() 2024-09-05T01:24:44.814 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-05T01:24:44.814 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:24:44 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:24:45.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.000+0000 7feea1c00640 1 -- 172.21.15.12:0/625871213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee9c112a30 msgr2=0x7fee9c114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:45.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.000+0000 7feea1c00640 1 --2- 172.21.15.12:0/625871213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee9c112a30 0x7fee9c114e20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fee94009ca0 tx=0x7fee9402a8c0 comp rx=0 tx=0).stop 2024-09-05T01:24:45.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.000+0000 7feea1c00640 1 -- 172.21.15.12:0/625871213 shutdown_connections 2024-09-05T01:24:45.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.000+0000 7feea1c00640 1 --2- 172.21.15.12:0/625871213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee9c112a30 0x7fee9c114e20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:45.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.000+0000 7feea1c00640 1 --2- 172.21.15.12:0/625871213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee9c077040 0x7fee9c1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:45.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.000+0000 7feea1c00640 1 --2- 172.21.15.12:0/625871213 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee9c076720 0x7fee9c076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:45.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.000+0000 7feea1c00640 1 -- 172.21.15.12:0/625871213 >> 172.21.15.12:0/625871213 conn(0x7fee9c0ffa90 msgr2=0x7fee9c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:45.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.000+0000 7feea1c00640 1 -- 172.21.15.12:0/625871213 shutdown_connections 2024-09-05T01:24:45.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.000+0000 7feea1c00640 1 -- 172.21.15.12:0/625871213 wait complete. 2024-09-05T01:24:45.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.001+0000 7feea1c00640 1 Processor -- start 2024-09-05T01:24:45.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.001+0000 7feea1c00640 1 -- start start 2024-09-05T01:24:45.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.002+0000 7feea1c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee9c076720 0x7fee9c1a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:45.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.002+0000 7feea1c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee9c077040 0x7fee9c1a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:45.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.002+0000 7feea1c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee9c112a30 0x7fee9c19e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.002+0000 7feea1c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fee9c118590 con 0x7fee9c112a30 2024-09-05T01:24:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.002+0000 7feea1c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fee9c118410 con 0x7fee9c077040 2024-09-05T01:24:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.002+0000 7feea1c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fee9c118710 con 0x7fee9c076720 2024-09-05T01:24:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.002+0000 7fee9aa00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee9c076720 0x7fee9c1a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.002+0000 7fee9a000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee9c077040 0x7fee9c1a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.002+0000 7fee9aa00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee9c076720 0x7fee9c1a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:49876/0 (socket says 172.21.15.12:49876) 2024-09-05T01:24:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.002+0000 7fee9aa00640 1 -- 172.21.15.12:0/466823092 learned_addr learned my addr 172.21.15.12:0/466823092 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.002+0000 7fee9b400640 1 --2- 172.21.15.12:0/466823092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee9c112a30 0x7fee9c19e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.002+0000 7fee9aa00640 1 -- 172.21.15.12:0/466823092 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee9c077040 msgr2=0x7fee9c1a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.002+0000 7fee9aa00640 1 --2- 172.21.15.12:0/466823092 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee9c077040 0x7fee9c1a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.002+0000 7fee9aa00640 1 -- 172.21.15.12:0/466823092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee9c112a30 msgr2=0x7fee9c19e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.002+0000 7fee9aa00640 1 --2- 172.21.15.12:0/466823092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee9c112a30 0x7fee9c19e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.003+0000 7fee9aa00640 1 -- 172.21.15.12:0/466823092 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee9c19f000 con 0x7fee9c076720 2024-09-05T01:24:45.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.003+0000 7fee9b400640 1 --2- 172.21.15.12:0/466823092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee9c112a30 0x7fee9c19e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:24:45.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.003+0000 7fee9aa00640 1 --2- 172.21.15.12:0/466823092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee9c076720 0x7fee9c1a4710 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00ea60 tx=0x7fee8c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:45.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.003+0000 7fee93400640 1 -- 172.21.15.12:0/466823092 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8c00cde0 con 0x7fee9c076720 2024-09-05T01:24:45.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.003+0000 7feea1c00640 1 -- 172.21.15.12:0/466823092 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee9c19f2f0 con 0x7fee9c076720 2024-09-05T01:24:45.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.003+0000 7fee93400640 1 -- 172.21.15.12:0/466823092 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee8c0035f0 con 0x7fee9c076720 2024-09-05T01:24:45.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.003+0000 7fee93400640 1 -- 172.21.15.12:0/466823092 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8c010670 con 0x7fee9c076720 2024-09-05T01:24:45.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.003+0000 7feea1c00640 1 -- 172.21.15.12:0/466823092 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee9c1ab5e0 con 0x7fee9c076720 2024-09-05T01:24:45.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.004+0000 7feea1c00640 1 -- 172.21.15.12:0/466823092 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee9c076b00 con 0x7fee9c076720 2024-09-05T01:24:45.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.006+0000 7fee93400640 1 -- 172.21.15.12:0/466823092 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 23) ==== 137953+0+0 (secure 0 0 0) 0x7fee8c0037a0 con 0x7fee9c076720 2024-09-05T01:24:45.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.007+0000 7fee93400640 1 --2- 172.21.15.12:0/466823092 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fee800a2cf0 0x7fee800a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:45.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.008+0000 7fee93400640 1 -- 172.21.15.12:0/466823092 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fee8c0cf820 con 0x7fee9c076720 2024-09-05T01:24:45.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.008+0000 7fee9a000640 1 --2- 172.21.15.12:0/466823092 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fee800a2cf0 0x7fee800a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:45.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.009+0000 7fee9a000640 1 --2- 172.21.15.12:0/466823092 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fee800a2cf0 0x7fee800a51b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fee9c0793e0 tx=0x7fee88005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:45.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.012+0000 7fee93400640 1 -- 172.21.15.12:0/466823092 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fee8c09c3d0 con 0x7fee9c076720 2024-09-05T01:24:45.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.243+0000 7feea1c00640 1 -- 172.21.15.12:0/466823092 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee9c19fe00 con 0x7fee9c076720 2024-09-05T01:24:45.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.244+0000 7fee93400640 1 -- 172.21.15.12:0/466823092 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7fee8c09bcd0 con 0x7fee9c076720 2024-09-05T01:24:45.246 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:24:45.246 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":28,"btime":"2024-09-05T01:24:42:138818+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14532,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/2949711075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":2949711075},{"type":"v1","addr":"172.21.15.12:6839","nonce":2949711075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T01:22:35.979384+0000","modified":"2024-09-05T01:24:41.174185+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24529,"mds_2":24524,"mds_3":24517,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/497406458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":497406458},{"type":"v1","addr":"172.21.15.12:6841","nonce":497406458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":10,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.145:6839/1706431882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":1706431882},{"type":"v1","addr":"172.21.15.145:6839","nonce":1706431882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24529,24524,24517,24460]},"id":1}]} 2024-09-05T01:24:45.246 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 28 2024-09-05T01:24:45.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.246+0000 7feea1c00640 1 -- 172.21.15.12:0/466823092 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fee800a2cf0 msgr2=0x7fee800a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:45.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.246+0000 7feea1c00640 1 --2- 172.21.15.12:0/466823092 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fee800a2cf0 0x7fee800a51b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fee9c0793e0 tx=0x7fee88005f90 comp rx=0 tx=0).stop 2024-09-05T01:24:45.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.246+0000 7feea1c00640 1 -- 172.21.15.12:0/466823092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee9c076720 msgr2=0x7fee9c1a4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:45.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.246+0000 7feea1c00640 1 --2- 172.21.15.12:0/466823092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee9c076720 0x7fee9c1a4710 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00ea60 tx=0x7fee8c00ef20 comp rx=0 tx=0).stop 2024-09-05T01:24:45.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.246+0000 7feea1c00640 1 -- 172.21.15.12:0/466823092 shutdown_connections 2024-09-05T01:24:45.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.246+0000 7feea1c00640 1 --2- 172.21.15.12:0/466823092 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fee800a2cf0 0x7fee800a51b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:45.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.246+0000 7feea1c00640 1 --2- 172.21.15.12:0/466823092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fee9c112a30 0x7fee9c19e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:45.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.246+0000 7feea1c00640 1 --2- 172.21.15.12:0/466823092 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fee9c077040 0x7fee9c1a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:45.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.246+0000 7feea1c00640 1 --2- 172.21.15.12:0/466823092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee9c076720 0x7fee9c1a4710 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:45.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.246+0000 7feea1c00640 1 -- 172.21.15.12:0/466823092 >> 172.21.15.12:0/466823092 conn(0x7fee9c0ffa90 msgr2=0x7fee9c101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:45.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.247+0000 7feea1c00640 1 -- 172.21.15.12:0/466823092 shutdown_connections 2024-09-05T01:24:45.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:45.247+0000 7feea1c00640 1 -- 172.21.15.12:0/466823092 wait complete. 2024-09-05T01:24:45.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-09-05T01:24:45.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:45.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:45.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:45.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:45.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: Adjusting osd_memory_target on smithi145 to 176.0M 2024-09-05T01:24:45.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: Unable to set osd_memory_target on smithi145 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-05T01:24:45.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: Adjusting osd_memory_target on smithi151 to 176.0M 2024-09-05T01:24:45.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: Unable to set osd_memory_target on smithi151 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-05T01:24:45.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:45.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:45 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:45.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-09-05T01:24:45.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:45.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:45.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:45.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: Adjusting osd_memory_target on smithi145 to 176.0M 2024-09-05T01:24:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: Unable to set osd_memory_target on smithi145 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-05T01:24:45.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: Adjusting osd_memory_target on smithi151 to 176.0M 2024-09-05T01:24:45.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: Unable to set osd_memory_target on smithi151 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-05T01:24:45.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:45.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:45 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:45.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-09-05T01:24:45.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:45.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:45.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: Adjusting osd_memory_target on smithi145 to 176.0M 2024-09-05T01:24:45.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: Unable to set osd_memory_target on smithi145 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-05T01:24:45.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:45.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: Adjusting osd_memory_target on smithi151 to 176.0M 2024-09-05T01:24:45.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: Unable to set osd_memory_target on smithi151 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-05T01:24:45.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:45.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:45 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:45.961 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-05T01:24:45.961 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-05T01:24:45.961 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T01:24:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.127+0000 7efd5fe00640 1 -- 172.21.15.12:0/102872655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd58076bb0 msgr2=0x7efd58076fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.127+0000 7efd5fe00640 1 --2- 172.21.15.12:0/102872655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd58076bb0 0x7efd58076fb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efd4c009900 tx=0x7efd4c02a400 comp rx=0 tx=0).stop 2024-09-05T01:24:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.128+0000 7efd5fe00640 1 -- 172.21.15.12:0/102872655 shutdown_connections 2024-09-05T01:24:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.128+0000 7efd5fe00640 1 --2- 172.21.15.12:0/102872655 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd58078790 0x7efd58079030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.128+0000 7efd5fe00640 1 --2- 172.21.15.12:0/102872655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd58077df0 0x7efd58078250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.128+0000 7efd5fe00640 1 --2- 172.21.15.12:0/102872655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd58076bb0 0x7efd58076fb0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.128+0000 7efd5fe00640 1 -- 172.21.15.12:0/102872655 >> 172.21.15.12:0/102872655 conn(0x7efd580ff4b0 msgr2=0x7efd581018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.128+0000 7efd5fe00640 1 -- 172.21.15.12:0/102872655 shutdown_connections 2024-09-05T01:24:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.128+0000 7efd5fe00640 1 -- 172.21.15.12:0/102872655 wait complete. 2024-09-05T01:24:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.129+0000 7efd5fe00640 1 Processor -- start 2024-09-05T01:24:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.129+0000 7efd5fe00640 1 -- start start 2024-09-05T01:24:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.129+0000 7efd5fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd58076bb0 0x7efd5819e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.129+0000 7efd5fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd58077df0 0x7efd5819e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.129+0000 7efd5fe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd58078790 0x7efd581a5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.129+0000 7efd5fe00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efd58113dc0 con 0x7efd58077df0 2024-09-05T01:24:46.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.129+0000 7efd5fe00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7efd58113c40 con 0x7efd58078790 2024-09-05T01:24:46.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.129+0000 7efd5fe00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7efd58113f40 con 0x7efd58076bb0 2024-09-05T01:24:46.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.129+0000 7efd5ca00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd58077df0 0x7efd5819e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:46.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.129+0000 7efd5d400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd58076bb0 0x7efd5819e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:46.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.129+0000 7efd5ca00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd58077df0 0x7efd5819e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51822/0 (socket says 172.21.15.12:51822) 2024-09-05T01:24:46.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.129+0000 7efd5ca00640 1 -- 172.21.15.12:0/247224446 learned_addr learned my addr 172.21.15.12:0/247224446 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:46.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.130+0000 7efd5d400640 1 -- 172.21.15.12:0/247224446 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd58078790 msgr2=0x7efd581a5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:46.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.130+0000 7efd5d400640 1 --2- 172.21.15.12:0/247224446 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd58078790 0x7efd581a5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:46.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.130+0000 7efd5d400640 1 -- 172.21.15.12:0/247224446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd58077df0 msgr2=0x7efd5819e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:46.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.130+0000 7efd5d400640 1 --2- 172.21.15.12:0/247224446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd58077df0 0x7efd5819e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:46.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.130+0000 7efd5d400640 1 -- 172.21.15.12:0/247224446 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd581a60a0 con 0x7efd58076bb0 2024-09-05T01:24:46.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.130+0000 7efd5ca00640 1 --2- 172.21.15.12:0/247224446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd58077df0 0x7efd5819e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:46.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.130+0000 7efd5d400640 1 --2- 172.21.15.12:0/247224446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd58076bb0 0x7efd5819e480 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efd4c031440 tx=0x7efd4c004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:46.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.131+0000 7efd56000640 1 -- 172.21.15.12:0/247224446 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c03f070 con 0x7efd58076bb0 2024-09-05T01:24:46.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.131+0000 7efd56000640 1 -- 172.21.15.12:0/247224446 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd4c003cd0 con 0x7efd58076bb0 2024-09-05T01:24:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.131+0000 7efd5fe00640 1 -- 172.21.15.12:0/247224446 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd581a6330 con 0x7efd58076bb0 2024-09-05T01:24:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.131+0000 7efd56000640 1 -- 172.21.15.12:0/247224446 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c035070 con 0x7efd58076bb0 2024-09-05T01:24:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.131+0000 7efd5fe00640 1 -- 172.21.15.12:0/247224446 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd581a67f0 con 0x7efd58076bb0 2024-09-05T01:24:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.132+0000 7efd5fe00640 1 -- 172.21.15.12:0/247224446 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd58110830 con 0x7efd58076bb0 2024-09-05T01:24:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.134+0000 7efd56000640 1 -- 172.21.15.12:0/247224446 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 23) ==== 137953+0+0 (secure 0 0 0) 0x7efd4c03b4f0 con 0x7efd58076bb0 2024-09-05T01:24:46.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.135+0000 7efd56000640 1 --2- 172.21.15.12:0/247224446 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7efd400a2d00 0x7efd400a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:46.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.135+0000 7efd56000640 1 -- 172.21.15.12:0/247224446 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7efd4c0efda0 con 0x7efd58076bb0 2024-09-05T01:24:46.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.135+0000 7efd5ca00640 1 --2- 172.21.15.12:0/247224446 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7efd400a2d00 0x7efd400a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:46.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.136+0000 7efd5ca00640 1 --2- 172.21.15.12:0/247224446 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7efd400a2d00 0x7efd400a51c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efd440095f0 tx=0x7efd44005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.137+0000 7efd56000640 1 -- 172.21.15.12:0/247224446 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efd4c0bc9b0 con 0x7efd58076bb0 2024-09-05T01:24:46.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.184+0000 7efd56000640 1 -- 172.21.15.12:0/247224446 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7efd4c0ed760 con 0x7efd58076bb0 2024-09-05T01:24:46.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.355+0000 7efd5fe00640 1 -- 172.21.15.12:0/247224446 --> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efd58062630 con 0x7efd400a2d00 2024-09-05T01:24:46.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.363+0000 7efd56000640 1 -- 172.21.15.12:0/247224446 <== mgr.15138 v2:172.21.15.12:6800/3451745620 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257822 (secure 0 0 0) 0x7efd58062630 con 0x7efd400a2d00 2024-09-05T01:24:46.368 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:24:46.369 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-05T01:24:46.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.368+0000 7efd5fe00640 1 -- 172.21.15.12:0/247224446 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7efd400a2d00 msgr2=0x7efd400a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:46.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.368+0000 7efd5fe00640 1 --2- 172.21.15.12:0/247224446 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7efd400a2d00 0x7efd400a51c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efd440095f0 tx=0x7efd44005f90 comp rx=0 tx=0).stop 2024-09-05T01:24:46.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.368+0000 7efd5fe00640 1 -- 172.21.15.12:0/247224446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd58076bb0 msgr2=0x7efd5819e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:46.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.368+0000 7efd5fe00640 1 --2- 172.21.15.12:0/247224446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd58076bb0 0x7efd5819e480 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efd4c031440 tx=0x7efd4c004270 comp rx=0 tx=0).stop 2024-09-05T01:24:46.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.368+0000 7efd5fe00640 1 -- 172.21.15.12:0/247224446 shutdown_connections 2024-09-05T01:24:46.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.368+0000 7efd5fe00640 1 --2- 172.21.15.12:0/247224446 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7efd400a2d00 0x7efd400a51c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:46.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.368+0000 7efd5fe00640 1 --2- 172.21.15.12:0/247224446 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd58078790 0x7efd581a5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:46.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.368+0000 7efd5fe00640 1 --2- 172.21.15.12:0/247224446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd58077df0 0x7efd5819e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:46.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.368+0000 7efd5fe00640 1 --2- 172.21.15.12:0/247224446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd58076bb0 0x7efd5819e480 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:46.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.368+0000 7efd5fe00640 1 -- 172.21.15.12:0/247224446 >> 172.21.15.12:0/247224446 conn(0x7efd580ff4b0 msgr2=0x7efd58100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:46.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.369+0000 7efd5fe00640 1 -- 172.21.15.12:0/247224446 shutdown_connections 2024-09-05T01:24:46.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.369+0000 7efd5fe00640 1 -- 172.21.15.12:0/247224446 wait complete. 2024-09-05T01:24:46.388 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-05T01:24:45.615335+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1192577,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1398,"num_read_kb":884,"num_write":565,"num_write_kb":4411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":1182018,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":946,"ondisk_log_size":946,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376760,"kb_used_data":15000,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124565064,"statfs":{"total":1151940427776,"available":1151554625536,"internally_reserved":0,"allocated":15360000,"data_stored":9115204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.982018"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.706548+0000","last_change":"2024-09-05T01:22:35.038389+0000","last_active":"2024-09-05T01:24:41.706548+0000","last_peered":"2024-09-05T01:24:41.706548+0000","last_clean":"2024-09-05T01:24:41.706548+0000","last_became_active":"2024-09-05T01:22:35.037982+0000","last_became_peered":"2024-09-05T01:22:35.037982+0000","last_unstale":"2024-09-05T01:24:41.706548+0000","last_undegraded":"2024-09-05T01:24:41.706548+0000","last_fullsized":"2024-09-05T01:24:41.706548+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:23:33.802592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839568+0000","last_change":"2024-09-05T01:22:35.035340+0000","last_active":"2024-09-05T01:24:41.839568+0000","last_peered":"2024-09-05T01:24:41.839568+0000","last_clean":"2024-09-05T01:24:41.839568+0000","last_became_active":"2024-09-05T01:22:35.032871+0000","last_became_peered":"2024-09-05T01:22:35.032871+0000","last_unstale":"2024-09-05T01:24:41.839568+0000","last_undegraded":"2024-09-05T01:24:41.839568+0000","last_fullsized":"2024-09-05T01:24:41.839568+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:51:07.235915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.840354+0000","last_change":"2024-09-05T01:22:35.045443+0000","last_active":"2024-09-05T01:24:41.840354+0000","last_peered":"2024-09-05T01:24:41.840354+0000","last_clean":"2024-09-05T01:24:41.840354+0000","last_became_active":"2024-09-05T01:22:35.042342+0000","last_became_peered":"2024-09-05T01:22:35.042342+0000","last_unstale":"2024-09-05T01:24:41.840354+0000","last_undegraded":"2024-09-05T01:24:41.840354+0000","last_fullsized":"2024-09-05T01:24:41.840354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:42:46.878959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.840049+0000","last_change":"2024-09-05T01:22:35.041527+0000","last_active":"2024-09-05T01:24:41.840049+0000","last_peered":"2024-09-05T01:24:41.840049+0000","last_clean":"2024-09-05T01:24:41.840049+0000","last_became_active":"2024-09-05T01:22:35.041210+0000","last_became_peered":"2024-09-05T01:22:35.041210+0000","last_unstale":"2024-09-05T01:24:41.840049+0000","last_undegraded":"2024-09-05T01:24:41.840049+0000","last_fullsized":"2024-09-05T01:24:41.840049+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:22:28.770307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949039+0000","last_change":"2024-09-05T01:22:35.036810+0000","last_active":"2024-09-05T01:24:41.949039+0000","last_peered":"2024-09-05T01:24:41.949039+0000","last_clean":"2024-09-05T01:24:41.949039+0000","last_became_active":"2024-09-05T01:22:35.036435+0000","last_became_peered":"2024-09-05T01:22:35.036435+0000","last_unstale":"2024-09-05T01:24:41.949039+0000","last_undegraded":"2024-09-05T01:24:41.949039+0000","last_fullsized":"2024-09-05T01:24:41.949039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:41:43.649178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.715224+0000","last_change":"2024-09-05T01:22:35.039198+0000","last_active":"2024-09-05T01:24:41.715224+0000","last_peered":"2024-09-05T01:24:41.715224+0000","last_clean":"2024-09-05T01:24:41.715224+0000","last_became_active":"2024-09-05T01:22:35.038822+0000","last_became_peered":"2024-09-05T01:22:35.038822+0000","last_unstale":"2024-09-05T01:24:41.715224+0000","last_undegraded":"2024-09-05T01:24:41.715224+0000","last_fullsized":"2024-09-05T01:24:41.715224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:22:08.600927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838383+0000","last_change":"2024-09-05T01:22:35.034687+0000","last_active":"2024-09-05T01:24:41.838383+0000","last_peered":"2024-09-05T01:24:41.838383+0000","last_clean":"2024-09-05T01:24:41.838383+0000","last_became_active":"2024-09-05T01:22:35.034351+0000","last_became_peered":"2024-09-05T01:22:35.034351+0000","last_unstale":"2024-09-05T01:24:41.838383+0000","last_undegraded":"2024-09-05T01:24:41.838383+0000","last_fullsized":"2024-09-05T01:24:41.838383+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:38:27.311348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.703672+0000","last_change":"2024-09-05T01:23:23.250016+0000","last_active":"2024-09-05T01:24:41.703672+0000","last_peered":"2024-09-05T01:24:41.703672+0000","last_clean":"2024-09-05T01:24:41.703672+0000","last_became_active":"2024-09-05T01:23:23.249553+0000","last_became_peered":"2024-09-05T01:23:23.249553+0000","last_unstale":"2024-09-05T01:24:41.703672+0000","last_undegraded":"2024-09-05T01:24:41.703672+0000","last_fullsized":"2024-09-05T01:24:41.703672+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:06:32.460400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839596+0000","last_change":"2024-09-05T01:22:35.036394+0000","last_active":"2024-09-05T01:24:41.839596+0000","last_peered":"2024-09-05T01:24:41.839596+0000","last_clean":"2024-09-05T01:24:41.839596+0000","last_became_active":"2024-09-05T01:22:35.035990+0000","last_became_peered":"2024-09-05T01:22:35.035990+0000","last_unstale":"2024-09-05T01:24:41.839596+0000","last_undegraded":"2024-09-05T01:24:41.839596+0000","last_fullsized":"2024-09-05T01:24:41.839596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:42:18.870263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.715654+0000","last_change":"2024-09-05T01:22:35.033389+0000","last_active":"2024-09-05T01:24:41.715654+0000","last_peered":"2024-09-05T01:24:41.715654+0000","last_clean":"2024-09-05T01:24:41.715654+0000","last_became_active":"2024-09-05T01:22:35.033081+0000","last_became_peered":"2024-09-05T01:22:35.033081+0000","last_unstale":"2024-09-05T01:24:41.715654+0000","last_undegraded":"2024-09-05T01:24:41.715654+0000","last_fullsized":"2024-09-05T01:24:41.715654+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:53:08.266905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839098+0000","last_change":"2024-09-05T01:22:35.035768+0000","last_active":"2024-09-05T01:24:41.839098+0000","last_peered":"2024-09-05T01:24:41.839098+0000","last_clean":"2024-09-05T01:24:41.839098+0000","last_became_active":"2024-09-05T01:22:35.035456+0000","last_became_peered":"2024-09-05T01:22:35.035456+0000","last_unstale":"2024-09-05T01:24:41.839098+0000","last_undegraded":"2024-09-05T01:24:41.839098+0000","last_fullsized":"2024-09-05T01:24:41.839098+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:15:48.723816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.840030+0000","last_change":"2024-09-05T01:22:35.040720+0000","last_active":"2024-09-05T01:24:41.840030+0000","last_peered":"2024-09-05T01:24:41.840030+0000","last_clean":"2024-09-05T01:24:41.840030+0000","last_became_active":"2024-09-05T01:22:35.039617+0000","last_became_peered":"2024-09-05T01:22:35.039617+0000","last_unstale":"2024-09-05T01:24:41.840030+0000","last_undegraded":"2024-09-05T01:24:41.840030+0000","last_fullsized":"2024-09-05T01:24:41.840030+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:23:11.633617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.600017+0000","last_change":"2024-09-05T01:22:35.022096+0000","last_active":"2024-09-05T01:24:41.600017+0000","last_peered":"2024-09-05T01:24:41.600017+0000","last_clean":"2024-09-05T01:24:41.600017+0000","last_became_active":"2024-09-05T01:22:35.021707+0000","last_became_peered":"2024-09-05T01:22:35.021707+0000","last_unstale":"2024-09-05T01:24:41.600017+0000","last_undegraded":"2024-09-05T01:24:41.600017+0000","last_fullsized":"2024-09-05T01:24:41.600017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:50:35.035386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839490+0000","last_change":"2024-09-05T01:22:35.034481+0000","last_active":"2024-09-05T01:24:41.839490+0000","last_peered":"2024-09-05T01:24:41.839490+0000","last_clean":"2024-09-05T01:24:41.839490+0000","last_became_active":"2024-09-05T01:22:35.034145+0000","last_became_peered":"2024-09-05T01:22:35.034145+0000","last_unstale":"2024-09-05T01:24:41.839490+0000","last_undegraded":"2024-09-05T01:24:41.839490+0000","last_fullsized":"2024-09-05T01:24:41.839490+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:19:33.386981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839375+0000","last_change":"2024-09-05T01:23:23.195234+0000","last_active":"2024-09-05T01:24:41.839375+0000","last_peered":"2024-09-05T01:24:41.839375+0000","last_clean":"2024-09-05T01:24:41.839375+0000","last_became_active":"2024-09-05T01:23:23.194014+0000","last_became_peered":"2024-09-05T01:23:23.194014+0000","last_unstale":"2024-09-05T01:24:41.839375+0000","last_undegraded":"2024-09-05T01:24:41.839375+0000","last_fullsized":"2024-09-05T01:24:41.839375+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:05:38.517017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838720+0000","last_change":"2024-09-05T01:22:35.046517+0000","last_active":"2024-09-05T01:24:41.838720+0000","last_peered":"2024-09-05T01:24:41.838720+0000","last_clean":"2024-09-05T01:24:41.838720+0000","last_became_active":"2024-09-05T01:22:35.046230+0000","last_became_peered":"2024-09-05T01:22:35.046230+0000","last_unstale":"2024-09-05T01:24:41.838720+0000","last_undegraded":"2024-09-05T01:24:41.838720+0000","last_fullsized":"2024-09-05T01:24:41.838720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:16:49.672039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.706548+0000","last_change":"2024-09-05T01:22:35.041140+0000","last_active":"2024-09-05T01:24:41.706548+0000","last_peered":"2024-09-05T01:24:41.706548+0000","last_clean":"2024-09-05T01:24:41.706548+0000","last_became_active":"2024-09-05T01:22:35.040838+0000","last_became_peered":"2024-09-05T01:22:35.040838+0000","last_unstale":"2024-09-05T01:24:41.706548+0000","last_undegraded":"2024-09-05T01:24:41.706548+0000","last_fullsized":"2024-09-05T01:24:41.706548+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:47:55.730240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.703957+0000","last_change":"2024-09-05T01:22:35.036830+0000","last_active":"2024-09-05T01:24:41.703957+0000","last_peered":"2024-09-05T01:24:41.703957+0000","last_clean":"2024-09-05T01:24:41.703957+0000","last_became_active":"2024-09-05T01:22:35.036356+0000","last_became_peered":"2024-09-05T01:22:35.036356+0000","last_unstale":"2024-09-05T01:24:41.703957+0000","last_undegraded":"2024-09-05T01:24:41.703957+0000","last_fullsized":"2024-09-05T01:24:41.703957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:19:01.736301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838151+0000","last_change":"2024-09-05T01:22:35.036386+0000","last_active":"2024-09-05T01:24:41.838151+0000","last_peered":"2024-09-05T01:24:41.838151+0000","last_clean":"2024-09-05T01:24:41.838151+0000","last_became_active":"2024-09-05T01:22:35.036046+0000","last_became_peered":"2024-09-05T01:22:35.036046+0000","last_unstale":"2024-09-05T01:24:41.838151+0000","last_undegraded":"2024-09-05T01:24:41.838151+0000","last_fullsized":"2024-09-05T01:24:41.838151+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:19:37.861719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.706279+0000","last_change":"2024-09-05T01:22:35.041077+0000","last_active":"2024-09-05T01:24:41.706279+0000","last_peered":"2024-09-05T01:24:41.706279+0000","last_clean":"2024-09-05T01:24:41.706279+0000","last_became_active":"2024-09-05T01:22:35.040736+0000","last_became_peered":"2024-09-05T01:22:35.040736+0000","last_unstale":"2024-09-05T01:24:41.706279+0000","last_undegraded":"2024-09-05T01:24:41.706279+0000","last_fullsized":"2024-09-05T01:24:41.706279+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:30:54.670559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.600184+0000","last_change":"2024-09-05T01:22:35.047774+0000","last_active":"2024-09-05T01:24:41.600184+0000","last_peered":"2024-09-05T01:24:41.600184+0000","last_clean":"2024-09-05T01:24:41.600184+0000","last_became_active":"2024-09-05T01:22:35.047153+0000","last_became_peered":"2024-09-05T01:22:35.047153+0000","last_unstale":"2024-09-05T01:24:41.600184+0000","last_undegraded":"2024-09-05T01:24:41.600184+0000","last_fullsized":"2024-09-05T01:24:41.600184+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:07:02.189116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838935+0000","last_change":"2024-09-05T01:22:35.041346+0000","last_active":"2024-09-05T01:24:41.838935+0000","last_peered":"2024-09-05T01:24:41.838935+0000","last_clean":"2024-09-05T01:24:41.838935+0000","last_became_active":"2024-09-05T01:22:35.040282+0000","last_became_peered":"2024-09-05T01:22:35.040282+0000","last_unstale":"2024-09-05T01:24:41.838935+0000","last_undegraded":"2024-09-05T01:24:41.838935+0000","last_fullsized":"2024-09-05T01:24:41.838935+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:19:38.203479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.601624+0000","last_change":"2024-09-05T01:22:35.041780+0000","last_active":"2024-09-05T01:24:41.601624+0000","last_peered":"2024-09-05T01:24:41.601624+0000","last_clean":"2024-09-05T01:24:41.601624+0000","last_became_active":"2024-09-05T01:22:35.038453+0000","last_became_peered":"2024-09-05T01:22:35.038453+0000","last_unstale":"2024-09-05T01:24:41.601624+0000","last_undegraded":"2024-09-05T01:24:41.601624+0000","last_fullsized":"2024-09-05T01:24:41.601624+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:17:56.453627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.601680+0000","last_change":"2024-09-05T01:22:35.038699+0000","last_active":"2024-09-05T01:24:41.601680+0000","last_peered":"2024-09-05T01:24:41.601680+0000","last_clean":"2024-09-05T01:24:41.601680+0000","last_became_active":"2024-09-05T01:22:35.038349+0000","last_became_peered":"2024-09-05T01:22:35.038349+0000","last_unstale":"2024-09-05T01:24:41.601680+0000","last_undegraded":"2024-09-05T01:24:41.601680+0000","last_fullsized":"2024-09-05T01:24:41.601680+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:17:18.175643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.603332+0000","last_change":"2024-09-05T01:22:35.048281+0000","last_active":"2024-09-05T01:24:41.603332+0000","last_peered":"2024-09-05T01:24:41.603332+0000","last_clean":"2024-09-05T01:24:41.603332+0000","last_became_active":"2024-09-05T01:22:35.047211+0000","last_became_peered":"2024-09-05T01:22:35.047211+0000","last_unstale":"2024-09-05T01:24:41.603332+0000","last_undegraded":"2024-09-05T01:24:41.603332+0000","last_fullsized":"2024-09-05T01:24:41.603332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:40:43.196562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838291+0000","last_change":"2024-09-05T01:22:35.041215+0000","last_active":"2024-09-05T01:24:41.838291+0000","last_peered":"2024-09-05T01:24:41.838291+0000","last_clean":"2024-09-05T01:24:41.838291+0000","last_became_active":"2024-09-05T01:22:35.040156+0000","last_became_peered":"2024-09-05T01:22:35.040156+0000","last_unstale":"2024-09-05T01:24:41.838291+0000","last_undegraded":"2024-09-05T01:24:41.838291+0000","last_fullsized":"2024-09-05T01:24:41.838291+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:39:01.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.706412+0000","last_change":"2024-09-05T01:23:23.197568+0000","last_active":"2024-09-05T01:24:41.706412+0000","last_peered":"2024-09-05T01:24:41.706412+0000","last_clean":"2024-09-05T01:24:41.706412+0000","last_became_active":"2024-09-05T01:23:23.197132+0000","last_became_peered":"2024-09-05T01:23:23.197132+0000","last_unstale":"2024-09-05T01:24:41.706412+0000","last_undegraded":"2024-09-05T01:24:41.706412+0000","last_fullsized":"2024-09-05T01:24:41.706412+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:55.524687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.599878+0000","last_change":"2024-09-05T01:22:35.038147+0000","last_active":"2024-09-05T01:24:41.599878+0000","last_peered":"2024-09-05T01:24:41.599878+0000","last_clean":"2024-09-05T01:24:41.599878+0000","last_became_active":"2024-09-05T01:22:35.037772+0000","last_became_peered":"2024-09-05T01:22:35.037772+0000","last_unstale":"2024-09-05T01:24:41.599878+0000","last_undegraded":"2024-09-05T01:24:41.599878+0000","last_fullsized":"2024-09-05T01:24:41.599878+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:40:01.786788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839878+0000","last_change":"2024-09-05T01:22:35.049040+0000","last_active":"2024-09-05T01:24:41.839878+0000","last_peered":"2024-09-05T01:24:41.839878+0000","last_clean":"2024-09-05T01:24:41.839878+0000","last_became_active":"2024-09-05T01:22:35.048373+0000","last_became_peered":"2024-09-05T01:22:35.048373+0000","last_unstale":"2024-09-05T01:24:41.839878+0000","last_undegraded":"2024-09-05T01:24:41.839878+0000","last_fullsized":"2024-09-05T01:24:41.839878+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:32:17.316513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838001+0000","last_change":"2024-09-05T01:22:35.043531+0000","last_active":"2024-09-05T01:24:41.838001+0000","last_peered":"2024-09-05T01:24:41.838001+0000","last_clean":"2024-09-05T01:24:41.838001+0000","last_became_active":"2024-09-05T01:22:35.043145+0000","last_became_peered":"2024-09-05T01:22:35.043145+0000","last_unstale":"2024-09-05T01:24:41.838001+0000","last_undegraded":"2024-09-05T01:24:41.838001+0000","last_fullsized":"2024-09-05T01:24:41.838001+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:04:41.902738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838085+0000","last_change":"2024-09-05T01:22:35.037684+0000","last_active":"2024-09-05T01:24:41.838085+0000","last_peered":"2024-09-05T01:24:41.838085+0000","last_clean":"2024-09-05T01:24:41.838085+0000","last_became_active":"2024-09-05T01:22:35.037392+0000","last_became_peered":"2024-09-05T01:22:35.037392+0000","last_unstale":"2024-09-05T01:24:41.838085+0000","last_undegraded":"2024-09-05T01:24:41.838085+0000","last_fullsized":"2024-09-05T01:24:41.838085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:12:37.705198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.706379+0000","last_change":"2024-09-05T01:22:35.036917+0000","last_active":"2024-09-05T01:24:41.706379+0000","last_peered":"2024-09-05T01:24:41.706379+0000","last_clean":"2024-09-05T01:24:41.706379+0000","last_became_active":"2024-09-05T01:22:35.036597+0000","last_became_peered":"2024-09-05T01:22:35.036597+0000","last_unstale":"2024-09-05T01:24:41.706379+0000","last_undegraded":"2024-09-05T01:24:41.706379+0000","last_fullsized":"2024-09-05T01:24:41.706379+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:25:46.472325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949036+0000","last_change":"2024-09-05T01:22:35.035858+0000","last_active":"2024-09-05T01:24:41.949036+0000","last_peered":"2024-09-05T01:24:41.949036+0000","last_clean":"2024-09-05T01:24:41.949036+0000","last_became_active":"2024-09-05T01:22:35.035075+0000","last_became_peered":"2024-09-05T01:22:35.035075+0000","last_unstale":"2024-09-05T01:24:41.949036+0000","last_undegraded":"2024-09-05T01:24:41.949036+0000","last_fullsized":"2024-09-05T01:24:41.949036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:49:42.487427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'7","reported_seq":155,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.602440+0000","last_change":"2024-09-05T01:22:32.615444+0000","last_active":"2024-09-05T01:24:41.602440+0000","last_peered":"2024-09-05T01:24:41.602440+0000","last_clean":"2024-09-05T01:24:41.602440+0000","last_became_active":"2024-09-05T01:22:32.615026+0000","last_became_peered":"2024-09-05T01:22:32.615026+0000","last_unstale":"2024-09-05T01:24:41.602440+0000","last_undegraded":"2024-09-05T01:24:41.602440+0000","last_fullsized":"2024-09-05T01:24:41.602440+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:52:51.410953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.602228+0000","last_change":"2024-09-05T01:22:35.039341+0000","last_active":"2024-09-05T01:24:41.602228+0000","last_peered":"2024-09-05T01:24:41.602228+0000","last_clean":"2024-09-05T01:24:41.602228+0000","last_became_active":"2024-09-05T01:22:35.038911+0000","last_became_peered":"2024-09-05T01:22:35.038911+0000","last_unstale":"2024-09-05T01:24:41.602228+0000","last_undegraded":"2024-09-05T01:24:41.602228+0000","last_fullsized":"2024-09-05T01:24:41.602228+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:18:41.735302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'7","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.715259+0000","last_change":"2024-09-05T01:22:32.610256+0000","last_active":"2024-09-05T01:24:41.715259+0000","last_peered":"2024-09-05T01:24:41.715259+0000","last_clean":"2024-09-05T01:24:41.715259+0000","last_became_active":"2024-09-05T01:22:32.609430+0000","last_became_peered":"2024-09-05T01:22:32.609430+0000","last_unstale":"2024-09-05T01:24:41.715259+0000","last_undegraded":"2024-09-05T01:24:41.715259+0000","last_fullsized":"2024-09-05T01:24:41.715259+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:00:13.171249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.599701+0000","last_change":"2024-09-05T01:22:32.609238+0000","last_active":"2024-09-05T01:24:41.599701+0000","last_peered":"2024-09-05T01:24:41.599701+0000","last_clean":"2024-09-05T01:24:41.599701+0000","last_became_active":"2024-09-05T01:22:32.608789+0000","last_became_peered":"2024-09-05T01:22:32.608789+0000","last_unstale":"2024-09-05T01:24:41.599701+0000","last_undegraded":"2024-09-05T01:24:41.599701+0000","last_fullsized":"2024-09-05T01:24:41.599701+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:01:55.536313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.601558+0000","last_change":"2024-09-05T01:22:35.048262+0000","last_active":"2024-09-05T01:24:41.601558+0000","last_peered":"2024-09-05T01:24:41.601558+0000","last_clean":"2024-09-05T01:24:41.601558+0000","last_became_active":"2024-09-05T01:22:35.046404+0000","last_became_peered":"2024-09-05T01:22:35.046404+0000","last_unstale":"2024-09-05T01:24:41.601558+0000","last_undegraded":"2024-09-05T01:24:41.601558+0000","last_fullsized":"2024-09-05T01:24:41.601558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:29:04.310095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.602241+0000","last_change":"2024-09-05T01:22:32.612116+0000","last_active":"2024-09-05T01:24:41.602241+0000","last_peered":"2024-09-05T01:24:41.602241+0000","last_clean":"2024-09-05T01:24:41.602241+0000","last_became_active":"2024-09-05T01:22:32.611794+0000","last_became_peered":"2024-09-05T01:22:32.611794+0000","last_unstale":"2024-09-05T01:24:41.602241+0000","last_undegraded":"2024-09-05T01:24:41.602241+0000","last_fullsized":"2024-09-05T01:24:41.602241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:59:55.360151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.703802+0000","last_change":"2024-09-05T01:23:23.250108+0000","last_active":"2024-09-05T01:24:41.703802+0000","last_peered":"2024-09-05T01:24:41.703802+0000","last_clean":"2024-09-05T01:24:41.703802+0000","last_became_active":"2024-09-05T01:23:23.249698+0000","last_became_peered":"2024-09-05T01:23:23.249698+0000","last_unstale":"2024-09-05T01:24:41.703802+0000","last_undegraded":"2024-09-05T01:24:41.703802+0000","last_fullsized":"2024-09-05T01:24:41.703802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:55:45.998595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,10],"acting":[9,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'6","reported_seq":266,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:42.029823+0000","last_change":"2024-09-05T01:22:32.611558+0000","last_active":"2024-09-05T01:24:42.029823+0000","last_peered":"2024-09-05T01:24:42.029823+0000","last_clean":"2024-09-05T01:24:42.029823+0000","last_became_active":"2024-09-05T01:22:32.611194+0000","last_became_peered":"2024-09-05T01:22:32.611194+0000","last_unstale":"2024-09-05T01:24:42.029823+0000","last_undegraded":"2024-09-05T01:24:42.029823+0000","last_fullsized":"2024-09-05T01:24:42.029823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:47:30.586224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839373+0000","last_change":"2024-09-05T01:22:35.042010+0000","last_active":"2024-09-05T01:24:41.839373+0000","last_peered":"2024-09-05T01:24:41.839373+0000","last_clean":"2024-09-05T01:24:41.839373+0000","last_became_active":"2024-09-05T01:22:35.041451+0000","last_became_peered":"2024-09-05T01:22:35.041451+0000","last_unstale":"2024-09-05T01:24:41.839373+0000","last_undegraded":"2024-09-05T01:24:41.839373+0000","last_fullsized":"2024-09-05T01:24:41.839373+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:12:15.429065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838986+0000","last_change":"2024-09-05T01:22:32.612131+0000","last_active":"2024-09-05T01:24:41.838986+0000","last_peered":"2024-09-05T01:24:41.838986+0000","last_clean":"2024-09-05T01:24:41.838986+0000","last_became_active":"2024-09-05T01:22:32.611778+0000","last_became_peered":"2024-09-05T01:22:32.611778+0000","last_unstale":"2024-09-05T01:24:41.838986+0000","last_undegraded":"2024-09-05T01:24:41.838986+0000","last_fullsized":"2024-09-05T01:24:41.838986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:18:21.930485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.840984+0000","last_change":"2024-09-05T01:22:35.047663+0000","last_active":"2024-09-05T01:24:41.840984+0000","last_peered":"2024-09-05T01:24:41.840984+0000","last_clean":"2024-09-05T01:24:41.840984+0000","last_became_active":"2024-09-05T01:22:35.047078+0000","last_became_peered":"2024-09-05T01:22:35.047078+0000","last_unstale":"2024-09-05T01:24:41.840984+0000","last_undegraded":"2024-09-05T01:24:41.840984+0000","last_fullsized":"2024-09-05T01:24:41.840984+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:44.992459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.602055+0000","last_change":"2024-09-05T01:22:33.064617+0000","last_active":"2024-09-05T01:24:41.602055+0000","last_peered":"2024-09-05T01:24:41.602055+0000","last_clean":"2024-09-05T01:24:41.602055+0000","last_became_active":"2024-09-05T01:22:33.064265+0000","last_became_peered":"2024-09-05T01:22:33.064265+0000","last_unstale":"2024-09-05T01:24:41.602055+0000","last_undegraded":"2024-09-05T01:24:41.602055+0000","last_fullsized":"2024-09-05T01:24:41.602055+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:43:57.315764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838950+0000","last_change":"2024-09-05T01:22:35.047109+0000","last_active":"2024-09-05T01:24:41.838950+0000","last_peered":"2024-09-05T01:24:41.838950+0000","last_clean":"2024-09-05T01:24:41.838950+0000","last_became_active":"2024-09-05T01:22:35.046806+0000","last_became_peered":"2024-09-05T01:22:35.046806+0000","last_unstale":"2024-09-05T01:24:41.838950+0000","last_undegraded":"2024-09-05T01:24:41.838950+0000","last_fullsized":"2024-09-05T01:24:41.838950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:19:42.743038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'36","reported_seq":307,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:42.031130+0000","last_change":"2024-09-05T01:22:32.610883+0000","last_active":"2024-09-05T01:24:42.031130+0000","last_peered":"2024-09-05T01:24:42.031130+0000","last_clean":"2024-09-05T01:24:42.031130+0000","last_became_active":"2024-09-05T01:22:32.610530+0000","last_became_peered":"2024-09-05T01:22:32.610530+0000","last_unstale":"2024-09-05T01:24:42.031130+0000","last_undegraded":"2024-09-05T01:24:42.031130+0000","last_fullsized":"2024-09-05T01:24:42.031130+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:51:01.111529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66859,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":243,"num_read_kb":186,"num_write":38,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949361+0000","last_change":"2024-09-05T01:22:35.032397+0000","last_active":"2024-09-05T01:24:41.949361+0000","last_peered":"2024-09-05T01:24:41.949361+0000","last_clean":"2024-09-05T01:24:41.949361+0000","last_became_active":"2024-09-05T01:22:35.032073+0000","last_became_peered":"2024-09-05T01:22:35.032073+0000","last_unstale":"2024-09-05T01:24:41.949361+0000","last_undegraded":"2024-09-05T01:24:41.949361+0000","last_fullsized":"2024-09-05T01:24:41.949361+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:36:02.866390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838150+0000","last_change":"2024-09-05T01:22:32.610247+0000","last_active":"2024-09-05T01:24:41.838150+0000","last_peered":"2024-09-05T01:24:41.838150+0000","last_clean":"2024-09-05T01:24:41.838150+0000","last_became_active":"2024-09-05T01:22:32.609881+0000","last_became_peered":"2024-09-05T01:22:32.609881+0000","last_unstale":"2024-09-05T01:24:41.838150+0000","last_undegraded":"2024-09-05T01:24:41.838150+0000","last_fullsized":"2024-09-05T01:24:41.838150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:40:39.835208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.599790+0000","last_change":"2024-09-05T01:22:35.041923+0000","last_active":"2024-09-05T01:24:41.599790+0000","last_peered":"2024-09-05T01:24:41.599790+0000","last_clean":"2024-09-05T01:24:41.599790+0000","last_became_active":"2024-09-05T01:22:35.041439+0000","last_became_peered":"2024-09-05T01:22:35.041439+0000","last_unstale":"2024-09-05T01:24:41.599790+0000","last_undegraded":"2024-09-05T01:24:41.599790+0000","last_fullsized":"2024-09-05T01:24:41.599790+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:36:56.545466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.601741+0000","last_change":"2024-09-05T01:22:32.611274+0000","last_active":"2024-09-05T01:24:41.601741+0000","last_peered":"2024-09-05T01:24:41.601741+0000","last_clean":"2024-09-05T01:24:41.601741+0000","last_became_active":"2024-09-05T01:22:32.610853+0000","last_became_peered":"2024-09-05T01:22:32.610853+0000","last_unstale":"2024-09-05T01:24:41.601741+0000","last_undegraded":"2024-09-05T01:24:41.601741+0000","last_fullsized":"2024-09-05T01:24:41.601741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:01:38.058836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838564+0000","last_change":"2024-09-05T01:22:35.040116+0000","last_active":"2024-09-05T01:24:41.838564+0000","last_peered":"2024-09-05T01:24:41.838564+0000","last_clean":"2024-09-05T01:24:41.838564+0000","last_became_active":"2024-09-05T01:22:35.037663+0000","last_became_peered":"2024-09-05T01:22:35.037663+0000","last_unstale":"2024-09-05T01:24:41.838564+0000","last_undegraded":"2024-09-05T01:24:41.838564+0000","last_fullsized":"2024-09-05T01:24:41.838564+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:16:37.309205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'10","reported_seq":160,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:42.030656+0000","last_change":"2024-09-05T01:22:32.612334+0000","last_active":"2024-09-05T01:24:42.030656+0000","last_peered":"2024-09-05T01:24:42.030656+0000","last_clean":"2024-09-05T01:24:42.030656+0000","last_became_active":"2024-09-05T01:22:32.612008+0000","last_became_peered":"2024-09-05T01:22:32.612008+0000","last_unstale":"2024-09-05T01:24:42.030656+0000","last_undegraded":"2024-09-05T01:24:42.030656+0000","last_fullsized":"2024-09-05T01:24:42.030656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:31:05.580219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2219,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":7,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838348+0000","last_change":"2024-09-05T01:22:35.037034+0000","last_active":"2024-09-05T01:24:41.838348+0000","last_peered":"2024-09-05T01:24:41.838348+0000","last_clean":"2024-09-05T01:24:41.838348+0000","last_became_active":"2024-09-05T01:22:35.036643+0000","last_became_peered":"2024-09-05T01:22:35.036643+0000","last_unstale":"2024-09-05T01:24:41.838348+0000","last_undegraded":"2024-09-05T01:24:41.838348+0000","last_fullsized":"2024-09-05T01:24:41.838348+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:41:24.073298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.706202+0000","last_change":"2024-09-05T01:24:23.306662+0000","last_active":"2024-09-05T01:24:41.706202+0000","last_peered":"2024-09-05T01:24:41.706202+0000","last_clean":"2024-09-05T01:24:41.706202+0000","last_became_active":"2024-09-05T01:24:23.295595+0000","last_became_peered":"2024-09-05T01:24:23.295595+0000","last_unstale":"2024-09-05T01:24:41.706202+0000","last_undegraded":"2024-09-05T01:24:41.706202+0000","last_fullsized":"2024-09-05T01:24:41.706202+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:55:06.973543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.601748+0000","last_change":"2024-09-05T01:22:35.039866+0000","last_active":"2024-09-05T01:24:41.601748+0000","last_peered":"2024-09-05T01:24:41.601748+0000","last_clean":"2024-09-05T01:24:41.601748+0000","last_became_active":"2024-09-05T01:22:35.039493+0000","last_became_peered":"2024-09-05T01:22:35.039493+0000","last_unstale":"2024-09-05T01:24:41.601748+0000","last_undegraded":"2024-09-05T01:24:41.601748+0000","last_fullsized":"2024-09-05T01:24:41.601748+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:39:20.036455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'4","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949403+0000","last_change":"2024-09-05T01:22:32.610948+0000","last_active":"2024-09-05T01:24:41.949403+0000","last_peered":"2024-09-05T01:24:41.949403+0000","last_clean":"2024-09-05T01:24:41.949403+0000","last_became_active":"2024-09-05T01:22:32.610596+0000","last_became_peered":"2024-09-05T01:22:32.610596+0000","last_unstale":"2024-09-05T01:24:41.949403+0000","last_undegraded":"2024-09-05T01:24:41.949403+0000","last_fullsized":"2024-09-05T01:24:41.949403+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:36:25.589705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.706548+0000","last_change":"2024-09-05T01:23:23.196770+0000","last_active":"2024-09-05T01:24:41.706548+0000","last_peered":"2024-09-05T01:24:41.706548+0000","last_clean":"2024-09-05T01:24:41.706548+0000","last_became_active":"2024-09-05T01:23:23.196495+0000","last_became_peered":"2024-09-05T01:23:23.196495+0000","last_unstale":"2024-09-05T01:24:41.706548+0000","last_undegraded":"2024-09-05T01:24:41.706548+0000","last_fullsized":"2024-09-05T01:24:41.706548+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:11:35.195038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7],"acting":[11,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.600237+0000","last_change":"2024-09-05T01:22:32.609555+0000","last_active":"2024-09-05T01:24:41.600237+0000","last_peered":"2024-09-05T01:24:41.600237+0000","last_clean":"2024-09-05T01:24:41.600237+0000","last_became_active":"2024-09-05T01:22:32.608448+0000","last_became_peered":"2024-09-05T01:22:32.608448+0000","last_unstale":"2024-09-05T01:24:41.600237+0000","last_undegraded":"2024-09-05T01:24:41.600237+0000","last_fullsized":"2024-09-05T01:24:41.600237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:13:27.724664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839189+0000","last_change":"2024-09-05T01:22:35.033418+0000","last_active":"2024-09-05T01:24:41.839189+0000","last_peered":"2024-09-05T01:24:41.839189+0000","last_clean":"2024-09-05T01:24:41.839189+0000","last_became_active":"2024-09-05T01:22:35.033096+0000","last_became_peered":"2024-09-05T01:22:35.033096+0000","last_unstale":"2024-09-05T01:24:41.839189+0000","last_undegraded":"2024-09-05T01:24:41.839189+0000","last_fullsized":"2024-09-05T01:24:41.839189+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:09:06.723427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'41","reported_seq":77,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.883481+0000","last_change":"2024-09-05T01:22:32.609821+0000","last_active":"2024-09-05T01:24:41.883481+0000","last_peered":"2024-09-05T01:24:41.883481+0000","last_clean":"2024-09-05T01:24:41.883481+0000","last_became_active":"2024-09-05T01:22:32.608932+0000","last_became_peered":"2024-09-05T01:22:32.608932+0000","last_unstale":"2024-09-05T01:24:41.883481+0000","last_undegraded":"2024-09-05T01:24:41.883481+0000","last_fullsized":"2024-09-05T01:24:41.883481+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:45:19.964263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838880+0000","last_change":"2024-09-05T01:22:35.037965+0000","last_active":"2024-09-05T01:24:41.838880+0000","last_peered":"2024-09-05T01:24:41.838880+0000","last_clean":"2024-09-05T01:24:41.838880+0000","last_became_active":"2024-09-05T01:22:35.037541+0000","last_became_peered":"2024-09-05T01:22:35.037541+0000","last_unstale":"2024-09-05T01:24:41.838880+0000","last_undegraded":"2024-09-05T01:24:41.838880+0000","last_fullsized":"2024-09-05T01:24:41.838880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:43:29.098517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'7","reported_seq":108,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:42.287528+0000","last_change":"2024-09-05T01:23:23.200721+0000","last_active":"2024-09-05T01:24:42.287528+0000","last_peered":"2024-09-05T01:24:42.287528+0000","last_clean":"2024-09-05T01:24:42.287528+0000","last_became_active":"2024-09-05T01:23:23.193780+0000","last_became_peered":"2024-09-05T01:23:23.193780+0000","last_unstale":"2024-09-05T01:24:42.287528+0000","last_undegraded":"2024-09-05T01:24:42.287528+0000","last_fullsized":"2024-09-05T01:24:42.287528+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:47:56.617158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1956,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1170,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839223+0000","last_change":"2024-09-05T01:22:35.035868+0000","last_active":"2024-09-05T01:24:41.839223+0000","last_peered":"2024-09-05T01:24:41.839223+0000","last_clean":"2024-09-05T01:24:41.839223+0000","last_became_active":"2024-09-05T01:22:35.035495+0000","last_became_peered":"2024-09-05T01:22:35.035495+0000","last_unstale":"2024-09-05T01:24:41.839223+0000","last_undegraded":"2024-09-05T01:24:41.839223+0000","last_fullsized":"2024-09-05T01:24:41.839223+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:13:25.679973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":351,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838523+0000","last_change":"2024-09-05T01:21:17.107509+0000","last_active":"2024-09-05T01:24:41.838523+0000","last_peered":"2024-09-05T01:24:41.838523+0000","last_clean":"2024-09-05T01:24:41.838523+0000","last_became_active":"2024-09-05T01:21:17.107063+0000","last_became_peered":"2024-09-05T01:21:17.107063+0000","last_unstale":"2024-09-05T01:24:41.838523+0000","last_undegraded":"2024-09-05T01:24:41.838523+0000","last_fullsized":"2024-09-05T01:24:41.838523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:17:44.744654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:17:44.744654+0000","last_clean_scrub_stamp":"2024-09-05T01:17:44.744654+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:14:18.603051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.840082+0000","last_change":"2024-09-05T01:22:32.610686+0000","last_active":"2024-09-05T01:24:41.840082+0000","last_peered":"2024-09-05T01:24:41.840082+0000","last_clean":"2024-09-05T01:24:41.840082+0000","last_became_active":"2024-09-05T01:22:32.610248+0000","last_became_peered":"2024-09-05T01:22:32.610248+0000","last_unstale":"2024-09-05T01:24:41.840082+0000","last_undegraded":"2024-09-05T01:24:41.840082+0000","last_fullsized":"2024-09-05T01:24:41.840082+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:14:09.468772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.602009+0000","last_change":"2024-09-05T01:22:35.044346+0000","last_active":"2024-09-05T01:24:41.602009+0000","last_peered":"2024-09-05T01:24:41.602009+0000","last_clean":"2024-09-05T01:24:41.602009+0000","last_became_active":"2024-09-05T01:22:35.043977+0000","last_became_peered":"2024-09-05T01:22:35.043977+0000","last_unstale":"2024-09-05T01:24:41.602009+0000","last_undegraded":"2024-09-05T01:24:41.602009+0000","last_fullsized":"2024-09-05T01:24:41.602009+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:03:33.007905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838533+0000","last_change":"2024-09-05T01:22:32.615120+0000","last_active":"2024-09-05T01:24:41.838533+0000","last_peered":"2024-09-05T01:24:41.838533+0000","last_clean":"2024-09-05T01:24:41.838533+0000","last_became_active":"2024-09-05T01:22:32.614671+0000","last_became_peered":"2024-09-05T01:22:32.614671+0000","last_unstale":"2024-09-05T01:24:41.838533+0000","last_undegraded":"2024-09-05T01:24:41.838533+0000","last_fullsized":"2024-09-05T01:24:41.838533+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:00:00.134610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.599752+0000","last_change":"2024-09-05T01:22:35.035840+0000","last_active":"2024-09-05T01:24:41.599752+0000","last_peered":"2024-09-05T01:24:41.599752+0000","last_clean":"2024-09-05T01:24:41.599752+0000","last_became_active":"2024-09-05T01:22:35.035511+0000","last_became_peered":"2024-09-05T01:22:35.035511+0000","last_unstale":"2024-09-05T01:24:41.599752+0000","last_undegraded":"2024-09-05T01:24:41.599752+0000","last_fullsized":"2024-09-05T01:24:41.599752+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:30:01.929816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"85'7","reported_seq":153,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:42.030142+0000","last_change":"2024-09-05T01:22:33.064281+0000","last_active":"2024-09-05T01:24:42.030142+0000","last_peered":"2024-09-05T01:24:42.030142+0000","last_clean":"2024-09-05T01:24:42.030142+0000","last_became_active":"2024-09-05T01:22:33.063792+0000","last_became_peered":"2024-09-05T01:22:33.063792+0000","last_unstale":"2024-09-05T01:24:42.030142+0000","last_undegraded":"2024-09-05T01:24:42.030142+0000","last_fullsized":"2024-09-05T01:24:42.030142+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:44:19.558140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.602034+0000","last_change":"2024-09-05T01:22:35.035336+0000","last_active":"2024-09-05T01:24:41.602034+0000","last_peered":"2024-09-05T01:24:41.602034+0000","last_clean":"2024-09-05T01:24:41.602034+0000","last_became_active":"2024-09-05T01:22:35.034976+0000","last_became_peered":"2024-09-05T01:22:35.034976+0000","last_unstale":"2024-09-05T01:24:41.602034+0000","last_undegraded":"2024-09-05T01:24:41.602034+0000","last_fullsized":"2024-09-05T01:24:41.602034+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:51:57.850225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"86'8","reported_seq":156,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:42.031156+0000","last_change":"2024-09-05T01:22:32.614203+0000","last_active":"2024-09-05T01:24:42.031156+0000","last_peered":"2024-09-05T01:24:42.031156+0000","last_clean":"2024-09-05T01:24:42.031156+0000","last_became_active":"2024-09-05T01:22:32.613774+0000","last_became_peered":"2024-09-05T01:22:32.613774+0000","last_unstale":"2024-09-05T01:24:42.031156+0000","last_undegraded":"2024-09-05T01:24:42.031156+0000","last_fullsized":"2024-09-05T01:24:42.031156+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:52:05.383835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.715359+0000","last_change":"2024-09-05T01:22:35.042770+0000","last_active":"2024-09-05T01:24:41.715359+0000","last_peered":"2024-09-05T01:24:41.715359+0000","last_clean":"2024-09-05T01:24:41.715359+0000","last_became_active":"2024-09-05T01:22:35.042338+0000","last_became_peered":"2024-09-05T01:22:35.042338+0000","last_unstale":"2024-09-05T01:24:41.715359+0000","last_undegraded":"2024-09-05T01:24:41.715359+0000","last_fullsized":"2024-09-05T01:24:41.715359+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:02:35.669717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"81'1","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.704254+0000","last_change":"2024-09-05T01:22:33.065134+0000","last_active":"2024-09-05T01:24:41.704254+0000","last_peered":"2024-09-05T01:24:41.704254+0000","last_clean":"2024-09-05T01:24:41.704254+0000","last_became_active":"2024-09-05T01:22:33.064685+0000","last_became_peered":"2024-09-05T01:22:33.064685+0000","last_unstale":"2024-09-05T01:24:41.704254+0000","last_undegraded":"2024-09-05T01:24:41.704254+0000","last_fullsized":"2024-09-05T01:24:41.704254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:03:00.976350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.715537+0000","last_change":"2024-09-05T01:22:35.035940+0000","last_active":"2024-09-05T01:24:41.715537+0000","last_peered":"2024-09-05T01:24:41.715537+0000","last_clean":"2024-09-05T01:24:41.715537+0000","last_became_active":"2024-09-05T01:22:35.035582+0000","last_became_peered":"2024-09-05T01:22:35.035582+0000","last_unstale":"2024-09-05T01:24:41.715537+0000","last_undegraded":"2024-09-05T01:24:41.715537+0000","last_fullsized":"2024-09-05T01:24:41.715537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:37:06.621512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949535+0000","last_change":"2024-09-05T01:22:33.064003+0000","last_active":"2024-09-05T01:24:41.949535+0000","last_peered":"2024-09-05T01:24:41.949535+0000","last_clean":"2024-09-05T01:24:41.949535+0000","last_became_active":"2024-09-05T01:22:33.063685+0000","last_became_peered":"2024-09-05T01:22:33.063685+0000","last_unstale":"2024-09-05T01:24:41.949535+0000","last_undegraded":"2024-09-05T01:24:41.949535+0000","last_fullsized":"2024-09-05T01:24:41.949535+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:49:03.742215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.600055+0000","last_change":"2024-09-05T01:22:35.034912+0000","last_active":"2024-09-05T01:24:41.600055+0000","last_peered":"2024-09-05T01:24:41.600055+0000","last_clean":"2024-09-05T01:24:41.600055+0000","last_became_active":"2024-09-05T01:22:35.034526+0000","last_became_peered":"2024-09-05T01:22:35.034526+0000","last_unstale":"2024-09-05T01:24:41.600055+0000","last_undegraded":"2024-09-05T01:24:41.600055+0000","last_fullsized":"2024-09-05T01:24:41.600055+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:06:00.000162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'50","reported_seq":118,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.891730+0000","last_change":"2024-09-05T01:23:23.206601+0000","last_active":"2024-09-05T01:24:41.891730+0000","last_peered":"2024-09-05T01:24:41.891730+0000","last_clean":"2024-09-05T01:24:41.891730+0000","last_became_active":"2024-09-05T01:23:23.195519+0000","last_became_peered":"2024-09-05T01:23:23.195519+0000","last_unstale":"2024-09-05T01:24:41.891730+0000","last_undegraded":"2024-09-05T01:24:41.891730+0000","last_fullsized":"2024-09-05T01:24:41.891730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:16:51.359980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":89,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.603443+0000","last_change":"2024-09-05T01:22:35.038184+0000","last_active":"2024-09-05T01:24:41.603443+0000","last_peered":"2024-09-05T01:24:41.603443+0000","last_clean":"2024-09-05T01:24:41.603443+0000","last_became_active":"2024-09-05T01:22:35.036702+0000","last_became_peered":"2024-09-05T01:22:35.036702+0000","last_unstale":"2024-09-05T01:24:41.603443+0000","last_undegraded":"2024-09-05T01:24:41.603443+0000","last_fullsized":"2024-09-05T01:24:41.603443+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:43:53.813358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.840115+0000","last_change":"2024-09-05T01:22:32.663209+0000","last_active":"2024-09-05T01:24:41.840115+0000","last_peered":"2024-09-05T01:24:41.840115+0000","last_clean":"2024-09-05T01:24:41.840115+0000","last_became_active":"2024-09-05T01:22:32.662928+0000","last_became_peered":"2024-09-05T01:22:32.662928+0000","last_unstale":"2024-09-05T01:24:41.840115+0000","last_undegraded":"2024-09-05T01:24:41.840115+0000","last_fullsized":"2024-09-05T01:24:41.840115+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:10:57.677344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839692+0000","last_change":"2024-09-05T01:23:23.250471+0000","last_active":"2024-09-05T01:24:41.839692+0000","last_peered":"2024-09-05T01:24:41.839692+0000","last_clean":"2024-09-05T01:24:41.839692+0000","last_became_active":"2024-09-05T01:23:23.250020+0000","last_became_peered":"2024-09-05T01:23:23.250020+0000","last_unstale":"2024-09-05T01:24:41.839692+0000","last_undegraded":"2024-09-05T01:24:41.839692+0000","last_fullsized":"2024-09-05T01:24:41.839692+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:22:52.762922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838809+0000","last_change":"2024-09-05T01:22:33.064832+0000","last_active":"2024-09-05T01:24:41.838809+0000","last_peered":"2024-09-05T01:24:41.838809+0000","last_clean":"2024-09-05T01:24:41.838809+0000","last_became_active":"2024-09-05T01:22:33.064405+0000","last_became_peered":"2024-09-05T01:22:33.064405+0000","last_unstale":"2024-09-05T01:24:41.838809+0000","last_undegraded":"2024-09-05T01:24:41.838809+0000","last_fullsized":"2024-09-05T01:24:41.838809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:48:43.093325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949069+0000","last_change":"2024-09-05T01:22:35.030670+0000","last_active":"2024-09-05T01:24:41.949069+0000","last_peered":"2024-09-05T01:24:41.949069+0000","last_clean":"2024-09-05T01:24:41.949069+0000","last_became_active":"2024-09-05T01:22:35.030338+0000","last_became_peered":"2024-09-05T01:22:35.030338+0000","last_unstale":"2024-09-05T01:24:41.949069+0000","last_undegraded":"2024-09-05T01:24:41.949069+0000","last_fullsized":"2024-09-05T01:24:41.949069+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:22:51.832965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.601908+0000","last_change":"2024-09-05T01:22:32.612040+0000","last_active":"2024-09-05T01:24:41.601908+0000","last_peered":"2024-09-05T01:24:41.601908+0000","last_clean":"2024-09-05T01:24:41.601908+0000","last_became_active":"2024-09-05T01:22:32.610597+0000","last_became_peered":"2024-09-05T01:22:32.610597+0000","last_unstale":"2024-09-05T01:24:41.601908+0000","last_undegraded":"2024-09-05T01:24:41.601908+0000","last_fullsized":"2024-09-05T01:24:41.601908+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:06:31.624775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.706417+0000","last_change":"2024-09-05T01:22:35.036220+0000","last_active":"2024-09-05T01:24:41.706417+0000","last_peered":"2024-09-05T01:24:41.706417+0000","last_clean":"2024-09-05T01:24:41.706417+0000","last_became_active":"2024-09-05T01:22:35.035881+0000","last_became_peered":"2024-09-05T01:22:35.035881+0000","last_unstale":"2024-09-05T01:24:41.706417+0000","last_undegraded":"2024-09-05T01:24:41.706417+0000","last_fullsized":"2024-09-05T01:24:41.706417+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:12:03.104075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'4","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838126+0000","last_change":"2024-09-05T01:22:32.608922+0000","last_active":"2024-09-05T01:24:41.838126+0000","last_peered":"2024-09-05T01:24:41.838126+0000","last_clean":"2024-09-05T01:24:41.838126+0000","last_became_active":"2024-09-05T01:22:32.608453+0000","last_became_peered":"2024-09-05T01:22:32.608453+0000","last_unstale":"2024-09-05T01:24:41.838126+0000","last_undegraded":"2024-09-05T01:24:41.838126+0000","last_fullsized":"2024-09-05T01:24:41.838126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:03:41.947264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.602224+0000","last_change":"2024-09-05T01:22:35.047556+0000","last_active":"2024-09-05T01:24:41.602224+0000","last_peered":"2024-09-05T01:24:41.602224+0000","last_clean":"2024-09-05T01:24:41.602224+0000","last_became_active":"2024-09-05T01:22:35.046260+0000","last_became_peered":"2024-09-05T01:22:35.046260+0000","last_unstale":"2024-09-05T01:24:41.602224+0000","last_undegraded":"2024-09-05T01:24:41.602224+0000","last_fullsized":"2024-09-05T01:24:41.602224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:13:09.379906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949107+0000","last_change":"2024-09-05T01:22:32.612948+0000","last_active":"2024-09-05T01:24:41.949107+0000","last_peered":"2024-09-05T01:24:41.949107+0000","last_clean":"2024-09-05T01:24:41.949107+0000","last_became_active":"2024-09-05T01:22:32.612319+0000","last_became_peered":"2024-09-05T01:22:32.612319+0000","last_unstale":"2024-09-05T01:24:41.949107+0000","last_undegraded":"2024-09-05T01:24:41.949107+0000","last_fullsized":"2024-09-05T01:24:41.949107+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:17:56.068106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838550+0000","last_change":"2024-09-05T01:22:35.036218+0000","last_active":"2024-09-05T01:24:41.838550+0000","last_peered":"2024-09-05T01:24:41.838550+0000","last_clean":"2024-09-05T01:24:41.838550+0000","last_became_active":"2024-09-05T01:22:35.035180+0000","last_became_peered":"2024-09-05T01:22:35.035180+0000","last_unstale":"2024-09-05T01:24:41.838550+0000","last_undegraded":"2024-09-05T01:24:41.838550+0000","last_fullsized":"2024-09-05T01:24:41.838550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:37:13.936829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.601818+0000","last_change":"2024-09-05T01:22:35.039616+0000","last_active":"2024-09-05T01:24:41.601818+0000","last_peered":"2024-09-05T01:24:41.601818+0000","last_clean":"2024-09-05T01:24:41.601818+0000","last_became_active":"2024-09-05T01:22:35.039297+0000","last_became_peered":"2024-09-05T01:22:35.039297+0000","last_unstale":"2024-09-05T01:24:41.601818+0000","last_undegraded":"2024-09-05T01:24:41.601818+0000","last_fullsized":"2024-09-05T01:24:41.601818+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:24:44.703168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949305+0000","last_change":"2024-09-05T01:22:32.609792+0000","last_active":"2024-09-05T01:24:41.949305+0000","last_peered":"2024-09-05T01:24:41.949305+0000","last_clean":"2024-09-05T01:24:41.949305+0000","last_became_active":"2024-09-05T01:22:32.609361+0000","last_became_peered":"2024-09-05T01:22:32.609361+0000","last_unstale":"2024-09-05T01:24:41.949305+0000","last_undegraded":"2024-09-05T01:24:41.949305+0000","last_fullsized":"2024-09-05T01:24:41.949305+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:05:15.105759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838871+0000","last_change":"2024-09-05T01:22:35.038792+0000","last_active":"2024-09-05T01:24:41.838871+0000","last_peered":"2024-09-05T01:24:41.838871+0000","last_clean":"2024-09-05T01:24:41.838871+0000","last_became_active":"2024-09-05T01:22:35.038129+0000","last_became_peered":"2024-09-05T01:22:35.038129+0000","last_unstale":"2024-09-05T01:24:41.838871+0000","last_undegraded":"2024-09-05T01:24:41.838871+0000","last_fullsized":"2024-09-05T01:24:41.838871+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:39:31.020488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'12","reported_seq":63,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949410+0000","last_change":"2024-09-05T01:23:23.208083+0000","last_active":"2024-09-05T01:24:41.949410+0000","last_peered":"2024-09-05T01:24:41.949410+0000","last_clean":"2024-09-05T01:24:41.949410+0000","last_became_active":"2024-09-05T01:23:23.194847+0000","last_became_peered":"2024-09-05T01:23:23.194847+0000","last_unstale":"2024-09-05T01:24:41.949410+0000","last_undegraded":"2024-09-05T01:24:41.949410+0000","last_fullsized":"2024-09-05T01:24:41.949410+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:09:16.923894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.840974+0000","last_change":"2024-09-05T01:22:35.045174+0000","last_active":"2024-09-05T01:24:41.840974+0000","last_peered":"2024-09-05T01:24:41.840974+0000","last_clean":"2024-09-05T01:24:41.840974+0000","last_became_active":"2024-09-05T01:22:35.041750+0000","last_became_peered":"2024-09-05T01:22:35.041750+0000","last_unstale":"2024-09-05T01:24:41.840974+0000","last_undegraded":"2024-09-05T01:24:41.840974+0000","last_fullsized":"2024-09-05T01:24:41.840974+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:34:00.174324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.603169+0000","last_change":"2024-09-05T01:22:33.065150+0000","last_active":"2024-09-05T01:24:41.603169+0000","last_peered":"2024-09-05T01:24:41.603169+0000","last_clean":"2024-09-05T01:24:41.603169+0000","last_became_active":"2024-09-05T01:22:33.064456+0000","last_became_peered":"2024-09-05T01:22:33.064456+0000","last_unstale":"2024-09-05T01:24:41.603169+0000","last_undegraded":"2024-09-05T01:24:41.603169+0000","last_fullsized":"2024-09-05T01:24:41.603169+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:16:20.879893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.602947+0000","last_change":"2024-09-05T01:22:35.043158+0000","last_active":"2024-09-05T01:24:41.602947+0000","last_peered":"2024-09-05T01:24:41.602947+0000","last_clean":"2024-09-05T01:24:41.602947+0000","last_became_active":"2024-09-05T01:22:35.038666+0000","last_became_peered":"2024-09-05T01:22:35.038666+0000","last_unstale":"2024-09-05T01:24:41.602947+0000","last_undegraded":"2024-09-05T01:24:41.602947+0000","last_fullsized":"2024-09-05T01:24:41.602947+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:44:18.551980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"86'15","reported_seq":160,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:42.029930+0000","last_change":"2024-09-05T01:22:32.613713+0000","last_active":"2024-09-05T01:24:42.029930+0000","last_peered":"2024-09-05T01:24:42.029930+0000","last_clean":"2024-09-05T01:24:42.029930+0000","last_became_active":"2024-09-05T01:22:32.613284+0000","last_became_peered":"2024-09-05T01:22:32.613284+0000","last_unstale":"2024-09-05T01:24:42.029930+0000","last_undegraded":"2024-09-05T01:24:42.029930+0000","last_fullsized":"2024-09-05T01:24:42.029930+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:39:46.881635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":601975,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1262,"num_read_kb":765,"num_write":382,"num_write_kb":1471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":1282,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2174976,"data_stored":1805925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307,"ondisk_log_size":307,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547239,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28360,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716792,"statfs":{"total":95995035648,"available":95965995008,"internally_reserved":0,"allocated":1363968,"data_stored":858133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776172,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32948,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712204,"statfs":{"total":95995035648,"available":95961296896,"internally_reserved":0,"allocated":1806336,"data_stored":1255138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939697,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36696,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708456,"statfs":{"total":95995035648,"available":95957458944,"internally_reserved":0,"allocated":1380352,"data_stored":857165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168631,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":974848,"data_stored":464215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397564,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1581056,"data_stored":1058367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561089,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":970752,"data_stored":464200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790022,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28712,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716440,"statfs":{"total":95995035648,"available":95965634560,"internally_reserved":0,"allocated":1728512,"data_stored":1188266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953548,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":978944,"data_stored":467114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182480,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":988307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":516929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1040384,"data_stored":532365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":991232,"data_stored":465005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":134954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":201826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":395306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T01:24:46.393 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T01:24:46.481 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:46 smithi012 ceph-mon[29942]: [05/Sep/2024:01:24:44] ENGINE Bus STARTING 2024-09-05T01:24:46.481 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:46 smithi012 ceph-mon[29942]: [05/Sep/2024:01:24:44] ENGINE Serving on https://172.21.15.12:7150 2024-09-05T01:24:46.481 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:46 smithi012 ceph-mon[29942]: [05/Sep/2024:01:24:44] ENGINE Error in HTTPServer.serve 2024-09-05T01:24:46.481 INFO:journalctl@ceph.mon.a.smithi012.stdout: Traceback (most recent call last): 2024-09-05T01:24:46.481 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-05T01:24:46.481 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._connections.run(self.expiration_interval) 2024-09-05T01:24:46.481 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-05T01:24:46.481 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._run(expiration_interval) 2024-09-05T01:24:46.481 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-05T01:24:46.481 INFO:journalctl@ceph.mon.a.smithi012.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-05T01:24:46.482 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-05T01:24:46.482 INFO:journalctl@ceph.mon.a.smithi012.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-05T01:24:46.482 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-05T01:24:46.482 INFO:journalctl@ceph.mon.a.smithi012.stdout: s = self.context.wrap_socket( 2024-09-05T01:24:46.482 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-05T01:24:46.482 INFO:journalctl@ceph.mon.a.smithi012.stdout: return self.sslsocket_class._create( 2024-09-05T01:24:46.482 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-05T01:24:46.482 INFO:journalctl@ceph.mon.a.smithi012.stdout: self.do_handshake() 2024-09-05T01:24:46.482 INFO:journalctl@ceph.mon.a.smithi012.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-05T01:24:46.482 INFO:journalctl@ceph.mon.a.smithi012.stdout: self._sslobj.do_handshake() 2024-09-05T01:24:46.482 INFO:journalctl@ceph.mon.a.smithi012.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-05T01:24:46.482 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:46 smithi012 ceph-mon[29942]: [05/Sep/2024:01:24:44] ENGINE Serving on http://172.21.15.12:8765 2024-09-05T01:24:46.482 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:46 smithi012 ceph-mon[29942]: [05/Sep/2024:01:24:44] ENGINE Bus STARTED 2024-09-05T01:24:46.483 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:46 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/466823092' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:24:46.483 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:46 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:46.483 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:46 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:46.483 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:46 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:46.483 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:46 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:46.483 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:46 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:46.483 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:46 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:46.483 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:46 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:46.483 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:46 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:46.483 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:46 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:46.483 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:46 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:46.483 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:46 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:24:46.483 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:46 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:24:46.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:46 smithi145 ceph-mon[34376]: [05/Sep/2024:01:24:44] ENGINE Bus STARTING 2024-09-05T01:24:46.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:46 smithi145 ceph-mon[34376]: [05/Sep/2024:01:24:44] ENGINE Serving on https://172.21.15.12:7150 2024-09-05T01:24:46.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:46 smithi145 ceph-mon[34376]: [05/Sep/2024:01:24:44] ENGINE Error in HTTPServer.serve 2024-09-05T01:24:46.584 INFO:journalctl@ceph.mon.b.smithi145.stdout: Traceback (most recent call last): 2024-09-05T01:24:46.584 INFO:journalctl@ceph.mon.b.smithi145.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-05T01:24:46.584 INFO:journalctl@ceph.mon.b.smithi145.stdout: self._connections.run(self.expiration_interval) 2024-09-05T01:24:46.584 INFO:journalctl@ceph.mon.b.smithi145.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-05T01:24:46.584 INFO:journalctl@ceph.mon.b.smithi145.stdout: self._run(expiration_interval) 2024-09-05T01:24:46.584 INFO:journalctl@ceph.mon.b.smithi145.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-05T01:24:46.584 INFO:journalctl@ceph.mon.b.smithi145.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-05T01:24:46.584 INFO:journalctl@ceph.mon.b.smithi145.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-05T01:24:46.584 INFO:journalctl@ceph.mon.b.smithi145.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-05T01:24:46.585 INFO:journalctl@ceph.mon.b.smithi145.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-05T01:24:46.585 INFO:journalctl@ceph.mon.b.smithi145.stdout: s = self.context.wrap_socket( 2024-09-05T01:24:46.585 INFO:journalctl@ceph.mon.b.smithi145.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-05T01:24:46.585 INFO:journalctl@ceph.mon.b.smithi145.stdout: return self.sslsocket_class._create( 2024-09-05T01:24:46.585 INFO:journalctl@ceph.mon.b.smithi145.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-05T01:24:46.585 INFO:journalctl@ceph.mon.b.smithi145.stdout: self.do_handshake() 2024-09-05T01:24:46.585 INFO:journalctl@ceph.mon.b.smithi145.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-05T01:24:46.585 INFO:journalctl@ceph.mon.b.smithi145.stdout: self._sslobj.do_handshake() 2024-09-05T01:24:46.585 INFO:journalctl@ceph.mon.b.smithi145.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-05T01:24:46.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:46 smithi145 ceph-mon[34376]: [05/Sep/2024:01:24:44] ENGINE Serving on http://172.21.15.12:8765 2024-09-05T01:24:46.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:46 smithi145 ceph-mon[34376]: [05/Sep/2024:01:24:44] ENGINE Bus STARTED 2024-09-05T01:24:46.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:46 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/466823092' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:24:46.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:46 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:46.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:46 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:46.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:46 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:46.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:46 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:46.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:46 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:46.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:46 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:46.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:46 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:46.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:46 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:46.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:46 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:46.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:46 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:46.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:46 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:24:46.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:46 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:24:46.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.593+0000 7f25aa800640 1 -- 172.21.15.12:0/2104739545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25a4104f20 msgr2=0x7f25a41053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:46.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.593+0000 7f25aa800640 1 --2- 172.21.15.12:0/2104739545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25a4104f20 0x7f25a41053a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2590009860 tx=0x7f259002a340 comp rx=0 tx=0).stop 2024-09-05T01:24:46.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.593+0000 7f25aa800640 1 -- 172.21.15.12:0/2104739545 shutdown_connections 2024-09-05T01:24:46.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.593+0000 7f25aa800640 1 --2- 172.21.15.12:0/2104739545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25a41058e0 0x7f25a410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:46.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.593+0000 7f25aa800640 1 --2- 172.21.15.12:0/2104739545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25a4104f20 0x7f25a41053a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:46.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.593+0000 7f25aa800640 1 --2- 172.21.15.12:0/2104739545 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f25a4103d30 0x7f25a4104130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:46.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.593+0000 7f25aa800640 1 -- 172.21.15.12:0/2104739545 >> 172.21.15.12:0/2104739545 conn(0x7f25a40ff4b0 msgr2=0x7f25a41018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:46.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.593+0000 7f25aa800640 1 -- 172.21.15.12:0/2104739545 shutdown_connections 2024-09-05T01:24:46.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.593+0000 7f25aa800640 1 -- 172.21.15.12:0/2104739545 wait complete. 2024-09-05T01:24:46.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.594+0000 7f25aa800640 1 Processor -- start 2024-09-05T01:24:46.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.594+0000 7f25aa800640 1 -- start start 2024-09-05T01:24:46.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.594+0000 7f25aa800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25a4103d30 0x7f25a419a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:46.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.594+0000 7f25aa800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25a4104f20 0x7f25a419a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:46.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.594+0000 7f25aa800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f25a41058e0 0x7f25a41a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:46.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.594+0000 7f25aa800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f25a410f990 con 0x7f25a4104f20 2024-09-05T01:24:46.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.594+0000 7f25aa800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f25a410f810 con 0x7f25a41058e0 2024-09-05T01:24:46.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.594+0000 7f25aa800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f25a410fb10 con 0x7f25a4103d30 2024-09-05T01:24:46.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.595+0000 7f25a3400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25a4103d30 0x7f25a419a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:46.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.595+0000 7f25a3400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25a4103d30 0x7f25a419a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:49906/0 (socket says 172.21.15.12:49906) 2024-09-05T01:24:46.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.595+0000 7f25a3400640 1 -- 172.21.15.12:0/1652567415 learned_addr learned my addr 172.21.15.12:0/1652567415 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:46.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.595+0000 7f25a2a00640 1 --2- 172.21.15.12:0/1652567415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25a4104f20 0x7f25a419a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:46.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.595+0000 7f25a3e00640 1 --2- 172.21.15.12:0/1652567415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f25a41058e0 0x7f25a41a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:46.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.595+0000 7f25a3400640 1 -- 172.21.15.12:0/1652567415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f25a41058e0 msgr2=0x7f25a41a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:46.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.595+0000 7f25a3400640 1 --2- 172.21.15.12:0/1652567415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f25a41058e0 0x7f25a41a15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:46.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.595+0000 7f25a3400640 1 -- 172.21.15.12:0/1652567415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25a4104f20 msgr2=0x7f25a419a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:46.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.595+0000 7f25a3400640 1 --2- 172.21.15.12:0/1652567415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25a4104f20 0x7f25a419a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:46.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.595+0000 7f25a3400640 1 -- 172.21.15.12:0/1652567415 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a41a1c30 con 0x7f25a4103d30 2024-09-05T01:24:46.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.595+0000 7f25a3400640 1 --2- 172.21.15.12:0/1652567415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25a4103d30 0x7f25a419a010 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f259400e9a0 tx=0x7f259400ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:46.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.596+0000 7f259be00640 1 -- 172.21.15.12:0/1652567415 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259400cd80 con 0x7f25a4103d30 2024-09-05T01:24:46.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.596+0000 7f259be00640 1 -- 172.21.15.12:0/1652567415 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2594010910 con 0x7f25a4103d30 2024-09-05T01:24:46.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.596+0000 7f25aa800640 1 -- 172.21.15.12:0/1652567415 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a41a1f20 con 0x7f25a4103d30 2024-09-05T01:24:46.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.596+0000 7f259be00640 1 -- 172.21.15.12:0/1652567415 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2594018a30 con 0x7f25a4103d30 2024-09-05T01:24:46.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.596+0000 7f25aa800640 1 -- 172.21.15.12:0/1652567415 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a41a2390 con 0x7f25a4103d30 2024-09-05T01:24:46.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.597+0000 7f25aa800640 1 -- 172.21.15.12:0/1652567415 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25a41a2620 con 0x7f25a4103d30 2024-09-05T01:24:46.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.599+0000 7f259be00640 1 -- 172.21.15.12:0/1652567415 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f2594010ac0 con 0x7f25a4103d30 2024-09-05T01:24:46.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.600+0000 7f259be00640 1 --2- 172.21.15.12:0/1652567415 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f25880a2e10 0x7f25880a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:46.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.600+0000 7f259be00640 1 -- 172.21.15.12:0/1652567415 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f25940cf930 con 0x7f25a4103d30 2024-09-05T01:24:46.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.600+0000 7f25a2a00640 1 --2- 172.21.15.12:0/1652567415 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f25880a2e10 0x7f25880a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:46.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.601+0000 7f25a2a00640 1 --2- 172.21.15.12:0/1652567415 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f25880a2e10 0x7f25880a52d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2590009830 tx=0x7f2590030550 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:46.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:46 smithi151 ceph-mon[35013]: [05/Sep/2024:01:24:44] ENGINE Bus STARTING 2024-09-05T01:24:46.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:46 smithi151 ceph-mon[35013]: [05/Sep/2024:01:24:44] ENGINE Serving on https://172.21.15.12:7150 2024-09-05T01:24:46.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:46 smithi151 ceph-mon[35013]: [05/Sep/2024:01:24:44] ENGINE Error in HTTPServer.serve 2024-09-05T01:24:46.604 INFO:journalctl@ceph.mon.c.smithi151.stdout: Traceback (most recent call last): 2024-09-05T01:24:46.604 INFO:journalctl@ceph.mon.c.smithi151.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-05T01:24:46.604 INFO:journalctl@ceph.mon.c.smithi151.stdout: self._connections.run(self.expiration_interval) 2024-09-05T01:24:46.604 INFO:journalctl@ceph.mon.c.smithi151.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-05T01:24:46.604 INFO:journalctl@ceph.mon.c.smithi151.stdout: self._run(expiration_interval) 2024-09-05T01:24:46.604 INFO:journalctl@ceph.mon.c.smithi151.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-05T01:24:46.605 INFO:journalctl@ceph.mon.c.smithi151.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-05T01:24:46.605 INFO:journalctl@ceph.mon.c.smithi151.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-05T01:24:46.605 INFO:journalctl@ceph.mon.c.smithi151.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-05T01:24:46.605 INFO:journalctl@ceph.mon.c.smithi151.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-05T01:24:46.605 INFO:journalctl@ceph.mon.c.smithi151.stdout: s = self.context.wrap_socket( 2024-09-05T01:24:46.605 INFO:journalctl@ceph.mon.c.smithi151.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-05T01:24:46.605 INFO:journalctl@ceph.mon.c.smithi151.stdout: return self.sslsocket_class._create( 2024-09-05T01:24:46.605 INFO:journalctl@ceph.mon.c.smithi151.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-05T01:24:46.605 INFO:journalctl@ceph.mon.c.smithi151.stdout: self.do_handshake() 2024-09-05T01:24:46.605 INFO:journalctl@ceph.mon.c.smithi151.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-05T01:24:46.605 INFO:journalctl@ceph.mon.c.smithi151.stdout: self._sslobj.do_handshake() 2024-09-05T01:24:46.605 INFO:journalctl@ceph.mon.c.smithi151.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-05T01:24:46.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:46 smithi151 ceph-mon[35013]: [05/Sep/2024:01:24:44] ENGINE Serving on http://172.21.15.12:8765 2024-09-05T01:24:46.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:46 smithi151 ceph-mon[35013]: [05/Sep/2024:01:24:44] ENGINE Bus STARTED 2024-09-05T01:24:46.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:46 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/466823092' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:24:46.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:46 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:46.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:46 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:46.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:46 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:46.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:46 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:46.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:46 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:46.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:46 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:46.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:46 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:46.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:46 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:46.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:46 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:46.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:46 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:24:46.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:46 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:24:46.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:46 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:24:46.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.604+0000 7f259be00640 1 -- 172.21.15.12:0/1652567415 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f25940541b0 con 0x7f25a4103d30 2024-09-05T01:24:46.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.793+0000 7f25aa800640 1 -- 172.21.15.12:0/1652567415 --> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f25a4062630 con 0x7f25880a2e10 2024-09-05T01:24:46.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.800+0000 7f259be00640 1 -- 172.21.15.12:0/1652567415 <== mgr.15138 v2:172.21.15.12:6800/3451745620 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257822 (secure 0 0 0) 0x7f25a4062630 con 0x7f25880a2e10 2024-09-05T01:24:46.804 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:24:46.805 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-05T01:24:46.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.803+0000 7f25aa800640 1 -- 172.21.15.12:0/1652567415 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f25880a2e10 msgr2=0x7f25880a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:46.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.803+0000 7f25aa800640 1 --2- 172.21.15.12:0/1652567415 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f25880a2e10 0x7f25880a52d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2590009830 tx=0x7f2590030550 comp rx=0 tx=0).stop 2024-09-05T01:24:46.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.803+0000 7f25aa800640 1 -- 172.21.15.12:0/1652567415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25a4103d30 msgr2=0x7f25a419a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:46.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.803+0000 7f25aa800640 1 --2- 172.21.15.12:0/1652567415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25a4103d30 0x7f25a419a010 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f259400e9a0 tx=0x7f259400ee60 comp rx=0 tx=0).stop 2024-09-05T01:24:46.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.804+0000 7f25aa800640 1 -- 172.21.15.12:0/1652567415 shutdown_connections 2024-09-05T01:24:46.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.804+0000 7f25aa800640 1 --2- 172.21.15.12:0/1652567415 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f25880a2e10 0x7f25880a52d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:46.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.804+0000 7f25aa800640 1 --2- 172.21.15.12:0/1652567415 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f25a41058e0 0x7f25a41a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:46.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.804+0000 7f25aa800640 1 --2- 172.21.15.12:0/1652567415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25a4104f20 0x7f25a419a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:46.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.804+0000 7f25aa800640 1 --2- 172.21.15.12:0/1652567415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25a4103d30 0x7f25a419a010 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:46.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.804+0000 7f25aa800640 1 -- 172.21.15.12:0/1652567415 >> 172.21.15.12:0/1652567415 conn(0x7f25a40ff4b0 msgr2=0x7f25a41015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:46.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.804+0000 7f25aa800640 1 -- 172.21.15.12:0/1652567415 shutdown_connections 2024-09-05T01:24:46.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:46.804+0000 7f25aa800640 1 -- 172.21.15.12:0/1652567415 wait complete. 2024-09-05T01:24:46.823 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-05T01:24:45.615335+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1192577,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1398,"num_read_kb":884,"num_write":565,"num_write_kb":4411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":1182018,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":946,"ondisk_log_size":946,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376760,"kb_used_data":15000,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124565064,"statfs":{"total":1151940427776,"available":1151554625536,"internally_reserved":0,"allocated":15360000,"data_stored":9115204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.982018"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.706548+0000","last_change":"2024-09-05T01:22:35.038389+0000","last_active":"2024-09-05T01:24:41.706548+0000","last_peered":"2024-09-05T01:24:41.706548+0000","last_clean":"2024-09-05T01:24:41.706548+0000","last_became_active":"2024-09-05T01:22:35.037982+0000","last_became_peered":"2024-09-05T01:22:35.037982+0000","last_unstale":"2024-09-05T01:24:41.706548+0000","last_undegraded":"2024-09-05T01:24:41.706548+0000","last_fullsized":"2024-09-05T01:24:41.706548+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:23:33.802592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839568+0000","last_change":"2024-09-05T01:22:35.035340+0000","last_active":"2024-09-05T01:24:41.839568+0000","last_peered":"2024-09-05T01:24:41.839568+0000","last_clean":"2024-09-05T01:24:41.839568+0000","last_became_active":"2024-09-05T01:22:35.032871+0000","last_became_peered":"2024-09-05T01:22:35.032871+0000","last_unstale":"2024-09-05T01:24:41.839568+0000","last_undegraded":"2024-09-05T01:24:41.839568+0000","last_fullsized":"2024-09-05T01:24:41.839568+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:51:07.235915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.840354+0000","last_change":"2024-09-05T01:22:35.045443+0000","last_active":"2024-09-05T01:24:41.840354+0000","last_peered":"2024-09-05T01:24:41.840354+0000","last_clean":"2024-09-05T01:24:41.840354+0000","last_became_active":"2024-09-05T01:22:35.042342+0000","last_became_peered":"2024-09-05T01:22:35.042342+0000","last_unstale":"2024-09-05T01:24:41.840354+0000","last_undegraded":"2024-09-05T01:24:41.840354+0000","last_fullsized":"2024-09-05T01:24:41.840354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:42:46.878959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.840049+0000","last_change":"2024-09-05T01:22:35.041527+0000","last_active":"2024-09-05T01:24:41.840049+0000","last_peered":"2024-09-05T01:24:41.840049+0000","last_clean":"2024-09-05T01:24:41.840049+0000","last_became_active":"2024-09-05T01:22:35.041210+0000","last_became_peered":"2024-09-05T01:22:35.041210+0000","last_unstale":"2024-09-05T01:24:41.840049+0000","last_undegraded":"2024-09-05T01:24:41.840049+0000","last_fullsized":"2024-09-05T01:24:41.840049+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:22:28.770307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949039+0000","last_change":"2024-09-05T01:22:35.036810+0000","last_active":"2024-09-05T01:24:41.949039+0000","last_peered":"2024-09-05T01:24:41.949039+0000","last_clean":"2024-09-05T01:24:41.949039+0000","last_became_active":"2024-09-05T01:22:35.036435+0000","last_became_peered":"2024-09-05T01:22:35.036435+0000","last_unstale":"2024-09-05T01:24:41.949039+0000","last_undegraded":"2024-09-05T01:24:41.949039+0000","last_fullsized":"2024-09-05T01:24:41.949039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:41:43.649178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.715224+0000","last_change":"2024-09-05T01:22:35.039198+0000","last_active":"2024-09-05T01:24:41.715224+0000","last_peered":"2024-09-05T01:24:41.715224+0000","last_clean":"2024-09-05T01:24:41.715224+0000","last_became_active":"2024-09-05T01:22:35.038822+0000","last_became_peered":"2024-09-05T01:22:35.038822+0000","last_unstale":"2024-09-05T01:24:41.715224+0000","last_undegraded":"2024-09-05T01:24:41.715224+0000","last_fullsized":"2024-09-05T01:24:41.715224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:22:08.600927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838383+0000","last_change":"2024-09-05T01:22:35.034687+0000","last_active":"2024-09-05T01:24:41.838383+0000","last_peered":"2024-09-05T01:24:41.838383+0000","last_clean":"2024-09-05T01:24:41.838383+0000","last_became_active":"2024-09-05T01:22:35.034351+0000","last_became_peered":"2024-09-05T01:22:35.034351+0000","last_unstale":"2024-09-05T01:24:41.838383+0000","last_undegraded":"2024-09-05T01:24:41.838383+0000","last_fullsized":"2024-09-05T01:24:41.838383+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:38:27.311348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.703672+0000","last_change":"2024-09-05T01:23:23.250016+0000","last_active":"2024-09-05T01:24:41.703672+0000","last_peered":"2024-09-05T01:24:41.703672+0000","last_clean":"2024-09-05T01:24:41.703672+0000","last_became_active":"2024-09-05T01:23:23.249553+0000","last_became_peered":"2024-09-05T01:23:23.249553+0000","last_unstale":"2024-09-05T01:24:41.703672+0000","last_undegraded":"2024-09-05T01:24:41.703672+0000","last_fullsized":"2024-09-05T01:24:41.703672+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:06:32.460400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839596+0000","last_change":"2024-09-05T01:22:35.036394+0000","last_active":"2024-09-05T01:24:41.839596+0000","last_peered":"2024-09-05T01:24:41.839596+0000","last_clean":"2024-09-05T01:24:41.839596+0000","last_became_active":"2024-09-05T01:22:35.035990+0000","last_became_peered":"2024-09-05T01:22:35.035990+0000","last_unstale":"2024-09-05T01:24:41.839596+0000","last_undegraded":"2024-09-05T01:24:41.839596+0000","last_fullsized":"2024-09-05T01:24:41.839596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:42:18.870263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.715654+0000","last_change":"2024-09-05T01:22:35.033389+0000","last_active":"2024-09-05T01:24:41.715654+0000","last_peered":"2024-09-05T01:24:41.715654+0000","last_clean":"2024-09-05T01:24:41.715654+0000","last_became_active":"2024-09-05T01:22:35.033081+0000","last_became_peered":"2024-09-05T01:22:35.033081+0000","last_unstale":"2024-09-05T01:24:41.715654+0000","last_undegraded":"2024-09-05T01:24:41.715654+0000","last_fullsized":"2024-09-05T01:24:41.715654+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:53:08.266905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839098+0000","last_change":"2024-09-05T01:22:35.035768+0000","last_active":"2024-09-05T01:24:41.839098+0000","last_peered":"2024-09-05T01:24:41.839098+0000","last_clean":"2024-09-05T01:24:41.839098+0000","last_became_active":"2024-09-05T01:22:35.035456+0000","last_became_peered":"2024-09-05T01:22:35.035456+0000","last_unstale":"2024-09-05T01:24:41.839098+0000","last_undegraded":"2024-09-05T01:24:41.839098+0000","last_fullsized":"2024-09-05T01:24:41.839098+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:15:48.723816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.840030+0000","last_change":"2024-09-05T01:22:35.040720+0000","last_active":"2024-09-05T01:24:41.840030+0000","last_peered":"2024-09-05T01:24:41.840030+0000","last_clean":"2024-09-05T01:24:41.840030+0000","last_became_active":"2024-09-05T01:22:35.039617+0000","last_became_peered":"2024-09-05T01:22:35.039617+0000","last_unstale":"2024-09-05T01:24:41.840030+0000","last_undegraded":"2024-09-05T01:24:41.840030+0000","last_fullsized":"2024-09-05T01:24:41.840030+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:23:11.633617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.600017+0000","last_change":"2024-09-05T01:22:35.022096+0000","last_active":"2024-09-05T01:24:41.600017+0000","last_peered":"2024-09-05T01:24:41.600017+0000","last_clean":"2024-09-05T01:24:41.600017+0000","last_became_active":"2024-09-05T01:22:35.021707+0000","last_became_peered":"2024-09-05T01:22:35.021707+0000","last_unstale":"2024-09-05T01:24:41.600017+0000","last_undegraded":"2024-09-05T01:24:41.600017+0000","last_fullsized":"2024-09-05T01:24:41.600017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:50:35.035386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839490+0000","last_change":"2024-09-05T01:22:35.034481+0000","last_active":"2024-09-05T01:24:41.839490+0000","last_peered":"2024-09-05T01:24:41.839490+0000","last_clean":"2024-09-05T01:24:41.839490+0000","last_became_active":"2024-09-05T01:22:35.034145+0000","last_became_peered":"2024-09-05T01:22:35.034145+0000","last_unstale":"2024-09-05T01:24:41.839490+0000","last_undegraded":"2024-09-05T01:24:41.839490+0000","last_fullsized":"2024-09-05T01:24:41.839490+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:19:33.386981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839375+0000","last_change":"2024-09-05T01:23:23.195234+0000","last_active":"2024-09-05T01:24:41.839375+0000","last_peered":"2024-09-05T01:24:41.839375+0000","last_clean":"2024-09-05T01:24:41.839375+0000","last_became_active":"2024-09-05T01:23:23.194014+0000","last_became_peered":"2024-09-05T01:23:23.194014+0000","last_unstale":"2024-09-05T01:24:41.839375+0000","last_undegraded":"2024-09-05T01:24:41.839375+0000","last_fullsized":"2024-09-05T01:24:41.839375+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:05:38.517017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838720+0000","last_change":"2024-09-05T01:22:35.046517+0000","last_active":"2024-09-05T01:24:41.838720+0000","last_peered":"2024-09-05T01:24:41.838720+0000","last_clean":"2024-09-05T01:24:41.838720+0000","last_became_active":"2024-09-05T01:22:35.046230+0000","last_became_peered":"2024-09-05T01:22:35.046230+0000","last_unstale":"2024-09-05T01:24:41.838720+0000","last_undegraded":"2024-09-05T01:24:41.838720+0000","last_fullsized":"2024-09-05T01:24:41.838720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:16:49.672039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.706548+0000","last_change":"2024-09-05T01:22:35.041140+0000","last_active":"2024-09-05T01:24:41.706548+0000","last_peered":"2024-09-05T01:24:41.706548+0000","last_clean":"2024-09-05T01:24:41.706548+0000","last_became_active":"2024-09-05T01:22:35.040838+0000","last_became_peered":"2024-09-05T01:22:35.040838+0000","last_unstale":"2024-09-05T01:24:41.706548+0000","last_undegraded":"2024-09-05T01:24:41.706548+0000","last_fullsized":"2024-09-05T01:24:41.706548+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:47:55.730240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.703957+0000","last_change":"2024-09-05T01:22:35.036830+0000","last_active":"2024-09-05T01:24:41.703957+0000","last_peered":"2024-09-05T01:24:41.703957+0000","last_clean":"2024-09-05T01:24:41.703957+0000","last_became_active":"2024-09-05T01:22:35.036356+0000","last_became_peered":"2024-09-05T01:22:35.036356+0000","last_unstale":"2024-09-05T01:24:41.703957+0000","last_undegraded":"2024-09-05T01:24:41.703957+0000","last_fullsized":"2024-09-05T01:24:41.703957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:19:01.736301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838151+0000","last_change":"2024-09-05T01:22:35.036386+0000","last_active":"2024-09-05T01:24:41.838151+0000","last_peered":"2024-09-05T01:24:41.838151+0000","last_clean":"2024-09-05T01:24:41.838151+0000","last_became_active":"2024-09-05T01:22:35.036046+0000","last_became_peered":"2024-09-05T01:22:35.036046+0000","last_unstale":"2024-09-05T01:24:41.838151+0000","last_undegraded":"2024-09-05T01:24:41.838151+0000","last_fullsized":"2024-09-05T01:24:41.838151+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:19:37.861719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.706279+0000","last_change":"2024-09-05T01:22:35.041077+0000","last_active":"2024-09-05T01:24:41.706279+0000","last_peered":"2024-09-05T01:24:41.706279+0000","last_clean":"2024-09-05T01:24:41.706279+0000","last_became_active":"2024-09-05T01:22:35.040736+0000","last_became_peered":"2024-09-05T01:22:35.040736+0000","last_unstale":"2024-09-05T01:24:41.706279+0000","last_undegraded":"2024-09-05T01:24:41.706279+0000","last_fullsized":"2024-09-05T01:24:41.706279+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:30:54.670559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.600184+0000","last_change":"2024-09-05T01:22:35.047774+0000","last_active":"2024-09-05T01:24:41.600184+0000","last_peered":"2024-09-05T01:24:41.600184+0000","last_clean":"2024-09-05T01:24:41.600184+0000","last_became_active":"2024-09-05T01:22:35.047153+0000","last_became_peered":"2024-09-05T01:22:35.047153+0000","last_unstale":"2024-09-05T01:24:41.600184+0000","last_undegraded":"2024-09-05T01:24:41.600184+0000","last_fullsized":"2024-09-05T01:24:41.600184+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:07:02.189116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838935+0000","last_change":"2024-09-05T01:22:35.041346+0000","last_active":"2024-09-05T01:24:41.838935+0000","last_peered":"2024-09-05T01:24:41.838935+0000","last_clean":"2024-09-05T01:24:41.838935+0000","last_became_active":"2024-09-05T01:22:35.040282+0000","last_became_peered":"2024-09-05T01:22:35.040282+0000","last_unstale":"2024-09-05T01:24:41.838935+0000","last_undegraded":"2024-09-05T01:24:41.838935+0000","last_fullsized":"2024-09-05T01:24:41.838935+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:19:38.203479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.601624+0000","last_change":"2024-09-05T01:22:35.041780+0000","last_active":"2024-09-05T01:24:41.601624+0000","last_peered":"2024-09-05T01:24:41.601624+0000","last_clean":"2024-09-05T01:24:41.601624+0000","last_became_active":"2024-09-05T01:22:35.038453+0000","last_became_peered":"2024-09-05T01:22:35.038453+0000","last_unstale":"2024-09-05T01:24:41.601624+0000","last_undegraded":"2024-09-05T01:24:41.601624+0000","last_fullsized":"2024-09-05T01:24:41.601624+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:17:56.453627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.601680+0000","last_change":"2024-09-05T01:22:35.038699+0000","last_active":"2024-09-05T01:24:41.601680+0000","last_peered":"2024-09-05T01:24:41.601680+0000","last_clean":"2024-09-05T01:24:41.601680+0000","last_became_active":"2024-09-05T01:22:35.038349+0000","last_became_peered":"2024-09-05T01:22:35.038349+0000","last_unstale":"2024-09-05T01:24:41.601680+0000","last_undegraded":"2024-09-05T01:24:41.601680+0000","last_fullsized":"2024-09-05T01:24:41.601680+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:17:18.175643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.603332+0000","last_change":"2024-09-05T01:22:35.048281+0000","last_active":"2024-09-05T01:24:41.603332+0000","last_peered":"2024-09-05T01:24:41.603332+0000","last_clean":"2024-09-05T01:24:41.603332+0000","last_became_active":"2024-09-05T01:22:35.047211+0000","last_became_peered":"2024-09-05T01:22:35.047211+0000","last_unstale":"2024-09-05T01:24:41.603332+0000","last_undegraded":"2024-09-05T01:24:41.603332+0000","last_fullsized":"2024-09-05T01:24:41.603332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:40:43.196562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838291+0000","last_change":"2024-09-05T01:22:35.041215+0000","last_active":"2024-09-05T01:24:41.838291+0000","last_peered":"2024-09-05T01:24:41.838291+0000","last_clean":"2024-09-05T01:24:41.838291+0000","last_became_active":"2024-09-05T01:22:35.040156+0000","last_became_peered":"2024-09-05T01:22:35.040156+0000","last_unstale":"2024-09-05T01:24:41.838291+0000","last_undegraded":"2024-09-05T01:24:41.838291+0000","last_fullsized":"2024-09-05T01:24:41.838291+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:39:01.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.706412+0000","last_change":"2024-09-05T01:23:23.197568+0000","last_active":"2024-09-05T01:24:41.706412+0000","last_peered":"2024-09-05T01:24:41.706412+0000","last_clean":"2024-09-05T01:24:41.706412+0000","last_became_active":"2024-09-05T01:23:23.197132+0000","last_became_peered":"2024-09-05T01:23:23.197132+0000","last_unstale":"2024-09-05T01:24:41.706412+0000","last_undegraded":"2024-09-05T01:24:41.706412+0000","last_fullsized":"2024-09-05T01:24:41.706412+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:55.524687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.599878+0000","last_change":"2024-09-05T01:22:35.038147+0000","last_active":"2024-09-05T01:24:41.599878+0000","last_peered":"2024-09-05T01:24:41.599878+0000","last_clean":"2024-09-05T01:24:41.599878+0000","last_became_active":"2024-09-05T01:22:35.037772+0000","last_became_peered":"2024-09-05T01:22:35.037772+0000","last_unstale":"2024-09-05T01:24:41.599878+0000","last_undegraded":"2024-09-05T01:24:41.599878+0000","last_fullsized":"2024-09-05T01:24:41.599878+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:40:01.786788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839878+0000","last_change":"2024-09-05T01:22:35.049040+0000","last_active":"2024-09-05T01:24:41.839878+0000","last_peered":"2024-09-05T01:24:41.839878+0000","last_clean":"2024-09-05T01:24:41.839878+0000","last_became_active":"2024-09-05T01:22:35.048373+0000","last_became_peered":"2024-09-05T01:22:35.048373+0000","last_unstale":"2024-09-05T01:24:41.839878+0000","last_undegraded":"2024-09-05T01:24:41.839878+0000","last_fullsized":"2024-09-05T01:24:41.839878+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:32:17.316513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838001+0000","last_change":"2024-09-05T01:22:35.043531+0000","last_active":"2024-09-05T01:24:41.838001+0000","last_peered":"2024-09-05T01:24:41.838001+0000","last_clean":"2024-09-05T01:24:41.838001+0000","last_became_active":"2024-09-05T01:22:35.043145+0000","last_became_peered":"2024-09-05T01:22:35.043145+0000","last_unstale":"2024-09-05T01:24:41.838001+0000","last_undegraded":"2024-09-05T01:24:41.838001+0000","last_fullsized":"2024-09-05T01:24:41.838001+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:04:41.902738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838085+0000","last_change":"2024-09-05T01:22:35.037684+0000","last_active":"2024-09-05T01:24:41.838085+0000","last_peered":"2024-09-05T01:24:41.838085+0000","last_clean":"2024-09-05T01:24:41.838085+0000","last_became_active":"2024-09-05T01:22:35.037392+0000","last_became_peered":"2024-09-05T01:22:35.037392+0000","last_unstale":"2024-09-05T01:24:41.838085+0000","last_undegraded":"2024-09-05T01:24:41.838085+0000","last_fullsized":"2024-09-05T01:24:41.838085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:12:37.705198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.706379+0000","last_change":"2024-09-05T01:22:35.036917+0000","last_active":"2024-09-05T01:24:41.706379+0000","last_peered":"2024-09-05T01:24:41.706379+0000","last_clean":"2024-09-05T01:24:41.706379+0000","last_became_active":"2024-09-05T01:22:35.036597+0000","last_became_peered":"2024-09-05T01:22:35.036597+0000","last_unstale":"2024-09-05T01:24:41.706379+0000","last_undegraded":"2024-09-05T01:24:41.706379+0000","last_fullsized":"2024-09-05T01:24:41.706379+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:25:46.472325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949036+0000","last_change":"2024-09-05T01:22:35.035858+0000","last_active":"2024-09-05T01:24:41.949036+0000","last_peered":"2024-09-05T01:24:41.949036+0000","last_clean":"2024-09-05T01:24:41.949036+0000","last_became_active":"2024-09-05T01:22:35.035075+0000","last_became_peered":"2024-09-05T01:22:35.035075+0000","last_unstale":"2024-09-05T01:24:41.949036+0000","last_undegraded":"2024-09-05T01:24:41.949036+0000","last_fullsized":"2024-09-05T01:24:41.949036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:49:42.487427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'7","reported_seq":155,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.602440+0000","last_change":"2024-09-05T01:22:32.615444+0000","last_active":"2024-09-05T01:24:41.602440+0000","last_peered":"2024-09-05T01:24:41.602440+0000","last_clean":"2024-09-05T01:24:41.602440+0000","last_became_active":"2024-09-05T01:22:32.615026+0000","last_became_peered":"2024-09-05T01:22:32.615026+0000","last_unstale":"2024-09-05T01:24:41.602440+0000","last_undegraded":"2024-09-05T01:24:41.602440+0000","last_fullsized":"2024-09-05T01:24:41.602440+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:52:51.410953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.602228+0000","last_change":"2024-09-05T01:22:35.039341+0000","last_active":"2024-09-05T01:24:41.602228+0000","last_peered":"2024-09-05T01:24:41.602228+0000","last_clean":"2024-09-05T01:24:41.602228+0000","last_became_active":"2024-09-05T01:22:35.038911+0000","last_became_peered":"2024-09-05T01:22:35.038911+0000","last_unstale":"2024-09-05T01:24:41.602228+0000","last_undegraded":"2024-09-05T01:24:41.602228+0000","last_fullsized":"2024-09-05T01:24:41.602228+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:18:41.735302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'7","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.715259+0000","last_change":"2024-09-05T01:22:32.610256+0000","last_active":"2024-09-05T01:24:41.715259+0000","last_peered":"2024-09-05T01:24:41.715259+0000","last_clean":"2024-09-05T01:24:41.715259+0000","last_became_active":"2024-09-05T01:22:32.609430+0000","last_became_peered":"2024-09-05T01:22:32.609430+0000","last_unstale":"2024-09-05T01:24:41.715259+0000","last_undegraded":"2024-09-05T01:24:41.715259+0000","last_fullsized":"2024-09-05T01:24:41.715259+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:00:13.171249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.599701+0000","last_change":"2024-09-05T01:22:32.609238+0000","last_active":"2024-09-05T01:24:41.599701+0000","last_peered":"2024-09-05T01:24:41.599701+0000","last_clean":"2024-09-05T01:24:41.599701+0000","last_became_active":"2024-09-05T01:22:32.608789+0000","last_became_peered":"2024-09-05T01:22:32.608789+0000","last_unstale":"2024-09-05T01:24:41.599701+0000","last_undegraded":"2024-09-05T01:24:41.599701+0000","last_fullsized":"2024-09-05T01:24:41.599701+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:01:55.536313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.601558+0000","last_change":"2024-09-05T01:22:35.048262+0000","last_active":"2024-09-05T01:24:41.601558+0000","last_peered":"2024-09-05T01:24:41.601558+0000","last_clean":"2024-09-05T01:24:41.601558+0000","last_became_active":"2024-09-05T01:22:35.046404+0000","last_became_peered":"2024-09-05T01:22:35.046404+0000","last_unstale":"2024-09-05T01:24:41.601558+0000","last_undegraded":"2024-09-05T01:24:41.601558+0000","last_fullsized":"2024-09-05T01:24:41.601558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:29:04.310095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.602241+0000","last_change":"2024-09-05T01:22:32.612116+0000","last_active":"2024-09-05T01:24:41.602241+0000","last_peered":"2024-09-05T01:24:41.602241+0000","last_clean":"2024-09-05T01:24:41.602241+0000","last_became_active":"2024-09-05T01:22:32.611794+0000","last_became_peered":"2024-09-05T01:22:32.611794+0000","last_unstale":"2024-09-05T01:24:41.602241+0000","last_undegraded":"2024-09-05T01:24:41.602241+0000","last_fullsized":"2024-09-05T01:24:41.602241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:59:55.360151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.703802+0000","last_change":"2024-09-05T01:23:23.250108+0000","last_active":"2024-09-05T01:24:41.703802+0000","last_peered":"2024-09-05T01:24:41.703802+0000","last_clean":"2024-09-05T01:24:41.703802+0000","last_became_active":"2024-09-05T01:23:23.249698+0000","last_became_peered":"2024-09-05T01:23:23.249698+0000","last_unstale":"2024-09-05T01:24:41.703802+0000","last_undegraded":"2024-09-05T01:24:41.703802+0000","last_fullsized":"2024-09-05T01:24:41.703802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:55:45.998595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,10],"acting":[9,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'6","reported_seq":266,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:42.029823+0000","last_change":"2024-09-05T01:22:32.611558+0000","last_active":"2024-09-05T01:24:42.029823+0000","last_peered":"2024-09-05T01:24:42.029823+0000","last_clean":"2024-09-05T01:24:42.029823+0000","last_became_active":"2024-09-05T01:22:32.611194+0000","last_became_peered":"2024-09-05T01:22:32.611194+0000","last_unstale":"2024-09-05T01:24:42.029823+0000","last_undegraded":"2024-09-05T01:24:42.029823+0000","last_fullsized":"2024-09-05T01:24:42.029823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:47:30.586224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839373+0000","last_change":"2024-09-05T01:22:35.042010+0000","last_active":"2024-09-05T01:24:41.839373+0000","last_peered":"2024-09-05T01:24:41.839373+0000","last_clean":"2024-09-05T01:24:41.839373+0000","last_became_active":"2024-09-05T01:22:35.041451+0000","last_became_peered":"2024-09-05T01:22:35.041451+0000","last_unstale":"2024-09-05T01:24:41.839373+0000","last_undegraded":"2024-09-05T01:24:41.839373+0000","last_fullsized":"2024-09-05T01:24:41.839373+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:12:15.429065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838986+0000","last_change":"2024-09-05T01:22:32.612131+0000","last_active":"2024-09-05T01:24:41.838986+0000","last_peered":"2024-09-05T01:24:41.838986+0000","last_clean":"2024-09-05T01:24:41.838986+0000","last_became_active":"2024-09-05T01:22:32.611778+0000","last_became_peered":"2024-09-05T01:22:32.611778+0000","last_unstale":"2024-09-05T01:24:41.838986+0000","last_undegraded":"2024-09-05T01:24:41.838986+0000","last_fullsized":"2024-09-05T01:24:41.838986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:18:21.930485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.840984+0000","last_change":"2024-09-05T01:22:35.047663+0000","last_active":"2024-09-05T01:24:41.840984+0000","last_peered":"2024-09-05T01:24:41.840984+0000","last_clean":"2024-09-05T01:24:41.840984+0000","last_became_active":"2024-09-05T01:22:35.047078+0000","last_became_peered":"2024-09-05T01:22:35.047078+0000","last_unstale":"2024-09-05T01:24:41.840984+0000","last_undegraded":"2024-09-05T01:24:41.840984+0000","last_fullsized":"2024-09-05T01:24:41.840984+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:44.992459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.602055+0000","last_change":"2024-09-05T01:22:33.064617+0000","last_active":"2024-09-05T01:24:41.602055+0000","last_peered":"2024-09-05T01:24:41.602055+0000","last_clean":"2024-09-05T01:24:41.602055+0000","last_became_active":"2024-09-05T01:22:33.064265+0000","last_became_peered":"2024-09-05T01:22:33.064265+0000","last_unstale":"2024-09-05T01:24:41.602055+0000","last_undegraded":"2024-09-05T01:24:41.602055+0000","last_fullsized":"2024-09-05T01:24:41.602055+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:43:57.315764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838950+0000","last_change":"2024-09-05T01:22:35.047109+0000","last_active":"2024-09-05T01:24:41.838950+0000","last_peered":"2024-09-05T01:24:41.838950+0000","last_clean":"2024-09-05T01:24:41.838950+0000","last_became_active":"2024-09-05T01:22:35.046806+0000","last_became_peered":"2024-09-05T01:22:35.046806+0000","last_unstale":"2024-09-05T01:24:41.838950+0000","last_undegraded":"2024-09-05T01:24:41.838950+0000","last_fullsized":"2024-09-05T01:24:41.838950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:19:42.743038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'36","reported_seq":307,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:42.031130+0000","last_change":"2024-09-05T01:22:32.610883+0000","last_active":"2024-09-05T01:24:42.031130+0000","last_peered":"2024-09-05T01:24:42.031130+0000","last_clean":"2024-09-05T01:24:42.031130+0000","last_became_active":"2024-09-05T01:22:32.610530+0000","last_became_peered":"2024-09-05T01:22:32.610530+0000","last_unstale":"2024-09-05T01:24:42.031130+0000","last_undegraded":"2024-09-05T01:24:42.031130+0000","last_fullsized":"2024-09-05T01:24:42.031130+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:51:01.111529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66859,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":243,"num_read_kb":186,"num_write":38,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949361+0000","last_change":"2024-09-05T01:22:35.032397+0000","last_active":"2024-09-05T01:24:41.949361+0000","last_peered":"2024-09-05T01:24:41.949361+0000","last_clean":"2024-09-05T01:24:41.949361+0000","last_became_active":"2024-09-05T01:22:35.032073+0000","last_became_peered":"2024-09-05T01:22:35.032073+0000","last_unstale":"2024-09-05T01:24:41.949361+0000","last_undegraded":"2024-09-05T01:24:41.949361+0000","last_fullsized":"2024-09-05T01:24:41.949361+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:36:02.866390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838150+0000","last_change":"2024-09-05T01:22:32.610247+0000","last_active":"2024-09-05T01:24:41.838150+0000","last_peered":"2024-09-05T01:24:41.838150+0000","last_clean":"2024-09-05T01:24:41.838150+0000","last_became_active":"2024-09-05T01:22:32.609881+0000","last_became_peered":"2024-09-05T01:22:32.609881+0000","last_unstale":"2024-09-05T01:24:41.838150+0000","last_undegraded":"2024-09-05T01:24:41.838150+0000","last_fullsized":"2024-09-05T01:24:41.838150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:40:39.835208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.599790+0000","last_change":"2024-09-05T01:22:35.041923+0000","last_active":"2024-09-05T01:24:41.599790+0000","last_peered":"2024-09-05T01:24:41.599790+0000","last_clean":"2024-09-05T01:24:41.599790+0000","last_became_active":"2024-09-05T01:22:35.041439+0000","last_became_peered":"2024-09-05T01:22:35.041439+0000","last_unstale":"2024-09-05T01:24:41.599790+0000","last_undegraded":"2024-09-05T01:24:41.599790+0000","last_fullsized":"2024-09-05T01:24:41.599790+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:36:56.545466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.601741+0000","last_change":"2024-09-05T01:22:32.611274+0000","last_active":"2024-09-05T01:24:41.601741+0000","last_peered":"2024-09-05T01:24:41.601741+0000","last_clean":"2024-09-05T01:24:41.601741+0000","last_became_active":"2024-09-05T01:22:32.610853+0000","last_became_peered":"2024-09-05T01:22:32.610853+0000","last_unstale":"2024-09-05T01:24:41.601741+0000","last_undegraded":"2024-09-05T01:24:41.601741+0000","last_fullsized":"2024-09-05T01:24:41.601741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:01:38.058836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838564+0000","last_change":"2024-09-05T01:22:35.040116+0000","last_active":"2024-09-05T01:24:41.838564+0000","last_peered":"2024-09-05T01:24:41.838564+0000","last_clean":"2024-09-05T01:24:41.838564+0000","last_became_active":"2024-09-05T01:22:35.037663+0000","last_became_peered":"2024-09-05T01:22:35.037663+0000","last_unstale":"2024-09-05T01:24:41.838564+0000","last_undegraded":"2024-09-05T01:24:41.838564+0000","last_fullsized":"2024-09-05T01:24:41.838564+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:16:37.309205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'10","reported_seq":160,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:42.030656+0000","last_change":"2024-09-05T01:22:32.612334+0000","last_active":"2024-09-05T01:24:42.030656+0000","last_peered":"2024-09-05T01:24:42.030656+0000","last_clean":"2024-09-05T01:24:42.030656+0000","last_became_active":"2024-09-05T01:22:32.612008+0000","last_became_peered":"2024-09-05T01:22:32.612008+0000","last_unstale":"2024-09-05T01:24:42.030656+0000","last_undegraded":"2024-09-05T01:24:42.030656+0000","last_fullsized":"2024-09-05T01:24:42.030656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:31:05.580219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2219,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":7,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838348+0000","last_change":"2024-09-05T01:22:35.037034+0000","last_active":"2024-09-05T01:24:41.838348+0000","last_peered":"2024-09-05T01:24:41.838348+0000","last_clean":"2024-09-05T01:24:41.838348+0000","last_became_active":"2024-09-05T01:22:35.036643+0000","last_became_peered":"2024-09-05T01:22:35.036643+0000","last_unstale":"2024-09-05T01:24:41.838348+0000","last_undegraded":"2024-09-05T01:24:41.838348+0000","last_fullsized":"2024-09-05T01:24:41.838348+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:41:24.073298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.706202+0000","last_change":"2024-09-05T01:24:23.306662+0000","last_active":"2024-09-05T01:24:41.706202+0000","last_peered":"2024-09-05T01:24:41.706202+0000","last_clean":"2024-09-05T01:24:41.706202+0000","last_became_active":"2024-09-05T01:24:23.295595+0000","last_became_peered":"2024-09-05T01:24:23.295595+0000","last_unstale":"2024-09-05T01:24:41.706202+0000","last_undegraded":"2024-09-05T01:24:41.706202+0000","last_fullsized":"2024-09-05T01:24:41.706202+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:55:06.973543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.601748+0000","last_change":"2024-09-05T01:22:35.039866+0000","last_active":"2024-09-05T01:24:41.601748+0000","last_peered":"2024-09-05T01:24:41.601748+0000","last_clean":"2024-09-05T01:24:41.601748+0000","last_became_active":"2024-09-05T01:22:35.039493+0000","last_became_peered":"2024-09-05T01:22:35.039493+0000","last_unstale":"2024-09-05T01:24:41.601748+0000","last_undegraded":"2024-09-05T01:24:41.601748+0000","last_fullsized":"2024-09-05T01:24:41.601748+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:39:20.036455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'4","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949403+0000","last_change":"2024-09-05T01:22:32.610948+0000","last_active":"2024-09-05T01:24:41.949403+0000","last_peered":"2024-09-05T01:24:41.949403+0000","last_clean":"2024-09-05T01:24:41.949403+0000","last_became_active":"2024-09-05T01:22:32.610596+0000","last_became_peered":"2024-09-05T01:22:32.610596+0000","last_unstale":"2024-09-05T01:24:41.949403+0000","last_undegraded":"2024-09-05T01:24:41.949403+0000","last_fullsized":"2024-09-05T01:24:41.949403+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:36:25.589705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.706548+0000","last_change":"2024-09-05T01:23:23.196770+0000","last_active":"2024-09-05T01:24:41.706548+0000","last_peered":"2024-09-05T01:24:41.706548+0000","last_clean":"2024-09-05T01:24:41.706548+0000","last_became_active":"2024-09-05T01:23:23.196495+0000","last_became_peered":"2024-09-05T01:23:23.196495+0000","last_unstale":"2024-09-05T01:24:41.706548+0000","last_undegraded":"2024-09-05T01:24:41.706548+0000","last_fullsized":"2024-09-05T01:24:41.706548+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:11:35.195038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7],"acting":[11,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.600237+0000","last_change":"2024-09-05T01:22:32.609555+0000","last_active":"2024-09-05T01:24:41.600237+0000","last_peered":"2024-09-05T01:24:41.600237+0000","last_clean":"2024-09-05T01:24:41.600237+0000","last_became_active":"2024-09-05T01:22:32.608448+0000","last_became_peered":"2024-09-05T01:22:32.608448+0000","last_unstale":"2024-09-05T01:24:41.600237+0000","last_undegraded":"2024-09-05T01:24:41.600237+0000","last_fullsized":"2024-09-05T01:24:41.600237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:13:27.724664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839189+0000","last_change":"2024-09-05T01:22:35.033418+0000","last_active":"2024-09-05T01:24:41.839189+0000","last_peered":"2024-09-05T01:24:41.839189+0000","last_clean":"2024-09-05T01:24:41.839189+0000","last_became_active":"2024-09-05T01:22:35.033096+0000","last_became_peered":"2024-09-05T01:22:35.033096+0000","last_unstale":"2024-09-05T01:24:41.839189+0000","last_undegraded":"2024-09-05T01:24:41.839189+0000","last_fullsized":"2024-09-05T01:24:41.839189+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:09:06.723427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'41","reported_seq":77,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.883481+0000","last_change":"2024-09-05T01:22:32.609821+0000","last_active":"2024-09-05T01:24:41.883481+0000","last_peered":"2024-09-05T01:24:41.883481+0000","last_clean":"2024-09-05T01:24:41.883481+0000","last_became_active":"2024-09-05T01:22:32.608932+0000","last_became_peered":"2024-09-05T01:22:32.608932+0000","last_unstale":"2024-09-05T01:24:41.883481+0000","last_undegraded":"2024-09-05T01:24:41.883481+0000","last_fullsized":"2024-09-05T01:24:41.883481+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:45:19.964263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838880+0000","last_change":"2024-09-05T01:22:35.037965+0000","last_active":"2024-09-05T01:24:41.838880+0000","last_peered":"2024-09-05T01:24:41.838880+0000","last_clean":"2024-09-05T01:24:41.838880+0000","last_became_active":"2024-09-05T01:22:35.037541+0000","last_became_peered":"2024-09-05T01:22:35.037541+0000","last_unstale":"2024-09-05T01:24:41.838880+0000","last_undegraded":"2024-09-05T01:24:41.838880+0000","last_fullsized":"2024-09-05T01:24:41.838880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:43:29.098517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'7","reported_seq":108,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:42.287528+0000","last_change":"2024-09-05T01:23:23.200721+0000","last_active":"2024-09-05T01:24:42.287528+0000","last_peered":"2024-09-05T01:24:42.287528+0000","last_clean":"2024-09-05T01:24:42.287528+0000","last_became_active":"2024-09-05T01:23:23.193780+0000","last_became_peered":"2024-09-05T01:23:23.193780+0000","last_unstale":"2024-09-05T01:24:42.287528+0000","last_undegraded":"2024-09-05T01:24:42.287528+0000","last_fullsized":"2024-09-05T01:24:42.287528+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:47:56.617158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1956,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1170,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839223+0000","last_change":"2024-09-05T01:22:35.035868+0000","last_active":"2024-09-05T01:24:41.839223+0000","last_peered":"2024-09-05T01:24:41.839223+0000","last_clean":"2024-09-05T01:24:41.839223+0000","last_became_active":"2024-09-05T01:22:35.035495+0000","last_became_peered":"2024-09-05T01:22:35.035495+0000","last_unstale":"2024-09-05T01:24:41.839223+0000","last_undegraded":"2024-09-05T01:24:41.839223+0000","last_fullsized":"2024-09-05T01:24:41.839223+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:13:25.679973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":351,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838523+0000","last_change":"2024-09-05T01:21:17.107509+0000","last_active":"2024-09-05T01:24:41.838523+0000","last_peered":"2024-09-05T01:24:41.838523+0000","last_clean":"2024-09-05T01:24:41.838523+0000","last_became_active":"2024-09-05T01:21:17.107063+0000","last_became_peered":"2024-09-05T01:21:17.107063+0000","last_unstale":"2024-09-05T01:24:41.838523+0000","last_undegraded":"2024-09-05T01:24:41.838523+0000","last_fullsized":"2024-09-05T01:24:41.838523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:17:44.744654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:17:44.744654+0000","last_clean_scrub_stamp":"2024-09-05T01:17:44.744654+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:14:18.603051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.840082+0000","last_change":"2024-09-05T01:22:32.610686+0000","last_active":"2024-09-05T01:24:41.840082+0000","last_peered":"2024-09-05T01:24:41.840082+0000","last_clean":"2024-09-05T01:24:41.840082+0000","last_became_active":"2024-09-05T01:22:32.610248+0000","last_became_peered":"2024-09-05T01:22:32.610248+0000","last_unstale":"2024-09-05T01:24:41.840082+0000","last_undegraded":"2024-09-05T01:24:41.840082+0000","last_fullsized":"2024-09-05T01:24:41.840082+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:14:09.468772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.602009+0000","last_change":"2024-09-05T01:22:35.044346+0000","last_active":"2024-09-05T01:24:41.602009+0000","last_peered":"2024-09-05T01:24:41.602009+0000","last_clean":"2024-09-05T01:24:41.602009+0000","last_became_active":"2024-09-05T01:22:35.043977+0000","last_became_peered":"2024-09-05T01:22:35.043977+0000","last_unstale":"2024-09-05T01:24:41.602009+0000","last_undegraded":"2024-09-05T01:24:41.602009+0000","last_fullsized":"2024-09-05T01:24:41.602009+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:03:33.007905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838533+0000","last_change":"2024-09-05T01:22:32.615120+0000","last_active":"2024-09-05T01:24:41.838533+0000","last_peered":"2024-09-05T01:24:41.838533+0000","last_clean":"2024-09-05T01:24:41.838533+0000","last_became_active":"2024-09-05T01:22:32.614671+0000","last_became_peered":"2024-09-05T01:22:32.614671+0000","last_unstale":"2024-09-05T01:24:41.838533+0000","last_undegraded":"2024-09-05T01:24:41.838533+0000","last_fullsized":"2024-09-05T01:24:41.838533+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:00:00.134610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.599752+0000","last_change":"2024-09-05T01:22:35.035840+0000","last_active":"2024-09-05T01:24:41.599752+0000","last_peered":"2024-09-05T01:24:41.599752+0000","last_clean":"2024-09-05T01:24:41.599752+0000","last_became_active":"2024-09-05T01:22:35.035511+0000","last_became_peered":"2024-09-05T01:22:35.035511+0000","last_unstale":"2024-09-05T01:24:41.599752+0000","last_undegraded":"2024-09-05T01:24:41.599752+0000","last_fullsized":"2024-09-05T01:24:41.599752+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:30:01.929816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"85'7","reported_seq":153,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:42.030142+0000","last_change":"2024-09-05T01:22:33.064281+0000","last_active":"2024-09-05T01:24:42.030142+0000","last_peered":"2024-09-05T01:24:42.030142+0000","last_clean":"2024-09-05T01:24:42.030142+0000","last_became_active":"2024-09-05T01:22:33.063792+0000","last_became_peered":"2024-09-05T01:22:33.063792+0000","last_unstale":"2024-09-05T01:24:42.030142+0000","last_undegraded":"2024-09-05T01:24:42.030142+0000","last_fullsized":"2024-09-05T01:24:42.030142+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:44:19.558140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.602034+0000","last_change":"2024-09-05T01:22:35.035336+0000","last_active":"2024-09-05T01:24:41.602034+0000","last_peered":"2024-09-05T01:24:41.602034+0000","last_clean":"2024-09-05T01:24:41.602034+0000","last_became_active":"2024-09-05T01:22:35.034976+0000","last_became_peered":"2024-09-05T01:22:35.034976+0000","last_unstale":"2024-09-05T01:24:41.602034+0000","last_undegraded":"2024-09-05T01:24:41.602034+0000","last_fullsized":"2024-09-05T01:24:41.602034+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:51:57.850225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"86'8","reported_seq":156,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:42.031156+0000","last_change":"2024-09-05T01:22:32.614203+0000","last_active":"2024-09-05T01:24:42.031156+0000","last_peered":"2024-09-05T01:24:42.031156+0000","last_clean":"2024-09-05T01:24:42.031156+0000","last_became_active":"2024-09-05T01:22:32.613774+0000","last_became_peered":"2024-09-05T01:22:32.613774+0000","last_unstale":"2024-09-05T01:24:42.031156+0000","last_undegraded":"2024-09-05T01:24:42.031156+0000","last_fullsized":"2024-09-05T01:24:42.031156+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:52:05.383835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.715359+0000","last_change":"2024-09-05T01:22:35.042770+0000","last_active":"2024-09-05T01:24:41.715359+0000","last_peered":"2024-09-05T01:24:41.715359+0000","last_clean":"2024-09-05T01:24:41.715359+0000","last_became_active":"2024-09-05T01:22:35.042338+0000","last_became_peered":"2024-09-05T01:22:35.042338+0000","last_unstale":"2024-09-05T01:24:41.715359+0000","last_undegraded":"2024-09-05T01:24:41.715359+0000","last_fullsized":"2024-09-05T01:24:41.715359+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:02:35.669717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"81'1","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.704254+0000","last_change":"2024-09-05T01:22:33.065134+0000","last_active":"2024-09-05T01:24:41.704254+0000","last_peered":"2024-09-05T01:24:41.704254+0000","last_clean":"2024-09-05T01:24:41.704254+0000","last_became_active":"2024-09-05T01:22:33.064685+0000","last_became_peered":"2024-09-05T01:22:33.064685+0000","last_unstale":"2024-09-05T01:24:41.704254+0000","last_undegraded":"2024-09-05T01:24:41.704254+0000","last_fullsized":"2024-09-05T01:24:41.704254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:03:00.976350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.715537+0000","last_change":"2024-09-05T01:22:35.035940+0000","last_active":"2024-09-05T01:24:41.715537+0000","last_peered":"2024-09-05T01:24:41.715537+0000","last_clean":"2024-09-05T01:24:41.715537+0000","last_became_active":"2024-09-05T01:22:35.035582+0000","last_became_peered":"2024-09-05T01:22:35.035582+0000","last_unstale":"2024-09-05T01:24:41.715537+0000","last_undegraded":"2024-09-05T01:24:41.715537+0000","last_fullsized":"2024-09-05T01:24:41.715537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:37:06.621512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949535+0000","last_change":"2024-09-05T01:22:33.064003+0000","last_active":"2024-09-05T01:24:41.949535+0000","last_peered":"2024-09-05T01:24:41.949535+0000","last_clean":"2024-09-05T01:24:41.949535+0000","last_became_active":"2024-09-05T01:22:33.063685+0000","last_became_peered":"2024-09-05T01:22:33.063685+0000","last_unstale":"2024-09-05T01:24:41.949535+0000","last_undegraded":"2024-09-05T01:24:41.949535+0000","last_fullsized":"2024-09-05T01:24:41.949535+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:49:03.742215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.600055+0000","last_change":"2024-09-05T01:22:35.034912+0000","last_active":"2024-09-05T01:24:41.600055+0000","last_peered":"2024-09-05T01:24:41.600055+0000","last_clean":"2024-09-05T01:24:41.600055+0000","last_became_active":"2024-09-05T01:22:35.034526+0000","last_became_peered":"2024-09-05T01:22:35.034526+0000","last_unstale":"2024-09-05T01:24:41.600055+0000","last_undegraded":"2024-09-05T01:24:41.600055+0000","last_fullsized":"2024-09-05T01:24:41.600055+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:06:00.000162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'50","reported_seq":118,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.891730+0000","last_change":"2024-09-05T01:23:23.206601+0000","last_active":"2024-09-05T01:24:41.891730+0000","last_peered":"2024-09-05T01:24:41.891730+0000","last_clean":"2024-09-05T01:24:41.891730+0000","last_became_active":"2024-09-05T01:23:23.195519+0000","last_became_peered":"2024-09-05T01:23:23.195519+0000","last_unstale":"2024-09-05T01:24:41.891730+0000","last_undegraded":"2024-09-05T01:24:41.891730+0000","last_fullsized":"2024-09-05T01:24:41.891730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:16:51.359980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":89,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.603443+0000","last_change":"2024-09-05T01:22:35.038184+0000","last_active":"2024-09-05T01:24:41.603443+0000","last_peered":"2024-09-05T01:24:41.603443+0000","last_clean":"2024-09-05T01:24:41.603443+0000","last_became_active":"2024-09-05T01:22:35.036702+0000","last_became_peered":"2024-09-05T01:22:35.036702+0000","last_unstale":"2024-09-05T01:24:41.603443+0000","last_undegraded":"2024-09-05T01:24:41.603443+0000","last_fullsized":"2024-09-05T01:24:41.603443+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:43:53.813358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.840115+0000","last_change":"2024-09-05T01:22:32.663209+0000","last_active":"2024-09-05T01:24:41.840115+0000","last_peered":"2024-09-05T01:24:41.840115+0000","last_clean":"2024-09-05T01:24:41.840115+0000","last_became_active":"2024-09-05T01:22:32.662928+0000","last_became_peered":"2024-09-05T01:22:32.662928+0000","last_unstale":"2024-09-05T01:24:41.840115+0000","last_undegraded":"2024-09-05T01:24:41.840115+0000","last_fullsized":"2024-09-05T01:24:41.840115+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:10:57.677344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839692+0000","last_change":"2024-09-05T01:23:23.250471+0000","last_active":"2024-09-05T01:24:41.839692+0000","last_peered":"2024-09-05T01:24:41.839692+0000","last_clean":"2024-09-05T01:24:41.839692+0000","last_became_active":"2024-09-05T01:23:23.250020+0000","last_became_peered":"2024-09-05T01:23:23.250020+0000","last_unstale":"2024-09-05T01:24:41.839692+0000","last_undegraded":"2024-09-05T01:24:41.839692+0000","last_fullsized":"2024-09-05T01:24:41.839692+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:22:52.762922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838809+0000","last_change":"2024-09-05T01:22:33.064832+0000","last_active":"2024-09-05T01:24:41.838809+0000","last_peered":"2024-09-05T01:24:41.838809+0000","last_clean":"2024-09-05T01:24:41.838809+0000","last_became_active":"2024-09-05T01:22:33.064405+0000","last_became_peered":"2024-09-05T01:22:33.064405+0000","last_unstale":"2024-09-05T01:24:41.838809+0000","last_undegraded":"2024-09-05T01:24:41.838809+0000","last_fullsized":"2024-09-05T01:24:41.838809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:48:43.093325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949069+0000","last_change":"2024-09-05T01:22:35.030670+0000","last_active":"2024-09-05T01:24:41.949069+0000","last_peered":"2024-09-05T01:24:41.949069+0000","last_clean":"2024-09-05T01:24:41.949069+0000","last_became_active":"2024-09-05T01:22:35.030338+0000","last_became_peered":"2024-09-05T01:22:35.030338+0000","last_unstale":"2024-09-05T01:24:41.949069+0000","last_undegraded":"2024-09-05T01:24:41.949069+0000","last_fullsized":"2024-09-05T01:24:41.949069+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:22:51.832965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.601908+0000","last_change":"2024-09-05T01:22:32.612040+0000","last_active":"2024-09-05T01:24:41.601908+0000","last_peered":"2024-09-05T01:24:41.601908+0000","last_clean":"2024-09-05T01:24:41.601908+0000","last_became_active":"2024-09-05T01:22:32.610597+0000","last_became_peered":"2024-09-05T01:22:32.610597+0000","last_unstale":"2024-09-05T01:24:41.601908+0000","last_undegraded":"2024-09-05T01:24:41.601908+0000","last_fullsized":"2024-09-05T01:24:41.601908+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:06:31.624775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.706417+0000","last_change":"2024-09-05T01:22:35.036220+0000","last_active":"2024-09-05T01:24:41.706417+0000","last_peered":"2024-09-05T01:24:41.706417+0000","last_clean":"2024-09-05T01:24:41.706417+0000","last_became_active":"2024-09-05T01:22:35.035881+0000","last_became_peered":"2024-09-05T01:22:35.035881+0000","last_unstale":"2024-09-05T01:24:41.706417+0000","last_undegraded":"2024-09-05T01:24:41.706417+0000","last_fullsized":"2024-09-05T01:24:41.706417+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:12:03.104075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'4","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838126+0000","last_change":"2024-09-05T01:22:32.608922+0000","last_active":"2024-09-05T01:24:41.838126+0000","last_peered":"2024-09-05T01:24:41.838126+0000","last_clean":"2024-09-05T01:24:41.838126+0000","last_became_active":"2024-09-05T01:22:32.608453+0000","last_became_peered":"2024-09-05T01:22:32.608453+0000","last_unstale":"2024-09-05T01:24:41.838126+0000","last_undegraded":"2024-09-05T01:24:41.838126+0000","last_fullsized":"2024-09-05T01:24:41.838126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:03:41.947264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.602224+0000","last_change":"2024-09-05T01:22:35.047556+0000","last_active":"2024-09-05T01:24:41.602224+0000","last_peered":"2024-09-05T01:24:41.602224+0000","last_clean":"2024-09-05T01:24:41.602224+0000","last_became_active":"2024-09-05T01:22:35.046260+0000","last_became_peered":"2024-09-05T01:22:35.046260+0000","last_unstale":"2024-09-05T01:24:41.602224+0000","last_undegraded":"2024-09-05T01:24:41.602224+0000","last_fullsized":"2024-09-05T01:24:41.602224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:13:09.379906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949107+0000","last_change":"2024-09-05T01:22:32.612948+0000","last_active":"2024-09-05T01:24:41.949107+0000","last_peered":"2024-09-05T01:24:41.949107+0000","last_clean":"2024-09-05T01:24:41.949107+0000","last_became_active":"2024-09-05T01:22:32.612319+0000","last_became_peered":"2024-09-05T01:22:32.612319+0000","last_unstale":"2024-09-05T01:24:41.949107+0000","last_undegraded":"2024-09-05T01:24:41.949107+0000","last_fullsized":"2024-09-05T01:24:41.949107+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:17:56.068106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838550+0000","last_change":"2024-09-05T01:22:35.036218+0000","last_active":"2024-09-05T01:24:41.838550+0000","last_peered":"2024-09-05T01:24:41.838550+0000","last_clean":"2024-09-05T01:24:41.838550+0000","last_became_active":"2024-09-05T01:22:35.035180+0000","last_became_peered":"2024-09-05T01:22:35.035180+0000","last_unstale":"2024-09-05T01:24:41.838550+0000","last_undegraded":"2024-09-05T01:24:41.838550+0000","last_fullsized":"2024-09-05T01:24:41.838550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:37:13.936829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.601818+0000","last_change":"2024-09-05T01:22:35.039616+0000","last_active":"2024-09-05T01:24:41.601818+0000","last_peered":"2024-09-05T01:24:41.601818+0000","last_clean":"2024-09-05T01:24:41.601818+0000","last_became_active":"2024-09-05T01:22:35.039297+0000","last_became_peered":"2024-09-05T01:22:35.039297+0000","last_unstale":"2024-09-05T01:24:41.601818+0000","last_undegraded":"2024-09-05T01:24:41.601818+0000","last_fullsized":"2024-09-05T01:24:41.601818+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:24:44.703168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949305+0000","last_change":"2024-09-05T01:22:32.609792+0000","last_active":"2024-09-05T01:24:41.949305+0000","last_peered":"2024-09-05T01:24:41.949305+0000","last_clean":"2024-09-05T01:24:41.949305+0000","last_became_active":"2024-09-05T01:22:32.609361+0000","last_became_peered":"2024-09-05T01:22:32.609361+0000","last_unstale":"2024-09-05T01:24:41.949305+0000","last_undegraded":"2024-09-05T01:24:41.949305+0000","last_fullsized":"2024-09-05T01:24:41.949305+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:05:15.105759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838871+0000","last_change":"2024-09-05T01:22:35.038792+0000","last_active":"2024-09-05T01:24:41.838871+0000","last_peered":"2024-09-05T01:24:41.838871+0000","last_clean":"2024-09-05T01:24:41.838871+0000","last_became_active":"2024-09-05T01:22:35.038129+0000","last_became_peered":"2024-09-05T01:22:35.038129+0000","last_unstale":"2024-09-05T01:24:41.838871+0000","last_undegraded":"2024-09-05T01:24:41.838871+0000","last_fullsized":"2024-09-05T01:24:41.838871+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:39:31.020488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'12","reported_seq":63,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949410+0000","last_change":"2024-09-05T01:23:23.208083+0000","last_active":"2024-09-05T01:24:41.949410+0000","last_peered":"2024-09-05T01:24:41.949410+0000","last_clean":"2024-09-05T01:24:41.949410+0000","last_became_active":"2024-09-05T01:23:23.194847+0000","last_became_peered":"2024-09-05T01:23:23.194847+0000","last_unstale":"2024-09-05T01:24:41.949410+0000","last_undegraded":"2024-09-05T01:24:41.949410+0000","last_fullsized":"2024-09-05T01:24:41.949410+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:09:16.923894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.840974+0000","last_change":"2024-09-05T01:22:35.045174+0000","last_active":"2024-09-05T01:24:41.840974+0000","last_peered":"2024-09-05T01:24:41.840974+0000","last_clean":"2024-09-05T01:24:41.840974+0000","last_became_active":"2024-09-05T01:22:35.041750+0000","last_became_peered":"2024-09-05T01:22:35.041750+0000","last_unstale":"2024-09-05T01:24:41.840974+0000","last_undegraded":"2024-09-05T01:24:41.840974+0000","last_fullsized":"2024-09-05T01:24:41.840974+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:34:00.174324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.603169+0000","last_change":"2024-09-05T01:22:33.065150+0000","last_active":"2024-09-05T01:24:41.603169+0000","last_peered":"2024-09-05T01:24:41.603169+0000","last_clean":"2024-09-05T01:24:41.603169+0000","last_became_active":"2024-09-05T01:22:33.064456+0000","last_became_peered":"2024-09-05T01:22:33.064456+0000","last_unstale":"2024-09-05T01:24:41.603169+0000","last_undegraded":"2024-09-05T01:24:41.603169+0000","last_fullsized":"2024-09-05T01:24:41.603169+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:16:20.879893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.602947+0000","last_change":"2024-09-05T01:22:35.043158+0000","last_active":"2024-09-05T01:24:41.602947+0000","last_peered":"2024-09-05T01:24:41.602947+0000","last_clean":"2024-09-05T01:24:41.602947+0000","last_became_active":"2024-09-05T01:22:35.038666+0000","last_became_peered":"2024-09-05T01:22:35.038666+0000","last_unstale":"2024-09-05T01:24:41.602947+0000","last_undegraded":"2024-09-05T01:24:41.602947+0000","last_fullsized":"2024-09-05T01:24:41.602947+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:44:18.551980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"86'15","reported_seq":160,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:42.029930+0000","last_change":"2024-09-05T01:22:32.613713+0000","last_active":"2024-09-05T01:24:42.029930+0000","last_peered":"2024-09-05T01:24:42.029930+0000","last_clean":"2024-09-05T01:24:42.029930+0000","last_became_active":"2024-09-05T01:22:32.613284+0000","last_became_peered":"2024-09-05T01:22:32.613284+0000","last_unstale":"2024-09-05T01:24:42.029930+0000","last_undegraded":"2024-09-05T01:24:42.029930+0000","last_fullsized":"2024-09-05T01:24:42.029930+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:39:46.881635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":601975,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1262,"num_read_kb":765,"num_write":382,"num_write_kb":1471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":1282,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2174976,"data_stored":1805925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307,"ondisk_log_size":307,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547239,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28360,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716792,"statfs":{"total":95995035648,"available":95965995008,"internally_reserved":0,"allocated":1363968,"data_stored":858133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776172,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32948,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712204,"statfs":{"total":95995035648,"available":95961296896,"internally_reserved":0,"allocated":1806336,"data_stored":1255138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939697,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36696,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708456,"statfs":{"total":95995035648,"available":95957458944,"internally_reserved":0,"allocated":1380352,"data_stored":857165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168631,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":974848,"data_stored":464215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397564,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1581056,"data_stored":1058367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561089,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":970752,"data_stored":464200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790022,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28712,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716440,"statfs":{"total":95995035648,"available":95965634560,"internally_reserved":0,"allocated":1728512,"data_stored":1188266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953548,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":978944,"data_stored":467114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182480,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":988307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":516929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1040384,"data_stored":532365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":991232,"data_stored":465005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":134954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":201826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":395306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T01:24:46.826 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-05T01:24:46.827 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-05T01:24:47.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.028+0000 7f5382c00640 1 -- 172.21.15.12:0/3635923942 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f537c101b30 msgr2=0x7f537c101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:47.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.028+0000 7f5382c00640 1 --2- 172.21.15.12:0/3635923942 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f537c101b30 0x7f537c101f30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f536c009860 tx=0x7f536c02a340 comp rx=0 tx=0).stop 2024-09-05T01:24:47.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.028+0000 7f5382c00640 1 -- 172.21.15.12:0/3635923942 shutdown_connections 2024-09-05T01:24:47.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.028+0000 7f5382c00640 1 --2- 172.21.15.12:0/3635923942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f537c1036e0 0x7f537c109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:47.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.028+0000 7f5382c00640 1 --2- 172.21.15.12:0/3635923942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f537c102d20 0x7f537c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:47.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.028+0000 7f5382c00640 1 --2- 172.21.15.12:0/3635923942 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f537c101b30 0x7f537c101f30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:47.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.028+0000 7f5382c00640 1 -- 172.21.15.12:0/3635923942 >> 172.21.15.12:0/3635923942 conn(0x7f537c0fd2b0 msgr2=0x7f537c0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:47.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.028+0000 7f5382c00640 1 -- 172.21.15.12:0/3635923942 shutdown_connections 2024-09-05T01:24:47.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.028+0000 7f5382c00640 1 -- 172.21.15.12:0/3635923942 wait complete. 2024-09-05T01:24:47.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.029+0000 7f5382c00640 1 Processor -- start 2024-09-05T01:24:47.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.029+0000 7f5382c00640 1 -- start start 2024-09-05T01:24:47.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.030+0000 7f5382c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f537c101b30 0x7f537c19a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:47.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.030+0000 7f5382c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f537c102d20 0x7f537c19a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:47.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.030+0000 7f5382c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f537c1036e0 0x7f537c1a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:47.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.030+0000 7f5382c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f537c10d790 con 0x7f537c1036e0 2024-09-05T01:24:47.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.030+0000 7f5382c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f537c10d610 con 0x7f537c101b30 2024-09-05T01:24:47.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.030+0000 7f5382c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f537c10d910 con 0x7f537c102d20 2024-09-05T01:24:47.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.030+0000 7f537be00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f537c101b30 0x7f537c19a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:47.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.030+0000 7f537b400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f537c102d20 0x7f537c19a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:47.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.030+0000 7f537be00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f537c101b30 0x7f537c19a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:60494/0 (socket says 172.21.15.12:60494) 2024-09-05T01:24:47.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.030+0000 7f537be00640 1 -- 172.21.15.12:0/2347351664 learned_addr learned my addr 172.21.15.12:0/2347351664 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:47.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.030+0000 7f5380c00640 1 --2- 172.21.15.12:0/2347351664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f537c1036e0 0x7f537c1a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:47.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.030+0000 7f537be00640 1 -- 172.21.15.12:0/2347351664 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f537c102d20 msgr2=0x7f537c19a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:47.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.030+0000 7f537be00640 1 --2- 172.21.15.12:0/2347351664 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f537c102d20 0x7f537c19a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:47.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.030+0000 7f537be00640 1 -- 172.21.15.12:0/2347351664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f537c1036e0 msgr2=0x7f537c1a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:47.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.030+0000 7f537be00640 1 --2- 172.21.15.12:0/2347351664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f537c1036e0 0x7f537c1a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:47.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.030+0000 7f537be00640 1 -- 172.21.15.12:0/2347351664 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537c1a1cb0 con 0x7f537c101b30 2024-09-05T01:24:47.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.031+0000 7f537be00640 1 --2- 172.21.15.12:0/2347351664 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f537c101b30 0x7f537c19a090 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f536c035040 tx=0x7f536c033d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:47.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.031+0000 7f5378c00640 1 -- 172.21.15.12:0/2347351664 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c037040 con 0x7f537c101b30 2024-09-05T01:24:47.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.031+0000 7f5378c00640 1 -- 172.21.15.12:0/2347351664 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f536c030850 con 0x7f537c101b30 2024-09-05T01:24:47.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.031+0000 7f5382c00640 1 -- 172.21.15.12:0/2347351664 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f537c1a1f40 con 0x7f537c101b30 2024-09-05T01:24:47.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.031+0000 7f5378c00640 1 -- 172.21.15.12:0/2347351664 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536c004920 con 0x7f537c101b30 2024-09-05T01:24:47.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.031+0000 7f5382c00640 1 -- 172.21.15.12:0/2347351664 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f537c1a2350 con 0x7f537c101b30 2024-09-05T01:24:47.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.032+0000 7f5382c00640 1 -- 172.21.15.12:0/2347351664 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f537c1a2580 con 0x7f537c101b30 2024-09-05T01:24:47.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.034+0000 7f5378c00640 1 -- 172.21.15.12:0/2347351664 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f536c004050 con 0x7f537c101b30 2024-09-05T01:24:47.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.036+0000 7f5378c00640 1 --2- 172.21.15.12:0/2347351664 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f53600a2d90 0x7f53600a5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:47.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.036+0000 7f5378c00640 1 -- 172.21.15.12:0/2347351664 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f536c0ef600 con 0x7f537c101b30 2024-09-05T01:24:47.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.036+0000 7f537b400640 1 --2- 172.21.15.12:0/2347351664 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f53600a2d90 0x7f53600a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:47.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.037+0000 7f537b400640 1 --2- 172.21.15.12:0/2347351664 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f53600a2d90 0x7f53600a5250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f537c19b5a0 tx=0x7f5368009260 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:47.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.038+0000 7f5378c00640 1 -- 172.21.15.12:0/2347351664 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f536c0bc150 con 0x7f537c101b30 2024-09-05T01:24:47.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.264+0000 7f5382c00640 1 -- 172.21.15.12:0/2347351664 --> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f537c109cb0 con 0x7f53600a2d90 2024-09-05T01:24:47.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.271+0000 7f5378c00640 1 -- 172.21.15.12:0/2347351664 <== mgr.15138 v2:172.21.15.12:6800/3451745620 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257822 (secure 0 0 0) 0x7f537c109cb0 con 0x7f53600a2d90 2024-09-05T01:24:47.275 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:24:47.277 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-05T01:24:47.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.275+0000 7f5382c00640 1 -- 172.21.15.12:0/2347351664 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f53600a2d90 msgr2=0x7f53600a5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:47.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.275+0000 7f5382c00640 1 --2- 172.21.15.12:0/2347351664 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f53600a2d90 0x7f53600a5250 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f537c19b5a0 tx=0x7f5368009260 comp rx=0 tx=0).stop 2024-09-05T01:24:47.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.275+0000 7f5382c00640 1 -- 172.21.15.12:0/2347351664 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f537c101b30 msgr2=0x7f537c19a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:47.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.275+0000 7f5382c00640 1 --2- 172.21.15.12:0/2347351664 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f537c101b30 0x7f537c19a090 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f536c035040 tx=0x7f536c033d90 comp rx=0 tx=0).stop 2024-09-05T01:24:47.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.275+0000 7f5382c00640 1 -- 172.21.15.12:0/2347351664 shutdown_connections 2024-09-05T01:24:47.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.275+0000 7f5382c00640 1 --2- 172.21.15.12:0/2347351664 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f53600a2d90 0x7f53600a5250 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:47.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.275+0000 7f5382c00640 1 --2- 172.21.15.12:0/2347351664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f537c1036e0 0x7f537c1a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:47.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.275+0000 7f5382c00640 1 --2- 172.21.15.12:0/2347351664 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f537c102d20 0x7f537c19a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:47.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.275+0000 7f5382c00640 1 --2- 172.21.15.12:0/2347351664 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f537c101b30 0x7f537c19a090 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:47.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.275+0000 7f5382c00640 1 -- 172.21.15.12:0/2347351664 >> 172.21.15.12:0/2347351664 conn(0x7f537c0fd2b0 msgr2=0x7f537c108590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:47.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.276+0000 7f5382c00640 1 -- 172.21.15.12:0/2347351664 shutdown_connections 2024-09-05T01:24:47.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:47.276+0000 7f5382c00640 1 -- 172.21.15.12:0/2347351664 wait complete. 2024-09-05T01:24:47.295 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-05T01:24:45.615335+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1192577,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1398,"num_read_kb":884,"num_write":565,"num_write_kb":4411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":1182018,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":946,"ondisk_log_size":946,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376760,"kb_used_data":15000,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124565064,"statfs":{"total":1151940427776,"available":1151554625536,"internally_reserved":0,"allocated":15360000,"data_stored":9115204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.982018"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.706548+0000","last_change":"2024-09-05T01:22:35.038389+0000","last_active":"2024-09-05T01:24:41.706548+0000","last_peered":"2024-09-05T01:24:41.706548+0000","last_clean":"2024-09-05T01:24:41.706548+0000","last_became_active":"2024-09-05T01:22:35.037982+0000","last_became_peered":"2024-09-05T01:22:35.037982+0000","last_unstale":"2024-09-05T01:24:41.706548+0000","last_undegraded":"2024-09-05T01:24:41.706548+0000","last_fullsized":"2024-09-05T01:24:41.706548+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:23:33.802592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839568+0000","last_change":"2024-09-05T01:22:35.035340+0000","last_active":"2024-09-05T01:24:41.839568+0000","last_peered":"2024-09-05T01:24:41.839568+0000","last_clean":"2024-09-05T01:24:41.839568+0000","last_became_active":"2024-09-05T01:22:35.032871+0000","last_became_peered":"2024-09-05T01:22:35.032871+0000","last_unstale":"2024-09-05T01:24:41.839568+0000","last_undegraded":"2024-09-05T01:24:41.839568+0000","last_fullsized":"2024-09-05T01:24:41.839568+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:51:07.235915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.840354+0000","last_change":"2024-09-05T01:22:35.045443+0000","last_active":"2024-09-05T01:24:41.840354+0000","last_peered":"2024-09-05T01:24:41.840354+0000","last_clean":"2024-09-05T01:24:41.840354+0000","last_became_active":"2024-09-05T01:22:35.042342+0000","last_became_peered":"2024-09-05T01:22:35.042342+0000","last_unstale":"2024-09-05T01:24:41.840354+0000","last_undegraded":"2024-09-05T01:24:41.840354+0000","last_fullsized":"2024-09-05T01:24:41.840354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:42:46.878959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.840049+0000","last_change":"2024-09-05T01:22:35.041527+0000","last_active":"2024-09-05T01:24:41.840049+0000","last_peered":"2024-09-05T01:24:41.840049+0000","last_clean":"2024-09-05T01:24:41.840049+0000","last_became_active":"2024-09-05T01:22:35.041210+0000","last_became_peered":"2024-09-05T01:22:35.041210+0000","last_unstale":"2024-09-05T01:24:41.840049+0000","last_undegraded":"2024-09-05T01:24:41.840049+0000","last_fullsized":"2024-09-05T01:24:41.840049+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:22:28.770307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949039+0000","last_change":"2024-09-05T01:22:35.036810+0000","last_active":"2024-09-05T01:24:41.949039+0000","last_peered":"2024-09-05T01:24:41.949039+0000","last_clean":"2024-09-05T01:24:41.949039+0000","last_became_active":"2024-09-05T01:22:35.036435+0000","last_became_peered":"2024-09-05T01:22:35.036435+0000","last_unstale":"2024-09-05T01:24:41.949039+0000","last_undegraded":"2024-09-05T01:24:41.949039+0000","last_fullsized":"2024-09-05T01:24:41.949039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:41:43.649178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.715224+0000","last_change":"2024-09-05T01:22:35.039198+0000","last_active":"2024-09-05T01:24:41.715224+0000","last_peered":"2024-09-05T01:24:41.715224+0000","last_clean":"2024-09-05T01:24:41.715224+0000","last_became_active":"2024-09-05T01:22:35.038822+0000","last_became_peered":"2024-09-05T01:22:35.038822+0000","last_unstale":"2024-09-05T01:24:41.715224+0000","last_undegraded":"2024-09-05T01:24:41.715224+0000","last_fullsized":"2024-09-05T01:24:41.715224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:22:08.600927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838383+0000","last_change":"2024-09-05T01:22:35.034687+0000","last_active":"2024-09-05T01:24:41.838383+0000","last_peered":"2024-09-05T01:24:41.838383+0000","last_clean":"2024-09-05T01:24:41.838383+0000","last_became_active":"2024-09-05T01:22:35.034351+0000","last_became_peered":"2024-09-05T01:22:35.034351+0000","last_unstale":"2024-09-05T01:24:41.838383+0000","last_undegraded":"2024-09-05T01:24:41.838383+0000","last_fullsized":"2024-09-05T01:24:41.838383+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:38:27.311348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.703672+0000","last_change":"2024-09-05T01:23:23.250016+0000","last_active":"2024-09-05T01:24:41.703672+0000","last_peered":"2024-09-05T01:24:41.703672+0000","last_clean":"2024-09-05T01:24:41.703672+0000","last_became_active":"2024-09-05T01:23:23.249553+0000","last_became_peered":"2024-09-05T01:23:23.249553+0000","last_unstale":"2024-09-05T01:24:41.703672+0000","last_undegraded":"2024-09-05T01:24:41.703672+0000","last_fullsized":"2024-09-05T01:24:41.703672+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:06:32.460400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839596+0000","last_change":"2024-09-05T01:22:35.036394+0000","last_active":"2024-09-05T01:24:41.839596+0000","last_peered":"2024-09-05T01:24:41.839596+0000","last_clean":"2024-09-05T01:24:41.839596+0000","last_became_active":"2024-09-05T01:22:35.035990+0000","last_became_peered":"2024-09-05T01:22:35.035990+0000","last_unstale":"2024-09-05T01:24:41.839596+0000","last_undegraded":"2024-09-05T01:24:41.839596+0000","last_fullsized":"2024-09-05T01:24:41.839596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:42:18.870263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.715654+0000","last_change":"2024-09-05T01:22:35.033389+0000","last_active":"2024-09-05T01:24:41.715654+0000","last_peered":"2024-09-05T01:24:41.715654+0000","last_clean":"2024-09-05T01:24:41.715654+0000","last_became_active":"2024-09-05T01:22:35.033081+0000","last_became_peered":"2024-09-05T01:22:35.033081+0000","last_unstale":"2024-09-05T01:24:41.715654+0000","last_undegraded":"2024-09-05T01:24:41.715654+0000","last_fullsized":"2024-09-05T01:24:41.715654+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:53:08.266905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839098+0000","last_change":"2024-09-05T01:22:35.035768+0000","last_active":"2024-09-05T01:24:41.839098+0000","last_peered":"2024-09-05T01:24:41.839098+0000","last_clean":"2024-09-05T01:24:41.839098+0000","last_became_active":"2024-09-05T01:22:35.035456+0000","last_became_peered":"2024-09-05T01:22:35.035456+0000","last_unstale":"2024-09-05T01:24:41.839098+0000","last_undegraded":"2024-09-05T01:24:41.839098+0000","last_fullsized":"2024-09-05T01:24:41.839098+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:15:48.723816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.840030+0000","last_change":"2024-09-05T01:22:35.040720+0000","last_active":"2024-09-05T01:24:41.840030+0000","last_peered":"2024-09-05T01:24:41.840030+0000","last_clean":"2024-09-05T01:24:41.840030+0000","last_became_active":"2024-09-05T01:22:35.039617+0000","last_became_peered":"2024-09-05T01:22:35.039617+0000","last_unstale":"2024-09-05T01:24:41.840030+0000","last_undegraded":"2024-09-05T01:24:41.840030+0000","last_fullsized":"2024-09-05T01:24:41.840030+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:23:11.633617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.600017+0000","last_change":"2024-09-05T01:22:35.022096+0000","last_active":"2024-09-05T01:24:41.600017+0000","last_peered":"2024-09-05T01:24:41.600017+0000","last_clean":"2024-09-05T01:24:41.600017+0000","last_became_active":"2024-09-05T01:22:35.021707+0000","last_became_peered":"2024-09-05T01:22:35.021707+0000","last_unstale":"2024-09-05T01:24:41.600017+0000","last_undegraded":"2024-09-05T01:24:41.600017+0000","last_fullsized":"2024-09-05T01:24:41.600017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:50:35.035386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839490+0000","last_change":"2024-09-05T01:22:35.034481+0000","last_active":"2024-09-05T01:24:41.839490+0000","last_peered":"2024-09-05T01:24:41.839490+0000","last_clean":"2024-09-05T01:24:41.839490+0000","last_became_active":"2024-09-05T01:22:35.034145+0000","last_became_peered":"2024-09-05T01:22:35.034145+0000","last_unstale":"2024-09-05T01:24:41.839490+0000","last_undegraded":"2024-09-05T01:24:41.839490+0000","last_fullsized":"2024-09-05T01:24:41.839490+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:19:33.386981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839375+0000","last_change":"2024-09-05T01:23:23.195234+0000","last_active":"2024-09-05T01:24:41.839375+0000","last_peered":"2024-09-05T01:24:41.839375+0000","last_clean":"2024-09-05T01:24:41.839375+0000","last_became_active":"2024-09-05T01:23:23.194014+0000","last_became_peered":"2024-09-05T01:23:23.194014+0000","last_unstale":"2024-09-05T01:24:41.839375+0000","last_undegraded":"2024-09-05T01:24:41.839375+0000","last_fullsized":"2024-09-05T01:24:41.839375+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:05:38.517017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838720+0000","last_change":"2024-09-05T01:22:35.046517+0000","last_active":"2024-09-05T01:24:41.838720+0000","last_peered":"2024-09-05T01:24:41.838720+0000","last_clean":"2024-09-05T01:24:41.838720+0000","last_became_active":"2024-09-05T01:22:35.046230+0000","last_became_peered":"2024-09-05T01:22:35.046230+0000","last_unstale":"2024-09-05T01:24:41.838720+0000","last_undegraded":"2024-09-05T01:24:41.838720+0000","last_fullsized":"2024-09-05T01:24:41.838720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:16:49.672039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.706548+0000","last_change":"2024-09-05T01:22:35.041140+0000","last_active":"2024-09-05T01:24:41.706548+0000","last_peered":"2024-09-05T01:24:41.706548+0000","last_clean":"2024-09-05T01:24:41.706548+0000","last_became_active":"2024-09-05T01:22:35.040838+0000","last_became_peered":"2024-09-05T01:22:35.040838+0000","last_unstale":"2024-09-05T01:24:41.706548+0000","last_undegraded":"2024-09-05T01:24:41.706548+0000","last_fullsized":"2024-09-05T01:24:41.706548+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:47:55.730240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.703957+0000","last_change":"2024-09-05T01:22:35.036830+0000","last_active":"2024-09-05T01:24:41.703957+0000","last_peered":"2024-09-05T01:24:41.703957+0000","last_clean":"2024-09-05T01:24:41.703957+0000","last_became_active":"2024-09-05T01:22:35.036356+0000","last_became_peered":"2024-09-05T01:22:35.036356+0000","last_unstale":"2024-09-05T01:24:41.703957+0000","last_undegraded":"2024-09-05T01:24:41.703957+0000","last_fullsized":"2024-09-05T01:24:41.703957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:19:01.736301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838151+0000","last_change":"2024-09-05T01:22:35.036386+0000","last_active":"2024-09-05T01:24:41.838151+0000","last_peered":"2024-09-05T01:24:41.838151+0000","last_clean":"2024-09-05T01:24:41.838151+0000","last_became_active":"2024-09-05T01:22:35.036046+0000","last_became_peered":"2024-09-05T01:22:35.036046+0000","last_unstale":"2024-09-05T01:24:41.838151+0000","last_undegraded":"2024-09-05T01:24:41.838151+0000","last_fullsized":"2024-09-05T01:24:41.838151+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:19:37.861719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.706279+0000","last_change":"2024-09-05T01:22:35.041077+0000","last_active":"2024-09-05T01:24:41.706279+0000","last_peered":"2024-09-05T01:24:41.706279+0000","last_clean":"2024-09-05T01:24:41.706279+0000","last_became_active":"2024-09-05T01:22:35.040736+0000","last_became_peered":"2024-09-05T01:22:35.040736+0000","last_unstale":"2024-09-05T01:24:41.706279+0000","last_undegraded":"2024-09-05T01:24:41.706279+0000","last_fullsized":"2024-09-05T01:24:41.706279+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:30:54.670559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.600184+0000","last_change":"2024-09-05T01:22:35.047774+0000","last_active":"2024-09-05T01:24:41.600184+0000","last_peered":"2024-09-05T01:24:41.600184+0000","last_clean":"2024-09-05T01:24:41.600184+0000","last_became_active":"2024-09-05T01:22:35.047153+0000","last_became_peered":"2024-09-05T01:22:35.047153+0000","last_unstale":"2024-09-05T01:24:41.600184+0000","last_undegraded":"2024-09-05T01:24:41.600184+0000","last_fullsized":"2024-09-05T01:24:41.600184+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:07:02.189116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838935+0000","last_change":"2024-09-05T01:22:35.041346+0000","last_active":"2024-09-05T01:24:41.838935+0000","last_peered":"2024-09-05T01:24:41.838935+0000","last_clean":"2024-09-05T01:24:41.838935+0000","last_became_active":"2024-09-05T01:22:35.040282+0000","last_became_peered":"2024-09-05T01:22:35.040282+0000","last_unstale":"2024-09-05T01:24:41.838935+0000","last_undegraded":"2024-09-05T01:24:41.838935+0000","last_fullsized":"2024-09-05T01:24:41.838935+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:19:38.203479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.601624+0000","last_change":"2024-09-05T01:22:35.041780+0000","last_active":"2024-09-05T01:24:41.601624+0000","last_peered":"2024-09-05T01:24:41.601624+0000","last_clean":"2024-09-05T01:24:41.601624+0000","last_became_active":"2024-09-05T01:22:35.038453+0000","last_became_peered":"2024-09-05T01:22:35.038453+0000","last_unstale":"2024-09-05T01:24:41.601624+0000","last_undegraded":"2024-09-05T01:24:41.601624+0000","last_fullsized":"2024-09-05T01:24:41.601624+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:17:56.453627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.601680+0000","last_change":"2024-09-05T01:22:35.038699+0000","last_active":"2024-09-05T01:24:41.601680+0000","last_peered":"2024-09-05T01:24:41.601680+0000","last_clean":"2024-09-05T01:24:41.601680+0000","last_became_active":"2024-09-05T01:22:35.038349+0000","last_became_peered":"2024-09-05T01:22:35.038349+0000","last_unstale":"2024-09-05T01:24:41.601680+0000","last_undegraded":"2024-09-05T01:24:41.601680+0000","last_fullsized":"2024-09-05T01:24:41.601680+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:17:18.175643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.603332+0000","last_change":"2024-09-05T01:22:35.048281+0000","last_active":"2024-09-05T01:24:41.603332+0000","last_peered":"2024-09-05T01:24:41.603332+0000","last_clean":"2024-09-05T01:24:41.603332+0000","last_became_active":"2024-09-05T01:22:35.047211+0000","last_became_peered":"2024-09-05T01:22:35.047211+0000","last_unstale":"2024-09-05T01:24:41.603332+0000","last_undegraded":"2024-09-05T01:24:41.603332+0000","last_fullsized":"2024-09-05T01:24:41.603332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:40:43.196562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838291+0000","last_change":"2024-09-05T01:22:35.041215+0000","last_active":"2024-09-05T01:24:41.838291+0000","last_peered":"2024-09-05T01:24:41.838291+0000","last_clean":"2024-09-05T01:24:41.838291+0000","last_became_active":"2024-09-05T01:22:35.040156+0000","last_became_peered":"2024-09-05T01:22:35.040156+0000","last_unstale":"2024-09-05T01:24:41.838291+0000","last_undegraded":"2024-09-05T01:24:41.838291+0000","last_fullsized":"2024-09-05T01:24:41.838291+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:39:01.882674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.706412+0000","last_change":"2024-09-05T01:23:23.197568+0000","last_active":"2024-09-05T01:24:41.706412+0000","last_peered":"2024-09-05T01:24:41.706412+0000","last_clean":"2024-09-05T01:24:41.706412+0000","last_became_active":"2024-09-05T01:23:23.197132+0000","last_became_peered":"2024-09-05T01:23:23.197132+0000","last_unstale":"2024-09-05T01:24:41.706412+0000","last_undegraded":"2024-09-05T01:24:41.706412+0000","last_fullsized":"2024-09-05T01:24:41.706412+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:31:55.524687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.599878+0000","last_change":"2024-09-05T01:22:35.038147+0000","last_active":"2024-09-05T01:24:41.599878+0000","last_peered":"2024-09-05T01:24:41.599878+0000","last_clean":"2024-09-05T01:24:41.599878+0000","last_became_active":"2024-09-05T01:22:35.037772+0000","last_became_peered":"2024-09-05T01:22:35.037772+0000","last_unstale":"2024-09-05T01:24:41.599878+0000","last_undegraded":"2024-09-05T01:24:41.599878+0000","last_fullsized":"2024-09-05T01:24:41.599878+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:40:01.786788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839878+0000","last_change":"2024-09-05T01:22:35.049040+0000","last_active":"2024-09-05T01:24:41.839878+0000","last_peered":"2024-09-05T01:24:41.839878+0000","last_clean":"2024-09-05T01:24:41.839878+0000","last_became_active":"2024-09-05T01:22:35.048373+0000","last_became_peered":"2024-09-05T01:22:35.048373+0000","last_unstale":"2024-09-05T01:24:41.839878+0000","last_undegraded":"2024-09-05T01:24:41.839878+0000","last_fullsized":"2024-09-05T01:24:41.839878+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:32:17.316513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838001+0000","last_change":"2024-09-05T01:22:35.043531+0000","last_active":"2024-09-05T01:24:41.838001+0000","last_peered":"2024-09-05T01:24:41.838001+0000","last_clean":"2024-09-05T01:24:41.838001+0000","last_became_active":"2024-09-05T01:22:35.043145+0000","last_became_peered":"2024-09-05T01:22:35.043145+0000","last_unstale":"2024-09-05T01:24:41.838001+0000","last_undegraded":"2024-09-05T01:24:41.838001+0000","last_fullsized":"2024-09-05T01:24:41.838001+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:04:41.902738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838085+0000","last_change":"2024-09-05T01:22:35.037684+0000","last_active":"2024-09-05T01:24:41.838085+0000","last_peered":"2024-09-05T01:24:41.838085+0000","last_clean":"2024-09-05T01:24:41.838085+0000","last_became_active":"2024-09-05T01:22:35.037392+0000","last_became_peered":"2024-09-05T01:22:35.037392+0000","last_unstale":"2024-09-05T01:24:41.838085+0000","last_undegraded":"2024-09-05T01:24:41.838085+0000","last_fullsized":"2024-09-05T01:24:41.838085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:12:37.705198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.706379+0000","last_change":"2024-09-05T01:22:35.036917+0000","last_active":"2024-09-05T01:24:41.706379+0000","last_peered":"2024-09-05T01:24:41.706379+0000","last_clean":"2024-09-05T01:24:41.706379+0000","last_became_active":"2024-09-05T01:22:35.036597+0000","last_became_peered":"2024-09-05T01:22:35.036597+0000","last_unstale":"2024-09-05T01:24:41.706379+0000","last_undegraded":"2024-09-05T01:24:41.706379+0000","last_fullsized":"2024-09-05T01:24:41.706379+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:25:46.472325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949036+0000","last_change":"2024-09-05T01:22:35.035858+0000","last_active":"2024-09-05T01:24:41.949036+0000","last_peered":"2024-09-05T01:24:41.949036+0000","last_clean":"2024-09-05T01:24:41.949036+0000","last_became_active":"2024-09-05T01:22:35.035075+0000","last_became_peered":"2024-09-05T01:22:35.035075+0000","last_unstale":"2024-09-05T01:24:41.949036+0000","last_undegraded":"2024-09-05T01:24:41.949036+0000","last_fullsized":"2024-09-05T01:24:41.949036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:49:42.487427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'7","reported_seq":155,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.602440+0000","last_change":"2024-09-05T01:22:32.615444+0000","last_active":"2024-09-05T01:24:41.602440+0000","last_peered":"2024-09-05T01:24:41.602440+0000","last_clean":"2024-09-05T01:24:41.602440+0000","last_became_active":"2024-09-05T01:22:32.615026+0000","last_became_peered":"2024-09-05T01:22:32.615026+0000","last_unstale":"2024-09-05T01:24:41.602440+0000","last_undegraded":"2024-09-05T01:24:41.602440+0000","last_fullsized":"2024-09-05T01:24:41.602440+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:52:51.410953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1156,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.602228+0000","last_change":"2024-09-05T01:22:35.039341+0000","last_active":"2024-09-05T01:24:41.602228+0000","last_peered":"2024-09-05T01:24:41.602228+0000","last_clean":"2024-09-05T01:24:41.602228+0000","last_became_active":"2024-09-05T01:22:35.038911+0000","last_became_peered":"2024-09-05T01:22:35.038911+0000","last_unstale":"2024-09-05T01:24:41.602228+0000","last_undegraded":"2024-09-05T01:24:41.602228+0000","last_fullsized":"2024-09-05T01:24:41.602228+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:18:41.735302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'7","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.715259+0000","last_change":"2024-09-05T01:22:32.610256+0000","last_active":"2024-09-05T01:24:41.715259+0000","last_peered":"2024-09-05T01:24:41.715259+0000","last_clean":"2024-09-05T01:24:41.715259+0000","last_became_active":"2024-09-05T01:22:32.609430+0000","last_became_peered":"2024-09-05T01:22:32.609430+0000","last_unstale":"2024-09-05T01:24:41.715259+0000","last_undegraded":"2024-09-05T01:24:41.715259+0000","last_fullsized":"2024-09-05T01:24:41.715259+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:00:13.171249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'3","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.599701+0000","last_change":"2024-09-05T01:22:32.609238+0000","last_active":"2024-09-05T01:24:41.599701+0000","last_peered":"2024-09-05T01:24:41.599701+0000","last_clean":"2024-09-05T01:24:41.599701+0000","last_became_active":"2024-09-05T01:22:32.608789+0000","last_became_peered":"2024-09-05T01:22:32.608789+0000","last_unstale":"2024-09-05T01:24:41.599701+0000","last_undegraded":"2024-09-05T01:24:41.599701+0000","last_fullsized":"2024-09-05T01:24:41.599701+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:01:55.536313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.601558+0000","last_change":"2024-09-05T01:22:35.048262+0000","last_active":"2024-09-05T01:24:41.601558+0000","last_peered":"2024-09-05T01:24:41.601558+0000","last_clean":"2024-09-05T01:24:41.601558+0000","last_became_active":"2024-09-05T01:22:35.046404+0000","last_became_peered":"2024-09-05T01:22:35.046404+0000","last_unstale":"2024-09-05T01:24:41.601558+0000","last_undegraded":"2024-09-05T01:24:41.601558+0000","last_fullsized":"2024-09-05T01:24:41.601558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:29:04.310095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'3","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.602241+0000","last_change":"2024-09-05T01:22:32.612116+0000","last_active":"2024-09-05T01:24:41.602241+0000","last_peered":"2024-09-05T01:24:41.602241+0000","last_clean":"2024-09-05T01:24:41.602241+0000","last_became_active":"2024-09-05T01:22:32.611794+0000","last_became_peered":"2024-09-05T01:22:32.611794+0000","last_unstale":"2024-09-05T01:24:41.602241+0000","last_undegraded":"2024-09-05T01:24:41.602241+0000","last_fullsized":"2024-09-05T01:24:41.602241+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:59:55.360151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.703802+0000","last_change":"2024-09-05T01:23:23.250108+0000","last_active":"2024-09-05T01:24:41.703802+0000","last_peered":"2024-09-05T01:24:41.703802+0000","last_clean":"2024-09-05T01:24:41.703802+0000","last_became_active":"2024-09-05T01:23:23.249698+0000","last_became_peered":"2024-09-05T01:23:23.249698+0000","last_unstale":"2024-09-05T01:24:41.703802+0000","last_undegraded":"2024-09-05T01:24:41.703802+0000","last_fullsized":"2024-09-05T01:24:41.703802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:55:45.998595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,10],"acting":[9,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'6","reported_seq":266,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:42.029823+0000","last_change":"2024-09-05T01:22:32.611558+0000","last_active":"2024-09-05T01:24:42.029823+0000","last_peered":"2024-09-05T01:24:42.029823+0000","last_clean":"2024-09-05T01:24:42.029823+0000","last_became_active":"2024-09-05T01:22:32.611194+0000","last_became_peered":"2024-09-05T01:22:32.611194+0000","last_unstale":"2024-09-05T01:24:42.029823+0000","last_undegraded":"2024-09-05T01:24:42.029823+0000","last_fullsized":"2024-09-05T01:24:42.029823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:47:30.586224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839373+0000","last_change":"2024-09-05T01:22:35.042010+0000","last_active":"2024-09-05T01:24:41.839373+0000","last_peered":"2024-09-05T01:24:41.839373+0000","last_clean":"2024-09-05T01:24:41.839373+0000","last_became_active":"2024-09-05T01:22:35.041451+0000","last_became_peered":"2024-09-05T01:22:35.041451+0000","last_unstale":"2024-09-05T01:24:41.839373+0000","last_undegraded":"2024-09-05T01:24:41.839373+0000","last_fullsized":"2024-09-05T01:24:41.839373+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:12:15.429065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'4","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838986+0000","last_change":"2024-09-05T01:22:32.612131+0000","last_active":"2024-09-05T01:24:41.838986+0000","last_peered":"2024-09-05T01:24:41.838986+0000","last_clean":"2024-09-05T01:24:41.838986+0000","last_became_active":"2024-09-05T01:22:32.611778+0000","last_became_peered":"2024-09-05T01:22:32.611778+0000","last_unstale":"2024-09-05T01:24:41.838986+0000","last_undegraded":"2024-09-05T01:24:41.838986+0000","last_fullsized":"2024-09-05T01:24:41.838986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:18:21.930485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.840984+0000","last_change":"2024-09-05T01:22:35.047663+0000","last_active":"2024-09-05T01:24:41.840984+0000","last_peered":"2024-09-05T01:24:41.840984+0000","last_clean":"2024-09-05T01:24:41.840984+0000","last_became_active":"2024-09-05T01:22:35.047078+0000","last_became_peered":"2024-09-05T01:22:35.047078+0000","last_unstale":"2024-09-05T01:24:41.840984+0000","last_undegraded":"2024-09-05T01:24:41.840984+0000","last_fullsized":"2024-09-05T01:24:41.840984+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:25:44.992459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.602055+0000","last_change":"2024-09-05T01:22:33.064617+0000","last_active":"2024-09-05T01:24:41.602055+0000","last_peered":"2024-09-05T01:24:41.602055+0000","last_clean":"2024-09-05T01:24:41.602055+0000","last_became_active":"2024-09-05T01:22:33.064265+0000","last_became_peered":"2024-09-05T01:22:33.064265+0000","last_unstale":"2024-09-05T01:24:41.602055+0000","last_undegraded":"2024-09-05T01:24:41.602055+0000","last_fullsized":"2024-09-05T01:24:41.602055+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:43:57.315764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838950+0000","last_change":"2024-09-05T01:22:35.047109+0000","last_active":"2024-09-05T01:24:41.838950+0000","last_peered":"2024-09-05T01:24:41.838950+0000","last_clean":"2024-09-05T01:24:41.838950+0000","last_became_active":"2024-09-05T01:22:35.046806+0000","last_became_peered":"2024-09-05T01:22:35.046806+0000","last_unstale":"2024-09-05T01:24:41.838950+0000","last_undegraded":"2024-09-05T01:24:41.838950+0000","last_fullsized":"2024-09-05T01:24:41.838950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:19:42.743038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'36","reported_seq":307,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:42.031130+0000","last_change":"2024-09-05T01:22:32.610883+0000","last_active":"2024-09-05T01:24:42.031130+0000","last_peered":"2024-09-05T01:24:42.031130+0000","last_clean":"2024-09-05T01:24:42.031130+0000","last_became_active":"2024-09-05T01:22:32.610530+0000","last_became_peered":"2024-09-05T01:22:32.610530+0000","last_unstale":"2024-09-05T01:24:42.031130+0000","last_undegraded":"2024-09-05T01:24:42.031130+0000","last_fullsized":"2024-09-05T01:24:42.031130+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:51:01.111529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66859,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":243,"num_read_kb":186,"num_write":38,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949361+0000","last_change":"2024-09-05T01:22:35.032397+0000","last_active":"2024-09-05T01:24:41.949361+0000","last_peered":"2024-09-05T01:24:41.949361+0000","last_clean":"2024-09-05T01:24:41.949361+0000","last_became_active":"2024-09-05T01:22:35.032073+0000","last_became_peered":"2024-09-05T01:22:35.032073+0000","last_unstale":"2024-09-05T01:24:41.949361+0000","last_undegraded":"2024-09-05T01:24:41.949361+0000","last_fullsized":"2024-09-05T01:24:41.949361+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:36:02.866390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'9","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838150+0000","last_change":"2024-09-05T01:22:32.610247+0000","last_active":"2024-09-05T01:24:41.838150+0000","last_peered":"2024-09-05T01:24:41.838150+0000","last_clean":"2024-09-05T01:24:41.838150+0000","last_became_active":"2024-09-05T01:22:32.609881+0000","last_became_peered":"2024-09-05T01:22:32.609881+0000","last_unstale":"2024-09-05T01:24:41.838150+0000","last_undegraded":"2024-09-05T01:24:41.838150+0000","last_fullsized":"2024-09-05T01:24:41.838150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T07:40:39.835208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.599790+0000","last_change":"2024-09-05T01:22:35.041923+0000","last_active":"2024-09-05T01:24:41.599790+0000","last_peered":"2024-09-05T01:24:41.599790+0000","last_clean":"2024-09-05T01:24:41.599790+0000","last_became_active":"2024-09-05T01:22:35.041439+0000","last_became_peered":"2024-09-05T01:22:35.041439+0000","last_unstale":"2024-09-05T01:24:41.599790+0000","last_undegraded":"2024-09-05T01:24:41.599790+0000","last_fullsized":"2024-09-05T01:24:41.599790+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:36:56.545466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.601741+0000","last_change":"2024-09-05T01:22:32.611274+0000","last_active":"2024-09-05T01:24:41.601741+0000","last_peered":"2024-09-05T01:24:41.601741+0000","last_clean":"2024-09-05T01:24:41.601741+0000","last_became_active":"2024-09-05T01:22:32.610853+0000","last_became_peered":"2024-09-05T01:22:32.610853+0000","last_unstale":"2024-09-05T01:24:41.601741+0000","last_undegraded":"2024-09-05T01:24:41.601741+0000","last_fullsized":"2024-09-05T01:24:41.601741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:01:38.058836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838564+0000","last_change":"2024-09-05T01:22:35.040116+0000","last_active":"2024-09-05T01:24:41.838564+0000","last_peered":"2024-09-05T01:24:41.838564+0000","last_clean":"2024-09-05T01:24:41.838564+0000","last_became_active":"2024-09-05T01:22:35.037663+0000","last_became_peered":"2024-09-05T01:22:35.037663+0000","last_unstale":"2024-09-05T01:24:41.838564+0000","last_undegraded":"2024-09-05T01:24:41.838564+0000","last_fullsized":"2024-09-05T01:24:41.838564+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:16:37.309205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'10","reported_seq":160,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:42.030656+0000","last_change":"2024-09-05T01:22:32.612334+0000","last_active":"2024-09-05T01:24:42.030656+0000","last_peered":"2024-09-05T01:24:42.030656+0000","last_clean":"2024-09-05T01:24:42.030656+0000","last_became_active":"2024-09-05T01:22:32.612008+0000","last_became_peered":"2024-09-05T01:22:32.612008+0000","last_unstale":"2024-09-05T01:24:42.030656+0000","last_undegraded":"2024-09-05T01:24:42.030656+0000","last_fullsized":"2024-09-05T01:24:42.030656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:31:05.580219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2219,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":7,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838348+0000","last_change":"2024-09-05T01:22:35.037034+0000","last_active":"2024-09-05T01:24:41.838348+0000","last_peered":"2024-09-05T01:24:41.838348+0000","last_clean":"2024-09-05T01:24:41.838348+0000","last_became_active":"2024-09-05T01:22:35.036643+0000","last_became_peered":"2024-09-05T01:22:35.036643+0000","last_unstale":"2024-09-05T01:24:41.838348+0000","last_undegraded":"2024-09-05T01:24:41.838348+0000","last_fullsized":"2024-09-05T01:24:41.838348+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:41:24.073298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'17","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.706202+0000","last_change":"2024-09-05T01:24:23.306662+0000","last_active":"2024-09-05T01:24:41.706202+0000","last_peered":"2024-09-05T01:24:41.706202+0000","last_clean":"2024-09-05T01:24:41.706202+0000","last_became_active":"2024-09-05T01:24:23.295595+0000","last_became_peered":"2024-09-05T01:24:23.295595+0000","last_unstale":"2024-09-05T01:24:41.706202+0000","last_undegraded":"2024-09-05T01:24:41.706202+0000","last_fullsized":"2024-09-05T01:24:41.706202+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:55:06.973543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.601748+0000","last_change":"2024-09-05T01:22:35.039866+0000","last_active":"2024-09-05T01:24:41.601748+0000","last_peered":"2024-09-05T01:24:41.601748+0000","last_clean":"2024-09-05T01:24:41.601748+0000","last_became_active":"2024-09-05T01:22:35.039493+0000","last_became_peered":"2024-09-05T01:22:35.039493+0000","last_unstale":"2024-09-05T01:24:41.601748+0000","last_undegraded":"2024-09-05T01:24:41.601748+0000","last_fullsized":"2024-09-05T01:24:41.601748+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:39:20.036455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'4","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949403+0000","last_change":"2024-09-05T01:22:32.610948+0000","last_active":"2024-09-05T01:24:41.949403+0000","last_peered":"2024-09-05T01:24:41.949403+0000","last_clean":"2024-09-05T01:24:41.949403+0000","last_became_active":"2024-09-05T01:22:32.610596+0000","last_became_peered":"2024-09-05T01:22:32.610596+0000","last_unstale":"2024-09-05T01:24:41.949403+0000","last_undegraded":"2024-09-05T01:24:41.949403+0000","last_fullsized":"2024-09-05T01:24:41.949403+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:36:25.589705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.706548+0000","last_change":"2024-09-05T01:23:23.196770+0000","last_active":"2024-09-05T01:24:41.706548+0000","last_peered":"2024-09-05T01:24:41.706548+0000","last_clean":"2024-09-05T01:24:41.706548+0000","last_became_active":"2024-09-05T01:23:23.196495+0000","last_became_peered":"2024-09-05T01:23:23.196495+0000","last_unstale":"2024-09-05T01:24:41.706548+0000","last_undegraded":"2024-09-05T01:24:41.706548+0000","last_fullsized":"2024-09-05T01:24:41.706548+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:11:35.195038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7],"acting":[11,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'5","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.600237+0000","last_change":"2024-09-05T01:22:32.609555+0000","last_active":"2024-09-05T01:24:41.600237+0000","last_peered":"2024-09-05T01:24:41.600237+0000","last_clean":"2024-09-05T01:24:41.600237+0000","last_became_active":"2024-09-05T01:22:32.608448+0000","last_became_peered":"2024-09-05T01:22:32.608448+0000","last_unstale":"2024-09-05T01:24:41.600237+0000","last_undegraded":"2024-09-05T01:24:41.600237+0000","last_fullsized":"2024-09-05T01:24:41.600237+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:13:27.724664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839189+0000","last_change":"2024-09-05T01:22:35.033418+0000","last_active":"2024-09-05T01:24:41.839189+0000","last_peered":"2024-09-05T01:24:41.839189+0000","last_clean":"2024-09-05T01:24:41.839189+0000","last_became_active":"2024-09-05T01:22:35.033096+0000","last_became_peered":"2024-09-05T01:22:35.033096+0000","last_unstale":"2024-09-05T01:24:41.839189+0000","last_undegraded":"2024-09-05T01:24:41.839189+0000","last_fullsized":"2024-09-05T01:24:41.839189+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:09:06.723427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'41","reported_seq":77,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.883481+0000","last_change":"2024-09-05T01:22:32.609821+0000","last_active":"2024-09-05T01:24:41.883481+0000","last_peered":"2024-09-05T01:24:41.883481+0000","last_clean":"2024-09-05T01:24:41.883481+0000","last_became_active":"2024-09-05T01:22:32.608932+0000","last_became_peered":"2024-09-05T01:22:32.608932+0000","last_unstale":"2024-09-05T01:24:41.883481+0000","last_undegraded":"2024-09-05T01:24:41.883481+0000","last_fullsized":"2024-09-05T01:24:41.883481+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:45:19.964263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838880+0000","last_change":"2024-09-05T01:22:35.037965+0000","last_active":"2024-09-05T01:24:41.838880+0000","last_peered":"2024-09-05T01:24:41.838880+0000","last_clean":"2024-09-05T01:24:41.838880+0000","last_became_active":"2024-09-05T01:22:35.037541+0000","last_became_peered":"2024-09-05T01:22:35.037541+0000","last_unstale":"2024-09-05T01:24:41.838880+0000","last_undegraded":"2024-09-05T01:24:41.838880+0000","last_fullsized":"2024-09-05T01:24:41.838880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:43:29.098517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'7","reported_seq":108,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:42.287528+0000","last_change":"2024-09-05T01:23:23.200721+0000","last_active":"2024-09-05T01:24:42.287528+0000","last_peered":"2024-09-05T01:24:42.287528+0000","last_clean":"2024-09-05T01:24:42.287528+0000","last_became_active":"2024-09-05T01:23:23.193780+0000","last_became_peered":"2024-09-05T01:23:23.193780+0000","last_unstale":"2024-09-05T01:24:42.287528+0000","last_undegraded":"2024-09-05T01:24:42.287528+0000","last_fullsized":"2024-09-05T01:24:42.287528+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T01:47:56.617158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1956,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1170,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839223+0000","last_change":"2024-09-05T01:22:35.035868+0000","last_active":"2024-09-05T01:24:41.839223+0000","last_peered":"2024-09-05T01:24:41.839223+0000","last_clean":"2024-09-05T01:24:41.839223+0000","last_became_active":"2024-09-05T01:22:35.035495+0000","last_became_peered":"2024-09-05T01:22:35.035495+0000","last_unstale":"2024-09-05T01:24:41.839223+0000","last_undegraded":"2024-09-05T01:24:41.839223+0000","last_fullsized":"2024-09-05T01:24:41.839223+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:13:25.679973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":351,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838523+0000","last_change":"2024-09-05T01:21:17.107509+0000","last_active":"2024-09-05T01:24:41.838523+0000","last_peered":"2024-09-05T01:24:41.838523+0000","last_clean":"2024-09-05T01:24:41.838523+0000","last_became_active":"2024-09-05T01:21:17.107063+0000","last_became_peered":"2024-09-05T01:21:17.107063+0000","last_unstale":"2024-09-05T01:24:41.838523+0000","last_undegraded":"2024-09-05T01:24:41.838523+0000","last_fullsized":"2024-09-05T01:24:41.838523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:17:44.744654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:17:44.744654+0000","last_clean_scrub_stamp":"2024-09-05T01:17:44.744654+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:14:18.603051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'6","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.840082+0000","last_change":"2024-09-05T01:22:32.610686+0000","last_active":"2024-09-05T01:24:41.840082+0000","last_peered":"2024-09-05T01:24:41.840082+0000","last_clean":"2024-09-05T01:24:41.840082+0000","last_became_active":"2024-09-05T01:22:32.610248+0000","last_became_peered":"2024-09-05T01:22:32.610248+0000","last_unstale":"2024-09-05T01:24:41.840082+0000","last_undegraded":"2024-09-05T01:24:41.840082+0000","last_fullsized":"2024-09-05T01:24:41.840082+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:14:09.468772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.602009+0000","last_change":"2024-09-05T01:22:35.044346+0000","last_active":"2024-09-05T01:24:41.602009+0000","last_peered":"2024-09-05T01:24:41.602009+0000","last_clean":"2024-09-05T01:24:41.602009+0000","last_became_active":"2024-09-05T01:22:35.043977+0000","last_became_peered":"2024-09-05T01:22:35.043977+0000","last_unstale":"2024-09-05T01:24:41.602009+0000","last_undegraded":"2024-09-05T01:24:41.602009+0000","last_fullsized":"2024-09-05T01:24:41.602009+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:03:33.007905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'4","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838533+0000","last_change":"2024-09-05T01:22:32.615120+0000","last_active":"2024-09-05T01:24:41.838533+0000","last_peered":"2024-09-05T01:24:41.838533+0000","last_clean":"2024-09-05T01:24:41.838533+0000","last_became_active":"2024-09-05T01:22:32.614671+0000","last_became_peered":"2024-09-05T01:22:32.614671+0000","last_unstale":"2024-09-05T01:24:41.838533+0000","last_undegraded":"2024-09-05T01:24:41.838533+0000","last_fullsized":"2024-09-05T01:24:41.838533+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T13:00:00.134610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.599752+0000","last_change":"2024-09-05T01:22:35.035840+0000","last_active":"2024-09-05T01:24:41.599752+0000","last_peered":"2024-09-05T01:24:41.599752+0000","last_clean":"2024-09-05T01:24:41.599752+0000","last_became_active":"2024-09-05T01:22:35.035511+0000","last_became_peered":"2024-09-05T01:22:35.035511+0000","last_unstale":"2024-09-05T01:24:41.599752+0000","last_undegraded":"2024-09-05T01:24:41.599752+0000","last_fullsized":"2024-09-05T01:24:41.599752+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:30:01.929816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"85'7","reported_seq":153,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:42.030142+0000","last_change":"2024-09-05T01:22:33.064281+0000","last_active":"2024-09-05T01:24:42.030142+0000","last_peered":"2024-09-05T01:24:42.030142+0000","last_clean":"2024-09-05T01:24:42.030142+0000","last_became_active":"2024-09-05T01:22:33.063792+0000","last_became_peered":"2024-09-05T01:22:33.063792+0000","last_unstale":"2024-09-05T01:24:42.030142+0000","last_undegraded":"2024-09-05T01:24:42.030142+0000","last_fullsized":"2024-09-05T01:24:42.030142+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:44:19.558140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.602034+0000","last_change":"2024-09-05T01:22:35.035336+0000","last_active":"2024-09-05T01:24:41.602034+0000","last_peered":"2024-09-05T01:24:41.602034+0000","last_clean":"2024-09-05T01:24:41.602034+0000","last_became_active":"2024-09-05T01:22:35.034976+0000","last_became_peered":"2024-09-05T01:22:35.034976+0000","last_unstale":"2024-09-05T01:24:41.602034+0000","last_undegraded":"2024-09-05T01:24:41.602034+0000","last_fullsized":"2024-09-05T01:24:41.602034+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T08:51:57.850225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"86'8","reported_seq":156,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:42.031156+0000","last_change":"2024-09-05T01:22:32.614203+0000","last_active":"2024-09-05T01:24:42.031156+0000","last_peered":"2024-09-05T01:24:42.031156+0000","last_clean":"2024-09-05T01:24:42.031156+0000","last_became_active":"2024-09-05T01:22:32.613774+0000","last_became_peered":"2024-09-05T01:22:32.613774+0000","last_unstale":"2024-09-05T01:24:42.031156+0000","last_undegraded":"2024-09-05T01:24:42.031156+0000","last_fullsized":"2024-09-05T01:24:42.031156+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:52:05.383835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1515,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.715359+0000","last_change":"2024-09-05T01:22:35.042770+0000","last_active":"2024-09-05T01:24:41.715359+0000","last_peered":"2024-09-05T01:24:41.715359+0000","last_clean":"2024-09-05T01:24:41.715359+0000","last_became_active":"2024-09-05T01:22:35.042338+0000","last_became_peered":"2024-09-05T01:22:35.042338+0000","last_unstale":"2024-09-05T01:24:41.715359+0000","last_undegraded":"2024-09-05T01:24:41.715359+0000","last_fullsized":"2024-09-05T01:24:41.715359+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T04:02:35.669717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"81'1","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.704254+0000","last_change":"2024-09-05T01:22:33.065134+0000","last_active":"2024-09-05T01:24:41.704254+0000","last_peered":"2024-09-05T01:24:41.704254+0000","last_clean":"2024-09-05T01:24:41.704254+0000","last_became_active":"2024-09-05T01:22:33.064685+0000","last_became_peered":"2024-09-05T01:22:33.064685+0000","last_unstale":"2024-09-05T01:24:41.704254+0000","last_undegraded":"2024-09-05T01:24:41.704254+0000","last_fullsized":"2024-09-05T01:24:41.704254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:03:00.976350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.715537+0000","last_change":"2024-09-05T01:22:35.035940+0000","last_active":"2024-09-05T01:24:41.715537+0000","last_peered":"2024-09-05T01:24:41.715537+0000","last_clean":"2024-09-05T01:24:41.715537+0000","last_became_active":"2024-09-05T01:22:35.035582+0000","last_became_peered":"2024-09-05T01:22:35.035582+0000","last_unstale":"2024-09-05T01:24:41.715537+0000","last_undegraded":"2024-09-05T01:24:41.715537+0000","last_fullsized":"2024-09-05T01:24:41.715537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:37:06.621512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'4","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949535+0000","last_change":"2024-09-05T01:22:33.064003+0000","last_active":"2024-09-05T01:24:41.949535+0000","last_peered":"2024-09-05T01:24:41.949535+0000","last_clean":"2024-09-05T01:24:41.949535+0000","last_became_active":"2024-09-05T01:22:33.063685+0000","last_became_peered":"2024-09-05T01:22:33.063685+0000","last_unstale":"2024-09-05T01:24:41.949535+0000","last_undegraded":"2024-09-05T01:24:41.949535+0000","last_fullsized":"2024-09-05T01:24:41.949535+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:49:03.742215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.600055+0000","last_change":"2024-09-05T01:22:35.034912+0000","last_active":"2024-09-05T01:24:41.600055+0000","last_peered":"2024-09-05T01:24:41.600055+0000","last_clean":"2024-09-05T01:24:41.600055+0000","last_became_active":"2024-09-05T01:22:35.034526+0000","last_became_peered":"2024-09-05T01:22:35.034526+0000","last_unstale":"2024-09-05T01:24:41.600055+0000","last_undegraded":"2024-09-05T01:24:41.600055+0000","last_fullsized":"2024-09-05T01:24:41.600055+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:06:00.000162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'50","reported_seq":118,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.891730+0000","last_change":"2024-09-05T01:23:23.206601+0000","last_active":"2024-09-05T01:24:41.891730+0000","last_peered":"2024-09-05T01:24:41.891730+0000","last_clean":"2024-09-05T01:24:41.891730+0000","last_became_active":"2024-09-05T01:23:23.195519+0000","last_became_peered":"2024-09-05T01:23:23.195519+0000","last_unstale":"2024-09-05T01:24:41.891730+0000","last_undegraded":"2024-09-05T01:24:41.891730+0000","last_fullsized":"2024-09-05T01:24:41.891730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:16:51.359980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":89,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.603443+0000","last_change":"2024-09-05T01:22:35.038184+0000","last_active":"2024-09-05T01:24:41.603443+0000","last_peered":"2024-09-05T01:24:41.603443+0000","last_clean":"2024-09-05T01:24:41.603443+0000","last_became_active":"2024-09-05T01:22:35.036702+0000","last_became_peered":"2024-09-05T01:22:35.036702+0000","last_unstale":"2024-09-05T01:24:41.603443+0000","last_undegraded":"2024-09-05T01:24:41.603443+0000","last_fullsized":"2024-09-05T01:24:41.603443+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:43:53.813358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'7","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.840115+0000","last_change":"2024-09-05T01:22:32.663209+0000","last_active":"2024-09-05T01:24:41.840115+0000","last_peered":"2024-09-05T01:24:41.840115+0000","last_clean":"2024-09-05T01:24:41.840115+0000","last_became_active":"2024-09-05T01:22:32.662928+0000","last_became_peered":"2024-09-05T01:22:32.662928+0000","last_unstale":"2024-09-05T01:24:41.840115+0000","last_undegraded":"2024-09-05T01:24:41.840115+0000","last_fullsized":"2024-09-05T01:24:41.840115+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:10:57.677344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":37,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.839692+0000","last_change":"2024-09-05T01:23:23.250471+0000","last_active":"2024-09-05T01:24:41.839692+0000","last_peered":"2024-09-05T01:24:41.839692+0000","last_clean":"2024-09-05T01:24:41.839692+0000","last_became_active":"2024-09-05T01:23:23.250020+0000","last_became_peered":"2024-09-05T01:23:23.250020+0000","last_unstale":"2024-09-05T01:24:41.839692+0000","last_undegraded":"2024-09-05T01:24:41.839692+0000","last_fullsized":"2024-09-05T01:24:41.839692+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:22:52.762922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838809+0000","last_change":"2024-09-05T01:22:33.064832+0000","last_active":"2024-09-05T01:24:41.838809+0000","last_peered":"2024-09-05T01:24:41.838809+0000","last_clean":"2024-09-05T01:24:41.838809+0000","last_became_active":"2024-09-05T01:22:33.064405+0000","last_became_peered":"2024-09-05T01:22:33.064405+0000","last_unstale":"2024-09-05T01:24:41.838809+0000","last_undegraded":"2024-09-05T01:24:41.838809+0000","last_fullsized":"2024-09-05T01:24:41.838809+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:48:43.093325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949069+0000","last_change":"2024-09-05T01:22:35.030670+0000","last_active":"2024-09-05T01:24:41.949069+0000","last_peered":"2024-09-05T01:24:41.949069+0000","last_clean":"2024-09-05T01:24:41.949069+0000","last_became_active":"2024-09-05T01:22:35.030338+0000","last_became_peered":"2024-09-05T01:22:35.030338+0000","last_unstale":"2024-09-05T01:24:41.949069+0000","last_undegraded":"2024-09-05T01:24:41.949069+0000","last_fullsized":"2024-09-05T01:24:41.949069+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:22:51.832965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.601908+0000","last_change":"2024-09-05T01:22:32.612040+0000","last_active":"2024-09-05T01:24:41.601908+0000","last_peered":"2024-09-05T01:24:41.601908+0000","last_clean":"2024-09-05T01:24:41.601908+0000","last_became_active":"2024-09-05T01:22:32.610597+0000","last_became_peered":"2024-09-05T01:22:32.610597+0000","last_unstale":"2024-09-05T01:24:41.601908+0000","last_undegraded":"2024-09-05T01:24:41.601908+0000","last_fullsized":"2024-09-05T01:24:41.601908+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:06:31.624775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.706417+0000","last_change":"2024-09-05T01:22:35.036220+0000","last_active":"2024-09-05T01:24:41.706417+0000","last_peered":"2024-09-05T01:24:41.706417+0000","last_clean":"2024-09-05T01:24:41.706417+0000","last_became_active":"2024-09-05T01:22:35.035881+0000","last_became_peered":"2024-09-05T01:22:35.035881+0000","last_unstale":"2024-09-05T01:24:41.706417+0000","last_undegraded":"2024-09-05T01:24:41.706417+0000","last_fullsized":"2024-09-05T01:24:41.706417+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:12:03.104075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'4","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838126+0000","last_change":"2024-09-05T01:22:32.608922+0000","last_active":"2024-09-05T01:24:41.838126+0000","last_peered":"2024-09-05T01:24:41.838126+0000","last_clean":"2024-09-05T01:24:41.838126+0000","last_became_active":"2024-09-05T01:22:32.608453+0000","last_became_peered":"2024-09-05T01:22:32.608453+0000","last_unstale":"2024-09-05T01:24:41.838126+0000","last_undegraded":"2024-09-05T01:24:41.838126+0000","last_fullsized":"2024-09-05T01:24:41.838126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T03:03:41.947264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.602224+0000","last_change":"2024-09-05T01:22:35.047556+0000","last_active":"2024-09-05T01:24:41.602224+0000","last_peered":"2024-09-05T01:24:41.602224+0000","last_clean":"2024-09-05T01:24:41.602224+0000","last_became_active":"2024-09-05T01:22:35.046260+0000","last_became_peered":"2024-09-05T01:22:35.046260+0000","last_unstale":"2024-09-05T01:24:41.602224+0000","last_undegraded":"2024-09-05T01:24:41.602224+0000","last_fullsized":"2024-09-05T01:24:41.602224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T12:13:09.379906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949107+0000","last_change":"2024-09-05T01:22:32.612948+0000","last_active":"2024-09-05T01:24:41.949107+0000","last_peered":"2024-09-05T01:24:41.949107+0000","last_clean":"2024-09-05T01:24:41.949107+0000","last_became_active":"2024-09-05T01:22:32.612319+0000","last_became_peered":"2024-09-05T01:22:32.612319+0000","last_unstale":"2024-09-05T01:24:41.949107+0000","last_undegraded":"2024-09-05T01:24:41.949107+0000","last_fullsized":"2024-09-05T01:24:41.949107+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T11:17:56.068106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838550+0000","last_change":"2024-09-05T01:22:35.036218+0000","last_active":"2024-09-05T01:24:41.838550+0000","last_peered":"2024-09-05T01:24:41.838550+0000","last_clean":"2024-09-05T01:24:41.838550+0000","last_became_active":"2024-09-05T01:22:35.035180+0000","last_became_peered":"2024-09-05T01:22:35.035180+0000","last_unstale":"2024-09-05T01:24:41.838550+0000","last_undegraded":"2024-09-05T01:24:41.838550+0000","last_fullsized":"2024-09-05T01:24:41.838550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T05:37:13.936829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.601818+0000","last_change":"2024-09-05T01:22:35.039616+0000","last_active":"2024-09-05T01:24:41.601818+0000","last_peered":"2024-09-05T01:24:41.601818+0000","last_clean":"2024-09-05T01:24:41.601818+0000","last_became_active":"2024-09-05T01:22:35.039297+0000","last_became_peered":"2024-09-05T01:22:35.039297+0000","last_unstale":"2024-09-05T01:24:41.601818+0000","last_undegraded":"2024-09-05T01:24:41.601818+0000","last_fullsized":"2024-09-05T01:24:41.601818+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:24:44.703168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'5","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949305+0000","last_change":"2024-09-05T01:22:32.609792+0000","last_active":"2024-09-05T01:24:41.949305+0000","last_peered":"2024-09-05T01:24:41.949305+0000","last_clean":"2024-09-05T01:24:41.949305+0000","last_became_active":"2024-09-05T01:22:32.609361+0000","last_became_peered":"2024-09-05T01:22:32.609361+0000","last_unstale":"2024-09-05T01:24:41.949305+0000","last_undegraded":"2024-09-05T01:24:41.949305+0000","last_fullsized":"2024-09-05T01:24:41.949305+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T10:05:15.105759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.838871+0000","last_change":"2024-09-05T01:22:35.038792+0000","last_active":"2024-09-05T01:24:41.838871+0000","last_peered":"2024-09-05T01:24:41.838871+0000","last_clean":"2024-09-05T01:24:41.838871+0000","last_became_active":"2024-09-05T01:22:35.038129+0000","last_became_peered":"2024-09-05T01:22:35.038129+0000","last_unstale":"2024-09-05T01:24:41.838871+0000","last_undegraded":"2024-09-05T01:24:41.838871+0000","last_fullsized":"2024-09-05T01:24:41.838871+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:39:31.020488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'12","reported_seq":63,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.949410+0000","last_change":"2024-09-05T01:23:23.208083+0000","last_active":"2024-09-05T01:24:41.949410+0000","last_peered":"2024-09-05T01:24:41.949410+0000","last_clean":"2024-09-05T01:24:41.949410+0000","last_became_active":"2024-09-05T01:23:23.194847+0000","last_became_peered":"2024-09-05T01:23:23.194847+0000","last_unstale":"2024-09-05T01:24:41.949410+0000","last_undegraded":"2024-09-05T01:24:41.949410+0000","last_fullsized":"2024-09-05T01:24:41.949410+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:09:16.923894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7],"acting":[8,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.840974+0000","last_change":"2024-09-05T01:22:35.045174+0000","last_active":"2024-09-05T01:24:41.840974+0000","last_peered":"2024-09-05T01:24:41.840974+0000","last_clean":"2024-09-05T01:24:41.840974+0000","last_became_active":"2024-09-05T01:22:35.041750+0000","last_became_peered":"2024-09-05T01:22:35.041750+0000","last_unstale":"2024-09-05T01:24:41.840974+0000","last_undegraded":"2024-09-05T01:24:41.840974+0000","last_fullsized":"2024-09-05T01:24:41.840974+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:34:00.174324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.603169+0000","last_change":"2024-09-05T01:22:33.065150+0000","last_active":"2024-09-05T01:24:41.603169+0000","last_peered":"2024-09-05T01:24:41.603169+0000","last_clean":"2024-09-05T01:24:41.603169+0000","last_became_active":"2024-09-05T01:22:33.064456+0000","last_became_peered":"2024-09-05T01:22:33.064456+0000","last_unstale":"2024-09-05T01:24:41.603169+0000","last_undegraded":"2024-09-05T01:24:41.603169+0000","last_fullsized":"2024-09-05T01:24:41.603169+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T02:16:20.879893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:41.602947+0000","last_change":"2024-09-05T01:22:35.043158+0000","last_active":"2024-09-05T01:24:41.602947+0000","last_peered":"2024-09-05T01:24:41.602947+0000","last_clean":"2024-09-05T01:24:41.602947+0000","last_became_active":"2024-09-05T01:22:35.038666+0000","last_became_peered":"2024-09-05T01:22:35.038666+0000","last_unstale":"2024-09-05T01:24:41.602947+0000","last_undegraded":"2024-09-05T01:24:41.602947+0000","last_fullsized":"2024-09-05T01:24:41.602947+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:34.000067+0000","last_clean_scrub_stamp":"2024-09-05T01:22:34.000067+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T09:44:18.551980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"86'15","reported_seq":160,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-05T01:24:42.029930+0000","last_change":"2024-09-05T01:22:32.613713+0000","last_active":"2024-09-05T01:24:42.029930+0000","last_peered":"2024-09-05T01:24:42.029930+0000","last_clean":"2024-09-05T01:24:42.029930+0000","last_became_active":"2024-09-05T01:22:32.613284+0000","last_became_peered":"2024-09-05T01:22:32.613284+0000","last_unstale":"2024-09-05T01:24:42.029930+0000","last_undegraded":"2024-09-05T01:24:42.029930+0000","last_fullsized":"2024-09-05T01:24:42.029930+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-05T01:22:31.590346+0000","last_clean_scrub_stamp":"2024-09-05T01:22:31.590346+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-06T06:39:46.881635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":601975,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1262,"num_read_kb":765,"num_write":382,"num_write_kb":1471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":1282,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2174976,"data_stored":1805925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307,"ondisk_log_size":307,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547239,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28360,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716792,"statfs":{"total":95995035648,"available":95965995008,"internally_reserved":0,"allocated":1363968,"data_stored":858133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776172,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32948,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712204,"statfs":{"total":95995035648,"available":95961296896,"internally_reserved":0,"allocated":1806336,"data_stored":1255138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939697,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36696,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708456,"statfs":{"total":95995035648,"available":95957458944,"internally_reserved":0,"allocated":1380352,"data_stored":857165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168631,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":974848,"data_stored":464215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397564,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1581056,"data_stored":1058367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561089,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":970752,"data_stored":464200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790022,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28712,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716440,"statfs":{"total":95995035648,"available":95965634560,"internally_reserved":0,"allocated":1728512,"data_stored":1188266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953548,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":978944,"data_stored":467114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182480,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":988307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":516929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1040384,"data_stored":532365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":991232,"data_stored":465005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":68195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":134954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":201826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":395306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-05T01:24:47.299 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:24:47.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:47 smithi012 ceph-mon[29942]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:24:47.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:47 smithi012 ceph-mon[29942]: Adjusting osd_memory_target on smithi012 to 177.5M 2024-09-05T01:24:47.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:47 smithi012 ceph-mon[29942]: Unable to set osd_memory_target on smithi012 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-05T01:24:47.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:47 smithi012 ceph-mon[29942]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-05T01:24:47.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:47 smithi012 ceph-mon[29942]: Updating smithi145:/etc/ceph/ceph.conf 2024-09-05T01:24:47.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:47 smithi012 ceph-mon[29942]: Updating smithi151:/etc/ceph/ceph.conf 2024-09-05T01:24:47.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:47 smithi012 ceph-mon[29942]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-09-05T01:24:47.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:47 smithi012 ceph-mon[29942]: Updating smithi151:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:24:47.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:47 smithi012 ceph-mon[29942]: Updating smithi145:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:24:47.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:47 smithi012 ceph-mon[29942]: from='client.25240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T01:24:47.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:47 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:47.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:47 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:47.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:47 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:47.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:47 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:47.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:47 smithi145 ceph-mon[34376]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:24:47.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:47 smithi145 ceph-mon[34376]: Adjusting osd_memory_target on smithi012 to 177.5M 2024-09-05T01:24:47.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:47 smithi145 ceph-mon[34376]: Unable to set osd_memory_target on smithi012 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-05T01:24:47.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:47 smithi145 ceph-mon[34376]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-05T01:24:47.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:47 smithi145 ceph-mon[34376]: Updating smithi145:/etc/ceph/ceph.conf 2024-09-05T01:24:47.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:47 smithi145 ceph-mon[34376]: Updating smithi151:/etc/ceph/ceph.conf 2024-09-05T01:24:47.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:47 smithi145 ceph-mon[34376]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-09-05T01:24:47.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:47 smithi145 ceph-mon[34376]: Updating smithi151:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:24:47.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:47 smithi145 ceph-mon[34376]: Updating smithi145:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:24:47.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:47 smithi145 ceph-mon[34376]: from='client.25240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T01:24:47.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:47 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:47.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:47 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:47.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:47 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:47.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:47 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:47 smithi151 ceph-mon[35013]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:24:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:47 smithi151 ceph-mon[35013]: Adjusting osd_memory_target on smithi012 to 177.5M 2024-09-05T01:24:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:47 smithi151 ceph-mon[35013]: Unable to set osd_memory_target on smithi012 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-05T01:24:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:47 smithi151 ceph-mon[35013]: Updating smithi012:/etc/ceph/ceph.conf 2024-09-05T01:24:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:47 smithi151 ceph-mon[35013]: Updating smithi145:/etc/ceph/ceph.conf 2024-09-05T01:24:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:47 smithi151 ceph-mon[35013]: Updating smithi151:/etc/ceph/ceph.conf 2024-09-05T01:24:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:47 smithi151 ceph-mon[35013]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-09-05T01:24:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:47 smithi151 ceph-mon[35013]: Updating smithi151:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:24:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:47 smithi151 ceph-mon[35013]: Updating smithi145:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:24:47.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:47 smithi151 ceph-mon[35013]: from='client.25240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T01:24:47.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:47 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:47.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:47 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:47.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:47 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:47.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:47 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:47.732 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:24:48.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.307+0000 7fb055c00640 1 -- 172.21.15.12:0/879090752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb050103ff0 msgr2=0x7fb0501043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:48.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.307+0000 7fb055c00640 1 --2- 172.21.15.12:0/879090752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb050103ff0 0x7fb0501043d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb040009860 tx=0x7fb04002a340 comp rx=0 tx=0).stop 2024-09-05T01:24:48.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.307+0000 7fb055c00640 1 -- 172.21.15.12:0/879090752 shutdown_connections 2024-09-05T01:24:48.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.307+0000 7fb055c00640 1 --2- 172.21.15.12:0/879090752 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb050109120 0x7fb050110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:48.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.307+0000 7fb055c00640 1 --2- 172.21.15.12:0/879090752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0501049a0 0x7fb0501089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:48.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.307+0000 7fb055c00640 1 --2- 172.21.15.12:0/879090752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb050103ff0 0x7fb0501043d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:48.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.308+0000 7fb055c00640 1 -- 172.21.15.12:0/879090752 >> 172.21.15.12:0/879090752 conn(0x7fb0500ffa90 msgr2=0x7fb050101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:48.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.308+0000 7fb055c00640 1 -- 172.21.15.12:0/879090752 shutdown_connections 2024-09-05T01:24:48.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.308+0000 7fb055c00640 1 -- 172.21.15.12:0/879090752 wait complete. 2024-09-05T01:24:48.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.309+0000 7fb055c00640 1 Processor -- start 2024-09-05T01:24:48.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.309+0000 7fb055c00640 1 -- start start 2024-09-05T01:24:48.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.309+0000 7fb055c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb050103ff0 0x7fb05019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:48.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.309+0000 7fb055c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0501049a0 0x7fb05019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:48.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.309+0000 7fb055c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb050109120 0x7fb05019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:48.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.309+0000 7fb055c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb050114140 con 0x7fb0501049a0 2024-09-05T01:24:48.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.309+0000 7fb055c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb050113fc0 con 0x7fb050109120 2024-09-05T01:24:48.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.309+0000 7fb055c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb0501142c0 con 0x7fb050103ff0 2024-09-05T01:24:48.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.310+0000 7fb04ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb050103ff0 0x7fb05019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:48.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.310+0000 7fb047e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0501049a0 0x7fb05019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:48.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.310+0000 7fb04ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb050103ff0 0x7fb05019a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:36592/0 (socket says 172.21.15.12:36592) 2024-09-05T01:24:48.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.310+0000 7fb047e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0501049a0 0x7fb05019ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47776/0 (socket says 172.21.15.12:47776) 2024-09-05T01:24:48.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.310+0000 7fb04ea00640 1 -- 172.21.15.12:0/2990206508 learned_addr learned my addr 172.21.15.12:0/2990206508 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:48.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.310+0000 7fb04f400640 1 --2- 172.21.15.12:0/2990206508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb050109120 0x7fb05019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:48.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.310+0000 7fb04ea00640 1 -- 172.21.15.12:0/2990206508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb050109120 msgr2=0x7fb05019eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:48.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.310+0000 7fb04ea00640 1 --2- 172.21.15.12:0/2990206508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb050109120 0x7fb05019eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:48.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.310+0000 7fb04ea00640 1 -- 172.21.15.12:0/2990206508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0501049a0 msgr2=0x7fb05019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:48.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.310+0000 7fb04ea00640 1 --2- 172.21.15.12:0/2990206508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0501049a0 0x7fb05019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:48.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.310+0000 7fb04ea00640 1 -- 172.21.15.12:0/2990206508 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb05019f5b0 con 0x7fb050103ff0 2024-09-05T01:24:48.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.311+0000 7fb04ea00640 1 --2- 172.21.15.12:0/2990206508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb050103ff0 0x7fb05019a600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb040035040 tx=0x7fb040033d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:48.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.311+0000 7fb047400640 1 -- 172.21.15.12:0/2990206508 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04003f020 con 0x7fb050103ff0 2024-09-05T01:24:48.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.311+0000 7fb047400640 1 -- 172.21.15.12:0/2990206508 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb040032770 con 0x7fb050103ff0 2024-09-05T01:24:48.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.311+0000 7fb047400640 1 -- 172.21.15.12:0/2990206508 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb040037040 con 0x7fb050103ff0 2024-09-05T01:24:48.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.311+0000 7fb055c00640 1 -- 172.21.15.12:0/2990206508 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb05019f840 con 0x7fb050103ff0 2024-09-05T01:24:48.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.311+0000 7fb055c00640 1 -- 172.21.15.12:0/2990206508 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb05019fcd0 con 0x7fb050103ff0 2024-09-05T01:24:48.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.312+0000 7fb055c00640 1 -- 172.21.15.12:0/2990206508 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0501043d0 con 0x7fb050103ff0 2024-09-05T01:24:48.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.314+0000 7fb047400640 1 -- 172.21.15.12:0/2990206508 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7fb040042020 con 0x7fb050103ff0 2024-09-05T01:24:48.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.315+0000 7fb047400640 1 --2- 172.21.15.12:0/2990206508 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fb0340a2d80 0x7fb0340a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:48.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.315+0000 7fb047400640 1 -- 172.21.15.12:0/2990206508 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fb0400ef6c0 con 0x7fb050103ff0 2024-09-05T01:24:48.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.315+0000 7fb047e00640 1 --2- 172.21.15.12:0/2990206508 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fb0340a2d80 0x7fb0340a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:48.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.316+0000 7fb047e00640 1 --2- 172.21.15.12:0/2990206508 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fb0340a2d80 0x7fb0340a5240 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb0500fff90 tx=0x7fb038005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:48.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.319+0000 7fb047400640 1 -- 172.21.15.12:0/2990206508 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb040049020 con 0x7fb050103ff0 2024-09-05T01:24:48.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.544+0000 7fb055c00640 1 -- 172.21.15.12:0/2990206508 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb05002d7c0 con 0x7fb050103ff0 2024-09-05T01:24:48.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:48 smithi012 ceph-mon[29942]: Updating smithi012:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:24:48.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:48 smithi012 ceph-mon[29942]: Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-09-05T01:24:48.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:48 smithi012 ceph-mon[29942]: Updating smithi151:/etc/ceph/ceph.client.admin.keyring 2024-09-05T01:24:48.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:48 smithi012 ceph-mon[29942]: from='client.25246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T01:24:48.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:48 smithi012 ceph-mon[29942]: Updating smithi145:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-05T01:24:48.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:48 smithi012 ceph-mon[29942]: Updating smithi151:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-05T01:24:48.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:48 smithi012 ceph-mon[29942]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2024-09-05T01:24:48.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:48 smithi012 ceph-mon[29942]: from='client.25250 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T01:24:48.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:48 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:48.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:48 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:48.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:48 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:48.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.545+0000 7fb047400640 1 -- 172.21.15.12:0/2990206508 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7fb0400bc210 con 0x7fb050103ff0 2024-09-05T01:24:48.547 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:24:48.547 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":28,"btime":"2024-09-05T01:24:42:138818+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14532,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/2949711075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":2949711075},{"type":"v1","addr":"172.21.15.12:6839","nonce":2949711075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T01:22:35.979384+0000","modified":"2024-09-05T01:24:41.174185+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24529,"mds_2":24524,"mds_3":24517,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/497406458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":497406458},{"type":"v1","addr":"172.21.15.12:6841","nonce":497406458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":10,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.145:6839/1706431882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":1706431882},{"type":"v1","addr":"172.21.15.145:6839","nonce":1706431882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24529,24524,24517,24460]},"id":1}]} 2024-09-05T01:24:48.547 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 28 2024-09-05T01:24:48.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.547+0000 7fb055c00640 1 -- 172.21.15.12:0/2990206508 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fb0340a2d80 msgr2=0x7fb0340a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:48.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.547+0000 7fb055c00640 1 --2- 172.21.15.12:0/2990206508 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fb0340a2d80 0x7fb0340a5240 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb0500fff90 tx=0x7fb038005f90 comp rx=0 tx=0).stop 2024-09-05T01:24:48.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.547+0000 7fb055c00640 1 -- 172.21.15.12:0/2990206508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb050103ff0 msgr2=0x7fb05019a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:48.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.547+0000 7fb055c00640 1 --2- 172.21.15.12:0/2990206508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb050103ff0 0x7fb05019a600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb040035040 tx=0x7fb040033d90 comp rx=0 tx=0).stop 2024-09-05T01:24:48.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.547+0000 7fb055c00640 1 -- 172.21.15.12:0/2990206508 shutdown_connections 2024-09-05T01:24:48.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.547+0000 7fb055c00640 1 --2- 172.21.15.12:0/2990206508 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fb0340a2d80 0x7fb0340a5240 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:48.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.547+0000 7fb055c00640 1 --2- 172.21.15.12:0/2990206508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb050109120 0x7fb05019eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:48.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.547+0000 7fb055c00640 1 --2- 172.21.15.12:0/2990206508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0501049a0 0x7fb05019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:48.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.547+0000 7fb055c00640 1 --2- 172.21.15.12:0/2990206508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb050103ff0 0x7fb05019a600 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:48.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.547+0000 7fb055c00640 1 -- 172.21.15.12:0/2990206508 >> 172.21.15.12:0/2990206508 conn(0x7fb0500ffa90 msgr2=0x7fb050100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:48.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.548+0000 7fb055c00640 1 -- 172.21.15.12:0/2990206508 shutdown_connections 2024-09-05T01:24:48.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:48.548+0000 7fb055c00640 1 -- 172.21.15.12:0/2990206508 wait complete. 2024-09-05T01:24:48.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:48 smithi145 ceph-mon[34376]: Updating smithi012:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:24:48.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:48 smithi145 ceph-mon[34376]: Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-09-05T01:24:48.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:48 smithi145 ceph-mon[34376]: Updating smithi151:/etc/ceph/ceph.client.admin.keyring 2024-09-05T01:24:48.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:48 smithi145 ceph-mon[34376]: from='client.25246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T01:24:48.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:48 smithi145 ceph-mon[34376]: Updating smithi145:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-05T01:24:48.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:48 smithi145 ceph-mon[34376]: Updating smithi151:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-05T01:24:48.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:48 smithi145 ceph-mon[34376]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2024-09-05T01:24:48.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:48 smithi145 ceph-mon[34376]: from='client.25250 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T01:24:48.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:48 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:48.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:48 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:48.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:48 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:48.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:48 smithi151 ceph-mon[35013]: Updating smithi012:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.conf 2024-09-05T01:24:48.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:48 smithi151 ceph-mon[35013]: Updating smithi145:/etc/ceph/ceph.client.admin.keyring 2024-09-05T01:24:48.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:48 smithi151 ceph-mon[35013]: Updating smithi151:/etc/ceph/ceph.client.admin.keyring 2024-09-05T01:24:48.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:48 smithi151 ceph-mon[35013]: from='client.25246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T01:24:48.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:48 smithi151 ceph-mon[35013]: Updating smithi145:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-05T01:24:48.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:48 smithi151 ceph-mon[35013]: Updating smithi151:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-05T01:24:48.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:48 smithi151 ceph-mon[35013]: Updating smithi012:/etc/ceph/ceph.client.admin.keyring 2024-09-05T01:24:48.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:48 smithi151 ceph-mon[35013]: from='client.25250 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-05T01:24:48.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:48 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:48.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:48 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:48.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:48 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:49.217 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T01:24:49.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:49 smithi012 ceph-mon[29942]: Updating smithi012:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-05T01:24:49.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:49 smithi012 ceph-mon[29942]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:24:49.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:49 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:24:49.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:49 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:24:49.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:49 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:24:49.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:49 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:49.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:49 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2990206508' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:24:49.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:49 smithi145 ceph-mon[34376]: Updating smithi012:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-05T01:24:49.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:49 smithi145 ceph-mon[34376]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:24:49.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:49 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:24:49.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:49 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:24:49.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:49 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:24:49.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:49 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:49.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:49 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/2990206508' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:24:49.594 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:24:49.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:49 smithi151 ceph-mon[35013]: Updating smithi012:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/config/ceph.client.admin.keyring 2024-09-05T01:24:49.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:49 smithi151 ceph-mon[35013]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:24:49.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:49 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:24:49.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:49 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:24:49.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:49 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:24:49.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:49 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:49.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:49 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/2990206508' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:24:50.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.188+0000 7efd28200640 1 -- 172.21.15.12:0/350189346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd2010c180 msgr2=0x7efd2010e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:50.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.188+0000 7efd28200640 1 --2- 172.21.15.12:0/350189346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd2010c180 0x7efd2010e620 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efd18009ca0 tx=0x7efd1802a950 comp rx=0 tx=0).stop 2024-09-05T01:24:50.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.188+0000 7efd28200640 1 -- 172.21.15.12:0/350189346 shutdown_connections 2024-09-05T01:24:50.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.188+0000 7efd28200640 1 --2- 172.21.15.12:0/350189346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd2010c180 0x7efd2010e620 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:50.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.188+0000 7efd28200640 1 --2- 172.21.15.12:0/350189346 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd20103670 0x7efd2010bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:50.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.188+0000 7efd28200640 1 --2- 172.21.15.12:0/350189346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd20102d50 0x7efd20103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:50.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.188+0000 7efd28200640 1 -- 172.21.15.12:0/350189346 >> 172.21.15.12:0/350189346 conn(0x7efd200fc7d0 msgr2=0x7efd200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:50.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.188+0000 7efd28200640 1 -- 172.21.15.12:0/350189346 shutdown_connections 2024-09-05T01:24:50.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.188+0000 7efd28200640 1 -- 172.21.15.12:0/350189346 wait complete. 2024-09-05T01:24:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.189+0000 7efd28200640 1 Processor -- start 2024-09-05T01:24:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.189+0000 7efd28200640 1 -- start start 2024-09-05T01:24:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.189+0000 7efd28200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd20102d50 0x7efd201009b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.189+0000 7efd28200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd20103670 0x7efd20100ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.189+0000 7efd28200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd2010c180 0x7efd20101430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.189+0000 7efd28200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efd20111f80 con 0x7efd20103670 2024-09-05T01:24:50.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.189+0000 7efd28200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7efd20111e00 con 0x7efd2010c180 2024-09-05T01:24:50.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.189+0000 7efd28200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7efd20112100 con 0x7efd20102d50 2024-09-05T01:24:50.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.190+0000 7efd24e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd20103670 0x7efd20100ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:50.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.190+0000 7efd24e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd20103670 0x7efd20100ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47786/0 (socket says 172.21.15.12:47786) 2024-09-05T01:24:50.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.190+0000 7efd24e00640 1 -- 172.21.15.12:0/3990008835 learned_addr learned my addr 172.21.15.12:0/3990008835 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:50.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.190+0000 7efd26200640 1 --2- 172.21.15.12:0/3990008835 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd2010c180 0x7efd20101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:50.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.190+0000 7efd25800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd20102d50 0x7efd201009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:50.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.190+0000 7efd24e00640 1 -- 172.21.15.12:0/3990008835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd20102d50 msgr2=0x7efd201009b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:50.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.190+0000 7efd24e00640 1 --2- 172.21.15.12:0/3990008835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd20102d50 0x7efd201009b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:50.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.190+0000 7efd24e00640 1 -- 172.21.15.12:0/3990008835 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd2010c180 msgr2=0x7efd20101430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:50.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.190+0000 7efd24e00640 1 --2- 172.21.15.12:0/3990008835 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd2010c180 0x7efd20101430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:50.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.190+0000 7efd24e00640 1 -- 172.21.15.12:0/3990008835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd201aae30 con 0x7efd20103670 2024-09-05T01:24:50.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.191+0000 7efd24e00640 1 --2- 172.21.15.12:0/3990008835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd20103670 0x7efd20100ef0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00e9f0 tx=0x7efd0c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:50.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.191+0000 7efd1e000640 1 -- 172.21.15.12:0/3990008835 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c00ccc0 con 0x7efd20103670 2024-09-05T01:24:50.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.191+0000 7efd1e000640 1 -- 172.21.15.12:0/3990008835 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd0c010910 con 0x7efd20103670 2024-09-05T01:24:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.191+0000 7efd1e000640 1 -- 172.21.15.12:0/3990008835 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c018920 con 0x7efd20103670 2024-09-05T01:24:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.191+0000 7efd28200640 1 -- 172.21.15.12:0/3990008835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd201ab060 con 0x7efd20103670 2024-09-05T01:24:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.191+0000 7efd28200640 1 -- 172.21.15.12:0/3990008835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd201ab5f0 con 0x7efd20103670 2024-09-05T01:24:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.192+0000 7efd28200640 1 -- 172.21.15.12:0/3990008835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd2006b070 con 0x7efd20103670 2024-09-05T01:24:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.194+0000 7efd1e000640 1 -- 172.21.15.12:0/3990008835 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7efd0c010430 con 0x7efd20103670 2024-09-05T01:24:50.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.196+0000 7efd1e000640 1 --2- 172.21.15.12:0/3990008835 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7efd080a2e00 0x7efd080a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:50.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.196+0000 7efd1e000640 1 -- 172.21.15.12:0/3990008835 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7efd0c0cf7b0 con 0x7efd20103670 2024-09-05T01:24:50.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.196+0000 7efd25800640 1 --2- 172.21.15.12:0/3990008835 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7efd080a2e00 0x7efd080a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:50.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.197+0000 7efd25800640 1 --2- 172.21.15.12:0/3990008835 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7efd080a2e00 0x7efd080a52c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efd14005fd0 tx=0x7efd1400b390 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:50.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.200+0000 7efd1e000640 1 -- 172.21.15.12:0/3990008835 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efd0c09bba0 con 0x7efd20103670 2024-09-05T01:24:50.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.389+0000 7efd28200640 1 -- 172.21.15.12:0/3990008835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd20107220 con 0x7efd20103670 2024-09-05T01:24:50.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.391+0000 7efd1e000640 1 -- 172.21.15.12:0/3990008835 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+23237 (secure 0 0 0) 0x7efd0c09fea0 con 0x7efd20103670 2024-09-05T01:24:50.394 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:24:50.394 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":86,"fsid":"0d44cd7e-6b24-11ef-bcd6-c7b262605968","created":"2024-09-05T01:14:21.162850+0000","modified":"2024-09-05T01:24:41.593694+0000","last_up_change":"2024-09-05T01:21:37.145073+0000","last_in_change":"2024-09-05T01:21:15.076991+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T01:17:44.744065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T01:22:31.540178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T01:22:33.999318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b74ac640-b680-46e2-9106-d24168e685e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6803","nonce":2090563987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6805","nonce":2090563987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6809","nonce":2090563987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6807","nonce":2090563987}]},"public_addr":"172.21.15.12:6803/2090563987","cluster_addr":"172.21.15.12:6805/2090563987","heartbeat_back_addr":"172.21.15.12:6809/2090563987","heartbeat_front_addr":"172.21.15.12:6807/2090563987","state":["exists","up"]},{"osd":1,"uuid":"efca1216-8d85-4e6a-8c49-0afb511ece59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6801","nonce":2639126629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6803","nonce":2639126629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6807","nonce":2639126629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6805","nonce":2639126629}]},"public_addr":"172.21.15.145:6801/2639126629","cluster_addr":"172.21.15.145:6803/2639126629","heartbeat_back_addr":"172.21.15.145:6807/2639126629","heartbeat_front_addr":"172.21.15.145:6805/2639126629","state":["exists","up"]},{"osd":2,"uuid":"4d5699b2-646a-4ab6-94a5-ad223aa27ac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6801","nonce":3753171761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6803","nonce":3753171761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6807","nonce":3753171761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6805","nonce":3753171761}]},"public_addr":"172.21.15.151:6801/3753171761","cluster_addr":"172.21.15.151:6803/3753171761","heartbeat_back_addr":"172.21.15.151:6807/3753171761","heartbeat_front_addr":"172.21.15.151:6805/3753171761","state":["exists","up"]},{"osd":3,"uuid":"275ad2ad-93e6-4a68-8784-8f8dcb620f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6811","nonce":2231650146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6813","nonce":2231650146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6817","nonce":2231650146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6815","nonce":2231650146}]},"public_addr":"172.21.15.12:6811/2231650146","cluster_addr":"172.21.15.12:6813/2231650146","heartbeat_back_addr":"172.21.15.12:6817/2231650146","heartbeat_front_addr":"172.21.15.12:6815/2231650146","state":["exists","up"]},{"osd":4,"uuid":"21a0c5b4-4e0e-4fb6-8be6-a300cb811cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6809","nonce":1828591275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6811","nonce":1828591275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6815","nonce":1828591275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6813","nonce":1828591275}]},"public_addr":"172.21.15.145:6809/1828591275","cluster_addr":"172.21.15.145:6811/1828591275","heartbeat_back_addr":"172.21.15.145:6815/1828591275","heartbeat_front_addr":"172.21.15.145:6813/1828591275","state":["exists","up"]},{"osd":5,"uuid":"e2c7e6fb-5dea-459f-8d7a-7ae5b1936218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6809","nonce":3888870109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6811","nonce":3888870109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6815","nonce":3888870109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6813","nonce":3888870109}]},"public_addr":"172.21.15.151:6809/3888870109","cluster_addr":"172.21.15.151:6811/3888870109","heartbeat_back_addr":"172.21.15.151:6815/3888870109","heartbeat_front_addr":"172.21.15.151:6813/3888870109","state":["exists","up"]},{"osd":6,"uuid":"0df0a29c-3404-4ff5-ae48-78b69b77cbd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6819","nonce":3084810269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6821","nonce":3084810269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6825","nonce":3084810269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6823","nonce":3084810269}]},"public_addr":"172.21.15.12:6819/3084810269","cluster_addr":"172.21.15.12:6821/3084810269","heartbeat_back_addr":"172.21.15.12:6825/3084810269","heartbeat_front_addr":"172.21.15.12:6823/3084810269","state":["exists","up"]},{"osd":7,"uuid":"c7b3ad7c-a566-435c-9ef8-837bb764acb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6817","nonce":3058588721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6819","nonce":3058588721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6823","nonce":3058588721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6821","nonce":3058588721}]},"public_addr":"172.21.15.145:6817/3058588721","cluster_addr":"172.21.15.145:6819/3058588721","heartbeat_back_addr":"172.21.15.145:6823/3058588721","heartbeat_front_addr":"172.21.15.145:6821/3058588721","state":["exists","up"]},{"osd":8,"uuid":"8018a468-fbc5-4667-a53c-2e97c08713bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6817","nonce":905705309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6819","nonce":905705309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6823","nonce":905705309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6821","nonce":905705309}]},"public_addr":"172.21.15.151:6817/905705309","cluster_addr":"172.21.15.151:6819/905705309","heartbeat_back_addr":"172.21.15.151:6823/905705309","heartbeat_front_addr":"172.21.15.151:6821/905705309","state":["exists","up"]},{"osd":9,"uuid":"dcf3b524-c8b8-4ab6-83c6-fc52c776d72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6827","nonce":1193852496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6829","nonce":1193852496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6833","nonce":1193852496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6831","nonce":1193852496}]},"public_addr":"172.21.15.12:6827/1193852496","cluster_addr":"172.21.15.12:6829/1193852496","heartbeat_back_addr":"172.21.15.12:6833/1193852496","heartbeat_front_addr":"172.21.15.12:6831/1193852496","state":["exists","up"]},{"osd":10,"uuid":"7b5b34c3-8814-4d16-80ce-0b0c9be07cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6825","nonce":1296813755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6827","nonce":1296813755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6831","nonce":1296813755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6829","nonce":1296813755}]},"public_addr":"172.21.15.145:6825/1296813755","cluster_addr":"172.21.15.145:6827/1296813755","heartbeat_back_addr":"172.21.15.145:6831/1296813755","heartbeat_front_addr":"172.21.15.145:6829/1296813755","state":["exists","up"]},{"osd":11,"uuid":"157ee32a-43f0-4e5a-8dac-fce53c1efdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6825","nonce":2855185758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6827","nonce":2855185758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6831","nonce":2855185758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6829","nonce":2855185758}]},"public_addr":"172.21.15.151:6825/2855185758","cluster_addr":"172.21.15.151:6827/2855185758","heartbeat_back_addr":"172.21.15.151:6831/2855185758","heartbeat_front_addr":"172.21.15.151:6829/2855185758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:16:52.947222+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:17:17.845611+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:17:41.769521+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:10.848974+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:35.471340+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:59.554980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:19:28.908089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:19:53.540000+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:20:17.764886+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:20:46.835859+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:21:12.186176+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:21:35.863935+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9},{"from":4,"to":7}]},{"pgid":"3.19","mappings":[{"from":3,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3089660384":"2024-09-06T01:24:41.593667+0000","172.21.15.12:0/2280578773":"2024-09-06T01:24:41.593667+0000","172.21.15.12:0/1532325396":"2024-09-06T01:14:54.625209+0000","172.21.15.12:6800/3541208629":"2024-09-06T01:14:54.625209+0000","172.21.15.12:6801/3541208629":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/992405704":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/784506983":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/1815886492":"2024-09-06T01:24:41.593667+0000","172.21.15.12:6800/4067110310":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6801/2664180840":"2024-09-06T01:24:41.593667+0000","172.21.15.12:0/1171838695":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/1040591124":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6801/4067110310":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/1385871202":"2024-09-06T01:24:41.593667+0000","172.21.15.12:0/1132389058":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6800/2664180840":"2024-09-06T01:24:41.593667+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T01:24:50.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.394+0000 7efd28200640 1 -- 172.21.15.12:0/3990008835 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7efd080a2e00 msgr2=0x7efd080a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:50.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.394+0000 7efd28200640 1 --2- 172.21.15.12:0/3990008835 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7efd080a2e00 0x7efd080a52c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efd14005fd0 tx=0x7efd1400b390 comp rx=0 tx=0).stop 2024-09-05T01:24:50.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.394+0000 7efd28200640 1 -- 172.21.15.12:0/3990008835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd20103670 msgr2=0x7efd20100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:50.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.394+0000 7efd28200640 1 --2- 172.21.15.12:0/3990008835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd20103670 0x7efd20100ef0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00e9f0 tx=0x7efd0c00eeb0 comp rx=0 tx=0).stop 2024-09-05T01:24:50.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.394+0000 7efd28200640 1 -- 172.21.15.12:0/3990008835 shutdown_connections 2024-09-05T01:24:50.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.394+0000 7efd28200640 1 --2- 172.21.15.12:0/3990008835 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7efd080a2e00 0x7efd080a52c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:50.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.394+0000 7efd28200640 1 --2- 172.21.15.12:0/3990008835 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7efd2010c180 0x7efd20101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:50.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.394+0000 7efd28200640 1 --2- 172.21.15.12:0/3990008835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd20103670 0x7efd20100ef0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:50.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.394+0000 7efd28200640 1 --2- 172.21.15.12:0/3990008835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd20102d50 0x7efd201009b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:50.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.394+0000 7efd28200640 1 -- 172.21.15.12:0/3990008835 >> 172.21.15.12:0/3990008835 conn(0x7efd200fc7d0 msgr2=0x7efd200fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:50.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.394+0000 7efd28200640 1 -- 172.21.15.12:0/3990008835 shutdown_connections 2024-09-05T01:24:50.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:50.395+0000 7efd28200640 1 -- 172.21.15.12:0/3990008835 wait complete. 2024-09-05T01:24:51.052 DEBUG:tasks.fwd_scrub:Yielding 2024-09-05T01:24:51.052 INFO:teuthology.run_tasks:Running task exec... 2024-09-05T01:24:51.061 INFO:teuthology.task.exec:Executing custom commands... 2024-09-05T01:24:51.061 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi012.front.sepia.ceph.com 2024-09-05T01:24:51.061 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-05T01:24:51.061 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-05T01:24:51.062 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-05T01:24:51.062 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-05T01:24:51.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.222+0000 7f7b23200640 1 -- 172.21.15.12:0/3832257757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b24100660 msgr2=0x7f7b24100a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:51.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.222+0000 7f7b23200640 1 --2- 172.21.15.12:0/3832257757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b24100660 0x7f7b24100a40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009900 tx=0x7f7b1402a410 comp rx=0 tx=0).stop 2024-09-05T01:24:51.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.223+0000 7f7b23200640 1 -- 172.21.15.12:0/3832257757 shutdown_connections 2024-09-05T01:24:51.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.223+0000 7f7b23200640 1 --2- 172.21.15.12:0/3832257757 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b2410e210 0x7f7b24110600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:51.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.223+0000 7f7b23200640 1 --2- 172.21.15.12:0/3832257757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b24101010 0x7f7b2410dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:51.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.223+0000 7f7b23200640 1 --2- 172.21.15.12:0/3832257757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b24100660 0x7f7b24100a40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:51.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.223+0000 7f7b23200640 1 -- 172.21.15.12:0/3832257757 >> 172.21.15.12:0/3832257757 conn(0x7f7b240777c0 msgr2=0x7f7b240feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:51.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.223+0000 7f7b23200640 1 -- 172.21.15.12:0/3832257757 shutdown_connections 2024-09-05T01:24:51.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.223+0000 7f7b23200640 1 -- 172.21.15.12:0/3832257757 wait complete. 2024-09-05T01:24:51.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.224+0000 7f7b23200640 1 Processor -- start 2024-09-05T01:24:51.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.224+0000 7f7b23200640 1 -- start start 2024-09-05T01:24:51.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.224+0000 7f7b23200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b24100660 0x7f7b2419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:51.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.224+0000 7f7b23200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b24101010 0x7f7b2419a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:51.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.224+0000 7f7b23200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b2410e210 0x7f7b2419ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:51.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.224+0000 7f7b23200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7b24113ef0 con 0x7f7b24101010 2024-09-05T01:24:51.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.224+0000 7f7b23200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7b24113d70 con 0x7f7b24100660 2024-09-05T01:24:51.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.224+0000 7f7b23200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7b24114070 con 0x7f7b2410e210 2024-09-05T01:24:51.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.224+0000 7f7b21400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b24101010 0x7f7b2419a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:51.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.224+0000 7f7b21400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b24101010 0x7f7b2419a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47802/0 (socket says 172.21.15.12:47802) 2024-09-05T01:24:51.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.224+0000 7f7b21400640 1 -- 172.21.15.12:0/551339681 learned_addr learned my addr 172.21.15.12:0/551339681 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:51.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.225+0000 7f7b21e00640 1 --2- 172.21.15.12:0/551339681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b24100660 0x7f7b2419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:51.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.225+0000 7f7b22800640 1 --2- 172.21.15.12:0/551339681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b2410e210 0x7f7b2419ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:51.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.225+0000 7f7b21400640 1 -- 172.21.15.12:0/551339681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b2410e210 msgr2=0x7f7b2419ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:51.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.225+0000 7f7b21400640 1 --2- 172.21.15.12:0/551339681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b2410e210 0x7f7b2419ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:51.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.225+0000 7f7b21400640 1 -- 172.21.15.12:0/551339681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b24100660 msgr2=0x7f7b2419a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:51.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.225+0000 7f7b21400640 1 --2- 172.21.15.12:0/551339681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b24100660 0x7f7b2419a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:51.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.225+0000 7f7b21400640 1 -- 172.21.15.12:0/551339681 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2419f430 con 0x7f7b24101010 2024-09-05T01:24:51.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.225+0000 7f7b21400640 1 --2- 172.21.15.12:0/551339681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b24101010 0x7f7b2419a980 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000e9f0 tx=0x7f7b1000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:51.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.225+0000 7f7b1aa00640 1 -- 172.21.15.12:0/551339681 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1000cd80 con 0x7f7b24101010 2024-09-05T01:24:51.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.225+0000 7f7b1aa00640 1 -- 172.21.15.12:0/551339681 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b10010910 con 0x7f7b24101010 2024-09-05T01:24:51.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.225+0000 7f7b1aa00640 1 -- 172.21.15.12:0/551339681 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10018990 con 0x7f7b24101010 2024-09-05T01:24:51.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.225+0000 7f7b23200640 1 -- 172.21.15.12:0/551339681 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b2419f720 con 0x7f7b24101010 2024-09-05T01:24:51.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.226+0000 7f7b23200640 1 -- 172.21.15.12:0/551339681 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b241a6fb0 con 0x7f7b24101010 2024-09-05T01:24:51.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.227+0000 7f7b23200640 1 -- 172.21.15.12:0/551339681 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b24100a40 con 0x7f7b24101010 2024-09-05T01:24:51.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.229+0000 7f7b1aa00640 1 -- 172.21.15.12:0/551339681 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f7b10010ac0 con 0x7f7b24101010 2024-09-05T01:24:51.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.230+0000 7f7b1aa00640 1 --2- 172.21.15.12:0/551339681 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7b080a2e00 0x7f7b080a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:51.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.231+0000 7f7b1aa00640 1 -- 172.21.15.12:0/551339681 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f7b100cf8d0 con 0x7f7b24101010 2024-09-05T01:24:51.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.231+0000 7f7b21e00640 1 --2- 172.21.15.12:0/551339681 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7b080a2e00 0x7f7b080a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:51.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.232+0000 7f7b21e00640 1 --2- 172.21.15.12:0/551339681 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7b080a2e00 0x7f7b080a52c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7b14000c00 tx=0x7f7b14005b50 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:51.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.235+0000 7f7b1aa00640 1 -- 172.21.15.12:0/551339681 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7b1009bcc0 con 0x7f7b24101010 2024-09-05T01:24:51.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:51 smithi012 ceph-mon[29942]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-05T01:24:51.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:51 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3990008835' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:24:51.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.426+0000 7f7b23200640 1 -- 172.21.15.12:0/551339681 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f7b2402d7c0 con 0x7f7b24101010 2024-09-05T01:24:51.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.432+0000 7f7b1aa00640 1 -- 172.21.15.12:0/551339681 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v29)=0 v29) ==== 129+0+0 (secure 0 0 0) 0x7f7b1009ffc0 con 0x7f7b24101010 2024-09-05T01:24:51.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.435+0000 7f7b23200640 1 -- 172.21.15.12:0/551339681 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7b080a2e00 msgr2=0x7f7b080a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:51.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.435+0000 7f7b23200640 1 --2- 172.21.15.12:0/551339681 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7b080a2e00 0x7f7b080a52c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7b14000c00 tx=0x7f7b14005b50 comp rx=0 tx=0).stop 2024-09-05T01:24:51.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.435+0000 7f7b23200640 1 -- 172.21.15.12:0/551339681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b24101010 msgr2=0x7f7b2419a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:51.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.435+0000 7f7b23200640 1 --2- 172.21.15.12:0/551339681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b24101010 0x7f7b2419a980 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000e9f0 tx=0x7f7b1000eeb0 comp rx=0 tx=0).stop 2024-09-05T01:24:51.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.435+0000 7f7b23200640 1 -- 172.21.15.12:0/551339681 shutdown_connections 2024-09-05T01:24:51.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.435+0000 7f7b23200640 1 --2- 172.21.15.12:0/551339681 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7b080a2e00 0x7f7b080a52c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.435+0000 7f7b23200640 1 --2- 172.21.15.12:0/551339681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b2410e210 0x7f7b2419ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.435+0000 7f7b23200640 1 --2- 172.21.15.12:0/551339681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b24101010 0x7f7b2419a980 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.435+0000 7f7b23200640 1 --2- 172.21.15.12:0/551339681 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b24100660 0x7f7b2419a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.435+0000 7f7b23200640 1 -- 172.21.15.12:0/551339681 >> 172.21.15.12:0/551339681 conn(0x7f7b240777c0 msgr2=0x7f7b240ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.435+0000 7f7b23200640 1 -- 172.21.15.12:0/551339681 shutdown_connections 2024-09-05T01:24:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.435+0000 7f7b23200640 1 -- 172.21.15.12:0/551339681 wait complete. 2024-09-05T01:24:51.456 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-05T01:24:51.460 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:24:51.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:51 smithi145 ceph-mon[34376]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-05T01:24:51.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:51 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3990008835' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:24:51.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:51 smithi151 ceph-mon[35013]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 0 B/s wr, 24 op/s 2024-09-05T01:24:51.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:51 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3990008835' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:24:51.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.623+0000 7f3d8f600640 1 -- 172.21.15.12:0/279813933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d88107b80 msgr2=0x7f3d88107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:51.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.623+0000 7f3d8f600640 1 --2- 172.21.15.12:0/279813933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d88107b80 0x7f3d88107f60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009930 tx=0x7f3d7c02a420 comp rx=0 tx=0).stop 2024-09-05T01:24:51.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.623+0000 7f3d8f600640 1 -- 172.21.15.12:0/279813933 shutdown_connections 2024-09-05T01:24:51.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.623+0000 7f3d8f600640 1 --2- 172.21.15.12:0/279813933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d88102480 0x7f3d8810e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:51.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.623+0000 7f3d8f600640 1 --2- 172.21.15.12:0/279813933 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d88101ae0 0x7f3d88101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:51.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.623+0000 7f3d8f600640 1 --2- 172.21.15.12:0/279813933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d88107b80 0x7f3d88107f60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:51.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.623+0000 7f3d8f600640 1 -- 172.21.15.12:0/279813933 >> 172.21.15.12:0/279813933 conn(0x7f3d880fd7e0 msgr2=0x7f3d880ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:51.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.623+0000 7f3d8f600640 1 -- 172.21.15.12:0/279813933 shutdown_connections 2024-09-05T01:24:51.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.623+0000 7f3d8f600640 1 -- 172.21.15.12:0/279813933 wait complete. 2024-09-05T01:24:51.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.624+0000 7f3d8f600640 1 Processor -- start 2024-09-05T01:24:51.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.624+0000 7f3d8f600640 1 -- start start 2024-09-05T01:24:51.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.625+0000 7f3d8f600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d88101ae0 0x7f3d8819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:51.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.625+0000 7f3d8f600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d88102480 0x7f3d8819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:51.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.625+0000 7f3d8f600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d88107b80 0x7f3d8819ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:51.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.625+0000 7f3d8f600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3d88111f80 con 0x7f3d88107b80 2024-09-05T01:24:51.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.625+0000 7f3d8f600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3d88111e00 con 0x7f3d88102480 2024-09-05T01:24:51.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.625+0000 7f3d8f600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3d88112100 con 0x7f3d88101ae0 2024-09-05T01:24:51.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.625+0000 7f3d8d600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d88107b80 0x7f3d8819ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:51.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.625+0000 7f3d87e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d88102480 0x7f3d8819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:51.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.625+0000 7f3d87e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d88102480 0x7f3d8819aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:60540/0 (socket says 172.21.15.12:60540) 2024-09-05T01:24:51.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.625+0000 7f3d87e00640 1 -- 172.21.15.12:0/925192452 learned_addr learned my addr 172.21.15.12:0/925192452 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:51.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.625+0000 7f3d8cc00640 1 --2- 172.21.15.12:0/925192452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d88101ae0 0x7f3d8819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:51.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.625+0000 7f3d8d600640 1 -- 172.21.15.12:0/925192452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d88101ae0 msgr2=0x7f3d8819a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:51.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.625+0000 7f3d8d600640 1 --2- 172.21.15.12:0/925192452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d88101ae0 0x7f3d8819a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:51.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.625+0000 7f3d8d600640 1 -- 172.21.15.12:0/925192452 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d88102480 msgr2=0x7f3d8819aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:51.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.625+0000 7f3d8d600640 1 --2- 172.21.15.12:0/925192452 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d88102480 0x7f3d8819aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:51.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.625+0000 7f3d8d600640 1 -- 172.21.15.12:0/925192452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8819f570 con 0x7f3d88107b80 2024-09-05T01:24:51.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.626+0000 7f3d8d600640 1 --2- 172.21.15.12:0/925192452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d88107b80 0x7f3d8819ee40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3d80009fd0 tx=0x7f3d8000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:51.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.626+0000 7f3d85600640 1 -- 172.21.15.12:0/925192452 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8000ce20 con 0x7f3d88107b80 2024-09-05T01:24:51.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.626+0000 7f3d85600640 1 -- 172.21.15.12:0/925192452 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d80005020 con 0x7f3d88107b80 2024-09-05T01:24:51.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.626+0000 7f3d85600640 1 -- 172.21.15.12:0/925192452 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d80010720 con 0x7f3d88107b80 2024-09-05T01:24:51.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.626+0000 7f3d8f600640 1 -- 172.21.15.12:0/925192452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d8819f860 con 0x7f3d88107b80 2024-09-05T01:24:51.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.626+0000 7f3d8f600640 1 -- 172.21.15.12:0/925192452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d881a70f0 con 0x7f3d88107b80 2024-09-05T01:24:51.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.627+0000 7f3d8f600640 1 -- 172.21.15.12:0/925192452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d88101f40 con 0x7f3d88107b80 2024-09-05T01:24:51.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.629+0000 7f3d85600640 1 -- 172.21.15.12:0/925192452 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f3d80005540 con 0x7f3d88107b80 2024-09-05T01:24:51.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.631+0000 7f3d85600640 1 --2- 172.21.15.12:0/925192452 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f3d700a2ec0 0x7f3d700a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:51.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.632+0000 7f3d85600640 1 -- 172.21.15.12:0/925192452 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f3d800cfb80 con 0x7f3d88107b80 2024-09-05T01:24:51.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.632+0000 7f3d8cc00640 1 --2- 172.21.15.12:0/925192452 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f3d700a2ec0 0x7f3d700a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:51.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.632+0000 7f3d8cc00640 1 --2- 172.21.15.12:0/925192452 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f3d700a2ec0 0x7f3d700a5380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c006010 tx=0x7f3d7c000bc0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:51.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.635+0000 7f3d85600640 1 -- 172.21.15.12:0/925192452 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3d8009c5c0 con 0x7f3d88107b80 2024-09-05T01:24:51.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.831+0000 7f3d8f600640 1 -- 172.21.15.12:0/925192452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f3d881a7420 con 0x7f3d88107b80 2024-09-05T01:24:51.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.836+0000 7f3d85600640 1 -- 172.21.15.12:0/925192452 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v30)=0 v30) ==== 138+0+0 (secure 0 0 0) 0x7f3d8009bec0 con 0x7f3d88107b80 2024-09-05T01:24:51.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.838+0000 7f3d8f600640 1 -- 172.21.15.12:0/925192452 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f3d700a2ec0 msgr2=0x7f3d700a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:51.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.838+0000 7f3d8f600640 1 --2- 172.21.15.12:0/925192452 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f3d700a2ec0 0x7f3d700a5380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c006010 tx=0x7f3d7c000bc0 comp rx=0 tx=0).stop 2024-09-05T01:24:51.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.838+0000 7f3d8f600640 1 -- 172.21.15.12:0/925192452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d88107b80 msgr2=0x7f3d8819ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:51.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.838+0000 7f3d8f600640 1 --2- 172.21.15.12:0/925192452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d88107b80 0x7f3d8819ee40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3d80009fd0 tx=0x7f3d8000ef10 comp rx=0 tx=0).stop 2024-09-05T01:24:51.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.839+0000 7f3d8f600640 1 -- 172.21.15.12:0/925192452 shutdown_connections 2024-09-05T01:24:51.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.839+0000 7f3d8f600640 1 --2- 172.21.15.12:0/925192452 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f3d700a2ec0 0x7f3d700a5380 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:51.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.839+0000 7f3d8f600640 1 --2- 172.21.15.12:0/925192452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d88107b80 0x7f3d8819ee40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:51.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.839+0000 7f3d8f600640 1 --2- 172.21.15.12:0/925192452 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3d88102480 0x7f3d8819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:51.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.839+0000 7f3d8f600640 1 --2- 172.21.15.12:0/925192452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d88101ae0 0x7f3d8819a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:51.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.839+0000 7f3d8f600640 1 -- 172.21.15.12:0/925192452 >> 172.21.15.12:0/925192452 conn(0x7f3d880fd7e0 msgr2=0x7f3d880fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:51.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.839+0000 7f3d8f600640 1 -- 172.21.15.12:0/925192452 shutdown_connections 2024-09-05T01:24:51.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:51.839+0000 7f3d8f600640 1 -- 172.21.15.12:0/925192452 wait complete. 2024-09-05T01:24:51.859 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-05T01:24:52.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.024+0000 7f7cc7600640 1 -- 172.21.15.12:0/469702527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cc0103f50 msgr2=0x7f7cc0104330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:52.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.024+0000 7f7cc7600640 1 --2- 172.21.15.12:0/469702527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cc0103f50 0x7f7cc0104330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009900 tx=0x7f7cb402a410 comp rx=0 tx=0).stop 2024-09-05T01:24:52.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.024+0000 7f7cc7600640 1 -- 172.21.15.12:0/469702527 shutdown_connections 2024-09-05T01:24:52.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.024+0000 7f7cc7600640 1 --2- 172.21.15.12:0/469702527 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7cc01090a0 0x7f7cc0110bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.024+0000 7f7cc7600640 1 --2- 172.21.15.12:0/469702527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cc0104900 0x7f7cc0108940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.024+0000 7f7cc7600640 1 --2- 172.21.15.12:0/469702527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cc0103f50 0x7f7cc0104330 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.024+0000 7f7cc7600640 1 -- 172.21.15.12:0/469702527 >> 172.21.15.12:0/469702527 conn(0x7f7cc00ff9e0 msgr2=0x7f7cc0101e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:52.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.024+0000 7f7cc7600640 1 -- 172.21.15.12:0/469702527 shutdown_connections 2024-09-05T01:24:52.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.024+0000 7f7cc7600640 1 -- 172.21.15.12:0/469702527 wait complete. 2024-09-05T01:24:52.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.026+0000 7f7cc7600640 1 Processor -- start 2024-09-05T01:24:52.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.026+0000 7f7cc7600640 1 -- start start 2024-09-05T01:24:52.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.026+0000 7f7cc7600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cc0103f50 0x7f7cc019a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.026+0000 7f7cc7600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cc01090a0 0x7f7cc019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.026+0000 7f7cc7600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7cc019ee10 0x7f7cc019f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.026+0000 7f7cc7600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc01140e0 con 0x7f7cc0103f50 2024-09-05T01:24:52.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.026+0000 7f7cc7600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc0113f60 con 0x7f7cc019ee10 2024-09-05T01:24:52.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.026+0000 7f7cc7600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc0114260 con 0x7f7cc01090a0 2024-09-05T01:24:52.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.027+0000 7f7cc4c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cc0103f50 0x7f7cc019a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.027+0000 7f7cc4c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cc0103f50 0x7f7cc019a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47832/0 (socket says 172.21.15.12:47832) 2024-09-05T01:24:52.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.027+0000 7f7cc4c00640 1 -- 172.21.15.12:0/1537650611 learned_addr learned my addr 172.21.15.12:0/1537650611 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:52.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.027+0000 7f7cbfe00640 1 --2- 172.21.15.12:0/1537650611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cc01090a0 0x7f7cc019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.027+0000 7f7cc5600640 1 --2- 172.21.15.12:0/1537650611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7cc019ee10 0x7f7cc019f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.027+0000 7f7cbfe00640 1 -- 172.21.15.12:0/1537650611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7cc019ee10 msgr2=0x7f7cc019f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:52.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.027+0000 7f7cbfe00640 1 --2- 172.21.15.12:0/1537650611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7cc019ee10 0x7f7cc019f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.027+0000 7f7cbfe00640 1 -- 172.21.15.12:0/1537650611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cc0103f50 msgr2=0x7f7cc019a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:52.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.027+0000 7f7cbfe00640 1 --2- 172.21.15.12:0/1537650611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cc0103f50 0x7f7cc019a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.027+0000 7f7cbfe00640 1 -- 172.21.15.12:0/1537650611 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc019f900 con 0x7f7cc01090a0 2024-09-05T01:24:52.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.027+0000 7f7cc5600640 1 --2- 172.21.15.12:0/1537650611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7cc019ee10 0x7f7cc019f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:52.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.027+0000 7f7cc4c00640 1 --2- 172.21.15.12:0/1537650611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cc0103f50 0x7f7cc019a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:52.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.028+0000 7f7cbfe00640 1 --2- 172.21.15.12:0/1537650611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cc01090a0 0x7f7cc019aa90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00e9c0 tx=0x7f7cac00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:52.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.028+0000 7f7cbd600640 1 -- 172.21.15.12:0/1537650611 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cac00ccc0 con 0x7f7cc01090a0 2024-09-05T01:24:52.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.028+0000 7f7cc7600640 1 -- 172.21.15.12:0/1537650611 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cc019fbf0 con 0x7f7cc01090a0 2024-09-05T01:24:52.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.028+0000 7f7cbd600640 1 -- 172.21.15.12:0/1537650611 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cac010910 con 0x7f7cc01090a0 2024-09-05T01:24:52.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.028+0000 7f7cbd600640 1 -- 172.21.15.12:0/1537650611 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cac018880 con 0x7f7cc01090a0 2024-09-05T01:24:52.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.028+0000 7f7cc7600640 1 -- 172.21.15.12:0/1537650611 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cc01a7430 con 0x7f7cc01090a0 2024-09-05T01:24:52.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.029+0000 7f7cc7600640 1 -- 172.21.15.12:0/1537650611 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cc0104330 con 0x7f7cc01090a0 2024-09-05T01:24:52.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.031+0000 7f7cbd600640 1 -- 172.21.15.12:0/1537650611 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f7cac010ac0 con 0x7f7cc01090a0 2024-09-05T01:24:52.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.033+0000 7f7cbd600640 1 --2- 172.21.15.12:0/1537650611 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7ca80a2ec0 0x7f7ca80a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.033+0000 7f7cbd600640 1 -- 172.21.15.12:0/1537650611 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f7cac0cf940 con 0x7f7cc01090a0 2024-09-05T01:24:52.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.033+0000 7f7cc4c00640 1 --2- 172.21.15.12:0/1537650611 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7ca80a2ec0 0x7f7ca80a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.034+0000 7f7cc4c00640 1 --2- 172.21.15.12:0/1537650611 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7ca80a2ec0 0x7f7ca80a5380 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7cb40096c0 tx=0x7f7cb4005a20 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:52.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.036+0000 7f7cbd600640 1 -- 172.21.15.12:0/1537650611 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7cac09bd30 con 0x7f7cc01090a0 2024-09-05T01:24:52.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.077+0000 7f1720200640 1 -- 172.21.15.12:0/605039533 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1718101de0 msgr2=0x7f17181021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:52.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.077+0000 7f1720200640 1 --2- 172.21.15.12:0/605039533 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1718101de0 0x7f17181021c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f170c009ca0 tx=0x7f170c02a8c0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.077+0000 7f1720200640 1 -- 172.21.15.12:0/605039533 shutdown_connections 2024-09-05T01:24:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.077+0000 7f1720200640 1 --2- 172.21.15.12:0/605039533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1718106f10 0x7f171810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.077+0000 7f1720200640 1 --2- 172.21.15.12:0/605039533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1718102790 0x7f17181067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.077+0000 7f1720200640 1 --2- 172.21.15.12:0/605039533 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1718101de0 0x7f17181021c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.077+0000 7f1720200640 1 -- 172.21.15.12:0/605039533 >> 172.21.15.12:0/605039533 conn(0x7f17180fd8c0 msgr2=0x7f17180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.077+0000 7f1720200640 1 -- 172.21.15.12:0/605039533 shutdown_connections 2024-09-05T01:24:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.077+0000 7f1720200640 1 -- 172.21.15.12:0/605039533 wait complete. 2024-09-05T01:24:52.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.078+0000 7f1720200640 1 Processor -- start 2024-09-05T01:24:52.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.078+0000 7f1720200640 1 -- start start 2024-09-05T01:24:52.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.079+0000 7f1720200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1718101de0 0x7f17180744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.079+0000 7f1720200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1718102790 0x7f1718074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.079+0000 7f1720200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1718106f10 0x7f1718074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.079+0000 7f1720200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1718111f30 con 0x7f1718106f10 2024-09-05T01:24:52.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.079+0000 7f1720200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1718111db0 con 0x7f1718101de0 2024-09-05T01:24:52.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.079+0000 7f1720200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f17181120b0 con 0x7f1718102790 2024-09-05T01:24:52.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.079+0000 7f171d800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1718101de0 0x7f17180744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.079+0000 7f171d800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1718101de0 0x7f17180744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:60566/0 (socket says 172.21.15.12:60566) 2024-09-05T01:24:52.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.079+0000 7f171d800640 1 -- 172.21.15.12:0/1111520609 learned_addr learned my addr 172.21.15.12:0/1111520609 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:52.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.079+0000 7f171ce00640 1 --2- 172.21.15.12:0/1111520609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1718102790 0x7f1718074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.079+0000 7f171e200640 1 --2- 172.21.15.12:0/1111520609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1718106f10 0x7f1718074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.079+0000 7f171d800640 1 -- 172.21.15.12:0/1111520609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1718102790 msgr2=0x7f1718074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:52.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.079+0000 7f171d800640 1 --2- 172.21.15.12:0/1111520609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1718102790 0x7f1718074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.079+0000 7f171d800640 1 -- 172.21.15.12:0/1111520609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1718106f10 msgr2=0x7f1718074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:52.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.079+0000 7f171d800640 1 --2- 172.21.15.12:0/1111520609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1718106f10 0x7f1718074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.079+0000 7f171d800640 1 -- 172.21.15.12:0/1111520609 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17181a6980 con 0x7f1718101de0 2024-09-05T01:24:52.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.079+0000 7f171e200640 1 --2- 172.21.15.12:0/1111520609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1718106f10 0x7f1718074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:24:52.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.080+0000 7f171d800640 1 --2- 172.21.15.12:0/1111520609 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1718101de0 0x7f17180744f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f170c02ade0 tx=0x7f170c0319f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:52.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.080+0000 7f1716000640 1 -- 172.21.15.12:0/1111520609 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c02fa20 con 0x7f1718101de0 2024-09-05T01:24:52.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.080+0000 7f1716000640 1 -- 172.21.15.12:0/1111520609 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f170c02fbc0 con 0x7f1718101de0 2024-09-05T01:24:52.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.080+0000 7f1716000640 1 -- 172.21.15.12:0/1111520609 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c0466e0 con 0x7f1718101de0 2024-09-05T01:24:52.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.080+0000 7f1720200640 1 -- 172.21.15.12:0/1111520609 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17181a6c10 con 0x7f1718101de0 2024-09-05T01:24:52.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.080+0000 7f1720200640 1 -- 172.21.15.12:0/1111520609 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17181a7100 con 0x7f1718101de0 2024-09-05T01:24:52.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.084+0000 7f1722e7d740 1 Processor -- start 2024-09-05T01:24:52.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.084+0000 7f1722e7d740 1 -- start start 2024-09-05T01:24:52.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.084+0000 7f1722e7d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 0x55eabad21ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.084+0000 7f1722e7d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eabad223e0 0x55eabad2c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.084+0000 7f1722e7d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad2cca0 0x55eabad2f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.084+0000 7f1722e7d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55eabac88290 con 0x55eabad223e0 2024-09-05T01:24:52.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.084+0000 7f1722e7d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55eabac2fb40 con 0x55eabad21ac0 2024-09-05T01:24:52.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.084+0000 7f1722e7d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55eabac84250 con 0x55eabad2cca0 2024-09-05T01:24:52.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.084+0000 7f171e200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 0x55eabad21ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.084+0000 7f171e200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 0x55eabad21ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:60572/0 (socket says 172.21.15.12:60572) 2024-09-05T01:24:52.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.084+0000 7f171e200640 1 -- 172.21.15.12:0/1969607918 learned_addr learned my addr 172.21.15.12:0/1969607918 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:52.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.085+0000 7f171ce00640 1 --2- 172.21.15.12:0/1969607918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad2cca0 0x55eabad2f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.085+0000 7f171e200640 1 -- 172.21.15.12:0/1969607918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad2cca0 msgr2=0x55eabad2f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:52.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.085+0000 7f171e200640 1 --2- 172.21.15.12:0/1969607918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad2cca0 0x55eabad2f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.085+0000 7f171e200640 1 -- 172.21.15.12:0/1969607918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eabad223e0 msgr2=0x55eabad2c760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:24:52.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.085+0000 7f171e200640 1 --2- 172.21.15.12:0/1969607918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eabad223e0 0x55eabad2c760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.085+0000 7f171e200640 1 -- 172.21.15.12:0/1969607918 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaba9f96a0 con 0x55eabad21ac0 2024-09-05T01:24:52.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.085+0000 7f171ce00640 1 --2- 172.21.15.12:0/1969607918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad2cca0 0x55eabad2f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:24:52.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.085+0000 7f171e200640 1 --2- 172.21.15.12:0/1969607918 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 0x55eabad21ea0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1710009c20 tx=0x7f17100117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd23849a7922c712 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:52.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.086+0000 7f170aa00640 1 -- 172.21.15.12:0/1969607918 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710012450 con 0x55eabad21ac0 2024-09-05T01:24:52.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.086+0000 7f170aa00640 1 -- 172.21.15.12:0/1969607918 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1710012ad0 con 0x55eabad21ac0 2024-09-05T01:24:52.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.086+0000 7f170aa00640 1 -- 172.21.15.12:0/1969607918 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171000fbe0 con 0x55eabad21ac0 2024-09-05T01:24:52.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.086+0000 7f1716000640 1 -- 172.21.15.12:0/1111520609 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f170c02fd70 con 0x7f1718101de0 2024-09-05T01:24:52.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.086+0000 7f1722e7d740 1 -- 172.21.15.12:0/1969607918 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 msgr2=0x55eabad21ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:52.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.086+0000 7f1722e7d740 1 --2- 172.21.15.12:0/1969607918 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 0x55eabad21ea0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1710009c20 tx=0x7f17100117b0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.086+0000 7f1722e7d740 1 -- 172.21.15.12:0/1969607918 shutdown_connections 2024-09-05T01:24:52.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.086+0000 7f1722e7d740 1 --2- 172.21.15.12:0/1969607918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad2cca0 0x55eabad2f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.086+0000 7f1722e7d740 1 --2- 172.21.15.12:0/1969607918 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eabad223e0 0x55eabad2c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.086+0000 7f1722e7d740 1 --2- 172.21.15.12:0/1969607918 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 0x55eabad21ea0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.086+0000 7f1722e7d740 1 -- 172.21.15.12:0/1969607918 >> 172.21.15.12:0/1969607918 conn(0x55eabad1e050 msgr2=0x55eabad1e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:52.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.087+0000 7f1722e7d740 1 -- 172.21.15.12:0/1969607918 shutdown_connections 2024-09-05T01:24:52.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.087+0000 7f1722e7d740 1 -- 172.21.15.12:0/1969607918 wait complete. 2024-09-05T01:24:52.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.087+0000 7f1722e7d740 1 -- start start 2024-09-05T01:24:52.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.088+0000 7f1722e7d740 1 Processor -- start 2024-09-05T01:24:52.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.088+0000 7f1722e7d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 0x55eabad2c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.088+0000 7f1722e7d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad223e0 0x55eabad29900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.088+0000 7f1722e7d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eabad2cca0 0x55eabad29ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.088+0000 7f1722e7d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55eabad2f910 con 0x55eabad2cca0 2024-09-05T01:24:52.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.088+0000 7f1722e7d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55eabac42fa0 con 0x55eabad21ac0 2024-09-05T01:24:52.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.088+0000 7f1722e7d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55eabad2fa90 con 0x55eabad223e0 2024-09-05T01:24:52.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.088+0000 7f1716000640 1 --2- 172.21.15.12:0/1111520609 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f17000a2d10 0x7f17000a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.088+0000 7f1722e7d740 10 client.0 _ll_register_callbacks cb 0x55eaba996ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:24:52.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.089+0000 7f171e200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 0x55eabad2c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.089+0000 7f1716000640 1 -- 172.21.15.12:0/1111520609 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f170c0f0950 con 0x7f1718101de0 2024-09-05T01:24:52.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.089+0000 7f171e200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 0x55eabad2c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:60580/0 (socket says 172.21.15.12:60580) 2024-09-05T01:24:52.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.089+0000 7f171e200640 1 -- 172.21.15.12:0/357813814 learned_addr learned my addr 172.21.15.12:0/357813814 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:52.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.089+0000 7f171e200640 1 --2- 172.21.15.12:0/1111520609 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f17000a2d10 0x7f17000a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.089+0000 7f171ce00640 1 --2- 172.21.15.12:0/357813814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eabad2cca0 0x55eabad29ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.089+0000 7f171d800640 1 --2- 172.21.15.12:0/357813814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad223e0 0x55eabad29900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.089+0000 7f171e200640 1 -- 172.21.15.12:0/357813814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad223e0 msgr2=0x55eabad29900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:52.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.089+0000 7f171e200640 1 --2- 172.21.15.12:0/357813814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad223e0 0x55eabad29900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.089+0000 7f171e200640 1 -- 172.21.15.12:0/357813814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eabad2cca0 msgr2=0x55eabad29ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:52.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.089+0000 7f171e200640 1 --2- 172.21.15.12:0/357813814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eabad2cca0 0x55eabad29ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.089+0000 7f171e200640 1 -- 172.21.15.12:0/357813814 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eabad2a6d0 con 0x55eabad21ac0 2024-09-05T01:24:52.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.089+0000 7f171d800640 1 --2- 172.21.15.12:0/357813814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad223e0 0x55eabad29900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:24:52.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.090+0000 7f171ce00640 1 --2- 172.21.15.12:0/357813814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eabad2cca0 0x55eabad29ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:24:52.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.090+0000 7f171e200640 1 --2- 172.21.15.12:0/357813814 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 0x55eabad2c650 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1710011cb0 tx=0x7f1710012d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbd7a065c36baf6b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:52.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.090+0000 7f16ff400640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:24:52.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.090+0000 7f171e200640 1 --2- 172.21.15.12:0/1111520609 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f17000a2d10 0x7f17000a51d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f17100099e0 tx=0x7f1710014000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:52.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.090+0000 7f16ff400640 1 -- 172.21.15.12:0/357813814 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710039070 con 0x55eabad21ac0 2024-09-05T01:24:52.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.090+0000 7f1722e7d740 1 -- 172.21.15.12:0/357813814 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1710012ad0 con 0x55eabad21ac0 2024-09-05T01:24:52.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.090+0000 7f16ff400640 1 -- 172.21.15.12:0/357813814 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f171000fae0 con 0x55eabad21ac0 2024-09-05T01:24:52.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.091+0000 7f16ff400640 1 -- 172.21.15.12:0/357813814 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f171000fd00 con 0x55eabad21ac0 2024-09-05T01:24:52.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.091+0000 7f1722e7d740 10 client.25292 fetch_fsmap learned FSMap version 28 2024-09-05T01:24:52.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.091+0000 7f1722e7d740 1 -- 172.21.15.12:0/357813814 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55eabad3b8c0 con 0x55eabad21ac0 2024-09-05T01:24:52.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.091+0000 7f16ff400640 1 -- 172.21.15.12:0/357813814 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1710012ad0 con 0x55eabad21ac0 2024-09-05T01:24:52.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.091+0000 7f16ff400640 1 -- 172.21.15.12:0/357813814 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1710035bb0 con 0x55eabad21ac0 2024-09-05T01:24:52.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.091+0000 7f1722e7d740 10 client.25292 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:24:52.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.091+0000 7f1722e7d740 10 client.25292 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:24:52.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.091+0000 7f1722e7d740 20 client.25292 populate_metadata read hostname 'smithi012' 2024-09-05T01:24:52.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.091+0000 7f1722e7d740 1 --2- 172.21.15.12:0/357813814 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55eabad3cc10 0x55eabad3f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.092+0000 7f1722e7d740 4 client.25292 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:24:52.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.092+0000 7f1722e7d740 1 -- 172.21.15.12:0/357813814 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eabac95800 con 0x55eabad3cc10 2024-09-05T01:24:52.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.092+0000 7f171d800640 1 --2- 172.21.15.12:0/357813814 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55eabad3cc10 0x55eabad3f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.092+0000 7f16ff400640 10 client.25292 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:24:52.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.092+0000 7f171d800640 1 --2- 172.21.15.12:0/357813814 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55eabad3cc10 0x55eabad3f000 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a76833b936995762 server_cookie=8b3831c57fb8cdf0 in_seq=0 out_seq=0 2024-09-05T01:24:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.093+0000 7f16ff400640 1 -- 172.21.15.12:0/357813814 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eabac95800 con 0x55eabad3cc10 2024-09-05T01:24:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.093+0000 7f16ff400640 10 client.25292 handle_command_reply: tid=0 2024-09-05T01:24:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.093+0000 7f1722e7d740 1 client.25292 shutdown 2024-09-05T01:24:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.094+0000 7f1722e7d740 1 -- 172.21.15.12:0/357813814 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 msgr2=0x55eabad2c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.094+0000 7f1722e7d740 1 --2- 172.21.15.12:0/357813814 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 0x55eabad2c650 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1710011cb0 tx=0x7f1710012d80 comp rx=0 tx=0).stop 2024-09-05T01:24:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.094+0000 7f1722e7d740 1 -- 172.21.15.12:0/357813814 shutdown_connections 2024-09-05T01:24:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.094+0000 7f1722e7d740 1 --2- 172.21.15.12:0/357813814 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55eabad3cc10 0x55eabad3f000 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.094+0000 7f1722e7d740 1 --2- 172.21.15.12:0/357813814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eabad2cca0 0x55eabad29ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.094+0000 7f1722e7d740 1 --2- 172.21.15.12:0/357813814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad223e0 0x55eabad29900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.094+0000 7f1722e7d740 1 --2- 172.21.15.12:0/357813814 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 0x55eabad2c650 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.094+0000 7f1722e7d740 1 -- 172.21.15.12:0/357813814 >> 172.21.15.12:0/357813814 conn(0x55eabad1e050 msgr2=0x55eabad23d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:52.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.094+0000 7f16ff400640 0 client.25292 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:24:52.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.094+0000 7f1722e7d740 1 -- 172.21.15.12:0/357813814 shutdown_connections 2024-09-05T01:24:52.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.094+0000 7f1722e7d740 1 -- 172.21.15.12:0/357813814 wait complete. 2024-09-05T01:24:52.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.094+0000 7f1722e7d740 20 client.25292 trim_cache size 0 max 16384 2024-09-05T01:24:52.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.112+0000 7f1722e7d740 1 Processor -- start 2024-09-05T01:24:52.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.112+0000 7f1722e7d740 1 -- start start 2024-09-05T01:24:52.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.113+0000 7f1722e7d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 0x55eabad287d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.113+0000 7f1722e7d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eabad223e0 0x55eabad44770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.113+0000 7f1722e7d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad2cca0 0x55eabad44cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.113+0000 7f1722e7d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f17181ab730 con 0x55eabad223e0 2024-09-05T01:24:52.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.113+0000 7f1722e7d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f17181ad270 con 0x55eabad21ac0 2024-09-05T01:24:52.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.113+0000 7f1722e7d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f17181abe00 con 0x55eabad2cca0 2024-09-05T01:24:52.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.113+0000 7f171ce00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eabad223e0 0x55eabad44770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.113+0000 7f171e200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad2cca0 0x55eabad44cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.113+0000 7f171ce00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eabad223e0 0x55eabad44770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47856/0 (socket says 172.21.15.12:47856) 2024-09-05T01:24:52.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.113+0000 7f171ce00640 1 -- 172.21.15.12:0/273068194 learned_addr learned my addr 172.21.15.12:0/273068194 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:52.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.113+0000 7f171e200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad2cca0 0x55eabad44cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:36732/0 (socket says 172.21.15.12:36732) 2024-09-05T01:24:52.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.113+0000 7f171d800640 1 --2- 172.21.15.12:0/273068194 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 0x55eabad287d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.114+0000 7f171e200640 1 -- 172.21.15.12:0/273068194 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 msgr2=0x55eabad287d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:52.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.114+0000 7f171e200640 1 --2- 172.21.15.12:0/273068194 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 0x55eabad287d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.114+0000 7f171e200640 1 -- 172.21.15.12:0/273068194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eabad223e0 msgr2=0x55eabad44770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:52.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.114+0000 7f171e200640 1 --2- 172.21.15.12:0/273068194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eabad223e0 0x55eabad44770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.114+0000 7f171e200640 1 -- 172.21.15.12:0/273068194 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eabad22210 con 0x55eabad2cca0 2024-09-05T01:24:52.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.114+0000 7f171d800640 1 --2- 172.21.15.12:0/273068194 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 0x55eabad287d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:52.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.114+0000 7f171ce00640 1 --2- 172.21.15.12:0/273068194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eabad223e0 0x55eabad44770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:52.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.114+0000 7f171e200640 1 --2- 172.21.15.12:0/273068194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad2cca0 0x55eabad44cb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1710009b70 tx=0x7f17100117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=743119cd36675d55 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:52.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.114+0000 7f170a000640 1 -- 172.21.15.12:0/273068194 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171004a070 con 0x55eabad2cca0 2024-09-05T01:24:52.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.115+0000 7f170a000640 1 -- 172.21.15.12:0/273068194 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1710009530 con 0x55eabad2cca0 2024-09-05T01:24:52.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.115+0000 7f170a000640 1 -- 172.21.15.12:0/273068194 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710039040 con 0x55eabad2cca0 2024-09-05T01:24:52.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.115+0000 7f1722e7d740 1 -- 172.21.15.12:0/273068194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad2cca0 msgr2=0x55eabad44cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:52.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.115+0000 7f1722e7d740 1 --2- 172.21.15.12:0/273068194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad2cca0 0x55eabad44cb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1710009b70 tx=0x7f17100117b0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.115+0000 7f1722e7d740 1 -- 172.21.15.12:0/273068194 shutdown_connections 2024-09-05T01:24:52.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.115+0000 7f1722e7d740 1 --2- 172.21.15.12:0/273068194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad2cca0 0x55eabad44cb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.115+0000 7f1722e7d740 1 --2- 172.21.15.12:0/273068194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eabad223e0 0x55eabad44770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.115+0000 7f1722e7d740 1 --2- 172.21.15.12:0/273068194 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 0x55eabad287d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.115+0000 7f1722e7d740 1 -- 172.21.15.12:0/273068194 >> 172.21.15.12:0/273068194 conn(0x55eabad1e050 msgr2=0x55eabad280c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:52.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.115+0000 7f1722e7d740 1 -- 172.21.15.12:0/273068194 shutdown_connections 2024-09-05T01:24:52.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.116+0000 7f1722e7d740 1 -- 172.21.15.12:0/273068194 wait complete. 2024-09-05T01:24:52.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.116+0000 7f1722e7d740 1 -- start start 2024-09-05T01:24:52.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.116+0000 7f1722e7d740 1 Processor -- start 2024-09-05T01:24:52.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.117+0000 7f1722e7d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 0x55eabad33270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.117+0000 7f1722e7d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad223e0 0x55eabad337b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.117+0000 7f1722e7d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eabad2cca0 0x55eabada6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.117+0000 7f1722e7d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f17181acba0 con 0x55eabad2cca0 2024-09-05T01:24:52.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.117+0000 7f1722e7d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f17181ac4d0 con 0x55eabad21ac0 2024-09-05T01:24:52.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.117+0000 7f1722e7d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f17181a9710 con 0x55eabad223e0 2024-09-05T01:24:52.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.117+0000 7f1722e7d740 10 client.0 _ll_register_callbacks cb 0x7f1710009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:24:52.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.117+0000 7f171e200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eabad2cca0 0x55eabada6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.117+0000 7f171d800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 0x55eabad33270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.117+0000 7f171ce00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad223e0 0x55eabad337b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.117+0000 7f171d800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 0x55eabad33270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:60594/0 (socket says 172.21.15.12:60594) 2024-09-05T01:24:52.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.117+0000 7f171e200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eabad2cca0 0x55eabada6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47870/0 (socket says 172.21.15.12:47870) 2024-09-05T01:24:52.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.117+0000 7f171e200640 1 -- 172.21.15.12:0/2523194302 learned_addr learned my addr 172.21.15.12:0/2523194302 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:52.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.117+0000 7f171ce00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad223e0 0x55eabad337b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:36740/0 (socket says 172.21.15.12:36740) 2024-09-05T01:24:52.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.118+0000 7f171e200640 1 -- 172.21.15.12:0/2523194302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad223e0 msgr2=0x55eabad337b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:52.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.118+0000 7f171e200640 1 --2- 172.21.15.12:0/2523194302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad223e0 0x55eabad337b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.118+0000 7f171e200640 1 -- 172.21.15.12:0/2523194302 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 msgr2=0x55eabad33270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:52.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.118+0000 7f171e200640 1 --2- 172.21.15.12:0/2523194302 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 0x55eabad33270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.118+0000 7f171e200640 1 -- 172.21.15.12:0/2523194302 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eabada6d40 con 0x55eabad2cca0 2024-09-05T01:24:52.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.118+0000 7f171ce00640 1 --2- 172.21.15.12:0/2523194302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad223e0 0x55eabad337b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:52.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.118+0000 7f171d800640 1 --2- 172.21.15.12:0/2523194302 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 0x55eabad33270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:52.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.118+0000 7f171e200640 1 --2- 172.21.15.12:0/2523194302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eabad2cca0 0x55eabada6750 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1710005fd0 tx=0x7f171000fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa8410badebfc68 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:52.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.118+0000 7f16ff400640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:24:52.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.118+0000 7f16ff400640 1 -- 172.21.15.12:0/2523194302 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710039040 con 0x55eabad2cca0 2024-09-05T01:24:52.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.118+0000 7f1722e7d740 1 -- 172.21.15.12:0/2523194302 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1710009530 con 0x55eabad2cca0 2024-09-05T01:24:52.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.118+0000 7f16ff400640 1 -- 172.21.15.12:0/2523194302 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f171001adc0 con 0x55eabad2cca0 2024-09-05T01:24:52.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.119+0000 7f16ff400640 1 -- 172.21.15.12:0/2523194302 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f171005c050 con 0x55eabad2cca0 2024-09-05T01:24:52.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.119+0000 7f1722e7d740 10 client.15282 fetch_fsmap learned FSMap version 28 2024-09-05T01:24:52.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.119+0000 7f1722e7d740 1 -- 172.21.15.12:0/2523194302 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55eabada8060 con 0x55eabad2cca0 2024-09-05T01:24:52.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.119+0000 7f16ff400640 1 -- 172.21.15.12:0/2523194302 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1710009530 con 0x55eabad2cca0 2024-09-05T01:24:52.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.119+0000 7f16ff400640 1 -- 172.21.15.12:0/2523194302 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1710035a50 con 0x55eabad2cca0 2024-09-05T01:24:52.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.119+0000 7f1722e7d740 10 client.15282 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:24:52.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.119+0000 7f1722e7d740 10 client.15282 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:24:52.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.119+0000 7f1722e7d740 20 client.15282 populate_metadata read hostname 'smithi012' 2024-09-05T01:24:52.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.119+0000 7f1722e7d740 1 --2- 172.21.15.12:0/2523194302 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55eabada86c0 0x55eabadaaae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.119+0000 7f1722e7d740 4 client.15282 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-05T01:24:52.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.119+0000 7f1722e7d740 1 -- 172.21.15.12:0/2523194302 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55eabac8fd10 con 0x55eabada86c0 2024-09-05T01:24:52.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.120+0000 7f171d800640 1 --2- 172.21.15.12:0/2523194302 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55eabada86c0 0x55eabadaaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.120+0000 7f171d800640 1 --2- 172.21.15.12:0/2523194302 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55eabada86c0 0x55eabadaaae0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6408617f3451da90 server_cookie=23f62b0e5d31443b in_seq=0 out_seq=0 2024-09-05T01:24:52.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.120+0000 7f16ff400640 10 client.15282 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:24:52.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.121+0000 7f16ff400640 1 -- 172.21.15.12:0/2523194302 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55eabac8fd10 con 0x55eabada86c0 2024-09-05T01:24:52.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.121+0000 7f16ff400640 10 client.15282 handle_command_reply: tid=0 2024-09-05T01:24:52.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.121+0000 7f1722e7d740 1 client.15282 shutdown 2024-09-05T01:24:52.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.121+0000 7f1722e7d740 1 -- 172.21.15.12:0/2523194302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eabad2cca0 msgr2=0x55eabada6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:52.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.121+0000 7f1722e7d740 1 --2- 172.21.15.12:0/2523194302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eabad2cca0 0x55eabada6750 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1710005fd0 tx=0x7f171000fc80 comp rx=0 tx=0).stop 2024-09-05T01:24:52.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.122+0000 7f1722e7d740 1 -- 172.21.15.12:0/2523194302 shutdown_connections 2024-09-05T01:24:52.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.122+0000 7f1722e7d740 1 --2- 172.21.15.12:0/2523194302 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55eabada86c0 0x55eabadaaae0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.122+0000 7f1722e7d740 1 --2- 172.21.15.12:0/2523194302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eabad2cca0 0x55eabada6750 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.122+0000 7f1722e7d740 1 --2- 172.21.15.12:0/2523194302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eabad223e0 0x55eabad337b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.122+0000 7f16ff400640 0 client.15282 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:24:52.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.122+0000 7f1722e7d740 1 --2- 172.21.15.12:0/2523194302 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55eabad21ac0 0x55eabad33270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.122+0000 7f1722e7d740 1 -- 172.21.15.12:0/2523194302 >> 172.21.15.12:0/2523194302 conn(0x55eabad1e050 msgr2=0x55eabad288e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:52.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.122+0000 7f1722e7d740 1 -- 172.21.15.12:0/2523194302 shutdown_connections 2024-09-05T01:24:52.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.122+0000 7f1722e7d740 1 -- 172.21.15.12:0/2523194302 wait complete. 2024-09-05T01:24:52.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.122+0000 7f1722e7d740 20 client.15282 trim_cache size 0 max 16384 2024-09-05T01:24:52.127 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:24:52.127 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-05T01:24:52.127 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "0b6e4ce5-1b3a-4ee9-8521-91d4d7c6dd55", 2024-09-05T01:24:52.128 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-05T01:24:52.128 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:24:52.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.123+0000 7f1720200640 1 -- 172.21.15.12:0/1111520609 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f17000a2d10 msgr2=0x7f17000a51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:52.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.123+0000 7f1720200640 1 --2- 172.21.15.12:0/1111520609 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f17000a2d10 0x7f17000a51d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f17100099e0 tx=0x7f1710014000 comp rx=0 tx=0).stop 2024-09-05T01:24:52.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.123+0000 7f1720200640 1 -- 172.21.15.12:0/1111520609 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1718101de0 msgr2=0x7f17180744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:52.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.123+0000 7f1720200640 1 --2- 172.21.15.12:0/1111520609 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1718101de0 0x7f17180744f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f170c02ade0 tx=0x7f170c0319f0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.123+0000 7f1720200640 1 -- 172.21.15.12:0/1111520609 shutdown_connections 2024-09-05T01:24:52.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.123+0000 7f1720200640 1 --2- 172.21.15.12:0/1111520609 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f17000a2d10 0x7f17000a51d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.123+0000 7f1720200640 1 --2- 172.21.15.12:0/1111520609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1718106f10 0x7f1718074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.123+0000 7f1720200640 1 --2- 172.21.15.12:0/1111520609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1718102790 0x7f1718074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.123+0000 7f1720200640 1 --2- 172.21.15.12:0/1111520609 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1718101de0 0x7f17180744f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.123+0000 7f1720200640 1 -- 172.21.15.12:0/1111520609 >> 172.21.15.12:0/1111520609 conn(0x7f17180fd8c0 msgr2=0x7f17180fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:52.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.123+0000 7f1720200640 1 -- 172.21.15.12:0/1111520609 shutdown_connections 2024-09-05T01:24:52.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.123+0000 7f1720200640 1 -- 172.21.15.12:0/1111520609 wait complete. 2024-09-05T01:24:52.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.236+0000 7f7cc7600640 1 -- 172.21.15.12:0/1537650611 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f7cc010c280 con 0x7f7cc01090a0 2024-09-05T01:24:52.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.245+0000 7f7cbd600640 1 -- 172.21.15.12:0/1537650611 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v31)=0 v31) ==== 133+0+0 (secure 0 0 0) 0x7f7cac0a0030 con 0x7f7cc01090a0 2024-09-05T01:24:52.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.248+0000 7f7cc7600640 1 -- 172.21.15.12:0/1537650611 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7ca80a2ec0 msgr2=0x7f7ca80a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:52.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.248+0000 7f7cc7600640 1 --2- 172.21.15.12:0/1537650611 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7ca80a2ec0 0x7f7ca80a5380 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7cb40096c0 tx=0x7f7cb4005a20 comp rx=0 tx=0).stop 2024-09-05T01:24:52.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.248+0000 7f7cc7600640 1 -- 172.21.15.12:0/1537650611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cc01090a0 msgr2=0x7f7cc019aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:52.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.248+0000 7f7cc7600640 1 --2- 172.21.15.12:0/1537650611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cc01090a0 0x7f7cc019aa90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00e9c0 tx=0x7f7cac00ee80 comp rx=0 tx=0).stop 2024-09-05T01:24:52.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.248+0000 7f7cc7600640 1 -- 172.21.15.12:0/1537650611 shutdown_connections 2024-09-05T01:24:52.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.248+0000 7f7cc7600640 1 --2- 172.21.15.12:0/1537650611 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7ca80a2ec0 0x7f7ca80a5380 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.248+0000 7f7cc7600640 1 --2- 172.21.15.12:0/1537650611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7cc019ee10 0x7f7cc019f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.248+0000 7f7cc7600640 1 --2- 172.21.15.12:0/1537650611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cc01090a0 0x7f7cc019aa90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.248+0000 7f7cc7600640 1 --2- 172.21.15.12:0/1537650611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cc0103f50 0x7f7cc019a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.248+0000 7f7cc7600640 1 -- 172.21.15.12:0/1537650611 >> 172.21.15.12:0/1537650611 conn(0x7f7cc00ff9e0 msgr2=0x7f7cc0100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:52.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.248+0000 7f7cc7600640 1 -- 172.21.15.12:0/1537650611 shutdown_connections 2024-09-05T01:24:52.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.248+0000 7f7cc7600640 1 -- 172.21.15.12:0/1537650611 wait complete. 2024-09-05T01:24:52.266 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-05T01:24:52.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.438+0000 7f8e04a00640 1 -- 172.21.15.12:0/1612405166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e00109b80 msgr2=0x7f8e00109f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:52.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.438+0000 7f8e04a00640 1 --2- 172.21.15.12:0/1612405166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e00109b80 0x7f8e00109f60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8df0009930 tx=0x7f8df002a440 comp rx=0 tx=0).stop 2024-09-05T01:24:52.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.438+0000 7f8e04a00640 1 -- 172.21.15.12:0/1612405166 shutdown_connections 2024-09-05T01:24:52.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.438+0000 7f8e04a00640 1 --2- 172.21.15.12:0/1612405166 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e00104480 0x7f8e001109b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.438+0000 7f8e04a00640 1 --2- 172.21.15.12:0/1612405166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e00103ae0 0x7f8e00103f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.438+0000 7f8e04a00640 1 --2- 172.21.15.12:0/1612405166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e00109b80 0x7f8e00109f60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.438+0000 7f8e04a00640 1 -- 172.21.15.12:0/1612405166 >> 172.21.15.12:0/1612405166 conn(0x7f8e000ff7c0 msgr2=0x7f8e00101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:52.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.438+0000 7f8e04a00640 1 -- 172.21.15.12:0/1612405166 shutdown_connections 2024-09-05T01:24:52.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.438+0000 7f8e04a00640 1 -- 172.21.15.12:0/1612405166 wait complete. 2024-09-05T01:24:52.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.439+0000 7f8e04a00640 1 Processor -- start 2024-09-05T01:24:52.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.439+0000 7f8e04a00640 1 -- start start 2024-09-05T01:24:52.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.439+0000 7f8e04a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e00103ae0 0x7f8e0019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.439+0000 7f8e04a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e00104480 0x7f8e0019a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.439+0000 7f8e04a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e00109b80 0x7f8e0019ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.439+0000 7f8e04a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8e00113f80 con 0x7f8e00103ae0 2024-09-05T01:24:52.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.439+0000 7f8e04a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8e00113e00 con 0x7f8e00104480 2024-09-05T01:24:52.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.439+0000 7f8e04a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8e00114100 con 0x7f8e00109b80 2024-09-05T01:24:52.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.440+0000 7f8dff400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e00103ae0 0x7f8e0019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.440+0000 7f8dfea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e00104480 0x7f8e0019a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.440+0000 7f8dff400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e00103ae0 0x7f8e0019a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47882/0 (socket says 172.21.15.12:47882) 2024-09-05T01:24:52.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.440+0000 7f8dffe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e00109b80 0x7f8e0019ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.440+0000 7f8dff400640 1 -- 172.21.15.12:0/2595793866 learned_addr learned my addr 172.21.15.12:0/2595793866 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:52.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.440+0000 7f8dfea00640 1 -- 172.21.15.12:0/2595793866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e00109b80 msgr2=0x7f8e0019ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:52.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.440+0000 7f8dfea00640 1 --2- 172.21.15.12:0/2595793866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e00109b80 0x7f8e0019ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.440+0000 7f8dfea00640 1 -- 172.21.15.12:0/2595793866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e00103ae0 msgr2=0x7f8e0019a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:52.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.440+0000 7f8dfea00640 1 --2- 172.21.15.12:0/2595793866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e00103ae0 0x7f8e0019a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.440+0000 7f8dfea00640 1 -- 172.21.15.12:0/2595793866 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e0019f440 con 0x7f8e00104480 2024-09-05T01:24:52.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.440+0000 7f8dff400640 1 --2- 172.21.15.12:0/2595793866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e00103ae0 0x7f8e0019a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:52.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.440+0000 7f8dfea00640 1 --2- 172.21.15.12:0/2595793866 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e00104480 0x7f8e0019a990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00e9f0 tx=0x7f8dec00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:52.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.440+0000 7f8df7e00640 1 -- 172.21.15.12:0/2595793866 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec00ccc0 con 0x7f8e00104480 2024-09-05T01:24:52.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.441+0000 7f8df7e00640 1 -- 172.21.15.12:0/2595793866 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dec010910 con 0x7f8e00104480 2024-09-05T01:24:52.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.441+0000 7f8df7e00640 1 -- 172.21.15.12:0/2595793866 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec018960 con 0x7f8e00104480 2024-09-05T01:24:52.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.441+0000 7f8e04a00640 1 -- 172.21.15.12:0/2595793866 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e0019f730 con 0x7f8e00104480 2024-09-05T01:24:52.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.441+0000 7f8e04a00640 1 -- 172.21.15.12:0/2595793866 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e001a6fc0 con 0x7f8e00104480 2024-09-05T01:24:52.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.442+0000 7f8e04a00640 1 -- 172.21.15.12:0/2595793866 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e00103f40 con 0x7f8e00104480 2024-09-05T01:24:52.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.444+0000 7f8df7e00640 1 -- 172.21.15.12:0/2595793866 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f8dec010ac0 con 0x7f8e00104480 2024-09-05T01:24:52.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.445+0000 7f8df7e00640 1 --2- 172.21.15.12:0/2595793866 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8de40a2e00 0x7f8de40a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.445+0000 7f8df7e00640 1 -- 172.21.15.12:0/2595793866 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f8dec0cf970 con 0x7f8e00104480 2024-09-05T01:24:52.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.446+0000 7f8dff400640 1 --2- 172.21.15.12:0/2595793866 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8de40a2e00 0x7f8de40a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.446+0000 7f8dff400640 1 --2- 172.21.15.12:0/2595793866 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8de40a2e00 0x7f8de40a52c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8df0000c00 tx=0x7f8df0031510 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:52.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.450+0000 7f8df7e00640 1 -- 172.21.15.12:0/2595793866 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8dec09bd60 con 0x7f8e00104480 2024-09-05T01:24:52.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:52 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/551339681' entity='client.admin' 2024-09-05T01:24:52.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:52 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:24:52.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:52 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:24:52.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:52 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:24:52.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:52 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:52.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:52 smithi012 ceph-mon[29942]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-05T01:24:52.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:52 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/925192452' entity='client.admin' 2024-09-05T01:24:52.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:52 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:24:52.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:52 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:24:52.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:52 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:24:52.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:52 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:52.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:52 smithi012 ceph-mon[29942]: scrub queued for path: / 2024-09-05T01:24:52.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:52 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:24:52.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:52 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:24:52.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:52 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:24:52.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:52 smithi012 ceph-mon[29942]: from='client.? ' entity='client.admin' 2024-09-05T01:24:52.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:52 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:24:52.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:52 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:24:52.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:52 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:24:52.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:52 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:52.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.660+0000 7f8e04a00640 1 -- 172.21.15.12:0/2595793866 --> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f8e00062630 con 0x7f8de40a2e00 2024-09-05T01:24:52.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.736+0000 7f8df7e00640 1 -- 172.21.15.12:0/2595793866 <== mgr.15138 v2:172.21.15.12:6800/3451745620 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f8e00062630 con 0x7f8de40a2e00 2024-09-05T01:24:52.738 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule set for path / 2024-09-05T01:24:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.738+0000 7f8e04a00640 1 -- 172.21.15.12:0/2595793866 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8de40a2e00 msgr2=0x7f8de40a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.738+0000 7f8e04a00640 1 --2- 172.21.15.12:0/2595793866 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8de40a2e00 0x7f8de40a52c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8df0000c00 tx=0x7f8df0031510 comp rx=0 tx=0).stop 2024-09-05T01:24:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.739+0000 7f8e04a00640 1 -- 172.21.15.12:0/2595793866 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e00104480 msgr2=0x7f8e0019a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.739+0000 7f8e04a00640 1 --2- 172.21.15.12:0/2595793866 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e00104480 0x7f8e0019a990 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00e9f0 tx=0x7f8dec00eeb0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.739+0000 7f8e04a00640 1 -- 172.21.15.12:0/2595793866 shutdown_connections 2024-09-05T01:24:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.739+0000 7f8e04a00640 1 --2- 172.21.15.12:0/2595793866 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8de40a2e00 0x7f8de40a52c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.739+0000 7f8e04a00640 1 --2- 172.21.15.12:0/2595793866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e00109b80 0x7f8e0019ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.739+0000 7f8e04a00640 1 --2- 172.21.15.12:0/2595793866 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e00104480 0x7f8e0019a990 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.739+0000 7f8e04a00640 1 --2- 172.21.15.12:0/2595793866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e00103ae0 0x7f8e0019a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.739+0000 7f8e04a00640 1 -- 172.21.15.12:0/2595793866 >> 172.21.15.12:0/2595793866 conn(0x7f8e000ff7c0 msgr2=0x7f8e000fffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.739+0000 7f8e04a00640 1 -- 172.21.15.12:0/2595793866 shutdown_connections 2024-09-05T01:24:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.739+0000 7f8e04a00640 1 -- 172.21.15.12:0/2595793866 wait complete. 2024-09-05T01:24:52.755 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-05T01:24:52.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:52 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/551339681' entity='client.admin' 2024-09-05T01:24:52.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:52 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:24:52.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:52 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:24:52.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:52 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:24:52.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:52 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:52.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:52 smithi145 ceph-mon[34376]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-05T01:24:52.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:52 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/925192452' entity='client.admin' 2024-09-05T01:24:52.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:52 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:24:52.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:52 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:24:52.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:52 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:24:52.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:52 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:52.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:52 smithi145 ceph-mon[34376]: scrub queued for path: / 2024-09-05T01:24:52.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:52 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:24:52.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:52 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:24:52.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:52 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:24:52.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:52 smithi145 ceph-mon[34376]: from='client.? ' entity='client.admin' 2024-09-05T01:24:52.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:52 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:24:52.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:52 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:24:52.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:52 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:24:52.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:52 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:52.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:52 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/551339681' entity='client.admin' 2024-09-05T01:24:52.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:52 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:24:52.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:52 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:24:52.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:52 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:24:52.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:52 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:52.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:52 smithi151 ceph-mon[35013]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-05T01:24:52.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:52 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/925192452' entity='client.admin' 2024-09-05T01:24:52.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:52 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:24:52.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:52 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:24:52.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:52 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:24:52.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:52 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:52.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:52 smithi151 ceph-mon[35013]: scrub queued for path: / 2024-09-05T01:24:52.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:52 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:24:52.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:52 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:24:52.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:52 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:24:52.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:52 smithi151 ceph-mon[35013]: from='client.? ' entity='client.admin' 2024-09-05T01:24:52.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:52 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:24:52.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:52 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:24:52.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:52 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:24:52.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:52 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:24:52.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.913+0000 7f93bc800640 1 -- 172.21.15.12:0/2590487163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93b4103f30 msgr2=0x7f93b4104310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:52.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.913+0000 7f93bc800640 1 --2- 172.21.15.12:0/2590487163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93b4103f30 0x7f93b4104310 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f93a8009900 tx=0x7f93a802a410 comp rx=0 tx=0).stop 2024-09-05T01:24:52.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.913+0000 7f93bc800640 1 -- 172.21.15.12:0/2590487163 shutdown_connections 2024-09-05T01:24:52.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.913+0000 7f93bc800640 1 --2- 172.21.15.12:0/2590487163 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93b4109080 0x7f93b4110bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.913+0000 7f93bc800640 1 --2- 172.21.15.12:0/2590487163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93b41048e0 0x7f93b4108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.913+0000 7f93bc800640 1 --2- 172.21.15.12:0/2590487163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93b4103f30 0x7f93b4104310 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.913+0000 7f93bc800640 1 -- 172.21.15.12:0/2590487163 >> 172.21.15.12:0/2590487163 conn(0x7f93b40ff980 msgr2=0x7f93b4101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.913+0000 7f93bc800640 1 -- 172.21.15.12:0/2590487163 shutdown_connections 2024-09-05T01:24:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.913+0000 7f93bc800640 1 -- 172.21.15.12:0/2590487163 wait complete. 2024-09-05T01:24:52.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.914+0000 7f93bc800640 1 Processor -- start 2024-09-05T01:24:52.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.914+0000 7f93bc800640 1 -- start start 2024-09-05T01:24:52.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.914+0000 7f93bc800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93b4103f30 0x7f93b419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.914+0000 7f93bc800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93b4109080 0x7f93b419aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.914+0000 7f93bc800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93b419ee60 0x7f93b419f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.914+0000 7f93bc800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f93b4114110 con 0x7f93b4109080 2024-09-05T01:24:52.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.914+0000 7f93bc800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f93b4113f90 con 0x7f93b419ee60 2024-09-05T01:24:52.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.914+0000 7f93bc800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f93b4114290 con 0x7f93b4103f30 2024-09-05T01:24:52.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.915+0000 7f93b9400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93b4109080 0x7f93b419aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.915+0000 7f93b9400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93b4109080 0x7f93b419aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47906/0 (socket says 172.21.15.12:47906) 2024-09-05T01:24:52.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.915+0000 7f93b9400640 1 -- 172.21.15.12:0/228992035 learned_addr learned my addr 172.21.15.12:0/228992035 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:52.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.915+0000 7f93ba800640 1 --2- 172.21.15.12:0/228992035 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93b419ee60 0x7f93b419f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.915+0000 7f93b9e00640 1 --2- 172.21.15.12:0/228992035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93b4103f30 0x7f93b419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.915+0000 7f93b9400640 1 -- 172.21.15.12:0/228992035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93b4103f30 msgr2=0x7f93b419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.915+0000 7f93b9400640 1 --2- 172.21.15.12:0/228992035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93b4103f30 0x7f93b419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.915+0000 7f93b9400640 1 -- 172.21.15.12:0/228992035 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93b419ee60 msgr2=0x7f93b419f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.915+0000 7f93b9400640 1 --2- 172.21.15.12:0/228992035 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93b419ee60 0x7f93b419f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.915+0000 7f93b9400640 1 -- 172.21.15.12:0/228992035 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b419f950 con 0x7f93b4109080 2024-09-05T01:24:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.915+0000 7f93b9400640 1 --2- 172.21.15.12:0/228992035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93b4109080 0x7f93b419aae0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f93a400e9f0 tx=0x7f93a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.916+0000 7f93aea00640 1 -- 172.21.15.12:0/228992035 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a400ccc0 con 0x7f93b4109080 2024-09-05T01:24:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.916+0000 7f93aea00640 1 -- 172.21.15.12:0/228992035 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93a4005500 con 0x7f93b4109080 2024-09-05T01:24:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.916+0000 7f93aea00640 1 -- 172.21.15.12:0/228992035 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a4010690 con 0x7f93b4109080 2024-09-05T01:24:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.916+0000 7f93bc800640 1 -- 172.21.15.12:0/228992035 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b419fc40 con 0x7f93b4109080 2024-09-05T01:24:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.916+0000 7f93bc800640 1 -- 172.21.15.12:0/228992035 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b41a7430 con 0x7f93b4109080 2024-09-05T01:24:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.917+0000 7f93bc800640 1 -- 172.21.15.12:0/228992035 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93b4104310 con 0x7f93b4109080 2024-09-05T01:24:52.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.920+0000 7f93aea00640 1 -- 172.21.15.12:0/228992035 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f93a40046c0 con 0x7f93b4109080 2024-09-05T01:24:52.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.921+0000 7f93aea00640 1 --2- 172.21.15.12:0/228992035 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f939c0a2ec0 0x7f939c0a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:52.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.921+0000 7f93aea00640 1 -- 172.21.15.12:0/228992035 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f93a40cf930 con 0x7f93b4109080 2024-09-05T01:24:52.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.921+0000 7f93b9e00640 1 --2- 172.21.15.12:0/228992035 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f939c0a2ec0 0x7f939c0a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:52.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.922+0000 7f93b9e00640 1 --2- 172.21.15.12:0/228992035 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f939c0a2ec0 0x7f939c0a5380 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f93a8000c00 tx=0x7f93a8005b50 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:52.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:52.925+0000 7f93aea00640 1 -- 172.21.15.12:0/228992035 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f93a409c370 con 0x7f93b4109080 2024-09-05T01:24:52.992 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T01:24:53.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.140+0000 7f93bc800640 1 -- 172.21.15.12:0/228992035 --> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f93b41048e0 con 0x7f939c0a2ec0 2024-09-05T01:24:53.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.215+0000 7f93aea00640 1 -- 172.21.15.12:0/228992035 <== mgr.15138 v2:172.21.15.12:6800/3451745620 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f93b41048e0 con 0x7f939c0a2ec0 2024-09-05T01:24:53.216 INFO:teuthology.orchestra.run.smithi012.stdout:Retention added to path / 2024-09-05T01:24:53.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.217+0000 7f93bc800640 1 -- 172.21.15.12:0/228992035 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f939c0a2ec0 msgr2=0x7f939c0a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:53.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.217+0000 7f93bc800640 1 --2- 172.21.15.12:0/228992035 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f939c0a2ec0 0x7f939c0a5380 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f93a8000c00 tx=0x7f93a8005b50 comp rx=0 tx=0).stop 2024-09-05T01:24:53.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.217+0000 7f93bc800640 1 -- 172.21.15.12:0/228992035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93b4109080 msgr2=0x7f93b419aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:53.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.217+0000 7f93bc800640 1 --2- 172.21.15.12:0/228992035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93b4109080 0x7f93b419aae0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f93a400e9f0 tx=0x7f93a400eeb0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.217+0000 7f93bc800640 1 -- 172.21.15.12:0/228992035 shutdown_connections 2024-09-05T01:24:53.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.217+0000 7f93bc800640 1 --2- 172.21.15.12:0/228992035 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f939c0a2ec0 0x7f939c0a5380 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.217+0000 7f93bc800640 1 --2- 172.21.15.12:0/228992035 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f93b419ee60 0x7f93b419f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.217+0000 7f93bc800640 1 --2- 172.21.15.12:0/228992035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f93b4109080 0x7f93b419aae0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.217+0000 7f93bc800640 1 --2- 172.21.15.12:0/228992035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93b4103f30 0x7f93b419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.217+0000 7f93bc800640 1 -- 172.21.15.12:0/228992035 >> 172.21.15.12:0/228992035 conn(0x7f93b40ff980 msgr2=0x7f93b4100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:53.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.217+0000 7f93bc800640 1 -- 172.21.15.12:0/228992035 shutdown_connections 2024-09-05T01:24:53.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.217+0000 7f93bc800640 1 -- 172.21.15.12:0/228992035 wait complete. 2024-09-05T01:24:53.235 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-05T01:24:53.394 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:24:53.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.401+0000 7f8a36600640 1 -- 172.21.15.12:0/3336101860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a30102250 msgr2=0x7f8a3010e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:53.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.401+0000 7f8a36600640 1 --2- 172.21.15.12:0/3336101860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a30102250 0x7f8a3010e780 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8a28009cd0 tx=0x7f8a2802a8f0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.401+0000 7f8a36600640 1 -- 172.21.15.12:0/3336101860 shutdown_connections 2024-09-05T01:24:53.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.401+0000 7f8a36600640 1 --2- 172.21.15.12:0/3336101860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a30102250 0x7f8a3010e780 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.401+0000 7f8a36600640 1 --2- 172.21.15.12:0/3336101860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a301018b0 0x7f8a30101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.401+0000 7f8a36600640 1 --2- 172.21.15.12:0/3336101860 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a301078c0 0x7f8a30107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.401+0000 7f8a36600640 1 -- 172.21.15.12:0/3336101860 >> 172.21.15.12:0/3336101860 conn(0x7f8a300fd5d0 msgr2=0x7f8a300ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:53.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.401+0000 7f8a36600640 1 -- 172.21.15.12:0/3336101860 shutdown_connections 2024-09-05T01:24:53.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.401+0000 7f8a36600640 1 -- 172.21.15.12:0/3336101860 wait complete. 2024-09-05T01:24:53.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.402+0000 7f8a36600640 1 Processor -- start 2024-09-05T01:24:53.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.402+0000 7f8a36600640 1 -- start start 2024-09-05T01:24:53.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.403+0000 7f8a36600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a301018b0 0x7f8a3019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:53.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.403+0000 7f8a36600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a30102250 0x7f8a3019a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:53.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.403+0000 7f8a36600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a301078c0 0x7f8a3019eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:53.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.403+0000 7f8a36600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8a30111d50 con 0x7f8a30102250 2024-09-05T01:24:53.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.403+0000 7f8a36600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8a30111bd0 con 0x7f8a301078c0 2024-09-05T01:24:53.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.403+0000 7f8a36600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8a30111ed0 con 0x7f8a301018b0 2024-09-05T01:24:53.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.403+0000 7f8a2fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a30102250 0x7f8a3019a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:53.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.403+0000 7f8a2fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a30102250 0x7f8a3019a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47920/0 (socket says 172.21.15.12:47920) 2024-09-05T01:24:53.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.403+0000 7f8a35200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a301018b0 0x7f8a3019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:53.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.403+0000 7f8a2fe00640 1 -- 172.21.15.12:0/1050315120 learned_addr learned my addr 172.21.15.12:0/1050315120 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:53.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.403+0000 7f8a35c00640 1 --2- 172.21.15.12:0/1050315120 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a301078c0 0x7f8a3019eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:53.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.404+0000 7f8a35200640 1 -- 172.21.15.12:0/1050315120 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a301078c0 msgr2=0x7f8a3019eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:53.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.404+0000 7f8a35200640 1 --2- 172.21.15.12:0/1050315120 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a301078c0 0x7f8a3019eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.404+0000 7f8a35200640 1 -- 172.21.15.12:0/1050315120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a30102250 msgr2=0x7f8a3019a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:53.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.404+0000 7f8a35200640 1 --2- 172.21.15.12:0/1050315120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a30102250 0x7f8a3019a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.404+0000 7f8a35200640 1 -- 172.21.15.12:0/1050315120 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a3019f3d0 con 0x7f8a301018b0 2024-09-05T01:24:53.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.404+0000 7f8a2fe00640 1 --2- 172.21.15.12:0/1050315120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a30102250 0x7f8a3019a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:53.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.404+0000 7f8a35200640 1 --2- 172.21.15.12:0/1050315120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a301018b0 0x7f8a3019a3e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8a2400e9f0 tx=0x7f8a2400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:53.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.404+0000 7f8a2d600640 1 -- 172.21.15.12:0/1050315120 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2400ccc0 con 0x7f8a301018b0 2024-09-05T01:24:53.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.404+0000 7f8a36600640 1 -- 172.21.15.12:0/1050315120 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a3019f6c0 con 0x7f8a301018b0 2024-09-05T01:24:53.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.405+0000 7f8a2d600640 1 -- 172.21.15.12:0/1050315120 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a24010910 con 0x7f8a301018b0 2024-09-05T01:24:53.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.405+0000 7f8a2d600640 1 -- 172.21.15.12:0/1050315120 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a24018960 con 0x7f8a301018b0 2024-09-05T01:24:53.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.405+0000 7f8a36600640 1 -- 172.21.15.12:0/1050315120 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a301a6f50 con 0x7f8a301018b0 2024-09-05T01:24:53.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.406+0000 7f8a36600640 1 -- 172.21.15.12:0/1050315120 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a30101d10 con 0x7f8a301018b0 2024-09-05T01:24:53.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.408+0000 7f8a2d600640 1 -- 172.21.15.12:0/1050315120 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f8a24010ac0 con 0x7f8a301018b0 2024-09-05T01:24:53.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.410+0000 7f8a2d600640 1 --2- 172.21.15.12:0/1050315120 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8a180a2d80 0x7f8a180a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:53.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.410+0000 7f8a2d600640 1 -- 172.21.15.12:0/1050315120 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f8a240cfe50 con 0x7f8a301018b0 2024-09-05T01:24:53.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.410+0000 7f8a2fe00640 1 --2- 172.21.15.12:0/1050315120 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8a180a2d80 0x7f8a180a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:53.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.411+0000 7f8a2fe00640 1 --2- 172.21.15.12:0/1050315120 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8a180a2d80 0x7f8a180a5240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8a3010ec30 tx=0x7f8a1c005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:53.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.411+0000 7f8a2d600640 1 -- 172.21.15.12:0/1050315120 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8a2409c240 con 0x7f8a301018b0 2024-09-05T01:24:53.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:53 smithi012 ceph-mon[29942]: from='client.25304 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:53.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:53 smithi012 ceph-mon[29942]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:53.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.623+0000 7f8a36600640 1 -- 172.21.15.12:0/1050315120 --> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f8a300fe310 con 0x7f8a180a2d80 2024-09-05T01:24:53.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.631+0000 7f8a2d600640 1 -- 172.21.15.12:0/1050315120 <== mgr.15138 v2:172.21.15.12:6800/3451745620 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f8a300fe310 con 0x7f8a180a2d80 2024-09-05T01:24:53.632 INFO:teuthology.orchestra.run.smithi012.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-05T00:00:00", "created": "2024-09-05T01:24:52", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-05T01:24:53.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.633+0000 7f8a36600640 1 -- 172.21.15.12:0/1050315120 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8a180a2d80 msgr2=0x7f8a180a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:53.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.633+0000 7f8a36600640 1 --2- 172.21.15.12:0/1050315120 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8a180a2d80 0x7f8a180a5240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8a3010ec30 tx=0x7f8a1c005f90 comp rx=0 tx=0).stop 2024-09-05T01:24:53.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.633+0000 7f8a36600640 1 -- 172.21.15.12:0/1050315120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a301018b0 msgr2=0x7f8a3019a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:53.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.633+0000 7f8a36600640 1 --2- 172.21.15.12:0/1050315120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a301018b0 0x7f8a3019a3e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8a2400e9f0 tx=0x7f8a2400eeb0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.633+0000 7f8a36600640 1 -- 172.21.15.12:0/1050315120 shutdown_connections 2024-09-05T01:24:53.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.633+0000 7f8a36600640 1 --2- 172.21.15.12:0/1050315120 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8a180a2d80 0x7f8a180a5240 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.633+0000 7f8a36600640 1 --2- 172.21.15.12:0/1050315120 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a301078c0 0x7f8a3019eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.633+0000 7f8a36600640 1 --2- 172.21.15.12:0/1050315120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a30102250 0x7f8a3019a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.633+0000 7f8a36600640 1 --2- 172.21.15.12:0/1050315120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a301018b0 0x7f8a3019a3e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.633+0000 7f8a36600640 1 -- 172.21.15.12:0/1050315120 >> 172.21.15.12:0/1050315120 conn(0x7f8a300fd5d0 msgr2=0x7f8a300fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:53.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.633+0000 7f8a36600640 1 -- 172.21.15.12:0/1050315120 shutdown_connections 2024-09-05T01:24:53.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.633+0000 7f8a36600640 1 -- 172.21.15.12:0/1050315120 wait complete. 2024-09-05T01:24:53.650 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-05T01:24:53.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.817+0000 7fd548a00640 1 -- 172.21.15.12:0/254835124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd544104490 msgr2=0x7fd5441109c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:53.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.817+0000 7fd548a00640 1 --2- 172.21.15.12:0/254835124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd544104490 0x7fd5441109c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd53c009cd0 tx=0x7fd53c02a8e0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.817+0000 7fd548a00640 1 -- 172.21.15.12:0/254835124 shutdown_connections 2024-09-05T01:24:53.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.817+0000 7fd548a00640 1 --2- 172.21.15.12:0/254835124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd544104490 0x7fd5441109c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.817+0000 7fd548a00640 1 --2- 172.21.15.12:0/254835124 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd544103af0 0x7fd544103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.817+0000 7fd548a00640 1 --2- 172.21.15.12:0/254835124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd544109b90 0x7fd544109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.817+0000 7fd548a00640 1 -- 172.21.15.12:0/254835124 >> 172.21.15.12:0/254835124 conn(0x7fd5440ff7d0 msgr2=0x7fd544101bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:53.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.817+0000 7fd548a00640 1 -- 172.21.15.12:0/254835124 shutdown_connections 2024-09-05T01:24:53.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.817+0000 7fd548a00640 1 -- 172.21.15.12:0/254835124 wait complete. 2024-09-05T01:24:53.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.818+0000 7fd548a00640 1 Processor -- start 2024-09-05T01:24:53.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.818+0000 7fd548a00640 1 -- start start 2024-09-05T01:24:53.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.819+0000 7fd548a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd544103af0 0x7fd54419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:53.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.819+0000 7fd548a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd544104490 0x7fd54419a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:53.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.819+0000 7fd548a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd544109b90 0x7fd54419ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:53.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.819+0000 7fd548a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd544113f90 con 0x7fd544104490 2024-09-05T01:24:53.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.819+0000 7fd548a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fd544113e10 con 0x7fd544103af0 2024-09-05T01:24:53.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.819+0000 7fd548a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd544114110 con 0x7fd544109b90 2024-09-05T01:24:53.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.819+0000 7fd541e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd544104490 0x7fd54419a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:53.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.819+0000 7fd541e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd544104490 0x7fd54419a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47936/0 (socket says 172.21.15.12:47936) 2024-09-05T01:24:53.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.819+0000 7fd541e00640 1 -- 172.21.15.12:0/903184427 learned_addr learned my addr 172.21.15.12:0/903184427 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:53.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.819+0000 7fd542800640 1 --2- 172.21.15.12:0/903184427 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd544103af0 0x7fd54419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:53.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.819+0000 7fd543200640 1 --2- 172.21.15.12:0/903184427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd544109b90 0x7fd54419ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:53.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.819+0000 7fd541e00640 1 -- 172.21.15.12:0/903184427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd544109b90 msgr2=0x7fd54419ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:53.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.819+0000 7fd541e00640 1 --2- 172.21.15.12:0/903184427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd544109b90 0x7fd54419ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.819+0000 7fd541e00640 1 -- 172.21.15.12:0/903184427 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd544103af0 msgr2=0x7fd54419a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:53.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.819+0000 7fd541e00640 1 --2- 172.21.15.12:0/903184427 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd544103af0 0x7fd54419a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.819+0000 7fd541e00640 1 -- 172.21.15.12:0/903184427 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54419f430 con 0x7fd544104490 2024-09-05T01:24:53.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.820+0000 7fd541e00640 1 --2- 172.21.15.12:0/903184427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd544104490 0x7fd54419a980 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd53000ea60 tx=0x7fd53000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:53.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.820+0000 7fd53b400640 1 -- 172.21.15.12:0/903184427 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53000cde0 con 0x7fd544104490 2024-09-05T01:24:53.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.820+0000 7fd53b400640 1 -- 172.21.15.12:0/903184427 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5300035f0 con 0x7fd544104490 2024-09-05T01:24:53.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.820+0000 7fd53b400640 1 -- 172.21.15.12:0/903184427 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd530010670 con 0x7fd544104490 2024-09-05T01:24:53.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.820+0000 7fd548a00640 1 -- 172.21.15.12:0/903184427 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd54419f720 con 0x7fd544104490 2024-09-05T01:24:53.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.820+0000 7fd548a00640 1 -- 172.21.15.12:0/903184427 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5441a6fb0 con 0x7fd544104490 2024-09-05T01:24:53.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.821+0000 7fd548a00640 1 -- 172.21.15.12:0/903184427 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd544103f50 con 0x7fd544104490 2024-09-05T01:24:53.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.824+0000 7fd53b400640 1 -- 172.21.15.12:0/903184427 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7fd5300037a0 con 0x7fd544104490 2024-09-05T01:24:53.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.825+0000 7fd53b400640 1 --2- 172.21.15.12:0/903184427 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fd5280a2e00 0x7fd5280a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:53.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.825+0000 7fd53b400640 1 -- 172.21.15.12:0/903184427 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fd5300cf980 con 0x7fd544104490 2024-09-05T01:24:53.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.825+0000 7fd542800640 1 --2- 172.21.15.12:0/903184427 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fd5280a2e00 0x7fd5280a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:53.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.826+0000 7fd542800640 1 --2- 172.21.15.12:0/903184427 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fd5280a2e00 0x7fd5280a52c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd534009b50 tx=0x7fd534005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:53.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.829+0000 7fd53b400640 1 -- 172.21.15.12:0/903184427 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd53009c3c0 con 0x7fd544104490 2024-09-05T01:24:53.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:53 smithi145 ceph-mon[34376]: from='client.25304 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:53.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:53 smithi145 ceph-mon[34376]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:53.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:53 smithi151 ceph-mon[35013]: from='client.25304 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:53.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:53 smithi151 ceph-mon[35013]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:53.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.982+0000 7f7b27200640 1 -- 172.21.15.12:0/3109627176 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b28074e30 msgr2=0x7f7b2810dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:53.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.982+0000 7f7b27200640 1 --2- 172.21.15.12:0/3109627176 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b28074e30 0x7f7b2810dd40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009860 tx=0x7f7b1402a3d0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.983+0000 7f7b27200640 1 -- 172.21.15.12:0/3109627176 shutdown_connections 2024-09-05T01:24:53.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.983+0000 7f7b27200640 1 --2- 172.21.15.12:0/3109627176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b2810e280 0x7f7b28110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.983+0000 7f7b27200640 1 --2- 172.21.15.12:0/3109627176 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b28074e30 0x7f7b2810dd40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.983+0000 7f7b27200640 1 --2- 172.21.15.12:0/3109627176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b28074510 0x7f7b280748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.983+0000 7f7b27200640 1 -- 172.21.15.12:0/3109627176 >> 172.21.15.12:0/3109627176 conn(0x7f7b280fd740 msgr2=0x7f7b280ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:53.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.983+0000 7f7b27200640 1 -- 172.21.15.12:0/3109627176 shutdown_connections 2024-09-05T01:24:53.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.983+0000 7f7b27200640 1 -- 172.21.15.12:0/3109627176 wait complete. 2024-09-05T01:24:53.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.984+0000 7f7b27200640 1 Processor -- start 2024-09-05T01:24:53.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.984+0000 7f7b27200640 1 -- start start 2024-09-05T01:24:53.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.984+0000 7f7b27200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b28074510 0x7f7b2819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:53.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.984+0000 7f7b27200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b28074e30 0x7f7b2819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:53.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.984+0000 7f7b27200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b2810e280 0x7f7b2819eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:53.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.984+0000 7f7b27200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7b28113fb0 con 0x7f7b2810e280 2024-09-05T01:24:53.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.984+0000 7f7b27200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7b28113e30 con 0x7f7b28074510 2024-09-05T01:24:53.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.984+0000 7f7b27200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7b28114130 con 0x7f7b28074e30 2024-09-05T01:24:53.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.985+0000 7f7b25400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b28074e30 0x7f7b2819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:53.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.985+0000 7f7b25e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b28074510 0x7f7b2819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:53.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.985+0000 7f7b25400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b28074e30 0x7f7b2819aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:36838/0 (socket says 172.21.15.12:36838) 2024-09-05T01:24:53.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.985+0000 7f7b25e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b28074510 0x7f7b2819a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:60676/0 (socket says 172.21.15.12:60676) 2024-09-05T01:24:53.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.985+0000 7f7b25400640 1 -- 172.21.15.12:0/4211420152 learned_addr learned my addr 172.21.15.12:0/4211420152 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:53.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.985+0000 7f7b26800640 1 --2- 172.21.15.12:0/4211420152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b2810e280 0x7f7b2819eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:53.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.985+0000 7f7b25e00640 1 -- 172.21.15.12:0/4211420152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b28074e30 msgr2=0x7f7b2819aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:53.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.985+0000 7f7b25e00640 1 --2- 172.21.15.12:0/4211420152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b28074e30 0x7f7b2819aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.985+0000 7f7b25e00640 1 -- 172.21.15.12:0/4211420152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b2810e280 msgr2=0x7f7b2819eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:53.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.985+0000 7f7b25e00640 1 --2- 172.21.15.12:0/4211420152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b2810e280 0x7f7b2819eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.985+0000 7f7b25e00640 1 -- 172.21.15.12:0/4211420152 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2819f480 con 0x7f7b28074510 2024-09-05T01:24:53.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.985+0000 7f7b25e00640 1 --2- 172.21.15.12:0/4211420152 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b28074510 0x7f7b2819a4d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800d6d0 tx=0x7f7b1800db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:53.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.986+0000 7f7b1ea00640 1 -- 172.21.15.12:0/4211420152 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b18017070 con 0x7f7b28074510 2024-09-05T01:24:53.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.986+0000 7f7b1ea00640 1 -- 172.21.15.12:0/4211420152 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b18009820 con 0x7f7b28074510 2024-09-05T01:24:53.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.986+0000 7f7b1ea00640 1 -- 172.21.15.12:0/4211420152 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b18004d00 con 0x7f7b28074510 2024-09-05T01:24:53.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.986+0000 7f7b27200640 1 -- 172.21.15.12:0/4211420152 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b2819f770 con 0x7f7b28074510 2024-09-05T01:24:53.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.986+0000 7f7b27200640 1 -- 172.21.15.12:0/4211420152 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b281a7050 con 0x7f7b28074510 2024-09-05T01:24:53.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.989+0000 7f7b2f86b740 1 Processor -- start 2024-09-05T01:24:53.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.989+0000 7f7b1ea00640 1 -- 172.21.15.12:0/4211420152 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 24) ==== 138009+0+0 (secure 0 0 0) 0x7f7b180099d0 con 0x7f7b28074510 2024-09-05T01:24:53.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.989+0000 7f7b2f86b740 1 -- start start 2024-09-05T01:24:53.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.990+0000 7f7b2f86b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af73d50 0x55cc9af74130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:53.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.990+0000 7f7b2f86b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc9af74670 0x55cc9af7e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:53.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.990+0000 7f7b2f86b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc9af7ef30 0x55cc9af81320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:53.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.990+0000 7f7b2f86b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cc9aeda3e0 con 0x55cc9af74670 2024-09-05T01:24:53.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.990+0000 7f7b2f86b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55cc9ae81d80 con 0x55cc9af7ef30 2024-09-05T01:24:53.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.990+0000 7f7b2f86b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55cc9aed63a0 con 0x55cc9af73d50 2024-09-05T01:24:53.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.990+0000 7f7b26800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af73d50 0x55cc9af74130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:53.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.990+0000 7f7b26800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af73d50 0x55cc9af74130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:36852/0 (socket says 172.21.15.12:36852) 2024-09-05T01:24:53.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.990+0000 7f7b26800640 1 -- 172.21.15.12:0/4126928210 learned_addr learned my addr 172.21.15.12:0/4126928210 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:53.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.990+0000 7f7b25400640 1 --2- 172.21.15.12:0/4126928210 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc9af7ef30 0x55cc9af81320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:53.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.990+0000 7f7b25e00640 1 --2- 172.21.15.12:0/4126928210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc9af74670 0x55cc9af7e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:53.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.991+0000 7f7b26800640 1 -- 172.21.15.12:0/4126928210 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc9af7ef30 msgr2=0x55cc9af81320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:53.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.991+0000 7f7b26800640 1 --2- 172.21.15.12:0/4126928210 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc9af7ef30 0x55cc9af81320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.991+0000 7f7b26800640 1 -- 172.21.15.12:0/4126928210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc9af74670 msgr2=0x55cc9af7e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:53.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.991+0000 7f7b26800640 1 --2- 172.21.15.12:0/4126928210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc9af74670 0x55cc9af7e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.991+0000 7f7b26800640 1 -- 172.21.15.12:0/4126928210 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc9aea0ae0 con 0x55cc9af73d50 2024-09-05T01:24:53.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.991+0000 7f7b26800640 1 --2- 172.21.15.12:0/4126928210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af73d50 0x55cc9af74130 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000e480 tx=0x7f7b200095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc6946d355af8217 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:53.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.991+0000 7f7b1ea00640 1 --2- 172.21.15.12:0/4211420152 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7b0c0a2e00 0x7f7b0c0a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:53.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.991+0000 7f7b1ea00640 1 -- 172.21.15.12:0/4211420152 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f7b180cf0e0 con 0x7f7b28074510 2024-09-05T01:24:53.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.991+0000 7f7b13000640 1 -- 172.21.15.12:0/4126928210 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b20003970 con 0x55cc9af73d50 2024-09-05T01:24:53.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.991+0000 7f7b13000640 1 -- 172.21.15.12:0/4126928210 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b2000d7d0 con 0x55cc9af73d50 2024-09-05T01:24:53.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.991+0000 7f7b13000640 1 -- 172.21.15.12:0/4126928210 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b20004460 con 0x55cc9af73d50 2024-09-05T01:24:53.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.992+0000 7f7b25e00640 1 --2- 172.21.15.12:0/4211420152 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7b0c0a2e00 0x7f7b0c0a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:53.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.992+0000 7f7b2f86b740 1 -- 172.21.15.12:0/4126928210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af73d50 msgr2=0x55cc9af74130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:53.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.992+0000 7f7b2f86b740 1 --2- 172.21.15.12:0/4126928210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af73d50 0x55cc9af74130 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000e480 tx=0x7f7b200095c0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.992+0000 7f7b25e00640 1 --2- 172.21.15.12:0/4211420152 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7b0c0a2e00 0x7f7b0c0a52c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7b180cc760 tx=0x7f7b18097040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:53.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.992+0000 7f7b2f86b740 1 -- 172.21.15.12:0/4126928210 shutdown_connections 2024-09-05T01:24:53.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.992+0000 7f7b2f86b740 1 --2- 172.21.15.12:0/4126928210 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc9af7ef30 0x55cc9af81320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.992+0000 7f7b2f86b740 1 --2- 172.21.15.12:0/4126928210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc9af74670 0x55cc9af7e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.992+0000 7f7b2f86b740 1 --2- 172.21.15.12:0/4126928210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af73d50 0x55cc9af74130 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.992+0000 7f7b2f86b740 1 -- 172.21.15.12:0/4126928210 >> 172.21.15.12:0/4126928210 conn(0x55cc9af702e0 msgr2=0x55cc9af706c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:53.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.993+0000 7f7b2f86b740 1 -- 172.21.15.12:0/4126928210 shutdown_connections 2024-09-05T01:24:53.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.993+0000 7f7b2f86b740 1 -- 172.21.15.12:0/4126928210 wait complete. 2024-09-05T01:24:53.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.993+0000 7f7b2f86b740 1 -- start start 2024-09-05T01:24:53.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.993+0000 7f7b2f86b740 1 Processor -- start 2024-09-05T01:24:53.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.994+0000 7f7b2f86b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc9af73d50 0x55cc9af7be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:53.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.994+0000 7f7b2f86b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc9af74670 0x55cc9af7c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:53.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.994+0000 7f7b2f86b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af7ef30 0x55cc9af7c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:53.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.994+0000 7f7b2f86b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cc9af81ba0 con 0x55cc9af73d50 2024-09-05T01:24:53.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.994+0000 7f7b2f86b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55cc9ae950f0 con 0x55cc9af74670 2024-09-05T01:24:53.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.994+0000 7f7b2f86b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55cc9af81d20 con 0x55cc9af7ef30 2024-09-05T01:24:53.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.994+0000 7f7b2f86b740 10 client.0 _ll_register_callbacks cb 0x55cc9ae869e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:24:53.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.994+0000 7f7b25400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc9af74670 0x55cc9af7c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:53.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.994+0000 7f7b25400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc9af74670 0x55cc9af7c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:60700/0 (socket says 172.21.15.12:60700) 2024-09-05T01:24:53.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.994+0000 7f7b25400640 1 -- 172.21.15.12:0/1558123698 learned_addr learned my addr 172.21.15.12:0/1558123698 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:53.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.994+0000 7f7b26800640 1 --2- 172.21.15.12:0/1558123698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc9af73d50 0x55cc9af7be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:53.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.994+0000 7f7b26800640 1 --2- 172.21.15.12:0/1558123698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af7ef30 0x55cc9af7c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:53.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.994+0000 7f7b25400640 1 -- 172.21.15.12:0/1558123698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af7ef30 msgr2=0x55cc9af7c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.994+0000 7f7b25400640 1 --2- 172.21.15.12:0/1558123698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af7ef30 0x55cc9af7c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.994+0000 7f7b25400640 1 -- 172.21.15.12:0/1558123698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc9af73d50 msgr2=0x55cc9af7be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.994+0000 7f7b25400640 1 --2- 172.21.15.12:0/1558123698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc9af73d50 0x55cc9af7be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.994+0000 7f7b25400640 1 -- 172.21.15.12:0/1558123698 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc9ac4b3c0 con 0x55cc9af74670 2024-09-05T01:24:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.994+0000 7f7b26800640 1 --2- 172.21.15.12:0/1558123698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af7ef30 0x55cc9af7c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:24:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.995+0000 7f7b25400640 1 --2- 172.21.15.12:0/1558123698 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc9af74670 0x55cc9af7c360 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7b1402a8f0 tx=0x7f7b14009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fce1a9829312274 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.995+0000 7f7b07400640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:24:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.995+0000 7f7b07400640 1 -- 172.21.15.12:0/1558123698 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b140306f0 con 0x55cc9af74670 2024-09-05T01:24:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.995+0000 7f7b2f86b740 1 -- 172.21.15.12:0/1558123698 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b2000d7d0 con 0x55cc9af74670 2024-09-05T01:24:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.995+0000 7f7b07400640 1 -- 172.21.15.12:0/1558123698 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f7b14004020 con 0x55cc9af74670 2024-09-05T01:24:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.995+0000 7f7b07400640 1 -- 172.21.15.12:0/1558123698 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7b14030890 con 0x55cc9af74670 2024-09-05T01:24:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.995+0000 7f7b2f86b740 10 client.25334 fetch_fsmap learned FSMap version 28 2024-09-05T01:24:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.995+0000 7f7b2f86b740 1 -- 172.21.15.12:0/1558123698 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cc9af8d8a0 con 0x55cc9af74670 2024-09-05T01:24:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.996+0000 7f7b07400640 1 -- 172.21.15.12:0/1558123698 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b2000d7d0 con 0x55cc9af74670 2024-09-05T01:24:54.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.996+0000 7f7b07400640 1 -- 172.21.15.12:0/1558123698 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7b140049c0 con 0x55cc9af74670 2024-09-05T01:24:54.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.996+0000 7f7b2f86b740 10 client.25334 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:24:54.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.996+0000 7f7b2f86b740 10 client.25334 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:24:54.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.996+0000 7f7b2f86b740 20 client.25334 populate_metadata read hostname 'smithi012' 2024-09-05T01:24:54.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.996+0000 7f7b2f86b740 1 --2- 172.21.15.12:0/1558123698 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55cc9af8ecb0 0x55cc9af910c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:54.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.996+0000 7f7b2f86b740 4 client.25334 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:24:54.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.996+0000 7f7b2f86b740 1 -- 172.21.15.12:0/1558123698 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc9aee7950 con 0x55cc9af8ecb0 2024-09-05T01:24:54.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.997+0000 7f7b26800640 1 --2- 172.21.15.12:0/1558123698 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55cc9af8ecb0 0x55cc9af910c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:54.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.997+0000 7f7b26800640 1 --2- 172.21.15.12:0/1558123698 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55cc9af8ecb0 0x55cc9af910c0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=333fa8bce3c03580 server_cookie=637dce80a30b20f1 in_seq=0 out_seq=0 2024-09-05T01:24:54.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.997+0000 7f7b07400640 10 client.25334 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:24:54.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.998+0000 7f7b07400640 1 -- 172.21.15.12:0/1558123698 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cc9aee7950 con 0x55cc9af8ecb0 2024-09-05T01:24:54.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.998+0000 7f7b07400640 10 client.25334 handle_command_reply: tid=0 2024-09-05T01:24:54.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.998+0000 7f7b2f86b740 1 client.25334 shutdown 2024-09-05T01:24:54.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.998+0000 7f7b2f86b740 1 -- 172.21.15.12:0/1558123698 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc9af74670 msgr2=0x55cc9af7c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:54.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.998+0000 7f7b2f86b740 1 --2- 172.21.15.12:0/1558123698 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc9af74670 0x55cc9af7c360 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7b1402a8f0 tx=0x7f7b14009500 comp rx=0 tx=0).stop 2024-09-05T01:24:54.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.998+0000 7f7b2f86b740 1 -- 172.21.15.12:0/1558123698 shutdown_connections 2024-09-05T01:24:54.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.998+0000 7f7b2f86b740 1 --2- 172.21.15.12:0/1558123698 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55cc9af8ecb0 0x55cc9af910c0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:54.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.998+0000 7f7b2f86b740 1 --2- 172.21.15.12:0/1558123698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af7ef30 0x55cc9af7c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:54.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.998+0000 7f7b2f86b740 1 --2- 172.21.15.12:0/1558123698 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc9af74670 0x55cc9af7c360 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:54.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.998+0000 7f7b2f86b740 1 --2- 172.21.15.12:0/1558123698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc9af73d50 0x55cc9af7be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:54.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.998+0000 7f7b2f86b740 1 -- 172.21.15.12:0/1558123698 >> 172.21.15.12:0/1558123698 conn(0x55cc9af702e0 msgr2=0x55cc9af76010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:54.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.998+0000 7f7b07400640 0 client.25334 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:24:54.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.999+0000 7f7b2f86b740 1 -- 172.21.15.12:0/1558123698 shutdown_connections 2024-09-05T01:24:54.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.999+0000 7f7b2f86b740 1 -- 172.21.15.12:0/1558123698 wait complete. 2024-09-05T01:24:54.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:53.999+0000 7f7b2f86b740 20 client.25334 trim_cache size 0 max 16384 2024-09-05T01:24:54.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.017+0000 7f7b2f86b740 1 Processor -- start 2024-09-05T01:24:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.017+0000 7f7b2f86b740 1 -- start start 2024-09-05T01:24:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.017+0000 7f7b2f86b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc9af73d50 0x55cc9af7a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.017+0000 7f7b2f86b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc9af74670 0x55cc9af75eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.017+0000 7f7b2f86b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af7ef30 0x55cc9af96990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.017+0000 7f7b2f86b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281afa50 con 0x55cc9af74670 2024-09-05T01:24:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.017+0000 7f7b2f86b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281b1590 con 0x55cc9af73d50 2024-09-05T01:24:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.017+0000 7f7b2f86b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281b0120 con 0x55cc9af7ef30 2024-09-05T01:24:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.018+0000 7f7b25400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc9af74670 0x55cc9af75eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.018+0000 7f7b25400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc9af74670 0x55cc9af75eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47998/0 (socket says 172.21.15.12:47998) 2024-09-05T01:24:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.018+0000 7f7b25400640 1 -- 172.21.15.12:0/2724152033 learned_addr learned my addr 172.21.15.12:0/2724152033 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.018+0000 7f7b26800640 1 --2- 172.21.15.12:0/2724152033 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc9af73d50 0x55cc9af7a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:54.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.018+0000 7f7b26800640 1 --2- 172.21.15.12:0/2724152033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af7ef30 0x55cc9af96990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.018+0000 7f7b25400640 1 -- 172.21.15.12:0/2724152033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af7ef30 msgr2=0x55cc9af96990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.018+0000 7f7b25400640 1 --2- 172.21.15.12:0/2724152033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af7ef30 0x55cc9af96990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.018+0000 7f7b25400640 1 -- 172.21.15.12:0/2724152033 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc9af73d50 msgr2=0x55cc9af7a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.018+0000 7f7b25400640 1 --2- 172.21.15.12:0/2724152033 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc9af73d50 0x55cc9af7a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.018+0000 7f7b25400640 1 -- 172.21.15.12:0/2724152033 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc9af7add0 con 0x55cc9af74670 2024-09-05T01:24:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.018+0000 7f7b25400640 1 --2- 172.21.15.12:0/2724152033 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc9af74670 0x55cc9af75eb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7b14000c00 tx=0x7f7b14005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764590ec4946ab6d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.019+0000 7f7b12600640 1 -- 172.21.15.12:0/2724152033 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b14052020 con 0x55cc9af74670 2024-09-05T01:24:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.019+0000 7f7b12600640 1 -- 172.21.15.12:0/2724152033 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b14004ba0 con 0x55cc9af74670 2024-09-05T01:24:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.019+0000 7f7b12600640 1 -- 172.21.15.12:0/2724152033 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1402f780 con 0x55cc9af74670 2024-09-05T01:24:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.019+0000 7f7b2f86b740 1 -- 172.21.15.12:0/2724152033 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc9af74670 msgr2=0x55cc9af75eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:54.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.019+0000 7f7b2f86b740 1 --2- 172.21.15.12:0/2724152033 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc9af74670 0x55cc9af75eb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7b14000c00 tx=0x7f7b14005b10 comp rx=0 tx=0).stop 2024-09-05T01:24:54.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.020+0000 7f7b2f86b740 1 -- 172.21.15.12:0/2724152033 shutdown_connections 2024-09-05T01:24:54.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.020+0000 7f7b2f86b740 1 --2- 172.21.15.12:0/2724152033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af7ef30 0x55cc9af96990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:54.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.020+0000 7f7b2f86b740 1 --2- 172.21.15.12:0/2724152033 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc9af74670 0x55cc9af75eb0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:54.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.020+0000 7f7b2f86b740 1 --2- 172.21.15.12:0/2724152033 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc9af73d50 0x55cc9af7a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:54.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.020+0000 7f7b2f86b740 1 -- 172.21.15.12:0/2724152033 >> 172.21.15.12:0/2724152033 conn(0x55cc9af702e0 msgr2=0x55cc9af757a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:54.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.020+0000 7f7b2f86b740 1 -- 172.21.15.12:0/2724152033 shutdown_connections 2024-09-05T01:24:54.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.020+0000 7f7b2f86b740 1 -- 172.21.15.12:0/2724152033 wait complete. 2024-09-05T01:24:54.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.020+0000 7f7b2f86b740 1 -- start start 2024-09-05T01:24:54.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.021+0000 7f7b2f86b740 1 Processor -- start 2024-09-05T01:24:54.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.021+0000 7f7b2f86b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af73d50 0x55cc9af875b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:54.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.021+0000 7f7b2f86b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc9af74670 0x55cc9af78a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:54.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.021+0000 7f7b2f86b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc9af7ef30 0x55cc9af78fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:54.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.021+0000 7f7b2f86b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281b0ec0 con 0x55cc9af7ef30 2024-09-05T01:24:54.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.021+0000 7f7b2f86b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281b07f0 con 0x55cc9af74670 2024-09-05T01:24:54.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.021+0000 7f7b2f86b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281ada30 con 0x55cc9af73d50 2024-09-05T01:24:54.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.021+0000 7f7b2f86b740 10 client.0 _ll_register_callbacks cb 0x7f7b14030f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:24:54.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.022+0000 7f7b26800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af73d50 0x55cc9af875b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:54.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.022+0000 7f7b26800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af73d50 0x55cc9af875b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:36878/0 (socket says 172.21.15.12:36878) 2024-09-05T01:24:54.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.022+0000 7f7b26800640 1 -- 172.21.15.12:0/2248773088 learned_addr learned my addr 172.21.15.12:0/2248773088 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:24:54.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.022+0000 7f7b25400640 1 --2- 172.21.15.12:0/2248773088 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc9af74670 0x55cc9af78a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:54.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.022+0000 7f7b26800640 1 --2- 172.21.15.12:0/2248773088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc9af7ef30 0x55cc9af78fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:54.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.022+0000 7f7b25400640 1 -- 172.21.15.12:0/2248773088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af73d50 msgr2=0x55cc9af875b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:54.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.022+0000 7f7b25400640 1 --2- 172.21.15.12:0/2248773088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af73d50 0x55cc9af875b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:54.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.022+0000 7f7b25400640 1 -- 172.21.15.12:0/2248773088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc9af7ef30 msgr2=0x55cc9af78fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:24:54.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.022+0000 7f7b25400640 1 --2- 172.21.15.12:0/2248773088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc9af7ef30 0x55cc9af78fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:54.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.022+0000 7f7b25400640 1 -- 172.21.15.12:0/2248773088 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc9af79710 con 0x55cc9af74670 2024-09-05T01:24:54.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.022+0000 7f7b26800640 1 --2- 172.21.15.12:0/2248773088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af73d50 0x55cc9af875b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:24:54.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.023+0000 7f7b25400640 1 --2- 172.21.15.12:0/2248773088 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc9af74670 0x55cc9af78a90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7b14004eb0 tx=0x7f7b14005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7444dd60d934af7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:24:54.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.023+0000 7f7b07400640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:24:54.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.023+0000 7f7b07400640 1 -- 172.21.15.12:0/2248773088 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1405c060 con 0x55cc9af74670 2024-09-05T01:24:54.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.023+0000 7f7b2f86b740 1 -- 172.21.15.12:0/2248773088 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b14004ba0 con 0x55cc9af74670 2024-09-05T01:24:54.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.023+0000 7f7b07400640 1 -- 172.21.15.12:0/2248773088 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f7b14004990 con 0x55cc9af74670 2024-09-05T01:24:54.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.023+0000 7f7b07400640 1 -- 172.21.15.12:0/2248773088 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7b14052030 con 0x55cc9af74670 2024-09-05T01:24:54.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.023+0000 7f7b2f86b740 10 client.25340 fetch_fsmap learned FSMap version 28 2024-09-05T01:24:54.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.023+0000 7f7b2f86b740 1 -- 172.21.15.12:0/2248773088 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cc9aff98a0 con 0x55cc9af74670 2024-09-05T01:24:54.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.024+0000 7f7b07400640 1 -- 172.21.15.12:0/2248773088 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b14004ba0 con 0x55cc9af74670 2024-09-05T01:24:54.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.024+0000 7f7b07400640 1 -- 172.21.15.12:0/2248773088 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7b14003ce0 con 0x55cc9af74670 2024-09-05T01:24:54.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.024+0000 7f7b2f86b740 10 client.25340 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:24:54.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.024+0000 7f7b2f86b740 10 client.25340 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:24:54.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.024+0000 7f7b2f86b740 20 client.25340 populate_metadata read hostname 'smithi012' 2024-09-05T01:24:54.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.024+0000 7f7b2f86b740 1 --2- 172.21.15.12:0/2248773088 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55cc9aff9f60 0x55cc9affc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:24:54.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.024+0000 7f7b2f86b740 4 client.25340 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T01:24:54.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.024+0000 7f7b2f86b740 1 -- 172.21.15.12:0/2248773088 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cc9aee1e60 con 0x55cc9aff9f60 2024-09-05T01:24:54.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.024+0000 7f7b26800640 1 --2- 172.21.15.12:0/2248773088 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55cc9aff9f60 0x55cc9affc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:24:54.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.025+0000 7f7b26800640 1 --2- 172.21.15.12:0/2248773088 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55cc9aff9f60 0x55cc9affc350 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bdfb75aa980068e server_cookie=27363023904cc048 in_seq=0 out_seq=0 2024-09-05T01:24:54.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.025+0000 7f7b07400640 10 client.25340 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:24:54.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.025+0000 7f7b07400640 1 -- 172.21.15.12:0/2248773088 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55cc9aee1e60 con 0x55cc9aff9f60 2024-09-05T01:24:54.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.025+0000 7f7b07400640 10 client.25340 handle_command_reply: tid=0 2024-09-05T01:24:54.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.025+0000 7f7b2f86b740 1 client.25340 shutdown 2024-09-05T01:24:54.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.025+0000 7f7b2f86b740 1 -- 172.21.15.12:0/2248773088 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc9af74670 msgr2=0x55cc9af78a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:54.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.025+0000 7f7b2f86b740 1 --2- 172.21.15.12:0/2248773088 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc9af74670 0x55cc9af78a90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7b14004eb0 tx=0x7f7b14005d50 comp rx=0 tx=0).stop 2024-09-05T01:24:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.025+0000 7f7b2f86b740 1 -- 172.21.15.12:0/2248773088 shutdown_connections 2024-09-05T01:24:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.025+0000 7f7b2f86b740 1 --2- 172.21.15.12:0/2248773088 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55cc9aff9f60 0x55cc9affc350 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.025+0000 7f7b2f86b740 1 --2- 172.21.15.12:0/2248773088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc9af7ef30 0x55cc9af78fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.025+0000 7f7b2f86b740 1 --2- 172.21.15.12:0/2248773088 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc9af74670 0x55cc9af78a90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.025+0000 7f7b2f86b740 1 --2- 172.21.15.12:0/2248773088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc9af73d50 0x55cc9af875b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.025+0000 7f7b2f86b740 1 -- 172.21.15.12:0/2248773088 >> 172.21.15.12:0/2248773088 conn(0x55cc9af702e0 msgr2=0x55cc9af7c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.025+0000 7f7b07400640 0 client.25340 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:24:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.026+0000 7f7b2f86b740 1 -- 172.21.15.12:0/2248773088 shutdown_connections 2024-09-05T01:24:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.026+0000 7f7b2f86b740 1 -- 172.21.15.12:0/2248773088 wait complete. 2024-09-05T01:24:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.026+0000 7f7b2f86b740 20 client.25340 trim_cache size 0 max 16384 2024-09-05T01:24:54.029 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:24:54.030 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-05T01:24:54.030 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-05T01:24:54.030 INFO:teuthology.orchestra.run.smithi012.stdout: "0b6e4ce5-1b3a-4ee9-8521-91d4d7c6dd55": { 2024-09-05T01:24:54.030 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-05T01:24:54.030 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "0b6e4ce5-1b3a-4ee9-8521-91d4d7c6dd55", 2024-09-05T01:24:54.030 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-05T01:24:54.030 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:24:54.030 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:24:54.030 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:24:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.027+0000 7f7b27200640 1 -- 172.21.15.12:0/4211420152 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7b0c0a2e00 msgr2=0x7f7b0c0a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.027+0000 7f7b27200640 1 --2- 172.21.15.12:0/4211420152 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7b0c0a2e00 0x7f7b0c0a52c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7b180cc760 tx=0x7f7b18097040 comp rx=0 tx=0).stop 2024-09-05T01:24:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.027+0000 7f7b27200640 1 -- 172.21.15.12:0/4211420152 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b28074510 msgr2=0x7f7b2819a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.027+0000 7f7b27200640 1 --2- 172.21.15.12:0/4211420152 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b28074510 0x7f7b2819a4d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800d6d0 tx=0x7f7b1800db90 comp rx=0 tx=0).stop 2024-09-05T01:24:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.027+0000 7f7b27200640 1 -- 172.21.15.12:0/4211420152 shutdown_connections 2024-09-05T01:24:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.027+0000 7f7b27200640 1 --2- 172.21.15.12:0/4211420152 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7b0c0a2e00 0x7f7b0c0a52c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.027+0000 7f7b27200640 1 --2- 172.21.15.12:0/4211420152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b2810e280 0x7f7b2819eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.027+0000 7f7b27200640 1 --2- 172.21.15.12:0/4211420152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b28074e30 0x7f7b2819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:54.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.027+0000 7f7b27200640 1 --2- 172.21.15.12:0/4211420152 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7b28074510 0x7f7b2819a4d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:54.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.027+0000 7f7b27200640 1 -- 172.21.15.12:0/4211420152 >> 172.21.15.12:0/4211420152 conn(0x7f7b280fd740 msgr2=0x7f7b280fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:54.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.027+0000 7f7b27200640 1 -- 172.21.15.12:0/4211420152 shutdown_connections 2024-09-05T01:24:54.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.027+0000 7f7b27200640 1 -- 172.21.15.12:0/4211420152 wait complete. 2024-09-05T01:24:54.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.049+0000 7fd548a00640 1 -- 172.21.15.12:0/903184427 --> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fd544062630 con 0x7fd5280a2e00 2024-09-05T01:24:54.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.057+0000 7fd53b400640 1 -- 172.21.15.12:0/903184427 <== mgr.15138 v2:172.21.15.12:6800/3451745620 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fd544062630 con 0x7fd5280a2e00 2024-09-05T01:24:54.058 INFO:teuthology.orchestra.run.smithi012.stdout:/ 1m 6m3h 2024-09-05T01:24:54.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.060+0000 7fd548a00640 1 -- 172.21.15.12:0/903184427 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fd5280a2e00 msgr2=0x7fd5280a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:54.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.060+0000 7fd548a00640 1 --2- 172.21.15.12:0/903184427 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fd5280a2e00 0x7fd5280a52c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd534009b50 tx=0x7fd534005f90 comp rx=0 tx=0).stop 2024-09-05T01:24:54.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.060+0000 7fd548a00640 1 -- 172.21.15.12:0/903184427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd544104490 msgr2=0x7fd54419a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:24:54.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.060+0000 7fd548a00640 1 --2- 172.21.15.12:0/903184427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd544104490 0x7fd54419a980 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd53000ea60 tx=0x7fd53000ef20 comp rx=0 tx=0).stop 2024-09-05T01:24:54.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.061+0000 7fd548a00640 1 -- 172.21.15.12:0/903184427 shutdown_connections 2024-09-05T01:24:54.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.061+0000 7fd548a00640 1 --2- 172.21.15.12:0/903184427 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fd5280a2e00 0x7fd5280a52c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:54.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.061+0000 7fd548a00640 1 --2- 172.21.15.12:0/903184427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd544109b90 0x7fd54419ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:54.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.061+0000 7fd548a00640 1 --2- 172.21.15.12:0/903184427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd544104490 0x7fd54419a980 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:54.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.061+0000 7fd548a00640 1 --2- 172.21.15.12:0/903184427 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fd544103af0 0x7fd54419a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:24:54.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.061+0000 7fd548a00640 1 -- 172.21.15.12:0/903184427 >> 172.21.15.12:0/903184427 conn(0x7fd5440ff7d0 msgr2=0x7fd5440fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:24:54.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.061+0000 7fd548a00640 1 -- 172.21.15.12:0/903184427 shutdown_connections 2024-09-05T01:24:54.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:24:54.061+0000 7fd548a00640 1 -- 172.21.15.12:0/903184427 wait complete. 2024-09-05T01:24:54.085 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-05T01:24:54.146 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-05T01:24:54.160 INFO:teuthology.run_tasks:Running task workunit... 2024-09-05T01:24:54.209 INFO:tasks.workunit:Pulling workunits from ref 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T01:24:54.210 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-05T01:24:54.210 INFO:tasks.workunit:timeout=3h 2024-09-05T01:24:54.210 INFO:tasks.workunit:cleanup=True 2024-09-05T01:24:54.210 DEBUG:teuthology.orchestra.run.smithi012:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-05T01:24:54.246 INFO:teuthology.orchestra.run.smithi012.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-05T01:24:54.247 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-05T01:24:54.247 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 6ch/108d Inode: 1099511628283 Links: 2 2024-09-05T01:24:54.247 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-05T01:24:54.247 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-05T01:24:54.247 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-05 01:22:56.525286538 +0000 2024-09-05T01:24:54.247 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-05 01:22:56.525286538 +0000 2024-09-05T01:24:54.247 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-05 01:24:40.243295441 +0000 2024-09-05T01:24:54.247 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-09-05 01:22:56.525286538 +0000 2024-09-05T01:24:54.247 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-05T01:24:54.247 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-05T01:24:54.356 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 2024-09-05T01:24:54.394 INFO:tasks.workunit.client.0.smithi012.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-05T01:24:54.772 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:54 smithi012 ceph-mon[29942]: pgmap v9: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 186 B/s wr, 20 op/s 2024-09-05T01:24:54.772 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:54 smithi012 ceph-mon[29942]: from='client.25318 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:54.772 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:54 smithi012 ceph-mon[29942]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:54.809 INFO:tasks.cephfs.filesystem:scrub status for tag:0b6e4ce5-1b3a-4ee9-8521-91d4d7c6dd55 - {'path': '/', 'tag': '0b6e4ce5-1b3a-4ee9-8521-91d4d7c6dd55', 'options': 'recursive,force'} 2024-09-05T01:24:54.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:54 smithi145 ceph-mon[34376]: pgmap v9: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 186 B/s wr, 20 op/s 2024-09-05T01:24:54.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:54 smithi145 ceph-mon[34376]: from='client.25318 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:54.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:54 smithi145 ceph-mon[34376]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:54.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:54 smithi151 ceph-mon[35013]: pgmap v9: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 186 B/s wr, 20 op/s 2024-09-05T01:24:54.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:54 smithi151 ceph-mon[35013]: from='client.25318 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:54.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:54 smithi151 ceph-mon[35013]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:24:57.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:56 smithi012 ceph-mon[29942]: pgmap v10: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 170 B/s wr, 18 op/s 2024-09-05T01:24:57.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:56 smithi145 ceph-mon[34376]: pgmap v10: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 170 B/s wr, 18 op/s 2024-09-05T01:24:57.103 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:56 smithi151 ceph-mon[35013]: pgmap v10: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 170 B/s wr, 18 op/s 2024-09-05T01:24:59.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:24:58 smithi012 ceph-mon[29942]: pgmap v11: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 170 B/s wr, 18 op/s 2024-09-05T01:24:59.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:24:58 smithi145 ceph-mon[34376]: pgmap v11: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 170 B/s wr, 18 op/s 2024-09-05T01:24:59.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:24:58 smithi151 ceph-mon[35013]: pgmap v11: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 170 B/s wr, 18 op/s 2024-09-05T01:25:00.562 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:25:00 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:25:00.229+0000 7f2d87000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T01:25:00.562 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:25:00 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:25:00.229+0000 7f2d87000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T01:25:00.562 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:25:00 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:25:00.229+0000 7f2d87000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T01:25:00.562 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:25:00 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:25:00.229+0000 7f2d87000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T01:25:00.562 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:25:00 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:25:00.229+0000 7f2d87000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-05T01:25:01.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:00 smithi012 ceph-mon[29942]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 KiB/s wr, 55 op/s 2024-09-05T01:25:01.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:00 smithi145 ceph-mon[34376]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 KiB/s wr, 55 op/s 2024-09-05T01:25:01.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:00 smithi151 ceph-mon[35013]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 77 KiB/s wr, 55 op/s 2024-09-05T01:25:03.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:02 smithi012 ceph-mon[29942]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-09-05T01:25:03.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:02 smithi012 ceph-mon[29942]: mgrmap e25: x(active, since 20s), standbys: y, z 2024-09-05T01:25:03.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:02 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:25:03.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:02 smithi145 ceph-mon[34376]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-09-05T01:25:03.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:02 smithi145 ceph-mon[34376]: mgrmap e25: x(active, since 20s), standbys: y, z 2024-09-05T01:25:03.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:02 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:25:03.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:02 smithi151 ceph-mon[35013]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-09-05T01:25:03.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:02 smithi151 ceph-mon[35013]: mgrmap e25: x(active, since 20s), standbys: y, z 2024-09-05T01:25:03.105 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:02 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:25:05.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:04 smithi012 ceph-mon[29942]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 100 KiB/s wr, 60 op/s 2024-09-05T01:25:05.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:04 smithi145 ceph-mon[34376]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 100 KiB/s wr, 60 op/s 2024-09-05T01:25:05.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:04 smithi151 ceph-mon[35013]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 100 KiB/s wr, 60 op/s 2024-09-05T01:25:07.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:06 smithi012 ceph-mon[29942]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 100 KiB/s wr, 55 op/s 2024-09-05T01:25:07.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:06 smithi145 ceph-mon[34376]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 100 KiB/s wr, 55 op/s 2024-09-05T01:25:07.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:06 smithi151 ceph-mon[35013]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 100 KiB/s wr, 55 op/s 2024-09-05T01:25:09.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:08 smithi012 ceph-mon[29942]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 100 KiB/s wr, 55 op/s 2024-09-05T01:25:09.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:08 smithi145 ceph-mon[34376]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 100 KiB/s wr, 55 op/s 2024-09-05T01:25:09.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:08 smithi151 ceph-mon[35013]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 100 KiB/s wr, 55 op/s 2024-09-05T01:25:11.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:10 smithi012 ceph-mon[29942]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 100 KiB/s wr, 60 op/s 2024-09-05T01:25:11.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:10 smithi145 ceph-mon[34376]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 100 KiB/s wr, 60 op/s 2024-09-05T01:25:11.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:10 smithi151 ceph-mon[35013]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 100 KiB/s wr, 60 op/s 2024-09-05T01:25:12.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:12 smithi012 ceph-mon[29942]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-05T01:25:13.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:12 smithi145 ceph-mon[34376]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-05T01:25:13.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:12 smithi151 ceph-mon[35013]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-05T01:25:15.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:14 smithi012 ceph-mon[29942]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-05T01:25:15.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:14 smithi145 ceph-mon[34376]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-05T01:25:15.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:14 smithi151 ceph-mon[35013]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-09-05T01:25:17.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:16 smithi012 ceph-mon[29942]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-05T01:25:17.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:16 smithi145 ceph-mon[34376]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-05T01:25:17.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:16 smithi151 ceph-mon[35013]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-05T01:25:19.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:18 smithi012 ceph-mon[29942]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-05T01:25:19.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:18 smithi145 ceph-mon[34376]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-05T01:25:19.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:18 smithi151 ceph-mon[35013]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-05T01:25:21.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:20 smithi012 ceph-mon[29942]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-05T01:25:21.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:20 smithi145 ceph-mon[34376]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-05T01:25:21.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:20 smithi151 ceph-mon[35013]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 85 B/s wr, 12 op/s 2024-09-05T01:25:23.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:22 smithi012 ceph-mon[29942]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T01:25:23.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:22 smithi145 ceph-mon[34376]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T01:25:23.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:22 smithi151 ceph-mon[35013]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T01:25:24.810 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T01:25:25.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:24 smithi012 ceph-mon[29942]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-05T01:25:25.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:24 smithi145 ceph-mon[34376]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-05T01:25:25.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:24 smithi151 ceph-mon[35013]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 12 op/s 2024-09-05T01:25:25.208 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:25:25.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.967+0000 7f1d5f200640 1 -- 172.21.15.12:0/2541448739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d6010c620 msgr2=0x7f1d6010ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:25.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.967+0000 7f1d5f200640 1 --2- 172.21.15.12:0/2541448739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d6010c620 0x7f1d6010ca00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1d50009900 tx=0x7f1d5002a3f0 comp rx=0 tx=0).stop 2024-09-05T01:25:25.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.967+0000 7f1d5f200640 1 -- 172.21.15.12:0/2541448739 shutdown_connections 2024-09-05T01:25:25.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.967+0000 7f1d5f200640 1 --2- 172.21.15.12:0/2541448739 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d60111750 0x7f1d601192d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:25.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.967+0000 7f1d5f200640 1 --2- 172.21.15.12:0/2541448739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d6010cfd0 0x7f1d60111020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:25.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.967+0000 7f1d5f200640 1 --2- 172.21.15.12:0/2541448739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d6010c620 0x7f1d6010ca00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:25.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.967+0000 7f1d5f200640 1 -- 172.21.15.12:0/2541448739 >> 172.21.15.12:0/2541448739 conn(0x7f1d6006cbe0 msgr2=0x7f1d6006cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:25.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.967+0000 7f1d5f200640 1 -- 172.21.15.12:0/2541448739 shutdown_connections 2024-09-05T01:25:25.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.967+0000 7f1d5f200640 1 -- 172.21.15.12:0/2541448739 wait complete. 2024-09-05T01:25:25.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.968+0000 7f1d5f200640 1 Processor -- start 2024-09-05T01:25:25.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.968+0000 7f1d5f200640 1 -- start start 2024-09-05T01:25:25.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.969+0000 7f1d5f200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d6010c620 0x7f1d601a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.969+0000 7f1d5f200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d6010cfd0 0x7f1d601a8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.969+0000 7f1d5f200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d60111750 0x7f1d601a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.969+0000 7f1d5f200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6011c7a0 con 0x7f1d6010c620 2024-09-05T01:25:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.969+0000 7f1d5f200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6011c620 con 0x7f1d60111750 2024-09-05T01:25:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.969+0000 7f1d5f200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6011c920 con 0x7f1d6010cfd0 2024-09-05T01:25:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.969+0000 7f1d5d400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d6010cfd0 0x7f1d601a8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.969+0000 7f1d5e800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d60111750 0x7f1d601a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.969+0000 7f1d5d400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d6010cfd0 0x7f1d601a8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:40326/0 (socket says 172.21.15.12:40326) 2024-09-05T01:25:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.969+0000 7f1d5d400640 1 -- 172.21.15.12:0/3232108201 learned_addr learned my addr 172.21.15.12:0/3232108201 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:25.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.970+0000 7f1d5de00640 1 --2- 172.21.15.12:0/3232108201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d6010c620 0x7f1d601a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:25.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.970+0000 7f1d5d400640 1 -- 172.21.15.12:0/3232108201 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d60111750 msgr2=0x7f1d601a2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:25.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.970+0000 7f1d5d400640 1 --2- 172.21.15.12:0/3232108201 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d60111750 0x7f1d601a2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:25.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.970+0000 7f1d5d400640 1 -- 172.21.15.12:0/3232108201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d6010c620 msgr2=0x7f1d601a88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:25.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.970+0000 7f1d5d400640 1 --2- 172.21.15.12:0/3232108201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d6010c620 0x7f1d601a88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:25.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.970+0000 7f1d5d400640 1 -- 172.21.15.12:0/3232108201 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d601a31a0 con 0x7f1d6010cfd0 2024-09-05T01:25:25.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.970+0000 7f1d5e800640 1 --2- 172.21.15.12:0/3232108201 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d60111750 0x7f1d601a2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:25:25.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.970+0000 7f1d5d400640 1 --2- 172.21.15.12:0/3232108201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d6010cfd0 0x7f1d601a8df0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c00d950 tx=0x7f1d4c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:25.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.971+0000 7f1d56a00640 1 -- 172.21.15.12:0/3232108201 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c017070 con 0x7f1d6010cfd0 2024-09-05T01:25:25.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.971+0000 7f1d56a00640 1 -- 172.21.15.12:0/3232108201 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d4c009c30 con 0x7f1d6010cfd0 2024-09-05T01:25:25.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.971+0000 7f1d56a00640 1 -- 172.21.15.12:0/3232108201 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c00f6b0 con 0x7f1d6010cfd0 2024-09-05T01:25:25.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.971+0000 7f1d5f200640 1 -- 172.21.15.12:0/3232108201 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d601a3490 con 0x7f1d6010cfd0 2024-09-05T01:25:25.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.971+0000 7f1d5f200640 1 -- 172.21.15.12:0/3232108201 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d601af780 con 0x7f1d6010cfd0 2024-09-05T01:25:25.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.975+0000 7f1d56a00640 1 -- 172.21.15.12:0/3232108201 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) ==== 138066+0+0 (secure 0 0 0) 0x7f1d4c00f850 con 0x7f1d6010cfd0 2024-09-05T01:25:25.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.975+0000 7f1d6761a740 1 Processor -- start 2024-09-05T01:25:25.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.975+0000 7f1d6761a740 1 -- start start 2024-09-05T01:25:25.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.976+0000 7f1d6761a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 0x559059480940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:25.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.976+0000 7f1d6761a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559059480e80 0x55905948b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:25.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.976+0000 7f1d6761a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55905948b740 0x55905948db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:25.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.976+0000 7f1d6761a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5590593de3e0 con 0x559059480560 2024-09-05T01:25:25.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.976+0000 7f1d6761a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x559059385d80 con 0x55905948b740 2024-09-05T01:25:25.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.976+0000 7f1d6761a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5590593da3a0 con 0x559059480e80 2024-09-05T01:25:25.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.976+0000 7f1d5e800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 0x559059480940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:25.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.976+0000 7f1d56a00640 1 --2- 172.21.15.12:0/3232108201 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1d440a2e10 0x7f1d440a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:25.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.976+0000 7f1d5de00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559059480e80 0x55905948b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:25.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.977+0000 7f1d56a00640 1 -- 172.21.15.12:0/3232108201 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f1d4c0cf190 con 0x7f1d6010cfd0 2024-09-05T01:25:25.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.977+0000 7f1d5e800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 0x559059480940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54944/0 (socket says 172.21.15.12:54944) 2024-09-05T01:25:25.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.977+0000 7f1d5e800640 1 -- 172.21.15.12:0/3509804671 learned_addr learned my addr 172.21.15.12:0/3509804671 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:25.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.977+0000 7f1d5d400640 1 --2- 172.21.15.12:0/3509804671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55905948b740 0x55905948db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:25.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.977+0000 7f1d5e800640 1 --2- 172.21.15.12:0/3232108201 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1d440a2e10 0x7f1d440a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:25.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.977+0000 7f1d5e800640 1 -- 172.21.15.12:0/3509804671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559059480e80 msgr2=0x55905948b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:25.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.977+0000 7f1d5e800640 1 --2- 172.21.15.12:0/3509804671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559059480e80 0x55905948b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:25.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.977+0000 7f1d5e800640 1 -- 172.21.15.12:0/3509804671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55905948b740 msgr2=0x55905948db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:25.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.977+0000 7f1d5e800640 1 --2- 172.21.15.12:0/3509804671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55905948b740 0x55905948db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:25.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.977+0000 7f1d5e800640 1 -- 172.21.15.12:0/3509804671 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590593a4ae0 con 0x559059480560 2024-09-05T01:25:25.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.978+0000 7f1d5e800640 1 --2- 172.21.15.12:0/3509804671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 0x559059480940 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1d58013d80 tx=0x7f1d58011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8bd89490419b7a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:25.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.978+0000 7f1d4b000640 1 -- 172.21.15.12:0/3509804671 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d58023070 con 0x559059480560 2024-09-05T01:25:25.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.978+0000 7f1d4b000640 1 -- 172.21.15.12:0/3509804671 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d58009e20 con 0x559059480560 2024-09-05T01:25:25.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.979+0000 7f1d4b000640 1 -- 172.21.15.12:0/3509804671 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d58028b90 con 0x559059480560 2024-09-05T01:25:25.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.979+0000 7f1d6761a740 1 -- 172.21.15.12:0/3509804671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 msgr2=0x559059480940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.979+0000 7f1d6761a740 1 --2- 172.21.15.12:0/3509804671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 0x559059480940 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1d58013d80 tx=0x7f1d58011750 comp rx=0 tx=0).stop 2024-09-05T01:25:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.979+0000 7f1d5e800640 1 --2- 172.21.15.12:0/3232108201 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1d440a2e10 0x7f1d440a52d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1d58011c50 tx=0x7f1d5801e000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.979+0000 7f1d6761a740 1 -- 172.21.15.12:0/3509804671 shutdown_connections 2024-09-05T01:25:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.979+0000 7f1d6761a740 1 --2- 172.21.15.12:0/3509804671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55905948b740 0x55905948db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.979+0000 7f1d6761a740 1 --2- 172.21.15.12:0/3509804671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559059480e80 0x55905948b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.979+0000 7f1d6761a740 1 --2- 172.21.15.12:0/3509804671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 0x559059480940 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.979+0000 7f1d6761a740 1 -- 172.21.15.12:0/3509804671 >> 172.21.15.12:0/3509804671 conn(0x55905947caf0 msgr2=0x55905947ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.980+0000 7f1d6761a740 1 -- 172.21.15.12:0/3509804671 shutdown_connections 2024-09-05T01:25:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.980+0000 7f1d6761a740 1 -- 172.21.15.12:0/3509804671 wait complete. 2024-09-05T01:25:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.980+0000 7f1d6761a740 1 -- start start 2024-09-05T01:25:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.981+0000 7f1d6761a740 1 Processor -- start 2024-09-05T01:25:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.981+0000 7f1d6761a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 0x559059488600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.981+0000 7f1d6761a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559059480e80 0x559059488b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.981+0000 7f1d6761a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55905948b740 0x559059489080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.981+0000 7f1d6761a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55905948e400 con 0x559059480560 2024-09-05T01:25:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.981+0000 7f1d6761a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5590593990f0 con 0x559059480e80 2024-09-05T01:25:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.981+0000 7f1d6761a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55905948e580 con 0x55905948b740 2024-09-05T01:25:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.981+0000 7f1d6761a740 10 client.0 _ll_register_callbacks cb 0x55905938a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.981+0000 7f1d5de00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 0x559059488600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.981+0000 7f1d5d400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559059480e80 0x559059488b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.982+0000 7f1d5de00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 0x559059488600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54954/0 (socket says 172.21.15.12:54954) 2024-09-05T01:25:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.982+0000 7f1d5de00640 1 -- 172.21.15.12:0/2111728786 learned_addr learned my addr 172.21.15.12:0/2111728786 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.982+0000 7f1d5d400640 1 -- 172.21.15.12:0/2111728786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55905948b740 msgr2=0x559059489080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:25:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.982+0000 7f1d5d400640 1 --2- 172.21.15.12:0/2111728786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55905948b740 0x559059489080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.982+0000 7f1d5d400640 1 -- 172.21.15.12:0/2111728786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 msgr2=0x559059488600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.982+0000 7f1d5d400640 1 --2- 172.21.15.12:0/2111728786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 0x559059488600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.982+0000 7f1d5d400640 1 -- 172.21.15.12:0/2111728786 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55905914f3c0 con 0x559059480e80 2024-09-05T01:25:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.982+0000 7f1d5d400640 1 --2- 172.21.15.12:0/2111728786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559059480e80 0x559059488b40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0cc750 tx=0x7f1d4c09b0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e811533ef29f0d64 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.982+0000 7f1d3f400640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:25:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.983+0000 7f1d3f400640 1 -- 172.21.15.12:0/2111728786 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c020070 con 0x559059480e80 2024-09-05T01:25:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.983+0000 7f1d3f400640 1 -- 172.21.15.12:0/2111728786 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f1d4c0ccc30 con 0x559059480e80 2024-09-05T01:25:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.983+0000 7f1d6761a740 1 -- 172.21.15.12:0/2111728786 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d58009e20 con 0x559059480e80 2024-09-05T01:25:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.983+0000 7f1d3f400640 1 -- 172.21.15.12:0/2111728786 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1d4c09b450 con 0x559059480e80 2024-09-05T01:25:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.983+0000 7f1d6761a740 10 client.25358 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.983+0000 7f1d6761a740 1 -- 172.21.15.12:0/2111728786 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55905949a130 con 0x559059480e80 2024-09-05T01:25:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.983+0000 7f1d3f400640 1 -- 172.21.15.12:0/2111728786 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d58009e20 con 0x559059480e80 2024-09-05T01:25:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.983+0000 7f1d3f400640 1 -- 172.21.15.12:0/2111728786 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1d4c09a8a0 con 0x559059480e80 2024-09-05T01:25:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.984+0000 7f1d6761a740 10 client.25358 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.984+0000 7f1d6761a740 10 client.25358 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:25:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.984+0000 7f1d6761a740 20 client.25358 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.984+0000 7f1d6761a740 1 --2- 172.21.15.12:0/2111728786 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55905949b4d0 0x55905949d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.984+0000 7f1d6761a740 4 client.25358 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:25:25.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.984+0000 7f1d6761a740 1 -- 172.21.15.12:0/2111728786 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590593eb950 con 0x55905949b4d0 2024-09-05T01:25:25.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.984+0000 7f1d5de00640 1 --2- 172.21.15.12:0/2111728786 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55905949b4d0 0x55905949d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.985+0000 7f1d5de00640 1 --2- 172.21.15.12:0/2111728786 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55905949b4d0 0x55905949d8f0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae3025357cf7e1d4 server_cookie=872a6a99c6d1b30f in_seq=0 out_seq=0 2024-09-05T01:25:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.985+0000 7f1d3f400640 10 client.25358 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:25:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.986+0000 7f1d3f400640 1 -- 172.21.15.12:0/2111728786 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5590593eb950 con 0x55905949b4d0 2024-09-05T01:25:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.986+0000 7f1d3f400640 10 client.25358 handle_command_reply: tid=0 2024-09-05T01:25:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.986+0000 7f1d6761a740 1 client.25358 shutdown 2024-09-05T01:25:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.986+0000 7f1d6761a740 1 -- 172.21.15.12:0/2111728786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559059480e80 msgr2=0x559059488b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.986+0000 7f1d6761a740 1 --2- 172.21.15.12:0/2111728786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559059480e80 0x559059488b40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0cc750 tx=0x7f1d4c09b0c0 comp rx=0 tx=0).stop 2024-09-05T01:25:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.986+0000 7f1d6761a740 1 -- 172.21.15.12:0/2111728786 shutdown_connections 2024-09-05T01:25:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.986+0000 7f1d6761a740 1 --2- 172.21.15.12:0/2111728786 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55905949b4d0 0x55905949d8f0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.986+0000 7f1d6761a740 1 --2- 172.21.15.12:0/2111728786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55905948b740 0x559059489080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.986+0000 7f1d6761a740 1 --2- 172.21.15.12:0/2111728786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559059480e80 0x559059488b40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.986+0000 7f1d6761a740 1 --2- 172.21.15.12:0/2111728786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 0x559059488600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:25.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.986+0000 7f1d3f400640 0 client.25358 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:25:25.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.986+0000 7f1d6761a740 1 -- 172.21.15.12:0/2111728786 >> 172.21.15.12:0/2111728786 conn(0x55905947caf0 msgr2=0x5590594827d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:25.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.987+0000 7f1d6761a740 1 -- 172.21.15.12:0/2111728786 shutdown_connections 2024-09-05T01:25:25.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.987+0000 7f1d6761a740 1 -- 172.21.15.12:0/2111728786 wait complete. 2024-09-05T01:25:25.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:25.987+0000 7f1d6761a740 20 client.25358 trim_cache size 0 max 16384 2024-09-05T01:25:26.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.005+0000 7f1d6761a740 1 Processor -- start 2024-09-05T01:25:26.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.005+0000 7f1d6761a740 1 -- start start 2024-09-05T01:25:26.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.005+0000 7f1d6761a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 0x55905948a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:26.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.005+0000 7f1d6761a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559059480e80 0x5590594a31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:26.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.005+0000 7f1d6761a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55905948b740 0x5590594a3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:26.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.005+0000 7f1d6761a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4000e730 con 0x559059480560 2024-09-05T01:25:26.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.005+0000 7f1d6761a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1d40010270 con 0x559059480e80 2024-09-05T01:25:26.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.005+0000 7f1d6761a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4000ee00 con 0x55905948b740 2024-09-05T01:25:26.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.006+0000 7f1d5de00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 0x55905948a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.006+0000 7f1d5d400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559059480e80 0x5590594a31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.006+0000 7f1d5de00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 0x55905948a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54968/0 (socket says 172.21.15.12:54968) 2024-09-05T01:25:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.006+0000 7f1d5de00640 1 -- 172.21.15.12:0/858943082 learned_addr learned my addr 172.21.15.12:0/858943082 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.006+0000 7f1d5e800640 1 --2- 172.21.15.12:0/858943082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55905948b740 0x5590594a3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.006+0000 7f1d5de00640 1 -- 172.21.15.12:0/858943082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55905948b740 msgr2=0x5590594a3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.006+0000 7f1d5de00640 1 --2- 172.21.15.12:0/858943082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55905948b740 0x5590594a3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.006+0000 7f1d5de00640 1 -- 172.21.15.12:0/858943082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559059480e80 msgr2=0x5590594a31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.006+0000 7f1d5de00640 1 --2- 172.21.15.12:0/858943082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559059480e80 0x5590594a31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.006+0000 7f1d5de00640 1 -- 172.21.15.12:0/858943082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55905947c920 con 0x559059480560 2024-09-05T01:25:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.007+0000 7f1d5de00640 1 --2- 172.21.15.12:0/858943082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 0x55905948a570 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1d50009230 tx=0x7f1d50005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4cce8077df99ee7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.007+0000 7f1d4a600640 1 -- 172.21.15.12:0/858943082 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d50035040 con 0x559059480560 2024-09-05T01:25:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.007+0000 7f1d4a600640 1 -- 172.21.15.12:0/858943082 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d5004a070 con 0x559059480560 2024-09-05T01:25:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.007+0000 7f1d4a600640 1 -- 172.21.15.12:0/858943082 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d50031810 con 0x559059480560 2024-09-05T01:25:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.008+0000 7f1d6761a740 1 -- 172.21.15.12:0/858943082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 msgr2=0x55905948a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.008+0000 7f1d6761a740 1 --2- 172.21.15.12:0/858943082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 0x55905948a570 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1d50009230 tx=0x7f1d50005b50 comp rx=0 tx=0).stop 2024-09-05T01:25:26.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.008+0000 7f1d6761a740 1 -- 172.21.15.12:0/858943082 shutdown_connections 2024-09-05T01:25:26.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.008+0000 7f1d6761a740 1 --2- 172.21.15.12:0/858943082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55905948b740 0x5590594a3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:26.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.008+0000 7f1d6761a740 1 --2- 172.21.15.12:0/858943082 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559059480e80 0x5590594a31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:26.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.008+0000 7f1d6761a740 1 --2- 172.21.15.12:0/858943082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 0x55905948a570 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:26.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.008+0000 7f1d6761a740 1 -- 172.21.15.12:0/858943082 >> 172.21.15.12:0/858943082 conn(0x55905947caf0 msgr2=0x559059489e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:26.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.009+0000 7f1d6761a740 1 -- 172.21.15.12:0/858943082 shutdown_connections 2024-09-05T01:25:26.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.009+0000 7f1d6761a740 1 -- 172.21.15.12:0/858943082 wait complete. 2024-09-05T01:25:26.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.009+0000 7f1d6761a740 1 -- start start 2024-09-05T01:25:26.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.010+0000 7f1d6761a740 1 Processor -- start 2024-09-05T01:25:26.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.010+0000 7f1d6761a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 0x55905948f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:26.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.010+0000 7f1d6761a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559059480e80 0x55905948faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:26.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.010+0000 7f1d6761a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55905948b740 0x55905948ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:26.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.010+0000 7f1d6761a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4000fba0 con 0x559059480560 2024-09-05T01:25:26.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.010+0000 7f1d6761a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4000f4d0 con 0x55905948b740 2024-09-05T01:25:26.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.011+0000 7f1d6761a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4000c710 con 0x559059480e80 2024-09-05T01:25:26.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.011+0000 7f1d6761a740 10 client.0 _ll_register_callbacks cb 0x7f1d4c09adb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:26.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.011+0000 7f1d5e800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55905948b740 0x55905948ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:26.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.011+0000 7f1d5e800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55905948b740 0x55905948ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:51826/0 (socket says 172.21.15.12:51826) 2024-09-05T01:25:26.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.011+0000 7f1d5e800640 1 -- 172.21.15.12:0/3100490151 learned_addr learned my addr 172.21.15.12:0/3100490151 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:26.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.011+0000 7f1d5de00640 1 --2- 172.21.15.12:0/3100490151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 0x55905948f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:26.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.011+0000 7f1d5d400640 1 --2- 172.21.15.12:0/3100490151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559059480e80 0x55905948faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:26.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.012+0000 7f1d5d400640 1 -- 172.21.15.12:0/3100490151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55905948b740 msgr2=0x55905948ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:26.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.012+0000 7f1d5d400640 1 --2- 172.21.15.12:0/3100490151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55905948b740 0x55905948ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:26.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.012+0000 7f1d5d400640 1 -- 172.21.15.12:0/3100490151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 msgr2=0x55905948f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:26.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.012+0000 7f1d5d400640 1 --2- 172.21.15.12:0/3100490151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 0x55905948f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:26.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.012+0000 7f1d5d400640 1 -- 172.21.15.12:0/3100490151 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590594833d0 con 0x559059480e80 2024-09-05T01:25:26.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.012+0000 7f1d5de00640 1 --2- 172.21.15.12:0/3100490151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 0x55905948f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:25:26.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.012+0000 7f1d5e800640 1 --2- 172.21.15.12:0/3100490151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55905948b740 0x55905948ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:25:26.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.013+0000 7f1d5d400640 1 --2- 172.21.15.12:0/3100490151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559059480e80 0x55905948faa0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c010ef0 tx=0x7f1d4c000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b11cb629e386e901 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:26.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.013+0000 7f1d3f400640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:25:26.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.013+0000 7f1d3f400640 1 -- 172.21.15.12:0/3100490151 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c0b9060 con 0x559059480e80 2024-09-05T01:25:26.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.013+0000 7f1d3f400640 1 -- 172.21.15.12:0/3100490151 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f1d4c0971a0 con 0x559059480e80 2024-09-05T01:25:26.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.013+0000 7f1d6761a740 1 -- 172.21.15.12:0/3100490151 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d5004a070 con 0x559059480e80 2024-09-05T01:25:26.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.013+0000 7f1d3f400640 1 -- 172.21.15.12:0/3100490151 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1d4c014070 con 0x559059480e80 2024-09-05T01:25:26.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.013+0000 7f1d6761a740 10 client.25360 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:26.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.013+0000 7f1d6761a740 1 -- 172.21.15.12:0/3100490151 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559059474dd0 con 0x559059480e80 2024-09-05T01:25:26.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.014+0000 7f1d3f400640 1 -- 172.21.15.12:0/3100490151 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d5004a070 con 0x559059480e80 2024-09-05T01:25:26.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.014+0000 7f1d3f400640 1 -- 172.21.15.12:0/3100490151 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1d4c0973a0 con 0x559059480e80 2024-09-05T01:25:26.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.014+0000 7f1d6761a740 10 client.25360 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:26.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.014+0000 7f1d6761a740 10 client.25360 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:25:26.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.014+0000 7f1d6761a740 20 client.25360 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:26.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.014+0000 7f1d6761a740 1 --2- 172.21.15.12:0/3100490151 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x559059475370 0x559059477790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:26.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.014+0000 7f1d6761a740 4 client.25360 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T01:25:26.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.014+0000 7f1d6761a740 1 -- 172.21.15.12:0/3100490151 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5590593e5e60 con 0x559059475370 2024-09-05T01:25:26.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.014+0000 7f1d5de00640 1 --2- 172.21.15.12:0/3100490151 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x559059475370 0x559059477790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:26.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.015+0000 7f1d5de00640 1 --2- 172.21.15.12:0/3100490151 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x559059475370 0x559059477790 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a5715450d0fc7cc server_cookie=8ef2a0317a1e00fb in_seq=0 out_seq=0 2024-09-05T01:25:26.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.015+0000 7f1d3f400640 10 client.25360 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:25:26.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.015+0000 7f1d3f400640 1 -- 172.21.15.12:0/3100490151 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5590593e5e60 con 0x559059475370 2024-09-05T01:25:26.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.015+0000 7f1d3f400640 10 client.25360 handle_command_reply: tid=0 2024-09-05T01:25:26.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.015+0000 7f1d6761a740 1 client.25360 shutdown 2024-09-05T01:25:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.016+0000 7f1d6761a740 1 -- 172.21.15.12:0/3100490151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559059480e80 msgr2=0x55905948faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.016+0000 7f1d6761a740 1 --2- 172.21.15.12:0/3100490151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559059480e80 0x55905948faa0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c010ef0 tx=0x7f1d4c000bc0 comp rx=0 tx=0).stop 2024-09-05T01:25:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.016+0000 7f1d6761a740 1 -- 172.21.15.12:0/3100490151 shutdown_connections 2024-09-05T01:25:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.016+0000 7f1d6761a740 1 --2- 172.21.15.12:0/3100490151 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x559059475370 0x559059477790 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.016+0000 7f1d6761a740 1 --2- 172.21.15.12:0/3100490151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55905948b740 0x55905948ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.016+0000 7f1d6761a740 1 --2- 172.21.15.12:0/3100490151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559059480e80 0x55905948faa0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.016+0000 7f1d6761a740 1 --2- 172.21.15.12:0/3100490151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559059480560 0x55905948f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.016+0000 7f1d6761a740 1 -- 172.21.15.12:0/3100490151 >> 172.21.15.12:0/3100490151 conn(0x55905947caf0 msgr2=0x559059486aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.016+0000 7f1d3f400640 0 client.25360 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:25:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.016+0000 7f1d6761a740 1 -- 172.21.15.12:0/3100490151 shutdown_connections 2024-09-05T01:25:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.016+0000 7f1d6761a740 1 -- 172.21.15.12:0/3100490151 wait complete. 2024-09-05T01:25:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.016+0000 7f1d6761a740 20 client.25360 trim_cache size 0 max 16384 2024-09-05T01:25:26.020 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:25:26.020 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-05T01:25:26.020 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-05T01:25:26.020 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:25:26.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.017+0000 7f1d5f200640 1 -- 172.21.15.12:0/3232108201 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1d440a2e10 msgr2=0x7f1d440a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:26.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.017+0000 7f1d5f200640 1 --2- 172.21.15.12:0/3232108201 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1d440a2e10 0x7f1d440a52d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1d58011c50 tx=0x7f1d5801e000 comp rx=0 tx=0).stop 2024-09-05T01:25:26.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.017+0000 7f1d5f200640 1 -- 172.21.15.12:0/3232108201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d6010cfd0 msgr2=0x7f1d601a8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:26.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.017+0000 7f1d5f200640 1 --2- 172.21.15.12:0/3232108201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d6010cfd0 0x7f1d601a8df0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c00d950 tx=0x7f1d4c00de10 comp rx=0 tx=0).stop 2024-09-05T01:25:26.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.018+0000 7f1d5f200640 1 -- 172.21.15.12:0/3232108201 shutdown_connections 2024-09-05T01:25:26.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.018+0000 7f1d5f200640 1 --2- 172.21.15.12:0/3232108201 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1d440a2e10 0x7f1d440a52d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:26.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.018+0000 7f1d5f200640 1 --2- 172.21.15.12:0/3232108201 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1d60111750 0x7f1d601a2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:26.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.018+0000 7f1d5f200640 1 --2- 172.21.15.12:0/3232108201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d6010cfd0 0x7f1d601a8df0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:26.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.018+0000 7f1d5f200640 1 --2- 172.21.15.12:0/3232108201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d6010c620 0x7f1d601a88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:26.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.018+0000 7f1d5f200640 1 -- 172.21.15.12:0/3232108201 >> 172.21.15.12:0/3232108201 conn(0x7f1d6006cbe0 msgr2=0x7f1d6010a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:26.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.018+0000 7f1d5f200640 1 -- 172.21.15.12:0/3232108201 shutdown_connections 2024-09-05T01:25:26.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:26.018+0000 7f1d5f200640 1 -- 172.21.15.12:0/3232108201 wait complete. 2024-09-05T01:25:26.934 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-05T01:25:26.934 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:25:26.990 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:26 smithi012 ceph-mon[29942]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T01:25:27.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:26 smithi145 ceph-mon[34376]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T01:25:27.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:26 smithi151 ceph-mon[35013]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T01:25:27.422 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:25:28.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.111+0000 7f5011a00640 1 -- 172.21.15.12:0/987580827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f500c104000 msgr2=0x7f500c1043e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:28.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.111+0000 7f5011a00640 1 --2- 172.21.15.12:0/987580827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f500c104000 0x7f500c1043e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc009900 tx=0x7f4ffc02a3f0 comp rx=0 tx=0).stop 2024-09-05T01:25:28.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.111+0000 7f5011a00640 1 -- 172.21.15.12:0/987580827 shutdown_connections 2024-09-05T01:25:28.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.111+0000 7f5011a00640 1 --2- 172.21.15.12:0/987580827 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f500c109130 0x7f500c110cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:28.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.111+0000 7f5011a00640 1 --2- 172.21.15.12:0/987580827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f500c1049b0 0x7f500c108a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:28.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.111+0000 7f5011a00640 1 --2- 172.21.15.12:0/987580827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f500c104000 0x7f500c1043e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:28.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.111+0000 7f5011a00640 1 -- 172.21.15.12:0/987580827 >> 172.21.15.12:0/987580827 conn(0x7f500c0ffa20 msgr2=0x7f500c101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:28.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.111+0000 7f5011a00640 1 -- 172.21.15.12:0/987580827 shutdown_connections 2024-09-05T01:25:28.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.112+0000 7f5011a00640 1 -- 172.21.15.12:0/987580827 wait complete. 2024-09-05T01:25:28.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.114+0000 7f5011a00640 1 Processor -- start 2024-09-05T01:25:28.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.114+0000 7f5011a00640 1 -- start start 2024-09-05T01:25:28.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.114+0000 7f5011a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f500c104000 0x7f500c19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:28.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.114+0000 7f5011a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f500c1049b0 0x7f500c19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:28.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.114+0000 7f5011a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f500c109130 0x7f500c19ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:28.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.114+0000 7f5011a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f500c114180 con 0x7f500c109130 2024-09-05T01:25:28.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.114+0000 7f5011a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f500c114000 con 0x7f500c1049b0 2024-09-05T01:25:28.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.114+0000 7f5011a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f500c114300 con 0x7f500c104000 2024-09-05T01:25:28.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.115+0000 7f500aa00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f500c104000 0x7f500c19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:28.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.115+0000 7f500aa00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f500c104000 0x7f500c19a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:49228/0 (socket says 172.21.15.12:49228) 2024-09-05T01:25:28.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.115+0000 7f500aa00640 1 -- 172.21.15.12:0/956361308 learned_addr learned my addr 172.21.15.12:0/956361308 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:28.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.115+0000 7f500a000640 1 --2- 172.21.15.12:0/956361308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f500c1049b0 0x7f500c19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:28.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.115+0000 7f500b400640 1 --2- 172.21.15.12:0/956361308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f500c109130 0x7f500c19ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:28.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.115+0000 7f500aa00640 1 -- 172.21.15.12:0/956361308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f500c1049b0 msgr2=0x7f500c19abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:28.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.115+0000 7f500aa00640 1 --2- 172.21.15.12:0/956361308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f500c1049b0 0x7f500c19abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:28.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.115+0000 7f500aa00640 1 -- 172.21.15.12:0/956361308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f500c109130 msgr2=0x7f500c19ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:28.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.115+0000 7f500aa00640 1 --2- 172.21.15.12:0/956361308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f500c109130 0x7f500c19ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:28.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.115+0000 7f500aa00640 1 -- 172.21.15.12:0/956361308 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500c19f650 con 0x7f500c104000 2024-09-05T01:25:28.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.116+0000 7f500aa00640 1 --2- 172.21.15.12:0/956361308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f500c104000 0x7f500c19a6a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc004770 tx=0x7f4ffc003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:28.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.116+0000 7f5003400640 1 -- 172.21.15.12:0/956361308 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc03f070 con 0x7f500c104000 2024-09-05T01:25:28.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.116+0000 7f5003400640 1 -- 172.21.15.12:0/956361308 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ffc031ca0 con 0x7f500c104000 2024-09-05T01:25:28.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.116+0000 7f5011a00640 1 -- 172.21.15.12:0/956361308 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f500c19f8e0 con 0x7f500c104000 2024-09-05T01:25:28.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.116+0000 7f5011a00640 1 -- 172.21.15.12:0/956361308 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f500c1a7220 con 0x7f500c104000 2024-09-05T01:25:28.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.116+0000 7f5003400640 1 -- 172.21.15.12:0/956361308 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc035030 con 0x7f500c104000 2024-09-05T01:25:28.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.118+0000 7f5011a00640 1 -- 172.21.15.12:0/956361308 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f500c1043e0 con 0x7f500c104000 2024-09-05T01:25:28.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.121+0000 7f5003400640 1 -- 172.21.15.12:0/956361308 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) ==== 138066+0+0 (secure 0 0 0) 0x7f4ffc042070 con 0x7f500c104000 2024-09-05T01:25:28.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.123+0000 7f5003400640 1 --2- 172.21.15.12:0/956361308 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f4ff00a2e10 0x7f4ff00a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:28.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.123+0000 7f5003400640 1 -- 172.21.15.12:0/956361308 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f4ffc0efc50 con 0x7f500c104000 2024-09-05T01:25:28.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.123+0000 7f500a000640 1 --2- 172.21.15.12:0/956361308 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f4ff00a2e10 0x7f4ff00a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:28.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.124+0000 7f500a000640 1 --2- 172.21.15.12:0/956361308 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f4ff00a2e10 0x7f4ff00a52d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f500c10a9f0 tx=0x7f4ff8005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:28.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.126+0000 7f5003400640 1 -- 172.21.15.12:0/956361308 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4ffc0bc0f0 con 0x7f500c104000 2024-09-05T01:25:28.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.406+0000 7f5011a00640 1 -- 172.21.15.12:0/956361308 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f500c10c310 con 0x7f500c104000 2024-09-05T01:25:28.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.407+0000 7f5003400640 1 -- 172.21.15.12:0/956361308 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7f4ffc0c03f0 con 0x7f500c104000 2024-09-05T01:25:28.409 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:25:28.409 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":28,"btime":"2024-09-05T01:24:42:138818+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14532,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/2949711075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":2949711075},{"type":"v1","addr":"172.21.15.12:6839","nonce":2949711075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T01:22:35.979384+0000","modified":"2024-09-05T01:24:41.174185+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24529,"mds_2":24524,"mds_3":24517,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/497406458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":497406458},{"type":"v1","addr":"172.21.15.12:6841","nonce":497406458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":10,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.145:6839/1706431882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":1706431882},{"type":"v1","addr":"172.21.15.145:6839","nonce":1706431882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24529,24524,24517,24460]},"id":1}]} 2024-09-05T01:25:28.410 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 28 2024-09-05T01:25:28.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.410+0000 7f5011a00640 1 -- 172.21.15.12:0/956361308 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f4ff00a2e10 msgr2=0x7f4ff00a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:28.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.410+0000 7f5011a00640 1 --2- 172.21.15.12:0/956361308 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f4ff00a2e10 0x7f4ff00a52d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f500c10a9f0 tx=0x7f4ff8005f90 comp rx=0 tx=0).stop 2024-09-05T01:25:28.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.410+0000 7f5011a00640 1 -- 172.21.15.12:0/956361308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f500c104000 msgr2=0x7f500c19a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:28.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.410+0000 7f5011a00640 1 --2- 172.21.15.12:0/956361308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f500c104000 0x7f500c19a6a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc004770 tx=0x7f4ffc003c10 comp rx=0 tx=0).stop 2024-09-05T01:25:28.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.411+0000 7f5011a00640 1 -- 172.21.15.12:0/956361308 shutdown_connections 2024-09-05T01:25:28.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.411+0000 7f5011a00640 1 --2- 172.21.15.12:0/956361308 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f4ff00a2e10 0x7f4ff00a52d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:28.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.411+0000 7f5011a00640 1 --2- 172.21.15.12:0/956361308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f500c109130 0x7f500c19ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:28.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.411+0000 7f5011a00640 1 --2- 172.21.15.12:0/956361308 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f500c1049b0 0x7f500c19abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:28.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.411+0000 7f5011a00640 1 --2- 172.21.15.12:0/956361308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f500c104000 0x7f500c19a6a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:28.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.411+0000 7f5011a00640 1 -- 172.21.15.12:0/956361308 >> 172.21.15.12:0/956361308 conn(0x7f500c0ffa20 msgr2=0x7f500c100d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:28.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.411+0000 7f5011a00640 1 -- 172.21.15.12:0/956361308 shutdown_connections 2024-09-05T01:25:28.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:28.411+0000 7f5011a00640 1 -- 172.21.15.12:0/956361308 wait complete. 2024-09-05T01:25:28.732 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:28 smithi012 ceph-mon[29942]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T01:25:28.732 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:28 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/956361308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:25:29.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:28 smithi145 ceph-mon[34376]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T01:25:29.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:28 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/956361308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:25:29.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:28 smithi151 ceph-mon[35013]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T01:25:29.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:28 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/956361308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:25:29.335 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-05T01:25:29.855 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:25:30.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.503+0000 7f5857e00640 1 -- 172.21.15.12:0/1696119124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5858100720 msgr2=0x7f5858100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:30.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.503+0000 7f5857e00640 1 --2- 172.21.15.12:0/1696119124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5858100720 0x7f5858100b00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5848009900 tx=0x7f584802a3f0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.504+0000 7f5857e00640 1 -- 172.21.15.12:0/1696119124 shutdown_connections 2024-09-05T01:25:30.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.504+0000 7f5857e00640 1 --2- 172.21.15.12:0/1696119124 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f585810e2d0 0x7f58581106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.504+0000 7f5857e00640 1 --2- 172.21.15.12:0/1696119124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58581010d0 0x7f585810dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.504+0000 7f5857e00640 1 --2- 172.21.15.12:0/1696119124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5858100720 0x7f5858100b00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.504+0000 7f5857e00640 1 -- 172.21.15.12:0/1696119124 >> 172.21.15.12:0/1696119124 conn(0x7f58580fc610 msgr2=0x7f58580fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:30.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.504+0000 7f5857e00640 1 -- 172.21.15.12:0/1696119124 shutdown_connections 2024-09-05T01:25:30.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.504+0000 7f5857e00640 1 -- 172.21.15.12:0/1696119124 wait complete. 2024-09-05T01:25:30.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.505+0000 7f5857e00640 1 Processor -- start 2024-09-05T01:25:30.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.505+0000 7f5857e00640 1 -- start start 2024-09-05T01:25:30.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.506+0000 7f5857e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5858100720 0x7f585819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:30.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.506+0000 7f5857e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58581010d0 0x7f585819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:30.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.506+0000 7f5857e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f585810e2d0 0x7f585819edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:30.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.506+0000 7f5857e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5858114020 con 0x7f5858100720 2024-09-05T01:25:30.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.506+0000 7f5857e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5858113ea0 con 0x7f585810e2d0 2024-09-05T01:25:30.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.506+0000 7f5857e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f58581141a0 con 0x7f58581010d0 2024-09-05T01:25:30.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.506+0000 7f5856a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5858100720 0x7f585819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:30.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.506+0000 7f5856a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5858100720 0x7f585819a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56248/0 (socket says 172.21.15.12:56248) 2024-09-05T01:25:30.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.506+0000 7f5856a00640 1 -- 172.21.15.12:0/3420303670 learned_addr learned my addr 172.21.15.12:0/3420303670 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:30.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.506+0000 7f5857400640 1 --2- 172.21.15.12:0/3420303670 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f585810e2d0 0x7f585819edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:30.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.507+0000 7f5856000640 1 --2- 172.21.15.12:0/3420303670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58581010d0 0x7f585819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:30.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.507+0000 7f5856a00640 1 -- 172.21.15.12:0/3420303670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58581010d0 msgr2=0x7f585819aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:30.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.507+0000 7f5856a00640 1 --2- 172.21.15.12:0/3420303670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58581010d0 0x7f585819aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.507+0000 7f5856a00640 1 -- 172.21.15.12:0/3420303670 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f585810e2d0 msgr2=0x7f585819edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:30.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.507+0000 7f5856a00640 1 --2- 172.21.15.12:0/3420303670 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f585810e2d0 0x7f585819edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.507+0000 7f5856a00640 1 -- 172.21.15.12:0/3420303670 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585819f490 con 0x7f5858100720 2024-09-05T01:25:30.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.507+0000 7f5856000640 1 --2- 172.21.15.12:0/3420303670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58581010d0 0x7f585819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:25:30.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.507+0000 7f5857400640 1 --2- 172.21.15.12:0/3420303670 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f585810e2d0 0x7f585819edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:25:30.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.507+0000 7f5856a00640 1 --2- 172.21.15.12:0/3420303670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5858100720 0x7f585819a4e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5848004770 tx=0x7f5848003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:30.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.508+0000 7f585ca00640 1 -- 172.21.15.12:0/3420303670 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584803f070 con 0x7f5858100720 2024-09-05T01:25:30.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.508+0000 7f585ca00640 1 -- 172.21.15.12:0/3420303670 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5848031ca0 con 0x7f5858100720 2024-09-05T01:25:30.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.508+0000 7f585ca00640 1 -- 172.21.15.12:0/3420303670 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5848035030 con 0x7f5858100720 2024-09-05T01:25:30.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.508+0000 7f5857e00640 1 -- 172.21.15.12:0/3420303670 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f585819f720 con 0x7f5858100720 2024-09-05T01:25:30.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.508+0000 7f5857e00640 1 -- 172.21.15.12:0/3420303670 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f585819fbb0 con 0x7f5858100720 2024-09-05T01:25:30.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.512+0000 7f58608d4740 1 Processor -- start 2024-09-05T01:25:30.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.513+0000 7f58608d4740 1 -- start start 2024-09-05T01:25:30.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.513+0000 7f585ca00640 1 -- 172.21.15.12:0/3420303670 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138066+0+0 (secure 0 0 0) 0x7f5848042070 con 0x7f5858100720 2024-09-05T01:25:30.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.514+0000 7f58608d4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f166c4e40 0x561f166c5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:30.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.514+0000 7f58608d4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c5760 0x561f166cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:30.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.514+0000 7f58608d4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f166d0020 0x561f166d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:30.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.514+0000 7f58608d4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561f1662b3e0 con 0x561f166c5760 2024-09-05T01:25:30.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.514+0000 7f58608d4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x561f165d2d80 con 0x561f166d0020 2024-09-05T01:25:30.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.514+0000 7f58608d4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561f166273a0 con 0x561f166c4e40 2024-09-05T01:25:30.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.514+0000 7f5857400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f166c4e40 0x561f166c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:30.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.514+0000 7f5856000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f166d0020 0x561f166d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:30.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.514+0000 7f5856a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c5760 0x561f166cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:30.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.514+0000 7f5856a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c5760 0x561f166cfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56254/0 (socket says 172.21.15.12:56254) 2024-09-05T01:25:30.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.514+0000 7f5856a00640 1 -- 172.21.15.12:0/1093909369 learned_addr learned my addr 172.21.15.12:0/1093909369 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:30.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.515+0000 7f5856a00640 1 -- 172.21.15.12:0/1093909369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f166c4e40 msgr2=0x561f166c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:30.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.515+0000 7f5856a00640 1 --2- 172.21.15.12:0/1093909369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f166c4e40 0x561f166c5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.515+0000 7f5856a00640 1 -- 172.21.15.12:0/1093909369 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f166d0020 msgr2=0x561f166d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:30.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.515+0000 7f5856a00640 1 --2- 172.21.15.12:0/1093909369 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f166d0020 0x561f166d2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.515+0000 7f5856a00640 1 -- 172.21.15.12:0/1093909369 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f165f1ae0 con 0x561f166c5760 2024-09-05T01:25:30.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.515+0000 7f585ca00640 1 --2- 172.21.15.12:0/3420303670 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f583c0a2f60 0x7f583c0a5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:30.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.515+0000 7f5856a00640 1 --2- 172.21.15.12:0/1093909369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c5760 0x561f166cfae0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f58480ecf00 tx=0x7f58480f5cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=607d862e1ff3fe84 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:30.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.516+0000 7f585ca00640 1 -- 172.21.15.12:0/3420303670 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f58480ef830 con 0x7f5858100720 2024-09-05T01:25:30.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.516+0000 7f5857400640 1 --2- 172.21.15.12:0/3420303670 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f583c0a2f60 0x7f583c0a5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:30.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.516+0000 7f5843e00640 1 -- 172.21.15.12:0/1093909369 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58480b7e60 con 0x561f166c5760 2024-09-05T01:25:30.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.516+0000 7f5843e00640 1 -- 172.21.15.12:0/1093909369 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58480bc2c0 con 0x561f166c5760 2024-09-05T01:25:30.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.516+0000 7f5843e00640 1 -- 172.21.15.12:0/1093909369 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58480bb520 con 0x561f166c5760 2024-09-05T01:25:30.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.517+0000 7f58608d4740 1 -- 172.21.15.12:0/1093909369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c5760 msgr2=0x561f166cfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:30.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.517+0000 7f5857400640 1 --2- 172.21.15.12:0/3420303670 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f583c0a2f60 0x7f583c0a5420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f58500099a0 tx=0x7f5850009500 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:30.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.517+0000 7f58608d4740 1 --2- 172.21.15.12:0/1093909369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c5760 0x561f166cfae0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f58480ecf00 tx=0x7f58480f5cd0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.518+0000 7f58608d4740 1 -- 172.21.15.12:0/1093909369 shutdown_connections 2024-09-05T01:25:30.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.518+0000 7f58608d4740 1 --2- 172.21.15.12:0/1093909369 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f166d0020 0x561f166d2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.518+0000 7f58608d4740 1 --2- 172.21.15.12:0/1093909369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c5760 0x561f166cfae0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.518+0000 7f58608d4740 1 --2- 172.21.15.12:0/1093909369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f166c4e40 0x561f166c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.518+0000 7f58608d4740 1 -- 172.21.15.12:0/1093909369 >> 172.21.15.12:0/1093909369 conn(0x561f166c13d0 msgr2=0x561f166c17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:30.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.518+0000 7f58608d4740 1 -- 172.21.15.12:0/1093909369 shutdown_connections 2024-09-05T01:25:30.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.518+0000 7f58608d4740 1 -- 172.21.15.12:0/1093909369 wait complete. 2024-09-05T01:25:30.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.518+0000 7f58608d4740 1 -- start start 2024-09-05T01:25:30.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.519+0000 7f58608d4740 1 Processor -- start 2024-09-05T01:25:30.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.519+0000 7f58608d4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f166c4e40 0x561f166ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:30.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.519+0000 7f58608d4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c5760 0x561f166cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:30.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.519+0000 7f58608d4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f166d0020 0x561f166cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:30.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.519+0000 7f58608d4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561f166d29b0 con 0x561f166c5760 2024-09-05T01:25:30.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.519+0000 7f58608d4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x561f165e60f0 con 0x561f166d0020 2024-09-05T01:25:30.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.519+0000 7f58608d4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561f166d2b30 con 0x561f166c4e40 2024-09-05T01:25:30.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.519+0000 7f58608d4740 10 client.0 _ll_register_callbacks cb 0x561f165cdbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:30.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.520+0000 7f5856a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f166c4e40 0x561f166ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:30.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.520+0000 7f5857400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f166d0020 0x561f166cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.520+0000 7f5857400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f166d0020 0x561f166cda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:34906/0 (socket says 172.21.15.12:34906) 2024-09-05T01:25:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.520+0000 7f5856a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f166c4e40 0x561f166ccf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:49260/0 (socket says 172.21.15.12:49260) 2024-09-05T01:25:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.520+0000 7f5857400640 1 -- 172.21.15.12:0/3563442617 learned_addr learned my addr 172.21.15.12:0/3563442617 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.520+0000 7f5856000640 1 --2- 172.21.15.12:0/3563442617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c5760 0x561f166cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.520+0000 7f5856a00640 1 -- 172.21.15.12:0/3563442617 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f166d0020 msgr2=0x561f166cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.520+0000 7f5856a00640 1 --2- 172.21.15.12:0/3563442617 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f166d0020 0x561f166cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.520+0000 7f5856a00640 1 -- 172.21.15.12:0/3563442617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c5760 msgr2=0x561f166cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.521+0000 7f5856a00640 1 --2- 172.21.15.12:0/3563442617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c5760 0x561f166cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.521+0000 7f5856a00640 1 -- 172.21.15.12:0/3563442617 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f1639c3c0 con 0x561f166c4e40 2024-09-05T01:25:30.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.521+0000 7f5856000640 1 --2- 172.21.15.12:0/3563442617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c5760 0x561f166cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:25:30.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.521+0000 7f5856a00640 1 --2- 172.21.15.12:0/3563442617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f166c4e40 0x561f166ccf80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f58480bc470 tx=0x7f584803b690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c2656df018b010d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:30.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.521+0000 7f5840c00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:25:30.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.521+0000 7f5840c00640 1 -- 172.21.15.12:0/3563442617 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5848049070 con 0x561f166c4e40 2024-09-05T01:25:30.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.521+0000 7f5840c00640 1 -- 172.21.15.12:0/3563442617 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f58480b8230 con 0x561f166c4e40 2024-09-05T01:25:30.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.521+0000 7f58608d4740 1 -- 172.21.15.12:0/3563442617 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58480bc2c0 con 0x561f166c4e40 2024-09-05T01:25:30.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.522+0000 7f5840c00640 1 -- 172.21.15.12:0/3563442617 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f58480bb700 con 0x561f166c4e40 2024-09-05T01:25:30.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.522+0000 7f58608d4740 10 client.25375 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:30.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.522+0000 7f58608d4740 1 -- 172.21.15.12:0/3563442617 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561f166d29b0 con 0x561f166c4e40 2024-09-05T01:25:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.522+0000 7f5840c00640 1 -- 172.21.15.12:0/3563442617 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58480bc2c0 con 0x561f166c4e40 2024-09-05T01:25:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.522+0000 7f5840c00640 1 -- 172.21.15.12:0/3563442617 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f58480efce0 con 0x561f166c4e40 2024-09-05T01:25:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.522+0000 7f58608d4740 10 client.25375 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.522+0000 7f58608d4740 10 client.25375 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-05T01:25:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.522+0000 7f58608d4740 20 client.25375 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.522+0000 7f58608d4740 1 --2- 172.21.15.12:0/3563442617 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x561f166e8360 0x561f166ea750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.523+0000 7f58608d4740 4 client.25375 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:25:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.523+0000 7f58608d4740 1 -- 172.21.15.12:0/3563442617 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f16638950 con 0x561f166e8360 2024-09-05T01:25:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.523+0000 7f5856000640 1 --2- 172.21.15.12:0/3563442617 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x561f166e8360 0x561f166ea750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.523+0000 7f5856000640 1 --2- 172.21.15.12:0/3563442617 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x561f166e8360 0x561f166ea750 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=27219ab601e2860c server_cookie=7ca7146487bd1aa8 in_seq=0 out_seq=0 2024-09-05T01:25:30.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.523+0000 7f5840c00640 10 client.25375 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:25:30.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.524+0000 7f5840c00640 1 -- 172.21.15.12:0/3563442617 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561f16638950 con 0x561f166e8360 2024-09-05T01:25:30.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.524+0000 7f5840c00640 10 client.25375 handle_command_reply: tid=0 2024-09-05T01:25:30.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.524+0000 7f58608d4740 1 client.25375 shutdown 2024-09-05T01:25:30.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.525+0000 7f58608d4740 1 -- 172.21.15.12:0/3563442617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f166c4e40 msgr2=0x561f166ccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:30.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.525+0000 7f58608d4740 1 --2- 172.21.15.12:0/3563442617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f166c4e40 0x561f166ccf80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f58480bc470 tx=0x7f584803b690 comp rx=0 tx=0).stop 2024-09-05T01:25:30.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.525+0000 7f58608d4740 1 -- 172.21.15.12:0/3563442617 shutdown_connections 2024-09-05T01:25:30.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.525+0000 7f58608d4740 1 --2- 172.21.15.12:0/3563442617 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x561f166e8360 0x561f166ea750 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.525+0000 7f58608d4740 1 --2- 172.21.15.12:0/3563442617 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f166d0020 0x561f166cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.525+0000 7f58608d4740 1 --2- 172.21.15.12:0/3563442617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c5760 0x561f166cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.525+0000 7f58608d4740 1 --2- 172.21.15.12:0/3563442617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f166c4e40 0x561f166ccf80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.525+0000 7f58608d4740 1 -- 172.21.15.12:0/3563442617 >> 172.21.15.12:0/3563442617 conn(0x561f166c13d0 msgr2=0x561f166c7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:30.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.525+0000 7f5840c00640 0 client.25375 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:25:30.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.525+0000 7f58608d4740 1 -- 172.21.15.12:0/3563442617 shutdown_connections 2024-09-05T01:25:30.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.525+0000 7f58608d4740 1 -- 172.21.15.12:0/3563442617 wait complete. 2024-09-05T01:25:30.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.526+0000 7f58608d4740 20 client.25375 trim_cache size 0 max 16384 2024-09-05T01:25:30.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.540+0000 7f58608d4740 1 Processor -- start 2024-09-05T01:25:30.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.540+0000 7f58608d4740 1 -- start start 2024-09-05T01:25:30.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.540+0000 7f58608d4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c4e40 0x561f166c7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:30.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.540+0000 7f58608d4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f166c5760 0x561f166c0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:30.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.540+0000 7f58608d4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f166d0020 0x561f166eff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:30.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.540+0000 7f58608d4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f58581ab600 con 0x561f166c4e40 2024-09-05T01:25:30.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.540+0000 7f58608d4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f58581ad140 con 0x561f166d0020 2024-09-05T01:25:30.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.540+0000 7f58608d4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f58581abcd0 con 0x561f166c5760 2024-09-05T01:25:30.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.540+0000 7f5856a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c4e40 0x561f166c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:30.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.541+0000 7f5856a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c4e40 0x561f166c7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56266/0 (socket says 172.21.15.12:56266) 2024-09-05T01:25:30.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.541+0000 7f5856a00640 1 -- 172.21.15.12:0/2498216864 learned_addr learned my addr 172.21.15.12:0/2498216864 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:30.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.541+0000 7f5857400640 1 --2- 172.21.15.12:0/2498216864 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f166d0020 0x561f166eff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:30.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.541+0000 7f5856000640 1 --2- 172.21.15.12:0/2498216864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f166c5760 0x561f166c0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:30.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.541+0000 7f5856a00640 1 -- 172.21.15.12:0/2498216864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f166c5760 msgr2=0x561f166c0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:30.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.541+0000 7f5856a00640 1 --2- 172.21.15.12:0/2498216864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f166c5760 0x561f166c0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.541+0000 7f5856a00640 1 -- 172.21.15.12:0/2498216864 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f166d0020 msgr2=0x561f166eff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:30.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.541+0000 7f5856a00640 1 --2- 172.21.15.12:0/2498216864 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f166d0020 0x561f166eff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.541+0000 7f5856a00640 1 -- 172.21.15.12:0/2498216864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f166c2560 con 0x561f166c4e40 2024-09-05T01:25:30.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.541+0000 7f5856a00640 1 --2- 172.21.15.12:0/2498216864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c4e40 0x561f166c7810 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f58480b8590 tx=0x7f58480f5cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=141789e4da5e6175 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:30.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.542+0000 7f5843400640 1 -- 172.21.15.12:0/2498216864 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58480c8070 con 0x561f166c4e40 2024-09-05T01:25:30.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.542+0000 7f5843400640 1 -- 172.21.15.12:0/2498216864 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5848031e50 con 0x561f166c4e40 2024-09-05T01:25:30.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.542+0000 7f5843400640 1 -- 172.21.15.12:0/2498216864 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5848049070 con 0x561f166c4e40 2024-09-05T01:25:30.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.543+0000 7f58608d4740 1 -- 172.21.15.12:0/2498216864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c4e40 msgr2=0x561f166c7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:30.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.543+0000 7f58608d4740 1 --2- 172.21.15.12:0/2498216864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c4e40 0x561f166c7810 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f58480b8590 tx=0x7f58480f5cd0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.543+0000 7f58608d4740 1 -- 172.21.15.12:0/2498216864 shutdown_connections 2024-09-05T01:25:30.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.543+0000 7f58608d4740 1 --2- 172.21.15.12:0/2498216864 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f166d0020 0x561f166eff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.543+0000 7f58608d4740 1 --2- 172.21.15.12:0/2498216864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f166c5760 0x561f166c0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.543+0000 7f58608d4740 1 --2- 172.21.15.12:0/2498216864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c4e40 0x561f166c7810 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.543+0000 7f58608d4740 1 -- 172.21.15.12:0/2498216864 >> 172.21.15.12:0/2498216864 conn(0x561f166c13d0 msgr2=0x561f166bfc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:30.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.543+0000 7f58608d4740 1 -- 172.21.15.12:0/2498216864 shutdown_connections 2024-09-05T01:25:30.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.543+0000 7f58608d4740 1 -- 172.21.15.12:0/2498216864 wait complete. 2024-09-05T01:25:30.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.544+0000 7f58608d4740 1 -- start start 2024-09-05T01:25:30.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.544+0000 7f58608d4740 1 Processor -- start 2024-09-05T01:25:30.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.544+0000 7f58608d4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c4e40 0x561f166d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:30.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.544+0000 7f58608d4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f166c5760 0x561f166d3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:30.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.544+0000 7f58608d4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f166d0020 0x561f166d36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:30.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.544+0000 7f58608d4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f58581aca70 con 0x561f166c4e40 2024-09-05T01:25:30.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.544+0000 7f58608d4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f58581ac3a0 con 0x561f166c5760 2024-09-05T01:25:30.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.544+0000 7f58608d4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f58581a95e0 con 0x561f166d0020 2024-09-05T01:25:30.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.544+0000 7f58608d4740 10 client.0 _ll_register_callbacks cb 0x7f58480f5a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:30.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.545+0000 7f5856a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c4e40 0x561f166d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:30.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.545+0000 7f5856000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f166c5760 0x561f166d3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:30.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.545+0000 7f5857400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f166d0020 0x561f166d36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:30.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.545+0000 7f5856a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c4e40 0x561f166d2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56272/0 (socket says 172.21.15.12:56272) 2024-09-05T01:25:30.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.545+0000 7f5856a00640 1 -- 172.21.15.12:0/1889210702 learned_addr learned my addr 172.21.15.12:0/1889210702 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:30.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.545+0000 7f5856a00640 1 -- 172.21.15.12:0/1889210702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f166d0020 msgr2=0x561f166d36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:30.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.545+0000 7f5856a00640 1 --2- 172.21.15.12:0/1889210702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f166d0020 0x561f166d36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.545+0000 7f5856a00640 1 -- 172.21.15.12:0/1889210702 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f166c5760 msgr2=0x561f166d3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:30.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.545+0000 7f5856a00640 1 --2- 172.21.15.12:0/1889210702 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f166c5760 0x561f166d3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.545+0000 7f5856a00640 1 -- 172.21.15.12:0/1889210702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f16751120 con 0x561f166c4e40 2024-09-05T01:25:30.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.546+0000 7f5856a00640 1 --2- 172.21.15.12:0/1889210702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c4e40 0x561f166d2c40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f58480b9e70 tx=0x7f58480f5960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79863e14d2cb152 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:30.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.546+0000 7f5840c00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:25:30.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.546+0000 7f5840c00640 1 -- 172.21.15.12:0/1889210702 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58480c8020 con 0x561f166c4e40 2024-09-05T01:25:30.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.546+0000 7f5840c00640 1 -- 172.21.15.12:0/1889210702 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f58480c45a0 con 0x561f166c4e40 2024-09-05T01:25:30.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.546+0000 7f58608d4740 1 -- 172.21.15.12:0/1889210702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5848031e50 con 0x561f166c4e40 2024-09-05T01:25:30.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.546+0000 7f5840c00640 1 -- 172.21.15.12:0/1889210702 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5848049070 con 0x561f166c4e40 2024-09-05T01:25:30.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.546+0000 7f58608d4740 10 client.15372 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:30.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.546+0000 7f58608d4740 1 -- 172.21.15.12:0/1889210702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561f16751120 con 0x561f166c4e40 2024-09-05T01:25:30.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.547+0000 7f5840c00640 1 -- 172.21.15.12:0/1889210702 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5848031e50 con 0x561f166c4e40 2024-09-05T01:25:30.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.547+0000 7f5840c00640 1 -- 172.21.15.12:0/1889210702 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f58480f9040 con 0x561f166c4e40 2024-09-05T01:25:30.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.547+0000 7f58608d4740 10 client.15372 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:30.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.547+0000 7f58608d4740 10 client.15372 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-05T01:25:30.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.547+0000 7f58608d4740 20 client.15372 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:30.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.547+0000 7f58608d4740 1 --2- 172.21.15.12:0/1889210702 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x561f167526f0 0x561f16754ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:30.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.547+0000 7f58608d4740 4 client.15372 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:25:30.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.547+0000 7f58608d4740 1 -- 172.21.15.12:0/1889210702 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561f16632e60 con 0x561f167526f0 2024-09-05T01:25:30.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.548+0000 7f5856000640 1 --2- 172.21.15.12:0/1889210702 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x561f167526f0 0x561f16754ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:30.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.548+0000 7f5856000640 1 --2- 172.21.15.12:0/1889210702 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x561f167526f0 0x561f16754ae0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f2896f0eef929241 server_cookie=3f26adce0c1fad45 in_seq=0 out_seq=0 2024-09-05T01:25:30.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.548+0000 7f5840c00640 10 client.15372 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:25:30.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.548+0000 7f5840c00640 1 -- 172.21.15.12:0/1889210702 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561f16632e60 con 0x561f167526f0 2024-09-05T01:25:30.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.548+0000 7f5840c00640 10 client.15372 handle_command_reply: tid=0 2024-09-05T01:25:30.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.549+0000 7f58608d4740 1 client.15372 shutdown 2024-09-05T01:25:30.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.549+0000 7f58608d4740 1 -- 172.21.15.12:0/1889210702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c4e40 msgr2=0x561f166d2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:30.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.549+0000 7f58608d4740 1 --2- 172.21.15.12:0/1889210702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c4e40 0x561f166d2c40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f58480b9e70 tx=0x7f58480f5960 comp rx=0 tx=0).stop 2024-09-05T01:25:30.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.549+0000 7f58608d4740 1 -- 172.21.15.12:0/1889210702 shutdown_connections 2024-09-05T01:25:30.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.549+0000 7f58608d4740 1 --2- 172.21.15.12:0/1889210702 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x561f167526f0 0x561f16754ae0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.549+0000 7f58608d4740 1 --2- 172.21.15.12:0/1889210702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561f166d0020 0x561f166d36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.549+0000 7f58608d4740 1 --2- 172.21.15.12:0/1889210702 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561f166c5760 0x561f166d3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.549+0000 7f58608d4740 1 --2- 172.21.15.12:0/1889210702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561f166c4e40 0x561f166d2c40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.549+0000 7f58608d4740 1 -- 172.21.15.12:0/1889210702 >> 172.21.15.12:0/1889210702 conn(0x561f166c13d0 msgr2=0x561f166c0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:30.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.549+0000 7f5840c00640 0 client.15372 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:25:30.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.549+0000 7f58608d4740 1 -- 172.21.15.12:0/1889210702 shutdown_connections 2024-09-05T01:25:30.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.550+0000 7f58608d4740 1 -- 172.21.15.12:0/1889210702 wait complete. 2024-09-05T01:25:30.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.550+0000 7f58608d4740 20 client.15372 trim_cache size 0 max 16384 2024-09-05T01:25:30.554 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:25:30.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.550+0000 7f5857e00640 1 -- 172.21.15.12:0/3420303670 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f583c0a2f60 msgr2=0x7f583c0a5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:30.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.551+0000 7f5857e00640 1 --2- 172.21.15.12:0/3420303670 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f583c0a2f60 0x7f583c0a5420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f58500099a0 tx=0x7f5850009500 comp rx=0 tx=0).stop 2024-09-05T01:25:30.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.551+0000 7f5857e00640 1 -- 172.21.15.12:0/3420303670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5858100720 msgr2=0x7f585819a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:30.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.551+0000 7f5857e00640 1 --2- 172.21.15.12:0/3420303670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5858100720 0x7f585819a4e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5848004770 tx=0x7f5848003c10 comp rx=0 tx=0).stop 2024-09-05T01:25:30.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.551+0000 7f5857e00640 1 -- 172.21.15.12:0/3420303670 shutdown_connections 2024-09-05T01:25:30.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.551+0000 7f5857e00640 1 --2- 172.21.15.12:0/3420303670 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f583c0a2f60 0x7f583c0a5420 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.551+0000 7f5857e00640 1 --2- 172.21.15.12:0/3420303670 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f585810e2d0 0x7f585819edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.551+0000 7f5857e00640 1 --2- 172.21.15.12:0/3420303670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58581010d0 0x7f585819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.551+0000 7f5857e00640 1 --2- 172.21.15.12:0/3420303670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5858100720 0x7f585819a4e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:30.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.551+0000 7f5857e00640 1 -- 172.21.15.12:0/3420303670 >> 172.21.15.12:0/3420303670 conn(0x7f58580fc610 msgr2=0x7f58580fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:30.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.551+0000 7f5857e00640 1 -- 172.21.15.12:0/3420303670 shutdown_connections 2024-09-05T01:25:30.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:30.551+0000 7f5857e00640 1 -- 172.21.15.12:0/3420303670 wait complete. 2024-09-05T01:25:31.033 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:30 smithi012 ceph-mon[29942]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-05T01:25:31.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:30 smithi145 ceph-mon[34376]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-05T01:25:31.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:30 smithi151 ceph-mon[35013]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-05T01:25:31.444 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-05T01:25:31.936 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:25:32.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.710+0000 7f7a39800640 1 -- 172.21.15.12:0/538496094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a34104010 msgr2=0x7f7a341043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:32.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.710+0000 7f7a39800640 1 --2- 172.21.15.12:0/538496094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a34104010 0x7f7a341043f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7a24009900 tx=0x7f7a2402a3f0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.710+0000 7f7a39800640 1 -- 172.21.15.12:0/538496094 shutdown_connections 2024-09-05T01:25:32.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.710+0000 7f7a39800640 1 --2- 172.21.15.12:0/538496094 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a34109140 0x7f7a34110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.710+0000 7f7a39800640 1 --2- 172.21.15.12:0/538496094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a341049c0 0x7f7a34108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.710+0000 7f7a39800640 1 --2- 172.21.15.12:0/538496094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a34104010 0x7f7a341043f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.710+0000 7f7a39800640 1 -- 172.21.15.12:0/538496094 >> 172.21.15.12:0/538496094 conn(0x7f7a340ffa50 msgr2=0x7f7a34101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:32.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.710+0000 7f7a39800640 1 -- 172.21.15.12:0/538496094 shutdown_connections 2024-09-05T01:25:32.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.710+0000 7f7a39800640 1 -- 172.21.15.12:0/538496094 wait complete. 2024-09-05T01:25:32.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.711+0000 7f7a39800640 1 Processor -- start 2024-09-05T01:25:32.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.712+0000 7f7a39800640 1 -- start start 2024-09-05T01:25:32.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.712+0000 7f7a39800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a34104010 0x7f7a3419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:32.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.712+0000 7f7a39800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a341049c0 0x7f7a3419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:32.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.712+0000 7f7a39800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a34109140 0x7f7a3419ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:32.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.712+0000 7f7a39800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7a341141c0 con 0x7f7a34104010 2024-09-05T01:25:32.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.712+0000 7f7a39800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7a34114040 con 0x7f7a341049c0 2024-09-05T01:25:32.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.712+0000 7f7a39800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7a34114340 con 0x7f7a34109140 2024-09-05T01:25:32.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.713+0000 7f7a32000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a341049c0 0x7f7a3419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:32.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.713+0000 7f7a32a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a34104010 0x7f7a3419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:32.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.713+0000 7f7a32000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a341049c0 0x7f7a3419ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:34936/0 (socket says 172.21.15.12:34936) 2024-09-05T01:25:32.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.713+0000 7f7a32000640 1 -- 172.21.15.12:0/110775113 learned_addr learned my addr 172.21.15.12:0/110775113 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:32.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.713+0000 7f7a33400640 1 --2- 172.21.15.12:0/110775113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a34109140 0x7f7a3419ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:32.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.713+0000 7f7a32000640 1 -- 172.21.15.12:0/110775113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a34109140 msgr2=0x7f7a3419ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:32.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.713+0000 7f7a32000640 1 --2- 172.21.15.12:0/110775113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a34109140 0x7f7a3419ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.713+0000 7f7a32000640 1 -- 172.21.15.12:0/110775113 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a34104010 msgr2=0x7f7a3419a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:32.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.713+0000 7f7a32000640 1 --2- 172.21.15.12:0/110775113 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a34104010 0x7f7a3419a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.713+0000 7f7a32000640 1 -- 172.21.15.12:0/110775113 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3419f5f0 con 0x7f7a341049c0 2024-09-05T01:25:32.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.714+0000 7f7a32000640 1 --2- 172.21.15.12:0/110775113 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a341049c0 0x7f7a3419ab80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000e9f0 tx=0x7f7a2000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:32.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.714+0000 7f7a2b400640 1 -- 172.21.15.12:0/110775113 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2000cd80 con 0x7f7a341049c0 2024-09-05T01:25:32.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.714+0000 7f7a39800640 1 -- 172.21.15.12:0/110775113 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a3419f8e0 con 0x7f7a341049c0 2024-09-05T01:25:32.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.714+0000 7f7a39800640 1 -- 172.21.15.12:0/110775113 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a341a71c0 con 0x7f7a341049c0 2024-09-05T01:25:32.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.714+0000 7f7a2b400640 1 -- 172.21.15.12:0/110775113 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a20010910 con 0x7f7a341049c0 2024-09-05T01:25:32.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.714+0000 7f7a2b400640 1 -- 172.21.15.12:0/110775113 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a200188f0 con 0x7f7a341049c0 2024-09-05T01:25:32.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.717+0000 7f7a3c29d740 1 Processor -- start 2024-09-05T01:25:32.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.718+0000 7f7a3c29d740 1 -- start start 2024-09-05T01:25:32.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.718+0000 7f7a3c29d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7e0480 0x55c98b7e0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:32.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.718+0000 7f7a3c29d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c98b7e0da0 0x55c98b7eb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:32.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.718+0000 7f7a3c29d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c98b7eb660 0x55c98b7eda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:32.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.718+0000 7f7a3c29d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c98b73e3e0 con 0x55c98b7e0480 2024-09-05T01:25:32.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.718+0000 7f7a3c29d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c98b6e5d80 con 0x55c98b7e0da0 2024-09-05T01:25:32.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.718+0000 7f7a3c29d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c98b73a3a0 con 0x55c98b7eb660 2024-09-05T01:25:32.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.719+0000 7f7a33400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7e0480 0x55c98b7e0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:32.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.719+0000 7f7a32a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c98b7e0da0 0x55c98b7eb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:32.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.719+0000 7f7a32a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c98b7e0da0 0x55c98b7eb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:34938/0 (socket says 172.21.15.12:34938) 2024-09-05T01:25:32.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.719+0000 7f7a32a00640 1 -- 172.21.15.12:0/3220226438 learned_addr learned my addr 172.21.15.12:0/3220226438 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:32.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.719+0000 7f7a2b400640 1 -- 172.21.15.12:0/110775113 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 25) ==== 138066+0+0 (secure 0 0 0) 0x7f7a20018bb0 con 0x7f7a341049c0 2024-09-05T01:25:32.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.719+0000 7f7a32a00640 1 -- 172.21.15.12:0/3220226438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c98b7eb660 msgr2=0x55c98b7eda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:32.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.719+0000 7f7a32a00640 1 --2- 172.21.15.12:0/3220226438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c98b7eb660 0x55c98b7eda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.719+0000 7f7a32a00640 1 -- 172.21.15.12:0/3220226438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7e0480 msgr2=0x55c98b7e0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:32.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.720+0000 7f7a32a00640 1 --2- 172.21.15.12:0/3220226438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7e0480 0x55c98b7e0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.720+0000 7f7a32a00640 1 -- 172.21.15.12:0/3220226438 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c98b704ae0 con 0x55c98b7e0da0 2024-09-05T01:25:32.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.720+0000 7f7a33400640 1 --2- 172.21.15.12:0/3220226438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7e0480 0x55c98b7e0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:25:32.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.720+0000 7f7a32a00640 1 --2- 172.21.15.12:0/3220226438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c98b7e0da0 0x55c98b7eb120 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7a24009900 tx=0x7f7a24005e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7014a5fef725ed7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:32.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.721+0000 7f7a1fe00640 1 -- 172.21.15.12:0/3220226438 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a24035030 con 0x55c98b7e0da0 2024-09-05T01:25:32.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.721+0000 7f7a1fe00640 1 -- 172.21.15.12:0/3220226438 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a240043c0 con 0x55c98b7e0da0 2024-09-05T01:25:32.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.721+0000 7f7a1fe00640 1 -- 172.21.15.12:0/3220226438 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a240035f0 con 0x55c98b7e0da0 2024-09-05T01:25:32.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.721+0000 7f7a2b400640 1 --2- 172.21.15.12:0/110775113 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7a180a2f10 0x7f7a180a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:32.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.721+0000 7f7a2b400640 1 -- 172.21.15.12:0/110775113 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f7a200cf9b0 con 0x7f7a341049c0 2024-09-05T01:25:32.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.722+0000 7f7a3c29d740 1 -- 172.21.15.12:0/3220226438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c98b7e0da0 msgr2=0x55c98b7eb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:32.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.722+0000 7f7a3c29d740 1 --2- 172.21.15.12:0/3220226438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c98b7e0da0 0x55c98b7eb120 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7a24009900 tx=0x7f7a24005e60 comp rx=0 tx=0).stop 2024-09-05T01:25:32.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.722+0000 7f7a3c29d740 1 -- 172.21.15.12:0/3220226438 shutdown_connections 2024-09-05T01:25:32.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.722+0000 7f7a3c29d740 1 --2- 172.21.15.12:0/3220226438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c98b7eb660 0x55c98b7eda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.722+0000 7f7a3c29d740 1 --2- 172.21.15.12:0/3220226438 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c98b7e0da0 0x55c98b7eb120 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.722+0000 7f7a3c29d740 1 --2- 172.21.15.12:0/3220226438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7e0480 0x55c98b7e0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.722+0000 7f7a3c29d740 1 -- 172.21.15.12:0/3220226438 >> 172.21.15.12:0/3220226438 conn(0x55c98b7dca10 msgr2=0x55c98b7dcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:32.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.722+0000 7f7a33400640 1 --2- 172.21.15.12:0/110775113 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7a180a2f10 0x7f7a180a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:32.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.723+0000 7f7a3c29d740 1 -- 172.21.15.12:0/3220226438 shutdown_connections 2024-09-05T01:25:32.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.723+0000 7f7a3c29d740 1 -- 172.21.15.12:0/3220226438 wait complete. 2024-09-05T01:25:32.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.723+0000 7f7a33400640 1 --2- 172.21.15.12:0/110775113 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7a180a2f10 0x7f7a180a53d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c005fd0 tx=0x7f7a2c009500 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:32.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.724+0000 7f7a3c29d740 1 -- start start 2024-09-05T01:25:32.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.724+0000 7f7a3c29d740 1 Processor -- start 2024-09-05T01:25:32.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.724+0000 7f7a3c29d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c98b7e0480 0x55c98b7e8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:32.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.725+0000 7f7a3c29d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c98b7e0da0 0x55c98b7e8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:32.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.725+0000 7f7a3c29d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7eb660 0x55c98b7e8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:32.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.725+0000 7f7a3c29d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c98b7ee230 con 0x55c98b7eb660 2024-09-05T01:25:32.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.725+0000 7f7a3c29d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c98b6f90f0 con 0x55c98b7e0da0 2024-09-05T01:25:32.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.725+0000 7f7a3c29d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c98b7ee3b0 con 0x55c98b7e0480 2024-09-05T01:25:32.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.725+0000 7f7a3c29d740 10 client.0 _ll_register_callbacks cb 0x55c98b6e0bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:32.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.725+0000 7f7a32a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c98b7e0480 0x55c98b7e8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:32.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.725+0000 7f7a32a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c98b7e0480 0x55c98b7e8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:49320/0 (socket says 172.21.15.12:49320) 2024-09-05T01:25:32.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.725+0000 7f7a32a00640 1 -- 172.21.15.12:0/3586085024 learned_addr learned my addr 172.21.15.12:0/3586085024 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:32.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.725+0000 7f7a32a00640 1 -- 172.21.15.12:0/3586085024 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c98b7e0da0 msgr2=0x55c98b7e8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:32.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.725+0000 7f7a32000640 1 --2- 172.21.15.12:0/3586085024 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c98b7e0da0 0x55c98b7e8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:32.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.725+0000 7f7a32a00640 1 --2- 172.21.15.12:0/3586085024 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c98b7e0da0 0x55c98b7e8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.725+0000 7f7a32a00640 1 -- 172.21.15.12:0/3586085024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7eb660 msgr2=0x55c98b7e8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:32.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.725+0000 7f7a33400640 1 --2- 172.21.15.12:0/3586085024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7eb660 0x55c98b7e8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:32.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.726+0000 7f7a32a00640 1 --2- 172.21.15.12:0/3586085024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7eb660 0x55c98b7e8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.726+0000 7f7a32a00640 1 -- 172.21.15.12:0/3586085024 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c98b4af3c0 con 0x55c98b7e0480 2024-09-05T01:25:32.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.726+0000 7f7a33400640 1 --2- 172.21.15.12:0/3586085024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7eb660 0x55c98b7e8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:25:32.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.726+0000 7f7a32a00640 1 --2- 172.21.15.12:0/3586085024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c98b7e0480 0x55c98b7e8570 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7a2402a9e0 tx=0x7f7a24003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd5235720b207e1c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:32.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.726+0000 7f7a1cc00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:25:32.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.726+0000 7f7a1cc00640 1 -- 172.21.15.12:0/3586085024 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a24035070 con 0x55c98b7e0480 2024-09-05T01:25:32.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.726+0000 7f7a3c29d740 1 -- 172.21.15.12:0/3586085024 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a240043c0 con 0x55c98b7e0480 2024-09-05T01:25:32.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.726+0000 7f7a1cc00640 1 -- 172.21.15.12:0/3586085024 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f7a24003ba0 con 0x55c98b7e0480 2024-09-05T01:25:32.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.727+0000 7f7a1cc00640 1 -- 172.21.15.12:0/3586085024 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7a24009520 con 0x55c98b7e0480 2024-09-05T01:25:32.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.727+0000 7f7a3c29d740 10 client.25390 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:32.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.727+0000 7f7a3c29d740 1 -- 172.21.15.12:0/3586085024 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c98b7ee230 con 0x55c98b7e0480 2024-09-05T01:25:32.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.727+0000 7f7a1cc00640 1 -- 172.21.15.12:0/3586085024 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a240043c0 con 0x55c98b7e0480 2024-09-05T01:25:32.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.728+0000 7f7a1cc00640 1 -- 172.21.15.12:0/3586085024 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7a240574e0 con 0x55c98b7e0480 2024-09-05T01:25:32.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.728+0000 7f7a3c29d740 10 client.25390 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:32.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.728+0000 7f7a3c29d740 10 client.25390 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-05T01:25:32.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.728+0000 7f7a3c29d740 20 client.25390 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:32.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.728+0000 7f7a3c29d740 1 --2- 172.21.15.12:0/3586085024 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55c98b7fb3f0 0x55c98b7fd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:32.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.728+0000 7f7a3c29d740 4 client.25390 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:25:32.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.728+0000 7f7a3c29d740 1 -- 172.21.15.12:0/3586085024 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c98b74b950 con 0x55c98b7fb3f0 2024-09-05T01:25:32.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.728+0000 7f7a32000640 1 --2- 172.21.15.12:0/3586085024 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55c98b7fb3f0 0x55c98b7fd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:32.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.729+0000 7f7a32000640 1 --2- 172.21.15.12:0/3586085024 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55c98b7fb3f0 0x55c98b7fd7e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=892696dc645cc977 server_cookie=66d9ad941ec09a86 in_seq=0 out_seq=0 2024-09-05T01:25:32.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.729+0000 7f7a1cc00640 10 client.25390 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:25:32.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.730+0000 7f7a1cc00640 1 -- 172.21.15.12:0/3586085024 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c98b74b950 con 0x55c98b7fb3f0 2024-09-05T01:25:32.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.730+0000 7f7a1cc00640 10 client.25390 handle_command_reply: tid=0 2024-09-05T01:25:32.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.730+0000 7f7a3c29d740 1 client.25390 shutdown 2024-09-05T01:25:32.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.730+0000 7f7a3c29d740 1 -- 172.21.15.12:0/3586085024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c98b7e0480 msgr2=0x55c98b7e8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:32.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.730+0000 7f7a3c29d740 1 --2- 172.21.15.12:0/3586085024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c98b7e0480 0x55c98b7e8570 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7a2402a9e0 tx=0x7f7a24003820 comp rx=0 tx=0).stop 2024-09-05T01:25:32.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.730+0000 7f7a3c29d740 1 -- 172.21.15.12:0/3586085024 shutdown_connections 2024-09-05T01:25:32.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.730+0000 7f7a3c29d740 1 --2- 172.21.15.12:0/3586085024 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55c98b7fb3f0 0x55c98b7fd7e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.730+0000 7f7a3c29d740 1 --2- 172.21.15.12:0/3586085024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7eb660 0x55c98b7e8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.730+0000 7f7a3c29d740 1 --2- 172.21.15.12:0/3586085024 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c98b7e0da0 0x55c98b7e8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.730+0000 7f7a3c29d740 1 --2- 172.21.15.12:0/3586085024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c98b7e0480 0x55c98b7e8570 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.730+0000 7f7a1cc00640 0 client.25390 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:25:32.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.730+0000 7f7a3c29d740 1 -- 172.21.15.12:0/3586085024 >> 172.21.15.12:0/3586085024 conn(0x55c98b7dca10 msgr2=0x55c98b7d3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:32.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.731+0000 7f7a3c29d740 1 -- 172.21.15.12:0/3586085024 shutdown_connections 2024-09-05T01:25:32.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.731+0000 7f7a3c29d740 1 -- 172.21.15.12:0/3586085024 wait complete. 2024-09-05T01:25:32.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.731+0000 7f7a3c29d740 20 client.25390 trim_cache size 0 max 16384 2024-09-05T01:25:32.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.747+0000 7f7a3c29d740 1 Processor -- start 2024-09-05T01:25:32.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.747+0000 7f7a3c29d740 1 -- start start 2024-09-05T01:25:32.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.747+0000 7f7a3c29d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c98b7e0480 0x55c98b7d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:32.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.747+0000 7f7a3c29d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c98b7e0da0 0x55c98b7e2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:32.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.747+0000 7f7a3c29d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7eb660 0x55c98b802d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:32.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.747+0000 7f7a3c29d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1400e7d0 con 0x55c98b7eb660 2024-09-05T01:25:32.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.747+0000 7f7a3c29d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7a14010310 con 0x55c98b7e0da0 2024-09-05T01:25:32.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.747+0000 7f7a3c29d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1400eea0 con 0x55c98b7e0480 2024-09-05T01:25:32.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.747+0000 7f7a33400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7eb660 0x55c98b802d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:32.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.748+0000 7f7a33400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7eb660 0x55c98b802d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56312/0 (socket says 172.21.15.12:56312) 2024-09-05T01:25:32.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.748+0000 7f7a32a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c98b7e0480 0x55c98b7d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:32.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.748+0000 7f7a33400640 1 -- 172.21.15.12:0/1003074200 learned_addr learned my addr 172.21.15.12:0/1003074200 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:32.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.748+0000 7f7a32000640 1 --2- 172.21.15.12:0/1003074200 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c98b7e0da0 0x55c98b7e2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:32.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.748+0000 7f7a32a00640 1 -- 172.21.15.12:0/1003074200 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c98b7e0da0 msgr2=0x55c98b7e2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:32.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.748+0000 7f7a32a00640 1 --2- 172.21.15.12:0/1003074200 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c98b7e0da0 0x55c98b7e2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.748+0000 7f7a32a00640 1 -- 172.21.15.12:0/1003074200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7eb660 msgr2=0x55c98b802d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:32.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.748+0000 7f7a32a00640 1 --2- 172.21.15.12:0/1003074200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7eb660 0x55c98b802d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.748+0000 7f7a32a00640 1 -- 172.21.15.12:0/1003074200 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c98b7cf770 con 0x55c98b7e0480 2024-09-05T01:25:32.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.748+0000 7f7a33400640 1 --2- 172.21.15.12:0/1003074200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7eb660 0x55c98b802d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:25:32.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.749+0000 7f7a32a00640 1 --2- 172.21.15.12:0/1003074200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c98b7e0480 0x55c98b7d3630 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7a24057a50 tx=0x7f7a240058b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d045e2fbf77404c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:32.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.749+0000 7f7a1f400640 1 -- 172.21.15.12:0/1003074200 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a24035040 con 0x55c98b7e0480 2024-09-05T01:25:32.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.749+0000 7f7a1f400640 1 -- 172.21.15.12:0/1003074200 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a2405c070 con 0x55c98b7e0480 2024-09-05T01:25:32.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.749+0000 7f7a1f400640 1 -- 172.21.15.12:0/1003074200 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a24031810 con 0x55c98b7e0480 2024-09-05T01:25:32.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.750+0000 7f7a3c29d740 1 -- 172.21.15.12:0/1003074200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c98b7e0480 msgr2=0x55c98b7d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:32.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.750+0000 7f7a3c29d740 1 --2- 172.21.15.12:0/1003074200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c98b7e0480 0x55c98b7d3630 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7a24057a50 tx=0x7f7a240058b0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.750+0000 7f7a3c29d740 1 -- 172.21.15.12:0/1003074200 shutdown_connections 2024-09-05T01:25:32.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.750+0000 7f7a3c29d740 1 --2- 172.21.15.12:0/1003074200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7eb660 0x55c98b802d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.750+0000 7f7a3c29d740 1 --2- 172.21.15.12:0/1003074200 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c98b7e0da0 0x55c98b7e2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.750+0000 7f7a3c29d740 1 --2- 172.21.15.12:0/1003074200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c98b7e0480 0x55c98b7d3630 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.750+0000 7f7a3c29d740 1 -- 172.21.15.12:0/1003074200 >> 172.21.15.12:0/1003074200 conn(0x55c98b7dca10 msgr2=0x55c98b7ea5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:32.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.750+0000 7f7a3c29d740 1 -- 172.21.15.12:0/1003074200 shutdown_connections 2024-09-05T01:25:32.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.750+0000 7f7a3c29d740 1 -- 172.21.15.12:0/1003074200 wait complete. 2024-09-05T01:25:32.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.751+0000 7f7a3c29d740 1 -- start start 2024-09-05T01:25:32.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.751+0000 7f7a3c29d740 1 Processor -- start 2024-09-05T01:25:32.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.752+0000 7f7a3c29d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c98b7e0da0 0x55c98b7f3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:32.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.752+0000 7f7a3c29d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c98b7eb660 0x55c98b7f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:32.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.752+0000 7f7a3c29d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7f40e0 0x55c98b85eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:32.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.752+0000 7f7a3c29d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1400fc40 con 0x55c98b7f40e0 2024-09-05T01:25:32.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.752+0000 7f7a3c29d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1400f570 con 0x55c98b7eb660 2024-09-05T01:25:32.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.752+0000 7f7a3c29d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1400c7b0 con 0x55c98b7e0da0 2024-09-05T01:25:32.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.752+0000 7f7a3c29d740 10 client.0 _ll_register_callbacks cb 0x7f7a2c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:32.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.752+0000 7f7a32a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c98b7e0da0 0x55c98b7f3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:32.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.752+0000 7f7a33400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7f40e0 0x55c98b85eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:32.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.752+0000 7f7a32a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c98b7e0da0 0x55c98b7f3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:49342/0 (socket says 172.21.15.12:49342) 2024-09-05T01:25:32.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.752+0000 7f7a32a00640 1 -- 172.21.15.12:0/3265188713 learned_addr learned my addr 172.21.15.12:0/3265188713 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:32.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.753+0000 7f7a32a00640 1 -- 172.21.15.12:0/3265188713 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c98b7eb660 msgr2=0x55c98b7f3ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:25:32.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.753+0000 7f7a32a00640 1 --2- 172.21.15.12:0/3265188713 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c98b7eb660 0x55c98b7f3ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.753+0000 7f7a32a00640 1 -- 172.21.15.12:0/3265188713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7f40e0 msgr2=0x55c98b85eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:32.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.753+0000 7f7a32a00640 1 --2- 172.21.15.12:0/3265188713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7f40e0 0x55c98b85eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.753+0000 7f7a32a00640 1 -- 172.21.15.12:0/3265188713 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c98b85f710 con 0x55c98b7e0da0 2024-09-05T01:25:32.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.753+0000 7f7a33400640 1 --2- 172.21.15.12:0/3265188713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7f40e0 0x55c98b85eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:25:32.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.753+0000 7f7a32a00640 1 --2- 172.21.15.12:0/3265188713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c98b7e0da0 0x55c98b7f3660 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7a2402a910 tx=0x7f7a240043f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28aaf6343d68740b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:32.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.753+0000 7f7a1cc00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:25:32.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.753+0000 7f7a1cc00640 1 -- 172.21.15.12:0/3265188713 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a24065060 con 0x55c98b7e0da0 2024-09-05T01:25:32.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.753+0000 7f7a1cc00640 1 -- 172.21.15.12:0/3265188713 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f7a24003db0 con 0x55c98b7e0da0 2024-09-05T01:25:32.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.753+0000 7f7a3c29d740 1 -- 172.21.15.12:0/3265188713 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a2405c070 con 0x55c98b7e0da0 2024-09-05T01:25:32.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.754+0000 7f7a1cc00640 1 -- 172.21.15.12:0/3265188713 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7a24035070 con 0x55c98b7e0da0 2024-09-05T01:25:32.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.754+0000 7f7a3c29d740 10 client.25396 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:32.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.754+0000 7f7a3c29d740 1 -- 172.21.15.12:0/3265188713 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c98b7d8730 con 0x55c98b7e0da0 2024-09-05T01:25:32.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.754+0000 7f7a1cc00640 1 -- 172.21.15.12:0/3265188713 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a2405c070 con 0x55c98b7e0da0 2024-09-05T01:25:32.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.755+0000 7f7a1cc00640 1 -- 172.21.15.12:0/3265188713 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7a240315b0 con 0x55c98b7e0da0 2024-09-05T01:25:32.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.755+0000 7f7a3c29d740 10 client.25396 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:32.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.755+0000 7f7a3c29d740 10 client.25396 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-05T01:25:32.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.755+0000 7f7a3c29d740 20 client.25396 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:32.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.755+0000 7f7a3c29d740 1 --2- 172.21.15.12:0/3265188713 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55c98b7d8df0 0x55c98b7db1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:32.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.755+0000 7f7a3c29d740 4 client.25396 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:25:32.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.755+0000 7f7a3c29d740 1 -- 172.21.15.12:0/3265188713 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c98b745e60 con 0x55c98b7d8df0 2024-09-05T01:25:32.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.755+0000 7f7a32000640 1 --2- 172.21.15.12:0/3265188713 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55c98b7d8df0 0x55c98b7db1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:32.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.756+0000 7f7a32000640 1 --2- 172.21.15.12:0/3265188713 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55c98b7d8df0 0x55c98b7db1e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=70d62365b204e7d3 server_cookie=403ad2eb2af08169 in_seq=0 out_seq=0 2024-09-05T01:25:32.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.756+0000 7f7a1cc00640 10 client.25396 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:25:32.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.756+0000 7f7a1cc00640 1 -- 172.21.15.12:0/3265188713 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c98b745e60 con 0x55c98b7d8df0 2024-09-05T01:25:32.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.756+0000 7f7a1cc00640 10 client.25396 handle_command_reply: tid=0 2024-09-05T01:25:32.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.756+0000 7f7a3c29d740 1 client.25396 shutdown 2024-09-05T01:25:32.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.757+0000 7f7a3c29d740 1 -- 172.21.15.12:0/3265188713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c98b7e0da0 msgr2=0x55c98b7f3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:32.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.757+0000 7f7a3c29d740 1 --2- 172.21.15.12:0/3265188713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c98b7e0da0 0x55c98b7f3660 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7a2402a910 tx=0x7f7a240043f0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.757+0000 7f7a3c29d740 1 -- 172.21.15.12:0/3265188713 shutdown_connections 2024-09-05T01:25:32.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.757+0000 7f7a3c29d740 1 --2- 172.21.15.12:0/3265188713 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55c98b7d8df0 0x55c98b7db1e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.757+0000 7f7a3c29d740 1 --2- 172.21.15.12:0/3265188713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c98b7f40e0 0x55c98b85eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.757+0000 7f7a1cc00640 0 client.25396 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:25:32.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.757+0000 7f7a3c29d740 1 --2- 172.21.15.12:0/3265188713 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c98b7eb660 0x55c98b7f3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.757+0000 7f7a3c29d740 1 --2- 172.21.15.12:0/3265188713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c98b7e0da0 0x55c98b7f3660 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.757+0000 7f7a3c29d740 1 -- 172.21.15.12:0/3265188713 >> 172.21.15.12:0/3265188713 conn(0x55c98b7dca10 msgr2=0x55c98b7f64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:32.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.757+0000 7f7a3c29d740 1 -- 172.21.15.12:0/3265188713 shutdown_connections 2024-09-05T01:25:32.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.757+0000 7f7a3c29d740 1 -- 172.21.15.12:0/3265188713 wait complete. 2024-09-05T01:25:32.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.757+0000 7f7a3c29d740 20 client.25396 trim_cache size 0 max 16384 2024-09-05T01:25:32.760 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:25:32.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.758+0000 7f7a39800640 1 -- 172.21.15.12:0/110775113 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7a180a2f10 msgr2=0x7f7a180a53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:32.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.758+0000 7f7a39800640 1 --2- 172.21.15.12:0/110775113 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7a180a2f10 0x7f7a180a53d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c005fd0 tx=0x7f7a2c009500 comp rx=0 tx=0).stop 2024-09-05T01:25:32.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.758+0000 7f7a39800640 1 -- 172.21.15.12:0/110775113 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a341049c0 msgr2=0x7f7a3419ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:32.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.758+0000 7f7a39800640 1 --2- 172.21.15.12:0/110775113 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a341049c0 0x7f7a3419ab80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000e9f0 tx=0x7f7a2000eeb0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.759+0000 7f7a39800640 1 -- 172.21.15.12:0/110775113 shutdown_connections 2024-09-05T01:25:32.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.759+0000 7f7a39800640 1 --2- 172.21.15.12:0/110775113 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7a180a2f10 0x7f7a180a53d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.759+0000 7f7a39800640 1 --2- 172.21.15.12:0/110775113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a34109140 0x7f7a3419ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.759+0000 7f7a39800640 1 --2- 172.21.15.12:0/110775113 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a341049c0 0x7f7a3419ab80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.759+0000 7f7a39800640 1 --2- 172.21.15.12:0/110775113 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a34104010 0x7f7a3419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:32.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.759+0000 7f7a39800640 1 -- 172.21.15.12:0/110775113 >> 172.21.15.12:0/110775113 conn(0x7f7a340ffa50 msgr2=0x7f7a34100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:32.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.759+0000 7f7a39800640 1 -- 172.21.15.12:0/110775113 shutdown_connections 2024-09-05T01:25:32.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:32.759+0000 7f7a39800640 1 -- 172.21.15.12:0/110775113 wait complete. 2024-09-05T01:25:33.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:32 smithi012 ceph-mon[29942]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T01:25:33.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:32 smithi145 ceph-mon[34376]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T01:25:33.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:32 smithi151 ceph-mon[35013]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T01:25:33.645 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-05T01:25:34.082 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:25:34.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.694+0000 7fa4e3200640 1 -- 172.21.15.12:0/2509517493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4e41019c0 msgr2=0x7fa4e4101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:34.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.694+0000 7fa4e3200640 1 --2- 172.21.15.12:0/2509517493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4e41019c0 0x7fa4e4101e20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009930 tx=0x7fa4d002a420 comp rx=0 tx=0).stop 2024-09-05T01:25:34.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.694+0000 7fa4e3200640 1 -- 172.21.15.12:0/2509517493 shutdown_connections 2024-09-05T01:25:34.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.694+0000 7fa4e3200640 1 --2- 172.21.15.12:0/2509517493 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4e4102360 0x7fa4e410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.694+0000 7fa4e3200640 1 --2- 172.21.15.12:0/2509517493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4e41019c0 0x7fa4e4101e20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.694+0000 7fa4e3200640 1 --2- 172.21.15.12:0/2509517493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4e41079c0 0x7fa4e4107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.694+0000 7fa4e3200640 1 -- 172.21.15.12:0/2509517493 >> 172.21.15.12:0/2509517493 conn(0x7fa4e40fd740 msgr2=0x7fa4e40ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:34.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.694+0000 7fa4e3200640 1 -- 172.21.15.12:0/2509517493 shutdown_connections 2024-09-05T01:25:34.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.694+0000 7fa4e3200640 1 -- 172.21.15.12:0/2509517493 wait complete. 2024-09-05T01:25:34.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.695+0000 7fa4e3200640 1 Processor -- start 2024-09-05T01:25:34.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.695+0000 7fa4e3200640 1 -- start start 2024-09-05T01:25:34.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.696+0000 7fa4e3200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4e41019c0 0x7fa4e410dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:34.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.696+0000 7fa4e3200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4e4102360 0x7fa4e410e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:34.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.696+0000 7fa4e3200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4e41079c0 0x7fa4e41a3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:34.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.696+0000 7fa4e3200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e4111dd0 con 0x7fa4e4102360 2024-09-05T01:25:34.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.696+0000 7fa4e3200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e4111c50 con 0x7fa4e41079c0 2024-09-05T01:25:34.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.696+0000 7fa4e3200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e4111f50 con 0x7fa4e41019c0 2024-09-05T01:25:34.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.696+0000 7fa4e1400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4e4102360 0x7fa4e410e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.696+0000 7fa4e1400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4e4102360 0x7fa4e410e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56328/0 (socket says 172.21.15.12:56328) 2024-09-05T01:25:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.696+0000 7fa4e1400640 1 -- 172.21.15.12:0/2783748306 learned_addr learned my addr 172.21.15.12:0/2783748306 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.697+0000 7fa4e1e00640 1 --2- 172.21.15.12:0/2783748306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4e41019c0 0x7fa4e410dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.697+0000 7fa4e1400640 1 -- 172.21.15.12:0/2783748306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4e41019c0 msgr2=0x7fa4e410dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.697+0000 7fa4e1400640 1 --2- 172.21.15.12:0/2783748306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4e41019c0 0x7fa4e410dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.697+0000 7fa4e1400640 1 -- 172.21.15.12:0/2783748306 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4e41079c0 msgr2=0x7fa4e41a3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:34.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.697+0000 7fa4e1400640 1 --2- 172.21.15.12:0/2783748306 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4e41079c0 0x7fa4e41a3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.697+0000 7fa4e1400640 1 -- 172.21.15.12:0/2783748306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e41a3880 con 0x7fa4e4102360 2024-09-05T01:25:34.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.697+0000 7fa4e1e00640 1 --2- 172.21.15.12:0/2783748306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4e41019c0 0x7fa4e410dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:25:34.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.698+0000 7fa4e1400640 1 --2- 172.21.15.12:0/2783748306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4e4102360 0x7fa4e410e0f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa4d002a940 tx=0x7fa4d0003b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:34.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.698+0000 7fa4daa00640 1 -- 172.21.15.12:0/2783748306 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d003f070 con 0x7fa4e4102360 2024-09-05T01:25:34.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.698+0000 7fa4daa00640 1 -- 172.21.15.12:0/2783748306 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4d0031c90 con 0x7fa4e4102360 2024-09-05T01:25:34.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.698+0000 7fa4daa00640 1 -- 172.21.15.12:0/2783748306 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0035030 con 0x7fa4e4102360 2024-09-05T01:25:34.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.698+0000 7fa4e3200640 1 -- 172.21.15.12:0/2783748306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4e41a3b10 con 0x7fa4e4102360 2024-09-05T01:25:34.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.698+0000 7fa4e3200640 1 -- 172.21.15.12:0/2783748306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4e41ab430 con 0x7fa4e4102360 2024-09-05T01:25:34.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.702+0000 7fa4eb638740 1 Processor -- start 2024-09-05T01:25:34.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.702+0000 7fa4eb638740 1 -- start start 2024-09-05T01:25:34.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.703+0000 7fa4eb638740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9eee40 0x559f6e9ef220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:34.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.703+0000 7fa4eb638740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f6e9ef760 0x559f6e9f9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:34.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.703+0000 7fa4eb638740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559f6e9fa020 0x559f6e9fc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:34.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.703+0000 7fa4eb638740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559f6e9553e0 con 0x559f6e9ef760 2024-09-05T01:25:34.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.703+0000 7fa4eb638740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x559f6e8fcd80 con 0x559f6e9fa020 2024-09-05T01:25:34.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.703+0000 7fa4eb638740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559f6e9513a0 con 0x559f6e9eee40 2024-09-05T01:25:34.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.703+0000 7fa4e2800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9eee40 0x559f6e9ef220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:34.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.703+0000 7fa4e2800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9eee40 0x559f6e9ef220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:49356/0 (socket says 172.21.15.12:49356) 2024-09-05T01:25:34.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.703+0000 7fa4e2800640 1 -- 172.21.15.12:0/1695668040 learned_addr learned my addr 172.21.15.12:0/1695668040 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:34.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.703+0000 7fa4e1e00640 1 --2- 172.21.15.12:0/1695668040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f6e9ef760 0x559f6e9f9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:34.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.703+0000 7fa4daa00640 1 -- 172.21.15.12:0/2783748306 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138066+0+0 (secure 0 0 0) 0x7fa4d0042070 con 0x7fa4e4102360 2024-09-05T01:25:34.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.704+0000 7fa4e2800640 1 -- 172.21.15.12:0/1695668040 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559f6e9fa020 msgr2=0x559f6e9fc410 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:25:34.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.704+0000 7fa4e2800640 1 --2- 172.21.15.12:0/1695668040 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559f6e9fa020 0x559f6e9fc410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.704+0000 7fa4e2800640 1 -- 172.21.15.12:0/1695668040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f6e9ef760 msgr2=0x559f6e9f9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.704+0000 7fa4e2800640 1 --2- 172.21.15.12:0/1695668040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f6e9ef760 0x559f6e9f9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.704+0000 7fa4e2800640 1 -- 172.21.15.12:0/1695668040 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f6e91bae0 con 0x559f6e9eee40 2024-09-05T01:25:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.704+0000 7fa4e1e00640 1 --2- 172.21.15.12:0/1695668040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f6e9ef760 0x559f6e9f9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:25:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.704+0000 7fa4e2800640 1 --2- 172.21.15.12:0/1695668040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9eee40 0x559f6e9ef220 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc009ea0 tx=0x7fa4dc009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=857b14ec914b666 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.705+0000 7fa4cf000640 1 -- 172.21.15.12:0/1695668040 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc004d20 con 0x559f6e9eee40 2024-09-05T01:25:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.705+0000 7fa4cf000640 1 -- 172.21.15.12:0/1695668040 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4dc00ee60 con 0x559f6e9eee40 2024-09-05T01:25:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.705+0000 7fa4cf000640 1 -- 172.21.15.12:0/1695668040 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc010840 con 0x559f6e9eee40 2024-09-05T01:25:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.705+0000 7fa4daa00640 1 --2- 172.21.15.12:0/2783748306 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fa4c80a2e90 0x7fa4c80a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.706+0000 7fa4eb638740 1 -- 172.21.15.12:0/1695668040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9eee40 msgr2=0x559f6e9ef220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.706+0000 7fa4eb638740 1 --2- 172.21.15.12:0/1695668040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9eee40 0x559f6e9ef220 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc009ea0 tx=0x7fa4dc009f90 comp rx=0 tx=0).stop 2024-09-05T01:25:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.706+0000 7fa4daa00640 1 -- 172.21.15.12:0/2783748306 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fa4d00efa20 con 0x7fa4e4102360 2024-09-05T01:25:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.706+0000 7fa4e1e00640 1 --2- 172.21.15.12:0/2783748306 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fa4c80a2e90 0x7fa4c80a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.706+0000 7fa4eb638740 1 -- 172.21.15.12:0/1695668040 shutdown_connections 2024-09-05T01:25:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.706+0000 7fa4eb638740 1 --2- 172.21.15.12:0/1695668040 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559f6e9fa020 0x559f6e9fc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.706+0000 7fa4eb638740 1 --2- 172.21.15.12:0/1695668040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f6e9ef760 0x559f6e9f9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.706+0000 7fa4eb638740 1 --2- 172.21.15.12:0/1695668040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9eee40 0x559f6e9ef220 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.706+0000 7fa4eb638740 1 -- 172.21.15.12:0/1695668040 >> 172.21.15.12:0/1695668040 conn(0x559f6e9eb3d0 msgr2=0x559f6e9eb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.706+0000 7fa4eb638740 1 -- 172.21.15.12:0/1695668040 shutdown_connections 2024-09-05T01:25:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.706+0000 7fa4eb638740 1 -- 172.21.15.12:0/1695668040 wait complete. 2024-09-05T01:25:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.707+0000 7fa4eb638740 1 -- start start 2024-09-05T01:25:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.707+0000 7fa4eb638740 1 Processor -- start 2024-09-05T01:25:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.708+0000 7fa4e1e00640 1 --2- 172.21.15.12:0/2783748306 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fa4c80a2e90 0x7fa4c80a5350 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x559f6e9ec230 tx=0x7fa4d4005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.708+0000 7fa4eb638740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559f6e9eee40 0x559f6e9f6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.708+0000 7fa4eb638740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9ef760 0x559f6e9f7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.708+0000 7fa4eb638740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f6e9fa020 0x559f6e9f79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.708+0000 7fa4eb638740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559f6e9fcbf0 con 0x559f6e9fa020 2024-09-05T01:25:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.708+0000 7fa4eb638740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x559f6e9100f0 con 0x559f6e9eee40 2024-09-05T01:25:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.708+0000 7fa4eb638740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559f6e9fcd70 con 0x559f6e9ef760 2024-09-05T01:25:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.708+0000 7fa4eb638740 10 client.0 _ll_register_callbacks cb 0x559f6e8f7bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.708+0000 7fa4e1400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9ef760 0x559f6e9f7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.708+0000 7fa4e1400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9ef760 0x559f6e9f7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:49360/0 (socket says 172.21.15.12:49360) 2024-09-05T01:25:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.708+0000 7fa4e1400640 1 -- 172.21.15.12:0/261018013 learned_addr learned my addr 172.21.15.12:0/261018013 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.708+0000 7fa4e1e00640 1 --2- 172.21.15.12:0/261018013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559f6e9eee40 0x559f6e9f6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.708+0000 7fa4e2800640 1 --2- 172.21.15.12:0/261018013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f6e9fa020 0x559f6e9f79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.709+0000 7fa4e1400640 1 -- 172.21.15.12:0/261018013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559f6e9eee40 msgr2=0x559f6e9f6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.709+0000 7fa4e1400640 1 --2- 172.21.15.12:0/261018013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559f6e9eee40 0x559f6e9f6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.709+0000 7fa4e1400640 1 -- 172.21.15.12:0/261018013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f6e9fa020 msgr2=0x559f6e9f79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.709+0000 7fa4e1400640 1 --2- 172.21.15.12:0/261018013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f6e9fa020 0x559f6e9f79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.709+0000 7fa4e1400640 1 -- 172.21.15.12:0/261018013 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f6e6c63c0 con 0x559f6e9ef760 2024-09-05T01:25:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.709+0000 7fa4e1400640 1 --2- 172.21.15.12:0/261018013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9ef760 0x559f6e9f7480 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00bbab0 tx=0x7fa4d0031490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b64aa6ace4e0f9f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.709+0000 7fa4c3400640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:25:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.710+0000 7fa4c3400640 1 -- 172.21.15.12:0/261018013 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0049050 con 0x559f6e9ef760 2024-09-05T01:25:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.710+0000 7fa4eb638740 1 -- 172.21.15.12:0/261018013 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4dc00ee60 con 0x559f6e9ef760 2024-09-05T01:25:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.710+0000 7fa4c3400640 1 -- 172.21.15.12:0/261018013 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fa4d00c4590 con 0x559f6e9ef760 2024-09-05T01:25:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.710+0000 7fa4c3400640 1 -- 172.21.15.12:0/261018013 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa4d00bb710 con 0x559f6e9ef760 2024-09-05T01:25:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.710+0000 7fa4eb638740 10 client.25408 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:34.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.710+0000 7fa4eb638740 1 -- 172.21.15.12:0/261018013 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559f6e9fcca0 con 0x559f6e9ef760 2024-09-05T01:25:34.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.710+0000 7fa4c3400640 1 -- 172.21.15.12:0/261018013 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4dc00ee60 con 0x559f6e9ef760 2024-09-05T01:25:34.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.711+0000 7fa4c3400640 1 -- 172.21.15.12:0/261018013 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa4d00a6070 con 0x559f6e9ef760 2024-09-05T01:25:34.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.711+0000 7fa4eb638740 10 client.25408 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:34.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.711+0000 7fa4eb638740 10 client.25408 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T01:25:34.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.711+0000 7fa4eb638740 20 client.25408 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:34.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.711+0000 7fa4eb638740 1 --2- 172.21.15.12:0/261018013 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x559f6ea0a090 0x559f6ea0c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:34.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.711+0000 7fa4eb638740 4 client.25408 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:25:34.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.711+0000 7fa4eb638740 1 -- 172.21.15.12:0/261018013 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f6e962950 con 0x559f6ea0a090 2024-09-05T01:25:34.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.711+0000 7fa4e1e00640 1 --2- 172.21.15.12:0/261018013 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x559f6ea0a090 0x559f6ea0c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:34.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.712+0000 7fa4e1e00640 1 --2- 172.21.15.12:0/261018013 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x559f6ea0a090 0x559f6ea0c480 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=89ec0a61a78d3db3 server_cookie=605a1765f4055eea in_seq=0 out_seq=0 2024-09-05T01:25:34.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.712+0000 7fa4c3400640 10 client.25408 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:25:34.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.713+0000 7fa4c3400640 1 -- 172.21.15.12:0/261018013 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f6e962950 con 0x559f6ea0a090 2024-09-05T01:25:34.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.713+0000 7fa4c3400640 10 client.25408 handle_command_reply: tid=0 2024-09-05T01:25:34.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.713+0000 7fa4eb638740 1 client.25408 shutdown 2024-09-05T01:25:34.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.713+0000 7fa4eb638740 1 -- 172.21.15.12:0/261018013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9ef760 msgr2=0x559f6e9f7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:34.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.713+0000 7fa4eb638740 1 --2- 172.21.15.12:0/261018013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9ef760 0x559f6e9f7480 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00bbab0 tx=0x7fa4d0031490 comp rx=0 tx=0).stop 2024-09-05T01:25:34.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.713+0000 7fa4eb638740 1 -- 172.21.15.12:0/261018013 shutdown_connections 2024-09-05T01:25:34.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.713+0000 7fa4eb638740 1 --2- 172.21.15.12:0/261018013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f6e9fa020 0x559f6e9f79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.713+0000 7fa4eb638740 1 --2- 172.21.15.12:0/261018013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9ef760 0x559f6e9f7480 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.713+0000 7fa4eb638740 1 --2- 172.21.15.12:0/261018013 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x559f6ea0a090 0x559f6ea0c480 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.713+0000 7fa4eb638740 1 --2- 172.21.15.12:0/261018013 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559f6e9eee40 0x559f6e9f6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.713+0000 7fa4eb638740 1 -- 172.21.15.12:0/261018013 >> 172.21.15.12:0/261018013 conn(0x559f6e9eb3d0 msgr2=0x559f6e9f1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:34.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.713+0000 7fa4c3400640 0 client.25408 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:25:34.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.714+0000 7fa4eb638740 1 -- 172.21.15.12:0/261018013 shutdown_connections 2024-09-05T01:25:34.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.714+0000 7fa4eb638740 1 -- 172.21.15.12:0/261018013 wait complete. 2024-09-05T01:25:34.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.714+0000 7fa4eb638740 20 client.25408 trim_cache size 0 max 16384 2024-09-05T01:25:34.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.728+0000 7fa4eb638740 1 Processor -- start 2024-09-05T01:25:34.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.728+0000 7fa4eb638740 1 -- start start 2024-09-05T01:25:34.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.729+0000 7fa4eb638740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559f6e9eee40 0x559f6e9eb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:34.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.729+0000 7fa4eb638740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f6e9ef760 0x559f6e9f8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:34.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.729+0000 7fa4eb638740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9fa020 0x559f6ea11ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:34.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.729+0000 7fa4eb638740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e41b3d90 con 0x559f6e9ef760 2024-09-05T01:25:34.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.729+0000 7fa4eb638740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e41b58d0 con 0x559f6e9eee40 2024-09-05T01:25:34.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.729+0000 7fa4eb638740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e41b4460 con 0x559f6e9fa020 2024-09-05T01:25:34.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.729+0000 7fa4e2800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9fa020 0x559f6ea11ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:34.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.729+0000 7fa4e2800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9fa020 0x559f6ea11ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:49372/0 (socket says 172.21.15.12:49372) 2024-09-05T01:25:34.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.729+0000 7fa4e2800640 1 -- 172.21.15.12:0/2948819973 learned_addr learned my addr 172.21.15.12:0/2948819973 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:34.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.729+0000 7fa4e1e00640 1 --2- 172.21.15.12:0/2948819973 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559f6e9eee40 0x559f6e9eb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:34.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.730+0000 7fa4e1400640 1 --2- 172.21.15.12:0/2948819973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f6e9ef760 0x559f6e9f8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:34.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.730+0000 7fa4e2800640 1 -- 172.21.15.12:0/2948819973 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559f6e9eee40 msgr2=0x559f6e9eb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:34.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.730+0000 7fa4e2800640 1 --2- 172.21.15.12:0/2948819973 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559f6e9eee40 0x559f6e9eb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.730+0000 7fa4e2800640 1 -- 172.21.15.12:0/2948819973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f6e9ef760 msgr2=0x559f6e9f8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:34.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.730+0000 7fa4e2800640 1 --2- 172.21.15.12:0/2948819973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f6e9ef760 0x559f6e9f8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.730+0000 7fa4e2800640 1 -- 172.21.15.12:0/2948819973 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f6e9f5f10 con 0x559f6e9fa020 2024-09-05T01:25:34.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.730+0000 7fa4e1400640 1 --2- 172.21.15.12:0/2948819973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f6e9ef760 0x559f6e9f8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:25:34.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.730+0000 7fa4e2800640 1 --2- 172.21.15.12:0/2948819973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9fa020 0x559f6ea11ce0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc009b50 tx=0x7fa4dc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2628ad5c5878db08 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:34.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.731+0000 7fa4ce600640 1 -- 172.21.15.12:0/2948819973 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc026030 con 0x559f6e9fa020 2024-09-05T01:25:34.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.731+0000 7fa4ce600640 1 -- 172.21.15.12:0/2948819973 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4dc003e50 con 0x559f6e9fa020 2024-09-05T01:25:34.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.731+0000 7fa4ce600640 1 -- 172.21.15.12:0/2948819973 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc022470 con 0x559f6e9fa020 2024-09-05T01:25:34.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.732+0000 7fa4eb638740 1 -- 172.21.15.12:0/2948819973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9fa020 msgr2=0x559f6ea11ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:34.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.732+0000 7fa4eb638740 1 --2- 172.21.15.12:0/2948819973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9fa020 0x559f6ea11ce0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc009b50 tx=0x7fa4dc004a40 comp rx=0 tx=0).stop 2024-09-05T01:25:34.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.732+0000 7fa4eb638740 1 -- 172.21.15.12:0/2948819973 shutdown_connections 2024-09-05T01:25:34.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.732+0000 7fa4eb638740 1 --2- 172.21.15.12:0/2948819973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9fa020 0x559f6ea11ce0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.732+0000 7fa4eb638740 1 --2- 172.21.15.12:0/2948819973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f6e9ef760 0x559f6e9f8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.732+0000 7fa4eb638740 1 --2- 172.21.15.12:0/2948819973 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559f6e9eee40 0x559f6e9eb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.732+0000 7fa4eb638740 1 -- 172.21.15.12:0/2948819973 >> 172.21.15.12:0/2948819973 conn(0x559f6e9eb3d0 msgr2=0x559f6e9f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:34.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.732+0000 7fa4eb638740 1 -- 172.21.15.12:0/2948819973 shutdown_connections 2024-09-05T01:25:34.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.732+0000 7fa4eb638740 1 -- 172.21.15.12:0/2948819973 wait complete. 2024-09-05T01:25:34.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.732+0000 7fa4eb638740 1 -- start start 2024-09-05T01:25:34.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.733+0000 7fa4eb638740 1 Processor -- start 2024-09-05T01:25:34.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.733+0000 7fa4eb638740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559f6e9eee40 0x559f6ea02610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:34.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.733+0000 7fa4eb638740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9ef760 0x559f6e9fd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:34.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.733+0000 7fa4eb638740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f6e9fa020 0x559f6e9fdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:34.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.733+0000 7fa4eb638740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e41b5200 con 0x559f6e9fa020 2024-09-05T01:25:34.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.733+0000 7fa4eb638740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e41b4b30 con 0x559f6e9eee40 2024-09-05T01:25:34.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.733+0000 7fa4eb638740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e41b1d70 con 0x559f6e9ef760 2024-09-05T01:25:34.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.733+0000 7fa4eb638740 10 client.0 _ll_register_callbacks cb 0x7fa4d0009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:34.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.734+0000 7fa4e1e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559f6e9eee40 0x559f6ea02610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:34.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.734+0000 7fa4e1e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559f6e9eee40 0x559f6ea02610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:35024/0 (socket says 172.21.15.12:35024) 2024-09-05T01:25:34.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.734+0000 7fa4e1e00640 1 -- 172.21.15.12:0/3659589232 learned_addr learned my addr 172.21.15.12:0/3659589232 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:34.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.734+0000 7fa4e2800640 1 --2- 172.21.15.12:0/3659589232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f6e9fa020 0x559f6e9fdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:34.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.734+0000 7fa4e1400640 1 --2- 172.21.15.12:0/3659589232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9ef760 0x559f6e9fd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:34.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.734+0000 7fa4e1e00640 1 -- 172.21.15.12:0/3659589232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9ef760 msgr2=0x559f6e9fd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:34.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.734+0000 7fa4e1e00640 1 --2- 172.21.15.12:0/3659589232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9ef760 0x559f6e9fd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.734+0000 7fa4e1e00640 1 -- 172.21.15.12:0/3659589232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f6e9fa020 msgr2=0x559f6e9fdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:34.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.734+0000 7fa4e1e00640 1 --2- 172.21.15.12:0/3659589232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f6e9fa020 0x559f6e9fdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.734+0000 7fa4e1e00640 1 -- 172.21.15.12:0/3659589232 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f6e9fe750 con 0x559f6e9eee40 2024-09-05T01:25:34.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.735+0000 7fa4e1e00640 1 --2- 172.21.15.12:0/3659589232 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559f6e9eee40 0x559f6ea02610 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4009a20 tx=0x7fa4d4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9d325f7237919c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:34.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.735+0000 7fa4c3400640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:25:34.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.735+0000 7fa4c3400640 1 -- 172.21.15.12:0/3659589232 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d4004390 con 0x559f6e9eee40 2024-09-05T01:25:34.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.735+0000 7fa4eb638740 1 -- 172.21.15.12:0/3659589232 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4dc003e50 con 0x559f6e9eee40 2024-09-05T01:25:34.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.735+0000 7fa4c3400640 1 -- 172.21.15.12:0/3659589232 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fa4d4003ac0 con 0x559f6e9eee40 2024-09-05T01:25:34.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.735+0000 7fa4c3400640 1 -- 172.21.15.12:0/3659589232 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa4d403c050 con 0x559f6e9eee40 2024-09-05T01:25:34.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.736+0000 7fa4eb638740 10 client.25403 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:34.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.736+0000 7fa4eb638740 1 -- 172.21.15.12:0/3659589232 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559f6ea74c10 con 0x559f6e9eee40 2024-09-05T01:25:34.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.736+0000 7fa4c3400640 1 -- 172.21.15.12:0/3659589232 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4dc003e50 con 0x559f6e9eee40 2024-09-05T01:25:34.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.736+0000 7fa4c3400640 1 -- 172.21.15.12:0/3659589232 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa4d4021410 con 0x559f6e9eee40 2024-09-05T01:25:34.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.736+0000 7fa4eb638740 10 client.25403 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:34.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.736+0000 7fa4eb638740 10 client.25403 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T01:25:34.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.736+0000 7fa4eb638740 20 client.25403 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:34.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.736+0000 7fa4eb638740 1 --2- 172.21.15.12:0/3659589232 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x559f6ea75390 0x559f6ea777b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:34.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.736+0000 7fa4eb638740 4 client.25403 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:25:34.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.736+0000 7fa4eb638740 1 -- 172.21.15.12:0/3659589232 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559f6e95ce60 con 0x559f6ea75390 2024-09-05T01:25:34.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.737+0000 7fa4e1400640 1 --2- 172.21.15.12:0/3659589232 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x559f6ea75390 0x559f6ea777b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:34.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.738+0000 7fa4e1400640 1 --2- 172.21.15.12:0/3659589232 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x559f6ea75390 0x559f6ea777b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=54c4e30dc11b2999 server_cookie=62b883dc74d15f19 in_seq=0 out_seq=0 2024-09-05T01:25:34.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.738+0000 7fa4c3400640 10 client.25403 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:25:34.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.738+0000 7fa4c3400640 1 -- 172.21.15.12:0/3659589232 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559f6e95ce60 con 0x559f6ea75390 2024-09-05T01:25:34.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.738+0000 7fa4c3400640 10 client.25403 handle_command_reply: tid=0 2024-09-05T01:25:34.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.738+0000 7fa4eb638740 1 client.25403 shutdown 2024-09-05T01:25:34.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.738+0000 7fa4eb638740 1 -- 172.21.15.12:0/3659589232 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559f6e9eee40 msgr2=0x559f6ea02610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:34.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.738+0000 7fa4eb638740 1 --2- 172.21.15.12:0/3659589232 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559f6e9eee40 0x559f6ea02610 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4009a20 tx=0x7fa4d4004730 comp rx=0 tx=0).stop 2024-09-05T01:25:34.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.738+0000 7fa4eb638740 1 -- 172.21.15.12:0/3659589232 shutdown_connections 2024-09-05T01:25:34.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.738+0000 7fa4eb638740 1 --2- 172.21.15.12:0/3659589232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f6e9fa020 0x559f6e9fdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.738+0000 7fa4eb638740 1 --2- 172.21.15.12:0/3659589232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6e9ef760 0x559f6e9fd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.738+0000 7fa4eb638740 1 --2- 172.21.15.12:0/3659589232 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x559f6ea75390 0x559f6ea777b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.739+0000 7fa4eb638740 1 --2- 172.21.15.12:0/3659589232 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559f6e9eee40 0x559f6ea02610 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.739+0000 7fa4eb638740 1 -- 172.21.15.12:0/3659589232 >> 172.21.15.12:0/3659589232 conn(0x559f6e9eb3d0 msgr2=0x559f6e9f1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:34.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.739+0000 7fa4c3400640 0 client.25403 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:25:34.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.740+0000 7fa4eb638740 1 -- 172.21.15.12:0/3659589232 shutdown_connections 2024-09-05T01:25:34.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.740+0000 7fa4eb638740 1 -- 172.21.15.12:0/3659589232 wait complete. 2024-09-05T01:25:34.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.740+0000 7fa4eb638740 20 client.25403 trim_cache size 0 max 16384 2024-09-05T01:25:34.742 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:25:34.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.741+0000 7fa4e3200640 1 -- 172.21.15.12:0/2783748306 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fa4c80a2e90 msgr2=0x7fa4c80a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:34.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.741+0000 7fa4e3200640 1 --2- 172.21.15.12:0/2783748306 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fa4c80a2e90 0x7fa4c80a5350 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x559f6e9ec230 tx=0x7fa4d4005f90 comp rx=0 tx=0).stop 2024-09-05T01:25:34.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.741+0000 7fa4e3200640 1 -- 172.21.15.12:0/2783748306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4e4102360 msgr2=0x7fa4e410e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:34.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.741+0000 7fa4e3200640 1 --2- 172.21.15.12:0/2783748306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4e4102360 0x7fa4e410e0f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa4d002a940 tx=0x7fa4d0003b20 comp rx=0 tx=0).stop 2024-09-05T01:25:34.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.741+0000 7fa4e3200640 1 -- 172.21.15.12:0/2783748306 shutdown_connections 2024-09-05T01:25:34.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.741+0000 7fa4e3200640 1 --2- 172.21.15.12:0/2783748306 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fa4c80a2e90 0x7fa4c80a5350 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.741+0000 7fa4e3200640 1 --2- 172.21.15.12:0/2783748306 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa4e41079c0 0x7fa4e41a3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.741+0000 7fa4e3200640 1 --2- 172.21.15.12:0/2783748306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4e4102360 0x7fa4e410e0f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.741+0000 7fa4e3200640 1 --2- 172.21.15.12:0/2783748306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4e41019c0 0x7fa4e410dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:34.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.741+0000 7fa4e3200640 1 -- 172.21.15.12:0/2783748306 >> 172.21.15.12:0/2783748306 conn(0x7fa4e40fd740 msgr2=0x7fa4e4074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:34.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.742+0000 7fa4e3200640 1 -- 172.21.15.12:0/2783748306 shutdown_connections 2024-09-05T01:25:34.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:34.742+0000 7fa4e3200640 1 -- 172.21.15.12:0/2783748306 wait complete. 2024-09-05T01:25:35.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:34 smithi012 ceph-mon[29942]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-05T01:25:35.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:34 smithi145 ceph-mon[34376]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-05T01:25:35.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:34 smithi151 ceph-mon[35013]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-05T01:25:35.578 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-05T01:25:36.058 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:25:36.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.708+0000 7feae7200640 1 -- 172.21.15.12:0/1937966379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feae810e280 msgr2=0x7feae8110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:36.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.708+0000 7feae7200640 1 --2- 172.21.15.12:0/1937966379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feae810e280 0x7feae8110670 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7feae0009ca0 tx=0x7feae002a950 comp rx=0 tx=0).stop 2024-09-05T01:25:36.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.708+0000 7feae7200640 1 -- 172.21.15.12:0/1937966379 shutdown_connections 2024-09-05T01:25:36.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.708+0000 7feae7200640 1 --2- 172.21.15.12:0/1937966379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feae810e280 0x7feae8110670 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.708+0000 7feae7200640 1 --2- 172.21.15.12:0/1937966379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feae8074e30 0x7feae810dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.708+0000 7feae7200640 1 --2- 172.21.15.12:0/1937966379 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feae8074510 0x7feae80748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.708+0000 7feae7200640 1 -- 172.21.15.12:0/1937966379 >> 172.21.15.12:0/1937966379 conn(0x7feae80fd740 msgr2=0x7feae80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:36.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.709+0000 7feae7200640 1 -- 172.21.15.12:0/1937966379 shutdown_connections 2024-09-05T01:25:36.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.710+0000 7feae7200640 1 -- 172.21.15.12:0/1937966379 wait complete. 2024-09-05T01:25:36.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.711+0000 7feae7200640 1 Processor -- start 2024-09-05T01:25:36.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.711+0000 7feae7200640 1 -- start start 2024-09-05T01:25:36.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.712+0000 7feae7200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feae8074510 0x7feae819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:36.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.712+0000 7feae7200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feae8074e30 0x7feae819a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:36.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.712+0000 7feae7200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feae810e280 0x7feae819ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:36.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.712+0000 7feae7200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7feae8114000 con 0x7feae8074e30 2024-09-05T01:25:36.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.712+0000 7feae7200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7feae8113e80 con 0x7feae8074510 2024-09-05T01:25:36.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.712+0000 7feae7200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7feae8114180 con 0x7feae810e280 2024-09-05T01:25:36.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.712+0000 7feae5400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feae8074e30 0x7feae819a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:36.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.712+0000 7feae5400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feae8074e30 0x7feae819a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56384/0 (socket says 172.21.15.12:56384) 2024-09-05T01:25:36.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.712+0000 7feae5400640 1 -- 172.21.15.12:0/1495134458 learned_addr learned my addr 172.21.15.12:0/1495134458 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:36.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.713+0000 7feae6800640 1 --2- 172.21.15.12:0/1495134458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feae810e280 0x7feae819ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:36.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.713+0000 7feae5400640 1 -- 172.21.15.12:0/1495134458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feae810e280 msgr2=0x7feae819ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:36.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.713+0000 7feae5400640 1 --2- 172.21.15.12:0/1495134458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feae810e280 0x7feae819ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.713+0000 7feae5400640 1 -- 172.21.15.12:0/1495134458 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feae8074510 msgr2=0x7feae819a440 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-05T01:25:36.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.713+0000 7feae5400640 1 --2- 172.21.15.12:0/1495134458 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feae8074510 0x7feae819a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.713+0000 7feae5400640 1 -- 172.21.15.12:0/1495134458 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae819f3f0 con 0x7feae8074e30 2024-09-05T01:25:36.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.713+0000 7feae6800640 1 --2- 172.21.15.12:0/1495134458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feae810e280 0x7feae819ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:25:36.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.713+0000 7feae5400640 1 --2- 172.21.15.12:0/1495134458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feae8074e30 0x7feae819a980 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fead400e9f0 tx=0x7fead400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:36.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.714+0000 7feadea00640 1 -- 172.21.15.12:0/1495134458 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead400cd80 con 0x7feae8074e30 2024-09-05T01:25:36.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.714+0000 7feadea00640 1 -- 172.21.15.12:0/1495134458 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fead4010910 con 0x7feae8074e30 2024-09-05T01:25:36.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.714+0000 7feae7200640 1 -- 172.21.15.12:0/1495134458 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feae819f6e0 con 0x7feae8074e30 2024-09-05T01:25:36.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.714+0000 7feadea00640 1 -- 172.21.15.12:0/1495134458 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead4018980 con 0x7feae8074e30 2024-09-05T01:25:36.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.714+0000 7feae7200640 1 -- 172.21.15.12:0/1495134458 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feae81a6fc0 con 0x7feae8074e30 2024-09-05T01:25:36.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.719+0000 7feaefcda740 1 Processor -- start 2024-09-05T01:25:36.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.720+0000 7feaefcda740 1 -- start start 2024-09-05T01:25:36.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.720+0000 7feadea00640 1 -- 172.21.15.12:0/1495134458 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) ==== 138066+0+0 (secure 0 0 0) 0x7fead4010ac0 con 0x7feae8074e30 2024-09-05T01:25:36.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.720+0000 7feaefcda740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f6915de40 0x557f6915e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:36.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.720+0000 7feaefcda740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f6915e760 0x557f69168ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:36.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.720+0000 7feaefcda740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f69169020 0x557f6916b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:36.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.720+0000 7feaefcda740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557f690c43e0 con 0x557f69169020 2024-09-05T01:25:36.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.720+0000 7feaefcda740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x557f6906bd80 con 0x557f6915de40 2024-09-05T01:25:36.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.720+0000 7feaefcda740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557f690c03a0 con 0x557f6915e760 2024-09-05T01:25:36.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.721+0000 7feae5e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f6915e760 0x557f69168ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:36.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.721+0000 7feae5e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f6915e760 0x557f69168ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:49404/0 (socket says 172.21.15.12:49404) 2024-09-05T01:25:36.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.721+0000 7feae5e00640 1 -- 172.21.15.12:0/3573384709 learned_addr learned my addr 172.21.15.12:0/3573384709 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:36.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.721+0000 7feae6800640 1 --2- 172.21.15.12:0/3573384709 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f6915de40 0x557f6915e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:36.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.721+0000 7feae5400640 1 --2- 172.21.15.12:0/3573384709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f69169020 0x557f6916b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:36.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.722+0000 7feae5400640 1 -- 172.21.15.12:0/3573384709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f6915e760 msgr2=0x557f69168ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:36.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.722+0000 7feae5400640 1 --2- 172.21.15.12:0/3573384709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f6915e760 0x557f69168ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.722+0000 7feae5400640 1 -- 172.21.15.12:0/3573384709 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f6915de40 msgr2=0x557f6915e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:36.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.722+0000 7feae5400640 1 --2- 172.21.15.12:0/3573384709 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f6915de40 0x557f6915e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.722+0000 7feae5400640 1 -- 172.21.15.12:0/3573384709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f6908aae0 con 0x557f69169020 2024-09-05T01:25:36.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.722+0000 7feae5e00640 1 --2- 172.21.15.12:0/3573384709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f6915e760 0x557f69168ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:25:36.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.722+0000 7feae6800640 1 --2- 172.21.15.12:0/3573384709 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f6915de40 0x557f6915e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:25:36.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.722+0000 7feae5400640 1 --2- 172.21.15.12:0/3573384709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f69169020 0x557f6916b410 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fead40cd0f0 tx=0x7fead40d8630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba46b7f208bbc8d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:36.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.723+0000 7feadea00640 1 --2- 172.21.15.12:0/1495134458 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7feacc0a2e90 0x7feacc0a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:36.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.723+0000 7feadea00640 1 -- 172.21.15.12:0/1495134458 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fead40cfb90 con 0x7feae8074e30 2024-09-05T01:25:36.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.723+0000 7fead3400640 1 -- 172.21.15.12:0/3573384709 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead4098090 con 0x557f69169020 2024-09-05T01:25:36.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.723+0000 7fead3400640 1 -- 172.21.15.12:0/3573384709 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fead40e1070 con 0x557f69169020 2024-09-05T01:25:36.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.723+0000 7fead3400640 1 -- 172.21.15.12:0/3573384709 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead409b750 con 0x557f69169020 2024-09-05T01:25:36.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.724+0000 7feae6800640 1 --2- 172.21.15.12:0/1495134458 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7feacc0a2e90 0x7feacc0a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:36.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.724+0000 7feaefcda740 1 -- 172.21.15.12:0/3573384709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f69169020 msgr2=0x557f6916b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:36.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.724+0000 7feaefcda740 1 --2- 172.21.15.12:0/3573384709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f69169020 0x557f6916b410 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fead40cd0f0 tx=0x7fead40d8630 comp rx=0 tx=0).stop 2024-09-05T01:25:36.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.726+0000 7feae6800640 1 --2- 172.21.15.12:0/1495134458 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7feacc0a2e90 0x7feacc0a5350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feae0009430 tx=0x7feae003c040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:36.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.726+0000 7feaefcda740 1 -- 172.21.15.12:0/3573384709 shutdown_connections 2024-09-05T01:25:36.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.726+0000 7feaefcda740 1 --2- 172.21.15.12:0/3573384709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f69169020 0x557f6916b410 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.726+0000 7feaefcda740 1 --2- 172.21.15.12:0/3573384709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f6915e760 0x557f69168ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.726+0000 7feaefcda740 1 --2- 172.21.15.12:0/3573384709 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f6915de40 0x557f6915e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.726+0000 7feaefcda740 1 -- 172.21.15.12:0/3573384709 >> 172.21.15.12:0/3573384709 conn(0x557f6915a3d0 msgr2=0x557f6915a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:36.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.726+0000 7feaefcda740 1 -- 172.21.15.12:0/3573384709 shutdown_connections 2024-09-05T01:25:36.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.726+0000 7feaefcda740 1 -- 172.21.15.12:0/3573384709 wait complete. 2024-09-05T01:25:36.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.726+0000 7feaefcda740 1 -- start start 2024-09-05T01:25:36.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.727+0000 7feaefcda740 1 Processor -- start 2024-09-05T01:25:36.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.727+0000 7feaefcda740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f6915de40 0x557f69165fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:36.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.727+0000 7feaefcda740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f6915e760 0x557f69166500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:36.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.728+0000 7feaefcda740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f69169020 0x557f69166a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:36.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.728+0000 7feaefcda740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557f6916bbf0 con 0x557f6915e760 2024-09-05T01:25:36.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.728+0000 7feaefcda740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x557f6907f0f0 con 0x557f69169020 2024-09-05T01:25:36.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.728+0000 7feaefcda740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557f6916bd70 con 0x557f6915de40 2024-09-05T01:25:36.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.728+0000 7feaefcda740 10 client.0 _ll_register_callbacks cb 0x557f69066bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:36.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.728+0000 7feae5e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f6915de40 0x557f69165fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:36.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.728+0000 7feae5e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f6915de40 0x557f69165fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:49418/0 (socket says 172.21.15.12:49418) 2024-09-05T01:25:36.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.728+0000 7feae5e00640 1 -- 172.21.15.12:0/2799215278 learned_addr learned my addr 172.21.15.12:0/2799215278 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:36.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.728+0000 7feae6800640 1 --2- 172.21.15.12:0/2799215278 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f69169020 0x557f69166a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:36.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.729+0000 7feae5400640 1 --2- 172.21.15.12:0/2799215278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f6915e760 0x557f69166500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:36.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.729+0000 7feae5e00640 1 -- 172.21.15.12:0/2799215278 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f69169020 msgr2=0x557f69166a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:36.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.729+0000 7feae5e00640 1 --2- 172.21.15.12:0/2799215278 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f69169020 0x557f69166a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.729+0000 7feae5e00640 1 -- 172.21.15.12:0/2799215278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f6915e760 msgr2=0x557f69166500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.729+0000 7feae5e00640 1 --2- 172.21.15.12:0/2799215278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f6915e760 0x557f69166500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.729+0000 7feae5e00640 1 -- 172.21.15.12:0/2799215278 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f68e353c0 con 0x557f6915de40 2024-09-05T01:25:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.729+0000 7feae5400640 1 --2- 172.21.15.12:0/2799215278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f6915e760 0x557f69166500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:25:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.729+0000 7feae5e00640 1 --2- 172.21.15.12:0/2799215278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f6915de40 0x557f69165fc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fead80116f0 tx=0x7fead8011bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9bb2a2896b0489f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.729+0000 7feac7e00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:25:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.730+0000 7feac7e00640 1 -- 172.21.15.12:0/2799215278 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead801e060 con 0x557f6915de40 2024-09-05T01:25:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.730+0000 7feaefcda740 1 -- 172.21.15.12:0/2799215278 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fead40e1070 con 0x557f6915de40 2024-09-05T01:25:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.730+0000 7feac7e00640 1 -- 172.21.15.12:0/2799215278 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fead800fd30 con 0x557f6915de40 2024-09-05T01:25:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.731+0000 7feac7e00640 1 -- 172.21.15.12:0/2799215278 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fead8019430 con 0x557f6915de40 2024-09-05T01:25:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.731+0000 7feaefcda740 10 client.25423 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.731+0000 7feaefcda740 1 -- 172.21.15.12:0/2799215278 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557f69180540 con 0x557f6915de40 2024-09-05T01:25:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.731+0000 7feac7e00640 1 -- 172.21.15.12:0/2799215278 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fead40e1070 con 0x557f6915de40 2024-09-05T01:25:36.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.731+0000 7feac7e00640 1 -- 172.21.15.12:0/2799215278 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fead8011ce0 con 0x557f6915de40 2024-09-05T01:25:36.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.732+0000 7feaefcda740 10 client.25423 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:36.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.732+0000 7feaefcda740 10 client.25423 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T01:25:36.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.732+0000 7feaefcda740 20 client.25423 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:36.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.732+0000 7feaefcda740 1 --2- 172.21.15.12:0/2799215278 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x557f69181a00 0x557f69183e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:36.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.732+0000 7feaefcda740 4 client.25423 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:25:36.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.732+0000 7feaefcda740 1 -- 172.21.15.12:0/2799215278 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f690d1950 con 0x557f69181a00 2024-09-05T01:25:36.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.732+0000 7feae5400640 1 --2- 172.21.15.12:0/2799215278 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x557f69181a00 0x557f69183e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:36.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.733+0000 7feae5400640 1 --2- 172.21.15.12:0/2799215278 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x557f69181a00 0x557f69183e30 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d6dacde6129fa35c server_cookie=794d81fb39ed09df in_seq=0 out_seq=0 2024-09-05T01:25:36.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.733+0000 7feac7e00640 10 client.25423 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:25:36.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.734+0000 7feac7e00640 1 -- 172.21.15.12:0/2799215278 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557f690d1950 con 0x557f69181a00 2024-09-05T01:25:36.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.734+0000 7feac7e00640 10 client.25423 handle_command_reply: tid=0 2024-09-05T01:25:36.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.734+0000 7feaefcda740 1 client.25423 shutdown 2024-09-05T01:25:36.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.734+0000 7feaefcda740 1 -- 172.21.15.12:0/2799215278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f6915de40 msgr2=0x557f69165fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:36.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.734+0000 7feaefcda740 1 --2- 172.21.15.12:0/2799215278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f6915de40 0x557f69165fc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fead80116f0 tx=0x7fead8011bb0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.734+0000 7feaefcda740 1 -- 172.21.15.12:0/2799215278 shutdown_connections 2024-09-05T01:25:36.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.734+0000 7feaefcda740 1 --2- 172.21.15.12:0/2799215278 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f69169020 0x557f69166a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.734+0000 7feaefcda740 1 --2- 172.21.15.12:0/2799215278 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x557f69181a00 0x557f69183e30 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.734+0000 7feaefcda740 1 --2- 172.21.15.12:0/2799215278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f6915e760 0x557f69166500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.734+0000 7feaefcda740 1 --2- 172.21.15.12:0/2799215278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f6915de40 0x557f69165fc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.734+0000 7feac7e00640 0 client.25423 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:25:36.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.735+0000 7feaefcda740 1 -- 172.21.15.12:0/2799215278 >> 172.21.15.12:0/2799215278 conn(0x557f6915a3d0 msgr2=0x557f691600b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:36.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.735+0000 7feaefcda740 1 -- 172.21.15.12:0/2799215278 shutdown_connections 2024-09-05T01:25:36.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.735+0000 7feaefcda740 1 -- 172.21.15.12:0/2799215278 wait complete. 2024-09-05T01:25:36.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.735+0000 7feaefcda740 20 client.25423 trim_cache size 0 max 16384 2024-09-05T01:25:36.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.765+0000 7feaefcda740 1 Processor -- start 2024-09-05T01:25:36.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.768+0000 7feaefcda740 1 -- start start 2024-09-05T01:25:36.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.768+0000 7feaefcda740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f6915de40 0x557f69155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:36.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.768+0000 7feaefcda740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f6915e760 0x557f69189700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:36.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.768+0000 7feaefcda740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f69169020 0x557f69189c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:36.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.769+0000 7feaefcda740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7feae81ab5e0 con 0x557f6915e760 2024-09-05T01:25:36.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.769+0000 7feaefcda740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7feae81ad120 con 0x557f6915de40 2024-09-05T01:25:36.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.769+0000 7feaefcda740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7feae81abcb0 con 0x557f69169020 2024-09-05T01:25:36.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.769+0000 7feae5e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f6915de40 0x557f69155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:36.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.769+0000 7feae5e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f6915de40 0x557f69155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:35072/0 (socket says 172.21.15.12:35072) 2024-09-05T01:25:36.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.769+0000 7feae5e00640 1 -- 172.21.15.12:0/3634336199 learned_addr learned my addr 172.21.15.12:0/3634336199 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:36.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.769+0000 7feae6800640 1 --2- 172.21.15.12:0/3634336199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f69169020 0x557f69189c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:36.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.769+0000 7feae5400640 1 --2- 172.21.15.12:0/3634336199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f6915e760 0x557f69189700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:36.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.770+0000 7feae5e00640 1 -- 172.21.15.12:0/3634336199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f69169020 msgr2=0x557f69189c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:36.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.770+0000 7feae5e00640 1 --2- 172.21.15.12:0/3634336199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f69169020 0x557f69189c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.770+0000 7feae5e00640 1 -- 172.21.15.12:0/3634336199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f6915e760 msgr2=0x557f69189700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:36.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.770+0000 7feae5e00640 1 --2- 172.21.15.12:0/3634336199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f6915e760 0x557f69189700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.770+0000 7feae5e00640 1 -- 172.21.15.12:0/3634336199 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f69164530 con 0x557f6915de40 2024-09-05T01:25:36.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.770+0000 7feae5e00640 1 --2- 172.21.15.12:0/3634336199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f6915de40 0x557f69155300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fead8009d80 tx=0x7fead8009db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f6071576be1f239 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:36.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.771+0000 7fead2a00640 1 -- 172.21.15.12:0/3634336199 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead8030070 con 0x557f6915de40 2024-09-05T01:25:36.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.771+0000 7fead2a00640 1 -- 172.21.15.12:0/3634336199 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fead8021580 con 0x557f6915de40 2024-09-05T01:25:36.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.771+0000 7fead2a00640 1 -- 172.21.15.12:0/3634336199 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead8019ad0 con 0x557f6915de40 2024-09-05T01:25:36.773 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:36 smithi012 ceph-mon[29942]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-05T01:25:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.772+0000 7feaefcda740 1 -- 172.21.15.12:0/3634336199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f6915de40 msgr2=0x557f69155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.772+0000 7feaefcda740 1 --2- 172.21.15.12:0/3634336199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f6915de40 0x557f69155300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fead8009d80 tx=0x7fead8009db0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.773+0000 7feaefcda740 1 -- 172.21.15.12:0/3634336199 shutdown_connections 2024-09-05T01:25:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.773+0000 7feaefcda740 1 --2- 172.21.15.12:0/3634336199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f69169020 0x557f69189c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.773+0000 7feaefcda740 1 --2- 172.21.15.12:0/3634336199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f6915e760 0x557f69189700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.773+0000 7feaefcda740 1 --2- 172.21.15.12:0/3634336199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f6915de40 0x557f69155300 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.773+0000 7feaefcda740 1 -- 172.21.15.12:0/3634336199 >> 172.21.15.12:0/3634336199 conn(0x557f6915a3d0 msgr2=0x557f691650d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.773+0000 7feaefcda740 1 -- 172.21.15.12:0/3634336199 shutdown_connections 2024-09-05T01:25:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.773+0000 7feaefcda740 1 -- 172.21.15.12:0/3634336199 wait complete. 2024-09-05T01:25:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.774+0000 7feaefcda740 1 -- start start 2024-09-05T01:25:36.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.774+0000 7feaefcda740 1 Processor -- start 2024-09-05T01:25:36.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.775+0000 7feaefcda740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f6915de40 0x557f69163160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:36.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.775+0000 7feaefcda740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f6915e760 0x557f691636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:36.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.776+0000 7feae5400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f6915e760 0x557f691636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.776+0000 7feae5400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f6915e760 0x557f691636a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:35088/0 (socket says 172.21.15.12:35088) 2024-09-05T01:25:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.775+0000 7feaefcda740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f69169020 0x557f69163be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.776+0000 7feaefcda740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7feae81aca50 con 0x557f69169020 2024-09-05T01:25:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.776+0000 7feaefcda740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7feae81ac380 con 0x557f6915e760 2024-09-05T01:25:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.776+0000 7feaefcda740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7feae81a95c0 con 0x557f6915de40 2024-09-05T01:25:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.776+0000 7feaefcda740 10 client.0 _ll_register_callbacks cb 0x7fead8009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:36.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.777+0000 7feae5400640 1 -- 172.21.15.12:0/2885469475 learned_addr learned my addr 172.21.15.12:0/2885469475 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.777+0000 7feae5e00640 1 --2- 172.21.15.12:0/2885469475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f6915de40 0x557f69163160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.777+0000 7feae5400640 1 -- 172.21.15.12:0/2885469475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f6915de40 msgr2=0x557f69163160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.777+0000 7feae5400640 1 --2- 172.21.15.12:0/2885469475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f6915de40 0x557f69163160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.777+0000 7feae5400640 1 -- 172.21.15.12:0/2885469475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f69169020 msgr2=0x557f69163be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:25:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.777+0000 7feae5400640 1 --2- 172.21.15.12:0/2885469475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f69169020 0x557f69163be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.777+0000 7feae5400640 1 -- 172.21.15.12:0/2885469475 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f691eb830 con 0x557f6915e760 2024-09-05T01:25:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.778+0000 7feae5400640 1 --2- 172.21.15.12:0/2885469475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f6915e760 0x557f691636a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fead4009380 tx=0x7fead4005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24d85c20ddafebfc server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.778+0000 7feac7e00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:25:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.779+0000 7feac7e00640 1 -- 172.21.15.12:0/2885469475 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead409f060 con 0x557f6915e760 2024-09-05T01:25:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.779+0000 7feac7e00640 1 -- 172.21.15.12:0/2885469475 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fead40d37e0 con 0x557f6915e760 2024-09-05T01:25:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.779+0000 7feaefcda740 1 -- 172.21.15.12:0/2885469475 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fead8021580 con 0x557f6915e760 2024-09-05T01:25:36.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.779+0000 7feac7e00640 1 -- 172.21.15.12:0/2885469475 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fead409b930 con 0x557f6915e760 2024-09-05T01:25:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.779+0000 7feaefcda740 10 client.25418 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:36.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.779+0000 7feaefcda740 1 -- 172.21.15.12:0/2885469475 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557f691ecb10 con 0x557f6915e760 2024-09-05T01:25:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.780+0000 7feac7e00640 1 -- 172.21.15.12:0/2885469475 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fead8021580 con 0x557f6915e760 2024-09-05T01:25:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.780+0000 7feac7e00640 1 -- 172.21.15.12:0/2885469475 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fead40d8d10 con 0x557f6915e760 2024-09-05T01:25:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.780+0000 7feaefcda740 10 client.25418 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.780+0000 7feaefcda740 10 client.25418 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T01:25:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.780+0000 7feaefcda740 20 client.25418 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.780+0000 7feaefcda740 1 --2- 172.21.15.12:0/2885469475 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x557f69181a00 0x557f691ef230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.780+0000 7feaefcda740 4 client.25418 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:25:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.780+0000 7feaefcda740 1 -- 172.21.15.12:0/2885469475 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557f690cbe60 con 0x557f69181a00 2024-09-05T01:25:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.781+0000 7feae5e00640 1 --2- 172.21.15.12:0/2885469475 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x557f69181a00 0x557f691ef230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.781+0000 7feac7e00640 10 client.25418 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:25:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.781+0000 7feae5e00640 1 --2- 172.21.15.12:0/2885469475 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x557f69181a00 0x557f691ef230 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3f3e88df48228c1 server_cookie=ae440a65b0ffb1c8 in_seq=0 out_seq=0 2024-09-05T01:25:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.782+0000 7feac7e00640 1 -- 172.21.15.12:0/2885469475 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557f690cbe60 con 0x557f69181a00 2024-09-05T01:25:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.782+0000 7feac7e00640 10 client.25418 handle_command_reply: tid=0 2024-09-05T01:25:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.782+0000 7feaefcda740 1 client.25418 shutdown 2024-09-05T01:25:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.782+0000 7feaefcda740 1 -- 172.21.15.12:0/2885469475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f6915e760 msgr2=0x557f691636a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.782+0000 7feaefcda740 1 --2- 172.21.15.12:0/2885469475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f6915e760 0x557f691636a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fead4009380 tx=0x7fead4005f10 comp rx=0 tx=0).stop 2024-09-05T01:25:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.783+0000 7feaefcda740 1 -- 172.21.15.12:0/2885469475 shutdown_connections 2024-09-05T01:25:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.783+0000 7feaefcda740 1 --2- 172.21.15.12:0/2885469475 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x557f69181a00 0x557f691ef230 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.783+0000 7feac7e00640 0 client.25418 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:25:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.783+0000 7feaefcda740 1 --2- 172.21.15.12:0/2885469475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f69169020 0x557f69163be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.783+0000 7feaefcda740 1 --2- 172.21.15.12:0/2885469475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557f6915e760 0x557f691636a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.783+0000 7feaefcda740 1 --2- 172.21.15.12:0/2885469475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f6915de40 0x557f69163160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.783+0000 7feaefcda740 1 -- 172.21.15.12:0/2885469475 >> 172.21.15.12:0/2885469475 conn(0x557f6915a3d0 msgr2=0x557f6915f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.784+0000 7feaefcda740 1 -- 172.21.15.12:0/2885469475 shutdown_connections 2024-09-05T01:25:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.784+0000 7feaefcda740 1 -- 172.21.15.12:0/2885469475 wait complete. 2024-09-05T01:25:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.784+0000 7feaefcda740 20 client.25418 trim_cache size 0 max 16384 2024-09-05T01:25:36.786 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:25:36.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.785+0000 7feae7200640 1 -- 172.21.15.12:0/1495134458 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7feacc0a2e90 msgr2=0x7feacc0a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:36.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.785+0000 7feae7200640 1 --2- 172.21.15.12:0/1495134458 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7feacc0a2e90 0x7feacc0a5350 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feae0009430 tx=0x7feae003c040 comp rx=0 tx=0).stop 2024-09-05T01:25:36.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.785+0000 7feae7200640 1 -- 172.21.15.12:0/1495134458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feae8074e30 msgr2=0x7feae819a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:36.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.785+0000 7feae7200640 1 --2- 172.21.15.12:0/1495134458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feae8074e30 0x7feae819a980 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fead400e9f0 tx=0x7fead400eeb0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.785+0000 7feae7200640 1 -- 172.21.15.12:0/1495134458 shutdown_connections 2024-09-05T01:25:36.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.785+0000 7feae7200640 1 --2- 172.21.15.12:0/1495134458 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7feacc0a2e90 0x7feacc0a5350 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.785+0000 7feae7200640 1 --2- 172.21.15.12:0/1495134458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feae810e280 0x7feae819ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.785+0000 7feae7200640 1 --2- 172.21.15.12:0/1495134458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feae8074e30 0x7feae819a980 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.785+0000 7feae7200640 1 --2- 172.21.15.12:0/1495134458 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feae8074510 0x7feae819a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:36.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.785+0000 7feae7200640 1 -- 172.21.15.12:0/1495134458 >> 172.21.15.12:0/1495134458 conn(0x7feae80fd740 msgr2=0x7feae80fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:36.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.786+0000 7feae7200640 1 -- 172.21.15.12:0/1495134458 shutdown_connections 2024-09-05T01:25:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:36.786+0000 7feae7200640 1 -- 172.21.15.12:0/1495134458 wait complete. 2024-09-05T01:25:37.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:36 smithi145 ceph-mon[34376]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-05T01:25:37.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:36 smithi151 ceph-mon[35013]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-05T01:25:37.624 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-05T01:25:38.068 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:25:38.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.674+0000 7f5cf6a00640 1 -- 172.21.15.12:0/2408910540 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cf0100720 msgr2=0x7f5cf0100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:38.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.674+0000 7f5cf6a00640 1 --2- 172.21.15.12:0/2408910540 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cf0100720 0x7f5cf0100b00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc009900 tx=0x7f5cdc02a3f0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.674+0000 7f5cf6a00640 1 -- 172.21.15.12:0/2408910540 shutdown_connections 2024-09-05T01:25:38.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.674+0000 7f5cf6a00640 1 --2- 172.21.15.12:0/2408910540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cf010e2d0 0x7f5cf01106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.674+0000 7f5cf6a00640 1 --2- 172.21.15.12:0/2408910540 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cf01010d0 0x7f5cf010dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.674+0000 7f5cf6a00640 1 --2- 172.21.15.12:0/2408910540 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cf0100720 0x7f5cf0100b00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.674+0000 7f5cf6a00640 1 -- 172.21.15.12:0/2408910540 >> 172.21.15.12:0/2408910540 conn(0x7f5cf00fc610 msgr2=0x7f5cf00fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.675+0000 7f5cf6a00640 1 -- 172.21.15.12:0/2408910540 shutdown_connections 2024-09-05T01:25:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.675+0000 7f5cf6a00640 1 -- 172.21.15.12:0/2408910540 wait complete. 2024-09-05T01:25:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.676+0000 7f5cf6a00640 1 Processor -- start 2024-09-05T01:25:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.676+0000 7f5cf6a00640 1 -- start start 2024-09-05T01:25:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.677+0000 7f5cf6a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cf0100720 0x7f5cf010dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.677+0000 7f5cf6a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cf01010d0 0x7f5cf010aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.677+0000 7f5cf5600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cf0100720 0x7f5cf010dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.677+0000 7f5cf6a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cf010e2d0 0x7f5cf010b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.677+0000 7f5cf6a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf0113ff0 con 0x7f5cf01010d0 2024-09-05T01:25:38.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.677+0000 7f5cf5600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cf0100720 0x7f5cf010dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:43308/0 (socket says 172.21.15.12:43308) 2024-09-05T01:25:38.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.677+0000 7f5cf6a00640 1 -- 172.21.15.12:0/3228360025 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf0113e70 con 0x7f5cf0100720 2024-09-05T01:25:38.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.677+0000 7f5cf5600640 1 -- 172.21.15.12:0/3228360025 learned_addr learned my addr 172.21.15.12:0/3228360025 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:38.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.677+0000 7f5cf6a00640 1 -- 172.21.15.12:0/3228360025 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf0114170 con 0x7f5cf010e2d0 2024-09-05T01:25:38.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.677+0000 7f5cf4c00640 1 --2- 172.21.15.12:0/3228360025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cf01010d0 0x7f5cf010aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:38.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.678+0000 7f5cf6000640 1 --2- 172.21.15.12:0/3228360025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cf010e2d0 0x7f5cf010b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:38.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.678+0000 7f5cf5600640 1 -- 172.21.15.12:0/3228360025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cf010e2d0 msgr2=0x7f5cf010b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:38.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.678+0000 7f5cf5600640 1 --2- 172.21.15.12:0/3228360025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cf010e2d0 0x7f5cf010b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.678+0000 7f5cf5600640 1 -- 172.21.15.12:0/3228360025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cf01010d0 msgr2=0x7f5cf010aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:38.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.678+0000 7f5cf5600640 1 --2- 172.21.15.12:0/3228360025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cf01010d0 0x7f5cf010aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.678+0000 7f5cf5600640 1 -- 172.21.15.12:0/3228360025 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf01aad30 con 0x7f5cf0100720 2024-09-05T01:25:38.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.679+0000 7f5cf5600640 1 --2- 172.21.15.12:0/3228360025 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cf0100720 0x7f5cf010dd00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc006010 tx=0x7f5cdc004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.679+0000 7f5cee000640 1 -- 172.21.15.12:0/3228360025 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc03f030 con 0x7f5cf0100720 2024-09-05T01:25:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.679+0000 7f5cf6a00640 1 -- 172.21.15.12:0/3228360025 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf01aaf00 con 0x7f5cf0100720 2024-09-05T01:25:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.680+0000 7f5cee000640 1 -- 172.21.15.12:0/3228360025 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5cdc004440 con 0x7f5cf0100720 2024-09-05T01:25:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.680+0000 7f5cee000640 1 -- 172.21.15.12:0/3228360025 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc035070 con 0x7f5cf0100720 2024-09-05T01:25:38.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.680+0000 7f5cf6a00640 1 -- 172.21.15.12:0/3228360025 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf01ab360 con 0x7f5cf0100720 2024-09-05T01:25:38.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.683+0000 7f5cfaa5f740 1 Processor -- start 2024-09-05T01:25:38.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.684+0000 7f5cfaa5f740 1 -- start start 2024-09-05T01:25:38.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.684+0000 7f5cfaa5f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d35dace40 0x557d35dad220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:38.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.684+0000 7f5cfaa5f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d35dad760 0x557d35db7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:38.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.684+0000 7f5cfaa5f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d35db8020 0x557d35dba410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:38.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.684+0000 7f5cfaa5f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557d35d133e0 con 0x557d35dad760 2024-09-05T01:25:38.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.684+0000 7f5cfaa5f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x557d35cbad80 con 0x557d35db8020 2024-09-05T01:25:38.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.684+0000 7f5cfaa5f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557d35d0f3a0 con 0x557d35dace40 2024-09-05T01:25:38.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.684+0000 7f5cf6000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d35dace40 0x557d35dad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:38.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.685+0000 7f5cf6000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d35dace40 0x557d35dad220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:41832/0 (socket says 172.21.15.12:41832) 2024-09-05T01:25:38.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.685+0000 7f5cf6000640 1 -- 172.21.15.12:0/3916665665 learned_addr learned my addr 172.21.15.12:0/3916665665 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:38.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.685+0000 7f5cf4c00640 1 --2- 172.21.15.12:0/3916665665 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d35db8020 0x557d35dba410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:38.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.685+0000 7f5cf6000640 1 -- 172.21.15.12:0/3916665665 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d35db8020 msgr2=0x557d35dba410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.685+0000 7f5cf6000640 1 --2- 172.21.15.12:0/3916665665 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d35db8020 0x557d35dba410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.685+0000 7f5cf6000640 1 -- 172.21.15.12:0/3916665665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d35dad760 msgr2=0x557d35db7ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:25:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.685+0000 7f5cf6000640 1 --2- 172.21.15.12:0/3916665665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d35dad760 0x557d35db7ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.685+0000 7f5cf6000640 1 -- 172.21.15.12:0/3916665665 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d35cd9ae0 con 0x557d35dace40 2024-09-05T01:25:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.685+0000 7f5cf4c00640 1 --2- 172.21.15.12:0/3916665665 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d35db8020 0x557d35dba410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:25:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.685+0000 7f5cee000640 1 -- 172.21.15.12:0/3228360025 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 25) ==== 138066+0+0 (secure 0 0 0) 0x7f5cdc042030 con 0x7f5cf0100720 2024-09-05T01:25:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.685+0000 7f5cf6000640 1 --2- 172.21.15.12:0/3916665665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d35dace40 0x557d35dad220 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009ec0 tx=0x7f5ce80107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3de13d8e25d318a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.686+0000 7f5ce2600640 1 -- 172.21.15.12:0/3916665665 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8004d20 con 0x557d35dace40 2024-09-05T01:25:38.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.686+0000 7f5ce2600640 1 -- 172.21.15.12:0/3916665665 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ce8003e50 con 0x557d35dace40 2024-09-05T01:25:38.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.686+0000 7f5ce2600640 1 -- 172.21.15.12:0/3916665665 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8005280 con 0x557d35dace40 2024-09-05T01:25:38.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.687+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/3916665665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d35dace40 msgr2=0x557d35dad220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:38.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.687+0000 7f5cfaa5f740 1 --2- 172.21.15.12:0/3916665665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d35dace40 0x557d35dad220 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009ec0 tx=0x7f5ce80107a0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.687+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/3916665665 shutdown_connections 2024-09-05T01:25:38.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.687+0000 7f5cfaa5f740 1 --2- 172.21.15.12:0/3916665665 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d35db8020 0x557d35dba410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.687+0000 7f5cfaa5f740 1 --2- 172.21.15.12:0/3916665665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d35dad760 0x557d35db7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.687+0000 7f5cfaa5f740 1 --2- 172.21.15.12:0/3916665665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d35dace40 0x557d35dad220 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.687+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/3916665665 >> 172.21.15.12:0/3916665665 conn(0x557d35da93d0 msgr2=0x557d35da97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:38.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.687+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/3916665665 shutdown_connections 2024-09-05T01:25:38.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.687+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/3916665665 wait complete. 2024-09-05T01:25:38.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.688+0000 7f5cee000640 1 --2- 172.21.15.12:0/3228360025 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5cd80a2da0 0x7f5cd80a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:38.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.688+0000 7f5cfaa5f740 1 -- start start 2024-09-05T01:25:38.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.688+0000 7f5cee000640 1 -- 172.21.15.12:0/3228360025 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f5cdc0ef600 con 0x7f5cf0100720 2024-09-05T01:25:38.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.688+0000 7f5cfaa5f740 1 Processor -- start 2024-09-05T01:25:38.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.688+0000 7f5cf6000640 1 --2- 172.21.15.12:0/3228360025 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5cd80a2da0 0x7f5cd80a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.689+0000 7f5cfaa5f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d35dace40 0x557d35db4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.689+0000 7f5cfaa5f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d35dad760 0x557d35db5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.689+0000 7f5cfaa5f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d35db8020 0x557d35db5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.689+0000 7f5cfaa5f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557d35dbabf0 con 0x557d35dace40 2024-09-05T01:25:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.689+0000 7f5cfaa5f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x557d35cce0f0 con 0x557d35dad760 2024-09-05T01:25:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.689+0000 7f5cfaa5f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557d35dbad70 con 0x557d35db8020 2024-09-05T01:25:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.689+0000 7f5cfaa5f740 10 client.0 _ll_register_callbacks cb 0x557d35cb5bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.690+0000 7f5cf5600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d35dace40 0x557d35db4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.690+0000 7f5cf5600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d35dace40 0x557d35db4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48508/0 (socket says 172.21.15.12:48508) 2024-09-05T01:25:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.690+0000 7f5cf5600640 1 -- 172.21.15.12:0/427171313 learned_addr learned my addr 172.21.15.12:0/427171313 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.690+0000 7f5cf4c00640 1 --2- 172.21.15.12:0/427171313 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d35dad760 0x557d35db5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.690+0000 7f5cf6000640 1 --2- 172.21.15.12:0/427171313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d35db8020 0x557d35db5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.691+0000 7f5cf6000640 1 --2- 172.21.15.12:0/3228360025 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5cd80a2da0 0x7f5cd80a5260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009e90 tx=0x7f5ce8010fd0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:38.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.691+0000 7f5cf5600640 1 -- 172.21.15.12:0/427171313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d35db8020 msgr2=0x557d35db5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:38.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.691+0000 7f5cf5600640 1 --2- 172.21.15.12:0/427171313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d35db8020 0x557d35db5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.691+0000 7f5cf5600640 1 -- 172.21.15.12:0/427171313 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d35dad760 msgr2=0x557d35db5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:38.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.691+0000 7f5cf5600640 1 --2- 172.21.15.12:0/427171313 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d35dad760 0x557d35db5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.691+0000 7f5cf5600640 1 -- 172.21.15.12:0/427171313 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d35a843c0 con 0x557d35dace40 2024-09-05T01:25:38.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.691+0000 7f5cf5600640 1 --2- 172.21.15.12:0/427171313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d35dace40 0x557d35db4fe0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc0b7d90 tx=0x7f5cdc0bb290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d858207f221e11c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:38.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.691+0000 7f5cd6a00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:25:38.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.692+0000 7f5cd6a00640 1 -- 172.21.15.12:0/427171313 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc049070 con 0x557d35dace40 2024-09-05T01:25:38.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.692+0000 7f5cd6a00640 1 -- 172.21.15.12:0/427171313 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f5cdc0a60b0 con 0x557d35dace40 2024-09-05T01:25:38.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.692+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/427171313 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ce8003e50 con 0x557d35dace40 2024-09-05T01:25:38.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.692+0000 7f5cd6a00640 1 -- 172.21.15.12:0/427171313 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5cdc0a62f0 con 0x557d35dace40 2024-09-05T01:25:38.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.692+0000 7f5cfaa5f740 10 client.15423 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:38.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.692+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/427171313 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557d35dc6c60 con 0x557d35dace40 2024-09-05T01:25:38.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.692+0000 7f5cd6a00640 1 -- 172.21.15.12:0/427171313 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ce8003e50 con 0x557d35dace40 2024-09-05T01:25:38.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.693+0000 7f5cd6a00640 1 -- 172.21.15.12:0/427171313 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5cdc04c060 con 0x557d35dace40 2024-09-05T01:25:38.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.693+0000 7f5cfaa5f740 10 client.15423 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:38.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.693+0000 7f5cfaa5f740 10 client.15423 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:25:38.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.693+0000 7f5cfaa5f740 20 client.15423 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:38.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.693+0000 7f5cfaa5f740 1 --2- 172.21.15.12:0/427171313 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x557d35dc7fb0 0x557d35dca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:38.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.693+0000 7f5cfaa5f740 4 client.15423 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:25:38.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.693+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/427171313 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d35d20950 con 0x557d35dc7fb0 2024-09-05T01:25:38.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.694+0000 7f5cf4c00640 1 --2- 172.21.15.12:0/427171313 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x557d35dc7fb0 0x557d35dca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:38.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.694+0000 7f5cf4c00640 1 --2- 172.21.15.12:0/427171313 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x557d35dc7fb0 0x557d35dca3a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdaf6121136a0e8a server_cookie=813380fab3e5c7fb in_seq=0 out_seq=0 2024-09-05T01:25:38.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.694+0000 7f5cd6a00640 10 client.15423 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:25:38.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.695+0000 7f5cd6a00640 1 -- 172.21.15.12:0/427171313 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557d35d20950 con 0x557d35dc7fb0 2024-09-05T01:25:38.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.695+0000 7f5cd6a00640 10 client.15423 handle_command_reply: tid=0 2024-09-05T01:25:38.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.695+0000 7f5cfaa5f740 1 client.15423 shutdown 2024-09-05T01:25:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.695+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/427171313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d35dace40 msgr2=0x557d35db4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.695+0000 7f5cfaa5f740 1 --2- 172.21.15.12:0/427171313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d35dace40 0x557d35db4fe0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc0b7d90 tx=0x7f5cdc0bb290 comp rx=0 tx=0).stop 2024-09-05T01:25:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.695+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/427171313 shutdown_connections 2024-09-05T01:25:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.695+0000 7f5cfaa5f740 1 --2- 172.21.15.12:0/427171313 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x557d35dc7fb0 0x557d35dca3a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.696+0000 7f5cfaa5f740 1 --2- 172.21.15.12:0/427171313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d35db8020 0x557d35db5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.696+0000 7f5cfaa5f740 1 --2- 172.21.15.12:0/427171313 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d35dad760 0x557d35db5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.696+0000 7f5cfaa5f740 1 --2- 172.21.15.12:0/427171313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d35dace40 0x557d35db4fe0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.696+0000 7f5cd6a00640 0 client.15423 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:25:38.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.696+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/427171313 >> 172.21.15.12:0/427171313 conn(0x557d35da93d0 msgr2=0x557d35daf100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:38.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.696+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/427171313 shutdown_connections 2024-09-05T01:25:38.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.696+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/427171313 wait complete. 2024-09-05T01:25:38.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.696+0000 7f5cfaa5f740 20 client.15423 trim_cache size 0 max 16384 2024-09-05T01:25:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.724+0000 7f5cfaa5f740 1 Processor -- start 2024-09-05T01:25:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.724+0000 7f5cfaa5f740 1 -- start start 2024-09-05T01:25:38.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.725+0000 7f5cfaa5f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d35dace40 0x557d35dcfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:38.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.725+0000 7f5cfaa5f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d35dad760 0x557d35dd00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:38.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.725+0000 7f5cfaa5f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d35db8020 0x557d35db2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:38.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.725+0000 7f5cfaa5f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf01b3db0 con 0x557d35dad760 2024-09-05T01:25:38.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.725+0000 7f5cfaa5f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf01b58f0 con 0x557d35db8020 2024-09-05T01:25:38.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.725+0000 7f5cfaa5f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf01b4480 con 0x557d35dace40 2024-09-05T01:25:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.725+0000 7f5cf4c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d35dad760 0x557d35dd00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.725+0000 7f5cf6000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d35db8020 0x557d35db2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.725+0000 7f5cf6000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d35db8020 0x557d35db2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:43328/0 (socket says 172.21.15.12:43328) 2024-09-05T01:25:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.725+0000 7f5cf6000640 1 -- 172.21.15.12:0/3895135423 learned_addr learned my addr 172.21.15.12:0/3895135423 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.726+0000 7f5cf5600640 1 --2- 172.21.15.12:0/3895135423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d35dace40 0x557d35dcfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.726+0000 7f5cf4c00640 1 -- 172.21.15.12:0/3895135423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d35dace40 msgr2=0x557d35dcfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.726+0000 7f5cf4c00640 1 --2- 172.21.15.12:0/3895135423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d35dace40 0x557d35dcfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.726+0000 7f5cf4c00640 1 -- 172.21.15.12:0/3895135423 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d35db8020 msgr2=0x557d35db2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.726+0000 7f5cf4c00640 1 --2- 172.21.15.12:0/3895135423 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d35db8020 0x557d35db2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.726+0000 7f5cf4c00640 1 -- 172.21.15.12:0/3895135423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d35da8e70 con 0x557d35dad760 2024-09-05T01:25:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.727+0000 7f5cf4c00640 1 --2- 172.21.15.12:0/3895135423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d35dad760 0x557d35dd00f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x557d35dcab50 tx=0x7f5ce4014840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc350f862e4b70b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:38.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.727+0000 7f5ce1c00640 1 -- 172.21.15.12:0/3895135423 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce40142d0 con 0x557d35dad760 2024-09-05T01:25:38.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.727+0000 7f5ce1c00640 1 -- 172.21.15.12:0/3895135423 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ce4005500 con 0x557d35dad760 2024-09-05T01:25:38.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.727+0000 7f5ce1c00640 1 -- 172.21.15.12:0/3895135423 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce401d6c0 con 0x557d35dad760 2024-09-05T01:25:38.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.728+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/3895135423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d35dad760 msgr2=0x557d35dd00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:38.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.728+0000 7f5cfaa5f740 1 --2- 172.21.15.12:0/3895135423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d35dad760 0x557d35dd00f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x557d35dcab50 tx=0x7f5ce4014840 comp rx=0 tx=0).stop 2024-09-05T01:25:38.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.728+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/3895135423 shutdown_connections 2024-09-05T01:25:38.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.728+0000 7f5cfaa5f740 1 --2- 172.21.15.12:0/3895135423 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d35db8020 0x557d35db2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.728+0000 7f5cfaa5f740 1 --2- 172.21.15.12:0/3895135423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d35dad760 0x557d35dd00f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.728+0000 7f5cfaa5f740 1 --2- 172.21.15.12:0/3895135423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d35dace40 0x557d35dcfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.728+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/3895135423 >> 172.21.15.12:0/3895135423 conn(0x557d35da93d0 msgr2=0x557d35db40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:38.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.729+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/3895135423 shutdown_connections 2024-09-05T01:25:38.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.729+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/3895135423 wait complete. 2024-09-05T01:25:38.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.729+0000 7f5cfaa5f740 1 -- start start 2024-09-05T01:25:38.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.729+0000 7f5cfaa5f740 1 Processor -- start 2024-09-05T01:25:38.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.730+0000 7f5cfaa5f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d35dace40 0x557d35dbbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:38.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.730+0000 7f5cfaa5f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d35db8020 0x557d35dbc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:38.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.730+0000 7f5cfaa5f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d35dbc750 0x557d35e31b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:38.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.730+0000 7f5cfaa5f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf01b5220 con 0x557d35dace40 2024-09-05T01:25:38.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.730+0000 7f5cfaa5f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf01b4b50 con 0x557d35db8020 2024-09-05T01:25:38.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.730+0000 7f5cfaa5f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf01b1d90 con 0x557d35dbc750 2024-09-05T01:25:38.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.730+0000 7f5cfaa5f740 10 client.0 _ll_register_callbacks cb 0x7f5cdc03b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:38.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.731+0000 7f5cf5600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d35dace40 0x557d35dbbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:38.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.731+0000 7f5cf5600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d35dace40 0x557d35dbbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48518/0 (socket says 172.21.15.12:48518) 2024-09-05T01:25:38.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.731+0000 7f5cf5600640 1 -- 172.21.15.12:0/2275665823 learned_addr learned my addr 172.21.15.12:0/2275665823 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:38.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.731+0000 7f5cf4c00640 1 --2- 172.21.15.12:0/2275665823 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d35db8020 0x557d35dbc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:38.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.731+0000 7f5cf6000640 1 --2- 172.21.15.12:0/2275665823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d35dbc750 0x557d35e31b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:38.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.731+0000 7f5cf6000640 1 -- 172.21.15.12:0/2275665823 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d35db8020 msgr2=0x557d35dbc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:38.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.731+0000 7f5cf6000640 1 --2- 172.21.15.12:0/2275665823 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d35db8020 0x557d35dbc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.731+0000 7f5cf6000640 1 -- 172.21.15.12:0/2275665823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d35dace40 msgr2=0x557d35dbbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:38.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.732+0000 7f5cf6000640 1 --2- 172.21.15.12:0/2275665823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d35dace40 0x557d35dbbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.732+0000 7f5cf6000640 1 -- 172.21.15.12:0/2275665823 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d35e320c0 con 0x557d35dbc750 2024-09-05T01:25:38.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.732+0000 7f5cf5600640 1 --2- 172.21.15.12:0/2275665823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d35dace40 0x557d35dbbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:25:38.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.732+0000 7f5cf6000640 1 --2- 172.21.15.12:0/2275665823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d35dbc750 0x557d35e31b80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8004800 tx=0x7f5ce8004690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eef8c5ede135c80f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:38.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.732+0000 7f5cd6a00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:25:38.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.733+0000 7f5cd6a00640 1 -- 172.21.15.12:0/2275665823 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8005000 con 0x557d35dbc750 2024-09-05T01:25:38.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.733+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/2275665823 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ce4005500 con 0x557d35dbc750 2024-09-05T01:25:38.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.733+0000 7f5cd6a00640 1 -- 172.21.15.12:0/2275665823 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f5ce8022030 con 0x557d35dbc750 2024-09-05T01:25:38.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.733+0000 7f5cd6a00640 1 -- 172.21.15.12:0/2275665823 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5ce80051a0 con 0x557d35dbc750 2024-09-05T01:25:38.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.733+0000 7f5cfaa5f740 10 client.25444 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:38.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.733+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/2275665823 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557d35e332e0 con 0x557d35dbc750 2024-09-05T01:25:38.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.733+0000 7f5cd6a00640 1 -- 172.21.15.12:0/2275665823 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ce4005500 con 0x557d35dbc750 2024-09-05T01:25:38.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.734+0000 7f5cd6a00640 1 -- 172.21.15.12:0/2275665823 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5ce80357c0 con 0x557d35dbc750 2024-09-05T01:25:38.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.734+0000 7f5cfaa5f740 10 client.25444 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:38.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.734+0000 7f5cfaa5f740 10 client.25444 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:25:38.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.734+0000 7f5cfaa5f740 20 client.25444 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:38.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.734+0000 7f5cfaa5f740 1 --2- 172.21.15.12:0/2275665823 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x557d35e336d0 0x557d35e35ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:38.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.734+0000 7f5cfaa5f740 4 client.25444 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:25:38.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.734+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/2275665823 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557d35d1ae60 con 0x557d35e336d0 2024-09-05T01:25:38.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.734+0000 7f5cf5600640 1 --2- 172.21.15.12:0/2275665823 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x557d35e336d0 0x557d35e35ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:38.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.735+0000 7f5cf5600640 1 --2- 172.21.15.12:0/2275665823 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x557d35e336d0 0x557d35e35ac0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6363e3c2d86e0bea server_cookie=76850624549a35de in_seq=0 out_seq=0 2024-09-05T01:25:38.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.735+0000 7f5cd6a00640 10 client.25444 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:25:38.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.735+0000 7f5cd6a00640 1 -- 172.21.15.12:0/2275665823 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557d35d1ae60 con 0x557d35e336d0 2024-09-05T01:25:38.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.735+0000 7f5cd6a00640 10 client.25444 handle_command_reply: tid=0 2024-09-05T01:25:38.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.735+0000 7f5cfaa5f740 1 client.25444 shutdown 2024-09-05T01:25:38.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.736+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/2275665823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d35dbc750 msgr2=0x557d35e31b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:38.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.736+0000 7f5cfaa5f740 1 --2- 172.21.15.12:0/2275665823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d35dbc750 0x557d35e31b80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8004800 tx=0x7f5ce8004690 comp rx=0 tx=0).stop 2024-09-05T01:25:38.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.736+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/2275665823 shutdown_connections 2024-09-05T01:25:38.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.736+0000 7f5cfaa5f740 1 --2- 172.21.15.12:0/2275665823 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x557d35e336d0 0x557d35e35ac0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.736+0000 7f5cfaa5f740 1 --2- 172.21.15.12:0/2275665823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d35dbc750 0x557d35e31b80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.736+0000 7f5cfaa5f740 1 --2- 172.21.15.12:0/2275665823 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557d35db8020 0x557d35dbc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.736+0000 7f5cfaa5f740 1 --2- 172.21.15.12:0/2275665823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557d35dace40 0x557d35dbbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.736+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/2275665823 >> 172.21.15.12:0/2275665823 conn(0x557d35da93d0 msgr2=0x557d35db6840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:38.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.736+0000 7f5cd6a00640 0 client.25444 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:25:38.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.736+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/2275665823 shutdown_connections 2024-09-05T01:25:38.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.736+0000 7f5cfaa5f740 1 -- 172.21.15.12:0/2275665823 wait complete. 2024-09-05T01:25:38.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.736+0000 7f5cfaa5f740 20 client.25444 trim_cache size 0 max 16384 2024-09-05T01:25:38.739 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:25:38.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.737+0000 7f5cf6a00640 1 -- 172.21.15.12:0/3228360025 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5cd80a2da0 msgr2=0x7f5cd80a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:38.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.737+0000 7f5cf6a00640 1 --2- 172.21.15.12:0/3228360025 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5cd80a2da0 0x7f5cd80a5260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009e90 tx=0x7f5ce8010fd0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.737+0000 7f5cf6a00640 1 -- 172.21.15.12:0/3228360025 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cf0100720 msgr2=0x7f5cf010dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:38.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.737+0000 7f5cf6a00640 1 --2- 172.21.15.12:0/3228360025 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cf0100720 0x7f5cf010dd00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc006010 tx=0x7f5cdc004040 comp rx=0 tx=0).stop 2024-09-05T01:25:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.737+0000 7f5cf6a00640 1 -- 172.21.15.12:0/3228360025 shutdown_connections 2024-09-05T01:25:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.738+0000 7f5cf6a00640 1 --2- 172.21.15.12:0/3228360025 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5cd80a2da0 0x7f5cd80a5260 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.738+0000 7f5cf6a00640 1 --2- 172.21.15.12:0/3228360025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cf010e2d0 0x7f5cf010b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.738+0000 7f5cf6a00640 1 --2- 172.21.15.12:0/3228360025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cf01010d0 0x7f5cf010aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.738+0000 7f5cf6a00640 1 --2- 172.21.15.12:0/3228360025 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5cf0100720 0x7f5cf010dd00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.738+0000 7f5cf6a00640 1 -- 172.21.15.12:0/3228360025 >> 172.21.15.12:0/3228360025 conn(0x7f5cf00fc610 msgr2=0x7f5cf00fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.738+0000 7f5cf6a00640 1 -- 172.21.15.12:0/3228360025 shutdown_connections 2024-09-05T01:25:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:38.738+0000 7f5cf6a00640 1 -- 172.21.15.12:0/3228360025 wait complete. 2024-09-05T01:25:38.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:38 smithi012 ceph-mon[29942]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-05T01:25:39.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:38 smithi145 ceph-mon[34376]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-05T01:25:39.103 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:38 smithi151 ceph-mon[35013]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-05T01:25:40.513 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-05T01:25:40.514 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-05T01:25:40.961 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:25:41.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:40 smithi012 ceph-mon[29942]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-05T01:25:41.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:40 smithi145 ceph-mon[34376]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-05T01:25:41.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:40 smithi151 ceph-mon[35013]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-05T01:25:41.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.926+0000 7fc339600640 1 -- 172.21.15.12:0/3719585117 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3341034b0 msgr2=0x7fc33410b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:41.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.926+0000 7fc339600640 1 --2- 172.21.15.12:0/3719585117 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3341034b0 0x7fc33410b9a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc320009900 tx=0x7fc32002a480 comp rx=0 tx=0).stop 2024-09-05T01:25:41.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.926+0000 7fc339600640 1 -- 172.21.15.12:0/3719585117 shutdown_connections 2024-09-05T01:25:41.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.926+0000 7fc339600640 1 --2- 172.21.15.12:0/3719585117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc33410bfc0 0x7fc33410e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:41.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.926+0000 7fc339600640 1 --2- 172.21.15.12:0/3719585117 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3341034b0 0x7fc33410b9a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:41.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.926+0000 7fc339600640 1 --2- 172.21.15.12:0/3719585117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc334102b90 0x7fc334102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:41.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.926+0000 7fc339600640 1 -- 172.21.15.12:0/3719585117 >> 172.21.15.12:0/3719585117 conn(0x7fc3340fc610 msgr2=0x7fc3340fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:41.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.927+0000 7fc339600640 1 -- 172.21.15.12:0/3719585117 shutdown_connections 2024-09-05T01:25:41.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.927+0000 7fc339600640 1 -- 172.21.15.12:0/3719585117 wait complete. 2024-09-05T01:25:41.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.928+0000 7fc339600640 1 Processor -- start 2024-09-05T01:25:41.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.928+0000 7fc339600640 1 -- start start 2024-09-05T01:25:41.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.929+0000 7fc339600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc334102b90 0x7fc33410b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:41.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.929+0000 7fc339600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3341034b0 0x7fc334108680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:41.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.929+0000 7fc339600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc33410bfc0 0x7fc334108bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:41.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.929+0000 7fc339600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc334101f00 con 0x7fc3341034b0 2024-09-05T01:25:41.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.929+0000 7fc333e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc334102b90 0x7fc33410b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:41.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.929+0000 7fc333e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc334102b90 0x7fc33410b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:41868/0 (socket says 172.21.15.12:41868) 2024-09-05T01:25:41.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.929+0000 7fc333e00640 1 -- 172.21.15.12:0/1806833326 learned_addr learned my addr 172.21.15.12:0/1806833326 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:41.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.929+0000 7fc338c00640 1 --2- 172.21.15.12:0/1806833326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc33410bfc0 0x7fc334108bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:41.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.929+0000 7fc339600640 1 -- 172.21.15.12:0/1806833326 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc334101d80 con 0x7fc33410bfc0 2024-09-05T01:25:41.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.929+0000 7fc339600640 1 -- 172.21.15.12:0/1806833326 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc334102080 con 0x7fc334102b90 2024-09-05T01:25:41.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.930+0000 7fc333e00640 1 -- 172.21.15.12:0/1806833326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc33410bfc0 msgr2=0x7fc334108bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:41.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.930+0000 7fc333e00640 1 --2- 172.21.15.12:0/1806833326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc33410bfc0 0x7fc334108bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:41.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.930+0000 7fc333e00640 1 -- 172.21.15.12:0/1806833326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3341034b0 msgr2=0x7fc334108680 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-05T01:25:41.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.930+0000 7fc333400640 1 --2- 172.21.15.12:0/1806833326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3341034b0 0x7fc334108680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:41.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.930+0000 7fc333e00640 1 --2- 172.21.15.12:0/1806833326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3341034b0 0x7fc334108680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:41.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.930+0000 7fc333e00640 1 -- 172.21.15.12:0/1806833326 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3341092f0 con 0x7fc334102b90 2024-09-05T01:25:41.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.931+0000 7fc333400640 1 --2- 172.21.15.12:0/1806833326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3341034b0 0x7fc334108680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:25:41.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.931+0000 7fc333e00640 1 --2- 172.21.15.12:0/1806833326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc334102b90 0x7fc33410b5d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc32400e9f0 tx=0x7fc32400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:41.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.931+0000 7fc330c00640 1 -- 172.21.15.12:0/1806833326 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32400cd80 con 0x7fc334102b90 2024-09-05T01:25:41.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.931+0000 7fc339600640 1 -- 172.21.15.12:0/1806833326 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3341aafc0 con 0x7fc334102b90 2024-09-05T01:25:41.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.931+0000 7fc330c00640 1 -- 172.21.15.12:0/1806833326 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc324010910 con 0x7fc334102b90 2024-09-05T01:25:41.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.931+0000 7fc330c00640 1 -- 172.21.15.12:0/1806833326 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3240188f0 con 0x7fc334102b90 2024-09-05T01:25:41.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.932+0000 7fc339600640 1 -- 172.21.15.12:0/1806833326 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3341ab360 con 0x7fc334102b90 2024-09-05T01:25:41.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.936+0000 7fc330c00640 1 -- 172.21.15.12:0/1806833326 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) ==== 138066+0+0 (secure 0 0 0) 0x7fc324010430 con 0x7fc334102b90 2024-09-05T01:25:41.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.938+0000 7fc33d5e9740 1 Processor -- start 2024-09-05T01:25:41.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.938+0000 7fc330c00640 1 --2- 172.21.15.12:0/1806833326 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc3180a2e90 0x7fc3180a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:41.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.938+0000 7fc33d5e9740 1 -- start start 2024-09-05T01:25:41.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.938+0000 7fc330c00640 1 -- 172.21.15.12:0/1806833326 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fc3240cf9c0 con 0x7fc334102b90 2024-09-05T01:25:41.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.939+0000 7fc33d5e9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1e077bcb0 0x55c1e077c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:41.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.939+0000 7fc33d5e9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1e077c5d0 0x55c1e0786950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:41.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.939+0000 7fc33d5e9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1e0786e90 0x55c1e0789280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:41.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.939+0000 7fc33d5e9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c1e06e2290 con 0x55c1e0786e90 2024-09-05T01:25:41.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.939+0000 7fc33d5e9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c1e0689b40 con 0x55c1e077bcb0 2024-09-05T01:25:41.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.939+0000 7fc33d5e9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c1e06de250 con 0x55c1e077c5d0 2024-09-05T01:25:41.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.939+0000 7fc338c00640 1 --2- 172.21.15.12:0/1806833326 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc3180a2e90 0x7fc3180a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:41.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.939+0000 7fc333400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1e077c5d0 0x55c1e0786950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:41.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.939+0000 7fc333400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1e077c5d0 0x55c1e0786950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:41878/0 (socket says 172.21.15.12:41878) 2024-09-05T01:25:41.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.939+0000 7fc333400640 1 -- 172.21.15.12:0/1805222735 learned_addr learned my addr 172.21.15.12:0/1805222735 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:41.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.940+0000 7fc333e00640 1 --2- 172.21.15.12:0/1805222735 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1e077bcb0 0x55c1e077c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:41.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.940+0000 7fc333400640 1 -- 172.21.15.12:0/1805222735 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1e077bcb0 msgr2=0x55c1e077c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:41.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.940+0000 7fc333400640 1 --2- 172.21.15.12:0/1805222735 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1e077bcb0 0x55c1e077c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:41.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.940+0000 7fc333400640 1 -- 172.21.15.12:0/1805222735 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1e0786e90 msgr2=0x55c1e0789280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:41.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.941+0000 7fc333400640 1 --2- 172.21.15.12:0/1805222735 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1e0786e90 0x55c1e0789280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:41.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.941+0000 7fc333400640 1 -- 172.21.15.12:0/1805222735 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1e04536a0 con 0x55c1e077c5d0 2024-09-05T01:25:41.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.941+0000 7fc338c00640 1 --2- 172.21.15.12:0/1806833326 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc3180a2e90 0x7fc3180a5350 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc32c005fd0 tx=0x7fc32c009a70 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:41.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.943+0000 7fc333400640 1 --2- 172.21.15.12:0/1805222735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1e077c5d0 0x55c1e0786950 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc32002a9a0 tx=0x7fc3200040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f8bcd37286d1a8e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:41.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.944+0000 7fc329200640 1 -- 172.21.15.12:0/1805222735 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32003f070 con 0x55c1e077c5d0 2024-09-05T01:25:41.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.944+0000 7fc329200640 1 -- 172.21.15.12:0/1805222735 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc320005520 con 0x55c1e077c5d0 2024-09-05T01:25:41.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.944+0000 7fc329200640 1 -- 172.21.15.12:0/1805222735 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc320035030 con 0x55c1e077c5d0 2024-09-05T01:25:41.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.945+0000 7fc33d5e9740 1 -- 172.21.15.12:0/1805222735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1e077c5d0 msgr2=0x55c1e0786950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:41.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.945+0000 7fc33d5e9740 1 --2- 172.21.15.12:0/1805222735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1e077c5d0 0x55c1e0786950 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc32002a9a0 tx=0x7fc3200040c0 comp rx=0 tx=0).stop 2024-09-05T01:25:41.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.945+0000 7fc33d5e9740 1 -- 172.21.15.12:0/1805222735 shutdown_connections 2024-09-05T01:25:41.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.945+0000 7fc33d5e9740 1 --2- 172.21.15.12:0/1805222735 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1e0786e90 0x55c1e0789280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:41.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.945+0000 7fc33d5e9740 1 --2- 172.21.15.12:0/1805222735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1e077c5d0 0x55c1e0786950 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:41.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.945+0000 7fc33d5e9740 1 --2- 172.21.15.12:0/1805222735 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1e077bcb0 0x55c1e077c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:41.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.945+0000 7fc33d5e9740 1 -- 172.21.15.12:0/1805222735 >> 172.21.15.12:0/1805222735 conn(0x55c1e0778240 msgr2=0x55c1e0778620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:41.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.945+0000 7fc33d5e9740 1 -- 172.21.15.12:0/1805222735 shutdown_connections 2024-09-05T01:25:41.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.945+0000 7fc33d5e9740 1 -- 172.21.15.12:0/1805222735 wait complete. 2024-09-05T01:25:41.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.946+0000 7fc33d5e9740 1 -- start start 2024-09-05T01:25:41.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.946+0000 7fc33d5e9740 1 Processor -- start 2024-09-05T01:25:41.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.947+0000 7fc33d5e9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1e077bcb0 0x55c1e07866b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:41.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.947+0000 7fc33d5e9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1e077c5d0 0x55c1e0783960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:41.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.947+0000 7fc33d5e9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1e0786e90 0x55c1e0783ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:41.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.947+0000 7fc33d5e9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c1e0789b00 con 0x55c1e077c5d0 2024-09-05T01:25:41.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.947+0000 7fc33d5e9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c1e069cfa0 con 0x55c1e077bcb0 2024-09-05T01:25:41.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.947+0000 7fc33d5e9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c1e0789c80 con 0x55c1e0786e90 2024-09-05T01:25:41.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.947+0000 7fc33d5e9740 10 client.0 _ll_register_callbacks cb 0x55c1e03f0ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:41.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.948+0000 7fc333e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1e077bcb0 0x55c1e07866b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:41.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.948+0000 7fc333e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1e077bcb0 0x55c1e07866b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:43384/0 (socket says 172.21.15.12:43384) 2024-09-05T01:25:41.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.948+0000 7fc333e00640 1 -- 172.21.15.12:0/2103233145 learned_addr learned my addr 172.21.15.12:0/2103233145 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:41.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.948+0000 7fc338c00640 1 --2- 172.21.15.12:0/2103233145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1e0786e90 0x55c1e0783ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:41.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.948+0000 7fc333400640 1 --2- 172.21.15.12:0/2103233145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1e077c5d0 0x55c1e0783960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:41.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.949+0000 7fc338c00640 1 -- 172.21.15.12:0/2103233145 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1e077bcb0 msgr2=0x55c1e07866b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:41.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.949+0000 7fc338c00640 1 --2- 172.21.15.12:0/2103233145 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1e077bcb0 0x55c1e07866b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:41.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.949+0000 7fc338c00640 1 -- 172.21.15.12:0/2103233145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1e077c5d0 msgr2=0x55c1e0783960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:41.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.949+0000 7fc338c00640 1 --2- 172.21.15.12:0/2103233145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1e077c5d0 0x55c1e0783960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:41.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.949+0000 7fc338c00640 1 -- 172.21.15.12:0/2103233145 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1e0784680 con 0x55c1e0786e90 2024-09-05T01:25:41.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.949+0000 7fc333400640 1 --2- 172.21.15.12:0/2103233145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1e077c5d0 0x55c1e0783960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:25:41.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.950+0000 7fc338c00640 1 --2- 172.21.15.12:0/2103233145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1e0786e90 0x55c1e0783ea0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc32c012ca0 tx=0x7fc32c004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dae02393f70275c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:41.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.950+0000 7fc31d600640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:25:41.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.950+0000 7fc31d600640 1 -- 172.21.15.12:0/2103233145 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c027400 con 0x55c1e0786e90 2024-09-05T01:25:41.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.950+0000 7fc31d600640 1 -- 172.21.15.12:0/2103233145 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fc32c01f3f0 con 0x55c1e0786e90 2024-09-05T01:25:41.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.951+0000 7fc33d5e9740 1 -- 172.21.15.12:0/2103233145 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc320005520 con 0x55c1e0786e90 2024-09-05T01:25:41.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.951+0000 7fc31d600640 1 -- 172.21.15.12:0/2103233145 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc32c01f5f0 con 0x55c1e0786e90 2024-09-05T01:25:41.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.951+0000 7fc33d5e9740 10 client.25456 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:41.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.951+0000 7fc33d5e9740 1 -- 172.21.15.12:0/2103233145 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c1e07959f0 con 0x55c1e0786e90 2024-09-05T01:25:41.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.952+0000 7fc31d600640 1 -- 172.21.15.12:0/2103233145 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc320005520 con 0x55c1e0786e90 2024-09-05T01:25:41.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.952+0000 7fc31d600640 1 -- 172.21.15.12:0/2103233145 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc32c027aa0 con 0x55c1e0786e90 2024-09-05T01:25:41.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.952+0000 7fc33d5e9740 10 client.25456 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:41.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.952+0000 7fc33d5e9740 10 client.25456 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:25:41.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.952+0000 7fc33d5e9740 20 client.25456 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:41.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.952+0000 7fc33d5e9740 1 --2- 172.21.15.12:0/2103233145 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55c1e0796eb0 0x55c1e0799300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:41.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.952+0000 7fc33d5e9740 4 client.25456 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:25:41.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.952+0000 7fc33d5e9740 1 -- 172.21.15.12:0/2103233145 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1e06ef800 con 0x55c1e0796eb0 2024-09-05T01:25:41.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.953+0000 7fc333e00640 1 --2- 172.21.15.12:0/2103233145 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55c1e0796eb0 0x55c1e0799300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:41.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.954+0000 7fc333e00640 1 --2- 172.21.15.12:0/2103233145 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55c1e0796eb0 0x55c1e0799300 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5093993cd215dbe2 server_cookie=b65341e1ceca798a in_seq=0 out_seq=0 2024-09-05T01:25:41.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.954+0000 7fc31d600640 10 client.25456 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:25:41.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.955+0000 7fc31d600640 1 -- 172.21.15.12:0/2103233145 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c1e06ef800 con 0x55c1e0796eb0 2024-09-05T01:25:41.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.955+0000 7fc31d600640 10 client.25456 handle_command_reply: tid=0 2024-09-05T01:25:41.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.955+0000 7fc33d5e9740 1 client.25456 shutdown 2024-09-05T01:25:41.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.955+0000 7fc33d5e9740 1 -- 172.21.15.12:0/2103233145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1e0786e90 msgr2=0x55c1e0783ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:41.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.955+0000 7fc33d5e9740 1 --2- 172.21.15.12:0/2103233145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1e0786e90 0x55c1e0783ea0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc32c012ca0 tx=0x7fc32c004ab0 comp rx=0 tx=0).stop 2024-09-05T01:25:41.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.955+0000 7fc33d5e9740 1 -- 172.21.15.12:0/2103233145 shutdown_connections 2024-09-05T01:25:41.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.955+0000 7fc33d5e9740 1 --2- 172.21.15.12:0/2103233145 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55c1e0796eb0 0x55c1e0799300 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:41.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.956+0000 7fc31d600640 0 client.25456 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:25:41.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.956+0000 7fc33d5e9740 1 --2- 172.21.15.12:0/2103233145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1e0786e90 0x55c1e0783ea0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:41.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.956+0000 7fc33d5e9740 1 --2- 172.21.15.12:0/2103233145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1e077c5d0 0x55c1e0783960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:41.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.956+0000 7fc33d5e9740 1 --2- 172.21.15.12:0/2103233145 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1e077bcb0 0x55c1e07866b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:41.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.956+0000 7fc33d5e9740 1 -- 172.21.15.12:0/2103233145 >> 172.21.15.12:0/2103233145 conn(0x55c1e0778240 msgr2=0x55c1e077df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:41.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.956+0000 7fc33d5e9740 1 -- 172.21.15.12:0/2103233145 shutdown_connections 2024-09-05T01:25:41.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.956+0000 7fc33d5e9740 1 -- 172.21.15.12:0/2103233145 wait complete. 2024-09-05T01:25:41.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.958+0000 7fc33d5e9740 20 client.25456 trim_cache size 0 max 16384 2024-09-05T01:25:41.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.994+0000 7fc33d5e9740 1 Processor -- start 2024-09-05T01:25:41.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.994+0000 7fc33d5e9740 1 -- start start 2024-09-05T01:25:41.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.994+0000 7fc33d5e9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1e077bcb0 0x55c1e077f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:41.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.994+0000 7fc33d5e9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1e077c5d0 0x55c1e079ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:41.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.994+0000 7fc33d5e9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1e0786e90 0x55c1e079f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:41.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.995+0000 7fc33d5e9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc31400e880 con 0x55c1e077bcb0 2024-09-05T01:25:41.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.995+0000 7fc333e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1e077bcb0 0x55c1e077f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:41.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.995+0000 7fc333e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1e077bcb0 0x55c1e077f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48556/0 (socket says 172.21.15.12:48556) 2024-09-05T01:25:41.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.995+0000 7fc333e00640 1 -- 172.21.15.12:0/4106379744 learned_addr learned my addr 172.21.15.12:0/4106379744 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:41.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.995+0000 7fc333400640 1 --2- 172.21.15.12:0/4106379744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1e077c5d0 0x55c1e079ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:41.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.995+0000 7fc33d5e9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc3140103c0 con 0x55c1e0786e90 2024-09-05T01:25:41.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.996+0000 7fc33d5e9740 1 -- 172.21.15.12:0/4106379744 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc31400ef50 con 0x55c1e077c5d0 2024-09-05T01:25:41.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.996+0000 7fc338c00640 1 --2- 172.21.15.12:0/4106379744 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1e0786e90 0x55c1e079f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:41.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.996+0000 7fc333e00640 1 -- 172.21.15.12:0/4106379744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1e077c5d0 msgr2=0x55c1e079ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:41.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.996+0000 7fc333e00640 1 --2- 172.21.15.12:0/4106379744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1e077c5d0 0x55c1e079ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:41.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.996+0000 7fc333e00640 1 -- 172.21.15.12:0/4106379744 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1e0786e90 msgr2=0x55c1e079f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:41.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.996+0000 7fc333e00640 1 --2- 172.21.15.12:0/4106379744 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1e0786e90 0x55c1e079f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:41.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.996+0000 7fc333e00640 1 -- 172.21.15.12:0/4106379744 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1e077f540 con 0x55c1e077bcb0 2024-09-05T01:25:41.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.997+0000 7fc333e00640 1 --2- 172.21.15.12:0/4106379744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1e077bcb0 0x55c1e077f000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc324098080 tx=0x7fc324023040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0edf95aeb676e93 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:41.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.998+0000 7fc31fe00640 1 -- 172.21.15.12:0/4106379744 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324010720 con 0x55c1e077bcb0 2024-09-05T01:25:41.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.998+0000 7fc31fe00640 1 -- 172.21.15.12:0/4106379744 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc324099f20 con 0x55c1e077bcb0 2024-09-05T01:25:41.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.998+0000 7fc31fe00640 1 -- 172.21.15.12:0/4106379744 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32409b070 con 0x55c1e077bcb0 2024-09-05T01:25:42.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.999+0000 7fc33d5e9740 1 -- 172.21.15.12:0/4106379744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1e077bcb0 msgr2=0x55c1e077f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:42.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.999+0000 7fc33d5e9740 1 --2- 172.21.15.12:0/4106379744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1e077bcb0 0x55c1e077f000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc324098080 tx=0x7fc324023040 comp rx=0 tx=0).stop 2024-09-05T01:25:42.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.999+0000 7fc33d5e9740 1 -- 172.21.15.12:0/4106379744 shutdown_connections 2024-09-05T01:25:42.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.999+0000 7fc33d5e9740 1 --2- 172.21.15.12:0/4106379744 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1e0786e90 0x55c1e079f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:42.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.999+0000 7fc33d5e9740 1 --2- 172.21.15.12:0/4106379744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1e077c5d0 0x55c1e079ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:42.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.999+0000 7fc33d5e9740 1 --2- 172.21.15.12:0/4106379744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1e077bcb0 0x55c1e077f000 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:42.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.999+0000 7fc33d5e9740 1 -- 172.21.15.12:0/4106379744 >> 172.21.15.12:0/4106379744 conn(0x55c1e0778240 msgr2=0x55c1e077e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:42.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.999+0000 7fc33d5e9740 1 -- 172.21.15.12:0/4106379744 shutdown_connections 2024-09-05T01:25:42.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:41.999+0000 7fc33d5e9740 1 -- 172.21.15.12:0/4106379744 wait complete. 2024-09-05T01:25:42.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.000+0000 7fc33d5e9740 1 -- start start 2024-09-05T01:25:42.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.000+0000 7fc33d5e9740 1 Processor -- start 2024-09-05T01:25:42.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.001+0000 7fc33d5e9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1e077bcb0 0x55c1e078b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:42.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.001+0000 7fc33d5e9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1e077c5d0 0x55c1e078ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:42.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.001+0000 7fc33d5e9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1e0786e90 0x55c1e07fabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:42.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.001+0000 7fc33d5e9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc31400fcf0 con 0x55c1e0786e90 2024-09-05T01:25:42.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.001+0000 7fc33d5e9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc31400f620 con 0x55c1e077c5d0 2024-09-05T01:25:42.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.001+0000 7fc33d5e9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc31400c860 con 0x55c1e077bcb0 2024-09-05T01:25:42.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.001+0000 7fc33d5e9740 10 client.0 _ll_register_callbacks cb 0x7fc32c0094c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:42.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.002+0000 7fc333e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1e077bcb0 0x55c1e078b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:42.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.002+0000 7fc333e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1e077bcb0 0x55c1e078b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:41896/0 (socket says 172.21.15.12:41896) 2024-09-05T01:25:42.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.002+0000 7fc333e00640 1 -- 172.21.15.12:0/924691230 learned_addr learned my addr 172.21.15.12:0/924691230 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:42.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.002+0000 7fc338c00640 1 --2- 172.21.15.12:0/924691230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1e0786e90 0x55c1e07fabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:42.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.002+0000 7fc338c00640 1 -- 172.21.15.12:0/924691230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1e077bcb0 msgr2=0x55c1e078b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:42.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.002+0000 7fc338c00640 1 --2- 172.21.15.12:0/924691230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1e077bcb0 0x55c1e078b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:42.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.002+0000 7fc338c00640 1 -- 172.21.15.12:0/924691230 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1e077c5d0 msgr2=0x55c1e078ba90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:25:42.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.002+0000 7fc338c00640 1 --2- 172.21.15.12:0/924691230 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1e077c5d0 0x55c1e078ba90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:42.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.002+0000 7fc338c00640 1 -- 172.21.15.12:0/924691230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1e07fb1f0 con 0x55c1e0786e90 2024-09-05T01:25:42.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.003+0000 7fc338c00640 1 --2- 172.21.15.12:0/924691230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1e0786e90 0x55c1e07fabb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc32c000f80 tx=0x7fc32c0316a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eeed9ee2a906bd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:42.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.003+0000 7fc31d600640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:25:42.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.004+0000 7fc31d600640 1 -- 172.21.15.12:0/924691230 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c03e060 con 0x55c1e0786e90 2024-09-05T01:25:42.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.004+0000 7fc31d600640 1 -- 172.21.15.12:0/924691230 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fc32c031b00 con 0x55c1e0786e90 2024-09-05T01:25:42.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.004+0000 7fc33d5e9740 1 -- 172.21.15.12:0/924691230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc324099f20 con 0x55c1e0786e90 2024-09-05T01:25:42.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.004+0000 7fc31d600640 1 -- 172.21.15.12:0/924691230 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc32c009590 con 0x55c1e0786e90 2024-09-05T01:25:42.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.004+0000 7fc33d5e9740 10 client.15441 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:42.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.004+0000 7fc33d5e9740 1 -- 172.21.15.12:0/924691230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c1e08025c0 con 0x55c1e0786e90 2024-09-05T01:25:42.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.006+0000 7fc31d600640 1 -- 172.21.15.12:0/924691230 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc324099f20 con 0x55c1e0786e90 2024-09-05T01:25:42.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.006+0000 7fc31d600640 1 -- 172.21.15.12:0/924691230 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc32c0274d0 con 0x55c1e0786e90 2024-09-05T01:25:42.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.006+0000 7fc33d5e9740 10 client.15441 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:42.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.006+0000 7fc33d5e9740 10 client.15441 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:25:42.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.006+0000 7fc33d5e9740 20 client.15441 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:42.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.006+0000 7fc33d5e9740 1 --2- 172.21.15.12:0/924691230 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55c1e0796eb0 0x55c1e0804c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:42.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.006+0000 7fc33d5e9740 4 client.15441 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-05T01:25:42.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.006+0000 7fc33d5e9740 1 -- 172.21.15.12:0/924691230 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c1e06e9d10 con 0x55c1e0796eb0 2024-09-05T01:25:42.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.006+0000 7fc333e00640 1 --2- 172.21.15.12:0/924691230 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55c1e0796eb0 0x55c1e0804c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:42.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.007+0000 7fc31d600640 10 client.15441 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:25:42.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.008+0000 7fc333e00640 1 --2- 172.21.15.12:0/924691230 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55c1e0796eb0 0x55c1e0804c10 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b4af5e37f8044f9 server_cookie=6207769da7dc8ed3 in_seq=0 out_seq=0 2024-09-05T01:25:42.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.009+0000 7fc31d600640 1 -- 172.21.15.12:0/924691230 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c1e06e9d10 con 0x55c1e0796eb0 2024-09-05T01:25:42.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.009+0000 7fc31d600640 10 client.15441 handle_command_reply: tid=0 2024-09-05T01:25:42.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.009+0000 7fc33d5e9740 1 client.15441 shutdown 2024-09-05T01:25:42.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.010+0000 7fc33d5e9740 1 -- 172.21.15.12:0/924691230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1e0786e90 msgr2=0x55c1e07fabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:42.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.010+0000 7fc33d5e9740 1 --2- 172.21.15.12:0/924691230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1e0786e90 0x55c1e07fabb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc32c000f80 tx=0x7fc32c0316a0 comp rx=0 tx=0).stop 2024-09-05T01:25:42.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.011+0000 7fc33d5e9740 1 -- 172.21.15.12:0/924691230 shutdown_connections 2024-09-05T01:25:42.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.011+0000 7fc33d5e9740 1 --2- 172.21.15.12:0/924691230 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55c1e0796eb0 0x55c1e0804c10 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:42.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.011+0000 7fc33d5e9740 1 --2- 172.21.15.12:0/924691230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c1e0786e90 0x55c1e07fabb0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:42.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.011+0000 7fc33d5e9740 1 --2- 172.21.15.12:0/924691230 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c1e077c5d0 0x55c1e078ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:42.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.011+0000 7fc33d5e9740 1 --2- 172.21.15.12:0/924691230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1e077bcb0 0x55c1e078b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:42.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.011+0000 7fc33d5e9740 1 -- 172.21.15.12:0/924691230 >> 172.21.15.12:0/924691230 conn(0x55c1e0778240 msgr2=0x55c1e07859e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:42.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.011+0000 7fc31d600640 0 client.15441 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:25:42.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.011+0000 7fc33d5e9740 1 -- 172.21.15.12:0/924691230 shutdown_connections 2024-09-05T01:25:42.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.012+0000 7fc33d5e9740 1 -- 172.21.15.12:0/924691230 wait complete. 2024-09-05T01:25:42.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.012+0000 7fc33d5e9740 20 client.15441 trim_cache size 0 max 16384 2024-09-05T01:25:42.014 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:25:42.014 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-05T01:25:42.014 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "91d06399-8b5f-45e5-9b78-6c8c7819a172", 2024-09-05T01:25:42.014 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-05T01:25:42.014 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:25:42.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.014+0000 7fc339600640 1 -- 172.21.15.12:0/1806833326 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc3180a2e90 msgr2=0x7fc3180a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:42.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.014+0000 7fc339600640 1 --2- 172.21.15.12:0/1806833326 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc3180a2e90 0x7fc3180a5350 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc32c005fd0 tx=0x7fc32c009a70 comp rx=0 tx=0).stop 2024-09-05T01:25:42.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.014+0000 7fc339600640 1 -- 172.21.15.12:0/1806833326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc334102b90 msgr2=0x7fc33410b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:42.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.014+0000 7fc339600640 1 --2- 172.21.15.12:0/1806833326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc334102b90 0x7fc33410b5d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc32400e9f0 tx=0x7fc32400eeb0 comp rx=0 tx=0).stop 2024-09-05T01:25:42.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.014+0000 7fc339600640 1 -- 172.21.15.12:0/1806833326 shutdown_connections 2024-09-05T01:25:42.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.014+0000 7fc339600640 1 --2- 172.21.15.12:0/1806833326 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc3180a2e90 0x7fc3180a5350 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:42.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.014+0000 7fc339600640 1 --2- 172.21.15.12:0/1806833326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc33410bfc0 0x7fc334108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:42.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.014+0000 7fc339600640 1 --2- 172.21.15.12:0/1806833326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3341034b0 0x7fc334108680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:42.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.014+0000 7fc339600640 1 --2- 172.21.15.12:0/1806833326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc334102b90 0x7fc33410b5d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:42.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.014+0000 7fc339600640 1 -- 172.21.15.12:0/1806833326 >> 172.21.15.12:0/1806833326 conn(0x7fc3340fc610 msgr2=0x7fc33410d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:42.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.015+0000 7fc339600640 1 -- 172.21.15.12:0/1806833326 shutdown_connections 2024-09-05T01:25:42.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:42.015+0000 7fc339600640 1 -- 172.21.15.12:0/1806833326 wait complete. 2024-09-05T01:25:42.764 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:42 smithi012 ceph-mon[29942]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-05T01:25:42.764 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:42 smithi012 ceph-mon[29942]: scrub queued for path: / 2024-09-05T01:25:42.764 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:42 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:25:42.764 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:42 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:25:42.765 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:42 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:25:42.765 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:42 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:25:42.851 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T01:25:43.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:42 smithi145 ceph-mon[34376]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-05T01:25:43.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:42 smithi145 ceph-mon[34376]: scrub queued for path: / 2024-09-05T01:25:43.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:42 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:25:43.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:42 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:25:43.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:42 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:25:43.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:42 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:25:43.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:42 smithi151 ceph-mon[35013]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-05T01:25:43.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:42 smithi151 ceph-mon[35013]: scrub queued for path: / 2024-09-05T01:25:43.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:42 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:25:43.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:42 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:25:43.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:42 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:25:43.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:42 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:25:43.268 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:25:43.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.880+0000 7f2aee600640 1 -- 172.21.15.12:0/1661710342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ae8112a30 msgr2=0x7f2ae8114e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:43.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.880+0000 7f2aee600640 1 --2- 172.21.15.12:0/1661710342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ae8112a30 0x7f2ae8114e20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0009ca0 tx=0x7f2ae002a8c0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.880+0000 7f2aee600640 1 -- 172.21.15.12:0/1661710342 shutdown_connections 2024-09-05T01:25:43.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.880+0000 7f2aee600640 1 --2- 172.21.15.12:0/1661710342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ae8112a30 0x7f2ae8114e20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.880+0000 7f2aee600640 1 --2- 172.21.15.12:0/1661710342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2ae8077040 0x7f2ae81124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.880+0000 7f2aee600640 1 --2- 172.21.15.12:0/1661710342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae8076720 0x7f2ae8076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.880+0000 7f2aee600640 1 -- 172.21.15.12:0/1661710342 >> 172.21.15.12:0/1661710342 conn(0x7f2ae80ffa90 msgr2=0x7f2ae8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:43.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.880+0000 7f2aee600640 1 -- 172.21.15.12:0/1661710342 shutdown_connections 2024-09-05T01:25:43.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.880+0000 7f2aee600640 1 -- 172.21.15.12:0/1661710342 wait complete. 2024-09-05T01:25:43.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.882+0000 7f2aee600640 1 Processor -- start 2024-09-05T01:25:43.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.882+0000 7f2aee600640 1 -- start start 2024-09-05T01:25:43.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.882+0000 7f2aee600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ae8076720 0x7f2ae81a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:43.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.883+0000 7f2aee600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2ae8077040 0x7f2ae81a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:43.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.883+0000 7f2aee600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae8112a30 0x7f2ae819e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:43.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.883+0000 7f2aee600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae8118570 con 0x7f2ae8112a30 2024-09-05T01:25:43.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.883+0000 7f2aee600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae81183f0 con 0x7f2ae8077040 2024-09-05T01:25:43.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.883+0000 7f2aee600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae81186f0 con 0x7f2ae8076720 2024-09-05T01:25:43.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.883+0000 7f2ae7400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ae8076720 0x7f2ae81a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:43.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.883+0000 7f2ae7400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ae8076720 0x7f2ae81a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:41916/0 (socket says 172.21.15.12:41916) 2024-09-05T01:25:43.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.883+0000 7f2ae7400640 1 -- 172.21.15.12:0/59375828 learned_addr learned my addr 172.21.15.12:0/59375828 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:43.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.883+0000 7f2ae7400640 1 -- 172.21.15.12:0/59375828 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2ae8077040 msgr2=0x7f2ae81a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:43.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.883+0000 7f2ae7400640 1 --2- 172.21.15.12:0/59375828 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2ae8077040 0x7f2ae81a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.883+0000 7f2ae7400640 1 -- 172.21.15.12:0/59375828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae8112a30 msgr2=0x7f2ae819e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:43.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.883+0000 7f2ae7400640 1 --2- 172.21.15.12:0/59375828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae8112a30 0x7f2ae819e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.883+0000 7f2ae7400640 1 -- 172.21.15.12:0/59375828 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae819efc0 con 0x7f2ae8076720 2024-09-05T01:25:43.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.884+0000 7f2ae7400640 1 --2- 172.21.15.12:0/59375828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ae8076720 0x7f2ae81a46a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2ad800ea60 tx=0x7f2ad800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:43.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.884+0000 7f2adfe00640 1 -- 172.21.15.12:0/59375828 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad800cde0 con 0x7f2ae8076720 2024-09-05T01:25:43.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.884+0000 7f2adfe00640 1 -- 172.21.15.12:0/59375828 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ad80035f0 con 0x7f2ae8076720 2024-09-05T01:25:43.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.884+0000 7f2adfe00640 1 -- 172.21.15.12:0/59375828 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8010670 con 0x7f2ae8076720 2024-09-05T01:25:43.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.884+0000 7f2aee600640 1 -- 172.21.15.12:0/59375828 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ae819f2b0 con 0x7f2ae8076720 2024-09-05T01:25:43.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.885+0000 7f2aee600640 1 -- 172.21.15.12:0/59375828 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ae81ab500 con 0x7f2ae8076720 2024-09-05T01:25:43.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.888+0000 7f2af1250740 1 Processor -- start 2024-09-05T01:25:43.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.888+0000 7f2af1250740 1 -- start start 2024-09-05T01:25:43.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.888+0000 7f2af1250740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558583fdeb90 0x558583fdef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:43.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.889+0000 7f2af1250740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558583fdf4b0 0x558583fe9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:43.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.889+0000 7f2af1250740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fe9d70 0x558583fec160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:43.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.889+0000 7f2af1250740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558583f453e0 con 0x558583fdeb90 2024-09-05T01:25:43.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.889+0000 7f2af1250740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x558583eecd80 con 0x558583fe9d70 2024-09-05T01:25:43.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.889+0000 7f2af1250740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558583f413a0 con 0x558583fdf4b0 2024-09-05T01:25:43.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.889+0000 7f2ae6a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fe9d70 0x558583fec160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:43.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.889+0000 7f2ae6a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fe9d70 0x558583fec160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:43444/0 (socket says 172.21.15.12:43444) 2024-09-05T01:25:43.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.889+0000 7f2ae6a00640 1 -- 172.21.15.12:0/3223976817 learned_addr learned my addr 172.21.15.12:0/3223976817 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:43.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.889+0000 7f2ae7e00640 1 --2- 172.21.15.12:0/3223976817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558583fdeb90 0x558583fdef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:43.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.890+0000 7f2adfe00640 1 -- 172.21.15.12:0/59375828 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) ==== 138066+0+0 (secure 0 0 0) 0x7f2ad80037a0 con 0x7f2ae8076720 2024-09-05T01:25:43.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.890+0000 7f2ae6a00640 1 -- 172.21.15.12:0/3223976817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558583fdf4b0 msgr2=0x558583fe9830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:25:43.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.890+0000 7f2ae6a00640 1 --2- 172.21.15.12:0/3223976817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558583fdf4b0 0x558583fe9830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.890+0000 7f2ae6a00640 1 -- 172.21.15.12:0/3223976817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558583fdeb90 msgr2=0x558583fdef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:43.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.890+0000 7f2ae6a00640 1 --2- 172.21.15.12:0/3223976817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558583fdeb90 0x558583fdef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.890+0000 7f2ae6a00640 1 -- 172.21.15.12:0/3223976817 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558583f0bae0 con 0x558583fe9d70 2024-09-05T01:25:43.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.890+0000 7f2ae7e00640 1 --2- 172.21.15.12:0/3223976817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558583fdeb90 0x558583fdef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:25:43.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.891+0000 7f2ae6a00640 1 --2- 172.21.15.12:0/3223976817 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fe9d70 0x558583fec160 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009b30 tx=0x7f2ad400e350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3190082887cfcb58 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:43.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.891+0000 7f2adcc00640 1 -- 172.21.15.12:0/3223976817 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad400ed80 con 0x558583fe9d70 2024-09-05T01:25:43.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.891+0000 7f2adcc00640 1 -- 172.21.15.12:0/3223976817 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ad4005500 con 0x558583fe9d70 2024-09-05T01:25:43.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.891+0000 7f2adcc00640 1 -- 172.21.15.12:0/3223976817 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4010670 con 0x558583fe9d70 2024-09-05T01:25:43.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.892+0000 7f2af1250740 1 -- 172.21.15.12:0/3223976817 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fe9d70 msgr2=0x558583fec160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:43.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.892+0000 7f2af1250740 1 --2- 172.21.15.12:0/3223976817 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fe9d70 0x558583fec160 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009b30 tx=0x7f2ad400e350 comp rx=0 tx=0).stop 2024-09-05T01:25:43.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.892+0000 7f2af1250740 1 -- 172.21.15.12:0/3223976817 shutdown_connections 2024-09-05T01:25:43.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.892+0000 7f2af1250740 1 --2- 172.21.15.12:0/3223976817 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fe9d70 0x558583fec160 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.892+0000 7f2af1250740 1 --2- 172.21.15.12:0/3223976817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558583fdf4b0 0x558583fe9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.892+0000 7f2af1250740 1 --2- 172.21.15.12:0/3223976817 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558583fdeb90 0x558583fdef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.892+0000 7f2af1250740 1 -- 172.21.15.12:0/3223976817 >> 172.21.15.12:0/3223976817 conn(0x558583fdb120 msgr2=0x558583fdb500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:43.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.892+0000 7f2adfe00640 1 --2- 172.21.15.12:0/59375828 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f2acc0a2fe0 0x7f2acc0a54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:43.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.892+0000 7f2af1250740 1 -- 172.21.15.12:0/3223976817 shutdown_connections 2024-09-05T01:25:43.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.893+0000 7f2adfe00640 1 -- 172.21.15.12:0/59375828 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f2ad80cfb20 con 0x7f2ae8076720 2024-09-05T01:25:43.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.893+0000 7f2af1250740 1 -- 172.21.15.12:0/3223976817 wait complete. 2024-09-05T01:25:43.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.893+0000 7f2af1250740 1 -- start start 2024-09-05T01:25:43.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.894+0000 7f2ae6a00640 1 --2- 172.21.15.12:0/59375828 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f2acc0a2fe0 0x7f2acc0a54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:43.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.894+0000 7f2af1250740 1 Processor -- start 2024-09-05T01:25:43.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.894+0000 7f2af1250740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558583fdeb90 0x558583fe6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:43.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.894+0000 7f2af1250740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fdf4b0 0x558583fe71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:43.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.894+0000 7f2af1250740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558583fe9d70 0x558583fe7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:43.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.894+0000 7f2af1250740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558583fec9e0 con 0x558583fdeb90 2024-09-05T01:25:43.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.894+0000 7f2af1250740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x558583f000f0 con 0x558583fdf4b0 2024-09-05T01:25:43.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.894+0000 7f2af1250740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558583fecb60 con 0x558583fe9d70 2024-09-05T01:25:43.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.894+0000 7f2af1250740 10 client.0 _ll_register_callbacks cb 0x558583ef19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:43.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.895+0000 7f2ae7400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558583fdeb90 0x558583fe6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:43.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.895+0000 7f2ae6a00640 1 --2- 172.21.15.12:0/59375828 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f2acc0a2fe0 0x7f2acc0a54a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2ad400e850 tx=0x7f2ad4000bc0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:43.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.895+0000 7f2ae7400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558583fdeb90 0x558583fe6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48590/0 (socket says 172.21.15.12:48590) 2024-09-05T01:25:43.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.895+0000 7f2ae7400640 1 -- 172.21.15.12:0/578457853 learned_addr learned my addr 172.21.15.12:0/578457853 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:43.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.895+0000 7f2ae6a00640 1 --2- 172.21.15.12:0/578457853 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fdf4b0 0x558583fe71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:43.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.896+0000 7f2ae7400640 1 -- 172.21.15.12:0/578457853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558583fe9d70 msgr2=0x558583fe7700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:25:43.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.896+0000 7f2ae7400640 1 --2- 172.21.15.12:0/578457853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558583fe9d70 0x558583fe7700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.896+0000 7f2ae7400640 1 -- 172.21.15.12:0/578457853 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fdf4b0 msgr2=0x558583fe71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.896+0000 7f2ae7400640 1 --2- 172.21.15.12:0/578457853 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fdf4b0 0x558583fe71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.896+0000 7f2ae7400640 1 -- 172.21.15.12:0/578457853 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558583cb63c0 con 0x558583fdeb90 2024-09-05T01:25:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.896+0000 7f2ae7400640 1 --2- 172.21.15.12:0/578457853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558583fdeb90 0x558583fe6c80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80981e0 tx=0x7f2ad809b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ac24995c80bac server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.896+0000 7f2ad1600640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:25:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.896+0000 7f2ad1600640 1 -- 172.21.15.12:0/578457853 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad80a0130 con 0x558583fdeb90 2024-09-05T01:25:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.896+0000 7f2af1250740 1 -- 172.21.15.12:0/578457853 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ad4005500 con 0x558583fdeb90 2024-09-05T01:25:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.896+0000 7f2ad1600640 1 -- 172.21.15.12:0/578457853 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f2ad80983f0 con 0x558583fdeb90 2024-09-05T01:25:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.897+0000 7f2ad1600640 1 -- 172.21.15.12:0/578457853 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2ad80a49f0 con 0x558583fdeb90 2024-09-05T01:25:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.897+0000 7f2af1250740 10 client.15450 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.897+0000 7f2af1250740 1 -- 172.21.15.12:0/578457853 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558584009720 con 0x558583fdeb90 2024-09-05T01:25:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.897+0000 7f2ad1600640 1 -- 172.21.15.12:0/578457853 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ad4005500 con 0x558583fdeb90 2024-09-05T01:25:43.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.898+0000 7f2ad1600640 1 -- 172.21.15.12:0/578457853 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2ad809b260 con 0x558583fdeb90 2024-09-05T01:25:43.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.898+0000 7f2af1250740 10 client.15450 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:43.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.898+0000 7f2af1250740 10 client.15450 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:25:43.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.898+0000 7f2af1250740 20 client.15450 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:43.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.898+0000 7f2af1250740 1 --2- 172.21.15.12:0/578457853 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55858400ab30 0x55858400cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:43.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.898+0000 7f2af1250740 4 client.15450 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:25:43.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.898+0000 7f2af1250740 1 -- 172.21.15.12:0/578457853 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558583f52950 con 0x55858400ab30 2024-09-05T01:25:43.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.898+0000 7f2ae6a00640 1 --2- 172.21.15.12:0/578457853 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55858400ab30 0x55858400cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:43.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.899+0000 7f2ae6a00640 1 --2- 172.21.15.12:0/578457853 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55858400ab30 0x55858400cf40 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cf683b184a8525b server_cookie=f279519d2bd8b93c in_seq=0 out_seq=0 2024-09-05T01:25:43.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.899+0000 7f2ad1600640 10 client.15450 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:25:43.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.900+0000 7f2ad1600640 1 -- 172.21.15.12:0/578457853 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558583f52950 con 0x55858400ab30 2024-09-05T01:25:43.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.900+0000 7f2ad1600640 10 client.15450 handle_command_reply: tid=0 2024-09-05T01:25:43.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.900+0000 7f2af1250740 1 client.15450 shutdown 2024-09-05T01:25:43.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.900+0000 7f2af1250740 1 -- 172.21.15.12:0/578457853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558583fdeb90 msgr2=0x558583fe6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:43.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.900+0000 7f2af1250740 1 --2- 172.21.15.12:0/578457853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558583fdeb90 0x558583fe6c80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80981e0 tx=0x7f2ad809b980 comp rx=0 tx=0).stop 2024-09-05T01:25:43.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.901+0000 7f2af1250740 1 -- 172.21.15.12:0/578457853 shutdown_connections 2024-09-05T01:25:43.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.901+0000 7f2af1250740 1 --2- 172.21.15.12:0/578457853 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55858400ab30 0x55858400cf40 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.901+0000 7f2af1250740 1 --2- 172.21.15.12:0/578457853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558583fe9d70 0x558583fe7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.901+0000 7f2af1250740 1 --2- 172.21.15.12:0/578457853 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fdf4b0 0x558583fe71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.901+0000 7f2af1250740 1 --2- 172.21.15.12:0/578457853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558583fdeb90 0x558583fe6c80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.901+0000 7f2af1250740 1 -- 172.21.15.12:0/578457853 >> 172.21.15.12:0/578457853 conn(0x558583fdb120 msgr2=0x558583fe0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:43.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.901+0000 7f2ad1600640 0 client.15450 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:25:43.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.901+0000 7f2af1250740 1 -- 172.21.15.12:0/578457853 shutdown_connections 2024-09-05T01:25:43.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.901+0000 7f2af1250740 1 -- 172.21.15.12:0/578457853 wait complete. 2024-09-05T01:25:43.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.901+0000 7f2af1250740 20 client.15450 trim_cache size 0 max 16384 2024-09-05T01:25:43.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.937+0000 7f2af1250740 1 Processor -- start 2024-09-05T01:25:43.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.937+0000 7f2af1250740 1 -- start start 2024-09-05T01:25:43.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.937+0000 7f2af1250740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558583fdeb90 0x558584012810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:43.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.937+0000 7f2af1250740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fdf4b0 0x558584012d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:43.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.937+0000 7f2af1250740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558583fe9d70 0x558583fe3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:43.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.937+0000 7f2af1250740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae81ab790 con 0x558583fe9d70 2024-09-05T01:25:43.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.937+0000 7f2af1250740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae81ad250 con 0x558583fdf4b0 2024-09-05T01:25:43.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.937+0000 7f2af1250740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae81abde0 con 0x558583fdeb90 2024-09-05T01:25:43.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.938+0000 7f2ae6a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fdf4b0 0x558584012d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:43.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.938+0000 7f2ae6a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fdf4b0 0x558584012d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:43464/0 (socket says 172.21.15.12:43464) 2024-09-05T01:25:43.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.938+0000 7f2ae6a00640 1 -- 172.21.15.12:0/2272536645 learned_addr learned my addr 172.21.15.12:0/2272536645 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.938+0000 7f2ae7400640 1 --2- 172.21.15.12:0/2272536645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558583fdeb90 0x558584012810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.938+0000 7f2ae7e00640 1 --2- 172.21.15.12:0/2272536645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558583fe9d70 0x558583fe3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:43.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.938+0000 7f2ae7400640 1 -- 172.21.15.12:0/2272536645 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fdf4b0 msgr2=0x558584012d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:43.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.938+0000 7f2ae7400640 1 --2- 172.21.15.12:0/2272536645 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fdf4b0 0x558584012d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.938+0000 7f2ae7400640 1 -- 172.21.15.12:0/2272536645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558583fe9d70 msgr2=0x558583fe3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:43.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.938+0000 7f2ae7400640 1 --2- 172.21.15.12:0/2272536645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558583fe9d70 0x558583fe3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.938+0000 7f2ae7400640 1 -- 172.21.15.12:0/2272536645 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558583fdc2b0 con 0x558583fdeb90 2024-09-05T01:25:43.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.939+0000 7f2ae7400640 1 --2- 172.21.15.12:0/2272536645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558583fdeb90 0x558584012810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2ad809bd10 tx=0x7f2ad809b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1180616fc0f8cdfb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:43.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.939+0000 7f2ad3e00640 1 -- 172.21.15.12:0/2272536645 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8097e10 con 0x558583fdeb90 2024-09-05T01:25:43.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.939+0000 7f2ad3e00640 1 -- 172.21.15.12:0/2272536645 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ad80a0130 con 0x558583fdeb90 2024-09-05T01:25:43.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.939+0000 7f2ad3e00640 1 -- 172.21.15.12:0/2272536645 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad809afc0 con 0x558583fdeb90 2024-09-05T01:25:43.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.940+0000 7f2af1250740 1 -- 172.21.15.12:0/2272536645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558583fdeb90 msgr2=0x558584012810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:43.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.940+0000 7f2af1250740 1 --2- 172.21.15.12:0/2272536645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558583fdeb90 0x558584012810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2ad809bd10 tx=0x7f2ad809b9f0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.940+0000 7f2af1250740 1 -- 172.21.15.12:0/2272536645 shutdown_connections 2024-09-05T01:25:43.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.940+0000 7f2af1250740 1 --2- 172.21.15.12:0/2272536645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558583fe9d70 0x558583fe3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.940+0000 7f2af1250740 1 --2- 172.21.15.12:0/2272536645 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fdf4b0 0x558584012d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.940+0000 7f2af1250740 1 --2- 172.21.15.12:0/2272536645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558583fdeb90 0x558584012810 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.940+0000 7f2af1250740 1 -- 172.21.15.12:0/2272536645 >> 172.21.15.12:0/2272536645 conn(0x558583fdb120 msgr2=0x558583fe8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:43.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.941+0000 7f2af1250740 1 -- 172.21.15.12:0/2272536645 shutdown_connections 2024-09-05T01:25:43.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.941+0000 7f2af1250740 1 -- 172.21.15.12:0/2272536645 wait complete. 2024-09-05T01:25:43.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.941+0000 7f2af1250740 1 -- start start 2024-09-05T01:25:43.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.942+0000 7f2af1250740 1 Processor -- start 2024-09-05T01:25:43.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.942+0000 7f2af1250740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fdeb90 0x558583ff1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:43.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.942+0000 7f2af1250740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558583fdf4b0 0x558583ff24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:43.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.942+0000 7f2af1250740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558583fe9d70 0x558583feed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:43.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.942+0000 7f2af1250740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae81acb80 con 0x558583fe9d70 2024-09-05T01:25:43.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.942+0000 7f2af1250740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae81ac4b0 con 0x558583fdeb90 2024-09-05T01:25:43.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.942+0000 7f2af1250740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae8072380 con 0x558583fdf4b0 2024-09-05T01:25:43.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.942+0000 7f2af1250740 10 client.0 _ll_register_callbacks cb 0x7f2ad809bb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:43.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.943+0000 7f2ae7400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fdeb90 0x558583ff1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:43.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.943+0000 7f2ae7400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fdeb90 0x558583ff1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:43472/0 (socket says 172.21.15.12:43472) 2024-09-05T01:25:43.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.943+0000 7f2ae7400640 1 -- 172.21.15.12:0/1145867866 learned_addr learned my addr 172.21.15.12:0/1145867866 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:43.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.943+0000 7f2ae6a00640 1 --2- 172.21.15.12:0/1145867866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558583fdf4b0 0x558583ff24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:43.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.943+0000 7f2ae7e00640 1 --2- 172.21.15.12:0/1145867866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558583fe9d70 0x558583feed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:43.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.944+0000 7f2ae7400640 1 -- 172.21.15.12:0/1145867866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558583fdf4b0 msgr2=0x558583ff24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:43.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.944+0000 7f2ae7400640 1 --2- 172.21.15.12:0/1145867866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558583fdf4b0 0x558583ff24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.944+0000 7f2ae7400640 1 -- 172.21.15.12:0/1145867866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558583fe9d70 msgr2=0x558583feed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:43.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.944+0000 7f2ae7400640 1 --2- 172.21.15.12:0/1145867866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558583fe9d70 0x558583feed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.944+0000 7f2ae7400640 1 -- 172.21.15.12:0/1145867866 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558583fef5b0 con 0x558583fdeb90 2024-09-05T01:25:43.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.944+0000 7f2ae6a00640 1 --2- 172.21.15.12:0/1145867866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558583fdf4b0 0x558583ff24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:25:43.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.944+0000 7f2ad1600640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:25:43.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.944+0000 7f2ae7400640 1 --2- 172.21.15.12:0/1145867866 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fdeb90 0x558583ff1f90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8097be0 tx=0x7f2ad8003d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2151b4a1f10d80a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:43.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.944+0000 7f2ad1600640 1 -- 172.21.15.12:0/1145867866 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad80ab070 con 0x558583fdeb90 2024-09-05T01:25:43.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.945+0000 7f2ad1600640 1 -- 172.21.15.12:0/1145867866 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f2ad809b1d0 con 0x558583fdeb90 2024-09-05T01:25:43.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.945+0000 7f2af1250740 1 -- 172.21.15.12:0/1145867866 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ad80a0130 con 0x558583fdeb90 2024-09-05T01:25:43.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.945+0000 7f2ad1600640 1 -- 172.21.15.12:0/1145867866 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2ad8097e10 con 0x558583fdeb90 2024-09-05T01:25:43.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.945+0000 7f2af1250740 10 client.25460 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:43.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.945+0000 7f2af1250740 1 -- 172.21.15.12:0/1145867866 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558584076240 con 0x558583fdeb90 2024-09-05T01:25:43.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.945+0000 7f2ad1600640 1 -- 172.21.15.12:0/1145867866 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ad80a0130 con 0x558583fdeb90 2024-09-05T01:25:43.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.945+0000 7f2ad1600640 1 -- 172.21.15.12:0/1145867866 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2ad80a12c0 con 0x558583fdeb90 2024-09-05T01:25:43.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.946+0000 7f2af1250740 10 client.25460 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:43.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.946+0000 7f2af1250740 10 client.25460 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:25:43.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.946+0000 7f2af1250740 20 client.25460 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:43.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.946+0000 7f2af1250740 1 --2- 172.21.15.12:0/1145867866 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558584076710 0x558584078b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:43.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.946+0000 7f2af1250740 4 client.25460 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T01:25:43.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.946+0000 7f2af1250740 1 -- 172.21.15.12:0/1145867866 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558583f4ce60 con 0x558584076710 2024-09-05T01:25:43.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.946+0000 7f2ae6a00640 1 --2- 172.21.15.12:0/1145867866 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558584076710 0x558584078b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:43.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.947+0000 7f2ae6a00640 1 --2- 172.21.15.12:0/1145867866 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558584076710 0x558584078b00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d42189c97b375ad4 server_cookie=e0fceda276ba917 in_seq=0 out_seq=0 2024-09-05T01:25:43.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.947+0000 7f2ad1600640 10 client.25460 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:25:43.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.947+0000 7f2ad1600640 1 -- 172.21.15.12:0/1145867866 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558583f4ce60 con 0x558584076710 2024-09-05T01:25:43.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.947+0000 7f2ad1600640 10 client.25460 handle_command_reply: tid=0 2024-09-05T01:25:43.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.947+0000 7f2af1250740 1 client.25460 shutdown 2024-09-05T01:25:43.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.947+0000 7f2af1250740 1 -- 172.21.15.12:0/1145867866 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fdeb90 msgr2=0x558583ff1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:43.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.947+0000 7f2af1250740 1 --2- 172.21.15.12:0/1145867866 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fdeb90 0x558583ff1f90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8097be0 tx=0x7f2ad8003d60 comp rx=0 tx=0).stop 2024-09-05T01:25:43.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.948+0000 7f2af1250740 1 -- 172.21.15.12:0/1145867866 shutdown_connections 2024-09-05T01:25:43.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.948+0000 7f2af1250740 1 --2- 172.21.15.12:0/1145867866 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558584076710 0x558584078b00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.948+0000 7f2af1250740 1 --2- 172.21.15.12:0/1145867866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558583fe9d70 0x558583feed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.948+0000 7f2af1250740 1 --2- 172.21.15.12:0/1145867866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558583fdf4b0 0x558583ff24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.948+0000 7f2af1250740 1 --2- 172.21.15.12:0/1145867866 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558583fdeb90 0x558583ff1f90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.948+0000 7f2af1250740 1 -- 172.21.15.12:0/1145867866 >> 172.21.15.12:0/1145867866 conn(0x558583fdb120 msgr2=0x558583fd99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:43.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.948+0000 7f2ad1600640 0 client.25460 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:25:43.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.948+0000 7f2af1250740 1 -- 172.21.15.12:0/1145867866 shutdown_connections 2024-09-05T01:25:43.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.948+0000 7f2af1250740 1 -- 172.21.15.12:0/1145867866 wait complete. 2024-09-05T01:25:43.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.948+0000 7f2af1250740 20 client.25460 trim_cache size 0 max 16384 2024-09-05T01:25:43.951 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:25:43.951 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-05T01:25:43.951 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-05T01:25:43.951 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:25:43.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.949+0000 7f2aee600640 1 -- 172.21.15.12:0/59375828 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f2acc0a2fe0 msgr2=0x7f2acc0a54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:43.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.949+0000 7f2aee600640 1 --2- 172.21.15.12:0/59375828 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f2acc0a2fe0 0x7f2acc0a54a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2ad400e850 tx=0x7f2ad4000bc0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.949+0000 7f2aee600640 1 -- 172.21.15.12:0/59375828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ae8076720 msgr2=0x7f2ae81a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:43.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.949+0000 7f2aee600640 1 --2- 172.21.15.12:0/59375828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ae8076720 0x7f2ae81a46a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2ad800ea60 tx=0x7f2ad800ef20 comp rx=0 tx=0).stop 2024-09-05T01:25:43.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.949+0000 7f2aee600640 1 -- 172.21.15.12:0/59375828 shutdown_connections 2024-09-05T01:25:43.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.949+0000 7f2aee600640 1 --2- 172.21.15.12:0/59375828 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f2acc0a2fe0 0x7f2acc0a54a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.949+0000 7f2aee600640 1 --2- 172.21.15.12:0/59375828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae8112a30 0x7f2ae819e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.949+0000 7f2aee600640 1 --2- 172.21.15.12:0/59375828 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2ae8077040 0x7f2ae81a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.949+0000 7f2aee600640 1 --2- 172.21.15.12:0/59375828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ae8076720 0x7f2ae81a46a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:43.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.949+0000 7f2aee600640 1 -- 172.21.15.12:0/59375828 >> 172.21.15.12:0/59375828 conn(0x7f2ae80ffa90 msgr2=0x7f2ae8101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:43.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.950+0000 7f2aee600640 1 -- 172.21.15.12:0/59375828 shutdown_connections 2024-09-05T01:25:43.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:43.950+0000 7f2aee600640 1 -- 172.21.15.12:0/59375828 wait complete. 2024-09-05T01:25:44.767 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:44 smithi012 ceph-mon[29942]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-05T01:25:44.939 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-05T01:25:44.940 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:25:45.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:44 smithi145 ceph-mon[34376]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-05T01:25:45.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:44 smithi151 ceph-mon[35013]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-05T01:25:45.500 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:25:46.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.116+0000 7f2971400640 1 -- 172.21.15.12:0/2130202505 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f296c074e30 msgr2=0x7f296c10dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:46.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.116+0000 7f2971400640 1 --2- 172.21.15.12:0/2130202505 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f296c074e30 0x7f296c10dd40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2954009900 tx=0x7f295402a480 comp rx=0 tx=0).stop 2024-09-05T01:25:46.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.116+0000 7f2971400640 1 -- 172.21.15.12:0/2130202505 shutdown_connections 2024-09-05T01:25:46.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.116+0000 7f2971400640 1 --2- 172.21.15.12:0/2130202505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f296c10e280 0x7f296c110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:46.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.116+0000 7f2971400640 1 --2- 172.21.15.12:0/2130202505 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f296c074e30 0x7f296c10dd40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:46.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.116+0000 7f2971400640 1 --2- 172.21.15.12:0/2130202505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f296c074510 0x7f296c0748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:46.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.116+0000 7f2971400640 1 -- 172.21.15.12:0/2130202505 >> 172.21.15.12:0/2130202505 conn(0x7f296c0fd740 msgr2=0x7f296c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:46.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.116+0000 7f2971400640 1 -- 172.21.15.12:0/2130202505 shutdown_connections 2024-09-05T01:25:46.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.116+0000 7f2971400640 1 -- 172.21.15.12:0/2130202505 wait complete. 2024-09-05T01:25:46.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.118+0000 7f2971400640 1 Processor -- start 2024-09-05T01:25:46.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.118+0000 7f2971400640 1 -- start start 2024-09-05T01:25:46.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.118+0000 7f2971400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f296c074510 0x7f296c073b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:46.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.118+0000 7f2971400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f296c074e30 0x7f296c06cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:46.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.118+0000 7f2971400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f296c10e280 0x7f296c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.118+0000 7f2971400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f296c114000 con 0x7f296c074e30 2024-09-05T01:25:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.118+0000 7f2971400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f296c113e80 con 0x7f296c074510 2024-09-05T01:25:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.118+0000 7f2971400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f296c114180 con 0x7f296c10e280 2024-09-05T01:25:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.119+0000 7f296be00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f296c074510 0x7f296c073b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.119+0000 7f296be00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f296c074510 0x7f296c073b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:43502/0 (socket says 172.21.15.12:43502) 2024-09-05T01:25:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.119+0000 7f296be00640 1 -- 172.21.15.12:0/3478883214 learned_addr learned my addr 172.21.15.12:0/3478883214 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.119+0000 7f2963400640 1 --2- 172.21.15.12:0/3478883214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f296c074e30 0x7f296c06cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.119+0000 7f2970a00640 1 --2- 172.21.15.12:0/3478883214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f296c10e280 0x7f296c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.119+0000 7f296be00640 1 -- 172.21.15.12:0/3478883214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f296c10e280 msgr2=0x7f296c06d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.119+0000 7f296be00640 1 --2- 172.21.15.12:0/3478883214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f296c10e280 0x7f296c06d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.119+0000 7f296be00640 1 -- 172.21.15.12:0/3478883214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f296c074e30 msgr2=0x7f296c06cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.119+0000 7f296be00640 1 --2- 172.21.15.12:0/3478883214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f296c074e30 0x7f296c06cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.119+0000 7f296be00640 1 -- 172.21.15.12:0/3478883214 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f296c06d730 con 0x7f296c074510 2024-09-05T01:25:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.119+0000 7f2970a00640 1 --2- 172.21.15.12:0/3478883214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f296c10e280 0x7f296c06d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:25:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.119+0000 7f2963400640 1 --2- 172.21.15.12:0/3478883214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f296c074e30 0x7f296c06cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:25:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.120+0000 7f296be00640 1 --2- 172.21.15.12:0/3478883214 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f296c074510 0x7f296c073b20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f295c00ebc0 tx=0x7f295c00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:46.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.120+0000 7f2969600640 1 -- 172.21.15.12:0/3478883214 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295c004d20 con 0x7f296c074510 2024-09-05T01:25:46.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.120+0000 7f2969600640 1 -- 172.21.15.12:0/3478883214 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f295c005500 con 0x7f296c074510 2024-09-05T01:25:46.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.120+0000 7f2971400640 1 -- 172.21.15.12:0/3478883214 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f296c071650 con 0x7f296c074510 2024-09-05T01:25:46.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.120+0000 7f2969600640 1 -- 172.21.15.12:0/3478883214 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295c0107f0 con 0x7f296c074510 2024-09-05T01:25:46.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.120+0000 7f2971400640 1 -- 172.21.15.12:0/3478883214 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f296c071b60 con 0x7f296c074510 2024-09-05T01:25:46.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.121+0000 7f2971400640 1 -- 172.21.15.12:0/3478883214 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f296c06d9c0 con 0x7f296c074510 2024-09-05T01:25:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.124+0000 7f2969600640 1 -- 172.21.15.12:0/3478883214 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 25) ==== 138066+0+0 (secure 0 0 0) 0x7f295c0056b0 con 0x7f296c074510 2024-09-05T01:25:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.127+0000 7f2969600640 1 --2- 172.21.15.12:0/3478883214 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f29500a2e90 0x7f29500a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.127+0000 7f2969600640 1 -- 172.21.15.12:0/3478883214 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f295c0d00a0 con 0x7f296c074510 2024-09-05T01:25:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.127+0000 7f2963400640 1 --2- 172.21.15.12:0/3478883214 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f29500a2e90 0x7f29500a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.128+0000 7f2969600640 1 -- 172.21.15.12:0/3478883214 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f295c0541b0 con 0x7f296c074510 2024-09-05T01:25:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.128+0000 7f2963400640 1 --2- 172.21.15.12:0/3478883214 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f29500a2e90 0x7f29500a5350 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2954000c00 tx=0x7f2954005a40 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:46.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.576+0000 7f2971400640 1 -- 172.21.15.12:0/3478883214 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f296c06e0e0 con 0x7f296c074510 2024-09-05T01:25:46.579 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:25:46.579 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":28,"btime":"2024-09-05T01:24:42:138818+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14532,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/2949711075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":2949711075},{"type":"v1","addr":"172.21.15.12:6839","nonce":2949711075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T01:22:35.979384+0000","modified":"2024-09-05T01:24:41.174185+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24529,"mds_2":24524,"mds_3":24517,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/497406458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":497406458},{"type":"v1","addr":"172.21.15.12:6841","nonce":497406458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":10,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.145:6839/1706431882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":1706431882},{"type":"v1","addr":"172.21.15.145:6839","nonce":1706431882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24529,24524,24517,24460]},"id":1}]} 2024-09-05T01:25:46.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.577+0000 7f2969600640 1 -- 172.21.15.12:0/3478883214 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11979 (secure 0 0 0) 0x7f295c01f340 con 0x7f296c074510 2024-09-05T01:25:46.579 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 28 2024-09-05T01:25:46.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.581+0000 7f2971400640 1 -- 172.21.15.12:0/3478883214 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f29500a2e90 msgr2=0x7f29500a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:46.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.581+0000 7f2971400640 1 --2- 172.21.15.12:0/3478883214 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f29500a2e90 0x7f29500a5350 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2954000c00 tx=0x7f2954005a40 comp rx=0 tx=0).stop 2024-09-05T01:25:46.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.581+0000 7f2971400640 1 -- 172.21.15.12:0/3478883214 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f296c074510 msgr2=0x7f296c073b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:46.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.581+0000 7f2971400640 1 --2- 172.21.15.12:0/3478883214 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f296c074510 0x7f296c073b20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f295c00ebc0 tx=0x7f295c00c6a0 comp rx=0 tx=0).stop 2024-09-05T01:25:46.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.581+0000 7f2971400640 1 -- 172.21.15.12:0/3478883214 shutdown_connections 2024-09-05T01:25:46.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.581+0000 7f2971400640 1 --2- 172.21.15.12:0/3478883214 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f29500a2e90 0x7f29500a5350 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:46.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.581+0000 7f2971400640 1 --2- 172.21.15.12:0/3478883214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f296c10e280 0x7f296c06d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:46.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.581+0000 7f2971400640 1 --2- 172.21.15.12:0/3478883214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f296c074e30 0x7f296c06cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:46.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.581+0000 7f2971400640 1 --2- 172.21.15.12:0/3478883214 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f296c074510 0x7f296c073b20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:46.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.581+0000 7f2971400640 1 -- 172.21.15.12:0/3478883214 >> 172.21.15.12:0/3478883214 conn(0x7f296c0fd740 msgr2=0x7f296c0fefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:46.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.581+0000 7f2971400640 1 -- 172.21.15.12:0/3478883214 shutdown_connections 2024-09-05T01:25:46.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:46.581+0000 7f2971400640 1 -- 172.21.15.12:0/3478883214 wait complete. 2024-09-05T01:25:46.953 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:46 smithi012 ceph-mon[29942]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-05T01:25:46.953 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:46 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3478883214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:25:47.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:46 smithi145 ceph-mon[34376]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-05T01:25:47.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:46 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3478883214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:25:47.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:46 smithi151 ceph-mon[35013]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-05T01:25:47.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:46 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3478883214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:25:47.430 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-05T01:25:47.977 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:25:48.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.631+0000 7f3639a00640 1 -- 172.21.15.12:0/1031253038 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3634077040 msgr2=0x7f3634112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:48.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.631+0000 7f3639a00640 1 --2- 172.21.15.12:0/1031253038 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3634077040 0x7f3634112330 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3620009900 tx=0x7f362002a410 comp rx=0 tx=0).stop 2024-09-05T01:25:48.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.631+0000 7f3639a00640 1 -- 172.21.15.12:0/1031253038 shutdown_connections 2024-09-05T01:25:48.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.631+0000 7f3639a00640 1 --2- 172.21.15.12:0/1031253038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3634112870 0x7f3634114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.631+0000 7f3639a00640 1 --2- 172.21.15.12:0/1031253038 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3634077040 0x7f3634112330 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.631+0000 7f3639a00640 1 --2- 172.21.15.12:0/1031253038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3634076720 0x7f3634076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.631+0000 7f3639a00640 1 -- 172.21.15.12:0/1031253038 >> 172.21.15.12:0/1031253038 conn(0x7f36340ff910 msgr2=0x7f3634101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:48.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.631+0000 7f3639a00640 1 -- 172.21.15.12:0/1031253038 shutdown_connections 2024-09-05T01:25:48.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.631+0000 7f3639a00640 1 -- 172.21.15.12:0/1031253038 wait complete. 2024-09-05T01:25:48.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.633+0000 7f3639a00640 1 Processor -- start 2024-09-05T01:25:48.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.633+0000 7f3639a00640 1 -- start start 2024-09-05T01:25:48.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.634+0000 7f3639a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3634076720 0x7f36341a4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:48.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.634+0000 7f3639a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3634077040 0x7f36341a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:48.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.634+0000 7f3639a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3634112870 0x7f363419e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:48.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.634+0000 7f3639a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f36341183e0 con 0x7f3634112870 2024-09-05T01:25:48.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.634+0000 7f3639a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3634118260 con 0x7f3634076720 2024-09-05T01:25:48.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.634+0000 7f3639a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3634118560 con 0x7f3634077040 2024-09-05T01:25:48.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.634+0000 7f3633400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3634077040 0x7f36341a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:48.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.634+0000 7f3633e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3634076720 0x7f36341a4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:48.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.634+0000 7f3633400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3634077040 0x7f36341a4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:52774/0 (socket says 172.21.15.12:52774) 2024-09-05T01:25:48.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.634+0000 7f3633400640 1 -- 172.21.15.12:0/3240477477 learned_addr learned my addr 172.21.15.12:0/3240477477 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:48.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.635+0000 7f3639000640 1 --2- 172.21.15.12:0/3240477477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3634112870 0x7f363419e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.635+0000 7f3633400640 1 -- 172.21.15.12:0/3240477477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3634076720 msgr2=0x7f36341a4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.635+0000 7f3633400640 1 --2- 172.21.15.12:0/3240477477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3634076720 0x7f36341a4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.635+0000 7f3633400640 1 -- 172.21.15.12:0/3240477477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3634112870 msgr2=0x7f363419e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.635+0000 7f3633400640 1 --2- 172.21.15.12:0/3240477477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3634112870 0x7f363419e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.635+0000 7f3633400640 1 -- 172.21.15.12:0/3240477477 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f363419ef50 con 0x7f3634077040 2024-09-05T01:25:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.635+0000 7f3633400640 1 --2- 172.21.15.12:0/3240477477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3634077040 0x7f36341a4b70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3620006010 tx=0x7f3620004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.636+0000 7f3630c00640 1 -- 172.21.15.12:0/3240477477 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362003f030 con 0x7f3634077040 2024-09-05T01:25:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.636+0000 7f3630c00640 1 -- 172.21.15.12:0/3240477477 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3620004440 con 0x7f3634077040 2024-09-05T01:25:48.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.636+0000 7f3630c00640 1 -- 172.21.15.12:0/3240477477 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3620035070 con 0x7f3634077040 2024-09-05T01:25:48.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.636+0000 7f3639a00640 1 -- 172.21.15.12:0/3240477477 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f363419f1e0 con 0x7f3634077040 2024-09-05T01:25:48.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.637+0000 7f3639a00640 1 -- 172.21.15.12:0/3240477477 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36341ab490 con 0x7f3634077040 2024-09-05T01:25:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.641+0000 7f3630c00640 1 -- 172.21.15.12:0/3240477477 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) ==== 138066+0+0 (secure 0 0 0) 0x7f3620042030 con 0x7f3634077040 2024-09-05T01:25:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.642+0000 7f363dbe2740 1 Processor -- start 2024-09-05T01:25:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.642+0000 7f363dbe2740 1 -- start start 2024-09-05T01:25:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.642+0000 7f363dbe2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a310de40 0x5592a310e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.643+0000 7f363dbe2740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592a310e760 0x5592a3118ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.643+0000 7f363dbe2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592a3119020 0x5592a311b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.643+0000 7f363dbe2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5592a30743e0 con 0x5592a310de40 2024-09-05T01:25:48.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.643+0000 7f363dbe2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5592a301bd80 con 0x5592a3119020 2024-09-05T01:25:48.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.643+0000 7f363dbe2740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5592a30703a0 con 0x5592a310e760 2024-09-05T01:25:48.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.643+0000 7f3639000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a310de40 0x5592a310e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:48.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.643+0000 7f3639000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a310de40 0x5592a310e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42774/0 (socket says 172.21.15.12:42774) 2024-09-05T01:25:48.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.643+0000 7f3639000640 1 -- 172.21.15.12:0/2808020599 learned_addr learned my addr 172.21.15.12:0/2808020599 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:48.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.643+0000 7f3633e00640 1 --2- 172.21.15.12:0/2808020599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592a310e760 0x5592a3118ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:48.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.643+0000 7f3630c00640 1 --2- 172.21.15.12:0/3240477477 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f36180a2f10 0x7f36180a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:48.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.644+0000 7f3630c00640 1 -- 172.21.15.12:0/3240477477 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f36200ef570 con 0x7f3634077040 2024-09-05T01:25:48.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.644+0000 7f3633400640 1 --2- 172.21.15.12:0/2808020599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592a3119020 0x5592a311b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:48.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.644+0000 7f3633400640 1 -- 172.21.15.12:0/2808020599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592a310e760 msgr2=0x5592a3118ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:48.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.644+0000 7f3633400640 1 --2- 172.21.15.12:0/2808020599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592a310e760 0x5592a3118ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.644+0000 7f3633400640 1 -- 172.21.15.12:0/2808020599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a310de40 msgr2=0x5592a310e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:48.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.644+0000 7f3633400640 1 --2- 172.21.15.12:0/2808020599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a310de40 0x5592a310e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.644+0000 7f3633400640 1 -- 172.21.15.12:0/2808020599 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592a303aae0 con 0x5592a3119020 2024-09-05T01:25:48.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.644+0000 7f3639000640 1 --2- 172.21.15.12:0/3240477477 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f36180a2f10 0x7f36180a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:48.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.645+0000 7f3633400640 1 --2- 172.21.15.12:0/2808020599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592a3119020 0x5592a311b410 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f36200ecad0 tx=0x7f36200bb2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a619bb6a2e5a2235 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:48.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.645+0000 7f3629600640 1 -- 172.21.15.12:0/2808020599 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3620049040 con 0x5592a3119020 2024-09-05T01:25:48.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.645+0000 7f3629600640 1 -- 172.21.15.12:0/2808020599 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36200bfd10 con 0x5592a3119020 2024-09-05T01:25:48.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.645+0000 7f3629600640 1 -- 172.21.15.12:0/2808020599 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36200a6340 con 0x5592a3119020 2024-09-05T01:25:48.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.645+0000 7f3639000640 1 --2- 172.21.15.12:0/3240477477 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f36180a2f10 0x7f36180a53d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f362c0094d0 tx=0x7f362c014040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:48.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.646+0000 7f363dbe2740 1 -- 172.21.15.12:0/2808020599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592a3119020 msgr2=0x5592a311b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:48.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.646+0000 7f363dbe2740 1 --2- 172.21.15.12:0/2808020599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592a3119020 0x5592a311b410 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f36200ecad0 tx=0x7f36200bb2c0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.646+0000 7f363dbe2740 1 -- 172.21.15.12:0/2808020599 shutdown_connections 2024-09-05T01:25:48.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.646+0000 7f363dbe2740 1 --2- 172.21.15.12:0/2808020599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592a3119020 0x5592a311b410 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.646+0000 7f363dbe2740 1 --2- 172.21.15.12:0/2808020599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592a310e760 0x5592a3118ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.646+0000 7f363dbe2740 1 --2- 172.21.15.12:0/2808020599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a310de40 0x5592a310e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.646+0000 7f363dbe2740 1 -- 172.21.15.12:0/2808020599 >> 172.21.15.12:0/2808020599 conn(0x5592a310a3d0 msgr2=0x5592a310a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:48.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.647+0000 7f363dbe2740 1 -- 172.21.15.12:0/2808020599 shutdown_connections 2024-09-05T01:25:48.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.647+0000 7f363dbe2740 1 -- 172.21.15.12:0/2808020599 wait complete. 2024-09-05T01:25:48.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.648+0000 7f363dbe2740 1 -- start start 2024-09-05T01:25:48.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.648+0000 7f363dbe2740 1 Processor -- start 2024-09-05T01:25:48.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.649+0000 7f363dbe2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592a310de40 0x5592a3115f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:48.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.649+0000 7f363dbe2740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592a310e760 0x5592a31164a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:48.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.649+0000 7f363dbe2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a3119020 0x5592a31169e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:48.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.649+0000 7f363dbe2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5592a312c9c0 con 0x5592a3119020 2024-09-05T01:25:48.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.649+0000 7f363dbe2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5592a302f0f0 con 0x5592a310de40 2024-09-05T01:25:48.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.649+0000 7f363dbe2740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5592a312cb40 con 0x5592a310e760 2024-09-05T01:25:48.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.649+0000 7f363dbe2740 10 client.0 _ll_register_callbacks cb 0x5592a3016bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:48.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.649+0000 7f3639000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a3119020 0x5592a31169e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:48.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.649+0000 7f3639000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a3119020 0x5592a31169e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42776/0 (socket says 172.21.15.12:42776) 2024-09-05T01:25:48.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.649+0000 7f3639000640 1 -- 172.21.15.12:0/2418123831 learned_addr learned my addr 172.21.15.12:0/2418123831 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:48.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.650+0000 7f3633e00640 1 --2- 172.21.15.12:0/2418123831 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592a310de40 0x5592a3115f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:48.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.650+0000 7f3639000640 1 -- 172.21.15.12:0/2418123831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592a310e760 msgr2=0x5592a31164a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:25:48.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.650+0000 7f3639000640 1 --2- 172.21.15.12:0/2418123831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592a310e760 0x5592a31164a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.650+0000 7f3639000640 1 -- 172.21.15.12:0/2418123831 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592a310de40 msgr2=0x5592a3115f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:48.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.650+0000 7f3639000640 1 --2- 172.21.15.12:0/2418123831 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592a310de40 0x5592a3115f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.650+0000 7f3639000640 1 -- 172.21.15.12:0/2418123831 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592a2de53c0 con 0x5592a3119020 2024-09-05T01:25:48.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.651+0000 7f3639000640 1 --2- 172.21.15.12:0/2418123831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a3119020 0x5592a31169e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f362c010830 tx=0x7f362c009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146deac426e87f43 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:48.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.651+0000 7f361e000640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:25:48.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.651+0000 7f361e000640 1 -- 172.21.15.12:0/2418123831 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c01b8f0 con 0x5592a3119020 2024-09-05T01:25:48.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.651+0000 7f361e000640 1 -- 172.21.15.12:0/2418123831 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f362c01ba90 con 0x5592a3119020 2024-09-05T01:25:48.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.651+0000 7f363dbe2740 1 -- 172.21.15.12:0/2418123831 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36200bfd10 con 0x5592a3119020 2024-09-05T01:25:48.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.652+0000 7f361e000640 1 -- 172.21.15.12:0/2418123831 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f362c01bc90 con 0x5592a3119020 2024-09-05T01:25:48.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.652+0000 7f363dbe2740 10 client.15474 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:48.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.652+0000 7f363dbe2740 1 -- 172.21.15.12:0/2418123831 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5592a3138a20 con 0x5592a3119020 2024-09-05T01:25:48.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.652+0000 7f361e000640 1 -- 172.21.15.12:0/2418123831 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36200bfd10 con 0x5592a3119020 2024-09-05T01:25:48.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.653+0000 7f361e000640 1 -- 172.21.15.12:0/2418123831 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f362c01d4a0 con 0x5592a3119020 2024-09-05T01:25:48.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.653+0000 7f363dbe2740 10 client.15474 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:48.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.653+0000 7f363dbe2740 10 client.15474 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-05T01:25:48.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.653+0000 7f363dbe2740 20 client.15474 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:48.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.653+0000 7f363dbe2740 1 --2- 172.21.15.12:0/2418123831 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5592a3139e80 0x5592a313c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:48.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.653+0000 7f363dbe2740 4 client.15474 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:25:48.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.653+0000 7f363dbe2740 1 -- 172.21.15.12:0/2418123831 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592a3081950 con 0x5592a3139e80 2024-09-05T01:25:48.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.654+0000 7f3633e00640 1 --2- 172.21.15.12:0/2418123831 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5592a3139e80 0x5592a313c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:48.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.654+0000 7f3633e00640 1 --2- 172.21.15.12:0/2418123831 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5592a3139e80 0x5592a313c320 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e661ee53b5475d16 server_cookie=39cdfd2d1e1afb4 in_seq=0 out_seq=0 2024-09-05T01:25:48.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.654+0000 7f361e000640 10 client.15474 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:25:48.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.655+0000 7f361e000640 1 -- 172.21.15.12:0/2418123831 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5592a3081950 con 0x5592a3139e80 2024-09-05T01:25:48.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.655+0000 7f361e000640 10 client.15474 handle_command_reply: tid=0 2024-09-05T01:25:48.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.655+0000 7f363dbe2740 1 client.15474 shutdown 2024-09-05T01:25:48.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.656+0000 7f363dbe2740 1 -- 172.21.15.12:0/2418123831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a3119020 msgr2=0x5592a31169e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:48.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.656+0000 7f363dbe2740 1 --2- 172.21.15.12:0/2418123831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a3119020 0x5592a31169e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f362c010830 tx=0x7f362c009500 comp rx=0 tx=0).stop 2024-09-05T01:25:48.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.656+0000 7f363dbe2740 1 -- 172.21.15.12:0/2418123831 shutdown_connections 2024-09-05T01:25:48.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.656+0000 7f363dbe2740 1 --2- 172.21.15.12:0/2418123831 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5592a3139e80 0x5592a313c320 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.656+0000 7f363dbe2740 1 --2- 172.21.15.12:0/2418123831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a3119020 0x5592a31169e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.656+0000 7f363dbe2740 1 --2- 172.21.15.12:0/2418123831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592a310e760 0x5592a31164a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.656+0000 7f363dbe2740 1 --2- 172.21.15.12:0/2418123831 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592a310de40 0x5592a3115f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.656+0000 7f363dbe2740 1 -- 172.21.15.12:0/2418123831 >> 172.21.15.12:0/2418123831 conn(0x5592a310a3d0 msgr2=0x5592a3110100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:48.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.656+0000 7f361e000640 0 client.15474 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:25:48.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.656+0000 7f363dbe2740 1 -- 172.21.15.12:0/2418123831 shutdown_connections 2024-09-05T01:25:48.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.656+0000 7f363dbe2740 1 -- 172.21.15.12:0/2418123831 wait complete. 2024-09-05T01:25:48.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.656+0000 7f363dbe2740 20 client.15474 trim_cache size 0 max 16384 2024-09-05T01:25:48.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.682+0000 7f363dbe2740 1 Processor -- start 2024-09-05T01:25:48.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.683+0000 7f363dbe2740 1 -- start start 2024-09-05T01:25:48.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.683+0000 7f363dbe2740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592a310de40 0x5592a3116830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:48.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.683+0000 7f363dbe2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a310e760 0x5592a3117ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:48.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.683+0000 7f363dbe2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592a3119020 0x5592a3141bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:48.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.683+0000 7f363dbe2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f36341ab660 con 0x5592a310e760 2024-09-05T01:25:48.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.683+0000 7f363dbe2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f36341ad0d0 con 0x5592a3119020 2024-09-05T01:25:48.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.683+0000 7f363dbe2740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f36341abc60 con 0x5592a310de40 2024-09-05T01:25:48.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.684+0000 7f3633400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a310e760 0x5592a3117ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:48.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.684+0000 7f3633400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a310e760 0x5592a3117ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42782/0 (socket says 172.21.15.12:42782) 2024-09-05T01:25:48.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.684+0000 7f3633400640 1 -- 172.21.15.12:0/2450291345 learned_addr learned my addr 172.21.15.12:0/2450291345 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:48.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.684+0000 7f3639000640 1 --2- 172.21.15.12:0/2450291345 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592a3119020 0x5592a3141bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:48.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.684+0000 7f3633e00640 1 --2- 172.21.15.12:0/2450291345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592a310de40 0x5592a3116830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:48.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.684+0000 7f3639000640 1 -- 172.21.15.12:0/2450291345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592a310de40 msgr2=0x5592a3116830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:48.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.684+0000 7f3639000640 1 --2- 172.21.15.12:0/2450291345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592a310de40 0x5592a3116830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.684+0000 7f3639000640 1 -- 172.21.15.12:0/2450291345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a310e760 msgr2=0x5592a3117ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:48.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.684+0000 7f3639000640 1 --2- 172.21.15.12:0/2450291345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a310e760 0x5592a3117ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.684+0000 7f3639000640 1 -- 172.21.15.12:0/2450291345 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592a310edb0 con 0x5592a3119020 2024-09-05T01:25:48.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.685+0000 7f3639000640 1 --2- 172.21.15.12:0/2450291345 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592a3119020 0x5592a3141bf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f362c010800 tx=0x7f362c01ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92dee1ec820bb60f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:48.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.685+0000 7f3628c00640 1 -- 172.21.15.12:0/2450291345 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c01d410 con 0x5592a3119020 2024-09-05T01:25:48.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.685+0000 7f3628c00640 1 -- 172.21.15.12:0/2450291345 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f362c01d5b0 con 0x5592a3119020 2024-09-05T01:25:48.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.685+0000 7f3628c00640 1 -- 172.21.15.12:0/2450291345 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c02f6a0 con 0x5592a3119020 2024-09-05T01:25:48.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.686+0000 7f363dbe2740 1 -- 172.21.15.12:0/2450291345 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592a3119020 msgr2=0x5592a3141bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:48.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.686+0000 7f363dbe2740 1 --2- 172.21.15.12:0/2450291345 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592a3119020 0x5592a3141bf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f362c010800 tx=0x7f362c01ef70 comp rx=0 tx=0).stop 2024-09-05T01:25:48.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.686+0000 7f363dbe2740 1 -- 172.21.15.12:0/2450291345 shutdown_connections 2024-09-05T01:25:48.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.686+0000 7f363dbe2740 1 --2- 172.21.15.12:0/2450291345 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592a3119020 0x5592a3141bf0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.686+0000 7f363dbe2740 1 --2- 172.21.15.12:0/2450291345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a310e760 0x5592a3117ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.686+0000 7f363dbe2740 1 --2- 172.21.15.12:0/2450291345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592a310de40 0x5592a3116830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.686+0000 7f363dbe2740 1 -- 172.21.15.12:0/2450291345 >> 172.21.15.12:0/2450291345 conn(0x5592a310a3d0 msgr2=0x5592a31177c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:48.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.687+0000 7f363dbe2740 1 -- 172.21.15.12:0/2450291345 shutdown_connections 2024-09-05T01:25:48.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.687+0000 7f363dbe2740 1 -- 172.21.15.12:0/2450291345 wait complete. 2024-09-05T01:25:48.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.688+0000 7f363dbe2740 1 -- start start 2024-09-05T01:25:48.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.688+0000 7f363dbe2740 1 Processor -- start 2024-09-05T01:25:48.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.688+0000 7f363dbe2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a310de40 0x5592a3131ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:48.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.689+0000 7f363dbe2740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592a310e760 0x5592a3132220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:48.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.689+0000 7f363dbe2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592a3119020 0x5592a312d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:48.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.689+0000 7f363dbe2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f36341aca00 con 0x5592a310de40 2024-09-05T01:25:48.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.689+0000 7f363dbe2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f36341ac330 con 0x5592a3119020 2024-09-05T01:25:48.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.689+0000 7f363dbe2740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3634072330 con 0x5592a310e760 2024-09-05T01:25:48.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.689+0000 7f363dbe2740 10 client.0 _ll_register_callbacks cb 0x7f362c009d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:48.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.689+0000 7f3633e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a310de40 0x5592a3131ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:48.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.689+0000 7f3639000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592a3119020 0x5592a312d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:48.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.689+0000 7f3633e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a310de40 0x5592a3131ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42784/0 (socket says 172.21.15.12:42784) 2024-09-05T01:25:48.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.689+0000 7f3633e00640 1 -- 172.21.15.12:0/284105071 learned_addr learned my addr 172.21.15.12:0/284105071 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:48.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.689+0000 7f3633400640 1 --2- 172.21.15.12:0/284105071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592a310e760 0x5592a3132220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:48.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.690+0000 7f3633e00640 1 -- 172.21.15.12:0/284105071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592a310e760 msgr2=0x5592a3132220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:48.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.690+0000 7f3633e00640 1 --2- 172.21.15.12:0/284105071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592a310e760 0x5592a3132220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.690+0000 7f3633e00640 1 -- 172.21.15.12:0/284105071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592a3119020 msgr2=0x5592a312d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:48.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.690+0000 7f3633e00640 1 --2- 172.21.15.12:0/284105071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592a3119020 0x5592a312d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.690+0000 7f3633e00640 1 -- 172.21.15.12:0/284105071 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592a312d980 con 0x5592a310de40 2024-09-05T01:25:48.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.690+0000 7f3633400640 1 --2- 172.21.15.12:0/284105071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592a310e760 0x5592a3132220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:25:48.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.691+0000 7f3633e00640 1 --2- 172.21.15.12:0/284105071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a310de40 0x5592a3131ce0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f36240146f0 tx=0x7f3624014bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5016389585623476 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:48.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.691+0000 7f361e000640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:25:48.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.691+0000 7f361e000640 1 -- 172.21.15.12:0/284105071 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3624014e60 con 0x5592a310de40 2024-09-05T01:25:48.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.691+0000 7f361e000640 1 -- 172.21.15.12:0/284105071 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f36240119a0 con 0x5592a310de40 2024-09-05T01:25:48.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.692+0000 7f363dbe2740 1 -- 172.21.15.12:0/284105071 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f362c01d5b0 con 0x5592a310de40 2024-09-05T01:25:48.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.692+0000 7f361e000640 1 -- 172.21.15.12:0/284105071 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f36240142d0 con 0x5592a310de40 2024-09-05T01:25:48.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.693+0000 7f363dbe2740 10 client.15480 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:48.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.693+0000 7f363dbe2740 1 -- 172.21.15.12:0/284105071 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5592a31a46c0 con 0x5592a310de40 2024-09-05T01:25:48.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.693+0000 7f361e000640 1 -- 172.21.15.12:0/284105071 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f362c01d5b0 con 0x5592a310de40 2024-09-05T01:25:48.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.693+0000 7f361e000640 1 -- 172.21.15.12:0/284105071 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f3624025030 con 0x5592a310de40 2024-09-05T01:25:48.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.694+0000 7f363dbe2740 10 client.15480 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:48.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.694+0000 7f363dbe2740 10 client.15480 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-05T01:25:48.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.694+0000 7f363dbe2740 20 client.15480 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:48.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.694+0000 7f363dbe2740 1 --2- 172.21.15.12:0/284105071 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5592a31a4dc0 0x5592a31a71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:48.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.694+0000 7f363dbe2740 4 client.15480 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:25:48.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.694+0000 7f363dbe2740 1 -- 172.21.15.12:0/284105071 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5592a307be60 con 0x5592a31a4dc0 2024-09-05T01:25:48.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.694+0000 7f3633400640 1 --2- 172.21.15.12:0/284105071 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5592a31a4dc0 0x5592a31a71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:48.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.696+0000 7f3633400640 1 --2- 172.21.15.12:0/284105071 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5592a31a4dc0 0x5592a31a71e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=641be6d737462e server_cookie=1ef93c48fde52986 in_seq=0 out_seq=0 2024-09-05T01:25:48.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.696+0000 7f361e000640 10 client.15480 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:25:48.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.696+0000 7f361e000640 1 -- 172.21.15.12:0/284105071 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5592a307be60 con 0x5592a31a4dc0 2024-09-05T01:25:48.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.696+0000 7f361e000640 10 client.15480 handle_command_reply: tid=0 2024-09-05T01:25:48.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.696+0000 7f363dbe2740 1 client.15480 shutdown 2024-09-05T01:25:48.702 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:25:48.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.697+0000 7f363dbe2740 1 -- 172.21.15.12:0/284105071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a310de40 msgr2=0x5592a3131ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:48.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.697+0000 7f363dbe2740 1 --2- 172.21.15.12:0/284105071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a310de40 0x5592a3131ce0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f36240146f0 tx=0x7f3624014bb0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.697+0000 7f363dbe2740 1 -- 172.21.15.12:0/284105071 shutdown_connections 2024-09-05T01:25:48.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.697+0000 7f363dbe2740 1 --2- 172.21.15.12:0/284105071 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5592a31a4dc0 0x5592a31a71e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.697+0000 7f363dbe2740 1 --2- 172.21.15.12:0/284105071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5592a3119020 0x5592a312d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.697+0000 7f363dbe2740 1 --2- 172.21.15.12:0/284105071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592a310e760 0x5592a3132220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.697+0000 7f363dbe2740 1 --2- 172.21.15.12:0/284105071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5592a310de40 0x5592a3131ce0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.697+0000 7f363dbe2740 1 -- 172.21.15.12:0/284105071 >> 172.21.15.12:0/284105071 conn(0x5592a310a3d0 msgr2=0x5592a31100b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:48.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.697+0000 7f361e000640 0 client.15480 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:25:48.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.698+0000 7f363dbe2740 1 -- 172.21.15.12:0/284105071 shutdown_connections 2024-09-05T01:25:48.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.698+0000 7f363dbe2740 1 -- 172.21.15.12:0/284105071 wait complete. 2024-09-05T01:25:48.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.698+0000 7f363dbe2740 20 client.15480 trim_cache size 0 max 16384 2024-09-05T01:25:48.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.700+0000 7f3639a00640 1 -- 172.21.15.12:0/3240477477 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f36180a2f10 msgr2=0x7f36180a53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:48.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.700+0000 7f3639a00640 1 --2- 172.21.15.12:0/3240477477 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f36180a2f10 0x7f36180a53d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f362c0094d0 tx=0x7f362c014040 comp rx=0 tx=0).stop 2024-09-05T01:25:48.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.700+0000 7f3639a00640 1 -- 172.21.15.12:0/3240477477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3634077040 msgr2=0x7f36341a4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:48.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.700+0000 7f3639a00640 1 --2- 172.21.15.12:0/3240477477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3634077040 0x7f36341a4b70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3620006010 tx=0x7f3620004040 comp rx=0 tx=0).stop 2024-09-05T01:25:48.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.700+0000 7f3639a00640 1 -- 172.21.15.12:0/3240477477 shutdown_connections 2024-09-05T01:25:48.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.700+0000 7f3639a00640 1 --2- 172.21.15.12:0/3240477477 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f36180a2f10 0x7f36180a53d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.700+0000 7f3639a00640 1 --2- 172.21.15.12:0/3240477477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3634112870 0x7f363419e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.700+0000 7f3639a00640 1 --2- 172.21.15.12:0/3240477477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3634077040 0x7f36341a4b70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.700+0000 7f3639a00640 1 --2- 172.21.15.12:0/3240477477 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3634076720 0x7f36341a4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:48.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.700+0000 7f3639a00640 1 -- 172.21.15.12:0/3240477477 >> 172.21.15.12:0/3240477477 conn(0x7f36340ff910 msgr2=0x7f3634101d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:48.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.700+0000 7f3639a00640 1 -- 172.21.15.12:0/3240477477 shutdown_connections 2024-09-05T01:25:48.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:48.700+0000 7f3639a00640 1 -- 172.21.15.12:0/3240477477 wait complete. 2024-09-05T01:25:49.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:48 smithi012 ceph-mon[29942]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-05T01:25:49.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:48 smithi145 ceph-mon[34376]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-05T01:25:49.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:48 smithi151 ceph-mon[35013]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-05T01:25:49.495 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-05T01:25:50.020 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:25:50.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.676+0000 7f85bb000640 1 -- 172.21.15.12:0/898194004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85b4077040 msgr2=0x7f85b41124f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:50.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.676+0000 7f85bb000640 1 --2- 172.21.15.12:0/898194004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85b4077040 0x7f85b41124f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f85a0009900 tx=0x7f85a002a3f0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.676+0000 7f85bb000640 1 -- 172.21.15.12:0/898194004 shutdown_connections 2024-09-05T01:25:50.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.676+0000 7f85bb000640 1 --2- 172.21.15.12:0/898194004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85b4112a30 0x7f85b4114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.676+0000 7f85bb000640 1 --2- 172.21.15.12:0/898194004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85b4077040 0x7f85b41124f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.676+0000 7f85bb000640 1 --2- 172.21.15.12:0/898194004 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f85b4076720 0x7f85b4076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.676+0000 7f85bb000640 1 -- 172.21.15.12:0/898194004 >> 172.21.15.12:0/898194004 conn(0x7f85b40ffa90 msgr2=0x7f85b4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:50.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.676+0000 7f85bb000640 1 -- 172.21.15.12:0/898194004 shutdown_connections 2024-09-05T01:25:50.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.676+0000 7f85bb000640 1 -- 172.21.15.12:0/898194004 wait complete. 2024-09-05T01:25:50.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.677+0000 7f85bb000640 1 Processor -- start 2024-09-05T01:25:50.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.678+0000 7f85bb000640 1 -- start start 2024-09-05T01:25:50.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.678+0000 7f85bb000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85b4076720 0x7f85b41a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:50.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.678+0000 7f85bb000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85b4077040 0x7f85b41a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:50.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.678+0000 7f85bb000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f85b4112a30 0x7f85b419e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:50.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.678+0000 7f85bb000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f85b41185f0 con 0x7f85b4076720 2024-09-05T01:25:50.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.678+0000 7f85bb000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f85b4118470 con 0x7f85b4112a30 2024-09-05T01:25:50.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.678+0000 7f85bb000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f85b4118770 con 0x7f85b4077040 2024-09-05T01:25:50.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.679+0000 7f85b3400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85b4077040 0x7f85b41a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:50.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.679+0000 7f85b9000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f85b4112a30 0x7f85b419e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:50.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.679+0000 7f85b3400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85b4077040 0x7f85b41a4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:52828/0 (socket says 172.21.15.12:52828) 2024-09-05T01:25:50.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.679+0000 7f85b3400640 1 -- 172.21.15.12:0/2593285058 learned_addr learned my addr 172.21.15.12:0/2593285058 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:50.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.679+0000 7f85b3e00640 1 --2- 172.21.15.12:0/2593285058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85b4076720 0x7f85b41a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:50.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.679+0000 7f85b9000640 1 -- 172.21.15.12:0/2593285058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85b4077040 msgr2=0x7f85b41a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:50.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.679+0000 7f85b9000640 1 --2- 172.21.15.12:0/2593285058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85b4077040 0x7f85b41a4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.679+0000 7f85b9000640 1 -- 172.21.15.12:0/2593285058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85b4076720 msgr2=0x7f85b41a46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:50.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.679+0000 7f85b9000640 1 --2- 172.21.15.12:0/2593285058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85b4076720 0x7f85b41a46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.679+0000 7f85b9000640 1 -- 172.21.15.12:0/2593285058 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b419efb0 con 0x7f85b4112a30 2024-09-05T01:25:50.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.679+0000 7f85b3e00640 1 --2- 172.21.15.12:0/2593285058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85b4076720 0x7f85b41a46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:25:50.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.680+0000 7f85b9000640 1 --2- 172.21.15.12:0/2593285058 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f85b4112a30 0x7f85b419e880 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f85b407aa10 tx=0x7f85ac00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:50.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.680+0000 7f85b0c00640 1 -- 172.21.15.12:0/2593285058 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac00cdf0 con 0x7f85b4112a30 2024-09-05T01:25:50.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.680+0000 7f85b0c00640 1 -- 172.21.15.12:0/2593285058 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85ac005020 con 0x7f85b4112a30 2024-09-05T01:25:50.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.680+0000 7f85b0c00640 1 -- 172.21.15.12:0/2593285058 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac010670 con 0x7f85b4112a30 2024-09-05T01:25:50.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.680+0000 7f85bb000640 1 -- 172.21.15.12:0/2593285058 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85b419f2a0 con 0x7f85b4112a30 2024-09-05T01:25:50.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.680+0000 7f85bb000640 1 -- 172.21.15.12:0/2593285058 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85b41ab590 con 0x7f85b4112a30 2024-09-05T01:25:50.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.685+0000 7f85bda1b740 1 Processor -- start 2024-09-05T01:25:50.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.685+0000 7f85b0c00640 1 -- 172.21.15.12:0/2593285058 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 25) ==== 138066+0+0 (secure 0 0 0) 0x7f85ac0054d0 con 0x7f85b4112a30 2024-09-05T01:25:50.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.686+0000 7f85bda1b740 1 -- start start 2024-09-05T01:25:50.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.686+0000 7f85bda1b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244ccc70 0x561a244cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:50.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.686+0000 7f85bda1b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a244cd590 0x561a244d7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:50.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.686+0000 7f85bda1b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a244d7e50 0x561a244da240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:50.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.686+0000 7f85bda1b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561a244333e0 con 0x561a244d7e50 2024-09-05T01:25:50.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.686+0000 7f85bda1b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x561a243dad80 con 0x561a244ccc70 2024-09-05T01:25:50.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.686+0000 7f85bda1b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561a2442f3a0 con 0x561a244cd590 2024-09-05T01:25:50.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.687+0000 7f85b3400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244ccc70 0x561a244cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:50.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.687+0000 7f85b3400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244ccc70 0x561a244cd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:48916/0 (socket says 172.21.15.12:48916) 2024-09-05T01:25:50.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.687+0000 7f85b3400640 1 -- 172.21.15.12:0/4278710538 learned_addr learned my addr 172.21.15.12:0/4278710538 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:50.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.687+0000 7f85b3400640 1 -- 172.21.15.12:0/4278710538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a244cd590 msgr2=0x561a244d7910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:25:50.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.687+0000 7f85b3400640 1 --2- 172.21.15.12:0/4278710538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a244cd590 0x561a244d7910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.687+0000 7f85b3400640 1 -- 172.21.15.12:0/4278710538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a244d7e50 msgr2=0x561a244da240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:50.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.687+0000 7f85b3400640 1 --2- 172.21.15.12:0/4278710538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a244d7e50 0x561a244da240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.687+0000 7f85b3400640 1 -- 172.21.15.12:0/4278710538 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a243f9ae0 con 0x561a244ccc70 2024-09-05T01:25:50.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.687+0000 7f85b0c00640 1 --2- 172.21.15.12:0/2593285058 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f85980a2e10 0x7f85980a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:50.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.687+0000 7f85b3400640 1 --2- 172.21.15.12:0/4278710538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244ccc70 0x561a244cd050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f85a0004770 tx=0x7f85a0005e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c0c235031968052 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:50.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.688+0000 7f85b0c00640 1 -- 172.21.15.12:0/2593285058 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f85ac0cfdf0 con 0x7f85b4112a30 2024-09-05T01:25:50.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.688+0000 7f85a9600640 1 -- 172.21.15.12:0/4278710538 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a0035070 con 0x561a244ccc70 2024-09-05T01:25:50.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.688+0000 7f85a9600640 1 -- 172.21.15.12:0/4278710538 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85a0041030 con 0x561a244ccc70 2024-09-05T01:25:50.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.688+0000 7f85a9600640 1 -- 172.21.15.12:0/4278710538 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a0004d10 con 0x561a244ccc70 2024-09-05T01:25:50.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.688+0000 7f85b3e00640 1 --2- 172.21.15.12:0/2593285058 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f85980a2e10 0x7f85980a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:50.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.689+0000 7f85bda1b740 1 -- 172.21.15.12:0/4278710538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244ccc70 msgr2=0x561a244cd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:50.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.689+0000 7f85bda1b740 1 --2- 172.21.15.12:0/4278710538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244ccc70 0x561a244cd050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f85a0004770 tx=0x7f85a0005e50 comp rx=0 tx=0).stop 2024-09-05T01:25:50.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.689+0000 7f85bda1b740 1 -- 172.21.15.12:0/4278710538 shutdown_connections 2024-09-05T01:25:50.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.689+0000 7f85bda1b740 1 --2- 172.21.15.12:0/4278710538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a244d7e50 0x561a244da240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.689+0000 7f85bda1b740 1 --2- 172.21.15.12:0/4278710538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a244cd590 0x561a244d7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.689+0000 7f85bda1b740 1 --2- 172.21.15.12:0/4278710538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244ccc70 0x561a244cd050 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.689+0000 7f85bda1b740 1 -- 172.21.15.12:0/4278710538 >> 172.21.15.12:0/4278710538 conn(0x561a244c9200 msgr2=0x561a244c95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:50.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.690+0000 7f85b3e00640 1 --2- 172.21.15.12:0/2593285058 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f85980a2e10 0x7f85980a52d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x561a244ca060 tx=0x7f85a4005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:50.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.690+0000 7f85bda1b740 1 -- 172.21.15.12:0/4278710538 shutdown_connections 2024-09-05T01:25:50.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.690+0000 7f85bda1b740 1 -- 172.21.15.12:0/4278710538 wait complete. 2024-09-05T01:25:50.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.690+0000 7f85bda1b740 1 -- start start 2024-09-05T01:25:50.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.690+0000 7f85bda1b740 1 Processor -- start 2024-09-05T01:25:50.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.691+0000 7f85bda1b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244ccc70 0x561a244d4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:50.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.691+0000 7f85bda1b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a244cd590 0x561a244d5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:50.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.691+0000 7f85bda1b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a244d7e50 0x561a244d57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:50.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.691+0000 7f85bda1b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561a244daa20 con 0x561a244cd590 2024-09-05T01:25:50.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.691+0000 7f85bda1b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x561a243ee0f0 con 0x561a244ccc70 2024-09-05T01:25:50.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.691+0000 7f85bda1b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561a244daba0 con 0x561a244d7e50 2024-09-05T01:25:50.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.691+0000 7f85bda1b740 10 client.0 _ll_register_callbacks cb 0x561a243d5bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:50.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.692+0000 7f85b3e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244ccc70 0x561a244d4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.692+0000 7f85b9000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a244d7e50 0x561a244d57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.692+0000 7f85b3e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244ccc70 0x561a244d4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:48932/0 (socket says 172.21.15.12:48932) 2024-09-05T01:25:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.692+0000 7f85b3e00640 1 -- 172.21.15.12:0/1336492191 learned_addr learned my addr 172.21.15.12:0/1336492191 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.692+0000 7f85b3400640 1 --2- 172.21.15.12:0/1336492191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a244cd590 0x561a244d5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.692+0000 7f85b3e00640 1 -- 172.21.15.12:0/1336492191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a244d7e50 msgr2=0x561a244d57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.692+0000 7f85b3e00640 1 --2- 172.21.15.12:0/1336492191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a244d7e50 0x561a244d57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.692+0000 7f85b3e00640 1 -- 172.21.15.12:0/1336492191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a244cd590 msgr2=0x561a244d5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.692+0000 7f85b3e00640 1 --2- 172.21.15.12:0/1336492191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a244cd590 0x561a244d5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.692+0000 7f85b3e00640 1 -- 172.21.15.12:0/1336492191 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a241a43c0 con 0x561a244ccc70 2024-09-05T01:25:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.692+0000 7f85b3e00640 1 --2- 172.21.15.12:0/1336492191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244ccc70 0x561a244d4d50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f85a4003760 tx=0x7f85a4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea96d83e80464055 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.692+0000 7f859e000640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:25:50.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.693+0000 7f859e000640 1 -- 172.21.15.12:0/1336492191 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a401ca30 con 0x561a244ccc70 2024-09-05T01:25:50.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.693+0000 7f859e000640 1 -- 172.21.15.12:0/1336492191 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f85a401cbd0 con 0x561a244ccc70 2024-09-05T01:25:50.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.693+0000 7f85bda1b740 1 -- 172.21.15.12:0/1336492191 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85a0041030 con 0x561a244ccc70 2024-09-05T01:25:50.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.693+0000 7f859e000640 1 -- 172.21.15.12:0/1336492191 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f85a401cdd0 con 0x561a244ccc70 2024-09-05T01:25:50.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.693+0000 7f85bda1b740 10 client.25496 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:50.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.693+0000 7f85bda1b740 1 -- 172.21.15.12:0/1336492191 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561a244e6ad0 con 0x561a244ccc70 2024-09-05T01:25:50.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.694+0000 7f859e000640 1 -- 172.21.15.12:0/1336492191 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85a0041030 con 0x561a244ccc70 2024-09-05T01:25:50.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.694+0000 7f859e000640 1 -- 172.21.15.12:0/1336492191 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f85a4032700 con 0x561a244ccc70 2024-09-05T01:25:50.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.694+0000 7f85bda1b740 10 client.25496 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.694+0000 7f85bda1b740 10 client.25496 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-05T01:25:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.694+0000 7f85bda1b740 20 client.25496 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.694+0000 7f85bda1b740 1 --2- 172.21.15.12:0/1336492191 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x561a244e7f90 0x561a244ea3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.694+0000 7f85bda1b740 4 client.25496 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:25:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.694+0000 7f85bda1b740 1 -- 172.21.15.12:0/1336492191 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a24440950 con 0x561a244e7f90 2024-09-05T01:25:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.695+0000 7f85b3400640 1 --2- 172.21.15.12:0/1336492191 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x561a244e7f90 0x561a244ea3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.695+0000 7f85b3400640 1 --2- 172.21.15.12:0/1336492191 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x561a244e7f90 0x561a244ea3c0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d8889cb87fb3256e server_cookie=c247f9ce7da638f7 in_seq=0 out_seq=0 2024-09-05T01:25:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.695+0000 7f859e000640 10 client.25496 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:25:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.696+0000 7f859e000640 1 -- 172.21.15.12:0/1336492191 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561a24440950 con 0x561a244e7f90 2024-09-05T01:25:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.696+0000 7f859e000640 10 client.25496 handle_command_reply: tid=0 2024-09-05T01:25:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.696+0000 7f85bda1b740 1 client.25496 shutdown 2024-09-05T01:25:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.697+0000 7f85bda1b740 1 -- 172.21.15.12:0/1336492191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244ccc70 msgr2=0x561a244d4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.697+0000 7f85bda1b740 1 --2- 172.21.15.12:0/1336492191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244ccc70 0x561a244d4d50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f85a4003760 tx=0x7f85a4004730 comp rx=0 tx=0).stop 2024-09-05T01:25:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.697+0000 7f85bda1b740 1 -- 172.21.15.12:0/1336492191 shutdown_connections 2024-09-05T01:25:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.697+0000 7f85bda1b740 1 --2- 172.21.15.12:0/1336492191 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x561a244e7f90 0x561a244ea3c0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.697+0000 7f85bda1b740 1 --2- 172.21.15.12:0/1336492191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a244d7e50 0x561a244d57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.697+0000 7f85bda1b740 1 --2- 172.21.15.12:0/1336492191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a244cd590 0x561a244d5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.697+0000 7f85bda1b740 1 --2- 172.21.15.12:0/1336492191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244ccc70 0x561a244d4d50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.697+0000 7f85bda1b740 1 -- 172.21.15.12:0/1336492191 >> 172.21.15.12:0/1336492191 conn(0x561a244c9200 msgr2=0x561a244c8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:50.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.697+0000 7f859e000640 0 client.25496 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:25:50.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.697+0000 7f85bda1b740 1 -- 172.21.15.12:0/1336492191 shutdown_connections 2024-09-05T01:25:50.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.697+0000 7f85bda1b740 1 -- 172.21.15.12:0/1336492191 wait complete. 2024-09-05T01:25:50.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.698+0000 7f85bda1b740 20 client.25496 trim_cache size 0 max 16384 2024-09-05T01:25:50.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.712+0000 7f85bda1b740 1 Processor -- start 2024-09-05T01:25:50.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.712+0000 7f85bda1b740 1 -- start start 2024-09-05T01:25:50.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.712+0000 7f85bda1b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a244ccc70 0x561a244d6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:50.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.712+0000 7f85bda1b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a244cd590 0x561a244efcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:50.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.712+0000 7f85bda1b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244d7e50 0x561a244f0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:50.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.712+0000 7f85bda1b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f85b41b3f10 con 0x561a244cd590 2024-09-05T01:25:50.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.712+0000 7f85bda1b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f85b41b5a50 con 0x561a244d7e50 2024-09-05T01:25:50.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.712+0000 7f85bda1b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f85b41b45e0 con 0x561a244ccc70 2024-09-05T01:25:50.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.713+0000 7f85b3e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a244ccc70 0x561a244d6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:50.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.713+0000 7f85b3400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a244cd590 0x561a244efcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:50.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.713+0000 7f85b3e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a244ccc70 0x561a244d6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:52858/0 (socket says 172.21.15.12:52858) 2024-09-05T01:25:50.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.713+0000 7f85b3400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a244cd590 0x561a244efcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42808/0 (socket says 172.21.15.12:42808) 2024-09-05T01:25:50.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.713+0000 7f85b3e00640 1 -- 172.21.15.12:0/124702131 learned_addr learned my addr 172.21.15.12:0/124702131 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:50.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.713+0000 7f85b9000640 1 --2- 172.21.15.12:0/124702131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244d7e50 0x561a244f0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:50.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.713+0000 7f85b3400640 1 -- 172.21.15.12:0/124702131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a244ccc70 msgr2=0x561a244d6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:50.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.713+0000 7f85b3400640 1 --2- 172.21.15.12:0/124702131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a244ccc70 0x561a244d6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.713+0000 7f85b3400640 1 -- 172.21.15.12:0/124702131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244d7e50 msgr2=0x561a244f0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:50.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.713+0000 7f85b3400640 1 --2- 172.21.15.12:0/124702131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244d7e50 0x561a244f0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.713+0000 7f85b3400640 1 -- 172.21.15.12:0/124702131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a244c4770 con 0x561a244cd590 2024-09-05T01:25:50.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.714+0000 7f85b3400640 1 --2- 172.21.15.12:0/124702131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a244cd590 0x561a244efcd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f85a0000c00 tx=0x7f85a0005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60e4dd131f81f1e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:50.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.714+0000 7f85a8c00640 1 -- 172.21.15.12:0/124702131 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a0035040 con 0x561a244cd590 2024-09-05T01:25:50.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.714+0000 7f85a8c00640 1 -- 172.21.15.12:0/124702131 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85a0041040 con 0x561a244cd590 2024-09-05T01:25:50.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.714+0000 7f85a8c00640 1 -- 172.21.15.12:0/124702131 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a0003ac0 con 0x561a244cd590 2024-09-05T01:25:50.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.715+0000 7f85bda1b740 1 -- 172.21.15.12:0/124702131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a244cd590 msgr2=0x561a244efcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:50.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.715+0000 7f85bda1b740 1 --2- 172.21.15.12:0/124702131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a244cd590 0x561a244efcd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f85a0000c00 tx=0x7f85a0005850 comp rx=0 tx=0).stop 2024-09-05T01:25:50.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.715+0000 7f85bda1b740 1 -- 172.21.15.12:0/124702131 shutdown_connections 2024-09-05T01:25:50.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.715+0000 7f85bda1b740 1 --2- 172.21.15.12:0/124702131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244d7e50 0x561a244f0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.715+0000 7f85bda1b740 1 --2- 172.21.15.12:0/124702131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a244cd590 0x561a244efcd0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.715+0000 7f85bda1b740 1 --2- 172.21.15.12:0/124702131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a244ccc70 0x561a244d6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.715+0000 7f85bda1b740 1 -- 172.21.15.12:0/124702131 >> 172.21.15.12:0/124702131 conn(0x561a244c9200 msgr2=0x561a244d65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:50.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.715+0000 7f85bda1b740 1 -- 172.21.15.12:0/124702131 shutdown_connections 2024-09-05T01:25:50.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.717+0000 7f85bda1b740 1 -- 172.21.15.12:0/124702131 wait complete. 2024-09-05T01:25:50.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.717+0000 7f85bda1b740 1 -- start start 2024-09-05T01:25:50.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.717+0000 7f85bda1b740 1 Processor -- start 2024-09-05T01:25:50.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.718+0000 7f85bda1b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a244ccc70 0x561a244d1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:50.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.718+0000 7f85bda1b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a244cd590 0x561a244d24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:50.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.718+0000 7f85bda1b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244d7e50 0x561a244d2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:50.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.718+0000 7f85bda1b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f85b41b5380 con 0x561a244ccc70 2024-09-05T01:25:50.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.718+0000 7f85bda1b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f85b41b4cb0 con 0x561a244d7e50 2024-09-05T01:25:50.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.718+0000 7f85bda1b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f85b41b1ef0 con 0x561a244cd590 2024-09-05T01:25:50.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.718+0000 7f85bda1b740 10 client.0 _ll_register_callbacks cb 0x7f85a4004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:50.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.718+0000 7f85b3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a244ccc70 0x561a244d1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:50.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.718+0000 7f85b3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a244ccc70 0x561a244d1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42824/0 (socket says 172.21.15.12:42824) 2024-09-05T01:25:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.718+0000 7f85b3e00640 1 -- 172.21.15.12:0/1646574400 learned_addr learned my addr 172.21.15.12:0/1646574400 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.718+0000 7f85b3400640 1 --2- 172.21.15.12:0/1646574400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a244cd590 0x561a244d24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.719+0000 7f85b9000640 1 --2- 172.21.15.12:0/1646574400 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244d7e50 0x561a244d2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.719+0000 7f85b3e00640 1 -- 172.21.15.12:0/1646574400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a244cd590 msgr2=0x561a244d24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.719+0000 7f85b3e00640 1 --2- 172.21.15.12:0/1646574400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a244cd590 0x561a244d24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.719+0000 7f85b3e00640 1 -- 172.21.15.12:0/1646574400 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244d7e50 msgr2=0x561a244d2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.719+0000 7f85b3e00640 1 --2- 172.21.15.12:0/1646574400 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244d7e50 0x561a244d2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.719+0000 7f85b3e00640 1 -- 172.21.15.12:0/1646574400 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a24551ea0 con 0x561a244ccc70 2024-09-05T01:25:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.719+0000 7f85b3400640 1 --2- 172.21.15.12:0/1646574400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a244cd590 0x561a244d24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:25:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.719+0000 7f85b9000640 1 --2- 172.21.15.12:0/1646574400 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244d7e50 0x561a244d2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:25:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.720+0000 7f85b3e00640 1 --2- 172.21.15.12:0/1646574400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a244ccc70 0x561a244d1f80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f85a4032b20 tx=0x7f85a401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc7f0bacbfeaaa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:50.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.720+0000 7f859e000640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:25:50.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.720+0000 7f859e000640 1 -- 172.21.15.12:0/1646574400 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a4005bf0 con 0x561a244ccc70 2024-09-05T01:25:50.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.720+0000 7f859e000640 1 -- 172.21.15.12:0/1646574400 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f85a4009040 con 0x561a244ccc70 2024-09-05T01:25:50.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.720+0000 7f85bda1b740 1 -- 172.21.15.12:0/1646574400 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85a0041040 con 0x561a244ccc70 2024-09-05T01:25:50.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.720+0000 7f859e000640 1 -- 172.21.15.12:0/1646574400 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f85a4048050 con 0x561a244ccc70 2024-09-05T01:25:50.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.720+0000 7f85bda1b740 10 client.15495 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:50.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.720+0000 7f85bda1b740 1 -- 172.21.15.12:0/1646574400 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561a24553180 con 0x561a244ccc70 2024-09-05T01:25:50.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.721+0000 7f859e000640 1 -- 172.21.15.12:0/1646574400 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85a403f070 con 0x561a244ccc70 2024-09-05T01:25:50.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.721+0000 7f859e000640 1 -- 172.21.15.12:0/1646574400 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f85a4039070 con 0x561a244ccc70 2024-09-05T01:25:50.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.721+0000 7f85bda1b740 10 client.15495 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:50.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.721+0000 7f85bda1b740 10 client.15495 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-05T01:25:50.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.721+0000 7f85bda1b740 20 client.15495 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:50.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.721+0000 7f85bda1b740 1 --2- 172.21.15.12:0/1646574400 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x561a245538c0 0x561a24555ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:50.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.721+0000 7f85bda1b740 4 client.15495 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:25:50.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.721+0000 7f85bda1b740 1 -- 172.21.15.12:0/1646574400 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f85a0041040 con 0x561a245538c0 2024-09-05T01:25:50.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.722+0000 7f85b3400640 1 --2- 172.21.15.12:0/1646574400 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x561a245538c0 0x561a24555ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:50.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.722+0000 7f85b3400640 1 --2- 172.21.15.12:0/1646574400 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x561a245538c0 0x561a24555ce0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a41ee7e8419d7699 server_cookie=83da22e43ceb14b2 in_seq=0 out_seq=0 2024-09-05T01:25:50.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.722+0000 7f859e000640 10 client.15495 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:25:50.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.722+0000 7f859e000640 1 -- 172.21.15.12:0/1646574400 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f85a0041040 con 0x561a245538c0 2024-09-05T01:25:50.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.722+0000 7f859e000640 10 client.15495 handle_command_reply: tid=0 2024-09-05T01:25:50.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.722+0000 7f85bda1b740 1 client.15495 shutdown 2024-09-05T01:25:50.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.723+0000 7f85bda1b740 1 -- 172.21.15.12:0/1646574400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a244ccc70 msgr2=0x561a244d1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:50.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.723+0000 7f85bda1b740 1 --2- 172.21.15.12:0/1646574400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a244ccc70 0x561a244d1f80 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f85a4032b20 tx=0x7f85a401c410 comp rx=0 tx=0).stop 2024-09-05T01:25:50.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.723+0000 7f85bda1b740 1 -- 172.21.15.12:0/1646574400 shutdown_connections 2024-09-05T01:25:50.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.723+0000 7f85bda1b740 1 --2- 172.21.15.12:0/1646574400 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x561a245538c0 0x561a24555ce0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.723+0000 7f85bda1b740 1 --2- 172.21.15.12:0/1646574400 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561a244d7e50 0x561a244d2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.723+0000 7f85bda1b740 1 --2- 172.21.15.12:0/1646574400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a244cd590 0x561a244d24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.723+0000 7f85bda1b740 1 --2- 172.21.15.12:0/1646574400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561a244ccc70 0x561a244d1f80 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.723+0000 7f85bda1b740 1 -- 172.21.15.12:0/1646574400 >> 172.21.15.12:0/1646574400 conn(0x561a244c9200 msgr2=0x561a244c8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:50.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.723+0000 7f859e000640 0 client.15495 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:25:50.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.723+0000 7f85bda1b740 1 -- 172.21.15.12:0/1646574400 shutdown_connections 2024-09-05T01:25:50.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.723+0000 7f85bda1b740 1 -- 172.21.15.12:0/1646574400 wait complete. 2024-09-05T01:25:50.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.724+0000 7f85bda1b740 20 client.15495 trim_cache size 0 max 16384 2024-09-05T01:25:50.726 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:25:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.724+0000 7f85bb000640 1 -- 172.21.15.12:0/2593285058 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f85980a2e10 msgr2=0x7f85980a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.724+0000 7f85bb000640 1 --2- 172.21.15.12:0/2593285058 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f85980a2e10 0x7f85980a52d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x561a244ca060 tx=0x7f85a4005f90 comp rx=0 tx=0).stop 2024-09-05T01:25:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.724+0000 7f85bb000640 1 -- 172.21.15.12:0/2593285058 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f85b4112a30 msgr2=0x7f85b419e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.724+0000 7f85bb000640 1 --2- 172.21.15.12:0/2593285058 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f85b4112a30 0x7f85b419e880 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f85b407aa10 tx=0x7f85ac00ef10 comp rx=0 tx=0).stop 2024-09-05T01:25:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.725+0000 7f85bb000640 1 -- 172.21.15.12:0/2593285058 shutdown_connections 2024-09-05T01:25:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.725+0000 7f85bb000640 1 --2- 172.21.15.12:0/2593285058 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f85980a2e10 0x7f85980a52d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.725+0000 7f85bb000640 1 --2- 172.21.15.12:0/2593285058 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f85b4112a30 0x7f85b419e880 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.725+0000 7f85bb000640 1 --2- 172.21.15.12:0/2593285058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85b4077040 0x7f85b41a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.725+0000 7f85bb000640 1 --2- 172.21.15.12:0/2593285058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85b4076720 0x7f85b41a46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.725+0000 7f85bb000640 1 -- 172.21.15.12:0/2593285058 >> 172.21.15.12:0/2593285058 conn(0x7f85b40ffa90 msgr2=0x7f85b4101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.725+0000 7f85bb000640 1 -- 172.21.15.12:0/2593285058 shutdown_connections 2024-09-05T01:25:50.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:50.725+0000 7f85bb000640 1 -- 172.21.15.12:0/2593285058 wait complete. 2024-09-05T01:25:50.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:50 smithi012 ceph-mon[29942]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2024-09-05T01:25:51.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:50 smithi145 ceph-mon[34376]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2024-09-05T01:25:51.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:50 smithi151 ceph-mon[35013]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 12 op/s 2024-09-05T01:25:51.484 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-05T01:25:51.924 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:25:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.613+0000 7f57b5200640 1 -- 172.21.15.12:0/2486308327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57b0074510 msgr2=0x7f57b00748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.613+0000 7f57b5200640 1 --2- 172.21.15.12:0/2486308327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57b0074510 0x7f57b00748f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009860 tx=0x7f57a002a3d0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.613+0000 7f57b5200640 1 -- 172.21.15.12:0/2486308327 shutdown_connections 2024-09-05T01:25:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.613+0000 7f57b5200640 1 --2- 172.21.15.12:0/2486308327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b010e450 0x7f57b0110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.613+0000 7f57b5200640 1 --2- 172.21.15.12:0/2486308327 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57b0074e30 0x7f57b010df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.613+0000 7f57b5200640 1 --2- 172.21.15.12:0/2486308327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57b0074510 0x7f57b00748f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.613+0000 7f57b5200640 1 -- 172.21.15.12:0/2486308327 >> 172.21.15.12:0/2486308327 conn(0x7f57b00fd8b0 msgr2=0x7f57b00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.613+0000 7f57b5200640 1 -- 172.21.15.12:0/2486308327 shutdown_connections 2024-09-05T01:25:52.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.613+0000 7f57b5200640 1 -- 172.21.15.12:0/2486308327 wait complete. 2024-09-05T01:25:52.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.615+0000 7f57b5200640 1 Processor -- start 2024-09-05T01:25:52.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.615+0000 7f57b5200640 1 -- start start 2024-09-05T01:25:52.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.616+0000 7f57b5200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b0074510 0x7f57b0101b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:52.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.616+0000 7f57b5200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57b0074e30 0x7f57b0102080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:52.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.617+0000 7f57b5200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57b010e450 0x7f57b01025c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:52.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.617+0000 7f57b5200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f57b0114180 con 0x7f57b0074510 2024-09-05T01:25:52.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.617+0000 7f57b5200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f57b0114000 con 0x7f57b010e450 2024-09-05T01:25:52.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.617+0000 7f57b5200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f57b0114300 con 0x7f57b0074e30 2024-09-05T01:25:52.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.618+0000 7f57ade00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b0074510 0x7f57b0101b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:52.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.618+0000 7f57ade00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b0074510 0x7f57b0101b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42850/0 (socket says 172.21.15.12:42850) 2024-09-05T01:25:52.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.618+0000 7f57ade00640 1 -- 172.21.15.12:0/4268807481 learned_addr learned my addr 172.21.15.12:0/4268807481 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:52.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.618+0000 7f57ad400640 1 --2- 172.21.15.12:0/4268807481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57b0074e30 0x7f57b0102080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:52.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.619+0000 7f57ae800640 1 --2- 172.21.15.12:0/4268807481 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57b010e450 0x7f57b01025c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:52.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.619+0000 7f57ad400640 1 -- 172.21.15.12:0/4268807481 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57b010e450 msgr2=0x7f57b01025c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:52.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.619+0000 7f57ad400640 1 --2- 172.21.15.12:0/4268807481 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57b010e450 0x7f57b01025c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.620+0000 7f57ad400640 1 -- 172.21.15.12:0/4268807481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b0074510 msgr2=0x7f57b0101b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:52.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.620+0000 7f57ad400640 1 --2- 172.21.15.12:0/4268807481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b0074510 0x7f57b0101b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.620+0000 7f57ad400640 1 -- 172.21.15.12:0/4268807481 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b0072910 con 0x7f57b0074e30 2024-09-05T01:25:52.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.620+0000 7f57ad400640 1 --2- 172.21.15.12:0/4268807481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57b0074e30 0x7f57b0102080 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f579c00e790 tx=0x7f579c00ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:52.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.621+0000 7f57a6a00640 1 -- 172.21.15.12:0/4268807481 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c00eea0 con 0x7f57b0074e30 2024-09-05T01:25:52.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.621+0000 7f57a6a00640 1 -- 172.21.15.12:0/4268807481 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f579c00ccc0 con 0x7f57b0074e30 2024-09-05T01:25:52.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.621+0000 7f57a6a00640 1 -- 172.21.15.12:0/4268807481 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c004a00 con 0x7f57b0074e30 2024-09-05T01:25:52.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.621+0000 7f57b5200640 1 -- 172.21.15.12:0/4268807481 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b0072c00 con 0x7f57b0074e30 2024-09-05T01:25:52.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.621+0000 7f57b5200640 1 -- 172.21.15.12:0/4268807481 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b0073090 con 0x7f57b0074e30 2024-09-05T01:25:52.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.626+0000 7f57b7e34740 1 Processor -- start 2024-09-05T01:25:52.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.626+0000 7f57a6a00640 1 -- 172.21.15.12:0/4268807481 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) ==== 138066+0+0 (secure 0 0 0) 0x7f579c004ba0 con 0x7f57b0074e30 2024-09-05T01:25:52.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.627+0000 7f57b7e34740 1 -- start start 2024-09-05T01:25:52.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.627+0000 7f57b7e34740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562970074c70 0x562970075050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:52.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.627+0000 7f57b7e34740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562970075590 0x56297007f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:52.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.627+0000 7f57b7e34740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56297007fe50 0x562970082240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:52.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.627+0000 7f57b7e34740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56296ffdb3e0 con 0x562970074c70 2024-09-05T01:25:52.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.627+0000 7f57b7e34740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56296ff82d80 con 0x562970075590 2024-09-05T01:25:52.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.627+0000 7f57b7e34740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56296ffd73a0 con 0x56297007fe50 2024-09-05T01:25:52.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.628+0000 7f57ade00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562970075590 0x56297007f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:52.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.628+0000 7f57ade00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562970075590 0x56297007f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:48970/0 (socket says 172.21.15.12:48970) 2024-09-05T01:25:52.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.628+0000 7f57ade00640 1 -- 172.21.15.12:0/4130050660 learned_addr learned my addr 172.21.15.12:0/4130050660 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:52.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.628+0000 7f57ad400640 1 --2- 172.21.15.12:0/4130050660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56297007fe50 0x562970082240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:52.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.628+0000 7f57ae800640 1 --2- 172.21.15.12:0/4130050660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562970074c70 0x562970075050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:52.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.629+0000 7f57ae800640 1 -- 172.21.15.12:0/4130050660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56297007fe50 msgr2=0x562970082240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:52.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.629+0000 7f57ae800640 1 --2- 172.21.15.12:0/4130050660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56297007fe50 0x562970082240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.629+0000 7f57ae800640 1 -- 172.21.15.12:0/4130050660 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562970075590 msgr2=0x56297007f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:52.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.629+0000 7f57ae800640 1 --2- 172.21.15.12:0/4130050660 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562970075590 0x56297007f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.629+0000 7f57ae800640 1 -- 172.21.15.12:0/4130050660 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56296ffa1ae0 con 0x562970074c70 2024-09-05T01:25:52.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.630+0000 7f57a6a00640 1 --2- 172.21.15.12:0/4268807481 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f57940a2f10 0x7f57940a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:52.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.630+0000 7f57ae800640 1 --2- 172.21.15.12:0/4130050660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562970074c70 0x562970075050 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f57a8005fd0 tx=0x7f57a80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a548e98e969a256c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:52.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.631+0000 7f579b400640 1 -- 172.21.15.12:0/4130050660 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8003b70 con 0x562970074c70 2024-09-05T01:25:52.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.631+0000 7f579b400640 1 -- 172.21.15.12:0/4130050660 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57a8015070 con 0x562970074c70 2024-09-05T01:25:52.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.631+0000 7f579b400640 1 -- 172.21.15.12:0/4130050660 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a8011880 con 0x562970074c70 2024-09-05T01:25:52.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.631+0000 7f57a6a00640 1 -- 172.21.15.12:0/4268807481 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f579c0cf630 con 0x7f57b0074e30 2024-09-05T01:25:52.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.632+0000 7f57ade00640 1 --2- 172.21.15.12:0/4268807481 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f57940a2f10 0x7f57940a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:52.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.632+0000 7f57b7e34740 1 -- 172.21.15.12:0/4130050660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562970074c70 msgr2=0x562970075050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:52.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.632+0000 7f57b7e34740 1 --2- 172.21.15.12:0/4130050660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562970074c70 0x562970075050 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f57a8005fd0 tx=0x7f57a80107a0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.633+0000 7f57b7e34740 1 -- 172.21.15.12:0/4130050660 shutdown_connections 2024-09-05T01:25:52.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.633+0000 7f57b7e34740 1 --2- 172.21.15.12:0/4130050660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56297007fe50 0x562970082240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.633+0000 7f57b7e34740 1 --2- 172.21.15.12:0/4130050660 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562970075590 0x56297007f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.633+0000 7f57b7e34740 1 --2- 172.21.15.12:0/4130050660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562970074c70 0x562970075050 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.633+0000 7f57b7e34740 1 -- 172.21.15.12:0/4130050660 >> 172.21.15.12:0/4130050660 conn(0x562970071200 msgr2=0x5629700715e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:52.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.634+0000 7f57ade00640 1 --2- 172.21.15.12:0/4268807481 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f57940a2f10 0x7f57940a53d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f57a00095f0 tx=0x7f57a000b040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:52.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.634+0000 7f57b7e34740 1 -- 172.21.15.12:0/4130050660 shutdown_connections 2024-09-05T01:25:52.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.634+0000 7f57b7e34740 1 -- 172.21.15.12:0/4130050660 wait complete. 2024-09-05T01:25:52.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.635+0000 7f57b7e34740 1 -- start start 2024-09-05T01:25:52.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.635+0000 7f57b7e34740 1 Processor -- start 2024-09-05T01:25:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.636+0000 7f57b7e34740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562970074c70 0x56297007cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.636+0000 7f57b7e34740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562970075590 0x56297007d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.636+0000 7f57b7e34740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56297007fe50 0x56297007d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.636+0000 7f57b7e34740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562970082a20 con 0x562970075590 2024-09-05T01:25:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.636+0000 7f57b7e34740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56296ff960f0 con 0x56297007fe50 2024-09-05T01:25:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.636+0000 7f57b7e34740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562970082ba0 con 0x562970074c70 2024-09-05T01:25:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.636+0000 7f57b7e34740 10 client.0 _ll_register_callbacks cb 0x56296ff7dbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.636+0000 7f57ade00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562970074c70 0x56297007cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.637+0000 7f57ade00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562970074c70 0x56297007cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:52916/0 (socket says 172.21.15.12:52916) 2024-09-05T01:25:52.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.637+0000 7f57ade00640 1 -- 172.21.15.12:0/3310183857 learned_addr learned my addr 172.21.15.12:0/3310183857 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.637+0000 7f57ae800640 1 --2- 172.21.15.12:0/3310183857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56297007fe50 0x56297007d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.637+0000 7f57ae800640 1 -- 172.21.15.12:0/3310183857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562970074c70 msgr2=0x56297007cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.637+0000 7f57ae800640 1 --2- 172.21.15.12:0/3310183857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562970074c70 0x56297007cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.637+0000 7f57ae800640 1 -- 172.21.15.12:0/3310183857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562970075590 msgr2=0x56297007d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.637+0000 7f57ae800640 1 --2- 172.21.15.12:0/3310183857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562970075590 0x56297007d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.637+0000 7f57ae800640 1 -- 172.21.15.12:0/3310183857 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56296fd4c3c0 con 0x56297007fe50 2024-09-05T01:25:52.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.637+0000 7f57ade00640 1 --2- 172.21.15.12:0/3310183857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562970074c70 0x56297007cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:25:52.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.638+0000 7f57ae800640 1 --2- 172.21.15.12:0/3310183857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56297007fe50 0x56297007d790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f57a8010ca0 tx=0x7f57a8010f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b7d0878ed7abbd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:52.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.638+0000 7f578fe00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:25:52.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.638+0000 7f578fe00640 1 -- 172.21.15.12:0/3310183857 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a802c060 con 0x56297007fe50 2024-09-05T01:25:52.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.639+0000 7f578fe00640 1 -- 172.21.15.12:0/3310183857 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f57a8004210 con 0x56297007fe50 2024-09-05T01:25:52.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.639+0000 7f57b7e34740 1 -- 172.21.15.12:0/3310183857 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57a8015070 con 0x56297007fe50 2024-09-05T01:25:52.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.639+0000 7f578fe00640 1 -- 172.21.15.12:0/3310183857 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f57a8004410 con 0x56297007fe50 2024-09-05T01:25:52.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.639+0000 7f57b7e34740 10 client.25514 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:52.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.639+0000 7f57b7e34740 1 -- 172.21.15.12:0/3310183857 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56297008ea30 con 0x56297007fe50 2024-09-05T01:25:52.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.639+0000 7f578fe00640 1 -- 172.21.15.12:0/3310183857 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57a8015070 con 0x56297007fe50 2024-09-05T01:25:52.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.640+0000 7f578fe00640 1 -- 172.21.15.12:0/3310183857 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f57a801a070 con 0x56297007fe50 2024-09-05T01:25:52.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.640+0000 7f57b7e34740 10 client.25514 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:52.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.640+0000 7f57b7e34740 10 client.25514 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T01:25:52.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.640+0000 7f57b7e34740 20 client.25514 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:52.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.640+0000 7f57b7e34740 1 --2- 172.21.15.12:0/3310183857 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x56297008fde0 0x5629700921d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:52.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.640+0000 7f57b7e34740 4 client.25514 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:25:52.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.640+0000 7f57b7e34740 1 -- 172.21.15.12:0/3310183857 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56296ffe8950 con 0x56297008fde0 2024-09-05T01:25:52.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.640+0000 7f57ade00640 1 --2- 172.21.15.12:0/3310183857 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x56297008fde0 0x5629700921d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:52.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.641+0000 7f57ade00640 1 --2- 172.21.15.12:0/3310183857 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x56297008fde0 0x5629700921d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1064a3b9bcdf9296 server_cookie=e5a6d196bf7c56b4 in_seq=0 out_seq=0 2024-09-05T01:25:52.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.641+0000 7f578fe00640 10 client.25514 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:25:52.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.643+0000 7f578fe00640 1 -- 172.21.15.12:0/3310183857 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56296ffe8950 con 0x56297008fde0 2024-09-05T01:25:52.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.643+0000 7f578fe00640 10 client.25514 handle_command_reply: tid=0 2024-09-05T01:25:52.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.643+0000 7f57b7e34740 1 client.25514 shutdown 2024-09-05T01:25:52.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.643+0000 7f57b7e34740 1 -- 172.21.15.12:0/3310183857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56297007fe50 msgr2=0x56297007d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:52.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.643+0000 7f57b7e34740 1 --2- 172.21.15.12:0/3310183857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56297007fe50 0x56297007d790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f57a8010ca0 tx=0x7f57a8010f70 comp rx=0 tx=0).stop 2024-09-05T01:25:52.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.643+0000 7f57b7e34740 1 -- 172.21.15.12:0/3310183857 shutdown_connections 2024-09-05T01:25:52.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.643+0000 7f57b7e34740 1 --2- 172.21.15.12:0/3310183857 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x56297008fde0 0x5629700921d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.643+0000 7f57b7e34740 1 --2- 172.21.15.12:0/3310183857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56297007fe50 0x56297007d790 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.643+0000 7f57b7e34740 1 --2- 172.21.15.12:0/3310183857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562970075590 0x56297007d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.643+0000 7f57b7e34740 1 --2- 172.21.15.12:0/3310183857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562970074c70 0x56297007cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.643+0000 7f57b7e34740 1 -- 172.21.15.12:0/3310183857 >> 172.21.15.12:0/3310183857 conn(0x562970071200 msgr2=0x562970076f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:52.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.643+0000 7f578fe00640 0 client.25514 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:25:52.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.644+0000 7f57b7e34740 1 -- 172.21.15.12:0/3310183857 shutdown_connections 2024-09-05T01:25:52.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.644+0000 7f57b7e34740 1 -- 172.21.15.12:0/3310183857 wait complete. 2024-09-05T01:25:52.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.644+0000 7f57b7e34740 20 client.25514 trim_cache size 0 max 16384 2024-09-05T01:25:52.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.665+0000 7f57b7e34740 1 Processor -- start 2024-09-05T01:25:52.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.665+0000 7f57b7e34740 1 -- start start 2024-09-05T01:25:52.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.665+0000 7f57b7e34740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562970074c70 0x5629700776d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:52.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.665+0000 7f57b7e34740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562970075590 0x562970078220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:52.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.665+0000 7f57ade00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562970074c70 0x5629700776d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:52.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.666+0000 7f57ade00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562970074c70 0x5629700776d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:52928/0 (socket says 172.21.15.12:52928) 2024-09-05T01:25:52.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.666+0000 7f57ade00640 1 -- 172.21.15.12:0/2342643418 learned_addr learned my addr 172.21.15.12:0/2342643418 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:52.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.666+0000 7f57b7e34740 1 --2- 172.21.15.12:0/2342643418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56297007fe50 0x562970097770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:52.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.666+0000 7f57b7e34740 1 -- 172.21.15.12:0/2342643418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f57b01bc7e0 con 0x562970075590 2024-09-05T01:25:52.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.666+0000 7f57b7e34740 1 -- 172.21.15.12:0/2342643418 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f57b01be320 con 0x56297007fe50 2024-09-05T01:25:52.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.666+0000 7f57b7e34740 1 -- 172.21.15.12:0/2342643418 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f57b01bceb0 con 0x562970074c70 2024-09-05T01:25:52.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.666+0000 7f57ad400640 1 --2- 172.21.15.12:0/2342643418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562970075590 0x562970078220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:52.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.666+0000 7f57ae800640 1 --2- 172.21.15.12:0/2342643418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56297007fe50 0x562970097770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:52.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.667+0000 7f57ade00640 1 -- 172.21.15.12:0/2342643418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56297007fe50 msgr2=0x562970097770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:52.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.667+0000 7f57ade00640 1 --2- 172.21.15.12:0/2342643418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56297007fe50 0x562970097770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.667+0000 7f57ade00640 1 -- 172.21.15.12:0/2342643418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562970075590 msgr2=0x562970078220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:52.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.667+0000 7f57ade00640 1 --2- 172.21.15.12:0/2342643418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562970075590 0x562970078220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.667+0000 7f57ade00640 1 -- 172.21.15.12:0/2342643418 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562970074aa0 con 0x562970074c70 2024-09-05T01:25:52.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.667+0000 7f57ad400640 1 --2- 172.21.15.12:0/2342643418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562970075590 0x562970078220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:25:52.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.667+0000 7f57ade00640 1 --2- 172.21.15.12:0/2342643418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562970074c70 0x5629700776d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f57a002f4f0 tx=0x7f57a0041000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d265c25fe3e4b80e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:52.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.668+0000 7f579aa00640 1 -- 172.21.15.12:0/2342643418 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a00041c0 con 0x562970074c70 2024-09-05T01:25:52.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.668+0000 7f579aa00640 1 -- 172.21.15.12:0/2342643418 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57a0004360 con 0x562970074c70 2024-09-05T01:25:52.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.668+0000 7f579aa00640 1 -- 172.21.15.12:0/2342643418 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a002f830 con 0x562970074c70 2024-09-05T01:25:52.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.669+0000 7f57b7e34740 1 -- 172.21.15.12:0/2342643418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562970074c70 msgr2=0x5629700776d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:52.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.669+0000 7f57b7e34740 1 --2- 172.21.15.12:0/2342643418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562970074c70 0x5629700776d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f57a002f4f0 tx=0x7f57a0041000 comp rx=0 tx=0).stop 2024-09-05T01:25:52.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.669+0000 7f57b7e34740 1 -- 172.21.15.12:0/2342643418 shutdown_connections 2024-09-05T01:25:52.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.669+0000 7f57b7e34740 1 --2- 172.21.15.12:0/2342643418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56297007fe50 0x562970097770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.669+0000 7f57b7e34740 1 --2- 172.21.15.12:0/2342643418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562970075590 0x562970078220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.669+0000 7f57b7e34740 1 --2- 172.21.15.12:0/2342643418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562970074c70 0x5629700776d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.669+0000 7f57b7e34740 1 -- 172.21.15.12:0/2342643418 >> 172.21.15.12:0/2342643418 conn(0x562970071200 msgr2=0x56297007be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:52.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.669+0000 7f57b7e34740 1 -- 172.21.15.12:0/2342643418 shutdown_connections 2024-09-05T01:25:52.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.669+0000 7f57b7e34740 1 -- 172.21.15.12:0/2342643418 wait complete. 2024-09-05T01:25:52.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.670+0000 7f57b7e34740 1 -- start start 2024-09-05T01:25:52.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.670+0000 7f57b7e34740 1 Processor -- start 2024-09-05T01:25:52.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.670+0000 7f57b7e34740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562970074c70 0x562970083580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:52.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.670+0000 7f57b7e34740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562970075590 0x562970083ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:52.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.670+0000 7f57b7e34740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56297007fe50 0x5629700f8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:52.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.670+0000 7f57b7e34740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f57b01bdc50 con 0x562970075590 2024-09-05T01:25:52.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.671+0000 7f57b7e34740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f57b01bd580 con 0x56297007fe50 2024-09-05T01:25:52.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.671+0000 7f57b7e34740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f57b01ba7c0 con 0x562970074c70 2024-09-05T01:25:52.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.671+0000 7f57b7e34740 10 client.0 _ll_register_callbacks cb 0x7f579c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:52.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.671+0000 7f57ae800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56297007fe50 0x5629700f8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:52.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.671+0000 7f57ae800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56297007fe50 0x5629700f8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:48990/0 (socket says 172.21.15.12:48990) 2024-09-05T01:25:52.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.671+0000 7f57ae800640 1 -- 172.21.15.12:0/241231071 learned_addr learned my addr 172.21.15.12:0/241231071 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:52.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.671+0000 7f57ade00640 1 --2- 172.21.15.12:0/241231071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562970074c70 0x562970083580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:52.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.671+0000 7f57ade00640 1 -- 172.21.15.12:0/241231071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56297007fe50 msgr2=0x5629700f8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:52.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.671+0000 7f57ade00640 1 --2- 172.21.15.12:0/241231071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56297007fe50 0x5629700f8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.671+0000 7f57ade00640 1 -- 172.21.15.12:0/241231071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562970075590 msgr2=0x562970083ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:25:52.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.672+0000 7f57ade00640 1 --2- 172.21.15.12:0/241231071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562970075590 0x562970083ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.672+0000 7f57ade00640 1 -- 172.21.15.12:0/241231071 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56297006c770 con 0x562970074c70 2024-09-05T01:25:52.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.673+0000 7f57ade00640 1 --2- 172.21.15.12:0/241231071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562970074c70 0x562970083580 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f57a000b010 tx=0x7f57a002a3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f7967cf193846f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:52.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.673+0000 7f578fe00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:25:52.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.673+0000 7f578fe00640 1 -- 172.21.15.12:0/241231071 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a00041c0 con 0x562970074c70 2024-09-05T01:25:52.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.673+0000 7f578fe00640 1 -- 172.21.15.12:0/241231071 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f57a002f9c0 con 0x562970074c70 2024-09-05T01:25:52.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.673+0000 7f57b7e34740 1 -- 172.21.15.12:0/241231071 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57a0004360 con 0x562970074c70 2024-09-05T01:25:52.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.673+0000 7f578fe00640 1 -- 172.21.15.12:0/241231071 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f57a002fbc0 con 0x562970074c70 2024-09-05T01:25:52.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.674+0000 7f57b7e34740 10 client.25525 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:52.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.674+0000 7f57b7e34740 1 -- 172.21.15.12:0/241231071 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5629700f9ec0 con 0x562970074c70 2024-09-05T01:25:52.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.674+0000 7f578fe00640 1 -- 172.21.15.12:0/241231071 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57a0004360 con 0x562970074c70 2024-09-05T01:25:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.674+0000 7f578fe00640 1 -- 172.21.15.12:0/241231071 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f57a00464f0 con 0x562970074c70 2024-09-05T01:25:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.674+0000 7f57b7e34740 10 client.25525 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.674+0000 7f57b7e34740 10 client.25525 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T01:25:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.674+0000 7f57b7e34740 20 client.25525 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.674+0000 7f57b7e34740 1 --2- 172.21.15.12:0/241231071 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5629700fa530 0x5629700fc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.674+0000 7f57b7e34740 4 client.25525 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:25:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.674+0000 7f57b7e34740 1 -- 172.21.15.12:0/241231071 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56296ffe2e60 con 0x5629700fa530 2024-09-05T01:25:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.675+0000 7f57ad400640 1 --2- 172.21.15.12:0/241231071 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5629700fa530 0x5629700fc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.676+0000 7f57ad400640 1 --2- 172.21.15.12:0/241231071 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5629700fa530 0x5629700fc950 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=452b4cbea6caf81d server_cookie=4347250d5a87a85d in_seq=0 out_seq=0 2024-09-05T01:25:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.676+0000 7f578fe00640 10 client.25525 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:25:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.676+0000 7f578fe00640 1 -- 172.21.15.12:0/241231071 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56296ffe2e60 con 0x5629700fa530 2024-09-05T01:25:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.676+0000 7f578fe00640 10 client.25525 handle_command_reply: tid=0 2024-09-05T01:25:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.676+0000 7f57b7e34740 1 client.25525 shutdown 2024-09-05T01:25:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.676+0000 7f57b7e34740 1 -- 172.21.15.12:0/241231071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562970074c70 msgr2=0x562970083580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.676+0000 7f57b7e34740 1 --2- 172.21.15.12:0/241231071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562970074c70 0x562970083580 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f57a000b010 tx=0x7f57a002a3d0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.676+0000 7f57b7e34740 1 -- 172.21.15.12:0/241231071 shutdown_connections 2024-09-05T01:25:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.676+0000 7f57b7e34740 1 --2- 172.21.15.12:0/241231071 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5629700fa530 0x5629700fc950 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.676+0000 7f57b7e34740 1 --2- 172.21.15.12:0/241231071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56297007fe50 0x5629700f8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.676+0000 7f57b7e34740 1 --2- 172.21.15.12:0/241231071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562970075590 0x562970083ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.676+0000 7f57b7e34740 1 --2- 172.21.15.12:0/241231071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562970074c70 0x562970083580 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.676+0000 7f57b7e34740 1 -- 172.21.15.12:0/241231071 >> 172.21.15.12:0/241231071 conn(0x562970071200 msgr2=0x56297007e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:52.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.677+0000 7f578fe00640 0 client.25525 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:25:52.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.677+0000 7f57b7e34740 1 -- 172.21.15.12:0/241231071 shutdown_connections 2024-09-05T01:25:52.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.677+0000 7f57b7e34740 1 -- 172.21.15.12:0/241231071 wait complete. 2024-09-05T01:25:52.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.677+0000 7f57b7e34740 20 client.25525 trim_cache size 0 max 16384 2024-09-05T01:25:52.681 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:25:52.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.679+0000 7f57b5200640 1 -- 172.21.15.12:0/4268807481 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f57940a2f10 msgr2=0x7f57940a53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:52.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.679+0000 7f57b5200640 1 --2- 172.21.15.12:0/4268807481 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f57940a2f10 0x7f57940a53d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f57a00095f0 tx=0x7f57a000b040 comp rx=0 tx=0).stop 2024-09-05T01:25:52.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.679+0000 7f57b5200640 1 -- 172.21.15.12:0/4268807481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57b0074e30 msgr2=0x7f57b0102080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:52.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.679+0000 7f57b5200640 1 --2- 172.21.15.12:0/4268807481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57b0074e30 0x7f57b0102080 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f579c00e790 tx=0x7f579c00ec50 comp rx=0 tx=0).stop 2024-09-05T01:25:52.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.679+0000 7f57b5200640 1 -- 172.21.15.12:0/4268807481 shutdown_connections 2024-09-05T01:25:52.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.679+0000 7f57b5200640 1 --2- 172.21.15.12:0/4268807481 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f57940a2f10 0x7f57940a53d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.679+0000 7f57b5200640 1 --2- 172.21.15.12:0/4268807481 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f57b010e450 0x7f57b01025c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.679+0000 7f57b5200640 1 --2- 172.21.15.12:0/4268807481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57b0074e30 0x7f57b0102080 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.679+0000 7f57b5200640 1 --2- 172.21.15.12:0/4268807481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b0074510 0x7f57b0101b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:52.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.679+0000 7f57b5200640 1 -- 172.21.15.12:0/4268807481 >> 172.21.15.12:0/4268807481 conn(0x7f57b00fd8b0 msgr2=0x7f57b00fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:52.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.680+0000 7f57b5200640 1 -- 172.21.15.12:0/4268807481 shutdown_connections 2024-09-05T01:25:52.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:52.680+0000 7f57b5200640 1 -- 172.21.15.12:0/4268807481 wait complete. 2024-09-05T01:25:53.049 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:52 smithi012 ceph-mon[29942]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-05T01:25:53.049 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:52 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:25:53.050 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:52 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:25:53.050 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:52 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:25:53.050 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:52 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:25:53.050 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:52 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:25:53.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:52 smithi145 ceph-mon[34376]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-05T01:25:53.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:52 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:25:53.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:52 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:25:53.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:52 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:25:53.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:52 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:25:53.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:52 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:25:53.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:52 smithi151 ceph-mon[35013]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-05T01:25:53.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:52 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:25:53.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:52 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:25:53.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:52 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:25:53.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:52 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:25:53.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:52 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:25:53.418 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-05T01:25:53.980 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:25:54.123 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:54 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:25:54.123 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:54 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:25:54.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:54 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:25:54.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:54 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:25:54.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:54 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:25:54.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:54 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:25:54.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.632+0000 7f1923e00640 1 -- 172.21.15.12:0/3690032715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1924102360 msgr2=0x7f192410e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:54.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.632+0000 7f1923e00640 1 --2- 172.21.15.12:0/3690032715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1924102360 0x7f192410e890 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f191c009cd0 tx=0x7f191c02a8e0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.633+0000 7f1923e00640 1 -- 172.21.15.12:0/3690032715 shutdown_connections 2024-09-05T01:25:54.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.633+0000 7f1923e00640 1 --2- 172.21.15.12:0/3690032715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1924102360 0x7f192410e890 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.633+0000 7f1923e00640 1 --2- 172.21.15.12:0/3690032715 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19241019c0 0x7f1924101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.633+0000 7f1923e00640 1 --2- 172.21.15.12:0/3690032715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19241079c0 0x7f1924107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.633+0000 7f1923e00640 1 -- 172.21.15.12:0/3690032715 >> 172.21.15.12:0/3690032715 conn(0x7f19240fd740 msgr2=0x7f19240ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:54.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.633+0000 7f1923e00640 1 -- 172.21.15.12:0/3690032715 shutdown_connections 2024-09-05T01:25:54.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.633+0000 7f1923e00640 1 -- 172.21.15.12:0/3690032715 wait complete. 2024-09-05T01:25:54.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.635+0000 7f1923e00640 1 Processor -- start 2024-09-05T01:25:54.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.635+0000 7f1923e00640 1 -- start start 2024-09-05T01:25:54.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.635+0000 7f1923e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19241019c0 0x7f1924075da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:54.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.635+0000 7f1923e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1924102360 0x7f1924070e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:54.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.635+0000 7f1923e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19241079c0 0x7f1924071370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:54.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.635+0000 7f1923e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1924111e10 con 0x7f19241019c0 2024-09-05T01:25:54.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.635+0000 7f1923e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1924111c90 con 0x7f19241079c0 2024-09-05T01:25:54.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.635+0000 7f1923e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1924111f90 con 0x7f1924102360 2024-09-05T01:25:54.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.636+0000 7f1922000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1924102360 0x7f1924070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:54.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.636+0000 7f1922000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1924102360 0x7f1924070e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:52960/0 (socket says 172.21.15.12:52960) 2024-09-05T01:25:54.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.636+0000 7f1922000640 1 -- 172.21.15.12:0/2659767951 learned_addr learned my addr 172.21.15.12:0/2659767951 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:54.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.636+0000 7f1923400640 1 --2- 172.21.15.12:0/2659767951 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19241079c0 0x7f1924071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:54.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.636+0000 7f1922a00640 1 --2- 172.21.15.12:0/2659767951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19241019c0 0x7f1924075da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:54.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.636+0000 7f1922000640 1 -- 172.21.15.12:0/2659767951 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19241079c0 msgr2=0x7f1924071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:54.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.636+0000 7f1922000640 1 --2- 172.21.15.12:0/2659767951 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19241079c0 0x7f1924071370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.636+0000 7f1922000640 1 -- 172.21.15.12:0/2659767951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19241019c0 msgr2=0x7f1924075da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:54.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.636+0000 7f1922000640 1 --2- 172.21.15.12:0/2659767951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19241019c0 0x7f1924075da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.636+0000 7f1922000640 1 -- 172.21.15.12:0/2659767951 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1924071a70 con 0x7f1924102360 2024-09-05T01:25:54.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.636+0000 7f1922a00640 1 --2- 172.21.15.12:0/2659767951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19241019c0 0x7f1924075da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:25:54.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.637+0000 7f1922000640 1 --2- 172.21.15.12:0/2659767951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1924102360 0x7f1924070e30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f191000e9f0 tx=0x7f191000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:54.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.637+0000 7f1928a00640 1 -- 172.21.15.12:0/2659767951 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191000cd80 con 0x7f1924102360 2024-09-05T01:25:54.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.637+0000 7f1928a00640 1 -- 172.21.15.12:0/2659767951 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1910010910 con 0x7f1924102360 2024-09-05T01:25:54.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.637+0000 7f1928a00640 1 -- 172.21.15.12:0/2659767951 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19100188f0 con 0x7f1924102360 2024-09-05T01:25:54.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.638+0000 7f1923e00640 1 -- 172.21.15.12:0/2659767951 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f192406c950 con 0x7f1924102360 2024-09-05T01:25:54.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.638+0000 7f1923e00640 1 -- 172.21.15.12:0/2659767951 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f192406cd80 con 0x7f1924102360 2024-09-05T01:25:54.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.641+0000 7f192c810740 1 Processor -- start 2024-09-05T01:25:54.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.641+0000 7f192c810740 1 -- start start 2024-09-05T01:25:54.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.642+0000 7f192c810740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be7e40 0x559ce9be8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:54.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.642+0000 7f192c810740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ce9be8760 0x559ce9bf2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:54.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.642+0000 7f192c810740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ce9bf3020 0x559ce9bf5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:54.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.642+0000 7f192c810740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559ce9b4e3e0 con 0x559ce9be8760 2024-09-05T01:25:54.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.642+0000 7f192c810740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x559ce9af5d80 con 0x559ce9be7e40 2024-09-05T01:25:54.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.642+0000 7f192c810740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559ce9b4a3a0 con 0x559ce9bf3020 2024-09-05T01:25:54.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.642+0000 7f1923400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be7e40 0x559ce9be8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:54.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.642+0000 7f1923400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be7e40 0x559ce9be8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:49018/0 (socket says 172.21.15.12:49018) 2024-09-05T01:25:54.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.642+0000 7f1923400640 1 -- 172.21.15.12:0/1115104996 learned_addr learned my addr 172.21.15.12:0/1115104996 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:54.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.642+0000 7f1928a00640 1 -- 172.21.15.12:0/2659767951 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) ==== 138066+0+0 (secure 0 0 0) 0x7f1910010ac0 con 0x7f1924102360 2024-09-05T01:25:54.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.643+0000 7f1923400640 1 -- 172.21.15.12:0/1115104996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ce9bf3020 msgr2=0x559ce9bf5410 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:25:54.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.643+0000 7f1923400640 1 --2- 172.21.15.12:0/1115104996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ce9bf3020 0x559ce9bf5410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.643+0000 7f1923400640 1 -- 172.21.15.12:0/1115104996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ce9be8760 msgr2=0x559ce9bf2ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:25:54.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.643+0000 7f1923400640 1 --2- 172.21.15.12:0/1115104996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ce9be8760 0x559ce9bf2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.643+0000 7f1923400640 1 -- 172.21.15.12:0/1115104996 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ce9b14ae0 con 0x559ce9be7e40 2024-09-05T01:25:54.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.643+0000 7f1923400640 1 --2- 172.21.15.12:0/1115104996 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be7e40 0x559ce9be8220 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f191c009cd0 tx=0x7f191c009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b27612e801e470a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:54.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.643+0000 7f190fe00640 1 -- 172.21.15.12:0/1115104996 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c031430 con 0x559ce9be7e40 2024-09-05T01:25:54.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.644+0000 7f190fe00640 1 -- 172.21.15.12:0/1115104996 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f191c036040 con 0x559ce9be7e40 2024-09-05T01:25:54.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.644+0000 7f190fe00640 1 -- 172.21.15.12:0/1115104996 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c003d70 con 0x559ce9be7e40 2024-09-05T01:25:54.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.645+0000 7f1928a00640 1 --2- 172.21.15.12:0/2659767951 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f19080a2f10 0x7f19080a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:54.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.645+0000 7f192c810740 1 -- 172.21.15.12:0/1115104996 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be7e40 msgr2=0x559ce9be8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:54.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.645+0000 7f192c810740 1 --2- 172.21.15.12:0/1115104996 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be7e40 0x559ce9be8220 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f191c009cd0 tx=0x7f191c009a20 comp rx=0 tx=0).stop 2024-09-05T01:25:54.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.645+0000 7f1928a00640 1 -- 172.21.15.12:0/2659767951 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f19100cfd50 con 0x7f1924102360 2024-09-05T01:25:54.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.645+0000 7f1922a00640 1 --2- 172.21.15.12:0/2659767951 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f19080a2f10 0x7f19080a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:54.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.645+0000 7f192c810740 1 -- 172.21.15.12:0/1115104996 shutdown_connections 2024-09-05T01:25:54.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.645+0000 7f192c810740 1 --2- 172.21.15.12:0/1115104996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ce9bf3020 0x559ce9bf5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.645+0000 7f192c810740 1 --2- 172.21.15.12:0/1115104996 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ce9be8760 0x559ce9bf2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.645+0000 7f192c810740 1 --2- 172.21.15.12:0/1115104996 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be7e40 0x559ce9be8220 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.645+0000 7f192c810740 1 -- 172.21.15.12:0/1115104996 >> 172.21.15.12:0/1115104996 conn(0x559ce9be43d0 msgr2=0x559ce9be47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:54.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.646+0000 7f192c810740 1 -- 172.21.15.12:0/1115104996 shutdown_connections 2024-09-05T01:25:54.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.646+0000 7f192c810740 1 -- 172.21.15.12:0/1115104996 wait complete. 2024-09-05T01:25:54.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.646+0000 7f1922a00640 1 --2- 172.21.15.12:0/2659767951 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f19080a2f10 0x7f19080a53d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x559ce9be5230 tx=0x7f19140046c0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:54.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.647+0000 7f192c810740 1 -- start start 2024-09-05T01:25:54.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.647+0000 7f192c810740 1 Processor -- start 2024-09-05T01:25:54.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.647+0000 7f192c810740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be7e40 0x559ce9beff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:54.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.648+0000 7f192c810740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ce9be8760 0x559ce9bf0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:54.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.648+0000 7f192c810740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ce9bf3020 0x559ce9bf09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:54.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.648+0000 7f192c810740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559ce9bf5b90 con 0x559ce9be8760 2024-09-05T01:25:54.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.648+0000 7f192c810740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x559ce9b090f0 con 0x559ce9be7e40 2024-09-05T01:25:54.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.648+0000 7f192c810740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559ce9bf5d10 con 0x559ce9bf3020 2024-09-05T01:25:54.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.648+0000 7f192c810740 10 client.0 _ll_register_callbacks cb 0x559ce9af0bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:54.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.648+0000 7f1922a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be7e40 0x559ce9beff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:54.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.648+0000 7f1922a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be7e40 0x559ce9beff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:49030/0 (socket says 172.21.15.12:49030) 2024-09-05T01:25:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.648+0000 7f1922a00640 1 -- 172.21.15.12:0/3257851390 learned_addr learned my addr 172.21.15.12:0/3257851390 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.648+0000 7f1922000640 1 --2- 172.21.15.12:0/3257851390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ce9be8760 0x559ce9bf0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.648+0000 7f1923400640 1 --2- 172.21.15.12:0/3257851390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ce9bf3020 0x559ce9bf09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.648+0000 7f1922a00640 1 -- 172.21.15.12:0/3257851390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ce9bf3020 msgr2=0x559ce9bf09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.648+0000 7f1922a00640 1 --2- 172.21.15.12:0/3257851390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ce9bf3020 0x559ce9bf09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.648+0000 7f1922a00640 1 -- 172.21.15.12:0/3257851390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ce9be8760 msgr2=0x559ce9bf0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.649+0000 7f1922a00640 1 --2- 172.21.15.12:0/3257851390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ce9be8760 0x559ce9bf0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.649+0000 7f1922a00640 1 -- 172.21.15.12:0/3257851390 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ce98bf3c0 con 0x559ce9be7e40 2024-09-05T01:25:54.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.649+0000 7f1923400640 1 --2- 172.21.15.12:0/3257851390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ce9bf3020 0x559ce9bf09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:25:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.649+0000 7f1922000640 1 --2- 172.21.15.12:0/3257851390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ce9be8760 0x559ce9bf0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:25:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.649+0000 7f1922a00640 1 --2- 172.21.15.12:0/3257851390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be7e40 0x559ce9beff30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f19140128a0 tx=0x7f1914005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fce9dddc4825cccd server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.649+0000 7f190cc00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:25:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.650+0000 7f190cc00640 1 -- 172.21.15.12:0/3257851390 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191400fd60 con 0x559ce9be7e40 2024-09-05T01:25:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.650+0000 7f190cc00640 1 -- 172.21.15.12:0/3257851390 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f191401f420 con 0x559ce9be7e40 2024-09-05T01:25:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.650+0000 7f192c810740 1 -- 172.21.15.12:0/3257851390 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f191c036040 con 0x559ce9be7e40 2024-09-05T01:25:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.650+0000 7f190cc00640 1 -- 172.21.15.12:0/3257851390 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f191401f620 con 0x559ce9be7e40 2024-09-05T01:25:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.650+0000 7f192c810740 10 client.25532 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.650+0000 7f192c810740 1 -- 172.21.15.12:0/3257851390 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559ce9c01c90 con 0x559ce9be7e40 2024-09-05T01:25:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.651+0000 7f190cc00640 1 -- 172.21.15.12:0/3257851390 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f191c036040 con 0x559ce9be7e40 2024-09-05T01:25:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.651+0000 7f190cc00640 1 -- 172.21.15.12:0/3257851390 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1914027700 con 0x559ce9be7e40 2024-09-05T01:25:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.651+0000 7f192c810740 10 client.25532 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:54.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.651+0000 7f192c810740 10 client.25532 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T01:25:54.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.651+0000 7f192c810740 20 client.25532 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:54.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.651+0000 7f192c810740 1 --2- 172.21.15.12:0/3257851390 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x559ce9c03150 0x559ce9c05580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:54.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.651+0000 7f192c810740 4 client.25532 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:25:54.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.651+0000 7f192c810740 1 -- 172.21.15.12:0/3257851390 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ce9b5b950 con 0x559ce9c03150 2024-09-05T01:25:54.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.652+0000 7f1922000640 1 --2- 172.21.15.12:0/3257851390 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x559ce9c03150 0x559ce9c05580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:54.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.652+0000 7f1922000640 1 --2- 172.21.15.12:0/3257851390 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x559ce9c03150 0x559ce9c05580 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2accb6eb20c9dd6 server_cookie=b3c34dd1e749ba49 in_seq=0 out_seq=0 2024-09-05T01:25:54.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.652+0000 7f190cc00640 10 client.25532 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:25:54.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.653+0000 7f190cc00640 1 -- 172.21.15.12:0/3257851390 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559ce9b5b950 con 0x559ce9c03150 2024-09-05T01:25:54.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.653+0000 7f190cc00640 10 client.25532 handle_command_reply: tid=0 2024-09-05T01:25:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.653+0000 7f192c810740 1 client.25532 shutdown 2024-09-05T01:25:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.653+0000 7f192c810740 1 -- 172.21.15.12:0/3257851390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be7e40 msgr2=0x559ce9beff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.653+0000 7f192c810740 1 --2- 172.21.15.12:0/3257851390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be7e40 0x559ce9beff30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f19140128a0 tx=0x7f1914005f90 comp rx=0 tx=0).stop 2024-09-05T01:25:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.653+0000 7f192c810740 1 -- 172.21.15.12:0/3257851390 shutdown_connections 2024-09-05T01:25:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.653+0000 7f192c810740 1 --2- 172.21.15.12:0/3257851390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ce9bf3020 0x559ce9bf09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.654+0000 7f192c810740 1 --2- 172.21.15.12:0/3257851390 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x559ce9c03150 0x559ce9c05580 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.654+0000 7f192c810740 1 --2- 172.21.15.12:0/3257851390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ce9be8760 0x559ce9bf0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.654+0000 7f192c810740 1 --2- 172.21.15.12:0/3257851390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be7e40 0x559ce9beff30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.654+0000 7f192c810740 1 -- 172.21.15.12:0/3257851390 >> 172.21.15.12:0/3257851390 conn(0x559ce9be43d0 msgr2=0x559ce9bea100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.654+0000 7f190cc00640 0 client.25532 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:25:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.654+0000 7f192c810740 1 -- 172.21.15.12:0/3257851390 shutdown_connections 2024-09-05T01:25:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.654+0000 7f192c810740 1 -- 172.21.15.12:0/3257851390 wait complete. 2024-09-05T01:25:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.654+0000 7f192c810740 20 client.25532 trim_cache size 0 max 16384 2024-09-05T01:25:54.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.668+0000 7f192c810740 1 Processor -- start 2024-09-05T01:25:54.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.668+0000 7f192c810740 1 -- start start 2024-09-05T01:25:54.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.669+0000 7f192c810740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ce9be7e40 0x559ce9c0ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:54.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.669+0000 7f192c810740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be8760 0x559ce9c0b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:54.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.669+0000 7f192c810740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ce9bf3020 0x559ce9be2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:54.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.669+0000 7f192c810740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f19241b3d60 con 0x559ce9bf3020 2024-09-05T01:25:54.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.669+0000 7f192c810740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f19241b58a0 con 0x559ce9be8760 2024-09-05T01:25:54.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.669+0000 7f192c810740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f19241b4430 con 0x559ce9be7e40 2024-09-05T01:25:54.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.669+0000 7f1922a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ce9be7e40 0x559ce9c0ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:54.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.669+0000 7f1922a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ce9be7e40 0x559ce9c0ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:52990/0 (socket says 172.21.15.12:52990) 2024-09-05T01:25:54.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.669+0000 7f1922a00640 1 -- 172.21.15.12:0/2013632900 learned_addr learned my addr 172.21.15.12:0/2013632900 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:54.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.669+0000 7f1923400640 1 --2- 172.21.15.12:0/2013632900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ce9bf3020 0x559ce9be2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:54.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.669+0000 7f1922000640 1 --2- 172.21.15.12:0/2013632900 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be8760 0x559ce9c0b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:54.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.670+0000 7f1923400640 1 -- 172.21.15.12:0/2013632900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ce9be7e40 msgr2=0x559ce9c0ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:54.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.670+0000 7f1923400640 1 --2- 172.21.15.12:0/2013632900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ce9be7e40 0x559ce9c0ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.670+0000 7f1923400640 1 -- 172.21.15.12:0/2013632900 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be8760 msgr2=0x559ce9c0b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:54.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.670+0000 7f1923400640 1 --2- 172.21.15.12:0/2013632900 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be8760 0x559ce9c0b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.670+0000 7f1923400640 1 -- 172.21.15.12:0/2013632900 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ce9be4200 con 0x559ce9bf3020 2024-09-05T01:25:54.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.670+0000 7f1923400640 1 --2- 172.21.15.12:0/2013632900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ce9bf3020 0x559ce9be2c90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f191c04f040 tx=0x7f191c000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89fb9c77a3f8453 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:54.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.671+0000 7f190f400640 1 -- 172.21.15.12:0/2013632900 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c05c070 con 0x559ce9bf3020 2024-09-05T01:25:54.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.671+0000 7f190f400640 1 -- 172.21.15.12:0/2013632900 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f191c036040 con 0x559ce9bf3020 2024-09-05T01:25:54.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.671+0000 7f190f400640 1 -- 172.21.15.12:0/2013632900 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c003c30 con 0x559ce9bf3020 2024-09-05T01:25:54.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.671+0000 7f192c810740 1 -- 172.21.15.12:0/2013632900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ce9bf3020 msgr2=0x559ce9be2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:54.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.671+0000 7f192c810740 1 --2- 172.21.15.12:0/2013632900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ce9bf3020 0x559ce9be2c90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f191c04f040 tx=0x7f191c000f40 comp rx=0 tx=0).stop 2024-09-05T01:25:54.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.672+0000 7f192c810740 1 -- 172.21.15.12:0/2013632900 shutdown_connections 2024-09-05T01:25:54.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.672+0000 7f192c810740 1 --2- 172.21.15.12:0/2013632900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ce9bf3020 0x559ce9be2c90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.672+0000 7f192c810740 1 --2- 172.21.15.12:0/2013632900 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be8760 0x559ce9c0b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.672+0000 7f192c810740 1 --2- 172.21.15.12:0/2013632900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ce9be7e40 0x559ce9c0ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.672+0000 7f192c810740 1 -- 172.21.15.12:0/2013632900 >> 172.21.15.12:0/2013632900 conn(0x559ce9be43d0 msgr2=0x559ce9bef020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:54.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.672+0000 7f192c810740 1 -- 172.21.15.12:0/2013632900 shutdown_connections 2024-09-05T01:25:54.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.672+0000 7f192c810740 1 -- 172.21.15.12:0/2013632900 wait complete. 2024-09-05T01:25:54.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.672+0000 7f192c810740 1 -- start start 2024-09-05T01:25:54.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.673+0000 7f192c810740 1 Processor -- start 2024-09-05T01:25:54.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.673+0000 7f192c810740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ce9be7e40 0x559ce9bfb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:54.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.673+0000 7f192c810740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be8760 0x559ce9bf6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:54.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.673+0000 7f192c810740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ce9bf3020 0x559ce9bf6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:54.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.673+0000 7f192c810740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f19241b51d0 con 0x559ce9bf3020 2024-09-05T01:25:54.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.673+0000 7f192c810740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f19241b4b00 con 0x559ce9be8760 2024-09-05T01:25:54.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.673+0000 7f192c810740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f19241b1d60 con 0x559ce9be7e40 2024-09-05T01:25:54.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.673+0000 7f192c810740 10 client.0 _ll_register_callbacks cb 0x7f19140098f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:54.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.674+0000 7f1923400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ce9bf3020 0x559ce9bf6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:54.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.674+0000 7f1923400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ce9bf3020 0x559ce9bf6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42948/0 (socket says 172.21.15.12:42948) 2024-09-05T01:25:54.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.674+0000 7f1923400640 1 -- 172.21.15.12:0/1879822538 learned_addr learned my addr 172.21.15.12:0/1879822538 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:54.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.674+0000 7f1922a00640 1 --2- 172.21.15.12:0/1879822538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ce9be7e40 0x559ce9bfb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:54.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.674+0000 7f1922000640 1 --2- 172.21.15.12:0/1879822538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be8760 0x559ce9bf6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:54.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.675+0000 7f1923400640 1 -- 172.21.15.12:0/1879822538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ce9be7e40 msgr2=0x559ce9bfb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:54.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.675+0000 7f1923400640 1 --2- 172.21.15.12:0/1879822538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ce9be7e40 0x559ce9bfb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.675+0000 7f1923400640 1 -- 172.21.15.12:0/1879822538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be8760 msgr2=0x559ce9bf6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:54.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.675+0000 7f1923400640 1 --2- 172.21.15.12:0/1879822538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be8760 0x559ce9bf6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.675+0000 7f1923400640 1 -- 172.21.15.12:0/1879822538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ce9bf7730 con 0x559ce9bf3020 2024-09-05T01:25:54.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.675+0000 7f1922000640 1 --2- 172.21.15.12:0/1879822538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be8760 0x559ce9bf6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:25:54.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.675+0000 7f1923400640 1 --2- 172.21.15.12:0/1879822538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ce9bf3020 0x559ce9bf6f50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f191c02ae00 tx=0x7f191c031cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b16a5490b23e57 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:54.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.675+0000 7f190cc00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:25:54.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.676+0000 7f190cc00640 1 -- 172.21.15.12:0/1879822538 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c05c030 con 0x559ce9bf3020 2024-09-05T01:25:54.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.676+0000 7f190cc00640 1 -- 172.21.15.12:0/1879822538 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f191c048040 con 0x559ce9bf3020 2024-09-05T01:25:54.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.676+0000 7f192c810740 1 -- 172.21.15.12:0/1879822538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f191c036040 con 0x559ce9bf3020 2024-09-05T01:25:54.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.676+0000 7f190cc00640 1 -- 172.21.15.12:0/1879822538 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f191c067050 con 0x559ce9bf3020 2024-09-05T01:25:54.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.676+0000 7f192c810740 10 client.15519 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:54.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.676+0000 7f192c810740 1 -- 172.21.15.12:0/1879822538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559ce9c6de30 con 0x559ce9bf3020 2024-09-05T01:25:54.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.677+0000 7f190cc00640 1 -- 172.21.15.12:0/1879822538 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f191c036040 con 0x559ce9bf3020 2024-09-05T01:25:54.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.677+0000 7f190cc00640 1 -- 172.21.15.12:0/1879822538 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f191c056070 con 0x559ce9bf3020 2024-09-05T01:25:54.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.677+0000 7f192c810740 10 client.15519 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:54.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.677+0000 7f192c810740 10 client.15519 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T01:25:54.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.677+0000 7f192c810740 20 client.15519 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:54.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.677+0000 7f192c810740 1 --2- 172.21.15.12:0/1879822538 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x559ce9c6e0b0 0x559ce9c704a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:54.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.677+0000 7f192c810740 4 client.15519 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:25:54.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.677+0000 7f192c810740 1 -- 172.21.15.12:0/1879822538 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559ce9b55e60 con 0x559ce9c6e0b0 2024-09-05T01:25:54.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.678+0000 7f1922a00640 1 --2- 172.21.15.12:0/1879822538 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x559ce9c6e0b0 0x559ce9c704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:54.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.679+0000 7f1922a00640 1 --2- 172.21.15.12:0/1879822538 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x559ce9c6e0b0 0x559ce9c704a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a0548054961b0793 server_cookie=4a730bfe6465c47 in_seq=0 out_seq=0 2024-09-05T01:25:54.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.679+0000 7f190cc00640 10 client.15519 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:25:54.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.679+0000 7f190cc00640 1 -- 172.21.15.12:0/1879822538 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559ce9b55e60 con 0x559ce9c6e0b0 2024-09-05T01:25:54.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.679+0000 7f190cc00640 10 client.15519 handle_command_reply: tid=0 2024-09-05T01:25:54.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.679+0000 7f192c810740 1 client.15519 shutdown 2024-09-05T01:25:54.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.679+0000 7f192c810740 1 -- 172.21.15.12:0/1879822538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ce9bf3020 msgr2=0x559ce9bf6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:54.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.679+0000 7f192c810740 1 --2- 172.21.15.12:0/1879822538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ce9bf3020 0x559ce9bf6f50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f191c02ae00 tx=0x7f191c031cb0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.680+0000 7f192c810740 1 -- 172.21.15.12:0/1879822538 shutdown_connections 2024-09-05T01:25:54.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.680+0000 7f192c810740 1 --2- 172.21.15.12:0/1879822538 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x559ce9c6e0b0 0x559ce9c704a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.680+0000 7f192c810740 1 --2- 172.21.15.12:0/1879822538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ce9bf3020 0x559ce9bf6f50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.680+0000 7f192c810740 1 --2- 172.21.15.12:0/1879822538 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ce9be8760 0x559ce9bf6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.680+0000 7f192c810740 1 --2- 172.21.15.12:0/1879822538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ce9be7e40 0x559ce9bfb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.680+0000 7f190cc00640 0 client.15519 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:25:54.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.680+0000 7f192c810740 1 -- 172.21.15.12:0/1879822538 >> 172.21.15.12:0/1879822538 conn(0x559ce9be43d0 msgr2=0x559ce9befed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:54.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.680+0000 7f192c810740 1 -- 172.21.15.12:0/1879822538 shutdown_connections 2024-09-05T01:25:54.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.680+0000 7f192c810740 1 -- 172.21.15.12:0/1879822538 wait complete. 2024-09-05T01:25:54.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.680+0000 7f192c810740 20 client.15519 trim_cache size 0 max 16384 2024-09-05T01:25:54.683 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:25:54.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.681+0000 7f1923e00640 1 -- 172.21.15.12:0/2659767951 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f19080a2f10 msgr2=0x7f19080a53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:54.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.681+0000 7f1923e00640 1 --2- 172.21.15.12:0/2659767951 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f19080a2f10 0x7f19080a53d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x559ce9be5230 tx=0x7f19140046c0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.681+0000 7f1923e00640 1 -- 172.21.15.12:0/2659767951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1924102360 msgr2=0x7f1924070e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:54.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.681+0000 7f1923e00640 1 --2- 172.21.15.12:0/2659767951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1924102360 0x7f1924070e30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f191000e9f0 tx=0x7f191000eeb0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.681+0000 7f1923e00640 1 -- 172.21.15.12:0/2659767951 shutdown_connections 2024-09-05T01:25:54.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.681+0000 7f1923e00640 1 --2- 172.21.15.12:0/2659767951 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f19080a2f10 0x7f19080a53d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.681+0000 7f1923e00640 1 --2- 172.21.15.12:0/2659767951 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f19241079c0 0x7f1924071370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.681+0000 7f1923e00640 1 --2- 172.21.15.12:0/2659767951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1924102360 0x7f1924070e30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.681+0000 7f1923e00640 1 --2- 172.21.15.12:0/2659767951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19241019c0 0x7f1924075da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:54.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.681+0000 7f1923e00640 1 -- 172.21.15.12:0/2659767951 >> 172.21.15.12:0/2659767951 conn(0x7f19240fd740 msgr2=0x7f19240fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:54.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.682+0000 7f1923e00640 1 -- 172.21.15.12:0/2659767951 shutdown_connections 2024-09-05T01:25:54.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:54.682+0000 7f1923e00640 1 -- 172.21.15.12:0/2659767951 wait complete. 2024-09-05T01:25:55.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:55 smithi145 ceph-mon[34376]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-05T01:25:55.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:55 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:25:55.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:55 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:25:55.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:55 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:25:55.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:55 smithi151 ceph-mon[35013]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-05T01:25:55.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:55 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:25:55.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:55 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:25:55.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:55 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:25:55.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:55 smithi012 ceph-mon[29942]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s 2024-09-05T01:25:55.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:55 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:25:55.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:55 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:25:55.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:55 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:25:55.561 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-05T01:25:56.013 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:25:56.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.702+0000 7fef52c00640 1 -- 172.21.15.12:0/350265886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef4c1047e0 msgr2=0x7fef4c108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:56.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.702+0000 7fef52c00640 1 --2- 172.21.15.12:0/350265886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef4c1047e0 0x7fef4c108830 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fef38009900 tx=0x7fef3802a410 comp rx=0 tx=0).stop 2024-09-05T01:25:56.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.702+0000 7fef52c00640 1 -- 172.21.15.12:0/350265886 shutdown_connections 2024-09-05T01:25:56.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.702+0000 7fef52c00640 1 --2- 172.21.15.12:0/350265886 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef4c108f60 0x7fef4c110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.702+0000 7fef52c00640 1 --2- 172.21.15.12:0/350265886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef4c1047e0 0x7fef4c108830 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.702+0000 7fef52c00640 1 --2- 172.21.15.12:0/350265886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef4c103e30 0x7fef4c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.702+0000 7fef52c00640 1 -- 172.21.15.12:0/350265886 >> 172.21.15.12:0/350265886 conn(0x7fef4c0ff910 msgr2=0x7fef4c101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:56.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.702+0000 7fef52c00640 1 -- 172.21.15.12:0/350265886 shutdown_connections 2024-09-05T01:25:56.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.703+0000 7fef52c00640 1 -- 172.21.15.12:0/350265886 wait complete. 2024-09-05T01:25:56.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.704+0000 7fef52c00640 1 Processor -- start 2024-09-05T01:25:56.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.705+0000 7fef52c00640 1 -- start start 2024-09-05T01:25:56.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.705+0000 7fef52c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef4c103e30 0x7fef4c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:56.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.705+0000 7fef52c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef4c1047e0 0x7fef4c19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:56.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.705+0000 7fef52c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef4c108f60 0x7fef4c19ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:56.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.705+0000 7fef52c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c113fd0 con 0x7fef4c1047e0 2024-09-05T01:25:56.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.705+0000 7fef52c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c113e50 con 0x7fef4c108f60 2024-09-05T01:25:56.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.705+0000 7fef52c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c114150 con 0x7fef4c103e30 2024-09-05T01:25:56.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.706+0000 7fef51800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef4c103e30 0x7fef4c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:56.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.706+0000 7fef51800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef4c103e30 0x7fef4c19a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:53004/0 (socket says 172.21.15.12:53004) 2024-09-05T01:25:56.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.706+0000 7fef51800640 1 -- 172.21.15.12:0/2386556237 learned_addr learned my addr 172.21.15.12:0/2386556237 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:56.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.706+0000 7fef52200640 1 --2- 172.21.15.12:0/2386556237 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef4c108f60 0x7fef4c19ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:56.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.706+0000 7fef50e00640 1 --2- 172.21.15.12:0/2386556237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef4c1047e0 0x7fef4c19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:56.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.707+0000 7fef51800640 1 -- 172.21.15.12:0/2386556237 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef4c108f60 msgr2=0x7fef4c19ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:56.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.707+0000 7fef51800640 1 --2- 172.21.15.12:0/2386556237 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef4c108f60 0x7fef4c19ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.707+0000 7fef51800640 1 -- 172.21.15.12:0/2386556237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef4c1047e0 msgr2=0x7fef4c19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:56.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.707+0000 7fef51800640 1 --2- 172.21.15.12:0/2386556237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef4c1047e0 0x7fef4c19a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.707+0000 7fef51800640 1 -- 172.21.15.12:0/2386556237 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4c19f460 con 0x7fef4c103e30 2024-09-05T01:25:56.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.707+0000 7fef51800640 1 --2- 172.21.15.12:0/2386556237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef4c103e30 0x7fef4c19a4b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fef4000e9f0 tx=0x7fef4000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:56.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.708+0000 7fef4a000640 1 -- 172.21.15.12:0/2386556237 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4000cd80 con 0x7fef4c103e30 2024-09-05T01:25:56.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.708+0000 7fef4a000640 1 -- 172.21.15.12:0/2386556237 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef40010910 con 0x7fef4c103e30 2024-09-05T01:25:56.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.708+0000 7fef4a000640 1 -- 172.21.15.12:0/2386556237 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40018990 con 0x7fef4c103e30 2024-09-05T01:25:56.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.709+0000 7fef52c00640 1 -- 172.21.15.12:0/2386556237 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef4c19f750 con 0x7fef4c103e30 2024-09-05T01:25:56.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.709+0000 7fef52c00640 1 -- 172.21.15.12:0/2386556237 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef4c1a7030 con 0x7fef4c103e30 2024-09-05T01:25:56.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.714+0000 7fef56dd9740 1 Processor -- start 2024-09-05T01:25:56.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.714+0000 7fef56dd9740 1 -- start start 2024-09-05T01:25:56.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.714+0000 7fef4a000640 1 -- 172.21.15.12:0/2386556237 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) ==== 138066+0+0 (secure 0 0 0) 0x7fef40010ac0 con 0x7fef4c103e30 2024-09-05T01:25:56.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.714+0000 7fef56dd9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b5b9eb7e40 0x55b5b9eb8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:56.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.715+0000 7fef56dd9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5b9eb8760 0x55b5b9ec2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:56.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.715+0000 7fef56dd9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5b9ec3020 0x55b5b9ec5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:56.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.715+0000 7fef56dd9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b5b9e1e3e0 con 0x55b5b9ec3020 2024-09-05T01:25:56.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.715+0000 7fef56dd9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55b5b9dc5d80 con 0x55b5b9eb7e40 2024-09-05T01:25:56.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.715+0000 7fef56dd9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b5b9e1a3a0 con 0x55b5b9eb8760 2024-09-05T01:25:56.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.715+0000 7fef50e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5b9ec3020 0x55b5b9ec5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:56.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.715+0000 7fef52200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b5b9eb7e40 0x55b5b9eb8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:56.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.715+0000 7fef52200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b5b9eb7e40 0x55b5b9eb8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:49078/0 (socket says 172.21.15.12:49078) 2024-09-05T01:25:56.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.715+0000 7fef52200640 1 -- 172.21.15.12:0/3329505710 learned_addr learned my addr 172.21.15.12:0/3329505710 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:56.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.716+0000 7fef51800640 1 --2- 172.21.15.12:0/3329505710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5b9eb8760 0x55b5b9ec2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:56.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.716+0000 7fef52200640 1 -- 172.21.15.12:0/3329505710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5b9eb8760 msgr2=0x55b5b9ec2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:56.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.716+0000 7fef52200640 1 --2- 172.21.15.12:0/3329505710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5b9eb8760 0x55b5b9ec2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.716+0000 7fef52200640 1 -- 172.21.15.12:0/3329505710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5b9ec3020 msgr2=0x55b5b9ec5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:56.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.716+0000 7fef52200640 1 --2- 172.21.15.12:0/3329505710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5b9ec3020 0x55b5b9ec5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.716+0000 7fef52200640 1 -- 172.21.15.12:0/3329505710 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5b9de4ae0 con 0x55b5b9eb7e40 2024-09-05T01:25:56.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.717+0000 7fef52200640 1 --2- 172.21.15.12:0/3329505710 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b5b9eb7e40 0x55b5b9eb8220 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fef44009f20 tx=0x7fef4400f7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37f8f2c212302eca server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:56.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.717+0000 7fef4a000640 1 --2- 172.21.15.12:0/2386556237 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fef340a2e90 0x7fef340a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:56.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.717+0000 7fef4a000640 1 -- 172.21.15.12:0/2386556237 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fef400cfc70 con 0x7fef4c103e30 2024-09-05T01:25:56.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.717+0000 7fef3ea00640 1 -- 172.21.15.12:0/3329505710 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44015070 con 0x55b5b9eb7e40 2024-09-05T01:25:56.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.717+0000 7fef3ea00640 1 -- 172.21.15.12:0/3329505710 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef4401ab40 con 0x55b5b9eb7e40 2024-09-05T01:25:56.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.717+0000 7fef3ea00640 1 -- 172.21.15.12:0/3329505710 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44011ca0 con 0x55b5b9eb7e40 2024-09-05T01:25:56.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.718+0000 7fef51800640 1 --2- 172.21.15.12:0/2386556237 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fef340a2e90 0x7fef340a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:56.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.718+0000 7fef56dd9740 1 -- 172.21.15.12:0/3329505710 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b5b9eb7e40 msgr2=0x55b5b9eb8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:56.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.718+0000 7fef56dd9740 1 --2- 172.21.15.12:0/3329505710 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b5b9eb7e40 0x55b5b9eb8220 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fef44009f20 tx=0x7fef4400f7f0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.719+0000 7fef56dd9740 1 -- 172.21.15.12:0/3329505710 shutdown_connections 2024-09-05T01:25:56.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.719+0000 7fef56dd9740 1 --2- 172.21.15.12:0/3329505710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5b9ec3020 0x55b5b9ec5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.719+0000 7fef56dd9740 1 --2- 172.21.15.12:0/3329505710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5b9eb8760 0x55b5b9ec2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.719+0000 7fef56dd9740 1 --2- 172.21.15.12:0/3329505710 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b5b9eb7e40 0x55b5b9eb8220 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.719+0000 7fef56dd9740 1 -- 172.21.15.12:0/3329505710 >> 172.21.15.12:0/3329505710 conn(0x55b5b9eb43d0 msgr2=0x55b5b9eb47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:56.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.719+0000 7fef51800640 1 --2- 172.21.15.12:0/2386556237 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fef340a2e90 0x7fef340a5350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fef400cd230 tx=0x7fef40018420 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:56.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.719+0000 7fef56dd9740 1 -- 172.21.15.12:0/3329505710 shutdown_connections 2024-09-05T01:25:56.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.719+0000 7fef56dd9740 1 -- 172.21.15.12:0/3329505710 wait complete. 2024-09-05T01:25:56.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.720+0000 7fef56dd9740 1 -- start start 2024-09-05T01:25:56.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.720+0000 7fef56dd9740 1 Processor -- start 2024-09-05T01:25:56.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.721+0000 7fef56dd9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b5b9eb7e40 0x55b5b9ebff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:56.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.721+0000 7fef56dd9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5b9eb8760 0x55b5b9ec0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:56.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.721+0000 7fef56dd9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5b9ec3020 0x55b5b9ec09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:56.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.721+0000 7fef56dd9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b5b9ec5bf0 con 0x55b5b9ec3020 2024-09-05T01:25:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.721+0000 7fef56dd9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55b5b9dd90f0 con 0x55b5b9eb7e40 2024-09-05T01:25:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.721+0000 7fef56dd9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b5b9ec5d70 con 0x55b5b9eb8760 2024-09-05T01:25:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.721+0000 7fef56dd9740 10 client.0 _ll_register_callbacks cb 0x55b5b9dc0bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.722+0000 7fef52200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b5b9eb7e40 0x55b5b9ebff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:56.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.722+0000 7fef52200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b5b9eb7e40 0x55b5b9ebff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:49090/0 (socket says 172.21.15.12:49090) 2024-09-05T01:25:56.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.722+0000 7fef52200640 1 -- 172.21.15.12:0/523002935 learned_addr learned my addr 172.21.15.12:0/523002935 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:56.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.722+0000 7fef52200640 1 --2- 172.21.15.12:0/523002935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5b9ec3020 0x55b5b9ec09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:56.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.722+0000 7fef50e00640 1 --2- 172.21.15.12:0/523002935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5b9eb8760 0x55b5b9ec0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:56.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.722+0000 7fef50e00640 1 -- 172.21.15.12:0/523002935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b5b9eb7e40 msgr2=0x55b5b9ebff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:56.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.722+0000 7fef50e00640 1 --2- 172.21.15.12:0/523002935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b5b9eb7e40 0x55b5b9ebff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.722+0000 7fef50e00640 1 -- 172.21.15.12:0/523002935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5b9ec3020 msgr2=0x55b5b9ec09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:56.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.722+0000 7fef50e00640 1 --2- 172.21.15.12:0/523002935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5b9ec3020 0x55b5b9ec09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.722+0000 7fef50e00640 1 -- 172.21.15.12:0/523002935 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5b9b8f3c0 con 0x55b5b9eb8760 2024-09-05T01:25:56.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.722+0000 7fef52200640 1 --2- 172.21.15.12:0/523002935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5b9ec3020 0x55b5b9ec09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:25:56.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.723+0000 7fef50e00640 1 --2- 172.21.15.12:0/523002935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5b9eb8760 0x55b5b9ec0460 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fef3802a930 tx=0x7fef38004440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad369f350544e32f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:56.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.723+0000 7fef33400640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:25:56.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.723+0000 7fef33400640 1 -- 172.21.15.12:0/523002935 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef38035040 con 0x55b5b9eb8760 2024-09-05T01:25:56.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.723+0000 7fef33400640 1 -- 172.21.15.12:0/523002935 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fef38005450 con 0x55b5b9eb8760 2024-09-05T01:25:56.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.723+0000 7fef56dd9740 1 -- 172.21.15.12:0/523002935 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef4401ab40 con 0x55b5b9eb8760 2024-09-05T01:25:56.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.724+0000 7fef33400640 1 -- 172.21.15.12:0/523002935 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fef38005650 con 0x55b5b9eb8760 2024-09-05T01:25:56.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.724+0000 7fef56dd9740 10 client.25546 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:56.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.724+0000 7fef56dd9740 1 -- 172.21.15.12:0/523002935 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b5b9eda450 con 0x55b5b9eb8760 2024-09-05T01:25:56.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.724+0000 7fef33400640 1 -- 172.21.15.12:0/523002935 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef4401ab40 con 0x55b5b9eb8760 2024-09-05T01:25:56.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.725+0000 7fef33400640 1 -- 172.21.15.12:0/523002935 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fef38031c30 con 0x55b5b9eb8760 2024-09-05T01:25:56.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.725+0000 7fef56dd9740 10 client.25546 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:56.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.725+0000 7fef56dd9740 10 client.25546 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:25:56.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.725+0000 7fef56dd9740 20 client.25546 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:56.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.725+0000 7fef56dd9740 1 --2- 172.21.15.12:0/523002935 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b5b9edb910 0x55b5b9eddd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:56.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.725+0000 7fef56dd9740 4 client.25546 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:25:56.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.725+0000 7fef56dd9740 1 -- 172.21.15.12:0/523002935 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5b9e2b950 con 0x55b5b9edb910 2024-09-05T01:25:56.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.726+0000 7fef52200640 1 --2- 172.21.15.12:0/523002935 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b5b9edb910 0x55b5b9eddd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:56.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.727+0000 7fef52200640 1 --2- 172.21.15.12:0/523002935 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b5b9edb910 0x55b5b9eddd30 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99f823517bcf5389 server_cookie=a332adec1ba8becf in_seq=0 out_seq=0 2024-09-05T01:25:56.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.727+0000 7fef33400640 10 client.25546 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:25:56.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.727+0000 7fef33400640 1 -- 172.21.15.12:0/523002935 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b5b9e2b950 con 0x55b5b9edb910 2024-09-05T01:25:56.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.727+0000 7fef33400640 10 client.25546 handle_command_reply: tid=0 2024-09-05T01:25:56.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.728+0000 7fef56dd9740 1 client.25546 shutdown 2024-09-05T01:25:56.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.728+0000 7fef56dd9740 1 -- 172.21.15.12:0/523002935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5b9eb8760 msgr2=0x55b5b9ec0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:56.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.728+0000 7fef56dd9740 1 --2- 172.21.15.12:0/523002935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5b9eb8760 0x55b5b9ec0460 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fef3802a930 tx=0x7fef38004440 comp rx=0 tx=0).stop 2024-09-05T01:25:56.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.728+0000 7fef56dd9740 1 -- 172.21.15.12:0/523002935 shutdown_connections 2024-09-05T01:25:56.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.728+0000 7fef56dd9740 1 --2- 172.21.15.12:0/523002935 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b5b9edb910 0x55b5b9eddd30 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.728+0000 7fef56dd9740 1 --2- 172.21.15.12:0/523002935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5b9ec3020 0x55b5b9ec09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.728+0000 7fef56dd9740 1 --2- 172.21.15.12:0/523002935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5b9eb8760 0x55b5b9ec0460 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.728+0000 7fef56dd9740 1 --2- 172.21.15.12:0/523002935 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b5b9eb7e40 0x55b5b9ebff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.728+0000 7fef56dd9740 1 -- 172.21.15.12:0/523002935 >> 172.21.15.12:0/523002935 conn(0x55b5b9eb43d0 msgr2=0x55b5b9eba0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:56.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.728+0000 7fef33400640 0 client.25546 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:25:56.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.728+0000 7fef56dd9740 1 -- 172.21.15.12:0/523002935 shutdown_connections 2024-09-05T01:25:56.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.729+0000 7fef56dd9740 1 -- 172.21.15.12:0/523002935 wait complete. 2024-09-05T01:25:56.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.729+0000 7fef56dd9740 20 client.25546 trim_cache size 0 max 16384 2024-09-05T01:25:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.756+0000 7fef56dd9740 1 Processor -- start 2024-09-05T01:25:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.756+0000 7fef56dd9740 1 -- start start 2024-09-05T01:25:56.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.757+0000 7fef56dd9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5b9eb7e40 0x55b5b9eaf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:56.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.757+0000 7fef56dd9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5b9eb8760 0x55b5b9ee3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:56.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.757+0000 7fef56dd9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b5b9ec3020 0x55b5b9ee3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:56.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.757+0000 7fef56dd9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c1ab600 con 0x55b5b9eb8760 2024-09-05T01:25:56.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.757+0000 7fef56dd9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c1ad140 con 0x55b5b9ec3020 2024-09-05T01:25:56.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.757+0000 7fef56dd9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c1abcd0 con 0x55b5b9eb7e40 2024-09-05T01:25:56.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.757+0000 7fef52200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5b9eb7e40 0x55b5b9eaf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:56.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.757+0000 7fef52200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5b9eb7e40 0x55b5b9eaf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:53024/0 (socket says 172.21.15.12:53024) 2024-09-05T01:25:56.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.757+0000 7fef52200640 1 -- 172.21.15.12:0/3647312815 learned_addr learned my addr 172.21.15.12:0/3647312815 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:56.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.757+0000 7fef52200640 1 --2- 172.21.15.12:0/3647312815 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b5b9ec3020 0x55b5b9ee3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:56.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.757+0000 7fef50e00640 1 --2- 172.21.15.12:0/3647312815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5b9eb8760 0x55b5b9ee3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:56.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.758+0000 7fef52200640 1 -- 172.21.15.12:0/3647312815 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b5b9ec3020 msgr2=0x55b5b9ee3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:56.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.758+0000 7fef52200640 1 --2- 172.21.15.12:0/3647312815 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b5b9ec3020 0x55b5b9ee3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.758+0000 7fef52200640 1 -- 172.21.15.12:0/3647312815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5b9eb8760 msgr2=0x55b5b9ee3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:56.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.758+0000 7fef52200640 1 --2- 172.21.15.12:0/3647312815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5b9eb8760 0x55b5b9ee3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.758+0000 7fef52200640 1 -- 172.21.15.12:0/3647312815 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5b9ec5750 con 0x55b5b9eb7e40 2024-09-05T01:25:56.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.758+0000 7fef50e00640 1 --2- 172.21.15.12:0/3647312815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5b9eb8760 0x55b5b9ee3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:25:56.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.759+0000 7fef52200640 1 --2- 172.21.15.12:0/3647312815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5b9eb7e40 0x55b5b9eaf300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fef4400f830 tx=0x7fef44013040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89a99e2e16fb9c0c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:56.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.759+0000 7fef3e000640 1 -- 172.21.15.12:0/3647312815 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44015040 con 0x55b5b9eb7e40 2024-09-05T01:25:56.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.759+0000 7fef3e000640 1 -- 172.21.15.12:0/3647312815 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef4401a460 con 0x55b5b9eb7e40 2024-09-05T01:25:56.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.759+0000 7fef3e000640 1 -- 172.21.15.12:0/3647312815 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef440050d0 con 0x55b5b9eb7e40 2024-09-05T01:25:56.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.760+0000 7fef56dd9740 1 -- 172.21.15.12:0/3647312815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5b9eb7e40 msgr2=0x55b5b9eaf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:56.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.760+0000 7fef56dd9740 1 --2- 172.21.15.12:0/3647312815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5b9eb7e40 0x55b5b9eaf300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fef4400f830 tx=0x7fef44013040 comp rx=0 tx=0).stop 2024-09-05T01:25:56.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.760+0000 7fef56dd9740 1 -- 172.21.15.12:0/3647312815 shutdown_connections 2024-09-05T01:25:56.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.760+0000 7fef56dd9740 1 --2- 172.21.15.12:0/3647312815 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b5b9ec3020 0x55b5b9ee3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.760+0000 7fef56dd9740 1 --2- 172.21.15.12:0/3647312815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5b9eb8760 0x55b5b9ee3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.760+0000 7fef56dd9740 1 --2- 172.21.15.12:0/3647312815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5b9eb7e40 0x55b5b9eaf300 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.760+0000 7fef56dd9740 1 -- 172.21.15.12:0/3647312815 >> 172.21.15.12:0/3647312815 conn(0x55b5b9eb43d0 msgr2=0x55b5b9ebf010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:56.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.760+0000 7fef56dd9740 1 -- 172.21.15.12:0/3647312815 shutdown_connections 2024-09-05T01:25:56.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.760+0000 7fef56dd9740 1 -- 172.21.15.12:0/3647312815 wait complete. 2024-09-05T01:25:56.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.761+0000 7fef56dd9740 1 -- start start 2024-09-05T01:25:56.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.761+0000 7fef56dd9740 1 Processor -- start 2024-09-05T01:25:56.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.762+0000 7fef56dd9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b5b9eb7e40 0x55b5b9ed3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:56.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.762+0000 7fef56dd9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5b9eb8760 0x55b5b9ecf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:56.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.762+0000 7fef56dd9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5b9ec3020 0x55b5b9ecf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:56.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.762+0000 7fef56dd9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c1aca70 con 0x55b5b9eb8760 2024-09-05T01:25:56.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.762+0000 7fef56dd9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c1ac3a0 con 0x55b5b9eb7e40 2024-09-05T01:25:56.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.762+0000 7fef56dd9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c1a95e0 con 0x55b5b9ec3020 2024-09-05T01:25:56.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.762+0000 7fef56dd9740 10 client.0 _ll_register_callbacks cb 0x7fef38009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:25:56.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.762+0000 7fef52200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5b9ec3020 0x55b5b9ecf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:56.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.762+0000 7fef50e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5b9eb8760 0x55b5b9ecf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:56.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.762+0000 7fef52200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b5b9eb7e40 0x55b5b9ed3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:56.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.762+0000 7fef50e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5b9eb8760 0x55b5b9ecf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43004/0 (socket says 172.21.15.12:43004) 2024-09-05T01:25:56.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.762+0000 7fef50e00640 1 -- 172.21.15.12:0/3558132913 learned_addr learned my addr 172.21.15.12:0/3558132913 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:25:56.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.762+0000 7fef52200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b5b9eb7e40 0x55b5b9ed3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:49104/0 (socket says 172.21.15.12:49104) 2024-09-05T01:25:56.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.763+0000 7fef50e00640 1 -- 172.21.15.12:0/3558132913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5b9ec3020 msgr2=0x55b5b9ecf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:56.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.763+0000 7fef50e00640 1 --2- 172.21.15.12:0/3558132913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5b9ec3020 0x55b5b9ecf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.763+0000 7fef50e00640 1 -- 172.21.15.12:0/3558132913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b5b9eb7e40 msgr2=0x55b5b9ed3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:25:56.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.763+0000 7fef50e00640 1 --2- 172.21.15.12:0/3558132913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b5b9eb7e40 0x55b5b9ed3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.763+0000 7fef50e00640 1 -- 172.21.15.12:0/3558132913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5b9ecfb90 con 0x55b5b9eb8760 2024-09-05T01:25:56.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.763+0000 7fef52200640 1 --2- 172.21.15.12:0/3558132913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5b9ec3020 0x55b5b9ecf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:25:56.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.764+0000 7fef50e00640 1 --2- 172.21.15.12:0/3558132913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5b9eb8760 0x55b5b9ecf090 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fef38031550 tx=0x7fef38004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d15e9fc0f11d580a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:25:56.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.764+0000 7fef33400640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:25:56.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.764+0000 7fef33400640 1 -- 172.21.15.12:0/3558132913 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef38035030 con 0x55b5b9eb8760 2024-09-05T01:25:56.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.764+0000 7fef33400640 1 -- 172.21.15.12:0/3558132913 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fef38004710 con 0x55b5b9eb8760 2024-09-05T01:25:56.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.765+0000 7fef56dd9740 1 -- 172.21.15.12:0/3558132913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef4401a460 con 0x55b5b9eb8760 2024-09-05T01:25:56.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.766+0000 7fef33400640 1 -- 172.21.15.12:0/3558132913 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fef38052070 con 0x55b5b9eb8760 2024-09-05T01:25:56.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.766+0000 7fef56dd9740 10 client.15537 fetch_fsmap learned FSMap version 28 2024-09-05T01:25:56.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.766+0000 7fef56dd9740 1 -- 172.21.15.12:0/3558132913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b5b9f463a0 con 0x55b5b9eb8760 2024-09-05T01:25:56.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.766+0000 7fef33400640 1 -- 172.21.15.12:0/3558132913 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef4401a460 con 0x55b5b9eb8760 2024-09-05T01:25:56.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.766+0000 7fef33400640 1 -- 172.21.15.12:0/3558132913 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fef38046b30 con 0x55b5b9eb8760 2024-09-05T01:25:56.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.767+0000 7fef56dd9740 10 client.15537 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:25:56.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.767+0000 7fef56dd9740 10 client.15537 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:25:56.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.767+0000 7fef56dd9740 20 client.15537 populate_metadata read hostname 'smithi012' 2024-09-05T01:25:56.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.767+0000 7fef56dd9740 1 --2- 172.21.15.12:0/3558132913 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b5b9f46af0 0x55b5b9f48f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:25:56.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.767+0000 7fef56dd9740 4 client.15537 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:25:56.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.767+0000 7fef56dd9740 1 -- 172.21.15.12:0/3558132913 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b5b9e25e60 con 0x55b5b9f46af0 2024-09-05T01:25:56.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.767+0000 7fef52200640 1 --2- 172.21.15.12:0/3558132913 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b5b9f46af0 0x55b5b9f48f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:25:56.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.768+0000 7fef52200640 1 --2- 172.21.15.12:0/3558132913 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b5b9f46af0 0x55b5b9f48f10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba8737809c7fdad0 server_cookie=b4b2e1b4c537a3dd in_seq=0 out_seq=0 2024-09-05T01:25:56.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.768+0000 7fef33400640 10 client.15537 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:25:56.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.768+0000 7fef33400640 1 -- 172.21.15.12:0/3558132913 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b5b9e25e60 con 0x55b5b9f46af0 2024-09-05T01:25:56.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.768+0000 7fef33400640 10 client.15537 handle_command_reply: tid=0 2024-09-05T01:25:56.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.768+0000 7fef56dd9740 1 client.15537 shutdown 2024-09-05T01:25:56.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.769+0000 7fef56dd9740 1 -- 172.21.15.12:0/3558132913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5b9eb8760 msgr2=0x55b5b9ecf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:56.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.769+0000 7fef56dd9740 1 --2- 172.21.15.12:0/3558132913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5b9eb8760 0x55b5b9ecf090 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fef38031550 tx=0x7fef38004530 comp rx=0 tx=0).stop 2024-09-05T01:25:56.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.769+0000 7fef56dd9740 1 -- 172.21.15.12:0/3558132913 shutdown_connections 2024-09-05T01:25:56.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.769+0000 7fef56dd9740 1 --2- 172.21.15.12:0/3558132913 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b5b9f46af0 0x55b5b9f48f10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.769+0000 7fef56dd9740 1 --2- 172.21.15.12:0/3558132913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5b9ec3020 0x55b5b9ecf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.769+0000 7fef56dd9740 1 --2- 172.21.15.12:0/3558132913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5b9eb8760 0x55b5b9ecf090 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.769+0000 7fef56dd9740 1 --2- 172.21.15.12:0/3558132913 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b5b9eb7e40 0x55b5b9ed3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.769+0000 7fef56dd9740 1 -- 172.21.15.12:0/3558132913 >> 172.21.15.12:0/3558132913 conn(0x55b5b9eb43d0 msgr2=0x55b5b9ebfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:56.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.769+0000 7fef33400640 0 client.15537 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:25:56.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.769+0000 7fef56dd9740 1 -- 172.21.15.12:0/3558132913 shutdown_connections 2024-09-05T01:25:56.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.770+0000 7fef56dd9740 1 -- 172.21.15.12:0/3558132913 wait complete. 2024-09-05T01:25:56.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.770+0000 7fef56dd9740 20 client.15537 trim_cache size 0 max 16384 2024-09-05T01:25:56.772 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:25:56.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.771+0000 7fef52c00640 1 -- 172.21.15.12:0/2386556237 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fef340a2e90 msgr2=0x7fef340a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:56.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.771+0000 7fef52c00640 1 --2- 172.21.15.12:0/2386556237 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fef340a2e90 0x7fef340a5350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fef400cd230 tx=0x7fef40018420 comp rx=0 tx=0).stop 2024-09-05T01:25:56.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.772+0000 7fef52c00640 1 -- 172.21.15.12:0/2386556237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef4c103e30 msgr2=0x7fef4c19a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:25:56.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.772+0000 7fef52c00640 1 --2- 172.21.15.12:0/2386556237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef4c103e30 0x7fef4c19a4b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fef4000e9f0 tx=0x7fef4000eeb0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.772+0000 7fef52c00640 1 -- 172.21.15.12:0/2386556237 shutdown_connections 2024-09-05T01:25:56.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.772+0000 7fef52c00640 1 --2- 172.21.15.12:0/2386556237 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fef340a2e90 0x7fef340a5350 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.772+0000 7fef52c00640 1 --2- 172.21.15.12:0/2386556237 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fef4c108f60 0x7fef4c19ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.772+0000 7fef52c00640 1 --2- 172.21.15.12:0/2386556237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef4c1047e0 0x7fef4c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.772+0000 7fef52c00640 1 --2- 172.21.15.12:0/2386556237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef4c103e30 0x7fef4c19a4b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:25:56.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.772+0000 7fef52c00640 1 -- 172.21.15.12:0/2386556237 >> 172.21.15.12:0/2386556237 conn(0x7fef4c0ff910 msgr2=0x7fef4c100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:25:56.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.772+0000 7fef52c00640 1 -- 172.21.15.12:0/2386556237 shutdown_connections 2024-09-05T01:25:56.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:25:56.773+0000 7fef52c00640 1 -- 172.21.15.12:0/2386556237 wait complete. 2024-09-05T01:25:57.342 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:57 smithi012 ceph-mon[29942]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T01:25:57.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:57 smithi151 ceph-mon[35013]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T01:25:57.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:57 smithi145 ceph-mon[34376]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T01:25:58.527 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-05T01:25:58.527 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-05T01:25:58.952 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:25:59.242 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:25:59 smithi012 ceph-mon[29942]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-05T01:25:59.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:25:59 smithi151 ceph-mon[35013]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-05T01:25:59.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:25:59 smithi145 ceph-mon[34376]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-05T01:26:01.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:01 smithi151 ceph-mon[35013]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-05T01:26:01.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:01 smithi012 ceph-mon[29942]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-05T01:26:01.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:01 smithi145 ceph-mon[34376]: pgmap v42: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-05T01:26:03.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.160+0000 7fbc3be00640 1 -- 172.21.15.12:0/3104331349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc3c1079c0 msgr2=0x7fbc3c107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:03.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.160+0000 7fbc3be00640 1 --2- 172.21.15.12:0/3104331349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc3c1079c0 0x7fbc3c107da0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c009900 tx=0x7fbc2c02a3f0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.160+0000 7fbc3be00640 1 -- 172.21.15.12:0/3104331349 shutdown_connections 2024-09-05T01:26:03.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.160+0000 7fbc3be00640 1 --2- 172.21.15.12:0/3104331349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc3c102360 0x7fbc3c10e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.160+0000 7fbc3be00640 1 --2- 172.21.15.12:0/3104331349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc3c1019c0 0x7fbc3c101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.160+0000 7fbc3be00640 1 --2- 172.21.15.12:0/3104331349 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc3c1079c0 0x7fbc3c107da0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.160+0000 7fbc3be00640 1 -- 172.21.15.12:0/3104331349 >> 172.21.15.12:0/3104331349 conn(0x7fbc3c0fd740 msgr2=0x7fbc3c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:03.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.160+0000 7fbc3be00640 1 -- 172.21.15.12:0/3104331349 shutdown_connections 2024-09-05T01:26:03.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.160+0000 7fbc3be00640 1 -- 172.21.15.12:0/3104331349 wait complete. 2024-09-05T01:26:03.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.161+0000 7fbc3be00640 1 Processor -- start 2024-09-05T01:26:03.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.161+0000 7fbc3be00640 1 -- start start 2024-09-05T01:26:03.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.162+0000 7fbc3be00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc3c1019c0 0x7fbc3c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:03.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.162+0000 7fbc3be00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc3c102360 0x7fbc3c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:03.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.162+0000 7fbc3be00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc3c1079c0 0x7fbc3c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:03.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.162+0000 7fbc3be00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c111e10 con 0x7fbc3c102360 2024-09-05T01:26:03.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.162+0000 7fbc3be00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c111c90 con 0x7fbc3c1079c0 2024-09-05T01:26:03.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.162+0000 7fbc3be00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c111f90 con 0x7fbc3c1019c0 2024-09-05T01:26:03.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.162+0000 7fbc33e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc3c102360 0x7fbc3c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:03.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.162+0000 7fbc3aa00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc3c1019c0 0x7fbc3c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:03.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.162+0000 7fbc3aa00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc3c1019c0 0x7fbc3c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:40588/0 (socket says 172.21.15.12:40588) 2024-09-05T01:26:03.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.162+0000 7fbc33e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc3c102360 0x7fbc3c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42604/0 (socket says 172.21.15.12:42604) 2024-09-05T01:26:03.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.162+0000 7fbc3aa00640 1 -- 172.21.15.12:0/1920862227 learned_addr learned my addr 172.21.15.12:0/1920862227 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:03.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.162+0000 7fbc3b400640 1 --2- 172.21.15.12:0/1920862227 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc3c1079c0 0x7fbc3c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:03.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.162+0000 7fbc3aa00640 1 -- 172.21.15.12:0/1920862227 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc3c1079c0 msgr2=0x7fbc3c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:03.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.162+0000 7fbc3aa00640 1 --2- 172.21.15.12:0/1920862227 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc3c1079c0 0x7fbc3c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.162+0000 7fbc3aa00640 1 -- 172.21.15.12:0/1920862227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc3c102360 msgr2=0x7fbc3c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:03.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.163+0000 7fbc3aa00640 1 --2- 172.21.15.12:0/1920862227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc3c102360 0x7fbc3c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.163+0000 7fbc3aa00640 1 -- 172.21.15.12:0/1920862227 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc3c1aabc0 con 0x7fbc3c1019c0 2024-09-05T01:26:03.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.163+0000 7fbc3b400640 1 --2- 172.21.15.12:0/1920862227 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc3c1079c0 0x7fbc3c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:26:03.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.163+0000 7fbc33e00640 1 --2- 172.21.15.12:0/1920862227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc3c102360 0x7fbc3c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:26:03.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.163+0000 7fbc3aa00640 1 --2- 172.21.15.12:0/1920862227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc3c1019c0 0x7fbc3c0744f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c02a9e0 tx=0x7fbc2c003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:03.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.163+0000 7fbc40a00640 1 -- 172.21.15.12:0/1920862227 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c03f070 con 0x7fbc3c1019c0 2024-09-05T01:26:03.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.163+0000 7fbc40a00640 1 -- 172.21.15.12:0/1920862227 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc2c031c30 con 0x7fbc3c1019c0 2024-09-05T01:26:03.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.163+0000 7fbc40a00640 1 -- 172.21.15.12:0/1920862227 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c035030 con 0x7fbc3c1019c0 2024-09-05T01:26:03.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.163+0000 7fbc3be00640 1 -- 172.21.15.12:0/1920862227 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc3c1aad90 con 0x7fbc3c1019c0 2024-09-05T01:26:03.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.164+0000 7fbc3be00640 1 -- 172.21.15.12:0/1920862227 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc3c1ab210 con 0x7fbc3c1019c0 2024-09-05T01:26:03.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.167+0000 7fbc448cd740 1 Processor -- start 2024-09-05T01:26:03.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.167+0000 7fbc448cd740 1 -- start start 2024-09-05T01:26:03.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.167+0000 7fbc448cd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb7275bcb0 0x55cb7275c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:03.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.167+0000 7fbc448cd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb7275c5d0 0x55cb72766950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:03.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.167+0000 7fbc448cd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb72766e90 0x55cb72769280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:03.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.167+0000 7fbc448cd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cb726c2290 con 0x55cb72766e90 2024-09-05T01:26:03.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.167+0000 7fbc448cd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55cb72669b40 con 0x55cb7275bcb0 2024-09-05T01:26:03.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.167+0000 7fbc448cd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55cb726be250 con 0x55cb7275c5d0 2024-09-05T01:26:03.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.167+0000 7fbc3b400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb7275bcb0 0x55cb7275c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:03.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.167+0000 7fbc33e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb72766e90 0x55cb72769280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:03.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.168+0000 7fbc3b400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb7275bcb0 0x55cb7275c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:50804/0 (socket says 172.21.15.12:50804) 2024-09-05T01:26:03.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.168+0000 7fbc3b400640 1 -- 172.21.15.12:0/864804424 learned_addr learned my addr 172.21.15.12:0/864804424 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:03.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.168+0000 7fbc3b400640 1 -- 172.21.15.12:0/864804424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb7275c5d0 msgr2=0x55cb72766950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:26:03.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.168+0000 7fbc3b400640 1 --2- 172.21.15.12:0/864804424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb7275c5d0 0x55cb72766950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.168+0000 7fbc3b400640 1 -- 172.21.15.12:0/864804424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb72766e90 msgr2=0x55cb72769280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:03.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.168+0000 7fbc3b400640 1 --2- 172.21.15.12:0/864804424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb72766e90 0x55cb72769280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.168+0000 7fbc3b400640 1 -- 172.21.15.12:0/864804424 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb724336a0 con 0x55cb7275bcb0 2024-09-05T01:26:03.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.168+0000 7fbc3b400640 1 --2- 172.21.15.12:0/864804424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb7275bcb0 0x55cb7275c090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbc34010710 tx=0x7fbc34010bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c12e8696a66e219 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:03.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.168+0000 7fbc40a00640 1 -- 172.21.15.12:0/1920862227 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) ==== 138066+0+0 (secure 0 0 0) 0x7fbc2c042070 con 0x7fbc3c1019c0 2024-09-05T01:26:03.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.168+0000 7fbc2be00640 1 -- 172.21.15.12:0/864804424 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3400e8d0 con 0x55cb7275bcb0 2024-09-05T01:26:03.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.169+0000 7fbc2be00640 1 -- 172.21.15.12:0/864804424 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc34012450 con 0x55cb7275bcb0 2024-09-05T01:26:03.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.169+0000 7fbc2be00640 1 -- 172.21.15.12:0/864804424 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc34011600 con 0x55cb7275bcb0 2024-09-05T01:26:03.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.169+0000 7fbc448cd740 1 -- 172.21.15.12:0/864804424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb7275bcb0 msgr2=0x55cb7275c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:03.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.169+0000 7fbc448cd740 1 --2- 172.21.15.12:0/864804424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb7275bcb0 0x55cb7275c090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbc34010710 tx=0x7fbc34010bd0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.169+0000 7fbc448cd740 1 -- 172.21.15.12:0/864804424 shutdown_connections 2024-09-05T01:26:03.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.169+0000 7fbc448cd740 1 --2- 172.21.15.12:0/864804424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb72766e90 0x55cb72769280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.169+0000 7fbc448cd740 1 --2- 172.21.15.12:0/864804424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb7275c5d0 0x55cb72766950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.169+0000 7fbc448cd740 1 --2- 172.21.15.12:0/864804424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb7275bcb0 0x55cb7275c090 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.169+0000 7fbc448cd740 1 -- 172.21.15.12:0/864804424 >> 172.21.15.12:0/864804424 conn(0x55cb72758240 msgr2=0x55cb72758620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:03.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.170+0000 7fbc448cd740 1 -- 172.21.15.12:0/864804424 shutdown_connections 2024-09-05T01:26:03.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.170+0000 7fbc448cd740 1 -- 172.21.15.12:0/864804424 wait complete. 2024-09-05T01:26:03.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.170+0000 7fbc40a00640 1 --2- 172.21.15.12:0/1920862227 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fbc200a2d20 0x7fbc200a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:03.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.170+0000 7fbc448cd740 1 -- start start 2024-09-05T01:26:03.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.170+0000 7fbc40a00640 1 -- 172.21.15.12:0/1920862227 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fbc2c0efd30 con 0x7fbc3c1019c0 2024-09-05T01:26:03.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.170+0000 7fbc3b400640 1 --2- 172.21.15.12:0/1920862227 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fbc200a2d20 0x7fbc200a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:03.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.170+0000 7fbc448cd740 1 Processor -- start 2024-09-05T01:26:03.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.171+0000 7fbc448cd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb7275bcb0 0x55cb72766800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:03.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.171+0000 7fbc448cd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb7275c5d0 0x55cb72763ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:03.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.171+0000 7fbc448cd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb72766e90 0x55cb72764010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:03.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.171+0000 7fbc448cd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cb72769b00 con 0x55cb7275bcb0 2024-09-05T01:26:03.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.171+0000 7fbc448cd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55cb7267cfa0 con 0x55cb7275c5d0 2024-09-05T01:26:03.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.171+0000 7fbc448cd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55cb72769c80 con 0x55cb72766e90 2024-09-05T01:26:03.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.171+0000 7fbc448cd740 10 client.0 _ll_register_callbacks cb 0x55cb723d0ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:26:03.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.171+0000 7fbc3aa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb7275bcb0 0x55cb72766800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:03.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.171+0000 7fbc3b400640 1 --2- 172.21.15.12:0/1920862227 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fbc200a2d20 0x7fbc200a51e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbc34012d90 tx=0x7fbc34005fd0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:03.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.171+0000 7fbc3aa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb7275bcb0 0x55cb72766800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42636/0 (socket says 172.21.15.12:42636) 2024-09-05T01:26:03.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.171+0000 7fbc3aa00640 1 -- 172.21.15.12:0/1404848406 learned_addr learned my addr 172.21.15.12:0/1404848406 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:03.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.172+0000 7fbc33e00640 1 --2- 172.21.15.12:0/1404848406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb7275c5d0 0x55cb72763ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:03.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.172+0000 7fbc3b400640 1 --2- 172.21.15.12:0/1404848406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb72766e90 0x55cb72764010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:03.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.172+0000 7fbc3aa00640 1 -- 172.21.15.12:0/1404848406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb72766e90 msgr2=0x55cb72764010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:03.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.172+0000 7fbc3aa00640 1 --2- 172.21.15.12:0/1404848406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb72766e90 0x55cb72764010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.172+0000 7fbc3aa00640 1 -- 172.21.15.12:0/1404848406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb7275c5d0 msgr2=0x55cb72763ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:03.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.172+0000 7fbc3aa00640 1 --2- 172.21.15.12:0/1404848406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb7275c5d0 0x55cb72763ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.172+0000 7fbc3aa00640 1 -- 172.21.15.12:0/1404848406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb72764840 con 0x55cb7275bcb0 2024-09-05T01:26:03.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.172+0000 7fbc33e00640 1 --2- 172.21.15.12:0/1404848406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb7275c5d0 0x55cb72763ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:26:03.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.172+0000 7fbc3aa00640 1 --2- 172.21.15.12:0/1404848406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb7275bcb0 0x55cb72766800 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c006010 tx=0x7fbc2c0bba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20496021e1679299 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:03.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.172+0000 7fbc28c00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:26:03.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.173+0000 7fbc28c00640 1 -- 172.21.15.12:0/1404848406 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c049050 con 0x55cb7275bcb0 2024-09-05T01:26:03.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.173+0000 7fbc28c00640 1 -- 172.21.15.12:0/1404848406 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fbc2c0b8780 con 0x55cb7275bcb0 2024-09-05T01:26:03.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.173+0000 7fbc448cd740 1 -- 172.21.15.12:0/1404848406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc34012450 con 0x55cb7275bcb0 2024-09-05T01:26:03.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.173+0000 7fbc28c00640 1 -- 172.21.15.12:0/1404848406 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbc2c0c0410 con 0x55cb7275bcb0 2024-09-05T01:26:03.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.173+0000 7fbc448cd740 10 client.15549 fetch_fsmap learned FSMap version 28 2024-09-05T01:26:03.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.173+0000 7fbc448cd740 1 -- 172.21.15.12:0/1404848406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cb72775a20 con 0x55cb7275bcb0 2024-09-05T01:26:03.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.173+0000 7fbc28c00640 1 -- 172.21.15.12:0/1404848406 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc34012450 con 0x55cb7275bcb0 2024-09-05T01:26:03.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.173+0000 7fbc28c00640 1 -- 172.21.15.12:0/1404848406 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbc2c0c4840 con 0x55cb7275bcb0 2024-09-05T01:26:03.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.174+0000 7fbc448cd740 10 client.15549 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:26:03.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.174+0000 7fbc448cd740 10 client.15549 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:26:03.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.174+0000 7fbc448cd740 20 client.15549 populate_metadata read hostname 'smithi012' 2024-09-05T01:26:03.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.174+0000 7fbc448cd740 1 --2- 172.21.15.12:0/1404848406 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55cb72776e30 0x55cb72779220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:03.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.174+0000 7fbc448cd740 4 client.15549 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:26:03.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.174+0000 7fbc448cd740 1 -- 172.21.15.12:0/1404848406 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb726cf800 con 0x55cb72776e30 2024-09-05T01:26:03.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.174+0000 7fbc33e00640 1 --2- 172.21.15.12:0/1404848406 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55cb72776e30 0x55cb72779220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:03.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.175+0000 7fbc33e00640 1 --2- 172.21.15.12:0/1404848406 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55cb72776e30 0x55cb72779220 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6166787e97493c38 server_cookie=9ae01661f03d08bc in_seq=0 out_seq=0 2024-09-05T01:26:03.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.175+0000 7fbc28c00640 10 client.15549 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:26:03.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.176+0000 7fbc28c00640 1 -- 172.21.15.12:0/1404848406 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cb726cf800 con 0x55cb72776e30 2024-09-05T01:26:03.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.176+0000 7fbc28c00640 10 client.15549 handle_command_reply: tid=0 2024-09-05T01:26:03.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.176+0000 7fbc448cd740 1 client.15549 shutdown 2024-09-05T01:26:03.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.176+0000 7fbc448cd740 1 -- 172.21.15.12:0/1404848406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb7275bcb0 msgr2=0x55cb72766800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:03.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.176+0000 7fbc448cd740 1 --2- 172.21.15.12:0/1404848406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb7275bcb0 0x55cb72766800 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c006010 tx=0x7fbc2c0bba70 comp rx=0 tx=0).stop 2024-09-05T01:26:03.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.176+0000 7fbc448cd740 1 -- 172.21.15.12:0/1404848406 shutdown_connections 2024-09-05T01:26:03.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.176+0000 7fbc448cd740 1 --2- 172.21.15.12:0/1404848406 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55cb72776e30 0x55cb72779220 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.176+0000 7fbc448cd740 1 --2- 172.21.15.12:0/1404848406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb72766e90 0x55cb72764010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.176+0000 7fbc448cd740 1 --2- 172.21.15.12:0/1404848406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb7275c5d0 0x55cb72763ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.176+0000 7fbc448cd740 1 --2- 172.21.15.12:0/1404848406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb7275bcb0 0x55cb72766800 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.176+0000 7fbc448cd740 1 -- 172.21.15.12:0/1404848406 >> 172.21.15.12:0/1404848406 conn(0x55cb72758240 msgr2=0x55cb7275df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:03.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.176+0000 7fbc28c00640 0 client.15549 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:26:03.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.176+0000 7fbc448cd740 1 -- 172.21.15.12:0/1404848406 shutdown_connections 2024-09-05T01:26:03.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.176+0000 7fbc448cd740 1 -- 172.21.15.12:0/1404848406 wait complete. 2024-09-05T01:26:03.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.177+0000 7fbc448cd740 20 client.15549 trim_cache size 0 max 16384 2024-09-05T01:26:03.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.195+0000 7fbc448cd740 1 Processor -- start 2024-09-05T01:26:03.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.195+0000 7fbc448cd740 1 -- start start 2024-09-05T01:26:03.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.195+0000 7fbc448cd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb7275bcb0 0x55cb72765a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:03.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.195+0000 7fbc448cd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb7275c5d0 0x55cb7277eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:03.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.195+0000 7fbc448cd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb72766e90 0x55cb7277f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:03.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.195+0000 7fbc448cd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c1b3c90 con 0x55cb7275bcb0 2024-09-05T01:26:03.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.195+0000 7fbc448cd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c1b57d0 con 0x55cb72766e90 2024-09-05T01:26:03.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.195+0000 7fbc448cd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c1b4360 con 0x55cb7275c5d0 2024-09-05T01:26:03.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.195+0000 7fbc3aa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb7275bcb0 0x55cb72765a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:03.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.195+0000 7fbc33e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb7275c5d0 0x55cb7277eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:03.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.195+0000 7fbc33e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb7275c5d0 0x55cb7277eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:40618/0 (socket says 172.21.15.12:40618) 2024-09-05T01:26:03.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.195+0000 7fbc33e00640 1 -- 172.21.15.12:0/3903126460 learned_addr learned my addr 172.21.15.12:0/3903126460 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:03.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.195+0000 7fbc3b400640 1 --2- 172.21.15.12:0/3903126460 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb72766e90 0x55cb7277f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:03.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.196+0000 7fbc33e00640 1 -- 172.21.15.12:0/3903126460 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb72766e90 msgr2=0x55cb7277f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:03.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.196+0000 7fbc33e00640 1 --2- 172.21.15.12:0/3903126460 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb72766e90 0x55cb7277f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.196+0000 7fbc33e00640 1 -- 172.21.15.12:0/3903126460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb7275bcb0 msgr2=0x55cb72765a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:03.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.196+0000 7fbc33e00640 1 --2- 172.21.15.12:0/3903126460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb7275bcb0 0x55cb72765a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.196+0000 7fbc33e00640 1 -- 172.21.15.12:0/3903126460 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb72762a80 con 0x55cb7275c5d0 2024-09-05T01:26:03.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.196+0000 7fbc33e00640 1 --2- 172.21.15.12:0/3903126460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb7275c5d0 0x55cb7277eaf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c075cb0 tx=0x7fbc24005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e16c3adc0b6b50f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:03.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.196+0000 7fbc2b400640 1 -- 172.21.15.12:0/3903126460 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc24012e60 con 0x55cb7275c5d0 2024-09-05T01:26:03.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.196+0000 7fbc2b400640 1 -- 172.21.15.12:0/3903126460 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc24005500 con 0x55cb7275c5d0 2024-09-05T01:26:03.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.196+0000 7fbc2b400640 1 -- 172.21.15.12:0/3903126460 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc24004ba0 con 0x55cb7275c5d0 2024-09-05T01:26:03.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.197+0000 7fbc448cd740 1 -- 172.21.15.12:0/3903126460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb7275c5d0 msgr2=0x55cb7277eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:03.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.197+0000 7fbc448cd740 1 --2- 172.21.15.12:0/3903126460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb7275c5d0 0x55cb7277eaf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c075cb0 tx=0x7fbc24005f90 comp rx=0 tx=0).stop 2024-09-05T01:26:03.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.197+0000 7fbc448cd740 1 -- 172.21.15.12:0/3903126460 shutdown_connections 2024-09-05T01:26:03.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.197+0000 7fbc448cd740 1 --2- 172.21.15.12:0/3903126460 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb72766e90 0x55cb7277f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.197+0000 7fbc448cd740 1 --2- 172.21.15.12:0/3903126460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb7275c5d0 0x55cb7277eaf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.197+0000 7fbc448cd740 1 --2- 172.21.15.12:0/3903126460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb7275bcb0 0x55cb72765a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.197+0000 7fbc448cd740 1 -- 172.21.15.12:0/3903126460 >> 172.21.15.12:0/3903126460 conn(0x55cb72758240 msgr2=0x55cb72765310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:03.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.197+0000 7fbc448cd740 1 -- 172.21.15.12:0/3903126460 shutdown_connections 2024-09-05T01:26:03.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.197+0000 7fbc448cd740 1 -- 172.21.15.12:0/3903126460 wait complete. 2024-09-05T01:26:03.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.198+0000 7fbc448cd740 1 -- start start 2024-09-05T01:26:03.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.198+0000 7fbc448cd740 1 Processor -- start 2024-09-05T01:26:03.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.199+0000 7fbc448cd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb7275bcb0 0x55cb7276f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:03.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.199+0000 7fbc448cd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb7275c5d0 0x55cb7276c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:03.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.199+0000 7fbc448cd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb72766e90 0x55cb7276ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:03.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.199+0000 7fbc448cd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c1b5100 con 0x55cb7275c5d0 2024-09-05T01:26:03.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.199+0000 7fbc448cd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c1b4a30 con 0x55cb72766e90 2024-09-05T01:26:03.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.199+0000 7fbc448cd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3c1b1c70 con 0x55cb7275bcb0 2024-09-05T01:26:03.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.199+0000 7fbc448cd740 10 client.0 _ll_register_callbacks cb 0x55cb72764a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:26:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.199+0000 7fbc3b400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb72766e90 0x55cb7276ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.199+0000 7fbc33e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb7275c5d0 0x55cb7276c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.199+0000 7fbc3b400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb72766e90 0x55cb7276ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:50830/0 (socket says 172.21.15.12:50830) 2024-09-05T01:26:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.199+0000 7fbc3b400640 1 -- 172.21.15.12:0/2907345365 learned_addr learned my addr 172.21.15.12:0/2907345365 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.199+0000 7fbc3aa00640 1 --2- 172.21.15.12:0/2907345365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb7275bcb0 0x55cb7276f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.200+0000 7fbc3b400640 1 -- 172.21.15.12:0/2907345365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb7275bcb0 msgr2=0x55cb7276f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.200+0000 7fbc3b400640 1 --2- 172.21.15.12:0/2907345365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb7275bcb0 0x55cb7276f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.200+0000 7fbc3b400640 1 -- 172.21.15.12:0/2907345365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb7275c5d0 msgr2=0x55cb7276c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.200+0000 7fbc3b400640 1 --2- 172.21.15.12:0/2907345365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb7275c5d0 0x55cb7276c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.200+0000 7fbc3b400640 1 -- 172.21.15.12:0/2907345365 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb7276d5e0 con 0x55cb72766e90 2024-09-05T01:26:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.200+0000 7fbc3aa00640 1 --2- 172.21.15.12:0/2907345365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb7275bcb0 0x55cb7276f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:26:03.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.200+0000 7fbc33e00640 1 --2- 172.21.15.12:0/2907345365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb7275c5d0 0x55cb7276c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:26:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.200+0000 7fbc3b400640 1 --2- 172.21.15.12:0/2907345365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb72766e90 0x55cb7276ce30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbc34010710 tx=0x7fbc34012df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6d214301911d2b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.200+0000 7fbc28c00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:26:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.200+0000 7fbc28c00640 1 -- 172.21.15.12:0/2907345365 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc34037060 con 0x55cb72766e90 2024-09-05T01:26:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.200+0000 7fbc448cd740 1 -- 172.21.15.12:0/2907345365 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc24005500 con 0x55cb72766e90 2024-09-05T01:26:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.200+0000 7fbc28c00640 1 -- 172.21.15.12:0/2907345365 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fbc34032450 con 0x55cb72766e90 2024-09-05T01:26:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.201+0000 7fbc28c00640 1 -- 172.21.15.12:0/2907345365 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbc34032690 con 0x55cb72766e90 2024-09-05T01:26:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.201+0000 7fbc448cd740 10 client.25574 fetch_fsmap learned FSMap version 28 2024-09-05T01:26:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.201+0000 7fbc448cd740 1 -- 172.21.15.12:0/2907345365 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cb727f2aa0 con 0x55cb72766e90 2024-09-05T01:26:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.201+0000 7fbc28c00640 1 -- 172.21.15.12:0/2907345365 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc24005500 con 0x55cb72766e90 2024-09-05T01:26:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.201+0000 7fbc28c00640 1 -- 172.21.15.12:0/2907345365 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbc3400f040 con 0x55cb72766e90 2024-09-05T01:26:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.201+0000 7fbc448cd740 10 client.25574 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:26:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.201+0000 7fbc448cd740 10 client.25574 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:26:03.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.201+0000 7fbc448cd740 20 client.25574 populate_metadata read hostname 'smithi012' 2024-09-05T01:26:03.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.201+0000 7fbc448cd740 1 --2- 172.21.15.12:0/2907345365 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55cb727f2ee0 0x55cb727f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:03.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.201+0000 7fbc448cd740 4 client.25574 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-05T01:26:03.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.201+0000 7fbc448cd740 1 -- 172.21.15.12:0/2907345365 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55cb726c9d10 con 0x55cb727f2ee0 2024-09-05T01:26:03.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.202+0000 7fbc3aa00640 1 --2- 172.21.15.12:0/2907345365 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55cb727f2ee0 0x55cb727f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:03.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.202+0000 7fbc3aa00640 1 --2- 172.21.15.12:0/2907345365 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55cb727f2ee0 0x55cb727f52d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88f62b190f389842 server_cookie=27bea1c289e1f5ca in_seq=0 out_seq=0 2024-09-05T01:26:03.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.202+0000 7fbc28c00640 10 client.25574 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:26:03.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.203+0000 7fbc28c00640 1 -- 172.21.15.12:0/2907345365 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55cb726c9d10 con 0x55cb727f2ee0 2024-09-05T01:26:03.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.203+0000 7fbc28c00640 10 client.25574 handle_command_reply: tid=0 2024-09-05T01:26:03.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.203+0000 7fbc448cd740 1 client.25574 shutdown 2024-09-05T01:26:03.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.204+0000 7fbc448cd740 1 -- 172.21.15.12:0/2907345365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb72766e90 msgr2=0x55cb7276ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:03.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.204+0000 7fbc448cd740 1 --2- 172.21.15.12:0/2907345365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb72766e90 0x55cb7276ce30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbc34010710 tx=0x7fbc34012df0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.204+0000 7fbc448cd740 1 -- 172.21.15.12:0/2907345365 shutdown_connections 2024-09-05T01:26:03.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.204+0000 7fbc448cd740 1 --2- 172.21.15.12:0/2907345365 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55cb727f2ee0 0x55cb727f52d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.204+0000 7fbc448cd740 1 --2- 172.21.15.12:0/2907345365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cb72766e90 0x55cb7276ce30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.204+0000 7fbc448cd740 1 --2- 172.21.15.12:0/2907345365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cb7275c5d0 0x55cb7276c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.204+0000 7fbc448cd740 1 --2- 172.21.15.12:0/2907345365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb7275bcb0 0x55cb7276f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.204+0000 7fbc448cd740 1 -- 172.21.15.12:0/2907345365 >> 172.21.15.12:0/2907345365 conn(0x55cb72758240 msgr2=0x55cb72765b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:03.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.204+0000 7fbc28c00640 0 client.25574 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:26:03.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.204+0000 7fbc448cd740 1 -- 172.21.15.12:0/2907345365 shutdown_connections 2024-09-05T01:26:03.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.204+0000 7fbc448cd740 1 -- 172.21.15.12:0/2907345365 wait complete. 2024-09-05T01:26:03.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.204+0000 7fbc448cd740 20 client.25574 trim_cache size 0 max 16384 2024-09-05T01:26:03.208 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:26:03.208 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-05T01:26:03.209 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "9891b9c5-b3a7-4681-b25f-26e3ce0ddd42", 2024-09-05T01:26:03.209 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-05T01:26:03.209 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:26:03.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.205+0000 7fbc3be00640 1 -- 172.21.15.12:0/1920862227 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fbc200a2d20 msgr2=0x7fbc200a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:03.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.205+0000 7fbc3be00640 1 --2- 172.21.15.12:0/1920862227 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fbc200a2d20 0x7fbc200a51e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbc34012d90 tx=0x7fbc34005fd0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.205+0000 7fbc3be00640 1 -- 172.21.15.12:0/1920862227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc3c1019c0 msgr2=0x7fbc3c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:03.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.205+0000 7fbc3be00640 1 --2- 172.21.15.12:0/1920862227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc3c1019c0 0x7fbc3c0744f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c02a9e0 tx=0x7fbc2c003c10 comp rx=0 tx=0).stop 2024-09-05T01:26:03.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.205+0000 7fbc3be00640 1 -- 172.21.15.12:0/1920862227 shutdown_connections 2024-09-05T01:26:03.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.205+0000 7fbc3be00640 1 --2- 172.21.15.12:0/1920862227 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fbc200a2d20 0x7fbc200a51e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.205+0000 7fbc3be00640 1 --2- 172.21.15.12:0/1920862227 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fbc3c1079c0 0x7fbc3c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.205+0000 7fbc3be00640 1 --2- 172.21.15.12:0/1920862227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc3c102360 0x7fbc3c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.205+0000 7fbc3be00640 1 --2- 172.21.15.12:0/1920862227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc3c1019c0 0x7fbc3c0744f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:03.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.205+0000 7fbc3be00640 1 -- 172.21.15.12:0/1920862227 >> 172.21.15.12:0/1920862227 conn(0x7fbc3c0fd740 msgr2=0x7fbc3c0fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:03.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.205+0000 7fbc3be00640 1 -- 172.21.15.12:0/1920862227 shutdown_connections 2024-09-05T01:26:03.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:03.205+0000 7fbc3be00640 1 -- 172.21.15.12:0/1920862227 wait complete. 2024-09-05T01:26:03.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:03 smithi012 ceph-mon[29942]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T01:26:03.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:03 smithi151 ceph-mon[35013]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T01:26:03.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:03 smithi145 ceph-mon[34376]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-05T01:26:04.141 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T01:26:04.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:04 smithi151 ceph-mon[35013]: scrub queued for path: / 2024-09-05T01:26:04.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:04 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:26:04.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:04 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:26:04.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:04 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:26:04.528 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:26:04.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:04 smithi012 ceph-mon[29942]: scrub queued for path: / 2024-09-05T01:26:04.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:04 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:26:04.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:04 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:26:04.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:04 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:26:04.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:04 smithi145 ceph-mon[34376]: scrub queued for path: / 2024-09-05T01:26:04.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:04 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:26:04.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:04 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:26:04.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:04 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:26:04.916 INFO:tasks.workunit.client.0.smithi012.stderr:Updating files: 60% (7801/12892) Updating files: 61% (7865/12892) Updating files: 62% (7994/12892) Updating files: 63% (8122/12892) Updating files: 64% (8251/12892) Updating files: 65% (8380/12892) Updating files: 66% (8509/12892) Updating files: 67% (8638/12892) Updating files: 68% (8767/12892) Updating files: 69% (8896/12892) Updating files: 70% (9025/12892) Updating files: 71% (9154/12892) Updating files: 72% (9283/12892) Updating files: 73% (9412/12892) Updating files: 74% (9541/12892) Updating files: 75% (9669/12892) Updating files: 76% (9798/12892) Updating files: 77% (9927/12892) Updating files: 78% (10056/12892) Updating files: 79% (10185/12892) Updating files: 80% (10314/12892) Updating files: 81% (10443/12892) Updating files: 82% (10572/12892) Updating files: 83% (10701/12892) Updating files: 84% (10830/12892) Updating files: 85% (10959/12892) Updating files: 86% (11088/12892) Updating files: 87% (11217/12892) Updating files: 88% (11345/12892) Updating files: 89% (11474/12892) Updating files: 90% (11603/12892) Updating files: 91% (11732/12892) Updating files: 92% (11861/12892) Updating files: 93% (11990/12892) Updating files: 94% (12119/12892) Updating files: 94% (12184/12892) Updating files: 95% (12248/12892) Updating files: 96% (12377/12892) Updating files: 97% (12506/12892) Updating files: 98% (12635/12892) Updating files: 99% (12764/12892) Updating files: 100% (12892/12892) Updating files: 100% (12892/12892), done. 2024-09-05T01:26:05.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.141+0000 7f67e9a00640 1 -- 172.21.15.12:0/89095508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67e41049a0 msgr2=0x7f67e41089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:05.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.141+0000 7f67e9a00640 1 --2- 172.21.15.12:0/89095508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67e41049a0 0x7f67e41089f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f67d0009900 tx=0x7f67d002a3f0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.142+0000 7f67e9a00640 1 -- 172.21.15.12:0/89095508 shutdown_connections 2024-09-05T01:26:05.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.142+0000 7f67e9a00640 1 --2- 172.21.15.12:0/89095508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f67e4109120 0x7f67e4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.142+0000 7f67e9a00640 1 --2- 172.21.15.12:0/89095508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67e41049a0 0x7f67e41089f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.142+0000 7f67e9a00640 1 --2- 172.21.15.12:0/89095508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67e4103ff0 0x7f67e41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.142+0000 7f67e9a00640 1 -- 172.21.15.12:0/89095508 >> 172.21.15.12:0/89095508 conn(0x7f67e40ffa90 msgr2=0x7f67e4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:05.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.142+0000 7f67e9a00640 1 -- 172.21.15.12:0/89095508 shutdown_connections 2024-09-05T01:26:05.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.142+0000 7f67e9a00640 1 -- 172.21.15.12:0/89095508 wait complete. 2024-09-05T01:26:05.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.143+0000 7f67e9a00640 1 Processor -- start 2024-09-05T01:26:05.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.143+0000 7f67e9a00640 1 -- start start 2024-09-05T01:26:05.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.143+0000 7f67e9a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67e4103ff0 0x7f67e419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:05.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.143+0000 7f67e9a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67e41049a0 0x7f67e419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:05.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.143+0000 7f67e9a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f67e4109120 0x7f67e419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:05.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.143+0000 7f67e9a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f67e4114190 con 0x7f67e4103ff0 2024-09-05T01:26:05.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.143+0000 7f67e9a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f67e4114010 con 0x7f67e4109120 2024-09-05T01:26:05.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.143+0000 7f67e9a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f67e4114310 con 0x7f67e41049a0 2024-09-05T01:26:05.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.144+0000 7f67e2000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67e41049a0 0x7f67e419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:05.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.144+0000 7f67e2a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67e4103ff0 0x7f67e419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:05.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.144+0000 7f67e2000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67e41049a0 0x7f67e419ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:40638/0 (socket says 172.21.15.12:40638) 2024-09-05T01:26:05.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.144+0000 7f67e3400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f67e4109120 0x7f67e419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:05.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.144+0000 7f67e2000640 1 -- 172.21.15.12:0/791808720 learned_addr learned my addr 172.21.15.12:0/791808720 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:05.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.144+0000 7f67e2a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67e4103ff0 0x7f67e419a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42654/0 (socket says 172.21.15.12:42654) 2024-09-05T01:26:05.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.144+0000 7f67e2000640 1 -- 172.21.15.12:0/791808720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f67e4109120 msgr2=0x7f67e419eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:05.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.144+0000 7f67e2000640 1 --2- 172.21.15.12:0/791808720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f67e4109120 0x7f67e419eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.144+0000 7f67e2000640 1 -- 172.21.15.12:0/791808720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67e4103ff0 msgr2=0x7f67e419a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:05.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.144+0000 7f67e2000640 1 --2- 172.21.15.12:0/791808720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67e4103ff0 0x7f67e419a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.144+0000 7f67e2000640 1 -- 172.21.15.12:0/791808720 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e419f5c0 con 0x7f67e41049a0 2024-09-05T01:26:05.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.144+0000 7f67e2a00640 1 --2- 172.21.15.12:0/791808720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67e4103ff0 0x7f67e419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:26:05.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.144+0000 7f67e3400640 1 --2- 172.21.15.12:0/791808720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f67e4109120 0x7f67e419eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:26:05.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.145+0000 7f67e2000640 1 --2- 172.21.15.12:0/791808720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67e41049a0 0x7f67e419ab50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f67d0004770 tx=0x7f67d0003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:05.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.145+0000 7f67db400640 1 -- 172.21.15.12:0/791808720 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d003f070 con 0x7f67e41049a0 2024-09-05T01:26:05.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.145+0000 7f67db400640 1 -- 172.21.15.12:0/791808720 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67d0031ca0 con 0x7f67e41049a0 2024-09-05T01:26:05.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.145+0000 7f67e9a00640 1 -- 172.21.15.12:0/791808720 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e419f850 con 0x7f67e41049a0 2024-09-05T01:26:05.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.145+0000 7f67db400640 1 -- 172.21.15.12:0/791808720 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d0035030 con 0x7f67e41049a0 2024-09-05T01:26:05.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.145+0000 7f67e9a00640 1 -- 172.21.15.12:0/791808720 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e41a7190 con 0x7f67e41049a0 2024-09-05T01:26:05.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.148+0000 7f67db400640 1 -- 172.21.15.12:0/791808720 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) ==== 138066+0+0 (secure 0 0 0) 0x7f67d0042070 con 0x7f67e41049a0 2024-09-05T01:26:05.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.148+0000 7f67ec62b740 1 Processor -- start 2024-09-05T01:26:05.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.149+0000 7f67ec62b740 1 -- start start 2024-09-05T01:26:05.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.149+0000 7f67ec62b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 0x5594566daf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:05.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.149+0000 7f67ec62b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594566db4b0 0x5594566e5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:05.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.149+0000 7f67ec62b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594566e5d70 0x5594566e8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:05.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.149+0000 7f67ec62b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5594566413e0 con 0x5594566db4b0 2024-09-05T01:26:05.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.149+0000 7f67ec62b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5594565e8d80 con 0x5594566e5d70 2024-09-05T01:26:05.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.149+0000 7f67ec62b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55945663d3a0 con 0x5594566dab90 2024-09-05T01:26:05.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.149+0000 7f67e3400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 0x5594566daf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:05.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.149+0000 7f67e3400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 0x5594566daf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:40642/0 (socket says 172.21.15.12:40642) 2024-09-05T01:26:05.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.149+0000 7f67e3400640 1 -- 172.21.15.12:0/2937670565 learned_addr learned my addr 172.21.15.12:0/2937670565 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:05.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.149+0000 7f67e2a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594566db4b0 0x5594566e5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:05.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.149+0000 7f67e2000640 1 --2- 172.21.15.12:0/2937670565 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594566e5d70 0x5594566e8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:05.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.150+0000 7f67e3400640 1 -- 172.21.15.12:0/2937670565 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594566e5d70 msgr2=0x5594566e8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:05.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.150+0000 7f67e3400640 1 --2- 172.21.15.12:0/2937670565 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594566e5d70 0x5594566e8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.150+0000 7f67e3400640 1 -- 172.21.15.12:0/2937670565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594566db4b0 msgr2=0x5594566e5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:05.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.150+0000 7f67e3400640 1 --2- 172.21.15.12:0/2937670565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594566db4b0 0x5594566e5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.150+0000 7f67e3400640 1 -- 172.21.15.12:0/2937670565 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559456607ae0 con 0x5594566dab90 2024-09-05T01:26:05.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.150+0000 7f67db400640 1 --2- 172.21.15.12:0/791808720 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f67c80a2e90 0x7f67c80a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:05.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.150+0000 7f67e3400640 1 --2- 172.21.15.12:0/2937670565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 0x5594566daf70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f67dc011790 tx=0x7f67dc011c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33b8e90c12b539d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:05.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.150+0000 7f67db400640 1 -- 172.21.15.12:0/791808720 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f67d00efbc0 con 0x7f67e41049a0 2024-09-05T01:26:05.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.150+0000 7f67e2a00640 1 --2- 172.21.15.12:0/791808720 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f67c80a2e90 0x7f67c80a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:05.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.150+0000 7f67cfe00640 1 -- 172.21.15.12:0/2937670565 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc003c30 con 0x5594566dab90 2024-09-05T01:26:05.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.151+0000 7f67cfe00640 1 -- 172.21.15.12:0/2937670565 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67dc00fe80 con 0x5594566dab90 2024-09-05T01:26:05.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.151+0000 7f67cfe00640 1 -- 172.21.15.12:0/2937670565 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc0193e0 con 0x5594566dab90 2024-09-05T01:26:05.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.151+0000 7f67e2a00640 1 --2- 172.21.15.12:0/791808720 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f67c80a2e90 0x7f67c80a5350 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x5594566d7f80 tx=0x7f67d4005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:05.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.151+0000 7f67ec62b740 1 -- 172.21.15.12:0/2937670565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 msgr2=0x5594566daf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:05.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.151+0000 7f67ec62b740 1 --2- 172.21.15.12:0/2937670565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 0x5594566daf70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f67dc011790 tx=0x7f67dc011c50 comp rx=0 tx=0).stop 2024-09-05T01:26:05.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.152+0000 7f67ec62b740 1 -- 172.21.15.12:0/2937670565 shutdown_connections 2024-09-05T01:26:05.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.152+0000 7f67ec62b740 1 --2- 172.21.15.12:0/2937670565 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594566e5d70 0x5594566e8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.152+0000 7f67ec62b740 1 --2- 172.21.15.12:0/2937670565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594566db4b0 0x5594566e5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.152+0000 7f67ec62b740 1 --2- 172.21.15.12:0/2937670565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 0x5594566daf70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.152+0000 7f67ec62b740 1 -- 172.21.15.12:0/2937670565 >> 172.21.15.12:0/2937670565 conn(0x5594566d7120 msgr2=0x5594566d7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:05.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.152+0000 7f67ec62b740 1 -- 172.21.15.12:0/2937670565 shutdown_connections 2024-09-05T01:26:05.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.152+0000 7f67ec62b740 1 -- 172.21.15.12:0/2937670565 wait complete. 2024-09-05T01:26:05.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.152+0000 7f67ec62b740 1 -- start start 2024-09-05T01:26:05.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.153+0000 7f67ec62b740 1 Processor -- start 2024-09-05T01:26:05.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.153+0000 7f67ec62b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 0x5594566e2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:05.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.153+0000 7f67ec62b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594566db4b0 0x5594566e3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:05.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.153+0000 7f67ec62b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594566e5d70 0x5594566e37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:05.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.153+0000 7f67ec62b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5594566e89e0 con 0x5594566db4b0 2024-09-05T01:26:05.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.153+0000 7f67ec62b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5594565fc0f0 con 0x5594566e5d70 2024-09-05T01:26:05.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.153+0000 7f67ec62b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5594566e8b60 con 0x5594566dab90 2024-09-05T01:26:05.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.153+0000 7f67ec62b740 10 client.0 _ll_register_callbacks cb 0x5594565ed9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:26:05.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.154+0000 7f67e2a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 0x5594566e2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:05.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.154+0000 7f67e2a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 0x5594566e2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:40646/0 (socket says 172.21.15.12:40646) 2024-09-05T01:26:05.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.154+0000 7f67e2a00640 1 -- 172.21.15.12:0/3179248721 learned_addr learned my addr 172.21.15.12:0/3179248721 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:05.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.154+0000 7f67e2000640 1 --2- 172.21.15.12:0/3179248721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594566db4b0 0x5594566e3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:05.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.154+0000 7f67e3400640 1 --2- 172.21.15.12:0/3179248721 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594566e5d70 0x5594566e37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:05.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.154+0000 7f67e2a00640 1 -- 172.21.15.12:0/3179248721 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594566e5d70 msgr2=0x5594566e37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:05.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.154+0000 7f67e2a00640 1 --2- 172.21.15.12:0/3179248721 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594566e5d70 0x5594566e37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.154+0000 7f67e2a00640 1 -- 172.21.15.12:0/3179248721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594566db4b0 msgr2=0x5594566e3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:05.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.154+0000 7f67e2a00640 1 --2- 172.21.15.12:0/3179248721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594566db4b0 0x5594566e3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.154+0000 7f67e2a00640 1 -- 172.21.15.12:0/3179248721 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594563b23c0 con 0x5594566dab90 2024-09-05T01:26:05.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.155+0000 7f67e2a00640 1 --2- 172.21.15.12:0/3179248721 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 0x5594566e2d30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f67d4005bc0 tx=0x7f67d4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86f8b58248c85391 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:05.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.155+0000 7f67ccc00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:26:05.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.155+0000 7f67ccc00640 1 -- 172.21.15.12:0/3179248721 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d400f770 con 0x5594566dab90 2024-09-05T01:26:05.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.155+0000 7f67ccc00640 1 -- 172.21.15.12:0/3179248721 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f67d400f910 con 0x5594566dab90 2024-09-05T01:26:05.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.155+0000 7f67ec62b740 1 -- 172.21.15.12:0/3179248721 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55945664e950 con 0x5594566dab90 2024-09-05T01:26:05.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.155+0000 7f67ccc00640 1 -- 172.21.15.12:0/3179248721 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f67d400fb10 con 0x5594566dab90 2024-09-05T01:26:05.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.156+0000 7f67ec62b740 10 client.25579 fetch_fsmap learned FSMap version 28 2024-09-05T01:26:05.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.156+0000 7f67ec62b740 1 -- 172.21.15.12:0/3179248721 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5594566f47b0 con 0x5594566dab90 2024-09-05T01:26:05.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.156+0000 7f67ccc00640 1 -- 172.21.15.12:0/3179248721 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55945664e950 con 0x5594566dab90 2024-09-05T01:26:05.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.156+0000 7f67ccc00640 1 -- 172.21.15.12:0/3179248721 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f67d4027070 con 0x5594566dab90 2024-09-05T01:26:05.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.156+0000 7f67ec62b740 10 client.25579 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:26:05.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.156+0000 7f67ec62b740 10 client.25579 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:26:05.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.156+0000 7f67ec62b740 20 client.25579 populate_metadata read hostname 'smithi012' 2024-09-05T01:26:05.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.156+0000 7f67ec62b740 1 --2- 172.21.15.12:0/3179248721 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5594566f5c70 0x5594566f8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:05.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.156+0000 7f67ec62b740 4 client.25579 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:26:05.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.156+0000 7f67ec62b740 1 -- 172.21.15.12:0/3179248721 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559456648e60 con 0x5594566f5c70 2024-09-05T01:26:05.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.157+0000 7f67e2000640 1 --2- 172.21.15.12:0/3179248721 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5594566f5c70 0x5594566f8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:05.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.157+0000 7f67e2000640 1 --2- 172.21.15.12:0/3179248721 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5594566f5c70 0x5594566f8110 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e730e358d88d308 server_cookie=560efa3e8a63b070 in_seq=0 out_seq=0 2024-09-05T01:26:05.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.157+0000 7f67ccc00640 10 client.25579 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:26:05.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.158+0000 7f67ccc00640 1 -- 172.21.15.12:0/3179248721 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559456648e60 con 0x5594566f5c70 2024-09-05T01:26:05.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.158+0000 7f67ccc00640 10 client.25579 handle_command_reply: tid=0 2024-09-05T01:26:05.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.158+0000 7f67ec62b740 1 client.25579 shutdown 2024-09-05T01:26:05.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.158+0000 7f67ec62b740 1 -- 172.21.15.12:0/3179248721 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 msgr2=0x5594566e2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:05.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.158+0000 7f67ec62b740 1 --2- 172.21.15.12:0/3179248721 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 0x5594566e2d30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f67d4005bc0 tx=0x7f67d4004730 comp rx=0 tx=0).stop 2024-09-05T01:26:05.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.158+0000 7f67ec62b740 1 -- 172.21.15.12:0/3179248721 shutdown_connections 2024-09-05T01:26:05.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.158+0000 7f67ec62b740 1 --2- 172.21.15.12:0/3179248721 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5594566f5c70 0x5594566f8110 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.158+0000 7f67ec62b740 1 --2- 172.21.15.12:0/3179248721 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594566e5d70 0x5594566e37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.158+0000 7f67ec62b740 1 --2- 172.21.15.12:0/3179248721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594566db4b0 0x5594566e3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.158+0000 7f67ec62b740 1 --2- 172.21.15.12:0/3179248721 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 0x5594566e2d30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.158+0000 7f67ccc00640 0 client.25579 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:26:05.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.158+0000 7f67ec62b740 1 -- 172.21.15.12:0/3179248721 >> 172.21.15.12:0/3179248721 conn(0x5594566d7120 msgr2=0x5594566dce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:05.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.158+0000 7f67ec62b740 1 -- 172.21.15.12:0/3179248721 shutdown_connections 2024-09-05T01:26:05.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.159+0000 7f67ec62b740 1 -- 172.21.15.12:0/3179248721 wait complete. 2024-09-05T01:26:05.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.159+0000 7f67ec62b740 20 client.25579 trim_cache size 0 max 16384 2024-09-05T01:26:05.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.177+0000 7f67ec62b740 1 Processor -- start 2024-09-05T01:26:05.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.177+0000 7f67ec62b740 1 -- start start 2024-09-05T01:26:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.177+0000 7f67ec62b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 0x5594566fda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.177+0000 7f67ec62b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594566db4b0 0x5594566fdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.178+0000 7f67ec62b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594566e5d70 0x5594566d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.178+0000 7f67ec62b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f67e41afaf0 con 0x5594566db4b0 2024-09-05T01:26:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.178+0000 7f67ec62b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f67e41b1630 con 0x5594566e5d70 2024-09-05T01:26:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.178+0000 7f67ec62b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f67e41b01c0 con 0x5594566dab90 2024-09-05T01:26:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.178+0000 7f67e2a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 0x5594566fda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.178+0000 7f67e2000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594566db4b0 0x5594566fdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.178+0000 7f67e2a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 0x5594566fda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:40660/0 (socket says 172.21.15.12:40660) 2024-09-05T01:26:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.178+0000 7f67e2a00640 1 -- 172.21.15.12:0/2318567541 learned_addr learned my addr 172.21.15.12:0/2318567541 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.178+0000 7f67e3400640 1 --2- 172.21.15.12:0/2318567541 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594566e5d70 0x5594566d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.178+0000 7f67e2a00640 1 -- 172.21.15.12:0/2318567541 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594566e5d70 msgr2=0x5594566d59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.178+0000 7f67e2a00640 1 --2- 172.21.15.12:0/2318567541 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594566e5d70 0x5594566d59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.178+0000 7f67e2a00640 1 -- 172.21.15.12:0/2318567541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594566db4b0 msgr2=0x5594566fdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.178+0000 7f67e2a00640 1 --2- 172.21.15.12:0/2318567541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594566db4b0 0x5594566fdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.178+0000 7f67e2a00640 1 -- 172.21.15.12:0/2318567541 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594566d81d0 con 0x5594566dab90 2024-09-05T01:26:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.179+0000 7f67e2a00640 1 --2- 172.21.15.12:0/2318567541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 0x5594566fda30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f67d4012f40 tx=0x7f67d400fe40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75902158bcbbef90 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.179+0000 7f67cf400640 1 -- 172.21.15.12:0/2318567541 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d401f7a0 con 0x5594566dab90 2024-09-05T01:26:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.179+0000 7f67cf400640 1 -- 172.21.15.12:0/2318567541 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67d401f940 con 0x5594566dab90 2024-09-05T01:26:05.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.179+0000 7f67cf400640 1 -- 172.21.15.12:0/2318567541 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d40299f0 con 0x5594566dab90 2024-09-05T01:26:05.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.180+0000 7f67ec62b740 1 -- 172.21.15.12:0/2318567541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 msgr2=0x5594566fda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:05.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.180+0000 7f67ec62b740 1 --2- 172.21.15.12:0/2318567541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 0x5594566fda30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f67d4012f40 tx=0x7f67d400fe40 comp rx=0 tx=0).stop 2024-09-05T01:26:05.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.180+0000 7f67ec62b740 1 -- 172.21.15.12:0/2318567541 shutdown_connections 2024-09-05T01:26:05.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.180+0000 7f67ec62b740 1 --2- 172.21.15.12:0/2318567541 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594566e5d70 0x5594566d59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.180+0000 7f67ec62b740 1 --2- 172.21.15.12:0/2318567541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594566db4b0 0x5594566fdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.180+0000 7f67ec62b740 1 --2- 172.21.15.12:0/2318567541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 0x5594566fda30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.180+0000 7f67ec62b740 1 -- 172.21.15.12:0/2318567541 >> 172.21.15.12:0/2318567541 conn(0x5594566d7120 msgr2=0x5594566e1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:05.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.180+0000 7f67ec62b740 1 -- 172.21.15.12:0/2318567541 shutdown_connections 2024-09-05T01:26:05.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.180+0000 7f67ec62b740 1 -- 172.21.15.12:0/2318567541 wait complete. 2024-09-05T01:26:05.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.180+0000 7f67ec62b740 1 -- start start 2024-09-05T01:26:05.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.181+0000 7f67ec62b740 1 Processor -- start 2024-09-05T01:26:05.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.181+0000 7f67ec62b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 0x5594566ee300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:05.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.181+0000 7f67ec62b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594566db4b0 0x5594566df8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:05.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.181+0000 7f67ec62b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594566e5d70 0x5594566dfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:05.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.181+0000 7f67ec62b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f67e41b0f60 con 0x5594566e5d70 2024-09-05T01:26:05.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.181+0000 7f67ec62b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f67e41b0890 con 0x5594566db4b0 2024-09-05T01:26:05.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.181+0000 7f67ec62b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f67e41adad0 con 0x5594566dab90 2024-09-05T01:26:05.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.181+0000 7f67ec62b740 10 client.0 _ll_register_callbacks cb 0x7f67d4004540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:26:05.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.181+0000 7f67e2a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 0x5594566ee300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:05.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.182+0000 7f67e2a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 0x5594566ee300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:40676/0 (socket says 172.21.15.12:40676) 2024-09-05T01:26:05.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.182+0000 7f67e2a00640 1 -- 172.21.15.12:0/3396105700 learned_addr learned my addr 172.21.15.12:0/3396105700 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:05.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.182+0000 7f67e3400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594566e5d70 0x5594566dfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:05.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.182+0000 7f67e2000640 1 --2- 172.21.15.12:0/3396105700 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594566db4b0 0x5594566df8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:05.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.182+0000 7f67e2a00640 1 -- 172.21.15.12:0/3396105700 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594566db4b0 msgr2=0x5594566df8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:05.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.182+0000 7f67e2a00640 1 --2- 172.21.15.12:0/3396105700 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594566db4b0 0x5594566df8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.182+0000 7f67e2a00640 1 -- 172.21.15.12:0/3396105700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594566e5d70 msgr2=0x5594566dfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:05.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.182+0000 7f67e2a00640 1 --2- 172.21.15.12:0/3396105700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594566e5d70 0x5594566dfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.182+0000 7f67e2a00640 1 -- 172.21.15.12:0/3396105700 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594566d7db0 con 0x5594566dab90 2024-09-05T01:26:05.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.182+0000 7f67e3400640 1 --2- 172.21.15.12:0/3396105700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594566e5d70 0x5594566dfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:26:05.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.182+0000 7f67e2a00640 1 --2- 172.21.15.12:0/3396105700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 0x5594566ee300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f67d401f650 tx=0x7f67d4005be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1e01a201829b77d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:05.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.182+0000 7f67ccc00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:26:05.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.183+0000 7f67ccc00640 1 -- 172.21.15.12:0/3396105700 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d403e070 con 0x5594566dab90 2024-09-05T01:26:05.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.183+0000 7f67ccc00640 1 -- 172.21.15.12:0/3396105700 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f67d4005240 con 0x5594566dab90 2024-09-05T01:26:05.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.183+0000 7f67ec62b740 1 -- 172.21.15.12:0/3396105700 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67d401f940 con 0x5594566dab90 2024-09-05T01:26:05.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.183+0000 7f67ccc00640 1 -- 172.21.15.12:0/3396105700 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f67d404a050 con 0x5594566dab90 2024-09-05T01:26:05.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.183+0000 7f67ec62b740 10 client.25585 fetch_fsmap learned FSMap version 28 2024-09-05T01:26:05.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.183+0000 7f67ec62b740 1 -- 172.21.15.12:0/3396105700 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559456760670 con 0x5594566dab90 2024-09-05T01:26:05.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.183+0000 7f67ccc00640 1 -- 172.21.15.12:0/3396105700 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67d401f940 con 0x5594566dab90 2024-09-05T01:26:05.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.183+0000 7f67ccc00640 1 -- 172.21.15.12:0/3396105700 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f67d4038020 con 0x5594566dab90 2024-09-05T01:26:05.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.184+0000 7f67ec62b740 10 client.25585 fetch_fsmap finished waiting for FSMap version 28 2024-09-05T01:26:05.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.184+0000 7f67ec62b740 10 client.25585 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:26:05.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.184+0000 7f67ec62b740 20 client.25585 populate_metadata read hostname 'smithi012' 2024-09-05T01:26:05.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.184+0000 7f67ec62b740 1 --2- 172.21.15.12:0/3396105700 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x559456760c70 0x559456763090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:05.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.184+0000 7f67ec62b740 4 client.25585 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T01:26:05.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.184+0000 7f67ec62b740 1 -- 172.21.15.12:0/3396105700 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5594565c50c0 con 0x559456760c70 2024-09-05T01:26:05.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.184+0000 7f67e2000640 1 --2- 172.21.15.12:0/3396105700 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x559456760c70 0x559456763090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:05.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.184+0000 7f67e2000640 1 --2- 172.21.15.12:0/3396105700 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x559456760c70 0x559456763090 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b1c49aecfe33da4 server_cookie=d7f7aff62ca76ec6 in_seq=0 out_seq=0 2024-09-05T01:26:05.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.184+0000 7f67ccc00640 10 client.25585 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:26:05.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.185+0000 7f67ccc00640 1 -- 172.21.15.12:0/3396105700 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5594565c50c0 con 0x559456760c70 2024-09-05T01:26:05.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.185+0000 7f67ccc00640 10 client.25585 handle_command_reply: tid=0 2024-09-05T01:26:05.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.185+0000 7f67ec62b740 1 client.25585 shutdown 2024-09-05T01:26:05.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.185+0000 7f67ec62b740 1 -- 172.21.15.12:0/3396105700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 msgr2=0x5594566ee300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:05.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.185+0000 7f67ec62b740 1 --2- 172.21.15.12:0/3396105700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 0x5594566ee300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f67d401f650 tx=0x7f67d4005be0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.185+0000 7f67ec62b740 1 -- 172.21.15.12:0/3396105700 shutdown_connections 2024-09-05T01:26:05.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.185+0000 7f67ec62b740 1 --2- 172.21.15.12:0/3396105700 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x559456760c70 0x559456763090 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.185+0000 7f67ec62b740 1 --2- 172.21.15.12:0/3396105700 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5594566e5d70 0x5594566dfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.185+0000 7f67ec62b740 1 --2- 172.21.15.12:0/3396105700 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5594566db4b0 0x5594566df8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.185+0000 7f67ec62b740 1 --2- 172.21.15.12:0/3396105700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594566dab90 0x5594566ee300 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.185+0000 7f67ec62b740 1 -- 172.21.15.12:0/3396105700 >> 172.21.15.12:0/3396105700 conn(0x5594566d7120 msgr2=0x5594566dc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:05.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.185+0000 7f67ccc00640 0 client.25585 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:26:05.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.185+0000 7f67ec62b740 1 -- 172.21.15.12:0/3396105700 shutdown_connections 2024-09-05T01:26:05.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.185+0000 7f67ec62b740 1 -- 172.21.15.12:0/3396105700 wait complete. 2024-09-05T01:26:05.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.185+0000 7f67ec62b740 20 client.25585 trim_cache size 0 max 16384 2024-09-05T01:26:05.190 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:26:05.190 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-05T01:26:05.190 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-05T01:26:05.190 INFO:teuthology.orchestra.run.smithi012.stdout: "9891b9c5-b3a7-4681-b25f-26e3ce0ddd42": { 2024-09-05T01:26:05.190 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-05T01:26:05.190 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "9891b9c5-b3a7-4681-b25f-26e3ce0ddd42", 2024-09-05T01:26:05.190 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-05T01:26:05.190 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:26:05.191 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:26:05.191 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:26:05.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.186+0000 7f67e9a00640 1 -- 172.21.15.12:0/791808720 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f67c80a2e90 msgr2=0x7f67c80a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:05.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.186+0000 7f67e9a00640 1 --2- 172.21.15.12:0/791808720 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f67c80a2e90 0x7f67c80a5350 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x5594566d7f80 tx=0x7f67d4005f90 comp rx=0 tx=0).stop 2024-09-05T01:26:05.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.186+0000 7f67e9a00640 1 -- 172.21.15.12:0/791808720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67e41049a0 msgr2=0x7f67e419ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:05.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.186+0000 7f67e9a00640 1 --2- 172.21.15.12:0/791808720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67e41049a0 0x7f67e419ab50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f67d0004770 tx=0x7f67d0003c10 comp rx=0 tx=0).stop 2024-09-05T01:26:05.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.186+0000 7f67e9a00640 1 -- 172.21.15.12:0/791808720 shutdown_connections 2024-09-05T01:26:05.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.186+0000 7f67e9a00640 1 --2- 172.21.15.12:0/791808720 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f67c80a2e90 0x7f67c80a5350 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.186+0000 7f67e9a00640 1 --2- 172.21.15.12:0/791808720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f67e4109120 0x7f67e419eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.186+0000 7f67e9a00640 1 --2- 172.21.15.12:0/791808720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67e41049a0 0x7f67e419ab50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.186+0000 7f67e9a00640 1 --2- 172.21.15.12:0/791808720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67e4103ff0 0x7f67e419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:05.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.186+0000 7f67e9a00640 1 -- 172.21.15.12:0/791808720 >> 172.21.15.12:0/791808720 conn(0x7f67e40ffa90 msgr2=0x7f67e4100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:05.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.186+0000 7f67e9a00640 1 -- 172.21.15.12:0/791808720 shutdown_connections 2024-09-05T01:26:05.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:05.186+0000 7f67e9a00640 1 -- 172.21.15.12:0/791808720 wait complete. 2024-09-05T01:26:05.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:05 smithi012 ceph-mon[29942]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-05T01:26:05.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:05 smithi151 ceph-mon[35013]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-05T01:26:05.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:05 smithi145 ceph-mon[34376]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-09-05T01:26:06.028 INFO:tasks.cephfs.filesystem:scrub status for tag:9891b9c5-b3a7-4681-b25f-26e3ce0ddd42 - {'path': '/', 'tag': '9891b9c5-b3a7-4681-b25f-26e3ce0ddd42', 'options': 'recursive,force'} 2024-09-05T01:26:06.048 INFO:tasks.workunit.client.0.smithi012.stderr:Note: switching to '91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4'. 2024-09-05T01:26:06.048 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-05T01:26:06.048 INFO:tasks.workunit.client.0.smithi012.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-05T01:26:06.048 INFO:tasks.workunit.client.0.smithi012.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-05T01:26:06.048 INFO:tasks.workunit.client.0.smithi012.stderr:state without impacting any branches by switching back to a branch. 2024-09-05T01:26:06.048 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-05T01:26:06.048 INFO:tasks.workunit.client.0.smithi012.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-05T01:26:06.049 INFO:tasks.workunit.client.0.smithi012.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-05T01:26:06.049 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-05T01:26:06.049 INFO:tasks.workunit.client.0.smithi012.stderr: git switch -c 2024-09-05T01:26:06.049 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-05T01:26:06.049 INFO:tasks.workunit.client.0.smithi012.stderr:Or undo this operation with: 2024-09-05T01:26:06.049 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-05T01:26:06.049 INFO:tasks.workunit.client.0.smithi012.stderr: git switch - 2024-09-05T01:26:06.049 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-05T01:26:06.049 INFO:tasks.workunit.client.0.smithi012.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-05T01:26:06.049 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-05T01:26:06.049 INFO:tasks.workunit.client.0.smithi012.stderr:HEAD is now at 91c8a7e56f7 Merge pull request #59582 from zdover23/wip-doc-2024-09-04-backport-59546-to-squid 2024-09-05T01:26:06.063 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-05T01:26:06.148 INFO:tasks.workunit.client.0.smithi012.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-05T01:26:06.153 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-05T01:26:06.153 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-05T01:26:06.834 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-05T01:26:06.939 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-05T01:26:07.006 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-05T01:26:07.010 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-05T01:26:07.010 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-05T01:26:07.076 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-05T01:26:07.083 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-05T01:26:07.083 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-05T01:26:07.119 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2024-09-05T01:26:07.120 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2024-09-05T01:26:07.120 DEBUG:teuthology.orchestra.run.smithi012:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2024-09-05T01:26:07.207 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'getting blogbench' 2024-09-05T01:26:07.208 INFO:tasks.workunit.client.0.smithi012.stdout:getting blogbench 2024-09-05T01:26:07.208 INFO:tasks.workunit.client.0.smithi012.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-05T01:26:07.255 INFO:tasks.workunit.client.0.smithi012.stderr:--2024-09-05 01:26:07-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-05T01:26:07.265 INFO:tasks.workunit.client.0.smithi012.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-05T01:26:07.286 INFO:tasks.workunit.client.0.smithi012.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-05T01:26:07.320 INFO:tasks.workunit.client.0.smithi012.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-05T01:26:07.320 INFO:tasks.workunit.client.0.smithi012.stderr:Length: 103355 (101K) [application/octet-stream] 2024-09-05T01:26:07.322 INFO:tasks.workunit.client.0.smithi012.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2024-09-05T01:26:07.326 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-05T01:26:07.361 INFO:tasks.workunit.client.0.smithi012.stderr: 0K .......... .......... .......... .......... .......... 49% 1.26M 0s 2024-09-05T01:26:07.381 INFO:tasks.workunit.client.0.smithi012.stderr: 50K .......... .......... .......... .......... .......... 99% 2.43M 0s 2024-09-05T01:26:07.381 INFO:tasks.workunit.client.0.smithi012.stderr: 100K 100% 1.74T=0.06s 2024-09-05T01:26:07.381 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-05T01:26:07.382 INFO:tasks.workunit.client.0.smithi012.stderr:2024-09-05 01:26:07 (1.68 MB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2024-09-05T01:26:07.382 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-09-05T01:26:07.382 INFO:tasks.workunit.client.0.smithi012.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2024-09-05T01:26:07.386 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:07 smithi145 ceph-mon[34376]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-05T01:26:07.416 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/ 2024-09-05T01:26:07.417 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/m4/ 2024-09-05T01:26:07.418 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/m4/acx_pthread.m4 2024-09-05T01:26:07.420 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/man/ 2024-09-05T01:26:07.422 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/man/blogbench.8 2024-09-05T01:26:07.423 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/man/Makefile.am 2024-09-05T01:26:07.425 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/man/Makefile.in 2024-09-05T01:26:07.427 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/src/ 2024-09-05T01:26:07.428 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/src/mysnprintf.c 2024-09-05T01:26:07.430 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/src/mysnprintf.h 2024-09-05T01:26:07.431 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/src/blogbench.c 2024-09-05T01:26:07.433 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/src/blogbench.h 2024-09-05T01:26:07.435 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/src/fakesnprintf.c 2024-09-05T01:26:07.436 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/src/fakesnprintf.h 2024-09-05T01:26:07.438 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/src/blogbench_p.h 2024-09-05T01:26:07.440 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/src/bsd-getopt_long.c 2024-09-05T01:26:07.441 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/src/bsd-getopt_long.h 2024-09-05T01:26:07.443 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/src/Makefile.am 2024-09-05T01:26:07.444 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/src/Makefile.in 2024-09-05T01:26:07.446 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/src/process.c 2024-09-05T01:26:07.447 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/src/globals.h 2024-09-05T01:26:07.449 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/src/commenter.c 2024-09-05T01:26:07.451 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/src/rewriter.c 2024-09-05T01:26:07.452 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/src/reader.c 2024-09-05T01:26:07.454 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/src/writer.c 2024-09-05T01:26:07.455 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/src/helpers.c 2024-09-05T01:26:07.457 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/NEWS 2024-09-05T01:26:07.459 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/compile 2024-09-05T01:26:07.461 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/depcomp 2024-09-05T01:26:07.462 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/aclocal.m4 2024-09-05T01:26:07.464 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/README 2024-09-05T01:26:07.465 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/configure 2024-09-05T01:26:07.470 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/configure.ac 2024-09-05T01:26:07.471 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/config.guess 2024-09-05T01:26:07.472 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/install-sh 2024-09-05T01:26:07.474 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/config.sub 2024-09-05T01:26:07.476 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/missing 2024-09-05T01:26:07.477 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/mkinstalldirs 2024-09-05T01:26:07.480 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/Makefile.am 2024-09-05T01:26:07.480 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/Makefile.in 2024-09-05T01:26:07.482 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/config.h.in 2024-09-05T01:26:07.483 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/AUTHORS 2024-09-05T01:26:07.485 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/INSTALL 2024-09-05T01:26:07.486 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/ChangeLog 2024-09-05T01:26:07.488 INFO:tasks.workunit.client.0.smithi012.stdout:blogbench-1.0/COPYING 2024-09-05T01:26:07.490 INFO:tasks.workunit.client.0.smithi012.stderr:+ cd blogbench-1.0/ 2024-09-05T01:26:07.490 INFO:tasks.workunit.client.0.smithi012.stdout:making blogbench 2024-09-05T01:26:07.490 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'making blogbench' 2024-09-05T01:26:07.490 INFO:tasks.workunit.client.0.smithi012.stderr:+ ./configure 2024-09-05T01:26:07.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:07 smithi012 ceph-mon[29942]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-05T01:26:07.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:07 smithi151 ceph-mon[35013]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-05T01:26:07.701 INFO:tasks.workunit.client.0.smithi012.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-05T01:26:08.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:08 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:26:08.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:08 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:26:08.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:08 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:26:08.714 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether build environment is sane... yes 2024-09-05T01:26:08.732 INFO:tasks.workunit.client.0.smithi012.stdout:checking for gawk... gawk 2024-09-05T01:26:08.755 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether make sets $(MAKE)... yes 2024-09-05T01:26:08.781 INFO:tasks.workunit.client.0.smithi012.stdout:checking for gcc... gcc 2024-09-05T01:26:08.870 INFO:tasks.workunit.client.0.smithi012.stdout:checking for C compiler default output file name... a.out 2024-09-05T01:26:08.874 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether the C compiler works... yes 2024-09-05T01:26:08.878 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether we are cross compiling... no 2024-09-05T01:26:08.938 INFO:tasks.workunit.client.0.smithi012.stdout:checking for suffix of executables... 2024-09-05T01:26:09.000 INFO:tasks.workunit.client.0.smithi012.stdout:checking for suffix of object files... o 2024-09-05T01:26:09.063 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether we are using the GNU C compiler... yes 2024-09-05T01:26:09.130 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether gcc accepts -g... yes 2024-09-05T01:26:09.251 INFO:tasks.workunit.client.0.smithi012.stdout:checking for gcc option to accept ANSI C... none needed 2024-09-05T01:26:09.323 INFO:tasks.workunit.client.0.smithi012.stdout:checking for style of include used by make... GNU 2024-09-05T01:26:09.455 INFO:tasks.workunit.client.0.smithi012.stdout:checking dependency style of gcc... gcc3 2024-09-05T01:26:09.455 INFO:tasks.workunit.client.0.smithi012.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-05T01:26:09.538 INFO:tasks.workunit.client.0.smithi012.stdout:checking how to run the C preprocessor... gcc -E 2024-09-05T01:26:09.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:09 smithi012 ceph-mon[29942]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-05T01:26:09.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:09 smithi145 ceph-mon[34376]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-05T01:26:09.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:09 smithi151 ceph-mon[35013]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-09-05T01:26:09.618 INFO:tasks.workunit.client.0.smithi012.stdout:checking for egrep... grep -E 2024-09-05T01:26:09.638 INFO:tasks.workunit.client.0.smithi012.stdout:checking for AIX... no 2024-09-05T01:26:09.742 INFO:tasks.workunit.client.0.smithi012.stdout:checking for library containing strerror... none required 2024-09-05T01:26:09.972 INFO:tasks.workunit.client.0.smithi012.stdout:checking for ANSI C header files... yes 2024-09-05T01:26:10.042 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-05T01:26:10.124 INFO:tasks.workunit.client.0.smithi012.stdout:checking for sys/types.h... yes 2024-09-05T01:26:10.214 INFO:tasks.workunit.client.0.smithi012.stdout:checking for sys/stat.h... yes 2024-09-05T01:26:10.300 INFO:tasks.workunit.client.0.smithi012.stdout:checking for stdlib.h... yes 2024-09-05T01:26:10.386 INFO:tasks.workunit.client.0.smithi012.stdout:checking for string.h... yes 2024-09-05T01:26:10.473 INFO:tasks.workunit.client.0.smithi012.stdout:checking for memory.h... yes 2024-09-05T01:26:10.564 INFO:tasks.workunit.client.0.smithi012.stdout:checking for strings.h... yes 2024-09-05T01:26:10.656 INFO:tasks.workunit.client.0.smithi012.stdout:checking for inttypes.h... yes 2024-09-05T01:26:10.755 INFO:tasks.workunit.client.0.smithi012.stdout:checking for stdint.h... yes 2024-09-05T01:26:10.851 INFO:tasks.workunit.client.0.smithi012.stdout:checking for unistd.h... yes 2024-09-05T01:26:10.872 INFO:tasks.workunit.client.0.smithi012.stdout:checking for memory.h... (cached) yes 2024-09-05T01:26:10.886 INFO:tasks.workunit.client.0.smithi012.stdout:checking for strings.h... (cached) yes 2024-09-05T01:26:10.900 INFO:tasks.workunit.client.0.smithi012.stdout:checking for unistd.h... (cached) yes 2024-09-05T01:26:10.983 INFO:tasks.workunit.client.0.smithi012.stdout:checking locale.h usability... yes 2024-09-05T01:26:11.019 INFO:tasks.workunit.client.0.smithi012.stdout:checking locale.h presence... yes 2024-09-05T01:26:11.021 INFO:tasks.workunit.client.0.smithi012.stdout:checking for locale.h... yes 2024-09-05T01:26:11.046 INFO:tasks.workunit.client.0.smithi012.stdout:checking for stdlib.h... (cached) yes 2024-09-05T01:26:11.061 INFO:tasks.workunit.client.0.smithi012.stdout:checking for string.h... (cached) yes 2024-09-05T01:26:11.148 INFO:tasks.workunit.client.0.smithi012.stdout:checking sys/socket.h usability... yes 2024-09-05T01:26:11.188 INFO:tasks.workunit.client.0.smithi012.stdout:checking sys/socket.h presence... yes 2024-09-05T01:26:11.190 INFO:tasks.workunit.client.0.smithi012.stdout:checking for sys/socket.h... yes 2024-09-05T01:26:11.282 INFO:tasks.workunit.client.0.smithi012.stdout:checking sys/time.h usability... yes 2024-09-05T01:26:11.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:11 smithi012 ceph-mon[29942]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 26 op/s 2024-09-05T01:26:11.318 INFO:tasks.workunit.client.0.smithi012.stdout:checking sys/time.h presence... yes 2024-09-05T01:26:11.320 INFO:tasks.workunit.client.0.smithi012.stdout:checking for sys/time.h... yes 2024-09-05T01:26:11.410 INFO:tasks.workunit.client.0.smithi012.stdout:checking fcntl.h usability... yes 2024-09-05T01:26:11.446 INFO:tasks.workunit.client.0.smithi012.stdout:checking fcntl.h presence... yes 2024-09-05T01:26:11.448 INFO:tasks.workunit.client.0.smithi012.stdout:checking for fcntl.h... yes 2024-09-05T01:26:11.539 INFO:tasks.workunit.client.0.smithi012.stdout:checking sys/fcntl.h usability... yes 2024-09-05T01:26:11.576 INFO:tasks.workunit.client.0.smithi012.stdout:checking sys/fcntl.h presence... yes 2024-09-05T01:26:11.578 INFO:tasks.workunit.client.0.smithi012.stdout:checking for sys/fcntl.h... yes 2024-09-05T01:26:11.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:11 smithi145 ceph-mon[34376]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 26 op/s 2024-09-05T01:26:11.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:11 smithi151 ceph-mon[35013]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 26 op/s 2024-09-05T01:26:11.769 INFO:tasks.workunit.client.0.smithi012.stdout:checking sys/param.h usability... yes 2024-09-05T01:26:11.811 INFO:tasks.workunit.client.0.smithi012.stdout:checking sys/param.h presence... yes 2024-09-05T01:26:11.813 INFO:tasks.workunit.client.0.smithi012.stdout:checking for sys/param.h... yes 2024-09-05T01:26:11.889 INFO:tasks.workunit.client.0.smithi012.stdout:checking ioctl.h usability... no 2024-09-05T01:26:11.931 INFO:tasks.workunit.client.0.smithi012.stdout:checking ioctl.h presence... no 2024-09-05T01:26:11.934 INFO:tasks.workunit.client.0.smithi012.stdout:checking for ioctl.h... no 2024-09-05T01:26:12.013 INFO:tasks.workunit.client.0.smithi012.stdout:checking sys/ioctl.h usability... yes 2024-09-05T01:26:12.050 INFO:tasks.workunit.client.0.smithi012.stdout:checking sys/ioctl.h presence... yes 2024-09-05T01:26:12.052 INFO:tasks.workunit.client.0.smithi012.stdout:checking for sys/ioctl.h... yes 2024-09-05T01:26:12.140 INFO:tasks.workunit.client.0.smithi012.stdout:checking return type of signal handlers... void 2024-09-05T01:26:12.223 INFO:tasks.workunit.client.0.smithi012.stdout:checking for size_t... yes 2024-09-05T01:26:12.296 INFO:tasks.workunit.client.0.smithi012.stdout:checking for dev_t... yes 2024-09-05T01:26:12.376 INFO:tasks.workunit.client.0.smithi012.stdout:checking for short... yes 2024-09-05T01:26:12.478 INFO:tasks.workunit.client.0.smithi012.stdout:checking size of short... 2 2024-09-05T01:26:12.557 INFO:tasks.workunit.client.0.smithi012.stdout:checking for int... yes 2024-09-05T01:26:12.664 INFO:tasks.workunit.client.0.smithi012.stdout:checking size of int... 4 2024-09-05T01:26:12.795 INFO:tasks.workunit.client.0.smithi012.stdout:checking for long... yes 2024-09-05T01:26:12.909 INFO:tasks.workunit.client.0.smithi012.stdout:checking size of long... 8 2024-09-05T01:26:12.988 INFO:tasks.workunit.client.0.smithi012.stdout:checking for long long... yes 2024-09-05T01:26:13.096 INFO:tasks.workunit.client.0.smithi012.stdout:checking size of long long... 8 2024-09-05T01:26:13.191 INFO:tasks.workunit.client.0.smithi012.stdout:checking for ssize_t... yes 2024-09-05T01:26:13.264 INFO:tasks.workunit.client.0.smithi012.stdout:checking for sig_atomic_t... yes 2024-09-05T01:26:13.351 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether gcc needs -traditional... no 2024-09-05T01:26:13.413 INFO:tasks.workunit.client.0.smithi012.stdout:checking for an ANSI C-conforming const... yes 2024-09-05T01:26:13.462 INFO:tasks.workunit.client.0.smithi012.stdout:checking for inline... inline 2024-09-05T01:26:13.556 INFO:tasks.workunit.client.0.smithi012.stdout:checking for working alloca.h... yes 2024-09-05T01:26:13.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:13 smithi012 ceph-mon[29942]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-05T01:26:13.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:13 smithi145 ceph-mon[34376]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-05T01:26:13.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:13 smithi151 ceph-mon[35013]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-05T01:26:13.639 INFO:tasks.workunit.client.0.smithi012.stdout:checking for alloca... yes 2024-09-05T01:26:13.742 INFO:tasks.workunit.client.0.smithi012.stdout:checking for working memcmp... yes 2024-09-05T01:26:13.837 INFO:tasks.workunit.client.0.smithi012.stdout:checking for strftime... yes 2024-09-05T01:26:13.951 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2024-09-05T01:26:14.048 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether stat accepts an empty string... no 2024-09-05T01:26:14.149 INFO:tasks.workunit.client.0.smithi012.stdout:checking for vprintf... yes 2024-09-05T01:26:14.243 INFO:tasks.workunit.client.0.smithi012.stdout:checking for _doprnt... no 2024-09-05T01:26:14.293 INFO:tasks.workunit.client.0.smithi012.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-05T01:26:14.322 INFO:tasks.workunit.client.0.smithi012.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-05T01:26:14.412 INFO:tasks.workunit.client.0.smithi012.stdout:checking for the pthreads library -lpthreads... no 2024-09-05T01:26:14.503 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether pthreads work without any flags... yes 2024-09-05T01:26:14.587 INFO:tasks.workunit.client.0.smithi012.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2024-09-05T01:26:14.587 INFO:tasks.workunit.client.0.smithi012.stdout:checking if more special flags are required for pthreads... no 2024-09-05T01:26:14.587 INFO:tasks.workunit.client.0.smithi012.stdout:checking for cc_r... gcc 2024-09-05T01:26:14.709 INFO:tasks.workunit.client.0.smithi012.stdout:checking for setrlimit... yes 2024-09-05T01:26:14.812 INFO:tasks.workunit.client.0.smithi012.stdout:checking for setproctitle... no 2024-09-05T01:26:14.915 INFO:tasks.workunit.client.0.smithi012.stdout:checking for getopt_long... yes 2024-09-05T01:26:15.026 INFO:tasks.workunit.client.0.smithi012.stdout:checking for strtoull... yes 2024-09-05T01:26:15.135 INFO:tasks.workunit.client.0.smithi012.stdout:checking for strtoq... yes 2024-09-05T01:26:15.241 INFO:tasks.workunit.client.0.smithi012.stdout:checking for snprintf... yes 2024-09-05T01:26:15.347 INFO:tasks.workunit.client.0.smithi012.stdout:checking for vsnprintf... yes 2024-09-05T01:26:15.454 INFO:tasks.workunit.client.0.smithi012.stdout:checking for vfprintf... yes 2024-09-05T01:26:15.559 INFO:tasks.workunit.client.0.smithi012.stdout:checking for gethostname... yes 2024-09-05T01:26:15.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:15 smithi012 ceph-mon[29942]: pgmap v49: 97 pgs: 97 active+clean; 2.8 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 149 KiB/s wr, 33 op/s 2024-09-05T01:26:15.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:15 smithi012 ceph-mon[29942]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-09-05T01:26:15.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:15 smithi145 ceph-mon[34376]: pgmap v49: 97 pgs: 97 active+clean; 2.8 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 149 KiB/s wr, 33 op/s 2024-09-05T01:26:15.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:15 smithi145 ceph-mon[34376]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-09-05T01:26:15.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:15 smithi151 ceph-mon[35013]: pgmap v49: 97 pgs: 97 active+clean; 2.8 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 149 KiB/s wr, 33 op/s 2024-09-05T01:26:15.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:15 smithi151 ceph-mon[35013]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-09-05T01:26:15.665 INFO:tasks.workunit.client.0.smithi012.stdout:checking for setlocale... yes 2024-09-05T01:26:15.771 INFO:tasks.workunit.client.0.smithi012.stdout:checking for sync... yes 2024-09-05T01:26:15.877 INFO:tasks.workunit.client.0.smithi012.stdout:checking whether snprintf is C99 conformant... done 2024-09-05T01:26:15.899 INFO:tasks.workunit.client.0.smithi012.stdout:configure: creating ./config.status 2024-09-05T01:26:16.193 INFO:tasks.workunit.client.0.smithi012.stdout:config.status: creating Makefile 2024-09-05T01:26:16.231 INFO:tasks.workunit.client.0.smithi012.stdout:config.status: creating src/Makefile 2024-09-05T01:26:16.273 INFO:tasks.workunit.client.0.smithi012.stdout:config.status: creating man/Makefile 2024-09-05T01:26:16.294 INFO:tasks.workunit.client.0.smithi012.stdout:config.status: creating config.h 2024-09-05T01:26:16.378 INFO:tasks.workunit.client.0.smithi012.stdout:config.status: executing depfiles commands 2024-09-05T01:26:16.650 INFO:tasks.workunit.client.0.smithi012.stderr:+ make 2024-09-05T01:26:16.662 INFO:tasks.workunit.client.0.smithi012.stdout:make all-recursive 2024-09-05T01:26:16.665 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-05T01:26:16.671 INFO:tasks.workunit.client.0.smithi012.stdout:Making all in src 2024-09-05T01:26:16.680 INFO:tasks.workunit.client.0.smithi012.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-05T01:26:16.680 INFO:tasks.workunit.client.0.smithi012.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2024-09-05T01:26:16.680 INFO:tasks.workunit.client.0.smithi012.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2024-09-05T01:26:16.789 INFO:tasks.workunit.client.0.smithi012.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2024-09-05T01:26:16.789 INFO:tasks.workunit.client.0.smithi012.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2024-09-05T01:26:16.885 INFO:tasks.workunit.client.0.smithi012.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2024-09-05T01:26:16.885 INFO:tasks.workunit.client.0.smithi012.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2024-09-05T01:26:16.966 INFO:tasks.workunit.client.0.smithi012.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2024-09-05T01:26:16.966 INFO:tasks.workunit.client.0.smithi012.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2024-09-05T01:26:17.044 INFO:tasks.workunit.client.0.smithi012.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2024-09-05T01:26:17.044 INFO:tasks.workunit.client.0.smithi012.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2024-09-05T01:26:17.121 INFO:tasks.workunit.client.0.smithi012.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2024-09-05T01:26:17.122 INFO:tasks.workunit.client.0.smithi012.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2024-09-05T01:26:17.196 INFO:tasks.workunit.client.0.smithi012.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2024-09-05T01:26:17.196 INFO:tasks.workunit.client.0.smithi012.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2024-09-05T01:26:17.300 INFO:tasks.workunit.client.0.smithi012.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2024-09-05T01:26:17.300 INFO:tasks.workunit.client.0.smithi012.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2024-09-05T01:26:17.358 INFO:tasks.workunit.client.0.smithi012.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2024-09-05T01:26:17.358 INFO:tasks.workunit.client.0.smithi012.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2024-09-05T01:26:17.419 INFO:tasks.workunit.client.0.smithi012.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2024-09-05T01:26:17.419 INFO:tasks.workunit.client.0.smithi012.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2024-09-05T01:26:17.478 INFO:tasks.workunit.client.0.smithi012.stdout:gcc -g -O2 -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2024-09-05T01:26:17.507 INFO:tasks.workunit.client.0.smithi012.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-05T01:26:17.508 INFO:tasks.workunit.client.0.smithi012.stdout:Making all in man 2024-09-05T01:26:17.518 INFO:tasks.workunit.client.0.smithi012.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-05T01:26:17.519 INFO:tasks.workunit.client.0.smithi012.stdout:make[2]: Nothing to be done for 'all'. 2024-09-05T01:26:17.519 INFO:tasks.workunit.client.0.smithi012.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-05T01:26:17.522 INFO:tasks.workunit.client.0.smithi012.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-05T01:26:17.524 INFO:tasks.workunit.client.0.smithi012.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-05T01:26:17.524 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-05T01:26:17.525 INFO:tasks.workunit.client.0.smithi012.stderr:+ cd src 2024-09-05T01:26:17.525 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir blogtest_in 2024-09-05T01:26:17.529 INFO:tasks.workunit.client.0.smithi012.stdout:running blogbench 2024-09-05T01:26:17.529 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'running blogbench' 2024-09-05T01:26:17.529 INFO:tasks.workunit.client.0.smithi012.stderr:+ ./blogbench -d blogtest_in 2024-09-05T01:26:17.530 INFO:tasks.workunit.client.0.smithi012.stdout: 2024-09-05T01:26:17.530 INFO:tasks.workunit.client.0.smithi012.stdout:Frequency = 10 secs 2024-09-05T01:26:17.530 INFO:tasks.workunit.client.0.smithi012.stdout:Scratch dir = [blogtest_in] 2024-09-05T01:26:17.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:17 smithi012 ceph-mon[29942]: pgmap v50: 97 pgs: 97 active+clean; 2.8 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 127 KiB/s wr, 14 op/s 2024-09-05T01:26:17.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:17 smithi145 ceph-mon[34376]: pgmap v50: 97 pgs: 97 active+clean; 2.8 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 127 KiB/s wr, 14 op/s 2024-09-05T01:26:17.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:17 smithi151 ceph-mon[35013]: pgmap v50: 97 pgs: 97 active+clean; 2.8 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 127 KiB/s wr, 14 op/s 2024-09-05T01:26:19.113 INFO:tasks.workunit.client.0.smithi012.stdout:Spawning 3 writers... 2024-09-05T01:26:19.114 INFO:tasks.workunit.client.0.smithi012.stdout:Spawning 1 rewriters... 2024-09-05T01:26:19.114 INFO:tasks.workunit.client.0.smithi012.stdout:Spawning 5 commenters... 2024-09-05T01:26:19.114 INFO:tasks.workunit.client.0.smithi012.stdout:Spawning 100 readers... 2024-09-05T01:26:19.120 INFO:tasks.workunit.client.0.smithi012.stdout:Benchmarking for 30 iterations. 2024-09-05T01:26:19.121 INFO:tasks.workunit.client.0.smithi012.stdout:The test will run during 5 minutes. 2024-09-05T01:26:19.121 INFO:tasks.workunit.client.0.smithi012.stdout: 2024-09-05T01:26:19.121 INFO:tasks.workunit.client.0.smithi012.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2024-09-05T01:26:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:19 smithi012 ceph-mon[29942]: pgmap v51: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 231 KiB/s wr, 35 op/s 2024-09-05T01:26:19.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:19 smithi145 ceph-mon[34376]: pgmap v51: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 231 KiB/s wr, 35 op/s 2024-09-05T01:26:19.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:19 smithi151 ceph-mon[35013]: pgmap v51: 97 pgs: 97 active+clean; 3.8 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 231 KiB/s wr, 35 op/s 2024-09-05T01:26:21.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:21 smithi012 ceph-mon[29942]: pgmap v52: 97 pgs: 97 active+clean; 6.0 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 444 KiB/s wr, 57 op/s 2024-09-05T01:26:21.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:21 smithi145 ceph-mon[34376]: pgmap v52: 97 pgs: 97 active+clean; 6.0 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 444 KiB/s wr, 57 op/s 2024-09-05T01:26:21.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:21 smithi151 ceph-mon[35013]: pgmap v52: 97 pgs: 97 active+clean; 6.0 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 444 KiB/s wr, 57 op/s 2024-09-05T01:26:23.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:23 smithi012 ceph-mon[29942]: pgmap v53: 97 pgs: 97 active+clean; 6.0 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 443 KiB/s wr, 54 op/s 2024-09-05T01:26:23.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:23 smithi145 ceph-mon[34376]: pgmap v53: 97 pgs: 97 active+clean; 6.0 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 443 KiB/s wr, 54 op/s 2024-09-05T01:26:23.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:23 smithi151 ceph-mon[35013]: pgmap v53: 97 pgs: 97 active+clean; 6.0 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 443 KiB/s wr, 54 op/s 2024-09-05T01:26:25.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:25 smithi012 ceph-mon[29942]: pgmap v54: 97 pgs: 97 active+clean; 12 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 999 KiB/s wr, 74 op/s 2024-09-05T01:26:25.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:25 smithi145 ceph-mon[34376]: pgmap v54: 97 pgs: 97 active+clean; 12 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 999 KiB/s wr, 74 op/s 2024-09-05T01:26:25.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:25 smithi151 ceph-mon[35013]: pgmap v54: 97 pgs: 97 active+clean; 12 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 999 KiB/s wr, 74 op/s 2024-09-05T01:26:27.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:27 smithi012 ceph-mon[29942]: pgmap v55: 97 pgs: 97 active+clean; 12 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 873 KiB/s wr, 64 op/s 2024-09-05T01:26:27.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:27 smithi145 ceph-mon[34376]: pgmap v55: 97 pgs: 97 active+clean; 12 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 873 KiB/s wr, 64 op/s 2024-09-05T01:26:27.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:27 smithi151 ceph-mon[35013]: pgmap v55: 97 pgs: 97 active+clean; 12 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 873 KiB/s wr, 64 op/s 2024-09-05T01:26:29.122 INFO:tasks.workunit.client.0.smithi012.stdout: 12 218293 835 129826 824 33987 859 2024-09-05T01:26:29.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:29 smithi012 ceph-mon[29942]: pgmap v56: 97 pgs: 97 active+clean; 25 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 111 op/s 2024-09-05T01:26:29.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:29 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:26:29.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:29 smithi145 ceph-mon[34376]: pgmap v56: 97 pgs: 97 active+clean; 25 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 111 op/s 2024-09-05T01:26:29.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:29 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:26:29.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:29 smithi151 ceph-mon[35013]: pgmap v56: 97 pgs: 97 active+clean; 25 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 111 op/s 2024-09-05T01:26:29.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:29 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:26:31.338 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:31 smithi012 ceph-mon[29942]: pgmap v57: 97 pgs: 97 active+clean; 31 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 127 op/s 2024-09-05T01:26:31.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:31 smithi145 ceph-mon[34376]: pgmap v57: 97 pgs: 97 active+clean; 31 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 127 op/s 2024-09-05T01:26:31.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:31 smithi151 ceph-mon[35013]: pgmap v57: 97 pgs: 97 active+clean; 31 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 127 op/s 2024-09-05T01:26:33.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:33 smithi012 ceph-mon[29942]: pgmap v58: 97 pgs: 97 active+clean; 31 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 2.3 MiB/s wr, 103 op/s 2024-09-05T01:26:33.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:33 smithi145 ceph-mon[34376]: pgmap v58: 97 pgs: 97 active+clean; 31 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 2.3 MiB/s wr, 103 op/s 2024-09-05T01:26:33.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:33 smithi151 ceph-mon[35013]: pgmap v58: 97 pgs: 97 active+clean; 31 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 2.3 MiB/s wr, 103 op/s 2024-09-05T01:26:34.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:34 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:26:34.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:34 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:26:34.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:34 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:26:35.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:35 smithi012 ceph-mon[29942]: pgmap v59: 97 pgs: 97 active+clean; 52 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 210 op/s 2024-09-05T01:26:35.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:35 smithi145 ceph-mon[34376]: pgmap v59: 97 pgs: 97 active+clean; 52 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 210 op/s 2024-09-05T01:26:35.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:35 smithi151 ceph-mon[35013]: pgmap v59: 97 pgs: 97 active+clean; 52 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 210 op/s 2024-09-05T01:26:36.029 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T01:26:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:26:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.276+0000 7f8e33800640 1 -- 172.21.15.12:0/639758585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e240aa830 msgr2=0x7f8e240aac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.277+0000 7f8e33800640 1 --2- 172.21.15.12:0/639758585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e240aa830 0x7f8e240aac10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c02dd50 tx=0x7f8e2c08e660 comp rx=0 tx=0).stop 2024-09-05T01:26:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.278+0000 7f8e33800640 1 -- 172.21.15.12:0/639758585 shutdown_connections 2024-09-05T01:26:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.278+0000 7f8e33800640 1 --2- 172.21.15.12:0/639758585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e240a5160 0x7f8e240b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.278+0000 7f8e33800640 1 --2- 172.21.15.12:0/639758585 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e240a47e0 0x7f8e240a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.278+0000 7f8e33800640 1 --2- 172.21.15.12:0/639758585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e240aa830 0x7f8e240aac10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.278+0000 7f8e33800640 1 -- 172.21.15.12:0/639758585 >> 172.21.15.12:0/639758585 conn(0x7f8e2401a4f0 msgr2=0x7f8e2401a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:37.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.279+0000 7f8e33800640 1 -- 172.21.15.12:0/639758585 shutdown_connections 2024-09-05T01:26:37.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.279+0000 7f8e33800640 1 -- 172.21.15.12:0/639758585 wait complete. 2024-09-05T01:26:37.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.281+0000 7f8e33800640 1 Processor -- start 2024-09-05T01:26:37.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.281+0000 7f8e33800640 1 -- start start 2024-09-05T01:26:37.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.281+0000 7f8e33800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e240a47e0 0x7f8e24143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:37.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.281+0000 7f8e33800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e240a5160 0x7f8e24143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:37.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.282+0000 7f8e33800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e240aa830 0x7f8e24147cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:37.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.282+0000 7f8e33800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8e240bcec0 con 0x7f8e240a5160 2024-09-05T01:26:37.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.282+0000 7f8e33800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8e240bcd40 con 0x7f8e240aa830 2024-09-05T01:26:37.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.282+0000 7f8e33800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8e240bd040 con 0x7f8e240a47e0 2024-09-05T01:26:37.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.282+0000 7f8e30e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e240a47e0 0x7f8e24143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:37.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.282+0000 7f8e30e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e240a47e0 0x7f8e24143400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:53978/0 (socket says 172.21.15.12:53978) 2024-09-05T01:26:37.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.282+0000 7f8e30e00640 1 -- 172.21.15.12:0/2555312988 learned_addr learned my addr 172.21.15.12:0/2555312988 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:37.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.282+0000 7f8e30e00640 1 -- 172.21.15.12:0/2555312988 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e240aa830 msgr2=0x7f8e24147cd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T01:26:37.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.282+0000 7f8e30e00640 1 --2- 172.21.15.12:0/2555312988 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e240aa830 0x7f8e24147cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.282+0000 7f8e30e00640 1 -- 172.21.15.12:0/2555312988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e240a5160 msgr2=0x7f8e24143940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T01:26:37.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.283+0000 7f8e30e00640 1 --2- 172.21.15.12:0/2555312988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e240a5160 0x7f8e24143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.283+0000 7f8e30e00640 1 -- 172.21.15.12:0/2555312988 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e241483b0 con 0x7f8e240a47e0 2024-09-05T01:26:37.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.284+0000 7f8e30e00640 1 --2- 172.21.15.12:0/2555312988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e240a47e0 0x7f8e24143400 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c067c70 tx=0x7f8e2c06e7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:37.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.285+0000 7f8e29600640 1 -- 172.21.15.12:0/2555312988 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c06d4a0 con 0x7f8e240a47e0 2024-09-05T01:26:37.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.285+0000 7f8e29600640 1 -- 172.21.15.12:0/2555312988 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e2c06db20 con 0x7f8e240a47e0 2024-09-05T01:26:37.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.285+0000 7f8e29600640 1 -- 172.21.15.12:0/2555312988 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c095ae0 con 0x7f8e240a47e0 2024-09-05T01:26:37.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.286+0000 7f8e33800640 1 -- 172.21.15.12:0/2555312988 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e24148640 con 0x7f8e240a47e0 2024-09-05T01:26:37.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.286+0000 7f8e33800640 1 -- 172.21.15.12:0/2555312988 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e24148b00 con 0x7f8e240a47e0 2024-09-05T01:26:37.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.291+0000 7f8e3628b740 1 Processor -- start 2024-09-05T01:26:37.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.291+0000 7f8e3628b740 1 -- start start 2024-09-05T01:26:37.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.292+0000 7f8e3628b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd53d50 0x555c3bd54130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:37.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.293+0000 7f8e31800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd53d50 0x555c3bd54130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:37.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.294+0000 7f8e3628b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd54670 0x555c3bd5e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:37.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.294+0000 7f8e3628b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c3bd5ef30 0x555c3bd61320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:37.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.294+0000 7f8e3628b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555c3bcba3e0 con 0x555c3bd53d50 2024-09-05T01:26:37.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.294+0000 7f8e3628b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555c3bc61d80 con 0x555c3bd54670 2024-09-05T01:26:37.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.294+0000 7f8e3628b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555c3bcb63a0 con 0x555c3bd5ef30 2024-09-05T01:26:37.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.294+0000 7f8e29600640 1 -- 172.21.15.12:0/2555312988 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f8e2c06d640 con 0x7f8e240a47e0 2024-09-05T01:26:37.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.295+0000 7f8e31800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd53d50 0x555c3bd54130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38470/0 (socket says 172.21.15.12:38470) 2024-09-05T01:26:37.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.296+0000 7f8e2be00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c3bd5ef30 0x555c3bd61320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:37.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.296+0000 7f8e31800640 1 -- 172.21.15.12:0/3113749597 learned_addr learned my addr 172.21.15.12:0/3113749597 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:37.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.296+0000 7f8e29600640 1 --2- 172.21.15.12:0/2555312988 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8e140a2d80 0x7f8e140a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:37.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.297+0000 7f8e29600640 1 -- 172.21.15.12:0/2555312988 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f8e2c050ea0 con 0x7f8e240a47e0 2024-09-05T01:26:37.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.297+0000 7f8e30e00640 1 --2- 172.21.15.12:0/3113749597 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd54670 0x555c3bd5e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:37.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.297+0000 7f8e30e00640 1 -- 172.21.15.12:0/3113749597 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c3bd5ef30 msgr2=0x555c3bd61320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:37.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.297+0000 7f8e30e00640 1 --2- 172.21.15.12:0/3113749597 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c3bd5ef30 0x555c3bd61320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.297+0000 7f8e30e00640 1 -- 172.21.15.12:0/3113749597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd53d50 msgr2=0x555c3bd54130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:37.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.298+0000 7f8e30e00640 1 --2- 172.21.15.12:0/3113749597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd53d50 0x555c3bd54130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.298+0000 7f8e30e00640 1 -- 172.21.15.12:0/3113749597 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c3bc80ae0 con 0x555c3bd54670 2024-09-05T01:26:37.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.298+0000 7f8e30e00640 1 --2- 172.21.15.12:0/3113749597 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd54670 0x555c3bd5e9f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c14fec0 tx=0x7f8e2c124160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e184963189327845 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:37.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.298+0000 7f8e31800640 1 --2- 172.21.15.12:0/3113749597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd53d50 0x555c3bd54130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:26:37.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.298+0000 7f8e1a000640 1 -- 172.21.15.12:0/3113749597 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c11b630 con 0x555c3bd54670 2024-09-05T01:26:37.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.299+0000 7f8e1a000640 1 -- 172.21.15.12:0/3113749597 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e2c0a3e70 con 0x555c3bd54670 2024-09-05T01:26:37.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.299+0000 7f8e1a000640 1 -- 172.21.15.12:0/3113749597 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c11b7d0 con 0x555c3bd54670 2024-09-05T01:26:37.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.299+0000 7f8e31800640 1 --2- 172.21.15.12:0/2555312988 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8e140a2d80 0x7f8e140a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:37.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.300+0000 7f8e3628b740 1 -- 172.21.15.12:0/3113749597 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd54670 msgr2=0x555c3bd5e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:37.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.300+0000 7f8e3628b740 1 --2- 172.21.15.12:0/3113749597 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd54670 0x555c3bd5e9f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c14fec0 tx=0x7f8e2c124160 comp rx=0 tx=0).stop 2024-09-05T01:26:37.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.301+0000 7f8e3628b740 1 -- 172.21.15.12:0/3113749597 shutdown_connections 2024-09-05T01:26:37.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.301+0000 7f8e3628b740 1 --2- 172.21.15.12:0/3113749597 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c3bd5ef30 0x555c3bd61320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.301+0000 7f8e3628b740 1 --2- 172.21.15.12:0/3113749597 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd54670 0x555c3bd5e9f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.301+0000 7f8e3628b740 1 --2- 172.21.15.12:0/3113749597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd53d50 0x555c3bd54130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.301+0000 7f8e3628b740 1 -- 172.21.15.12:0/3113749597 >> 172.21.15.12:0/3113749597 conn(0x555c3bd502e0 msgr2=0x555c3bd506c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:37.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.303+0000 7f8e31800640 1 --2- 172.21.15.12:0/2555312988 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8e140a2d80 0x7f8e140a5240 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e20005bc0 tx=0x7f8e200046c0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:37.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.306+0000 7f8e3628b740 1 -- 172.21.15.12:0/3113749597 shutdown_connections 2024-09-05T01:26:37.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.306+0000 7f8e3628b740 1 -- 172.21.15.12:0/3113749597 wait complete. 2024-09-05T01:26:37.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.307+0000 7f8e3628b740 1 -- start start 2024-09-05T01:26:37.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.307+0000 7f8e3628b740 1 Processor -- start 2024-09-05T01:26:37.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.309+0000 7f8e3628b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd53d50 0x555c3bd5bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:37.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.310+0000 7f8e3628b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c3bd54670 0x555c3bd5c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:37.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.310+0000 7f8e3628b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd5ef30 0x555c3bd5c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:37.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.312+0000 7f8e31800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd5ef30 0x555c3bd5c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:37.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.312+0000 7f8e31800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd5ef30 0x555c3bd5c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38474/0 (socket says 172.21.15.12:38474) 2024-09-05T01:26:37.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.312+0000 7f8e31800640 1 -- 172.21.15.12:0/3121192631 learned_addr learned my addr 172.21.15.12:0/3121192631 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.313+0000 7f8e3628b740 1 -- 172.21.15.12:0/3121192631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555c3bc61d80 con 0x555c3bd5ef30 2024-09-05T01:26:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.313+0000 7f8e3628b740 1 -- 172.21.15.12:0/3121192631 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555c3bc750f0 con 0x555c3bd53d50 2024-09-05T01:26:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.313+0000 7f8e3628b740 1 -- 172.21.15.12:0/3121192631 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555c3bd618c0 con 0x555c3bd54670 2024-09-05T01:26:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.314+0000 7f8e31800640 1 -- 172.21.15.12:0/3121192631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c3bd54670 msgr2=0x555c3bd5c320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:26:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.314+0000 7f8e31800640 1 --2- 172.21.15.12:0/3121192631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c3bd54670 0x555c3bd5c320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.314+0000 7f8e31800640 1 -- 172.21.15.12:0/3121192631 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd53d50 msgr2=0x555c3bd5bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:37.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.310+0000 7f8e30e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd53d50 0x555c3bd5bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:37.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.315+0000 7f8e3628b740 10 client.0 _ll_register_callbacks cb 0x555c3bc669e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:26:37.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.315+0000 7f8e31800640 1 --2- 172.21.15.12:0/3121192631 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd53d50 0x555c3bd5bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.315+0000 7f8e31800640 1 -- 172.21.15.12:0/3121192631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c3ba2b3c0 con 0x555c3bd5ef30 2024-09-05T01:26:37.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.316+0000 7f8e30e00640 1 --2- 172.21.15.12:0/3121192631 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd53d50 0x555c3bd5bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:26:37.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.317+0000 7f8e3628b740 1 -- 172.21.15.12:0/3121192631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e2c0a3e70 con 0x555c3bd5ef30 2024-09-05T01:26:37.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.318+0000 7f8e31800640 1 --2- 172.21.15.12:0/3121192631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd5ef30 0x555c3bd5c860 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000c640 tx=0x7f8e20004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bdb15a74969678e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:37.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.319+0000 7f8e0ea00640 10 client.15582 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:26:37.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.319+0000 7f8e0ea00640 1 -- 172.21.15.12:0/3121192631 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e20024070 con 0x555c3bd5ef30 2024-09-05T01:26:37.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.320+0000 7f8e0ea00640 1 -- 172.21.15.12:0/3121192631 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f8e200209a0 con 0x555c3bd5ef30 2024-09-05T01:26:37.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.324+0000 7f8e0ea00640 1 -- 172.21.15.12:0/3121192631 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8e20030050 con 0x555c3bd5ef30 2024-09-05T01:26:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.324+0000 7f8e3628b740 10 client.15582 fetch_fsmap learned FSMap version 30 2024-09-05T01:26:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.324+0000 7f8e3628b740 1 -- 172.21.15.12:0/3121192631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({fsmap=30}) -- 0x555c3bd6d360 con 0x555c3bd5ef30 2024-09-05T01:26:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.326+0000 7f8e0ea00640 1 -- 172.21.15.12:0/3121192631 <== mon.0 v2:172.21.15.12:3300/0 4 ==== fsmap(e 30) ==== 8374+0+0 (secure 0 0 0) 0x7f8e2001c070 con 0x555c3bd5ef30 2024-09-05T01:26:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.326+0000 7f8e3628b740 10 client.15582 fetch_fsmap finished waiting for FSMap version 30 2024-09-05T01:26:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.326+0000 7f8e3628b740 10 client.15582 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:26:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.326+0000 7f8e3628b740 20 client.15582 populate_metadata read hostname 'smithi012' 2024-09-05T01:26:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.326+0000 7f8e3628b740 1 --2- 172.21.15.12:0/3121192631 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x555c3bd6e700 0x555c3bd70b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.326+0000 7f8e3628b740 4 client.15582 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:26:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.326+0000 7f8e3628b740 1 -- 172.21.15.12:0/3121192631 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c3bcc7950 con 0x555c3bd6e700 2024-09-05T01:26:37.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.327+0000 7f8e30e00640 1 --2- 172.21.15.12:0/3121192631 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x555c3bd6e700 0x555c3bd70b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:37.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.327+0000 7f8e30e00640 1 --2- 172.21.15.12:0/3121192631 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x555c3bd6e700 0x555c3bd70b50 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2162a0cd1ecc07cd server_cookie=bb2951e83ede73e1 in_seq=0 out_seq=0 2024-09-05T01:26:37.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.327+0000 7f8e0ea00640 10 client.15582 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:26:37.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.329+0000 7f8e0ea00640 1 -- 172.21.15.12:0/3121192631 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555c3bcc7950 con 0x555c3bd6e700 2024-09-05T01:26:37.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.329+0000 7f8e0ea00640 10 client.15582 handle_command_reply: tid=0 2024-09-05T01:26:37.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.329+0000 7f8e3628b740 1 client.15582 shutdown 2024-09-05T01:26:37.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.330+0000 7f8e3628b740 1 -- 172.21.15.12:0/3121192631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd5ef30 msgr2=0x555c3bd5c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:37.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.330+0000 7f8e3628b740 1 --2- 172.21.15.12:0/3121192631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd5ef30 0x555c3bd5c860 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000c640 tx=0x7f8e20004730 comp rx=0 tx=0).stop 2024-09-05T01:26:37.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.330+0000 7f8e3628b740 1 -- 172.21.15.12:0/3121192631 shutdown_connections 2024-09-05T01:26:37.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.330+0000 7f8e3628b740 1 --2- 172.21.15.12:0/3121192631 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x555c3bd6e700 0x555c3bd70b50 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.330+0000 7f8e3628b740 1 --2- 172.21.15.12:0/3121192631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd5ef30 0x555c3bd5c860 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.330+0000 7f8e3628b740 1 --2- 172.21.15.12:0/3121192631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c3bd54670 0x555c3bd5c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.330+0000 7f8e3628b740 1 --2- 172.21.15.12:0/3121192631 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd53d50 0x555c3bd5bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.330+0000 7f8e3628b740 1 -- 172.21.15.12:0/3121192631 >> 172.21.15.12:0/3121192631 conn(0x555c3bd502e0 msgr2=0x555c3bd56010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:37.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.330+0000 7f8e0ea00640 0 client.15582 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:26:37.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.331+0000 7f8e3628b740 1 -- 172.21.15.12:0/3121192631 shutdown_connections 2024-09-05T01:26:37.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.331+0000 7f8e3628b740 1 -- 172.21.15.12:0/3121192631 wait complete. 2024-09-05T01:26:37.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.331+0000 7f8e3628b740 20 client.15582 trim_cache size 0 max 16384 2024-09-05T01:26:37.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.367+0000 7f8e3628b740 1 Processor -- start 2024-09-05T01:26:37.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.367+0000 7f8e3628b740 1 -- start start 2024-09-05T01:26:37.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.368+0000 7f8e3628b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c3bd53d50 0x555c3bd5dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:37.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.368+0000 7f8e3628b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd54670 0x555c3bd76420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:37.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.368+0000 7f8e3628b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd5ef30 0x555c3bd76960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:37.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.368+0000 7f8e3628b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8e241587c0 con 0x555c3bd5ef30 2024-09-05T01:26:37.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.368+0000 7f8e3628b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2415a390 con 0x555c3bd54670 2024-09-05T01:26:37.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.368+0000 7f8e3628b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8e24158e90 con 0x555c3bd53d50 2024-09-05T01:26:37.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.369+0000 7f8e30e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c3bd53d50 0x555c3bd5dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:37.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.369+0000 7f8e2be00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd54670 0x555c3bd76420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:37.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.369+0000 7f8e2be00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd54670 0x555c3bd76420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:38696/0 (socket says 172.21.15.12:38696) 2024-09-05T01:26:37.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.369+0000 7f8e2be00640 1 -- 172.21.15.12:0/2819007128 learned_addr learned my addr 172.21.15.12:0/2819007128 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:37.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.369+0000 7f8e31800640 1 --2- 172.21.15.12:0/2819007128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd5ef30 0x555c3bd76960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:37.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.370+0000 7f8e2be00640 1 -- 172.21.15.12:0/2819007128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c3bd53d50 msgr2=0x555c3bd5dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:37.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.370+0000 7f8e2be00640 1 --2- 172.21.15.12:0/2819007128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c3bd53d50 0x555c3bd5dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.370+0000 7f8e2be00640 1 -- 172.21.15.12:0/2819007128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd5ef30 msgr2=0x555c3bd76960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:37.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.370+0000 7f8e2be00640 1 --2- 172.21.15.12:0/2819007128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd5ef30 0x555c3bd76960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.370+0000 7f8e2be00640 1 -- 172.21.15.12:0/2819007128 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c3bd50110 con 0x555c3bd54670 2024-09-05T01:26:37.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.370+0000 7f8e2be00640 1 --2- 172.21.15.12:0/2819007128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd54670 0x555c3bd76420 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8e240a2ce0 tx=0x7f8e1c009da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6b30750ac81fd22 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:37.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.371+0000 7f8e19600640 1 -- 172.21.15.12:0/2819007128 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c004230 con 0x555c3bd54670 2024-09-05T01:26:37.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.371+0000 7f8e19600640 1 -- 172.21.15.12:0/2819007128 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e1c00edf0 con 0x555c3bd54670 2024-09-05T01:26:37.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.371+0000 7f8e19600640 1 -- 172.21.15.12:0/2819007128 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c011470 con 0x555c3bd54670 2024-09-05T01:26:37.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.372+0000 7f8e3628b740 1 -- 172.21.15.12:0/2819007128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd54670 msgr2=0x555c3bd76420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:37.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.372+0000 7f8e3628b740 1 --2- 172.21.15.12:0/2819007128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd54670 0x555c3bd76420 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8e240a2ce0 tx=0x7f8e1c009da0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.372+0000 7f8e3628b740 1 -- 172.21.15.12:0/2819007128 shutdown_connections 2024-09-05T01:26:37.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.373+0000 7f8e3628b740 1 --2- 172.21.15.12:0/2819007128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd5ef30 0x555c3bd76960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.373+0000 7f8e3628b740 1 --2- 172.21.15.12:0/2819007128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd54670 0x555c3bd76420 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.373+0000 7f8e3628b740 1 --2- 172.21.15.12:0/2819007128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c3bd53d50 0x555c3bd5dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.373+0000 7f8e3628b740 1 -- 172.21.15.12:0/2819007128 >> 172.21.15.12:0/2819007128 conn(0x555c3bd502e0 msgr2=0x555c3bd5d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:37.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.373+0000 7f8e3628b740 1 -- 172.21.15.12:0/2819007128 shutdown_connections 2024-09-05T01:26:37.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.373+0000 7f8e3628b740 1 -- 172.21.15.12:0/2819007128 wait complete. 2024-09-05T01:26:37.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.374+0000 7f8e3628b740 1 -- start start 2024-09-05T01:26:37.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.375+0000 7f8e3628b740 1 Processor -- start 2024-09-05T01:26:37.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.375+0000 7f8e3628b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd53d50 0x555c3bd67360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:37.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.376+0000 7f8e3628b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd54670 0x555c3bd62690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:37.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.376+0000 7f8e30e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd53d50 0x555c3bd67360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:37.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.376+0000 7f8e30e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd53d50 0x555c3bd67360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:38712/0 (socket says 172.21.15.12:38712) 2024-09-05T01:26:37.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.376+0000 7f8e3628b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c3bd5ef30 0x555c3bd62c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:37.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.376+0000 7f8e3628b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8e24159c30 con 0x555c3bd54670 2024-09-05T01:26:37.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.376+0000 7f8e3628b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8e24159560 con 0x555c3bd53d50 2024-09-05T01:26:37.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.376+0000 7f8e3628b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8e241567a0 con 0x555c3bd5ef30 2024-09-05T01:26:37.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.376+0000 7f8e2be00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd54670 0x555c3bd62690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:37.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.376+0000 7f8e3628b740 10 client.0 _ll_register_callbacks cb 0x7f8e2000f650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:26:37.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.376+0000 7f8e2be00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd54670 0x555c3bd62690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38502/0 (socket says 172.21.15.12:38502) 2024-09-05T01:26:37.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.376+0000 7f8e2be00640 1 -- 172.21.15.12:0/429741513 learned_addr learned my addr 172.21.15.12:0/429741513 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:37.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.377+0000 7f8e31800640 1 --2- 172.21.15.12:0/429741513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c3bd5ef30 0x555c3bd62c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:37.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.377+0000 7f8e30e00640 1 -- 172.21.15.12:0/429741513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c3bd5ef30 msgr2=0x555c3bd62c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:37.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.377+0000 7f8e30e00640 1 --2- 172.21.15.12:0/429741513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c3bd5ef30 0x555c3bd62c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.377+0000 7f8e30e00640 1 -- 172.21.15.12:0/429741513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd54670 msgr2=0x555c3bd62690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:37.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.378+0000 7f8e30e00640 1 --2- 172.21.15.12:0/429741513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd54670 0x555c3bd62690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.378+0000 7f8e30e00640 1 -- 172.21.15.12:0/429741513 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c3bd63490 con 0x555c3bd53d50 2024-09-05T01:26:37.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.378+0000 7f8e30e00640 1 --2- 172.21.15.12:0/429741513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd53d50 0x555c3bd67360 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c051500 tx=0x7f8e2c08e660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d26051c219d1a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:37.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.378+0000 7f8e0ea00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:26:37.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.378+0000 7f8e0ea00640 1 -- 172.21.15.12:0/429741513 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c11b970 con 0x555c3bd53d50 2024-09-05T01:26:37.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.378+0000 7f8e0ea00640 1 -- 172.21.15.12:0/429741513 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f8e2c11f2c0 con 0x555c3bd53d50 2024-09-05T01:26:37.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.378+0000 7f8e3628b740 1 -- 172.21.15.12:0/429741513 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e1c00edf0 con 0x555c3bd53d50 2024-09-05T01:26:37.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.379+0000 7f8e0ea00640 1 -- 172.21.15.12:0/429741513 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8e2c13d030 con 0x555c3bd53d50 2024-09-05T01:26:37.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.379+0000 7f8e3628b740 10 client.25604 fetch_fsmap learned FSMap version 30 2024-09-05T01:26:37.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.379+0000 7f8e3628b740 1 -- 172.21.15.12:0/429741513 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555c3bdd9500 con 0x555c3bd53d50 2024-09-05T01:26:37.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.379+0000 7f8e0ea00640 1 -- 172.21.15.12:0/429741513 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e1c00edf0 con 0x555c3bd53d50 2024-09-05T01:26:37.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.379+0000 7f8e0ea00640 1 -- 172.21.15.12:0/429741513 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 30) ==== 8374+0+0 (secure 0 0 0) 0x7f8e2c11ea60 con 0x555c3bd53d50 2024-09-05T01:26:37.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.379+0000 7f8e3628b740 10 client.25604 fetch_fsmap finished waiting for FSMap version 30 2024-09-05T01:26:37.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.379+0000 7f8e3628b740 10 client.25604 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:26:37.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.379+0000 7f8e3628b740 20 client.25604 populate_metadata read hostname 'smithi012' 2024-09-05T01:26:37.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.379+0000 7f8e3628b740 1 --2- 172.21.15.12:0/429741513 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x555c3bdd9c70 0x555c3bddc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:37.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.379+0000 7f8e3628b740 4 client.25604 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T01:26:37.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.379+0000 7f8e3628b740 1 -- 172.21.15.12:0/429741513 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555c3bcc1e60 con 0x555c3bdd9c70 2024-09-05T01:26:37.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.380+0000 7f8e2be00640 1 --2- 172.21.15.12:0/429741513 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x555c3bdd9c70 0x555c3bddc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:37.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.381+0000 7f8e2be00640 1 --2- 172.21.15.12:0/429741513 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x555c3bdd9c70 0x555c3bddc090 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f323a0208340b66e server_cookie=f68c66b39d27596b in_seq=0 out_seq=0 2024-09-05T01:26:37.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.381+0000 7f8e0ea00640 10 client.25604 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:26:37.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.387+0000 7f8e0ea00640 1 -- 172.21.15.12:0/429741513 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555c3bcc1e60 con 0x555c3bdd9c70 2024-09-05T01:26:37.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.387+0000 7f8e0ea00640 10 client.25604 handle_command_reply: tid=0 2024-09-05T01:26:37.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.387+0000 7f8e3628b740 1 client.25604 shutdown 2024-09-05T01:26:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.387+0000 7f8e3628b740 1 -- 172.21.15.12:0/429741513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd53d50 msgr2=0x555c3bd67360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.387+0000 7f8e3628b740 1 --2- 172.21.15.12:0/429741513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd53d50 0x555c3bd67360 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c051500 tx=0x7f8e2c08e660 comp rx=0 tx=0).stop 2024-09-05T01:26:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.387+0000 7f8e3628b740 1 -- 172.21.15.12:0/429741513 shutdown_connections 2024-09-05T01:26:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.387+0000 7f8e3628b740 1 --2- 172.21.15.12:0/429741513 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x555c3bdd9c70 0x555c3bddc090 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.387+0000 7f8e3628b740 1 --2- 172.21.15.12:0/429741513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c3bd5ef30 0x555c3bd62c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.387+0000 7f8e0ea00640 0 client.25604 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:26:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.387+0000 7f8e3628b740 1 --2- 172.21.15.12:0/429741513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555c3bd54670 0x555c3bd62690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.387+0000 7f8e3628b740 1 --2- 172.21.15.12:0/429741513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555c3bd53d50 0x555c3bd67360 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.387+0000 7f8e3628b740 1 -- 172.21.15.12:0/429741513 >> 172.21.15.12:0/429741513 conn(0x555c3bd502e0 msgr2=0x555c3bd5d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.388+0000 7f8e3628b740 1 -- 172.21.15.12:0/429741513 shutdown_connections 2024-09-05T01:26:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.388+0000 7f8e3628b740 1 -- 172.21.15.12:0/429741513 wait complete. 2024-09-05T01:26:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.388+0000 7f8e3628b740 20 client.25604 trim_cache size 0 max 16384 2024-09-05T01:26:37.390 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:26:37.390 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-05T01:26:37.390 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-05T01:26:37.390 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:26:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.389+0000 7f8e33800640 1 -- 172.21.15.12:0/2555312988 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8e140a2d80 msgr2=0x7f8e140a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.389+0000 7f8e33800640 1 --2- 172.21.15.12:0/2555312988 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8e140a2d80 0x7f8e140a5240 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e20005bc0 tx=0x7f8e200046c0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.389+0000 7f8e33800640 1 -- 172.21.15.12:0/2555312988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e240a47e0 msgr2=0x7f8e24143400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.389+0000 7f8e33800640 1 --2- 172.21.15.12:0/2555312988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e240a47e0 0x7f8e24143400 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c067c70 tx=0x7f8e2c06e7e0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.390+0000 7f8e33800640 1 -- 172.21.15.12:0/2555312988 shutdown_connections 2024-09-05T01:26:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.390+0000 7f8e33800640 1 --2- 172.21.15.12:0/2555312988 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8e140a2d80 0x7f8e140a5240 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.390+0000 7f8e33800640 1 --2- 172.21.15.12:0/2555312988 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8e240aa830 0x7f8e24147cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.390+0000 7f8e33800640 1 --2- 172.21.15.12:0/2555312988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e240a5160 0x7f8e24143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.390+0000 7f8e33800640 1 --2- 172.21.15.12:0/2555312988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e240a47e0 0x7f8e24143400 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:37.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.390+0000 7f8e33800640 1 -- 172.21.15.12:0/2555312988 >> 172.21.15.12:0/2555312988 conn(0x7f8e2401a4f0 msgr2=0x7f8e240a3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:37.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.390+0000 7f8e33800640 1 -- 172.21.15.12:0/2555312988 shutdown_connections 2024-09-05T01:26:37.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:37.390+0000 7f8e33800640 1 -- 172.21.15.12:0/2555312988 wait complete. 2024-09-05T01:26:37.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:37 smithi012 ceph-mon[29942]: pgmap v60: 97 pgs: 97 active+clean; 52 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 3.7 MiB/s wr, 190 op/s 2024-09-05T01:26:37.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:37 smithi145 ceph-mon[34376]: pgmap v60: 97 pgs: 97 active+clean; 52 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 3.7 MiB/s wr, 190 op/s 2024-09-05T01:26:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:37 smithi151 ceph-mon[35013]: pgmap v60: 97 pgs: 97 active+clean; 52 MiB data, 550 MiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 3.7 MiB/s wr, 190 op/s 2024-09-05T01:26:38.639 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-05T01:26:38.639 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:26:39.098 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:26:39.122 INFO:tasks.workunit.client.0.smithi012.stdout: 27 239125 880 157722 745 44962 431 2024-09-05T01:26:39.482 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:39 smithi012 ceph-mon[29942]: pgmap v61: 97 pgs: 97 active+clean; 60 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 220 op/s 2024-09-05T01:26:39.482 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:39 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:26:39.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:39 smithi145 ceph-mon[34376]: pgmap v61: 97 pgs: 97 active+clean; 60 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 220 op/s 2024-09-05T01:26:39.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:39 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:26:39.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:39 smithi151 ceph-mon[35013]: pgmap v61: 97 pgs: 97 active+clean; 60 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 220 op/s 2024-09-05T01:26:39.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:39 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:26:39.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.850+0000 7ff615c00640 1 -- 172.21.15.12:0/4257197468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff610102b90 msgr2=0x7ff610102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:39.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.851+0000 7ff615c00640 1 --2- 172.21.15.12:0/4257197468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff610102b90 0x7ff610102f70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009900 tx=0x7ff5fc02a4d0 comp rx=0 tx=0).stop 2024-09-05T01:26:39.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.851+0000 7ff615c00640 1 -- 172.21.15.12:0/4257197468 shutdown_connections 2024-09-05T01:26:39.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.851+0000 7ff615c00640 1 --2- 172.21.15.12:0/4257197468 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff61010bfc0 0x7ff61010e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:39.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.851+0000 7ff615c00640 1 --2- 172.21.15.12:0/4257197468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6101034b0 0x7ff61010b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:39.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.852+0000 7ff615c00640 1 --2- 172.21.15.12:0/4257197468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff610102b90 0x7ff610102f70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:39.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.852+0000 7ff615c00640 1 -- 172.21.15.12:0/4257197468 >> 172.21.15.12:0/4257197468 conn(0x7ff6100fc610 msgr2=0x7ff6100fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:39.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.856+0000 7ff615c00640 1 -- 172.21.15.12:0/4257197468 shutdown_connections 2024-09-05T01:26:39.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.856+0000 7ff615c00640 1 -- 172.21.15.12:0/4257197468 wait complete. 2024-09-05T01:26:39.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.857+0000 7ff615c00640 1 Processor -- start 2024-09-05T01:26:39.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.857+0000 7ff615c00640 1 -- start start 2024-09-05T01:26:39.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.858+0000 7ff615c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff610102b90 0x7ff6101007f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:39.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.858+0000 7ff615c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff6101034b0 0x7ff610100d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:39.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.859+0000 7ff60f400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff6101034b0 0x7ff610100d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:39.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.859+0000 7ff60f400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff6101034b0 0x7ff610100d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:38732/0 (socket says 172.21.15.12:38732) 2024-09-05T01:26:39.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.859+0000 7ff60fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff610102b90 0x7ff6101007f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:39.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.859+0000 7ff60fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff610102b90 0x7ff6101007f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:54032/0 (socket says 172.21.15.12:54032) 2024-09-05T01:26:39.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.859+0000 7ff615c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61010bfc0 0x7ff610101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:39.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.859+0000 7ff60f400640 1 -- 172.21.15.12:0/310013131 learned_addr learned my addr 172.21.15.12:0/310013131 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:39.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.859+0000 7ff615c00640 1 -- 172.21.15.12:0/310013131 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff610111e70 con 0x7ff61010bfc0 2024-09-05T01:26:39.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.859+0000 7ff615c00640 1 -- 172.21.15.12:0/310013131 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff610111cf0 con 0x7ff6101034b0 2024-09-05T01:26:39.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.859+0000 7ff615c00640 1 -- 172.21.15.12:0/310013131 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff610111ff0 con 0x7ff610102b90 2024-09-05T01:26:39.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.860+0000 7ff60f400640 1 -- 172.21.15.12:0/310013131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff610102b90 msgr2=0x7ff6101007f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:39.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.860+0000 7ff60f400640 1 --2- 172.21.15.12:0/310013131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff610102b90 0x7ff6101007f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:39.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.860+0000 7ff60f400640 1 -- 172.21.15.12:0/310013131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61010bfc0 msgr2=0x7ff610101270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:39.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.860+0000 7ff60f400640 1 --2- 172.21.15.12:0/310013131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61010bfc0 0x7ff610101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:39.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.860+0000 7ff60f400640 1 -- 172.21.15.12:0/310013131 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6101a67e0 con 0x7ff6101034b0 2024-09-05T01:26:39.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.861+0000 7ff60f400640 1 --2- 172.21.15.12:0/310013131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff6101034b0 0x7ff610100d30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff60000c970 tx=0x7ff60000ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:39.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.861+0000 7ff60cc00640 1 -- 172.21.15.12:0/310013131 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff600007bb0 con 0x7ff6101034b0 2024-09-05T01:26:39.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.861+0000 7ff60cc00640 1 -- 172.21.15.12:0/310013131 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff600007d50 con 0x7ff6101034b0 2024-09-05T01:26:39.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.861+0000 7ff60cc00640 1 -- 172.21.15.12:0/310013131 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff600018890 con 0x7ff6101034b0 2024-09-05T01:26:39.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.861+0000 7ff615c00640 1 -- 172.21.15.12:0/310013131 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6101a6ad0 con 0x7ff6101034b0 2024-09-05T01:26:39.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.862+0000 7ff615c00640 1 -- 172.21.15.12:0/310013131 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6101a6fc0 con 0x7ff6101034b0 2024-09-05T01:26:39.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.865+0000 7ff615c00640 1 -- 172.21.15.12:0/310013131 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff610102f70 con 0x7ff6101034b0 2024-09-05T01:26:39.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.867+0000 7ff60cc00640 1 -- 172.21.15.12:0/310013131 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7ff600018a30 con 0x7ff6101034b0 2024-09-05T01:26:39.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.870+0000 7ff60cc00640 1 --2- 172.21.15.12:0/310013131 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7ff5f40a2d70 0x7ff5f40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:39.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.870+0000 7ff60cc00640 1 -- 172.21.15.12:0/310013131 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7ff6000cf3d0 con 0x7ff6101034b0 2024-09-05T01:26:39.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.870+0000 7ff60fe00640 1 --2- 172.21.15.12:0/310013131 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7ff5f40a2d70 0x7ff5f40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:39.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.871+0000 7ff60fe00640 1 --2- 172.21.15.12:0/310013131 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7ff5f40a2d70 0x7ff5f40a5230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc000c00 tx=0x7ff5fc005df0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:39.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:39.873+0000 7ff60cc00640 1 -- 172.21.15.12:0/310013131 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff600014030 con 0x7ff6101034b0 2024-09-05T01:26:40.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:40.363+0000 7ff615c00640 1 -- 172.21.15.12:0/310013131 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff610107030 con 0x7ff6101034b0 2024-09-05T01:26:40.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:40.364+0000 7ff60cc00640 1 -- 172.21.15.12:0/310013131 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11986 (secure 0 0 0) 0x7ff60009bfe0 con 0x7ff6101034b0 2024-09-05T01:26:40.377 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:26:40.377 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"btime":"2024-09-05T01:26:38:200397+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14532,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/2949711075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":2949711075},{"type":"v1","addr":"172.21.15.12:6839","nonce":2949711075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T01:22:35.979384+0000","modified":"2024-09-05T01:26:37.375643+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24529,"mds_2":24524,"mds_3":24517,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/497406458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":497406458},{"type":"v1","addr":"172.21.15.12:6841","nonce":497406458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":10,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.145:6839/1706431882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":1706431882},{"type":"v1","addr":"172.21.15.145:6839","nonce":1706431882}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24460,24517,24524,24529,24560]},"id":1}]} 2024-09-05T01:26:40.377 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 31 2024-09-05T01:26:40.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:40.370+0000 7ff615c00640 1 -- 172.21.15.12:0/310013131 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7ff5f40a2d70 msgr2=0x7ff5f40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:40.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:40.370+0000 7ff615c00640 1 --2- 172.21.15.12:0/310013131 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7ff5f40a2d70 0x7ff5f40a5230 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc000c00 tx=0x7ff5fc005df0 comp rx=0 tx=0).stop 2024-09-05T01:26:40.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:40.370+0000 7ff615c00640 1 -- 172.21.15.12:0/310013131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff6101034b0 msgr2=0x7ff610100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:40.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:40.370+0000 7ff615c00640 1 --2- 172.21.15.12:0/310013131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff6101034b0 0x7ff610100d30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff60000c970 tx=0x7ff60000ce30 comp rx=0 tx=0).stop 2024-09-05T01:26:40.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:40.371+0000 7ff615c00640 1 -- 172.21.15.12:0/310013131 shutdown_connections 2024-09-05T01:26:40.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:40.371+0000 7ff615c00640 1 --2- 172.21.15.12:0/310013131 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7ff5f40a2d70 0x7ff5f40a5230 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:40.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:40.371+0000 7ff615c00640 1 --2- 172.21.15.12:0/310013131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61010bfc0 0x7ff610101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:40.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:40.371+0000 7ff615c00640 1 --2- 172.21.15.12:0/310013131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff6101034b0 0x7ff610100d30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:40.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:40.371+0000 7ff615c00640 1 --2- 172.21.15.12:0/310013131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff610102b90 0x7ff6101007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:40.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:40.371+0000 7ff615c00640 1 -- 172.21.15.12:0/310013131 >> 172.21.15.12:0/310013131 conn(0x7ff6100fc610 msgr2=0x7ff6100fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:40.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:40.375+0000 7ff615c00640 1 -- 172.21.15.12:0/310013131 shutdown_connections 2024-09-05T01:26:40.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:40.375+0000 7ff615c00640 1 -- 172.21.15.12:0/310013131 wait complete. 2024-09-05T01:26:41.254 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-05T01:26:41.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:41 smithi012 ceph-mon[29942]: pgmap v62: 97 pgs: 97 active+clean; 60 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 174 op/s 2024-09-05T01:26:41.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:41 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/310013131' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:26:41.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:41 smithi145 ceph-mon[34376]: pgmap v62: 97 pgs: 97 active+clean; 60 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 174 op/s 2024-09-05T01:26:41.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:41 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/310013131' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:26:41.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:41 smithi151 ceph-mon[35013]: pgmap v62: 97 pgs: 97 active+clean; 60 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 174 op/s 2024-09-05T01:26:41.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:41 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/310013131' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:26:42.297 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:26:43.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.056+0000 7f99cb800640 1 -- 172.21.15.12:0/3748941828 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99c4101dd0 msgr2=0x7f99c41021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:43.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.056+0000 7f99cb800640 1 --2- 172.21.15.12:0/3748941828 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99c4101dd0 0x7f99c41021b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009860 tx=0x7f99b802a340 comp rx=0 tx=0).stop 2024-09-05T01:26:43.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.056+0000 7f99cb800640 1 -- 172.21.15.12:0/3748941828 shutdown_connections 2024-09-05T01:26:43.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.056+0000 7f99cb800640 1 --2- 172.21.15.12:0/3748941828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c4106f00 0x7f99c410ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.056+0000 7f99cb800640 1 --2- 172.21.15.12:0/3748941828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99c4102780 0x7f99c41067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.056+0000 7f99cb800640 1 --2- 172.21.15.12:0/3748941828 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99c4101dd0 0x7f99c41021b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.056+0000 7f99cb800640 1 -- 172.21.15.12:0/3748941828 >> 172.21.15.12:0/3748941828 conn(0x7f99c40fd890 msgr2=0x7f99c40ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:43.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.056+0000 7f99cb800640 1 -- 172.21.15.12:0/3748941828 shutdown_connections 2024-09-05T01:26:43.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.056+0000 7f99cb800640 1 -- 172.21.15.12:0/3748941828 wait complete. 2024-09-05T01:26:43.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.057+0000 7f99cb800640 1 Processor -- start 2024-09-05T01:26:43.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.057+0000 7f99cb800640 1 -- start start 2024-09-05T01:26:43.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.058+0000 7f99cb800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c4101dd0 0x7f99c41a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:43.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.058+0000 7f99cb800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99c4102780 0x7f99c41a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:43.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.058+0000 7f99cb800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99c4106f00 0x7f99c419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:43.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.058+0000 7f99cb800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f99c4111f60 con 0x7f99c4101dd0 2024-09-05T01:26:43.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.058+0000 7f99cb800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f99c4111de0 con 0x7f99c4102780 2024-09-05T01:26:43.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.058+0000 7f99cb800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f99c41120e0 con 0x7f99c4106f00 2024-09-05T01:26:43.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.058+0000 7f99c8e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c4101dd0 0x7f99c41a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:43.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.058+0000 7f99c3e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99c4102780 0x7f99c41a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:43.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.058+0000 7f99c8e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c4101dd0 0x7f99c41a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38540/0 (socket says 172.21.15.12:38540) 2024-09-05T01:26:43.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.058+0000 7f99c8e00640 1 -- 172.21.15.12:0/3895439897 learned_addr learned my addr 172.21.15.12:0/3895439897 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:43.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.058+0000 7f99c3e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99c4102780 0x7f99c41a0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:38752/0 (socket says 172.21.15.12:38752) 2024-09-05T01:26:43.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.058+0000 7f99c9800640 1 --2- 172.21.15.12:0/3895439897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99c4106f00 0x7f99c419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:43.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.058+0000 7f99c3e00640 1 -- 172.21.15.12:0/3895439897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99c4106f00 msgr2=0x7f99c419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:43.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.058+0000 7f99c3e00640 1 --2- 172.21.15.12:0/3895439897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99c4106f00 0x7f99c419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.058+0000 7f99c3e00640 1 -- 172.21.15.12:0/3895439897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c4101dd0 msgr2=0x7f99c41a03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:43.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.058+0000 7f99c3e00640 1 --2- 172.21.15.12:0/3895439897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c4101dd0 0x7f99c41a03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.058+0000 7f99c3e00640 1 -- 172.21.15.12:0/3895439897 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c419acc0 con 0x7f99c4102780 2024-09-05T01:26:43.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.059+0000 7f99c3e00640 1 --2- 172.21.15.12:0/3895439897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99c4102780 0x7f99c41a0910 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f99b000e790 tx=0x7f99b000ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:43.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.059+0000 7f99c1600640 1 -- 172.21.15.12:0/3895439897 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b000eea0 con 0x7f99c4102780 2024-09-05T01:26:43.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.059+0000 7f99c1600640 1 -- 172.21.15.12:0/3895439897 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99b000ccc0 con 0x7f99c4102780 2024-09-05T01:26:43.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.059+0000 7f99cb800640 1 -- 172.21.15.12:0/3895439897 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c419afb0 con 0x7f99c4102780 2024-09-05T01:26:43.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.059+0000 7f99c1600640 1 -- 172.21.15.12:0/3895439897 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b0018780 con 0x7f99c4102780 2024-09-05T01:26:43.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.059+0000 7f99cb800640 1 -- 172.21.15.12:0/3895439897 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c41a72a0 con 0x7f99c4102780 2024-09-05T01:26:43.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.063+0000 7f99c1600640 1 -- 172.21.15.12:0/3895439897 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f99b0010430 con 0x7f99c4102780 2024-09-05T01:26:43.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.063+0000 7f99ce437740 1 Processor -- start 2024-09-05T01:26:43.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.063+0000 7f99ce437740 1 -- start start 2024-09-05T01:26:43.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.064+0000 7f99ce437740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b1eae0c70 0x563b1eae1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:43.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.064+0000 7f99ce437740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eae1590 0x563b1eaeb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:43.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.064+0000 7f99ce437740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b1eaebe50 0x563b1eaee240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:43.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.064+0000 7f99ce437740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563b1ea473e0 con 0x563b1eae0c70 2024-09-05T01:26:43.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.064+0000 7f99ce437740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x563b1e9eed80 con 0x563b1eae1590 2024-09-05T01:26:43.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.064+0000 7f99ce437740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563b1ea433a0 con 0x563b1eaebe50 2024-09-05T01:26:43.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.064+0000 7f99c8e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eae1590 0x563b1eaeb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:43.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.064+0000 7f99c8e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eae1590 0x563b1eaeb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:38762/0 (socket says 172.21.15.12:38762) 2024-09-05T01:26:43.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.064+0000 7f99c8e00640 1 -- 172.21.15.12:0/4086920884 learned_addr learned my addr 172.21.15.12:0/4086920884 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:43.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.064+0000 7f99c9800640 1 --2- 172.21.15.12:0/4086920884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b1eae0c70 0x563b1eae1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:43.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.064+0000 7f99c3e00640 1 --2- 172.21.15.12:0/4086920884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b1eaebe50 0x563b1eaee240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:43.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.064+0000 7f99c8e00640 1 -- 172.21.15.12:0/4086920884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b1eaebe50 msgr2=0x563b1eaee240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:43.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.064+0000 7f99c8e00640 1 --2- 172.21.15.12:0/4086920884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b1eaebe50 0x563b1eaee240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.064+0000 7f99c8e00640 1 -- 172.21.15.12:0/4086920884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b1eae0c70 msgr2=0x563b1eae1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:43.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.064+0000 7f99c8e00640 1 --2- 172.21.15.12:0/4086920884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b1eae0c70 0x563b1eae1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.064+0000 7f99c8e00640 1 -- 172.21.15.12:0/4086920884 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b1ea0dae0 con 0x563b1eae1590 2024-09-05T01:26:43.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.065+0000 7f99c1600640 1 --2- 172.21.15.12:0/3895439897 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f99ac0a2cf0 0x7f99ac0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:43.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.065+0000 7f99c8e00640 1 --2- 172.21.15.12:0/4086920884 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eae1590 0x563b1eaeb910 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f99b8035040 tx=0x7f99b8009520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69699021fd46c433 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:43.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.065+0000 7f99c1600640 1 -- 172.21.15.12:0/3895439897 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f99b00cf600 con 0x7f99c4102780 2024-09-05T01:26:43.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.065+0000 7f99b6000640 1 -- 172.21.15.12:0/4086920884 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b8041020 con 0x563b1eae1590 2024-09-05T01:26:43.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.065+0000 7f99c9800640 1 --2- 172.21.15.12:0/3895439897 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f99ac0a2cf0 0x7f99ac0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:43.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.065+0000 7f99b6000640 1 -- 172.21.15.12:0/4086920884 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99b8030550 con 0x563b1eae1590 2024-09-05T01:26:43.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.065+0000 7f99b6000640 1 -- 172.21.15.12:0/4086920884 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b8037040 con 0x563b1eae1590 2024-09-05T01:26:43.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.066+0000 7f99ce437740 1 -- 172.21.15.12:0/4086920884 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eae1590 msgr2=0x563b1eaeb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:43.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.066+0000 7f99c9800640 1 --2- 172.21.15.12:0/3895439897 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f99ac0a2cf0 0x7f99ac0a51b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f99bc005fd0 tx=0x7f99bc009500 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:43.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.066+0000 7f99ce437740 1 --2- 172.21.15.12:0/4086920884 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eae1590 0x563b1eaeb910 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f99b8035040 tx=0x7f99b8009520 comp rx=0 tx=0).stop 2024-09-05T01:26:43.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.066+0000 7f99ce437740 1 -- 172.21.15.12:0/4086920884 shutdown_connections 2024-09-05T01:26:43.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.066+0000 7f99ce437740 1 --2- 172.21.15.12:0/4086920884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b1eaebe50 0x563b1eaee240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.066+0000 7f99ce437740 1 --2- 172.21.15.12:0/4086920884 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eae1590 0x563b1eaeb910 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.066+0000 7f99ce437740 1 --2- 172.21.15.12:0/4086920884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b1eae0c70 0x563b1eae1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.066+0000 7f99ce437740 1 -- 172.21.15.12:0/4086920884 >> 172.21.15.12:0/4086920884 conn(0x563b1eadd200 msgr2=0x563b1eadd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:43.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.066+0000 7f99ce437740 1 -- 172.21.15.12:0/4086920884 shutdown_connections 2024-09-05T01:26:43.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.066+0000 7f99ce437740 1 -- 172.21.15.12:0/4086920884 wait complete. 2024-09-05T01:26:43.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.067+0000 7f99ce437740 1 -- start start 2024-09-05T01:26:43.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.067+0000 7f99ce437740 1 Processor -- start 2024-09-05T01:26:43.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.068+0000 7f99ce437740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b1eae0c70 0x563b1eae8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:43.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.068+0000 7f99ce437740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b1eae1590 0x563b1eae9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:43.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.068+0000 7f99ce437740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eaebe50 0x563b1eae9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:43.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.068+0000 7f99ce437740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563b1eaeea20 con 0x563b1eae0c70 2024-09-05T01:26:43.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.068+0000 7f99ce437740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x563b1ea020f0 con 0x563b1eaebe50 2024-09-05T01:26:43.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.068+0000 7f99ce437740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563b1eaeeba0 con 0x563b1eae1590 2024-09-05T01:26:43.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.068+0000 7f99ce437740 10 client.0 _ll_register_callbacks cb 0x563b1e9e9bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:26:43.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.068+0000 7f99c9800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eaebe50 0x563b1eae9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:43.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.068+0000 7f99c9800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eaebe50 0x563b1eae9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:38776/0 (socket says 172.21.15.12:38776) 2024-09-05T01:26:43.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.068+0000 7f99c9800640 1 -- 172.21.15.12:0/13636926 learned_addr learned my addr 172.21.15.12:0/13636926 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:43.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.068+0000 7f99c3e00640 1 --2- 172.21.15.12:0/13636926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b1eae1590 0x563b1eae9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:43.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.068+0000 7f99c3e00640 1 -- 172.21.15.12:0/13636926 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eaebe50 msgr2=0x563b1eae9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:43.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.068+0000 7f99c3e00640 1 --2- 172.21.15.12:0/13636926 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eaebe50 0x563b1eae9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.068+0000 7f99c3e00640 1 -- 172.21.15.12:0/13636926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b1eae0c70 msgr2=0x563b1eae8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:43.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.068+0000 7f99c3e00640 1 --2- 172.21.15.12:0/13636926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b1eae0c70 0x563b1eae8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.068+0000 7f99c3e00640 1 -- 172.21.15.12:0/13636926 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b1e7b83c0 con 0x563b1eae1590 2024-09-05T01:26:43.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.068+0000 7f99c9800640 1 --2- 172.21.15.12:0/13636926 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eaebe50 0x563b1eae9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:26:43.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.069+0000 7f99c3e00640 1 --2- 172.21.15.12:0/13636926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b1eae1590 0x563b1eae9210 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f99b00ccce0 tx=0x7f99b0097ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b91e28f5f1cb2fa server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:43.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.069+0000 7f99aaa00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:26:43.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.069+0000 7f99aaa00640 1 -- 172.21.15.12:0/13636926 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b009bb60 con 0x563b1eae1590 2024-09-05T01:26:43.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.069+0000 7f99aaa00640 1 -- 172.21.15.12:0/13636926 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f99b00ccf60 con 0x563b1eae1590 2024-09-05T01:26:43.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.069+0000 7f99ce437740 1 -- 172.21.15.12:0/13636926 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99b8030550 con 0x563b1eae1590 2024-09-05T01:26:43.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.069+0000 7f99aaa00640 1 -- 172.21.15.12:0/13636926 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f99b00cd160 con 0x563b1eae1590 2024-09-05T01:26:43.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.069+0000 7f99ce437740 10 client.25615 fetch_fsmap learned FSMap version 31 2024-09-05T01:26:43.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.069+0000 7f99ce437740 1 -- 172.21.15.12:0/13636926 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563b1eafa9f0 con 0x563b1eae1590 2024-09-05T01:26:43.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.069+0000 7f99aaa00640 1 -- 172.21.15.12:0/13636926 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99b8030550 con 0x563b1eae1590 2024-09-05T01:26:43.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.070+0000 7f99aaa00640 1 -- 172.21.15.12:0/13636926 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f99b009afb0 con 0x563b1eae1590 2024-09-05T01:26:43.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.070+0000 7f99ce437740 10 client.25615 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T01:26:43.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.070+0000 7f99ce437740 10 client.25615 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-05T01:26:43.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.070+0000 7f99ce437740 20 client.25615 populate_metadata read hostname 'smithi012' 2024-09-05T01:26:43.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.070+0000 7f99ce437740 1 --2- 172.21.15.12:0/13636926 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x563b1eafbe00 0x563b1eafe2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:43.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.070+0000 7f99ce437740 4 client.25615 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:26:43.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.070+0000 7f99ce437740 1 -- 172.21.15.12:0/13636926 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b1ea54950 con 0x563b1eafbe00 2024-09-05T01:26:43.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.070+0000 7f99c8e00640 1 --2- 172.21.15.12:0/13636926 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x563b1eafbe00 0x563b1eafe2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:43.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.071+0000 7f99c8e00640 1 --2- 172.21.15.12:0/13636926 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x563b1eafbe00 0x563b1eafe2c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=becad0206f239bca server_cookie=b5b75ba6dae9badc in_seq=0 out_seq=0 2024-09-05T01:26:43.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.071+0000 7f99aaa00640 10 client.25615 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:26:43.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.071+0000 7f99aaa00640 1 -- 172.21.15.12:0/13636926 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563b1ea54950 con 0x563b1eafbe00 2024-09-05T01:26:43.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.071+0000 7f99aaa00640 10 client.25615 handle_command_reply: tid=0 2024-09-05T01:26:43.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.071+0000 7f99ce437740 1 client.25615 shutdown 2024-09-05T01:26:43.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.072+0000 7f99ce437740 1 -- 172.21.15.12:0/13636926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b1eae1590 msgr2=0x563b1eae9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:43.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.072+0000 7f99ce437740 1 --2- 172.21.15.12:0/13636926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b1eae1590 0x563b1eae9210 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f99b00ccce0 tx=0x7f99b0097ec0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.072+0000 7f99ce437740 1 -- 172.21.15.12:0/13636926 shutdown_connections 2024-09-05T01:26:43.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.072+0000 7f99ce437740 1 --2- 172.21.15.12:0/13636926 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x563b1eafbe00 0x563b1eafe2c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.072+0000 7f99ce437740 1 --2- 172.21.15.12:0/13636926 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eaebe50 0x563b1eae9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.072+0000 7f99ce437740 1 --2- 172.21.15.12:0/13636926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b1eae1590 0x563b1eae9210 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.072+0000 7f99ce437740 1 --2- 172.21.15.12:0/13636926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b1eae0c70 0x563b1eae8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.072+0000 7f99aaa00640 0 client.25615 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:26:43.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.072+0000 7f99ce437740 1 -- 172.21.15.12:0/13636926 >> 172.21.15.12:0/13636926 conn(0x563b1eadd200 msgr2=0x563b1eae2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:43.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.072+0000 7f99ce437740 1 -- 172.21.15.12:0/13636926 shutdown_connections 2024-09-05T01:26:43.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.072+0000 7f99ce437740 1 -- 172.21.15.12:0/13636926 wait complete. 2024-09-05T01:26:43.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.072+0000 7f99ce437740 20 client.25615 trim_cache size 0 max 16384 2024-09-05T01:26:43.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.086+0000 7f99ce437740 1 Processor -- start 2024-09-05T01:26:43.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.086+0000 7f99ce437740 1 -- start start 2024-09-05T01:26:43.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.087+0000 7f99ce437740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b1eae0c70 0x563b1eae3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:43.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.087+0000 7f99ce437740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eae1590 0x563b1eb03be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:43.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.087+0000 7f99ce437740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b1eaebe50 0x563b1eb04120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:43.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.087+0000 7f99ce437740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f99c41afb70 con 0x563b1eaebe50 2024-09-05T01:26:43.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.087+0000 7f99ce437740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f99c41b1770 con 0x563b1eae1590 2024-09-05T01:26:43.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.087+0000 7f99ce437740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f99c41b0240 con 0x563b1eae0c70 2024-09-05T01:26:43.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.087+0000 7f99c9800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b1eaebe50 0x563b1eb04120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.087+0000 7f99c3e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eae1590 0x563b1eb03be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.087+0000 7f99c3e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eae1590 0x563b1eb03be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:38780/0 (socket says 172.21.15.12:38780) 2024-09-05T01:26:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.087+0000 7f99c8e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b1eae0c70 0x563b1eae3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.087+0000 7f99c3e00640 1 -- 172.21.15.12:0/2283917433 learned_addr learned my addr 172.21.15.12:0/2283917433 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.087+0000 7f99c9800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b1eaebe50 0x563b1eb04120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38558/0 (socket says 172.21.15.12:38558) 2024-09-05T01:26:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.087+0000 7f99c8e00640 1 -- 172.21.15.12:0/2283917433 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eae1590 msgr2=0x563b1eb03be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.087+0000 7f99c8e00640 1 --2- 172.21.15.12:0/2283917433 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eae1590 0x563b1eb03be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.087+0000 7f99c8e00640 1 -- 172.21.15.12:0/2283917433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b1eaebe50 msgr2=0x563b1eb04120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.087+0000 7f99c8e00640 1 --2- 172.21.15.12:0/2283917433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b1eaebe50 0x563b1eb04120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.088+0000 7f99c8e00640 1 -- 172.21.15.12:0/2283917433 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b1eadd030 con 0x563b1eae0c70 2024-09-05T01:26:43.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.088+0000 7f99c3e00640 1 --2- 172.21.15.12:0/2283917433 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eae1590 0x563b1eb03be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:26:43.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.088+0000 7f99c8e00640 1 --2- 172.21.15.12:0/2283917433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b1eae0c70 0x563b1eae3720 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f99b802a930 tx=0x7f99b8003690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5346a92d3b3625 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:43.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.088+0000 7f99b5600640 1 -- 172.21.15.12:0/2283917433 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b8037050 con 0x563b1eae0c70 2024-09-05T01:26:43.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.088+0000 7f99b5600640 1 -- 172.21.15.12:0/2283917433 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99b804a070 con 0x563b1eae0c70 2024-09-05T01:26:43.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.088+0000 7f99b5600640 1 -- 172.21.15.12:0/2283917433 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b8041040 con 0x563b1eae0c70 2024-09-05T01:26:43.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.089+0000 7f99ce437740 1 -- 172.21.15.12:0/2283917433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b1eae0c70 msgr2=0x563b1eae3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:43.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.089+0000 7f99ce437740 1 --2- 172.21.15.12:0/2283917433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b1eae0c70 0x563b1eae3720 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f99b802a930 tx=0x7f99b8003690 comp rx=0 tx=0).stop 2024-09-05T01:26:43.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.089+0000 7f99ce437740 1 -- 172.21.15.12:0/2283917433 shutdown_connections 2024-09-05T01:26:43.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.089+0000 7f99ce437740 1 --2- 172.21.15.12:0/2283917433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b1eaebe50 0x563b1eb04120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.089+0000 7f99ce437740 1 --2- 172.21.15.12:0/2283917433 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eae1590 0x563b1eb03be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.089+0000 7f99ce437740 1 --2- 172.21.15.12:0/2283917433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b1eae0c70 0x563b1eae3720 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.089+0000 7f99ce437740 1 -- 172.21.15.12:0/2283917433 >> 172.21.15.12:0/2283917433 conn(0x563b1eadd200 msgr2=0x563b1eaead50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:43.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.089+0000 7f99ce437740 1 -- 172.21.15.12:0/2283917433 shutdown_connections 2024-09-05T01:26:43.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.089+0000 7f99ce437740 1 -- 172.21.15.12:0/2283917433 wait complete. 2024-09-05T01:26:43.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.090+0000 7f99ce437740 1 -- start start 2024-09-05T01:26:43.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.090+0000 7f99ce437740 1 Processor -- start 2024-09-05T01:26:43.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.090+0000 7f99ce437740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eae0c70 0x563b1eaefab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:43.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.090+0000 7f99ce437740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b1eae1590 0x563b1eaefff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:43.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.090+0000 7f99ce437740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b1eaebe50 0x563b1eaf0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:43.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.090+0000 7f99ce437740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f99c41b0fe0 con 0x563b1eae1590 2024-09-05T01:26:43.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.090+0000 7f99ce437740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f99c41b0910 con 0x563b1eae0c70 2024-09-05T01:26:43.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.090+0000 7f99ce437740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f99c41adb50 con 0x563b1eaebe50 2024-09-05T01:26:43.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.090+0000 7f99ce437740 10 client.0 _ll_register_callbacks cb 0x7f99b00d2da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:26:43.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.091+0000 7f99c8e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eae0c70 0x563b1eaefab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:43.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.091+0000 7f99c8e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eae0c70 0x563b1eaefab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:38796/0 (socket says 172.21.15.12:38796) 2024-09-05T01:26:43.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.091+0000 7f99c8e00640 1 -- 172.21.15.12:0/2685092659 learned_addr learned my addr 172.21.15.12:0/2685092659 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:43.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.091+0000 7f99c3e00640 1 --2- 172.21.15.12:0/2685092659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b1eae1590 0x563b1eaefff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:43.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.091+0000 7f99c9800640 1 --2- 172.21.15.12:0/2685092659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b1eaebe50 0x563b1eaf0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:43.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.091+0000 7f99c8e00640 1 -- 172.21.15.12:0/2685092659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b1eaebe50 msgr2=0x563b1eaf0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:43.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.091+0000 7f99c8e00640 1 --2- 172.21.15.12:0/2685092659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b1eaebe50 0x563b1eaf0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.091+0000 7f99c8e00640 1 -- 172.21.15.12:0/2685092659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b1eae1590 msgr2=0x563b1eaefff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:43.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.091+0000 7f99c8e00640 1 --2- 172.21.15.12:0/2685092659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b1eae1590 0x563b1eaefff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.091+0000 7f99c8e00640 1 -- 172.21.15.12:0/2685092659 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b1ead8770 con 0x563b1eae0c70 2024-09-05T01:26:43.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.091+0000 7f99c8e00640 1 --2- 172.21.15.12:0/2685092659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eae0c70 0x563b1eaefab0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f99b8035040 tx=0x7f99b8030eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfe76bd3e5157951 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:43.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.091+0000 7f99aaa00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:26:43.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.092+0000 7f99aaa00640 1 -- 172.21.15.12:0/2685092659 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b8041040 con 0x563b1eae0c70 2024-09-05T01:26:43.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.092+0000 7f99ce437740 1 -- 172.21.15.12:0/2685092659 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99b804a070 con 0x563b1eae0c70 2024-09-05T01:26:43.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.092+0000 7f99aaa00640 1 -- 172.21.15.12:0/2685092659 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f99b8030750 con 0x563b1eae0c70 2024-09-05T01:26:43.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.092+0000 7f99aaa00640 1 -- 172.21.15.12:0/2685092659 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f99b8037020 con 0x563b1eae0c70 2024-09-05T01:26:43.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.092+0000 7f99ce437740 10 client.25625 fetch_fsmap learned FSMap version 31 2024-09-05T01:26:43.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.092+0000 7f99ce437740 1 -- 172.21.15.12:0/2685092659 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563b1eb66c20 con 0x563b1eae0c70 2024-09-05T01:26:43.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.092+0000 7f99aaa00640 1 -- 172.21.15.12:0/2685092659 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99b804a070 con 0x563b1eae0c70 2024-09-05T01:26:43.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.092+0000 7f99aaa00640 1 -- 172.21.15.12:0/2685092659 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f99b8004be0 con 0x563b1eae0c70 2024-09-05T01:26:43.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.092+0000 7f99ce437740 10 client.25625 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T01:26:43.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.092+0000 7f99ce437740 10 client.25625 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-05T01:26:43.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.092+0000 7f99ce437740 20 client.25625 populate_metadata read hostname 'smithi012' 2024-09-05T01:26:43.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.092+0000 7f99ce437740 1 --2- 172.21.15.12:0/2685092659 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x563b1eb66ef0 0x563b1eb692e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:43.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.093+0000 7f99ce437740 4 client.25625 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:26:43.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.093+0000 7f99ce437740 1 -- 172.21.15.12:0/2685092659 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563b1ea4ee60 con 0x563b1eb66ef0 2024-09-05T01:26:43.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.093+0000 7f99c3e00640 1 --2- 172.21.15.12:0/2685092659 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x563b1eb66ef0 0x563b1eb692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:43.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.093+0000 7f99c3e00640 1 --2- 172.21.15.12:0/2685092659 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x563b1eb66ef0 0x563b1eb692e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d714dfc85a8fb691 server_cookie=2a8ede3a6904db5d in_seq=0 out_seq=0 2024-09-05T01:26:43.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.093+0000 7f99aaa00640 10 client.25625 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:26:43.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.094+0000 7f99aaa00640 1 -- 172.21.15.12:0/2685092659 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563b1ea4ee60 con 0x563b1eb66ef0 2024-09-05T01:26:43.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.094+0000 7f99aaa00640 10 client.25625 handle_command_reply: tid=0 2024-09-05T01:26:43.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.094+0000 7f99ce437740 1 client.25625 shutdown 2024-09-05T01:26:43.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.096+0000 7f99ce437740 1 -- 172.21.15.12:0/2685092659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eae0c70 msgr2=0x563b1eaefab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:43.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.096+0000 7f99ce437740 1 --2- 172.21.15.12:0/2685092659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eae0c70 0x563b1eaefab0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f99b8035040 tx=0x7f99b8030eb0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.096+0000 7f99ce437740 1 -- 172.21.15.12:0/2685092659 shutdown_connections 2024-09-05T01:26:43.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.096+0000 7f99ce437740 1 --2- 172.21.15.12:0/2685092659 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x563b1eb66ef0 0x563b1eb692e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.096+0000 7f99ce437740 1 --2- 172.21.15.12:0/2685092659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b1eaebe50 0x563b1eaf0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.096+0000 7f99ce437740 1 --2- 172.21.15.12:0/2685092659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563b1eae1590 0x563b1eaefff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.096+0000 7f99ce437740 1 --2- 172.21.15.12:0/2685092659 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563b1eae0c70 0x563b1eaefab0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.096+0000 7f99ce437740 1 -- 172.21.15.12:0/2685092659 >> 172.21.15.12:0/2685092659 conn(0x563b1eadd200 msgr2=0x563b1eadbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:43.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.096+0000 7f99aaa00640 0 client.25625 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:26:43.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.096+0000 7f99ce437740 1 -- 172.21.15.12:0/2685092659 shutdown_connections 2024-09-05T01:26:43.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.096+0000 7f99ce437740 1 -- 172.21.15.12:0/2685092659 wait complete. 2024-09-05T01:26:43.101 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:26:43.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.096+0000 7f99ce437740 20 client.25625 trim_cache size 0 max 16384 2024-09-05T01:26:43.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.097+0000 7f99cb800640 1 -- 172.21.15.12:0/3895439897 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f99ac0a2cf0 msgr2=0x7f99ac0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:43.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.097+0000 7f99cb800640 1 --2- 172.21.15.12:0/3895439897 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f99ac0a2cf0 0x7f99ac0a51b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f99bc005fd0 tx=0x7f99bc009500 comp rx=0 tx=0).stop 2024-09-05T01:26:43.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.098+0000 7f99cb800640 1 -- 172.21.15.12:0/3895439897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99c4102780 msgr2=0x7f99c41a0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:43.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.098+0000 7f99cb800640 1 --2- 172.21.15.12:0/3895439897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99c4102780 0x7f99c41a0910 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f99b000e790 tx=0x7f99b000ec50 comp rx=0 tx=0).stop 2024-09-05T01:26:43.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.098+0000 7f99cb800640 1 -- 172.21.15.12:0/3895439897 shutdown_connections 2024-09-05T01:26:43.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.098+0000 7f99cb800640 1 --2- 172.21.15.12:0/3895439897 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f99ac0a2cf0 0x7f99ac0a51b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.098+0000 7f99cb800640 1 --2- 172.21.15.12:0/3895439897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99c4106f00 0x7f99c419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.098+0000 7f99cb800640 1 --2- 172.21.15.12:0/3895439897 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f99c4102780 0x7f99c41a0910 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.098+0000 7f99cb800640 1 --2- 172.21.15.12:0/3895439897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c4101dd0 0x7f99c41a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:43.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.098+0000 7f99cb800640 1 -- 172.21.15.12:0/3895439897 >> 172.21.15.12:0/3895439897 conn(0x7f99c40fd890 msgr2=0x7f99c40fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:43.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.098+0000 7f99cb800640 1 -- 172.21.15.12:0/3895439897 shutdown_connections 2024-09-05T01:26:43.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:43.098+0000 7f99cb800640 1 -- 172.21.15.12:0/3895439897 wait complete. 2024-09-05T01:26:43.502 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:43 smithi012 ceph-mon[29942]: pgmap v63: 97 pgs: 97 active+clean; 60 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 137 op/s 2024-09-05T01:26:43.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:43 smithi145 ceph-mon[34376]: pgmap v63: 97 pgs: 97 active+clean; 60 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 137 op/s 2024-09-05T01:26:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:43 smithi151 ceph-mon[35013]: pgmap v63: 97 pgs: 97 active+clean; 60 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 137 op/s 2024-09-05T01:26:43.937 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-05T01:26:44.366 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:26:45.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.022+0000 7f9172200640 1 -- 172.21.15.12:0/582021251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f916c103ff0 msgr2=0x7f916c1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:45.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.022+0000 7f9172200640 1 --2- 172.21.15.12:0/582021251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f916c103ff0 0x7f916c1043d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f915c009900 tx=0x7f915c02a3f0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.022+0000 7f9172200640 1 -- 172.21.15.12:0/582021251 shutdown_connections 2024-09-05T01:26:45.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.022+0000 7f9172200640 1 --2- 172.21.15.12:0/582021251 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f916c109120 0x7f916c110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.022+0000 7f9172200640 1 --2- 172.21.15.12:0/582021251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f916c1049a0 0x7f916c1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.022+0000 7f9172200640 1 --2- 172.21.15.12:0/582021251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f916c103ff0 0x7f916c1043d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.023+0000 7f9172200640 1 -- 172.21.15.12:0/582021251 >> 172.21.15.12:0/582021251 conn(0x7f916c0ffa90 msgr2=0x7f916c101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:45.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.023+0000 7f9172200640 1 -- 172.21.15.12:0/582021251 shutdown_connections 2024-09-05T01:26:45.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.024+0000 7f9172200640 1 -- 172.21.15.12:0/582021251 wait complete. 2024-09-05T01:26:45.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.025+0000 7f9172200640 1 Processor -- start 2024-09-05T01:26:45.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.025+0000 7f9172200640 1 -- start start 2024-09-05T01:26:45.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.026+0000 7f9172200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f916c103ff0 0x7f916c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:45.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.026+0000 7f9172200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f916c1049a0 0x7f916c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:45.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.026+0000 7f9172200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f916c109120 0x7f916c19eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:45.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.026+0000 7f9172200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f916c114140 con 0x7f916c1049a0 2024-09-05T01:26:45.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.026+0000 7f9172200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f916c113fc0 con 0x7f916c109120 2024-09-05T01:26:45.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.026+0000 7f9172200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f916c1142c0 con 0x7f916c103ff0 2024-09-05T01:26:45.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.026+0000 7f916aa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f916c1049a0 0x7f916c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:45.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.026+0000 7f916b400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f916c103ff0 0x7f916c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:45.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.026+0000 7f916aa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f916c1049a0 0x7f916c19ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38594/0 (socket says 172.21.15.12:38594) 2024-09-05T01:26:45.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.026+0000 7f916aa00640 1 -- 172.21.15.12:0/2610351411 learned_addr learned my addr 172.21.15.12:0/2610351411 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:45.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.026+0000 7f916aa00640 1 -- 172.21.15.12:0/2610351411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f916c103ff0 msgr2=0x7f916c19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:45.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.026+0000 7f916aa00640 1 --2- 172.21.15.12:0/2610351411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f916c103ff0 0x7f916c19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.026+0000 7f916aa00640 1 -- 172.21.15.12:0/2610351411 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f916c109120 msgr2=0x7f916c19eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:45.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.026+0000 7f916be00640 1 --2- 172.21.15.12:0/2610351411 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f916c109120 0x7f916c19eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:45.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.027+0000 7f916aa00640 1 --2- 172.21.15.12:0/2610351411 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f916c109120 0x7f916c19eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.027+0000 7f916aa00640 1 -- 172.21.15.12:0/2610351411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f916c19f5b0 con 0x7f916c1049a0 2024-09-05T01:26:45.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.027+0000 7f916be00640 1 --2- 172.21.15.12:0/2610351411 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f916c109120 0x7f916c19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:26:45.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.027+0000 7f916aa00640 1 --2- 172.21.15.12:0/2610351411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f916c1049a0 0x7f916c19ab40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f915800d770 tx=0x7f915800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:45.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.027+0000 7f9163e00640 1 -- 172.21.15.12:0/2610351411 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158017070 con 0x7f916c1049a0 2024-09-05T01:26:45.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.027+0000 7f9163e00640 1 -- 172.21.15.12:0/2610351411 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9158005500 con 0x7f916c1049a0 2024-09-05T01:26:45.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.027+0000 7f9172200640 1 -- 172.21.15.12:0/2610351411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f916c19f8a0 con 0x7f916c1049a0 2024-09-05T01:26:45.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.028+0000 7f9163e00640 1 -- 172.21.15.12:0/2610351411 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158004e00 con 0x7f916c1049a0 2024-09-05T01:26:45.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.028+0000 7f9172200640 1 -- 172.21.15.12:0/2610351411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f916c1a7180 con 0x7f916c1049a0 2024-09-05T01:26:45.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.032+0000 7f9174cc7740 1 Processor -- start 2024-09-05T01:26:45.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.032+0000 7f9174cc7740 1 -- start start 2024-09-05T01:26:45.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.033+0000 7f9174cc7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556de6c39c70 0x556de6c3a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:45.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.033+0000 7f9174cc7740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c3a590 0x556de6c44910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:45.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.033+0000 7f9174cc7740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556de6c44e50 0x556de6c47240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:45.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.033+0000 7f9174cc7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556de6ba03e0 con 0x556de6c39c70 2024-09-05T01:26:45.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.033+0000 7f9174cc7740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x556de6b47d80 con 0x556de6c44e50 2024-09-05T01:26:45.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.033+0000 7f9174cc7740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556de6b9c3a0 con 0x556de6c3a590 2024-09-05T01:26:45.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.033+0000 7f9163e00640 1 -- 172.21.15.12:0/2610351411 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f9158004fa0 con 0x7f916c1049a0 2024-09-05T01:26:45.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.033+0000 7f916b400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c3a590 0x556de6c44910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:45.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.033+0000 7f916b400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c3a590 0x556de6c44910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:54142/0 (socket says 172.21.15.12:54142) 2024-09-05T01:26:45.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.033+0000 7f916b400640 1 -- 172.21.15.12:0/1490837144 learned_addr learned my addr 172.21.15.12:0/1490837144 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:45.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.033+0000 7f916aa00640 1 --2- 172.21.15.12:0/1490837144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556de6c44e50 0x556de6c47240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:45.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.034+0000 7f916be00640 1 --2- 172.21.15.12:0/1490837144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556de6c39c70 0x556de6c3a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:45.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.034+0000 7f916b400640 1 -- 172.21.15.12:0/1490837144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556de6c44e50 msgr2=0x556de6c47240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:45.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.034+0000 7f916b400640 1 --2- 172.21.15.12:0/1490837144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556de6c44e50 0x556de6c47240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.034+0000 7f916b400640 1 -- 172.21.15.12:0/1490837144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556de6c39c70 msgr2=0x556de6c3a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:45.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.034+0000 7f916b400640 1 --2- 172.21.15.12:0/1490837144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556de6c39c70 0x556de6c3a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.034+0000 7f916b400640 1 -- 172.21.15.12:0/1490837144 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556de6b66ae0 con 0x556de6c3a590 2024-09-05T01:26:45.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.034+0000 7f916aa00640 1 --2- 172.21.15.12:0/1490837144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556de6c44e50 0x556de6c47240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:26:45.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.034+0000 7f916b400640 1 --2- 172.21.15.12:0/1490837144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c3a590 0x556de6c44910 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f915c009900 tx=0x7f915c005e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7daa4833f62d442d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:45.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.035+0000 7f9157e00640 1 -- 172.21.15.12:0/1490837144 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c040070 con 0x556de6c3a590 2024-09-05T01:26:45.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.035+0000 7f9157e00640 1 -- 172.21.15.12:0/1490837144 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f915c0318f0 con 0x556de6c3a590 2024-09-05T01:26:45.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.035+0000 7f9157e00640 1 -- 172.21.15.12:0/1490837144 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c035040 con 0x556de6c3a590 2024-09-05T01:26:45.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.035+0000 7f9163e00640 1 --2- 172.21.15.12:0/2610351411 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f91500a2cf0 0x7f91500a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:45.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.035+0000 7f9163e00640 1 -- 172.21.15.12:0/2610351411 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f91580cef50 con 0x7f916c1049a0 2024-09-05T01:26:45.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.035+0000 7f916be00640 1 --2- 172.21.15.12:0/2610351411 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f91500a2cf0 0x7f91500a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:45.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.035+0000 7f9174cc7740 1 -- 172.21.15.12:0/1490837144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c3a590 msgr2=0x556de6c44910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:45.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.035+0000 7f9174cc7740 1 --2- 172.21.15.12:0/1490837144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c3a590 0x556de6c44910 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f915c009900 tx=0x7f915c005e00 comp rx=0 tx=0).stop 2024-09-05T01:26:45.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.036+0000 7f9174cc7740 1 -- 172.21.15.12:0/1490837144 shutdown_connections 2024-09-05T01:26:45.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.036+0000 7f9174cc7740 1 --2- 172.21.15.12:0/1490837144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556de6c44e50 0x556de6c47240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.036+0000 7f9174cc7740 1 --2- 172.21.15.12:0/1490837144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c3a590 0x556de6c44910 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.036+0000 7f9174cc7740 1 --2- 172.21.15.12:0/1490837144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556de6c39c70 0x556de6c3a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.036+0000 7f9174cc7740 1 -- 172.21.15.12:0/1490837144 >> 172.21.15.12:0/1490837144 conn(0x556de6c36200 msgr2=0x556de6c365e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:45.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.036+0000 7f9174cc7740 1 -- 172.21.15.12:0/1490837144 shutdown_connections 2024-09-05T01:26:45.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.036+0000 7f9174cc7740 1 -- 172.21.15.12:0/1490837144 wait complete. 2024-09-05T01:26:45.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.036+0000 7f916be00640 1 --2- 172.21.15.12:0/2610351411 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f91500a2cf0 0x7f91500a51b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9164005fd0 tx=0x7f9164009500 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:45.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.037+0000 7f9174cc7740 1 -- start start 2024-09-05T01:26:45.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.037+0000 7f9174cc7740 1 Processor -- start 2024-09-05T01:26:45.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.038+0000 7f9174cc7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556de6c39c70 0x556de6c41ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:45.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.038+0000 7f9174cc7740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556de6c3a590 0x556de6c42220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:45.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.038+0000 7f9174cc7740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c44e50 0x556de6c42760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:45.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.038+0000 7f9174cc7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556de6c47a20 con 0x556de6c39c70 2024-09-05T01:26:45.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.038+0000 7f9174cc7740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x556de6b5b0f0 con 0x556de6c3a590 2024-09-05T01:26:45.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.038+0000 7f9174cc7740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556de6c47ba0 con 0x556de6c44e50 2024-09-05T01:26:45.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.038+0000 7f9174cc7740 10 client.0 _ll_register_callbacks cb 0x556de6b42bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:26:45.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.038+0000 7f916aa00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556de6c3a590 0x556de6c42220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:45.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.039+0000 7f916aa00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556de6c3a590 0x556de6c42220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:38838/0 (socket says 172.21.15.12:38838) 2024-09-05T01:26:45.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.039+0000 7f916aa00640 1 -- 172.21.15.12:0/2621614974 learned_addr learned my addr 172.21.15.12:0/2621614974 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:45.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.039+0000 7f916be00640 1 --2- 172.21.15.12:0/2621614974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c44e50 0x556de6c42760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:45.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.039+0000 7f916b400640 1 --2- 172.21.15.12:0/2621614974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556de6c39c70 0x556de6c41ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:45.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.039+0000 7f916be00640 1 -- 172.21.15.12:0/2621614974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556de6c3a590 msgr2=0x556de6c42220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:45.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.039+0000 7f916be00640 1 --2- 172.21.15.12:0/2621614974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556de6c3a590 0x556de6c42220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.039+0000 7f916be00640 1 -- 172.21.15.12:0/2621614974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556de6c39c70 msgr2=0x556de6c41ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:45.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.039+0000 7f916be00640 1 --2- 172.21.15.12:0/2621614974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556de6c39c70 0x556de6c41ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.039+0000 7f916be00640 1 -- 172.21.15.12:0/2621614974 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556de69113c0 con 0x556de6c44e50 2024-09-05T01:26:45.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.039+0000 7f916be00640 1 --2- 172.21.15.12:0/2621614974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c44e50 0x556de6c42760 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9164004410 tx=0x7f9164004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79ee5027b1e968e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:45.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.040+0000 7f9154c00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:26:45.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.040+0000 7f9154c00640 1 -- 172.21.15.12:0/2621614974 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916401f830 con 0x556de6c44e50 2024-09-05T01:26:45.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.040+0000 7f9154c00640 1 -- 172.21.15.12:0/2621614974 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f916401f9d0 con 0x556de6c44e50 2024-09-05T01:26:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.040+0000 7f9174cc7740 1 -- 172.21.15.12:0/2621614974 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f915c0318f0 con 0x556de6c44e50 2024-09-05T01:26:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.040+0000 7f9154c00640 1 -- 172.21.15.12:0/2621614974 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f916401fbd0 con 0x556de6c44e50 2024-09-05T01:26:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.040+0000 7f9174cc7740 10 client.25633 fetch_fsmap learned FSMap version 31 2024-09-05T01:26:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.040+0000 7f9174cc7740 1 -- 172.21.15.12:0/2621614974 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556de6c5c260 con 0x556de6c44e50 2024-09-05T01:26:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.040+0000 7f9154c00640 1 -- 172.21.15.12:0/2621614974 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f915c0318f0 con 0x556de6c44e50 2024-09-05T01:26:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.041+0000 7f9154c00640 1 -- 172.21.15.12:0/2621614974 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f916401d3b0 con 0x556de6c44e50 2024-09-05T01:26:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.041+0000 7f9174cc7740 10 client.25633 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T01:26:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.041+0000 7f9174cc7740 10 client.25633 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-05T01:26:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.041+0000 7f9174cc7740 20 client.25633 populate_metadata read hostname 'smithi012' 2024-09-05T01:26:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.041+0000 7f9174cc7740 1 --2- 172.21.15.12:0/2621614974 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x556de6c5d720 0x556de6c5fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.041+0000 7f9174cc7740 4 client.25633 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:26:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.041+0000 7f9174cc7740 1 -- 172.21.15.12:0/2621614974 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556de6bad950 con 0x556de6c5d720 2024-09-05T01:26:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.041+0000 7f916b400640 1 --2- 172.21.15.12:0/2621614974 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x556de6c5d720 0x556de6c5fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.042+0000 7f916b400640 1 --2- 172.21.15.12:0/2621614974 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x556de6c5d720 0x556de6c5fb70 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4337e7eb09d7967a server_cookie=b4edbfe0f5ec60d1 in_seq=0 out_seq=0 2024-09-05T01:26:45.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.042+0000 7f9154c00640 10 client.25633 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:26:45.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.042+0000 7f9154c00640 1 -- 172.21.15.12:0/2621614974 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556de6bad950 con 0x556de6c5d720 2024-09-05T01:26:45.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.042+0000 7f9154c00640 10 client.25633 handle_command_reply: tid=0 2024-09-05T01:26:45.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.042+0000 7f9174cc7740 1 client.25633 shutdown 2024-09-05T01:26:45.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.043+0000 7f9174cc7740 1 -- 172.21.15.12:0/2621614974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c44e50 msgr2=0x556de6c42760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:45.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.043+0000 7f9174cc7740 1 --2- 172.21.15.12:0/2621614974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c44e50 0x556de6c42760 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9164004410 tx=0x7f9164004a40 comp rx=0 tx=0).stop 2024-09-05T01:26:45.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.043+0000 7f9174cc7740 1 -- 172.21.15.12:0/2621614974 shutdown_connections 2024-09-05T01:26:45.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.043+0000 7f9174cc7740 1 --2- 172.21.15.12:0/2621614974 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x556de6c5d720 0x556de6c5fb70 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.043+0000 7f9174cc7740 1 --2- 172.21.15.12:0/2621614974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c44e50 0x556de6c42760 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.043+0000 7f9174cc7740 1 --2- 172.21.15.12:0/2621614974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556de6c3a590 0x556de6c42220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.043+0000 7f9174cc7740 1 --2- 172.21.15.12:0/2621614974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556de6c39c70 0x556de6c41ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.043+0000 7f9174cc7740 1 -- 172.21.15.12:0/2621614974 >> 172.21.15.12:0/2621614974 conn(0x556de6c36200 msgr2=0x556de6c3bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:45.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.043+0000 7f9154c00640 0 client.25633 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:26:45.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.043+0000 7f9174cc7740 1 -- 172.21.15.12:0/2621614974 shutdown_connections 2024-09-05T01:26:45.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.043+0000 7f9174cc7740 1 -- 172.21.15.12:0/2621614974 wait complete. 2024-09-05T01:26:45.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.043+0000 7f9174cc7740 20 client.25633 trim_cache size 0 max 16384 2024-09-05T01:26:45.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.058+0000 7f9174cc7740 1 Processor -- start 2024-09-05T01:26:45.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.058+0000 7f9174cc7740 1 -- start start 2024-09-05T01:26:45.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.059+0000 7f9174cc7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556de6c39c70 0x556de6c3c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:45.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.059+0000 7f9174cc7740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c3a590 0x556de6c35270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:45.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.059+0000 7f9174cc7740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556de6c44e50 0x556de6c65440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:45.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.059+0000 7f9174cc7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f916c1ab6d0 con 0x556de6c39c70 2024-09-05T01:26:45.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.059+0000 7f9174cc7740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f916c1ad2d0 con 0x556de6c44e50 2024-09-05T01:26:45.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.059+0000 7f9174cc7740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f916c1abda0 con 0x556de6c3a590 2024-09-05T01:26:45.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.059+0000 7f916aa00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c3a590 0x556de6c35270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:45.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.059+0000 7f916b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556de6c39c70 0x556de6c3c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:45.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.059+0000 7f916aa00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c3a590 0x556de6c35270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:54172/0 (socket says 172.21.15.12:54172) 2024-09-05T01:26:45.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.059+0000 7f916aa00640 1 -- 172.21.15.12:0/3413174035 learned_addr learned my addr 172.21.15.12:0/3413174035 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:45.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.059+0000 7f916be00640 1 --2- 172.21.15.12:0/3413174035 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556de6c44e50 0x556de6c65440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:45.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.059+0000 7f916aa00640 1 -- 172.21.15.12:0/3413174035 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556de6c44e50 msgr2=0x556de6c65440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:45.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.059+0000 7f916aa00640 1 --2- 172.21.15.12:0/3413174035 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556de6c44e50 0x556de6c65440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.059+0000 7f916aa00640 1 -- 172.21.15.12:0/3413174035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556de6c39c70 msgr2=0x556de6c3c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:45.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.059+0000 7f916aa00640 1 --2- 172.21.15.12:0/3413174035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556de6c39c70 0x556de6c3c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.059+0000 7f916aa00640 1 -- 172.21.15.12:0/3413174035 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556de6c36030 con 0x556de6c3a590 2024-09-05T01:26:45.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.059+0000 7f916be00640 1 --2- 172.21.15.12:0/3413174035 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556de6c44e50 0x556de6c65440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:26:45.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.060+0000 7f916aa00640 1 --2- 172.21.15.12:0/3413174035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c3a590 0x556de6c35270 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f91580a3b40 tx=0x7f9158097040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7caa72dec20f1995 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:45.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.060+0000 7f9157400640 1 -- 172.21.15.12:0/3413174035 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158020040 con 0x556de6c3a590 2024-09-05T01:26:45.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.060+0000 7f9157400640 1 -- 172.21.15.12:0/3413174035 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f915809bb00 con 0x556de6c3a590 2024-09-05T01:26:45.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.060+0000 7f9157400640 1 -- 172.21.15.12:0/3413174035 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158097a70 con 0x556de6c3a590 2024-09-05T01:26:45.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.061+0000 7f9174cc7740 1 -- 172.21.15.12:0/3413174035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c3a590 msgr2=0x556de6c35270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:45.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.061+0000 7f9174cc7740 1 --2- 172.21.15.12:0/3413174035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c3a590 0x556de6c35270 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f91580a3b40 tx=0x7f9158097040 comp rx=0 tx=0).stop 2024-09-05T01:26:45.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.061+0000 7f9174cc7740 1 -- 172.21.15.12:0/3413174035 shutdown_connections 2024-09-05T01:26:45.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.061+0000 7f9174cc7740 1 --2- 172.21.15.12:0/3413174035 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556de6c44e50 0x556de6c65440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.061+0000 7f9174cc7740 1 --2- 172.21.15.12:0/3413174035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c3a590 0x556de6c35270 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.061+0000 7f9174cc7740 1 --2- 172.21.15.12:0/3413174035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556de6c39c70 0x556de6c3c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.061+0000 7f9174cc7740 1 -- 172.21.15.12:0/3413174035 >> 172.21.15.12:0/3413174035 conn(0x556de6c36200 msgr2=0x556de6c34b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:45.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.061+0000 7f9174cc7740 1 -- 172.21.15.12:0/3413174035 shutdown_connections 2024-09-05T01:26:45.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.061+0000 7f9174cc7740 1 -- 172.21.15.12:0/3413174035 wait complete. 2024-09-05T01:26:45.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.062+0000 7f9174cc7740 1 -- start start 2024-09-05T01:26:45.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.062+0000 7f9174cc7740 1 Processor -- start 2024-09-05T01:26:45.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.063+0000 7f9174cc7740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c39c70 0x556de6c3ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:45.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.063+0000 7f9174cc7740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556de6c3a590 0x556de6c3f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:45.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.063+0000 7f9174cc7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556de6c44e50 0x556de6c3f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:45.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.063+0000 7f9174cc7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f916c1acb40 con 0x556de6c44e50 2024-09-05T01:26:45.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.063+0000 7f9174cc7740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f916c1ac470 con 0x556de6c3a590 2024-09-05T01:26:45.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.063+0000 7f9174cc7740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f916c1a96b0 con 0x556de6c39c70 2024-09-05T01:26:45.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.063+0000 7f9174cc7740 10 client.0 _ll_register_callbacks cb 0x7f9164003f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:26:45.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.063+0000 7f916b400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c39c70 0x556de6c3ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:45.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.063+0000 7f916b400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c39c70 0x556de6c3ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:54180/0 (socket says 172.21.15.12:54180) 2024-09-05T01:26:45.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.063+0000 7f916b400640 1 -- 172.21.15.12:0/289178786 learned_addr learned my addr 172.21.15.12:0/289178786 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:45.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.063+0000 7f916aa00640 1 --2- 172.21.15.12:0/289178786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556de6c3a590 0x556de6c3f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:45.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.063+0000 7f916be00640 1 --2- 172.21.15.12:0/289178786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556de6c44e50 0x556de6c3f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:45.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.064+0000 7f916b400640 1 -- 172.21.15.12:0/289178786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556de6c3a590 msgr2=0x556de6c3f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:45.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.064+0000 7f916b400640 1 --2- 172.21.15.12:0/289178786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556de6c3a590 0x556de6c3f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.064+0000 7f916b400640 1 -- 172.21.15.12:0/289178786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556de6c44e50 msgr2=0x556de6c3f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:45.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.064+0000 7f916b400640 1 --2- 172.21.15.12:0/289178786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556de6c44e50 0x556de6c3f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.064+0000 7f916b400640 1 -- 172.21.15.12:0/289178786 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556de6c36e90 con 0x556de6c39c70 2024-09-05T01:26:45.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.064+0000 7f916b400640 1 --2- 172.21.15.12:0/289178786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c39c70 0x556de6c3ed20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x556de6c37060 tx=0x7f915c005510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccd67ac7f6d7386a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:45.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.064+0000 7f9154c00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:26:45.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.064+0000 7f9154c00640 1 -- 172.21.15.12:0/289178786 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c040040 con 0x556de6c39c70 2024-09-05T01:26:45.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.064+0000 7f9154c00640 1 -- 172.21.15.12:0/289178786 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f915c004030 con 0x556de6c39c70 2024-09-05T01:26:45.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.064+0000 7f9174cc7740 1 -- 172.21.15.12:0/289178786 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f915809bb00 con 0x556de6c39c70 2024-09-05T01:26:45.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.064+0000 7f9154c00640 1 -- 172.21.15.12:0/289178786 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f915c05d050 con 0x556de6c39c70 2024-09-05T01:26:45.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.065+0000 7f9174cc7740 10 client.25639 fetch_fsmap learned FSMap version 31 2024-09-05T01:26:45.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.065+0000 7f9174cc7740 1 -- 172.21.15.12:0/289178786 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556de6c31770 con 0x556de6c39c70 2024-09-05T01:26:45.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.065+0000 7f9154c00640 1 -- 172.21.15.12:0/289178786 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f915809bb00 con 0x556de6c39c70 2024-09-05T01:26:45.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.065+0000 7f9154c00640 1 -- 172.21.15.12:0/289178786 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f915c058030 con 0x556de6c39c70 2024-09-05T01:26:45.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.065+0000 7f9174cc7740 10 client.25639 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T01:26:45.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.065+0000 7f9174cc7740 10 client.25639 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-05T01:26:45.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.065+0000 7f9174cc7740 20 client.25639 populate_metadata read hostname 'smithi012' 2024-09-05T01:26:45.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.065+0000 7f9174cc7740 1 --2- 172.21.15.12:0/289178786 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x556de6cc8800 0x556de6ccabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:45.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.065+0000 7f9174cc7740 4 client.25639 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:26:45.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.065+0000 7f9174cc7740 1 -- 172.21.15.12:0/289178786 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556de6ba7e60 con 0x556de6cc8800 2024-09-05T01:26:45.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.065+0000 7f916aa00640 1 --2- 172.21.15.12:0/289178786 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x556de6cc8800 0x556de6ccabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:45.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.066+0000 7f916aa00640 1 --2- 172.21.15.12:0/289178786 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x556de6cc8800 0x556de6ccabf0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=192bd5f8b52df5f server_cookie=2fde75432c4fe2c4 in_seq=0 out_seq=0 2024-09-05T01:26:45.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.066+0000 7f9154c00640 10 client.25639 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:26:45.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.066+0000 7f9154c00640 1 -- 172.21.15.12:0/289178786 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556de6ba7e60 con 0x556de6cc8800 2024-09-05T01:26:45.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.066+0000 7f9154c00640 10 client.25639 handle_command_reply: tid=0 2024-09-05T01:26:45.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.066+0000 7f9174cc7740 1 client.25639 shutdown 2024-09-05T01:26:45.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.067+0000 7f9174cc7740 1 -- 172.21.15.12:0/289178786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c39c70 msgr2=0x556de6c3ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:45.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.067+0000 7f9174cc7740 1 --2- 172.21.15.12:0/289178786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c39c70 0x556de6c3ed20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x556de6c37060 tx=0x7f915c005510 comp rx=0 tx=0).stop 2024-09-05T01:26:45.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.067+0000 7f9174cc7740 1 -- 172.21.15.12:0/289178786 shutdown_connections 2024-09-05T01:26:45.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.067+0000 7f9174cc7740 1 --2- 172.21.15.12:0/289178786 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x556de6cc8800 0x556de6ccabf0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.067+0000 7f9174cc7740 1 --2- 172.21.15.12:0/289178786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556de6c44e50 0x556de6c3f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.067+0000 7f9174cc7740 1 --2- 172.21.15.12:0/289178786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556de6c3a590 0x556de6c3f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.067+0000 7f9174cc7740 1 --2- 172.21.15.12:0/289178786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556de6c39c70 0x556de6c3ed20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.067+0000 7f9154c00640 0 client.25639 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:26:45.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.067+0000 7f9174cc7740 1 -- 172.21.15.12:0/289178786 >> 172.21.15.12:0/289178786 conn(0x556de6c36200 msgr2=0x556de6c35380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:45.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.067+0000 7f9174cc7740 1 -- 172.21.15.12:0/289178786 shutdown_connections 2024-09-05T01:26:45.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.067+0000 7f9174cc7740 1 -- 172.21.15.12:0/289178786 wait complete. 2024-09-05T01:26:45.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.067+0000 7f9174cc7740 20 client.25639 trim_cache size 0 max 16384 2024-09-05T01:26:45.071 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:26:45.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.068+0000 7f9172200640 1 -- 172.21.15.12:0/2610351411 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f91500a2cf0 msgr2=0x7f91500a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:45.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.068+0000 7f9172200640 1 --2- 172.21.15.12:0/2610351411 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f91500a2cf0 0x7f91500a51b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9164005fd0 tx=0x7f9164009500 comp rx=0 tx=0).stop 2024-09-05T01:26:45.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.068+0000 7f9172200640 1 -- 172.21.15.12:0/2610351411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f916c1049a0 msgr2=0x7f916c19ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:45.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.068+0000 7f9172200640 1 --2- 172.21.15.12:0/2610351411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f916c1049a0 0x7f916c19ab40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f915800d770 tx=0x7f915800dc30 comp rx=0 tx=0).stop 2024-09-05T01:26:45.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.068+0000 7f9172200640 1 -- 172.21.15.12:0/2610351411 shutdown_connections 2024-09-05T01:26:45.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.068+0000 7f9172200640 1 --2- 172.21.15.12:0/2610351411 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f91500a2cf0 0x7f91500a51b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.068+0000 7f9172200640 1 --2- 172.21.15.12:0/2610351411 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f916c109120 0x7f916c19eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.068+0000 7f9172200640 1 --2- 172.21.15.12:0/2610351411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f916c1049a0 0x7f916c19ab40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.068+0000 7f9172200640 1 --2- 172.21.15.12:0/2610351411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f916c103ff0 0x7f916c19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:45.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.068+0000 7f9172200640 1 -- 172.21.15.12:0/2610351411 >> 172.21.15.12:0/2610351411 conn(0x7f916c0ffa90 msgr2=0x7f916c100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:45.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.068+0000 7f9172200640 1 -- 172.21.15.12:0/2610351411 shutdown_connections 2024-09-05T01:26:45.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:45.068+0000 7f9172200640 1 -- 172.21.15.12:0/2610351411 wait complete. 2024-09-05T01:26:45.369 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:45 smithi012 ceph-mon[29942]: pgmap v64: 97 pgs: 97 active+clean; 69 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 159 op/s 2024-09-05T01:26:45.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:45 smithi145 ceph-mon[34376]: pgmap v64: 97 pgs: 97 active+clean; 69 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 159 op/s 2024-09-05T01:26:45.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:45 smithi151 ceph-mon[35013]: pgmap v64: 97 pgs: 97 active+clean; 69 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 159 op/s 2024-09-05T01:26:46.172 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-05T01:26:46.823 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:26:47.240 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:47 smithi012 ceph-mon[29942]: pgmap v65: 97 pgs: 97 active+clean; 69 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 53 op/s 2024-09-05T01:26:47.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:47 smithi145 ceph-mon[34376]: pgmap v65: 97 pgs: 97 active+clean; 69 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 53 op/s 2024-09-05T01:26:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:47 smithi151 ceph-mon[35013]: pgmap v65: 97 pgs: 97 active+clean; 69 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 53 op/s 2024-09-05T01:26:47.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.825+0000 7f783fe00640 1 -- 172.21.15.12:0/756176668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7840103e30 msgr2=0x7f7840104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:47.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.825+0000 7f783fe00640 1 --2- 172.21.15.12:0/756176668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7840103e30 0x7f7840104210 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7830009900 tx=0x7f783002a410 comp rx=0 tx=0).stop 2024-09-05T01:26:47.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.825+0000 7f783fe00640 1 -- 172.21.15.12:0/756176668 shutdown_connections 2024-09-05T01:26:47.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.825+0000 7f783fe00640 1 --2- 172.21.15.12:0/756176668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7840108f60 0x7f7840110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.825+0000 7f783fe00640 1 --2- 172.21.15.12:0/756176668 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f78401047e0 0x7f7840108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.825+0000 7f783fe00640 1 --2- 172.21.15.12:0/756176668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7840103e30 0x7f7840104210 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7830009900 tx=0x7f783002a410 comp rx=0 tx=0).stop 2024-09-05T01:26:47.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.825+0000 7f783fe00640 1 -- 172.21.15.12:0/756176668 >> 172.21.15.12:0/756176668 conn(0x7f78400ff910 msgr2=0x7f7840101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:47.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.826+0000 7f783fe00640 1 -- 172.21.15.12:0/756176668 shutdown_connections 2024-09-05T01:26:47.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.826+0000 7f783fe00640 1 -- 172.21.15.12:0/756176668 wait complete. 2024-09-05T01:26:47.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.828+0000 7f783fe00640 1 Processor -- start 2024-09-05T01:26:47.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.828+0000 7f783fe00640 1 -- start start 2024-09-05T01:26:47.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.830+0000 7f783fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78401047e0 0x7f784010f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:47.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.830+0000 7f783fe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7840108f60 0x7f784010fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:47.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.830+0000 7f783fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78401a3460 0x7f78401a38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:47.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.830+0000 7f783e000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7840108f60 0x7f784010fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:47.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.830+0000 7f783e000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7840108f60 0x7f784010fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:52160/0 (socket says 172.21.15.12:52160) 2024-09-05T01:26:47.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.831+0000 7f783f400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78401a3460 0x7f78401a38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:47.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.831+0000 7f783f400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78401a3460 0x7f78401a38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:36690/0 (socket says 172.21.15.12:36690) 2024-09-05T01:26:47.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.831+0000 7f783f400640 1 -- 172.21.15.12:0/750107513 learned_addr learned my addr 172.21.15.12:0/750107513 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:47.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.831+0000 7f783fe00640 1 -- 172.21.15.12:0/750107513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f78400777d0 con 0x7f78401047e0 2024-09-05T01:26:47.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.831+0000 7f783fe00640 1 -- 172.21.15.12:0/750107513 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7840077650 con 0x7f7840108f60 2024-09-05T01:26:47.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.831+0000 7f783fe00640 1 -- 172.21.15.12:0/750107513 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7840077950 con 0x7f78401a3460 2024-09-05T01:26:47.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.831+0000 7f783f400640 1 -- 172.21.15.12:0/750107513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7840108f60 msgr2=0x7f784010fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:47.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.831+0000 7f783f400640 1 --2- 172.21.15.12:0/750107513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7840108f60 0x7f784010fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.831+0000 7f783f400640 1 -- 172.21.15.12:0/750107513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78401047e0 msgr2=0x7f784010f7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T01:26:47.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.833+0000 7f783ea00640 1 --2- 172.21.15.12:0/750107513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78401047e0 0x7f784010f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:47.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.833+0000 7f783f400640 1 --2- 172.21.15.12:0/750107513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78401047e0 0x7f784010f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.833+0000 7f783f400640 1 -- 172.21.15.12:0/750107513 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78401a3f20 con 0x7f78401a3460 2024-09-05T01:26:47.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.834+0000 7f783f400640 1 --2- 172.21.15.12:0/750107513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78401a3460 0x7f78401a38e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7838009fd0 tx=0x7f783800b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:47.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.835+0000 7f7837400640 1 -- 172.21.15.12:0/750107513 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838017070 con 0x7f78401a3460 2024-09-05T01:26:47.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.835+0000 7f783fe00640 1 -- 172.21.15.12:0/750107513 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78401a4210 con 0x7f78401a3460 2024-09-05T01:26:47.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.835+0000 7f783fe00640 1 -- 172.21.15.12:0/750107513 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78401ab9d0 con 0x7f78401a3460 2024-09-05T01:26:47.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.835+0000 7f7837400640 1 -- 172.21.15.12:0/750107513 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7838003e50 con 0x7f78401a3460 2024-09-05T01:26:47.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.835+0000 7f7837400640 1 -- 172.21.15.12:0/750107513 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838017070 con 0x7f78401a3460 2024-09-05T01:26:47.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.840+0000 7f7837400640 1 -- 172.21.15.12:0/750107513 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f7838010460 con 0x7f78401a3460 2024-09-05T01:26:47.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.841+0000 7f78487d9740 1 Processor -- start 2024-09-05T01:26:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.844+0000 7f7837400640 1 --2- 172.21.15.12:0/750107513 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f78240a2fa0 0x7f78240a5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.844+0000 7f78487d9740 1 -- start start 2024-09-05T01:26:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.844+0000 7f78487d9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562edb087e40 0x562edb088220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.844+0000 7f78487d9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562edb088760 0x562edb092ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.844+0000 7f78487d9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562edb093020 0x562edb095410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.845+0000 7f783f400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562edb093020 0x562edb095410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.845+0000 7f783f400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562edb093020 0x562edb095410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:52166/0 (socket says 172.21.15.12:52166) 2024-09-05T01:26:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.845+0000 7f783f400640 1 -- 172.21.15.12:0/920827970 learned_addr learned my addr 172.21.15.12:0/920827970 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:47.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.845+0000 7f78487d9740 1 -- 172.21.15.12:0/920827970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562edafee3e0 con 0x562edb087e40 2024-09-05T01:26:47.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.845+0000 7f78487d9740 1 -- 172.21.15.12:0/920827970 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x562edaf95d80 con 0x562edb093020 2024-09-05T01:26:47.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.845+0000 7f78487d9740 1 -- 172.21.15.12:0/920827970 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562edafea3a0 con 0x562edb088760 2024-09-05T01:26:47.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.845+0000 7f783f400640 1 -- 172.21.15.12:0/920827970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562edb088760 msgr2=0x562edb092ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:26:47.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.845+0000 7f783f400640 1 --2- 172.21.15.12:0/920827970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562edb088760 0x562edb092ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.845+0000 7f783f400640 1 -- 172.21.15.12:0/920827970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562edb087e40 msgr2=0x562edb088220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:26:47.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.846+0000 7f7837400640 1 -- 172.21.15.12:0/750107513 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f78380cecf0 con 0x7f78401a3460 2024-09-05T01:26:47.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.846+0000 7f783ea00640 1 --2- 172.21.15.12:0/920827970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562edb087e40 0x562edb088220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:47.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.846+0000 7f783e000640 1 --2- 172.21.15.12:0/750107513 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f78240a2fa0 0x7f78240a5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:47.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.850+0000 7f783f400640 1 --2- 172.21.15.12:0/920827970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562edb087e40 0x562edb088220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.850+0000 7f783f400640 1 -- 172.21.15.12:0/920827970 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562edafb4ae0 con 0x562edb093020 2024-09-05T01:26:47.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.850+0000 7f783f400640 1 --2- 172.21.15.12:0/920827970 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562edb093020 0x562edb095410 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f78380099a0 tx=0x7f7838015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e360411dfb28e80a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:47.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.850+0000 7f782be00640 1 -- 172.21.15.12:0/920827970 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838020070 con 0x562edb093020 2024-09-05T01:26:47.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.851+0000 7f782be00640 1 -- 172.21.15.12:0/920827970 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f783809c8c0 con 0x562edb093020 2024-09-05T01:26:47.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.851+0000 7f783ea00640 1 --2- 172.21.15.12:0/920827970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562edb087e40 0x562edb088220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:26:47.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.851+0000 7f78487d9740 1 -- 172.21.15.12:0/920827970 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562edb093020 msgr2=0x562edb095410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:47.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.852+0000 7f782be00640 1 -- 172.21.15.12:0/920827970 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838020070 con 0x562edb093020 2024-09-05T01:26:47.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.852+0000 7f78487d9740 1 --2- 172.21.15.12:0/920827970 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562edb093020 0x562edb095410 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f78380099a0 tx=0x7f7838015000 comp rx=0 tx=0).stop 2024-09-05T01:26:47.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.852+0000 7f783e000640 1 --2- 172.21.15.12:0/750107513 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f78240a2fa0 0x7f78240a5460 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x562edb085230 tx=0x7f782c005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:47.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.852+0000 7f78487d9740 1 -- 172.21.15.12:0/920827970 shutdown_connections 2024-09-05T01:26:47.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.852+0000 7f78487d9740 1 --2- 172.21.15.12:0/920827970 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562edb093020 0x562edb095410 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.852+0000 7f78487d9740 1 --2- 172.21.15.12:0/920827970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562edb088760 0x562edb092ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.852+0000 7f78487d9740 1 --2- 172.21.15.12:0/920827970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562edb087e40 0x562edb088220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.852+0000 7f78487d9740 1 -- 172.21.15.12:0/920827970 >> 172.21.15.12:0/920827970 conn(0x562edb0843d0 msgr2=0x562edb0847b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:47.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.853+0000 7f78487d9740 1 -- 172.21.15.12:0/920827970 shutdown_connections 2024-09-05T01:26:47.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.853+0000 7f78487d9740 1 -- 172.21.15.12:0/920827970 wait complete. 2024-09-05T01:26:47.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.853+0000 7f78487d9740 1 -- start start 2024-09-05T01:26:47.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.854+0000 7f78487d9740 1 Processor -- start 2024-09-05T01:26:47.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.855+0000 7f78487d9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562edb087e40 0x562edb08fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:47.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.856+0000 7f783ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562edb087e40 0x562edb08fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:47.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.857+0000 7f783ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562edb087e40 0x562edb08fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57014/0 (socket says 172.21.15.12:57014) 2024-09-05T01:26:47.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.857+0000 7f783ea00640 1 -- 172.21.15.12:0/3010761705 learned_addr learned my addr 172.21.15.12:0/3010761705 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:47.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.857+0000 7f78487d9740 1 --2- 172.21.15.12:0/3010761705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562edb088760 0x562edb090400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:47.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.857+0000 7f783e000640 1 --2- 172.21.15.12:0/3010761705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562edb088760 0x562edb090400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:47.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.857+0000 7f78487d9740 1 --2- 172.21.15.12:0/3010761705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562edb093020 0x562edb090940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:47.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.858+0000 7f78487d9740 1 -- 172.21.15.12:0/3010761705 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562edb095bf0 con 0x562edb087e40 2024-09-05T01:26:47.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.858+0000 7f783f400640 1 --2- 172.21.15.12:0/3010761705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562edb093020 0x562edb090940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:47.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.858+0000 7f78487d9740 1 -- 172.21.15.12:0/3010761705 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x562edafa90f0 con 0x562edb088760 2024-09-05T01:26:47.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.858+0000 7f78487d9740 1 -- 172.21.15.12:0/3010761705 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562edb095d70 con 0x562edb093020 2024-09-05T01:26:47.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.860+0000 7f78487d9740 10 client.0 _ll_register_callbacks cb 0x562edaf90bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:26:47.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.860+0000 7f783f400640 1 -- 172.21.15.12:0/3010761705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562edb088760 msgr2=0x562edb090400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:47.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.860+0000 7f783f400640 1 --2- 172.21.15.12:0/3010761705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562edb088760 0x562edb090400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.860+0000 7f783f400640 1 -- 172.21.15.12:0/3010761705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562edb087e40 msgr2=0x562edb08fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:47.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.860+0000 7f783f400640 1 --2- 172.21.15.12:0/3010761705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562edb087e40 0x562edb08fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.860+0000 7f783f400640 1 -- 172.21.15.12:0/3010761705 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562edad5f3c0 con 0x562edb093020 2024-09-05T01:26:47.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.860+0000 7f783e000640 1 --2- 172.21.15.12:0/3010761705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562edb088760 0x562edb090400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:26:47.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.861+0000 7f783ea00640 1 --2- 172.21.15.12:0/3010761705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562edb087e40 0x562edb08fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:26:47.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.865+0000 7f783f400640 1 --2- 172.21.15.12:0/3010761705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562edb093020 0x562edb090940 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f783809ca70 tx=0x7f7838098a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5495a1cf053aa87 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:47.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.865+0000 7f7828c00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:26:47.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.865+0000 7f7828c00640 1 -- 172.21.15.12:0/3010761705 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838020070 con 0x562edb093020 2024-09-05T01:26:47.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.865+0000 7f7828c00640 1 -- 172.21.15.12:0/3010761705 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f78380bb300 con 0x562edb093020 2024-09-05T01:26:47.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.866+0000 7f78487d9740 1 -- 172.21.15.12:0/3010761705 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f783809c8c0 con 0x562edb093020 2024-09-05T01:26:47.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.866+0000 7f7828c00640 1 -- 172.21.15.12:0/3010761705 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f78380b81b0 con 0x562edb093020 2024-09-05T01:26:47.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.866+0000 7f78487d9740 10 client.25648 fetch_fsmap learned FSMap version 31 2024-09-05T01:26:47.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.866+0000 7f78487d9740 1 -- 172.21.15.12:0/3010761705 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562edb095bf0 con 0x562edb093020 2024-09-05T01:26:47.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.867+0000 7f7828c00640 1 -- 172.21.15.12:0/3010761705 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f783809c8c0 con 0x562edb093020 2024-09-05T01:26:47.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.871+0000 7f7828c00640 1 -- 172.21.15.12:0/3010761705 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f7838097f10 con 0x562edb093020 2024-09-05T01:26:47.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.871+0000 7f78487d9740 10 client.25648 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T01:26:47.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.871+0000 7f78487d9740 10 client.25648 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T01:26:47.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.871+0000 7f78487d9740 20 client.25648 populate_metadata read hostname 'smithi012' 2024-09-05T01:26:47.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.871+0000 7f78487d9740 1 --2- 172.21.15.12:0/3010761705 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x562edb0a2cc0 0x562edb0a50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:47.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.871+0000 7f78487d9740 4 client.25648 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:26:47.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.871+0000 7f78487d9740 1 -- 172.21.15.12:0/3010761705 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562edaffb950 con 0x562edb0a2cc0 2024-09-05T01:26:47.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.871+0000 7f783ea00640 1 --2- 172.21.15.12:0/3010761705 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x562edb0a2cc0 0x562edb0a50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:47.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.872+0000 7f7828c00640 10 client.25648 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:26:47.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.872+0000 7f783ea00640 1 --2- 172.21.15.12:0/3010761705 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x562edb0a2cc0 0x562edb0a50b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a493722e060f414d server_cookie=f4eab121e47f6730 in_seq=0 out_seq=0 2024-09-05T01:26:47.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.873+0000 7f7828c00640 1 -- 172.21.15.12:0/3010761705 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562edaffb950 con 0x562edb0a2cc0 2024-09-05T01:26:47.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.873+0000 7f7828c00640 10 client.25648 handle_command_reply: tid=0 2024-09-05T01:26:47.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.873+0000 7f78487d9740 1 client.25648 shutdown 2024-09-05T01:26:47.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.874+0000 7f78487d9740 1 -- 172.21.15.12:0/3010761705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562edb093020 msgr2=0x562edb090940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:47.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.874+0000 7f78487d9740 1 --2- 172.21.15.12:0/3010761705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562edb093020 0x562edb090940 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f783809ca70 tx=0x7f7838098a60 comp rx=0 tx=0).stop 2024-09-05T01:26:47.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.874+0000 7f78487d9740 1 -- 172.21.15.12:0/3010761705 shutdown_connections 2024-09-05T01:26:47.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.874+0000 7f78487d9740 1 --2- 172.21.15.12:0/3010761705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562edb093020 0x562edb090940 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.874+0000 7f78487d9740 1 --2- 172.21.15.12:0/3010761705 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x562edb0a2cc0 0x562edb0a50b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.874+0000 7f7828c00640 0 client.25648 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:26:47.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.874+0000 7f78487d9740 1 --2- 172.21.15.12:0/3010761705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562edb088760 0x562edb090400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.874+0000 7f78487d9740 1 --2- 172.21.15.12:0/3010761705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562edb087e40 0x562edb08fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.874+0000 7f78487d9740 1 -- 172.21.15.12:0/3010761705 >> 172.21.15.12:0/3010761705 conn(0x562edb0843d0 msgr2=0x562edb08a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:47.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.874+0000 7f78487d9740 1 -- 172.21.15.12:0/3010761705 shutdown_connections 2024-09-05T01:26:47.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.874+0000 7f78487d9740 1 -- 172.21.15.12:0/3010761705 wait complete. 2024-09-05T01:26:47.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.875+0000 7f78487d9740 20 client.25648 trim_cache size 0 max 16384 2024-09-05T01:26:47.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.910+0000 7f78487d9740 1 Processor -- start 2024-09-05T01:26:47.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.910+0000 7f78487d9740 1 -- start start 2024-09-05T01:26:47.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.914+0000 7f78487d9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562edb087e40 0x562edb090790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:47.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.914+0000 7f78487d9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562edb088760 0x562edb0aa930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:47.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.914+0000 7f78487d9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562edb093020 0x562edb0aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:47.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.914+0000 7f78487d9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f782000e780 con 0x562edb088760 2024-09-05T01:26:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.914+0000 7f78487d9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7820010380 con 0x562edb093020 2024-09-05T01:26:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.914+0000 7f78487d9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f782000ee50 con 0x562edb087e40 2024-09-05T01:26:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.915+0000 7f783ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562edb087e40 0x562edb090790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.915+0000 7f783ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562edb087e40 0x562edb090790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:36698/0 (socket says 172.21.15.12:36698) 2024-09-05T01:26:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.915+0000 7f783ea00640 1 -- 172.21.15.12:0/4015268998 learned_addr learned my addr 172.21.15.12:0/4015268998 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.915+0000 7f783e000640 1 --2- 172.21.15.12:0/4015268998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562edb088760 0x562edb0aa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.915+0000 7f783ea00640 1 -- 172.21.15.12:0/4015268998 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562edb093020 msgr2=0x562edb0aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.915+0000 7f783ea00640 1 --2- 172.21.15.12:0/4015268998 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562edb093020 0x562edb0aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.915+0000 7f783ea00640 1 -- 172.21.15.12:0/4015268998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562edb088760 msgr2=0x562edb0aa930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.915+0000 7f783ea00640 1 --2- 172.21.15.12:0/4015268998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562edb088760 0x562edb0aa930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.915+0000 7f783ea00640 1 -- 172.21.15.12:0/4015268998 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562edb0a5420 con 0x562edb087e40 2024-09-05T01:26:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.916+0000 7f783e000640 1 --2- 172.21.15.12:0/4015268998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562edb088760 0x562edb0aa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:26:47.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.916+0000 7f783ea00640 1 --2- 172.21.15.12:0/4015268998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562edb087e40 0x562edb090790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f783002aa00 tx=0x7f7830009510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bc29cf69c95291f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:47.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.917+0000 7f782b400640 1 -- 172.21.15.12:0/4015268998 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7830035040 con 0x562edb087e40 2024-09-05T01:26:47.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.917+0000 7f782b400640 1 -- 172.21.15.12:0/4015268998 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7830005520 con 0x562edb087e40 2024-09-05T01:26:47.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.917+0000 7f782b400640 1 -- 172.21.15.12:0/4015268998 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7830035040 con 0x562edb087e40 2024-09-05T01:26:47.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.923+0000 7f78487d9740 1 -- 172.21.15.12:0/4015268998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562edb087e40 msgr2=0x562edb090790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:47.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.923+0000 7f78487d9740 1 --2- 172.21.15.12:0/4015268998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562edb087e40 0x562edb090790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f783002aa00 tx=0x7f7830009510 comp rx=0 tx=0).stop 2024-09-05T01:26:47.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.923+0000 7f78487d9740 1 -- 172.21.15.12:0/4015268998 shutdown_connections 2024-09-05T01:26:47.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.923+0000 7f78487d9740 1 --2- 172.21.15.12:0/4015268998 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562edb093020 0x562edb0aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.923+0000 7f78487d9740 1 --2- 172.21.15.12:0/4015268998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562edb088760 0x562edb0aa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.923+0000 7f78487d9740 1 --2- 172.21.15.12:0/4015268998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562edb087e40 0x562edb090790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.923+0000 7f78487d9740 1 -- 172.21.15.12:0/4015268998 >> 172.21.15.12:0/4015268998 conn(0x562edb0843d0 msgr2=0x562edb08b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:47.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.923+0000 7f78487d9740 1 -- 172.21.15.12:0/4015268998 shutdown_connections 2024-09-05T01:26:47.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.924+0000 7f78487d9740 1 -- 172.21.15.12:0/4015268998 wait complete. 2024-09-05T01:26:47.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.924+0000 7f78487d9740 1 -- start start 2024-09-05T01:26:47.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.924+0000 7f78487d9740 1 Processor -- start 2024-09-05T01:26:47.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.925+0000 7f78487d9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562edb087e40 0x562edb096490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:47.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.925+0000 7f78487d9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562edb088760 0x562edb0969d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:47.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.925+0000 7f78487d9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562edb093020 0x562edb11c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:47.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.926+0000 7f783ea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562edb087e40 0x562edb096490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:47.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.926+0000 7f783ea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562edb087e40 0x562edb096490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:52192/0 (socket says 172.21.15.12:52192) 2024-09-05T01:26:47.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.926+0000 7f783ea00640 1 -- 172.21.15.12:0/1335433514 learned_addr learned my addr 172.21.15.12:0/1335433514 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:47.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.926+0000 7f78487d9740 1 -- 172.21.15.12:0/1335433514 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f782000fbf0 con 0x562edb093020 2024-09-05T01:26:47.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.926+0000 7f78487d9740 1 -- 172.21.15.12:0/1335433514 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f782000f520 con 0x562edb087e40 2024-09-05T01:26:47.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.926+0000 7f78487d9740 1 -- 172.21.15.12:0/1335433514 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f782000c760 con 0x562edb088760 2024-09-05T01:26:47.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.927+0000 7f78487d9740 10 client.0 _ll_register_callbacks cb 0x7f78380b46b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:26:47.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.927+0000 7f783f400640 1 --2- 172.21.15.12:0/1335433514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562edb093020 0x562edb11c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:47.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.928+0000 7f783ea00640 1 -- 172.21.15.12:0/1335433514 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562edb088760 msgr2=0x562edb0969d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:26:47.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.928+0000 7f783ea00640 1 --2- 172.21.15.12:0/1335433514 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562edb088760 0x562edb0969d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.928+0000 7f783ea00640 1 -- 172.21.15.12:0/1335433514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562edb093020 msgr2=0x562edb11c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:47.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.928+0000 7f783ea00640 1 --2- 172.21.15.12:0/1335433514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562edb093020 0x562edb11c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.928+0000 7f783ea00640 1 -- 172.21.15.12:0/1335433514 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562edb11ce40 con 0x562edb087e40 2024-09-05T01:26:47.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.929+0000 7f7828c00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:26:47.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.929+0000 7f783ea00640 1 --2- 172.21.15.12:0/1335433514 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562edb087e40 0x562edb096490 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7830000c00 tx=0x7f7830004f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67a428d17658b39d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:47.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.930+0000 7f7828c00640 1 -- 172.21.15.12:0/1335433514 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7830075060 con 0x562edb087e40 2024-09-05T01:26:47.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.930+0000 7f78487d9740 1 -- 172.21.15.12:0/1335433514 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7830005520 con 0x562edb087e40 2024-09-05T01:26:47.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.930+0000 7f7828c00640 1 -- 172.21.15.12:0/1335433514 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f7830043030 con 0x562edb087e40 2024-09-05T01:26:47.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.930+0000 7f7828c00640 1 -- 172.21.15.12:0/1335433514 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7830075060 con 0x562edb087e40 2024-09-05T01:26:47.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.930+0000 7f78487d9740 10 client.25655 fetch_fsmap learned FSMap version 31 2024-09-05T01:26:47.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.930+0000 7f78487d9740 1 -- 172.21.15.12:0/1335433514 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562edb106940 con 0x562edb087e40 2024-09-05T01:26:47.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.931+0000 7f7828c00640 1 -- 172.21.15.12:0/1335433514 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7830005520 con 0x562edb087e40 2024-09-05T01:26:47.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.931+0000 7f7828c00640 1 -- 172.21.15.12:0/1335433514 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f783003a040 con 0x562edb087e40 2024-09-05T01:26:47.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.931+0000 7f78487d9740 10 client.25655 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T01:26:47.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.931+0000 7f78487d9740 10 client.25655 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T01:26:47.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.931+0000 7f78487d9740 20 client.25655 populate_metadata read hostname 'smithi012' 2024-09-05T01:26:47.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.931+0000 7f78487d9740 1 --2- 172.21.15.12:0/1335433514 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x562edb0a2cc0 0x562edb109160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:47.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.931+0000 7f78487d9740 4 client.25655 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:26:47.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.931+0000 7f78487d9740 1 -- 172.21.15.12:0/1335433514 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562edaff5e60 con 0x562edb0a2cc0 2024-09-05T01:26:47.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.940+0000 7f783e000640 1 --2- 172.21.15.12:0/1335433514 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x562edb0a2cc0 0x562edb109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:47.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.941+0000 7f783e000640 1 --2- 172.21.15.12:0/1335433514 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x562edb0a2cc0 0x562edb109160 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=61e70dcc08db0da3 server_cookie=f642ab96cd17ad63 in_seq=0 out_seq=0 2024-09-05T01:26:47.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.941+0000 7f7828c00640 10 client.25655 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:26:47.955 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:26:47.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.941+0000 7f7828c00640 1 -- 172.21.15.12:0/1335433514 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562edaff5e60 con 0x562edb0a2cc0 2024-09-05T01:26:47.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.941+0000 7f7828c00640 10 client.25655 handle_command_reply: tid=0 2024-09-05T01:26:47.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.941+0000 7f78487d9740 1 client.25655 shutdown 2024-09-05T01:26:47.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.943+0000 7f78487d9740 1 -- 172.21.15.12:0/1335433514 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562edb087e40 msgr2=0x562edb096490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:47.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.943+0000 7f78487d9740 1 --2- 172.21.15.12:0/1335433514 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562edb087e40 0x562edb096490 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7830000c00 tx=0x7f7830004f50 comp rx=0 tx=0).stop 2024-09-05T01:26:47.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.944+0000 7f78487d9740 1 -- 172.21.15.12:0/1335433514 shutdown_connections 2024-09-05T01:26:47.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.944+0000 7f78487d9740 1 --2- 172.21.15.12:0/1335433514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562edb093020 0x562edb11c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.944+0000 7f78487d9740 1 --2- 172.21.15.12:0/1335433514 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562edb088760 0x562edb0969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.944+0000 7f78487d9740 1 --2- 172.21.15.12:0/1335433514 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x562edb0a2cc0 0x562edb109160 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.944+0000 7f78487d9740 1 --2- 172.21.15.12:0/1335433514 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x562edb087e40 0x562edb096490 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.944+0000 7f78487d9740 1 -- 172.21.15.12:0/1335433514 >> 172.21.15.12:0/1335433514 conn(0x562edb0843d0 msgr2=0x562edb089890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:47.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.944+0000 7f7828c00640 0 client.25655 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:26:47.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.944+0000 7f78487d9740 1 -- 172.21.15.12:0/1335433514 shutdown_connections 2024-09-05T01:26:47.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.944+0000 7f78487d9740 1 -- 172.21.15.12:0/1335433514 wait complete. 2024-09-05T01:26:47.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.944+0000 7f78487d9740 20 client.25655 trim_cache size 0 max 16384 2024-09-05T01:26:47.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.948+0000 7f783fe00640 1 -- 172.21.15.12:0/750107513 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f78240a2fa0 msgr2=0x7f78240a5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:47.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.948+0000 7f783fe00640 1 --2- 172.21.15.12:0/750107513 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f78240a2fa0 0x7f78240a5460 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x562edb085230 tx=0x7f782c005f90 comp rx=0 tx=0).stop 2024-09-05T01:26:47.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.948+0000 7f783fe00640 1 -- 172.21.15.12:0/750107513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78401a3460 msgr2=0x7f78401a38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:47.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.948+0000 7f783fe00640 1 --2- 172.21.15.12:0/750107513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78401a3460 0x7f78401a38e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7838009fd0 tx=0x7f783800b260 comp rx=0 tx=0).stop 2024-09-05T01:26:47.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.949+0000 7f783fe00640 1 -- 172.21.15.12:0/750107513 shutdown_connections 2024-09-05T01:26:47.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.949+0000 7f783fe00640 1 --2- 172.21.15.12:0/750107513 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f78240a2fa0 0x7f78240a5460 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.949+0000 7f783fe00640 1 --2- 172.21.15.12:0/750107513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78401a3460 0x7f78401a38e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.949+0000 7f783fe00640 1 --2- 172.21.15.12:0/750107513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7840108f60 0x7f784010fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.949+0000 7f783fe00640 1 --2- 172.21.15.12:0/750107513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78401047e0 0x7f784010f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:47.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.949+0000 7f783fe00640 1 -- 172.21.15.12:0/750107513 >> 172.21.15.12:0/750107513 conn(0x7f78400ff910 msgr2=0x7f7840100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:47.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.949+0000 7f783fe00640 1 -- 172.21.15.12:0/750107513 shutdown_connections 2024-09-05T01:26:47.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:47.949+0000 7f783fe00640 1 -- 172.21.15.12:0/750107513 wait complete. 2024-09-05T01:26:49.130 INFO:tasks.workunit.client.0.smithi012.stdout: 55 484969 1258 333191 1506 69490 47 2024-09-05T01:26:49.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:49 smithi012 ceph-mon[29942]: pgmap v66: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 105 op/s 2024-09-05T01:26:49.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:49 smithi145 ceph-mon[34376]: pgmap v66: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 105 op/s 2024-09-05T01:26:49.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:49 smithi151 ceph-mon[35013]: pgmap v66: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 105 op/s 2024-09-05T01:26:49.753 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-05T01:26:51.277 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:26:51.369 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:51 smithi012 ceph-mon[29942]: pgmap v67: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 75 op/s 2024-09-05T01:26:51.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:51 smithi145 ceph-mon[34376]: pgmap v67: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 75 op/s 2024-09-05T01:26:51.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:51 smithi151 ceph-mon[35013]: pgmap v67: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 75 op/s 2024-09-05T01:26:52.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df8600640 1 -- 172.21.15.12:0/3184366903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5df0112b90 msgr2=0x7f5df0114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:52.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df8600640 1 --2- 172.21.15.12:0/3184366903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5df0112b90 0x7f5df0114f80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5de8009be0 tx=0x7f5de802a750 comp rx=0 tx=0).stop 2024-09-05T01:26:52.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df8600640 1 -- 172.21.15.12:0/3184366903 shutdown_connections 2024-09-05T01:26:52.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df8600640 1 --2- 172.21.15.12:0/3184366903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5df0112b90 0x7f5df0114f80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df8600640 1 --2- 172.21.15.12:0/3184366903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5df0074eb0 0x7f5df0112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df8600640 1 --2- 172.21.15.12:0/3184366903 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5df0074590 0x7f5df0074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df8600640 1 -- 172.21.15.12:0/3184366903 >> 172.21.15.12:0/3184366903 conn(0x7f5df00fd8c0 msgr2=0x7f5df00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:52.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df8600640 1 -- 172.21.15.12:0/3184366903 shutdown_connections 2024-09-05T01:26:52.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df8600640 1 -- 172.21.15.12:0/3184366903 wait complete. 2024-09-05T01:26:52.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df8600640 1 Processor -- start 2024-09-05T01:26:52.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df8600640 1 -- start start 2024-09-05T01:26:52.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df8600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5df0074590 0x7f5df01121c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:52.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df8600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5df0074eb0 0x7f5df010b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:52.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df8600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5df0112b90 0x7f5df010b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:52.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df8600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5df0118550 con 0x7f5df0074590 2024-09-05T01:26:52.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df8600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5df01183d0 con 0x7f5df0112b90 2024-09-05T01:26:52.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df8600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5df01186d0 con 0x7f5df0074eb0 2024-09-05T01:26:52.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df6600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5df0112b90 0x7f5df010b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:52.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df5c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5df0074590 0x7f5df01121c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:52.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df5200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5df0074eb0 0x7f5df010b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:52.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df6600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5df0112b90 0x7f5df010b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:52198/0 (socket says 172.21.15.12:52198) 2024-09-05T01:26:52.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df6600640 1 -- 172.21.15.12:0/3090825692 learned_addr learned my addr 172.21.15.12:0/3090825692 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:52.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df6600640 1 -- 172.21.15.12:0/3090825692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5df0074eb0 msgr2=0x7f5df010b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:52.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df6600640 1 --2- 172.21.15.12:0/3090825692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5df0074eb0 0x7f5df010b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df6600640 1 -- 172.21.15.12:0/3090825692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5df0074590 msgr2=0x7f5df01121c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:52.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df6600640 1 --2- 172.21.15.12:0/3090825692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5df0074590 0x7f5df01121c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df6600640 1 -- 172.21.15.12:0/3090825692 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df010bda0 con 0x7f5df0112b90 2024-09-05T01:26:52.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df6600640 1 --2- 172.21.15.12:0/3090825692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5df0112b90 0x7f5df010b790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5de8009b30 tx=0x7f5de80305d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:52.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5dee000640 1 -- 172.21.15.12:0/3090825692 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de8041020 con 0x7f5df0112b90 2024-09-05T01:26:52.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df8600640 1 -- 172.21.15.12:0/3090825692 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5df010c030 con 0x7f5df0112b90 2024-09-05T01:26:52.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5dee000640 1 -- 172.21.15.12:0/3090825692 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5de8003e50 con 0x7f5df0112b90 2024-09-05T01:26:52.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5dee000640 1 -- 172.21.15.12:0/3090825692 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de8036040 con 0x7f5df0112b90 2024-09-05T01:26:52.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.054+0000 7f5df8600640 1 -- 172.21.15.12:0/3090825692 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5df0110000 con 0x7f5df0112b90 2024-09-05T01:26:52.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.060+0000 7f5dee000640 1 -- 172.21.15.12:0/3090825692 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f5de8044020 con 0x7f5df0112b90 2024-09-05T01:26:52.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.060+0000 7f5dfb059740 1 Processor -- start 2024-09-05T01:26:52.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.060+0000 7f5dfb059740 1 -- start start 2024-09-05T01:26:52.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.060+0000 7f5dfb059740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b39c70 0x5637d0b3a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:52.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.060+0000 7f5dfb059740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637d0b3a590 0x5637d0b44910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:52.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.060+0000 7f5dfb059740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637d0b44e50 0x5637d0b47240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:52.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.060+0000 7f5dfb059740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5637d0aa03e0 con 0x5637d0b39c70 2024-09-05T01:26:52.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.060+0000 7f5dfb059740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5637d0a47d80 con 0x5637d0b3a590 2024-09-05T01:26:52.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.060+0000 7f5dfb059740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5637d0a9c3a0 con 0x5637d0b44e50 2024-09-05T01:26:52.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.060+0000 7f5dee000640 1 --2- 172.21.15.12:0/3090825692 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5dd80a2d70 0x7f5dd80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:52.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.065+0000 7f5dee000640 1 -- 172.21.15.12:0/3090825692 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f5de80eff00 con 0x7f5df0112b90 2024-09-05T01:26:52.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.065+0000 7f5df6600640 1 --2- 172.21.15.12:0/3090825692 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5dd80a2d70 0x7f5dd80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:52.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.065+0000 7f5df5200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637d0b44e50 0x5637d0b47240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:52.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.065+0000 7f5df5200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637d0b44e50 0x5637d0b47240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:36730/0 (socket says 172.21.15.12:36730) 2024-09-05T01:26:52.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.065+0000 7f5df5200640 1 -- 172.21.15.12:0/240279737 learned_addr learned my addr 172.21.15.12:0/240279737 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:52.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.065+0000 7f5df5200640 1 --2- 172.21.15.12:0/240279737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b39c70 0x5637d0b3a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:52.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5df5c00640 1 --2- 172.21.15.12:0/240279737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637d0b3a590 0x5637d0b44910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:52.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5df5200640 1 -- 172.21.15.12:0/240279737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637d0b44e50 msgr2=0x5637d0b47240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:52.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5df5200640 1 --2- 172.21.15.12:0/240279737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637d0b44e50 0x5637d0b47240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5df5200640 1 -- 172.21.15.12:0/240279737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637d0b3a590 msgr2=0x5637d0b44910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:52.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5df5200640 1 --2- 172.21.15.12:0/240279737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637d0b3a590 0x5637d0b44910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5df5200640 1 -- 172.21.15.12:0/240279737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637d0a66ae0 con 0x5637d0b39c70 2024-09-05T01:26:52.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5df5c00640 1 --2- 172.21.15.12:0/240279737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637d0b3a590 0x5637d0b44910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:26:52.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5df5200640 1 --2- 172.21.15.12:0/240279737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b39c70 0x5637d0b3a050 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0058c0 tx=0x7f5ddc005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7df90d5cdf49ad server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:52.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5df6600640 1 --2- 172.21.15.12:0/3090825692 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5dd80a2d70 0x7f5dd80a5230 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5de80b8d80 tx=0x7f5de8030940 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:52.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5de2a00640 1 -- 172.21.15.12:0/240279737 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc011cd0 con 0x5637d0b39c70 2024-09-05T01:26:52.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5de2a00640 1 -- 172.21.15.12:0/240279737 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ddc00f790 con 0x5637d0b39c70 2024-09-05T01:26:52.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5de2a00640 1 -- 172.21.15.12:0/240279737 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc003850 con 0x5637d0b39c70 2024-09-05T01:26:52.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5dfb059740 1 -- 172.21.15.12:0/240279737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b39c70 msgr2=0x5637d0b3a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:52.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5dfb059740 1 --2- 172.21.15.12:0/240279737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b39c70 0x5637d0b3a050 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0058c0 tx=0x7f5ddc005f90 comp rx=0 tx=0).stop 2024-09-05T01:26:52.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5dfb059740 1 -- 172.21.15.12:0/240279737 shutdown_connections 2024-09-05T01:26:52.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5dfb059740 1 --2- 172.21.15.12:0/240279737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637d0b44e50 0x5637d0b47240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5dfb059740 1 --2- 172.21.15.12:0/240279737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637d0b3a590 0x5637d0b44910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5dfb059740 1 --2- 172.21.15.12:0/240279737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b39c70 0x5637d0b3a050 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5dfb059740 1 -- 172.21.15.12:0/240279737 >> 172.21.15.12:0/240279737 conn(0x5637d0b36200 msgr2=0x5637d0b365e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:52.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5dfb059740 1 -- 172.21.15.12:0/240279737 shutdown_connections 2024-09-05T01:26:52.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5dfb059740 1 -- 172.21.15.12:0/240279737 wait complete. 2024-09-05T01:26:52.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5dfb059740 1 -- start start 2024-09-05T01:26:52.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5dfb059740 1 Processor -- start 2024-09-05T01:26:52.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5dfb059740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637d0b39c70 0x5637d0b41d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:52.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5dfb059740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b3a590 0x5637d0b42250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:52.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5dfb059740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637d0b44e50 0x5637d0b42790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:52.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5dfb059740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5637d0b47a20 con 0x5637d0b3a590 2024-09-05T01:26:52.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5dfb059740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5637d0a5b0f0 con 0x5637d0b44e50 2024-09-05T01:26:52.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5dfb059740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5637d0b47ba0 con 0x5637d0b39c70 2024-09-05T01:26:52.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5dfb059740 10 client.0 _ll_register_callbacks cb 0x5637d0a42bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:26:52.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5df5c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b3a590 0x5637d0b42250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:52.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5df5c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b3a590 0x5637d0b42250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57062/0 (socket says 172.21.15.12:57062) 2024-09-05T01:26:52.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5df5c00640 1 -- 172.21.15.12:0/3814058917 learned_addr learned my addr 172.21.15.12:0/3814058917 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:52.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.066+0000 7f5df5200640 1 --2- 172.21.15.12:0/3814058917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637d0b39c70 0x5637d0b41d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:52.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5df5c00640 1 -- 172.21.15.12:0/3814058917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637d0b39c70 msgr2=0x5637d0b41d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:52.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5df5200640 1 --2- 172.21.15.12:0/3814058917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637d0b44e50 0x5637d0b42790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:52.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5df5c00640 1 --2- 172.21.15.12:0/3814058917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637d0b39c70 0x5637d0b41d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5df5c00640 1 -- 172.21.15.12:0/3814058917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637d0b44e50 msgr2=0x5637d0b42790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:52.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5df5c00640 1 --2- 172.21.15.12:0/3814058917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637d0b44e50 0x5637d0b42790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5df5c00640 1 -- 172.21.15.12:0/3814058917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637d08113c0 con 0x5637d0b3a590 2024-09-05T01:26:52.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5df5200640 1 --2- 172.21.15.12:0/3814058917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637d0b44e50 0x5637d0b42790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:26:52.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5df5c00640 1 --2- 172.21.15.12:0/3814058917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b3a590 0x5637d0b42250 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5de4013740 tx=0x7f5de4013c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426c6763ac3f17fe server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:52.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5dd7400640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:26:52.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5dd7400640 1 -- 172.21.15.12:0/3814058917 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de4011c80 con 0x5637d0b3a590 2024-09-05T01:26:52.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5dd7400640 1 -- 172.21.15.12:0/3814058917 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f5de4011e20 con 0x5637d0b3a590 2024-09-05T01:26:52.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5dfb059740 1 -- 172.21.15.12:0/3814058917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ddc00f790 con 0x5637d0b3a590 2024-09-05T01:26:52.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5dd7400640 1 -- 172.21.15.12:0/3814058917 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5de4004020 con 0x5637d0b3a590 2024-09-05T01:26:52.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5dfb059740 10 client.15639 fetch_fsmap learned FSMap version 31 2024-09-05T01:26:52.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5dfb059740 1 -- 172.21.15.12:0/3814058917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5637d0b53a30 con 0x5637d0b3a590 2024-09-05T01:26:52.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5dd7400640 1 -- 172.21.15.12:0/3814058917 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ddc00f790 con 0x5637d0b3a590 2024-09-05T01:26:52.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5dd7400640 1 -- 172.21.15.12:0/3814058917 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f5de4024470 con 0x5637d0b3a590 2024-09-05T01:26:52.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5dfb059740 10 client.15639 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T01:26:52.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5dfb059740 10 client.15639 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T01:26:52.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5dfb059740 20 client.15639 populate_metadata read hostname 'smithi012' 2024-09-05T01:26:52.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5dfb059740 1 --2- 172.21.15.12:0/3814058917 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x5637d0b54f40 0x5637d0b573a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:52.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5dfb059740 4 client.15639 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:26:52.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5dfb059740 1 -- 172.21.15.12:0/3814058917 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637d0aad950 con 0x5637d0b54f40 2024-09-05T01:26:52.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5df5200640 1 --2- 172.21.15.12:0/3814058917 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x5637d0b54f40 0x5637d0b573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:52.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5df5200640 1 --2- 172.21.15.12:0/3814058917 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x5637d0b54f40 0x5637d0b573a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2b09f20a87bc05fb server_cookie=96fbc09df858ee16 in_seq=0 out_seq=0 2024-09-05T01:26:52.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5dd7400640 10 client.15639 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:26:52.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5dd7400640 1 -- 172.21.15.12:0/3814058917 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5637d0aad950 con 0x5637d0b54f40 2024-09-05T01:26:52.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5dd7400640 10 client.15639 handle_command_reply: tid=0 2024-09-05T01:26:52.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5dfb059740 1 client.15639 shutdown 2024-09-05T01:26:52.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5dfb059740 1 -- 172.21.15.12:0/3814058917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b3a590 msgr2=0x5637d0b42250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:52.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.072+0000 7f5dfb059740 1 --2- 172.21.15.12:0/3814058917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b3a590 0x5637d0b42250 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5de4013740 tx=0x7f5de4013c00 comp rx=0 tx=0).stop 2024-09-05T01:26:52.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.077+0000 7f5dfb059740 1 -- 172.21.15.12:0/3814058917 shutdown_connections 2024-09-05T01:26:52.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.077+0000 7f5dfb059740 1 --2- 172.21.15.12:0/3814058917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637d0b44e50 0x5637d0b42790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.077+0000 7f5dfb059740 1 --2- 172.21.15.12:0/3814058917 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x5637d0b54f40 0x5637d0b573a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.077+0000 7f5dfb059740 1 --2- 172.21.15.12:0/3814058917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b3a590 0x5637d0b42250 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.077+0000 7f5dfb059740 1 --2- 172.21.15.12:0/3814058917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637d0b39c70 0x5637d0b41d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.077+0000 7f5dd7400640 0 client.15639 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:26:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.077+0000 7f5dfb059740 1 -- 172.21.15.12:0/3814058917 >> 172.21.15.12:0/3814058917 conn(0x5637d0b36200 msgr2=0x5637d0b3bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.077+0000 7f5dfb059740 1 -- 172.21.15.12:0/3814058917 shutdown_connections 2024-09-05T01:26:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.077+0000 7f5dfb059740 1 -- 172.21.15.12:0/3814058917 wait complete. 2024-09-05T01:26:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.077+0000 7f5dfb059740 20 client.15639 trim_cache size 0 max 16384 2024-09-05T01:26:52.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5dfb059740 1 Processor -- start 2024-09-05T01:26:52.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5dfb059740 1 -- start start 2024-09-05T01:26:52.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5dfb059740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b39c70 0x5637d0b3c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:52.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5dfb059740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637d0b3a590 0x5637d0b5cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:52.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5dfb059740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637d0b44e50 0x5637d0b5d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:52.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5dfb059740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5df01bc6b0 con 0x5637d0b39c70 2024-09-05T01:26:52.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5dfb059740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5df01be2b0 con 0x5637d0b44e50 2024-09-05T01:26:52.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5dfb059740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5df01bcd80 con 0x5637d0b3a590 2024-09-05T01:26:52.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5df5200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b39c70 0x5637d0b3c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:52.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5df5200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b39c70 0x5637d0b3c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57068/0 (socket says 172.21.15.12:57068) 2024-09-05T01:26:52.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5df5200640 1 -- 172.21.15.12:0/3304904217 learned_addr learned my addr 172.21.15.12:0/3304904217 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:52.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5df5200640 1 --2- 172.21.15.12:0/3304904217 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637d0b44e50 0x5637d0b5d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:52.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5df5200640 1 -- 172.21.15.12:0/3304904217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637d0b3a590 msgr2=0x5637d0b5cc70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:26:52.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5df5200640 1 --2- 172.21.15.12:0/3304904217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637d0b3a590 0x5637d0b5cc70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5df5200640 1 -- 172.21.15.12:0/3304904217 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637d0b44e50 msgr2=0x5637d0b5d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:52.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5df5200640 1 --2- 172.21.15.12:0/3304904217 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637d0b44e50 0x5637d0b5d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5df5200640 1 -- 172.21.15.12:0/3304904217 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637d0b31770 con 0x5637d0b39c70 2024-09-05T01:26:52.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5df5200640 1 --2- 172.21.15.12:0/3304904217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b39c70 0x5637d0b3c6d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00ff60 tx=0x7f5ddc005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf945eef6d7b6525 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:52.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5de2000640 1 -- 172.21.15.12:0/3304904217 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc011220 con 0x5637d0b39c70 2024-09-05T01:26:52.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5de2000640 1 -- 172.21.15.12:0/3304904217 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ddc00f790 con 0x5637d0b39c70 2024-09-05T01:26:52.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5de2000640 1 -- 172.21.15.12:0/3304904217 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc003950 con 0x5637d0b39c70 2024-09-05T01:26:52.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5dfb059740 1 -- 172.21.15.12:0/3304904217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b39c70 msgr2=0x5637d0b3c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:52.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5dfb059740 1 --2- 172.21.15.12:0/3304904217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b39c70 0x5637d0b3c6d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00ff60 tx=0x7f5ddc005850 comp rx=0 tx=0).stop 2024-09-05T01:26:52.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5dfb059740 1 -- 172.21.15.12:0/3304904217 shutdown_connections 2024-09-05T01:26:52.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5dfb059740 1 --2- 172.21.15.12:0/3304904217 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637d0b44e50 0x5637d0b5d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5dfb059740 1 --2- 172.21.15.12:0/3304904217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637d0b3a590 0x5637d0b5cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5dfb059740 1 --2- 172.21.15.12:0/3304904217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b39c70 0x5637d0b3c6d0 secure :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00ff60 tx=0x7f5ddc005850 comp rx=0 tx=0).stop 2024-09-05T01:26:52.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5dfb059740 1 -- 172.21.15.12:0/3304904217 >> 172.21.15.12:0/3304904217 conn(0x5637d0b36200 msgr2=0x5637d0b40e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:52.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5dfb059740 1 -- 172.21.15.12:0/3304904217 shutdown_connections 2024-09-05T01:26:52.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5dfb059740 1 -- 172.21.15.12:0/3304904217 wait complete. 2024-09-05T01:26:52.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5dfb059740 1 -- start start 2024-09-05T01:26:52.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.101+0000 7f5dfb059740 1 Processor -- start 2024-09-05T01:26:52.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5dfb059740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b3a590 0x5637d0b486f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:52.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5dfb059740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637d0b44e50 0x5637d0b48c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:52.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5dfb059740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637d0bb7c00 0x5637d0bb8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:52.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5dfb059740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5df01bdb20 con 0x5637d0b3a590 2024-09-05T01:26:52.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5dfb059740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5df01bd450 con 0x5637d0bb7c00 2024-09-05T01:26:52.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5dfb059740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5df01ba690 con 0x5637d0b44e50 2024-09-05T01:26:52.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5dfb059740 10 client.0 _ll_register_callbacks cb 0x7f5de4009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:26:52.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5df5200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b3a590 0x5637d0b486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:52.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5df5200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b3a590 0x5637d0b486f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57074/0 (socket says 172.21.15.12:57074) 2024-09-05T01:26:52.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5df5200640 1 -- 172.21.15.12:0/1428434045 learned_addr learned my addr 172.21.15.12:0/1428434045 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:52.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5df5c00640 1 --2- 172.21.15.12:0/1428434045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637d0b44e50 0x5637d0b48c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:52.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5df5200640 1 -- 172.21.15.12:0/1428434045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637d0b44e50 msgr2=0x5637d0b48c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:52.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5df5200640 1 --2- 172.21.15.12:0/1428434045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637d0b44e50 0x5637d0b48c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5df5200640 1 -- 172.21.15.12:0/1428434045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637d0bb7c00 msgr2=0x5637d0bb8080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:26:52.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5df5200640 1 --2- 172.21.15.12:0/1428434045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637d0bb7c00 0x5637d0bb8080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5df5200640 1 -- 172.21.15.12:0/1428434045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637d0bb8770 con 0x5637d0b3a590 2024-09-05T01:26:52.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5df5200640 1 --2- 172.21.15.12:0/1428434045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b3a590 0x5637d0b486f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc009d70 tx=0x7f5ddc011020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f4f689faf8903a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:52.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5dd7400640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:26:52.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5dd7400640 1 -- 172.21.15.12:0/1428434045 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc03c070 con 0x5637d0b3a590 2024-09-05T01:26:52.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5dd7400640 1 -- 172.21.15.12:0/1428434045 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f5ddc005070 con 0x5637d0b3a590 2024-09-05T01:26:52.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5dfb059740 1 -- 172.21.15.12:0/1428434045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ddc00f790 con 0x5637d0b3a590 2024-09-05T01:26:52.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5dd7400640 1 -- 172.21.15.12:0/1428434045 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5ddc048050 con 0x5637d0b3a590 2024-09-05T01:26:52.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5dfb059740 10 client.15645 fetch_fsmap learned FSMap version 31 2024-09-05T01:26:52.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5dfb059740 1 -- 172.21.15.12:0/1428434045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5637d0bbfb30 con 0x5637d0b3a590 2024-09-05T01:26:52.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5dd7400640 1 -- 172.21.15.12:0/1428434045 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ddc00f790 con 0x5637d0b3a590 2024-09-05T01:26:52.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5dd7400640 1 -- 172.21.15.12:0/1428434045 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f5ddc035040 con 0x5637d0b3a590 2024-09-05T01:26:52.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5dfb059740 10 client.15645 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T01:26:52.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5dfb059740 10 client.15645 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T01:26:52.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5dfb059740 20 client.15645 populate_metadata read hostname 'smithi012' 2024-09-05T01:26:52.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5dfb059740 1 --2- 172.21.15.12:0/1428434045 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x5637d0bbfeb0 0x5637d0bc22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:52.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5dfb059740 4 client.15645 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:26:52.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.107+0000 7f5dfb059740 1 -- 172.21.15.12:0/1428434045 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5637d0aa7e60 con 0x5637d0bbfeb0 2024-09-05T01:26:52.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.125+0000 7f5df5c00640 1 --2- 172.21.15.12:0/1428434045 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x5637d0bbfeb0 0x5637d0bc22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:52.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.207+0000 7f5dd7400640 10 client.15645 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:26:52.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.207+0000 7f5df5c00640 1 --2- 172.21.15.12:0/1428434045 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x5637d0bbfeb0 0x5637d0bc22a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cf1af53da94cc134 server_cookie=965ac32a681d8f8e in_seq=0 out_seq=0 2024-09-05T01:26:52.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5dd7400640 1 -- 172.21.15.12:0/1428434045 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5637d0aa7e60 con 0x5637d0bbfeb0 2024-09-05T01:26:52.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5dd7400640 10 client.15645 handle_command_reply: tid=0 2024-09-05T01:26:52.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5dfb059740 1 client.15645 shutdown 2024-09-05T01:26:52.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5dfb059740 1 -- 172.21.15.12:0/1428434045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b3a590 msgr2=0x5637d0b486f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:52.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5dfb059740 1 --2- 172.21.15.12:0/1428434045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b3a590 0x5637d0b486f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc009d70 tx=0x7f5ddc011020 comp rx=0 tx=0).stop 2024-09-05T01:26:52.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5dfb059740 1 -- 172.21.15.12:0/1428434045 shutdown_connections 2024-09-05T01:26:52.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5dfb059740 1 --2- 172.21.15.12:0/1428434045 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5637d0bb7c00 0x5637d0bb8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5dfb059740 1 --2- 172.21.15.12:0/1428434045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637d0b44e50 0x5637d0b48c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5dfb059740 1 --2- 172.21.15.12:0/1428434045 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x5637d0bbfeb0 0x5637d0bc22a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5dfb059740 1 --2- 172.21.15.12:0/1428434045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637d0b3a590 0x5637d0b486f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5dfb059740 1 -- 172.21.15.12:0/1428434045 >> 172.21.15.12:0/1428434045 conn(0x5637d0b36200 msgr2=0x5637d0b43570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:52.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5dd7400640 0 client.15645 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:26:52.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5dfb059740 1 -- 172.21.15.12:0/1428434045 shutdown_connections 2024-09-05T01:26:52.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5dfb059740 1 -- 172.21.15.12:0/1428434045 wait complete. 2024-09-05T01:26:52.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5dfb059740 20 client.15645 trim_cache size 0 max 16384 2024-09-05T01:26:52.235 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:26:52.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5df8600640 1 -- 172.21.15.12:0/3090825692 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5dd80a2d70 msgr2=0x7f5dd80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:52.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5df8600640 1 --2- 172.21.15.12:0/3090825692 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5dd80a2d70 0x7f5dd80a5230 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5de80b8d80 tx=0x7f5de8030940 comp rx=0 tx=0).stop 2024-09-05T01:26:52.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5df8600640 1 -- 172.21.15.12:0/3090825692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5df0112b90 msgr2=0x7f5df010b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:52.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5df8600640 1 --2- 172.21.15.12:0/3090825692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5df0112b90 0x7f5df010b790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5de8009b30 tx=0x7f5de80305d0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5df8600640 1 -- 172.21.15.12:0/3090825692 shutdown_connections 2024-09-05T01:26:52.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5df8600640 1 --2- 172.21.15.12:0/3090825692 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5dd80a2d70 0x7f5dd80a5230 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5df8600640 1 --2- 172.21.15.12:0/3090825692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5df0112b90 0x7f5df010b790 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5df8600640 1 --2- 172.21.15.12:0/3090825692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5df0074eb0 0x7f5df010b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5df8600640 1 --2- 172.21.15.12:0/3090825692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5df0074590 0x7f5df01121c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:52.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5df8600640 1 -- 172.21.15.12:0/3090825692 >> 172.21.15.12:0/3090825692 conn(0x7f5df00fd8c0 msgr2=0x7f5df00ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:52.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5df8600640 1 -- 172.21.15.12:0/3090825692 shutdown_connections 2024-09-05T01:26:52.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:52.231+0000 7f5df8600640 1 -- 172.21.15.12:0/3090825692 wait complete. 2024-09-05T01:26:53.318 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-05T01:26:53.328 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:53 smithi012 ceph-mon[29942]: pgmap v68: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 75 op/s 2024-09-05T01:26:53.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:53 smithi145 ceph-mon[34376]: pgmap v68: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 75 op/s 2024-09-05T01:26:53.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:53 smithi151 ceph-mon[35013]: pgmap v68: 97 pgs: 97 active+clean; 76 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 75 op/s 2024-09-05T01:26:53.717 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:26:54.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.675+0000 7f987f200640 1 -- 172.21.15.12:0/4164353685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9880102b90 msgr2=0x7f9880102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:54.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.675+0000 7f987f200640 1 --2- 172.21.15.12:0/4164353685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9880102b90 0x7f9880102f70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9870009900 tx=0x7f987002a4d0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.679+0000 7f987f200640 1 -- 172.21.15.12:0/4164353685 shutdown_connections 2024-09-05T01:26:54.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.679+0000 7f987f200640 1 --2- 172.21.15.12:0/4164353685 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f988010bfc0 0x7f988010e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.679+0000 7f987f200640 1 --2- 172.21.15.12:0/4164353685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98801034b0 0x7f988010b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.679+0000 7f987f200640 1 --2- 172.21.15.12:0/4164353685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9880102b90 0x7f9880102f70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.680+0000 7f987f200640 1 -- 172.21.15.12:0/4164353685 >> 172.21.15.12:0/4164353685 conn(0x7f98800fc610 msgr2=0x7f98800fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:54.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.680+0000 7f987f200640 1 -- 172.21.15.12:0/4164353685 shutdown_connections 2024-09-05T01:26:54.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.681+0000 7f987f200640 1 -- 172.21.15.12:0/4164353685 wait complete. 2024-09-05T01:26:54.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.683+0000 7f987f200640 1 Processor -- start 2024-09-05T01:26:54.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.684+0000 7f987f200640 1 -- start start 2024-09-05T01:26:54.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.685+0000 7f987f200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9880102b90 0x7f9880116150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:54.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.686+0000 7f987f200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98801034b0 0x7f9880116690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:54.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.686+0000 7f987d400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98801034b0 0x7f9880116690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:54.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.686+0000 7f987d400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98801034b0 0x7f9880116690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:52262/0 (socket says 172.21.15.12:52262) 2024-09-05T01:26:54.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.687+0000 7f987f200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f988010bfc0 0x7f988011be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:54.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.688+0000 7f987d400640 1 -- 172.21.15.12:0/1763588825 learned_addr learned my addr 172.21.15.12:0/1763588825 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:54.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.687+0000 7f987de00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9880102b90 0x7f9880116150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:54.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.688+0000 7f987f200640 1 -- 172.21.15.12:0/1763588825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f98801023e0 con 0x7f988010bfc0 2024-09-05T01:26:54.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.688+0000 7f987f200640 1 -- 172.21.15.12:0/1763588825 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9880102260 con 0x7f98801034b0 2024-09-05T01:26:54.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.688+0000 7f987f200640 1 -- 172.21.15.12:0/1763588825 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9880102560 con 0x7f9880102b90 2024-09-05T01:26:54.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.689+0000 7f987d400640 1 -- 172.21.15.12:0/1763588825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9880102b90 msgr2=0x7f9880116150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:54.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.690+0000 7f987d400640 1 --2- 172.21.15.12:0/1763588825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9880102b90 0x7f9880116150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.690+0000 7f987d400640 1 -- 172.21.15.12:0/1763588825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f988010bfc0 msgr2=0x7f988011be70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T01:26:54.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.690+0000 7f987e800640 1 --2- 172.21.15.12:0/1763588825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f988010bfc0 0x7f988011be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:54.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.691+0000 7f987d400640 1 --2- 172.21.15.12:0/1763588825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f988010bfc0 0x7f988011be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.691+0000 7f987d400640 1 -- 172.21.15.12:0/1763588825 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f988011c730 con 0x7f98801034b0 2024-09-05T01:26:54.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.691+0000 7f987de00640 1 --2- 172.21.15.12:0/1763588825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9880102b90 0x7f9880116150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:26:54.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.692+0000 7f987e800640 1 --2- 172.21.15.12:0/1763588825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f988010bfc0 0x7f988011be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:26:54.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.692+0000 7f987d400640 1 --2- 172.21.15.12:0/1763588825 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98801034b0 0x7f9880116690 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f986c00e9f0 tx=0x7f986c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:54.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.693+0000 7f9876a00640 1 -- 172.21.15.12:0/1763588825 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c00cd80 con 0x7f98801034b0 2024-09-05T01:26:54.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.694+0000 7f987f200640 1 -- 172.21.15.12:0/1763588825 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f988011ca20 con 0x7f98801034b0 2024-09-05T01:26:54.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.694+0000 7f9876a00640 1 -- 172.21.15.12:0/1763588825 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f986c0035f0 con 0x7f98801034b0 2024-09-05T01:26:54.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.694+0000 7f9876a00640 1 -- 172.21.15.12:0/1763588825 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c00cd80 con 0x7f98801034b0 2024-09-05T01:26:54.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.694+0000 7f987f200640 1 -- 172.21.15.12:0/1763588825 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98801114f0 con 0x7f98801034b0 2024-09-05T01:26:54.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.702+0000 7f9876a00640 1 -- 172.21.15.12:0/1763588825 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f986c004020 con 0x7f98801034b0 2024-09-05T01:26:54.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.703+0000 7f9887ccb740 1 Processor -- start 2024-09-05T01:26:54.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.704+0000 7f9887ccb740 1 -- start start 2024-09-05T01:26:54.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.706+0000 7f9876a00640 1 --2- 172.21.15.12:0/1763588825 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f98640a2fb0 0x7f98640a5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:54.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.707+0000 7f9876a00640 1 -- 172.21.15.12:0/1763588825 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f986c0cf390 con 0x7f98801034b0 2024-09-05T01:26:54.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.710+0000 7f987e800640 1 --2- 172.21.15.12:0/1763588825 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f98640a2fb0 0x7f98640a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:54.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.710+0000 7f9887ccb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277cce40 0x5632277cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:54.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.710+0000 7f9887ccb740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5632277cd760 0x5632277d7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:54.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.710+0000 7f9887ccb740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632277d8020 0x5632277da410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:54.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.710+0000 7f9887ccb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5632277333e0 con 0x5632277cce40 2024-09-05T01:26:54.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.710+0000 7f9887ccb740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5632276dad80 con 0x5632277d8020 2024-09-05T01:26:54.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.710+0000 7f9887ccb740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56322772f3a0 con 0x5632277cd760 2024-09-05T01:26:54.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.714+0000 7f987de00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277cce40 0x5632277cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:54.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.714+0000 7f987de00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277cce40 0x5632277cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57100/0 (socket says 172.21.15.12:57100) 2024-09-05T01:26:54.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.715+0000 7f987de00640 1 -- 172.21.15.12:0/1244427509 learned_addr learned my addr 172.21.15.12:0/1244427509 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:54.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.716+0000 7f987de00640 1 -- 172.21.15.12:0/1244427509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5632277cd760 msgr2=0x5632277d7ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:26:54.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.716+0000 7f987de00640 1 --2- 172.21.15.12:0/1244427509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5632277cd760 0x5632277d7ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.716+0000 7f987de00640 1 -- 172.21.15.12:0/1244427509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632277d8020 msgr2=0x5632277da410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:26:54.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.716+0000 7f987de00640 1 --2- 172.21.15.12:0/1244427509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632277d8020 0x5632277da410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.717+0000 7f987de00640 1 -- 172.21.15.12:0/1244427509 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632276f9ae0 con 0x5632277cce40 2024-09-05T01:26:54.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.718+0000 7f987de00640 1 --2- 172.21.15.12:0/1244427509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277cce40 0x5632277cd220 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9870005ab0 tx=0x7f9870004ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ad37cf7ba2b103 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:54.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.721+0000 7f987e800640 1 --2- 172.21.15.12:0/1763588825 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f98640a2fb0 0x7f98640a5470 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f988010d4b0 tx=0x7f9878009500 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:54.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.721+0000 7f986b400640 1 -- 172.21.15.12:0/1244427509 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9870040030 con 0x5632277cce40 2024-09-05T01:26:54.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.721+0000 7f986b400640 1 -- 172.21.15.12:0/1244427509 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9870004e10 con 0x5632277cce40 2024-09-05T01:26:54.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.721+0000 7f986b400640 1 -- 172.21.15.12:0/1244427509 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9870005530 con 0x5632277cce40 2024-09-05T01:26:54.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.725+0000 7f9887ccb740 1 -- 172.21.15.12:0/1244427509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277cce40 msgr2=0x5632277cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:54.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.725+0000 7f9887ccb740 1 --2- 172.21.15.12:0/1244427509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277cce40 0x5632277cd220 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9870005ab0 tx=0x7f9870004ca0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.727+0000 7f9887ccb740 1 -- 172.21.15.12:0/1244427509 shutdown_connections 2024-09-05T01:26:54.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.727+0000 7f9887ccb740 1 --2- 172.21.15.12:0/1244427509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632277d8020 0x5632277da410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.727+0000 7f9887ccb740 1 --2- 172.21.15.12:0/1244427509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5632277cd760 0x5632277d7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.727+0000 7f9887ccb740 1 --2- 172.21.15.12:0/1244427509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277cce40 0x5632277cd220 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.727+0000 7f9887ccb740 1 -- 172.21.15.12:0/1244427509 >> 172.21.15.12:0/1244427509 conn(0x5632277c93d0 msgr2=0x5632277c97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:54.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.729+0000 7f9887ccb740 1 -- 172.21.15.12:0/1244427509 shutdown_connections 2024-09-05T01:26:54.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.730+0000 7f9887ccb740 1 -- 172.21.15.12:0/1244427509 wait complete. 2024-09-05T01:26:54.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.730+0000 7f9887ccb740 1 -- start start 2024-09-05T01:26:54.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.731+0000 7f9887ccb740 1 Processor -- start 2024-09-05T01:26:54.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.738+0000 7f9887ccb740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5632277cce40 0x5632277d4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:54.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.738+0000 7f9887ccb740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632277cd760 0x5632277d54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:54.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.738+0000 7f9887ccb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277d8020 0x5632277d59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:54.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.738+0000 7f987de00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5632277cce40 0x5632277d4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:54.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.738+0000 7f987de00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5632277cce40 0x5632277d4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:36792/0 (socket says 172.21.15.12:36792) 2024-09-05T01:26:54.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.740+0000 7f9887ccb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5632277dabf0 con 0x5632277d8020 2024-09-05T01:26:54.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.740+0000 7f9887ccb740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5632276ee0f0 con 0x5632277cd760 2024-09-05T01:26:54.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.740+0000 7f9887ccb740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5632277dad70 con 0x5632277cce40 2024-09-05T01:26:54.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.740+0000 7f9887ccb740 10 client.0 _ll_register_callbacks cb 0x5632276d5bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:26:54.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.742+0000 7f987e800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277d8020 0x5632277d59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:54.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.742+0000 7f987e800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277d8020 0x5632277d59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57110/0 (socket says 172.21.15.12:57110) 2024-09-05T01:26:54.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.742+0000 7f987e800640 1 -- 172.21.15.12:0/1330348186 learned_addr learned my addr 172.21.15.12:0/1330348186 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:54.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.743+0000 7f987de00640 1 -- 172.21.15.12:0/1330348186 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632277cd760 msgr2=0x5632277d54b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:26:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.743+0000 7f987de00640 1 --2- 172.21.15.12:0/1330348186 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632277cd760 0x5632277d54b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.743+0000 7f987de00640 1 -- 172.21.15.12:0/1330348186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277d8020 msgr2=0x5632277d59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.743+0000 7f987de00640 1 --2- 172.21.15.12:0/1330348186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277d8020 0x5632277d59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.743+0000 7f987de00640 1 -- 172.21.15.12:0/1330348186 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632274a43c0 con 0x5632277cce40 2024-09-05T01:26:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.744+0000 7f985fe00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:26:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.744+0000 7f987de00640 1 --2- 172.21.15.12:0/1330348186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5632277cce40 0x5632277d4f70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f987002aac0 tx=0x7f9870009550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cf798d7f2cb1294 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.744+0000 7f985fe00640 1 -- 172.21.15.12:0/1330348186 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9870063060 con 0x5632277cce40 2024-09-05T01:26:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.745+0000 7f985fe00640 1 -- 172.21.15.12:0/1330348186 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f98700052b0 con 0x5632277cce40 2024-09-05T01:26:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.745+0000 7f9887ccb740 1 -- 172.21.15.12:0/1330348186 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563227740950 con 0x5632277cce40 2024-09-05T01:26:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.745+0000 7f985fe00640 1 -- 172.21.15.12:0/1330348186 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9870063060 con 0x5632277cce40 2024-09-05T01:26:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.745+0000 7f9887ccb740 10 client.25669 fetch_fsmap learned FSMap version 31 2024-09-05T01:26:54.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.746+0000 7f9887ccb740 1 -- 172.21.15.12:0/1330348186 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5632277dabf0 con 0x5632277cce40 2024-09-05T01:26:54.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.746+0000 7f985fe00640 1 -- 172.21.15.12:0/1330348186 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x563227740950 con 0x5632277cce40 2024-09-05T01:26:54.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.746+0000 7f985fe00640 1 -- 172.21.15.12:0/1330348186 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f98700038f0 con 0x5632277cce40 2024-09-05T01:26:54.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.747+0000 7f9887ccb740 10 client.25669 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T01:26:54.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.747+0000 7f9887ccb740 10 client.25669 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:26:54.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.747+0000 7f9887ccb740 20 client.25669 populate_metadata read hostname 'smithi012' 2024-09-05T01:26:54.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.747+0000 7f9887ccb740 1 --2- 172.21.15.12:0/1330348186 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5632277e7e40 0x5632277ea230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:54.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.747+0000 7f9887ccb740 4 client.25669 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:26:54.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.747+0000 7f9887ccb740 1 -- 172.21.15.12:0/1330348186 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56322773ae60 con 0x5632277e7e40 2024-09-05T01:26:54.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.748+0000 7f987d400640 1 --2- 172.21.15.12:0/1330348186 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5632277e7e40 0x5632277ea230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:54.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.752+0000 7f985fe00640 10 client.25669 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:26:54.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.752+0000 7f987d400640 1 --2- 172.21.15.12:0/1330348186 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5632277e7e40 0x5632277ea230 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=463ce107f4c172f5 server_cookie=217dc2ba89005f10 in_seq=0 out_seq=0 2024-09-05T01:26:54.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.755+0000 7f985fe00640 1 -- 172.21.15.12:0/1330348186 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56322773ae60 con 0x5632277e7e40 2024-09-05T01:26:54.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.755+0000 7f985fe00640 10 client.25669 handle_command_reply: tid=0 2024-09-05T01:26:54.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.755+0000 7f9887ccb740 1 client.25669 shutdown 2024-09-05T01:26:54.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.756+0000 7f9887ccb740 1 -- 172.21.15.12:0/1330348186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5632277cce40 msgr2=0x5632277d4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:54.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.756+0000 7f9887ccb740 1 --2- 172.21.15.12:0/1330348186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5632277cce40 0x5632277d4f70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f987002aac0 tx=0x7f9870009550 comp rx=0 tx=0).stop 2024-09-05T01:26:54.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.756+0000 7f9887ccb740 1 -- 172.21.15.12:0/1330348186 shutdown_connections 2024-09-05T01:26:54.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.756+0000 7f9887ccb740 1 --2- 172.21.15.12:0/1330348186 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5632277e7e40 0x5632277ea230 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.757+0000 7f9887ccb740 1 --2- 172.21.15.12:0/1330348186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277d8020 0x5632277d59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.757+0000 7f985fe00640 0 client.25669 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:26:54.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.757+0000 7f9887ccb740 1 --2- 172.21.15.12:0/1330348186 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632277cd760 0x5632277d54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.757+0000 7f9887ccb740 1 --2- 172.21.15.12:0/1330348186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5632277cce40 0x5632277d4f70 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.757+0000 7f9887ccb740 1 -- 172.21.15.12:0/1330348186 >> 172.21.15.12:0/1330348186 conn(0x5632277c93d0 msgr2=0x5632277cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:54.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.760+0000 7f9887ccb740 1 -- 172.21.15.12:0/1330348186 shutdown_connections 2024-09-05T01:26:54.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.760+0000 7f9887ccb740 1 -- 172.21.15.12:0/1330348186 wait complete. 2024-09-05T01:26:54.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.760+0000 7f9887ccb740 20 client.25669 trim_cache size 0 max 16384 2024-09-05T01:26:54.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.795+0000 7f9887ccb740 1 Processor -- start 2024-09-05T01:26:54.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.796+0000 7f9887ccb740 1 -- start start 2024-09-05T01:26:54.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.796+0000 7f9887ccb740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5632277cce40 0x5632277d4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:54.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.796+0000 7f9887ccb740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632277cd760 0x5632277d67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:54.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.796+0000 7f9887ccb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277d8020 0x5632277ef9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:54.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.796+0000 7f9887ccb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9880073800 con 0x5632277d8020 2024-09-05T01:26:54.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.796+0000 7f9887ccb740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f98801b5a90 con 0x5632277cd760 2024-09-05T01:26:54.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.796+0000 7f9887ccb740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9880073ed0 con 0x5632277cce40 2024-09-05T01:26:54.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.797+0000 7f987d400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632277cd760 0x5632277d67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:54.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.797+0000 7f987d400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632277cd760 0x5632277d67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:52270/0 (socket says 172.21.15.12:52270) 2024-09-05T01:26:54.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.797+0000 7f987d400640 1 -- 172.21.15.12:0/2486903692 learned_addr learned my addr 172.21.15.12:0/2486903692 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:54.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.801+0000 7f987de00640 1 --2- 172.21.15.12:0/2486903692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5632277cce40 0x5632277d4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:54.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.801+0000 7f987e800640 1 --2- 172.21.15.12:0/2486903692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277d8020 0x5632277ef9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:54.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.801+0000 7f987de00640 1 -- 172.21.15.12:0/2486903692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632277cd760 msgr2=0x5632277d67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:54.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.801+0000 7f987de00640 1 --2- 172.21.15.12:0/2486903692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632277cd760 0x5632277d67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.801+0000 7f987de00640 1 -- 172.21.15.12:0/2486903692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277d8020 msgr2=0x5632277ef9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:54.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.801+0000 7f987de00640 1 --2- 172.21.15.12:0/2486903692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277d8020 0x5632277ef9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.801+0000 7f987de00640 1 -- 172.21.15.12:0/2486903692 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632277ccc70 con 0x5632277cce40 2024-09-05T01:26:54.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.802+0000 7f987de00640 1 --2- 172.21.15.12:0/2486903692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5632277cce40 0x5632277d4890 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9870006010 tx=0x7f987002b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef9d0c7220c7b6df server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:54.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.802+0000 7f987e800640 1 --2- 172.21.15.12:0/2486903692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277d8020 0x5632277ef9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:26:54.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.805+0000 7f986aa00640 1 -- 172.21.15.12:0/2486903692 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987006d080 con 0x5632277cce40 2024-09-05T01:26:54.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.805+0000 7f986aa00640 1 -- 172.21.15.12:0/2486903692 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9870004a10 con 0x5632277cce40 2024-09-05T01:26:54.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.805+0000 7f986aa00640 1 -- 172.21.15.12:0/2486903692 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9870040040 con 0x5632277cce40 2024-09-05T01:26:54.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.806+0000 7f9887ccb740 1 -- 172.21.15.12:0/2486903692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5632277cce40 msgr2=0x5632277d4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:54.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.806+0000 7f9887ccb740 1 --2- 172.21.15.12:0/2486903692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5632277cce40 0x5632277d4890 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9870006010 tx=0x7f987002b000 comp rx=0 tx=0).stop 2024-09-05T01:26:54.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.806+0000 7f9887ccb740 1 -- 172.21.15.12:0/2486903692 shutdown_connections 2024-09-05T01:26:54.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.806+0000 7f9887ccb740 1 --2- 172.21.15.12:0/2486903692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277d8020 0x5632277ef9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.806+0000 7f9887ccb740 1 --2- 172.21.15.12:0/2486903692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632277cd760 0x5632277d67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.806+0000 7f9887ccb740 1 --2- 172.21.15.12:0/2486903692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5632277cce40 0x5632277d4890 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.806+0000 7f9887ccb740 1 -- 172.21.15.12:0/2486903692 >> 172.21.15.12:0/2486903692 conn(0x5632277c93d0 msgr2=0x5632277c84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:54.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.808+0000 7f9887ccb740 1 -- 172.21.15.12:0/2486903692 shutdown_connections 2024-09-05T01:26:54.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.808+0000 7f9887ccb740 1 -- 172.21.15.12:0/2486903692 wait complete. 2024-09-05T01:26:54.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.808+0000 7f9887ccb740 1 -- start start 2024-09-05T01:26:54.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.808+0000 7f9887ccb740 1 Processor -- start 2024-09-05T01:26:54.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.810+0000 7f9887ccb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277cce40 0x5632277e0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:54.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.810+0000 7f9887ccb740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5632277cd760 0x5632277db8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:54.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.810+0000 7f9887ccb740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632277d8020 0x5632277dbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:54.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.812+0000 7f987de00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277cce40 0x5632277e0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:54.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.812+0000 7f987de00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277cce40 0x5632277e0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57114/0 (socket says 172.21.15.12:57114) 2024-09-05T01:26:54.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.815+0000 7f987e800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632277d8020 0x5632277dbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:54.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.815+0000 7f987e800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632277d8020 0x5632277dbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:52284/0 (socket says 172.21.15.12:52284) 2024-09-05T01:26:54.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.816+0000 7f9887ccb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f98801b5300 con 0x5632277cce40 2024-09-05T01:26:54.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.816+0000 7f9887ccb740 1 -- 172.21.15.12:0/504739906 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f98801b4c30 con 0x5632277d8020 2024-09-05T01:26:54.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.816+0000 7f987de00640 1 -- 172.21.15.12:0/504739906 learned_addr learned my addr 172.21.15.12:0/504739906 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:54.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.816+0000 7f9887ccb740 1 -- 172.21.15.12:0/504739906 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f98800717e0 con 0x5632277cd760 2024-09-05T01:26:54.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.817+0000 7f987de00640 1 -- 172.21.15.12:0/504739906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5632277cd760 msgr2=0x5632277db8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:26:54.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.817+0000 7f987de00640 1 --2- 172.21.15.12:0/504739906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5632277cd760 0x5632277db8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.817+0000 7f987de00640 1 -- 172.21.15.12:0/504739906 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632277d8020 msgr2=0x5632277dbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:54.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.817+0000 7f987de00640 1 --2- 172.21.15.12:0/504739906 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632277d8020 0x5632277dbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.817+0000 7f987de00640 1 -- 172.21.15.12:0/504739906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632277dc420 con 0x5632277cce40 2024-09-05T01:26:54.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.820+0000 7f985fe00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:26:54.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.820+0000 7f987de00640 1 --2- 172.21.15.12:0/504739906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277cce40 0x5632277e0520 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9870009850 tx=0x7f9870005470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4093affebdc163e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:54.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.821+0000 7f9887ccb740 10 client.0 _ll_register_callbacks cb 0x7f98780093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:26:54.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.821+0000 7f9887ccb740 1 -- 172.21.15.12:0/504739906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9870004a10 con 0x5632277cce40 2024-09-05T01:26:54.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.826+0000 7f985fe00640 1 -- 172.21.15.12:0/504739906 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987006d070 con 0x5632277cce40 2024-09-05T01:26:54.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.826+0000 7f985fe00640 1 -- 172.21.15.12:0/504739906 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f98700040a0 con 0x5632277cce40 2024-09-05T01:26:54.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.826+0000 7f985fe00640 1 -- 172.21.15.12:0/504739906 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9870081050 con 0x5632277cce40 2024-09-05T01:26:54.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.826+0000 7f9887ccb740 10 client.15657 fetch_fsmap learned FSMap version 31 2024-09-05T01:26:54.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.826+0000 7f9887ccb740 1 -- 172.21.15.12:0/504739906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({fsmap=31}) -- 0x563227852450 con 0x5632277cce40 2024-09-05T01:26:54.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.827+0000 7f985fe00640 1 -- 172.21.15.12:0/504739906 <== mon.0 v2:172.21.15.12:3300/0 4 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f98700042a0 con 0x5632277cce40 2024-09-05T01:26:54.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.829+0000 7f9887ccb740 10 client.15657 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T01:26:54.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.829+0000 7f9887ccb740 10 client.15657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:26:54.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.829+0000 7f9887ccb740 20 client.15657 populate_metadata read hostname 'smithi012' 2024-09-05T01:26:54.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.829+0000 7f9887ccb740 1 --2- 172.21.15.12:0/504739906 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5632277e7e40 0x563227854cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:54.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.829+0000 7f9887ccb740 4 client.15657 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:26:54.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.829+0000 7f9887ccb740 1 -- 172.21.15.12:0/504739906 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5632276b7010 con 0x5632277e7e40 2024-09-05T01:26:54.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.829+0000 7f987d400640 1 --2- 172.21.15.12:0/504739906 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5632277e7e40 0x563227854cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:54.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.830+0000 7f987d400640 1 --2- 172.21.15.12:0/504739906 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5632277e7e40 0x563227854cd0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64cf67ef462507bc server_cookie=3fc6ec00ba458002 in_seq=0 out_seq=0 2024-09-05T01:26:54.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.830+0000 7f985fe00640 10 client.15657 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:26:54.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.834+0000 7f985fe00640 1 -- 172.21.15.12:0/504739906 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5632276b7010 con 0x5632277e7e40 2024-09-05T01:26:54.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.834+0000 7f985fe00640 10 client.15657 handle_command_reply: tid=0 2024-09-05T01:26:54.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.834+0000 7f9887ccb740 1 client.15657 shutdown 2024-09-05T01:26:54.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.836+0000 7f9887ccb740 1 -- 172.21.15.12:0/504739906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277cce40 msgr2=0x5632277e0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:54.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.836+0000 7f9887ccb740 1 --2- 172.21.15.12:0/504739906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277cce40 0x5632277e0520 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9870009850 tx=0x7f9870005470 comp rx=0 tx=0).stop 2024-09-05T01:26:54.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.836+0000 7f9887ccb740 1 -- 172.21.15.12:0/504739906 shutdown_connections 2024-09-05T01:26:54.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.836+0000 7f9887ccb740 1 --2- 172.21.15.12:0/504739906 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5632277e7e40 0x563227854cd0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.837+0000 7f9887ccb740 1 --2- 172.21.15.12:0/504739906 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5632277d8020 0x5632277dbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.849 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:26:54.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.837+0000 7f9887ccb740 1 --2- 172.21.15.12:0/504739906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5632277cd760 0x5632277db8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.837+0000 7f985fe00640 0 client.15657 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:26:54.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.837+0000 7f9887ccb740 1 --2- 172.21.15.12:0/504739906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5632277cce40 0x5632277e0520 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.837+0000 7f9887ccb740 1 -- 172.21.15.12:0/504739906 >> 172.21.15.12:0/504739906 conn(0x5632277c93d0 msgr2=0x5632277d5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:54.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.838+0000 7f9887ccb740 1 -- 172.21.15.12:0/504739906 shutdown_connections 2024-09-05T01:26:54.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.838+0000 7f9887ccb740 1 -- 172.21.15.12:0/504739906 wait complete. 2024-09-05T01:26:54.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.838+0000 7f9887ccb740 20 client.15657 trim_cache size 0 max 16384 2024-09-05T01:26:54.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.839+0000 7f987f200640 1 -- 172.21.15.12:0/1763588825 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f98640a2fb0 msgr2=0x7f98640a5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:54.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.840+0000 7f987f200640 1 --2- 172.21.15.12:0/1763588825 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f98640a2fb0 0x7f98640a5470 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f988010d4b0 tx=0x7f9878009500 comp rx=0 tx=0).stop 2024-09-05T01:26:54.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.840+0000 7f987f200640 1 -- 172.21.15.12:0/1763588825 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98801034b0 msgr2=0x7f9880116690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:54.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.840+0000 7f987f200640 1 --2- 172.21.15.12:0/1763588825 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98801034b0 0x7f9880116690 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f986c00e9f0 tx=0x7f986c00eeb0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.841+0000 7f987f200640 1 -- 172.21.15.12:0/1763588825 shutdown_connections 2024-09-05T01:26:54.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.841+0000 7f987f200640 1 --2- 172.21.15.12:0/1763588825 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f98640a2fb0 0x7f98640a5470 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.841+0000 7f987f200640 1 --2- 172.21.15.12:0/1763588825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f988010bfc0 0x7f988011be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.841+0000 7f987f200640 1 --2- 172.21.15.12:0/1763588825 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f98801034b0 0x7f9880116690 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.841+0000 7f987f200640 1 --2- 172.21.15.12:0/1763588825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9880102b90 0x7f9880116150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:54.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.841+0000 7f987f200640 1 -- 172.21.15.12:0/1763588825 >> 172.21.15.12:0/1763588825 conn(0x7f98800fc610 msgr2=0x7f98800fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:54.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.841+0000 7f987f200640 1 -- 172.21.15.12:0/1763588825 shutdown_connections 2024-09-05T01:26:54.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:54.842+0000 7f987f200640 1 -- 172.21.15.12:0/1763588825 wait complete. 2024-09-05T01:26:55.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:55 smithi012 ceph-mon[29942]: pgmap v69: 97 pgs: 97 active+clean; 114 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.0 MiB/s wr, 285 op/s 2024-09-05T01:26:55.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:55 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:26:55.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:55 smithi145 ceph-mon[34376]: pgmap v69: 97 pgs: 97 active+clean; 114 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.0 MiB/s wr, 285 op/s 2024-09-05T01:26:55.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:55 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:26:55.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:55 smithi151 ceph-mon[35013]: pgmap v69: 97 pgs: 97 active+clean; 114 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 5.0 MiB/s wr, 285 op/s 2024-09-05T01:26:55.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:55 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:26:57.289 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-05T01:26:57.290 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-05T01:26:57.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:57 smithi012 ceph-mon[29942]: pgmap v70: 97 pgs: 97 active+clean; 114 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 262 op/s 2024-09-05T01:26:57.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:57 smithi145 ceph-mon[34376]: pgmap v70: 97 pgs: 97 active+clean; 114 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 262 op/s 2024-09-05T01:26:57.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:57 smithi151 ceph-mon[35013]: pgmap v70: 97 pgs: 97 active+clean; 114 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 262 op/s 2024-09-05T01:26:57.713 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:26:58.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.315+0000 7f7197200640 1 -- 172.21.15.12:0/3767237053 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7198108f60 msgr2=0x7f7198110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:58.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.315+0000 7f7197200640 1 --2- 172.21.15.12:0/3767237053 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7198108f60 0x7f7198110ae0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7190009ca0 tx=0x7f719002a8c0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.316+0000 7f7197200640 1 -- 172.21.15.12:0/3767237053 shutdown_connections 2024-09-05T01:26:58.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.316+0000 7f7197200640 1 --2- 172.21.15.12:0/3767237053 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7198108f60 0x7f7198110ae0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.316+0000 7f7197200640 1 --2- 172.21.15.12:0/3767237053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71981047e0 0x7f7198108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.316+0000 7f7197200640 1 --2- 172.21.15.12:0/3767237053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7198103e30 0x7f7198104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.316+0000 7f7197200640 1 -- 172.21.15.12:0/3767237053 >> 172.21.15.12:0/3767237053 conn(0x7f71980ff910 msgr2=0x7f7198101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:58.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.316+0000 7f7197200640 1 -- 172.21.15.12:0/3767237053 shutdown_connections 2024-09-05T01:26:58.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.316+0000 7f7197200640 1 -- 172.21.15.12:0/3767237053 wait complete. 2024-09-05T01:26:58.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.317+0000 7f7197200640 1 Processor -- start 2024-09-05T01:26:58.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.317+0000 7f7197200640 1 -- start start 2024-09-05T01:26:58.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.317+0000 7f7197200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7198103e30 0x7f7198076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:58.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.317+0000 7f7197200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71981047e0 0x7f7198076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:58.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.317+0000 7f7197200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7198108f60 0x7f7198077180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:58.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.317+0000 7f7197200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7198114010 con 0x7f7198108f60 2024-09-05T01:26:58.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.317+0000 7f7197200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7198113e90 con 0x7f7198103e30 2024-09-05T01:26:58.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.317+0000 7f7197200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7198114190 con 0x7f71981047e0 2024-09-05T01:26:58.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.318+0000 7f7195e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7198103e30 0x7f7198076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:58.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.318+0000 7f7195e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7198103e30 0x7f7198076700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:41090/0 (socket says 172.21.15.12:41090) 2024-09-05T01:26:58.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.318+0000 7f7195e00640 1 -- 172.21.15.12:0/273691022 learned_addr learned my addr 172.21.15.12:0/273691022 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:58.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.318+0000 7f7196800640 1 --2- 172.21.15.12:0/273691022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7198108f60 0x7f7198077180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:58.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.318+0000 7f718fe00640 1 --2- 172.21.15.12:0/273691022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71981047e0 0x7f7198076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:58.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.318+0000 7f7195e00640 1 -- 172.21.15.12:0/273691022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71981047e0 msgr2=0x7f7198076c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:58.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.318+0000 7f7195e00640 1 --2- 172.21.15.12:0/273691022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71981047e0 0x7f7198076c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.318+0000 7f7195e00640 1 -- 172.21.15.12:0/273691022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7198108f60 msgr2=0x7f7198077180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:58.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.318+0000 7f7195e00640 1 --2- 172.21.15.12:0/273691022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7198108f60 0x7f7198077180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.318+0000 7f7195e00640 1 -- 172.21.15.12:0/273691022 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71981aaa90 con 0x7f7198103e30 2024-09-05T01:26:58.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.319+0000 7f7195e00640 1 --2- 172.21.15.12:0/273691022 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7198103e30 0x7f7198076700 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f718800ea50 tx=0x7f718800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:58.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.319+0000 7f718ea00640 1 -- 172.21.15.12:0/273691022 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718800cd60 con 0x7f7198103e30 2024-09-05T01:26:58.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.319+0000 7f718ea00640 1 -- 172.21.15.12:0/273691022 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7188010910 con 0x7f7198103e30 2024-09-05T01:26:58.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.319+0000 7f718ea00640 1 -- 172.21.15.12:0/273691022 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7188018950 con 0x7f7198103e30 2024-09-05T01:26:58.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.319+0000 7f7197200640 1 -- 172.21.15.12:0/273691022 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71981aad80 con 0x7f7198103e30 2024-09-05T01:26:58.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.319+0000 7f7197200640 1 -- 172.21.15.12:0/273691022 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71981ab210 con 0x7f7198103e30 2024-09-05T01:26:58.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.322+0000 7f718ea00640 1 -- 172.21.15.12:0/273691022 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f7188010ac0 con 0x7f7198103e30 2024-09-05T01:26:58.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.322+0000 7f719fdc6740 1 Processor -- start 2024-09-05T01:26:58.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.323+0000 7f719fdc6740 1 -- start start 2024-09-05T01:26:58.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.323+0000 7f719fdc6740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6a59fdcb0 0x55b6a59fe090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:58.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.323+0000 7f719fdc6740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b6a59fe5d0 0x55b6a5a08950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:58.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.323+0000 7f719fdc6740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6a5a08e90 0x55b6a5a0b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:58.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.323+0000 7f719fdc6740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b6a5964290 con 0x55b6a59fdcb0 2024-09-05T01:26:58.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.323+0000 7f719fdc6740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55b6a590bb40 con 0x55b6a59fe5d0 2024-09-05T01:26:58.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.323+0000 7f719fdc6740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b6a5960250 con 0x55b6a5a08e90 2024-09-05T01:26:58.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.323+0000 7f7195e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b6a59fe5d0 0x55b6a5a08950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:58.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.323+0000 7f7195e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b6a59fe5d0 0x55b6a5a08950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:41100/0 (socket says 172.21.15.12:41100) 2024-09-05T01:26:58.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.323+0000 7f7195e00640 1 -- 172.21.15.12:0/2824459489 learned_addr learned my addr 172.21.15.12:0/2824459489 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:58.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.323+0000 7f718ea00640 1 --2- 172.21.15.12:0/273691022 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f717c0a2d70 0x7f717c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:58.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.323+0000 7f7196800640 1 --2- 172.21.15.12:0/2824459489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6a59fdcb0 0x55b6a59fe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:58.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.324+0000 7f718ea00640 1 -- 172.21.15.12:0/273691022 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f71880cf730 con 0x7f7198103e30 2024-09-05T01:26:58.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.324+0000 7f7195e00640 1 -- 172.21.15.12:0/2824459489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6a5a08e90 msgr2=0x55b6a5a0b280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:26:58.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.324+0000 7f7195e00640 1 --2- 172.21.15.12:0/2824459489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6a5a08e90 0x55b6a5a0b280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.324+0000 7f7195e00640 1 -- 172.21.15.12:0/2824459489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6a59fdcb0 msgr2=0x55b6a59fe090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:58.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.324+0000 7f7195e00640 1 --2- 172.21.15.12:0/2824459489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6a59fdcb0 0x55b6a59fe090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.324+0000 7f7195e00640 1 -- 172.21.15.12:0/2824459489 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6a56d56a0 con 0x55b6a59fe5d0 2024-09-05T01:26:58.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.324+0000 7f7196800640 1 --2- 172.21.15.12:0/273691022 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f717c0a2d70 0x7f717c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:58.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.324+0000 7f7195e00640 1 --2- 172.21.15.12:0/2824459489 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b6a59fe5d0 0x55b6a5a08950 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f718809b990 tx=0x7f7188018420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ceba6edc28a20422 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:58.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.324+0000 7f7187400640 1 -- 172.21.15.12:0/2824459489 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718809bc90 con 0x55b6a59fe5d0 2024-09-05T01:26:58.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.324+0000 7f7187400640 1 -- 172.21.15.12:0/2824459489 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f718809ff90 con 0x55b6a59fe5d0 2024-09-05T01:26:58.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.324+0000 7f7187400640 1 -- 172.21.15.12:0/2824459489 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71880cd090 con 0x55b6a59fe5d0 2024-09-05T01:26:58.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.325+0000 7f719fdc6740 1 -- 172.21.15.12:0/2824459489 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b6a59fe5d0 msgr2=0x55b6a5a08950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:58.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.325+0000 7f7196800640 1 --2- 172.21.15.12:0/273691022 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f717c0a2d70 0x7f717c0a5230 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7190006010 tx=0x7f719002a8c0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:58.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.325+0000 7f719fdc6740 1 --2- 172.21.15.12:0/2824459489 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b6a59fe5d0 0x55b6a5a08950 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f718809b990 tx=0x7f7188018420 comp rx=0 tx=0).stop 2024-09-05T01:26:58.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.325+0000 7f719fdc6740 1 -- 172.21.15.12:0/2824459489 shutdown_connections 2024-09-05T01:26:58.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.325+0000 7f719fdc6740 1 --2- 172.21.15.12:0/2824459489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6a5a08e90 0x55b6a5a0b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.325+0000 7f719fdc6740 1 --2- 172.21.15.12:0/2824459489 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b6a59fe5d0 0x55b6a5a08950 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.325+0000 7f719fdc6740 1 --2- 172.21.15.12:0/2824459489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6a59fdcb0 0x55b6a59fe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.325+0000 7f719fdc6740 1 -- 172.21.15.12:0/2824459489 >> 172.21.15.12:0/2824459489 conn(0x55b6a59fa240 msgr2=0x55b6a59fa620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:58.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.325+0000 7f719fdc6740 1 -- 172.21.15.12:0/2824459489 shutdown_connections 2024-09-05T01:26:58.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.325+0000 7f719fdc6740 1 -- 172.21.15.12:0/2824459489 wait complete. 2024-09-05T01:26:58.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.326+0000 7f719fdc6740 1 -- start start 2024-09-05T01:26:58.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.326+0000 7f719fdc6740 1 Processor -- start 2024-09-05T01:26:58.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.326+0000 7f719fdc6740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b6a59fdcb0 0x55b6a5a08700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:58.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.326+0000 7f719fdc6740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6a59fe5d0 0x55b6a5a059b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:58.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.327+0000 7f719fdc6740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6a5a08e90 0x55b6a5a05ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:58.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.327+0000 7f719fdc6740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b6a5a0bb00 con 0x55b6a59fe5d0 2024-09-05T01:26:58.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.327+0000 7f719fdc6740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55b6a591efa0 con 0x55b6a59fdcb0 2024-09-05T01:26:58.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.327+0000 7f719fdc6740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b6a5a0bc80 con 0x55b6a5a08e90 2024-09-05T01:26:58.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.327+0000 7f719fdc6740 10 client.0 _ll_register_callbacks cb 0x55b6a5672ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:26:58.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.327+0000 7f718fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6a59fe5d0 0x55b6a5a059b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:58.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.327+0000 7f718fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6a59fe5d0 0x55b6a5a059b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34700/0 (socket says 172.21.15.12:34700) 2024-09-05T01:26:58.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.327+0000 7f718fe00640 1 -- 172.21.15.12:0/3023112594 learned_addr learned my addr 172.21.15.12:0/3023112594 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:58.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.327+0000 7f7195e00640 1 --2- 172.21.15.12:0/3023112594 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b6a59fdcb0 0x55b6a5a08700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:58.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.327+0000 7f718fe00640 1 -- 172.21.15.12:0/3023112594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6a5a08e90 msgr2=0x55b6a5a05ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:58.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.327+0000 7f718fe00640 1 --2- 172.21.15.12:0/3023112594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6a5a08e90 0x55b6a5a05ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.327+0000 7f718fe00640 1 -- 172.21.15.12:0/3023112594 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b6a59fdcb0 msgr2=0x55b6a5a08700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:58.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.327+0000 7f718fe00640 1 --2- 172.21.15.12:0/3023112594 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b6a59fdcb0 0x55b6a5a08700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.327+0000 7f718fe00640 1 -- 172.21.15.12:0/3023112594 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6a5a06720 con 0x55b6a59fe5d0 2024-09-05T01:26:58.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.328+0000 7f718fe00640 1 --2- 172.21.15.12:0/3023112594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6a59fe5d0 0x55b6a5a059b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f71800116f0 tx=0x7f7180011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5937dd5c606db45a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:58.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.328+0000 7f717be00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:26:58.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.328+0000 7f717be00640 1 -- 172.21.15.12:0/3023112594 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718000f8a0 con 0x55b6a59fe5d0 2024-09-05T01:26:58.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.328+0000 7f717be00640 1 -- 172.21.15.12:0/3023112594 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f718000fa40 con 0x55b6a59fe5d0 2024-09-05T01:26:58.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.328+0000 7f719fdc6740 1 -- 172.21.15.12:0/3023112594 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f718809ff90 con 0x55b6a59fe5d0 2024-09-05T01:26:58.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.328+0000 7f717be00640 1 -- 172.21.15.12:0/3023112594 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f718000fc40 con 0x55b6a59fe5d0 2024-09-05T01:26:58.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.328+0000 7f719fdc6740 10 client.15669 fetch_fsmap learned FSMap version 31 2024-09-05T01:26:58.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.328+0000 7f719fdc6740 1 -- 172.21.15.12:0/3023112594 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b6a5a179a0 con 0x55b6a59fe5d0 2024-09-05T01:26:58.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.329+0000 7f717be00640 1 -- 172.21.15.12:0/3023112594 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f718809ff90 con 0x55b6a59fe5d0 2024-09-05T01:26:58.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.329+0000 7f717be00640 1 -- 172.21.15.12:0/3023112594 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f7180018070 con 0x55b6a59fe5d0 2024-09-05T01:26:58.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.329+0000 7f719fdc6740 10 client.15669 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T01:26:58.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.329+0000 7f719fdc6740 10 client.15669 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:26:58.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.329+0000 7f719fdc6740 20 client.15669 populate_metadata read hostname 'smithi012' 2024-09-05T01:26:58.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.329+0000 7f719fdc6740 1 --2- 172.21.15.12:0/3023112594 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b6a5a19120 0x55b6a5a1b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:58.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.329+0000 7f719fdc6740 4 client.15669 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:26:58.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.329+0000 7f719fdc6740 1 -- 172.21.15.12:0/3023112594 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6a5971800 con 0x55b6a5a19120 2024-09-05T01:26:58.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.329+0000 7f7195e00640 1 --2- 172.21.15.12:0/3023112594 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b6a5a19120 0x55b6a5a1b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:58.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.330+0000 7f7195e00640 1 --2- 172.21.15.12:0/3023112594 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b6a5a19120 0x55b6a5a1b5c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab237be420aa38a4 server_cookie=5bce1b360181e460 in_seq=0 out_seq=0 2024-09-05T01:26:58.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.330+0000 7f717be00640 10 client.15669 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:26:58.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.332+0000 7f717be00640 1 -- 172.21.15.12:0/3023112594 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b6a5971800 con 0x55b6a5a19120 2024-09-05T01:26:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.332+0000 7f717be00640 10 client.15669 handle_command_reply: tid=0 2024-09-05T01:26:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.332+0000 7f719fdc6740 1 client.15669 shutdown 2024-09-05T01:26:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.332+0000 7f719fdc6740 1 -- 172.21.15.12:0/3023112594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6a59fe5d0 msgr2=0x55b6a5a059b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.332+0000 7f719fdc6740 1 --2- 172.21.15.12:0/3023112594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6a59fe5d0 0x55b6a5a059b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f71800116f0 tx=0x7f7180011bb0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.333+0000 7f719fdc6740 1 -- 172.21.15.12:0/3023112594 shutdown_connections 2024-09-05T01:26:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.333+0000 7f719fdc6740 1 --2- 172.21.15.12:0/3023112594 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b6a5a19120 0x55b6a5a1b5c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.333+0000 7f719fdc6740 1 --2- 172.21.15.12:0/3023112594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6a5a08e90 0x55b6a5a05ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.333+0000 7f719fdc6740 1 --2- 172.21.15.12:0/3023112594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6a59fe5d0 0x55b6a5a059b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.333+0000 7f719fdc6740 1 --2- 172.21.15.12:0/3023112594 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b6a59fdcb0 0x55b6a5a08700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.333+0000 7f719fdc6740 1 -- 172.21.15.12:0/3023112594 >> 172.21.15.12:0/3023112594 conn(0x55b6a59fa240 msgr2=0x55b6a59fff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:58.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.333+0000 7f717be00640 0 client.15669 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:26:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.333+0000 7f719fdc6740 1 -- 172.21.15.12:0/3023112594 shutdown_connections 2024-09-05T01:26:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.333+0000 7f719fdc6740 1 -- 172.21.15.12:0/3023112594 wait complete. 2024-09-05T01:26:58.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.333+0000 7f719fdc6740 20 client.15669 trim_cache size 0 max 16384 2024-09-05T01:26:58.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.354+0000 7f719fdc6740 1 Processor -- start 2024-09-05T01:26:58.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.354+0000 7f719fdc6740 1 -- start start 2024-09-05T01:26:58.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.354+0000 7f719fdc6740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6a59fdcb0 0x55b6a59f9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:58.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.354+0000 7f719fdc6740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6a59fe5d0 0x55b6a5a20e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:58.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.354+0000 7f719fdc6740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b6a5a08e90 0x55b6a5a213d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:58.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.354+0000 7f719fdc6740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f71981b3da0 con 0x55b6a59fe5d0 2024-09-05T01:26:58.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.354+0000 7f719fdc6740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f71981b59a0 con 0x55b6a5a08e90 2024-09-05T01:26:58.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.354+0000 7f719fdc6740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f71981b4470 con 0x55b6a59fdcb0 2024-09-05T01:26:58.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.355+0000 7f718fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6a59fe5d0 0x55b6a5a20e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:58.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.355+0000 7f718fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6a59fe5d0 0x55b6a5a20e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34712/0 (socket says 172.21.15.12:34712) 2024-09-05T01:26:58.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.355+0000 7f718fe00640 1 -- 172.21.15.12:0/3337122609 learned_addr learned my addr 172.21.15.12:0/3337122609 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:58.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.355+0000 7f7195e00640 1 --2- 172.21.15.12:0/3337122609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6a59fdcb0 0x55b6a59f9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:58.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.355+0000 7f7196800640 1 --2- 172.21.15.12:0/3337122609 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b6a5a08e90 0x55b6a5a213d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:58.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.355+0000 7f718fe00640 1 -- 172.21.15.12:0/3337122609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6a59fdcb0 msgr2=0x55b6a59f9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:58.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.355+0000 7f718fe00640 1 --2- 172.21.15.12:0/3337122609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6a59fdcb0 0x55b6a59f9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.355+0000 7f718fe00640 1 -- 172.21.15.12:0/3337122609 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b6a5a08e90 msgr2=0x55b6a5a213d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:58.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.355+0000 7f718fe00640 1 --2- 172.21.15.12:0/3337122609 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b6a5a08e90 0x55b6a5a213d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.355+0000 7f718fe00640 1 -- 172.21.15.12:0/3337122609 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6a5a04960 con 0x55b6a59fe5d0 2024-09-05T01:26:58.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.355+0000 7f718fe00640 1 --2- 172.21.15.12:0/3337122609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6a59fe5d0 0x55b6a5a20e90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7180000c00 tx=0x7f7180009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe76a58a452b84b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:58.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.356+0000 7f7186a00640 1 -- 172.21.15.12:0/3337122609 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7180000e60 con 0x55b6a59fe5d0 2024-09-05T01:26:58.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.356+0000 7f7186a00640 1 -- 172.21.15.12:0/3337122609 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7180021cf0 con 0x55b6a59fe5d0 2024-09-05T01:26:58.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.356+0000 7f7186a00640 1 -- 172.21.15.12:0/3337122609 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7180003ab0 con 0x55b6a59fe5d0 2024-09-05T01:26:58.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.356+0000 7f719fdc6740 1 -- 172.21.15.12:0/3337122609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6a59fe5d0 msgr2=0x55b6a5a20e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:58.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.356+0000 7f719fdc6740 1 --2- 172.21.15.12:0/3337122609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6a59fe5d0 0x55b6a5a20e90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7180000c00 tx=0x7f7180009620 comp rx=0 tx=0).stop 2024-09-05T01:26:58.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.357+0000 7f719fdc6740 1 -- 172.21.15.12:0/3337122609 shutdown_connections 2024-09-05T01:26:58.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.357+0000 7f719fdc6740 1 --2- 172.21.15.12:0/3337122609 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b6a5a08e90 0x55b6a5a213d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.357+0000 7f719fdc6740 1 --2- 172.21.15.12:0/3337122609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6a59fe5d0 0x55b6a5a20e90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.357+0000 7f719fdc6740 1 --2- 172.21.15.12:0/3337122609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6a59fdcb0 0x55b6a59f9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.357+0000 7f719fdc6740 1 -- 172.21.15.12:0/3337122609 >> 172.21.15.12:0/3337122609 conn(0x55b6a59fa240 msgr2=0x55b6a59f8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.357+0000 7f719fdc6740 1 -- 172.21.15.12:0/3337122609 shutdown_connections 2024-09-05T01:26:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.357+0000 7f719fdc6740 1 -- 172.21.15.12:0/3337122609 wait complete. 2024-09-05T01:26:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.357+0000 7f719fdc6740 1 -- start start 2024-09-05T01:26:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.357+0000 7f719fdc6740 1 Processor -- start 2024-09-05T01:26:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.358+0000 7f719fdc6740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b6a59fdcb0 0x55b6a5a0d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.358+0000 7f719fdc6740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6a59fe5d0 0x55b6a5a0dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.358+0000 7f719fdc6740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6a5a08e90 0x55b6a5a7be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.358+0000 7f719fdc6740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f71981b5210 con 0x55b6a59fe5d0 2024-09-05T01:26:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.358+0000 7f719fdc6740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f71981b4b40 con 0x55b6a59fdcb0 2024-09-05T01:26:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.358+0000 7f719fdc6740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f71981b1d80 con 0x55b6a5a08e90 2024-09-05T01:26:58.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.358+0000 7f719fdc6740 10 client.0 _ll_register_callbacks cb 0x7f7180009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:26:58.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.358+0000 7f7195e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b6a59fdcb0 0x55b6a5a0d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:58.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.358+0000 7f7195e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b6a59fdcb0 0x55b6a5a0d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:41122/0 (socket says 172.21.15.12:41122) 2024-09-05T01:26:58.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.358+0000 7f7195e00640 1 -- 172.21.15.12:0/2432953628 learned_addr learned my addr 172.21.15.12:0/2432953628 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:26:58.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.358+0000 7f718fe00640 1 --2- 172.21.15.12:0/2432953628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6a59fe5d0 0x55b6a5a0dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:58.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.358+0000 7f7196800640 1 --2- 172.21.15.12:0/2432953628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6a5a08e90 0x55b6a5a7be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:58.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.359+0000 7f7195e00640 1 -- 172.21.15.12:0/2432953628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6a5a08e90 msgr2=0x55b6a5a7be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:58.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.359+0000 7f7195e00640 1 --2- 172.21.15.12:0/2432953628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6a5a08e90 0x55b6a5a7be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.359+0000 7f7195e00640 1 -- 172.21.15.12:0/2432953628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6a59fe5d0 msgr2=0x55b6a5a0dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:26:58.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.359+0000 7f7195e00640 1 --2- 172.21.15.12:0/2432953628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6a59fe5d0 0x55b6a5a0dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.359+0000 7f7195e00640 1 -- 172.21.15.12:0/2432953628 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6a5a7c650 con 0x55b6a59fdcb0 2024-09-05T01:26:58.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.359+0000 7f7195e00640 1 --2- 172.21.15.12:0/2432953628 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b6a59fdcb0 0x55b6a5a0d800 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f71880980f0 tx=0x7f718806f280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=779be60dd9cb6cfb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:26:58.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.359+0000 7f717be00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:26:58.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.359+0000 7f717be00640 1 -- 172.21.15.12:0/2432953628 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71880a4850 con 0x55b6a59fdcb0 2024-09-05T01:26:58.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.359+0000 7f717be00640 1 -- 172.21.15.12:0/2432953628 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f7188099f90 con 0x55b6a59fdcb0 2024-09-05T01:26:58.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.359+0000 7f719fdc6740 1 -- 172.21.15.12:0/2432953628 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7180021cf0 con 0x55b6a59fdcb0 2024-09-05T01:26:58.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.359+0000 7f717be00640 1 -- 172.21.15.12:0/2432953628 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7188098300 con 0x55b6a59fdcb0 2024-09-05T01:26:58.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.359+0000 7f719fdc6740 10 client.25694 fetch_fsmap learned FSMap version 31 2024-09-05T01:26:58.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.359+0000 7f719fdc6740 1 -- 172.21.15.12:0/2432953628 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b6a5a849a0 con 0x55b6a59fdcb0 2024-09-05T01:26:58.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.360+0000 7f717be00640 1 -- 172.21.15.12:0/2432953628 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7180021cf0 con 0x55b6a59fdcb0 2024-09-05T01:26:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.360+0000 7f717be00640 1 -- 172.21.15.12:0/2432953628 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f71880ba2d0 con 0x55b6a59fdcb0 2024-09-05T01:26:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.360+0000 7f719fdc6740 10 client.25694 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T01:26:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.360+0000 7f719fdc6740 10 client.25694 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:26:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.360+0000 7f719fdc6740 20 client.25694 populate_metadata read hostname 'smithi012' 2024-09-05T01:26:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.360+0000 7f719fdc6740 1 --2- 172.21.15.12:0/2432953628 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b6a5a84c20 0x55b6a5a87010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:26:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.360+0000 7f719fdc6740 4 client.25694 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-05T01:26:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.360+0000 7f719fdc6740 1 -- 172.21.15.12:0/2432953628 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b6a596bd10 con 0x55b6a5a84c20 2024-09-05T01:26:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.360+0000 7f718fe00640 1 --2- 172.21.15.12:0/2432953628 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b6a5a84c20 0x55b6a5a87010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:26:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.361+0000 7f718fe00640 1 --2- 172.21.15.12:0/2432953628 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b6a5a84c20 0x55b6a5a87010 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ea4e43a5c75a226 server_cookie=c665037f8a009d59 in_seq=0 out_seq=0 2024-09-05T01:26:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.361+0000 7f717be00640 10 client.25694 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:26:58.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:58 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:26:58.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:58 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:26:58.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:58 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:26:58.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:58 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:26:58.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:58 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:26:58.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:58 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:26:58.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.657+0000 7f717be00640 1 -- 172.21.15.12:0/2432953628 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b6a596bd10 con 0x55b6a5a84c20 2024-09-05T01:26:58.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.657+0000 7f717be00640 10 client.25694 handle_command_reply: tid=0 2024-09-05T01:26:58.657 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.657+0000 7f719fdc6740 1 client.25694 shutdown 2024-09-05T01:26:58.657 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:58 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:26:58.657 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:58 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:26:58.658 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:58 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:26:58.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.657+0000 7f719fdc6740 1 -- 172.21.15.12:0/2432953628 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b6a59fdcb0 msgr2=0x55b6a5a0d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:58.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.657+0000 7f719fdc6740 1 --2- 172.21.15.12:0/2432953628 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b6a59fdcb0 0x55b6a5a0d800 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f71880980f0 tx=0x7f718806f280 comp rx=0 tx=0).stop 2024-09-05T01:26:58.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.657+0000 7f719fdc6740 1 -- 172.21.15.12:0/2432953628 shutdown_connections 2024-09-05T01:26:58.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.657+0000 7f719fdc6740 1 --2- 172.21.15.12:0/2432953628 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b6a5a84c20 0x55b6a5a87010 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.657+0000 7f719fdc6740 1 --2- 172.21.15.12:0/2432953628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6a5a08e90 0x55b6a5a7be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.657+0000 7f719fdc6740 1 --2- 172.21.15.12:0/2432953628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b6a59fe5d0 0x55b6a5a0dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.657+0000 7f719fdc6740 1 --2- 172.21.15.12:0/2432953628 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b6a59fdcb0 0x55b6a5a0d800 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.657+0000 7f717be00640 0 client.25694 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:26:58.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.657+0000 7f719fdc6740 1 -- 172.21.15.12:0/2432953628 >> 172.21.15.12:0/2432953628 conn(0x55b6a59fa240 msgr2=0x55b6a59f9270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:58.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.657+0000 7f719fdc6740 1 -- 172.21.15.12:0/2432953628 shutdown_connections 2024-09-05T01:26:58.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.658+0000 7f719fdc6740 1 -- 172.21.15.12:0/2432953628 wait complete. 2024-09-05T01:26:58.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.658+0000 7f719fdc6740 20 client.25694 trim_cache size 0 max 16384 2024-09-05T01:26:58.659 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:26:58.659 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-05T01:26:58.660 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "44c1a9f4-43f6-40eb-8b38-576221a3ee7b", 2024-09-05T01:26:58.660 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-05T01:26:58.660 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:26:58.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.658+0000 7f7197200640 1 -- 172.21.15.12:0/273691022 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f717c0a2d70 msgr2=0x7f717c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:58.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.658+0000 7f7197200640 1 --2- 172.21.15.12:0/273691022 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f717c0a2d70 0x7f717c0a5230 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7190006010 tx=0x7f719002a8c0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.658+0000 7f7197200640 1 -- 172.21.15.12:0/273691022 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7198103e30 msgr2=0x7f7198076700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:26:58.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.658+0000 7f7197200640 1 --2- 172.21.15.12:0/273691022 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7198103e30 0x7f7198076700 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f718800ea50 tx=0x7f718800ef10 comp rx=0 tx=0).stop 2024-09-05T01:26:58.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.659+0000 7f7197200640 1 -- 172.21.15.12:0/273691022 shutdown_connections 2024-09-05T01:26:58.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.659+0000 7f7197200640 1 --2- 172.21.15.12:0/273691022 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f717c0a2d70 0x7f717c0a5230 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.659+0000 7f7197200640 1 --2- 172.21.15.12:0/273691022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7198108f60 0x7f7198077180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.659+0000 7f7197200640 1 --2- 172.21.15.12:0/273691022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71981047e0 0x7f7198076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.659+0000 7f7197200640 1 --2- 172.21.15.12:0/273691022 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7198103e30 0x7f7198076700 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:26:58.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.659+0000 7f7197200640 1 -- 172.21.15.12:0/273691022 >> 172.21.15.12:0/273691022 conn(0x7f71980ff910 msgr2=0x7f7198100bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:26:58.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.659+0000 7f7197200640 1 -- 172.21.15.12:0/273691022 shutdown_connections 2024-09-05T01:26:58.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:26:58.659+0000 7f7197200640 1 -- 172.21.15.12:0/273691022 wait complete. 2024-09-05T01:26:59.135 INFO:tasks.workunit.client.0.smithi012.stdout: 66 348244 754 242007 496 40534 30 2024-09-05T01:26:59.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:26:59 smithi012 ceph-mon[29942]: pgmap v71: 97 pgs: 97 active+clean; 232 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 14 MiB/s wr, 680 op/s 2024-09-05T01:26:59.613 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T01:26:59.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:26:59 smithi145 ceph-mon[34376]: pgmap v71: 97 pgs: 97 active+clean; 232 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 14 MiB/s wr, 680 op/s 2024-09-05T01:26:59.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:26:59 smithi151 ceph-mon[35013]: pgmap v71: 97 pgs: 97 active+clean; 232 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 14 MiB/s wr, 680 op/s 2024-09-05T01:27:00.269 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:27:00.643 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:00 smithi012 ceph-mon[29942]: scrub queued for path: / 2024-09-05T01:27:00.643 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:00 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:00.643 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:00 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:27:00.643 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:00 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:27:00.643 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:00 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:27:00.643 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:00 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:27:00.643 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:00 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:00.643 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:00 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:00.643 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:00 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:27:00.643 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:00 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:27:00.644 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:00 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:00.644 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:00 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:00.644 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:00 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:27:00.644 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:00 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:27:00.644 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:00 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:00.644 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:00 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:00.644 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:00 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:27:00.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:00 smithi145 ceph-mon[34376]: scrub queued for path: / 2024-09-05T01:27:00.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:00 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:00.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:00 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:27:00.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:00 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:27:00.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:00 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:27:00.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:00 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:27:00.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:00 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:00.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:00 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:00.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:00 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:27:00.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:00 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:27:00.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:00 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:00.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:00 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:00.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:00 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:27:00.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:00 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:27:00.836 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:00 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:00.836 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:00 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:00.836 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:00 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:27:00.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:00 smithi151 ceph-mon[35013]: scrub queued for path: / 2024-09-05T01:27:00.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:00 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:00.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:00 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:27:00.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:00 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:27:00.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:00 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:27:00.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:00 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:27:00.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:00 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:00.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:00 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:00.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:00 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:27:00.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:00 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:27:00.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:00 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:00.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:00 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:00.856 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:00 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:27:00.856 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:00 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:27:00.856 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:00 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:00.856 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:00 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:00.856 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:00 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:27:00.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.890+0000 7f6894600640 1 -- 172.21.15.12:0/45519068 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f688c104010 msgr2=0x7f688c1043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:27:00.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.890+0000 7f6894600640 1 --2- 172.21.15.12:0/45519068 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f688c104010 0x7f688c1043f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6880009900 tx=0x7f688002a3f0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.890+0000 7f6894600640 1 -- 172.21.15.12:0/45519068 shutdown_connections 2024-09-05T01:27:00.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.890+0000 7f6894600640 1 --2- 172.21.15.12:0/45519068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f688c109140 0x7f688c110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.890+0000 7f6894600640 1 --2- 172.21.15.12:0/45519068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f688c1049c0 0x7f688c108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.890+0000 7f6894600640 1 --2- 172.21.15.12:0/45519068 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f688c104010 0x7f688c1043f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.890+0000 7f6894600640 1 -- 172.21.15.12:0/45519068 >> 172.21.15.12:0/45519068 conn(0x7f688c0ffa50 msgr2=0x7f688c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:27:00.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.890+0000 7f6894600640 1 -- 172.21.15.12:0/45519068 shutdown_connections 2024-09-05T01:27:00.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.890+0000 7f6894600640 1 -- 172.21.15.12:0/45519068 wait complete. 2024-09-05T01:27:00.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.891+0000 7f6894600640 1 Processor -- start 2024-09-05T01:27:00.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.891+0000 7f6894600640 1 -- start start 2024-09-05T01:27:00.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.892+0000 7f6894600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f688c104010 0x7f688c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:00.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.892+0000 7f6894600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f688c1049c0 0x7f688c19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:00.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.892+0000 7f6894600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f688c109140 0x7f688c19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:00.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.892+0000 7f6894600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f688c114190 con 0x7f688c109140 2024-09-05T01:27:00.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.892+0000 7f6894600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f688c114010 con 0x7f688c1049c0 2024-09-05T01:27:00.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.892+0000 7f6894600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f688c114310 con 0x7f688c104010 2024-09-05T01:27:00.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.892+0000 7f6891c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f688c104010 0x7f688c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:00.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.892+0000 7f6891200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f688c1049c0 0x7f688c19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:00.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.892+0000 7f6891c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f688c104010 0x7f688c19a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:52656/0 (socket says 172.21.15.12:52656) 2024-09-05T01:27:00.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.892+0000 7f6892600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f688c109140 0x7f688c19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:00.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.892+0000 7f6891c00640 1 -- 172.21.15.12:0/995751919 learned_addr learned my addr 172.21.15.12:0/995751919 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:27:00.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.893+0000 7f6891200640 1 -- 172.21.15.12:0/995751919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f688c104010 msgr2=0x7f688c19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:27:00.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.893+0000 7f6891200640 1 --2- 172.21.15.12:0/995751919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f688c104010 0x7f688c19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.893+0000 7f6891200640 1 -- 172.21.15.12:0/995751919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f688c109140 msgr2=0x7f688c19ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:27:00.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.893+0000 7f6891200640 1 --2- 172.21.15.12:0/995751919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f688c109140 0x7f688c19ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.893+0000 7f6891200640 1 -- 172.21.15.12:0/995751919 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f688c19f600 con 0x7f688c1049c0 2024-09-05T01:27:00.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.893+0000 7f6891200640 1 --2- 172.21.15.12:0/995751919 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f688c1049c0 0x7f688c19ab90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f687800e9f0 tx=0x7f687800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:27:00.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.894+0000 7f688a000640 1 -- 172.21.15.12:0/995751919 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687800ccc0 con 0x7f688c1049c0 2024-09-05T01:27:00.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.894+0000 7f688a000640 1 -- 172.21.15.12:0/995751919 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68780035f0 con 0x7f688c1049c0 2024-09-05T01:27:00.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.894+0000 7f6894600640 1 -- 172.21.15.12:0/995751919 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f688c19f8f0 con 0x7f688c1049c0 2024-09-05T01:27:00.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.894+0000 7f6894600640 1 -- 172.21.15.12:0/995751919 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f688c1a71d0 con 0x7f688c1049c0 2024-09-05T01:27:00.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.894+0000 7f688a000640 1 -- 172.21.15.12:0/995751919 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687800ce60 con 0x7f688c1049c0 2024-09-05T01:27:00.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.898+0000 7f6897268740 1 Processor -- start 2024-09-05T01:27:00.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.898+0000 7f6897268740 1 -- start start 2024-09-05T01:27:00.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.898+0000 7f688a000640 1 -- 172.21.15.12:0/995751919 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f6878004000 con 0x7f688c1049c0 2024-09-05T01:27:00.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.899+0000 7f6897268740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b379424b90 0x55b379424f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:00.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.899+0000 7f6897268740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3794254b0 0x55b37942f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:00.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.899+0000 7f6897268740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b37942fd70 0x55b379432160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:00.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.899+0000 7f6897268740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b37938b3e0 con 0x55b379424b90 2024-09-05T01:27:00.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.899+0000 7f6897268740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55b379332d80 con 0x55b37942fd70 2024-09-05T01:27:00.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.899+0000 7f6897268740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b3793873a0 con 0x55b3794254b0 2024-09-05T01:27:00.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.899+0000 7f6891c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3794254b0 0x55b37942f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:00.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.899+0000 7f6892600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b379424b90 0x55b379424f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:00.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.899+0000 7f6891c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3794254b0 0x55b37942f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:52662/0 (socket says 172.21.15.12:52662) 2024-09-05T01:27:00.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.899+0000 7f6891c00640 1 -- 172.21.15.12:0/3865118485 learned_addr learned my addr 172.21.15.12:0/3865118485 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:27:00.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.900+0000 7f6891c00640 1 -- 172.21.15.12:0/3865118485 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b37942fd70 msgr2=0x55b379432160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:27:00.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.900+0000 7f6891200640 1 --2- 172.21.15.12:0/3865118485 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b37942fd70 0x55b379432160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:00.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.900+0000 7f6891c00640 1 --2- 172.21.15.12:0/3865118485 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b37942fd70 0x55b379432160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.900+0000 7f6891c00640 1 -- 172.21.15.12:0/3865118485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b379424b90 msgr2=0x55b379424f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:27:00.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.900+0000 7f6891c00640 1 --2- 172.21.15.12:0/3865118485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b379424b90 0x55b379424f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.900+0000 7f6891c00640 1 -- 172.21.15.12:0/3865118485 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b379351ae0 con 0x55b3794254b0 2024-09-05T01:27:00.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.900+0000 7f6892600640 1 --2- 172.21.15.12:0/3865118485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b379424b90 0x55b379424f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:27:00.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.900+0000 7f6891c00640 1 --2- 172.21.15.12:0/3865118485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3794254b0 0x55b37942f830 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6880005dd0 tx=0x7f6880005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c287c82db6b27dae server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:27:00.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.900+0000 7f687ea00640 1 -- 172.21.15.12:0/3865118485 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880040070 con 0x55b3794254b0 2024-09-05T01:27:00.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.900+0000 7f688a000640 1 --2- 172.21.15.12:0/995751919 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f68740a2d70 0x7f68740a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:00.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.900+0000 7f687ea00640 1 -- 172.21.15.12:0/3865118485 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6880004400 con 0x55b3794254b0 2024-09-05T01:27:00.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.900+0000 7f687ea00640 1 -- 172.21.15.12:0/3865118485 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880035040 con 0x55b3794254b0 2024-09-05T01:27:00.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.901+0000 7f688a000640 1 -- 172.21.15.12:0/995751919 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f68780cf500 con 0x7f688c1049c0 2024-09-05T01:27:00.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.901+0000 7f6892600640 1 --2- 172.21.15.12:0/995751919 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f68740a2d70 0x7f68740a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:00.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.902+0000 7f6897268740 1 -- 172.21.15.12:0/3865118485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3794254b0 msgr2=0x55b37942f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:27:00.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.902+0000 7f6897268740 1 --2- 172.21.15.12:0/3865118485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3794254b0 0x55b37942f830 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6880005dd0 tx=0x7f6880005c00 comp rx=0 tx=0).stop 2024-09-05T01:27:00.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.902+0000 7f6897268740 1 -- 172.21.15.12:0/3865118485 shutdown_connections 2024-09-05T01:27:00.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.902+0000 7f6897268740 1 --2- 172.21.15.12:0/3865118485 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b37942fd70 0x55b379432160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.902+0000 7f6897268740 1 --2- 172.21.15.12:0/3865118485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3794254b0 0x55b37942f830 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.902+0000 7f6897268740 1 --2- 172.21.15.12:0/3865118485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b379424b90 0x55b379424f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.902+0000 7f6897268740 1 -- 172.21.15.12:0/3865118485 >> 172.21.15.12:0/3865118485 conn(0x55b379421120 msgr2=0x55b379421500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:27:00.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.902+0000 7f6892600640 1 --2- 172.21.15.12:0/995751919 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f68740a2d70 0x7f68740a5230 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6884005fd0 tx=0x7f6884009500 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:27:00.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.902+0000 7f6897268740 1 -- 172.21.15.12:0/3865118485 shutdown_connections 2024-09-05T01:27:00.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.902+0000 7f6897268740 1 -- 172.21.15.12:0/3865118485 wait complete. 2024-09-05T01:27:00.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.903+0000 7f6897268740 1 -- start start 2024-09-05T01:27:00.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.903+0000 7f6897268740 1 Processor -- start 2024-09-05T01:27:00.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.903+0000 7f6897268740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b379424b90 0x55b37942cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:00.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.903+0000 7f6897268740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3794254b0 0x55b37942d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:00.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.903+0000 7f6897268740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b37942fd70 0x55b37942d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:00.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.903+0000 7f6897268740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b3794329e0 con 0x55b379424b90 2024-09-05T01:27:00.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.903+0000 7f6897268740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55b3793460f0 con 0x55b37942fd70 2024-09-05T01:27:00.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.903+0000 7f6897268740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b379432b60 con 0x55b3794254b0 2024-09-05T01:27:00.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.903+0000 7f6897268740 10 client.0 _ll_register_callbacks cb 0x55b3793379e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:27:00.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.904+0000 7f6892600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b37942fd70 0x55b37942d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:00.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.904+0000 7f6892600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b37942fd70 0x55b37942d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:41160/0 (socket says 172.21.15.12:41160) 2024-09-05T01:27:00.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.904+0000 7f6892600640 1 -- 172.21.15.12:0/2486748302 learned_addr learned my addr 172.21.15.12:0/2486748302 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:27:00.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.904+0000 7f6891c00640 1 --2- 172.21.15.12:0/2486748302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b379424b90 0x55b37942cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:00.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.904+0000 7f6891200640 1 --2- 172.21.15.12:0/2486748302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3794254b0 0x55b37942d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:00.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.904+0000 7f6892600640 1 -- 172.21.15.12:0/2486748302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3794254b0 msgr2=0x55b37942d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:27:00.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.904+0000 7f6892600640 1 --2- 172.21.15.12:0/2486748302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3794254b0 0x55b37942d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.904+0000 7f6892600640 1 -- 172.21.15.12:0/2486748302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b379424b90 msgr2=0x55b37942cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:27:00.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.904+0000 7f6892600640 1 --2- 172.21.15.12:0/2486748302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b379424b90 0x55b37942cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.904+0000 7f6892600640 1 -- 172.21.15.12:0/2486748302 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3790fc3c0 con 0x55b37942fd70 2024-09-05T01:27:00.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.904+0000 7f6892600640 1 --2- 172.21.15.12:0/2486748302 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b37942fd70 0x55b37942d600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6884009b80 tx=0x7f6884004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6f1db4c25245276 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:27:00.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.904+0000 7f6873400640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:27:00.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.905+0000 7f6873400640 1 -- 172.21.15.12:0/2486748302 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6884003b80 con 0x55b37942fd70 2024-09-05T01:27:00.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.905+0000 7f6873400640 1 -- 172.21.15.12:0/2486748302 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f6884003d20 con 0x55b37942fd70 2024-09-05T01:27:00.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.905+0000 7f6897268740 1 -- 172.21.15.12:0/2486748302 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6880004400 con 0x55b37942fd70 2024-09-05T01:27:00.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.905+0000 7f6873400640 1 -- 172.21.15.12:0/2486748302 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f6884004050 con 0x55b37942fd70 2024-09-05T01:27:00.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.905+0000 7f6897268740 10 client.25703 fetch_fsmap learned FSMap version 31 2024-09-05T01:27:00.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.905+0000 7f6897268740 1 -- 172.21.15.12:0/2486748302 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b37943e670 con 0x55b37942fd70 2024-09-05T01:27:00.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.905+0000 7f6873400640 1 -- 172.21.15.12:0/2486748302 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6880004400 con 0x55b37942fd70 2024-09-05T01:27:00.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.905+0000 7f6873400640 1 -- 172.21.15.12:0/2486748302 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f6884027020 con 0x55b37942fd70 2024-09-05T01:27:00.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.906+0000 7f6897268740 10 client.25703 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T01:27:00.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.906+0000 7f6897268740 10 client.25703 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:27:00.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.906+0000 7f6897268740 20 client.25703 populate_metadata read hostname 'smithi012' 2024-09-05T01:27:00.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.906+0000 7f6897268740 1 --2- 172.21.15.12:0/2486748302 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b37943faf0 0x55b379441f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:00.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.906+0000 7f6897268740 4 client.25703 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:27:00.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.906+0000 7f6897268740 1 -- 172.21.15.12:0/2486748302 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b379398950 con 0x55b37943faf0 2024-09-05T01:27:00.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.906+0000 7f6891c00640 1 --2- 172.21.15.12:0/2486748302 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b37943faf0 0x55b379441f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:00.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.906+0000 7f6891c00640 1 --2- 172.21.15.12:0/2486748302 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b37943faf0 0x55b379441f90 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58fe3936d0c510c8 server_cookie=bcdeb9bb916fb345 in_seq=0 out_seq=0 2024-09-05T01:27:00.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.906+0000 7f6873400640 10 client.25703 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:27:00.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.907+0000 7f6873400640 1 -- 172.21.15.12:0/2486748302 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b379398950 con 0x55b37943faf0 2024-09-05T01:27:00.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.907+0000 7f6873400640 10 client.25703 handle_command_reply: tid=0 2024-09-05T01:27:00.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.907+0000 7f6897268740 1 client.25703 shutdown 2024-09-05T01:27:00.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.908+0000 7f6897268740 1 -- 172.21.15.12:0/2486748302 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b37942fd70 msgr2=0x55b37942d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:27:00.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.908+0000 7f6897268740 1 --2- 172.21.15.12:0/2486748302 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b37942fd70 0x55b37942d600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6884009b80 tx=0x7f6884004ab0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.908+0000 7f6897268740 1 -- 172.21.15.12:0/2486748302 shutdown_connections 2024-09-05T01:27:00.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.908+0000 7f6897268740 1 --2- 172.21.15.12:0/2486748302 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b37943faf0 0x55b379441f90 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.908+0000 7f6897268740 1 --2- 172.21.15.12:0/2486748302 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b37942fd70 0x55b37942d600 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.908+0000 7f6897268740 1 --2- 172.21.15.12:0/2486748302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3794254b0 0x55b37942d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.908+0000 7f6897268740 1 --2- 172.21.15.12:0/2486748302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b379424b90 0x55b37942cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.908+0000 7f6897268740 1 -- 172.21.15.12:0/2486748302 >> 172.21.15.12:0/2486748302 conn(0x55b379421120 msgr2=0x55b379426e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:27:00.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.908+0000 7f6873400640 0 client.25703 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:27:00.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.908+0000 7f6897268740 1 -- 172.21.15.12:0/2486748302 shutdown_connections 2024-09-05T01:27:00.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.908+0000 7f6897268740 1 -- 172.21.15.12:0/2486748302 wait complete. 2024-09-05T01:27:00.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.908+0000 7f6897268740 20 client.25703 trim_cache size 0 max 16384 2024-09-05T01:27:00.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.926+0000 7f6897268740 1 Processor -- start 2024-09-05T01:27:00.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.926+0000 7f6897268740 1 -- start start 2024-09-05T01:27:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.926+0000 7f6897268740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b379424b90 0x55b379441a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.926+0000 7f6897268740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b3794254b0 0x55b37942ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.926+0000 7f6897268740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b37942fd70 0x55b3794478f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.926+0000 7f6897268740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f686c00e7c0 con 0x55b37942fd70 2024-09-05T01:27:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.926+0000 7f6897268740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f686c0103c0 con 0x55b3794254b0 2024-09-05T01:27:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.926+0000 7f6897268740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f686c00ee90 con 0x55b379424b90 2024-09-05T01:27:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.927+0000 7f6891c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b379424b90 0x55b379441a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.927+0000 7f6891200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b3794254b0 0x55b37942ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.927+0000 7f6891c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b379424b90 0x55b379441a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:52674/0 (socket says 172.21.15.12:52674) 2024-09-05T01:27:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.927+0000 7f6891c00640 1 -- 172.21.15.12:0/2719942707 learned_addr learned my addr 172.21.15.12:0/2719942707 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:27:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.927+0000 7f6892600640 1 --2- 172.21.15.12:0/2719942707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b37942fd70 0x55b3794478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.927+0000 7f6891c00640 1 -- 172.21.15.12:0/2719942707 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b3794254b0 msgr2=0x55b37942ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:27:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.927+0000 7f6891c00640 1 --2- 172.21.15.12:0/2719942707 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b3794254b0 0x55b37942ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.927+0000 7f6891c00640 1 -- 172.21.15.12:0/2719942707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b37942fd70 msgr2=0x55b3794478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:27:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.927+0000 7f6891c00640 1 --2- 172.21.15.12:0/2719942707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b37942fd70 0x55b3794478f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.927+0000 7f6891c00640 1 -- 172.21.15.12:0/2719942707 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b37942f4f0 con 0x55b379424b90 2024-09-05T01:27:00.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.927+0000 7f6892600640 1 --2- 172.21.15.12:0/2719942707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b37942fd70 0x55b3794478f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:27:00.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.927+0000 7f6891c00640 1 --2- 172.21.15.12:0/2719942707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b379424b90 0x55b379441a90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6880004cb0 tx=0x7f6880009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ea6d3c31a9756a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:27:00.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.928+0000 7f687e000640 1 -- 172.21.15.12:0/2719942707 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880040040 con 0x55b379424b90 2024-09-05T01:27:00.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.928+0000 7f687e000640 1 -- 172.21.15.12:0/2719942707 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6880004400 con 0x55b379424b90 2024-09-05T01:27:00.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.928+0000 7f687e000640 1 -- 172.21.15.12:0/2719942707 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880035040 con 0x55b379424b90 2024-09-05T01:27:00.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.928+0000 7f6897268740 1 -- 172.21.15.12:0/2719942707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b379424b90 msgr2=0x55b379441a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:27:00.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.928+0000 7f6897268740 1 --2- 172.21.15.12:0/2719942707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b379424b90 0x55b379441a90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6880004cb0 tx=0x7f6880009260 comp rx=0 tx=0).stop 2024-09-05T01:27:00.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.929+0000 7f6897268740 1 -- 172.21.15.12:0/2719942707 shutdown_connections 2024-09-05T01:27:00.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.929+0000 7f6897268740 1 --2- 172.21.15.12:0/2719942707 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b37942fd70 0x55b3794478f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.929+0000 7f6897268740 1 --2- 172.21.15.12:0/2719942707 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b3794254b0 0x55b37942ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.929+0000 7f6897268740 1 --2- 172.21.15.12:0/2719942707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b379424b90 0x55b379441a90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.929+0000 7f6897268740 1 -- 172.21.15.12:0/2719942707 >> 172.21.15.12:0/2719942707 conn(0x55b379421120 msgr2=0x55b37942b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:27:00.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.929+0000 7f6897268740 1 -- 172.21.15.12:0/2719942707 shutdown_connections 2024-09-05T01:27:00.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.929+0000 7f6897268740 1 -- 172.21.15.12:0/2719942707 wait complete. 2024-09-05T01:27:00.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.929+0000 7f6897268740 1 -- start start 2024-09-05T01:27:00.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.930+0000 7f6897268740 1 Processor -- start 2024-09-05T01:27:00.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.930+0000 7f6897268740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b379424b90 0x55b379433dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:00.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.930+0000 7f6897268740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3794254b0 0x55b379434310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:00.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.930+0000 7f6897268740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b37942fd70 0x55b379434850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:00.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.930+0000 7f6897268740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f686c00fc30 con 0x55b379424b90 2024-09-05T01:27:00.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.930+0000 7f6897268740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f686c00f560 con 0x55b37942fd70 2024-09-05T01:27:00.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.930+0000 7f6897268740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f686c00c7a0 con 0x55b3794254b0 2024-09-05T01:27:00.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.930+0000 7f6897268740 10 client.0 _ll_register_callbacks cb 0x7f6884009cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:27:00.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.931+0000 7f6891c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b379424b90 0x55b379433dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:00.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.931+0000 7f6891200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3794254b0 0x55b379434310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:00.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.931+0000 7f6891c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b379424b90 0x55b379433dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34790/0 (socket says 172.21.15.12:34790) 2024-09-05T01:27:00.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.931+0000 7f6891c00640 1 -- 172.21.15.12:0/2855005449 learned_addr learned my addr 172.21.15.12:0/2855005449 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:27:00.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.931+0000 7f6892600640 1 --2- 172.21.15.12:0/2855005449 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b37942fd70 0x55b379434850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:00.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.931+0000 7f6891200640 1 -- 172.21.15.12:0/2855005449 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b37942fd70 msgr2=0x55b379434850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:27:00.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.931+0000 7f6891200640 1 --2- 172.21.15.12:0/2855005449 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b37942fd70 0x55b379434850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.931+0000 7f6891200640 1 -- 172.21.15.12:0/2855005449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b379424b90 msgr2=0x55b379433dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:27:00.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.931+0000 7f6891200640 1 --2- 172.21.15.12:0/2855005449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b379424b90 0x55b379433dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.931+0000 7f6891200640 1 -- 172.21.15.12:0/2855005449 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3794a9b10 con 0x55b3794254b0 2024-09-05T01:27:00.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.931+0000 7f6891c00640 1 --2- 172.21.15.12:0/2855005449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b379424b90 0x55b379433dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:27:00.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.932+0000 7f6891200640 1 --2- 172.21.15.12:0/2855005449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3794254b0 0x55b379434310 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f68780ccc40 tx=0x7f687809ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c767174564b8a79e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:27:00.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.932+0000 7f6873400640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:27:00.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.932+0000 7f6873400640 1 -- 172.21.15.12:0/2855005449 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878098080 con 0x55b3794254b0 2024-09-05T01:27:00.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.932+0000 7f6873400640 1 -- 172.21.15.12:0/2855005449 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f687809bc70 con 0x55b3794254b0 2024-09-05T01:27:00.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.932+0000 7f6897268740 1 -- 172.21.15.12:0/2855005449 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6880004400 con 0x55b3794254b0 2024-09-05T01:27:00.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.933+0000 7f6873400640 1 -- 172.21.15.12:0/2855005449 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f6878098220 con 0x55b3794254b0 2024-09-05T01:27:00.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.933+0000 7f6897268740 10 client.25702 fetch_fsmap learned FSMap version 31 2024-09-05T01:27:00.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.933+0000 7f6897268740 1 -- 172.21.15.12:0/2855005449 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b3794aae20 con 0x55b3794254b0 2024-09-05T01:27:00.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.933+0000 7f6873400640 1 -- 172.21.15.12:0/2855005449 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6880004400 con 0x55b3794254b0 2024-09-05T01:27:00.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.933+0000 7f6873400640 1 -- 172.21.15.12:0/2855005449 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f68780cf040 con 0x55b3794254b0 2024-09-05T01:27:00.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.933+0000 7f6897268740 10 client.25702 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T01:27:00.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.933+0000 7f6897268740 10 client.25702 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:27:00.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.933+0000 7f6897268740 20 client.25702 populate_metadata read hostname 'smithi012' 2024-09-05T01:27:00.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.933+0000 7f6897268740 1 --2- 172.21.15.12:0/2855005449 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b3794ab600 0x55b3794ada20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:00.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.933+0000 7f6897268740 4 client.25702 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T01:27:00.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.933+0000 7f6897268740 1 -- 172.21.15.12:0/2855005449 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b379392e60 con 0x55b3794ab600 2024-09-05T01:27:00.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.934+0000 7f6891c00640 1 --2- 172.21.15.12:0/2855005449 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b3794ab600 0x55b3794ada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:00.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.934+0000 7f6891c00640 1 --2- 172.21.15.12:0/2855005449 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b3794ab600 0x55b3794ada20 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a34a781e4f24ae3 server_cookie=948e84855f050304 in_seq=0 out_seq=0 2024-09-05T01:27:00.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.934+0000 7f6873400640 10 client.25702 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:27:00.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.934+0000 7f6873400640 1 -- 172.21.15.12:0/2855005449 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b379392e60 con 0x55b3794ab600 2024-09-05T01:27:00.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.934+0000 7f6873400640 10 client.25702 handle_command_reply: tid=0 2024-09-05T01:27:00.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.934+0000 7f6897268740 1 client.25702 shutdown 2024-09-05T01:27:00.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.935+0000 7f6897268740 1 -- 172.21.15.12:0/2855005449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3794254b0 msgr2=0x55b379434310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:27:00.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.935+0000 7f6897268740 1 --2- 172.21.15.12:0/2855005449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3794254b0 0x55b379434310 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f68780ccc40 tx=0x7f687809ba10 comp rx=0 tx=0).stop 2024-09-05T01:27:00.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.935+0000 7f6897268740 1 -- 172.21.15.12:0/2855005449 shutdown_connections 2024-09-05T01:27:00.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.935+0000 7f6897268740 1 --2- 172.21.15.12:0/2855005449 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b3794ab600 0x55b3794ada20 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.935+0000 7f6897268740 1 --2- 172.21.15.12:0/2855005449 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b37942fd70 0x55b379434850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.935+0000 7f6897268740 1 --2- 172.21.15.12:0/2855005449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3794254b0 0x55b379434310 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.935+0000 7f6873400640 0 client.25702 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:27:00.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.935+0000 7f6897268740 1 --2- 172.21.15.12:0/2855005449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b379424b90 0x55b379433dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.935+0000 7f6897268740 1 -- 172.21.15.12:0/2855005449 >> 172.21.15.12:0/2855005449 conn(0x55b379421120 msgr2=0x55b37942d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:27:00.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.935+0000 7f6897268740 1 -- 172.21.15.12:0/2855005449 shutdown_connections 2024-09-05T01:27:00.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.935+0000 7f6897268740 1 -- 172.21.15.12:0/2855005449 wait complete. 2024-09-05T01:27:00.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.935+0000 7f6897268740 20 client.25702 trim_cache size 0 max 16384 2024-09-05T01:27:00.942 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:27:00.943 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-05T01:27:00.943 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-05T01:27:00.943 INFO:teuthology.orchestra.run.smithi012.stdout: "44c1a9f4-43f6-40eb-8b38-576221a3ee7b": { 2024-09-05T01:27:00.943 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-05T01:27:00.943 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "44c1a9f4-43f6-40eb-8b38-576221a3ee7b", 2024-09-05T01:27:00.943 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-05T01:27:00.943 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:27:00.943 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:27:00.943 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:27:00.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.936+0000 7f6894600640 1 -- 172.21.15.12:0/995751919 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f68740a2d70 msgr2=0x7f68740a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:27:00.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.936+0000 7f6894600640 1 --2- 172.21.15.12:0/995751919 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f68740a2d70 0x7f68740a5230 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6884005fd0 tx=0x7f6884009500 comp rx=0 tx=0).stop 2024-09-05T01:27:00.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.936+0000 7f6894600640 1 -- 172.21.15.12:0/995751919 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f688c1049c0 msgr2=0x7f688c19ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:27:00.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.936+0000 7f6894600640 1 --2- 172.21.15.12:0/995751919 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f688c1049c0 0x7f688c19ab90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f687800e9f0 tx=0x7f687800edf0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.936+0000 7f6894600640 1 -- 172.21.15.12:0/995751919 shutdown_connections 2024-09-05T01:27:00.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.936+0000 7f6894600640 1 --2- 172.21.15.12:0/995751919 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f68740a2d70 0x7f68740a5230 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.936+0000 7f6894600640 1 --2- 172.21.15.12:0/995751919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f688c109140 0x7f688c19ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.936+0000 7f6894600640 1 --2- 172.21.15.12:0/995751919 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f688c1049c0 0x7f688c19ab90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.936+0000 7f6894600640 1 --2- 172.21.15.12:0/995751919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f688c104010 0x7f688c19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:00.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.936+0000 7f6894600640 1 -- 172.21.15.12:0/995751919 >> 172.21.15.12:0/995751919 conn(0x7f688c0ffa50 msgr2=0x7f688c100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:27:00.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.936+0000 7f6894600640 1 -- 172.21.15.12:0/995751919 shutdown_connections 2024-09-05T01:27:00.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:00.936+0000 7f6894600640 1 -- 172.21.15.12:0/995751919 wait complete. 2024-09-05T01:27:01.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: pgmap v72: 97 pgs: 97 active+clean; 232 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 14 MiB/s wr, 627 op/s 2024-09-05T01:27:01.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:27:01.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:27:01.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:27:01.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:27:01.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:27:01.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:27:01.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:27:01.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:27:01.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:27:01.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:27:01.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:27:01.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:27:01.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:27:01.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:01 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.782 INFO:tasks.cephfs.filesystem:scrub status for tag:44c1a9f4-43f6-40eb-8b38-576221a3ee7b - {'path': '/', 'tag': '44c1a9f4-43f6-40eb-8b38-576221a3ee7b', 'options': 'recursive,force'} 2024-09-05T01:27:01.852 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: pgmap v72: 97 pgs: 97 active+clean; 232 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 14 MiB/s wr, 627 op/s 2024-09-05T01:27:01.852 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:27:01.852 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.852 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:27:01.852 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.852 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:27:01.852 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.852 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:27:01.853 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:27:01.853 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.853 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.853 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.853 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.853 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:27:01.853 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.853 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:27:01.853 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:27:01.853 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.853 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:27:01.853 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.853 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:27:01.854 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.854 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:27:01.854 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.854 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:27:01.854 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.854 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:27:01.854 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:01 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.862 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: pgmap v72: 97 pgs: 97 active+clean; 232 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 14 MiB/s wr, 627 op/s 2024-09-05T01:27:01.862 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:27:01.862 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.862 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:27:01.862 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.862 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:27:01.863 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.863 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:27:01.863 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:27:01.863 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.863 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.863 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.863 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.863 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:27:01.863 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.863 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:27:01.863 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:27:01.863 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.863 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:27:01.864 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.864 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:27:01.864 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.864 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:27:01.864 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.864 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:27:01.864 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:01.864 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:27:01.864 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:01 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:02.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:02 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:02.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:02 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:27:02.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:02 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:02.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:02 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:27:02.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:02 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:02.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:02 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:02.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:02 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:02.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:02 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:27:02.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:02 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:02.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:02 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:27:02.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:02 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:02.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:02 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:02.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:02 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:02.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:02 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:27:02.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:02 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:02.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:02 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:27:02.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:02 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:02.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:02 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:27:03.754 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:03 smithi151 ceph-mon[35013]: pgmap v73: 97 pgs: 97 active+clean; 232 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 14 MiB/s wr, 627 op/s 2024-09-05T01:27:03.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:03 smithi012 ceph-mon[29942]: pgmap v73: 97 pgs: 97 active+clean; 232 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 14 MiB/s wr, 627 op/s 2024-09-05T01:27:03.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:03 smithi145 ceph-mon[34376]: pgmap v73: 97 pgs: 97 active+clean; 232 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 14 MiB/s wr, 627 op/s 2024-09-05T01:27:05.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:05 smithi012 ceph-mon[29942]: pgmap v74: 97 pgs: 97 active+clean; 240 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 695 op/s 2024-09-05T01:27:05.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:05 smithi145 ceph-mon[34376]: pgmap v74: 97 pgs: 97 active+clean; 240 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 695 op/s 2024-09-05T01:27:05.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:05 smithi151 ceph-mon[35013]: pgmap v74: 97 pgs: 97 active+clean; 240 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 695 op/s 2024-09-05T01:27:07.820 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:07 smithi012 ceph-mon[29942]: pgmap v75: 97 pgs: 97 active+clean; 240 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 11 MiB/s wr, 484 op/s 2024-09-05T01:27:07.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:07 smithi145 ceph-mon[34376]: pgmap v75: 97 pgs: 97 active+clean; 240 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 11 MiB/s wr, 484 op/s 2024-09-05T01:27:07.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:07 smithi151 ceph-mon[35013]: pgmap v75: 97 pgs: 97 active+clean; 240 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 11 MiB/s wr, 484 op/s 2024-09-05T01:27:09.132 INFO:tasks.workunit.client.0.smithi012.stdout: 88 517012 1010 344767 1005 61974 693 2024-09-05T01:27:09.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:09 smithi012 ceph-mon[29942]: pgmap v76: 97 pgs: 97 active+clean; 249 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 524 op/s 2024-09-05T01:27:09.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:09 smithi145 ceph-mon[34376]: pgmap v76: 97 pgs: 97 active+clean; 249 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 524 op/s 2024-09-05T01:27:09.853 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:09 smithi151 ceph-mon[35013]: pgmap v76: 97 pgs: 97 active+clean; 249 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 524 op/s 2024-09-05T01:27:11.731 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:11 smithi012 ceph-mon[29942]: pgmap v77: 97 pgs: 97 active+clean; 249 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 107 op/s 2024-09-05T01:27:11.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:11 smithi145 ceph-mon[34376]: pgmap v77: 97 pgs: 97 active+clean; 249 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 107 op/s 2024-09-05T01:27:11.853 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:11 smithi151 ceph-mon[35013]: pgmap v77: 97 pgs: 97 active+clean; 249 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 107 op/s 2024-09-05T01:27:12.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:12 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:27:12.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:12 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:27:12.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:12 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:27:13.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:13 smithi012 ceph-mon[29942]: pgmap v78: 97 pgs: 97 active+clean; 249 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 107 op/s 2024-09-05T01:27:13.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:13 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:27:13.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:13 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:27:13.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:13 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:27:13.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:13 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:27:13.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:13 smithi145 ceph-mon[34376]: pgmap v78: 97 pgs: 97 active+clean; 249 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 107 op/s 2024-09-05T01:27:13.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:13 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:27:13.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:13 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:27:13.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:13 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:27:13.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:13 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:27:13.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:13 smithi151 ceph-mon[35013]: pgmap v78: 97 pgs: 97 active+clean; 249 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 107 op/s 2024-09-05T01:27:13.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:13 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:27:13.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:13 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:27:13.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:13 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:27:13.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:13 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:27:15.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:15 smithi012 ceph-mon[29942]: pgmap v79: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 154 op/s 2024-09-05T01:27:15.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:15 smithi145 ceph-mon[34376]: pgmap v79: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 154 op/s 2024-09-05T01:27:15.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:15 smithi151 ceph-mon[35013]: pgmap v79: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 154 op/s 2024-09-05T01:27:17.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:17 smithi145 ceph-mon[34376]: pgmap v80: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 86 op/s 2024-09-05T01:27:17.851 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:17 smithi012 ceph-mon[29942]: pgmap v80: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 86 op/s 2024-09-05T01:27:17.853 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:17 smithi151 ceph-mon[35013]: pgmap v80: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 86 op/s 2024-09-05T01:27:19.133 INFO:tasks.workunit.client.0.smithi012.stdout: 115 611330 1357 420397 1499 89384 1043 2024-09-05T01:27:19.816 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:19 smithi012 ceph-mon[29942]: pgmap v81: 97 pgs: 97 active+clean; 270 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 135 op/s 2024-09-05T01:27:19.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:19 smithi145 ceph-mon[34376]: pgmap v81: 97 pgs: 97 active+clean; 270 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 135 op/s 2024-09-05T01:27:19.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:19 smithi151 ceph-mon[35013]: pgmap v81: 97 pgs: 97 active+clean; 270 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 135 op/s 2024-09-05T01:27:20.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:20 smithi012 ceph-mon[29942]: pgmap v82: 97 pgs: 97 active+clean; 270 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 95 op/s 2024-09-05T01:27:20.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:20 smithi145 ceph-mon[34376]: pgmap v82: 97 pgs: 97 active+clean; 270 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 95 op/s 2024-09-05T01:27:20.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:20 smithi151 ceph-mon[35013]: pgmap v82: 97 pgs: 97 active+clean; 270 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 95 op/s 2024-09-05T01:27:22.912 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:22 smithi012 ceph-mon[29942]: pgmap v83: 97 pgs: 97 active+clean; 270 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 95 op/s 2024-09-05T01:27:23.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:22 smithi145 ceph-mon[34376]: pgmap v83: 97 pgs: 97 active+clean; 270 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 95 op/s 2024-09-05T01:27:23.103 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:22 smithi151 ceph-mon[35013]: pgmap v83: 97 pgs: 97 active+clean; 270 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 95 op/s 2024-09-05T01:27:25.077 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:24 smithi012 ceph-mon[29942]: pgmap v84: 97 pgs: 97 active+clean; 306 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 251 op/s 2024-09-05T01:27:25.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:24 smithi145 ceph-mon[34376]: pgmap v84: 97 pgs: 97 active+clean; 306 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 251 op/s 2024-09-05T01:27:25.103 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:24 smithi151 ceph-mon[35013]: pgmap v84: 97 pgs: 97 active+clean; 306 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.2 MiB/s wr, 251 op/s 2024-09-05T01:27:27.071 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:26 smithi012 ceph-mon[29942]: pgmap v85: 97 pgs: 97 active+clean; 306 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 204 op/s 2024-09-05T01:27:27.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:26 smithi145 ceph-mon[34376]: pgmap v85: 97 pgs: 97 active+clean; 306 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 204 op/s 2024-09-05T01:27:27.103 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:26 smithi151 ceph-mon[35013]: pgmap v85: 97 pgs: 97 active+clean; 306 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.2 MiB/s wr, 204 op/s 2024-09-05T01:27:28.870 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:28 smithi012 ceph-mon[29942]: pgmap v86: 97 pgs: 97 active+clean; 317 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.3 MiB/s wr, 244 op/s 2024-09-05T01:27:29.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:28 smithi145 ceph-mon[34376]: pgmap v86: 97 pgs: 97 active+clean; 317 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.3 MiB/s wr, 244 op/s 2024-09-05T01:27:29.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:28 smithi151 ceph-mon[35013]: pgmap v86: 97 pgs: 97 active+clean; 317 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.3 MiB/s wr, 244 op/s 2024-09-05T01:27:29.153 INFO:tasks.workunit.client.0.smithi012.stdout: 128 635287 592 435811 693 111389 633 2024-09-05T01:27:31.064 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:30 smithi012 ceph-mon[29942]: pgmap v87: 97 pgs: 97 active+clean; 325 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 215 op/s 2024-09-05T01:27:31.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:30 smithi145 ceph-mon[34376]: pgmap v87: 97 pgs: 97 active+clean; 325 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 215 op/s 2024-09-05T01:27:31.103 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:30 smithi151 ceph-mon[35013]: pgmap v87: 97 pgs: 97 active+clean; 325 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 215 op/s 2024-09-05T01:27:31.784 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T01:27:32.773 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:32 smithi012 ceph-mon[29942]: pgmap v88: 97 pgs: 97 active+clean; 325 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 215 op/s 2024-09-05T01:27:33.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:32 smithi145 ceph-mon[34376]: pgmap v88: 97 pgs: 97 active+clean; 325 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 215 op/s 2024-09-05T01:27:33.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:32 smithi151 ceph-mon[35013]: pgmap v88: 97 pgs: 97 active+clean; 325 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.9 MiB/s wr, 215 op/s 2024-09-05T01:27:35.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:34 smithi012 ceph-mon[29942]: pgmap v89: 97 pgs: 97 active+clean; 465 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 17 MiB/s wr, 799 op/s 2024-09-05T01:27:35.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:34 smithi145 ceph-mon[34376]: pgmap v89: 97 pgs: 97 active+clean; 465 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 17 MiB/s wr, 799 op/s 2024-09-05T01:27:35.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:34 smithi151 ceph-mon[35013]: pgmap v89: 97 pgs: 97 active+clean; 465 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 17 MiB/s wr, 799 op/s 2024-09-05T01:27:37.075 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:36 smithi012 ceph-mon[29942]: pgmap v90: 97 pgs: 97 active+clean; 465 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 14 MiB/s wr, 644 op/s 2024-09-05T01:27:37.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:36 smithi145 ceph-mon[34376]: pgmap v90: 97 pgs: 97 active+clean; 465 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 14 MiB/s wr, 644 op/s 2024-09-05T01:27:37.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:36 smithi151 ceph-mon[35013]: pgmap v90: 97 pgs: 97 active+clean; 465 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 14 MiB/s wr, 644 op/s 2024-09-05T01:27:38.519 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:27:39.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:38 smithi012 ceph-mon[29942]: pgmap v91: 97 pgs: 97 active+clean; 476 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 15 MiB/s wr, 687 op/s 2024-09-05T01:27:39.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:38 smithi145 ceph-mon[34376]: pgmap v91: 97 pgs: 97 active+clean; 476 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 15 MiB/s wr, 687 op/s 2024-09-05T01:27:39.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:38 smithi151 ceph-mon[35013]: pgmap v91: 97 pgs: 97 active+clean; 476 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 15 MiB/s wr, 687 op/s 2024-09-05T01:27:39.153 INFO:tasks.workunit.client.0.smithi012.stdout: 165 652327 1806 454104 1927 122525 404 2024-09-05T01:27:40.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.445+0000 7f7e7be00640 1 -- 172.21.15.12:0/2611024396 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e7c108f60 msgr2=0x7f7e7c110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:27:40.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.445+0000 7f7e7be00640 1 --2- 172.21.15.12:0/2611024396 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e7c108f60 0x7f7e7c110ae0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7e68009900 tx=0x7f7e6802a410 comp rx=0 tx=0).stop 2024-09-05T01:27:40.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.447+0000 7f7e7be00640 1 -- 172.21.15.12:0/2611024396 shutdown_connections 2024-09-05T01:27:40.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.447+0000 7f7e7be00640 1 --2- 172.21.15.12:0/2611024396 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e7c108f60 0x7f7e7c110ae0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.447+0000 7f7e7be00640 1 --2- 172.21.15.12:0/2611024396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e7c1047e0 0x7f7e7c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.447+0000 7f7e7be00640 1 --2- 172.21.15.12:0/2611024396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e7c103e30 0x7f7e7c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.447+0000 7f7e7be00640 1 -- 172.21.15.12:0/2611024396 >> 172.21.15.12:0/2611024396 conn(0x7f7e7c0ff910 msgr2=0x7f7e7c101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:27:40.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.447+0000 7f7e7be00640 1 -- 172.21.15.12:0/2611024396 shutdown_connections 2024-09-05T01:27:40.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.447+0000 7f7e7be00640 1 -- 172.21.15.12:0/2611024396 wait complete. 2024-09-05T01:27:40.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.449+0000 7f7e7be00640 1 Processor -- start 2024-09-05T01:27:40.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.450+0000 7f7e7be00640 1 -- start start 2024-09-05T01:27:40.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.451+0000 7f7e7be00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e7c103e30 0x7f7e7c19a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:40.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.455+0000 7f7e7be00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e7c1047e0 0x7f7e7c19a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:40.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.455+0000 7f7e7be00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e7c108f60 0x7f7e7c19ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:40.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.455+0000 7f7e7be00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c113fc0 con 0x7f7e7c1047e0 2024-09-05T01:27:40.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.455+0000 7f7e7be00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c113e40 con 0x7f7e7c108f60 2024-09-05T01:27:40.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.455+0000 7f7e7be00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c114140 con 0x7f7e7c103e30 2024-09-05T01:27:40.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.455+0000 7f7e7b400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e7c108f60 0x7f7e7c19ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:40.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.455+0000 7f7e7b400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e7c108f60 0x7f7e7c19ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:49574/0 (socket says 172.21.15.12:49574) 2024-09-05T01:27:40.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.455+0000 7f7e7b400640 1 -- 172.21.15.12:0/902367302 learned_addr learned my addr 172.21.15.12:0/902367302 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:27:40.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.456+0000 7f7e7aa00640 1 --2- 172.21.15.12:0/902367302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e7c103e30 0x7f7e7c19a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:40.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.456+0000 7f7e7a000640 1 --2- 172.21.15.12:0/902367302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e7c1047e0 0x7f7e7c19a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:40.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.457+0000 7f7e7aa00640 1 -- 172.21.15.12:0/902367302 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e7c108f60 msgr2=0x7f7e7c19ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:27:40.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.457+0000 7f7e7aa00640 1 --2- 172.21.15.12:0/902367302 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e7c108f60 0x7f7e7c19ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.457+0000 7f7e7aa00640 1 -- 172.21.15.12:0/902367302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e7c1047e0 msgr2=0x7f7e7c19a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:27:40.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.457+0000 7f7e7aa00640 1 --2- 172.21.15.12:0/902367302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e7c1047e0 0x7f7e7c19a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.458+0000 7f7e7aa00640 1 -- 172.21.15.12:0/902367302 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7c19f3b0 con 0x7f7e7c103e30 2024-09-05T01:27:40.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.458+0000 7f7e7aa00640 1 --2- 172.21.15.12:0/902367302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e7c103e30 0x7f7e7c19a400 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400cce0 tx=0x7f7e740075f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:27:40.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.459+0000 7f7e73400640 1 -- 172.21.15.12:0/902367302 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e74004b20 con 0x7f7e7c103e30 2024-09-05T01:27:40.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.459+0000 7f7e73400640 1 -- 172.21.15.12:0/902367302 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e74004cc0 con 0x7f7e7c103e30 2024-09-05T01:27:40.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.459+0000 7f7e7be00640 1 -- 172.21.15.12:0/902367302 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e7c19f6a0 con 0x7f7e7c103e30 2024-09-05T01:27:40.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.460+0000 7f7e73400640 1 -- 172.21.15.12:0/902367302 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7400f6b0 con 0x7f7e7c103e30 2024-09-05T01:27:40.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.460+0000 7f7e7be00640 1 -- 172.21.15.12:0/902367302 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e7c1a6f80 con 0x7f7e7c103e30 2024-09-05T01:27:40.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.470+0000 7f7e73400640 1 -- 172.21.15.12:0/902367302 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f7e74005000 con 0x7f7e7c103e30 2024-09-05T01:27:40.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.470+0000 7f7e845c9740 1 Processor -- start 2024-09-05T01:27:40.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.471+0000 7f7e845c9740 1 -- start start 2024-09-05T01:27:40.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.471+0000 7f7e845c9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921add400 0x55a921add7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:40.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.471+0000 7f7e845c9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a921addd20 0x55a921ad8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:40.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.471+0000 7f7e845c9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a921af11b0 0x55a921af35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:40.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.471+0000 7f7e845c9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a921a3b3e0 con 0x55a921af11b0 2024-09-05T01:27:40.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.471+0000 7f7e845c9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55a9219e2d80 con 0x55a921addd20 2024-09-05T01:27:40.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.471+0000 7f7e845c9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a921a373a0 con 0x55a921add400 2024-09-05T01:27:40.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.471+0000 7f7e7b400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921add400 0x55a921add7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:40.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.471+0000 7f7e7b400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921add400 0x55a921add7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:50590/0 (socket says 172.21.15.12:50590) 2024-09-05T01:27:40.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.471+0000 7f7e7b400640 1 -- 172.21.15.12:0/1713314352 learned_addr learned my addr 172.21.15.12:0/1713314352 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:27:40.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.472+0000 7f7e7a000640 1 --2- 172.21.15.12:0/1713314352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a921af11b0 0x55a921af35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:40.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.472+0000 7f7e7b400640 1 -- 172.21.15.12:0/1713314352 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a921addd20 msgr2=0x55a921ad8cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:27:40.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.472+0000 7f7e7b400640 1 --2- 172.21.15.12:0/1713314352 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a921addd20 0x55a921ad8cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.472+0000 7f7e7b400640 1 -- 172.21.15.12:0/1713314352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a921af11b0 msgr2=0x55a921af35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:27:40.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.472+0000 7f7e7b400640 1 --2- 172.21.15.12:0/1713314352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a921af11b0 0x55a921af35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.472+0000 7f7e7b400640 1 -- 172.21.15.12:0/1713314352 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a921a01ae0 con 0x55a921add400 2024-09-05T01:27:40.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.472+0000 7f7e7a000640 1 --2- 172.21.15.12:0/1713314352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a921af11b0 0x55a921af35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:27:40.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.472+0000 7f7e7b400640 1 --2- 172.21.15.12:0/1713314352 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921add400 0x55a921add7e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7e68004310 tx=0x7f7e68004340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0508d3e2f93568f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:27:40.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.476+0000 7f7e73400640 1 --2- 172.21.15.12:0/902367302 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7e600a2dc0 0x7f7e600a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:40.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.476+0000 7f7e67e00640 1 -- 172.21.15.12:0/1713314352 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68035030 con 0x55a921add400 2024-09-05T01:27:40.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.476+0000 7f7e67e00640 1 -- 172.21.15.12:0/1713314352 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e680046c0 con 0x55a921add400 2024-09-05T01:27:40.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.476+0000 7f7e67e00640 1 -- 172.21.15.12:0/1713314352 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68003850 con 0x55a921add400 2024-09-05T01:27:40.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.477+0000 7f7e845c9740 1 -- 172.21.15.12:0/1713314352 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921add400 msgr2=0x55a921add7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:27:40.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.477+0000 7f7e845c9740 1 --2- 172.21.15.12:0/1713314352 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921add400 0x55a921add7e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7e68004310 tx=0x7f7e68004340 comp rx=0 tx=0).stop 2024-09-05T01:27:40.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.477+0000 7f7e845c9740 1 -- 172.21.15.12:0/1713314352 shutdown_connections 2024-09-05T01:27:40.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.477+0000 7f7e73400640 1 -- 172.21.15.12:0/902367302 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f7e740cf720 con 0x7f7e7c103e30 2024-09-05T01:27:40.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.477+0000 7f7e845c9740 1 --2- 172.21.15.12:0/1713314352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a921af11b0 0x55a921af35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.478+0000 7f7e845c9740 1 --2- 172.21.15.12:0/1713314352 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a921addd20 0x55a921ad8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.478+0000 7f7e845c9740 1 --2- 172.21.15.12:0/1713314352 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921add400 0x55a921add7e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.478+0000 7f7e845c9740 1 -- 172.21.15.12:0/1713314352 >> 172.21.15.12:0/1713314352 conn(0x55a921ad9af0 msgr2=0x55a921ad9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:27:40.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.478+0000 7f7e7aa00640 1 --2- 172.21.15.12:0/902367302 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7e600a2dc0 0x7f7e600a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:40.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.480+0000 7f7e7aa00640 1 --2- 172.21.15.12:0/902367302 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7e600a2dc0 0x7f7e600a5280 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x55a921ada950 tx=0x7f7e7400af30 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:27:40.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.480+0000 7f7e845c9740 1 -- 172.21.15.12:0/1713314352 shutdown_connections 2024-09-05T01:27:40.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.480+0000 7f7e845c9740 1 -- 172.21.15.12:0/1713314352 wait complete. 2024-09-05T01:27:40.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.480+0000 7f7e845c9740 1 -- start start 2024-09-05T01:27:40.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.481+0000 7f7e845c9740 1 Processor -- start 2024-09-05T01:27:40.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.482+0000 7f7e845c9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a921add400 0x55a921ae08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:40.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.482+0000 7f7e845c9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921addd20 0x55a921ae0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:40.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.482+0000 7f7e845c9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a921af11b0 0x55a921aeb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:40.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.482+0000 7f7e845c9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a921ae0240 con 0x55a921af11b0 2024-09-05T01:27:40.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.482+0000 7f7e845c9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55a9219f60f0 con 0x55a921add400 2024-09-05T01:27:40.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.482+0000 7f7e845c9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a921ae03c0 con 0x55a921addd20 2024-09-05T01:27:40.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.483+0000 7f7e845c9740 10 client.0 _ll_register_callbacks cb 0x55a9219e79e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:27:40.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.483+0000 7f7e7b400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a921add400 0x55a921ae08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:40.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.483+0000 7f7e7b400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a921add400 0x55a921ae08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:49600/0 (socket says 172.21.15.12:49600) 2024-09-05T01:27:40.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.483+0000 7f7e7b400640 1 -- 172.21.15.12:0/4152532555 learned_addr learned my addr 172.21.15.12:0/4152532555 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:27:40.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.483+0000 7f7e7a000640 1 --2- 172.21.15.12:0/4152532555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921addd20 0x55a921ae0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:40.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.483+0000 7f7e7a000640 1 -- 172.21.15.12:0/4152532555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a921add400 msgr2=0x55a921ae08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:27:40.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.483+0000 7f7e7a000640 1 --2- 172.21.15.12:0/4152532555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a921add400 0x55a921ae08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.483+0000 7f7e7a000640 1 -- 172.21.15.12:0/4152532555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a921af11b0 msgr2=0x55a921aeb770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:27:40.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.485+0000 7f7e7b400640 1 --2- 172.21.15.12:0/4152532555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a921af11b0 0x55a921aeb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:40.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.485+0000 7f7e7a000640 1 --2- 172.21.15.12:0/4152532555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a921af11b0 0x55a921aeb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.485+0000 7f7e7a000640 1 -- 172.21.15.12:0/4152532555 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9217ac3c0 con 0x55a921addd20 2024-09-05T01:27:40.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.489+0000 7f7e7b400640 1 --2- 172.21.15.12:0/4152532555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a921af11b0 0x55a921aeb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:27:40.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.489+0000 7f7e7a000640 1 --2- 172.21.15.12:0/4152532555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921addd20 0x55a921ae0e10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0ffd30 tx=0x7f7e6c00bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1a05be38763515d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:27:40.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.489+0000 7f7e64c00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:27:40.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.490+0000 7f7e64c00640 1 -- 172.21.15.12:0/4152532555 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c02b640 con 0x55a921addd20 2024-09-05T01:27:40.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.491+0000 7f7e64c00640 1 -- 172.21.15.12:0/4152532555 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f7e6c02b7e0 con 0x55a921addd20 2024-09-05T01:27:40.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.491+0000 7f7e845c9740 1 -- 172.21.15.12:0/4152532555 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e680046c0 con 0x55a921addd20 2024-09-05T01:27:40.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.492+0000 7f7e64c00640 1 -- 172.21.15.12:0/4152532555 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7e6c02b9e0 con 0x55a921addd20 2024-09-05T01:27:40.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.492+0000 7f7e845c9740 10 client.25714 fetch_fsmap learned FSMap version 31 2024-09-05T01:27:40.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.492+0000 7f7e845c9740 1 -- 172.21.15.12:0/4152532555 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a921aee640 con 0x55a921addd20 2024-09-05T01:27:40.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.495+0000 7f7e64c00640 1 -- 172.21.15.12:0/4152532555 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e680046c0 con 0x55a921addd20 2024-09-05T01:27:40.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.495+0000 7f7e64c00640 1 -- 172.21.15.12:0/4152532555 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f7e6c029020 con 0x55a921addd20 2024-09-05T01:27:40.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.495+0000 7f7e845c9740 10 client.25714 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T01:27:40.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.495+0000 7f7e845c9740 10 client.25714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:27:40.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.495+0000 7f7e845c9740 20 client.25714 populate_metadata read hostname 'smithi012' 2024-09-05T01:27:40.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.495+0000 7f7e845c9740 1 --2- 172.21.15.12:0/4152532555 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55a921aefaa0 0x55a921aefeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:40.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.495+0000 7f7e845c9740 4 client.25714 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:27:40.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.495+0000 7f7e845c9740 1 -- 172.21.15.12:0/4152532555 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a921a48950 con 0x55a921aefaa0 2024-09-05T01:27:40.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.495+0000 7f7e7b400640 1 --2- 172.21.15.12:0/4152532555 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55a921aefaa0 0x55a921aefeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:40.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.496+0000 7f7e64c00640 10 client.25714 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:27:40.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.501+0000 7f7e7b400640 1 --2- 172.21.15.12:0/4152532555 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55a921aefaa0 0x55a921aefeb0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d406d9d24b751853 server_cookie=7c0973e1b109ecce in_seq=0 out_seq=0 2024-09-05T01:27:40.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.503+0000 7f7e64c00640 1 -- 172.21.15.12:0/4152532555 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a921a48950 con 0x55a921aefaa0 2024-09-05T01:27:40.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.503+0000 7f7e64c00640 10 client.25714 handle_command_reply: tid=0 2024-09-05T01:27:40.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.503+0000 7f7e845c9740 1 client.25714 shutdown 2024-09-05T01:27:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.504+0000 7f7e845c9740 1 -- 172.21.15.12:0/4152532555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921addd20 msgr2=0x55a921ae0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:27:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.504+0000 7f7e845c9740 1 --2- 172.21.15.12:0/4152532555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921addd20 0x55a921ae0e10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0ffd30 tx=0x7f7e6c00bda0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.505+0000 7f7e845c9740 1 -- 172.21.15.12:0/4152532555 shutdown_connections 2024-09-05T01:27:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.505+0000 7f7e845c9740 1 --2- 172.21.15.12:0/4152532555 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55a921aefaa0 0x55a921aefeb0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.505+0000 7f7e845c9740 1 --2- 172.21.15.12:0/4152532555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a921af11b0 0x55a921aeb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.505+0000 7f7e64c00640 0 client.25714 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:27:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.505+0000 7f7e845c9740 1 --2- 172.21.15.12:0/4152532555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921addd20 0x55a921ae0e10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.505+0000 7f7e845c9740 1 --2- 172.21.15.12:0/4152532555 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a921add400 0x55a921ae08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.505+0000 7f7e845c9740 1 -- 172.21.15.12:0/4152532555 >> 172.21.15.12:0/4152532555 conn(0x55a921ad9af0 msgr2=0x55a921adf850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:27:40.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.505+0000 7f7e845c9740 1 -- 172.21.15.12:0/4152532555 shutdown_connections 2024-09-05T01:27:40.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.505+0000 7f7e845c9740 1 -- 172.21.15.12:0/4152532555 wait complete. 2024-09-05T01:27:40.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.506+0000 7f7e845c9740 20 client.25714 trim_cache size 0 max 16384 2024-09-05T01:27:40.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.558+0000 7f7e845c9740 1 Processor -- start 2024-09-05T01:27:40.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.558+0000 7f7e845c9740 1 -- start start 2024-09-05T01:27:40.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.559+0000 7f7e845c9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a921add400 0x55a921af85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:40.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.559+0000 7f7e845c9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921addd20 0x55a921af8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:40.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.559+0000 7f7e845c9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a921aefaa0 0x55a921ad5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:40.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.559+0000 7f7e845c9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c070030 con 0x55a921aefaa0 2024-09-05T01:27:40.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.559+0000 7f7e845c9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c071c30 con 0x55a921add400 2024-09-05T01:27:40.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.559+0000 7f7e845c9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c070700 con 0x55a921addd20 2024-09-05T01:27:40.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.562+0000 7f7e7a000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921addd20 0x55a921af8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:40.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.562+0000 7f7e7b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a921aefaa0 0x55a921ad5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:40.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.562+0000 7f7e7a000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921addd20 0x55a921af8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:50616/0 (socket says 172.21.15.12:50616) 2024-09-05T01:27:40.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.562+0000 7f7e7a000640 1 -- 172.21.15.12:0/3939517941 learned_addr learned my addr 172.21.15.12:0/3939517941 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:27:40.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.562+0000 7f7e7b400640 1 --2- 172.21.15.12:0/3939517941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a921add400 0x55a921af85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:40.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.563+0000 7f7e7a000640 1 -- 172.21.15.12:0/3939517941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a921add400 msgr2=0x55a921af85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:27:40.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.563+0000 7f7e7a000640 1 --2- 172.21.15.12:0/3939517941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a921add400 0x55a921af85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.563+0000 7f7e7a000640 1 -- 172.21.15.12:0/3939517941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a921aefaa0 msgr2=0x55a921ad5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:27:40.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.563+0000 7f7e7a000640 1 --2- 172.21.15.12:0/3939517941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a921aefaa0 0x55a921ad5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.563+0000 7f7e7a000640 1 -- 172.21.15.12:0/3939517941 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a921ae1180 con 0x55a921addd20 2024-09-05T01:27:40.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.565+0000 7f7e7a000640 1 --2- 172.21.15.12:0/3939517941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921addd20 0x55a921af8b20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0039c0 tx=0x7f7e6c00b570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95c312ed9d156650 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:27:40.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.567+0000 7f7e67400640 1 -- 172.21.15.12:0/3939517941 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c035620 con 0x55a921addd20 2024-09-05T01:27:40.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.567+0000 7f7e67400640 1 -- 172.21.15.12:0/3939517941 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e6c005b90 con 0x55a921addd20 2024-09-05T01:27:40.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.567+0000 7f7e67400640 1 -- 172.21.15.12:0/3939517941 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c005560 con 0x55a921addd20 2024-09-05T01:27:40.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.568+0000 7f7e845c9740 1 -- 172.21.15.12:0/3939517941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921addd20 msgr2=0x55a921af8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:27:40.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.568+0000 7f7e845c9740 1 --2- 172.21.15.12:0/3939517941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921addd20 0x55a921af8b20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0039c0 tx=0x7f7e6c00b570 comp rx=0 tx=0).stop 2024-09-05T01:27:40.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.569+0000 7f7e845c9740 1 -- 172.21.15.12:0/3939517941 shutdown_connections 2024-09-05T01:27:40.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.569+0000 7f7e845c9740 1 --2- 172.21.15.12:0/3939517941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a921aefaa0 0x55a921ad5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.569+0000 7f7e845c9740 1 --2- 172.21.15.12:0/3939517941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921addd20 0x55a921af8b20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.569+0000 7f7e845c9740 1 --2- 172.21.15.12:0/3939517941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a921add400 0x55a921af85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.569+0000 7f7e845c9740 1 -- 172.21.15.12:0/3939517941 >> 172.21.15.12:0/3939517941 conn(0x55a921ad9af0 msgr2=0x55a921ad7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:27:40.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.569+0000 7f7e845c9740 1 -- 172.21.15.12:0/3939517941 shutdown_connections 2024-09-05T01:27:40.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.569+0000 7f7e845c9740 1 -- 172.21.15.12:0/3939517941 wait complete. 2024-09-05T01:27:40.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.570+0000 7f7e845c9740 1 -- start start 2024-09-05T01:27:40.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.570+0000 7f7e845c9740 1 Processor -- start 2024-09-05T01:27:40.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.571+0000 7f7e845c9740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a921add400 0x55a921af6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:40.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.572+0000 7f7e845c9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921addd20 0x55a921af6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:40.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.572+0000 7f7e845c9740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a921aefaa0 0x55a921af6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:40.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.572+0000 7f7e7a000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921addd20 0x55a921af6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:40.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.572+0000 7f7e7a000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921addd20 0x55a921af6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:50618/0 (socket says 172.21.15.12:50618) 2024-09-05T01:27:40.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.572+0000 7f7e845c9740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c0714a0 con 0x55a921aefaa0 2024-09-05T01:27:40.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.572+0000 7f7e845c9740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c070dd0 con 0x55a921add400 2024-09-05T01:27:40.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.572+0000 7f7e845c9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c06e010 con 0x55a921addd20 2024-09-05T01:27:40.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.572+0000 7f7e845c9740 10 client.0 _ll_register_callbacks cb 0x7f7e6c0043f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:27:40.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.573+0000 7f7e7a000640 1 -- 172.21.15.12:0/75494862 learned_addr learned my addr 172.21.15.12:0/75494862 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:27:40.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.573+0000 7f7e7a000640 1 -- 172.21.15.12:0/75494862 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a921add400 msgr2=0x55a921af6340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:27:40.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.573+0000 7f7e7a000640 1 --2- 172.21.15.12:0/75494862 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a921add400 0x55a921af6340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.574+0000 7f7e7a000640 1 -- 172.21.15.12:0/75494862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a921aefaa0 msgr2=0x55a921af6dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:27:40.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.574+0000 7f7e7a000640 1 --2- 172.21.15.12:0/75494862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a921aefaa0 0x55a921af6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.574+0000 7f7e7a000640 1 -- 172.21.15.12:0/75494862 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a921adffb0 con 0x55a921addd20 2024-09-05T01:27:40.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.575+0000 7f7e64c00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:27:40.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.575+0000 7f7e7a000640 1 --2- 172.21.15.12:0/75494862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921addd20 0x55a921af6880 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c022fd0 tx=0x7f7e6c003f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80774f8530305ac3 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:27:40.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.575+0000 7f7e64c00640 1 -- 172.21.15.12:0/75494862 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c005390 con 0x55a921addd20 2024-09-05T01:27:40.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.575+0000 7f7e64c00640 1 -- 172.21.15.12:0/75494862 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f7e6c005530 con 0x55a921addd20 2024-09-05T01:27:40.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.576+0000 7f7e845c9740 1 -- 172.21.15.12:0/75494862 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e6c005b90 con 0x55a921addd20 2024-09-05T01:27:40.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.576+0000 7f7e64c00640 1 -- 172.21.15.12:0/75494862 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7e6c04c050 con 0x55a921addd20 2024-09-05T01:27:40.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.576+0000 7f7e845c9740 10 client.25720 fetch_fsmap learned FSMap version 31 2024-09-05T01:27:40.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.576+0000 7f7e845c9740 1 -- 172.21.15.12:0/75494862 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a921b5b6e0 con 0x55a921addd20 2024-09-05T01:27:40.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.576+0000 7f7e64c00640 1 -- 172.21.15.12:0/75494862 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e6c005b90 con 0x55a921addd20 2024-09-05T01:27:40.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.577+0000 7f7e64c00640 1 -- 172.21.15.12:0/75494862 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f7e6c029040 con 0x55a921addd20 2024-09-05T01:27:40.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.577+0000 7f7e845c9740 10 client.25720 fetch_fsmap finished waiting for FSMap version 31 2024-09-05T01:27:40.597 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:27:40.597 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-05T01:27:40.597 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-05T01:27:40.597 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:27:40.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.577+0000 7f7e845c9740 10 client.25720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:27:40.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.577+0000 7f7e845c9740 20 client.25720 populate_metadata read hostname 'smithi012' 2024-09-05T01:27:40.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.577+0000 7f7e845c9740 1 --2- 172.21.15.12:0/75494862 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55a921af11b0 0x55a921b5de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:40.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.577+0000 7f7e845c9740 4 client.25720 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T01:27:40.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.577+0000 7f7e845c9740 1 -- 172.21.15.12:0/75494862 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a921a42e60 con 0x55a921af11b0 2024-09-05T01:27:40.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.581+0000 7f7e7b400640 1 --2- 172.21.15.12:0/75494862 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55a921af11b0 0x55a921b5de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:40.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.585+0000 7f7e7b400640 1 --2- 172.21.15.12:0/75494862 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55a921af11b0 0x55a921b5de00 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc5f8187d2e7de52 server_cookie=a3f1569a63168bde in_seq=0 out_seq=0 2024-09-05T01:27:40.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.585+0000 7f7e64c00640 10 client.25720 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:27:40.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.585+0000 7f7e64c00640 1 -- 172.21.15.12:0/75494862 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a921a42e60 con 0x55a921af11b0 2024-09-05T01:27:40.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.585+0000 7f7e64c00640 10 client.25720 handle_command_reply: tid=0 2024-09-05T01:27:40.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.586+0000 7f7e845c9740 1 client.25720 shutdown 2024-09-05T01:27:40.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.590+0000 7f7e845c9740 1 -- 172.21.15.12:0/75494862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921addd20 msgr2=0x55a921af6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:27:40.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.590+0000 7f7e845c9740 1 --2- 172.21.15.12:0/75494862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921addd20 0x55a921af6880 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c022fd0 tx=0x7f7e6c003f60 comp rx=0 tx=0).stop 2024-09-05T01:27:40.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.590+0000 7f7e845c9740 1 -- 172.21.15.12:0/75494862 shutdown_connections 2024-09-05T01:27:40.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.590+0000 7f7e845c9740 1 --2- 172.21.15.12:0/75494862 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55a921af11b0 0x55a921b5de00 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.590+0000 7f7e845c9740 1 --2- 172.21.15.12:0/75494862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a921aefaa0 0x55a921af6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.590+0000 7f7e64c00640 0 client.25720 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:27:40.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.590+0000 7f7e845c9740 1 --2- 172.21.15.12:0/75494862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a921addd20 0x55a921af6880 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.590+0000 7f7e845c9740 1 --2- 172.21.15.12:0/75494862 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a921add400 0x55a921af6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.590+0000 7f7e845c9740 1 -- 172.21.15.12:0/75494862 >> 172.21.15.12:0/75494862 conn(0x55a921ad9af0 msgr2=0x55a921adef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:27:40.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.591+0000 7f7e845c9740 1 -- 172.21.15.12:0/75494862 shutdown_connections 2024-09-05T01:27:40.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.591+0000 7f7e845c9740 1 -- 172.21.15.12:0/75494862 wait complete. 2024-09-05T01:27:40.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.591+0000 7f7e845c9740 20 client.25720 trim_cache size 0 max 16384 2024-09-05T01:27:40.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.592+0000 7f7e7be00640 1 -- 172.21.15.12:0/902367302 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7e600a2dc0 msgr2=0x7f7e600a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:27:40.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.592+0000 7f7e7be00640 1 --2- 172.21.15.12:0/902367302 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7e600a2dc0 0x7f7e600a5280 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x55a921ada950 tx=0x7f7e7400af30 comp rx=0 tx=0).stop 2024-09-05T01:27:40.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.592+0000 7f7e7be00640 1 -- 172.21.15.12:0/902367302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e7c103e30 msgr2=0x7f7e7c19a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:27:40.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.592+0000 7f7e7be00640 1 --2- 172.21.15.12:0/902367302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e7c103e30 0x7f7e7c19a400 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400cce0 tx=0x7f7e740075f0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.592+0000 7f7e7be00640 1 -- 172.21.15.12:0/902367302 shutdown_connections 2024-09-05T01:27:40.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.592+0000 7f7e7be00640 1 --2- 172.21.15.12:0/902367302 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7e600a2dc0 0x7f7e600a5280 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.592+0000 7f7e7be00640 1 --2- 172.21.15.12:0/902367302 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7e7c108f60 0x7f7e7c19ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.592+0000 7f7e7be00640 1 --2- 172.21.15.12:0/902367302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e7c1047e0 0x7f7e7c19a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.592+0000 7f7e7be00640 1 --2- 172.21.15.12:0/902367302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e7c103e30 0x7f7e7c19a400 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:40.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.592+0000 7f7e7be00640 1 -- 172.21.15.12:0/902367302 >> 172.21.15.12:0/902367302 conn(0x7f7e7c0ff910 msgr2=0x7f7e7c100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:27:40.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.592+0000 7f7e7be00640 1 -- 172.21.15.12:0/902367302 shutdown_connections 2024-09-05T01:27:40.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:40.593+0000 7f7e7be00640 1 -- 172.21.15.12:0/902367302 wait complete. 2024-09-05T01:27:41.065 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:40 smithi012 ceph-mon[29942]: pgmap v92: 97 pgs: 97 active+clean; 476 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 14 MiB/s wr, 648 op/s 2024-09-05T01:27:41.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:40 smithi145 ceph-mon[34376]: pgmap v92: 97 pgs: 97 active+clean; 476 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 14 MiB/s wr, 648 op/s 2024-09-05T01:27:41.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:40 smithi151 ceph-mon[35013]: pgmap v92: 97 pgs: 97 active+clean; 476 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 14 MiB/s wr, 648 op/s 2024-09-05T01:27:42.495 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-05T01:27:42.495 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:27:43.069 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:42 smithi012 ceph-mon[29942]: pgmap v93: 97 pgs: 97 active+clean; 476 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 13 MiB/s wr, 628 op/s 2024-09-05T01:27:43.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:42 smithi145 ceph-mon[34376]: pgmap v93: 97 pgs: 97 active+clean; 476 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 13 MiB/s wr, 628 op/s 2024-09-05T01:27:43.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:42 smithi151 ceph-mon[35013]: pgmap v93: 97 pgs: 97 active+clean; 476 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 13 MiB/s wr, 628 op/s 2024-09-05T01:27:45.066 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:44 smithi012 ceph-mon[29942]: pgmap v94: 97 pgs: 97 active+clean; 488 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 676 op/s 2024-09-05T01:27:45.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:44 smithi145 ceph-mon[34376]: pgmap v94: 97 pgs: 97 active+clean; 488 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 676 op/s 2024-09-05T01:27:45.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:44 smithi151 ceph-mon[35013]: pgmap v94: 97 pgs: 97 active+clean; 488 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 676 op/s 2024-09-05T01:27:46.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:45 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:27:46.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:45 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:27:46.321 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:45 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:27:47.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:46 smithi145 ceph-mon[34376]: pgmap v95: 97 pgs: 97 active+clean; 488 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 91 op/s 2024-09-05T01:27:47.103 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:46 smithi151 ceph-mon[35013]: pgmap v95: 97 pgs: 97 active+clean; 488 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 91 op/s 2024-09-05T01:27:47.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:46 smithi012 ceph-mon[29942]: pgmap v95: 97 pgs: 97 active+clean; 488 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 91 op/s 2024-09-05T01:27:49.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:48 smithi145 ceph-mon[34376]: pgmap v96: 97 pgs: 97 active+clean; 501 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.6 MiB/s wr, 177 op/s 2024-09-05T01:27:49.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:48 smithi151 ceph-mon[35013]: pgmap v96: 97 pgs: 97 active+clean; 501 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.6 MiB/s wr, 177 op/s 2024-09-05T01:27:49.160 INFO:tasks.workunit.client.0.smithi012.stdout: 205 698580 1784 492338 2275 116671 1013 2024-09-05T01:27:49.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:48 smithi012 ceph-mon[29942]: pgmap v96: 97 pgs: 97 active+clean; 501 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.6 MiB/s wr, 177 op/s 2024-09-05T01:27:51.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:50 smithi012 ceph-mon[29942]: pgmap v97: 97 pgs: 97 active+clean; 501 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 133 op/s 2024-09-05T01:27:51.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:50 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:27:51.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:50 smithi145 ceph-mon[34376]: pgmap v97: 97 pgs: 97 active+clean; 501 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 133 op/s 2024-09-05T01:27:51.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:50 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:27:51.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:50 smithi151 ceph-mon[35013]: pgmap v97: 97 pgs: 97 active+clean; 501 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 133 op/s 2024-09-05T01:27:51.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:50 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:27:52.510 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:27:53.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:52 smithi012 ceph-mon[29942]: pgmap v98: 97 pgs: 97 active+clean; 501 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 133 op/s 2024-09-05T01:27:53.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:52 smithi145 ceph-mon[34376]: pgmap v98: 97 pgs: 97 active+clean; 501 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 133 op/s 2024-09-05T01:27:53.353 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:52 smithi151 ceph-mon[35013]: pgmap v98: 97 pgs: 97 active+clean; 501 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 133 op/s 2024-09-05T01:27:54.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.741+0000 7fe080c00640 1 -- 172.21.15.12:0/740296631 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe07c102360 msgr2=0x7fe07c10e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:27:54.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.741+0000 7fe080c00640 1 --2- 172.21.15.12:0/740296631 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe07c102360 0x7fe07c10e890 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe074009ca0 tx=0x7fe07402a8f0 comp rx=0 tx=0).stop 2024-09-05T01:27:54.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.741+0000 7fe080c00640 1 -- 172.21.15.12:0/740296631 shutdown_connections 2024-09-05T01:27:54.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.741+0000 7fe080c00640 1 --2- 172.21.15.12:0/740296631 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe07c102360 0x7fe07c10e890 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:54.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.741+0000 7fe080c00640 1 --2- 172.21.15.12:0/740296631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe07c1019c0 0x7fe07c101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:54.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.741+0000 7fe080c00640 1 --2- 172.21.15.12:0/740296631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe07c1079c0 0x7fe07c107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:54.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.741+0000 7fe080c00640 1 -- 172.21.15.12:0/740296631 >> 172.21.15.12:0/740296631 conn(0x7fe07c0fd740 msgr2=0x7fe07c0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:27:54.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.744+0000 7fe080c00640 1 -- 172.21.15.12:0/740296631 shutdown_connections 2024-09-05T01:27:54.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.744+0000 7fe080c00640 1 -- 172.21.15.12:0/740296631 wait complete. 2024-09-05T01:27:54.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.752+0000 7fe080c00640 1 Processor -- start 2024-09-05T01:27:54.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.753+0000 7fe080c00640 1 -- start start 2024-09-05T01:27:54.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.757+0000 7fe080c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe07c1019c0 0x7fe07c1a4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:54.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.757+0000 7fe080c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe07c102360 0x7fe07c1a4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:54.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.766+0000 7fe080c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe07c1079c0 0x7fe07c10d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:54.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.766+0000 7fe080c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c111e70 con 0x7fe07c1019c0 2024-09-05T01:27:54.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.766+0000 7fe080c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c111cf0 con 0x7fe07c102360 2024-09-05T01:27:54.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.766+0000 7fe080c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c111ff0 con 0x7fe07c1079c0 2024-09-05T01:27:54.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.771+0000 7fe07b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe07c1019c0 0x7fe07c1a4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:54.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.771+0000 7fe07b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe07c1019c0 0x7fe07c1a4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46748/0 (socket says 172.21.15.12:46748) 2024-09-05T01:27:54.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.771+0000 7fe07b400640 1 -- 172.21.15.12:0/1210715709 learned_addr learned my addr 172.21.15.12:0/1210715709 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:27:54.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.772+0000 7fe07be00640 1 --2- 172.21.15.12:0/1210715709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe07c1079c0 0x7fe07c10d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:54.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.772+0000 7fe07b400640 1 -- 172.21.15.12:0/1210715709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe07c1079c0 msgr2=0x7fe07c10d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:27:54.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.772+0000 7fe07b400640 1 --2- 172.21.15.12:0/1210715709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe07c1079c0 0x7fe07c10d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:54.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.772+0000 7fe07b400640 1 -- 172.21.15.12:0/1210715709 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe07c102360 msgr2=0x7fe07c1a4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:27:54.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.772+0000 7fe07b400640 1 --2- 172.21.15.12:0/1210715709 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe07c102360 0x7fe07c1a4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:54.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.772+0000 7fe07b400640 1 -- 172.21.15.12:0/1210715709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe07c10e080 con 0x7fe07c1019c0 2024-09-05T01:27:54.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.773+0000 7fe07b400640 1 --2- 172.21.15.12:0/1210715709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe07c1019c0 0x7fe07c1a4510 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe06800b450 tx=0x7fe06800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:27:54.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.774+0000 7fe073e00640 1 -- 172.21.15.12:0/1210715709 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe068015020 con 0x7fe07c1019c0 2024-09-05T01:27:54.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.774+0000 7fe073e00640 1 -- 172.21.15.12:0/1210715709 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe068011d70 con 0x7fe07c1019c0 2024-09-05T01:27:54.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.774+0000 7fe073e00640 1 -- 172.21.15.12:0/1210715709 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06800f340 con 0x7fe07c1019c0 2024-09-05T01:27:54.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.774+0000 7fe080c00640 1 -- 172.21.15.12:0/1210715709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe07c10e370 con 0x7fe07c1019c0 2024-09-05T01:27:54.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.774+0000 7fe080c00640 1 -- 172.21.15.12:0/1210715709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe07c1ab4b0 con 0x7fe07c1019c0 2024-09-05T01:27:54.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.777+0000 7fe080c00640 1 -- 172.21.15.12:0/1210715709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe07c103100 con 0x7fe07c1019c0 2024-09-05T01:27:54.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.789+0000 7fe073e00640 1 -- 172.21.15.12:0/1210715709 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fe068018020 con 0x7fe07c1019c0 2024-09-05T01:27:54.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.791+0000 7fe073e00640 1 --2- 172.21.15.12:0/1210715709 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe0600a2d70 0x7fe0600a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:27:54.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.791+0000 7fe073e00640 1 -- 172.21.15.12:0/1210715709 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fe0680ceff0 con 0x7fe07c1019c0 2024-09-05T01:27:54.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.792+0000 7fe07aa00640 1 --2- 172.21.15.12:0/1210715709 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe0600a2d70 0x7fe0600a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:27:54.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.794+0000 7fe07aa00640 1 --2- 172.21.15.12:0/1210715709 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe0600a2d70 0x7fe0600a5230 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe06c005fd0 tx=0x7fe06c005850 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:27:54.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:54.799+0000 7fe073e00640 1 -- 172.21.15.12:0/1210715709 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe06800d040 con 0x7fe07c1019c0 2024-09-05T01:27:55.080 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:54 smithi012 ceph-mon[29942]: pgmap v99: 97 pgs: 97 active+clean; 541 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.2 MiB/s wr, 310 op/s 2024-09-05T01:27:55.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:54 smithi145 ceph-mon[34376]: pgmap v99: 97 pgs: 97 active+clean; 541 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.2 MiB/s wr, 310 op/s 2024-09-05T01:27:55.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:54 smithi151 ceph-mon[35013]: pgmap v99: 97 pgs: 97 active+clean; 541 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.2 MiB/s wr, 310 op/s 2024-09-05T01:27:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:27:55.508 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":34,"btime":"2024-09-05T01:27:54:860762+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14532,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/2949711075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":2949711075},{"type":"v1","addr":"172.21.15.12:6839","nonce":2949711075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T01:22:35.979384+0000","modified":"2024-09-05T01:27:54.513858+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24529,"mds_2":24524,"mds_3":24517,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/497406458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":497406458},{"type":"v1","addr":"172.21.15.12:6841","nonce":497406458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":10,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.145:6839/1706431882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":1706431882},{"type":"v1","addr":"172.21.15.145:6839","nonce":1706431882}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24529,24524,24517,24460]},"id":1}]} 2024-09-05T01:27:55.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:55.471+0000 7fe080c00640 1 -- 172.21.15.12:0/1210715709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe07c19fb50 con 0x7fe07c1019c0 2024-09-05T01:27:55.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:55.472+0000 7fe073e00640 1 -- 172.21.15.12:0/1210715709 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+12000 (secure 0 0 0) 0x7fe07c19fb50 con 0x7fe07c1019c0 2024-09-05T01:27:55.509 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 34 2024-09-05T01:27:55.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:55.476+0000 7fe080c00640 1 -- 172.21.15.12:0/1210715709 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe0600a2d70 msgr2=0x7fe0600a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:27:55.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:55.476+0000 7fe080c00640 1 --2- 172.21.15.12:0/1210715709 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe0600a2d70 0x7fe0600a5230 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe06c005fd0 tx=0x7fe06c005850 comp rx=0 tx=0).stop 2024-09-05T01:27:55.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:55.476+0000 7fe080c00640 1 -- 172.21.15.12:0/1210715709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe07c1019c0 msgr2=0x7fe07c1a4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:27:55.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:55.476+0000 7fe080c00640 1 --2- 172.21.15.12:0/1210715709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe07c1019c0 0x7fe07c1a4510 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe06800b450 tx=0x7fe06800b910 comp rx=0 tx=0).stop 2024-09-05T01:27:55.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:55.477+0000 7fe080c00640 1 -- 172.21.15.12:0/1210715709 shutdown_connections 2024-09-05T01:27:55.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:55.477+0000 7fe080c00640 1 --2- 172.21.15.12:0/1210715709 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe0600a2d70 0x7fe0600a5230 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:55.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:55.477+0000 7fe080c00640 1 --2- 172.21.15.12:0/1210715709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe07c1079c0 0x7fe07c10d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:55.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:55.477+0000 7fe080c00640 1 --2- 172.21.15.12:0/1210715709 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe07c102360 0x7fe07c1a4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:55.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:55.477+0000 7fe080c00640 1 --2- 172.21.15.12:0/1210715709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe07c1019c0 0x7fe07c1a4510 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:27:55.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:55.478+0000 7fe080c00640 1 -- 172.21.15.12:0/1210715709 >> 172.21.15.12:0/1210715709 conn(0x7fe07c0fd740 msgr2=0x7fe07c0fdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:27:55.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:55.479+0000 7fe080c00640 1 -- 172.21.15.12:0/1210715709 shutdown_connections 2024-09-05T01:27:55.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:27:55.479+0000 7fe080c00640 1 -- 172.21.15.12:0/1210715709 wait complete. 2024-09-05T01:27:56.091 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:55 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:27:56.091 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:55 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/1210715709' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:27:56.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:55 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:27:56.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:55 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/1210715709' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:27:56.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:55 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:27:56.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:55 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/1210715709' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:27:56.896 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:56 smithi012 ceph-mon[29942]: pgmap v100: 97 pgs: 97 active+clean; 541 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.0 MiB/s wr, 261 op/s 2024-09-05T01:27:56.909 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-05T01:27:57.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:56 smithi145 ceph-mon[34376]: pgmap v100: 97 pgs: 97 active+clean; 541 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.0 MiB/s wr, 261 op/s 2024-09-05T01:27:57.353 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:56 smithi151 ceph-mon[35013]: pgmap v100: 97 pgs: 97 active+clean; 541 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.0 MiB/s wr, 261 op/s 2024-09-05T01:27:58.067 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:57 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:27:58.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:57 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:27:58.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:57 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:27:59.165 INFO:tasks.workunit.client.0.smithi012.stdout: 224 503417 984 362770 1170 97349 1385 2024-09-05T01:27:59.177 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:27:58 smithi012 ceph-mon[29942]: pgmap v101: 97 pgs: 97 active+clean; 700 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 19 MiB/s wr, 832 op/s 2024-09-05T01:27:59.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:27:58 smithi145 ceph-mon[34376]: pgmap v101: 97 pgs: 97 active+clean; 700 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 19 MiB/s wr, 832 op/s 2024-09-05T01:27:59.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:27:58 smithi151 ceph-mon[35013]: pgmap v101: 97 pgs: 97 active+clean; 700 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 19 MiB/s wr, 832 op/s 2024-09-05T01:28:01.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:00 smithi012 ceph-mon[29942]: pgmap v102: 97 pgs: 97 active+clean; 761 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 22 MiB/s wr, 953 op/s 2024-09-05T01:28:01.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:00 smithi145 ceph-mon[34376]: pgmap v102: 97 pgs: 97 active+clean; 761 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 22 MiB/s wr, 953 op/s 2024-09-05T01:28:01.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:00 smithi151 ceph-mon[35013]: pgmap v102: 97 pgs: 97 active+clean; 761 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 22 MiB/s wr, 953 op/s 2024-09-05T01:28:02.826 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:28:03.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:02 smithi012 ceph-mon[29942]: pgmap v103: 97 pgs: 97 active+clean; 761 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 22 MiB/s wr, 953 op/s 2024-09-05T01:28:03.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:02 smithi145 ceph-mon[34376]: pgmap v103: 97 pgs: 97 active+clean; 761 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 22 MiB/s wr, 953 op/s 2024-09-05T01:28:03.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:02 smithi151 ceph-mon[35013]: pgmap v103: 97 pgs: 97 active+clean; 761 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 22 MiB/s wr, 953 op/s 2024-09-05T01:28:03.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.890+0000 7fedad000640 1 -- 172.21.15.12:0/3458170323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feda81079c0 msgr2=0x7feda8107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:03.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.890+0000 7fedad000640 1 --2- 172.21.15.12:0/3458170323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feda81079c0 0x7feda8107da0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fed98009930 tx=0x7fed9802a420 comp rx=0 tx=0).stop 2024-09-05T01:28:03.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.890+0000 7fedad000640 1 -- 172.21.15.12:0/3458170323 shutdown_connections 2024-09-05T01:28:03.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.890+0000 7fedad000640 1 --2- 172.21.15.12:0/3458170323 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feda8102360 0x7feda810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.890+0000 7fedad000640 1 --2- 172.21.15.12:0/3458170323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feda81019c0 0x7feda8101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.890+0000 7fedad000640 1 --2- 172.21.15.12:0/3458170323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feda81079c0 0x7feda8107da0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.890+0000 7fedad000640 1 -- 172.21.15.12:0/3458170323 >> 172.21.15.12:0/3458170323 conn(0x7feda80fd740 msgr2=0x7feda80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:03.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.890+0000 7fedad000640 1 -- 172.21.15.12:0/3458170323 shutdown_connections 2024-09-05T01:28:03.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.890+0000 7fedad000640 1 -- 172.21.15.12:0/3458170323 wait complete. 2024-09-05T01:28:03.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.891+0000 7fedad000640 1 Processor -- start 2024-09-05T01:28:03.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.892+0000 7fedad000640 1 -- start start 2024-09-05T01:28:03.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.892+0000 7fedad000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feda81019c0 0x7feda810dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:03.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.892+0000 7fedad000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feda8102360 0x7feda810e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:03.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.892+0000 7fedad000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feda81079c0 0x7feda81a3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:03.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.892+0000 7fedad000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7feda8111e10 con 0x7feda81019c0 2024-09-05T01:28:03.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.892+0000 7fedad000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7feda8111c90 con 0x7feda8102360 2024-09-05T01:28:03.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.892+0000 7fedad000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7feda8111f90 con 0x7feda81079c0 2024-09-05T01:28:03.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.893+0000 7feda7400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feda81019c0 0x7feda810dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:03.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.893+0000 7feda7400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feda81019c0 0x7feda810dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52666/0 (socket says 172.21.15.12:52666) 2024-09-05T01:28:03.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.893+0000 7feda7400640 1 -- 172.21.15.12:0/2908530322 learned_addr learned my addr 172.21.15.12:0/2908530322 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:03.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.893+0000 7feda6a00640 1 --2- 172.21.15.12:0/2908530322 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feda8102360 0x7feda810e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:03.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.893+0000 7feda7400640 1 -- 172.21.15.12:0/2908530322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feda81079c0 msgr2=0x7feda81a3180 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-05T01:28:03.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.893+0000 7feda7400640 1 --2- 172.21.15.12:0/2908530322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feda81079c0 0x7feda81a3180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.893+0000 7feda7400640 1 -- 172.21.15.12:0/2908530322 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feda8102360 msgr2=0x7feda810e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:03.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.893+0000 7feda7400640 1 --2- 172.21.15.12:0/2908530322 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feda8102360 0x7feda810e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.893+0000 7feda7400640 1 -- 172.21.15.12:0/2908530322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda81a3880 con 0x7feda81019c0 2024-09-05T01:28:03.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.894+0000 7feda7400640 1 --2- 172.21.15.12:0/2908530322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feda81019c0 0x7feda810dbb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fed9802a940 tx=0x7fed98003b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:03.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.894+0000 7fed9fe00640 1 -- 172.21.15.12:0/2908530322 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9803f070 con 0x7feda81019c0 2024-09-05T01:28:03.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.894+0000 7fed9fe00640 1 -- 172.21.15.12:0/2908530322 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed98031c90 con 0x7feda81019c0 2024-09-05T01:28:03.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.894+0000 7fedad000640 1 -- 172.21.15.12:0/2908530322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda81a3b10 con 0x7feda81019c0 2024-09-05T01:28:03.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.895+0000 7fedad000640 1 -- 172.21.15.12:0/2908530322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda81ab430 con 0x7feda81019c0 2024-09-05T01:28:03.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.895+0000 7fed9fe00640 1 -- 172.21.15.12:0/2908530322 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98035030 con 0x7feda81019c0 2024-09-05T01:28:03.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.899+0000 7fedb125a740 1 Processor -- start 2024-09-05T01:28:03.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.899+0000 7fedb125a740 1 -- start start 2024-09-05T01:28:03.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.900+0000 7fedb125a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559591a6de40 0x559591a6e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:03.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.900+0000 7fed9fe00640 1 -- 172.21.15.12:0/2908530322 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fed98042070 con 0x7feda81019c0 2024-09-05T01:28:03.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.900+0000 7fedb125a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559591a6e760 0x559591a78ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:03.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.900+0000 7fedb125a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a79020 0x559591a7b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:03.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.900+0000 7fedb125a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5595919d43e0 con 0x559591a6e760 2024-09-05T01:28:03.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.900+0000 7fedb125a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55959197bd80 con 0x559591a79020 2024-09-05T01:28:03.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.900+0000 7fedb125a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5595919d03a0 con 0x559591a6de40 2024-09-05T01:28:03.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.900+0000 7feda6a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a79020 0x559591a7b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:03.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.900+0000 7feda6a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a79020 0x559591a7b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:56626/0 (socket says 172.21.15.12:56626) 2024-09-05T01:28:03.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.900+0000 7feda7e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559591a6de40 0x559591a6e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:03.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.900+0000 7feda6a00640 1 -- 172.21.15.12:0/1694633499 learned_addr learned my addr 172.21.15.12:0/1694633499 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:03.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.901+0000 7feda7400640 1 --2- 172.21.15.12:0/1694633499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559591a6e760 0x559591a78ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:03.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.901+0000 7feda6a00640 1 -- 172.21.15.12:0/1694633499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559591a6de40 msgr2=0x559591a6e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:03.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.901+0000 7feda6a00640 1 --2- 172.21.15.12:0/1694633499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559591a6de40 0x559591a6e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.901+0000 7feda6a00640 1 -- 172.21.15.12:0/1694633499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559591a6e760 msgr2=0x559591a78ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:03.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.901+0000 7feda6a00640 1 --2- 172.21.15.12:0/1694633499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559591a6e760 0x559591a78ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.901+0000 7feda6a00640 1 -- 172.21.15.12:0/1694633499 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55959199aae0 con 0x559591a79020 2024-09-05T01:28:03.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.902+0000 7fed9fe00640 1 --2- 172.21.15.12:0/2908530322 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fed8c0a2cf0 0x7fed8c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:03.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.902+0000 7feda6a00640 1 --2- 172.21.15.12:0/1694633499 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a79020 0x559591a7b410 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fed94009c90 tx=0x7fed94011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dbfdf01c895e357 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:03.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.902+0000 7fed9fe00640 1 -- 172.21.15.12:0/2908530322 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fed980efaa0 con 0x7feda81019c0 2024-09-05T01:28:03.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.902+0000 7fed9cc00640 1 -- 172.21.15.12:0/1694633499 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9401e070 con 0x559591a79020 2024-09-05T01:28:03.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.902+0000 7feda7e00640 1 --2- 172.21.15.12:0/2908530322 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fed8c0a2cf0 0x7fed8c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:03.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.903+0000 7fed9cc00640 1 -- 172.21.15.12:0/1694633499 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed94019b10 con 0x559591a79020 2024-09-05T01:28:03.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.903+0000 7fed9cc00640 1 -- 172.21.15.12:0/1694633499 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9400eac0 con 0x559591a79020 2024-09-05T01:28:03.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.904+0000 7fedb125a740 1 -- 172.21.15.12:0/1694633499 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a79020 msgr2=0x559591a7b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:03.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.904+0000 7feda7e00640 1 --2- 172.21.15.12:0/2908530322 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fed8c0a2cf0 0x7fed8c0a51b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feda0005fd0 tx=0x7feda0009500 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:03.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.904+0000 7fedb125a740 1 --2- 172.21.15.12:0/1694633499 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a79020 0x559591a7b410 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fed94009c90 tx=0x7fed94011810 comp rx=0 tx=0).stop 2024-09-05T01:28:03.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.904+0000 7fedb125a740 1 -- 172.21.15.12:0/1694633499 shutdown_connections 2024-09-05T01:28:03.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.904+0000 7fedb125a740 1 --2- 172.21.15.12:0/1694633499 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a79020 0x559591a7b410 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.904+0000 7fedb125a740 1 --2- 172.21.15.12:0/1694633499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559591a6e760 0x559591a78ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.904+0000 7fedb125a740 1 --2- 172.21.15.12:0/1694633499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559591a6de40 0x559591a6e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.904+0000 7fedb125a740 1 -- 172.21.15.12:0/1694633499 >> 172.21.15.12:0/1694633499 conn(0x559591a6a3d0 msgr2=0x559591a6a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:03.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.905+0000 7fedb125a740 1 -- 172.21.15.12:0/1694633499 shutdown_connections 2024-09-05T01:28:03.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.905+0000 7fedb125a740 1 -- 172.21.15.12:0/1694633499 wait complete. 2024-09-05T01:28:03.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.905+0000 7fedb125a740 1 -- start start 2024-09-05T01:28:03.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.905+0000 7fedb125a740 1 Processor -- start 2024-09-05T01:28:03.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.906+0000 7fedb125a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a6de40 0x559591a75ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:03.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.906+0000 7fedb125a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559591a6e760 0x559591a763e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:03.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.906+0000 7fedb125a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559591a79020 0x559591a76920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:03.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.906+0000 7fedb125a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559591a7bbf0 con 0x559591a6e760 2024-09-05T01:28:03.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.906+0000 7fedb125a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55959198f0f0 con 0x559591a6de40 2024-09-05T01:28:03.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.906+0000 7fedb125a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559591a7bd70 con 0x559591a79020 2024-09-05T01:28:03.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.906+0000 7fedb125a740 10 client.0 _ll_register_callbacks cb 0x559591976bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:28:03.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.906+0000 7feda7400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a6de40 0x559591a75ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:03.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.906+0000 7feda7400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a6de40 0x559591a75ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:56630/0 (socket says 172.21.15.12:56630) 2024-09-05T01:28:03.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.906+0000 7feda7400640 1 -- 172.21.15.12:0/984274006 learned_addr learned my addr 172.21.15.12:0/984274006 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:03.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.906+0000 7feda6a00640 1 --2- 172.21.15.12:0/984274006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559591a6e760 0x559591a763e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:03.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.907+0000 7feda7400640 1 -- 172.21.15.12:0/984274006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559591a79020 msgr2=0x559591a76920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:28:03.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.907+0000 7feda7400640 1 --2- 172.21.15.12:0/984274006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559591a79020 0x559591a76920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.907+0000 7feda7400640 1 -- 172.21.15.12:0/984274006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559591a6e760 msgr2=0x559591a763e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:03.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.907+0000 7feda7400640 1 --2- 172.21.15.12:0/984274006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559591a6e760 0x559591a763e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.907+0000 7feda7400640 1 -- 172.21.15.12:0/984274006 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595917453c0 con 0x559591a6de40 2024-09-05T01:28:03.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.907+0000 7feda7400640 1 --2- 172.21.15.12:0/984274006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a6de40 0x559591a75ea0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fed9803b8a0 tx=0x7fed98000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4437f01c580c0f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:03.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.907+0000 7fed91600640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:28:03.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.907+0000 7fed91600640 1 -- 172.21.15.12:0/984274006 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98049070 con 0x559591a6de40 2024-09-05T01:28:03.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.907+0000 7fed91600640 1 -- 172.21.15.12:0/984274006 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fed980bc1b0 con 0x559591a6de40 2024-09-05T01:28:03.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.908+0000 7fedb125a740 1 -- 172.21.15.12:0/984274006 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed94019b10 con 0x559591a6de40 2024-09-05T01:28:03.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.908+0000 7fed91600640 1 -- 172.21.15.12:0/984274006 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fed980bbd20 con 0x559591a6de40 2024-09-05T01:28:03.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.909+0000 7fedb125a740 10 client.25736 fetch_fsmap learned FSMap version 34 2024-09-05T01:28:03.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.909+0000 7fedb125a740 1 -- 172.21.15.12:0/984274006 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559591a87c50 con 0x559591a6de40 2024-09-05T01:28:03.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.909+0000 7fed91600640 1 -- 172.21.15.12:0/984274006 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed94019b10 con 0x559591a6de40 2024-09-05T01:28:03.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.909+0000 7fed91600640 1 -- 172.21.15.12:0/984274006 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 34) ==== 8410+0+0 (secure 0 0 0) 0x7fed980c4730 con 0x559591a6de40 2024-09-05T01:28:03.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.909+0000 7fedb125a740 10 client.25736 fetch_fsmap finished waiting for FSMap version 34 2024-09-05T01:28:03.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.909+0000 7fedb125a740 10 client.25736 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-05T01:28:03.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.909+0000 7fedb125a740 20 client.25736 populate_metadata read hostname 'smithi012' 2024-09-05T01:28:03.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.909+0000 7fedb125a740 1 --2- 172.21.15.12:0/984274006 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x559591a89160 0x559591a8b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:03.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.909+0000 7fedb125a740 4 client.25736 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:28:03.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.909+0000 7fedb125a740 1 -- 172.21.15.12:0/984274006 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595919e1950 con 0x559591a89160 2024-09-05T01:28:03.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.910+0000 7feda6a00640 1 --2- 172.21.15.12:0/984274006 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x559591a89160 0x559591a8b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:03.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.910+0000 7feda6a00640 1 --2- 172.21.15.12:0/984274006 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x559591a89160 0x559591a8b620 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b5917457ea9770df server_cookie=dd1b12cf447711c5 in_seq=0 out_seq=0 2024-09-05T01:28:03.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.911+0000 7fed91600640 10 client.25736 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:28:03.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.911+0000 7fed91600640 1 -- 172.21.15.12:0/984274006 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5595919e1950 con 0x559591a89160 2024-09-05T01:28:03.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.911+0000 7fed91600640 10 client.25736 handle_command_reply: tid=0 2024-09-05T01:28:03.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.911+0000 7fedb125a740 1 client.25736 shutdown 2024-09-05T01:28:03.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.912+0000 7fedb125a740 1 -- 172.21.15.12:0/984274006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a6de40 msgr2=0x559591a75ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:03.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.912+0000 7fedb125a740 1 --2- 172.21.15.12:0/984274006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a6de40 0x559591a75ea0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fed9803b8a0 tx=0x7fed98000bc0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.912+0000 7fedb125a740 1 -- 172.21.15.12:0/984274006 shutdown_connections 2024-09-05T01:28:03.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.912+0000 7fedb125a740 1 --2- 172.21.15.12:0/984274006 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x559591a89160 0x559591a8b620 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.912+0000 7fedb125a740 1 --2- 172.21.15.12:0/984274006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559591a79020 0x559591a76920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.912+0000 7fedb125a740 1 --2- 172.21.15.12:0/984274006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559591a6e760 0x559591a763e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.912+0000 7fedb125a740 1 --2- 172.21.15.12:0/984274006 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a6de40 0x559591a75ea0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.912+0000 7fedb125a740 1 -- 172.21.15.12:0/984274006 >> 172.21.15.12:0/984274006 conn(0x559591a6a3d0 msgr2=0x559591a70100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:03.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.912+0000 7fed91600640 0 client.25736 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:28:03.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.913+0000 7fedb125a740 1 -- 172.21.15.12:0/984274006 shutdown_connections 2024-09-05T01:28:03.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.913+0000 7fedb125a740 1 -- 172.21.15.12:0/984274006 wait complete. 2024-09-05T01:28:03.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.913+0000 7fedb125a740 20 client.25736 trim_cache size 0 max 16384 2024-09-05T01:28:03.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.933+0000 7fedb125a740 1 Processor -- start 2024-09-05T01:28:03.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.933+0000 7fedb125a740 1 -- start start 2024-09-05T01:28:03.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.933+0000 7fedb125a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a6de40 0x559591a6fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:03.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.933+0000 7fedb125a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559591a6e760 0x559591a90ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:03.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.933+0000 7fedb125a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559591a79020 0x559591a91430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:03.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.933+0000 7fedb125a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fed8800e730 con 0x559591a6e760 2024-09-05T01:28:03.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.933+0000 7fedb125a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fed880103f0 con 0x559591a6de40 2024-09-05T01:28:03.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.933+0000 7fedb125a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fed8800ee00 con 0x559591a79020 2024-09-05T01:28:03.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.934+0000 7feda6a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559591a6e760 0x559591a90ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:03.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.934+0000 7feda7400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a6de40 0x559591a6fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:03.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.934+0000 7feda7400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a6de40 0x559591a6fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:56640/0 (socket says 172.21.15.12:56640) 2024-09-05T01:28:03.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.934+0000 7feda6a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559591a6e760 0x559591a90ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52696/0 (socket says 172.21.15.12:52696) 2024-09-05T01:28:03.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.934+0000 7feda7e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559591a79020 0x559591a91430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:03.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.934+0000 7feda7400640 1 -- 172.21.15.12:0/1880707867 learned_addr learned my addr 172.21.15.12:0/1880707867 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:03.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.934+0000 7feda7400640 1 -- 172.21.15.12:0/1880707867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559591a79020 msgr2=0x559591a91430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:03.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.934+0000 7feda7400640 1 --2- 172.21.15.12:0/1880707867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559591a79020 0x559591a91430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.934+0000 7feda7400640 1 -- 172.21.15.12:0/1880707867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559591a6e760 msgr2=0x559591a90ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:03.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.934+0000 7feda7400640 1 --2- 172.21.15.12:0/1880707867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559591a6e760 0x559591a90ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.934+0000 7feda7400640 1 -- 172.21.15.12:0/1880707867 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559591a6a200 con 0x559591a6de40 2024-09-05T01:28:03.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.935+0000 7feda7400640 1 --2- 172.21.15.12:0/1880707867 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a6de40 0x559591a6fff0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fed98031550 tx=0x7fed98003f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ddebcb99cf8ee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:03.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.935+0000 7fed93e00640 1 -- 172.21.15.12:0/1880707867 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98049070 con 0x559591a6de40 2024-09-05T01:28:03.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.935+0000 7fed93e00640 1 -- 172.21.15.12:0/1880707867 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed980f6030 con 0x559591a6de40 2024-09-05T01:28:03.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.935+0000 7fed93e00640 1 -- 172.21.15.12:0/1880707867 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed980bb8b0 con 0x559591a6de40 2024-09-05T01:28:03.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.935+0000 7fedb125a740 1 -- 172.21.15.12:0/1880707867 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a6de40 msgr2=0x559591a6fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:03.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.935+0000 7fedb125a740 1 --2- 172.21.15.12:0/1880707867 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a6de40 0x559591a6fff0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fed98031550 tx=0x7fed98003f50 comp rx=0 tx=0).stop 2024-09-05T01:28:03.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.936+0000 7fedb125a740 1 -- 172.21.15.12:0/1880707867 shutdown_connections 2024-09-05T01:28:03.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.936+0000 7fedb125a740 1 --2- 172.21.15.12:0/1880707867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559591a79020 0x559591a91430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.936+0000 7fedb125a740 1 --2- 172.21.15.12:0/1880707867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559591a6e760 0x559591a90ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.936+0000 7fedb125a740 1 --2- 172.21.15.12:0/1880707867 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a6de40 0x559591a6fff0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.936+0000 7fedb125a740 1 -- 172.21.15.12:0/1880707867 >> 172.21.15.12:0/1880707867 conn(0x559591a6a3d0 msgr2=0x559591a6f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:03.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.936+0000 7fedb125a740 1 -- 172.21.15.12:0/1880707867 shutdown_connections 2024-09-05T01:28:03.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.936+0000 7fedb125a740 1 -- 172.21.15.12:0/1880707867 wait complete. 2024-09-05T01:28:03.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.936+0000 7fedb125a740 1 -- start start 2024-09-05T01:28:03.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.937+0000 7fedb125a740 1 Processor -- start 2024-09-05T01:28:03.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.937+0000 7fedb125a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a6de40 0x559591a815e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:03.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.937+0000 7fedb125a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559591a6e760 0x559591a7c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:03.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.937+0000 7fedb125a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559591a79020 0x559591a7cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:03.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.937+0000 7fedb125a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fed8800fc60 con 0x559591a79020 2024-09-05T01:28:03.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.937+0000 7fedb125a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fed8800f590 con 0x559591a6de40 2024-09-05T01:28:03.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.937+0000 7fedb125a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fed8800c710 con 0x559591a6e760 2024-09-05T01:28:03.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.937+0000 7fedb125a740 10 client.0 _ll_register_callbacks cb 0x7fed98009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:28:03.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.937+0000 7feda7400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a6de40 0x559591a815e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:03.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.937+0000 7feda7400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a6de40 0x559591a815e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:56650/0 (socket says 172.21.15.12:56650) 2024-09-05T01:28:03.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.937+0000 7feda7400640 1 -- 172.21.15.12:0/2766083611 learned_addr learned my addr 172.21.15.12:0/2766083611 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:03.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.938+0000 7feda7e00640 1 --2- 172.21.15.12:0/2766083611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559591a79020 0x559591a7cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:03.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.938+0000 7feda6a00640 1 --2- 172.21.15.12:0/2766083611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559591a6e760 0x559591a7c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:03.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.938+0000 7feda7e00640 1 -- 172.21.15.12:0/2766083611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559591a6e760 msgr2=0x559591a7c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:03.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.938+0000 7feda7e00640 1 --2- 172.21.15.12:0/2766083611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559591a6e760 0x559591a7c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.938+0000 7feda7e00640 1 -- 172.21.15.12:0/2766083611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a6de40 msgr2=0x559591a815e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:03.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.938+0000 7feda7e00640 1 --2- 172.21.15.12:0/2766083611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a6de40 0x559591a815e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.938+0000 7feda7e00640 1 -- 172.21.15.12:0/2766083611 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559591a7d4e0 con 0x559591a79020 2024-09-05T01:28:03.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.938+0000 7feda7400640 1 --2- 172.21.15.12:0/2766083611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a6de40 0x559591a815e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:28:03.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.939+0000 7feda7e00640 1 --2- 172.21.15.12:0/2766083611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559591a79020 0x559591a7cea0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x559591a6eb80 tx=0x7feda0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebdf5bd8fa945bcf server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:03.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.939+0000 7fed91600640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:28:03.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.939+0000 7fed91600640 1 -- 172.21.15.12:0/2766083611 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda001fd10 con 0x559591a79020 2024-09-05T01:28:03.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.939+0000 7fed91600640 1 -- 172.21.15.12:0/2766083611 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7feda00273e0 con 0x559591a79020 2024-09-05T01:28:03.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.939+0000 7fedb125a740 1 -- 172.21.15.12:0/2766083611 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed980f6030 con 0x559591a79020 2024-09-05T01:28:03.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.939+0000 7fed91600640 1 -- 172.21.15.12:0/2766083611 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7feda00275e0 con 0x559591a79020 2024-09-05T01:28:03.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.939+0000 7fedb125a740 10 client.15723 fetch_fsmap learned FSMap version 34 2024-09-05T01:28:03.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.939+0000 7fedb125a740 1 -- 172.21.15.12:0/2766083611 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559591af3d70 con 0x559591a79020 2024-09-05T01:28:03.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.939+0000 7fed91600640 1 -- 172.21.15.12:0/2766083611 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feda0027c60 con 0x559591a79020 2024-09-05T01:28:03.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.940+0000 7fed91600640 1 -- 172.21.15.12:0/2766083611 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 34) ==== 8410+0+0 (secure 0 0 0) 0x7feda0026070 con 0x559591a79020 2024-09-05T01:28:03.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.940+0000 7fedb125a740 10 client.15723 fetch_fsmap finished waiting for FSMap version 34 2024-09-05T01:28:03.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.940+0000 7fedb125a740 10 client.15723 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-05T01:28:03.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.940+0000 7fedb125a740 20 client.15723 populate_metadata read hostname 'smithi012' 2024-09-05T01:28:03.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.940+0000 7fedb125a740 1 --2- 172.21.15.12:0/2766083611 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x559591af45d0 0x559591af69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:03.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.940+0000 7fedb125a740 4 client.15723 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:28:03.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.940+0000 7fedb125a740 1 -- 172.21.15.12:0/2766083611 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fed980f6030 con 0x559591af45d0 2024-09-05T01:28:03.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.941+0000 7feda7400640 1 --2- 172.21.15.12:0/2766083611 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x559591af45d0 0x559591af69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:03.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.941+0000 7fed91600640 10 client.15723 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:28:03.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.941+0000 7feda7400640 1 --2- 172.21.15.12:0/2766083611 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x559591af45d0 0x559591af69f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c75c948600c6ddb8 server_cookie=e992d18225a9d74d in_seq=0 out_seq=0 2024-09-05T01:28:03.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.942+0000 7fed91600640 1 -- 172.21.15.12:0/2766083611 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fed980f6030 con 0x559591af45d0 2024-09-05T01:28:03.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.942+0000 7fed91600640 10 client.15723 handle_command_reply: tid=0 2024-09-05T01:28:03.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.942+0000 7fedb125a740 1 client.15723 shutdown 2024-09-05T01:28:03.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.942+0000 7fedb125a740 1 -- 172.21.15.12:0/2766083611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559591a79020 msgr2=0x559591a7cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:03.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.942+0000 7fedb125a740 1 --2- 172.21.15.12:0/2766083611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559591a79020 0x559591a7cea0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x559591a6eb80 tx=0x7feda0004ab0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.942+0000 7fedb125a740 1 -- 172.21.15.12:0/2766083611 shutdown_connections 2024-09-05T01:28:03.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.942+0000 7fedb125a740 1 --2- 172.21.15.12:0/2766083611 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x559591af45d0 0x559591af69f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.942+0000 7fedb125a740 1 --2- 172.21.15.12:0/2766083611 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559591a79020 0x559591a7cea0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.942+0000 7fedb125a740 1 --2- 172.21.15.12:0/2766083611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559591a6e760 0x559591a7c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.942+0000 7fed91600640 0 client.15723 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:28:03.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.942+0000 7fedb125a740 1 --2- 172.21.15.12:0/2766083611 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559591a6de40 0x559591a815e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.942+0000 7fedb125a740 1 -- 172.21.15.12:0/2766083611 >> 172.21.15.12:0/2766083611 conn(0x559591a6a3d0 msgr2=0x559591a76680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:03.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.943+0000 7fedb125a740 1 -- 172.21.15.12:0/2766083611 shutdown_connections 2024-09-05T01:28:03.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.943+0000 7fedb125a740 1 -- 172.21.15.12:0/2766083611 wait complete. 2024-09-05T01:28:03.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.943+0000 7fedb125a740 20 client.15723 trim_cache size 0 max 16384 2024-09-05T01:28:03.947 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:28:03.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.944+0000 7fedad000640 1 -- 172.21.15.12:0/2908530322 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fed8c0a2cf0 msgr2=0x7fed8c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:03.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.944+0000 7fedad000640 1 --2- 172.21.15.12:0/2908530322 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fed8c0a2cf0 0x7fed8c0a51b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feda0005fd0 tx=0x7feda0009500 comp rx=0 tx=0).stop 2024-09-05T01:28:03.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.944+0000 7fedad000640 1 -- 172.21.15.12:0/2908530322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feda81019c0 msgr2=0x7feda810dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:03.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.944+0000 7fedad000640 1 --2- 172.21.15.12:0/2908530322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feda81019c0 0x7feda810dbb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fed9802a940 tx=0x7fed98003b20 comp rx=0 tx=0).stop 2024-09-05T01:28:03.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.945+0000 7fedad000640 1 -- 172.21.15.12:0/2908530322 shutdown_connections 2024-09-05T01:28:03.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.945+0000 7fedad000640 1 --2- 172.21.15.12:0/2908530322 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fed8c0a2cf0 0x7fed8c0a51b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.945+0000 7fedad000640 1 --2- 172.21.15.12:0/2908530322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feda81079c0 0x7feda81a3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.945+0000 7fedad000640 1 --2- 172.21.15.12:0/2908530322 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7feda8102360 0x7feda810e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.945+0000 7fedad000640 1 --2- 172.21.15.12:0/2908530322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feda81019c0 0x7feda810dbb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:03.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.945+0000 7fedad000640 1 -- 172.21.15.12:0/2908530322 >> 172.21.15.12:0/2908530322 conn(0x7feda80fd740 msgr2=0x7feda80fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:03.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.947+0000 7fedad000640 1 -- 172.21.15.12:0/2908530322 shutdown_connections 2024-09-05T01:28:03.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:03.947+0000 7fedad000640 1 -- 172.21.15.12:0/2908530322 wait complete. 2024-09-05T01:28:04.760 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-05T01:28:05.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:04 smithi012 ceph-mon[29942]: pgmap v104: 97 pgs: 97 active+clean; 791 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 25 MiB/s wr, 1.09k op/s 2024-09-05T01:28:05.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:04 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:28:05.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:04 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:28:05.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:04 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:28:05.189 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:28:05.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:04 smithi145 ceph-mon[34376]: pgmap v104: 97 pgs: 97 active+clean; 791 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 25 MiB/s wr, 1.09k op/s 2024-09-05T01:28:05.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:04 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:28:05.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:04 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:28:05.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:04 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:28:05.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:04 smithi151 ceph-mon[35013]: pgmap v104: 97 pgs: 97 active+clean; 791 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 25 MiB/s wr, 1.09k op/s 2024-09-05T01:28:05.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:04 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:28:05.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:04 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:28:05.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:04 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:28:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.751+0000 7f5194c00640 1 -- 172.21.15.12:0/2442686148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5190109140 msgr2=0x7f5190110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.751+0000 7f5194c00640 1 --2- 172.21.15.12:0/2442686148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5190109140 0x7f5190110cc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5188009ca0 tx=0x7f518802a8c0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.751+0000 7f5194c00640 1 -- 172.21.15.12:0/2442686148 shutdown_connections 2024-09-05T01:28:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.751+0000 7f5194c00640 1 --2- 172.21.15.12:0/2442686148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5190109140 0x7f5190110cc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.751+0000 7f5194c00640 1 --2- 172.21.15.12:0/2442686148 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51901049c0 0x7f5190108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.751+0000 7f5194c00640 1 --2- 172.21.15.12:0/2442686148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5190104010 0x7f51901043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.751+0000 7f5194c00640 1 -- 172.21.15.12:0/2442686148 >> 172.21.15.12:0/2442686148 conn(0x7f51900ffa50 msgr2=0x7f5190101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.751+0000 7f5194c00640 1 -- 172.21.15.12:0/2442686148 shutdown_connections 2024-09-05T01:28:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.751+0000 7f5194c00640 1 -- 172.21.15.12:0/2442686148 wait complete. 2024-09-05T01:28:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.752+0000 7f5194c00640 1 Processor -- start 2024-09-05T01:28:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.752+0000 7f5194c00640 1 -- start start 2024-09-05T01:28:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.752+0000 7f5194c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5190104010 0x7f519019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.752+0000 7f5194c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51901049c0 0x7f519019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.753+0000 7f5194c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5190109140 0x7f519019eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.753+0000 7f5194c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5190114150 con 0x7f5190104010 2024-09-05T01:28:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.753+0000 7f5194c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5190113fd0 con 0x7f51901049c0 2024-09-05T01:28:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.753+0000 7f5194c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f51901142d0 con 0x7f5190109140 2024-09-05T01:28:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.753+0000 7f518de00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5190104010 0x7f519019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.753+0000 7f518e800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5190109140 0x7f519019eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.753+0000 7f518de00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5190104010 0x7f519019a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52722/0 (socket says 172.21.15.12:52722) 2024-09-05T01:28:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.753+0000 7f518de00640 1 -- 172.21.15.12:0/3942870266 learned_addr learned my addr 172.21.15.12:0/3942870266 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.753+0000 7f5187e00640 1 --2- 172.21.15.12:0/3942870266 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51901049c0 0x7f519019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.753+0000 7f518de00640 1 -- 172.21.15.12:0/3942870266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5190109140 msgr2=0x7f519019eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.753+0000 7f518de00640 1 --2- 172.21.15.12:0/3942870266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5190109140 0x7f519019eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.753+0000 7f518de00640 1 -- 172.21.15.12:0/3942870266 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51901049c0 msgr2=0x7f519019ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.753+0000 7f518de00640 1 --2- 172.21.15.12:0/3942870266 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51901049c0 0x7f519019ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.753+0000 7f518de00640 1 -- 172.21.15.12:0/3942870266 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f519019f5a0 con 0x7f5190104010 2024-09-05T01:28:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.753+0000 7f5187e00640 1 --2- 172.21.15.12:0/3942870266 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51901049c0 0x7f519019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:28:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.754+0000 7f518de00640 1 --2- 172.21.15.12:0/3942870266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5190104010 0x7f519019a5f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f518000e9f0 tx=0x7f518000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.754+0000 7f5186a00640 1 -- 172.21.15.12:0/3942870266 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518000cd80 con 0x7f5190104010 2024-09-05T01:28:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.754+0000 7f5186a00640 1 -- 172.21.15.12:0/3942870266 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5180010910 con 0x7f5190104010 2024-09-05T01:28:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.754+0000 7f5194c00640 1 -- 172.21.15.12:0/3942870266 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f519019f890 con 0x7f5190104010 2024-09-05T01:28:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.754+0000 7f5186a00640 1 -- 172.21.15.12:0/3942870266 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180018990 con 0x7f5190104010 2024-09-05T01:28:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.754+0000 7f5194c00640 1 -- 172.21.15.12:0/3942870266 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51901a7170 con 0x7f5190104010 2024-09-05T01:28:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.757+0000 7f5186a00640 1 -- 172.21.15.12:0/3942870266 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f5180010ac0 con 0x7f5190104010 2024-09-05T01:28:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.757+0000 7f5197681740 1 Processor -- start 2024-09-05T01:28:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.757+0000 7f5197681740 1 -- start start 2024-09-05T01:28:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.758+0000 7f5197681740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fdac70 0x556186fdb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.758+0000 7f5197681740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556186fdb590 0x556186fe5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.758+0000 7f5197681740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556186fe5e50 0x556186fe8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.758+0000 7f5197681740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556186f413e0 con 0x556186fdb590 2024-09-05T01:28:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.758+0000 7f5197681740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x556186ee8d80 con 0x556186fdac70 2024-09-05T01:28:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.758+0000 7f5197681740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556186f3d3a0 con 0x556186fe5e50 2024-09-05T01:28:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.758+0000 7f518de00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556186fdb590 0x556186fe5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.758+0000 7f518e800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fdac70 0x556186fdb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.758+0000 7f518e800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fdac70 0x556186fdb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:56670/0 (socket says 172.21.15.12:56670) 2024-09-05T01:28:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.758+0000 7f518e800640 1 -- 172.21.15.12:0/1704632158 learned_addr learned my addr 172.21.15.12:0/1704632158 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.758+0000 7f5187e00640 1 --2- 172.21.15.12:0/1704632158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556186fe5e50 0x556186fe8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.758+0000 7f518e800640 1 -- 172.21.15.12:0/1704632158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556186fe5e50 msgr2=0x556186fe8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.758+0000 7f518e800640 1 --2- 172.21.15.12:0/1704632158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556186fe5e50 0x556186fe8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.758+0000 7f518e800640 1 -- 172.21.15.12:0/1704632158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556186fdb590 msgr2=0x556186fe5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.758+0000 7f518e800640 1 --2- 172.21.15.12:0/1704632158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556186fdb590 0x556186fe5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.758+0000 7f518e800640 1 -- 172.21.15.12:0/1704632158 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556186f07ae0 con 0x556186fdac70 2024-09-05T01:28:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.758+0000 7f5187e00640 1 --2- 172.21.15.12:0/1704632158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556186fe5e50 0x556186fe8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:28:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.759+0000 7f518e800640 1 --2- 172.21.15.12:0/1704632158 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fdac70 0x556186fdb050 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5188009ca0 tx=0x7f5188005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5067b8c5d18a144f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.759+0000 7f5186a00640 1 --2- 172.21.15.12:0/3942870266 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f51740a2d70 0x7f51740a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.759+0000 7f517f000640 1 -- 172.21.15.12:0/1704632158 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5188031db0 con 0x556186fdac70 2024-09-05T01:28:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.759+0000 7f5186a00640 1 -- 172.21.15.12:0/3942870266 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f51800cf730 con 0x7f5190104010 2024-09-05T01:28:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.759+0000 7f517f000640 1 -- 172.21.15.12:0/1704632158 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5188036040 con 0x556186fdac70 2024-09-05T01:28:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.759+0000 7f517f000640 1 -- 172.21.15.12:0/1704632158 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51880042a0 con 0x556186fdac70 2024-09-05T01:28:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.759+0000 7f518de00640 1 --2- 172.21.15.12:0/3942870266 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f51740a2d70 0x7f51740a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.760+0000 7f5197681740 1 -- 172.21.15.12:0/1704632158 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fdac70 msgr2=0x556186fdb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.760+0000 7f518de00640 1 --2- 172.21.15.12:0/3942870266 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f51740a2d70 0x7f51740a5230 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x556186fd8060 tx=0x7f51800d5530 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.760+0000 7f5197681740 1 --2- 172.21.15.12:0/1704632158 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fdac70 0x556186fdb050 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5188009ca0 tx=0x7f5188005f10 comp rx=0 tx=0).stop 2024-09-05T01:28:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.760+0000 7f5197681740 1 -- 172.21.15.12:0/1704632158 shutdown_connections 2024-09-05T01:28:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.760+0000 7f5197681740 1 --2- 172.21.15.12:0/1704632158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556186fe5e50 0x556186fe8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.760+0000 7f5197681740 1 --2- 172.21.15.12:0/1704632158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556186fdb590 0x556186fe5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.760+0000 7f5197681740 1 --2- 172.21.15.12:0/1704632158 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fdac70 0x556186fdb050 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.760+0000 7f5197681740 1 -- 172.21.15.12:0/1704632158 >> 172.21.15.12:0/1704632158 conn(0x556186fd7200 msgr2=0x556186fd75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.760+0000 7f5197681740 1 -- 172.21.15.12:0/1704632158 shutdown_connections 2024-09-05T01:28:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.760+0000 7f5197681740 1 -- 172.21.15.12:0/1704632158 wait complete. 2024-09-05T01:28:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.760+0000 7f5197681740 1 -- start start 2024-09-05T01:28:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.761+0000 7f5197681740 1 Processor -- start 2024-09-05T01:28:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.761+0000 7f5197681740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fdac70 0x556186fe2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.761+0000 7f5197681740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556186fdb590 0x556186fe31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.761+0000 7f5197681740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556186fe5e50 0x556186fe3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.761+0000 7f5197681740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556186fe88a0 con 0x556186fe5e50 2024-09-05T01:28:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.761+0000 7f5197681740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x556186efc0f0 con 0x556186fdac70 2024-09-05T01:28:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.761+0000 7f5197681740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556186fe8a20 con 0x556186fdb590 2024-09-05T01:28:05.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.761+0000 7f5197681740 10 client.0 _ll_register_callbacks cb 0x556186ee3bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:28:05.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.761+0000 7f518e800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fdac70 0x556186fe2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:05.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.761+0000 7f518e800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556186fe5e50 0x556186fe3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:05.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.762+0000 7f5187e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556186fdb590 0x556186fe31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:05.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.762+0000 7f518e800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fdac70 0x556186fe2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:56676/0 (socket says 172.21.15.12:56676) 2024-09-05T01:28:05.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.762+0000 7f518e800640 1 -- 172.21.15.12:0/1412928804 learned_addr learned my addr 172.21.15.12:0/1412928804 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:05.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.762+0000 7f518e800640 1 -- 172.21.15.12:0/1412928804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556186fdb590 msgr2=0x556186fe31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:05.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.762+0000 7f518e800640 1 --2- 172.21.15.12:0/1412928804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556186fdb590 0x556186fe31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.762+0000 7f518e800640 1 -- 172.21.15.12:0/1412928804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556186fe5e50 msgr2=0x556186fe3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:05.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.762+0000 7f518e800640 1 --2- 172.21.15.12:0/1412928804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556186fe5e50 0x556186fe3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.762+0000 7f518e800640 1 -- 172.21.15.12:0/1412928804 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556186cb23c0 con 0x556186fdac70 2024-09-05T01:28:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.762+0000 7f518e800640 1 --2- 172.21.15.12:0/1412928804 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fdac70 0x556186fe2c80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5188009a20 tx=0x7f5188031a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db525d248b7c0b82 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.762+0000 7f5173400640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:28:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.762+0000 7f5173400640 1 -- 172.21.15.12:0/1412928804 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518802f810 con 0x556186fdac70 2024-09-05T01:28:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.763+0000 7f5197681740 1 -- 172.21.15.12:0/1412928804 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5188036040 con 0x556186fdac70 2024-09-05T01:28:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.763+0000 7f5173400640 1 -- 172.21.15.12:0/1412928804 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f518802f9b0 con 0x556186fdac70 2024-09-05T01:28:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.763+0000 7f5173400640 1 -- 172.21.15.12:0/1412928804 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5188004b40 con 0x556186fdac70 2024-09-05T01:28:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.763+0000 7f5197681740 10 client.25754 fetch_fsmap learned FSMap version 34 2024-09-05T01:28:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.763+0000 7f5197681740 1 -- 172.21.15.12:0/1412928804 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556186fe88a0 con 0x556186fdac70 2024-09-05T01:28:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.763+0000 7f5173400640 1 -- 172.21.15.12:0/1412928804 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5188036040 con 0x556186fdac70 2024-09-05T01:28:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.763+0000 7f5173400640 1 -- 172.21.15.12:0/1412928804 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 34) ==== 8410+0+0 (secure 0 0 0) 0x7f5188043070 con 0x556186fdac70 2024-09-05T01:28:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.763+0000 7f5197681740 10 client.25754 fetch_fsmap finished waiting for FSMap version 34 2024-09-05T01:28:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.763+0000 7f5197681740 10 client.25754 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-05T01:28:05.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.763+0000 7f5197681740 20 client.25754 populate_metadata read hostname 'smithi012' 2024-09-05T01:28:05.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.763+0000 7f5197681740 1 --2- 172.21.15.12:0/1412928804 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x556186ff5920 0x556186ff7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:05.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.763+0000 7f5197681740 4 client.25754 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:28:05.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.763+0000 7f5197681740 1 -- 172.21.15.12:0/1412928804 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556186f4e950 con 0x556186ff5920 2024-09-05T01:28:05.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.764+0000 7f5187e00640 1 --2- 172.21.15.12:0/1412928804 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x556186ff5920 0x556186ff7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:05.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.764+0000 7f5187e00640 1 --2- 172.21.15.12:0/1412928804 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x556186ff5920 0x556186ff7d10 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8ca317fb9c6cfd00 server_cookie=65efd2dcb03b7a0b in_seq=0 out_seq=0 2024-09-05T01:28:05.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.764+0000 7f5173400640 10 client.25754 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:28:05.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.765+0000 7f5173400640 1 -- 172.21.15.12:0/1412928804 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556186f4e950 con 0x556186ff5920 2024-09-05T01:28:05.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.765+0000 7f5173400640 10 client.25754 handle_command_reply: tid=0 2024-09-05T01:28:05.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.765+0000 7f5197681740 1 client.25754 shutdown 2024-09-05T01:28:05.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.765+0000 7f5197681740 1 -- 172.21.15.12:0/1412928804 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fdac70 msgr2=0x556186fe2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:05.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.765+0000 7f5197681740 1 --2- 172.21.15.12:0/1412928804 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fdac70 0x556186fe2c80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5188009a20 tx=0x7f5188031a10 comp rx=0 tx=0).stop 2024-09-05T01:28:05.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.765+0000 7f5197681740 1 -- 172.21.15.12:0/1412928804 shutdown_connections 2024-09-05T01:28:05.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.765+0000 7f5197681740 1 --2- 172.21.15.12:0/1412928804 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x556186ff5920 0x556186ff7d10 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.765+0000 7f5197681740 1 --2- 172.21.15.12:0/1412928804 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556186fe5e50 0x556186fe3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.765+0000 7f5197681740 1 --2- 172.21.15.12:0/1412928804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556186fdb590 0x556186fe31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.765+0000 7f5197681740 1 --2- 172.21.15.12:0/1412928804 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fdac70 0x556186fe2c80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.765+0000 7f5173400640 0 client.25754 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:28:05.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.765+0000 7f5197681740 1 -- 172.21.15.12:0/1412928804 >> 172.21.15.12:0/1412928804 conn(0x556186fd7200 msgr2=0x556186fdcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:05.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.766+0000 7f5197681740 1 -- 172.21.15.12:0/1412928804 shutdown_connections 2024-09-05T01:28:05.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.766+0000 7f5197681740 1 -- 172.21.15.12:0/1412928804 wait complete. 2024-09-05T01:28:05.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.766+0000 7f5197681740 20 client.25754 trim_cache size 0 max 16384 2024-09-05T01:28:05.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.779+0000 7f5197681740 1 Processor -- start 2024-09-05T01:28:05.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.780+0000 7f5197681740 1 -- start start 2024-09-05T01:28:05.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.780+0000 7f5197681740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556186fdac70 0x556186fe4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:05.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.780+0000 7f5197681740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556186fdb590 0x556186ffd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:05.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.780+0000 7f5197681740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fe5e50 0x556186ffdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:05.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.780+0000 7f5197681740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f51901afa70 con 0x556186fdb590 2024-09-05T01:28:05.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.780+0000 7f5197681740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f51901b1730 con 0x556186fe5e50 2024-09-05T01:28:05.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.780+0000 7f5197681740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f51901b0140 con 0x556186fdac70 2024-09-05T01:28:05.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.780+0000 7f5187e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556186fdb590 0x556186ffd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:05.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.780+0000 7f5187e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556186fdb590 0x556186ffd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52750/0 (socket says 172.21.15.12:52750) 2024-09-05T01:28:05.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.780+0000 7f5187e00640 1 -- 172.21.15.12:0/4071254694 learned_addr learned my addr 172.21.15.12:0/4071254694 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:05.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.780+0000 7f518e800640 1 --2- 172.21.15.12:0/4071254694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fe5e50 0x556186ffdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:05.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.780+0000 7f518e800640 1 --2- 172.21.15.12:0/4071254694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556186fdac70 0x556186fe4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:05.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.780+0000 7f5187e00640 1 -- 172.21.15.12:0/4071254694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556186fdac70 msgr2=0x556186fe4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:05.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.781+0000 7f5187e00640 1 --2- 172.21.15.12:0/4071254694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556186fdac70 0x556186fe4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.781+0000 7f5187e00640 1 -- 172.21.15.12:0/4071254694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fe5e50 msgr2=0x556186ffdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:05.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.781+0000 7f5187e00640 1 --2- 172.21.15.12:0/4071254694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fe5e50 0x556186ffdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.781+0000 7f5187e00640 1 -- 172.21.15.12:0/4071254694 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556186fd7030 con 0x556186fdb590 2024-09-05T01:28:05.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.781+0000 7f518e800640 1 --2- 172.21.15.12:0/4071254694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556186fdac70 0x556186fe4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:28:05.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.781+0000 7f5187e00640 1 --2- 172.21.15.12:0/4071254694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556186fdb590 0x556186ffd590 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x556186fe2510 tx=0x7f51780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949f1a79e08c7942 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:05.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.781+0000 7f517e600640 1 -- 172.21.15.12:0/4071254694 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178004250 con 0x556186fdb590 2024-09-05T01:28:05.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.781+0000 7f517e600640 1 -- 172.21.15.12:0/4071254694 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51780043f0 con 0x556186fdb590 2024-09-05T01:28:05.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.781+0000 7f517e600640 1 -- 172.21.15.12:0/4071254694 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51780035f0 con 0x556186fdb590 2024-09-05T01:28:05.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.782+0000 7f5197681740 1 -- 172.21.15.12:0/4071254694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556186fdb590 msgr2=0x556186ffd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:05.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.782+0000 7f5197681740 1 --2- 172.21.15.12:0/4071254694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556186fdb590 0x556186ffd590 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x556186fe2510 tx=0x7f51780046c0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.782+0000 7f5197681740 1 -- 172.21.15.12:0/4071254694 shutdown_connections 2024-09-05T01:28:05.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.782+0000 7f5197681740 1 --2- 172.21.15.12:0/4071254694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fe5e50 0x556186ffdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.782+0000 7f5197681740 1 --2- 172.21.15.12:0/4071254694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556186fdb590 0x556186ffd590 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.782+0000 7f5197681740 1 --2- 172.21.15.12:0/4071254694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556186fdac70 0x556186fe4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.782+0000 7f5197681740 1 -- 172.21.15.12:0/4071254694 >> 172.21.15.12:0/4071254694 conn(0x556186fd7200 msgr2=0x556186fe1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:05.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.782+0000 7f5197681740 1 -- 172.21.15.12:0/4071254694 shutdown_connections 2024-09-05T01:28:05.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.782+0000 7f5197681740 1 -- 172.21.15.12:0/4071254694 wait complete. 2024-09-05T01:28:05.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.782+0000 7f5197681740 1 -- start start 2024-09-05T01:28:05.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.783+0000 7f5197681740 1 Processor -- start 2024-09-05T01:28:05.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.783+0000 7f5197681740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fdac70 0x556186fedc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:05.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.783+0000 7f5197681740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556186fdb590 0x556186fee1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:05.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.783+0000 7f5197681740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556186fe5e50 0x556186feac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:05.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.783+0000 7f5197681740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f51901b0fa0 con 0x556186fe5e50 2024-09-05T01:28:05.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.783+0000 7f5197681740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f51901b08d0 con 0x556186fdac70 2024-09-05T01:28:05.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.783+0000 7f5197681740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f51901ada50 con 0x556186fdb590 2024-09-05T01:28:05.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.783+0000 7f5197681740 10 client.0 _ll_register_callbacks cb 0x7f51800d5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:28:05.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.783+0000 7f518e800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556186fe5e50 0x556186feac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:05.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.783+0000 7f5187e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556186fdb590 0x556186fee1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:05.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.783+0000 7f518e800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fdac70 0x556186fedc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:05.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.783+0000 7f5187e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556186fdb590 0x556186fee1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:38210/0 (socket says 172.21.15.12:38210) 2024-09-05T01:28:05.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.783+0000 7f5187e00640 1 -- 172.21.15.12:0/1569053657 learned_addr learned my addr 172.21.15.12:0/1569053657 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.784+0000 7f518e800640 1 -- 172.21.15.12:0/1569053657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556186fdb590 msgr2=0x556186fee1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.784+0000 7f518e800640 1 --2- 172.21.15.12:0/1569053657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556186fdb590 0x556186fee1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.784+0000 7f518e800640 1 -- 172.21.15.12:0/1569053657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556186fe5e50 msgr2=0x556186feac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.784+0000 7f518e800640 1 --2- 172.21.15.12:0/1569053657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556186fe5e50 0x556186feac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.784+0000 7f518e800640 1 -- 172.21.15.12:0/1569053657 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556186fddae0 con 0x556186fdac70 2024-09-05T01:28:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.784+0000 7f5187e00640 1 --2- 172.21.15.12:0/1569053657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556186fdb590 0x556186fee1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:28:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.784+0000 7f518e800640 1 --2- 172.21.15.12:0/1569053657 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fdac70 0x556186fedc70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5188031b50 tx=0x7f5188031a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70c3fe63e3d670d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.784+0000 7f5173400640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:28:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.784+0000 7f5173400640 1 -- 172.21.15.12:0/1569053657 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5188062040 con 0x556186fdac70 2024-09-05T01:28:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.784+0000 7f5197681740 1 -- 172.21.15.12:0/1569053657 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51780043f0 con 0x556186fdac70 2024-09-05T01:28:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.785+0000 7f5173400640 1 -- 172.21.15.12:0/1569053657 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f51880307c0 con 0x556186fdac70 2024-09-05T01:28:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.785+0000 7f5173400640 1 -- 172.21.15.12:0/1569053657 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f518802f610 con 0x556186fdac70 2024-09-05T01:28:05.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.785+0000 7f5197681740 10 client.25760 fetch_fsmap learned FSMap version 34 2024-09-05T01:28:05.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.785+0000 7f5197681740 1 -- 172.21.15.12:0/1569053657 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556186fd2770 con 0x556186fdac70 2024-09-05T01:28:05.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.785+0000 7f5173400640 1 -- 172.21.15.12:0/1569053657 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51780043f0 con 0x556186fdac70 2024-09-05T01:28:05.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.785+0000 7f5173400640 1 -- 172.21.15.12:0/1569053657 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 34) ==== 8410+0+0 (secure 0 0 0) 0x7f5188066020 con 0x556186fdac70 2024-09-05T01:28:05.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.785+0000 7f5197681740 10 client.25760 fetch_fsmap finished waiting for FSMap version 34 2024-09-05T01:28:05.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.785+0000 7f5197681740 10 client.25760 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-05T01:28:05.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.785+0000 7f5197681740 20 client.25760 populate_metadata read hostname 'smithi012' 2024-09-05T01:28:05.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.785+0000 7f5197681740 1 --2- 172.21.15.12:0/1569053657 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x556187060f40 0x556187063360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:05.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.785+0000 7f5197681740 4 client.25760 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:28:05.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.785+0000 7f5197681740 1 -- 172.21.15.12:0/1569053657 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556186f48e60 con 0x556187060f40 2024-09-05T01:28:05.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.786+0000 7f5187e00640 1 --2- 172.21.15.12:0/1569053657 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x556187060f40 0x556187063360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:05.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.786+0000 7f5187e00640 1 --2- 172.21.15.12:0/1569053657 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x556187060f40 0x556187063360 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d257544d7d656f26 server_cookie=7466b7b1b5b2ef19 in_seq=0 out_seq=0 2024-09-05T01:28:05.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.786+0000 7f5173400640 10 client.25760 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:28:05.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.786+0000 7f5173400640 1 -- 172.21.15.12:0/1569053657 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556186f48e60 con 0x556187060f40 2024-09-05T01:28:05.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.786+0000 7f5173400640 10 client.25760 handle_command_reply: tid=0 2024-09-05T01:28:05.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.786+0000 7f5197681740 1 client.25760 shutdown 2024-09-05T01:28:05.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.787+0000 7f5197681740 1 -- 172.21.15.12:0/1569053657 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fdac70 msgr2=0x556186fedc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:05.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.787+0000 7f5197681740 1 --2- 172.21.15.12:0/1569053657 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fdac70 0x556186fedc70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5188031b50 tx=0x7f5188031a10 comp rx=0 tx=0).stop 2024-09-05T01:28:05.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.787+0000 7f5197681740 1 -- 172.21.15.12:0/1569053657 shutdown_connections 2024-09-05T01:28:05.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.787+0000 7f5197681740 1 --2- 172.21.15.12:0/1569053657 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x556187060f40 0x556187063360 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.787+0000 7f5197681740 1 --2- 172.21.15.12:0/1569053657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556186fe5e50 0x556186feac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.787+0000 7f5197681740 1 --2- 172.21.15.12:0/1569053657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556186fdb590 0x556186fee1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.787+0000 7f5197681740 1 --2- 172.21.15.12:0/1569053657 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556186fdac70 0x556186fedc70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.787+0000 7f5173400640 0 client.25760 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:28:05.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.787+0000 7f5197681740 1 -- 172.21.15.12:0/1569053657 >> 172.21.15.12:0/1569053657 conn(0x556186fd7200 msgr2=0x556186fd5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:05.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.787+0000 7f5197681740 1 -- 172.21.15.12:0/1569053657 shutdown_connections 2024-09-05T01:28:05.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.787+0000 7f5197681740 1 -- 172.21.15.12:0/1569053657 wait complete. 2024-09-05T01:28:05.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.787+0000 7f5197681740 20 client.25760 trim_cache size 0 max 16384 2024-09-05T01:28:05.793 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:28:05.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.788+0000 7f5194c00640 1 -- 172.21.15.12:0/3942870266 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f51740a2d70 msgr2=0x7f51740a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:05.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.788+0000 7f5194c00640 1 --2- 172.21.15.12:0/3942870266 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f51740a2d70 0x7f51740a5230 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x556186fd8060 tx=0x7f51800d5530 comp rx=0 tx=0).stop 2024-09-05T01:28:05.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.788+0000 7f5194c00640 1 -- 172.21.15.12:0/3942870266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5190104010 msgr2=0x7f519019a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:05.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.788+0000 7f5194c00640 1 --2- 172.21.15.12:0/3942870266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5190104010 0x7f519019a5f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f518000e9f0 tx=0x7f518000eeb0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.788+0000 7f5194c00640 1 -- 172.21.15.12:0/3942870266 shutdown_connections 2024-09-05T01:28:05.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.788+0000 7f5194c00640 1 --2- 172.21.15.12:0/3942870266 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f51740a2d70 0x7f51740a5230 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.788+0000 7f5194c00640 1 --2- 172.21.15.12:0/3942870266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5190109140 0x7f519019eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.788+0000 7f5194c00640 1 --2- 172.21.15.12:0/3942870266 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f51901049c0 0x7f519019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.788+0000 7f5194c00640 1 --2- 172.21.15.12:0/3942870266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5190104010 0x7f519019a5f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:05.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.788+0000 7f5194c00640 1 -- 172.21.15.12:0/3942870266 >> 172.21.15.12:0/3942870266 conn(0x7f51900ffa50 msgr2=0x7f5190100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:05.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.788+0000 7f5194c00640 1 -- 172.21.15.12:0/3942870266 shutdown_connections 2024-09-05T01:28:05.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:05.788+0000 7f5194c00640 1 -- 172.21.15.12:0/3942870266 wait complete. 2024-09-05T01:28:06.694 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-05T01:28:07.074 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:28:07.213 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:06 smithi012 ceph-mon[29942]: pgmap v105: 97 pgs: 97 active+clean; 791 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 22 MiB/s wr, 913 op/s 2024-09-05T01:28:07.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:06 smithi145 ceph-mon[34376]: pgmap v105: 97 pgs: 97 active+clean; 791 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 22 MiB/s wr, 913 op/s 2024-09-05T01:28:07.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:06 smithi151 ceph-mon[35013]: pgmap v105: 97 pgs: 97 active+clean; 791 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 22 MiB/s wr, 913 op/s 2024-09-05T01:28:07.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.755+0000 7fc4a5400640 1 -- 172.21.15.12:0/1869910408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4a0074510 msgr2=0x7fc4a00748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:07.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.755+0000 7fc4a5400640 1 --2- 172.21.15.12:0/1869910408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4a0074510 0x7fc4a00748f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc490009900 tx=0x7fc49002a490 comp rx=0 tx=0).stop 2024-09-05T01:28:07.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.755+0000 7fc4a5400640 1 -- 172.21.15.12:0/1869910408 shutdown_connections 2024-09-05T01:28:07.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.755+0000 7fc4a5400640 1 --2- 172.21.15.12:0/1869910408 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4a010e450 0x7fc4a0110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.755+0000 7fc4a5400640 1 --2- 172.21.15.12:0/1869910408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4a0074e30 0x7fc4a010df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.755+0000 7fc4a5400640 1 --2- 172.21.15.12:0/1869910408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4a0074510 0x7fc4a00748f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.755+0000 7fc4a5400640 1 -- 172.21.15.12:0/1869910408 >> 172.21.15.12:0/1869910408 conn(0x7fc4a00fd8b0 msgr2=0x7fc4a00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:07.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.756+0000 7fc4a5400640 1 -- 172.21.15.12:0/1869910408 shutdown_connections 2024-09-05T01:28:07.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.756+0000 7fc4a5400640 1 -- 172.21.15.12:0/1869910408 wait complete. 2024-09-05T01:28:07.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.757+0000 7fc4a5400640 1 Processor -- start 2024-09-05T01:28:07.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.757+0000 7fc4a5400640 1 -- start start 2024-09-05T01:28:07.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.757+0000 7fc4a5400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4a0074510 0x7fc4a019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:07.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.757+0000 7fc4a5400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4a0074e30 0x7fc4a019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:07.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.758+0000 7fc4a5400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4a010e450 0x7fc4a019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:07.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.758+0000 7fc4a5400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a01141d0 con 0x7fc4a010e450 2024-09-05T01:28:07.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.758+0000 7fc4a5400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a0114050 con 0x7fc4a0074e30 2024-09-05T01:28:07.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.758+0000 7fc4a5400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a0114350 con 0x7fc4a0074510 2024-09-05T01:28:07.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.758+0000 7fc49e800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4a0074510 0x7fc4a019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:07.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.758+0000 7fc49de00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4a0074e30 0x7fc4a019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:07.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.758+0000 7fc49e800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4a0074510 0x7fc4a019a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:38448/0 (socket says 172.21.15.12:38448) 2024-09-05T01:28:07.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.758+0000 7fc49e800640 1 -- 172.21.15.12:0/2197839526 learned_addr learned my addr 172.21.15.12:0/2197839526 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:07.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.758+0000 7fc49f200640 1 --2- 172.21.15.12:0/2197839526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4a010e450 0x7fc4a019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:07.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.758+0000 7fc49de00640 1 -- 172.21.15.12:0/2197839526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4a0074510 msgr2=0x7fc4a019a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:07.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.758+0000 7fc49de00640 1 --2- 172.21.15.12:0/2197839526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4a0074510 0x7fc4a019a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.758+0000 7fc49de00640 1 -- 172.21.15.12:0/2197839526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4a010e450 msgr2=0x7fc4a019ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:07.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.758+0000 7fc49de00640 1 --2- 172.21.15.12:0/2197839526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4a010e450 0x7fc4a019ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.758+0000 7fc49de00640 1 -- 172.21.15.12:0/2197839526 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a019f640 con 0x7fc4a0074e30 2024-09-05T01:28:07.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.758+0000 7fc49e800640 1 --2- 172.21.15.12:0/2197839526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4a0074510 0x7fc4a019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:28:07.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.758+0000 7fc49f200640 1 --2- 172.21.15.12:0/2197839526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4a010e450 0x7fc4a019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:28:07.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.759+0000 7fc49de00640 1 --2- 172.21.15.12:0/2197839526 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4a0074e30 0x7fc4a019abd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00e9f0 tx=0x7fc48c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:07.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.759+0000 7fc497400640 1 -- 172.21.15.12:0/2197839526 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c00ccc0 con 0x7fc4a0074e30 2024-09-05T01:28:07.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.759+0000 7fc4a5400640 1 -- 172.21.15.12:0/2197839526 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4a019f930 con 0x7fc4a0074e30 2024-09-05T01:28:07.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.759+0000 7fc497400640 1 -- 172.21.15.12:0/2197839526 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc48c010910 con 0x7fc4a0074e30 2024-09-05T01:28:07.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.759+0000 7fc497400640 1 -- 172.21.15.12:0/2197839526 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c018960 con 0x7fc4a0074e30 2024-09-05T01:28:07.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.759+0000 7fc4a5400640 1 -- 172.21.15.12:0/2197839526 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4a01a7210 con 0x7fc4a0074e30 2024-09-05T01:28:07.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.762+0000 7fc4a7fed740 1 Processor -- start 2024-09-05T01:28:07.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.762+0000 7fc4a7fed740 1 -- start start 2024-09-05T01:28:07.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.762+0000 7fc497400640 1 -- 172.21.15.12:0/2197839526 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fc48c010ac0 con 0x7fc4a0074e30 2024-09-05T01:28:07.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.763+0000 7fc4a7fed740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55879a4b5c70 0x55879a4b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:07.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.763+0000 7fc4a7fed740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55879a4b6590 0x55879a4c0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:07.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.763+0000 7fc4a7fed740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55879a4c0e50 0x55879a4c3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:07.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.763+0000 7fc4a7fed740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55879a41c3e0 con 0x55879a4b6590 2024-09-05T01:28:07.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.763+0000 7fc4a7fed740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55879a3c3d80 con 0x55879a4c0e50 2024-09-05T01:28:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.763+0000 7fc4a7fed740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55879a4183a0 con 0x55879a4b5c70 2024-09-05T01:28:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.763+0000 7fc49f200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55879a4b5c70 0x55879a4b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.763+0000 7fc49f200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55879a4b5c70 0x55879a4b6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:38458/0 (socket says 172.21.15.12:38458) 2024-09-05T01:28:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.763+0000 7fc49f200640 1 -- 172.21.15.12:0/3657005263 learned_addr learned my addr 172.21.15.12:0/3657005263 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.763+0000 7fc49de00640 1 --2- 172.21.15.12:0/3657005263 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55879a4c0e50 0x55879a4c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.763+0000 7fc49e800640 1 --2- 172.21.15.12:0/3657005263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55879a4b6590 0x55879a4c0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.764+0000 7fc49f200640 1 -- 172.21.15.12:0/3657005263 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55879a4c0e50 msgr2=0x55879a4c3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.764+0000 7fc49f200640 1 --2- 172.21.15.12:0/3657005263 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55879a4c0e50 0x55879a4c3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.764+0000 7fc49f200640 1 -- 172.21.15.12:0/3657005263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55879a4b6590 msgr2=0x55879a4c0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.764+0000 7fc49f200640 1 --2- 172.21.15.12:0/3657005263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55879a4b6590 0x55879a4c0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.764+0000 7fc49f200640 1 -- 172.21.15.12:0/3657005263 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55879a3e2ae0 con 0x55879a4b5c70 2024-09-05T01:28:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.764+0000 7fc49f200640 1 --2- 172.21.15.12:0/3657005263 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55879a4b5c70 0x55879a4b6050 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc498009ee0 tx=0x7fc49800f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8497bdd27a01e9e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.764+0000 7fc48b400640 1 -- 172.21.15.12:0/3657005263 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498011640 con 0x55879a4b5c70 2024-09-05T01:28:07.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.764+0000 7fc48b400640 1 -- 172.21.15.12:0/3657005263 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc498011cc0 con 0x55879a4b5c70 2024-09-05T01:28:07.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.764+0000 7fc48b400640 1 -- 172.21.15.12:0/3657005263 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49801be00 con 0x55879a4b5c70 2024-09-05T01:28:07.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.765+0000 7fc497400640 1 --2- 172.21.15.12:0/2197839526 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc4840a2d70 0x7fc4840a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:07.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.765+0000 7fc4a7fed740 1 -- 172.21.15.12:0/3657005263 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55879a4b5c70 msgr2=0x55879a4b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:07.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.765+0000 7fc4a7fed740 1 --2- 172.21.15.12:0/3657005263 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55879a4b5c70 0x55879a4b6050 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc498009ee0 tx=0x7fc49800f730 comp rx=0 tx=0).stop 2024-09-05T01:28:07.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.765+0000 7fc497400640 1 -- 172.21.15.12:0/2197839526 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fc48c0cf860 con 0x7fc4a0074e30 2024-09-05T01:28:07.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.765+0000 7fc4a7fed740 1 -- 172.21.15.12:0/3657005263 shutdown_connections 2024-09-05T01:28:07.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.765+0000 7fc4a7fed740 1 --2- 172.21.15.12:0/3657005263 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55879a4c0e50 0x55879a4c3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.765+0000 7fc4a7fed740 1 --2- 172.21.15.12:0/3657005263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55879a4b6590 0x55879a4c0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.765+0000 7fc4a7fed740 1 --2- 172.21.15.12:0/3657005263 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55879a4b5c70 0x55879a4b6050 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.765+0000 7fc4a7fed740 1 -- 172.21.15.12:0/3657005263 >> 172.21.15.12:0/3657005263 conn(0x55879a4b2200 msgr2=0x55879a4b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:07.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.765+0000 7fc49e800640 1 --2- 172.21.15.12:0/2197839526 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc4840a2d70 0x7fc4840a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:07.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.765+0000 7fc4a7fed740 1 -- 172.21.15.12:0/3657005263 shutdown_connections 2024-09-05T01:28:07.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.766+0000 7fc4a7fed740 1 -- 172.21.15.12:0/3657005263 wait complete. 2024-09-05T01:28:07.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.766+0000 7fc4a7fed740 1 -- start start 2024-09-05T01:28:07.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.766+0000 7fc49e800640 1 --2- 172.21.15.12:0/2197839526 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc4840a2d70 0x7fc4840a5230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc4900096c0 tx=0x7fc4900046c0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:07.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.766+0000 7fc4a7fed740 1 Processor -- start 2024-09-05T01:28:07.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.767+0000 7fc4a7fed740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55879a4b5c70 0x55879a4bdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:07.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.767+0000 7fc4a7fed740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55879a4b6590 0x55879a4be290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:07.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.767+0000 7fc4a7fed740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55879a4c0e50 0x55879a4be7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:07.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.767+0000 7fc4a7fed740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55879a4c3a20 con 0x55879a4b6590 2024-09-05T01:28:07.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.767+0000 7fc4a7fed740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55879a3d70f0 con 0x55879a4b5c70 2024-09-05T01:28:07.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.767+0000 7fc4a7fed740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55879a4c3ba0 con 0x55879a4c0e50 2024-09-05T01:28:07.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.767+0000 7fc4a7fed740 10 client.0 _ll_register_callbacks cb 0x55879a3bebd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:28:07.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.767+0000 7fc49f200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55879a4c0e50 0x55879a4be7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:07.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.767+0000 7fc49e800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55879a4b5c70 0x55879a4bdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:07.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.767+0000 7fc49de00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55879a4b6590 0x55879a4be290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:07.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.767+0000 7fc49f200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55879a4c0e50 0x55879a4be7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:38474/0 (socket says 172.21.15.12:38474) 2024-09-05T01:28:07.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.767+0000 7fc49f200640 1 -- 172.21.15.12:0/2531378089 learned_addr learned my addr 172.21.15.12:0/2531378089 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:07.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.768+0000 7fc49f200640 1 -- 172.21.15.12:0/2531378089 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55879a4b5c70 msgr2=0x55879a4bdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:07.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.768+0000 7fc49f200640 1 --2- 172.21.15.12:0/2531378089 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55879a4b5c70 0x55879a4bdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.768+0000 7fc49f200640 1 -- 172.21.15.12:0/2531378089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55879a4b6590 msgr2=0x55879a4be290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:07.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.768+0000 7fc49f200640 1 --2- 172.21.15.12:0/2531378089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55879a4b6590 0x55879a4be290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.768+0000 7fc49f200640 1 -- 172.21.15.12:0/2531378089 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55879a18d3c0 con 0x55879a4c0e50 2024-09-05T01:28:07.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.768+0000 7fc49f200640 1 --2- 172.21.15.12:0/2531378089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55879a4c0e50 0x55879a4be7d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc49801b620 tx=0x7fc498009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=640d674fc7c24e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:07.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.768+0000 7fc47fe00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:28:07.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.768+0000 7fc47fe00640 1 -- 172.21.15.12:0/2531378089 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498009aa0 con 0x55879a4c0e50 2024-09-05T01:28:07.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.768+0000 7fc4a7fed740 1 -- 172.21.15.12:0/2531378089 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc498011cc0 con 0x55879a4c0e50 2024-09-05T01:28:07.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.768+0000 7fc47fe00640 1 -- 172.21.15.12:0/2531378089 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fc49801bb80 con 0x55879a4c0e50 2024-09-05T01:28:07.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.769+0000 7fc47fe00640 1 -- 172.21.15.12:0/2531378089 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc49801bd80 con 0x55879a4c0e50 2024-09-05T01:28:07.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.769+0000 7fc4a7fed740 10 client.25762 fetch_fsmap learned FSMap version 34 2024-09-05T01:28:07.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.769+0000 7fc4a7fed740 1 -- 172.21.15.12:0/2531378089 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55879a4cfaa0 con 0x55879a4c0e50 2024-09-05T01:28:07.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.769+0000 7fc47fe00640 1 -- 172.21.15.12:0/2531378089 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc498011cc0 con 0x55879a4c0e50 2024-09-05T01:28:07.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.769+0000 7fc47fe00640 1 -- 172.21.15.12:0/2531378089 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 34) ==== 8410+0+0 (secure 0 0 0) 0x7fc498004040 con 0x55879a4c0e50 2024-09-05T01:28:07.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.769+0000 7fc4a7fed740 10 client.25762 fetch_fsmap finished waiting for FSMap version 34 2024-09-05T01:28:07.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.769+0000 7fc4a7fed740 10 client.25762 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T01:28:07.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.769+0000 7fc4a7fed740 20 client.25762 populate_metadata read hostname 'smithi012' 2024-09-05T01:28:07.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.769+0000 7fc4a7fed740 1 --2- 172.21.15.12:0/2531378089 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x55879a4d0eb0 0x55879a4d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:07.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.769+0000 7fc4a7fed740 4 client.25762 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:28:07.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.769+0000 7fc4a7fed740 1 -- 172.21.15.12:0/2531378089 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55879a429950 con 0x55879a4d0eb0 2024-09-05T01:28:07.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.770+0000 7fc49e800640 1 --2- 172.21.15.12:0/2531378089 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x55879a4d0eb0 0x55879a4d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:07.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.770+0000 7fc49e800640 1 --2- 172.21.15.12:0/2531378089 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x55879a4d0eb0 0x55879a4d32a0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5c77caa98756b6f1 server_cookie=e4c3640c1cb0cc42 in_seq=0 out_seq=0 2024-09-05T01:28:07.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.770+0000 7fc47fe00640 10 client.25762 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:28:07.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.771+0000 7fc47fe00640 1 -- 172.21.15.12:0/2531378089 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55879a429950 con 0x55879a4d0eb0 2024-09-05T01:28:07.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.771+0000 7fc47fe00640 10 client.25762 handle_command_reply: tid=0 2024-09-05T01:28:07.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.771+0000 7fc4a7fed740 1 client.25762 shutdown 2024-09-05T01:28:07.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.771+0000 7fc4a7fed740 1 -- 172.21.15.12:0/2531378089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55879a4c0e50 msgr2=0x55879a4be7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:07.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.771+0000 7fc4a7fed740 1 --2- 172.21.15.12:0/2531378089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55879a4c0e50 0x55879a4be7d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc49801b620 tx=0x7fc498009310 comp rx=0 tx=0).stop 2024-09-05T01:28:07.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.772+0000 7fc4a7fed740 1 -- 172.21.15.12:0/2531378089 shutdown_connections 2024-09-05T01:28:07.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.772+0000 7fc4a7fed740 1 --2- 172.21.15.12:0/2531378089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55879a4c0e50 0x55879a4be7d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.772+0000 7fc4a7fed740 1 --2- 172.21.15.12:0/2531378089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55879a4b6590 0x55879a4be290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.772+0000 7fc4a7fed740 1 --2- 172.21.15.12:0/2531378089 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x55879a4d0eb0 0x55879a4d32a0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.772+0000 7fc4a7fed740 1 --2- 172.21.15.12:0/2531378089 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55879a4b5c70 0x55879a4bdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.772+0000 7fc4a7fed740 1 -- 172.21.15.12:0/2531378089 >> 172.21.15.12:0/2531378089 conn(0x55879a4b2200 msgr2=0x55879a4b7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:07.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.772+0000 7fc47fe00640 0 client.25762 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:28:07.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.772+0000 7fc4a7fed740 1 -- 172.21.15.12:0/2531378089 shutdown_connections 2024-09-05T01:28:07.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.772+0000 7fc4a7fed740 1 -- 172.21.15.12:0/2531378089 wait complete. 2024-09-05T01:28:07.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.772+0000 7fc4a7fed740 20 client.25762 trim_cache size 0 max 16384 2024-09-05T01:28:07.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.788+0000 7fc4a7fed740 1 Processor -- start 2024-09-05T01:28:07.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.788+0000 7fc4a7fed740 1 -- start start 2024-09-05T01:28:07.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.788+0000 7fc4a7fed740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55879a4b5c70 0x55879a4c0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:07.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.788+0000 7fc4a7fed740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55879a4b6590 0x55879a4b8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:07.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.788+0000 7fc4a7fed740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55879a4c0e50 0x55879a4d8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:07.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.788+0000 7fc4a7fed740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a01afc00 con 0x55879a4c0e50 2024-09-05T01:28:07.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.788+0000 7fc4a7fed740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a01b18c0 con 0x55879a4b5c70 2024-09-05T01:28:07.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.788+0000 7fc4a7fed740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a01b02d0 con 0x55879a4b6590 2024-09-05T01:28:07.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.789+0000 7fc49e800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55879a4b5c70 0x55879a4c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:07.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.789+0000 7fc49de00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55879a4b6590 0x55879a4b8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:07.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.789+0000 7fc49e800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55879a4b5c70 0x55879a4c0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:43712/0 (socket says 172.21.15.12:43712) 2024-09-05T01:28:07.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.789+0000 7fc49e800640 1 -- 172.21.15.12:0/578696445 learned_addr learned my addr 172.21.15.12:0/578696445 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:07.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.789+0000 7fc49f200640 1 --2- 172.21.15.12:0/578696445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55879a4c0e50 0x55879a4d8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:07.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.789+0000 7fc49e800640 1 -- 172.21.15.12:0/578696445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55879a4b6590 msgr2=0x55879a4b8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:07.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.789+0000 7fc49e800640 1 --2- 172.21.15.12:0/578696445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55879a4b6590 0x55879a4b8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.789+0000 7fc49e800640 1 -- 172.21.15.12:0/578696445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55879a4c0e50 msgr2=0x55879a4d8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:07.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.789+0000 7fc49e800640 1 --2- 172.21.15.12:0/578696445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55879a4c0e50 0x55879a4d8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.789+0000 7fc49e800640 1 -- 172.21.15.12:0/578696445 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55879a4b2030 con 0x55879a4b5c70 2024-09-05T01:28:07.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.789+0000 7fc49e800640 1 --2- 172.21.15.12:0/578696445 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55879a4b5c70 0x55879a4c0080 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc490004770 tx=0x7fc49003f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=967088f712a06241 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:07.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.790+0000 7fc48aa00640 1 -- 172.21.15.12:0/578696445 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc490035040 con 0x55879a4b5c70 2024-09-05T01:28:07.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.790+0000 7fc48aa00640 1 -- 172.21.15.12:0/578696445 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc49005a070 con 0x55879a4b5c70 2024-09-05T01:28:07.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.790+0000 7fc48aa00640 1 -- 172.21.15.12:0/578696445 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc490054b10 con 0x55879a4b5c70 2024-09-05T01:28:07.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.790+0000 7fc4a7fed740 1 -- 172.21.15.12:0/578696445 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55879a4b5c70 msgr2=0x55879a4c0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:07.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.790+0000 7fc4a7fed740 1 --2- 172.21.15.12:0/578696445 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55879a4b5c70 0x55879a4c0080 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc490004770 tx=0x7fc49003f000 comp rx=0 tx=0).stop 2024-09-05T01:28:07.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.790+0000 7fc4a7fed740 1 -- 172.21.15.12:0/578696445 shutdown_connections 2024-09-05T01:28:07.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.790+0000 7fc4a7fed740 1 --2- 172.21.15.12:0/578696445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55879a4c0e50 0x55879a4d8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.790+0000 7fc4a7fed740 1 --2- 172.21.15.12:0/578696445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55879a4b6590 0x55879a4b8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.790+0000 7fc4a7fed740 1 --2- 172.21.15.12:0/578696445 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55879a4b5c70 0x55879a4c0080 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.790+0000 7fc4a7fed740 1 -- 172.21.15.12:0/578696445 >> 172.21.15.12:0/578696445 conn(0x55879a4b2200 msgr2=0x55879a4bcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:07.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.791+0000 7fc4a7fed740 1 -- 172.21.15.12:0/578696445 shutdown_connections 2024-09-05T01:28:07.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.791+0000 7fc4a7fed740 1 -- 172.21.15.12:0/578696445 wait complete. 2024-09-05T01:28:07.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.791+0000 7fc4a7fed740 1 -- start start 2024-09-05T01:28:07.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.791+0000 7fc4a7fed740 1 Processor -- start 2024-09-05T01:28:07.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.792+0000 7fc4a7fed740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55879a4b5c70 0x55879a4c9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:07.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.792+0000 7fc4a7fed740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55879a4b6590 0x55879a4c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:07.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.792+0000 7fc4a7fed740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55879a4c0e50 0x55879a4ba970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:07.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.792+0000 7fc4a7fed740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a01b1130 con 0x55879a4b5c70 2024-09-05T01:28:07.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.792+0000 7fc4a7fed740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a01b0a60 con 0x55879a4b6590 2024-09-05T01:28:07.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.792+0000 7fc4a7fed740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a01adbe0 con 0x55879a4c0e50 2024-09-05T01:28:07.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.792+0000 7fc4a7fed740 10 client.0 _ll_register_callbacks cb 0x7fc498015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:28:07.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.792+0000 7fc49de00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55879a4b6590 0x55879a4c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:07.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.792+0000 7fc49e800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55879a4b5c70 0x55879a4c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:07.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.792+0000 7fc49de00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55879a4b6590 0x55879a4c96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:43718/0 (socket says 172.21.15.12:43718) 2024-09-05T01:28:07.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.792+0000 7fc49de00640 1 -- 172.21.15.12:0/1372364764 learned_addr learned my addr 172.21.15.12:0/1372364764 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:07.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.792+0000 7fc49f200640 1 --2- 172.21.15.12:0/1372364764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55879a4c0e50 0x55879a4ba970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:07.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.792+0000 7fc49de00640 1 -- 172.21.15.12:0/1372364764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55879a4c0e50 msgr2=0x55879a4ba970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:07.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.792+0000 7fc49de00640 1 --2- 172.21.15.12:0/1372364764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55879a4c0e50 0x55879a4ba970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.792+0000 7fc49de00640 1 -- 172.21.15.12:0/1372364764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55879a4b5c70 msgr2=0x55879a4c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:07.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.792+0000 7fc49de00640 1 --2- 172.21.15.12:0/1372364764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55879a4b5c70 0x55879a4c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.792+0000 7fc49de00640 1 -- 172.21.15.12:0/1372364764 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55879a4bb170 con 0x55879a4b6590 2024-09-05T01:28:07.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.793+0000 7fc49de00640 1 --2- 172.21.15.12:0/1372364764 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55879a4b6590 0x55879a4c96d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00c6a0 tx=0x7fc48c09c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4d50b5dea697bea server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:07.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.793+0000 7fc47fe00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:28:07.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.793+0000 7fc47fe00640 1 -- 172.21.15.12:0/1372364764 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c0cd3d0 con 0x55879a4b6590 2024-09-05T01:28:07.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.793+0000 7fc47fe00640 1 -- 172.21.15.12:0/1372364764 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fc48c09b360 con 0x55879a4b6590 2024-09-05T01:28:07.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.793+0000 7fc4a7fed740 1 -- 172.21.15.12:0/1372364764 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc49005a070 con 0x55879a4b6590 2024-09-05T01:28:07.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.793+0000 7fc47fe00640 1 -- 172.21.15.12:0/1372364764 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc48c0a4980 con 0x55879a4b6590 2024-09-05T01:28:07.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.793+0000 7fc4a7fed740 10 client.25778 fetch_fsmap learned FSMap version 34 2024-09-05T01:28:07.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.793+0000 7fc4a7fed740 1 -- 172.21.15.12:0/1372364764 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55879a53b620 con 0x55879a4b6590 2024-09-05T01:28:07.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.793+0000 7fc47fe00640 1 -- 172.21.15.12:0/1372364764 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc49005a070 con 0x55879a4b6590 2024-09-05T01:28:07.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.793+0000 7fc47fe00640 1 -- 172.21.15.12:0/1372364764 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 34) ==== 8410+0+0 (secure 0 0 0) 0x7fc48c097c60 con 0x55879a4b6590 2024-09-05T01:28:07.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.794+0000 7fc4a7fed740 10 client.25778 fetch_fsmap finished waiting for FSMap version 34 2024-09-05T01:28:07.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.794+0000 7fc4a7fed740 10 client.25778 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T01:28:07.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.794+0000 7fc4a7fed740 20 client.25778 populate_metadata read hostname 'smithi012' 2024-09-05T01:28:07.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.794+0000 7fc4a7fed740 1 --2- 172.21.15.12:0/1372364764 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x55879a53be10 0x55879a53e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:07.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.794+0000 7fc4a7fed740 4 client.25778 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:28:07.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.794+0000 7fc4a7fed740 1 -- 172.21.15.12:0/1372364764 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55879a423e60 con 0x55879a53be10 2024-09-05T01:28:07.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.794+0000 7fc49e800640 1 --2- 172.21.15.12:0/1372364764 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x55879a53be10 0x55879a53e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:07.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.794+0000 7fc49e800640 1 --2- 172.21.15.12:0/1372364764 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x55879a53be10 0x55879a53e230 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d960010d764da5dd server_cookie=5efb7b4e24cc3838 in_seq=0 out_seq=0 2024-09-05T01:28:07.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.794+0000 7fc47fe00640 10 client.25778 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:28:07.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.795+0000 7fc47fe00640 1 -- 172.21.15.12:0/1372364764 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55879a423e60 con 0x55879a53be10 2024-09-05T01:28:07.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.795+0000 7fc47fe00640 10 client.25778 handle_command_reply: tid=0 2024-09-05T01:28:07.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.795+0000 7fc4a7fed740 1 client.25778 shutdown 2024-09-05T01:28:07.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.796+0000 7fc4a7fed740 1 -- 172.21.15.12:0/1372364764 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55879a4b6590 msgr2=0x55879a4c96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:07.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.796+0000 7fc4a7fed740 1 --2- 172.21.15.12:0/1372364764 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55879a4b6590 0x55879a4c96d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00c6a0 tx=0x7fc48c09c4d0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.796+0000 7fc4a7fed740 1 -- 172.21.15.12:0/1372364764 shutdown_connections 2024-09-05T01:28:07.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.796+0000 7fc4a7fed740 1 --2- 172.21.15.12:0/1372364764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55879a4c0e50 0x55879a4ba970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.796+0000 7fc4a7fed740 1 --2- 172.21.15.12:0/1372364764 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x55879a53be10 0x55879a53e230 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.796+0000 7fc4a7fed740 1 --2- 172.21.15.12:0/1372364764 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55879a4b6590 0x55879a4c96d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.796+0000 7fc4a7fed740 1 --2- 172.21.15.12:0/1372364764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55879a4b5c70 0x55879a4c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.796+0000 7fc47fe00640 0 client.25778 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:28:07.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.796+0000 7fc4a7fed740 1 -- 172.21.15.12:0/1372364764 >> 172.21.15.12:0/1372364764 conn(0x55879a4b2200 msgr2=0x55879a4b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:07.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.796+0000 7fc4a7fed740 1 -- 172.21.15.12:0/1372364764 shutdown_connections 2024-09-05T01:28:07.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.796+0000 7fc4a7fed740 1 -- 172.21.15.12:0/1372364764 wait complete. 2024-09-05T01:28:07.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.796+0000 7fc4a7fed740 20 client.25778 trim_cache size 0 max 16384 2024-09-05T01:28:07.800 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:28:07.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.797+0000 7fc4a5400640 1 -- 172.21.15.12:0/2197839526 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc4840a2d70 msgr2=0x7fc4840a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:07.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.797+0000 7fc4a5400640 1 --2- 172.21.15.12:0/2197839526 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc4840a2d70 0x7fc4840a5230 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc4900096c0 tx=0x7fc4900046c0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.797+0000 7fc4a5400640 1 -- 172.21.15.12:0/2197839526 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4a0074e30 msgr2=0x7fc4a019abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:07.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.797+0000 7fc4a5400640 1 --2- 172.21.15.12:0/2197839526 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4a0074e30 0x7fc4a019abd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00e9f0 tx=0x7fc48c00eeb0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.797+0000 7fc4a5400640 1 -- 172.21.15.12:0/2197839526 shutdown_connections 2024-09-05T01:28:07.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.797+0000 7fc4a5400640 1 --2- 172.21.15.12:0/2197839526 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc4840a2d70 0x7fc4840a5230 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.797+0000 7fc4a5400640 1 --2- 172.21.15.12:0/2197839526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4a010e450 0x7fc4a019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.797+0000 7fc4a5400640 1 --2- 172.21.15.12:0/2197839526 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4a0074e30 0x7fc4a019abd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.797+0000 7fc4a5400640 1 --2- 172.21.15.12:0/2197839526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4a0074510 0x7fc4a019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:07.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.797+0000 7fc4a5400640 1 -- 172.21.15.12:0/2197839526 >> 172.21.15.12:0/2197839526 conn(0x7fc4a00fd8b0 msgr2=0x7fc4a00fef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:07.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.797+0000 7fc4a5400640 1 -- 172.21.15.12:0/2197839526 shutdown_connections 2024-09-05T01:28:07.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:07.797+0000 7fc4a5400640 1 -- 172.21.15.12:0/2197839526 wait complete. 2024-09-05T01:28:08.588 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-05T01:28:08.968 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:28:09.163 INFO:tasks.workunit.client.0.smithi012.stdout: 249 307873 1494 225265 1455 67804 109 2024-09-05T01:28:09.290 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:08 smithi012 ceph-mon[29942]: pgmap v106: 97 pgs: 97 active+clean; 797 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 22 MiB/s wr, 942 op/s 2024-09-05T01:28:09.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:08 smithi145 ceph-mon[34376]: pgmap v106: 97 pgs: 97 active+clean; 797 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 22 MiB/s wr, 942 op/s 2024-09-05T01:28:09.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:08 smithi151 ceph-mon[35013]: pgmap v106: 97 pgs: 97 active+clean; 797 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 22 MiB/s wr, 942 op/s 2024-09-05T01:28:09.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.537+0000 7f365fe00640 1 -- 172.21.15.12:0/1294980222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36601079d0 msgr2=0x7f3660107db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:09.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.537+0000 7f365fe00640 1 --2- 172.21.15.12:0/1294980222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36601079d0 0x7f3660107db0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3650009930 tx=0x7f365002a420 comp rx=0 tx=0).stop 2024-09-05T01:28:09.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.537+0000 7f365fe00640 1 -- 172.21.15.12:0/1294980222 shutdown_connections 2024-09-05T01:28:09.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.537+0000 7f365fe00640 1 --2- 172.21.15.12:0/1294980222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3660102370 0x7f366010e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.537+0000 7f365fe00640 1 --2- 172.21.15.12:0/1294980222 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f36601019d0 0x7f3660101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.537+0000 7f365fe00640 1 --2- 172.21.15.12:0/1294980222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36601079d0 0x7f3660107db0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.537+0000 7f365fe00640 1 -- 172.21.15.12:0/1294980222 >> 172.21.15.12:0/1294980222 conn(0x7f36600fd710 msgr2=0x7f36600ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:09.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.538+0000 7f365fe00640 1 -- 172.21.15.12:0/1294980222 shutdown_connections 2024-09-05T01:28:09.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.538+0000 7f365fe00640 1 -- 172.21.15.12:0/1294980222 wait complete. 2024-09-05T01:28:09.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.539+0000 7f365fe00640 1 Processor -- start 2024-09-05T01:28:09.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.539+0000 7f365fe00640 1 -- start start 2024-09-05T01:28:09.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.539+0000 7f365fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36601019d0 0x7f366019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:09.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.539+0000 7f365fe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3660102370 0x7f366019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:09.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.539+0000 7f365fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36601079d0 0x7f366019ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:09.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.539+0000 7f365fe00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3660111de0 con 0x7f36601079d0 2024-09-05T01:28:09.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.539+0000 7f365fe00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f3660111c60 con 0x7f3660102370 2024-09-05T01:28:09.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.539+0000 7f365fe00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3660111f60 con 0x7f36601019d0 2024-09-05T01:28:09.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.540+0000 7f365e000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3660102370 0x7f366019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:09.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.540+0000 7f365ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36601019d0 0x7f366019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:09.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.540+0000 7f365ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36601019d0 0x7f366019a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:38524/0 (socket says 172.21.15.12:38524) 2024-09-05T01:28:09.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.540+0000 7f365ea00640 1 -- 172.21.15.12:0/3417222876 learned_addr learned my addr 172.21.15.12:0/3417222876 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:09.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.540+0000 7f365f400640 1 --2- 172.21.15.12:0/3417222876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36601079d0 0x7f366019ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:09.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.540+0000 7f365ea00640 1 -- 172.21.15.12:0/3417222876 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3660102370 msgr2=0x7f366019a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:09.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.540+0000 7f365ea00640 1 --2- 172.21.15.12:0/3417222876 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3660102370 0x7f366019a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.540+0000 7f365ea00640 1 -- 172.21.15.12:0/3417222876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36601079d0 msgr2=0x7f366019ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:09.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.540+0000 7f365ea00640 1 --2- 172.21.15.12:0/3417222876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36601079d0 0x7f366019ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.540+0000 7f365ea00640 1 -- 172.21.15.12:0/3417222876 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366019f460 con 0x7f36601019d0 2024-09-05T01:28:09.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.540+0000 7f365f400640 1 --2- 172.21.15.12:0/3417222876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36601079d0 0x7f366019ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:28:09.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.541+0000 7f365ea00640 1 --2- 172.21.15.12:0/3417222876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36601019d0 0x7f366019a4b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f365002a940 tx=0x7f3650003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:09.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.541+0000 7f3657400640 1 -- 172.21.15.12:0/3417222876 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365003f070 con 0x7f36601019d0 2024-09-05T01:28:09.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.541+0000 7f3657400640 1 -- 172.21.15.12:0/3417222876 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3650031c90 con 0x7f36601019d0 2024-09-05T01:28:09.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.541+0000 7f3657400640 1 -- 172.21.15.12:0/3417222876 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3650035030 con 0x7f36601019d0 2024-09-05T01:28:09.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.541+0000 7f365fe00640 1 -- 172.21.15.12:0/3417222876 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f366019f6f0 con 0x7f36601019d0 2024-09-05T01:28:09.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.541+0000 7f365fe00640 1 -- 172.21.15.12:0/3417222876 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3660108830 con 0x7f36601019d0 2024-09-05T01:28:09.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.547+0000 7f3657400640 1 -- 172.21.15.12:0/3417222876 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f3650042070 con 0x7f36601019d0 2024-09-05T01:28:09.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.548+0000 7f3657400640 1 --2- 172.21.15.12:0/3417222876 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f36440a2d70 0x7f36440a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:09.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.548+0000 7f3657400640 1 -- 172.21.15.12:0/3417222876 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f36500efa90 con 0x7f36601019d0 2024-09-05T01:28:09.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.549+0000 7f365e000640 1 --2- 172.21.15.12:0/3417222876 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f36440a2d70 0x7f36440a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:09.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.550+0000 7f366880c740 1 Processor -- start 2024-09-05T01:28:09.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.550+0000 7f365e000640 1 --2- 172.21.15.12:0/3417222876 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f36440a2d70 0x7f36440a5230 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f366010eca0 tx=0x7f364c005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:09.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.550+0000 7f366880c740 1 -- start start 2024-09-05T01:28:09.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.550+0000 7f366880c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559cfb092e40 0x559cfb093220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:09.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.550+0000 7f366880c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cfb093760 0x559cfb09dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:09.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.550+0000 7f366880c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb09e020 0x559cfb0a0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:09.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.550+0000 7f366880c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559cfaff93e0 con 0x559cfb093760 2024-09-05T01:28:09.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.550+0000 7f366880c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x559cfafa0d80 con 0x559cfb092e40 2024-09-05T01:28:09.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.550+0000 7f366880c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559cfaff53a0 con 0x559cfb09e020 2024-09-05T01:28:09.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.551+0000 7f365e000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cfb093760 0x559cfb09dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:09.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.551+0000 7f365ea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559cfb092e40 0x559cfb093220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:09.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.551+0000 7f365ea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559cfb092e40 0x559cfb093220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:43746/0 (socket says 172.21.15.12:43746) 2024-09-05T01:28:09.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.551+0000 7f365ea00640 1 -- 172.21.15.12:0/2222462772 learned_addr learned my addr 172.21.15.12:0/2222462772 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:09.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.551+0000 7f365f400640 1 --2- 172.21.15.12:0/2222462772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb09e020 0x559cfb0a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:09.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.551+0000 7f365ea00640 1 -- 172.21.15.12:0/2222462772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb09e020 msgr2=0x559cfb0a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:09.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.551+0000 7f365ea00640 1 --2- 172.21.15.12:0/2222462772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb09e020 0x559cfb0a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.551+0000 7f365ea00640 1 -- 172.21.15.12:0/2222462772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cfb093760 msgr2=0x559cfb09dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:09.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.551+0000 7f365ea00640 1 --2- 172.21.15.12:0/2222462772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cfb093760 0x559cfb09dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.551+0000 7f365ea00640 1 -- 172.21.15.12:0/2222462772 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cfafbfae0 con 0x559cfb092e40 2024-09-05T01:28:09.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.552+0000 7f365ea00640 1 --2- 172.21.15.12:0/2222462772 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559cfb092e40 0x559cfb093220 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f36500c46e0 tx=0x7f3650031490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=100d1982d7d7bafc server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:09.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.552+0000 7f364be00640 1 -- 172.21.15.12:0/2222462772 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36500bbfa0 con 0x559cfb092e40 2024-09-05T01:28:09.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.552+0000 7f364be00640 1 -- 172.21.15.12:0/2222462772 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36500c0350 con 0x559cfb092e40 2024-09-05T01:28:09.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.552+0000 7f364be00640 1 -- 172.21.15.12:0/2222462772 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36500dabe0 con 0x559cfb092e40 2024-09-05T01:28:09.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.553+0000 7f366880c740 1 -- 172.21.15.12:0/2222462772 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559cfb092e40 msgr2=0x559cfb093220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:09.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.553+0000 7f366880c740 1 --2- 172.21.15.12:0/2222462772 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559cfb092e40 0x559cfb093220 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f36500c46e0 tx=0x7f3650031490 comp rx=0 tx=0).stop 2024-09-05T01:28:09.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.554+0000 7f366880c740 1 -- 172.21.15.12:0/2222462772 shutdown_connections 2024-09-05T01:28:09.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.554+0000 7f366880c740 1 --2- 172.21.15.12:0/2222462772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb09e020 0x559cfb0a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.554+0000 7f366880c740 1 --2- 172.21.15.12:0/2222462772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cfb093760 0x559cfb09dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.554+0000 7f366880c740 1 --2- 172.21.15.12:0/2222462772 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559cfb092e40 0x559cfb093220 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.554+0000 7f366880c740 1 -- 172.21.15.12:0/2222462772 >> 172.21.15.12:0/2222462772 conn(0x559cfb08f3d0 msgr2=0x559cfb08f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:09.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.554+0000 7f366880c740 1 -- 172.21.15.12:0/2222462772 shutdown_connections 2024-09-05T01:28:09.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.554+0000 7f366880c740 1 -- 172.21.15.12:0/2222462772 wait complete. 2024-09-05T01:28:09.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.554+0000 7f366880c740 1 -- start start 2024-09-05T01:28:09.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.554+0000 7f366880c740 1 Processor -- start 2024-09-05T01:28:09.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.555+0000 7f366880c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb092e40 0x559cfb09af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.555+0000 7f366880c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cfb093760 0x559cfb09b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.555+0000 7f366880c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559cfb09e020 0x559cfb09b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.555+0000 7f366880c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559cfb0a09b0 con 0x559cfb093760 2024-09-05T01:28:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.555+0000 7f366880c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x559cfafb40f0 con 0x559cfb09e020 2024-09-05T01:28:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.555+0000 7f366880c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559cfb0a0b30 con 0x559cfb092e40 2024-09-05T01:28:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.555+0000 7f366880c740 10 client.0 _ll_register_callbacks cb 0x559cfaf9bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:28:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.556+0000 7f365ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb092e40 0x559cfb09af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.556+0000 7f365ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb092e40 0x559cfb09af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:38542/0 (socket says 172.21.15.12:38542) 2024-09-05T01:28:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.556+0000 7f365ea00640 1 -- 172.21.15.12:0/746193558 learned_addr learned my addr 172.21.15.12:0/746193558 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.556+0000 7f365f400640 1 --2- 172.21.15.12:0/746193558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559cfb09e020 0x559cfb09b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.556+0000 7f365e000640 1 --2- 172.21.15.12:0/746193558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cfb093760 0x559cfb09b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.556+0000 7f365ea00640 1 -- 172.21.15.12:0/746193558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559cfb09e020 msgr2=0x559cfb09b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:09.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.556+0000 7f365ea00640 1 --2- 172.21.15.12:0/746193558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559cfb09e020 0x559cfb09b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.556+0000 7f365ea00640 1 -- 172.21.15.12:0/746193558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cfb093760 msgr2=0x559cfb09b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:09.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.556+0000 7f365ea00640 1 --2- 172.21.15.12:0/746193558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cfb093760 0x559cfb09b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.556+0000 7f365ea00640 1 -- 172.21.15.12:0/746193558 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cfad6a3c0 con 0x559cfb092e40 2024-09-05T01:28:09.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.557+0000 7f365ea00640 1 --2- 172.21.15.12:0/746193558 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb092e40 0x559cfb09af50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3650009900 tx=0x7f3650009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b08ea35806d401bb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:09.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.557+0000 7f3648c00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:28:09.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.557+0000 7f3648c00640 1 -- 172.21.15.12:0/746193558 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36500d4070 con 0x559cfb092e40 2024-09-05T01:28:09.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.557+0000 7f3648c00640 1 -- 172.21.15.12:0/746193558 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f36500dabe0 con 0x559cfb092e40 2024-09-05T01:28:09.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.557+0000 7f366880c740 1 -- 172.21.15.12:0/746193558 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36500c0350 con 0x559cfb092e40 2024-09-05T01:28:09.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.557+0000 7f3648c00640 1 -- 172.21.15.12:0/746193558 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f36500ed450 con 0x559cfb092e40 2024-09-05T01:28:09.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.558+0000 7f366880c740 10 client.25780 fetch_fsmap learned FSMap version 34 2024-09-05T01:28:09.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.558+0000 7f366880c740 1 -- 172.21.15.12:0/746193558 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559cfb0a09b0 con 0x559cfb092e40 2024-09-05T01:28:09.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.558+0000 7f3648c00640 1 -- 172.21.15.12:0/746193558 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36500c0350 con 0x559cfb092e40 2024-09-05T01:28:09.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.558+0000 7f3648c00640 1 -- 172.21.15.12:0/746193558 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 34) ==== 8410+0+0 (secure 0 0 0) 0x7f36500d9020 con 0x559cfb092e40 2024-09-05T01:28:09.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.558+0000 7f366880c740 10 client.25780 fetch_fsmap finished waiting for FSMap version 34 2024-09-05T01:28:09.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.558+0000 7f366880c740 10 client.25780 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T01:28:09.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.558+0000 7f366880c740 20 client.25780 populate_metadata read hostname 'smithi012' 2024-09-05T01:28:09.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.558+0000 7f366880c740 1 --2- 172.21.15.12:0/746193558 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x559cfb0adb30 0x559cfb0aff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:09.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.558+0000 7f366880c740 4 client.25780 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:28:09.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.558+0000 7f366880c740 1 -- 172.21.15.12:0/746193558 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559cfb006950 con 0x559cfb0adb30 2024-09-05T01:28:09.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.559+0000 7f365e000640 1 --2- 172.21.15.12:0/746193558 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x559cfb0adb30 0x559cfb0aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:09.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.559+0000 7f365e000640 1 --2- 172.21.15.12:0/746193558 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x559cfb0adb30 0x559cfb0aff20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=53052dd8a5f665d6 server_cookie=c4683aae1c2b5a40 in_seq=0 out_seq=0 2024-09-05T01:28:09.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.559+0000 7f3648c00640 10 client.25780 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:28:09.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.560+0000 7f3648c00640 1 -- 172.21.15.12:0/746193558 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559cfb006950 con 0x559cfb0adb30 2024-09-05T01:28:09.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.560+0000 7f3648c00640 10 client.25780 handle_command_reply: tid=0 2024-09-05T01:28:09.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.560+0000 7f366880c740 1 client.25780 shutdown 2024-09-05T01:28:09.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.560+0000 7f366880c740 1 -- 172.21.15.12:0/746193558 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb092e40 msgr2=0x559cfb09af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:09.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.560+0000 7f366880c740 1 --2- 172.21.15.12:0/746193558 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb092e40 0x559cfb09af50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3650009900 tx=0x7f3650009260 comp rx=0 tx=0).stop 2024-09-05T01:28:09.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.561+0000 7f366880c740 1 -- 172.21.15.12:0/746193558 shutdown_connections 2024-09-05T01:28:09.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.561+0000 7f366880c740 1 --2- 172.21.15.12:0/746193558 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559cfb09e020 0x559cfb09b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.561+0000 7f366880c740 1 --2- 172.21.15.12:0/746193558 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x559cfb0adb30 0x559cfb0aff20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.561+0000 7f366880c740 1 --2- 172.21.15.12:0/746193558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cfb093760 0x559cfb09b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.561+0000 7f366880c740 1 --2- 172.21.15.12:0/746193558 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb092e40 0x559cfb09af50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.561+0000 7f3648c00640 0 client.25780 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:28:09.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.561+0000 7f366880c740 1 -- 172.21.15.12:0/746193558 >> 172.21.15.12:0/746193558 conn(0x559cfb08f3d0 msgr2=0x559cfb095100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:09.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.561+0000 7f366880c740 1 -- 172.21.15.12:0/746193558 shutdown_connections 2024-09-05T01:28:09.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.561+0000 7f366880c740 1 -- 172.21.15.12:0/746193558 wait complete. 2024-09-05T01:28:09.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.561+0000 7f366880c740 20 client.25780 trim_cache size 0 max 16384 2024-09-05T01:28:09.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.584+0000 7f366880c740 1 Processor -- start 2024-09-05T01:28:09.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.584+0000 7f366880c740 1 -- start start 2024-09-05T01:28:09.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.584+0000 7f366880c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb092e40 0x559cfb0b5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:09.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.584+0000 7f366880c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559cfb093760 0x559cfb0b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:09.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.584+0000 7f366880c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cfb09e020 0x559cfb08dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:09.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.584+0000 7f366880c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f36601ab660 con 0x559cfb09e020 2024-09-05T01:28:09.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.584+0000 7f366880c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f36601ad320 con 0x559cfb093760 2024-09-05T01:28:09.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.584+0000 7f366880c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f36601abd30 con 0x559cfb092e40 2024-09-05T01:28:09.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.584+0000 7f365ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb092e40 0x559cfb0b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:09.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.584+0000 7f365ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb092e40 0x559cfb0b5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:38552/0 (socket says 172.21.15.12:38552) 2024-09-05T01:28:09.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.584+0000 7f365ea00640 1 -- 172.21.15.12:0/2173254131 learned_addr learned my addr 172.21.15.12:0/2173254131 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:09.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.585+0000 7f365e000640 1 --2- 172.21.15.12:0/2173254131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559cfb093760 0x559cfb0b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:09.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.585+0000 7f365f400640 1 --2- 172.21.15.12:0/2173254131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cfb09e020 0x559cfb08dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:09.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.585+0000 7f365ea00640 1 -- 172.21.15.12:0/2173254131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559cfb093760 msgr2=0x559cfb0b5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:09.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.585+0000 7f365ea00640 1 --2- 172.21.15.12:0/2173254131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559cfb093760 0x559cfb0b5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.585+0000 7f365ea00640 1 -- 172.21.15.12:0/2173254131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cfb09e020 msgr2=0x559cfb08dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:09.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.585+0000 7f365ea00640 1 --2- 172.21.15.12:0/2173254131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cfb09e020 0x559cfb08dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.585+0000 7f365ea00640 1 -- 172.21.15.12:0/2173254131 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cfb08ee70 con 0x559cfb092e40 2024-09-05T01:28:09.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.585+0000 7f365f400640 1 --2- 172.21.15.12:0/2173254131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cfb09e020 0x559cfb08dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:28:09.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.585+0000 7f365ea00640 1 --2- 172.21.15.12:0/2173254131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb092e40 0x559cfb0b5700 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f36500bbf30 tx=0x7f3650031490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f15ca00baaafef89 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:09.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.585+0000 7f364b400640 1 -- 172.21.15.12:0/2173254131 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36500d4070 con 0x559cfb092e40 2024-09-05T01:28:09.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.586+0000 7f364b400640 1 -- 172.21.15.12:0/2173254131 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36500c0350 con 0x559cfb092e40 2024-09-05T01:28:09.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.586+0000 7f364b400640 1 -- 172.21.15.12:0/2173254131 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36500bb510 con 0x559cfb092e40 2024-09-05T01:28:09.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.586+0000 7f366880c740 1 -- 172.21.15.12:0/2173254131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb092e40 msgr2=0x559cfb0b5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:09.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.586+0000 7f366880c740 1 --2- 172.21.15.12:0/2173254131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb092e40 0x559cfb0b5700 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f36500bbf30 tx=0x7f3650031490 comp rx=0 tx=0).stop 2024-09-05T01:28:09.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.586+0000 7f366880c740 1 -- 172.21.15.12:0/2173254131 shutdown_connections 2024-09-05T01:28:09.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.586+0000 7f366880c740 1 --2- 172.21.15.12:0/2173254131 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cfb09e020 0x559cfb08dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.586+0000 7f366880c740 1 --2- 172.21.15.12:0/2173254131 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559cfb093760 0x559cfb0b5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.586+0000 7f366880c740 1 --2- 172.21.15.12:0/2173254131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb092e40 0x559cfb0b5700 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.586+0000 7f366880c740 1 -- 172.21.15.12:0/2173254131 >> 172.21.15.12:0/2173254131 conn(0x559cfb08f3d0 msgr2=0x559cfb09a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:09.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.587+0000 7f366880c740 1 -- 172.21.15.12:0/2173254131 shutdown_connections 2024-09-05T01:28:09.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.587+0000 7f366880c740 1 -- 172.21.15.12:0/2173254131 wait complete. 2024-09-05T01:28:09.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.587+0000 7f366880c740 1 -- start start 2024-09-05T01:28:09.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.587+0000 7f366880c740 1 Processor -- start 2024-09-05T01:28:09.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.588+0000 7f366880c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cfb092e40 0x559cfb0a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:09.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.588+0000 7f366880c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb093760 0x559cfb0a1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:09.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.588+0000 7f366880c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559cfb09e020 0x559cfb110690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:09.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.588+0000 7f366880c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f36601acb90 con 0x559cfb092e40 2024-09-05T01:28:09.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.588+0000 7f366880c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f36601ac4c0 con 0x559cfb09e020 2024-09-05T01:28:09.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.588+0000 7f366880c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f36601a96a0 con 0x559cfb093760 2024-09-05T01:28:09.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.588+0000 7f366880c740 10 client.0 _ll_register_callbacks cb 0x7f3658014bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:28:09.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.588+0000 7f365e000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb093760 0x559cfb0a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:09.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.588+0000 7f365e000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb093760 0x559cfb0a1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:38554/0 (socket says 172.21.15.12:38554) 2024-09-05T01:28:09.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.588+0000 7f365e000640 1 -- 172.21.15.12:0/2861113977 learned_addr learned my addr 172.21.15.12:0/2861113977 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:09.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.588+0000 7f365f400640 1 --2- 172.21.15.12:0/2861113977 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559cfb09e020 0x559cfb110690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:09.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.588+0000 7f365ea00640 1 --2- 172.21.15.12:0/2861113977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cfb092e40 0x559cfb0a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:09.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.588+0000 7f365e000640 1 -- 172.21.15.12:0/2861113977 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559cfb09e020 msgr2=0x559cfb110690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:09.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.588+0000 7f365e000640 1 --2- 172.21.15.12:0/2861113977 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559cfb09e020 0x559cfb110690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.588+0000 7f365e000640 1 -- 172.21.15.12:0/2861113977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cfb092e40 msgr2=0x559cfb0a13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:09.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.588+0000 7f365e000640 1 --2- 172.21.15.12:0/2861113977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cfb092e40 0x559cfb0a13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.588+0000 7f365e000640 1 -- 172.21.15.12:0/2861113977 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cfb110cd0 con 0x559cfb093760 2024-09-05T01:28:09.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.588+0000 7f365ea00640 1 --2- 172.21.15.12:0/2861113977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cfb092e40 0x559cfb0a13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:28:09.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.589+0000 7f365e000640 1 --2- 172.21.15.12:0/2861113977 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb093760 0x559cfb0a1920 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f364c009730 tx=0x7f364c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d392d2f44a6781b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:09.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.589+0000 7f3648c00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:28:09.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.589+0000 7f3648c00640 1 -- 172.21.15.12:0/2861113977 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364c037060 con 0x559cfb093760 2024-09-05T01:28:09.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.589+0000 7f366880c740 1 -- 172.21.15.12:0/2861113977 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36500c0350 con 0x559cfb093760 2024-09-05T01:28:09.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.589+0000 7f3648c00640 1 -- 172.21.15.12:0/2861113977 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f364c01d8d0 con 0x559cfb093760 2024-09-05T01:28:09.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.589+0000 7f3648c00640 1 -- 172.21.15.12:0/2861113977 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f364c01db10 con 0x559cfb093760 2024-09-05T01:28:09.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.589+0000 7f366880c740 10 client.25786 fetch_fsmap learned FSMap version 34 2024-09-05T01:28:09.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.589+0000 7f366880c740 1 -- 172.21.15.12:0/2861113977 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559cfb1180d0 con 0x559cfb093760 2024-09-05T01:28:09.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.590+0000 7f3648c00640 1 -- 172.21.15.12:0/2861113977 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36500c0350 con 0x559cfb093760 2024-09-05T01:28:09.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.590+0000 7f3648c00640 1 -- 172.21.15.12:0/2861113977 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 34) ==== 8410+0+0 (secure 0 0 0) 0x7f364c01c400 con 0x559cfb093760 2024-09-05T01:28:09.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.590+0000 7f366880c740 10 client.25786 fetch_fsmap finished waiting for FSMap version 34 2024-09-05T01:28:09.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.590+0000 7f366880c740 10 client.25786 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T01:28:09.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.590+0000 7f366880c740 20 client.25786 populate_metadata read hostname 'smithi012' 2024-09-05T01:28:09.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.590+0000 7f366880c740 1 --2- 172.21.15.12:0/2861113977 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x559cfb118830 0x559cfb11ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:09.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.590+0000 7f366880c740 4 client.25786 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:28:09.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.590+0000 7f366880c740 1 -- 172.21.15.12:0/2861113977 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559cfb000e60 con 0x559cfb118830 2024-09-05T01:28:09.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.590+0000 7f365ea00640 1 --2- 172.21.15.12:0/2861113977 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x559cfb118830 0x559cfb11ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:09.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.591+0000 7f365ea00640 1 --2- 172.21.15.12:0/2861113977 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x559cfb118830 0x559cfb11ac50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d595eacaf47f2b41 server_cookie=ae2707f9d05ffc18 in_seq=0 out_seq=0 2024-09-05T01:28:09.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.591+0000 7f3648c00640 10 client.25786 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:28:09.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.591+0000 7f3648c00640 1 -- 172.21.15.12:0/2861113977 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559cfb000e60 con 0x559cfb118830 2024-09-05T01:28:09.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.591+0000 7f3648c00640 10 client.25786 handle_command_reply: tid=0 2024-09-05T01:28:09.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.591+0000 7f366880c740 1 client.25786 shutdown 2024-09-05T01:28:09.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.591+0000 7f366880c740 1 -- 172.21.15.12:0/2861113977 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb093760 msgr2=0x559cfb0a1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:09.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.591+0000 7f366880c740 1 --2- 172.21.15.12:0/2861113977 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb093760 0x559cfb0a1920 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f364c009730 tx=0x7f364c004730 comp rx=0 tx=0).stop 2024-09-05T01:28:09.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.591+0000 7f366880c740 1 -- 172.21.15.12:0/2861113977 shutdown_connections 2024-09-05T01:28:09.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.591+0000 7f366880c740 1 --2- 172.21.15.12:0/2861113977 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559cfb09e020 0x559cfb110690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.591+0000 7f366880c740 1 --2- 172.21.15.12:0/2861113977 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559cfb093760 0x559cfb0a1920 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.591+0000 7f366880c740 1 --2- 172.21.15.12:0/2861113977 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x559cfb118830 0x559cfb11ac50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.591+0000 7f366880c740 1 --2- 172.21.15.12:0/2861113977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559cfb092e40 0x559cfb0a13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.591+0000 7f366880c740 1 -- 172.21.15.12:0/2861113977 >> 172.21.15.12:0/2861113977 conn(0x559cfb08f3d0 msgr2=0x559cfb08dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:09.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.591+0000 7f3648c00640 0 client.25786 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:28:09.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.591+0000 7f366880c740 1 -- 172.21.15.12:0/2861113977 shutdown_connections 2024-09-05T01:28:09.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.592+0000 7f366880c740 1 -- 172.21.15.12:0/2861113977 wait complete. 2024-09-05T01:28:09.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.592+0000 7f366880c740 20 client.25786 trim_cache size 0 max 16384 2024-09-05T01:28:09.596 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:28:09.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.592+0000 7f365fe00640 1 -- 172.21.15.12:0/3417222876 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f36440a2d70 msgr2=0x7f36440a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:09.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.592+0000 7f365fe00640 1 --2- 172.21.15.12:0/3417222876 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f36440a2d70 0x7f36440a5230 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f366010eca0 tx=0x7f364c005f90 comp rx=0 tx=0).stop 2024-09-05T01:28:09.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.592+0000 7f365fe00640 1 -- 172.21.15.12:0/3417222876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36601019d0 msgr2=0x7f366019a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:09.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.592+0000 7f365fe00640 1 --2- 172.21.15.12:0/3417222876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36601019d0 0x7f366019a4b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f365002a940 tx=0x7f3650003b20 comp rx=0 tx=0).stop 2024-09-05T01:28:09.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.592+0000 7f365fe00640 1 -- 172.21.15.12:0/3417222876 shutdown_connections 2024-09-05T01:28:09.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.592+0000 7f365fe00640 1 --2- 172.21.15.12:0/3417222876 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f36440a2d70 0x7f36440a5230 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.592+0000 7f365fe00640 1 --2- 172.21.15.12:0/3417222876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36601079d0 0x7f366019ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.592+0000 7f365fe00640 1 --2- 172.21.15.12:0/3417222876 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f3660102370 0x7f366019a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.592+0000 7f365fe00640 1 --2- 172.21.15.12:0/3417222876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f36601019d0 0x7f366019a4b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:09.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.592+0000 7f365fe00640 1 -- 172.21.15.12:0/3417222876 >> 172.21.15.12:0/3417222876 conn(0x7f36600fd710 msgr2=0x7f36600fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:09.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.593+0000 7f365fe00640 1 -- 172.21.15.12:0/3417222876 shutdown_connections 2024-09-05T01:28:09.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:09.593+0000 7f365fe00640 1 -- 172.21.15.12:0/3417222876 wait complete. 2024-09-05T01:28:10.390 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-05T01:28:10.797 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:28:11.203 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:10 smithi012 ceph-mon[29942]: pgmap v107: 97 pgs: 97 active+clean; 797 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.6 MiB/s wr, 374 op/s 2024-09-05T01:28:11.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:10 smithi145 ceph-mon[34376]: pgmap v107: 97 pgs: 97 active+clean; 797 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.6 MiB/s wr, 374 op/s 2024-09-05T01:28:11.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:10 smithi151 ceph-mon[35013]: pgmap v107: 97 pgs: 97 active+clean; 797 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.6 MiB/s wr, 374 op/s 2024-09-05T01:28:11.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.404+0000 7fe1f4800640 1 -- 172.21.15.12:0/1387934380 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1ec103ff0 msgr2=0x7fe1ec1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:11.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.404+0000 7fe1f4800640 1 --2- 172.21.15.12:0/1387934380 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1ec103ff0 0x7fe1ec1043d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0009900 tx=0x7fe1e002a400 comp rx=0 tx=0).stop 2024-09-05T01:28:11.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.404+0000 7fe1f4800640 1 -- 172.21.15.12:0/1387934380 shutdown_connections 2024-09-05T01:28:11.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.404+0000 7fe1f4800640 1 --2- 172.21.15.12:0/1387934380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1ec109120 0x7fe1ec110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.404+0000 7fe1f4800640 1 --2- 172.21.15.12:0/1387934380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1ec1049a0 0x7fe1ec1089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.404+0000 7fe1f4800640 1 --2- 172.21.15.12:0/1387934380 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1ec103ff0 0x7fe1ec1043d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.404+0000 7fe1f4800640 1 -- 172.21.15.12:0/1387934380 >> 172.21.15.12:0/1387934380 conn(0x7fe1ec0ffa90 msgr2=0x7fe1ec101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:11.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.404+0000 7fe1f4800640 1 -- 172.21.15.12:0/1387934380 shutdown_connections 2024-09-05T01:28:11.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.404+0000 7fe1f4800640 1 -- 172.21.15.12:0/1387934380 wait complete. 2024-09-05T01:28:11.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.405+0000 7fe1f4800640 1 Processor -- start 2024-09-05T01:28:11.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.405+0000 7fe1f4800640 1 -- start start 2024-09-05T01:28:11.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.406+0000 7fe1f4800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1ec103ff0 0x7fe1ec1a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:11.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.406+0000 7fe1f4800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1ec1049a0 0x7fe1ec1a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:11.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.406+0000 7fe1f4800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1ec109120 0x7fe1ec10fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:11.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.406+0000 7fe1f4800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec077d00 con 0x7fe1ec1049a0 2024-09-05T01:28:11.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.406+0000 7fe1f4800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec077b80 con 0x7fe1ec103ff0 2024-09-05T01:28:11.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.406+0000 7fe1f4800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec077e80 con 0x7fe1ec109120 2024-09-05T01:28:11.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.406+0000 7fe1f1e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1ec103ff0 0x7fe1ec1a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:11.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.406+0000 7fe1f1e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1ec103ff0 0x7fe1ec1a4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:43800/0 (socket says 172.21.15.12:43800) 2024-09-05T01:28:11.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.406+0000 7fe1f1e00640 1 -- 172.21.15.12:0/2354128338 learned_addr learned my addr 172.21.15.12:0/2354128338 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:11.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.406+0000 7fe1f2800640 1 --2- 172.21.15.12:0/2354128338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1ec109120 0x7fe1ec10fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:11.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.406+0000 7fe1f1400640 1 --2- 172.21.15.12:0/2354128338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1ec1049a0 0x7fe1ec1a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:11.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.406+0000 7fe1f1e00640 1 -- 172.21.15.12:0/2354128338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1ec109120 msgr2=0x7fe1ec10fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:11.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.406+0000 7fe1f1e00640 1 --2- 172.21.15.12:0/2354128338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1ec109120 0x7fe1ec10fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.406+0000 7fe1f1e00640 1 -- 172.21.15.12:0/2354128338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1ec1049a0 msgr2=0x7fe1ec1a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:11.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.406+0000 7fe1f1e00640 1 --2- 172.21.15.12:0/2354128338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1ec1049a0 0x7fe1ec1a4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.406+0000 7fe1f1e00640 1 -- 172.21.15.12:0/2354128338 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1ec1102e0 con 0x7fe1ec103ff0 2024-09-05T01:28:11.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.407+0000 7fe1f1e00640 1 --2- 172.21.15.12:0/2354128338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1ec103ff0 0x7fe1ec1a4760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0004770 tx=0x7fe1e0003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:11.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.407+0000 7fe1e6a00640 1 -- 172.21.15.12:0/2354128338 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e003f070 con 0x7fe1ec103ff0 2024-09-05T01:28:11.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.407+0000 7fe1e6a00640 1 -- 172.21.15.12:0/2354128338 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1e0031ca0 con 0x7fe1ec103ff0 2024-09-05T01:28:11.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.407+0000 7fe1e6a00640 1 -- 172.21.15.12:0/2354128338 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0035030 con 0x7fe1ec103ff0 2024-09-05T01:28:11.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.407+0000 7fe1f4800640 1 -- 172.21.15.12:0/2354128338 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1ec110570 con 0x7fe1ec103ff0 2024-09-05T01:28:11.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.407+0000 7fe1f4800640 1 -- 172.21.15.12:0/2354128338 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1ec1ab530 con 0x7fe1ec103ff0 2024-09-05T01:28:11.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.411+0000 7fe1e6a00640 1 -- 172.21.15.12:0/2354128338 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fe1e0042070 con 0x7fe1ec103ff0 2024-09-05T01:28:11.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.411+0000 7fe1f71e4740 1 Processor -- start 2024-09-05T01:28:11.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.411+0000 7fe1f71e4740 1 -- start start 2024-09-05T01:28:11.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.412+0000 7fe1f71e4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b4c82cc70 0x556b4c82d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:11.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.412+0000 7fe1f71e4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b4c82d590 0x556b4c837910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:11.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.412+0000 7fe1f71e4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b4c837e50 0x556b4c83a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:11.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.412+0000 7fe1f71e4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556b4c7933e0 con 0x556b4c82cc70 2024-09-05T01:28:11.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.412+0000 7fe1f71e4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x556b4c73ad80 con 0x556b4c82d590 2024-09-05T01:28:11.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.412+0000 7fe1f71e4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556b4c78f3a0 con 0x556b4c837e50 2024-09-05T01:28:11.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.412+0000 7fe1f2800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b4c82cc70 0x556b4c82d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:11.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.412+0000 7fe1f1e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b4c82d590 0x556b4c837910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:11.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.412+0000 7fe1f2800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b4c82cc70 0x556b4c82d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57734/0 (socket says 172.21.15.12:57734) 2024-09-05T01:28:11.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.412+0000 7fe1f2800640 1 -- 172.21.15.12:0/2859209320 learned_addr learned my addr 172.21.15.12:0/2859209320 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:11.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.413+0000 7fe1e6a00640 1 --2- 172.21.15.12:0/2354128338 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe1d40a2d70 0x7fe1d40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:11.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.413+0000 7fe1f1400640 1 --2- 172.21.15.12:0/2859209320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b4c837e50 0x556b4c83a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:11.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.413+0000 7fe1f2800640 1 -- 172.21.15.12:0/2859209320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b4c837e50 msgr2=0x556b4c83a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:11.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.413+0000 7fe1e6a00640 1 -- 172.21.15.12:0/2354128338 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fe1e00ef740 con 0x7fe1ec103ff0 2024-09-05T01:28:11.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.413+0000 7fe1f2800640 1 --2- 172.21.15.12:0/2859209320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b4c837e50 0x556b4c83a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.413+0000 7fe1f2800640 1 -- 172.21.15.12:0/2859209320 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b4c82d590 msgr2=0x556b4c837910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:11.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.413+0000 7fe1f2800640 1 --2- 172.21.15.12:0/2859209320 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b4c82d590 0x556b4c837910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.413+0000 7fe1f2800640 1 -- 172.21.15.12:0/2859209320 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b4c759ae0 con 0x556b4c82cc70 2024-09-05T01:28:11.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.413+0000 7fe1f1400640 1 --2- 172.21.15.12:0/2859209320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b4c837e50 0x556b4c83a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:28:11.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.413+0000 7fe1f2800640 1 --2- 172.21.15.12:0/2354128338 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe1d40a2d70 0x7fe1d40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:11.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.414+0000 7fe1f2800640 1 --2- 172.21.15.12:0/2859209320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b4c82cc70 0x556b4c82d050 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8011590 tx=0x7fe1e8011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e4ccf2c705ff9e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:11.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.414+0000 7fe1db000640 1 -- 172.21.15.12:0/2859209320 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8017050 con 0x556b4c82cc70 2024-09-05T01:28:11.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.414+0000 7fe1f2800640 1 --2- 172.21.15.12:0/2354128338 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe1d40a2d70 0x7fe1d40a5230 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8022000 tx=0x7fe1e8023000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:11.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.414+0000 7fe1db000640 1 -- 172.21.15.12:0/2859209320 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1e801bb90 con 0x556b4c82cc70 2024-09-05T01:28:11.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.414+0000 7fe1db000640 1 -- 172.21.15.12:0/2859209320 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e801a360 con 0x556b4c82cc70 2024-09-05T01:28:11.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.415+0000 7fe1f71e4740 1 -- 172.21.15.12:0/2859209320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b4c82cc70 msgr2=0x556b4c82d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:11.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.415+0000 7fe1f71e4740 1 --2- 172.21.15.12:0/2859209320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b4c82cc70 0x556b4c82d050 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8011590 tx=0x7fe1e8011a50 comp rx=0 tx=0).stop 2024-09-05T01:28:11.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.415+0000 7fe1f71e4740 1 -- 172.21.15.12:0/2859209320 shutdown_connections 2024-09-05T01:28:11.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.415+0000 7fe1f71e4740 1 --2- 172.21.15.12:0/2859209320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b4c837e50 0x556b4c83a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.415+0000 7fe1f71e4740 1 --2- 172.21.15.12:0/2859209320 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b4c82d590 0x556b4c837910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.415+0000 7fe1f71e4740 1 --2- 172.21.15.12:0/2859209320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b4c82cc70 0x556b4c82d050 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.415+0000 7fe1f71e4740 1 -- 172.21.15.12:0/2859209320 >> 172.21.15.12:0/2859209320 conn(0x556b4c829200 msgr2=0x556b4c8295e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:11.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.415+0000 7fe1f71e4740 1 -- 172.21.15.12:0/2859209320 shutdown_connections 2024-09-05T01:28:11.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.416+0000 7fe1f71e4740 1 -- 172.21.15.12:0/2859209320 wait complete. 2024-09-05T01:28:11.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.416+0000 7fe1f71e4740 1 -- start start 2024-09-05T01:28:11.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.416+0000 7fe1f71e4740 1 Processor -- start 2024-09-05T01:28:11.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.417+0000 7fe1f71e4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b4c82cc70 0x556b4c834d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:11.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.417+0000 7fe1f71e4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b4c82d590 0x556b4c835290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:11.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.417+0000 7fe1f71e4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b4c837e50 0x556b4c8357d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:11.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.417+0000 7fe1f71e4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556b4c83aa20 con 0x556b4c82cc70 2024-09-05T01:28:11.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.417+0000 7fe1f71e4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x556b4c74e0f0 con 0x556b4c82d590 2024-09-05T01:28:11.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.417+0000 7fe1f71e4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556b4c83aba0 con 0x556b4c837e50 2024-09-05T01:28:11.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.417+0000 7fe1f71e4740 10 client.0 _ll_register_callbacks cb 0x556b4c735bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:28:11.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.417+0000 7fe1f1400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b4c82d590 0x556b4c835290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:11.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.417+0000 7fe1f1400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b4c82d590 0x556b4c835290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:43820/0 (socket says 172.21.15.12:43820) 2024-09-05T01:28:11.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.417+0000 7fe1f1400640 1 -- 172.21.15.12:0/370236081 learned_addr learned my addr 172.21.15.12:0/370236081 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:11.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.417+0000 7fe1f2800640 1 --2- 172.21.15.12:0/370236081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b4c837e50 0x556b4c8357d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:11.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.417+0000 7fe1f1e00640 1 --2- 172.21.15.12:0/370236081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b4c82cc70 0x556b4c834d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:11.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.417+0000 7fe1f1400640 1 -- 172.21.15.12:0/370236081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b4c837e50 msgr2=0x556b4c8357d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:11.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.417+0000 7fe1f1400640 1 --2- 172.21.15.12:0/370236081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b4c837e50 0x556b4c8357d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.417+0000 7fe1f1400640 1 -- 172.21.15.12:0/370236081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b4c82cc70 msgr2=0x556b4c834d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:11.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.417+0000 7fe1f1400640 1 --2- 172.21.15.12:0/370236081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b4c82cc70 0x556b4c834d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.417+0000 7fe1f1400640 1 -- 172.21.15.12:0/370236081 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b4c5043c0 con 0x556b4c82d590 2024-09-05T01:28:11.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.418+0000 7fe1f1e00640 1 --2- 172.21.15.12:0/370236081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b4c82cc70 0x556b4c834d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:28:11.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.418+0000 7fe1f1400640 1 --2- 172.21.15.12:0/370236081 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b4c82d590 0x556b4c835290 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc013540 tx=0x7fe1dc013a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5aa896b0f9d985c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:11.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.418+0000 7fe1cf400640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:28:11.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.418+0000 7fe1cf400640 1 -- 172.21.15.12:0/370236081 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc011b30 con 0x556b4c82d590 2024-09-05T01:28:11.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.418+0000 7fe1f71e4740 1 -- 172.21.15.12:0/370236081 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1e801bb90 con 0x556b4c82d590 2024-09-05T01:28:11.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.418+0000 7fe1cf400640 1 -- 172.21.15.12:0/370236081 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fe1dc011cd0 con 0x556b4c82d590 2024-09-05T01:28:11.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.419+0000 7fe1cf400640 1 -- 172.21.15.12:0/370236081 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe1dc00f430 con 0x556b4c82d590 2024-09-05T01:28:11.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.419+0000 7fe1f71e4740 10 client.25808 fetch_fsmap learned FSMap version 34 2024-09-05T01:28:11.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.419+0000 7fe1f71e4740 1 -- 172.21.15.12:0/370236081 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556b4c846b20 con 0x556b4c82d590 2024-09-05T01:28:11.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.419+0000 7fe1cf400640 1 -- 172.21.15.12:0/370236081 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1e801bb90 con 0x556b4c82d590 2024-09-05T01:28:11.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.419+0000 7fe1cf400640 1 -- 172.21.15.12:0/370236081 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 34) ==== 8410+0+0 (secure 0 0 0) 0x7fe1dc025710 con 0x556b4c82d590 2024-09-05T01:28:11.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.419+0000 7fe1f71e4740 10 client.25808 fetch_fsmap finished waiting for FSMap version 34 2024-09-05T01:28:11.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.419+0000 7fe1f71e4740 10 client.25808 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:28:11.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.419+0000 7fe1f71e4740 20 client.25808 populate_metadata read hostname 'smithi012' 2024-09-05T01:28:11.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.419+0000 7fe1f71e4740 1 --2- 172.21.15.12:0/370236081 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x556b4c847f80 0x556b4c84a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:11.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.419+0000 7fe1f71e4740 4 client.25808 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:28:11.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.419+0000 7fe1f71e4740 1 -- 172.21.15.12:0/370236081 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b4c7a0950 con 0x556b4c847f80 2024-09-05T01:28:11.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.420+0000 7fe1f1e00640 1 --2- 172.21.15.12:0/370236081 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x556b4c847f80 0x556b4c84a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:11.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.420+0000 7fe1f1e00640 1 --2- 172.21.15.12:0/370236081 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x556b4c847f80 0x556b4c84a3f0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9044332519e51738 server_cookie=8496d54d02c262ce in_seq=0 out_seq=0 2024-09-05T01:28:11.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.420+0000 7fe1cf400640 10 client.25808 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:28:11.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.421+0000 7fe1cf400640 1 -- 172.21.15.12:0/370236081 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556b4c7a0950 con 0x556b4c847f80 2024-09-05T01:28:11.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.421+0000 7fe1cf400640 10 client.25808 handle_command_reply: tid=0 2024-09-05T01:28:11.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.421+0000 7fe1f71e4740 1 client.25808 shutdown 2024-09-05T01:28:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.421+0000 7fe1f71e4740 1 -- 172.21.15.12:0/370236081 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b4c82d590 msgr2=0x556b4c835290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.421+0000 7fe1f71e4740 1 --2- 172.21.15.12:0/370236081 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b4c82d590 0x556b4c835290 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc013540 tx=0x7fe1dc013a00 comp rx=0 tx=0).stop 2024-09-05T01:28:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.421+0000 7fe1f71e4740 1 -- 172.21.15.12:0/370236081 shutdown_connections 2024-09-05T01:28:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.421+0000 7fe1f71e4740 1 --2- 172.21.15.12:0/370236081 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x556b4c847f80 0x556b4c84a3f0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.421+0000 7fe1f71e4740 1 --2- 172.21.15.12:0/370236081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b4c837e50 0x556b4c8357d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.421+0000 7fe1f71e4740 1 --2- 172.21.15.12:0/370236081 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b4c82d590 0x556b4c835290 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.421+0000 7fe1f71e4740 1 --2- 172.21.15.12:0/370236081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b4c82cc70 0x556b4c834d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.421+0000 7fe1f71e4740 1 -- 172.21.15.12:0/370236081 >> 172.21.15.12:0/370236081 conn(0x556b4c829200 msgr2=0x556b4c82ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.421+0000 7fe1cf400640 0 client.25808 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:28:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.422+0000 7fe1f71e4740 1 -- 172.21.15.12:0/370236081 shutdown_connections 2024-09-05T01:28:11.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.422+0000 7fe1f71e4740 1 -- 172.21.15.12:0/370236081 wait complete. 2024-09-05T01:28:11.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.422+0000 7fe1f71e4740 20 client.25808 trim_cache size 0 max 16384 2024-09-05T01:28:11.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.435+0000 7fe1f71e4740 1 Processor -- start 2024-09-05T01:28:11.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.436+0000 7fe1f71e4740 1 -- start start 2024-09-05T01:28:11.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.436+0000 7fe1f71e4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b4c82cc70 0x556b4c82f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:11.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.436+0000 7fe1f71e4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b4c82d590 0x556b4c84fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:11.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.436+0000 7fe1f71e4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b4c837e50 0x556b4c850240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:11.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.436+0000 7fe1f71e4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec1b3ee0 con 0x556b4c82cc70 2024-09-05T01:28:11.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.436+0000 7fe1f71e4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec1b5ba0 con 0x556b4c837e50 2024-09-05T01:28:11.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.436+0000 7fe1f71e4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec1b45b0 con 0x556b4c82d590 2024-09-05T01:28:11.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.436+0000 7fe1f2800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b4c837e50 0x556b4c850240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:11.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.436+0000 7fe1f2800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b4c837e50 0x556b4c850240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:43832/0 (socket says 172.21.15.12:43832) 2024-09-05T01:28:11.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.436+0000 7fe1f1400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b4c82d590 0x556b4c84fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:11.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.436+0000 7fe1f2800640 1 -- 172.21.15.12:0/1537980979 learned_addr learned my addr 172.21.15.12:0/1537980979 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:11.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.437+0000 7fe1f1e00640 1 --2- 172.21.15.12:0/1537980979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b4c82cc70 0x556b4c82f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:11.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.437+0000 7fe1f1400640 1 -- 172.21.15.12:0/1537980979 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b4c837e50 msgr2=0x556b4c850240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:11.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.437+0000 7fe1f1400640 1 --2- 172.21.15.12:0/1537980979 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b4c837e50 0x556b4c850240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.437+0000 7fe1f1400640 1 -- 172.21.15.12:0/1537980979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b4c82cc70 msgr2=0x556b4c82f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:11.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.437+0000 7fe1f1400640 1 --2- 172.21.15.12:0/1537980979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b4c82cc70 0x556b4c82f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.437+0000 7fe1f1400640 1 -- 172.21.15.12:0/1537980979 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b4c824770 con 0x556b4c82d590 2024-09-05T01:28:11.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.437+0000 7fe1f2800640 1 --2- 172.21.15.12:0/1537980979 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b4c837e50 0x556b4c850240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:28:11.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.437+0000 7fe1f1400640 1 --2- 172.21.15.12:0/1537980979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b4c82d590 0x556b4c84fd00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc025cf0 tx=0x7fe1dc009be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9415e5a682daf912 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:11.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.437+0000 7fe1da600640 1 -- 172.21.15.12:0/1537980979 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc025610 con 0x556b4c82d590 2024-09-05T01:28:11.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.437+0000 7fe1da600640 1 -- 172.21.15.12:0/1537980979 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1dc005850 con 0x556b4c82d590 2024-09-05T01:28:11.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.437+0000 7fe1da600640 1 -- 172.21.15.12:0/1537980979 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc00fc50 con 0x556b4c82d590 2024-09-05T01:28:11.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.438+0000 7fe1f71e4740 1 -- 172.21.15.12:0/1537980979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b4c82d590 msgr2=0x556b4c84fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:11.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.438+0000 7fe1f71e4740 1 --2- 172.21.15.12:0/1537980979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b4c82d590 0x556b4c84fd00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc025cf0 tx=0x7fe1dc009be0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.438+0000 7fe1f71e4740 1 -- 172.21.15.12:0/1537980979 shutdown_connections 2024-09-05T01:28:11.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.438+0000 7fe1f71e4740 1 --2- 172.21.15.12:0/1537980979 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b4c837e50 0x556b4c850240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.438+0000 7fe1f71e4740 1 --2- 172.21.15.12:0/1537980979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b4c82d590 0x556b4c84fd00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.438+0000 7fe1f71e4740 1 --2- 172.21.15.12:0/1537980979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b4c82cc70 0x556b4c82f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.438+0000 7fe1f71e4740 1 -- 172.21.15.12:0/1537980979 >> 172.21.15.12:0/1537980979 conn(0x556b4c829200 msgr2=0x556b4c836dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:11.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.439+0000 7fe1f71e4740 1 -- 172.21.15.12:0/1537980979 shutdown_connections 2024-09-05T01:28:11.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.439+0000 7fe1f71e4740 1 -- 172.21.15.12:0/1537980979 wait complete. 2024-09-05T01:28:11.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.439+0000 7fe1f71e4740 1 -- start start 2024-09-05T01:28:11.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.439+0000 7fe1f71e4740 1 Processor -- start 2024-09-05T01:28:11.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.440+0000 7fe1f71e4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b4c82cc70 0x556b4c83c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:11.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.440+0000 7fe1f71e4740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b4c82d590 0x556b4c83c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:11.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.440+0000 7fe1f71e4740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b4c837e50 0x556b4c8b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:11.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.440+0000 7fe1f71e4740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec1b5410 con 0x556b4c837e50 2024-09-05T01:28:11.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.440+0000 7fe1f71e4740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec1b4d40 con 0x556b4c82d590 2024-09-05T01:28:11.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.440+0000 7fe1f71e4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec1b1ec0 con 0x556b4c82cc70 2024-09-05T01:28:11.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.440+0000 7fe1f71e4740 10 client.0 _ll_register_callbacks cb 0x7fe1dc009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:28:11.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.440+0000 7fe1f1e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b4c82cc70 0x556b4c83c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:11.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.440+0000 7fe1f1e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b4c82cc70 0x556b4c83c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:38604/0 (socket says 172.21.15.12:38604) 2024-09-05T01:28:11.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.440+0000 7fe1f1e00640 1 -- 172.21.15.12:0/3250976365 learned_addr learned my addr 172.21.15.12:0/3250976365 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:11.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.440+0000 7fe1f1400640 1 --2- 172.21.15.12:0/3250976365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b4c82d590 0x556b4c83c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:11.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.440+0000 7fe1f2800640 1 --2- 172.21.15.12:0/3250976365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b4c837e50 0x556b4c8b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:11.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.440+0000 7fe1f1e00640 1 -- 172.21.15.12:0/3250976365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b4c82d590 msgr2=0x556b4c83c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:11.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.440+0000 7fe1f1e00640 1 --2- 172.21.15.12:0/3250976365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b4c82d590 0x556b4c83c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.440+0000 7fe1f1e00640 1 -- 172.21.15.12:0/3250976365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b4c837e50 msgr2=0x556b4c8b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:11.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.440+0000 7fe1f1e00640 1 --2- 172.21.15.12:0/3250976365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b4c837e50 0x556b4c8b1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.441+0000 7fe1f1e00640 1 -- 172.21.15.12:0/3250976365 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b4c829e90 con 0x556b4c82cc70 2024-09-05T01:28:11.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.441+0000 7fe1f2800640 1 --2- 172.21.15.12:0/3250976365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b4c837e50 0x556b4c8b1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:28:11.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.441+0000 7fe1f1e00640 1 --2- 172.21.15.12:0/3250976365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b4c82cc70 0x556b4c83c220 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00bbc40 tx=0x7fe1e00b8080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=896219986976c80c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:11.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.441+0000 7fe1cf400640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:28:11.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.441+0000 7fe1cf400640 1 -- 172.21.15.12:0/3250976365 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0049040 con 0x556b4c82cc70 2024-09-05T01:28:11.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.441+0000 7fe1cf400640 1 -- 172.21.15.12:0/3250976365 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fe1e00b8320 con 0x556b4c82cc70 2024-09-05T01:28:11.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.441+0000 7fe1f71e4740 1 -- 172.21.15.12:0/3250976365 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1dc005850 con 0x556b4c82cc70 2024-09-05T01:28:11.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.442+0000 7fe1cf400640 1 -- 172.21.15.12:0/3250976365 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe1e00bc3b0 con 0x556b4c82cc70 2024-09-05T01:28:11.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.442+0000 7fe1f71e4740 10 client.25804 fetch_fsmap learned FSMap version 34 2024-09-05T01:28:11.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.442+0000 7fe1f71e4740 1 -- 172.21.15.12:0/3250976365 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556b4c82a2b0 con 0x556b4c82cc70 2024-09-05T01:28:11.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.442+0000 7fe1cf400640 1 -- 172.21.15.12:0/3250976365 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1dc005850 con 0x556b4c82cc70 2024-09-05T01:28:11.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.442+0000 7fe1cf400640 1 -- 172.21.15.12:0/3250976365 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 34) ==== 8410+0+0 (secure 0 0 0) 0x7fe1e004c060 con 0x556b4c82cc70 2024-09-05T01:28:11.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.442+0000 7fe1f71e4740 10 client.25804 fetch_fsmap finished waiting for FSMap version 34 2024-09-05T01:28:11.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.442+0000 7fe1f71e4740 10 client.25804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:28:11.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.442+0000 7fe1f71e4740 20 client.25804 populate_metadata read hostname 'smithi012' 2024-09-05T01:28:11.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.442+0000 7fe1f71e4740 1 --2- 172.21.15.12:0/3250976365 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x556b4c8b38a0 0x556b4c8b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:11.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.442+0000 7fe1f71e4740 4 client.25804 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:28:11.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.442+0000 7fe1f71e4740 1 -- 172.21.15.12:0/3250976365 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556b4c79ae60 con 0x556b4c8b38a0 2024-09-05T01:28:11.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.443+0000 7fe1f1400640 1 --2- 172.21.15.12:0/3250976365 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x556b4c8b38a0 0x556b4c8b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:11.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.443+0000 7fe1f1400640 1 --2- 172.21.15.12:0/3250976365 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x556b4c8b38a0 0x556b4c8b5cc0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3116e92f69f36be2 server_cookie=cbe7c9e38d5327e8 in_seq=0 out_seq=0 2024-09-05T01:28:11.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.443+0000 7fe1cf400640 10 client.25804 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:28:11.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.444+0000 7fe1cf400640 1 -- 172.21.15.12:0/3250976365 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556b4c79ae60 con 0x556b4c8b38a0 2024-09-05T01:28:11.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.444+0000 7fe1cf400640 10 client.25804 handle_command_reply: tid=0 2024-09-05T01:28:11.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.444+0000 7fe1f71e4740 1 client.25804 shutdown 2024-09-05T01:28:11.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.444+0000 7fe1f71e4740 1 -- 172.21.15.12:0/3250976365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b4c82cc70 msgr2=0x556b4c83c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:11.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.444+0000 7fe1f71e4740 1 --2- 172.21.15.12:0/3250976365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b4c82cc70 0x556b4c83c220 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00bbc40 tx=0x7fe1e00b8080 comp rx=0 tx=0).stop 2024-09-05T01:28:11.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.444+0000 7fe1f71e4740 1 -- 172.21.15.12:0/3250976365 shutdown_connections 2024-09-05T01:28:11.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.444+0000 7fe1f71e4740 1 --2- 172.21.15.12:0/3250976365 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x556b4c8b38a0 0x556b4c8b5cc0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.444+0000 7fe1f71e4740 1 --2- 172.21.15.12:0/3250976365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556b4c837e50 0x556b4c8b1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.444+0000 7fe1f71e4740 1 --2- 172.21.15.12:0/3250976365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556b4c82d590 0x556b4c83c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.444+0000 7fe1f71e4740 1 --2- 172.21.15.12:0/3250976365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b4c82cc70 0x556b4c83c220 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.444+0000 7fe1f71e4740 1 -- 172.21.15.12:0/3250976365 >> 172.21.15.12:0/3250976365 conn(0x556b4c829200 msgr2=0x556b4c834cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:11.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.444+0000 7fe1cf400640 0 client.25804 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:28:11.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.444+0000 7fe1f71e4740 1 -- 172.21.15.12:0/3250976365 shutdown_connections 2024-09-05T01:28:11.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.444+0000 7fe1f71e4740 1 -- 172.21.15.12:0/3250976365 wait complete. 2024-09-05T01:28:11.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.445+0000 7fe1f71e4740 20 client.25804 trim_cache size 0 max 16384 2024-09-05T01:28:11.449 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:28:11.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.445+0000 7fe1f4800640 1 -- 172.21.15.12:0/2354128338 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe1d40a2d70 msgr2=0x7fe1d40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:11.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.445+0000 7fe1f4800640 1 --2- 172.21.15.12:0/2354128338 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe1d40a2d70 0x7fe1d40a5230 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8022000 tx=0x7fe1e8023000 comp rx=0 tx=0).stop 2024-09-05T01:28:11.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.445+0000 7fe1f4800640 1 -- 172.21.15.12:0/2354128338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1ec103ff0 msgr2=0x7fe1ec1a4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:11.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.445+0000 7fe1f4800640 1 --2- 172.21.15.12:0/2354128338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1ec103ff0 0x7fe1ec1a4760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0004770 tx=0x7fe1e0003c10 comp rx=0 tx=0).stop 2024-09-05T01:28:11.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.445+0000 7fe1f4800640 1 -- 172.21.15.12:0/2354128338 shutdown_connections 2024-09-05T01:28:11.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.445+0000 7fe1f4800640 1 --2- 172.21.15.12:0/2354128338 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe1d40a2d70 0x7fe1d40a5230 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.445+0000 7fe1f4800640 1 --2- 172.21.15.12:0/2354128338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1ec109120 0x7fe1ec10fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.445+0000 7fe1f4800640 1 --2- 172.21.15.12:0/2354128338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1ec1049a0 0x7fe1ec1a4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.445+0000 7fe1f4800640 1 --2- 172.21.15.12:0/2354128338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe1ec103ff0 0x7fe1ec1a4760 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:11.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.445+0000 7fe1f4800640 1 -- 172.21.15.12:0/2354128338 >> 172.21.15.12:0/2354128338 conn(0x7fe1ec0ffa90 msgr2=0x7fe1ec101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:11.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.446+0000 7fe1f4800640 1 -- 172.21.15.12:0/2354128338 shutdown_connections 2024-09-05T01:28:11.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:11.446+0000 7fe1f4800640 1 -- 172.21.15.12:0/2354128338 wait complete. 2024-09-05T01:28:13.321 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:12 smithi012 ceph-mon[29942]: pgmap v108: 97 pgs: 97 active+clean; 797 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.4 MiB/s wr, 166 op/s 2024-09-05T01:28:13.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:12 smithi145 ceph-mon[34376]: pgmap v108: 97 pgs: 97 active+clean; 797 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.4 MiB/s wr, 166 op/s 2024-09-05T01:28:13.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:12 smithi151 ceph-mon[35013]: pgmap v108: 97 pgs: 97 active+clean; 797 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.4 MiB/s wr, 166 op/s 2024-09-05T01:28:13.405 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-05T01:28:13.406 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-05T01:28:15.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:14 smithi145 ceph-mon[34376]: pgmap v109: 97 pgs: 97 active+clean; 811 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.6 MiB/s wr, 191 op/s 2024-09-05T01:28:15.339 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:14 smithi012 ceph-mon[29942]: pgmap v109: 97 pgs: 97 active+clean; 811 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.6 MiB/s wr, 191 op/s 2024-09-05T01:28:15.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:14 smithi151 ceph-mon[35013]: pgmap v109: 97 pgs: 97 active+clean; 811 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.6 MiB/s wr, 191 op/s 2024-09-05T01:28:16.968 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:16 smithi012 ceph-mon[29942]: pgmap v110: 97 pgs: 97 active+clean; 811 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 55 op/s 2024-09-05T01:28:17.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:16 smithi145 ceph-mon[34376]: pgmap v110: 97 pgs: 97 active+clean; 811 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 55 op/s 2024-09-05T01:28:17.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:16 smithi151 ceph-mon[35013]: pgmap v110: 97 pgs: 97 active+clean; 811 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 55 op/s 2024-09-05T01:28:18.346 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:28:19.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:18 smithi012 ceph-mon[29942]: pgmap v111: 97 pgs: 97 active+clean; 838 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.3 MiB/s wr, 168 op/s 2024-09-05T01:28:19.193 INFO:tasks.workunit.client.0.smithi012.stdout: 293 420844 2125 305184 2042 75332 938 2024-09-05T01:28:19.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:18 smithi145 ceph-mon[34376]: pgmap v111: 97 pgs: 97 active+clean; 838 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.3 MiB/s wr, 168 op/s 2024-09-05T01:28:19.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:18 smithi151 ceph-mon[35013]: pgmap v111: 97 pgs: 97 active+clean; 838 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.3 MiB/s wr, 168 op/s 2024-09-05T01:28:21.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:20.997+0000 7f5b4f800640 1 -- 172.21.15.12:0/1310325970 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b4806e4f0 msgr2=0x7f5b4806e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:21.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:20.997+0000 7f5b4f800640 1 --2- 172.21.15.12:0/1310325970 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b4806e4f0 0x7f5b4806e8d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009860 tx=0x7f5b3002a380 comp rx=0 tx=0).stop 2024-09-05T01:28:21.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:20.997+0000 7f5b4f800640 1 -- 172.21.15.12:0/1310325970 shutdown_connections 2024-09-05T01:28:21.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:20.997+0000 7f5b4f800640 1 --2- 172.21.15.12:0/1310325970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b48114ab0 0x7f5b48116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:20.997+0000 7f5b4f800640 1 --2- 172.21.15.12:0/1310325970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b4806ee10 0x7f5b48114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:20.997+0000 7f5b4f800640 1 --2- 172.21.15.12:0/1310325970 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b4806e4f0 0x7f5b4806e8d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:20.997+0000 7f5b4f800640 1 -- 172.21.15.12:0/1310325970 >> 172.21.15.12:0/1310325970 conn(0x7f5b48073210 msgr2=0x7f5b48073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:21.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:20.997+0000 7f5b4f800640 1 -- 172.21.15.12:0/1310325970 shutdown_connections 2024-09-05T01:28:21.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:20.997+0000 7f5b4f800640 1 -- 172.21.15.12:0/1310325970 wait complete. 2024-09-05T01:28:21.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.000+0000 7f5b4f800640 1 Processor -- start 2024-09-05T01:28:21.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.001+0000 7f5b4f800640 1 -- start start 2024-09-05T01:28:21.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.003+0000 7f5b4f800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b4806e4f0 0x7f5b481a8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:21.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.003+0000 7f5b4f800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b4806ee10 0x7f5b481a8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:21.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.004+0000 7f5b47e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b4806ee10 0x7f5b481a8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:21.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.004+0000 7f5b47e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b4806ee10 0x7f5b481a8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50136/0 (socket says 172.21.15.12:50136) 2024-09-05T01:28:21.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.004+0000 7f5b4ce00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b4806e4f0 0x7f5b481a8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:21.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.004+0000 7f5b4ce00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b4806e4f0 0x7f5b481a8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:38086/0 (socket says 172.21.15.12:38086) 2024-09-05T01:28:21.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.005+0000 7f5b47e00640 1 -- 172.21.15.12:0/400111042 learned_addr learned my addr 172.21.15.12:0/400111042 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:21.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.005+0000 7f5b4f800640 1 --2- 172.21.15.12:0/400111042 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b48114ab0 0x7f5b481a2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:21.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.005+0000 7f5b4f800640 1 -- 172.21.15.12:0/400111042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5b4811c920 con 0x7f5b4806ee10 2024-09-05T01:28:21.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.005+0000 7f5b4f800640 1 -- 172.21.15.12:0/400111042 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5b4811c7a0 con 0x7f5b48114ab0 2024-09-05T01:28:21.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.005+0000 7f5b4f800640 1 -- 172.21.15.12:0/400111042 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5b4811caa0 con 0x7f5b4806e4f0 2024-09-05T01:28:21.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.006+0000 7f5b4d800640 1 --2- 172.21.15.12:0/400111042 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b48114ab0 0x7f5b481a2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:21.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.007+0000 7f5b47e00640 1 -- 172.21.15.12:0/400111042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b4806e4f0 msgr2=0x7f5b481a8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:21.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.007+0000 7f5b47e00640 1 --2- 172.21.15.12:0/400111042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b4806e4f0 0x7f5b481a8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.007+0000 7f5b47e00640 1 -- 172.21.15.12:0/400111042 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b48114ab0 msgr2=0x7f5b481a2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:21.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.007+0000 7f5b47e00640 1 --2- 172.21.15.12:0/400111042 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b48114ab0 0x7f5b481a2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.007+0000 7f5b47e00640 1 -- 172.21.15.12:0/400111042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b481a3380 con 0x7f5b4806ee10 2024-09-05T01:28:21.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.008+0000 7f5b47e00640 1 --2- 172.21.15.12:0/400111042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b4806ee10 0x7f5b481a8f80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5b3800c670 tx=0x7f5b3800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:21.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.009+0000 7f5b45600640 1 -- 172.21.15.12:0/400111042 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b3801b070 con 0x7f5b4806ee10 2024-09-05T01:28:21.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.009+0000 7f5b45600640 1 -- 172.21.15.12:0/400111042 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b3800bdc0 con 0x7f5b4806ee10 2024-09-05T01:28:21.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.009+0000 7f5b45600640 1 -- 172.21.15.12:0/400111042 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b38016c60 con 0x7f5b4806ee10 2024-09-05T01:28:21.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.010+0000 7f5b4f800640 1 -- 172.21.15.12:0/400111042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b481a3670 con 0x7f5b4806ee10 2024-09-05T01:28:21.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.010+0000 7f5b4f800640 1 -- 172.21.15.12:0/400111042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b481af7f0 con 0x7f5b4806ee10 2024-09-05T01:28:21.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.034+0000 7f5b52434740 1 Processor -- start 2024-09-05T01:28:21.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.034+0000 7f5b52434740 1 -- start start 2024-09-05T01:28:21.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.035+0000 7f5b45600640 1 -- 172.21.15.12:0/400111042 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f5b3801e070 con 0x7f5b4806ee10 2024-09-05T01:28:21.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.036+0000 7f5b52434740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a294c0 0x564229a298a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:21.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.036+0000 7f5b52434740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564229a29de0 0x564229a34160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:21.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.036+0000 7f5b52434740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a346a0 0x564229a36a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:21.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.036+0000 7f5b52434740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564229987290 con 0x564229a29de0 2024-09-05T01:28:21.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.036+0000 7f5b52434740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56422992eb40 con 0x564229a294c0 2024-09-05T01:28:21.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.036+0000 7f5b52434740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564229983250 con 0x564229a346a0 2024-09-05T01:28:21.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.037+0000 7f5b4d800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a294c0 0x564229a298a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:21.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.037+0000 7f5b4ce00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564229a29de0 0x564229a34160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:21.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.038+0000 7f5b4d800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a294c0 0x564229a298a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:36228/0 (socket says 172.21.15.12:36228) 2024-09-05T01:28:21.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.038+0000 7f5b4d800640 1 -- 172.21.15.12:0/1869448892 learned_addr learned my addr 172.21.15.12:0/1869448892 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:21.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.038+0000 7f5b47e00640 1 --2- 172.21.15.12:0/1869448892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a346a0 0x564229a36a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:21.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.038+0000 7f5b45600640 1 --2- 172.21.15.12:0/400111042 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5b2c0a2e40 0x7f5b2c0a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:21.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.039+0000 7f5b4d800640 1 -- 172.21.15.12:0/1869448892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a346a0 msgr2=0x564229a36a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:21.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.039+0000 7f5b4d800640 1 --2- 172.21.15.12:0/1869448892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a346a0 0x564229a36a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.039+0000 7f5b4d800640 1 -- 172.21.15.12:0/1869448892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564229a29de0 msgr2=0x564229a34160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:21.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.039+0000 7f5b4d800640 1 --2- 172.21.15.12:0/1869448892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564229a29de0 0x564229a34160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.039+0000 7f5b4d800640 1 -- 172.21.15.12:0/1869448892 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642296f86a0 con 0x564229a294c0 2024-09-05T01:28:21.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.040+0000 7f5b4ce00640 1 --2- 172.21.15.12:0/1869448892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564229a29de0 0x564229a34160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:28:21.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.040+0000 7f5b47e00640 1 --2- 172.21.15.12:0/1869448892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a346a0 0x564229a36a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:28:21.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.040+0000 7f5b4d800640 1 --2- 172.21.15.12:0/400111042 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5b2c0a2e40 0x7f5b2c0a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:21.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.041+0000 7f5b45600640 1 -- 172.21.15.12:0/400111042 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f5b38016e00 con 0x7f5b4806ee10 2024-09-05T01:28:21.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.041+0000 7f5b4d800640 1 --2- 172.21.15.12:0/1869448892 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a294c0 0x564229a298a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5b4000cd10 tx=0x7f5b4000e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f552ddb65175836 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:21.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.042+0000 7f5b3e000640 1 -- 172.21.15.12:0/1869448892 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b40022070 con 0x564229a294c0 2024-09-05T01:28:21.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.042+0000 7f5b3e000640 1 -- 172.21.15.12:0/1869448892 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b4001c470 con 0x564229a294c0 2024-09-05T01:28:21.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.042+0000 7f5b3e000640 1 -- 172.21.15.12:0/1869448892 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b4001a660 con 0x564229a294c0 2024-09-05T01:28:21.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.042+0000 7f5b4d800640 1 --2- 172.21.15.12:0/400111042 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5b2c0a2e40 0x7f5b2c0a5300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5b4001f000 tx=0x7f5b40020000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:21.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.043+0000 7f5b52434740 1 -- 172.21.15.12:0/1869448892 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a294c0 msgr2=0x564229a298a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:21.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.043+0000 7f5b52434740 1 --2- 172.21.15.12:0/1869448892 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a294c0 0x564229a298a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5b4000cd10 tx=0x7f5b4000e720 comp rx=0 tx=0).stop 2024-09-05T01:28:21.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.044+0000 7f5b52434740 1 -- 172.21.15.12:0/1869448892 shutdown_connections 2024-09-05T01:28:21.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.044+0000 7f5b52434740 1 --2- 172.21.15.12:0/1869448892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a346a0 0x564229a36a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.044+0000 7f5b52434740 1 --2- 172.21.15.12:0/1869448892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564229a29de0 0x564229a34160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.044+0000 7f5b52434740 1 --2- 172.21.15.12:0/1869448892 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a294c0 0x564229a298a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.044+0000 7f5b52434740 1 -- 172.21.15.12:0/1869448892 >> 172.21.15.12:0/1869448892 conn(0x564229a25a50 msgr2=0x564229a25e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:21.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.044+0000 7f5b52434740 1 -- 172.21.15.12:0/1869448892 shutdown_connections 2024-09-05T01:28:21.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.044+0000 7f5b52434740 1 -- 172.21.15.12:0/1869448892 wait complete. 2024-09-05T01:28:21.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.045+0000 7f5b52434740 1 -- start start 2024-09-05T01:28:21.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.045+0000 7f5b52434740 1 Processor -- start 2024-09-05T01:28:21.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.047+0000 7f5b52434740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a294c0 0x564229a33ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:21.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.047+0000 7f5b52434740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564229a29de0 0x564229a31190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:21.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.047+0000 7f5b52434740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a346a0 0x564229a316d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:21.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.048+0000 7f5b4d800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a346a0 0x564229a316d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:21.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.048+0000 7f5b4d800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a346a0 0x564229a316d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:38100/0 (socket says 172.21.15.12:38100) 2024-09-05T01:28:21.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.048+0000 7f5b4d800640 1 -- 172.21.15.12:0/3840416665 learned_addr learned my addr 172.21.15.12:0/3840416665 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:21.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.047+0000 7f5b4ce00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a294c0 0x564229a33ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:21.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.048+0000 7f5b52434740 1 -- 172.21.15.12:0/3840416665 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564229a37310 con 0x564229a29de0 2024-09-05T01:28:21.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.048+0000 7f5b52434740 1 -- 172.21.15.12:0/3840416665 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x564229941fa0 con 0x564229a294c0 2024-09-05T01:28:21.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.048+0000 7f5b52434740 1 -- 172.21.15.12:0/3840416665 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564229a37490 con 0x564229a346a0 2024-09-05T01:28:21.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.048+0000 7f5b52434740 10 client.0 _ll_register_callbacks cb 0x564229695ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:28:21.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.049+0000 7f5b4d800640 1 -- 172.21.15.12:0/3840416665 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a294c0 msgr2=0x564229a33ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:21.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.049+0000 7f5b4d800640 1 --2- 172.21.15.12:0/3840416665 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a294c0 0x564229a33ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.049+0000 7f5b4d800640 1 -- 172.21.15.12:0/3840416665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564229a29de0 msgr2=0x564229a31190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:28:21.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.050+0000 7f5b47e00640 1 --2- 172.21.15.12:0/3840416665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564229a29de0 0x564229a31190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:21.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.050+0000 7f5b4d800640 1 --2- 172.21.15.12:0/3840416665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564229a29de0 0x564229a31190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.050+0000 7f5b4d800640 1 -- 172.21.15.12:0/3840416665 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564229a31ed0 con 0x564229a346a0 2024-09-05T01:28:21.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.050+0000 7f5b4ce00640 1 --2- 172.21.15.12:0/3840416665 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a294c0 0x564229a33ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:28:21.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.050+0000 7f5b47e00640 1 --2- 172.21.15.12:0/3840416665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564229a29de0 0x564229a31190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:28:21.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.051+0000 7f5b4d800640 1 --2- 172.21.15.12:0/3840416665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a346a0 0x564229a316d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5b4001cd50 tx=0x7f5b4000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a29f89faa6003f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:21.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.051+0000 7f5b36a00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:28:21.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.052+0000 7f5b36a00640 1 -- 172.21.15.12:0/3840416665 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b40022040 con 0x564229a346a0 2024-09-05T01:28:21.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.052+0000 7f5b36a00640 1 -- 172.21.15.12:0/3840416665 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f5b40011a40 con 0x564229a346a0 2024-09-05T01:28:21.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.054+0000 7f5b52434740 1 -- 172.21.15.12:0/3840416665 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b4001c470 con 0x564229a346a0 2024-09-05T01:28:21.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.054+0000 7f5b36a00640 1 -- 172.21.15.12:0/3840416665 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5b40004600 con 0x564229a346a0 2024-09-05T01:28:21.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.054+0000 7f5b52434740 10 client.25813 fetch_fsmap learned FSMap version 34 2024-09-05T01:28:21.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.055+0000 7f5b52434740 1 -- 172.21.15.12:0/3840416665 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564229a430a0 con 0x564229a346a0 2024-09-05T01:28:21.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.055+0000 7f5b36a00640 1 -- 172.21.15.12:0/3840416665 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b4001c470 con 0x564229a346a0 2024-09-05T01:28:21.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.056+0000 7f5b36a00640 1 -- 172.21.15.12:0/3840416665 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 34) ==== 8410+0+0 (secure 0 0 0) 0x7f5b40019040 con 0x564229a346a0 2024-09-05T01:28:21.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.056+0000 7f5b52434740 10 client.25813 fetch_fsmap finished waiting for FSMap version 34 2024-09-05T01:28:21.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.056+0000 7f5b52434740 10 client.25813 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:28:21.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.056+0000 7f5b52434740 20 client.25813 populate_metadata read hostname 'smithi012' 2024-09-05T01:28:21.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.056+0000 7f5b52434740 1 --2- 172.21.15.12:0/3840416665 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x564229a44450 0x564229a46840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:21.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.056+0000 7f5b52434740 4 client.25813 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:28:21.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.056+0000 7f5b52434740 1 -- 172.21.15.12:0/3840416665 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564229994800 con 0x564229a44450 2024-09-05T01:28:21.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.056+0000 7f5b4ce00640 1 --2- 172.21.15.12:0/3840416665 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x564229a44450 0x564229a46840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:21.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.057+0000 7f5b4ce00640 1 --2- 172.21.15.12:0/3840416665 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x564229a44450 0x564229a46840 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c4893e3b0a97f1b server_cookie=b2684c3a712abc9a in_seq=0 out_seq=0 2024-09-05T01:28:21.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.057+0000 7f5b36a00640 10 client.25813 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:28:21.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.058+0000 7f5b36a00640 1 -- 172.21.15.12:0/3840416665 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564229994800 con 0x564229a44450 2024-09-05T01:28:21.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.058+0000 7f5b36a00640 10 client.25813 handle_command_reply: tid=0 2024-09-05T01:28:21.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.058+0000 7f5b52434740 1 client.25813 shutdown 2024-09-05T01:28:21.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.059+0000 7f5b52434740 1 -- 172.21.15.12:0/3840416665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a346a0 msgr2=0x564229a316d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:21.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.059+0000 7f5b52434740 1 --2- 172.21.15.12:0/3840416665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a346a0 0x564229a316d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5b4001cd50 tx=0x7f5b4000eef0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.059+0000 7f5b52434740 1 -- 172.21.15.12:0/3840416665 shutdown_connections 2024-09-05T01:28:21.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.059+0000 7f5b52434740 1 --2- 172.21.15.12:0/3840416665 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x564229a44450 0x564229a46840 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.059+0000 7f5b52434740 1 --2- 172.21.15.12:0/3840416665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a346a0 0x564229a316d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.059+0000 7f5b52434740 1 --2- 172.21.15.12:0/3840416665 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564229a29de0 0x564229a31190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.059+0000 7f5b36a00640 0 client.25813 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:28:21.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.059+0000 7f5b52434740 1 --2- 172.21.15.12:0/3840416665 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a294c0 0x564229a33ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.059+0000 7f5b52434740 1 -- 172.21.15.12:0/3840416665 >> 172.21.15.12:0/3840416665 conn(0x564229a25a50 msgr2=0x564229a2b780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:21.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.059+0000 7f5b52434740 1 -- 172.21.15.12:0/3840416665 shutdown_connections 2024-09-05T01:28:21.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.060+0000 7f5b52434740 1 -- 172.21.15.12:0/3840416665 wait complete. 2024-09-05T01:28:21.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.060+0000 7f5b52434740 20 client.25813 trim_cache size 0 max 16384 2024-09-05T01:28:21.151 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:20 smithi012 ceph-mon[29942]: pgmap v112: 97 pgs: 97 active+clean; 851 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.8 MiB/s wr, 180 op/s 2024-09-05T01:28:21.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.133+0000 7f5b52434740 1 Processor -- start 2024-09-05T01:28:21.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.137+0000 7f5b52434740 1 -- start start 2024-09-05T01:28:21.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.137+0000 7f5b52434740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564229a25a50 0x564229a4c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:21.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.137+0000 7f5b52434740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a294c0 0x564229a4c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:21.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.137+0000 7f5b52434740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a29de0 0x564229a3c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:21.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.137+0000 7f5b52434740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5b481b3d20 con 0x564229a25a50 2024-09-05T01:28:21.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.137+0000 7f5b52434740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5b481b59e0 con 0x564229a294c0 2024-09-05T01:28:21.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.137+0000 7f5b52434740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5b481b43f0 con 0x564229a29de0 2024-09-05T01:28:21.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.138+0000 7f5b47e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a294c0 0x564229a4c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:21.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.138+0000 7f5b47e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a294c0 0x564229a4c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:36246/0 (socket says 172.21.15.12:36246) 2024-09-05T01:28:21.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.139+0000 7f5b47e00640 1 -- 172.21.15.12:0/2595967236 learned_addr learned my addr 172.21.15.12:0/2595967236 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:21.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.138+0000 7f5b4ce00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564229a25a50 0x564229a4c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:21.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.138+0000 7f5b4d800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a29de0 0x564229a3c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:21.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.140+0000 7f5b4d800640 1 -- 172.21.15.12:0/2595967236 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a294c0 msgr2=0x564229a4c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:21.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.140+0000 7f5b4d800640 1 --2- 172.21.15.12:0/2595967236 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a294c0 0x564229a4c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.140+0000 7f5b4d800640 1 -- 172.21.15.12:0/2595967236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564229a25a50 msgr2=0x564229a4c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:21.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.140+0000 7f5b4d800640 1 --2- 172.21.15.12:0/2595967236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564229a25a50 0x564229a4c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.140+0000 7f5b4d800640 1 -- 172.21.15.12:0/2595967236 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564229a29c10 con 0x564229a29de0 2024-09-05T01:28:21.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.141+0000 7f5b4d800640 1 --2- 172.21.15.12:0/2595967236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a29de0 0x564229a3c6d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5b4001cda0 tx=0x7f5b4000c5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eebb4c335a262867 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:21.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.141+0000 7f5b3d600640 1 -- 172.21.15.12:0/2595967236 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b40022040 con 0x564229a29de0 2024-09-05T01:28:21.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.141+0000 7f5b3d600640 1 -- 172.21.15.12:0/2595967236 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b4001c470 con 0x564229a29de0 2024-09-05T01:28:21.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.141+0000 7f5b3d600640 1 -- 172.21.15.12:0/2595967236 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b40022040 con 0x564229a29de0 2024-09-05T01:28:21.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.142+0000 7f5b52434740 1 -- 172.21.15.12:0/2595967236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a29de0 msgr2=0x564229a3c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:21.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.142+0000 7f5b52434740 1 --2- 172.21.15.12:0/2595967236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a29de0 0x564229a3c6d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5b4001cda0 tx=0x7f5b4000c5d0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.144+0000 7f5b52434740 1 -- 172.21.15.12:0/2595967236 shutdown_connections 2024-09-05T01:28:21.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.144+0000 7f5b52434740 1 --2- 172.21.15.12:0/2595967236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a29de0 0x564229a3c6d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.144+0000 7f5b52434740 1 --2- 172.21.15.12:0/2595967236 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a294c0 0x564229a4c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.144+0000 7f5b52434740 1 --2- 172.21.15.12:0/2595967236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564229a25a50 0x564229a4c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.144+0000 7f5b52434740 1 -- 172.21.15.12:0/2595967236 >> 172.21.15.12:0/2595967236 conn(0x564229a31830 msgr2=0x564229a33210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:21.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.144+0000 7f5b52434740 1 -- 172.21.15.12:0/2595967236 shutdown_connections 2024-09-05T01:28:21.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.145+0000 7f5b52434740 1 -- 172.21.15.12:0/2595967236 wait complete. 2024-09-05T01:28:21.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.145+0000 7f5b52434740 1 -- start start 2024-09-05T01:28:21.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.145+0000 7f5b52434740 1 Processor -- start 2024-09-05T01:28:21.169 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:28:21.169 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-05T01:28:21.169 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "ec8faade-15a6-4469-9bed-86ac7a518efa", 2024-09-05T01:28:21.170 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-05T01:28:21.170 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:28:21.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.147+0000 7f5b52434740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a25a50 0x564229a385e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:21.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.147+0000 7f5b52434740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a294c0 0x564229a38b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:21.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.147+0000 7f5b4ce00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a25a50 0x564229a385e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:21.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.147+0000 7f5b52434740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564229a29de0 0x564229a39060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:21.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.147+0000 7f5b4ce00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a25a50 0x564229a385e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:36262/0 (socket says 172.21.15.12:36262) 2024-09-05T01:28:21.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.148+0000 7f5b4ce00640 1 -- 172.21.15.12:0/3695147810 learned_addr learned my addr 172.21.15.12:0/3695147810 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:21.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.148+0000 7f5b52434740 1 -- 172.21.15.12:0/3695147810 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5b481b5250 con 0x564229a29de0 2024-09-05T01:28:21.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.148+0000 7f5b52434740 1 -- 172.21.15.12:0/3695147810 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5b481b4b80 con 0x564229a25a50 2024-09-05T01:28:21.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.148+0000 7f5b52434740 1 -- 172.21.15.12:0/3695147810 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5b481b1d20 con 0x564229a294c0 2024-09-05T01:28:21.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.148+0000 7f5b47e00640 1 --2- 172.21.15.12:0/3695147810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a294c0 0x564229a38b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:21.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.148+0000 7f5b4d800640 1 --2- 172.21.15.12:0/3695147810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564229a29de0 0x564229a39060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:21.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.148+0000 7f5b52434740 10 client.0 _ll_register_callbacks cb 0x7f5b40020070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:28:21.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.149+0000 7f5b47e00640 1 -- 172.21.15.12:0/3695147810 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a25a50 msgr2=0x564229a385e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:21.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.149+0000 7f5b47e00640 1 --2- 172.21.15.12:0/3695147810 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a25a50 0x564229a385e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.149+0000 7f5b47e00640 1 -- 172.21.15.12:0/3695147810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564229a29de0 msgr2=0x564229a39060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:21.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.149+0000 7f5b47e00640 1 --2- 172.21.15.12:0/3695147810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564229a29de0 0x564229a39060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.149+0000 7f5b47e00640 1 -- 172.21.15.12:0/3695147810 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564229aae190 con 0x564229a294c0 2024-09-05T01:28:21.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.149+0000 7f5b47e00640 1 --2- 172.21.15.12:0/3695147810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a294c0 0x564229a38b20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5b38097ca0 tx=0x7f5b3809b380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f6ab94251a748a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:21.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.149+0000 7f5b36a00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:28:21.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.149+0000 7f5b36a00640 1 -- 172.21.15.12:0/3695147810 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b380b3020 con 0x564229a294c0 2024-09-05T01:28:21.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.150+0000 7f5b36a00640 1 -- 172.21.15.12:0/3695147810 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f5b3809cb70 con 0x564229a294c0 2024-09-05T01:28:21.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.150+0000 7f5b52434740 1 -- 172.21.15.12:0/3695147810 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b4001c470 con 0x564229a294c0 2024-09-05T01:28:21.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.150+0000 7f5b36a00640 1 -- 172.21.15.12:0/3695147810 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5b380ccef0 con 0x564229a294c0 2024-09-05T01:28:21.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.150+0000 7f5b52434740 10 client.25819 fetch_fsmap learned FSMap version 34 2024-09-05T01:28:21.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.150+0000 7f5b52434740 1 -- 172.21.15.12:0/3695147810 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564229aaf490 con 0x564229a294c0 2024-09-05T01:28:21.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.150+0000 7f5b36a00640 1 -- 172.21.15.12:0/3695147810 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b4001c470 con 0x564229a294c0 2024-09-05T01:28:21.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.150+0000 7f5b36a00640 1 -- 172.21.15.12:0/3695147810 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 34) ==== 8410+0+0 (secure 0 0 0) 0x7f5b3800b040 con 0x564229a294c0 2024-09-05T01:28:21.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.151+0000 7f5b52434740 10 client.25819 fetch_fsmap finished waiting for FSMap version 34 2024-09-05T01:28:21.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.151+0000 7f5b52434740 10 client.25819 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:28:21.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.151+0000 7f5b52434740 20 client.25819 populate_metadata read hostname 'smithi012' 2024-09-05T01:28:21.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.151+0000 7f5b52434740 1 --2- 172.21.15.12:0/3695147810 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x564229a346a0 0x564229ab1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:21.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.151+0000 7f5b52434740 4 client.25819 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-05T01:28:21.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.151+0000 7f5b52434740 1 -- 172.21.15.12:0/3695147810 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56422998ed10 con 0x564229a346a0 2024-09-05T01:28:21.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.151+0000 7f5b4ce00640 1 --2- 172.21.15.12:0/3695147810 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x564229a346a0 0x564229ab1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:21.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.152+0000 7f5b4ce00640 1 --2- 172.21.15.12:0/3695147810 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x564229a346a0 0x564229ab1d10 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f95f53afdd6c82a server_cookie=451e5a2f82edadba in_seq=0 out_seq=0 2024-09-05T01:28:21.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.152+0000 7f5b36a00640 10 client.25819 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:28:21.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.153+0000 7f5b36a00640 1 -- 172.21.15.12:0/3695147810 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56422998ed10 con 0x564229a346a0 2024-09-05T01:28:21.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.153+0000 7f5b36a00640 10 client.25819 handle_command_reply: tid=0 2024-09-05T01:28:21.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.154+0000 7f5b52434740 1 client.25819 shutdown 2024-09-05T01:28:21.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.156+0000 7f5b52434740 1 -- 172.21.15.12:0/3695147810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a294c0 msgr2=0x564229a38b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:21.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.156+0000 7f5b52434740 1 --2- 172.21.15.12:0/3695147810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a294c0 0x564229a38b20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5b38097ca0 tx=0x7f5b3809b380 comp rx=0 tx=0).stop 2024-09-05T01:28:21.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.156+0000 7f5b52434740 1 -- 172.21.15.12:0/3695147810 shutdown_connections 2024-09-05T01:28:21.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.156+0000 7f5b52434740 1 --2- 172.21.15.12:0/3695147810 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x564229a346a0 0x564229ab1d10 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.156+0000 7f5b52434740 1 --2- 172.21.15.12:0/3695147810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564229a29de0 0x564229a39060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.156+0000 7f5b52434740 1 --2- 172.21.15.12:0/3695147810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564229a294c0 0x564229a38b20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.156+0000 7f5b52434740 1 --2- 172.21.15.12:0/3695147810 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x564229a25a50 0x564229a385e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.156+0000 7f5b36a00640 0 client.25819 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:28:21.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.156+0000 7f5b52434740 1 -- 172.21.15.12:0/3695147810 >> 172.21.15.12:0/3695147810 conn(0x564229a31830 msgr2=0x564229a329f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:21.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.156+0000 7f5b52434740 1 -- 172.21.15.12:0/3695147810 shutdown_connections 2024-09-05T01:28:21.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.156+0000 7f5b52434740 1 -- 172.21.15.12:0/3695147810 wait complete. 2024-09-05T01:28:21.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.157+0000 7f5b52434740 20 client.25819 trim_cache size 0 max 16384 2024-09-05T01:28:21.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.158+0000 7f5b4f800640 1 -- 172.21.15.12:0/400111042 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5b2c0a2e40 msgr2=0x7f5b2c0a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:21.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.158+0000 7f5b4f800640 1 --2- 172.21.15.12:0/400111042 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5b2c0a2e40 0x7f5b2c0a5300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5b4001f000 tx=0x7f5b40020000 comp rx=0 tx=0).stop 2024-09-05T01:28:21.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.158+0000 7f5b4f800640 1 -- 172.21.15.12:0/400111042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b4806ee10 msgr2=0x7f5b481a8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:21.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.158+0000 7f5b4f800640 1 --2- 172.21.15.12:0/400111042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b4806ee10 0x7f5b481a8f80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5b3800c670 tx=0x7f5b3800cb30 comp rx=0 tx=0).stop 2024-09-05T01:28:21.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.158+0000 7f5b4f800640 1 -- 172.21.15.12:0/400111042 shutdown_connections 2024-09-05T01:28:21.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.158+0000 7f5b4f800640 1 --2- 172.21.15.12:0/400111042 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5b2c0a2e40 0x7f5b2c0a5300 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.158+0000 7f5b4f800640 1 --2- 172.21.15.12:0/400111042 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5b48114ab0 0x7f5b481a2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.158+0000 7f5b4f800640 1 --2- 172.21.15.12:0/400111042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b4806ee10 0x7f5b481a8f80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.158+0000 7f5b4f800640 1 --2- 172.21.15.12:0/400111042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b4806e4f0 0x7f5b481a8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:21.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.158+0000 7f5b4f800640 1 -- 172.21.15.12:0/400111042 >> 172.21.15.12:0/400111042 conn(0x7f5b48073210 msgr2=0x7f5b4806b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:21.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.158+0000 7f5b4f800640 1 -- 172.21.15.12:0/400111042 shutdown_connections 2024-09-05T01:28:21.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:21.158+0000 7f5b4f800640 1 -- 172.21.15.12:0/400111042 wait complete. 2024-09-05T01:28:21.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:20 smithi145 ceph-mon[34376]: pgmap v112: 97 pgs: 97 active+clean; 851 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.8 MiB/s wr, 180 op/s 2024-09-05T01:28:21.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:20 smithi151 ceph-mon[35013]: pgmap v112: 97 pgs: 97 active+clean; 851 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.8 MiB/s wr, 180 op/s 2024-09-05T01:28:22.007 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:22 smithi012 ceph-mon[29942]: scrub queued for path: / 2024-09-05T01:28:22.007 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:22 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:22.007 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:22 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:22.007 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:22 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:22.007 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:22 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:22.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:22 smithi145 ceph-mon[34376]: scrub queued for path: / 2024-09-05T01:28:22.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:22 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:22.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:22 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:22.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:22 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:22.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:22 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:22.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:22 smithi151 ceph-mon[35013]: scrub queued for path: / 2024-09-05T01:28:22.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:22 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:22.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:22 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:22.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:22 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:22.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:22 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:23.021 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:23 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:23.021 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:23 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:23.021 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:23 smithi012 ceph-mon[29942]: pgmap v113: 97 pgs: 97 active+clean; 851 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.8 MiB/s wr, 177 op/s 2024-09-05T01:28:23.207 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T01:28:23.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:23 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:23.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:23 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:23.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:23 smithi145 ceph-mon[34376]: pgmap v113: 97 pgs: 97 active+clean; 851 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.8 MiB/s wr, 177 op/s 2024-09-05T01:28:23.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:23 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:23.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:23 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:23.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:23 smithi151 ceph-mon[35013]: pgmap v113: 97 pgs: 97 active+clean; 851 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.8 MiB/s wr, 177 op/s 2024-09-05T01:28:25.041 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:25 smithi012 ceph-mon[29942]: pgmap v114: 97 pgs: 97 active+clean; 958 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 14 MiB/s wr, 614 op/s 2024-09-05T01:28:25.197 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:28:25.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:25 smithi145 ceph-mon[34376]: pgmap v114: 97 pgs: 97 active+clean; 958 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 14 MiB/s wr, 614 op/s 2024-09-05T01:28:25.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:25 smithi151 ceph-mon[35013]: pgmap v114: 97 pgs: 97 active+clean; 958 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 14 MiB/s wr, 614 op/s 2024-09-05T01:28:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.980+0000 7f8c88c00640 1 -- 172.21.15.12:0/1563816494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c84108e00 msgr2=0x7f8c8410ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.980+0000 7f8c88c00640 1 --2- 172.21.15.12:0/1563816494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c84108e00 0x7f8c8410ce00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009900 tx=0x7f8c7402a440 comp rx=0 tx=0).stop 2024-09-05T01:28:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.980+0000 7f8c88c00640 1 -- 172.21.15.12:0/1563816494 shutdown_connections 2024-09-05T01:28:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.980+0000 7f8c88c00640 1 --2- 172.21.15.12:0/1563816494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c8410d530 0x7f8c841150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.980+0000 7f8c88c00640 1 --2- 172.21.15.12:0/1563816494 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c84108e00 0x7f8c8410ce00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.980+0000 7f8c88c00640 1 --2- 172.21.15.12:0/1563816494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c84108450 0x7f8c84108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.980+0000 7f8c88c00640 1 -- 172.21.15.12:0/1563816494 >> 172.21.15.12:0/1563816494 conn(0x7f8c84077ba0 msgr2=0x7f8c84079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.981+0000 7f8c88c00640 1 -- 172.21.15.12:0/1563816494 shutdown_connections 2024-09-05T01:28:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.981+0000 7f8c88c00640 1 -- 172.21.15.12:0/1563816494 wait complete. 2024-09-05T01:28:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.982+0000 7f8c88c00640 1 Processor -- start 2024-09-05T01:28:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.983+0000 7f8c88c00640 1 -- start start 2024-09-05T01:28:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.984+0000 7f8c88c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c84108450 0x7f8c840737a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.984+0000 7f8c81e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c84108450 0x7f8c840737a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.985+0000 7f8c81e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c84108450 0x7f8c840737a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:36272/0 (socket says 172.21.15.12:36272) 2024-09-05T01:28:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.985+0000 7f8c88c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c84108e00 0x7f8c84073ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:25.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.985+0000 7f8c81e00640 1 -- 172.21.15.12:0/529835816 learned_addr learned my addr 172.21.15.12:0/529835816 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:25.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.985+0000 7f8c88c00640 1 --2- 172.21.15.12:0/529835816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c8410d530 0x7f8c8406c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:25.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.986+0000 7f8c88c00640 1 -- 172.21.15.12:0/529835816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8c84118580 con 0x7f8c84108e00 2024-09-05T01:28:25.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.986+0000 7f8c82800640 1 --2- 172.21.15.12:0/529835816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c8410d530 0x7f8c8406c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:25.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.986+0000 7f8c88c00640 1 -- 172.21.15.12:0/529835816 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8c84118400 con 0x7f8c84108450 2024-09-05T01:28:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.986+0000 7f8c88c00640 1 -- 172.21.15.12:0/529835816 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8c84118700 con 0x7f8c8410d530 2024-09-05T01:28:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.987+0000 7f8c81400640 1 --2- 172.21.15.12:0/529835816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c84108e00 0x7f8c84073ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:25.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.987+0000 7f8c82800640 1 -- 172.21.15.12:0/529835816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c84108450 msgr2=0x7f8c840737a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:25.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.987+0000 7f8c82800640 1 --2- 172.21.15.12:0/529835816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c84108450 0x7f8c840737a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:25.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.987+0000 7f8c82800640 1 -- 172.21.15.12:0/529835816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c84108e00 msgr2=0x7f8c84073ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:25.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.987+0000 7f8c82800640 1 --2- 172.21.15.12:0/529835816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c84108e00 0x7f8c84073ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:25.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.987+0000 7f8c82800640 1 -- 172.21.15.12:0/529835816 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8406d0d0 con 0x7f8c8410d530 2024-09-05T01:28:25.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.988+0000 7f8c82800640 1 --2- 172.21.15.12:0/529835816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c8410d530 0x7f8c8406c830 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c005fd0 tx=0x7f8c7c00ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:25.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.988+0000 7f8c81e00640 1 --2- 172.21.15.12:0/529835816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c84108450 0x7f8c840737a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:28:25.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.989+0000 7f8c7aa00640 1 -- 172.21.15.12:0/529835816 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c00cd80 con 0x7f8c8410d530 2024-09-05T01:28:25.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.989+0000 7f8c7aa00640 1 -- 172.21.15.12:0/529835816 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c7c005020 con 0x7f8c8410d530 2024-09-05T01:28:25.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.989+0000 7f8c7aa00640 1 -- 172.21.15.12:0/529835816 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c010690 con 0x7f8c8410d530 2024-09-05T01:28:25.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.989+0000 7f8c88c00640 1 -- 172.21.15.12:0/529835816 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c8406d3c0 con 0x7f8c8410d530 2024-09-05T01:28:25.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.989+0000 7f8c88c00640 1 -- 172.21.15.12:0/529835816 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c840714a0 con 0x7f8c8410d530 2024-09-05T01:28:26.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.999+0000 7f8c8b7cb740 1 Processor -- start 2024-09-05T01:28:26.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:25.999+0000 7f8c7aa00640 1 -- 172.21.15.12:0/529835816 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f8c7c0051d0 con 0x7f8c8410d530 2024-09-05T01:28:26.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.002+0000 7f8c7aa00640 1 --2- 172.21.15.12:0/529835816 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8c680a2e40 0x7f8c680a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:26.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.003+0000 7f8c8b7cb740 1 -- start start 2024-09-05T01:28:26.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.003+0000 7f8c8b7cb740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad98d8bb90 0x55ad98d8bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:26.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.003+0000 7f8c8b7cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad98d8c4b0 0x55ad98d96830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:26.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.003+0000 7f8c8b7cb740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d96d70 0x55ad98d99160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:26.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.003+0000 7f8c8b7cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ad98cf23e0 con 0x55ad98d8c4b0 2024-09-05T01:28:26.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.003+0000 7f8c8b7cb740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55ad98c99d80 con 0x55ad98d96d70 2024-09-05T01:28:26.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.004+0000 7f8c8b7cb740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ad98cee3a0 con 0x55ad98d8bb90 2024-09-05T01:28:26.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.004+0000 7f8c81400640 1 --2- 172.21.15.12:0/529835816 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8c680a2e40 0x7f8c680a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:26.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.005+0000 7f8c82800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d96d70 0x55ad98d99160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:26.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.005+0000 7f8c82800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d96d70 0x55ad98d99160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:36286/0 (socket says 172.21.15.12:36286) 2024-09-05T01:28:26.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.005+0000 7f8c82800640 1 -- 172.21.15.12:0/2696843336 learned_addr learned my addr 172.21.15.12:0/2696843336 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:26.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.006+0000 7f8c81e00640 1 --2- 172.21.15.12:0/2696843336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad98d8bb90 0x55ad98d8bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.006+0000 7f8c82800640 1 -- 172.21.15.12:0/2696843336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad98d8bb90 msgr2=0x55ad98d8bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.006+0000 7f8c82800640 1 --2- 172.21.15.12:0/2696843336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad98d8bb90 0x55ad98d8bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.006+0000 7f8c82800640 1 -- 172.21.15.12:0/2696843336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad98d8c4b0 msgr2=0x55ad98d96830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.006+0000 7f8c82800640 1 --2- 172.21.15.12:0/2696843336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad98d8c4b0 0x55ad98d96830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.006+0000 7f8c82800640 1 -- 172.21.15.12:0/2696843336 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad98cb8ae0 con 0x55ad98d96d70 2024-09-05T01:28:26.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.006+0000 7f8c82800640 1 --2- 172.21.15.12:0/2696843336 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d96d70 0x55ad98d99160 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c098fd0 tx=0x7f8c7c0a1220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3da486ab027930f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:26.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.007+0000 7f8c7aa00640 1 -- 172.21.15.12:0/529835816 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f8c7c099df0 con 0x7f8c8410d530 2024-09-05T01:28:26.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.007+0000 7f8c6f000640 1 -- 172.21.15.12:0/2696843336 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c098780 con 0x55ad98d96d70 2024-09-05T01:28:26.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.007+0000 7f8c6f000640 1 -- 172.21.15.12:0/2696843336 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c7c01ee50 con 0x55ad98d96d70 2024-09-05T01:28:26.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.007+0000 7f8c6f000640 1 -- 172.21.15.12:0/2696843336 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c098920 con 0x55ad98d96d70 2024-09-05T01:28:26.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.008+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/2696843336 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d96d70 msgr2=0x55ad98d99160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:26.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.008+0000 7f8c8b7cb740 1 --2- 172.21.15.12:0/2696843336 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d96d70 0x55ad98d99160 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c098fd0 tx=0x7f8c7c0a1220 comp rx=0 tx=0).stop 2024-09-05T01:28:26.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.009+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/2696843336 shutdown_connections 2024-09-05T01:28:26.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.009+0000 7f8c8b7cb740 1 --2- 172.21.15.12:0/2696843336 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d96d70 0x55ad98d99160 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.009+0000 7f8c8b7cb740 1 --2- 172.21.15.12:0/2696843336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad98d8c4b0 0x55ad98d96830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.009+0000 7f8c8b7cb740 1 --2- 172.21.15.12:0/2696843336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad98d8bb90 0x55ad98d8bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.009+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/2696843336 >> 172.21.15.12:0/2696843336 conn(0x55ad98d88120 msgr2=0x55ad98d88500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:26.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.016+0000 7f8c81400640 1 --2- 172.21.15.12:0/529835816 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8c680a2e40 0x7f8c680a5300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55ad98d88f80 tx=0x7f8c7400b040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:26.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.017+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/2696843336 shutdown_connections 2024-09-05T01:28:26.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.017+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/2696843336 wait complete. 2024-09-05T01:28:26.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.019+0000 7f8c8b7cb740 1 -- start start 2024-09-05T01:28:26.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.019+0000 7f8c8b7cb740 1 Processor -- start 2024-09-05T01:28:26.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.023+0000 7f8c8b7cb740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad98d8bb90 0x55ad98d93e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.023+0000 7f8c8b7cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad98d96d70 0x55ad98d94350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.023+0000 7f8c8b7cb740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d94890 0x55ad98db3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.024+0000 7f8c81e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad98d8bb90 0x55ad98d93e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.024+0000 7f8c8b7cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ad98daa960 con 0x55ad98d96d70 2024-09-05T01:28:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.024+0000 7f8c8b7cb740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55ad98cad0f0 con 0x55ad98d94890 2024-09-05T01:28:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.024+0000 7f8c8b7cb740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ad98daaae0 con 0x55ad98d8bb90 2024-09-05T01:28:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.024+0000 7f8c81e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad98d8bb90 0x55ad98d93e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:38154/0 (socket says 172.21.15.12:38154) 2024-09-05T01:28:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.024+0000 7f8c81e00640 1 -- 172.21.15.12:0/3212957033 learned_addr learned my addr 172.21.15.12:0/3212957033 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.024+0000 7f8c8b7cb740 10 client.0 _ll_register_callbacks cb 0x55ad98c9e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:28:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.024+0000 7f8c82800640 1 --2- 172.21.15.12:0/3212957033 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d94890 0x55ad98db3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.024+0000 7f8c82800640 1 -- 172.21.15.12:0/3212957033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad98d8bb90 msgr2=0x55ad98d93e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.024+0000 7f8c82800640 1 --2- 172.21.15.12:0/3212957033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad98d8bb90 0x55ad98d93e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.024+0000 7f8c82800640 1 -- 172.21.15.12:0/3212957033 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad98d96d70 msgr2=0x55ad98d94350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:26.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.024+0000 7f8c82800640 1 --2- 172.21.15.12:0/3212957033 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad98d96d70 0x55ad98d94350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.024+0000 7f8c82800640 1 -- 172.21.15.12:0/3212957033 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad98a633c0 con 0x55ad98d94890 2024-09-05T01:28:26.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.025+0000 7f8c63400640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:28:26.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.025+0000 7f8c82800640 1 --2- 172.21.15.12:0/3212957033 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d94890 0x55ad98db3dd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c01f000 tx=0x7f8c7c00ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bef8e84092f5af server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:26.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.027+0000 7f8c63400640 1 -- 172.21.15.12:0/3212957033 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c0a9060 con 0x55ad98d94890 2024-09-05T01:28:26.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.027+0000 7f8c63400640 1 -- 172.21.15.12:0/3212957033 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f8c7c005500 con 0x55ad98d94890 2024-09-05T01:28:26.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.027+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/3212957033 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c7c01ee50 con 0x55ad98d94890 2024-09-05T01:28:26.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.027+0000 7f8c63400640 1 -- 172.21.15.12:0/3212957033 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8c7c0a9060 con 0x55ad98d94890 2024-09-05T01:28:26.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.028+0000 7f8c8b7cb740 10 client.25841 fetch_fsmap learned FSMap version 34 2024-09-05T01:28:26.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.028+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/3212957033 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ad98db6bb0 con 0x55ad98d94890 2024-09-05T01:28:26.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.028+0000 7f8c63400640 1 -- 172.21.15.12:0/3212957033 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c7c01ee50 con 0x55ad98d94890 2024-09-05T01:28:26.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.030+0000 7f8c63400640 1 -- 172.21.15.12:0/3212957033 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 34) ==== 8410+0+0 (secure 0 0 0) 0x7f8c7c097e20 con 0x55ad98d94890 2024-09-05T01:28:26.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.032+0000 7f8c8b7cb740 10 client.25841 fetch_fsmap finished waiting for FSMap version 34 2024-09-05T01:28:26.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.032+0000 7f8c8b7cb740 10 client.25841 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:28:26.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.032+0000 7f8c8b7cb740 20 client.25841 populate_metadata read hostname 'smithi012' 2024-09-05T01:28:26.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.032+0000 7f8c8b7cb740 1 --2- 172.21.15.12:0/3212957033 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ad98db7f00 0x55ad98dba2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:26.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.032+0000 7f8c8b7cb740 4 client.25841 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:28:26.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.032+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/3212957033 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad98cff950 con 0x55ad98db7f00 2024-09-05T01:28:26.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.032+0000 7f8c81e00640 1 --2- 172.21.15.12:0/3212957033 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ad98db7f00 0x55ad98dba2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:26.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.036+0000 7f8c81e00640 1 --2- 172.21.15.12:0/3212957033 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ad98db7f00 0x55ad98dba2f0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13d30e7d3b6cbec4 server_cookie=9a2fa83ef4e148e9 in_seq=0 out_seq=0 2024-09-05T01:28:26.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.036+0000 7f8c63400640 10 client.25841 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:28:26.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.038+0000 7f8c63400640 1 -- 172.21.15.12:0/3212957033 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ad98cff950 con 0x55ad98db7f00 2024-09-05T01:28:26.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.038+0000 7f8c63400640 10 client.25841 handle_command_reply: tid=0 2024-09-05T01:28:26.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.038+0000 7f8c8b7cb740 1 client.25841 shutdown 2024-09-05T01:28:26.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.039+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/3212957033 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d94890 msgr2=0x55ad98db3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:26.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.039+0000 7f8c8b7cb740 1 --2- 172.21.15.12:0/3212957033 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d94890 0x55ad98db3dd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c01f000 tx=0x7f8c7c00ef90 comp rx=0 tx=0).stop 2024-09-05T01:28:26.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.039+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/3212957033 shutdown_connections 2024-09-05T01:28:26.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.039+0000 7f8c8b7cb740 1 --2- 172.21.15.12:0/3212957033 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ad98db7f00 0x55ad98dba2f0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.040+0000 7f8c8b7cb740 1 --2- 172.21.15.12:0/3212957033 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d94890 0x55ad98db3dd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.040+0000 7f8c63400640 0 client.25841 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:28:26.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.040+0000 7f8c8b7cb740 1 --2- 172.21.15.12:0/3212957033 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad98d96d70 0x55ad98d94350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.040+0000 7f8c8b7cb740 1 --2- 172.21.15.12:0/3212957033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad98d8bb90 0x55ad98d93e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.040+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/3212957033 >> 172.21.15.12:0/3212957033 conn(0x55ad98d88120 msgr2=0x55ad98d8de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:26.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.044+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/3212957033 shutdown_connections 2024-09-05T01:28:26.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.044+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/3212957033 wait complete. 2024-09-05T01:28:26.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.044+0000 7f8c8b7cb740 20 client.25841 trim_cache size 0 max 16384 2024-09-05T01:28:26.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.104+0000 7f8c8b7cb740 1 Processor -- start 2024-09-05T01:28:26.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.104+0000 7f8c8b7cb740 1 -- start start 2024-09-05T01:28:26.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.105+0000 7f8c8b7cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad98d8bb90 0x55ad98d96140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:26.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.105+0000 7f8c8b7cb740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad98d94890 0x55ad98db3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:26.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.105+0000 7f8c8b7cb740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d96d70 0x55ad98dbd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:26.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.105+0000 7f8c8b7cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8c84082630 con 0x55ad98d8bb90 2024-09-05T01:28:26.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.105+0000 7f8c8b7cb740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8c841b5b30 con 0x55ad98d96d70 2024-09-05T01:28:26.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.105+0000 7f8c8b7cb740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8c84082d00 con 0x55ad98d94890 2024-09-05T01:28:26.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.105+0000 7f8c81400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad98d94890 0x55ad98db3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:26.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.105+0000 7f8c81400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad98d94890 0x55ad98db3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:38166/0 (socket says 172.21.15.12:38166) 2024-09-05T01:28:26.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.105+0000 7f8c81400640 1 -- 172.21.15.12:0/2354375922 learned_addr learned my addr 172.21.15.12:0/2354375922 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:26.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.105+0000 7f8c82800640 1 --2- 172.21.15.12:0/2354375922 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d96d70 0x55ad98dbd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:26.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.106+0000 7f8c81e00640 1 --2- 172.21.15.12:0/2354375922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad98d8bb90 0x55ad98d96140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:26.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.106+0000 7f8c81400640 1 -- 172.21.15.12:0/2354375922 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d96d70 msgr2=0x55ad98dbd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:26.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.106+0000 7f8c81400640 1 --2- 172.21.15.12:0/2354375922 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d96d70 0x55ad98dbd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.106+0000 7f8c81400640 1 -- 172.21.15.12:0/2354375922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad98d8bb90 msgr2=0x55ad98d96140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.106+0000 7f8c81400640 1 --2- 172.21.15.12:0/2354375922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad98d8bb90 0x55ad98d96140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.106+0000 7f8c81400640 1 -- 172.21.15.12:0/2354375922 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad98daa9c0 con 0x55ad98d94890 2024-09-05T01:28:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.106+0000 7f8c82800640 1 --2- 172.21.15.12:0/2354375922 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d96d70 0x55ad98dbd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:28:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.107+0000 7f8c81400640 1 --2- 172.21.15.12:0/2354375922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad98d94890 0x55ad98db3d40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8c8406e080 tx=0x7f8c7402a440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6e9db54ead9a491 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.107+0000 7f8c6e600640 1 -- 172.21.15.12:0/2354375922 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c74005130 con 0x55ad98d94890 2024-09-05T01:28:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.107+0000 7f8c6e600640 1 -- 172.21.15.12:0/2354375922 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c74072070 con 0x55ad98d94890 2024-09-05T01:28:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.107+0000 7f8c6e600640 1 -- 172.21.15.12:0/2354375922 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c74040440 con 0x55ad98d94890 2024-09-05T01:28:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.109+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/2354375922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad98d94890 msgr2=0x55ad98db3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.109+0000 7f8c8b7cb740 1 --2- 172.21.15.12:0/2354375922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad98d94890 0x55ad98db3d40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8c8406e080 tx=0x7f8c7402a440 comp rx=0 tx=0).stop 2024-09-05T01:28:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.109+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/2354375922 shutdown_connections 2024-09-05T01:28:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.109+0000 7f8c8b7cb740 1 --2- 172.21.15.12:0/2354375922 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d96d70 0x55ad98dbd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.110+0000 7f8c8b7cb740 1 --2- 172.21.15.12:0/2354375922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad98d94890 0x55ad98db3d40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.110+0000 7f8c8b7cb740 1 --2- 172.21.15.12:0/2354375922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad98d8bb90 0x55ad98d96140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.110+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/2354375922 >> 172.21.15.12:0/2354375922 conn(0x55ad98d88120 msgr2=0x55ad98d92dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:26.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.110+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/2354375922 shutdown_connections 2024-09-05T01:28:26.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.110+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/2354375922 wait complete. 2024-09-05T01:28:26.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.111+0000 7f8c8b7cb740 1 -- start start 2024-09-05T01:28:26.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.111+0000 7f8c8b7cb740 1 Processor -- start 2024-09-05T01:28:26.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.112+0000 7f8c8b7cb740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad98d8bb90 0x55ad98dbafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:26.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.112+0000 7f8c8b7cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad98d94890 0x55ad98dbb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:26.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.112+0000 7f8c8b7cb740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d96d70 0x55ad98dbba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:26.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.113+0000 7f8c81e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad98d8bb90 0x55ad98dbafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:26.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.114+0000 7f8c82800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d96d70 0x55ad98dbba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:26.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.114+0000 7f8c82800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d96d70 0x55ad98dbba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:36316/0 (socket says 172.21.15.12:36316) 2024-09-05T01:28:26.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.114+0000 7f8c8b7cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8c841b53a0 con 0x55ad98d94890 2024-09-05T01:28:26.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.114+0000 7f8c8b7cb740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8c841b4cd0 con 0x55ad98d96d70 2024-09-05T01:28:26.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.114+0000 7f8c8b7cb740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8c84080610 con 0x55ad98d8bb90 2024-09-05T01:28:26.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.114+0000 7f8c8b7cb740 10 client.0 _ll_register_callbacks cb 0x7f8c7c09c630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:28:26.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.114+0000 7f8c81e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad98d8bb90 0x55ad98dbafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:38180/0 (socket says 172.21.15.12:38180) 2024-09-05T01:28:26.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.114+0000 7f8c81e00640 1 -- 172.21.15.12:0/1668505861 learned_addr learned my addr 172.21.15.12:0/1668505861 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:28:26.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.114+0000 7f8c81400640 1 --2- 172.21.15.12:0/1668505861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad98d94890 0x55ad98dbb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:26.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.115+0000 7f8c82800640 1 -- 172.21.15.12:0/1668505861 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad98d8bb90 msgr2=0x55ad98dbafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:26.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.115+0000 7f8c82800640 1 --2- 172.21.15.12:0/1668505861 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad98d8bb90 0x55ad98dbafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.115+0000 7f8c82800640 1 -- 172.21.15.12:0/1668505861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad98d94890 msgr2=0x55ad98dbb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:28:26.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.115+0000 7f8c82800640 1 --2- 172.21.15.12:0/1668505861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad98d94890 0x55ad98dbb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.115+0000 7f8c82800640 1 -- 172.21.15.12:0/1668505861 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad98da2690 con 0x55ad98d96d70 2024-09-05T01:28:26.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.116+0000 7f8c82800640 1 --2- 172.21.15.12:0/1668505861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d96d70 0x55ad98dbba50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0981b0 tx=0x7f8c7c009680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba85b0f7d436dc34 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:28:26.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.116+0000 7f8c63400640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:28:26.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.116+0000 7f8c63400640 1 -- 172.21.15.12:0/1668505861 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c098ac0 con 0x55ad98d96d70 2024-09-05T01:28:26.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.117+0000 7f8c63400640 1 -- 172.21.15.12:0/1668505861 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f8c7c097e20 con 0x55ad98d96d70 2024-09-05T01:28:26.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.117+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/1668505861 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c74072070 con 0x55ad98d96d70 2024-09-05T01:28:26.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.117+0000 7f8c63400640 1 -- 172.21.15.12:0/1668505861 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8c7c098c90 con 0x55ad98d96d70 2024-09-05T01:28:26.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.117+0000 7f8c8b7cb740 10 client.25847 fetch_fsmap learned FSMap version 34 2024-09-05T01:28:26.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.117+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/1668505861 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ad98da3980 con 0x55ad98d96d70 2024-09-05T01:28:26.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.117+0000 7f8c63400640 1 -- 172.21.15.12:0/1668505861 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c74072070 con 0x55ad98d96d70 2024-09-05T01:28:26.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.117+0000 7f8c63400640 1 -- 172.21.15.12:0/1668505861 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 34) ==== 8410+0+0 (secure 0 0 0) 0x7f8c7c0a1040 con 0x55ad98d96d70 2024-09-05T01:28:26.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.118+0000 7f8c8b7cb740 10 client.25847 fetch_fsmap finished waiting for FSMap version 34 2024-09-05T01:28:26.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.118+0000 7f8c8b7cb740 10 client.25847 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:28:26.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.118+0000 7f8c8b7cb740 20 client.25847 populate_metadata read hostname 'smithi012' 2024-09-05T01:28:26.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.118+0000 7f8c8b7cb740 1 --2- 172.21.15.12:0/1668505861 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ad98db7f00 0x55ad98da5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:28:26.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.118+0000 7f8c8b7cb740 4 client.25847 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T01:28:26.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.118+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/1668505861 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ad98cf9e60 con 0x55ad98db7f00 2024-09-05T01:28:26.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.118+0000 7f8c81e00640 1 --2- 172.21.15.12:0/1668505861 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ad98db7f00 0x55ad98da5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:28:26.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.119+0000 7f8c81e00640 1 --2- 172.21.15.12:0/1668505861 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ad98db7f00 0x55ad98da5f10 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ff4f27134dfa2bf server_cookie=637ccce61eee9ac7 in_seq=0 out_seq=0 2024-09-05T01:28:26.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.119+0000 7f8c63400640 10 client.25847 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:28:26.129 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:28:26.130 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "scrub active (624 inodes in the stack)", 2024-09-05T01:28:26.130 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-05T01:28:26.130 INFO:teuthology.orchestra.run.smithi012.stdout: "ec8faade-15a6-4469-9bed-86ac7a518efa": { 2024-09-05T01:28:26.130 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-05T01:28:26.130 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "ec8faade-15a6-4469-9bed-86ac7a518efa", 2024-09-05T01:28:26.130 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-05T01:28:26.130 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:28:26.130 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:28:26.130 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:28:26.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.119+0000 7f8c63400640 1 -- 172.21.15.12:0/1668505861 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x55ad98cf9e60 con 0x55ad98db7f00 2024-09-05T01:28:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.119+0000 7f8c63400640 10 client.25847 handle_command_reply: tid=0 2024-09-05T01:28:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.119+0000 7f8c8b7cb740 1 client.25847 shutdown 2024-09-05T01:28:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.120+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/1668505861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d96d70 msgr2=0x55ad98dbba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.120+0000 7f8c8b7cb740 1 --2- 172.21.15.12:0/1668505861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d96d70 0x55ad98dbba50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0981b0 tx=0x7f8c7c009680 comp rx=0 tx=0).stop 2024-09-05T01:28:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.121+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/1668505861 shutdown_connections 2024-09-05T01:28:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.121+0000 7f8c8b7cb740 1 --2- 172.21.15.12:0/1668505861 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ad98db7f00 0x55ad98da5f10 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.121+0000 7f8c8b7cb740 1 --2- 172.21.15.12:0/1668505861 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad98d96d70 0x55ad98dbba50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.121+0000 7f8c8b7cb740 1 --2- 172.21.15.12:0/1668505861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad98d94890 0x55ad98dbb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.121+0000 7f8c8b7cb740 1 --2- 172.21.15.12:0/1668505861 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad98d8bb90 0x55ad98dbafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.121+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/1668505861 >> 172.21.15.12:0/1668505861 conn(0x55ad98d88120 msgr2=0x55ad98d869a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.121+0000 7f8c63400640 0 client.25847 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:28:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.121+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/1668505861 shutdown_connections 2024-09-05T01:28:26.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.121+0000 7f8c8b7cb740 1 -- 172.21.15.12:0/1668505861 wait complete. 2024-09-05T01:28:26.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.121+0000 7f8c8b7cb740 20 client.25847 trim_cache size 0 max 16384 2024-09-05T01:28:26.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.124+0000 7f8c88c00640 1 -- 172.21.15.12:0/529835816 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8c680a2e40 msgr2=0x7f8c680a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:26.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.124+0000 7f8c88c00640 1 --2- 172.21.15.12:0/529835816 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8c680a2e40 0x7f8c680a5300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55ad98d88f80 tx=0x7f8c7400b040 comp rx=0 tx=0).stop 2024-09-05T01:28:26.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.124+0000 7f8c88c00640 1 -- 172.21.15.12:0/529835816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c8410d530 msgr2=0x7f8c8406c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:28:26.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.124+0000 7f8c88c00640 1 --2- 172.21.15.12:0/529835816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c8410d530 0x7f8c8406c830 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c005fd0 tx=0x7f8c7c00ee60 comp rx=0 tx=0).stop 2024-09-05T01:28:26.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.124+0000 7f8c88c00640 1 -- 172.21.15.12:0/529835816 shutdown_connections 2024-09-05T01:28:26.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.124+0000 7f8c88c00640 1 --2- 172.21.15.12:0/529835816 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8c680a2e40 0x7f8c680a5300 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.124+0000 7f8c88c00640 1 --2- 172.21.15.12:0/529835816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c8410d530 0x7f8c8406c830 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.124+0000 7f8c88c00640 1 --2- 172.21.15.12:0/529835816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c84108e00 0x7f8c84073ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.124+0000 7f8c88c00640 1 --2- 172.21.15.12:0/529835816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8c84108450 0x7f8c840737a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:28:26.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.124+0000 7f8c88c00640 1 -- 172.21.15.12:0/529835816 >> 172.21.15.12:0/529835816 conn(0x7f8c84077ba0 msgr2=0x7f8c84078460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:28:26.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.125+0000 7f8c88c00640 1 -- 172.21.15.12:0/529835816 shutdown_connections 2024-09-05T01:28:26.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:28:26.125+0000 7f8c88c00640 1 -- 172.21.15.12:0/529835816 wait complete. 2024-09-05T01:28:27.072 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:27 smithi012 ceph-mon[29942]: pgmap v115: 97 pgs: 97 active+clean; 966 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 14 MiB/s wr, 625 op/s 2024-09-05T01:28:27.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:27 smithi145 ceph-mon[34376]: pgmap v115: 97 pgs: 97 active+clean; 966 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 14 MiB/s wr, 625 op/s 2024-09-05T01:28:27.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:27 smithi151 ceph-mon[35013]: pgmap v115: 97 pgs: 97 active+clean; 966 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 14 MiB/s wr, 625 op/s 2024-09-05T01:28:27.559 INFO:tasks.cephfs.filesystem:scrub status for tag:ec8faade-15a6-4469-9bed-86ac7a518efa - {'path': '/', 'tag': 'ec8faade-15a6-4469-9bed-86ac7a518efa', 'options': 'recursive,force'} 2024-09-05T01:28:28.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:28.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:28.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:28.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:28.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:28.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:28.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:28.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:28.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:28.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:28.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:28.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.189 INFO:tasks.workunit.client.0.smithi012.stdout: 313 410312 964 295623 911 80888 558 2024-09-05T01:28:29.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: pgmap v116: 97 pgs: 97 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 19 MiB/s wr, 802 op/s 2024-09-05T01:28:29.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:29.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:29.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:29.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:29.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:29.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:29.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:29.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:29.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:29.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:29.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:28:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: pgmap v116: 97 pgs: 97 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 19 MiB/s wr, 802 op/s 2024-09-05T01:28:29.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:29.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:29.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:29.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:29.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:29.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:29.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:29.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.355 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:29.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:29.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:29.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:29.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:29.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:29.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:29.356 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:29.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:29.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:29.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:29.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:29.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:29.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:29.357 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.358 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:29.358 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.358 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:29.358 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.358 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:28:29.358 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.358 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: pgmap v116: 97 pgs: 97 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 19 MiB/s wr, 802 op/s 2024-09-05T01:28:29.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:29.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:29.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:29.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:29.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:29.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:29.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:29.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:29.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:29.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:29.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:29.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:29.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:29.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:29.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:29.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:29.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:29.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:29.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:29.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:29.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:29.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:29.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:29.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:28:29.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:29.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:30.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:30 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:30.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:30 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:30.485 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:30 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:31.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:31 smithi145 ceph-mon[34376]: pgmap v117: 97 pgs: 97 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 24 MiB/s wr, 993 op/s 2024-09-05T01:28:31.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:31 smithi151 ceph-mon[35013]: pgmap v117: 97 pgs: 97 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 24 MiB/s wr, 993 op/s 2024-09-05T01:28:31.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:31 smithi012 ceph-mon[29942]: pgmap v117: 97 pgs: 97 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 24 MiB/s wr, 993 op/s 2024-09-05T01:28:32.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:32.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:32.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:28:33.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:33 smithi151 ceph-mon[35013]: pgmap v118: 97 pgs: 97 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 22 MiB/s wr, 952 op/s 2024-09-05T01:28:33.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:33 smithi012 ceph-mon[29942]: pgmap v118: 97 pgs: 97 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 22 MiB/s wr, 952 op/s 2024-09-05T01:28:33.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:33 smithi145 ceph-mon[34376]: pgmap v118: 97 pgs: 97 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 22 MiB/s wr, 952 op/s 2024-09-05T01:28:35.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:35 smithi012 ceph-mon[29942]: pgmap v119: 97 pgs: 97 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 23 MiB/s wr, 1.01k op/s 2024-09-05T01:28:35.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:35 smithi145 ceph-mon[34376]: pgmap v119: 97 pgs: 97 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 23 MiB/s wr, 1.01k op/s 2024-09-05T01:28:35.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:35 smithi151 ceph-mon[35013]: pgmap v119: 97 pgs: 97 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 23 MiB/s wr, 1.01k op/s 2024-09-05T01:28:37.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:37 smithi012 ceph-mon[29942]: pgmap v120: 97 pgs: 97 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 14 MiB/s wr, 573 op/s 2024-09-05T01:28:37.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:37 smithi145 ceph-mon[34376]: pgmap v120: 97 pgs: 97 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 14 MiB/s wr, 573 op/s 2024-09-05T01:28:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:37 smithi151 ceph-mon[35013]: pgmap v120: 97 pgs: 97 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 14 MiB/s wr, 573 op/s 2024-09-05T01:28:39.189 INFO:tasks.workunit.client.0.smithi012.stdout: 334 611017 1401 444943 1391 126028 603 2024-09-05T01:28:39.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:39 smithi145 ceph-mon[34376]: pgmap v121: 97 pgs: 97 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 13 MiB/s wr, 569 op/s 2024-09-05T01:28:39.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:39 smithi012 ceph-mon[29942]: pgmap v121: 97 pgs: 97 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 13 MiB/s wr, 569 op/s 2024-09-05T01:28:39.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:39 smithi151 ceph-mon[35013]: pgmap v121: 97 pgs: 97 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 13 MiB/s wr, 569 op/s 2024-09-05T01:28:41.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:41 smithi012 ceph-mon[29942]: pgmap v122: 97 pgs: 97 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.0 MiB/s wr, 433 op/s 2024-09-05T01:28:41.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:41 smithi145 ceph-mon[34376]: pgmap v122: 97 pgs: 97 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.0 MiB/s wr, 433 op/s 2024-09-05T01:28:41.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:41 smithi151 ceph-mon[35013]: pgmap v122: 97 pgs: 97 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.0 MiB/s wr, 433 op/s 2024-09-05T01:28:43.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:43 smithi012 ceph-mon[29942]: pgmap v123: 97 pgs: 97 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 130 op/s 2024-09-05T01:28:43.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:43 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:28:43.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:43 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:28:43.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:43 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:28:43.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:43 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:28:43.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:43 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:28:43.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:43 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:28:43.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:43 smithi145 ceph-mon[34376]: pgmap v123: 97 pgs: 97 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 130 op/s 2024-09-05T01:28:43.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:43 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:28:43.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:43 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:28:43.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:43 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:28:43.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:43 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:28:43.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:43 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:28:43.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:43 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:28:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:43 smithi151 ceph-mon[35013]: pgmap v123: 97 pgs: 97 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 130 op/s 2024-09-05T01:28:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:43 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:28:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:43 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:28:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:43 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:28:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:43 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:28:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:43 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:28:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:43 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:28:45.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:45 smithi012 ceph-mon[29942]: pgmap v124: 97 pgs: 97 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 190 op/s 2024-09-05T01:28:45.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:45 smithi145 ceph-mon[34376]: pgmap v124: 97 pgs: 97 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 190 op/s 2024-09-05T01:28:45.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:45 smithi151 ceph-mon[35013]: pgmap v124: 97 pgs: 97 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 190 op/s 2024-09-05T01:28:47.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:47 smithi012 ceph-mon[29942]: pgmap v125: 97 pgs: 97 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 155 op/s 2024-09-05T01:28:47.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:47 smithi145 ceph-mon[34376]: pgmap v125: 97 pgs: 97 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 155 op/s 2024-09-05T01:28:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:47 smithi151 ceph-mon[35013]: pgmap v125: 97 pgs: 97 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.5 MiB/s wr, 155 op/s 2024-09-05T01:28:48.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:48 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:28:48.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:48 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:28:48.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:48 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:28:49.213 INFO:tasks.workunit.client.0.smithi012.stdout: 365 625910 1462 453379 1791 124321 1931 2024-09-05T01:28:49.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:49 smithi012 ceph-mon[29942]: pgmap v126: 97 pgs: 97 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 192 op/s 2024-09-05T01:28:49.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:49 smithi145 ceph-mon[34376]: pgmap v126: 97 pgs: 97 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 192 op/s 2024-09-05T01:28:49.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:49 smithi151 ceph-mon[35013]: pgmap v126: 97 pgs: 97 active+clean; 1.1 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 192 op/s 2024-09-05T01:28:51.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:51 smithi012 ceph-mon[29942]: pgmap v127: 97 pgs: 97 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.6 MiB/s wr, 242 op/s 2024-09-05T01:28:51.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:51 smithi145 ceph-mon[34376]: pgmap v127: 97 pgs: 97 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.6 MiB/s wr, 242 op/s 2024-09-05T01:28:51.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:51 smithi151 ceph-mon[35013]: pgmap v127: 97 pgs: 97 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.6 MiB/s wr, 242 op/s 2024-09-05T01:28:53.327 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:53 smithi012 ceph-mon[29942]: pgmap v128: 97 pgs: 97 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.7 MiB/s wr, 201 op/s 2024-09-05T01:28:53.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:53 smithi145 ceph-mon[34376]: pgmap v128: 97 pgs: 97 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.7 MiB/s wr, 201 op/s 2024-09-05T01:28:53.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:53 smithi151 ceph-mon[35013]: pgmap v128: 97 pgs: 97 active+clean; 1.1 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.7 MiB/s wr, 201 op/s 2024-09-05T01:28:55.500 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:55 smithi012 ceph-mon[29942]: pgmap v129: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 8.1 MiB/s wr, 387 op/s 2024-09-05T01:28:55.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:55 smithi145 ceph-mon[34376]: pgmap v129: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 8.1 MiB/s wr, 387 op/s 2024-09-05T01:28:55.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:55 smithi151 ceph-mon[35013]: pgmap v129: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 8.1 MiB/s wr, 387 op/s 2024-09-05T01:28:57.320 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:57 smithi012 ceph-mon[29942]: pgmap v130: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.5 MiB/s wr, 332 op/s 2024-09-05T01:28:57.560 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T01:28:57.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:57 smithi145 ceph-mon[34376]: pgmap v130: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.5 MiB/s wr, 332 op/s 2024-09-05T01:28:57.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:57 smithi151 ceph-mon[35013]: pgmap v130: 97 pgs: 97 active+clean; 1.2 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 7.5 MiB/s wr, 332 op/s 2024-09-05T01:28:59.224 INFO:tasks.workunit.client.0.smithi012.stdout: 380 509658 755 370591 896 124932 1855 2024-09-05T01:28:59.304 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:28:59 smithi012 ceph-mon[29942]: pgmap v131: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 16 MiB/s wr, 753 op/s 2024-09-05T01:28:59.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:28:59 smithi145 ceph-mon[34376]: pgmap v131: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 16 MiB/s wr, 753 op/s 2024-09-05T01:28:59.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:28:59 smithi151 ceph-mon[35013]: pgmap v131: 97 pgs: 97 active+clean; 1.3 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 16 MiB/s wr, 753 op/s 2024-09-05T01:29:01.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:01 smithi012 ceph-mon[29942]: pgmap v132: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 24 MiB/s wr, 1.08k op/s 2024-09-05T01:29:01.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:01 smithi145 ceph-mon[34376]: pgmap v132: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 24 MiB/s wr, 1.08k op/s 2024-09-05T01:29:01.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:01 smithi151 ceph-mon[35013]: pgmap v132: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 24 MiB/s wr, 1.08k op/s 2024-09-05T01:29:03.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:03 smithi145 ceph-mon[34376]: pgmap v133: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 24 MiB/s wr, 1.08k op/s 2024-09-05T01:29:03.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:03 smithi151 ceph-mon[35013]: pgmap v133: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 24 MiB/s wr, 1.08k op/s 2024-09-05T01:29:03.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:03 smithi012 ceph-mon[29942]: pgmap v133: 97 pgs: 97 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 24 MiB/s wr, 1.08k op/s 2024-09-05T01:29:04.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:04 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:29:04.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:04 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:29:04.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:04 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:29:05.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:05 smithi012 ceph-mon[29942]: pgmap v134: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 26 MiB/s wr, 1.17k op/s 2024-09-05T01:29:05.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:05 smithi145 ceph-mon[34376]: pgmap v134: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 26 MiB/s wr, 1.17k op/s 2024-09-05T01:29:05.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:05 smithi151 ceph-mon[35013]: pgmap v134: 97 pgs: 97 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 26 MiB/s wr, 1.17k op/s 2024-09-05T01:29:06.663 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:29:07.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:07 smithi145 ceph-mon[34376]: pgmap v135: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 22 MiB/s wr, 1.00k op/s 2024-09-05T01:29:07.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:07 smithi151 ceph-mon[35013]: pgmap v135: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 22 MiB/s wr, 1.00k op/s 2024-09-05T01:29:07.837 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:07 smithi012 ceph-mon[29942]: pgmap v135: 97 pgs: 97 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 22 MiB/s wr, 1.00k op/s 2024-09-05T01:29:09.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.081+0000 7fe597e00640 1 -- 172.21.15.12:0/1932756570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe590005650 msgr2=0x7fe5900a2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:09.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.081+0000 7fe597e00640 1 --2- 172.21.15.12:0/1932756570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe590005650 0x7fe5900a2420 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe598050280 tx=0x7fe598096c80 comp rx=0 tx=0).stop 2024-09-05T01:29:09.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.087+0000 7fe597e00640 1 -- 172.21.15.12:0/1932756570 shutdown_connections 2024-09-05T01:29:09.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.087+0000 7fe597e00640 1 --2- 172.21.15.12:0/1932756570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe590005650 0x7fe5900a2420 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.087+0000 7fe597e00640 1 --2- 172.21.15.12:0/1932756570 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe590004cb0 0x7fe590005110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.087+0000 7fe597e00640 1 --2- 172.21.15.12:0/1932756570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe59009b600 0x7fe59009b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.087+0000 7fe597e00640 1 -- 172.21.15.12:0/1932756570 >> 172.21.15.12:0/1932756570 conn(0x7fe59000a1f0 msgr2=0x7fe59000a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:29:09.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.087+0000 7fe597e00640 1 -- 172.21.15.12:0/1932756570 shutdown_connections 2024-09-05T01:29:09.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.087+0000 7fe597e00640 1 -- 172.21.15.12:0/1932756570 wait complete. 2024-09-05T01:29:09.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.089+0000 7fe597e00640 1 Processor -- start 2024-09-05T01:29:09.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.090+0000 7fe597e00640 1 -- start start 2024-09-05T01:29:09.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.091+0000 7fe597e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe590004cb0 0x7fe590131a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:09.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.091+0000 7fe597e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe590005650 0x7fe590131f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:09.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.092+0000 7fe596000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe590005650 0x7fe590131f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:09.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.092+0000 7fe596000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe590005650 0x7fe590131f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:51146/0 (socket says 172.21.15.12:51146) 2024-09-05T01:29:09.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.092+0000 7fe596000640 1 -- 172.21.15.12:0/999304592 learned_addr learned my addr 172.21.15.12:0/999304592 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:29:09.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.092+0000 7fe597e00640 1 --2- 172.21.15.12:0/999304592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe59009b600 0x7fe59012bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:09.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.093+0000 7fe597400640 1 --2- 172.21.15.12:0/999304592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe59009b600 0x7fe59012bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:09.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.093+0000 7fe596a00640 1 --2- 172.21.15.12:0/999304592 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe590004cb0 0x7fe590131a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:09.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.093+0000 7fe597e00640 1 -- 172.21.15.12:0/999304592 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe5900a5900 con 0x7fe59009b600 2024-09-05T01:29:09.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.093+0000 7fe597e00640 1 -- 172.21.15.12:0/999304592 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe5900a5780 con 0x7fe590004cb0 2024-09-05T01:29:09.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.093+0000 7fe597e00640 1 -- 172.21.15.12:0/999304592 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe5900a5a80 con 0x7fe590005650 2024-09-05T01:29:09.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.094+0000 7fe596000640 1 -- 172.21.15.12:0/999304592 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe590004cb0 msgr2=0x7fe590131a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:09.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.094+0000 7fe596000640 1 --2- 172.21.15.12:0/999304592 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe590004cb0 0x7fe590131a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.094+0000 7fe596000640 1 -- 172.21.15.12:0/999304592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe59009b600 msgr2=0x7fe59012bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:09.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.094+0000 7fe596000640 1 --2- 172.21.15.12:0/999304592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe59009b600 0x7fe59012bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.094+0000 7fe596000640 1 -- 172.21.15.12:0/999304592 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe59012c390 con 0x7fe590005650 2024-09-05T01:29:09.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.095+0000 7fe597400640 1 --2- 172.21.15.12:0/999304592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe59009b600 0x7fe59012bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:29:09.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.096+0000 7fe596000640 1 --2- 172.21.15.12:0/999304592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe590005650 0x7fe590131f90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe58400e9f0 tx=0x7fe58400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:29:09.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.096+0000 7fe58f400640 1 -- 172.21.15.12:0/999304592 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58400cd80 con 0x7fe590005650 2024-09-05T01:29:09.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.096+0000 7fe58f400640 1 -- 172.21.15.12:0/999304592 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe584010910 con 0x7fe590005650 2024-09-05T01:29:09.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.096+0000 7fe58f400640 1 -- 172.21.15.12:0/999304592 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe584018980 con 0x7fe590005650 2024-09-05T01:29:09.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.096+0000 7fe597e00640 1 -- 172.21.15.12:0/999304592 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe59012c620 con 0x7fe590005650 2024-09-05T01:29:09.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.096+0000 7fe597e00640 1 -- 172.21.15.12:0/999304592 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe590094930 con 0x7fe590005650 2024-09-05T01:29:09.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.107+0000 7fe5a026f740 1 Processor -- start 2024-09-05T01:29:09.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.107+0000 7fe5a026f740 1 -- start start 2024-09-05T01:29:09.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.109+0000 7fe58f400640 1 -- 172.21.15.12:0/999304592 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fe584018b20 con 0x7fe590005650 2024-09-05T01:29:09.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.111+0000 7fe5a026f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0437d50 0x55b2a0438130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:09.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.111+0000 7fe597400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0437d50 0x55b2a0438130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:09.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.111+0000 7fe597400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0437d50 0x55b2a0438130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:51162/0 (socket says 172.21.15.12:51162) 2024-09-05T01:29:09.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.112+0000 7fe5a026f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0438670 0x55b2a04429f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:09.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.112+0000 7fe5a026f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b2a0442f30 0x55b2a0445320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:09.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.113+0000 7fe5a026f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b2a039e3e0 con 0x55b2a0438670 2024-09-05T01:29:09.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.113+0000 7fe5a026f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55b2a0345d80 con 0x55b2a0442f30 2024-09-05T01:29:09.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.113+0000 7fe5a026f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b2a039a3a0 con 0x55b2a0437d50 2024-09-05T01:29:09.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.114+0000 7fe597400640 1 -- 172.21.15.12:0/3581445729 learned_addr learned my addr 172.21.15.12:0/3581445729 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:29:09.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.114+0000 7fe596a00640 1 --2- 172.21.15.12:0/3581445729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0438670 0x55b2a04429f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:09.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.115+0000 7fe597400640 1 -- 172.21.15.12:0/3581445729 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b2a0442f30 msgr2=0x55b2a0445320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:29:09.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.115+0000 7fe597400640 1 --2- 172.21.15.12:0/3581445729 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b2a0442f30 0x55b2a0445320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.115+0000 7fe597400640 1 -- 172.21.15.12:0/3581445729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0438670 msgr2=0x55b2a04429f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:29:09.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.115+0000 7fe597400640 1 --2- 172.21.15.12:0/3581445729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0438670 0x55b2a04429f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.115+0000 7fe597400640 1 -- 172.21.15.12:0/3581445729 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2a0364ae0 con 0x55b2a0437d50 2024-09-05T01:29:09.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.116+0000 7fe597400640 1 --2- 172.21.15.12:0/3581445729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0437d50 0x55b2a0438130 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe598000b60 tx=0x7fe59809e800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fff4f665d6e9442b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:29:09.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.116+0000 7fe58f400640 1 --2- 172.21.15.12:0/999304592 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe57c0a2e00 0x7fe57c0a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:09.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.117+0000 7fe58f400640 1 -- 172.21.15.12:0/999304592 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fe5840cf750 con 0x7fe590005650 2024-09-05T01:29:09.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.117+0000 7fe583e00640 1 -- 172.21.15.12:0/3581445729 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5980abc50 con 0x55b2a0437d50 2024-09-05T01:29:09.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.117+0000 7fe583e00640 1 -- 172.21.15.12:0/3581445729 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe59809b040 con 0x55b2a0437d50 2024-09-05T01:29:09.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.117+0000 7fe583e00640 1 -- 172.21.15.12:0/3581445729 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe598097d50 con 0x55b2a0437d50 2024-09-05T01:29:09.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.118+0000 7fe596a00640 1 --2- 172.21.15.12:0/3581445729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0438670 0x55b2a04429f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:29:09.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.118+0000 7fe596a00640 1 --2- 172.21.15.12:0/999304592 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe57c0a2e00 0x7fe57c0a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:09.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.123+0000 7fe5a026f740 1 -- 172.21.15.12:0/3581445729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0437d50 msgr2=0x55b2a0438130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:09.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.123+0000 7fe596a00640 1 --2- 172.21.15.12:0/999304592 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe57c0a2e00 0x7fe57c0a52c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55b2a0435140 tx=0x7fe588009260 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:29:09.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.123+0000 7fe5a026f740 1 --2- 172.21.15.12:0/3581445729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0437d50 0x55b2a0438130 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe598000b60 tx=0x7fe59809e800 comp rx=0 tx=0).stop 2024-09-05T01:29:09.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.123+0000 7fe5a026f740 1 -- 172.21.15.12:0/3581445729 shutdown_connections 2024-09-05T01:29:09.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.123+0000 7fe5a026f740 1 --2- 172.21.15.12:0/3581445729 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b2a0442f30 0x55b2a0445320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.123+0000 7fe5a026f740 1 --2- 172.21.15.12:0/3581445729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0438670 0x55b2a04429f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.124+0000 7fe5a026f740 1 --2- 172.21.15.12:0/3581445729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0437d50 0x55b2a0438130 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.124+0000 7fe5a026f740 1 -- 172.21.15.12:0/3581445729 >> 172.21.15.12:0/3581445729 conn(0x55b2a04342e0 msgr2=0x55b2a04346c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:29:09.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.124+0000 7fe5a026f740 1 -- 172.21.15.12:0/3581445729 shutdown_connections 2024-09-05T01:29:09.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.124+0000 7fe5a026f740 1 -- 172.21.15.12:0/3581445729 wait complete. 2024-09-05T01:29:09.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.125+0000 7fe5a026f740 1 -- start start 2024-09-05T01:29:09.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.126+0000 7fe5a026f740 1 Processor -- start 2024-09-05T01:29:09.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.127+0000 7fe5a026f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0437d50 0x55b2a043fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:09.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.128+0000 7fe5a026f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0438670 0x55b2a0440430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:09.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.128+0000 7fe5a026f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b2a0442f30 0x55b2a0440970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:09.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.128+0000 7fe5a026f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b2a0445b40 con 0x55b2a0437d50 2024-09-05T01:29:09.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.128+0000 7fe596000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0438670 0x55b2a0440430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:09.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.129+0000 7fe5a026f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55b2a03590f0 con 0x55b2a0442f30 2024-09-05T01:29:09.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.129+0000 7fe5a026f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b2a0445cc0 con 0x55b2a0438670 2024-09-05T01:29:09.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.129+0000 7fe5a026f740 10 client.0 _ll_register_callbacks cb 0x55b2a034a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:29:09.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.129+0000 7fe596000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0438670 0x55b2a0440430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:51178/0 (socket says 172.21.15.12:51178) 2024-09-05T01:29:09.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.129+0000 7fe596000640 1 -- 172.21.15.12:0/4070309383 learned_addr learned my addr 172.21.15.12:0/4070309383 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:29:09.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.128+0000 7fe597400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b2a0442f30 0x55b2a0440970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:09.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.129+0000 7fe596a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0437d50 0x55b2a043fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:09.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.133+0000 7fe596000640 1 -- 172.21.15.12:0/4070309383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b2a0442f30 msgr2=0x55b2a0440970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:29:09.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.133+0000 7fe596000640 1 --2- 172.21.15.12:0/4070309383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b2a0442f30 0x55b2a0440970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.133+0000 7fe596000640 1 -- 172.21.15.12:0/4070309383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0437d50 msgr2=0x55b2a043fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:29:09.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.133+0000 7fe596000640 1 --2- 172.21.15.12:0/4070309383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0437d50 0x55b2a043fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.133+0000 7fe596000640 1 -- 172.21.15.12:0/4070309383 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2a010f3c0 con 0x55b2a0438670 2024-09-05T01:29:09.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.134+0000 7fe596a00640 1 --2- 172.21.15.12:0/4070309383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0437d50 0x55b2a043fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:29:09.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.134+0000 7fe597400640 1 --2- 172.21.15.12:0/4070309383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b2a0442f30 0x55b2a0440970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:29:09.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.135+0000 7fe596000640 1 --2- 172.21.15.12:0/4070309383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0438670 0x55b2a0440430 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe58409b900 tx=0x7fe58409b560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd23fbe0d64e655d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:29:09.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.135+0000 7fe580c00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:29:09.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.135+0000 7fe580c00640 1 -- 172.21.15.12:0/4070309383 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58409ffb0 con 0x55b2a0438670 2024-09-05T01:29:09.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.136+0000 7fe580c00640 1 -- 172.21.15.12:0/4070309383 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fe5840a43e0 con 0x55b2a0438670 2024-09-05T01:29:09.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.136+0000 7fe5a026f740 1 -- 172.21.15.12:0/4070309383 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe59809b040 con 0x55b2a0438670 2024-09-05T01:29:09.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.136+0000 7fe580c00640 1 -- 172.21.15.12:0/4070309383 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fe5840a4870 con 0x55b2a0438670 2024-09-05T01:29:09.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.136+0000 7fe5a026f740 10 client.25846 fetch_fsmap learned FSMap version 36 2024-09-05T01:29:09.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.137+0000 7fe5a026f740 1 -- 172.21.15.12:0/4070309383 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b2a0451940 con 0x55b2a0438670 2024-09-05T01:29:09.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.137+0000 7fe580c00640 1 -- 172.21.15.12:0/4070309383 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe59809b040 con 0x55b2a0438670 2024-09-05T01:29:09.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.137+0000 7fe580c00640 1 -- 172.21.15.12:0/4070309383 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 36) ==== 8426+0+0 (secure 0 0 0) 0x7fe5840979e0 con 0x55b2a0438670 2024-09-05T01:29:09.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.138+0000 7fe5a026f740 10 client.25846 fetch_fsmap finished waiting for FSMap version 36 2024-09-05T01:29:09.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.138+0000 7fe5a026f740 10 client.25846 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:29:09.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.138+0000 7fe5a026f740 20 client.25846 populate_metadata read hostname 'smithi012' 2024-09-05T01:29:09.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.138+0000 7fe5a026f740 1 --2- 172.21.15.12:0/4070309383 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b2a0452e80 0x55b2a04552a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:09.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.138+0000 7fe5a026f740 4 client.25846 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:29:09.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.138+0000 7fe5a026f740 1 -- 172.21.15.12:0/4070309383 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2a03ab950 con 0x55b2a0452e80 2024-09-05T01:29:09.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.138+0000 7fe596a00640 1 --2- 172.21.15.12:0/4070309383 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b2a0452e80 0x55b2a04552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:09.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.139+0000 7fe596a00640 1 --2- 172.21.15.12:0/4070309383 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b2a0452e80 0x55b2a04552a0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6650e992faeb6eb0 server_cookie=63d5c385bed983bd in_seq=0 out_seq=0 2024-09-05T01:29:09.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.139+0000 7fe580c00640 10 client.25846 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:29:09.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.140+0000 7fe580c00640 1 -- 172.21.15.12:0/4070309383 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b2a03ab950 con 0x55b2a0452e80 2024-09-05T01:29:09.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.140+0000 7fe580c00640 10 client.25846 handle_command_reply: tid=0 2024-09-05T01:29:09.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.141+0000 7fe5a026f740 1 client.25846 shutdown 2024-09-05T01:29:09.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.141+0000 7fe5a026f740 1 -- 172.21.15.12:0/4070309383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0438670 msgr2=0x55b2a0440430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:09.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.141+0000 7fe5a026f740 1 --2- 172.21.15.12:0/4070309383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0438670 0x55b2a0440430 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe58409b900 tx=0x7fe58409b560 comp rx=0 tx=0).stop 2024-09-05T01:29:09.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.141+0000 7fe5a026f740 1 -- 172.21.15.12:0/4070309383 shutdown_connections 2024-09-05T01:29:09.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.141+0000 7fe5a026f740 1 --2- 172.21.15.12:0/4070309383 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b2a0452e80 0x55b2a04552a0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.141+0000 7fe5a026f740 1 --2- 172.21.15.12:0/4070309383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b2a0442f30 0x55b2a0440970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.141+0000 7fe5a026f740 1 --2- 172.21.15.12:0/4070309383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0438670 0x55b2a0440430 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.141+0000 7fe5a026f740 1 --2- 172.21.15.12:0/4070309383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0437d50 0x55b2a043fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.141+0000 7fe5a026f740 1 -- 172.21.15.12:0/4070309383 >> 172.21.15.12:0/4070309383 conn(0x55b2a04342e0 msgr2=0x55b2a043a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:29:09.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.142+0000 7fe580c00640 0 client.25846 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:29:09.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.142+0000 7fe5a026f740 1 -- 172.21.15.12:0/4070309383 shutdown_connections 2024-09-05T01:29:09.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.142+0000 7fe5a026f740 1 -- 172.21.15.12:0/4070309383 wait complete. 2024-09-05T01:29:09.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.142+0000 7fe5a026f740 20 client.25846 trim_cache size 0 max 16384 2024-09-05T01:29:09.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.191+0000 7fe5a026f740 1 Processor -- start 2024-09-05T01:29:09.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.191+0000 7fe5a026f740 1 -- start start 2024-09-05T01:29:09.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.191+0000 7fe5a026f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0437d50 0x55b2a043eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:09.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.191+0000 7fe5a026f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0442f30 0x55b2a045ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:09.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.191+0000 7fe5a026f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b2a043f2e0 0x55b2a045b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:09.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.191+0000 7fe5a026f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe57800e7f0 con 0x55b2a0442f30 2024-09-05T01:29:09.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.191+0000 7fe5a026f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe578010570 con 0x55b2a043f2e0 2024-09-05T01:29:09.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.191+0000 7fe5a026f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe57800eec0 con 0x55b2a0437d50 2024-09-05T01:29:09.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.193+0000 7fe596000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0442f30 0x55b2a045ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:09.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.193+0000 7fe596000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0442f30 0x55b2a045ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58800/0 (socket says 172.21.15.12:58800) 2024-09-05T01:29:09.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.194+0000 7fe596000640 1 -- 172.21.15.12:0/2569909565 learned_addr learned my addr 172.21.15.12:0/2569909565 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:29:09.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.194+0000 7fe596a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0437d50 0x55b2a043eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:09.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.194+0000 7fe597400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b2a043f2e0 0x55b2a045b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:09.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.196+0000 7fe596000640 1 -- 172.21.15.12:0/2569909565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0437d50 msgr2=0x55b2a043eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:29:09.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.196+0000 7fe596000640 1 --2- 172.21.15.12:0/2569909565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0437d50 0x55b2a043eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.196+0000 7fe596000640 1 -- 172.21.15.12:0/2569909565 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b2a043f2e0 msgr2=0x55b2a045b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:29:09.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.196+0000 7fe596000640 1 --2- 172.21.15.12:0/2569909565 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b2a043f2e0 0x55b2a045b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.196+0000 7fe596000640 1 -- 172.21.15.12:0/2569909565 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2a0434f70 con 0x55b2a0442f30 2024-09-05T01:29:09.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.197+0000 7fe596a00640 1 --2- 172.21.15.12:0/2569909565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0437d50 0x55b2a043eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:29:09.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.197+0000 7fe596000640 1 --2- 172.21.15.12:0/2569909565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0442f30 0x55b2a045ab30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe584098060 tx=0x7fe58409b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286e5e742a3d564d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:29:09.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.201+0000 7fe583400640 1 -- 172.21.15.12:0/2569909565 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58409ffb0 con 0x55b2a0442f30 2024-09-05T01:29:09.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.201+0000 7fe583400640 1 -- 172.21.15.12:0/2569909565 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe584010c60 con 0x55b2a0442f30 2024-09-05T01:29:09.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.201+0000 7fe583400640 1 -- 172.21.15.12:0/2569909565 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58409b050 con 0x55b2a0442f30 2024-09-05T01:29:09.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.202+0000 7fe5a026f740 1 -- 172.21.15.12:0/2569909565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0442f30 msgr2=0x55b2a045ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:09.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.202+0000 7fe5a026f740 1 --2- 172.21.15.12:0/2569909565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0442f30 0x55b2a045ab30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe584098060 tx=0x7fe58409b690 comp rx=0 tx=0).stop 2024-09-05T01:29:09.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.202+0000 7fe5a026f740 1 -- 172.21.15.12:0/2569909565 shutdown_connections 2024-09-05T01:29:09.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.202+0000 7fe5a026f740 1 --2- 172.21.15.12:0/2569909565 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b2a043f2e0 0x55b2a045b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.202+0000 7fe5a026f740 1 --2- 172.21.15.12:0/2569909565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0442f30 0x55b2a045ab30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.202+0000 7fe5a026f740 1 --2- 172.21.15.12:0/2569909565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0437d50 0x55b2a043eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.202+0000 7fe5a026f740 1 -- 172.21.15.12:0/2569909565 >> 172.21.15.12:0/2569909565 conn(0x55b2a04342e0 msgr2=0x55b2a043e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:29:09.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.203+0000 7fe5a026f740 1 -- 172.21.15.12:0/2569909565 shutdown_connections 2024-09-05T01:29:09.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.203+0000 7fe5a026f740 1 -- 172.21.15.12:0/2569909565 wait complete. 2024-09-05T01:29:09.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.203+0000 7fe5a026f740 1 -- start start 2024-09-05T01:29:09.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.204+0000 7fe5a026f740 1 Processor -- start 2024-09-05T01:29:09.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.204+0000 7fe5a026f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0437d50 0x55b2a043ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:09.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.204+0000 7fe5a026f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b2a043f2e0 0x55b2a043d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:09.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.204+0000 7fe5a026f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0442f30 0x55b2a043d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:09.219 INFO:tasks.workunit.client.0.smithi012.stdout: 412 597595 1896 433150 1721 172264 2905 2024-09-05T01:29:09.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.205+0000 7fe596000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b2a043f2e0 0x55b2a043d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:09.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.205+0000 7fe596000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b2a043f2e0 0x55b2a043d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:52878/0 (socket says 172.21.15.12:52878) 2024-09-05T01:29:09.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.205+0000 7fe597400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0442f30 0x55b2a043d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:09.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.205+0000 7fe597400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0442f30 0x55b2a043d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:51208/0 (socket says 172.21.15.12:51208) 2024-09-05T01:29:09.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.205+0000 7fe596000640 1 -- 172.21.15.12:0/3306787358 learned_addr learned my addr 172.21.15.12:0/3306787358 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:29:09.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.205+0000 7fe5a026f740 1 -- 172.21.15.12:0/3306787358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe57800fde0 con 0x55b2a0437d50 2024-09-05T01:29:09.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.206+0000 7fe5a026f740 1 -- 172.21.15.12:0/3306787358 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe57800f650 con 0x55b2a043f2e0 2024-09-05T01:29:09.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.206+0000 7fe5a026f740 1 -- 172.21.15.12:0/3306787358 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe57800c7d0 con 0x55b2a0442f30 2024-09-05T01:29:09.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.207+0000 7fe5a026f740 10 client.0 _ll_register_callbacks cb 0x7fe584097f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:29:09.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.207+0000 7fe596a00640 1 --2- 172.21.15.12:0/3306787358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0437d50 0x55b2a043ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:09.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.207+0000 7fe597400640 1 -- 172.21.15.12:0/3306787358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b2a043f2e0 msgr2=0x55b2a043d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:29:09.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.207+0000 7fe597400640 1 --2- 172.21.15.12:0/3306787358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b2a043f2e0 0x55b2a043d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.207+0000 7fe597400640 1 -- 172.21.15.12:0/3306787358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0437d50 msgr2=0x55b2a043ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:29:09.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.207+0000 7fe597400640 1 --2- 172.21.15.12:0/3306787358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0437d50 0x55b2a043ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.207+0000 7fe597400640 1 -- 172.21.15.12:0/3306787358 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2a04bcb00 con 0x55b2a0442f30 2024-09-05T01:29:09.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.208+0000 7fe5a026f740 1 -- 172.21.15.12:0/3306787358 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe584010c60 con 0x55b2a0442f30 2024-09-05T01:29:09.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.208+0000 7fe596a00640 1 --2- 172.21.15.12:0/3306787358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0437d50 0x55b2a043ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:29:09.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.208+0000 7fe596000640 1 --2- 172.21.15.12:0/3306787358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b2a043f2e0 0x55b2a043d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:29:09.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.208+0000 7fe580c00640 10 client.25852 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:29:09.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.208+0000 7fe597400640 1 --2- 172.21.15.12:0/3306787358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0442f30 0x55b2a043d8b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe598065a40 tx=0x7fe59809ebc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=294399c08538a0c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:29:09.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.209+0000 7fe580c00640 1 -- 172.21.15.12:0/3306787358 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe598063240 con 0x55b2a0442f30 2024-09-05T01:29:09.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.209+0000 7fe580c00640 1 -- 172.21.15.12:0/3306787358 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fe598063040 con 0x55b2a0442f30 2024-09-05T01:29:09.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.209+0000 7fe580c00640 1 -- 172.21.15.12:0/3306787358 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fe598063240 con 0x55b2a0442f30 2024-09-05T01:29:09.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.209+0000 7fe5a026f740 10 client.25852 fetch_fsmap learned FSMap version 36 2024-09-05T01:29:09.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.209+0000 7fe5a026f740 1 -- 172.21.15.12:0/3306787358 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({fsmap=36}) -- 0x55b2a04bdc30 con 0x55b2a0442f30 2024-09-05T01:29:09.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.210+0000 7fe580c00640 1 -- 172.21.15.12:0/3306787358 <== mon.1 v2:172.21.15.151:3300/0 4 ==== fsmap(e 36) ==== 8426+0+0 (secure 0 0 0) 0x7fe5980633e0 con 0x55b2a0442f30 2024-09-05T01:29:09.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.210+0000 7fe5a026f740 10 client.25852 fetch_fsmap finished waiting for FSMap version 36 2024-09-05T01:29:09.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.210+0000 7fe5a026f740 10 client.25852 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:29:09.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.210+0000 7fe5a026f740 20 client.25852 populate_metadata read hostname 'smithi012' 2024-09-05T01:29:09.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.210+0000 7fe5a026f740 1 --2- 172.21.15.12:0/3306787358 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b2a04bde50 0x55b2a04c0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:09.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.210+0000 7fe5a026f740 4 client.25852 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T01:29:09.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.210+0000 7fe5a026f740 1 -- 172.21.15.12:0/3306787358 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b2a03a5e60 con 0x55b2a04bde50 2024-09-05T01:29:09.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.211+0000 7fe596a00640 1 --2- 172.21.15.12:0/3306787358 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b2a04bde50 0x55b2a04c0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:09.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.211+0000 7fe596a00640 1 --2- 172.21.15.12:0/3306787358 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b2a04bde50 0x55b2a04c0240 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6eb472bed6e2a203 server_cookie=d139b35601763ff6 in_seq=0 out_seq=0 2024-09-05T01:29:09.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.211+0000 7fe580c00640 10 client.25852 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:29:09.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.212+0000 7fe580c00640 1 -- 172.21.15.12:0/3306787358 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b2a03a5e60 con 0x55b2a04bde50 2024-09-05T01:29:09.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.212+0000 7fe580c00640 10 client.25852 handle_command_reply: tid=0 2024-09-05T01:29:09.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.212+0000 7fe5a026f740 1 client.25852 shutdown 2024-09-05T01:29:09.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.212+0000 7fe5a026f740 1 -- 172.21.15.12:0/3306787358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0442f30 msgr2=0x55b2a043d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:09.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.212+0000 7fe5a026f740 1 --2- 172.21.15.12:0/3306787358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0442f30 0x55b2a043d8b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe598065a40 tx=0x7fe59809ebc0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.225 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:29:09.225 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-05T01:29:09.225 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-05T01:29:09.225 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:29:09.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.214+0000 7fe5a026f740 1 -- 172.21.15.12:0/3306787358 shutdown_connections 2024-09-05T01:29:09.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.214+0000 7fe5a026f740 1 --2- 172.21.15.12:0/3306787358 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55b2a04bde50 0x55b2a04c0240 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.214+0000 7fe5a026f740 1 --2- 172.21.15.12:0/3306787358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a0442f30 0x55b2a043d8b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.214+0000 7fe5a026f740 1 --2- 172.21.15.12:0/3306787358 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b2a043f2e0 0x55b2a043d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.214+0000 7fe5a026f740 1 --2- 172.21.15.12:0/3306787358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b2a0437d50 0x55b2a043ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.215+0000 7fe5a026f740 1 -- 172.21.15.12:0/3306787358 >> 172.21.15.12:0/3306787358 conn(0x55b2a04342e0 msgr2=0x55b2a0432b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:29:09.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.215+0000 7fe580c00640 0 client.25852 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:29:09.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.215+0000 7fe5a026f740 1 -- 172.21.15.12:0/3306787358 shutdown_connections 2024-09-05T01:29:09.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.215+0000 7fe5a026f740 1 -- 172.21.15.12:0/3306787358 wait complete. 2024-09-05T01:29:09.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.216+0000 7fe5a026f740 20 client.25852 trim_cache size 0 max 16384 2024-09-05T01:29:09.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.219+0000 7fe597e00640 1 -- 172.21.15.12:0/999304592 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe57c0a2e00 msgr2=0x7fe57c0a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:09.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.219+0000 7fe597e00640 1 --2- 172.21.15.12:0/999304592 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe57c0a2e00 0x7fe57c0a52c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55b2a0435140 tx=0x7fe588009260 comp rx=0 tx=0).stop 2024-09-05T01:29:09.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.219+0000 7fe597e00640 1 -- 172.21.15.12:0/999304592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe590005650 msgr2=0x7fe590131f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:09.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.219+0000 7fe597e00640 1 --2- 172.21.15.12:0/999304592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe590005650 0x7fe590131f90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe58400e9f0 tx=0x7fe58400eeb0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.219+0000 7fe597e00640 1 -- 172.21.15.12:0/999304592 shutdown_connections 2024-09-05T01:29:09.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.219+0000 7fe597e00640 1 --2- 172.21.15.12:0/999304592 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe57c0a2e00 0x7fe57c0a52c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.219+0000 7fe597e00640 1 --2- 172.21.15.12:0/999304592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe59009b600 0x7fe59012bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.219+0000 7fe597e00640 1 --2- 172.21.15.12:0/999304592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe590005650 0x7fe590131f90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.219+0000 7fe597e00640 1 --2- 172.21.15.12:0/999304592 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe590004cb0 0x7fe590131a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:09.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.219+0000 7fe597e00640 1 -- 172.21.15.12:0/999304592 >> 172.21.15.12:0/999304592 conn(0x7fe59000a1f0 msgr2=0x7fe590093550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:29:09.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.220+0000 7fe597e00640 1 -- 172.21.15.12:0/999304592 shutdown_connections 2024-09-05T01:29:09.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:09.220+0000 7fe597e00640 1 -- 172.21.15.12:0/999304592 wait complete. 2024-09-05T01:29:09.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:09 smithi151 ceph-mon[35013]: pgmap v136: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 23 MiB/s wr, 1.04k op/s 2024-09-05T01:29:09.738 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:09 smithi012 ceph-mon[29942]: pgmap v136: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 23 MiB/s wr, 1.04k op/s 2024-09-05T01:29:09.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:09 smithi145 ceph-mon[34376]: pgmap v136: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 23 MiB/s wr, 1.04k op/s 2024-09-05T01:29:10.816 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-05T01:29:10.816 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:29:11.340 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:11 smithi012 ceph-mon[29942]: pgmap v137: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 15 MiB/s wr, 645 op/s 2024-09-05T01:29:11.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:11 smithi151 ceph-mon[35013]: pgmap v137: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 15 MiB/s wr, 645 op/s 2024-09-05T01:29:11.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:11 smithi145 ceph-mon[34376]: pgmap v137: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 15 MiB/s wr, 645 op/s 2024-09-05T01:29:13.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:13 smithi012 ceph-mon[29942]: pgmap v138: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.6 MiB/s wr, 284 op/s 2024-09-05T01:29:13.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:13 smithi145 ceph-mon[34376]: pgmap v138: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.6 MiB/s wr, 284 op/s 2024-09-05T01:29:13.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:13 smithi151 ceph-mon[35013]: pgmap v138: 97 pgs: 97 active+clean; 1.5 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.6 MiB/s wr, 284 op/s 2024-09-05T01:29:15.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:15 smithi012 ceph-mon[29942]: pgmap v139: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.9 MiB/s wr, 303 op/s 2024-09-05T01:29:15.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:15 smithi145 ceph-mon[34376]: pgmap v139: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.9 MiB/s wr, 303 op/s 2024-09-05T01:29:15.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:15 smithi151 ceph-mon[35013]: pgmap v139: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.9 MiB/s wr, 303 op/s 2024-09-05T01:29:17.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:17 smithi012 ceph-mon[29942]: pgmap v140: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.1 MiB/s wr, 226 op/s 2024-09-05T01:29:17.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:17 smithi145 ceph-mon[34376]: pgmap v140: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.1 MiB/s wr, 226 op/s 2024-09-05T01:29:17.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:17 smithi151 ceph-mon[35013]: pgmap v140: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.1 MiB/s wr, 226 op/s 2024-09-05T01:29:19.217 INFO:tasks.workunit.client.0.smithi012.stdout: 449 602335 2141 437291 1889 170714 777 2024-09-05T01:29:19.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:19 smithi012 ceph-mon[29942]: pgmap v141: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.8 MiB/s wr, 303 op/s 2024-09-05T01:29:19.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:19 smithi145 ceph-mon[34376]: pgmap v141: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.8 MiB/s wr, 303 op/s 2024-09-05T01:29:19.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:19 smithi151 ceph-mon[35013]: pgmap v141: 97 pgs: 97 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.8 MiB/s wr, 303 op/s 2024-09-05T01:29:20.248 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:29:21.382 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:21 smithi012 ceph-mon[29942]: pgmap v142: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.1 MiB/s wr, 354 op/s 2024-09-05T01:29:21.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:21 smithi145 ceph-mon[34376]: pgmap v142: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.1 MiB/s wr, 354 op/s 2024-09-05T01:29:21.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:21 smithi151 ceph-mon[35013]: pgmap v142: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 6.1 MiB/s wr, 354 op/s 2024-09-05T01:29:22.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.368+0000 7f8959200640 1 -- 172.21.15.12:0/976770694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8954102360 msgr2=0x7f895410e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:22.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.368+0000 7f8959200640 1 --2- 172.21.15.12:0/976770694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8954102360 0x7f895410e890 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f894c009ca0 tx=0x7f894c02a8f0 comp rx=0 tx=0).stop 2024-09-05T01:29:22.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.373+0000 7f8959200640 1 -- 172.21.15.12:0/976770694 shutdown_connections 2024-09-05T01:29:22.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.373+0000 7f8959200640 1 --2- 172.21.15.12:0/976770694 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8954102360 0x7f895410e890 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:22.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.373+0000 7f8959200640 1 --2- 172.21.15.12:0/976770694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89541019c0 0x7f8954101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:22.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.373+0000 7f8959200640 1 --2- 172.21.15.12:0/976770694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89541079c0 0x7f8954107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:22.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.373+0000 7f8959200640 1 -- 172.21.15.12:0/976770694 >> 172.21.15.12:0/976770694 conn(0x7f89540fd740 msgr2=0x7f89540ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:29:22.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.373+0000 7f8959200640 1 -- 172.21.15.12:0/976770694 shutdown_connections 2024-09-05T01:29:22.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.373+0000 7f8959200640 1 -- 172.21.15.12:0/976770694 wait complete. 2024-09-05T01:29:22.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.375+0000 7f8959200640 1 Processor -- start 2024-09-05T01:29:22.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.380+0000 7f8959200640 1 -- start start 2024-09-05T01:29:22.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.381+0000 7f8959200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89541019c0 0x7f895410e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:22.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.381+0000 7f8959200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8954102360 0x7f895410e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:22.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.382+0000 7f8959200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89541079c0 0x7f895410b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:22.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.382+0000 7f8953400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89541019c0 0x7f895410e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:22.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.382+0000 7f8952a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8954102360 0x7f895410e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:22.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.382+0000 7f8952a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8954102360 0x7f895410e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:53162/0 (socket says 172.21.15.12:53162) 2024-09-05T01:29:22.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.382+0000 7f8952a00640 1 -- 172.21.15.12:0/2421646488 learned_addr learned my addr 172.21.15.12:0/2421646488 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:29:22.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.383+0000 7f8959200640 1 -- 172.21.15.12:0/2421646488 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8954075890 con 0x7f89541079c0 2024-09-05T01:29:22.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.383+0000 7f8959200640 1 -- 172.21.15.12:0/2421646488 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8954075710 con 0x7f8954102360 2024-09-05T01:29:22.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.383+0000 7f8959200640 1 -- 172.21.15.12:0/2421646488 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8954075a10 con 0x7f89541019c0 2024-09-05T01:29:22.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.384+0000 7f8952a00640 1 -- 172.21.15.12:0/2421646488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89541019c0 msgr2=0x7f895410e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:22.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.384+0000 7f8952a00640 1 --2- 172.21.15.12:0/2421646488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89541019c0 0x7f895410e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:22.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.384+0000 7f8952a00640 1 -- 172.21.15.12:0/2421646488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89541079c0 msgr2=0x7f895410b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:22.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.384+0000 7f8952a00640 1 --2- 172.21.15.12:0/2421646488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89541079c0 0x7f895410b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:22.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.384+0000 7f8952a00640 1 -- 172.21.15.12:0/2421646488 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f895410bad0 con 0x7f8954102360 2024-09-05T01:29:22.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.384+0000 7f8953400640 1 --2- 172.21.15.12:0/2421646488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89541019c0 0x7f895410e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:29:22.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.385+0000 7f8952a00640 1 --2- 172.21.15.12:0/2421646488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8954102360 0x7f895410e610 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f894000b4a0 tx=0x7f894000b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:29:22.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.385+0000 7f894be00640 1 -- 172.21.15.12:0/2421646488 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8940011830 con 0x7f8954102360 2024-09-05T01:29:22.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.386+0000 7f894be00640 1 -- 172.21.15.12:0/2421646488 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8940016070 con 0x7f8954102360 2024-09-05T01:29:22.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.386+0000 7f8959200640 1 -- 172.21.15.12:0/2421646488 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f895410bdc0 con 0x7f8954102360 2024-09-05T01:29:22.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.387+0000 7f894be00640 1 -- 172.21.15.12:0/2421646488 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894000f2e0 con 0x7f8954102360 2024-09-05T01:29:22.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.388+0000 7f8959200640 1 -- 172.21.15.12:0/2421646488 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89541a0cb0 con 0x7f8954102360 2024-09-05T01:29:22.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.395+0000 7f8959200640 1 -- 172.21.15.12:0/2421646488 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8954103100 con 0x7f8954102360 2024-09-05T01:29:22.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.397+0000 7f894be00640 1 -- 172.21.15.12:0/2421646488 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f894003ebb0 con 0x7f8954102360 2024-09-05T01:29:22.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.405+0000 7f894be00640 1 --2- 172.21.15.12:0/2421646488 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f89380a2dc0 0x7f89380a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:22.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.406+0000 7f894be00640 1 -- 172.21.15.12:0/2421646488 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f89400ce160 con 0x7f8954102360 2024-09-05T01:29:22.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.407+0000 7f894be00640 1 -- 172.21.15.12:0/2421646488 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f894009ae80 con 0x7f8954102360 2024-09-05T01:29:22.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.408+0000 7f8953400640 1 --2- 172.21.15.12:0/2421646488 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f89380a2dc0 0x7f89380a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:22.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.418+0000 7f8953400640 1 --2- 172.21.15.12:0/2421646488 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f89380a2dc0 0x7f89380a5280 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8944009fc0 tx=0x7f8944005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:29:22.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:22 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:29:22.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:22 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:29:22.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:22 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:29:22.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:22 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:29:22.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:22 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:29:22.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:22 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:29:22.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:22 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:29:22.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:22 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:29:22.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:22 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:29:22.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.885+0000 7f8959200640 1 -- 172.21.15.12:0/2421646488 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89541a0f40 con 0x7f8954102360 2024-09-05T01:29:22.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.890+0000 7f894be00640 1 -- 172.21.15.12:0/2421646488 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+12007 (secure 0 0 0) 0x7f894009a780 con 0x7f8954102360 2024-09-05T01:29:22.895 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:29:22.895 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 36 2024-09-05T01:29:22.899 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":36,"btime":"2024-09-05T01:28:47:145112+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14532,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/2949711075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":2949711075},{"type":"v1","addr":"172.21.15.12:6839","nonce":2949711075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T01:22:35.979384+0000","modified":"2024-09-05T01:28:46.958477+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24529,"mds_2":24524,"mds_3":24517,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/497406458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":497406458},{"type":"v1","addr":"172.21.15.12:6841","nonce":497406458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":10,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.145:6839/1706431882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":1706431882},{"type":"v1","addr":"172.21.15.145:6839","nonce":1706431882}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24529,24524,24517,24460]},"id":1}]} 2024-09-05T01:29:22.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.898+0000 7f8959200640 1 -- 172.21.15.12:0/2421646488 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f89380a2dc0 msgr2=0x7f89380a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:22.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.898+0000 7f8959200640 1 --2- 172.21.15.12:0/2421646488 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f89380a2dc0 0x7f89380a5280 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8944009fc0 tx=0x7f8944005f90 comp rx=0 tx=0).stop 2024-09-05T01:29:22.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.898+0000 7f8959200640 1 -- 172.21.15.12:0/2421646488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8954102360 msgr2=0x7f895410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:22.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.898+0000 7f8959200640 1 --2- 172.21.15.12:0/2421646488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8954102360 0x7f895410e610 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f894000b4a0 tx=0x7f894000b960 comp rx=0 tx=0).stop 2024-09-05T01:29:22.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.898+0000 7f8959200640 1 -- 172.21.15.12:0/2421646488 shutdown_connections 2024-09-05T01:29:22.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.898+0000 7f8959200640 1 --2- 172.21.15.12:0/2421646488 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f89380a2dc0 0x7f89380a5280 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:22.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.898+0000 7f8959200640 1 --2- 172.21.15.12:0/2421646488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89541079c0 0x7f895410b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:22.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.898+0000 7f8959200640 1 --2- 172.21.15.12:0/2421646488 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8954102360 0x7f895410e610 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:22.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.898+0000 7f8959200640 1 --2- 172.21.15.12:0/2421646488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89541019c0 0x7f895410e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:22.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.898+0000 7f8959200640 1 -- 172.21.15.12:0/2421646488 >> 172.21.15.12:0/2421646488 conn(0x7f89540fd740 msgr2=0x7f89540fdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:29:22.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.899+0000 7f8959200640 1 -- 172.21.15.12:0/2421646488 shutdown_connections 2024-09-05T01:29:22.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:22.899+0000 7f8959200640 1 -- 172.21.15.12:0/2421646488 wait complete. 2024-09-05T01:29:23.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:23 smithi145 ceph-mon[34376]: pgmap v143: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.2 MiB/s wr, 328 op/s 2024-09-05T01:29:23.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:23 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/2421646488' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:29:23.843 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:23 smithi012 ceph-mon[29942]: pgmap v143: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.2 MiB/s wr, 328 op/s 2024-09-05T01:29:23.843 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:23 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2421646488' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:29:23.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:23 smithi151 ceph-mon[35013]: pgmap v143: 97 pgs: 97 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.2 MiB/s wr, 328 op/s 2024-09-05T01:29:23.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:23 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/2421646488' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:29:25.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:25 smithi012 ceph-mon[29942]: pgmap v144: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 11 MiB/s wr, 713 op/s 2024-09-05T01:29:25.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:25 smithi145 ceph-mon[34376]: pgmap v144: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 11 MiB/s wr, 713 op/s 2024-09-05T01:29:25.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:25 smithi151 ceph-mon[35013]: pgmap v144: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 11 MiB/s wr, 713 op/s 2024-09-05T01:29:26.337 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-05T01:29:27.797 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:27 smithi012 ceph-mon[29942]: pgmap v145: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 10 MiB/s wr, 644 op/s 2024-09-05T01:29:27.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:27 smithi145 ceph-mon[34376]: pgmap v145: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 10 MiB/s wr, 644 op/s 2024-09-05T01:29:27.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:27 smithi151 ceph-mon[35013]: pgmap v145: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 10 MiB/s wr, 644 op/s 2024-09-05T01:29:28.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:28 smithi012 ceph-mon[29942]: pgmap v146: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 693 op/s 2024-09-05T01:29:28.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:28 smithi145 ceph-mon[34376]: pgmap v146: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 693 op/s 2024-09-05T01:29:28.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:28 smithi151 ceph-mon[35013]: pgmap v146: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 693 op/s 2024-09-05T01:29:29.217 INFO:tasks.workunit.client.0.smithi012.stdout: 459 441213 625 316901 523 116822 92 2024-09-05T01:29:31.066 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:30 smithi012 ceph-mon[29942]: pgmap v147: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 21 MiB/s wr, 1.11k op/s 2024-09-05T01:29:31.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:30 smithi145 ceph-mon[34376]: pgmap v147: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 21 MiB/s wr, 1.11k op/s 2024-09-05T01:29:31.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:30 smithi151 ceph-mon[35013]: pgmap v147: 97 pgs: 97 active+clean; 1.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 21 MiB/s wr, 1.11k op/s 2024-09-05T01:29:33.072 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:32 smithi012 ceph-mon[29942]: pgmap v148: 97 pgs: 97 active+clean; 1.7 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 21 MiB/s wr, 1.07k op/s 2024-09-05T01:29:33.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:32 smithi145 ceph-mon[34376]: pgmap v148: 97 pgs: 97 active+clean; 1.7 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 21 MiB/s wr, 1.07k op/s 2024-09-05T01:29:33.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:32 smithi151 ceph-mon[35013]: pgmap v148: 97 pgs: 97 active+clean; 1.7 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 21 MiB/s wr, 1.07k op/s 2024-09-05T01:29:35.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:34 smithi012 ceph-mon[29942]: pgmap v149: 97 pgs: 97 active+clean; 1.8 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 22 MiB/s wr, 1.16k op/s 2024-09-05T01:29:35.070 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:29:35.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:34 smithi145 ceph-mon[34376]: pgmap v149: 97 pgs: 97 active+clean; 1.8 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 22 MiB/s wr, 1.16k op/s 2024-09-05T01:29:35.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:34 smithi151 ceph-mon[35013]: pgmap v149: 97 pgs: 97 active+clean; 1.8 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 22 MiB/s wr, 1.16k op/s 2024-09-05T01:29:36.874 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:36 smithi012 ceph-mon[29942]: pgmap v150: 97 pgs: 97 active+clean; 1.8 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 16 MiB/s wr, 770 op/s 2024-09-05T01:29:37.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:36 smithi145 ceph-mon[34376]: pgmap v150: 97 pgs: 97 active+clean; 1.8 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 16 MiB/s wr, 770 op/s 2024-09-05T01:29:37.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:36 smithi151 ceph-mon[35013]: pgmap v150: 97 pgs: 97 active+clean; 1.8 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 16 MiB/s wr, 770 op/s 2024-09-05T01:29:37.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.182+0000 7f5dd1e00640 1 -- 172.21.15.12:0/542800755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dcc102360 msgr2=0x7f5dcc10e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:37.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.182+0000 7f5dd1e00640 1 --2- 172.21.15.12:0/542800755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dcc102360 0x7f5dcc10e890 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009cd0 tx=0x7f5dc402a910 comp rx=0 tx=0).stop 2024-09-05T01:29:37.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.183+0000 7f5dd1e00640 1 -- 172.21.15.12:0/542800755 shutdown_connections 2024-09-05T01:29:37.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.183+0000 7f5dd1e00640 1 --2- 172.21.15.12:0/542800755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dcc102360 0x7f5dcc10e890 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.183+0000 7f5dd1e00640 1 --2- 172.21.15.12:0/542800755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5dcc1019c0 0x7f5dcc101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.183+0000 7f5dd1e00640 1 --2- 172.21.15.12:0/542800755 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dcc1079c0 0x7f5dcc107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.183+0000 7f5dd1e00640 1 -- 172.21.15.12:0/542800755 >> 172.21.15.12:0/542800755 conn(0x7f5dcc0fd740 msgr2=0x7f5dcc0ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:29:37.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.184+0000 7f5dd1e00640 1 -- 172.21.15.12:0/542800755 shutdown_connections 2024-09-05T01:29:37.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.184+0000 7f5dd1e00640 1 -- 172.21.15.12:0/542800755 wait complete. 2024-09-05T01:29:37.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.185+0000 7f5dd1e00640 1 Processor -- start 2024-09-05T01:29:37.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.185+0000 7f5dd1e00640 1 -- start start 2024-09-05T01:29:37.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.186+0000 7f5dd1e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5dcc1019c0 0x7f5dcc10e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:37.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.186+0000 7f5dd1e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dcc102360 0x7f5dcc10b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:37.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.186+0000 7f5dd1e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dcc1079c0 0x7f5dcc10ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:37.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.186+0000 7f5dd0a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5dcc1019c0 0x7f5dcc10e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:37.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.186+0000 7f5dd1e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc075c00 con 0x7f5dcc1019c0 2024-09-05T01:29:37.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.186+0000 7f5dd1e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc075a80 con 0x7f5dcc1079c0 2024-09-05T01:29:37.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.187+0000 7f5dd1e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc075d80 con 0x7f5dcc102360 2024-09-05T01:29:37.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.187+0000 7f5dd0a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5dcc1019c0 0x7f5dcc10e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33836/0 (socket says 172.21.15.12:33836) 2024-09-05T01:29:37.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.187+0000 7f5dd0a00640 1 -- 172.21.15.12:0/2271659209 learned_addr learned my addr 172.21.15.12:0/2271659209 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:29:37.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.187+0000 7f5dd1400640 1 --2- 172.21.15.12:0/2271659209 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dcc1079c0 0x7f5dcc10ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:37.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.187+0000 7f5dcbe00640 1 --2- 172.21.15.12:0/2271659209 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dcc102360 0x7f5dcc10b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:37.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.188+0000 7f5dd1400640 1 -- 172.21.15.12:0/2271659209 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dcc102360 msgr2=0x7f5dcc10b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:37.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.188+0000 7f5dd1400640 1 --2- 172.21.15.12:0/2271659209 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dcc102360 0x7f5dcc10b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.188+0000 7f5dd1400640 1 -- 172.21.15.12:0/2271659209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5dcc1019c0 msgr2=0x7f5dcc10e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:37.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.188+0000 7f5dd1400640 1 --2- 172.21.15.12:0/2271659209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5dcc1019c0 0x7f5dcc10e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.188+0000 7f5dd1400640 1 -- 172.21.15.12:0/2271659209 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dcc10c1c0 con 0x7f5dcc1079c0 2024-09-05T01:29:37.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.189+0000 7f5dd1400640 1 --2- 172.21.15.12:0/2271659209 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dcc1079c0 0x7f5dcc10ba90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5dc402ae30 tx=0x7f5dc40317d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:29:37.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.189+0000 7f5dc9600640 1 -- 172.21.15.12:0/2271659209 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4003b70 con 0x7f5dcc1079c0 2024-09-05T01:29:37.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.189+0000 7f5dc9600640 1 -- 172.21.15.12:0/2271659209 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dc4003d10 con 0x7f5dcc1079c0 2024-09-05T01:29:37.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.189+0000 7f5dd1e00640 1 -- 172.21.15.12:0/2271659209 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dcc1aafc0 con 0x7f5dcc1079c0 2024-09-05T01:29:37.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.189+0000 7f5dc9600640 1 -- 172.21.15.12:0/2271659209 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc402fae0 con 0x7f5dcc1079c0 2024-09-05T01:29:37.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.189+0000 7f5dd1e00640 1 -- 172.21.15.12:0/2271659209 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dcc1ab360 con 0x7f5dcc1079c0 2024-09-05T01:29:37.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.197+0000 7f5dd5fda740 1 Processor -- start 2024-09-05T01:29:37.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.198+0000 7f5dc9600640 1 -- 172.21.15.12:0/2271659209 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f5dc402fc80 con 0x7f5dcc1079c0 2024-09-05T01:29:37.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.201+0000 7f5dc9600640 1 --2- 172.21.15.12:0/2271659209 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5db40a2df0 0x7f5db40a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:37.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.201+0000 7f5dc9600640 1 -- 172.21.15.12:0/2271659209 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f5dc40f06b0 con 0x7f5dcc1079c0 2024-09-05T01:29:37.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.201+0000 7f5dcbe00640 1 --2- 172.21.15.12:0/2271659209 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5db40a2df0 0x7f5db40a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:37.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.201+0000 7f5dd5fda740 1 -- start start 2024-09-05T01:29:37.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.202+0000 7f5dd5fda740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1dce40 0x558eac1dd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:37.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.202+0000 7f5dd5fda740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558eac1dd760 0x558eac1e7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:37.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.202+0000 7f5dd5fda740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eac1f9030 0x558eac1fb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:37.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.204+0000 7f5dd0a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1dce40 0x558eac1dd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:37.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.204+0000 7f5dd5fda740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558eac1433e0 con 0x558eac1dd760 2024-09-05T01:29:37.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.204+0000 7f5dd5fda740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x558eac0ead80 con 0x558eac1dce40 2024-09-05T01:29:37.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.204+0000 7f5dd5fda740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558eac13f3a0 con 0x558eac1f9030 2024-09-05T01:29:37.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.204+0000 7f5dd0a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1dce40 0x558eac1dd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:55328/0 (socket says 172.21.15.12:55328) 2024-09-05T01:29:37.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.204+0000 7f5dd0a00640 1 -- 172.21.15.12:0/367626365 learned_addr learned my addr 172.21.15.12:0/367626365 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:29:37.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.205+0000 7f5dd0a00640 1 -- 172.21.15.12:0/367626365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eac1f9030 msgr2=0x558eac1fb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:29:37.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.204+0000 7f5dd1400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eac1f9030 0x558eac1fb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:37.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.204+0000 7f5dcbe00640 1 --2- 172.21.15.12:0/2271659209 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5db40a2df0 0x7f5db40a52b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc10ccc0 tx=0x7f5db800b410 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:29:37.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.205+0000 7f5dcbe00640 1 --2- 172.21.15.12:0/367626365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558eac1dd760 0x558eac1e7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:37.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.209+0000 7f5dd0a00640 1 --2- 172.21.15.12:0/367626365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eac1f9030 0x558eac1fb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.209+0000 7f5dd0a00640 1 -- 172.21.15.12:0/367626365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558eac1dd760 msgr2=0x558eac1e7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:29:37.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.209+0000 7f5dd0a00640 1 --2- 172.21.15.12:0/367626365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558eac1dd760 0x558eac1e7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.209+0000 7f5dd0a00640 1 -- 172.21.15.12:0/367626365 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eac109ae0 con 0x558eac1dce40 2024-09-05T01:29:37.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.209+0000 7f5dcbe00640 1 --2- 172.21.15.12:0/367626365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558eac1dd760 0x558eac1e7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:29:37.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.209+0000 7f5dd1400640 1 --2- 172.21.15.12:0/367626365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eac1f9030 0x558eac1fb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:29:37.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.210+0000 7f5dd0a00640 1 --2- 172.21.15.12:0/367626365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1dce40 0x558eac1dd220 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0009d40 tx=0x7f5dc0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25dbf76d81333849 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:29:37.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.210+0000 7f5dbdc00640 1 -- 172.21.15.12:0/367626365 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0004220 con 0x558eac1dce40 2024-09-05T01:29:37.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.210+0000 7f5dbdc00640 1 -- 172.21.15.12:0/367626365 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dc00043c0 con 0x558eac1dce40 2024-09-05T01:29:37.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.210+0000 7f5dbdc00640 1 -- 172.21.15.12:0/367626365 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc00035f0 con 0x558eac1dce40 2024-09-05T01:29:37.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.211+0000 7f5dd5fda740 1 -- 172.21.15.12:0/367626365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1dce40 msgr2=0x558eac1dd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:37.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.211+0000 7f5dd5fda740 1 --2- 172.21.15.12:0/367626365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1dce40 0x558eac1dd220 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0009d40 tx=0x7f5dc0011810 comp rx=0 tx=0).stop 2024-09-05T01:29:37.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.213+0000 7f5dd5fda740 1 -- 172.21.15.12:0/367626365 shutdown_connections 2024-09-05T01:29:37.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.213+0000 7f5dd5fda740 1 --2- 172.21.15.12:0/367626365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eac1f9030 0x558eac1fb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.213+0000 7f5dd5fda740 1 --2- 172.21.15.12:0/367626365 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558eac1dd760 0x558eac1e7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.213+0000 7f5dd5fda740 1 --2- 172.21.15.12:0/367626365 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1dce40 0x558eac1dd220 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.213+0000 7f5dd5fda740 1 -- 172.21.15.12:0/367626365 >> 172.21.15.12:0/367626365 conn(0x558eac1d93d0 msgr2=0x558eac1d97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:29:37.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.214+0000 7f5dd5fda740 1 -- 172.21.15.12:0/367626365 shutdown_connections 2024-09-05T01:29:37.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.214+0000 7f5dd5fda740 1 -- 172.21.15.12:0/367626365 wait complete. 2024-09-05T01:29:37.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.215+0000 7f5dd5fda740 1 -- start start 2024-09-05T01:29:37.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.216+0000 7f5dd5fda740 1 Processor -- start 2024-09-05T01:29:37.270 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.217+0000 7f5dd5fda740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1dce40 0x558eac1e7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:37.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.217+0000 7f5dd5fda740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eac1dd760 0x558eac1e4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:37.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.217+0000 7f5dd5fda740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558eac1f9030 0x558eac1e5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:37.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.217+0000 7f5dd5fda740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558eac1fbc50 con 0x558eac1f9030 2024-09-05T01:29:37.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.217+0000 7f5dd5fda740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x558eac0fe0f0 con 0x558eac1dce40 2024-09-05T01:29:37.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.217+0000 7f5dd5fda740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558eac1fbdd0 con 0x558eac1dd760 2024-09-05T01:29:37.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.218+0000 7f5dd5fda740 10 client.0 _ll_register_callbacks cb 0x558eac0e5bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:29:37.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.217+0000 7f5dd0a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1dce40 0x558eac1e7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:37.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.221+0000 7f5dd0a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1dce40 0x558eac1e7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:55340/0 (socket says 172.21.15.12:55340) 2024-09-05T01:29:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.221+0000 7f5dd0a00640 1 -- 172.21.15.12:0/992144410 learned_addr learned my addr 172.21.15.12:0/992144410 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:29:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.222+0000 7f5dcbe00640 1 --2- 172.21.15.12:0/992144410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eac1dd760 0x558eac1e4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.222+0000 7f5dd0a00640 1 -- 172.21.15.12:0/992144410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eac1dd760 msgr2=0x558eac1e4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:29:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.222+0000 7f5dd0a00640 1 --2- 172.21.15.12:0/992144410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eac1dd760 0x558eac1e4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.223+0000 7f5dd0a00640 1 -- 172.21.15.12:0/992144410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558eac1f9030 msgr2=0x558eac1e5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:29:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.223+0000 7f5dd0a00640 1 --2- 172.21.15.12:0/992144410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558eac1f9030 0x558eac1e5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.223+0000 7f5dd0a00640 1 -- 172.21.15.12:0/992144410 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eabeb43c0 con 0x558eac1dce40 2024-09-05T01:29:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.224+0000 7f5dd0a00640 1 --2- 172.21.15.12:0/992144410 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1dce40 0x558eac1e7ad0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0009620 tx=0x7f5dc0005370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a7e6ad9d93adb08 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:29:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.224+0000 7f5db2000640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:29:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.224+0000 7f5db2000640 1 -- 172.21.15.12:0/992144410 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0028020 con 0x558eac1dce40 2024-09-05T01:29:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.225+0000 7f5db2000640 1 -- 172.21.15.12:0/992144410 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f5dc0024430 con 0x558eac1dce40 2024-09-05T01:29:37.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.225+0000 7f5dd5fda740 1 -- 172.21.15.12:0/992144410 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dc00043c0 con 0x558eac1dce40 2024-09-05T01:29:37.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.226+0000 7f5db2000640 1 -- 172.21.15.12:0/992144410 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f5dc001d030 con 0x558eac1dce40 2024-09-05T01:29:37.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.226+0000 7f5dd5fda740 10 client.25877 fetch_fsmap learned FSMap version 36 2024-09-05T01:29:37.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.226+0000 7f5dd5fda740 1 -- 172.21.15.12:0/992144410 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x558eac207b30 con 0x558eac1dce40 2024-09-05T01:29:37.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.227+0000 7f5db2000640 1 -- 172.21.15.12:0/992144410 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dc00043c0 con 0x558eac1dce40 2024-09-05T01:29:37.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.229+0000 7f5db2000640 1 -- 172.21.15.12:0/992144410 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 36) ==== 8426+0+0 (secure 0 0 0) 0x7f5dc0023070 con 0x558eac1dce40 2024-09-05T01:29:37.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.229+0000 7f5dd5fda740 10 client.25877 fetch_fsmap finished waiting for FSMap version 36 2024-09-05T01:29:37.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.229+0000 7f5dd5fda740 10 client.25877 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-05T01:29:37.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.229+0000 7f5dd5fda740 20 client.25877 populate_metadata read hostname 'smithi012' 2024-09-05T01:29:37.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.230+0000 7f5dd5fda740 1 --2- 172.21.15.12:0/992144410 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x558eac208f40 0x558eac20b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:37.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.230+0000 7f5dd5fda740 4 client.25877 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:29:37.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.230+0000 7f5dd5fda740 1 -- 172.21.15.12:0/992144410 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558eac150950 con 0x558eac208f40 2024-09-05T01:29:37.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.230+0000 7f5dcbe00640 1 --2- 172.21.15.12:0/992144410 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x558eac208f40 0x558eac20b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:37.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.231+0000 7f5dcbe00640 1 --2- 172.21.15.12:0/992144410 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x558eac208f40 0x558eac20b330 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=73356de4a4af6ff8 server_cookie=aa946e4e435c88b5 in_seq=0 out_seq=0 2024-09-05T01:29:37.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.231+0000 7f5db2000640 10 client.25877 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:29:37.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.232+0000 7f5db2000640 1 -- 172.21.15.12:0/992144410 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558eac150950 con 0x558eac208f40 2024-09-05T01:29:37.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.232+0000 7f5db2000640 10 client.25877 handle_command_reply: tid=0 2024-09-05T01:29:37.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.233+0000 7f5dd5fda740 1 client.25877 shutdown 2024-09-05T01:29:37.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.233+0000 7f5dd5fda740 1 -- 172.21.15.12:0/992144410 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1dce40 msgr2=0x558eac1e7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:37.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.233+0000 7f5dd5fda740 1 --2- 172.21.15.12:0/992144410 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1dce40 0x558eac1e7ad0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0009620 tx=0x7f5dc0005370 comp rx=0 tx=0).stop 2024-09-05T01:29:37.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.234+0000 7f5dd5fda740 1 -- 172.21.15.12:0/992144410 shutdown_connections 2024-09-05T01:29:37.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.234+0000 7f5dd5fda740 1 --2- 172.21.15.12:0/992144410 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x558eac208f40 0x558eac20b330 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.234+0000 7f5dd5fda740 1 --2- 172.21.15.12:0/992144410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558eac1f9030 0x558eac1e5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.234+0000 7f5dd5fda740 1 --2- 172.21.15.12:0/992144410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eac1dd760 0x558eac1e4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.234+0000 7f5dd5fda740 1 --2- 172.21.15.12:0/992144410 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1dce40 0x558eac1e7ad0 secure :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0009620 tx=0x7f5dc0005370 comp rx=0 tx=0).stop 2024-09-05T01:29:37.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.234+0000 7f5dd5fda740 1 -- 172.21.15.12:0/992144410 >> 172.21.15.12:0/992144410 conn(0x558eac1d93d0 msgr2=0x558eac1df100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:29:37.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.234+0000 7f5db2000640 0 client.25877 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:29:37.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.235+0000 7f5dd5fda740 1 -- 172.21.15.12:0/992144410 shutdown_connections 2024-09-05T01:29:37.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.235+0000 7f5dd5fda740 1 -- 172.21.15.12:0/992144410 wait complete. 2024-09-05T01:29:37.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.235+0000 7f5dd5fda740 20 client.25877 trim_cache size 0 max 16384 2024-09-05T01:29:37.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.263+0000 7f5dd5fda740 1 Processor -- start 2024-09-05T01:29:37.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.263+0000 7f5dd5fda740 1 -- start start 2024-09-05T01:29:37.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.264+0000 7f5dd5fda740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1dd760 0x558eac210b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:37.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.264+0000 7f5dd5fda740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558eac1f9030 0x558eac211090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:37.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.264+0000 7f5dd5fda740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eac1e3d60 0x558eac1e1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:37.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.264+0000 7f5dd5fda740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc074200 con 0x558eac1f9030 2024-09-05T01:29:37.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.264+0000 7f5dd5fda740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc1ad150 con 0x558eac1dd760 2024-09-05T01:29:37.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.264+0000 7f5dd5fda740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc1abaa0 con 0x558eac1e3d60 2024-09-05T01:29:37.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.265+0000 7f5dd1400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eac1e3d60 0x558eac1e1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:37.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.265+0000 7f5dd1400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eac1e3d60 0x558eac1e1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:46406/0 (socket says 172.21.15.12:46406) 2024-09-05T01:29:37.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.265+0000 7f5dd1400640 1 -- 172.21.15.12:0/676962406 learned_addr learned my addr 172.21.15.12:0/676962406 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:29:37.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.265+0000 7f5dcbe00640 1 --2- 172.21.15.12:0/676962406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558eac1f9030 0x558eac211090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:37.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.265+0000 7f5dd0a00640 1 --2- 172.21.15.12:0/676962406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1dd760 0x558eac210b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:37.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.265+0000 7f5dd1400640 1 -- 172.21.15.12:0/676962406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1dd760 msgr2=0x558eac210b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:29:37.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.265+0000 7f5dd1400640 1 --2- 172.21.15.12:0/676962406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1dd760 0x558eac210b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.265+0000 7f5dd1400640 1 -- 172.21.15.12:0/676962406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558eac1f9030 msgr2=0x558eac211090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:29:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.265+0000 7f5dd1400640 1 --2- 172.21.15.12:0/676962406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558eac1f9030 0x558eac211090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.265+0000 7f5dd1400640 1 -- 172.21.15.12:0/676962406 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eac1d9200 con 0x558eac1e3d60 2024-09-05T01:29:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.266+0000 7f5dcbe00640 1 --2- 172.21.15.12:0/676962406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558eac1f9030 0x558eac211090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:29:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.266+0000 7f5dd1400640 1 --2- 172.21.15.12:0/676962406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eac1e3d60 0x558eac1e1fe0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40edf00 tx=0x7f5dc4009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cfd173bc40ec79 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:29:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.267+0000 7f5dbd200640 1 -- 172.21.15.12:0/676962406 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc40bc5d0 con 0x558eac1e3d60 2024-09-05T01:29:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.267+0000 7f5dbd200640 1 -- 172.21.15.12:0/676962406 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dc4036030 con 0x558eac1e3d60 2024-09-05T01:29:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.267+0000 7f5dbd200640 1 -- 172.21.15.12:0/676962406 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc40ee010 con 0x558eac1e3d60 2024-09-05T01:29:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.268+0000 7f5dd5fda740 1 -- 172.21.15.12:0/676962406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eac1e3d60 msgr2=0x558eac1e1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.268+0000 7f5dd5fda740 1 --2- 172.21.15.12:0/676962406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eac1e3d60 0x558eac1e1fe0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40edf00 tx=0x7f5dc4009a20 comp rx=0 tx=0).stop 2024-09-05T01:29:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.268+0000 7f5dd5fda740 1 -- 172.21.15.12:0/676962406 shutdown_connections 2024-09-05T01:29:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.268+0000 7f5dd5fda740 1 --2- 172.21.15.12:0/676962406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eac1e3d60 0x558eac1e1fe0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.268+0000 7f5dd5fda740 1 --2- 172.21.15.12:0/676962406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558eac1f9030 0x558eac211090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.268+0000 7f5dd5fda740 1 --2- 172.21.15.12:0/676962406 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1dd760 0x558eac210b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.268+0000 7f5dd5fda740 1 -- 172.21.15.12:0/676962406 >> 172.21.15.12:0/676962406 conn(0x558eac1d93d0 msgr2=0x558eac1e3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:29:37.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.268+0000 7f5dd5fda740 1 -- 172.21.15.12:0/676962406 shutdown_connections 2024-09-05T01:29:37.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.269+0000 7f5dd5fda740 1 -- 172.21.15.12:0/676962406 wait complete. 2024-09-05T01:29:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.269+0000 7f5dd5fda740 1 -- start start 2024-09-05T01:29:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.270+0000 7f5dd5fda740 1 Processor -- start 2024-09-05T01:29:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.271+0000 7f5dd5fda740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558eac1dd760 0x558eac2010e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.271+0000 7f5dd5fda740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eac1e3d60 0x558eac201620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.271+0000 7f5dd5fda740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1f9030 0x558eac1fc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.272+0000 7f5dcbe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eac1e3d60 0x558eac201620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.272+0000 7f5dcbe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eac1e3d60 0x558eac201620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:46408/0 (socket says 172.21.15.12:46408) 2024-09-05T01:29:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.272+0000 7f5dd1400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1f9030 0x558eac1fc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.272+0000 7f5dd1400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1f9030 0x558eac1fc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:55352/0 (socket says 172.21.15.12:55352) 2024-09-05T01:29:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.273+0000 7f5dd5fda740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc1ac9c0 con 0x558eac1dd760 2024-09-05T01:29:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.273+0000 7f5dd5fda740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc1ac230 con 0x558eac1f9030 2024-09-05T01:29:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.273+0000 7f5dd5fda740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc101e20 con 0x558eac1e3d60 2024-09-05T01:29:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.273+0000 7f5dd5fda740 10 client.0 _ll_register_callbacks cb 0x7f5dc0009bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:29:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.273+0000 7f5dd0a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558eac1dd760 0x558eac2010e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.273+0000 7f5dcbe00640 1 -- 172.21.15.12:0/4188755343 learned_addr learned my addr 172.21.15.12:0/4188755343 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:29:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.275+0000 7f5dd0a00640 1 -- 172.21.15.12:0/4188755343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eac1e3d60 msgr2=0x558eac201620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:29:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.275+0000 7f5dd0a00640 1 --2- 172.21.15.12:0/4188755343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eac1e3d60 0x558eac201620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.275+0000 7f5dd0a00640 1 -- 172.21.15.12:0/4188755343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1f9030 msgr2=0x558eac1fc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:29:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.275+0000 7f5dd0a00640 1 --2- 172.21.15.12:0/4188755343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1f9030 0x558eac1fc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.275+0000 7f5dd0a00640 1 -- 172.21.15.12:0/4188755343 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eac1da060 con 0x558eac1dd760 2024-09-05T01:29:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.275+0000 7f5dd1400640 1 --2- 172.21.15.12:0/4188755343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1f9030 0x558eac1fc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:29:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.276+0000 7f5db2000640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:29:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.276+0000 7f5dd0a00640 1 --2- 172.21.15.12:0/4188755343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558eac1dd760 0x558eac2010e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0019480 tx=0x7f5dc00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c90962b5ee2ee5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:29:37.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.277+0000 7f5db2000640 1 -- 172.21.15.12:0/4188755343 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc001d030 con 0x558eac1dd760 2024-09-05T01:29:37.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.277+0000 7f5db2000640 1 -- 172.21.15.12:0/4188755343 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f5dc001e040 con 0x558eac1dd760 2024-09-05T01:29:37.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.278+0000 7f5dd5fda740 1 -- 172.21.15.12:0/4188755343 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dc4036030 con 0x558eac1dd760 2024-09-05T01:29:37.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.278+0000 7f5db2000640 1 -- 172.21.15.12:0/4188755343 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f5dc001d030 con 0x558eac1dd760 2024-09-05T01:29:37.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.278+0000 7f5dd5fda740 10 client.15831 fetch_fsmap learned FSMap version 36 2024-09-05T01:29:37.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.278+0000 7f5dd5fda740 1 -- 172.21.15.12:0/4188755343 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x558eac274030 con 0x558eac1dd760 2024-09-05T01:29:37.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.279+0000 7f5db2000640 1 -- 172.21.15.12:0/4188755343 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dc4036030 con 0x558eac1dd760 2024-09-05T01:29:37.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.279+0000 7f5db2000640 1 -- 172.21.15.12:0/4188755343 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 36) ==== 8426+0+0 (secure 0 0 0) 0x7f5dc0023040 con 0x558eac1dd760 2024-09-05T01:29:37.300 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:29:37.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.280+0000 7f5dd5fda740 10 client.15831 fetch_fsmap finished waiting for FSMap version 36 2024-09-05T01:29:37.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.280+0000 7f5dd5fda740 10 client.15831 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-05T01:29:37.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.280+0000 7f5dd5fda740 20 client.15831 populate_metadata read hostname 'smithi012' 2024-09-05T01:29:37.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.281+0000 7f5dd5fda740 1 --2- 172.21.15.12:0/4188755343 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x558eac274780 0x558eac276ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:37.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.281+0000 7f5dd5fda740 4 client.15831 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:29:37.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.281+0000 7f5dd5fda740 1 -- 172.21.15.12:0/4188755343 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558eac14ae60 con 0x558eac274780 2024-09-05T01:29:37.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.281+0000 7f5dcbe00640 1 --2- 172.21.15.12:0/4188755343 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x558eac274780 0x558eac276ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:37.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.282+0000 7f5dcbe00640 1 --2- 172.21.15.12:0/4188755343 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x558eac274780 0x558eac276ba0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=71f86deb921105b9 server_cookie=af72b4c969ae1fe7 in_seq=0 out_seq=0 2024-09-05T01:29:37.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.282+0000 7f5db2000640 10 client.15831 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:29:37.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.282+0000 7f5db2000640 1 -- 172.21.15.12:0/4188755343 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558eac14ae60 con 0x558eac274780 2024-09-05T01:29:37.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.282+0000 7f5db2000640 10 client.15831 handle_command_reply: tid=0 2024-09-05T01:29:37.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.282+0000 7f5dd5fda740 1 client.15831 shutdown 2024-09-05T01:29:37.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.283+0000 7f5dd5fda740 1 -- 172.21.15.12:0/4188755343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558eac1dd760 msgr2=0x558eac2010e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:37.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.283+0000 7f5dd5fda740 1 --2- 172.21.15.12:0/4188755343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558eac1dd760 0x558eac2010e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0019480 tx=0x7f5dc00048f0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.283+0000 7f5dd5fda740 1 -- 172.21.15.12:0/4188755343 shutdown_connections 2024-09-05T01:29:37.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.283+0000 7f5dd5fda740 1 --2- 172.21.15.12:0/4188755343 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x558eac274780 0x558eac276ba0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.283+0000 7f5dd5fda740 1 --2- 172.21.15.12:0/4188755343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558eac1f9030 0x558eac1fc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.283+0000 7f5dd5fda740 1 --2- 172.21.15.12:0/4188755343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eac1e3d60 0x558eac201620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.283+0000 7f5dd5fda740 1 --2- 172.21.15.12:0/4188755343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558eac1dd760 0x558eac2010e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.283+0000 7f5dd5fda740 1 -- 172.21.15.12:0/4188755343 >> 172.21.15.12:0/4188755343 conn(0x558eac1d93d0 msgr2=0x558eac203f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:29:37.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.284+0000 7f5db2000640 0 client.15831 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:29:37.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.284+0000 7f5dd5fda740 1 -- 172.21.15.12:0/4188755343 shutdown_connections 2024-09-05T01:29:37.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.284+0000 7f5dd5fda740 1 -- 172.21.15.12:0/4188755343 wait complete. 2024-09-05T01:29:37.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.285+0000 7f5dd5fda740 20 client.15831 trim_cache size 0 max 16384 2024-09-05T01:29:37.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.286+0000 7f5dd1e00640 1 -- 172.21.15.12:0/2271659209 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5db40a2df0 msgr2=0x7f5db40a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:37.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.286+0000 7f5dd1e00640 1 --2- 172.21.15.12:0/2271659209 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5db40a2df0 0x7f5db40a52b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc10ccc0 tx=0x7f5db800b410 comp rx=0 tx=0).stop 2024-09-05T01:29:37.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.286+0000 7f5dd1e00640 1 -- 172.21.15.12:0/2271659209 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dcc1079c0 msgr2=0x7f5dcc10ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:37.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.286+0000 7f5dd1e00640 1 --2- 172.21.15.12:0/2271659209 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dcc1079c0 0x7f5dcc10ba90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5dc402ae30 tx=0x7f5dc40317d0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.286+0000 7f5dd1e00640 1 -- 172.21.15.12:0/2271659209 shutdown_connections 2024-09-05T01:29:37.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.286+0000 7f5dd1e00640 1 --2- 172.21.15.12:0/2271659209 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5db40a2df0 0x7f5db40a52b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.286+0000 7f5dd1e00640 1 --2- 172.21.15.12:0/2271659209 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5dcc1079c0 0x7f5dcc10ba90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.286+0000 7f5dd1e00640 1 --2- 172.21.15.12:0/2271659209 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dcc102360 0x7f5dcc10b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.286+0000 7f5dd1e00640 1 --2- 172.21.15.12:0/2271659209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5dcc1019c0 0x7f5dcc10e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:37.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.286+0000 7f5dd1e00640 1 -- 172.21.15.12:0/2271659209 >> 172.21.15.12:0/2271659209 conn(0x7f5dcc0fd740 msgr2=0x7f5dcc0fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:29:37.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.287+0000 7f5dd1e00640 1 -- 172.21.15.12:0/2271659209 shutdown_connections 2024-09-05T01:29:37.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:37.287+0000 7f5dd1e00640 1 -- 172.21.15.12:0/2271659209 wait complete. 2024-09-05T01:29:39.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:38 smithi012 ceph-mon[29942]: pgmap v151: 97 pgs: 97 active+clean; 1.8 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 15 MiB/s wr, 739 op/s 2024-09-05T01:29:39.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:38 smithi145 ceph-mon[34376]: pgmap v151: 97 pgs: 97 active+clean; 1.8 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 15 MiB/s wr, 739 op/s 2024-09-05T01:29:39.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:38 smithi151 ceph-mon[35013]: pgmap v151: 97 pgs: 97 active+clean; 1.8 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 15 MiB/s wr, 739 op/s 2024-09-05T01:29:39.220 INFO:tasks.workunit.client.0.smithi012.stdout: 491 594879 2145 430137 1607 162488 1054 2024-09-05T01:29:39.443 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-05T01:29:41.072 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:40 smithi012 ceph-mon[29942]: pgmap v152: 97 pgs: 97 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 16 MiB/s wr, 773 op/s 2024-09-05T01:29:41.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:40 smithi145 ceph-mon[34376]: pgmap v152: 97 pgs: 97 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 16 MiB/s wr, 773 op/s 2024-09-05T01:29:41.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:40 smithi151 ceph-mon[35013]: pgmap v152: 97 pgs: 97 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 16 MiB/s wr, 773 op/s 2024-09-05T01:29:43.068 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:42 smithi012 ceph-mon[29942]: pgmap v153: 97 pgs: 97 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.2 MiB/s wr, 263 op/s 2024-09-05T01:29:43.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:42 smithi145 ceph-mon[34376]: pgmap v153: 97 pgs: 97 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.2 MiB/s wr, 263 op/s 2024-09-05T01:29:43.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:42 smithi151 ceph-mon[35013]: pgmap v153: 97 pgs: 97 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.2 MiB/s wr, 263 op/s 2024-09-05T01:29:45.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:44 smithi145 ceph-mon[34376]: pgmap v154: 97 pgs: 97 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 4.5 MiB/s wr, 302 op/s 2024-09-05T01:29:45.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:44 smithi151 ceph-mon[35013]: pgmap v154: 97 pgs: 97 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 4.5 MiB/s wr, 302 op/s 2024-09-05T01:29:45.324 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:44 smithi012 ceph-mon[29942]: pgmap v154: 97 pgs: 97 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 4.5 MiB/s wr, 302 op/s 2024-09-05T01:29:45.760 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:29:47.075 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:46 smithi012 ceph-mon[29942]: pgmap v155: 97 pgs: 97 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 203 op/s 2024-09-05T01:29:47.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:46 smithi145 ceph-mon[34376]: pgmap v155: 97 pgs: 97 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 203 op/s 2024-09-05T01:29:47.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:46 smithi151 ceph-mon[35013]: pgmap v155: 97 pgs: 97 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 203 op/s 2024-09-05T01:29:48.620 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:29:48.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.353+0000 7fdf17c00640 1 -- 172.21.15.12:0/3691771237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf101091f0 msgr2=0x7fdf101095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:48.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.353+0000 7fdf17c00640 1 --2- 172.21.15.12:0/3691771237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf101091f0 0x7fdf101095d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdf00009900 tx=0x7fdf0002a400 comp rx=0 tx=0).stop 2024-09-05T01:29:48.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.356+0000 7fdf17c00640 1 -- 172.21.15.12:0/3691771237 shutdown_connections 2024-09-05T01:29:48.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.356+0000 7fdf17c00640 1 --2- 172.21.15.12:0/3691771237 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf10116ea0 0x7fdf10119290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.356+0000 7fdf17c00640 1 --2- 172.21.15.12:0/3691771237 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf10109b10 0x7fdf10116960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.356+0000 7fdf17c00640 1 --2- 172.21.15.12:0/3691771237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf101091f0 0x7fdf101095d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.356+0000 7fdf17c00640 1 -- 172.21.15.12:0/3691771237 >> 172.21.15.12:0/3691771237 conn(0x7fdf1006e140 msgr2=0x7fdf1006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:29:48.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.358+0000 7fdf17c00640 1 -- 172.21.15.12:0/3691771237 shutdown_connections 2024-09-05T01:29:48.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.358+0000 7fdf17c00640 1 -- 172.21.15.12:0/3691771237 wait complete. 2024-09-05T01:29:48.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.360+0000 7fdf17c00640 1 Processor -- start 2024-09-05T01:29:48.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.361+0000 7fdf17c00640 1 -- start start 2024-09-05T01:29:48.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.365+0000 7fdf17c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf101091f0 0x7fdf101119d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:48.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.368+0000 7fdf17c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf10109b10 0x7fdf10111f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.369+0000 7fdf15200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf101091f0 0x7fdf101119d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.369+0000 7fdf15200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf101091f0 0x7fdf101119d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:44076/0 (socket says 172.21.15.12:44076) 2024-09-05T01:29:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.372+0000 7fdf17c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf10116ea0 0x7fdf10122a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.372+0000 7fdf0fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf10109b10 0x7fdf10111f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.372+0000 7fdf0fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf10109b10 0x7fdf10111f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34778/0 (socket says 172.21.15.12:34778) 2024-09-05T01:29:48.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.372+0000 7fdf15200640 1 -- 172.21.15.12:0/1438087206 learned_addr learned my addr 172.21.15.12:0/1438087206 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:29:48.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.373+0000 7fdf17c00640 1 -- 172.21.15.12:0/1438087206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1010d810 con 0x7fdf10109b10 2024-09-05T01:29:48.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.373+0000 7fdf17c00640 1 -- 172.21.15.12:0/1438087206 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1010d690 con 0x7fdf10116ea0 2024-09-05T01:29:48.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.373+0000 7fdf17c00640 1 -- 172.21.15.12:0/1438087206 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1010d990 con 0x7fdf101091f0 2024-09-05T01:29:48.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.374+0000 7fdf15200640 1 -- 172.21.15.12:0/1438087206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf10116ea0 msgr2=0x7fdf10122a70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-05T01:29:48.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.374+0000 7fdf15200640 1 --2- 172.21.15.12:0/1438087206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf10116ea0 0x7fdf10122a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.374+0000 7fdf15200640 1 -- 172.21.15.12:0/1438087206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf10109b10 msgr2=0x7fdf10111f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:48.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.374+0000 7fdf15200640 1 --2- 172.21.15.12:0/1438087206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf10109b10 0x7fdf10111f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.374+0000 7fdf15200640 1 -- 172.21.15.12:0/1438087206 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf10123330 con 0x7fdf101091f0 2024-09-05T01:29:48.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.375+0000 7fdf15200640 1 --2- 172.21.15.12:0/1438087206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf101091f0 0x7fdf101119d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdf00004770 tx=0x7fdf00003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:29:48.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.380+0000 7fdf0d600640 1 -- 172.21.15.12:0/1438087206 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0003f070 con 0x7fdf101091f0 2024-09-05T01:29:48.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.380+0000 7fdf0d600640 1 -- 172.21.15.12:0/1438087206 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf00031ca0 con 0x7fdf101091f0 2024-09-05T01:29:48.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.380+0000 7fdf0d600640 1 -- 172.21.15.12:0/1438087206 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf00035030 con 0x7fdf101091f0 2024-09-05T01:29:48.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.380+0000 7fdf17c00640 1 -- 172.21.15.12:0/1438087206 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf101235c0 con 0x7fdf101091f0 2024-09-05T01:29:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.380+0000 7fdf17c00640 1 -- 172.21.15.12:0/1438087206 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf101156e0 con 0x7fdf101091f0 2024-09-05T01:29:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.398+0000 7fdf1a669740 1 Processor -- start 2024-09-05T01:29:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.402+0000 7fdf1a669740 1 -- start start 2024-09-05T01:29:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.402+0000 7fdf1a669740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4bfb32c70 0x55c4bfb33050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.402+0000 7fdf1a669740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4bfb33590 0x55c4bfb3d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.402+0000 7fdf1a669740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4bfb3de50 0x55c4bfb40240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.402+0000 7fdf1a669740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c4bfa993e0 con 0x55c4bfb3de50 2024-09-05T01:29:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.402+0000 7fdf1a669740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c4bfa40d80 con 0x55c4bfb33590 2024-09-05T01:29:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.402+0000 7fdf1a669740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c4bfa953a0 con 0x55c4bfb32c70 2024-09-05T01:29:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.404+0000 7fdf0d600640 1 -- 172.21.15.12:0/1438087206 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fdf00042070 con 0x7fdf101091f0 2024-09-05T01:29:48.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.404+0000 7fdf0fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4bfb3de50 0x55c4bfb40240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:48.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.404+0000 7fdf0fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4bfb3de50 0x55c4bfb40240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34780/0 (socket says 172.21.15.12:34780) 2024-09-05T01:29:48.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.404+0000 7fdf0fe00640 1 -- 172.21.15.12:0/2042379687 learned_addr learned my addr 172.21.15.12:0/2042379687 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:29:48.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.406+0000 7fdf0fe00640 1 -- 172.21.15.12:0/2042379687 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4bfb32c70 msgr2=0x55c4bfb33050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:29:48.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.406+0000 7fdf0fe00640 1 --2- 172.21.15.12:0/2042379687 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4bfb32c70 0x55c4bfb33050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.406+0000 7fdf0fe00640 1 -- 172.21.15.12:0/2042379687 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4bfb33590 msgr2=0x55c4bfb3d910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:29:48.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.406+0000 7fdf0fe00640 1 --2- 172.21.15.12:0/2042379687 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4bfb33590 0x55c4bfb3d910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.406+0000 7fdf0fe00640 1 -- 172.21.15.12:0/2042379687 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4bfa5fae0 con 0x55c4bfb3de50 2024-09-05T01:29:48.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.406+0000 7fdf0d600640 1 --2- 172.21.15.12:0/1438087206 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fdef40a2ec0 0x7fdef40a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:48.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.406+0000 7fdf0d600640 1 -- 172.21.15.12:0/1438087206 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fdf000efa30 con 0x7fdf101091f0 2024-09-05T01:29:48.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.407+0000 7fdf0fe00640 1 --2- 172.21.15.12:0/2042379687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4bfb3de50 0x55c4bfb40240 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009fd0 tx=0x7fdef80118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7019b9f6919a9ffc server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:29:48.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.410+0000 7fdf06000640 1 -- 172.21.15.12:0/2042379687 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef8004b20 con 0x55c4bfb3de50 2024-09-05T01:29:48.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.412+0000 7fdf06000640 1 -- 172.21.15.12:0/2042379687 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdef8004cc0 con 0x55c4bfb3de50 2024-09-05T01:29:48.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.412+0000 7fdf06000640 1 -- 172.21.15.12:0/2042379687 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef80054c0 con 0x55c4bfb3de50 2024-09-05T01:29:48.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.413+0000 7fdf15c00640 1 --2- 172.21.15.12:0/1438087206 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fdef40a2ec0 0x7fdef40a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:48.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.414+0000 7fdf1a669740 1 -- 172.21.15.12:0/2042379687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4bfb3de50 msgr2=0x55c4bfb40240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:48.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.414+0000 7fdf1a669740 1 --2- 172.21.15.12:0/2042379687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4bfb3de50 0x55c4bfb40240 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009fd0 tx=0x7fdef80118d0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.414+0000 7fdf1a669740 1 -- 172.21.15.12:0/2042379687 shutdown_connections 2024-09-05T01:29:48.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.414+0000 7fdf1a669740 1 --2- 172.21.15.12:0/2042379687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4bfb3de50 0x55c4bfb40240 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.414+0000 7fdf1a669740 1 --2- 172.21.15.12:0/2042379687 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4bfb33590 0x55c4bfb3d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.414+0000 7fdf1a669740 1 --2- 172.21.15.12:0/2042379687 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4bfb32c70 0x55c4bfb33050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.414+0000 7fdf1a669740 1 -- 172.21.15.12:0/2042379687 >> 172.21.15.12:0/2042379687 conn(0x55c4bfb2f200 msgr2=0x55c4bfb2f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:29:48.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.415+0000 7fdf15c00640 1 --2- 172.21.15.12:0/1438087206 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fdef40a2ec0 0x7fdef40a5380 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdf080095f0 tx=0x7fdf08005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:29:48.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.417+0000 7fdf1a669740 1 -- 172.21.15.12:0/2042379687 shutdown_connections 2024-09-05T01:29:48.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.417+0000 7fdf1a669740 1 -- 172.21.15.12:0/2042379687 wait complete. 2024-09-05T01:29:48.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.417+0000 7fdf1a669740 1 -- start start 2024-09-05T01:29:48.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.418+0000 7fdf1a669740 1 Processor -- start 2024-09-05T01:29:48.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.420+0000 7fdf1a669740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4bfb32c70 0x55c4bfb3ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:48.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.423+0000 7fdf1a669740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4bfb33590 0x55c4bfb3b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:48.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.423+0000 7fdf1a669740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4bfb3de50 0x55c4bfb3b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:48.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.423+0000 7fdf15200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4bfb32c70 0x55c4bfb3ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:48.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.424+0000 7fdf1a669740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c4bfb40a20 con 0x55c4bfb32c70 2024-09-05T01:29:48.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.424+0000 7fdf1a669740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c4bfa540f0 con 0x55c4bfb33590 2024-09-05T01:29:48.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.424+0000 7fdf1a669740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c4bfb40ba0 con 0x55c4bfb3de50 2024-09-05T01:29:48.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.424+0000 7fdf1a669740 10 client.0 _ll_register_callbacks cb 0x55c4bfa3bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:29:48.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.424+0000 7fdf15c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4bfb3de50 0x55c4bfb3b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:48.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.425+0000 7fdf15c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4bfb3de50 0x55c4bfb3b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:44088/0 (socket says 172.21.15.12:44088) 2024-09-05T01:29:48.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.425+0000 7fdf15c00640 1 -- 172.21.15.12:0/3998081128 learned_addr learned my addr 172.21.15.12:0/3998081128 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:29:48.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.425+0000 7fdf15c00640 1 -- 172.21.15.12:0/3998081128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4bfb33590 msgr2=0x55c4bfb3b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:29:48.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.425+0000 7fdf15c00640 1 --2- 172.21.15.12:0/3998081128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4bfb33590 0x55c4bfb3b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.425+0000 7fdf15c00640 1 -- 172.21.15.12:0/3998081128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4bfb32c70 msgr2=0x55c4bfb3ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:29:48.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.425+0000 7fdf15c00640 1 --2- 172.21.15.12:0/3998081128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4bfb32c70 0x55c4bfb3ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.425+0000 7fdf15c00640 1 -- 172.21.15.12:0/3998081128 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4bf80a3c0 con 0x55c4bfb3de50 2024-09-05T01:29:48.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.429+0000 7fdf15c00640 1 --2- 172.21.15.12:0/3998081128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4bfb3de50 0x55c4bfb3b800 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdf08009760 tx=0x7fdf08004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34593e6d4cbecd26 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:29:48.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.429+0000 7fdefea00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:29:48.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.430+0000 7fdefea00640 1 -- 172.21.15.12:0/3998081128 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf08020070 con 0x55c4bfb3de50 2024-09-05T01:29:48.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.430+0000 7fdefea00640 1 -- 172.21.15.12:0/3998081128 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fdf08005220 con 0x55c4bfb3de50 2024-09-05T01:29:48.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.430+0000 7fdf1a669740 1 -- 172.21.15.12:0/3998081128 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdef8004cc0 con 0x55c4bfb3de50 2024-09-05T01:29:48.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.430+0000 7fdefea00640 1 -- 172.21.15.12:0/3998081128 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fdf08005420 con 0x55c4bfb3de50 2024-09-05T01:29:48.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.431+0000 7fdf1a669740 10 client.25882 fetch_fsmap learned FSMap version 36 2024-09-05T01:29:48.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.431+0000 7fdf1a669740 1 -- 172.21.15.12:0/3998081128 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55c4bfb4cb10 con 0x55c4bfb3de50 2024-09-05T01:29:48.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.431+0000 7fdefea00640 1 -- 172.21.15.12:0/3998081128 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf080055c0 con 0x55c4bfb3de50 2024-09-05T01:29:48.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.431+0000 7fdefea00640 1 -- 172.21.15.12:0/3998081128 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 36) ==== 8426+0+0 (secure 0 0 0) 0x7fdf0801cb50 con 0x55c4bfb3de50 2024-09-05T01:29:48.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.431+0000 7fdf1a669740 10 client.25882 fetch_fsmap finished waiting for FSMap version 36 2024-09-05T01:29:48.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.431+0000 7fdf1a669740 10 client.25882 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-05T01:29:48.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.431+0000 7fdf1a669740 20 client.25882 populate_metadata read hostname 'smithi012' 2024-09-05T01:29:48.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.432+0000 7fdf1a669740 1 --2- 172.21.15.12:0/3998081128 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55c4bfb4e070 0x55c4bfb50510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:48.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.436+0000 7fdf1a669740 4 client.25882 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:29:48.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.436+0000 7fdf1a669740 1 -- 172.21.15.12:0/3998081128 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fdef8004cc0 con 0x55c4bfb4e070 2024-09-05T01:29:48.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.436+0000 7fdf15200640 1 --2- 172.21.15.12:0/3998081128 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55c4bfb4e070 0x55c4bfb50510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:48.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.441+0000 7fdf15200640 1 --2- 172.21.15.12:0/3998081128 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55c4bfb4e070 0x55c4bfb50510 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=49d8b5b4bda13605 server_cookie=87a8fd22b06530d in_seq=0 out_seq=0 2024-09-05T01:29:48.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.441+0000 7fdefea00640 10 client.25882 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:29:48.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.442+0000 7fdefea00640 1 -- 172.21.15.12:0/3998081128 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fdef8004cc0 con 0x55c4bfb4e070 2024-09-05T01:29:48.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.442+0000 7fdefea00640 10 client.25882 handle_command_reply: tid=0 2024-09-05T01:29:48.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.443+0000 7fdf1a669740 1 client.25882 shutdown 2024-09-05T01:29:48.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.444+0000 7fdf1a669740 1 -- 172.21.15.12:0/3998081128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4bfb3de50 msgr2=0x55c4bfb3b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:48.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.444+0000 7fdf1a669740 1 --2- 172.21.15.12:0/3998081128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4bfb3de50 0x55c4bfb3b800 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdf08009760 tx=0x7fdf08004730 comp rx=0 tx=0).stop 2024-09-05T01:29:48.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.444+0000 7fdf1a669740 1 -- 172.21.15.12:0/3998081128 shutdown_connections 2024-09-05T01:29:48.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.444+0000 7fdf1a669740 1 --2- 172.21.15.12:0/3998081128 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55c4bfb4e070 0x55c4bfb50510 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.444+0000 7fdf1a669740 1 --2- 172.21.15.12:0/3998081128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4bfb3de50 0x55c4bfb3b800 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.444+0000 7fdf1a669740 1 --2- 172.21.15.12:0/3998081128 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4bfb33590 0x55c4bfb3b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.444+0000 7fdf1a669740 1 --2- 172.21.15.12:0/3998081128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4bfb32c70 0x55c4bfb3ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.444+0000 7fdefea00640 0 client.25882 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:29:48.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.444+0000 7fdf1a669740 1 -- 172.21.15.12:0/3998081128 >> 172.21.15.12:0/3998081128 conn(0x55c4bfb2f200 msgr2=0x55c4bfb2e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:29:48.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.445+0000 7fdf1a669740 1 -- 172.21.15.12:0/3998081128 shutdown_connections 2024-09-05T01:29:48.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.445+0000 7fdf1a669740 1 -- 172.21.15.12:0/3998081128 wait complete. 2024-09-05T01:29:48.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.445+0000 7fdf1a669740 20 client.25882 trim_cache size 0 max 16384 2024-09-05T01:29:48.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.481+0000 7fdf1a669740 1 Processor -- start 2024-09-05T01:29:48.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.481+0000 7fdf1a669740 1 -- start start 2024-09-05T01:29:48.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.482+0000 7fdf1a669740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4bfb32c70 0x55c4bfb356d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:48.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.482+0000 7fdf1a669740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4bfb33590 0x55c4bfb3ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:48.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.482+0000 7fdf1a669740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4bfb3de50 0x55c4bfb55dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:48.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.482+0000 7fdf1a669740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdf101c4fb0 con 0x55c4bfb33590 2024-09-05T01:29:48.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.482+0000 7fdf1a669740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdf101c6d30 con 0x55c4bfb32c70 2024-09-05T01:29:48.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.482+0000 7fdf1a669740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdf101c5680 con 0x55c4bfb3de50 2024-09-05T01:29:48.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.482+0000 7fdf15200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4bfb32c70 0x55c4bfb356d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:48.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.482+0000 7fdf15200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4bfb32c70 0x55c4bfb356d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:47538/0 (socket says 172.21.15.12:47538) 2024-09-05T01:29:48.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.482+0000 7fdf15200640 1 -- 172.21.15.12:0/801250285 learned_addr learned my addr 172.21.15.12:0/801250285 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:29:48.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.483+0000 7fdf15c00640 1 --2- 172.21.15.12:0/801250285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4bfb3de50 0x55c4bfb55dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.483+0000 7fdf15c00640 1 -- 172.21.15.12:0/801250285 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4bfb32c70 msgr2=0x55c4bfb356d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:29:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.483+0000 7fdf15c00640 1 --2- 172.21.15.12:0/801250285 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4bfb32c70 0x55c4bfb356d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.483+0000 7fdf15c00640 1 -- 172.21.15.12:0/801250285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4bfb33590 msgr2=0x55c4bfb3ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:29:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.483+0000 7fdf15c00640 1 --2- 172.21.15.12:0/801250285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4bfb33590 0x55c4bfb3ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.483+0000 7fdf15c00640 1 -- 172.21.15.12:0/801250285 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4bfb50b90 con 0x55c4bfb3de50 2024-09-05T01:29:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.484+0000 7fdf15c00640 1 --2- 172.21.15.12:0/801250285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4bfb3de50 0x55c4bfb55dc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdf0800e790 tx=0x7fdf08010f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cf032a387590f91 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:29:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.485+0000 7fdf05600640 1 -- 172.21.15.12:0/801250285 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf08020070 con 0x55c4bfb3de50 2024-09-05T01:29:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.485+0000 7fdf05600640 1 -- 172.21.15.12:0/801250285 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf0803a070 con 0x55c4bfb3de50 2024-09-05T01:29:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.485+0000 7fdf05600640 1 -- 172.21.15.12:0/801250285 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf08020070 con 0x55c4bfb3de50 2024-09-05T01:29:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.486+0000 7fdf1a669740 1 -- 172.21.15.12:0/801250285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4bfb3de50 msgr2=0x55c4bfb55dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:48.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.486+0000 7fdf1a669740 1 --2- 172.21.15.12:0/801250285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4bfb3de50 0x55c4bfb55dc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdf0800e790 tx=0x7fdf08010f50 comp rx=0 tx=0).stop 2024-09-05T01:29:48.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.487+0000 7fdf1a669740 1 -- 172.21.15.12:0/801250285 shutdown_connections 2024-09-05T01:29:48.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.487+0000 7fdf1a669740 1 --2- 172.21.15.12:0/801250285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4bfb3de50 0x55c4bfb55dc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.487+0000 7fdf1a669740 1 --2- 172.21.15.12:0/801250285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4bfb33590 0x55c4bfb3ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.487+0000 7fdf1a669740 1 --2- 172.21.15.12:0/801250285 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4bfb32c70 0x55c4bfb356d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.487+0000 7fdf1a669740 1 -- 172.21.15.12:0/801250285 >> 172.21.15.12:0/801250285 conn(0x55c4bfb2f200 msgr2=0x55c4bfb3c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:29:48.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.488+0000 7fdf1a669740 1 -- 172.21.15.12:0/801250285 shutdown_connections 2024-09-05T01:29:48.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.488+0000 7fdf1a669740 1 -- 172.21.15.12:0/801250285 wait complete. 2024-09-05T01:29:48.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.489+0000 7fdf1a669740 1 -- start start 2024-09-05T01:29:48.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.489+0000 7fdf1a669740 1 Processor -- start 2024-09-05T01:29:48.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.490+0000 7fdf1a669740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4bfb32c70 0x55c4bfb37d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:48.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.491+0000 7fdf1a669740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4bfb33590 0x55c4bfb38250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:48.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.491+0000 7fdf1a669740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4bfb3de50 0x55c4bfb38790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:48.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.491+0000 7fdf1a669740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdf101c65a0 con 0x55c4bfb33590 2024-09-05T01:29:48.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.491+0000 7fdf1a669740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fdf101c5e10 con 0x55c4bfb32c70 2024-09-05T01:29:48.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.491+0000 7fdf1a669740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdf101c2f90 con 0x55c4bfb3de50 2024-09-05T01:29:48.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.492+0000 7fdf15200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4bfb32c70 0x55c4bfb37d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:48.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.492+0000 7fdf15200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4bfb32c70 0x55c4bfb37d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:47544/0 (socket says 172.21.15.12:47544) 2024-09-05T01:29:48.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.492+0000 7fdf15200640 1 -- 172.21.15.12:0/3475830769 learned_addr learned my addr 172.21.15.12:0/3475830769 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:29:48.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.492+0000 7fdf1a669740 10 client.0 _ll_register_callbacks cb 0x7fdf08014050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:29:48.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.492+0000 7fdf15c00640 1 --2- 172.21.15.12:0/3475830769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4bfb3de50 0x55c4bfb38790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:48.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.493+0000 7fdf0fe00640 1 --2- 172.21.15.12:0/3475830769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4bfb33590 0x55c4bfb38250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:48.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.493+0000 7fdf15c00640 1 -- 172.21.15.12:0/3475830769 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4bfb32c70 msgr2=0x55c4bfb37d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:29:48.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.493+0000 7fdf15c00640 1 --2- 172.21.15.12:0/3475830769 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4bfb32c70 0x55c4bfb37d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.493+0000 7fdf15c00640 1 -- 172.21.15.12:0/3475830769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4bfb33590 msgr2=0x55c4bfb38250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:29:48.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.493+0000 7fdf15c00640 1 --2- 172.21.15.12:0/3475830769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4bfb33590 0x55c4bfb38250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.494+0000 7fdf15c00640 1 -- 172.21.15.12:0/3475830769 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4bfbb7d90 con 0x55c4bfb3de50 2024-09-05T01:29:48.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.495+0000 7fdefea00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:29:48.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.495+0000 7fdf15c00640 1 --2- 172.21.15.12:0/3475830769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4bfb3de50 0x55c4bfb38790 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdf08009730 tx=0x7fdf08005820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1fa73fb7bc2f322 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:29:48.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.495+0000 7fdefea00640 1 -- 172.21.15.12:0/3475830769 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf08042070 con 0x55c4bfb3de50 2024-09-05T01:29:48.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.496+0000 7fdefea00640 1 -- 172.21.15.12:0/3475830769 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fdf08024ca0 con 0x55c4bfb3de50 2024-09-05T01:29:48.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.496+0000 7fdf1a669740 1 -- 172.21.15.12:0/3475830769 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf0803a070 con 0x55c4bfb3de50 2024-09-05T01:29:48.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.496+0000 7fdefea00640 1 -- 172.21.15.12:0/3475830769 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fdf0804c050 con 0x55c4bfb3de50 2024-09-05T01:29:48.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.496+0000 7fdf1a669740 10 client.25888 fetch_fsmap learned FSMap version 36 2024-09-05T01:29:48.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.497+0000 7fdf1a669740 1 -- 172.21.15.12:0/3475830769 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55c4bfbb8f90 con 0x55c4bfb3de50 2024-09-05T01:29:48.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.497+0000 7fdefea00640 1 -- 172.21.15.12:0/3475830769 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf0803a070 con 0x55c4bfb3de50 2024-09-05T01:29:48.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.497+0000 7fdefea00640 1 -- 172.21.15.12:0/3475830769 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 36) ==== 8426+0+0 (secure 0 0 0) 0x7fdf08034070 con 0x55c4bfb3de50 2024-09-05T01:29:48.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.497+0000 7fdf1a669740 10 client.25888 fetch_fsmap finished waiting for FSMap version 36 2024-09-05T01:29:48.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.497+0000 7fdf1a669740 10 client.25888 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-05T01:29:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.497+0000 7fdf1a669740 20 client.25888 populate_metadata read hostname 'smithi012' 2024-09-05T01:29:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.498+0000 7fdf1a669740 1 --2- 172.21.15.12:0/3475830769 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55c4bfbb9590 0x55c4bfbbb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:29:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.498+0000 7fdf1a669740 4 client.25888 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:29:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.498+0000 7fdf1a669740 1 -- 172.21.15.12:0/3475830769 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c4bfaa6950 con 0x55c4bfbb9590 2024-09-05T01:29:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.499+0000 7fdf15200640 1 --2- 172.21.15.12:0/3475830769 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55c4bfbb9590 0x55c4bfbbb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:29:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.501+0000 7fdf15200640 1 --2- 172.21.15.12:0/3475830769 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55c4bfbb9590 0x55c4bfbbb980 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9c759af3e84c1290 server_cookie=8e66edf4558743ca in_seq=0 out_seq=0 2024-09-05T01:29:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.501+0000 7fdefea00640 10 client.25888 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:29:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.502+0000 7fdefea00640 1 -- 172.21.15.12:0/3475830769 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c4bfaa6950 con 0x55c4bfbb9590 2024-09-05T01:29:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.502+0000 7fdefea00640 10 client.25888 handle_command_reply: tid=0 2024-09-05T01:29:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.502+0000 7fdf1a669740 1 client.25888 shutdown 2024-09-05T01:29:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.502+0000 7fdf1a669740 1 -- 172.21.15.12:0/3475830769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4bfb3de50 msgr2=0x55c4bfb38790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.502+0000 7fdf1a669740 1 --2- 172.21.15.12:0/3475830769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4bfb3de50 0x55c4bfb38790 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdf08009730 tx=0x7fdf08005820 comp rx=0 tx=0).stop 2024-09-05T01:29:48.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.502+0000 7fdf1a669740 1 -- 172.21.15.12:0/3475830769 shutdown_connections 2024-09-05T01:29:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.502+0000 7fdf1a669740 1 --2- 172.21.15.12:0/3475830769 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55c4bfbb9590 0x55c4bfbbb980 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.502+0000 7fdf1a669740 1 --2- 172.21.15.12:0/3475830769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4bfb3de50 0x55c4bfb38790 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.502+0000 7fdf1a669740 1 --2- 172.21.15.12:0/3475830769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4bfb33590 0x55c4bfb38250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.502+0000 7fdf1a669740 1 --2- 172.21.15.12:0/3475830769 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4bfb32c70 0x55c4bfb37d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.502+0000 7fdf1a669740 1 -- 172.21.15.12:0/3475830769 >> 172.21.15.12:0/3475830769 conn(0x55c4bfb2f200 msgr2=0x55c4bfb39250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:29:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.503+0000 7fdefea00640 0 client.25888 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:29:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.504+0000 7fdf1a669740 1 -- 172.21.15.12:0/3475830769 shutdown_connections 2024-09-05T01:29:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.504+0000 7fdf1a669740 1 -- 172.21.15.12:0/3475830769 wait complete. 2024-09-05T01:29:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.504+0000 7fdf1a669740 20 client.25888 trim_cache size 0 max 16384 2024-09-05T01:29:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.505+0000 7fdf17c00640 1 -- 172.21.15.12:0/1438087206 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fdef40a2ec0 msgr2=0x7fdef40a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.505+0000 7fdf17c00640 1 --2- 172.21.15.12:0/1438087206 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fdef40a2ec0 0x7fdef40a5380 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdf080095f0 tx=0x7fdf08005f90 comp rx=0 tx=0).stop 2024-09-05T01:29:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.506+0000 7fdf17c00640 1 -- 172.21.15.12:0/1438087206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf101091f0 msgr2=0x7fdf101119d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:29:48.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.506+0000 7fdf17c00640 1 --2- 172.21.15.12:0/1438087206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf101091f0 0x7fdf101119d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdf00004770 tx=0x7fdf00003c10 comp rx=0 tx=0).stop 2024-09-05T01:29:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.506+0000 7fdf17c00640 1 -- 172.21.15.12:0/1438087206 shutdown_connections 2024-09-05T01:29:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.506+0000 7fdf17c00640 1 --2- 172.21.15.12:0/1438087206 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fdef40a2ec0 0x7fdef40a5380 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.506+0000 7fdf17c00640 1 --2- 172.21.15.12:0/1438087206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fdf10116ea0 0x7fdf10122a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.506+0000 7fdf17c00640 1 --2- 172.21.15.12:0/1438087206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf10109b10 0x7fdf10111f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.506+0000 7fdf17c00640 1 --2- 172.21.15.12:0/1438087206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf101091f0 0x7fdf101119d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:29:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.506+0000 7fdf17c00640 1 -- 172.21.15.12:0/1438087206 >> 172.21.15.12:0/1438087206 conn(0x7fdf1006e140 msgr2=0x7fdf10117620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:29:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.507+0000 7fdf17c00640 1 -- 172.21.15.12:0/1438087206 shutdown_connections 2024-09-05T01:29:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:29:48.507+0000 7fdf17c00640 1 -- 172.21.15.12:0/1438087206 wait complete. 2024-09-05T01:29:49.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:48 smithi145 ceph-mon[34376]: pgmap v156: 97 pgs: 97 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 218 op/s 2024-09-05T01:29:49.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:48 smithi151 ceph-mon[35013]: pgmap v156: 97 pgs: 97 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 218 op/s 2024-09-05T01:29:49.105 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:48 smithi012 ceph-mon[29942]: pgmap v156: 97 pgs: 97 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 218 op/s 2024-09-05T01:29:49.222 INFO:tasks.workunit.client.0.smithi012.stdout: 525 601685 1648 427273 1784 159193 1645 2024-09-05T01:29:51.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:50 smithi145 ceph-mon[34376]: pgmap v157: 97 pgs: 97 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.0 MiB/s wr, 296 op/s 2024-09-05T01:29:51.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:50 smithi151 ceph-mon[35013]: pgmap v157: 97 pgs: 97 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.0 MiB/s wr, 296 op/s 2024-09-05T01:29:51.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:50 smithi012 ceph-mon[29942]: pgmap v157: 97 pgs: 97 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.0 MiB/s wr, 296 op/s 2024-09-05T01:29:51.487 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-05T01:29:53.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:52 smithi151 ceph-mon[35013]: pgmap v158: 97 pgs: 97 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.8 MiB/s wr, 258 op/s 2024-09-05T01:29:53.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:52 smithi012 ceph-mon[29942]: pgmap v158: 97 pgs: 97 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.8 MiB/s wr, 258 op/s 2024-09-05T01:29:53.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:52 smithi145 ceph-mon[34376]: pgmap v158: 97 pgs: 97 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.8 MiB/s wr, 258 op/s 2024-09-05T01:29:55.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:54 smithi151 ceph-mon[35013]: pgmap v159: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 507 op/s 2024-09-05T01:29:55.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:54 smithi145 ceph-mon[34376]: pgmap v159: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 507 op/s 2024-09-05T01:29:55.343 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:54 smithi012 ceph-mon[29942]: pgmap v159: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 507 op/s 2024-09-05T01:29:57.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:56 smithi151 ceph-mon[35013]: pgmap v160: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 10 MiB/s wr, 445 op/s 2024-09-05T01:29:57.317 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:56 smithi012 ceph-mon[29942]: pgmap v160: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 10 MiB/s wr, 445 op/s 2024-09-05T01:29:57.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:56 smithi145 ceph-mon[34376]: pgmap v160: 97 pgs: 97 active+clean; 1.9 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 10 MiB/s wr, 445 op/s 2024-09-05T01:29:59.226 INFO:tasks.workunit.client.0.smithi012.stdout: 544 477578 751 338403 908 126078 693 2024-09-05T01:29:59.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:29:58 smithi012 ceph-mon[29942]: pgmap v161: 97 pgs: 97 active+clean; 1.9 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 13 MiB/s wr, 555 op/s 2024-09-05T01:29:59.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:29:58 smithi145 ceph-mon[34376]: pgmap v161: 97 pgs: 97 active+clean; 1.9 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 13 MiB/s wr, 555 op/s 2024-09-05T01:29:59.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:29:58 smithi151 ceph-mon[35013]: pgmap v161: 97 pgs: 97 active+clean; 1.9 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 13 MiB/s wr, 555 op/s 2024-09-05T01:30:01.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:00 smithi012 ceph-mon[29942]: pgmap v162: 97 pgs: 97 active+clean; 2.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 26 MiB/s wr, 1.15k op/s 2024-09-05T01:30:01.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:00 smithi012 ceph-mon[29942]: overall HEALTH_OK 2024-09-05T01:30:01.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:00 smithi145 ceph-mon[34376]: pgmap v162: 97 pgs: 97 active+clean; 2.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 26 MiB/s wr, 1.15k op/s 2024-09-05T01:30:01.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:00 smithi145 ceph-mon[34376]: overall HEALTH_OK 2024-09-05T01:30:01.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:00 smithi151 ceph-mon[35013]: pgmap v162: 97 pgs: 97 active+clean; 2.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 26 MiB/s wr, 1.15k op/s 2024-09-05T01:30:01.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:00 smithi151 ceph-mon[35013]: overall HEALTH_OK 2024-09-05T01:30:03.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:02 smithi012 ceph-mon[29942]: pgmap v163: 97 pgs: 97 active+clean; 2.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 26 MiB/s wr, 1.16k op/s 2024-09-05T01:30:03.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:02 smithi145 ceph-mon[34376]: pgmap v163: 97 pgs: 97 active+clean; 2.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 26 MiB/s wr, 1.16k op/s 2024-09-05T01:30:03.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:02 smithi151 ceph-mon[35013]: pgmap v163: 97 pgs: 97 active+clean; 2.1 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 26 MiB/s wr, 1.16k op/s 2024-09-05T01:30:03.459 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:30:05.168 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:04 smithi012 ceph-mon[29942]: pgmap v164: 97 pgs: 97 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 27 MiB/s wr, 1.27k op/s 2024-09-05T01:30:05.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:04 smithi145 ceph-mon[34376]: pgmap v164: 97 pgs: 97 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 27 MiB/s wr, 1.27k op/s 2024-09-05T01:30:05.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:04 smithi151 ceph-mon[35013]: pgmap v164: 97 pgs: 97 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 27 MiB/s wr, 1.27k op/s 2024-09-05T01:30:05.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.585+0000 7fe8e8a00640 1 -- 172.21.15.12:0/3574005737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8dc097790 msgr2=0x7fe8dc097bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:05.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.585+0000 7fe8e8a00640 1 --2- 172.21.15.12:0/3574005737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8dc097790 0x7fe8dc097bf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009930 tx=0x7fe8d002a480 comp rx=0 tx=0).stop 2024-09-05T01:30:05.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.585+0000 7fe8e8a00640 1 -- 172.21.15.12:0/3574005737 shutdown_connections 2024-09-05T01:30:05.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.585+0000 7fe8e8a00640 1 --2- 172.21.15.12:0/3574005737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8dc098130 0x7fe8dc0a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.585+0000 7fe8e8a00640 1 --2- 172.21.15.12:0/3574005737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8dc097790 0x7fe8dc097bf0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.585+0000 7fe8e8a00640 1 --2- 172.21.15.12:0/3574005737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe8dc09d790 0x7fe8dc09db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.585+0000 7fe8e8a00640 1 -- 172.21.15.12:0/3574005737 >> 172.21.15.12:0/3574005737 conn(0x7fe8dc093430 msgr2=0x7fe8dc095850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:30:05.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.585+0000 7fe8e8a00640 1 -- 172.21.15.12:0/3574005737 shutdown_connections 2024-09-05T01:30:05.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.585+0000 7fe8e8a00640 1 -- 172.21.15.12:0/3574005737 wait complete. 2024-09-05T01:30:05.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.587+0000 7fe8e8a00640 1 Processor -- start 2024-09-05T01:30:05.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.587+0000 7fe8e8a00640 1 -- start start 2024-09-05T01:30:05.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.588+0000 7fe8e8a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8dc097790 0x7fe8dc0a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:05.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.589+0000 7fe8e3400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8dc097790 0x7fe8dc0a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:05.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.589+0000 7fe8e3400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8dc097790 0x7fe8dc0a4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:45364/0 (socket says 172.21.15.12:45364) 2024-09-05T01:30:05.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.589+0000 7fe8e3400640 1 -- 172.21.15.12:0/3982095418 learned_addr learned my addr 172.21.15.12:0/3982095418 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:30:05.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.589+0000 7fe8e8a00640 1 --2- 172.21.15.12:0/3982095418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe8dc098130 0x7fe8dc0a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:05.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.589+0000 7fe8e8a00640 1 --2- 172.21.15.12:0/3982095418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8dc09d790 0x7fe8dc0a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:05.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.589+0000 7fe8e8a00640 1 -- 172.21.15.12:0/3982095418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc0a7be0 con 0x7fe8dc09d790 2024-09-05T01:30:05.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.589+0000 7fe8e2a00640 1 --2- 172.21.15.12:0/3982095418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe8dc098130 0x7fe8dc0a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:05.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.590+0000 7fe8e3e00640 1 --2- 172.21.15.12:0/3982095418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8dc09d790 0x7fe8dc0a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:05.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.590+0000 7fe8e8a00640 1 -- 172.21.15.12:0/3982095418 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc0a7a60 con 0x7fe8dc098130 2024-09-05T01:30:05.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.590+0000 7fe8e8a00640 1 -- 172.21.15.12:0/3982095418 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc0a7d60 con 0x7fe8dc097790 2024-09-05T01:30:05.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.592+0000 7fe8e3e00640 1 -- 172.21.15.12:0/3982095418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8dc097790 msgr2=0x7fe8dc0a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:05.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.592+0000 7fe8e3e00640 1 --2- 172.21.15.12:0/3982095418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8dc097790 0x7fe8dc0a4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.592+0000 7fe8e3e00640 1 -- 172.21.15.12:0/3982095418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe8dc098130 msgr2=0x7fe8dc0a14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:05.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.592+0000 7fe8e3e00640 1 --2- 172.21.15.12:0/3982095418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe8dc098130 0x7fe8dc0a14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.592+0000 7fe8e3e00640 1 -- 172.21.15.12:0/3982095418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8dc0a22a0 con 0x7fe8dc09d790 2024-09-05T01:30:05.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.594+0000 7fe8e3400640 1 --2- 172.21.15.12:0/3982095418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8dc097790 0x7fe8dc0a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:30:05.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.594+0000 7fe8e3e00640 1 --2- 172.21.15.12:0/3982095418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8dc09d790 0x7fe8dc0a1a00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4050280 tx=0x7fe8e40691d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:30:05.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.595+0000 7fe8d7e00640 1 -- 172.21.15.12:0/3982095418 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4074ca0 con 0x7fe8dc09d790 2024-09-05T01:30:05.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.596+0000 7fe8d7e00640 1 -- 172.21.15.12:0/3982095418 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8e4084020 con 0x7fe8dc09d790 2024-09-05T01:30:05.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.599+0000 7fe8e8a00640 1 -- 172.21.15.12:0/3982095418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8dc1340a0 con 0x7fe8dc09d790 2024-09-05T01:30:05.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.599+0000 7fe8e8a00640 1 -- 172.21.15.12:0/3982095418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8dc134560 con 0x7fe8dc09d790 2024-09-05T01:30:05.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.600+0000 7fe8d7e00640 1 -- 172.21.15.12:0/3982095418 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e407e600 con 0x7fe8dc09d790 2024-09-05T01:30:05.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.610+0000 7fe8d7e00640 1 -- 172.21.15.12:0/3982095418 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fe8e407e7a0 con 0x7fe8dc09d790 2024-09-05T01:30:05.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.612+0000 7fe8d7e00640 1 --2- 172.21.15.12:0/3982095418 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe8cc0a2d80 0x7fe8cc0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:05.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.613+0000 7fe8eca23740 1 Processor -- start 2024-09-05T01:30:05.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.613+0000 7fe8d7e00640 1 -- 172.21.15.12:0/3982095418 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fe8e407f620 con 0x7fe8dc09d790 2024-09-05T01:30:05.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.613+0000 7fe8eca23740 1 -- start start 2024-09-05T01:30:05.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.614+0000 7fe8eca23740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646ecd69e70 0x5646ecd6a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:05.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.615+0000 7fe8eca23740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646ecd6a790 0x5646ecd74b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:05.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.615+0000 7fe8eca23740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 0x5646ecd77440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:05.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.615+0000 7fe8e2a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646ecd6a790 0x5646ecd74b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:05.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.615+0000 7fe8e3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 0x5646ecd77440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:05.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.615+0000 7fe8e3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 0x5646ecd77440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48756/0 (socket says 172.21.15.12:48756) 2024-09-05T01:30:05.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.615+0000 7fe8e3e00640 1 -- 172.21.15.12:0/227048176 learned_addr learned my addr 172.21.15.12:0/227048176 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:30:05.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.615+0000 7fe8eca23740 1 -- 172.21.15.12:0/227048176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5646eccd03e0 con 0x5646ecd75050 2024-09-05T01:30:05.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.615+0000 7fe8eca23740 1 -- 172.21.15.12:0/227048176 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5646ecc77d80 con 0x5646ecd69e70 2024-09-05T01:30:05.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.615+0000 7fe8eca23740 1 -- 172.21.15.12:0/227048176 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5646ecccc3a0 con 0x5646ecd6a790 2024-09-05T01:30:05.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.616+0000 7fe8e3e00640 1 -- 172.21.15.12:0/227048176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646ecd6a790 msgr2=0x5646ecd74b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:05.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.616+0000 7fe8e3e00640 1 --2- 172.21.15.12:0/227048176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646ecd6a790 0x5646ecd74b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.616+0000 7fe8e3e00640 1 -- 172.21.15.12:0/227048176 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646ecd69e70 msgr2=0x5646ecd6a250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:30:05.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.616+0000 7fe8e3e00640 1 --2- 172.21.15.12:0/227048176 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646ecd69e70 0x5646ecd6a250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.616+0000 7fe8e3e00640 1 -- 172.21.15.12:0/227048176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646ecc96ae0 con 0x5646ecd75050 2024-09-05T01:30:05.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.617+0000 7fe8e2a00640 1 --2- 172.21.15.12:0/227048176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646ecd6a790 0x5646ecd74b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:30:05.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.617+0000 7fe8e3e00640 1 --2- 172.21.15.12:0/227048176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 0x5646ecd77440 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4067960 tx=0x7fe8e4108b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2712f5637f0d84a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:30:05.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.617+0000 7fe8cbe00640 1 -- 172.21.15.12:0/227048176 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4083030 con 0x5646ecd75050 2024-09-05T01:30:05.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.617+0000 7fe8cbe00640 1 -- 172.21.15.12:0/227048176 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8e410ee50 con 0x5646ecd75050 2024-09-05T01:30:05.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.618+0000 7fe8cbe00640 1 -- 172.21.15.12:0/227048176 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4140060 con 0x5646ecd75050 2024-09-05T01:30:05.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.619+0000 7fe8eca23740 1 -- 172.21.15.12:0/227048176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 msgr2=0x5646ecd77440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:05.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.619+0000 7fe8eca23740 1 --2- 172.21.15.12:0/227048176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 0x5646ecd77440 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4067960 tx=0x7fe8e4108b70 comp rx=0 tx=0).stop 2024-09-05T01:30:05.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.619+0000 7fe8eca23740 1 -- 172.21.15.12:0/227048176 shutdown_connections 2024-09-05T01:30:05.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.619+0000 7fe8eca23740 1 --2- 172.21.15.12:0/227048176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 0x5646ecd77440 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.619+0000 7fe8eca23740 1 --2- 172.21.15.12:0/227048176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646ecd6a790 0x5646ecd74b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.619+0000 7fe8eca23740 1 --2- 172.21.15.12:0/227048176 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646ecd69e70 0x5646ecd6a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.619+0000 7fe8eca23740 1 -- 172.21.15.12:0/227048176 >> 172.21.15.12:0/227048176 conn(0x5646ecd66400 msgr2=0x5646ecd667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:30:05.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.621+0000 7fe8e3400640 1 --2- 172.21.15.12:0/3982095418 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe8cc0a2d80 0x7fe8cc0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:05.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.624+0000 7fe8e3400640 1 --2- 172.21.15.12:0/3982095418 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe8cc0a2d80 0x7fe8cc0a5240 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009d20 tx=0x7fe8d80092a0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:30:05.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.624+0000 7fe8eca23740 1 -- 172.21.15.12:0/227048176 shutdown_connections 2024-09-05T01:30:05.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.624+0000 7fe8eca23740 1 -- 172.21.15.12:0/227048176 wait complete. 2024-09-05T01:30:05.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.625+0000 7fe8eca23740 1 -- start start 2024-09-05T01:30:05.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.626+0000 7fe8eca23740 1 Processor -- start 2024-09-05T01:30:05.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.626+0000 7fe8eca23740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646ecd6a790 0x5646ecd720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:05.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.626+0000 7fe8eca23740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 0x5646ecd72620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:05.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.626+0000 7fe8eca23740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646ecd72b60 0x5646ecd81090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:05.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.628+0000 7fe8eca23740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5646ecd77c20 con 0x5646ecd75050 2024-09-05T01:30:05.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.628+0000 7fe8eca23740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5646ecc8b0f0 con 0x5646ecd72b60 2024-09-05T01:30:05.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.628+0000 7fe8eca23740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5646ecd77da0 con 0x5646ecd6a790 2024-09-05T01:30:05.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.628+0000 7fe8e2a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 0x5646ecd72620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:05.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.629+0000 7fe8e2a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 0x5646ecd72620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48768/0 (socket says 172.21.15.12:48768) 2024-09-05T01:30:05.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.629+0000 7fe8e2a00640 1 -- 172.21.15.12:0/1204776766 learned_addr learned my addr 172.21.15.12:0/1204776766 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:30:05.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.629+0000 7fe8e3e00640 1 --2- 172.21.15.12:0/1204776766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646ecd72b60 0x5646ecd81090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:05.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.628+0000 7fe8eca23740 10 client.0 _ll_register_callbacks cb 0x5646ecc72bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:30:05.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.630+0000 7fe8e3e00640 1 -- 172.21.15.12:0/1204776766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646ecd6a790 msgr2=0x5646ecd720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:05.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.630+0000 7fe8e3400640 1 --2- 172.21.15.12:0/1204776766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646ecd6a790 0x5646ecd720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.630+0000 7fe8e3e00640 1 --2- 172.21.15.12:0/1204776766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646ecd6a790 0x5646ecd720e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.630+0000 7fe8e3e00640 1 -- 172.21.15.12:0/1204776766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 msgr2=0x5646ecd72620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.630+0000 7fe8e3e00640 1 --2- 172.21.15.12:0/1204776766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 0x5646ecd72620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.630+0000 7fe8e3e00640 1 -- 172.21.15.12:0/1204776766 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646eca413c0 con 0x5646ecd72b60 2024-09-05T01:30:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.633+0000 7fe8eca23740 1 -- 172.21.15.12:0/1204776766 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8e410ee50 con 0x5646ecd72b60 2024-09-05T01:30:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.633+0000 7fe8e3400640 1 --2- 172.21.15.12:0/1204776766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646ecd6a790 0x5646ecd720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:30:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.633+0000 7fe8e3e00640 1 --2- 172.21.15.12:0/1204776766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646ecd72b60 0x5646ecd81090 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4000b60 tx=0x7fe8e407fd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2b088d97d119fda server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:30:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.633+0000 7fe8c8c00640 10 client.25901 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:30:05.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.634+0000 7fe8c8c00640 1 -- 172.21.15.12:0/1204776766 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4083030 con 0x5646ecd72b60 2024-09-05T01:30:05.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.635+0000 7fe8c8c00640 1 -- 172.21.15.12:0/1204776766 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fe8e4108330 con 0x5646ecd72b60 2024-09-05T01:30:05.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.635+0000 7fe8c8c00640 1 -- 172.21.15.12:0/1204776766 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fe8e41211a0 con 0x5646ecd72b60 2024-09-05T01:30:05.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.635+0000 7fe8eca23740 10 client.25901 fetch_fsmap learned FSMap version 36 2024-09-05T01:30:05.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.635+0000 7fe8eca23740 1 -- 172.21.15.12:0/1204776766 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({fsmap=36}) -- 0x5646ecd84050 con 0x5646ecd72b60 2024-09-05T01:30:05.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.636+0000 7fe8c8c00640 1 -- 172.21.15.12:0/1204776766 <== mon.2 v2:172.21.15.145:3300/0 4 ==== fsmap(e 36) ==== 8426+0+0 (secure 0 0 0) 0x7fe8e41049a0 con 0x5646ecd72b60 2024-09-05T01:30:05.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.636+0000 7fe8eca23740 10 client.25901 fetch_fsmap finished waiting for FSMap version 36 2024-09-05T01:30:05.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.636+0000 7fe8eca23740 10 client.25901 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T01:30:05.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.636+0000 7fe8eca23740 20 client.25901 populate_metadata read hostname 'smithi012' 2024-09-05T01:30:05.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.636+0000 7fe8eca23740 1 --2- 172.21.15.12:0/1204776766 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5646ecd855f0 0x5646ecd87a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:05.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.636+0000 7fe8eca23740 4 client.25901 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:30:05.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.636+0000 7fe8eca23740 1 -- 172.21.15.12:0/1204776766 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646eccdd950 con 0x5646ecd855f0 2024-09-05T01:30:05.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.636+0000 7fe8e3400640 1 --2- 172.21.15.12:0/1204776766 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5646ecd855f0 0x5646ecd87a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:05.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.637+0000 7fe8e3400640 1 --2- 172.21.15.12:0/1204776766 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5646ecd855f0 0x5646ecd87a90 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=edbc52c696cf46df server_cookie=585605840db1855d in_seq=0 out_seq=0 2024-09-05T01:30:05.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.637+0000 7fe8c8c00640 10 client.25901 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:30:05.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.638+0000 7fe8c8c00640 1 -- 172.21.15.12:0/1204776766 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5646eccdd950 con 0x5646ecd855f0 2024-09-05T01:30:05.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.638+0000 7fe8c8c00640 10 client.25901 handle_command_reply: tid=0 2024-09-05T01:30:05.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.638+0000 7fe8eca23740 1 client.25901 shutdown 2024-09-05T01:30:05.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.639+0000 7fe8eca23740 1 -- 172.21.15.12:0/1204776766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646ecd72b60 msgr2=0x5646ecd81090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:05.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.639+0000 7fe8eca23740 1 --2- 172.21.15.12:0/1204776766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646ecd72b60 0x5646ecd81090 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4000b60 tx=0x7fe8e407fd50 comp rx=0 tx=0).stop 2024-09-05T01:30:05.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.639+0000 7fe8eca23740 1 -- 172.21.15.12:0/1204776766 shutdown_connections 2024-09-05T01:30:05.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.639+0000 7fe8eca23740 1 --2- 172.21.15.12:0/1204776766 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5646ecd855f0 0x5646ecd87a90 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.639+0000 7fe8eca23740 1 --2- 172.21.15.12:0/1204776766 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646ecd72b60 0x5646ecd81090 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.639+0000 7fe8eca23740 1 --2- 172.21.15.12:0/1204776766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 0x5646ecd72620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.639+0000 7fe8eca23740 1 --2- 172.21.15.12:0/1204776766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646ecd6a790 0x5646ecd720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.639+0000 7fe8c8c00640 0 client.25901 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:30:05.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.639+0000 7fe8eca23740 1 -- 172.21.15.12:0/1204776766 >> 172.21.15.12:0/1204776766 conn(0x5646ecd66400 msgr2=0x5646ecd65580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:30:05.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.639+0000 7fe8eca23740 1 -- 172.21.15.12:0/1204776766 shutdown_connections 2024-09-05T01:30:05.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.639+0000 7fe8eca23740 1 -- 172.21.15.12:0/1204776766 wait complete. 2024-09-05T01:30:05.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.640+0000 7fe8eca23740 20 client.25901 trim_cache size 0 max 16384 2024-09-05T01:30:05.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.671+0000 7fe8eca23740 1 Processor -- start 2024-09-05T01:30:05.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.671+0000 7fe8eca23740 1 -- start start 2024-09-05T01:30:05.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.671+0000 7fe8eca23740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646ecd6a790 0x5646ecd80e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:05.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.671+0000 7fe8eca23740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646ecd72b60 0x5646ecd8d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:05.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.671+0000 7fe8eca23740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 0x5646ecd8d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:05.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.672+0000 7fe8e3400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646ecd6a790 0x5646ecd80e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:05.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.672+0000 7fe8e2a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646ecd72b60 0x5646ecd8d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:05.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.672+0000 7fe8e2a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646ecd72b60 0x5646ecd8d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:45398/0 (socket says 172.21.15.12:45398) 2024-09-05T01:30:05.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.672+0000 7fe8e3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 0x5646ecd8d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:05.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.672+0000 7fe8e3400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646ecd6a790 0x5646ecd80e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:60448/0 (socket says 172.21.15.12:60448) 2024-09-05T01:30:05.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.672+0000 7fe8e2a00640 1 -- 172.21.15.12:0/1912263175 learned_addr learned my addr 172.21.15.12:0/1912263175 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:30:05.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.672+0000 7fe8eca23740 1 -- 172.21.15.12:0/1912263175 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c400e790 con 0x5646ecd75050 2024-09-05T01:30:05.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.672+0000 7fe8eca23740 1 -- 172.21.15.12:0/1912263175 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c4010510 con 0x5646ecd6a790 2024-09-05T01:30:05.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.672+0000 7fe8eca23740 1 -- 172.21.15.12:0/1912263175 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c400ee60 con 0x5646ecd72b60 2024-09-05T01:30:05.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.673+0000 7fe8e3400640 1 -- 172.21.15.12:0/1912263175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646ecd72b60 msgr2=0x5646ecd8d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:05.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.673+0000 7fe8e3400640 1 --2- 172.21.15.12:0/1912263175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646ecd72b60 0x5646ecd8d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.673+0000 7fe8e3400640 1 -- 172.21.15.12:0/1912263175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 msgr2=0x5646ecd8d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:05.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.673+0000 7fe8e3400640 1 --2- 172.21.15.12:0/1912263175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 0x5646ecd8d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.673+0000 7fe8e3400640 1 -- 172.21.15.12:0/1912263175 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646ecd74a50 con 0x5646ecd6a790 2024-09-05T01:30:05.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.673+0000 7fe8e3e00640 1 --2- 172.21.15.12:0/1912263175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 0x5646ecd8d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:30:05.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.674+0000 7fe8e3400640 1 --2- 172.21.15.12:0/1912263175 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646ecd6a790 0x5646ecd80e80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x5646ecd882d0 tx=0x7fe8d8011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e7854a4c21b02bb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:30:05.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.674+0000 7fe8cb400640 1 -- 172.21.15.12:0/1912263175 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8004020 con 0x5646ecd6a790 2024-09-05T01:30:05.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.674+0000 7fe8cb400640 1 -- 172.21.15.12:0/1912263175 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8d8017040 con 0x5646ecd6a790 2024-09-05T01:30:05.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.675+0000 7fe8cb400640 1 -- 172.21.15.12:0/1912263175 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8004020 con 0x5646ecd6a790 2024-09-05T01:30:05.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.676+0000 7fe8eca23740 1 -- 172.21.15.12:0/1912263175 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646ecd6a790 msgr2=0x5646ecd80e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:05.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.676+0000 7fe8eca23740 1 --2- 172.21.15.12:0/1912263175 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646ecd6a790 0x5646ecd80e80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x5646ecd882d0 tx=0x7fe8d8011000 comp rx=0 tx=0).stop 2024-09-05T01:30:05.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.676+0000 7fe8eca23740 1 -- 172.21.15.12:0/1912263175 shutdown_connections 2024-09-05T01:30:05.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.676+0000 7fe8eca23740 1 --2- 172.21.15.12:0/1912263175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 0x5646ecd8d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.676+0000 7fe8eca23740 1 --2- 172.21.15.12:0/1912263175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646ecd72b60 0x5646ecd8d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.676+0000 7fe8eca23740 1 --2- 172.21.15.12:0/1912263175 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646ecd6a790 0x5646ecd80e80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.676+0000 7fe8eca23740 1 -- 172.21.15.12:0/1912263175 >> 172.21.15.12:0/1912263175 conn(0x5646ecd66400 msgr2=0x5646ecd711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:30:05.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.678+0000 7fe8eca23740 1 -- 172.21.15.12:0/1912263175 shutdown_connections 2024-09-05T01:30:05.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.678+0000 7fe8eca23740 1 -- 172.21.15.12:0/1912263175 wait complete. 2024-09-05T01:30:05.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.678+0000 7fe8eca23740 1 -- start start 2024-09-05T01:30:05.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.679+0000 7fe8eca23740 1 Processor -- start 2024-09-05T01:30:05.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.680+0000 7fe8eca23740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646ecd6a790 0x5646ecd7d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:05.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.680+0000 7fe8eca23740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646ecd72b60 0x5646ecd7d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:05.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.681+0000 7fe8eca23740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 0x5646ecd78940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:05.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.681+0000 7fe8e3400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646ecd6a790 0x5646ecd7d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:05.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.681+0000 7fe8e3400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646ecd6a790 0x5646ecd7d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:60458/0 (socket says 172.21.15.12:60458) 2024-09-05T01:30:05.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.681+0000 7fe8e2a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646ecd72b60 0x5646ecd7d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:05.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.682+0000 7fe8e3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 0x5646ecd78940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:05.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.682+0000 7fe8e3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 0x5646ecd78940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48786/0 (socket says 172.21.15.12:48786) 2024-09-05T01:30:05.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.682+0000 7fe8e2a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646ecd72b60 0x5646ecd7d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:45412/0 (socket says 172.21.15.12:45412) 2024-09-05T01:30:05.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.682+0000 7fe8eca23740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c400fd80 con 0x5646ecd75050 2024-09-05T01:30:05.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.682+0000 7fe8eca23740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c400f5f0 con 0x5646ecd6a790 2024-09-05T01:30:05.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.682+0000 7fe8eca23740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c400c770 con 0x5646ecd72b60 2024-09-05T01:30:05.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.682+0000 7fe8eca23740 10 client.0 _ll_register_callbacks cb 0x7fe8e4108820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:30:05.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.682+0000 7fe8e2a00640 1 -- 172.21.15.12:0/754779920 learned_addr learned my addr 172.21.15.12:0/754779920 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:30:05.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.683+0000 7fe8e3e00640 1 -- 172.21.15.12:0/754779920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646ecd72b60 msgr2=0x5646ecd7d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:05.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.683+0000 7fe8e3e00640 1 --2- 172.21.15.12:0/754779920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646ecd72b60 0x5646ecd7d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.683+0000 7fe8e3e00640 1 -- 172.21.15.12:0/754779920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646ecd6a790 msgr2=0x5646ecd7d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:05.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.683+0000 7fe8e3e00640 1 --2- 172.21.15.12:0/754779920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646ecd6a790 0x5646ecd7d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.683+0000 7fe8e3e00640 1 -- 172.21.15.12:0/754779920 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646ecd79170 con 0x5646ecd75050 2024-09-05T01:30:05.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.684+0000 7fe8e3400640 1 --2- 172.21.15.12:0/754779920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646ecd6a790 0x5646ecd7d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-05T01:30:05.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.685+0000 7fe8c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:30:05.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.685+0000 7fe8e3e00640 1 --2- 172.21.15.12:0/754779920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 0x5646ecd78940 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4051220 tx=0x7fe8e407fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f71588b17319f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:30:05.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.686+0000 7fe8c8c00640 1 -- 172.21.15.12:0/754779920 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4083040 con 0x5646ecd75050 2024-09-05T01:30:05.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.686+0000 7fe8c8c00640 1 -- 172.21.15.12:0/754779920 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7fe8e4108340 con 0x5646ecd75050 2024-09-05T01:30:05.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.686+0000 7fe8eca23740 1 -- 172.21.15.12:0/754779920 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8d8017040 con 0x5646ecd75050 2024-09-05T01:30:05.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.687+0000 7fe8c8c00640 1 -- 172.21.15.12:0/754779920 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fe8e410c1b0 con 0x5646ecd75050 2024-09-05T01:30:05.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.687+0000 7fe8eca23740 10 client.15861 fetch_fsmap learned FSMap version 36 2024-09-05T01:30:05.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.687+0000 7fe8eca23740 1 -- 172.21.15.12:0/754779920 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5646ecdeff90 con 0x5646ecd75050 2024-09-05T01:30:05.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.688+0000 7fe8c8c00640 1 -- 172.21.15.12:0/754779920 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8e40ee080 con 0x5646ecd75050 2024-09-05T01:30:05.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.690+0000 7fe8c8c00640 1 -- 172.21.15.12:0/754779920 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 36) ==== 8426+0+0 (secure 0 0 0) 0x7fe8e407ecd0 con 0x5646ecd75050 2024-09-05T01:30:05.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.690+0000 7fe8eca23740 10 client.15861 fetch_fsmap finished waiting for FSMap version 36 2024-09-05T01:30:05.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.690+0000 7fe8eca23740 10 client.15861 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T01:30:05.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.690+0000 7fe8eca23740 20 client.15861 populate_metadata read hostname 'smithi012' 2024-09-05T01:30:05.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.690+0000 7fe8eca23740 1 --2- 172.21.15.12:0/754779920 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5646ecdf0520 0x5646ecdf2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:05.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.690+0000 7fe8eca23740 4 client.15861 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:30:05.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.690+0000 7fe8eca23740 1 -- 172.21.15.12:0/754779920 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5646eccd7e60 con 0x5646ecdf0520 2024-09-05T01:30:05.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.690+0000 7fe8e3400640 1 --2- 172.21.15.12:0/754779920 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5646ecdf0520 0x5646ecdf2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:05.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.691+0000 7fe8e3400640 1 --2- 172.21.15.12:0/754779920 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5646ecdf0520 0x5646ecdf2940 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fdae58930bbceb7d server_cookie=e229fcf95c9a4519 in_seq=0 out_seq=0 2024-09-05T01:30:05.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.691+0000 7fe8c8c00640 10 client.15861 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:30:05.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.695+0000 7fe8c8c00640 1 -- 172.21.15.12:0/754779920 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5646eccd7e60 con 0x5646ecdf0520 2024-09-05T01:30:05.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.695+0000 7fe8c8c00640 10 client.15861 handle_command_reply: tid=0 2024-09-05T01:30:05.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.695+0000 7fe8eca23740 1 client.15861 shutdown 2024-09-05T01:30:05.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.695+0000 7fe8eca23740 1 -- 172.21.15.12:0/754779920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 msgr2=0x5646ecd78940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:05.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.695+0000 7fe8eca23740 1 --2- 172.21.15.12:0/754779920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 0x5646ecd78940 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4051220 tx=0x7fe8e407fce0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.695+0000 7fe8eca23740 1 -- 172.21.15.12:0/754779920 shutdown_connections 2024-09-05T01:30:05.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.696+0000 7fe8eca23740 1 --2- 172.21.15.12:0/754779920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646ecd75050 0x5646ecd78940 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.696+0000 7fe8eca23740 1 --2- 172.21.15.12:0/754779920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646ecd72b60 0x5646ecd7d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.696+0000 7fe8eca23740 1 --2- 172.21.15.12:0/754779920 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5646ecdf0520 0x5646ecdf2940 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.696+0000 7fe8eca23740 1 --2- 172.21.15.12:0/754779920 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646ecd6a790 0x5646ecd7d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.696+0000 7fe8eca23740 1 -- 172.21.15.12:0/754779920 >> 172.21.15.12:0/754779920 conn(0x5646ecd66400 msgr2=0x5646ecd64d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:30:05.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.696+0000 7fe8c8c00640 0 client.15861 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:30:05.699 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:30:05.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.696+0000 7fe8eca23740 1 -- 172.21.15.12:0/754779920 shutdown_connections 2024-09-05T01:30:05.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.696+0000 7fe8eca23740 1 -- 172.21.15.12:0/754779920 wait complete. 2024-09-05T01:30:05.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.696+0000 7fe8eca23740 20 client.15861 trim_cache size 0 max 16384 2024-09-05T01:30:05.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.697+0000 7fe8e8a00640 1 -- 172.21.15.12:0/3982095418 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe8cc0a2d80 msgr2=0x7fe8cc0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:05.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.697+0000 7fe8e8a00640 1 --2- 172.21.15.12:0/3982095418 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe8cc0a2d80 0x7fe8cc0a5240 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009d20 tx=0x7fe8d80092a0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.697+0000 7fe8e8a00640 1 -- 172.21.15.12:0/3982095418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8dc09d790 msgr2=0x7fe8dc0a1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:05.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.697+0000 7fe8e8a00640 1 --2- 172.21.15.12:0/3982095418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8dc09d790 0x7fe8dc0a1a00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4050280 tx=0x7fe8e40691d0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.698+0000 7fe8e8a00640 1 -- 172.21.15.12:0/3982095418 shutdown_connections 2024-09-05T01:30:05.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.698+0000 7fe8e8a00640 1 --2- 172.21.15.12:0/3982095418 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe8cc0a2d80 0x7fe8cc0a5240 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.698+0000 7fe8e8a00640 1 --2- 172.21.15.12:0/3982095418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8dc09d790 0x7fe8dc0a1a00 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.698+0000 7fe8e8a00640 1 --2- 172.21.15.12:0/3982095418 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe8dc098130 0x7fe8dc0a14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.698+0000 7fe8e8a00640 1 --2- 172.21.15.12:0/3982095418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8dc097790 0x7fe8dc0a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:05.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.698+0000 7fe8e8a00640 1 -- 172.21.15.12:0/3982095418 >> 172.21.15.12:0/3982095418 conn(0x7fe8dc093430 msgr2=0x7fe8dc0938b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:30:05.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.700+0000 7fe8e8a00640 1 -- 172.21.15.12:0/3982095418 shutdown_connections 2024-09-05T01:30:05.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:05.700+0000 7fe8e8a00640 1 -- 172.21.15.12:0/3982095418 wait complete. 2024-09-05T01:30:07.155 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:06 smithi151 ceph-mon[35013]: pgmap v165: 97 pgs: 97 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 21 MiB/s wr, 1.02k op/s 2024-09-05T01:30:07.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:06 smithi012 ceph-mon[29942]: pgmap v165: 97 pgs: 97 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 21 MiB/s wr, 1.02k op/s 2024-09-05T01:30:07.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:06 smithi145 ceph-mon[34376]: pgmap v165: 97 pgs: 97 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 21 MiB/s wr, 1.02k op/s 2024-09-05T01:30:07.919 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-05T01:30:09.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:08 smithi012 ceph-mon[29942]: pgmap v166: 97 pgs: 97 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 21 MiB/s wr, 991 op/s 2024-09-05T01:30:09.223 INFO:tasks.workunit.client.0.smithi012.stdout: 569 621139 1556 445541 1679 166089 33 2024-09-05T01:30:09.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:08 smithi145 ceph-mon[34376]: pgmap v166: 97 pgs: 97 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 21 MiB/s wr, 991 op/s 2024-09-05T01:30:09.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:08 smithi151 ceph-mon[35013]: pgmap v166: 97 pgs: 97 active+clean; 2.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 21 MiB/s wr, 991 op/s 2024-09-05T01:30:11.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:10 smithi012 ceph-mon[29942]: pgmap v167: 97 pgs: 97 active+clean; 2.2 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 19 MiB/s wr, 918 op/s 2024-09-05T01:30:11.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:10 smithi145 ceph-mon[34376]: pgmap v167: 97 pgs: 97 active+clean; 2.2 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 19 MiB/s wr, 918 op/s 2024-09-05T01:30:11.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:10 smithi151 ceph-mon[35013]: pgmap v167: 97 pgs: 97 active+clean; 2.2 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 19 MiB/s wr, 918 op/s 2024-09-05T01:30:13.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:12 smithi012 ceph-mon[29942]: pgmap v168: 97 pgs: 97 active+clean; 2.2 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.3 MiB/s wr, 308 op/s 2024-09-05T01:30:13.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:12 smithi145 ceph-mon[34376]: pgmap v168: 97 pgs: 97 active+clean; 2.2 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.3 MiB/s wr, 308 op/s 2024-09-05T01:30:13.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:12 smithi151 ceph-mon[35013]: pgmap v168: 97 pgs: 97 active+clean; 2.2 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.3 MiB/s wr, 308 op/s 2024-09-05T01:30:15.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:14 smithi012 ceph-mon[29942]: pgmap v169: 97 pgs: 97 active+clean; 2.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.6 MiB/s wr, 268 op/s 2024-09-05T01:30:15.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:14 smithi145 ceph-mon[34376]: pgmap v169: 97 pgs: 97 active+clean; 2.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.6 MiB/s wr, 268 op/s 2024-09-05T01:30:15.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:14 smithi151 ceph-mon[35013]: pgmap v169: 97 pgs: 97 active+clean; 2.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.6 MiB/s wr, 268 op/s 2024-09-05T01:30:17.079 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:16 smithi012 ceph-mon[29942]: pgmap v170: 97 pgs: 97 active+clean; 2.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 106 op/s 2024-09-05T01:30:17.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:16 smithi145 ceph-mon[34376]: pgmap v170: 97 pgs: 97 active+clean; 2.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 106 op/s 2024-09-05T01:30:17.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:16 smithi151 ceph-mon[35013]: pgmap v170: 97 pgs: 97 active+clean; 2.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 106 op/s 2024-09-05T01:30:18.828 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:30:19.223 INFO:tasks.workunit.client.0.smithi012.stdout: 605 628700 1844 450477 2014 150849 55 2024-09-05T01:30:19.319 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:18 smithi012 ceph-mon[29942]: pgmap v171: 97 pgs: 97 active+clean; 2.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.6 MiB/s wr, 147 op/s 2024-09-05T01:30:19.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:18 smithi145 ceph-mon[34376]: pgmap v171: 97 pgs: 97 active+clean; 2.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.6 MiB/s wr, 147 op/s 2024-09-05T01:30:19.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:18 smithi151 ceph-mon[35013]: pgmap v171: 97 pgs: 97 active+clean; 2.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.6 MiB/s wr, 147 op/s 2024-09-05T01:30:21.202 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:20 smithi012 ceph-mon[29942]: pgmap v172: 97 pgs: 97 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.7 MiB/s wr, 296 op/s 2024-09-05T01:30:21.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.199+0000 7ff10fe00640 1 -- 172.21.15.12:0/2868061777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1101019c0 msgr2=0x7ff110101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:21.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.199+0000 7ff10fe00640 1 --2- 172.21.15.12:0/2868061777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1101019c0 0x7ff110101e20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc009900 tx=0x7ff0fc02a3f0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.199+0000 7ff10fe00640 1 -- 172.21.15.12:0/2868061777 shutdown_connections 2024-09-05T01:30:21.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.199+0000 7ff10fe00640 1 --2- 172.21.15.12:0/2868061777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff110102360 0x7ff11010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.199+0000 7ff10fe00640 1 --2- 172.21.15.12:0/2868061777 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1101019c0 0x7ff110101e20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.199+0000 7ff10fe00640 1 --2- 172.21.15.12:0/2868061777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1101079c0 0x7ff110107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.199+0000 7ff10fe00640 1 -- 172.21.15.12:0/2868061777 >> 172.21.15.12:0/2868061777 conn(0x7ff1100fd740 msgr2=0x7ff1100ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:30:21.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.201+0000 7ff10fe00640 1 -- 172.21.15.12:0/2868061777 shutdown_connections 2024-09-05T01:30:21.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.202+0000 7ff10fe00640 1 -- 172.21.15.12:0/2868061777 wait complete. 2024-09-05T01:30:21.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.208+0000 7ff10fe00640 1 Processor -- start 2024-09-05T01:30:21.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.209+0000 7ff10fe00640 1 -- start start 2024-09-05T01:30:21.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.210+0000 7ff10fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1101019c0 0x7ff11010e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:21.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.210+0000 7ff10fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff110102360 0x7ff11010b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:21.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.210+0000 7ff10ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1101019c0 0x7ff11010e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:21.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.210+0000 7ff10ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1101019c0 0x7ff11010e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:49046/0 (socket says 172.21.15.12:49046) 2024-09-05T01:30:21.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.210+0000 7ff10e000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff110102360 0x7ff11010b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:21.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.210+0000 7ff10e000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff110102360 0x7ff11010b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47052/0 (socket says 172.21.15.12:47052) 2024-09-05T01:30:21.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.210+0000 7ff10e000640 1 -- 172.21.15.12:0/3905260381 learned_addr learned my addr 172.21.15.12:0/3905260381 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:30:21.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.211+0000 7ff10fe00640 1 --2- 172.21.15.12:0/3905260381 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1101079c0 0x7ff11010bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:21.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.211+0000 7ff10f400640 1 --2- 172.21.15.12:0/3905260381 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1101079c0 0x7ff11010bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:21.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.211+0000 7ff10fe00640 1 -- 172.21.15.12:0/3905260381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff110114010 con 0x7ff110102360 2024-09-05T01:30:21.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.211+0000 7ff10fe00640 1 -- 172.21.15.12:0/3905260381 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff110113e90 con 0x7ff1101079c0 2024-09-05T01:30:21.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.211+0000 7ff10fe00640 1 -- 172.21.15.12:0/3905260381 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff110114190 con 0x7ff1101019c0 2024-09-05T01:30:21.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.212+0000 7ff10ea00640 1 -- 172.21.15.12:0/3905260381 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1101079c0 msgr2=0x7ff11010bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:21.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.212+0000 7ff10ea00640 1 --2- 172.21.15.12:0/3905260381 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1101079c0 0x7ff11010bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.212+0000 7ff10ea00640 1 -- 172.21.15.12:0/3905260381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff110102360 msgr2=0x7ff11010b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:21.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.212+0000 7ff10ea00640 1 --2- 172.21.15.12:0/3905260381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff110102360 0x7ff11010b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.213+0000 7ff10ea00640 1 -- 172.21.15.12:0/3905260381 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11010c590 con 0x7ff1101019c0 2024-09-05T01:30:21.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.213+0000 7ff10e000640 1 --2- 172.21.15.12:0/3905260381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff110102360 0x7ff11010b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:30:21.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.213+0000 7ff10ea00640 1 --2- 172.21.15.12:0/3905260381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1101019c0 0x7ff11010e710 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff10000c970 tx=0x7ff10000ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:30:21.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.214+0000 7ff107400640 1 -- 172.21.15.12:0/3905260381 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff100007bb0 con 0x7ff1101019c0 2024-09-05T01:30:21.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.214+0000 7ff107400640 1 -- 172.21.15.12:0/3905260381 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff100007d50 con 0x7ff1101019c0 2024-09-05T01:30:21.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.214+0000 7ff107400640 1 -- 172.21.15.12:0/3905260381 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10000f450 con 0x7ff1101019c0 2024-09-05T01:30:21.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.214+0000 7ff10fe00640 1 -- 172.21.15.12:0/3905260381 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1101aadb0 con 0x7ff1101019c0 2024-09-05T01:30:21.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.214+0000 7ff10fe00640 1 -- 172.21.15.12:0/3905260381 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1101ab210 con 0x7ff1101019c0 2024-09-05T01:30:21.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.224+0000 7ff11865a740 1 Processor -- start 2024-09-05T01:30:21.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.224+0000 7ff107400640 1 -- 172.21.15.12:0/3905260381 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7ff1000046c0 con 0x7ff1101019c0 2024-09-05T01:30:21.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.226+0000 7ff11865a740 1 -- start start 2024-09-05T01:30:21.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.226+0000 7ff11865a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee7fee40 0x5570ee7ff220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:21.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.226+0000 7ff11865a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7ff760 0x5570ee809ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:21.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.226+0000 7ff11865a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570ee80a020 0x5570ee80c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:21.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.226+0000 7ff11865a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5570ee7653e0 con 0x5570ee7fee40 2024-09-05T01:30:21.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.226+0000 7ff11865a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5570ee70cd80 con 0x5570ee7ff760 2024-09-05T01:30:21.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.227+0000 7ff11865a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5570ee7613a0 con 0x5570ee80a020 2024-09-05T01:30:21.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.227+0000 7ff10ea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7ff760 0x5570ee809ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:21.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.227+0000 7ff10ea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7ff760 0x5570ee809ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:49608/0 (socket says 172.21.15.12:49608) 2024-09-05T01:30:21.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.227+0000 7ff10ea00640 1 -- 172.21.15.12:0/285039800 learned_addr learned my addr 172.21.15.12:0/285039800 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:30:21.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.228+0000 7ff10f400640 1 --2- 172.21.15.12:0/285039800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee7fee40 0x5570ee7ff220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:21.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.228+0000 7ff10e000640 1 --2- 172.21.15.12:0/285039800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570ee80a020 0x5570ee80c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:21.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.228+0000 7ff107400640 1 --2- 172.21.15.12:0/3905260381 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7ff0f40a2e40 0x7ff0f40a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:21.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.229+0000 7ff107400640 1 -- 172.21.15.12:0/3905260381 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7ff1000cefe0 con 0x7ff1101019c0 2024-09-05T01:30:21.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.229+0000 7ff10ea00640 1 -- 172.21.15.12:0/285039800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570ee80a020 msgr2=0x5570ee80c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:21.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.229+0000 7ff10ea00640 1 --2- 172.21.15.12:0/285039800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570ee80a020 0x5570ee80c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.229+0000 7ff10ea00640 1 -- 172.21.15.12:0/285039800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee7fee40 msgr2=0x5570ee7ff220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:21.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.229+0000 7ff10ea00640 1 --2- 172.21.15.12:0/285039800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee7fee40 0x5570ee7ff220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.229+0000 7ff10ea00640 1 -- 172.21.15.12:0/285039800 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570ee72bae0 con 0x5570ee7ff760 2024-09-05T01:30:21.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.229+0000 7ff10e000640 1 --2- 172.21.15.12:0/285039800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570ee80a020 0x5570ee80c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:30:21.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.229+0000 7ff10f400640 1 --2- 172.21.15.12:0/285039800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee7fee40 0x5570ee7ff220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:30:21.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.230+0000 7ff10f400640 1 --2- 172.21.15.12:0/3905260381 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7ff0f40a2e40 0x7ff0f40a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:21.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.231+0000 7ff10f400640 1 --2- 172.21.15.12:0/3905260381 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7ff0f40a2e40 0x7ff0f40a5300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff108005fd0 tx=0x7ff108014040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:30:21.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.232+0000 7ff10ea00640 1 --2- 172.21.15.12:0/285039800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7ff760 0x5570ee809ae0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff10009b270 tx=0x7ff100000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c33038e619117d30 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:30:21.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.232+0000 7ff0fbe00640 1 -- 172.21.15.12:0/285039800 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10009b0b0 con 0x5570ee7ff760 2024-09-05T01:30:21.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.232+0000 7ff0fbe00640 1 -- 172.21.15.12:0/285039800 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1000d2740 con 0x5570ee7ff760 2024-09-05T01:30:21.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.232+0000 7ff0fbe00640 1 -- 172.21.15.12:0/285039800 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10009aed0 con 0x5570ee7ff760 2024-09-05T01:30:21.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.233+0000 7ff11865a740 1 -- 172.21.15.12:0/285039800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7ff760 msgr2=0x5570ee809ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:21.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.233+0000 7ff11865a740 1 --2- 172.21.15.12:0/285039800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7ff760 0x5570ee809ae0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff10009b270 tx=0x7ff100000bc0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.233+0000 7ff11865a740 1 -- 172.21.15.12:0/285039800 shutdown_connections 2024-09-05T01:30:21.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.233+0000 7ff11865a740 1 --2- 172.21.15.12:0/285039800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570ee80a020 0x5570ee80c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.233+0000 7ff11865a740 1 --2- 172.21.15.12:0/285039800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7ff760 0x5570ee809ae0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.233+0000 7ff11865a740 1 --2- 172.21.15.12:0/285039800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee7fee40 0x5570ee7ff220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.233+0000 7ff11865a740 1 -- 172.21.15.12:0/285039800 >> 172.21.15.12:0/285039800 conn(0x5570ee7fb3d0 msgr2=0x5570ee7fb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:30:21.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.234+0000 7ff11865a740 1 -- 172.21.15.12:0/285039800 shutdown_connections 2024-09-05T01:30:21.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.234+0000 7ff11865a740 1 -- 172.21.15.12:0/285039800 wait complete. 2024-09-05T01:30:21.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.235+0000 7ff11865a740 1 -- start start 2024-09-05T01:30:21.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.235+0000 7ff11865a740 1 Processor -- start 2024-09-05T01:30:21.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.236+0000 7ff11865a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee7fee40 0x5570ee806fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:21.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.237+0000 7ff11865a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7ff760 0x5570ee8074e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:21.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.237+0000 7ff11865a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570ee80a020 0x5570ee807a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:21.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.237+0000 7ff11865a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5570ee81dba0 con 0x5570ee7fee40 2024-09-05T01:30:21.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.237+0000 7ff11865a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5570ee7200f0 con 0x5570ee7ff760 2024-09-05T01:30:21.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.237+0000 7ff11865a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5570ee81dd20 con 0x5570ee80a020 2024-09-05T01:30:21.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.237+0000 7ff10e000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7ff760 0x5570ee8074e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:21.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.237+0000 7ff10e000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7ff760 0x5570ee8074e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:49614/0 (socket says 172.21.15.12:49614) 2024-09-05T01:30:21.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.237+0000 7ff10e000640 1 -- 172.21.15.12:0/2436708999 learned_addr learned my addr 172.21.15.12:0/2436708999 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:30:21.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.237+0000 7ff10f400640 1 --2- 172.21.15.12:0/2436708999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570ee80a020 0x5570ee807a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:21.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.237+0000 7ff10ea00640 1 --2- 172.21.15.12:0/2436708999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee7fee40 0x5570ee806fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:21.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.238+0000 7ff11865a740 10 client.0 _ll_register_callbacks cb 0x5570ee707bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:30:21.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.238+0000 7ff10f400640 1 -- 172.21.15.12:0/2436708999 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7ff760 msgr2=0x5570ee8074e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:21.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.238+0000 7ff10f400640 1 --2- 172.21.15.12:0/2436708999 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7ff760 0x5570ee8074e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.238+0000 7ff10f400640 1 -- 172.21.15.12:0/2436708999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee7fee40 msgr2=0x5570ee806fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:21.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.238+0000 7ff10f400640 1 --2- 172.21.15.12:0/2436708999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee7fee40 0x5570ee806fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.238+0000 7ff10f400640 1 -- 172.21.15.12:0/2436708999 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570ee4d63c0 con 0x5570ee80a020 2024-09-05T01:30:21.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.239+0000 7ff10ea00640 1 --2- 172.21.15.12:0/2436708999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee7fee40 0x5570ee806fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:30:21.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.239+0000 7ff10f400640 1 --2- 172.21.15.12:0/2436708999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570ee80a020 0x5570ee807a20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff108010bd0 tx=0x7ff108009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=605bdf85ddf1982c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:30:21.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.239+0000 7ff0f8c00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:30:21.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.240+0000 7ff0f8c00640 1 -- 172.21.15.12:0/2436708999 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10801e9a0 con 0x5570ee80a020 2024-09-05T01:30:21.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.240+0000 7ff0f8c00640 1 -- 172.21.15.12:0/2436708999 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7ff10801eb40 con 0x5570ee80a020 2024-09-05T01:30:21.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.240+0000 7ff11865a740 1 -- 172.21.15.12:0/2436708999 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5570ee772950 con 0x5570ee80a020 2024-09-05T01:30:21.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.240+0000 7ff0f8c00640 1 -- 172.21.15.12:0/2436708999 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7ff10801ed40 con 0x5570ee80a020 2024-09-05T01:30:21.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.240+0000 7ff11865a740 10 client.25909 fetch_fsmap learned FSMap version 36 2024-09-05T01:30:21.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.241+0000 7ff11865a740 1 -- 172.21.15.12:0/2436708999 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5570ee829d50 con 0x5570ee80a020 2024-09-05T01:30:21.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.241+0000 7ff0f8c00640 1 -- 172.21.15.12:0/2436708999 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5570ee772950 con 0x5570ee80a020 2024-09-05T01:30:21.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.241+0000 7ff0f8c00640 1 -- 172.21.15.12:0/2436708999 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 36) ==== 8426+0+0 (secure 0 0 0) 0x7ff108025070 con 0x5570ee80a020 2024-09-05T01:30:21.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.242+0000 7ff10e000640 1 --2- 172.21.15.12:0/2436708999 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7ff760 0x5570ee8074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:30:21.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.242+0000 7ff11865a740 10 client.25909 fetch_fsmap finished waiting for FSMap version 36 2024-09-05T01:30:21.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.242+0000 7ff11865a740 10 client.25909 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T01:30:21.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.242+0000 7ff11865a740 20 client.25909 populate_metadata read hostname 'smithi012' 2024-09-05T01:30:21.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.242+0000 7ff11865a740 1 --2- 172.21.15.12:0/2436708999 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x5570ee82b300 0x5570ee82d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:21.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.242+0000 7ff11865a740 4 client.25909 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:30:21.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.242+0000 7ff11865a740 1 -- 172.21.15.12:0/2436708999 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570ee76ce60 con 0x5570ee82b300 2024-09-05T01:30:21.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.243+0000 7ff10ea00640 1 --2- 172.21.15.12:0/2436708999 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x5570ee82b300 0x5570ee82d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:21.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.244+0000 7ff10ea00640 1 --2- 172.21.15.12:0/2436708999 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x5570ee82b300 0x5570ee82d720 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=426395eb2681e1a0 server_cookie=d29d9b4008040907 in_seq=0 out_seq=0 2024-09-05T01:30:21.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.244+0000 7ff0f8c00640 10 client.25909 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:30:21.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.244+0000 7ff0f8c00640 1 -- 172.21.15.12:0/2436708999 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5570ee76ce60 con 0x5570ee82b300 2024-09-05T01:30:21.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.244+0000 7ff0f8c00640 10 client.25909 handle_command_reply: tid=0 2024-09-05T01:30:21.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.245+0000 7ff11865a740 1 client.25909 shutdown 2024-09-05T01:30:21.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.245+0000 7ff11865a740 1 -- 172.21.15.12:0/2436708999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570ee80a020 msgr2=0x5570ee807a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:21.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.245+0000 7ff11865a740 1 --2- 172.21.15.12:0/2436708999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570ee80a020 0x5570ee807a20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff108010bd0 tx=0x7ff108009500 comp rx=0 tx=0).stop 2024-09-05T01:30:21.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.245+0000 7ff11865a740 1 -- 172.21.15.12:0/2436708999 shutdown_connections 2024-09-05T01:30:21.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.245+0000 7ff11865a740 1 --2- 172.21.15.12:0/2436708999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570ee80a020 0x5570ee807a20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.245+0000 7ff11865a740 1 --2- 172.21.15.12:0/2436708999 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7ff760 0x5570ee8074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.245+0000 7ff11865a740 1 --2- 172.21.15.12:0/2436708999 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x5570ee82b300 0x5570ee82d720 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.246+0000 7ff0f8c00640 0 client.25909 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:30:21.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.246+0000 7ff11865a740 1 --2- 172.21.15.12:0/2436708999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee7fee40 0x5570ee806fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.246+0000 7ff11865a740 1 -- 172.21.15.12:0/2436708999 >> 172.21.15.12:0/2436708999 conn(0x5570ee7fb3d0 msgr2=0x5570ee801100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:30:21.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.249+0000 7ff11865a740 1 -- 172.21.15.12:0/2436708999 shutdown_connections 2024-09-05T01:30:21.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.249+0000 7ff11865a740 1 -- 172.21.15.12:0/2436708999 wait complete. 2024-09-05T01:30:21.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.249+0000 7ff11865a740 20 client.25909 trim_cache size 0 max 16384 2024-09-05T01:30:21.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.279+0000 7ff11865a740 1 Processor -- start 2024-09-05T01:30:21.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.279+0000 7ff11865a740 1 -- start start 2024-09-05T01:30:21.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.280+0000 7ff11865a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7fee40 0x5570ee807870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:21.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.280+0000 7ff11865a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee7ff760 0x5570ee800fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:21.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.280+0000 7ff11865a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570ee80a020 0x5570ee833010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:21.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.280+0000 7ff11865a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f000e7c0 con 0x5570ee7ff760 2024-09-05T01:30:21.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.280+0000 7ff11865a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f0010540 con 0x5570ee7fee40 2024-09-05T01:30:21.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.280+0000 7ff11865a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f000ee90 con 0x5570ee80a020 2024-09-05T01:30:21.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.281+0000 7ff10ea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7fee40 0x5570ee807870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:21.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.281+0000 7ff10ea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7fee40 0x5570ee807870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:49630/0 (socket says 172.21.15.12:49630) 2024-09-05T01:30:21.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.281+0000 7ff10ea00640 1 -- 172.21.15.12:0/3712738696 learned_addr learned my addr 172.21.15.12:0/3712738696 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:30:21.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.281+0000 7ff10f400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570ee80a020 0x5570ee833010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:21.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.281+0000 7ff10e000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee7ff760 0x5570ee800fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:21.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.281+0000 7ff10f400640 1 -- 172.21.15.12:0/3712738696 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7fee40 msgr2=0x5570ee807870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:21.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.281+0000 7ff10f400640 1 --2- 172.21.15.12:0/3712738696 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7fee40 0x5570ee807870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.281+0000 7ff10f400640 1 -- 172.21.15.12:0/3712738696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee7ff760 msgr2=0x5570ee800fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:21.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.282+0000 7ff10f400640 1 --2- 172.21.15.12:0/3712738696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee7ff760 0x5570ee800fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.282+0000 7ff10f400640 1 -- 172.21.15.12:0/3712738696 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570ee82da90 con 0x5570ee80a020 2024-09-05T01:30:21.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.283+0000 7ff10e000640 1 --2- 172.21.15.12:0/3712738696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee7ff760 0x5570ee800fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:30:21.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.283+0000 7ff10f400640 1 --2- 172.21.15.12:0/3712738696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570ee80a020 0x5570ee833010 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff1080277c0 tx=0x7ff108004410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c15b6fffaedad86 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:30:21.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.287+0000 7ff0fb400640 1 -- 172.21.15.12:0/3712738696 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff108035030 con 0x5570ee80a020 2024-09-05T01:30:21.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.287+0000 7ff0fb400640 1 -- 172.21.15.12:0/3712738696 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff108010cc0 con 0x5570ee80a020 2024-09-05T01:30:21.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.287+0000 7ff0fb400640 1 -- 172.21.15.12:0/3712738696 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10801c480 con 0x5570ee80a020 2024-09-05T01:30:21.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.288+0000 7ff11865a740 1 -- 172.21.15.12:0/3712738696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570ee80a020 msgr2=0x5570ee833010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:21.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.288+0000 7ff11865a740 1 --2- 172.21.15.12:0/3712738696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570ee80a020 0x5570ee833010 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff1080277c0 tx=0x7ff108004410 comp rx=0 tx=0).stop 2024-09-05T01:30:21.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.288+0000 7ff11865a740 1 -- 172.21.15.12:0/3712738696 shutdown_connections 2024-09-05T01:30:21.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.288+0000 7ff11865a740 1 --2- 172.21.15.12:0/3712738696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570ee80a020 0x5570ee833010 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.288+0000 7ff11865a740 1 --2- 172.21.15.12:0/3712738696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee7ff760 0x5570ee800fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.288+0000 7ff11865a740 1 --2- 172.21.15.12:0/3712738696 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7fee40 0x5570ee807870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.288+0000 7ff11865a740 1 -- 172.21.15.12:0/3712738696 >> 172.21.15.12:0/3712738696 conn(0x5570ee7fb3d0 msgr2=0x5570ee800890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:30:21.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.289+0000 7ff11865a740 1 -- 172.21.15.12:0/3712738696 shutdown_connections 2024-09-05T01:30:21.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.289+0000 7ff11865a740 1 -- 172.21.15.12:0/3712738696 wait complete. 2024-09-05T01:30:21.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.290+0000 7ff11865a740 1 -- start start 2024-09-05T01:30:21.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.290+0000 7ff11865a740 1 Processor -- start 2024-09-05T01:30:21.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.291+0000 7ff11865a740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7fee40 0x5570ee823140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:21.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.291+0000 7ff11865a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570ee7ff760 0x5570ee823680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:21.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.292+0000 7ff11865a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee80a020 0x5570ee88e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:21.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.292+0000 7ff11865a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f000fdb0 con 0x5570ee80a020 2024-09-05T01:30:21.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.292+0000 7ff11865a740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f000f620 con 0x5570ee7fee40 2024-09-05T01:30:21.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.292+0000 7ff11865a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f000c7a0 con 0x5570ee7ff760 2024-09-05T01:30:21.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.292+0000 7ff11865a740 10 client.0 _ll_register_callbacks cb 0x7ff108009e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:30:21.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.294+0000 7ff10ea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7fee40 0x5570ee823140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:21.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.294+0000 7ff10ea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7fee40 0x5570ee823140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:49646/0 (socket says 172.21.15.12:49646) 2024-09-05T01:30:21.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.294+0000 7ff10ea00640 1 -- 172.21.15.12:0/3328135067 learned_addr learned my addr 172.21.15.12:0/3328135067 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:30:21.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.294+0000 7ff10e000640 1 --2- 172.21.15.12:0/3328135067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570ee7ff760 0x5570ee823680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:21.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.295+0000 7ff10f400640 1 --2- 172.21.15.12:0/3328135067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee80a020 0x5570ee88e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:21.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.295+0000 7ff10f400640 1 -- 172.21.15.12:0/3328135067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570ee7ff760 msgr2=0x5570ee823680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:21.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.295+0000 7ff10f400640 1 --2- 172.21.15.12:0/3328135067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570ee7ff760 0x5570ee823680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.295+0000 7ff10f400640 1 -- 172.21.15.12:0/3328135067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7fee40 msgr2=0x5570ee823140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:21.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.295+0000 7ff10f400640 1 --2- 172.21.15.12:0/3328135067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7fee40 0x5570ee823140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.295+0000 7ff10f400640 1 -- 172.21.15.12:0/3328135067 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570ee88f000 con 0x5570ee80a020 2024-09-05T01:30:21.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.296+0000 7ff10f400640 1 --2- 172.21.15.12:0/3328135067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee80a020 0x5570ee88e800 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff108027650 tx=0x7ff10801ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8173ca762c153870 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:30:21.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.297+0000 7ff0f8c00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:30:21.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.297+0000 7ff0f8c00640 1 -- 172.21.15.12:0/3328135067 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff108040020 con 0x5570ee80a020 2024-09-05T01:30:21.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.297+0000 7ff0f8c00640 1 -- 172.21.15.12:0/3328135067 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7ff10801c480 con 0x5570ee80a020 2024-09-05T01:30:21.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.297+0000 7ff11865a740 1 -- 172.21.15.12:0/3328135067 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff108010cc0 con 0x5570ee80a020 2024-09-05T01:30:21.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.298+0000 7ff0f8c00640 1 -- 172.21.15.12:0/3328135067 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7ff108040020 con 0x5570ee80a020 2024-09-05T01:30:21.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.298+0000 7ff11865a740 10 client.15873 fetch_fsmap learned FSMap version 36 2024-09-05T01:30:21.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.298+0000 7ff11865a740 1 -- 172.21.15.12:0/3328135067 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5570ee820c00 con 0x5570ee80a020 2024-09-05T01:30:21.333 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:30:21.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.302+0000 7ff0f8c00640 1 -- 172.21.15.12:0/3328135067 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff108010cc0 con 0x5570ee80a020 2024-09-05T01:30:21.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.303+0000 7ff0f8c00640 1 -- 172.21.15.12:0/3328135067 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 36) ==== 8426+0+0 (secure 0 0 0) 0x7ff108027ce0 con 0x5570ee80a020 2024-09-05T01:30:21.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.309+0000 7ff11865a740 10 client.15873 fetch_fsmap finished waiting for FSMap version 36 2024-09-05T01:30:21.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.309+0000 7ff11865a740 10 client.15873 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T01:30:21.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.309+0000 7ff11865a740 20 client.15873 populate_metadata read hostname 'smithi012' 2024-09-05T01:30:21.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.309+0000 7ff11865a740 1 --2- 172.21.15.12:0/3328135067 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x5570ee82b300 0x5570ee8a9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:21.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.309+0000 7ff11865a740 4 client.15873 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:30:21.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.309+0000 7ff11865a740 1 -- 172.21.15.12:0/3328135067 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5570ee6e9010 con 0x5570ee82b300 2024-09-05T01:30:21.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.309+0000 7ff10ea00640 1 --2- 172.21.15.12:0/3328135067 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x5570ee82b300 0x5570ee8a9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:21.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.310+0000 7ff10ea00640 1 --2- 172.21.15.12:0/3328135067 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x5570ee82b300 0x5570ee8a9310 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b07a3e4811379b06 server_cookie=e96267a7d1806e72 in_seq=0 out_seq=0 2024-09-05T01:30:21.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.310+0000 7ff0f8c00640 10 client.15873 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:30:21.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.310+0000 7ff0f8c00640 1 -- 172.21.15.12:0/3328135067 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5570ee6e9010 con 0x5570ee82b300 2024-09-05T01:30:21.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.310+0000 7ff0f8c00640 10 client.15873 handle_command_reply: tid=0 2024-09-05T01:30:21.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.310+0000 7ff11865a740 1 client.15873 shutdown 2024-09-05T01:30:21.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.311+0000 7ff11865a740 1 -- 172.21.15.12:0/3328135067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee80a020 msgr2=0x5570ee88e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:21.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.311+0000 7ff11865a740 1 --2- 172.21.15.12:0/3328135067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee80a020 0x5570ee88e800 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff108027650 tx=0x7ff10801ea20 comp rx=0 tx=0).stop 2024-09-05T01:30:21.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.311+0000 7ff11865a740 1 -- 172.21.15.12:0/3328135067 shutdown_connections 2024-09-05T01:30:21.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.311+0000 7ff11865a740 1 --2- 172.21.15.12:0/3328135067 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x5570ee82b300 0x5570ee8a9310 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.311+0000 7ff11865a740 1 --2- 172.21.15.12:0/3328135067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570ee80a020 0x5570ee88e800 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.311+0000 7ff11865a740 1 --2- 172.21.15.12:0/3328135067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570ee7ff760 0x5570ee823680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.311+0000 7ff0f8c00640 0 client.15873 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:30:21.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.311+0000 7ff11865a740 1 --2- 172.21.15.12:0/3328135067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570ee7fee40 0x5570ee823140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.311+0000 7ff11865a740 1 -- 172.21.15.12:0/3328135067 >> 172.21.15.12:0/3328135067 conn(0x5570ee7fb3d0 msgr2=0x5570ee8010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:30:21.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.312+0000 7ff11865a740 1 -- 172.21.15.12:0/3328135067 shutdown_connections 2024-09-05T01:30:21.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.312+0000 7ff11865a740 1 -- 172.21.15.12:0/3328135067 wait complete. 2024-09-05T01:30:21.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.312+0000 7ff11865a740 20 client.15873 trim_cache size 0 max 16384 2024-09-05T01:30:21.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.313+0000 7ff10fe00640 1 -- 172.21.15.12:0/3905260381 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7ff0f40a2e40 msgr2=0x7ff0f40a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:21.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.313+0000 7ff10fe00640 1 --2- 172.21.15.12:0/3905260381 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7ff0f40a2e40 0x7ff0f40a5300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff108005fd0 tx=0x7ff108014040 comp rx=0 tx=0).stop 2024-09-05T01:30:21.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.313+0000 7ff10fe00640 1 -- 172.21.15.12:0/3905260381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1101019c0 msgr2=0x7ff11010e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:21.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.313+0000 7ff10fe00640 1 --2- 172.21.15.12:0/3905260381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1101019c0 0x7ff11010e710 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff10000c970 tx=0x7ff10000ce30 comp rx=0 tx=0).stop 2024-09-05T01:30:21.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.314+0000 7ff10fe00640 1 -- 172.21.15.12:0/3905260381 shutdown_connections 2024-09-05T01:30:21.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.314+0000 7ff10fe00640 1 --2- 172.21.15.12:0/3905260381 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7ff0f40a2e40 0x7ff0f40a5300 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.314+0000 7ff10fe00640 1 --2- 172.21.15.12:0/3905260381 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1101079c0 0x7ff11010bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.314+0000 7ff10fe00640 1 --2- 172.21.15.12:0/3905260381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff110102360 0x7ff11010b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.314+0000 7ff10fe00640 1 --2- 172.21.15.12:0/3905260381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1101019c0 0x7ff11010e710 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:21.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.314+0000 7ff10fe00640 1 -- 172.21.15.12:0/3905260381 >> 172.21.15.12:0/3905260381 conn(0x7ff1100fd740 msgr2=0x7ff1100fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:30:21.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.314+0000 7ff10fe00640 1 -- 172.21.15.12:0/3905260381 shutdown_connections 2024-09-05T01:30:21.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:21.315+0000 7ff10fe00640 1 -- 172.21.15.12:0/3905260381 wait complete. 2024-09-05T01:30:21.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:20 smithi145 ceph-mon[34376]: pgmap v172: 97 pgs: 97 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.7 MiB/s wr, 296 op/s 2024-09-05T01:30:21.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:20 smithi151 ceph-mon[35013]: pgmap v172: 97 pgs: 97 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.7 MiB/s wr, 296 op/s 2024-09-05T01:30:23.184 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:23 smithi012 ceph-mon[29942]: pgmap v173: 97 pgs: 97 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.1 MiB/s wr, 275 op/s 2024-09-05T01:30:23.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:23 smithi145 ceph-mon[34376]: pgmap v173: 97 pgs: 97 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.1 MiB/s wr, 275 op/s 2024-09-05T01:30:23.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:23 smithi151 ceph-mon[35013]: pgmap v173: 97 pgs: 97 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.1 MiB/s wr, 275 op/s 2024-09-05T01:30:23.819 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-05T01:30:24.060 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:24 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:30:24.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:24 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:30:24.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:24 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:30:25.163 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:25 smithi012 ceph-mon[29942]: pgmap v174: 97 pgs: 97 active+clean; 2.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 16 MiB/s wr, 621 op/s 2024-09-05T01:30:25.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:25 smithi145 ceph-mon[34376]: pgmap v174: 97 pgs: 97 active+clean; 2.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 16 MiB/s wr, 621 op/s 2024-09-05T01:30:25.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:25 smithi151 ceph-mon[35013]: pgmap v174: 97 pgs: 97 active+clean; 2.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 16 MiB/s wr, 621 op/s 2024-09-05T01:30:27.067 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:27 smithi012 ceph-mon[29942]: pgmap v175: 97 pgs: 97 active+clean; 2.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 17 MiB/s wr, 644 op/s 2024-09-05T01:30:27.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:27 smithi145 ceph-mon[34376]: pgmap v175: 97 pgs: 97 active+clean; 2.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 17 MiB/s wr, 644 op/s 2024-09-05T01:30:27.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:27 smithi151 ceph-mon[35013]: pgmap v175: 97 pgs: 97 active+clean; 2.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 17 MiB/s wr, 644 op/s 2024-09-05T01:30:29.224 INFO:tasks.workunit.client.0.smithi012.stdout: 623 511142 1425 368962 1041 119290 954 2024-09-05T01:30:29.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:29 smithi145 ceph-mon[34376]: pgmap v176: 97 pgs: 97 active+clean; 2.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 17 MiB/s wr, 643 op/s 2024-09-05T01:30:29.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:29 smithi151 ceph-mon[35013]: pgmap v176: 97 pgs: 97 active+clean; 2.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 17 MiB/s wr, 643 op/s 2024-09-05T01:30:29.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:29 smithi012 ceph-mon[29942]: pgmap v176: 97 pgs: 97 active+clean; 2.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 17 MiB/s wr, 643 op/s 2024-09-05T01:30:30.746 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:30:31.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:31 smithi145 ceph-mon[34376]: pgmap v177: 97 pgs: 97 active+clean; 2.4 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 23 MiB/s wr, 888 op/s 2024-09-05T01:30:31.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:31 smithi151 ceph-mon[35013]: pgmap v177: 97 pgs: 97 active+clean; 2.4 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 23 MiB/s wr, 888 op/s 2024-09-05T01:30:31.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:31 smithi012 ceph-mon[29942]: pgmap v177: 97 pgs: 97 active+clean; 2.4 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 23 MiB/s wr, 888 op/s 2024-09-05T01:30:33.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.991+0000 7ff123e00640 1 -- 172.21.15.12:0/285896104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff124116ea0 msgr2=0x7ff124119290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:33.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.991+0000 7ff123e00640 1 --2- 172.21.15.12:0/285896104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff124116ea0 0x7ff124119290 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009be0 tx=0x7ff11c02a6c0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.993+0000 7ff123e00640 1 -- 172.21.15.12:0/285896104 shutdown_connections 2024-09-05T01:30:33.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.993+0000 7ff123e00640 1 --2- 172.21.15.12:0/285896104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff124116ea0 0x7ff124119290 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.993+0000 7ff123e00640 1 --2- 172.21.15.12:0/285896104 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff124109b10 0x7ff124116960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.993+0000 7ff123e00640 1 --2- 172.21.15.12:0/285896104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff1241091f0 0x7ff1241095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.993+0000 7ff123e00640 1 -- 172.21.15.12:0/285896104 >> 172.21.15.12:0/285896104 conn(0x7ff124073660 msgr2=0x7ff124073a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:30:33.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.993+0000 7ff123e00640 1 -- 172.21.15.12:0/285896104 shutdown_connections 2024-09-05T01:30:33.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.993+0000 7ff123e00640 1 -- 172.21.15.12:0/285896104 wait complete. 2024-09-05T01:30:33.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.994+0000 7ff123e00640 1 Processor -- start 2024-09-05T01:30:33.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.995+0000 7ff123e00640 1 -- start start 2024-09-05T01:30:33.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.996+0000 7ff123e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1241091f0 0x7ff1241a8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:33.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.996+0000 7ff123e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff124109b10 0x7ff1241a8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:33.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.996+0000 7ff122a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1241091f0 0x7ff1241a8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:33.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.996+0000 7ff122a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1241091f0 0x7ff1241a8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:34096/0 (socket says 172.21.15.12:34096) 2024-09-05T01:30:33.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.997+0000 7ff122a00640 1 -- 172.21.15.12:0/46427329 learned_addr learned my addr 172.21.15.12:0/46427329 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:30:33.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.997+0000 7ff122000640 1 --2- 172.21.15.12:0/46427329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff124109b10 0x7ff1241a8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:33.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.997+0000 7ff123e00640 1 --2- 172.21.15.12:0/46427329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff124116ea0 0x7ff1241a29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:33.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.997+0000 7ff123e00640 1 -- 172.21.15.12:0/46427329 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff12411c7d0 con 0x7ff124116ea0 2024-09-05T01:30:33.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.997+0000 7ff123e00640 1 -- 172.21.15.12:0/46427329 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff12411c650 con 0x7ff1241091f0 2024-09-05T01:30:33.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.997+0000 7ff123e00640 1 -- 172.21.15.12:0/46427329 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff12411c950 con 0x7ff124109b10 2024-09-05T01:30:33.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.998+0000 7ff123400640 1 --2- 172.21.15.12:0/46427329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff124116ea0 0x7ff1241a29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:33.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.999+0000 7ff122a00640 1 -- 172.21.15.12:0/46427329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff124109b10 msgr2=0x7ff1241a8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:33.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.999+0000 7ff122a00640 1 --2- 172.21.15.12:0/46427329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff124109b10 0x7ff1241a8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.999+0000 7ff122a00640 1 -- 172.21.15.12:0/46427329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff124116ea0 msgr2=0x7ff1241a29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:33.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.999+0000 7ff122a00640 1 --2- 172.21.15.12:0/46427329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff124116ea0 0x7ff1241a29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:32.999+0000 7ff122a00640 1 -- 172.21.15.12:0/46427329 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1241a30f0 con 0x7ff1241091f0 2024-09-05T01:30:33.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.000+0000 7ff123400640 1 --2- 172.21.15.12:0/46427329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff124116ea0 0x7ff1241a29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:30:33.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.000+0000 7ff122000640 1 --2- 172.21.15.12:0/46427329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff124109b10 0x7ff1241a8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:30:33.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.004+0000 7ff122a00640 1 --2- 172.21.15.12:0/46427329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1241091f0 0x7ff1241a8800 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff11400d950 tx=0x7ff11400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:30:33.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.007+0000 7ff11b400640 1 -- 172.21.15.12:0/46427329 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff114017030 con 0x7ff1241091f0 2024-09-05T01:30:33.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.012+0000 7ff11b400640 1 -- 172.21.15.12:0/46427329 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff114004020 con 0x7ff1241091f0 2024-09-05T01:30:33.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.012+0000 7ff123e00640 1 -- 172.21.15.12:0/46427329 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1241a33e0 con 0x7ff1241091f0 2024-09-05T01:30:33.016 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.012+0000 7ff123e00640 1 -- 172.21.15.12:0/46427329 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1241af6d0 con 0x7ff1241091f0 2024-09-05T01:30:33.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.014+0000 7ff11b400640 1 -- 172.21.15.12:0/46427329 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff114017030 con 0x7ff1241091f0 2024-09-05T01:30:33.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.020+0000 7ff11b400640 1 -- 172.21.15.12:0/46427329 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7ff11401a070 con 0x7ff1241091f0 2024-09-05T01:30:33.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.020+0000 7ff12c4da740 1 Processor -- start 2024-09-05T01:30:33.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.021+0000 7ff12c4da740 1 -- start start 2024-09-05T01:30:33.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.024+0000 7ff11b400640 1 --2- 172.21.15.12:0/46427329 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7ff1080a2f40 0x7ff1080a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:33.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.024+0000 7ff11b400640 1 -- 172.21.15.12:0/46427329 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7ff1140ce780 con 0x7ff1241091f0 2024-09-05T01:30:33.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.025+0000 7ff123400640 1 --2- 172.21.15.12:0/46427329 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7ff1080a2f40 0x7ff1080a5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:33.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.027+0000 7ff123400640 1 --2- 172.21.15.12:0/46427329 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7ff1080a2f40 0x7ff1080a5400 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff11c006010 tx=0x7ff11c009840 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:30:33.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.027+0000 7ff12c4da740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f873b75d60 0x55f873b76140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:33.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.027+0000 7ff12c4da740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f873b76680 0x55f873b892f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:33.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.027+0000 7ff12c4da740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f873b89830 0x55f873b8bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:33.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.027+0000 7ff12c4da740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f873adc3e0 con 0x55f873b89830 2024-09-05T01:30:33.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.027+0000 7ff12c4da740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55f873a83d80 con 0x55f873b75d60 2024-09-05T01:30:33.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.027+0000 7ff12c4da740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f873ad83a0 con 0x55f873b76680 2024-09-05T01:30:33.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.028+0000 7ff123400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f873b89830 0x55f873b8bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:33.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.028+0000 7ff123400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f873b89830 0x55f873b8bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42292/0 (socket says 172.21.15.12:42292) 2024-09-05T01:30:33.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.029+0000 7ff123400640 1 -- 172.21.15.12:0/3857185116 learned_addr learned my addr 172.21.15.12:0/3857185116 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:30:33.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.029+0000 7ff122000640 1 --2- 172.21.15.12:0/3857185116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f873b76680 0x55f873b892f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:33.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.030+0000 7ff122a00640 1 --2- 172.21.15.12:0/3857185116 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f873b75d60 0x55f873b76140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:33.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.030+0000 7ff123400640 1 -- 172.21.15.12:0/3857185116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f873b76680 msgr2=0x55f873b892f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:33.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.030+0000 7ff123400640 1 --2- 172.21.15.12:0/3857185116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f873b76680 0x55f873b892f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.030+0000 7ff123400640 1 -- 172.21.15.12:0/3857185116 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f873b75d60 msgr2=0x55f873b76140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:33.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.030+0000 7ff123400640 1 --2- 172.21.15.12:0/3857185116 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f873b75d60 0x55f873b76140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.031+0000 7ff123400640 1 -- 172.21.15.12:0/3857185116 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f873aa2ae0 con 0x55f873b89830 2024-09-05T01:30:33.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.032+0000 7ff123400640 1 --2- 172.21.15.12:0/3857185116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f873b89830 0x55f873b8bc20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff11c033000 tx=0x7ff11c03c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0fbda8969c75c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:30:33.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.032+0000 7ff10fe00640 1 -- 172.21.15.12:0/3857185116 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c036040 con 0x55f873b89830 2024-09-05T01:30:33.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.033+0000 7ff10fe00640 1 -- 172.21.15.12:0/3857185116 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff11c04e070 con 0x55f873b89830 2024-09-05T01:30:33.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.033+0000 7ff10fe00640 1 -- 172.21.15.12:0/3857185116 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c049870 con 0x55f873b89830 2024-09-05T01:30:33.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.034+0000 7ff12c4da740 1 -- 172.21.15.12:0/3857185116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f873b89830 msgr2=0x55f873b8bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:33.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.034+0000 7ff12c4da740 1 --2- 172.21.15.12:0/3857185116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f873b89830 0x55f873b8bc20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff11c033000 tx=0x7ff11c03c000 comp rx=0 tx=0).stop 2024-09-05T01:30:33.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.035+0000 7ff12c4da740 1 -- 172.21.15.12:0/3857185116 shutdown_connections 2024-09-05T01:30:33.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.035+0000 7ff12c4da740 1 --2- 172.21.15.12:0/3857185116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f873b89830 0x55f873b8bc20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.035+0000 7ff12c4da740 1 --2- 172.21.15.12:0/3857185116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f873b76680 0x55f873b892f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.035+0000 7ff12c4da740 1 --2- 172.21.15.12:0/3857185116 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f873b75d60 0x55f873b76140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.035+0000 7ff12c4da740 1 -- 172.21.15.12:0/3857185116 >> 172.21.15.12:0/3857185116 conn(0x55f873b723d0 msgr2=0x55f873b727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:30:33.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.036+0000 7ff12c4da740 1 -- 172.21.15.12:0/3857185116 shutdown_connections 2024-09-05T01:30:33.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.036+0000 7ff12c4da740 1 -- 172.21.15.12:0/3857185116 wait complete. 2024-09-05T01:30:33.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.037+0000 7ff12c4da740 1 -- start start 2024-09-05T01:30:33.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.038+0000 7ff12c4da740 1 Processor -- start 2024-09-05T01:30:33.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.039+0000 7ff12c4da740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f873b75d60 0x55f873b86740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:33.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.039+0000 7ff12c4da740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f873b76680 0x55f873b86c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:33.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.039+0000 7ff12c4da740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f873b89830 0x55f873b871c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:33.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.039+0000 7ff12c4da740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f873b8c340 con 0x55f873b75d60 2024-09-05T01:30:33.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.039+0000 7ff12c4da740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55f873a970f0 con 0x55f873b89830 2024-09-05T01:30:33.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.039+0000 7ff12c4da740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f873b8c4c0 con 0x55f873b76680 2024-09-05T01:30:33.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.039+0000 7ff12c4da740 10 client.0 _ll_register_callbacks cb 0x55f873a7ebd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:30:33.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.040+0000 7ff122000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f873b76680 0x55f873b86c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:33.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.040+0000 7ff122000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f873b76680 0x55f873b86c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:51054/0 (socket says 172.21.15.12:51054) 2024-09-05T01:30:33.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.040+0000 7ff122000640 1 -- 172.21.15.12:0/3952133908 learned_addr learned my addr 172.21.15.12:0/3952133908 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:30:33.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.041+0000 7ff122a00640 1 --2- 172.21.15.12:0/3952133908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f873b75d60 0x55f873b86740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:33.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.041+0000 7ff122000640 1 -- 172.21.15.12:0/3952133908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f873b89830 msgr2=0x55f873b871c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:33.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.041+0000 7ff122000640 1 --2- 172.21.15.12:0/3952133908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f873b89830 0x55f873b871c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.041+0000 7ff122000640 1 -- 172.21.15.12:0/3952133908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f873b75d60 msgr2=0x55f873b86740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:33.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.041+0000 7ff122000640 1 --2- 172.21.15.12:0/3952133908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f873b75d60 0x55f873b86740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.041+0000 7ff122000640 1 -- 172.21.15.12:0/3952133908 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f87384d3c0 con 0x55f873b76680 2024-09-05T01:30:33.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.042+0000 7ff122000640 1 --2- 172.21.15.12:0/3952133908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f873b76680 0x55f873b86c80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff110012a20 tx=0x7ff110012ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=346b68c91dabde2b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:30:33.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.042+0000 7ff10cc00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:30:33.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.043+0000 7ff10cc00640 1 -- 172.21.15.12:0/3952133908 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11000faa0 con 0x55f873b76680 2024-09-05T01:30:33.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.043+0000 7ff10cc00640 1 -- 172.21.15.12:0/3952133908 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7ff11000fc40 con 0x55f873b76680 2024-09-05T01:30:33.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.043+0000 7ff12c4da740 1 -- 172.21.15.12:0/3952133908 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff11c04e070 con 0x55f873b76680 2024-09-05T01:30:33.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.044+0000 7ff10cc00640 1 -- 172.21.15.12:0/3952133908 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7ff11000fe40 con 0x55f873b76680 2024-09-05T01:30:33.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.044+0000 7ff12c4da740 10 client.25927 fetch_fsmap learned FSMap version 36 2024-09-05T01:30:33.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.044+0000 7ff12c4da740 1 -- 172.21.15.12:0/3952133908 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f873b984e0 con 0x55f873b76680 2024-09-05T01:30:33.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.048+0000 7ff10cc00640 1 -- 172.21.15.12:0/3952133908 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff11c04e070 con 0x55f873b76680 2024-09-05T01:30:33.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.049+0000 7ff10cc00640 1 -- 172.21.15.12:0/3952133908 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 36) ==== 8426+0+0 (secure 0 0 0) 0x7ff110004050 con 0x55f873b76680 2024-09-05T01:30:33.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.049+0000 7ff12c4da740 10 client.25927 fetch_fsmap finished waiting for FSMap version 36 2024-09-05T01:30:33.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.049+0000 7ff12c4da740 10 client.25927 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:30:33.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.049+0000 7ff12c4da740 20 client.25927 populate_metadata read hostname 'smithi012' 2024-09-05T01:30:33.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.049+0000 7ff12c4da740 1 --2- 172.21.15.12:0/3952133908 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f873b999a0 0x55f873b9bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:33.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.049+0000 7ff12c4da740 4 client.25927 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:30:33.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.049+0000 7ff12c4da740 1 -- 172.21.15.12:0/3952133908 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f873ae9950 con 0x55f873b999a0 2024-09-05T01:30:33.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.050+0000 7ff122a00640 1 --2- 172.21.15.12:0/3952133908 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f873b999a0 0x55f873b9bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:33.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.056+0000 7ff122a00640 1 --2- 172.21.15.12:0/3952133908 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f873b999a0 0x55f873b9bdb0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a13c7feb10f4ed82 server_cookie=128eadae601ed4a1 in_seq=0 out_seq=0 2024-09-05T01:30:33.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.056+0000 7ff10cc00640 10 client.25927 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:30:33.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.059+0000 7ff10cc00640 1 -- 172.21.15.12:0/3952133908 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f873ae9950 con 0x55f873b999a0 2024-09-05T01:30:33.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.059+0000 7ff10cc00640 10 client.25927 handle_command_reply: tid=0 2024-09-05T01:30:33.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.059+0000 7ff12c4da740 1 client.25927 shutdown 2024-09-05T01:30:33.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.064+0000 7ff12c4da740 1 -- 172.21.15.12:0/3952133908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f873b76680 msgr2=0x55f873b86c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:33.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.064+0000 7ff12c4da740 1 --2- 172.21.15.12:0/3952133908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f873b76680 0x55f873b86c80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff110012a20 tx=0x7ff110012ee0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.064+0000 7ff12c4da740 1 -- 172.21.15.12:0/3952133908 shutdown_connections 2024-09-05T01:30:33.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.064+0000 7ff12c4da740 1 --2- 172.21.15.12:0/3952133908 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f873b999a0 0x55f873b9bdb0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.064+0000 7ff12c4da740 1 --2- 172.21.15.12:0/3952133908 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f873b89830 0x55f873b871c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.064+0000 7ff12c4da740 1 --2- 172.21.15.12:0/3952133908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f873b76680 0x55f873b86c80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.064+0000 7ff12c4da740 1 --2- 172.21.15.12:0/3952133908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f873b75d60 0x55f873b86740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.064+0000 7ff10cc00640 0 client.25927 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:30:33.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.064+0000 7ff12c4da740 1 -- 172.21.15.12:0/3952133908 >> 172.21.15.12:0/3952133908 conn(0x55f873b723d0 msgr2=0x55f873b78060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:30:33.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.065+0000 7ff12c4da740 1 -- 172.21.15.12:0/3952133908 shutdown_connections 2024-09-05T01:30:33.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.065+0000 7ff12c4da740 1 -- 172.21.15.12:0/3952133908 wait complete. 2024-09-05T01:30:33.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.065+0000 7ff12c4da740 20 client.25927 trim_cache size 0 max 16384 2024-09-05T01:30:33.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.105+0000 7ff12c4da740 1 Processor -- start 2024-09-05T01:30:33.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.105+0000 7ff12c4da740 1 -- start start 2024-09-05T01:30:33.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.105+0000 7ff12c4da740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f873b75d60 0x55f873b71380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:33.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.105+0000 7ff12c4da740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f873b76680 0x55f873ba1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:33.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.106+0000 7ff12c4da740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f873b89830 0x55f873ba1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:33.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.106+0000 7ff12c4da740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff1241b3e90 con 0x55f873b76680 2024-09-05T01:30:33.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.106+0000 7ff12c4da740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff1241b5c10 con 0x55f873b75d60 2024-09-05T01:30:33.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.106+0000 7ff12c4da740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff1241b4560 con 0x55f873b89830 2024-09-05T01:30:33.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.107+0000 7ff122000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f873b76680 0x55f873ba1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:33.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.107+0000 7ff122000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f873b76680 0x55f873ba1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42296/0 (socket says 172.21.15.12:42296) 2024-09-05T01:30:33.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.107+0000 7ff122000640 1 -- 172.21.15.12:0/1386071508 learned_addr learned my addr 172.21.15.12:0/1386071508 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:30:33.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.107+0000 7ff123400640 1 --2- 172.21.15.12:0/1386071508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f873b89830 0x55f873ba1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:33.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.108+0000 7ff122a00640 1 --2- 172.21.15.12:0/1386071508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f873b75d60 0x55f873b71380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:33.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.109+0000 7ff122000640 1 -- 172.21.15.12:0/1386071508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f873b89830 msgr2=0x55f873ba1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:33.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.109+0000 7ff122000640 1 --2- 172.21.15.12:0/1386071508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f873b89830 0x55f873ba1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.109+0000 7ff122000640 1 -- 172.21.15.12:0/1386071508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f873b75d60 msgr2=0x55f873b71380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:33.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.109+0000 7ff122000640 1 --2- 172.21.15.12:0/1386071508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f873b75d60 0x55f873b71380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.109+0000 7ff122000640 1 -- 172.21.15.12:0/1386071508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f873b84c90 con 0x55f873b76680 2024-09-05T01:30:33.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.109+0000 7ff123400640 1 --2- 172.21.15.12:0/1386071508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f873b89830 0x55f873ba1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:30:33.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.110+0000 7ff122000640 1 --2- 172.21.15.12:0/1386071508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f873b76680 0x55f873ba1680 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff110003ba0 tx=0x7ff110003b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45890912b94264c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:30:33.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.110+0000 7ff10f400640 1 -- 172.21.15.12:0/1386071508 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11002b070 con 0x55f873b76680 2024-09-05T01:30:33.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.111+0000 7ff10f400640 1 -- 172.21.15.12:0/1386071508 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff11c04e070 con 0x55f873b76680 2024-09-05T01:30:33.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.111+0000 7ff10f400640 1 -- 172.21.15.12:0/1386071508 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11002b070 con 0x55f873b76680 2024-09-05T01:30:33.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.112+0000 7ff12c4da740 1 -- 172.21.15.12:0/1386071508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f873b76680 msgr2=0x55f873ba1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:33.116 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.112+0000 7ff12c4da740 1 --2- 172.21.15.12:0/1386071508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f873b76680 0x55f873ba1680 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff110003ba0 tx=0x7ff110003b30 comp rx=0 tx=0).stop 2024-09-05T01:30:33.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.114+0000 7ff12c4da740 1 -- 172.21.15.12:0/1386071508 shutdown_connections 2024-09-05T01:30:33.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.114+0000 7ff12c4da740 1 --2- 172.21.15.12:0/1386071508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f873b89830 0x55f873ba1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.114+0000 7ff12c4da740 1 --2- 172.21.15.12:0/1386071508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f873b76680 0x55f873ba1680 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.115+0000 7ff12c4da740 1 --2- 172.21.15.12:0/1386071508 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f873b75d60 0x55f873b71380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.115+0000 7ff12c4da740 1 -- 172.21.15.12:0/1386071508 >> 172.21.15.12:0/1386071508 conn(0x55f873b723d0 msgr2=0x55f873b70c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:30:33.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.116+0000 7ff12c4da740 1 -- 172.21.15.12:0/1386071508 shutdown_connections 2024-09-05T01:30:33.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.116+0000 7ff12c4da740 1 -- 172.21.15.12:0/1386071508 wait complete. 2024-09-05T01:30:33.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.117+0000 7ff12c4da740 1 -- start start 2024-09-05T01:30:33.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.117+0000 7ff12c4da740 1 Processor -- start 2024-09-05T01:30:33.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.119+0000 7ff12c4da740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f873b75d60 0x55f873b8d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:33.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.119+0000 7ff12c4da740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f873b76680 0x55f873b8ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:33.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.119+0000 7ff12c4da740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f873b89830 0x55f873c03650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:33.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.119+0000 7ff12c4da740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff1241b5480 con 0x55f873b76680 2024-09-05T01:30:33.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.119+0000 7ff12c4da740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7ff1241b4cf0 con 0x55f873b89830 2024-09-05T01:30:33.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.119+0000 7ff12c4da740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff1241b1e70 con 0x55f873b75d60 2024-09-05T01:30:33.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.119+0000 7ff12c4da740 10 client.0 _ll_register_callbacks cb 0x7ff110009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:30:33.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.120+0000 7ff123400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f873b89830 0x55f873c03650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:33.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.120+0000 7ff123400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f873b89830 0x55f873c03650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:34142/0 (socket says 172.21.15.12:34142) 2024-09-05T01:30:33.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.120+0000 7ff123400640 1 -- 172.21.15.12:0/2358921290 learned_addr learned my addr 172.21.15.12:0/2358921290 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:30:33.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.120+0000 7ff122000640 1 --2- 172.21.15.12:0/2358921290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f873b76680 0x55f873b8ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:33.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.121+0000 7ff122a00640 1 --2- 172.21.15.12:0/2358921290 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f873b75d60 0x55f873b8d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:33.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.124+0000 7ff123400640 1 -- 172.21.15.12:0/2358921290 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f873b75d60 msgr2=0x55f873b8d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:33.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.124+0000 7ff123400640 1 --2- 172.21.15.12:0/2358921290 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f873b75d60 0x55f873b8d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.124+0000 7ff123400640 1 -- 172.21.15.12:0/2358921290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f873b76680 msgr2=0x55f873b8ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:33.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.124+0000 7ff123400640 1 --2- 172.21.15.12:0/2358921290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f873b76680 0x55f873b8ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.124+0000 7ff123400640 1 -- 172.21.15.12:0/2358921290 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f873b8e6d0 con 0x55f873b89830 2024-09-05T01:30:33.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.125+0000 7ff10cc00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:30:33.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.125+0000 7ff123400640 1 --2- 172.21.15.12:0/2358921290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f873b89830 0x55f873c03650 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff11c033000 tx=0x7ff11c030d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb72e0e0784aafdc server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:30:33.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.126+0000 7ff10cc00640 1 -- 172.21.15.12:0/2358921290 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11c036040 con 0x55f873b89830 2024-09-05T01:30:33.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.126+0000 7ff10cc00640 1 -- 172.21.15.12:0/2358921290 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7ff11c030750 con 0x55f873b89830 2024-09-05T01:30:33.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.126+0000 7ff12c4da740 1 -- 172.21.15.12:0/2358921290 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff11c04e070 con 0x55f873b89830 2024-09-05T01:30:33.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.127+0000 7ff10cc00640 1 -- 172.21.15.12:0/2358921290 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7ff11c036040 con 0x55f873b89830 2024-09-05T01:30:33.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.127+0000 7ff12c4da740 10 client.25937 fetch_fsmap learned FSMap version 36 2024-09-05T01:30:33.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.127+0000 7ff12c4da740 1 -- 172.21.15.12:0/2358921290 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f873c04ca0 con 0x55f873b89830 2024-09-05T01:30:33.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.128+0000 7ff10cc00640 1 -- 172.21.15.12:0/2358921290 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff11c042030 con 0x55f873b89830 2024-09-05T01:30:33.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.128+0000 7ff10cc00640 1 -- 172.21.15.12:0/2358921290 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 36) ==== 8426+0+0 (secure 0 0 0) 0x7ff11c0496b0 con 0x55f873b89830 2024-09-05T01:30:33.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.128+0000 7ff12c4da740 10 client.25937 fetch_fsmap finished waiting for FSMap version 36 2024-09-05T01:30:33.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.128+0000 7ff12c4da740 10 client.25937 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:30:33.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.128+0000 7ff12c4da740 20 client.25937 populate_metadata read hostname 'smithi012' 2024-09-05T01:30:33.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.128+0000 7ff12c4da740 1 --2- 172.21.15.12:0/2358921290 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f873c04f80 0x55f873c07370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:33.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.128+0000 7ff12c4da740 4 client.25937 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:30:33.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.128+0000 7ff12c4da740 1 -- 172.21.15.12:0/2358921290 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7ff11c04e070 con 0x55f873c04f80 2024-09-05T01:30:33.143 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:30:33.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.128+0000 7ff122a00640 1 --2- 172.21.15.12:0/2358921290 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f873c04f80 0x55f873c07370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:33.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.129+0000 7ff122a00640 1 --2- 172.21.15.12:0/2358921290 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f873c04f80 0x55f873c07370 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b9715a569c1a8f2 server_cookie=edc1709eb68f6f54 in_seq=0 out_seq=0 2024-09-05T01:30:33.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.129+0000 7ff10cc00640 10 client.25937 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:30:33.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.129+0000 7ff10cc00640 1 -- 172.21.15.12:0/2358921290 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7ff11c04e070 con 0x55f873c04f80 2024-09-05T01:30:33.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.129+0000 7ff10cc00640 10 client.25937 handle_command_reply: tid=0 2024-09-05T01:30:33.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.129+0000 7ff12c4da740 1 client.25937 shutdown 2024-09-05T01:30:33.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.130+0000 7ff12c4da740 1 -- 172.21.15.12:0/2358921290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f873b89830 msgr2=0x55f873c03650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:33.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.130+0000 7ff12c4da740 1 --2- 172.21.15.12:0/2358921290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f873b89830 0x55f873c03650 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff11c033000 tx=0x7ff11c030d10 comp rx=0 tx=0).stop 2024-09-05T01:30:33.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.130+0000 7ff12c4da740 1 -- 172.21.15.12:0/2358921290 shutdown_connections 2024-09-05T01:30:33.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.130+0000 7ff12c4da740 1 --2- 172.21.15.12:0/2358921290 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f873c04f80 0x55f873c07370 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.130+0000 7ff12c4da740 1 --2- 172.21.15.12:0/2358921290 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f873b89830 0x55f873c03650 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.130+0000 7ff12c4da740 1 --2- 172.21.15.12:0/2358921290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f873b76680 0x55f873b8ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.130+0000 7ff12c4da740 1 --2- 172.21.15.12:0/2358921290 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f873b75d60 0x55f873b8d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.130+0000 7ff12c4da740 1 -- 172.21.15.12:0/2358921290 >> 172.21.15.12:0/2358921290 conn(0x55f873b723d0 msgr2=0x55f873b887c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:30:33.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.130+0000 7ff10cc00640 0 client.25937 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:30:33.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.133+0000 7ff12c4da740 1 -- 172.21.15.12:0/2358921290 shutdown_connections 2024-09-05T01:30:33.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.133+0000 7ff12c4da740 1 -- 172.21.15.12:0/2358921290 wait complete. 2024-09-05T01:30:33.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.133+0000 7ff12c4da740 20 client.25937 trim_cache size 0 max 16384 2024-09-05T01:30:33.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.134+0000 7ff123e00640 1 -- 172.21.15.12:0/46427329 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7ff1080a2f40 msgr2=0x7ff1080a5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:33.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.134+0000 7ff123e00640 1 --2- 172.21.15.12:0/46427329 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7ff1080a2f40 0x7ff1080a5400 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff11c006010 tx=0x7ff11c009840 comp rx=0 tx=0).stop 2024-09-05T01:30:33.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.134+0000 7ff123e00640 1 -- 172.21.15.12:0/46427329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1241091f0 msgr2=0x7ff1241a8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:33.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.135+0000 7ff123e00640 1 --2- 172.21.15.12:0/46427329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1241091f0 0x7ff1241a8800 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff11400d950 tx=0x7ff11400de10 comp rx=0 tx=0).stop 2024-09-05T01:30:33.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.135+0000 7ff123e00640 1 -- 172.21.15.12:0/46427329 shutdown_connections 2024-09-05T01:30:33.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.135+0000 7ff123e00640 1 --2- 172.21.15.12:0/46427329 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7ff1080a2f40 0x7ff1080a5400 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.135+0000 7ff123e00640 1 --2- 172.21.15.12:0/46427329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff124116ea0 0x7ff1241a29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.135+0000 7ff123e00640 1 --2- 172.21.15.12:0/46427329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff124109b10 0x7ff1241a8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.135+0000 7ff123e00640 1 --2- 172.21.15.12:0/46427329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7ff1241091f0 0x7ff1241a8800 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:33.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.135+0000 7ff123e00640 1 -- 172.21.15.12:0/46427329 >> 172.21.15.12:0/46427329 conn(0x7ff124073660 msgr2=0x7ff1241172e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:30:33.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.135+0000 7ff123e00640 1 -- 172.21.15.12:0/46427329 shutdown_connections 2024-09-05T01:30:33.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:33.135+0000 7ff123e00640 1 -- 172.21.15.12:0/46427329 wait complete. 2024-09-05T01:30:33.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:33 smithi012 ceph-mon[29942]: pgmap v178: 97 pgs: 97 active+clean; 2.4 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 20 MiB/s wr, 750 op/s 2024-09-05T01:30:33.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:33 smithi145 ceph-mon[34376]: pgmap v178: 97 pgs: 97 active+clean; 2.4 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 20 MiB/s wr, 750 op/s 2024-09-05T01:30:33.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:33 smithi151 ceph-mon[35013]: pgmap v178: 97 pgs: 97 active+clean; 2.4 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 20 MiB/s wr, 750 op/s 2024-09-05T01:30:35.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:35 smithi145 ceph-mon[34376]: pgmap v179: 97 pgs: 97 active+clean; 2.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 21 MiB/s wr, 800 op/s 2024-09-05T01:30:35.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:35 smithi151 ceph-mon[35013]: pgmap v179: 97 pgs: 97 active+clean; 2.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 21 MiB/s wr, 800 op/s 2024-09-05T01:30:35.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:35 smithi012 ceph-mon[29942]: pgmap v179: 97 pgs: 97 active+clean; 2.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 21 MiB/s wr, 800 op/s 2024-09-05T01:30:36.156 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-05T01:30:36.157 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-05T01:30:37.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:37 smithi151 ceph-mon[35013]: pgmap v180: 97 pgs: 97 active+clean; 2.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 12 MiB/s wr, 465 op/s 2024-09-05T01:30:37.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:37 smithi012 ceph-mon[29942]: pgmap v180: 97 pgs: 97 active+clean; 2.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 12 MiB/s wr, 465 op/s 2024-09-05T01:30:37.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:37 smithi145 ceph-mon[34376]: pgmap v180: 97 pgs: 97 active+clean; 2.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 12 MiB/s wr, 465 op/s 2024-09-05T01:30:39.242 INFO:tasks.workunit.client.0.smithi012.stdout: 657 614808 1634 441262 1973 160201 2852 2024-09-05T01:30:39.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:39 smithi151 ceph-mon[35013]: pgmap v181: 97 pgs: 97 active+clean; 2.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.6 MiB/s wr, 388 op/s 2024-09-05T01:30:39.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:39 smithi012 ceph-mon[29942]: pgmap v181: 97 pgs: 97 active+clean; 2.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.6 MiB/s wr, 388 op/s 2024-09-05T01:30:39.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:39 smithi145 ceph-mon[34376]: pgmap v181: 97 pgs: 97 active+clean; 2.5 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.6 MiB/s wr, 388 op/s 2024-09-05T01:30:41.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:41 smithi151 ceph-mon[35013]: pgmap v182: 97 pgs: 97 active+clean; 2.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 12 MiB/s wr, 473 op/s 2024-09-05T01:30:41.385 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:41 smithi145 ceph-mon[34376]: pgmap v182: 97 pgs: 97 active+clean; 2.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 12 MiB/s wr, 473 op/s 2024-09-05T01:30:41.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:41 smithi012 ceph-mon[29942]: pgmap v182: 97 pgs: 97 active+clean; 2.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 12 MiB/s wr, 473 op/s 2024-09-05T01:30:43.470 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:43 smithi012 ceph-mon[29942]: pgmap v183: 97 pgs: 97 active+clean; 2.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.3 MiB/s wr, 189 op/s 2024-09-05T01:30:43.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:43 smithi145 ceph-mon[34376]: pgmap v183: 97 pgs: 97 active+clean; 2.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.3 MiB/s wr, 189 op/s 2024-09-05T01:30:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:43 smithi151 ceph-mon[35013]: pgmap v183: 97 pgs: 97 active+clean; 2.5 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.3 MiB/s wr, 189 op/s 2024-09-05T01:30:45.116 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:45 smithi012 ceph-mon[29942]: pgmap v184: 97 pgs: 97 active+clean; 2.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.9 MiB/s wr, 242 op/s 2024-09-05T01:30:45.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:45 smithi145 ceph-mon[34376]: pgmap v184: 97 pgs: 97 active+clean; 2.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.9 MiB/s wr, 242 op/s 2024-09-05T01:30:45.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:45 smithi151 ceph-mon[35013]: pgmap v184: 97 pgs: 97 active+clean; 2.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.9 MiB/s wr, 242 op/s 2024-09-05T01:30:45.800 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:30:47.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:47 smithi012 ceph-mon[29942]: pgmap v185: 97 pgs: 97 active+clean; 2.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.5 MiB/s wr, 205 op/s 2024-09-05T01:30:47.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:47 smithi145 ceph-mon[34376]: pgmap v185: 97 pgs: 97 active+clean; 2.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.5 MiB/s wr, 205 op/s 2024-09-05T01:30:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:47 smithi151 ceph-mon[35013]: pgmap v185: 97 pgs: 97 active+clean; 2.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.5 MiB/s wr, 205 op/s 2024-09-05T01:30:48.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.198+0000 7f7a06200640 1 -- 172.21.15.12:0/535099003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a001019c0 msgr2=0x7f7a00101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:48.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.198+0000 7f7a06200640 1 --2- 172.21.15.12:0/535099003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a001019c0 0x7f7a00101e20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f79ec009890 tx=0x7f79ec02a380 comp rx=0 tx=0).stop 2024-09-05T01:30:48.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.199+0000 7f7a06200640 1 -- 172.21.15.12:0/535099003 shutdown_connections 2024-09-05T01:30:48.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.199+0000 7f7a06200640 1 --2- 172.21.15.12:0/535099003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a00102360 0x7f7a0010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.199+0000 7f7a06200640 1 --2- 172.21.15.12:0/535099003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a001019c0 0x7f7a00101e20 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.199+0000 7f7a06200640 1 --2- 172.21.15.12:0/535099003 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a001079c0 0x7f7a00107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.199+0000 7f7a06200640 1 -- 172.21.15.12:0/535099003 >> 172.21.15.12:0/535099003 conn(0x7f7a000fd740 msgr2=0x7f7a000ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:30:48.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.200+0000 7f7a06200640 1 -- 172.21.15.12:0/535099003 shutdown_connections 2024-09-05T01:30:48.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.200+0000 7f7a06200640 1 -- 172.21.15.12:0/535099003 wait complete. 2024-09-05T01:30:48.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.201+0000 7f7a06200640 1 Processor -- start 2024-09-05T01:30:48.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.202+0000 7f7a06200640 1 -- start start 2024-09-05T01:30:48.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.202+0000 7f7a06200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a001019c0 0x7f7a00073a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:48.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.202+0000 7f7a06200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a00102360 0x7f7a0006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:48.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.202+0000 7f7a06200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a001079c0 0x7f7a0006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:48.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.204+0000 7f79ffe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a00102360 0x7f7a0006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:48.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.204+0000 7f79ffe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a00102360 0x7f7a0006cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35896/0 (socket says 172.21.15.12:35896) 2024-09-05T01:30:48.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.204+0000 7f7a04e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a001019c0 0x7f7a00073a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:48.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.204+0000 7f7a04e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a001019c0 0x7f7a00073a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:49966/0 (socket says 172.21.15.12:49966) 2024-09-05T01:30:48.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.204+0000 7f79ffe00640 1 -- 172.21.15.12:0/521073336 learned_addr learned my addr 172.21.15.12:0/521073336 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:30:48.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.205+0000 7f7a05800640 1 --2- 172.21.15.12:0/521073336 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a001079c0 0x7f7a0006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:48.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.205+0000 7f7a06200640 1 -- 172.21.15.12:0/521073336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7a00111dd0 con 0x7f7a00102360 2024-09-05T01:30:48.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.205+0000 7f7a06200640 1 -- 172.21.15.12:0/521073336 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7a00111c50 con 0x7f7a001079c0 2024-09-05T01:30:48.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.205+0000 7f7a06200640 1 -- 172.21.15.12:0/521073336 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7a00111f50 con 0x7f7a001019c0 2024-09-05T01:30:48.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.206+0000 7f79ffe00640 1 -- 172.21.15.12:0/521073336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a001019c0 msgr2=0x7f7a00073a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:48.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.207+0000 7f79ffe00640 1 --2- 172.21.15.12:0/521073336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a001019c0 0x7f7a00073a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.207+0000 7f79ffe00640 1 -- 172.21.15.12:0/521073336 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a001079c0 msgr2=0x7f7a0006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:48.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.207+0000 7f79ffe00640 1 --2- 172.21.15.12:0/521073336 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a001079c0 0x7f7a0006cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.207+0000 7f79ffe00640 1 -- 172.21.15.12:0/521073336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a0006d5e0 con 0x7f7a00102360 2024-09-05T01:30:48.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.208+0000 7f7a05800640 1 --2- 172.21.15.12:0/521073336 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a001079c0 0x7f7a0006cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:30:48.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.208+0000 7f79ffe00640 1 --2- 172.21.15.12:0/521073336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a00102360 0x7f7a0006cab0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f79ec000c00 tx=0x7f79ec033e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:30:48.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.209+0000 7f79fd600640 1 -- 172.21.15.12:0/521073336 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec03f020 con 0x7f7a00102360 2024-09-05T01:30:48.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.209+0000 7f79fd600640 1 -- 172.21.15.12:0/521073336 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79ec0042c0 con 0x7f7a00102360 2024-09-05T01:30:48.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.209+0000 7f7a06200640 1 -- 172.21.15.12:0/521073336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a0006d870 con 0x7f7a00102360 2024-09-05T01:30:48.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.210+0000 7f7a06200640 1 -- 172.21.15.12:0/521073336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a00071780 con 0x7f7a00102360 2024-09-05T01:30:48.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.216+0000 7f79fd600640 1 -- 172.21.15.12:0/521073336 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec037040 con 0x7f7a00102360 2024-09-05T01:30:48.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.227+0000 7f79fd600640 1 -- 172.21.15.12:0/521073336 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f79ec042020 con 0x7f7a00102360 2024-09-05T01:30:48.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.232+0000 7f79fd600640 1 --2- 172.21.15.12:0/521073336 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f79e80a2e80 0x7f79e80a5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:48.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.233+0000 7f79fd600640 1 -- 172.21.15.12:0/521073336 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f79ec0f0120 con 0x7f7a00102360 2024-09-05T01:30:48.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.233+0000 7f7a04e00640 1 --2- 172.21.15.12:0/521073336 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f79e80a2e80 0x7f79e80a5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:48.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.234+0000 7f7a0a2d3740 1 Processor -- start 2024-09-05T01:30:48.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.235+0000 7f7a04e00640 1 --2- 172.21.15.12:0/521073336 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f79e80a2e80 0x7f79e80a5340 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f79f4005e00 tx=0x7f79f4005c50 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:30:48.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.236+0000 7f7a0a2d3740 1 -- start start 2024-09-05T01:30:48.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.240+0000 7f7a0a2d3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ff0d45ef0 0x559ff0d462d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:48.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.241+0000 7f7a0a2d3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ff0d46810 0x559ff0d40840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:48.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.241+0000 7f7a0a2d3740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ff0d40eb0 0x559ff0d41330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:48.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.242+0000 7f7a0a2d3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559ff0c9d290 con 0x559ff0d46810 2024-09-05T01:30:48.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.242+0000 7f7a0a2d3740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x559ff0c44b40 con 0x559ff0d40eb0 2024-09-05T01:30:48.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.242+0000 7f7a0a2d3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559ff0c99250 con 0x559ff0d45ef0 2024-09-05T01:30:48.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.242+0000 7f7a05800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ff0d40eb0 0x559ff0d41330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:48.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.242+0000 7f7a05800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ff0d40eb0 0x559ff0d41330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:58280/0 (socket says 172.21.15.12:58280) 2024-09-05T01:30:48.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.243+0000 7f7a05800640 1 -- 172.21.15.12:0/3045238859 learned_addr learned my addr 172.21.15.12:0/3045238859 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:30:48.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.244+0000 7f7a04e00640 1 --2- 172.21.15.12:0/3045238859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ff0d45ef0 0x559ff0d462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:48.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.244+0000 7f79ffe00640 1 --2- 172.21.15.12:0/3045238859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ff0d46810 0x559ff0d40840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:48.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.245+0000 7f7a05800640 1 -- 172.21.15.12:0/3045238859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ff0d45ef0 msgr2=0x559ff0d462d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:48.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.245+0000 7f7a05800640 1 --2- 172.21.15.12:0/3045238859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ff0d45ef0 0x559ff0d462d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.245+0000 7f7a05800640 1 -- 172.21.15.12:0/3045238859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ff0d46810 msgr2=0x559ff0d40840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:48.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.245+0000 7f7a05800640 1 --2- 172.21.15.12:0/3045238859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ff0d46810 0x559ff0d40840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.245+0000 7f7a05800640 1 -- 172.21.15.12:0/3045238859 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ff0a0e6a0 con 0x559ff0d40eb0 2024-09-05T01:30:48.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.246+0000 7f79ffe00640 1 --2- 172.21.15.12:0/3045238859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ff0d46810 0x559ff0d40840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:30:48.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.246+0000 7f7a04e00640 1 --2- 172.21.15.12:0/3045238859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ff0d45ef0 0x559ff0d462d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:30:48.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.247+0000 7f7a05800640 1 --2- 172.21.15.12:0/3045238859 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ff0d40eb0 0x559ff0d41330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f79f800e8f0 tx=0x7f79f80095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c0f89ef5015353b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:30:48.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.248+0000 7f79f2000640 1 -- 172.21.15.12:0/3045238859 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f8017420 con 0x559ff0d40eb0 2024-09-05T01:30:48.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.248+0000 7f79f2000640 1 -- 172.21.15.12:0/3045238859 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79f801c070 con 0x559ff0d40eb0 2024-09-05T01:30:48.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.248+0000 7f79f2000640 1 -- 172.21.15.12:0/3045238859 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f8016740 con 0x559ff0d40eb0 2024-09-05T01:30:48.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.249+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/3045238859 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ff0d40eb0 msgr2=0x559ff0d41330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:48.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.250+0000 7f7a0a2d3740 1 --2- 172.21.15.12:0/3045238859 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ff0d40eb0 0x559ff0d41330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f79f800e8f0 tx=0x7f79f80095c0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.251+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/3045238859 shutdown_connections 2024-09-05T01:30:48.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.251+0000 7f7a0a2d3740 1 --2- 172.21.15.12:0/3045238859 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ff0d40eb0 0x559ff0d41330 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.251+0000 7f7a0a2d3740 1 --2- 172.21.15.12:0/3045238859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ff0d46810 0x559ff0d40840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.251+0000 7f7a0a2d3740 1 --2- 172.21.15.12:0/3045238859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ff0d45ef0 0x559ff0d462d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.251+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/3045238859 >> 172.21.15.12:0/3045238859 conn(0x559ff0d32cf0 msgr2=0x559ff0d330d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:30:48.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.253+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/3045238859 shutdown_connections 2024-09-05T01:30:48.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.253+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/3045238859 wait complete. 2024-09-05T01:30:48.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.254+0000 7f7a0a2d3740 1 -- start start 2024-09-05T01:30:48.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.254+0000 7f7a0a2d3740 1 Processor -- start 2024-09-05T01:30:48.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.256+0000 7f7a0a2d3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ff0d40eb0 0x559ff0d4c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:48.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.257+0000 7f7a0a2d3740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ff0d45ef0 0x559ff0d499d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:48.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.257+0000 7f7a0a2d3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ff0d46810 0x559ff0d49f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:48.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.258+0000 7f7a05800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ff0d46810 0x559ff0d49f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:48.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.258+0000 7f7a05800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ff0d46810 0x559ff0d49f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35924/0 (socket says 172.21.15.12:35924) 2024-09-05T01:30:48.264 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:48 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:30:48.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.258+0000 7f7a05800640 1 -- 172.21.15.12:0/1941049946 learned_addr learned my addr 172.21.15.12:0/1941049946 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:30:48.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.258+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/1941049946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559ff0d4d2d0 con 0x559ff0d46810 2024-09-05T01:30:48.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.258+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/1941049946 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x559ff0c57fa0 con 0x559ff0d45ef0 2024-09-05T01:30:48.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.258+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/1941049946 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559ff0d4d450 con 0x559ff0d40eb0 2024-09-05T01:30:48.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.258+0000 7f7a0a2d3740 10 client.0 _ll_register_callbacks cb 0x559ff09abba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:30:48.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.260+0000 7f79ffe00640 1 --2- 172.21.15.12:0/1941049946 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ff0d45ef0 0x559ff0d499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:48.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.260+0000 7f7a04e00640 1 --2- 172.21.15.12:0/1941049946 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ff0d40eb0 0x559ff0d4c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:48.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.261+0000 7f7a05800640 1 -- 172.21.15.12:0/1941049946 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ff0d40eb0 msgr2=0x559ff0d4c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:48.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.261+0000 7f7a05800640 1 --2- 172.21.15.12:0/1941049946 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ff0d40eb0 0x559ff0d4c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.261+0000 7f7a05800640 1 -- 172.21.15.12:0/1941049946 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ff0d45ef0 msgr2=0x559ff0d499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:30:48.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.261+0000 7f7a05800640 1 --2- 172.21.15.12:0/1941049946 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ff0d45ef0 0x559ff0d499d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.261+0000 7f7a05800640 1 -- 172.21.15.12:0/1941049946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ff0d4a780 con 0x559ff0d46810 2024-09-05T01:30:48.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.263+0000 7f79e6a00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:30:48.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.263+0000 7f7a05800640 1 --2- 172.21.15.12:0/1941049946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ff0d46810 0x559ff0d49f50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f79f800d7b0 tx=0x7f79f800dec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7671e4008499eb62 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:30:48.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.264+0000 7f79e6a00640 1 -- 172.21.15.12:0/1941049946 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f8004e50 con 0x559ff0d46810 2024-09-05T01:30:48.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.264+0000 7f79e6a00640 1 -- 172.21.15.12:0/1941049946 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f79f8005040 con 0x559ff0d46810 2024-09-05T01:30:48.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.264+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/1941049946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79f801c070 con 0x559ff0d46810 2024-09-05T01:30:48.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.265+0000 7f79e6a00640 1 -- 172.21.15.12:0/1941049946 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f79f8005240 con 0x559ff0d46810 2024-09-05T01:30:48.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.265+0000 7f7a0a2d3740 10 client.15897 fetch_fsmap learned FSMap version 37 2024-09-05T01:30:48.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.265+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/1941049946 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x559ff0d59200 con 0x559ff0d46810 2024-09-05T01:30:48.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.266+0000 7f79e6a00640 1 -- 172.21.15.12:0/1941049946 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79f801c070 con 0x559ff0d46810 2024-09-05T01:30:48.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.268+0000 7f79e6a00640 1 -- 172.21.15.12:0/1941049946 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 37) ==== 8430+0+0 (secure 0 0 0) 0x7f79f800b040 con 0x559ff0d46810 2024-09-05T01:30:48.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.268+0000 7f7a0a2d3740 10 client.15897 fetch_fsmap finished waiting for FSMap version 37 2024-09-05T01:30:48.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.268+0000 7f7a0a2d3740 10 client.15897 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:30:48.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.268+0000 7f7a0a2d3740 20 client.15897 populate_metadata read hostname 'smithi012' 2024-09-05T01:30:48.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.268+0000 7f7a0a2d3740 1 --2- 172.21.15.12:0/1941049946 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x559ff0d5a660 0x559ff0d5ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:48.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.268+0000 7f7a0a2d3740 4 client.15897 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:30:48.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.269+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/1941049946 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ff0caa800 con 0x559ff0d5a660 2024-09-05T01:30:48.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.269+0000 7f7a04e00640 1 --2- 172.21.15.12:0/1941049946 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x559ff0d5a660 0x559ff0d5ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:48.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.270+0000 7f7a04e00640 1 --2- 172.21.15.12:0/1941049946 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x559ff0d5a660 0x559ff0d5ca50 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b664366300cf29e5 server_cookie=f988eb16b1e48bbf in_seq=0 out_seq=0 2024-09-05T01:30:48.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.270+0000 7f79e6a00640 10 client.15897 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:30:48.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.271+0000 7f79e6a00640 1 -- 172.21.15.12:0/1941049946 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559ff0caa800 con 0x559ff0d5a660 2024-09-05T01:30:48.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.271+0000 7f79e6a00640 10 client.15897 handle_command_reply: tid=0 2024-09-05T01:30:48.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.271+0000 7f7a0a2d3740 1 client.15897 shutdown 2024-09-05T01:30:48.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.272+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/1941049946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ff0d46810 msgr2=0x559ff0d49f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:48.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.272+0000 7f7a0a2d3740 1 --2- 172.21.15.12:0/1941049946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ff0d46810 0x559ff0d49f50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f79f800d7b0 tx=0x7f79f800dec0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.273+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/1941049946 shutdown_connections 2024-09-05T01:30:48.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.273+0000 7f7a0a2d3740 1 --2- 172.21.15.12:0/1941049946 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x559ff0d5a660 0x559ff0d5ca50 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.274+0000 7f7a0a2d3740 1 --2- 172.21.15.12:0/1941049946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ff0d46810 0x559ff0d49f50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.274+0000 7f7a0a2d3740 1 --2- 172.21.15.12:0/1941049946 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ff0d45ef0 0x559ff0d499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.274+0000 7f7a0a2d3740 1 --2- 172.21.15.12:0/1941049946 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ff0d40eb0 0x559ff0d4c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.274+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/1941049946 >> 172.21.15.12:0/1941049946 conn(0x559ff0d32cf0 msgr2=0x559ff0d32270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:30:48.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.274+0000 7f79e6a00640 0 client.15897 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:30:48.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.275+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/1941049946 shutdown_connections 2024-09-05T01:30:48.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.275+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/1941049946 wait complete. 2024-09-05T01:30:48.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.276+0000 7f7a0a2d3740 20 client.15897 trim_cache size 0 max 16384 2024-09-05T01:30:48.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.317+0000 7f7a0a2d3740 1 Processor -- start 2024-09-05T01:30:48.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.319+0000 7f7a0a2d3740 1 -- start start 2024-09-05T01:30:48.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.319+0000 7f7a0a2d3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ff0d40eb0 0x559ff0d40840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:48.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.319+0000 7f7a0a2d3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ff0d45ef0 0x559ff0d55e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:48.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.319+0000 7f7a0a2d3740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ff0d46810 0x559ff0d5fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:48.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.319+0000 7f7a0a2d3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f79e000e750 con 0x559ff0d40eb0 2024-09-05T01:30:48.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.319+0000 7f7a0a2d3740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f79e00104d0 con 0x559ff0d46810 2024-09-05T01:30:48.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.319+0000 7f7a0a2d3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f79e000ee20 con 0x559ff0d45ef0 2024-09-05T01:30:48.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.320+0000 7f7a05800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ff0d46810 0x559ff0d5fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:48.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.320+0000 7f7a05800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ff0d46810 0x559ff0d5fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:58302/0 (socket says 172.21.15.12:58302) 2024-09-05T01:30:48.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.320+0000 7f7a05800640 1 -- 172.21.15.12:0/714620718 learned_addr learned my addr 172.21.15.12:0/714620718 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:30:48.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.321+0000 7f7a05800640 1 -- 172.21.15.12:0/714620718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ff0d45ef0 msgr2=0x559ff0d55e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:30:48.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.321+0000 7f7a05800640 1 --2- 172.21.15.12:0/714620718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ff0d45ef0 0x559ff0d55e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.321+0000 7f7a05800640 1 -- 172.21.15.12:0/714620718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ff0d40eb0 msgr2=0x559ff0d40840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:30:48.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.321+0000 7f7a05800640 1 --2- 172.21.15.12:0/714620718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ff0d40eb0 0x559ff0d40840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.321+0000 7f7a05800640 1 -- 172.21.15.12:0/714620718 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ff0d4d350 con 0x559ff0d46810 2024-09-05T01:30:48.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.321+0000 7f7a05800640 1 --2- 172.21.15.12:0/714620718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ff0d46810 0x559ff0d5fa70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f79f8000f80 tx=0x7f79f80095b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf1bcc2717845d34 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:30:48.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.321+0000 7f79f1600640 1 -- 172.21.15.12:0/714620718 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f802c540 con 0x559ff0d46810 2024-09-05T01:30:48.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.321+0000 7f79f1600640 1 -- 172.21.15.12:0/714620718 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79f801c030 con 0x559ff0d46810 2024-09-05T01:30:48.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.321+0000 7f79f1600640 1 -- 172.21.15.12:0/714620718 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f80177a0 con 0x559ff0d46810 2024-09-05T01:30:48.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.322+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/714620718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ff0d46810 msgr2=0x559ff0d5fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:48.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.322+0000 7f7a0a2d3740 1 --2- 172.21.15.12:0/714620718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ff0d46810 0x559ff0d5fa70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f79f8000f80 tx=0x7f79f80095b0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.323+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/714620718 shutdown_connections 2024-09-05T01:30:48.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.323+0000 7f7a0a2d3740 1 --2- 172.21.15.12:0/714620718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ff0d46810 0x559ff0d5fa70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.323+0000 7f7a0a2d3740 1 --2- 172.21.15.12:0/714620718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ff0d45ef0 0x559ff0d55e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.323+0000 7f7a0a2d3740 1 --2- 172.21.15.12:0/714620718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ff0d40eb0 0x559ff0d40840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.323+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/714620718 >> 172.21.15.12:0/714620718 conn(0x559ff0d32cf0 msgr2=0x559ff0d55710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:30:48.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.323+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/714620718 shutdown_connections 2024-09-05T01:30:48.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.323+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/714620718 wait complete. 2024-09-05T01:30:48.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.324+0000 7f7a0a2d3740 1 -- start start 2024-09-05T01:30:48.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.324+0000 7f7a0a2d3740 1 Processor -- start 2024-09-05T01:30:48.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.325+0000 7f7a0a2d3740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ff0d40eb0 0x559ff0d5d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:48.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.326+0000 7f7a0a2d3740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ff0d45ef0 0x559ff0d5dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:48.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.326+0000 7f7a0a2d3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ff0d46810 0x559ff0d5e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:48.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.326+0000 7f7a0a2d3740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f79e000fd40 con 0x559ff0d45ef0 2024-09-05T01:30:48.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.326+0000 7f7a0a2d3740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f79e000f5b0 con 0x559ff0d40eb0 2024-09-05T01:30:48.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.326+0000 7f7a0a2d3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f79e000c7e0 con 0x559ff0d46810 2024-09-05T01:30:48.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.326+0000 7f7a05800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ff0d46810 0x559ff0d5e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:48.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.326+0000 7f7a05800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ff0d46810 0x559ff0d5e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:49990/0 (socket says 172.21.15.12:49990) 2024-09-05T01:30:48.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.326+0000 7f7a05800640 1 -- 172.21.15.12:0/774007525 learned_addr learned my addr 172.21.15.12:0/774007525 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:30:48.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.327+0000 7f7a05800640 1 -- 172.21.15.12:0/774007525 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ff0d40eb0 msgr2=0x559ff0d5d800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:30:48.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.327+0000 7f7a05800640 1 --2- 172.21.15.12:0/774007525 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ff0d40eb0 0x559ff0d5d800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.327+0000 7f7a05800640 1 -- 172.21.15.12:0/774007525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ff0d45ef0 msgr2=0x559ff0d5dd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:30:48.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.327+0000 7f7a0a2d3740 10 client.0 _ll_register_callbacks cb 0x7f79f4015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:30:48.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.327+0000 7f7a05800640 1 --2- 172.21.15.12:0/774007525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ff0d45ef0 0x559ff0d5dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.328+0000 7f7a05800640 1 -- 172.21.15.12:0/774007525 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ff0d34350 con 0x559ff0d46810 2024-09-05T01:30:48.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.328+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/774007525 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79f801c030 con 0x559ff0d46810 2024-09-05T01:30:48.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.328+0000 7f7a05800640 1 --2- 172.21.15.12:0/774007525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ff0d46810 0x559ff0d5e280 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f79f8006010 tx=0x7f79f800dea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc5253999097cd79 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:30:48.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.328+0000 7f79e6a00640 10 client.25948 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:30:48.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.329+0000 7f79e6a00640 1 -- 172.21.15.12:0/774007525 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f803b070 con 0x559ff0d46810 2024-09-05T01:30:48.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.329+0000 7f79e6a00640 1 -- 172.21.15.12:0/774007525 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f79f80055e0 con 0x559ff0d46810 2024-09-05T01:30:48.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.329+0000 7f79e6a00640 1 -- 172.21.15.12:0/774007525 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f79f8005840 con 0x559ff0d46810 2024-09-05T01:30:48.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.329+0000 7f7a0a2d3740 10 client.25948 fetch_fsmap learned FSMap version 37 2024-09-05T01:30:48.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.329+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/774007525 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({fsmap=37}) -- 0x559ff0dc5010 con 0x559ff0d46810 2024-09-05T01:30:48.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.334+0000 7f79e6a00640 1 -- 172.21.15.12:0/774007525 <== mon.1 v2:172.21.15.151:3300/0 4 ==== fsmap(e 37) ==== 8430+0+0 (secure 0 0 0) 0x7f79f800b040 con 0x559ff0d46810 2024-09-05T01:30:48.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.334+0000 7f7a0a2d3740 10 client.25948 fetch_fsmap finished waiting for FSMap version 37 2024-09-05T01:30:48.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.334+0000 7f7a0a2d3740 10 client.25948 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:30:48.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.334+0000 7f7a0a2d3740 20 client.25948 populate_metadata read hostname 'smithi012' 2024-09-05T01:30:48.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.334+0000 7f7a0a2d3740 1 --2- 172.21.15.12:0/774007525 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x559ff0dc5650 0x559ff0dc7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:30:48.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.334+0000 7f7a0a2d3740 4 client.25948 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-05T01:30:48.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.334+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/774007525 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559ff0ca4d10 con 0x559ff0dc5650 2024-09-05T01:30:48.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.336+0000 7f7a04e00640 1 --2- 172.21.15.12:0/774007525 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x559ff0dc5650 0x559ff0dc7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:30:48.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.337+0000 7f7a04e00640 1 --2- 172.21.15.12:0/774007525 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x559ff0dc5650 0x559ff0dc7ad0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcf133a78b2b7a82 server_cookie=80f2b432785ffc43 in_seq=0 out_seq=0 2024-09-05T01:30:48.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.337+0000 7f79e6a00640 10 client.25948 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:30:48.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.338+0000 7f79e6a00640 1 -- 172.21.15.12:0/774007525 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559ff0ca4d10 con 0x559ff0dc5650 2024-09-05T01:30:48.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.338+0000 7f79e6a00640 10 client.25948 handle_command_reply: tid=0 2024-09-05T01:30:48.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.338+0000 7f7a0a2d3740 1 client.25948 shutdown 2024-09-05T01:30:48.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.339+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/774007525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ff0d46810 msgr2=0x559ff0d5e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:48.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.339+0000 7f7a0a2d3740 1 --2- 172.21.15.12:0/774007525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ff0d46810 0x559ff0d5e280 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f79f8006010 tx=0x7f79f800dea0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.339+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/774007525 shutdown_connections 2024-09-05T01:30:48.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.339+0000 7f7a0a2d3740 1 --2- 172.21.15.12:0/774007525 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x559ff0dc5650 0x559ff0dc7ad0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.339+0000 7f7a0a2d3740 1 --2- 172.21.15.12:0/774007525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559ff0d46810 0x559ff0d5e280 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.339+0000 7f7a0a2d3740 1 --2- 172.21.15.12:0/774007525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559ff0d45ef0 0x559ff0d5dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.366 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:30:48.366 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-05T01:30:48.366 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "0ae3b716-e7ac-40c8-ab2a-38e13361fb26", 2024-09-05T01:30:48.366 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-05T01:30:48.366 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:30:48.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.339+0000 7f7a0a2d3740 1 --2- 172.21.15.12:0/774007525 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x559ff0d40eb0 0x559ff0d5d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.339+0000 7f79e6a00640 0 client.25948 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:30:48.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.339+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/774007525 >> 172.21.15.12:0/774007525 conn(0x559ff0d32cf0 msgr2=0x559ff0d4ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:30:48.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.340+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/774007525 shutdown_connections 2024-09-05T01:30:48.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.340+0000 7f7a0a2d3740 1 -- 172.21.15.12:0/774007525 wait complete. 2024-09-05T01:30:48.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.341+0000 7f7a0a2d3740 20 client.25948 trim_cache size 0 max 16384 2024-09-05T01:30:48.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.342+0000 7f7a06200640 1 -- 172.21.15.12:0/521073336 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f79e80a2e80 msgr2=0x7f79e80a5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:48.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.342+0000 7f7a06200640 1 --2- 172.21.15.12:0/521073336 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f79e80a2e80 0x7f79e80a5340 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f79f4005e00 tx=0x7f79f4005c50 comp rx=0 tx=0).stop 2024-09-05T01:30:48.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.342+0000 7f7a06200640 1 -- 172.21.15.12:0/521073336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a00102360 msgr2=0x7f7a0006cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:30:48.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.342+0000 7f7a06200640 1 --2- 172.21.15.12:0/521073336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a00102360 0x7f7a0006cab0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f79ec000c00 tx=0x7f79ec033e50 comp rx=0 tx=0).stop 2024-09-05T01:30:48.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.343+0000 7f7a06200640 1 -- 172.21.15.12:0/521073336 shutdown_connections 2024-09-05T01:30:48.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.343+0000 7f7a06200640 1 --2- 172.21.15.12:0/521073336 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f79e80a2e80 0x7f79e80a5340 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.343+0000 7f7a06200640 1 --2- 172.21.15.12:0/521073336 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7a001079c0 0x7f7a0006cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.343+0000 7f7a06200640 1 --2- 172.21.15.12:0/521073336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7a00102360 0x7f7a0006cab0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.343+0000 7f7a06200640 1 --2- 172.21.15.12:0/521073336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a001019c0 0x7f7a00073a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:30:48.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.343+0000 7f7a06200640 1 -- 172.21.15.12:0/521073336 >> 172.21.15.12:0/521073336 conn(0x7f7a000fd740 msgr2=0x7f7a000fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:30:48.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.343+0000 7f7a06200640 1 -- 172.21.15.12:0/521073336 shutdown_connections 2024-09-05T01:30:48.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:30:48.343+0000 7f7a06200640 1 -- 172.21.15.12:0/521073336 wait complete. 2024-09-05T01:30:48.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:48 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:30:48.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:48 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:30:49.360 INFO:tasks.workunit.client.0.smithi012.stdout: 688 562803 1555 403910 1542 155532 1323 2024-09-05T01:30:49.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:49 smithi012 ceph-mon[29942]: pgmap v186: 97 pgs: 97 active+clean; 2.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.4 MiB/s wr, 202 op/s 2024-09-05T01:30:49.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:49 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:30:49.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:49 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:30:49.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:49 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:30:49.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:49 smithi012 ceph-mon[29942]: scrub queued for path: / 2024-09-05T01:30:49.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:49 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:30:49.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:49 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:30:49.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:49 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:30:49.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:49 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:30:49.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:49 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:30:49.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:49 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:30:49.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:49 smithi145 ceph-mon[34376]: pgmap v186: 97 pgs: 97 active+clean; 2.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.4 MiB/s wr, 202 op/s 2024-09-05T01:30:49.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:49 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:30:49.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:49 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:30:49.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:49 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:30:49.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:49 smithi145 ceph-mon[34376]: scrub queued for path: / 2024-09-05T01:30:49.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:49 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:30:49.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:49 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:30:49.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:49 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:30:49.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:49 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:30:49.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:49 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:30:49.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:49 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:30:49.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:49 smithi151 ceph-mon[35013]: pgmap v186: 97 pgs: 97 active+clean; 2.5 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.4 MiB/s wr, 202 op/s 2024-09-05T01:30:49.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:49 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:30:49.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:49 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:30:49.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:49 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:30:49.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:49 smithi151 ceph-mon[35013]: scrub queued for path: / 2024-09-05T01:30:49.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:49 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:30:49.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:49 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:30:49.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:49 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:30:49.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:49 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:30:49.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:49 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:30:49.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:49 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:30:51.212 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:51 smithi012 ceph-mon[29942]: pgmap v187: 97 pgs: 97 active+clean; 2.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 7.9 MiB/s wr, 357 op/s 2024-09-05T01:30:51.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:51 smithi145 ceph-mon[34376]: pgmap v187: 97 pgs: 97 active+clean; 2.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 7.9 MiB/s wr, 357 op/s 2024-09-05T01:30:51.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:51 smithi151 ceph-mon[35013]: pgmap v187: 97 pgs: 97 active+clean; 2.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 7.9 MiB/s wr, 357 op/s 2024-09-05T01:30:51.904 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T01:30:53.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:53 smithi012 ceph-mon[29942]: pgmap v188: 97 pgs: 97 active+clean; 2.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.2 MiB/s wr, 301 op/s 2024-09-05T01:30:53.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:53 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:30:53.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:53 smithi145 ceph-mon[34376]: pgmap v188: 97 pgs: 97 active+clean; 2.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.2 MiB/s wr, 301 op/s 2024-09-05T01:30:53.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:53 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:30:53.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:53 smithi151 ceph-mon[35013]: pgmap v188: 97 pgs: 97 active+clean; 2.5 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.2 MiB/s wr, 301 op/s 2024-09-05T01:30:53.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:53 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:30:55.244 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:55 smithi012 ceph-mon[29942]: pgmap v189: 97 pgs: 97 active+clean; 2.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 21 MiB/s wr, 1.03k op/s 2024-09-05T01:30:55.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:55 smithi145 ceph-mon[34376]: pgmap v189: 97 pgs: 97 active+clean; 2.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 21 MiB/s wr, 1.03k op/s 2024-09-05T01:30:55.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:55 smithi151 ceph-mon[35013]: pgmap v189: 97 pgs: 97 active+clean; 2.7 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 21 MiB/s wr, 1.03k op/s 2024-09-05T01:30:57.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:57 smithi012 ceph-mon[29942]: pgmap v190: 97 pgs: 97 active+clean; 2.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 21 MiB/s wr, 1k op/s 2024-09-05T01:30:57.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:57 smithi145 ceph-mon[34376]: pgmap v190: 97 pgs: 97 active+clean; 2.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 21 MiB/s wr, 1k op/s 2024-09-05T01:30:57.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:57 smithi151 ceph-mon[35013]: pgmap v190: 97 pgs: 97 active+clean; 2.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 21 MiB/s wr, 1k op/s 2024-09-05T01:30:59.265 INFO:tasks.workunit.client.0.smithi012.stdout: 696 404224 607 288027 412 107744 841 2024-09-05T01:30:59.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:30:59 smithi012 ceph-mon[29942]: pgmap v191: 97 pgs: 97 active+clean; 2.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 21 MiB/s wr, 1.06k op/s 2024-09-05T01:30:59.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:30:59 smithi145 ceph-mon[34376]: pgmap v191: 97 pgs: 97 active+clean; 2.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 21 MiB/s wr, 1.06k op/s 2024-09-05T01:30:59.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:30:59 smithi151 ceph-mon[35013]: pgmap v191: 97 pgs: 97 active+clean; 2.7 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 21 MiB/s wr, 1.06k op/s 2024-09-05T01:31:01.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:01 smithi012 ceph-mon[29942]: pgmap v192: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 24 MiB/s wr, 1.21k op/s 2024-09-05T01:31:01.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:01 smithi145 ceph-mon[34376]: pgmap v192: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 24 MiB/s wr, 1.21k op/s 2024-09-05T01:31:01.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:01 smithi151 ceph-mon[35013]: pgmap v192: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 24 MiB/s wr, 1.21k op/s 2024-09-05T01:31:03.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:03 smithi012 ceph-mon[29942]: pgmap v193: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 20 MiB/s wr, 1.06k op/s 2024-09-05T01:31:03.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:03 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:03.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:03 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:03.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:03 smithi145 ceph-mon[34376]: pgmap v193: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 20 MiB/s wr, 1.06k op/s 2024-09-05T01:31:03.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:03 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:03.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:03 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:03.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:03 smithi151 ceph-mon[35013]: pgmap v193: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 20 MiB/s wr, 1.06k op/s 2024-09-05T01:31:03.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:03 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:03.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:03 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:04.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:04 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:04.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:04 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:04.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:04 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:04.792 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:31:05.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:05 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:05.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:05 smithi012 ceph-mon[29942]: pgmap v194: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 21 MiB/s wr, 1.12k op/s 2024-09-05T01:31:05.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:05 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:05.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:05 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:05.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:05 smithi145 ceph-mon[34376]: pgmap v194: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 21 MiB/s wr, 1.12k op/s 2024-09-05T01:31:05.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:05 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:05.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:05 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:05.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:05 smithi151 ceph-mon[35013]: pgmap v194: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 21 MiB/s wr, 1.12k op/s 2024-09-05T01:31:05.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:05 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:06.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.697+0000 7f60d4000640 1 -- 172.21.15.12:0/1264875231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60cc1034b0 msgr2=0x7f60cc10b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:06.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.697+0000 7f60d4000640 1 --2- 172.21.15.12:0/1264875231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60cc1034b0 0x7f60cc10b9a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f60c0009900 tx=0x7f60c002a4a0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.697+0000 7f60d4000640 1 -- 172.21.15.12:0/1264875231 shutdown_connections 2024-09-05T01:31:06.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.697+0000 7f60d4000640 1 --2- 172.21.15.12:0/1264875231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60cc10bfc0 0x7f60cc10e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.697+0000 7f60d4000640 1 --2- 172.21.15.12:0/1264875231 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60cc1034b0 0x7f60cc10b9a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.697+0000 7f60d4000640 1 --2- 172.21.15.12:0/1264875231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60cc102b90 0x7f60cc102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.697+0000 7f60d4000640 1 -- 172.21.15.12:0/1264875231 >> 172.21.15.12:0/1264875231 conn(0x7f60cc0fc610 msgr2=0x7f60cc0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:06.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.697+0000 7f60d4000640 1 -- 172.21.15.12:0/1264875231 shutdown_connections 2024-09-05T01:31:06.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.697+0000 7f60d4000640 1 -- 172.21.15.12:0/1264875231 wait complete. 2024-09-05T01:31:06.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.698+0000 7f60d4000640 1 Processor -- start 2024-09-05T01:31:06.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.699+0000 7f60d4000640 1 -- start start 2024-09-05T01:31:06.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.699+0000 7f60d4000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60cc102b90 0x7f60cc198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:06.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.699+0000 7f60d4000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60cc1034b0 0x7f60cc198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:06.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.699+0000 7f60d4000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60cc10bfc0 0x7f60cc19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:06.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.700+0000 7f60d1600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60cc102b90 0x7f60cc198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:06.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.704+0000 7f60d0c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60cc1034b0 0x7f60cc198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:06.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.704+0000 7f60d1600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60cc102b90 0x7f60cc198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49098/0 (socket says 172.21.15.12:49098) 2024-09-05T01:31:06.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.704+0000 7f60d0c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60cc1034b0 0x7f60cc198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:42128/0 (socket says 172.21.15.12:42128) 2024-09-05T01:31:06.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.704+0000 7f60d0c00640 1 -- 172.21.15.12:0/3652154067 learned_addr learned my addr 172.21.15.12:0/3652154067 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:06.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.704+0000 7f60d4000640 1 -- 172.21.15.12:0/3652154067 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f60cc111e10 con 0x7f60cc102b90 2024-09-05T01:31:06.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.704+0000 7f60d4000640 1 -- 172.21.15.12:0/3652154067 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f60cc111c90 con 0x7f60cc1034b0 2024-09-05T01:31:06.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.704+0000 7f60d4000640 1 -- 172.21.15.12:0/3652154067 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f60cc111f90 con 0x7f60cc10bfc0 2024-09-05T01:31:06.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.704+0000 7f60d2000640 1 --2- 172.21.15.12:0/3652154067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60cc10bfc0 0x7f60cc19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:06.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.705+0000 7f60d2000640 1 -- 172.21.15.12:0/3652154067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60cc1034b0 msgr2=0x7f60cc198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:06.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.705+0000 7f60d2000640 1 --2- 172.21.15.12:0/3652154067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60cc1034b0 0x7f60cc198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.705+0000 7f60d2000640 1 -- 172.21.15.12:0/3652154067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60cc102b90 msgr2=0x7f60cc198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:06.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.705+0000 7f60d2000640 1 --2- 172.21.15.12:0/3652154067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60cc102b90 0x7f60cc198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.705+0000 7f60d2000640 1 -- 172.21.15.12:0/3652154067 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60cc19d2e0 con 0x7f60cc10bfc0 2024-09-05T01:31:06.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.706+0000 7f60d2000640 1 --2- 172.21.15.12:0/3652154067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60cc10bfc0 0x7f60cc19cc00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f60b8009e40 tx=0x7f60b800ed40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:06.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.706+0000 7f60ca000640 1 -- 172.21.15.12:0/3652154067 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b800ccc0 con 0x7f60cc10bfc0 2024-09-05T01:31:06.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.706+0000 7f60d4000640 1 -- 172.21.15.12:0/3652154067 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60cc19d5d0 con 0x7f60cc10bfc0 2024-09-05T01:31:06.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.707+0000 7f60d4000640 1 -- 172.21.15.12:0/3652154067 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60cc100720 con 0x7f60cc10bfc0 2024-09-05T01:31:06.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.707+0000 7f60ca000640 1 -- 172.21.15.12:0/3652154067 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60b8005020 con 0x7f60cc10bfc0 2024-09-05T01:31:06.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.707+0000 7f60ca000640 1 -- 172.21.15.12:0/3652154067 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b800ccc0 con 0x7f60cc10bfc0 2024-09-05T01:31:06.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.717+0000 7f60d6c4c740 1 Processor -- start 2024-09-05T01:31:06.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.719+0000 7f60ca000640 1 -- 172.21.15.12:0/3652154067 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f60b8022020 con 0x7f60cc10bfc0 2024-09-05T01:31:06.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.719+0000 7f60d6c4c740 1 -- start start 2024-09-05T01:31:06.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.720+0000 7f60d6c4c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad85cf2d50 0x55ad85cf3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:06.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.720+0000 7f60d6c4c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad85cf3670 0x55ad85cfd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:06.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.720+0000 7f60d6c4c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cfdf30 0x55ad85d00320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:06.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.720+0000 7f60d6c4c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ad85c593e0 con 0x55ad85cf2d50 2024-09-05T01:31:06.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.720+0000 7f60d6c4c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55ad85c00d80 con 0x55ad85cf3670 2024-09-05T01:31:06.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.720+0000 7f60d6c4c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ad85c553a0 con 0x55ad85cfdf30 2024-09-05T01:31:06.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.720+0000 7f60d1600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad85cf3670 0x55ad85cfd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:06.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.720+0000 7f60d1600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad85cf3670 0x55ad85cfd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:42138/0 (socket says 172.21.15.12:42138) 2024-09-05T01:31:06.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.720+0000 7f60d1600640 1 -- 172.21.15.12:0/600719599 learned_addr learned my addr 172.21.15.12:0/600719599 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:06.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.721+0000 7f60d1600640 1 -- 172.21.15.12:0/600719599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cfdf30 msgr2=0x55ad85d00320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:31:06.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.721+0000 7f60d1600640 1 --2- 172.21.15.12:0/600719599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cfdf30 0x55ad85d00320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.721+0000 7f60d1600640 1 -- 172.21.15.12:0/600719599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad85cf2d50 msgr2=0x55ad85cf3130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:31:06.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.721+0000 7f60d1600640 1 --2- 172.21.15.12:0/600719599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad85cf2d50 0x55ad85cf3130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.721+0000 7f60d1600640 1 -- 172.21.15.12:0/600719599 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad85c1fae0 con 0x55ad85cf3670 2024-09-05T01:31:06.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.721+0000 7f60d1600640 1 --2- 172.21.15.12:0/600719599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad85cf3670 0x55ad85cfd9f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009fc0 tx=0x7f60c400f7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1e0ac48431d580c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:06.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.722+0000 7f60ca000640 1 --2- 172.21.15.12:0/3652154067 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f60b40a2ef0 0x7f60b40a53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:06.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.722+0000 7f60be600640 1 -- 172.21.15.12:0/600719599 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c4011700 con 0x55ad85cf3670 2024-09-05T01:31:06.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.722+0000 7f60be600640 1 -- 172.21.15.12:0/600719599 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60c4011d80 con 0x55ad85cf3670 2024-09-05T01:31:06.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.722+0000 7f60ca000640 1 -- 172.21.15.12:0/3652154067 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f60b80d2ef0 con 0x7f60cc10bfc0 2024-09-05T01:31:06.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.722+0000 7f60be600640 1 -- 172.21.15.12:0/600719599 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c40103d0 con 0x55ad85cf3670 2024-09-05T01:31:06.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.723+0000 7f60d0c00640 1 --2- 172.21.15.12:0/3652154067 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f60b40a2ef0 0x7f60b40a53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:06.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.723+0000 7f60d6c4c740 1 -- 172.21.15.12:0/600719599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad85cf3670 msgr2=0x55ad85cfd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:06.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.723+0000 7f60d6c4c740 1 --2- 172.21.15.12:0/600719599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad85cf3670 0x55ad85cfd9f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009fc0 tx=0x7f60c400f7f0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.723+0000 7f60d6c4c740 1 -- 172.21.15.12:0/600719599 shutdown_connections 2024-09-05T01:31:06.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.723+0000 7f60d6c4c740 1 --2- 172.21.15.12:0/600719599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cfdf30 0x55ad85d00320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.723+0000 7f60d6c4c740 1 --2- 172.21.15.12:0/600719599 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad85cf3670 0x55ad85cfd9f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.723+0000 7f60d6c4c740 1 --2- 172.21.15.12:0/600719599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad85cf2d50 0x55ad85cf3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.723+0000 7f60d6c4c740 1 -- 172.21.15.12:0/600719599 >> 172.21.15.12:0/600719599 conn(0x55ad85cef2e0 msgr2=0x55ad85cef6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:06.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.723+0000 7f60d6c4c740 1 -- 172.21.15.12:0/600719599 shutdown_connections 2024-09-05T01:31:06.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.724+0000 7f60d6c4c740 1 -- 172.21.15.12:0/600719599 wait complete. 2024-09-05T01:31:06.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.724+0000 7f60d6c4c740 1 -- start start 2024-09-05T01:31:06.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.725+0000 7f60d6c4c740 1 Processor -- start 2024-09-05T01:31:06.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.725+0000 7f60d0c00640 1 --2- 172.21.15.12:0/3652154067 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f60b40a2ef0 0x7f60b40a53b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55ad85cf0660 tx=0x7f60c00046c0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:06.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.729+0000 7f60d6c4c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad85cf2d50 0x55ad85cfd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:06.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.729+0000 7f60d6c4c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad85cf3670 0x55ad85cfac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:06.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.729+0000 7f60d6c4c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cfdf30 0x55ad85cfb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:06.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.730+0000 7f60d6c4c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ad85d11c00 con 0x55ad85cf2d50 2024-09-05T01:31:06.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.730+0000 7f60d6c4c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55ad85c140f0 con 0x55ad85cf3670 2024-09-05T01:31:06.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.730+0000 7f60d6c4c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ad85d11d80 con 0x55ad85cfdf30 2024-09-05T01:31:06.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.730+0000 7f60d6c4c740 10 client.0 _ll_register_callbacks cb 0x55ad85c059e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:31:06.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.730+0000 7f60d0c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad85cf3670 0x55ad85cfac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:06.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.730+0000 7f60d2000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cfdf30 0x55ad85cfb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:06.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.730+0000 7f60d2000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cfdf30 0x55ad85cfb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:51768/0 (socket says 172.21.15.12:51768) 2024-09-05T01:31:06.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.730+0000 7f60d2000640 1 -- 172.21.15.12:0/705227136 learned_addr learned my addr 172.21.15.12:0/705227136 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:06.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.730+0000 7f60d2000640 1 -- 172.21.15.12:0/705227136 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad85cf3670 msgr2=0x55ad85cfac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:06.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.731+0000 7f60d2000640 1 --2- 172.21.15.12:0/705227136 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad85cf3670 0x55ad85cfac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.731+0000 7f60d2000640 1 -- 172.21.15.12:0/705227136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad85cf2d50 msgr2=0x55ad85cfd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:06.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.731+0000 7f60d2000640 1 --2- 172.21.15.12:0/705227136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad85cf2d50 0x55ad85cfd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.731+0000 7f60d2000640 1 -- 172.21.15.12:0/705227136 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad859ca3c0 con 0x55ad85cfdf30 2024-09-05T01:31:06.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.731+0000 7f60b2a00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:31:06.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.731+0000 7f60d2000640 1 --2- 172.21.15.12:0/705227136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cfdf30 0x55ad85cfb3b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f60b809b910 tx=0x7f60b809f4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=412d6e9196b7b403 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:06.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.731+0000 7f60b2a00640 1 -- 172.21.15.12:0/705227136 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b801f040 con 0x55ad85cfdf30 2024-09-05T01:31:06.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.732+0000 7f60d6c4c740 1 -- 172.21.15.12:0/705227136 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60c4011d80 con 0x55ad85cfdf30 2024-09-05T01:31:06.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.732+0000 7f60b2a00640 1 -- 172.21.15.12:0/705227136 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f60b809f710 con 0x55ad85cfdf30 2024-09-05T01:31:06.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.735+0000 7f60b2a00640 1 -- 172.21.15.12:0/705227136 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f60b801f040 con 0x55ad85cfdf30 2024-09-05T01:31:06.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.735+0000 7f60d6c4c740 10 client.25957 fetch_fsmap learned FSMap version 38 2024-09-05T01:31:06.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.735+0000 7f60d6c4c740 1 -- 172.21.15.12:0/705227136 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55ad85d1d830 con 0x55ad85cfdf30 2024-09-05T01:31:06.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.735+0000 7f60b2a00640 1 -- 172.21.15.12:0/705227136 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60c4011d80 con 0x55ad85cfdf30 2024-09-05T01:31:06.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.739+0000 7f60b2a00640 1 -- 172.21.15.12:0/705227136 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 38) ==== 8442+0+0 (secure 0 0 0) 0x7f60b80a7c90 con 0x55ad85cfdf30 2024-09-05T01:31:06.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.740+0000 7f60d6c4c740 10 client.25957 fetch_fsmap finished waiting for FSMap version 38 2024-09-05T01:31:06.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.740+0000 7f60d6c4c740 10 client.25957 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:31:06.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.740+0000 7f60d6c4c740 20 client.25957 populate_metadata read hostname 'smithi012' 2024-09-05T01:31:06.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.740+0000 7f60d6c4c740 1 --2- 172.21.15.12:0/705227136 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ad85d1ed30 0x55ad85d211f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:06.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.740+0000 7f60d6c4c740 4 client.25957 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:31:06.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.740+0000 7f60d6c4c740 1 -- 172.21.15.12:0/705227136 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad85c66950 con 0x55ad85d1ed30 2024-09-05T01:31:06.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.740+0000 7f60d1600640 1 --2- 172.21.15.12:0/705227136 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ad85d1ed30 0x55ad85d211f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:06.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.741+0000 7f60d1600640 1 --2- 172.21.15.12:0/705227136 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ad85d1ed30 0x55ad85d211f0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfd9e76e166d957d server_cookie=e27c43998e86d153 in_seq=0 out_seq=0 2024-09-05T01:31:06.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.741+0000 7f60b2a00640 10 client.25957 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:31:06.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.742+0000 7f60b2a00640 1 -- 172.21.15.12:0/705227136 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ad85c66950 con 0x55ad85d1ed30 2024-09-05T01:31:06.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.742+0000 7f60b2a00640 10 client.25957 handle_command_reply: tid=0 2024-09-05T01:31:06.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.743+0000 7f60d6c4c740 1 client.25957 shutdown 2024-09-05T01:31:06.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.743+0000 7f60d6c4c740 1 -- 172.21.15.12:0/705227136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cfdf30 msgr2=0x55ad85cfb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:06.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.743+0000 7f60d6c4c740 1 --2- 172.21.15.12:0/705227136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cfdf30 0x55ad85cfb3b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f60b809b910 tx=0x7f60b809f4b0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.743+0000 7f60d6c4c740 1 -- 172.21.15.12:0/705227136 shutdown_connections 2024-09-05T01:31:06.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.743+0000 7f60d6c4c740 1 --2- 172.21.15.12:0/705227136 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ad85d1ed30 0x55ad85d211f0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.743+0000 7f60d6c4c740 1 --2- 172.21.15.12:0/705227136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cfdf30 0x55ad85cfb3b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.743+0000 7f60d6c4c740 1 --2- 172.21.15.12:0/705227136 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad85cf3670 0x55ad85cfac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.743+0000 7f60d6c4c740 1 --2- 172.21.15.12:0/705227136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad85cf2d50 0x55ad85cfd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.743+0000 7f60d6c4c740 1 -- 172.21.15.12:0/705227136 >> 172.21.15.12:0/705227136 conn(0x55ad85cef2e0 msgr2=0x55ad85cf5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:06.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.743+0000 7f60b2a00640 0 client.25957 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:31:06.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.744+0000 7f60d6c4c740 1 -- 172.21.15.12:0/705227136 shutdown_connections 2024-09-05T01:31:06.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.744+0000 7f60d6c4c740 1 -- 172.21.15.12:0/705227136 wait complete. 2024-09-05T01:31:06.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.744+0000 7f60d6c4c740 20 client.25957 trim_cache size 0 max 16384 2024-09-05T01:31:06.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.787+0000 7f60d6c4c740 1 Processor -- start 2024-09-05T01:31:06.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.787+0000 7f60d6c4c740 1 -- start start 2024-09-05T01:31:06.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.787+0000 7f60d6c4c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cf2d50 0x55ad85cfabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:06.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.787+0000 7f60d6c4c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad85cf3670 0x55ad85d26b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:06.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.788+0000 7f60d6c4c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad85cfdf30 0x55ad85d27040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:06.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.788+0000 7f60d6c4c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f60ac00e7f0 con 0x55ad85cf3670 2024-09-05T01:31:06.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.788+0000 7f60d6c4c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f60ac010570 con 0x55ad85cfdf30 2024-09-05T01:31:06.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.788+0000 7f60d6c4c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f60ac00eec0 con 0x55ad85cf2d50 2024-09-05T01:31:06.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.788+0000 7f60d1600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cf2d50 0x55ad85cfabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:06.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.788+0000 7f60d1600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cf2d50 0x55ad85cfabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:51780/0 (socket says 172.21.15.12:51780) 2024-09-05T01:31:06.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.788+0000 7f60d1600640 1 -- 172.21.15.12:0/1636183470 learned_addr learned my addr 172.21.15.12:0/1636183470 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:06.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.788+0000 7f60d1600640 1 -- 172.21.15.12:0/1636183470 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad85cfdf30 msgr2=0x55ad85d27040 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:31:06.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.788+0000 7f60d1600640 1 --2- 172.21.15.12:0/1636183470 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad85cfdf30 0x55ad85d27040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.788+0000 7f60d1600640 1 -- 172.21.15.12:0/1636183470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad85cf3670 msgr2=0x55ad85d26b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:06.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.788+0000 7f60d1600640 1 --2- 172.21.15.12:0/1636183470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad85cf3670 0x55ad85d26b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.788+0000 7f60d1600640 1 -- 172.21.15.12:0/1636183470 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad85d21870 con 0x55ad85cf2d50 2024-09-05T01:31:06.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.789+0000 7f60d1600640 1 --2- 172.21.15.12:0/1636183470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cf2d50 0x55ad85cfabf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f60c400fcf0 tx=0x7f60c401ba70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f898bf1806070e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:06.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.792+0000 7f60bdc00640 1 -- 172.21.15.12:0/1636183470 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c40103d0 con 0x55ad85cf2d50 2024-09-05T01:31:06.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.792+0000 7f60bdc00640 1 -- 172.21.15.12:0/1636183470 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60c4021040 con 0x55ad85cf2d50 2024-09-05T01:31:06.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.792+0000 7f60bdc00640 1 -- 172.21.15.12:0/1636183470 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c4003bd0 con 0x55ad85cf2d50 2024-09-05T01:31:06.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.794+0000 7f60d6c4c740 1 -- 172.21.15.12:0/1636183470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cf2d50 msgr2=0x55ad85cfabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:06.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.794+0000 7f60d6c4c740 1 --2- 172.21.15.12:0/1636183470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cf2d50 0x55ad85cfabf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f60c400fcf0 tx=0x7f60c401ba70 comp rx=0 tx=0).stop 2024-09-05T01:31:06.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.794+0000 7f60d6c4c740 1 -- 172.21.15.12:0/1636183470 shutdown_connections 2024-09-05T01:31:06.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.794+0000 7f60d6c4c740 1 --2- 172.21.15.12:0/1636183470 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad85cfdf30 0x55ad85d27040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.794+0000 7f60d6c4c740 1 --2- 172.21.15.12:0/1636183470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad85cf3670 0x55ad85d26b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.794+0000 7f60d6c4c740 1 --2- 172.21.15.12:0/1636183470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cf2d50 0x55ad85cfabf0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.794+0000 7f60d6c4c740 1 -- 172.21.15.12:0/1636183470 >> 172.21.15.12:0/1636183470 conn(0x55ad85cef2e0 msgr2=0x55ad85cfa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:06.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.794+0000 7f60d6c4c740 1 -- 172.21.15.12:0/1636183470 shutdown_connections 2024-09-05T01:31:06.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.794+0000 7f60d6c4c740 1 -- 172.21.15.12:0/1636183470 wait complete. 2024-09-05T01:31:06.821 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:31:06.822 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-05T01:31:06.822 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-05T01:31:06.822 INFO:teuthology.orchestra.run.smithi012.stdout: "0ae3b716-e7ac-40c8-ab2a-38e13361fb26": { 2024-09-05T01:31:06.822 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-05T01:31:06.822 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "0ae3b716-e7ac-40c8-ab2a-38e13361fb26", 2024-09-05T01:31:06.822 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-05T01:31:06.822 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:31:06.822 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:31:06.823 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:31:06.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.795+0000 7f60d6c4c740 1 -- start start 2024-09-05T01:31:06.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.795+0000 7f60d6c4c740 1 Processor -- start 2024-09-05T01:31:06.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.796+0000 7f60d6c4c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad85cf2d50 0x55ad85d17290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:06.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.796+0000 7f60d6c4c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad85cf3670 0x55ad85d177d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:06.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.796+0000 7f60d6c4c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cfdf30 0x55ad85d12060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:06.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.797+0000 7f60d6c4c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f60ac00fde0 con 0x55ad85cf3670 2024-09-05T01:31:06.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.797+0000 7f60d6c4c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f60ac00f650 con 0x55ad85cf2d50 2024-09-05T01:31:06.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.797+0000 7f60d6c4c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f60ac00c7d0 con 0x55ad85cfdf30 2024-09-05T01:31:06.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.797+0000 7f60d6c4c740 10 client.0 _ll_register_callbacks cb 0x7f60b809ee80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:31:06.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.797+0000 7f60d2000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cfdf30 0x55ad85d12060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:06.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.797+0000 7f60d2000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cfdf30 0x55ad85d12060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:51784/0 (socket says 172.21.15.12:51784) 2024-09-05T01:31:06.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.797+0000 7f60d2000640 1 -- 172.21.15.12:0/1472009106 learned_addr learned my addr 172.21.15.12:0/1472009106 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:06.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.799+0000 7f60d1600640 1 --2- 172.21.15.12:0/1472009106 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad85cf2d50 0x55ad85d17290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:06.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.799+0000 7f60d0c00640 1 --2- 172.21.15.12:0/1472009106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad85cf3670 0x55ad85d177d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:06.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.800+0000 7f60d2000640 1 -- 172.21.15.12:0/1472009106 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad85cf2d50 msgr2=0x55ad85d17290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:06.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.800+0000 7f60d2000640 1 --2- 172.21.15.12:0/1472009106 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad85cf2d50 0x55ad85d17290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.800+0000 7f60d2000640 1 -- 172.21.15.12:0/1472009106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad85cf3670 msgr2=0x55ad85d177d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:06.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.800+0000 7f60d2000640 1 --2- 172.21.15.12:0/1472009106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad85cf3670 0x55ad85d177d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.801+0000 7f60d2000640 1 -- 172.21.15.12:0/1472009106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad85ceff70 con 0x55ad85cfdf30 2024-09-05T01:31:06.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.801+0000 7f60d0c00640 1 --2- 172.21.15.12:0/1472009106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad85cf3670 0x55ad85d177d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:31:06.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.801+0000 7f60d2000640 1 --2- 172.21.15.12:0/1472009106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cfdf30 0x55ad85d12060 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f60b809f440 tx=0x7f60b80045a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63626bf197b1767f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:06.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.801+0000 7f60b2a00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:31:06.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.802+0000 7f60b2a00640 1 -- 172.21.15.12:0/1472009106 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b809f710 con 0x55ad85cfdf30 2024-09-05T01:31:06.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.802+0000 7f60b2a00640 1 -- 172.21.15.12:0/1472009106 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8535+0+0 (secure 0 0 0) 0x7f60b809f8b0 con 0x55ad85cfdf30 2024-09-05T01:31:06.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.802+0000 7f60d6c4c740 1 -- 172.21.15.12:0/1472009106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60c4021040 con 0x55ad85cfdf30 2024-09-05T01:31:06.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.802+0000 7f60b2a00640 1 -- 172.21.15.12:0/1472009106 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f60b809b200 con 0x55ad85cfdf30 2024-09-05T01:31:06.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.802+0000 7f60d6c4c740 10 client.25963 fetch_fsmap learned FSMap version 38 2024-09-05T01:31:06.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.802+0000 7f60d6c4c740 1 -- 172.21.15.12:0/1472009106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55ad85cef110 con 0x55ad85cfdf30 2024-09-05T01:31:06.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.802+0000 7f60b2a00640 1 -- 172.21.15.12:0/1472009106 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60c4021040 con 0x55ad85cfdf30 2024-09-05T01:31:06.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.803+0000 7f60b2a00640 1 -- 172.21.15.12:0/1472009106 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 38) ==== 8442+0+0 (secure 0 0 0) 0x7f60b80a49f0 con 0x55ad85cfdf30 2024-09-05T01:31:06.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.803+0000 7f60d6c4c740 10 client.25963 fetch_fsmap finished waiting for FSMap version 38 2024-09-05T01:31:06.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.803+0000 7f60d6c4c740 10 client.25963 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:31:06.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.803+0000 7f60d6c4c740 20 client.25963 populate_metadata read hostname 'smithi012' 2024-09-05T01:31:06.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.803+0000 7f60d6c4c740 1 --2- 172.21.15.12:0/1472009106 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ad85d93030 0x55ad85d95450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:06.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.803+0000 7f60d6c4c740 4 client.25963 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T01:31:06.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.803+0000 7f60d6c4c740 1 -- 172.21.15.12:0/1472009106 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ad85c60e60 con 0x55ad85d93030 2024-09-05T01:31:06.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.803+0000 7f60d1600640 1 --2- 172.21.15.12:0/1472009106 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ad85d93030 0x55ad85d95450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:06.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.804+0000 7f60d1600640 1 --2- 172.21.15.12:0/1472009106 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ad85d93030 0x55ad85d95450 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88dffc032eb6b9cf server_cookie=da8f57f887770802 in_seq=0 out_seq=0 2024-09-05T01:31:06.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.804+0000 7f60b2a00640 10 client.25963 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:31:06.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.805+0000 7f60b2a00640 1 -- 172.21.15.12:0/1472009106 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55ad85c60e60 con 0x55ad85d93030 2024-09-05T01:31:06.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.805+0000 7f60b2a00640 10 client.25963 handle_command_reply: tid=0 2024-09-05T01:31:06.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.805+0000 7f60d6c4c740 1 client.25963 shutdown 2024-09-05T01:31:06.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.805+0000 7f60d6c4c740 1 -- 172.21.15.12:0/1472009106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cfdf30 msgr2=0x55ad85d12060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:06.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.805+0000 7f60d6c4c740 1 --2- 172.21.15.12:0/1472009106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cfdf30 0x55ad85d12060 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f60b809f440 tx=0x7f60b80045a0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.805+0000 7f60d6c4c740 1 -- 172.21.15.12:0/1472009106 shutdown_connections 2024-09-05T01:31:06.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.805+0000 7f60d6c4c740 1 --2- 172.21.15.12:0/1472009106 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ad85d93030 0x55ad85d95450 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.805+0000 7f60d6c4c740 1 --2- 172.21.15.12:0/1472009106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad85cfdf30 0x55ad85d12060 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.805+0000 7f60d6c4c740 1 --2- 172.21.15.12:0/1472009106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ad85cf3670 0x55ad85d177d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.805+0000 7f60d6c4c740 1 --2- 172.21.15.12:0/1472009106 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ad85cf2d50 0x55ad85d17290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.805+0000 7f60d6c4c740 1 -- 172.21.15.12:0/1472009106 >> 172.21.15.12:0/1472009106 conn(0x55ad85cef2e0 msgr2=0x55ad85cfc480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:06.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.805+0000 7f60b2a00640 0 client.25963 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:31:06.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.806+0000 7f60d6c4c740 1 -- 172.21.15.12:0/1472009106 shutdown_connections 2024-09-05T01:31:06.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.806+0000 7f60d6c4c740 1 -- 172.21.15.12:0/1472009106 wait complete. 2024-09-05T01:31:06.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.806+0000 7f60d6c4c740 20 client.25963 trim_cache size 0 max 16384 2024-09-05T01:31:06.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.807+0000 7f60d4000640 1 -- 172.21.15.12:0/3652154067 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f60b40a2ef0 msgr2=0x7f60b40a53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:06.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.807+0000 7f60d4000640 1 --2- 172.21.15.12:0/3652154067 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f60b40a2ef0 0x7f60b40a53b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55ad85cf0660 tx=0x7f60c00046c0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.808+0000 7f60d4000640 1 -- 172.21.15.12:0/3652154067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60cc10bfc0 msgr2=0x7f60cc19cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:06.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.808+0000 7f60d4000640 1 --2- 172.21.15.12:0/3652154067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60cc10bfc0 0x7f60cc19cc00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f60b8009e40 tx=0x7f60b800ed40 comp rx=0 tx=0).stop 2024-09-05T01:31:06.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.808+0000 7f60d4000640 1 -- 172.21.15.12:0/3652154067 shutdown_connections 2024-09-05T01:31:06.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.808+0000 7f60d4000640 1 --2- 172.21.15.12:0/3652154067 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f60b40a2ef0 0x7f60b40a53b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.808+0000 7f60d4000640 1 --2- 172.21.15.12:0/3652154067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60cc10bfc0 0x7f60cc19cc00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.808+0000 7f60d4000640 1 --2- 172.21.15.12:0/3652154067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60cc1034b0 0x7f60cc198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.808+0000 7f60d4000640 1 --2- 172.21.15.12:0/3652154067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60cc102b90 0x7f60cc198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:06.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.808+0000 7f60d4000640 1 -- 172.21.15.12:0/3652154067 >> 172.21.15.12:0/3652154067 conn(0x7f60cc0fc610 msgr2=0x7f60cc0fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:06.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.808+0000 7f60d4000640 1 -- 172.21.15.12:0/3652154067 shutdown_connections 2024-09-05T01:31:06.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:06.808+0000 7f60d4000640 1 -- 172.21.15.12:0/3652154067 wait complete. 2024-09-05T01:31:07.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:07 smithi012 ceph-mon[29942]: pgmap v195: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.3 MiB/s wr, 407 op/s 2024-09-05T01:31:07.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:07 smithi145 ceph-mon[34376]: pgmap v195: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.3 MiB/s wr, 407 op/s 2024-09-05T01:31:07.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:07 smithi151 ceph-mon[35013]: pgmap v195: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.3 MiB/s wr, 407 op/s 2024-09-05T01:31:07.812 INFO:tasks.cephfs.filesystem:scrub status for tag:0ae3b716-e7ac-40c8-ab2a-38e13361fb26 - {'path': '/', 'tag': '0ae3b716-e7ac-40c8-ab2a-38e13361fb26', 'options': 'recursive,force'} 2024-09-05T01:31:08.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:08 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:31:08.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:08 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:31:08.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:08 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:31:09.259 INFO:tasks.workunit.client.0.smithi012.stdout: 698 617967 166 443433 211 162343 169 2024-09-05T01:31:09.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:09 smithi012 ceph-mon[29942]: pgmap v196: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 369 op/s 2024-09-05T01:31:09.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:09 smithi145 ceph-mon[34376]: pgmap v196: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 369 op/s 2024-09-05T01:31:09.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:09 smithi151 ceph-mon[35013]: pgmap v196: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 369 op/s 2024-09-05T01:31:11.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:11 smithi012 ceph-mon[29942]: pgmap v197: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.0 MiB/s wr, 301 op/s 2024-09-05T01:31:11.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:11 smithi145 ceph-mon[34376]: pgmap v197: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.0 MiB/s wr, 301 op/s 2024-09-05T01:31:11.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:11 smithi151 ceph-mon[35013]: pgmap v197: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.0 MiB/s wr, 301 op/s 2024-09-05T01:31:13.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:13 smithi012 ceph-mon[29942]: pgmap v198: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 977 KiB/s wr, 139 op/s 2024-09-05T01:31:13.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:13 smithi145 ceph-mon[34376]: pgmap v198: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 977 KiB/s wr, 139 op/s 2024-09-05T01:31:13.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:13 smithi151 ceph-mon[35013]: pgmap v198: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 977 KiB/s wr, 139 op/s 2024-09-05T01:31:15.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:15 smithi145 ceph-mon[34376]: pgmap v199: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 945 KiB/s wr, 134 op/s 2024-09-05T01:31:15.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:15 smithi012 ceph-mon[29942]: pgmap v199: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 945 KiB/s wr, 134 op/s 2024-09-05T01:31:15.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:15 smithi151 ceph-mon[35013]: pgmap v199: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 945 KiB/s wr, 134 op/s 2024-09-05T01:31:17.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:17 smithi145 ceph-mon[34376]: pgmap v200: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 166 KiB/s wr, 54 op/s 2024-09-05T01:31:17.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:17 smithi151 ceph-mon[35013]: pgmap v200: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 166 KiB/s wr, 54 op/s 2024-09-05T01:31:17.841 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:17 smithi012 ceph-mon[29942]: pgmap v200: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 166 KiB/s wr, 54 op/s 2024-09-05T01:31:18.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:18 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:31:18.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:18 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:31:18.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:18 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:31:18.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:18 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:31:18.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:18 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:31:18.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:18 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:31:18.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:18 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:31:18.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:18 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:31:18.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:18 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:31:18.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:18 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:31:18.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:18 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:31:18.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:18 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:31:18.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:18 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:31:18.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:18 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:31:18.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:18 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:31:19.301 INFO:tasks.workunit.client.0.smithi012.stdout: 706 177532 388 126117 440 48582 26 2024-09-05T01:31:19.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:19 smithi151 ceph-mon[35013]: pgmap v201: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 619 KiB/s wr, 56 op/s 2024-09-05T01:31:19.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:19 smithi012 ceph-mon[29942]: pgmap v201: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 619 KiB/s wr, 56 op/s 2024-09-05T01:31:19.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:19 smithi145 ceph-mon[34376]: pgmap v201: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 619 KiB/s wr, 56 op/s 2024-09-05T01:31:21.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:21 smithi012 ceph-mon[29942]: pgmap v202: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 2.1 MiB/s wr, 117 op/s 2024-09-05T01:31:21.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:21 smithi151 ceph-mon[35013]: pgmap v202: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 2.1 MiB/s wr, 117 op/s 2024-09-05T01:31:21.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:21 smithi145 ceph-mon[34376]: pgmap v202: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 2.1 MiB/s wr, 117 op/s 2024-09-05T01:31:23.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:23 smithi151 ceph-mon[35013]: pgmap v203: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 2.4 MiB/s wr, 113 op/s 2024-09-05T01:31:23.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:23 smithi012 ceph-mon[29942]: pgmap v203: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 2.4 MiB/s wr, 113 op/s 2024-09-05T01:31:23.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:23 smithi145 ceph-mon[34376]: pgmap v203: 97 pgs: 97 active+clean; 2.8 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 2.4 MiB/s wr, 113 op/s 2024-09-05T01:31:24.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:24 smithi012 ceph-mon[29942]: osdmap e87: 12 total, 12 up, 12 in 2024-09-05T01:31:24.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:24 smithi145 ceph-mon[34376]: osdmap e87: 12 total, 12 up, 12 in 2024-09-05T01:31:24.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:24 smithi151 ceph-mon[35013]: osdmap e87: 12 total, 12 up, 12 in 2024-09-05T01:31:25.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:25 smithi012 ceph-mon[29942]: pgmap v205: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.1 MiB/s wr, 345 op/s 2024-09-05T01:31:25.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:25 smithi145 ceph-mon[34376]: pgmap v205: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.1 MiB/s wr, 345 op/s 2024-09-05T01:31:25.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:25 smithi151 ceph-mon[35013]: pgmap v205: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 8.1 MiB/s wr, 345 op/s 2024-09-05T01:31:27.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:27 smithi012 ceph-mon[29942]: pgmap v206: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.4 MiB/s wr, 356 op/s 2024-09-05T01:31:27.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:27 smithi145 ceph-mon[34376]: pgmap v206: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.4 MiB/s wr, 356 op/s 2024-09-05T01:31:27.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:27 smithi151 ceph-mon[35013]: pgmap v206: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.4 MiB/s wr, 356 op/s 2024-09-05T01:31:29.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:29 smithi012 ceph-mon[29942]: pgmap v207: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.9 MiB/s wr, 353 op/s 2024-09-05T01:31:29.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:29 smithi145 ceph-mon[34376]: pgmap v207: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.9 MiB/s wr, 353 op/s 2024-09-05T01:31:29.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:29 smithi151 ceph-mon[35013]: pgmap v207: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.9 MiB/s wr, 353 op/s 2024-09-05T01:31:31.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:31 smithi012 ceph-mon[29942]: pgmap v208: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.2 MiB/s wr, 348 op/s 2024-09-05T01:31:31.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:31 smithi145 ceph-mon[34376]: pgmap v208: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.2 MiB/s wr, 348 op/s 2024-09-05T01:31:31.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:31 smithi151 ceph-mon[35013]: pgmap v208: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.2 MiB/s wr, 348 op/s 2024-09-05T01:31:33.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:33 smithi012 ceph-mon[29942]: pgmap v209: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.7 MiB/s wr, 326 op/s 2024-09-05T01:31:33.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:33 smithi012 ceph-mon[29942]: osdmap e88: 12 total, 12 up, 12 in 2024-09-05T01:31:33.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:33 smithi145 ceph-mon[34376]: pgmap v209: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.7 MiB/s wr, 326 op/s 2024-09-05T01:31:33.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:33 smithi145 ceph-mon[34376]: osdmap e88: 12 total, 12 up, 12 in 2024-09-05T01:31:33.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:33 smithi151 ceph-mon[35013]: pgmap v209: 97 pgs: 97 active+clean; 2.9 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.7 MiB/s wr, 326 op/s 2024-09-05T01:31:33.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:33 smithi151 ceph-mon[35013]: osdmap e88: 12 total, 12 up, 12 in 2024-09-05T01:31:35.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:35 smithi012 ceph-mon[29942]: pgmap v211: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.8 MiB/s wr, 285 op/s 2024-09-05T01:31:35.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:35 smithi145 ceph-mon[34376]: pgmap v211: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.8 MiB/s wr, 285 op/s 2024-09-05T01:31:35.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:35 smithi151 ceph-mon[35013]: pgmap v211: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.8 MiB/s wr, 285 op/s 2024-09-05T01:31:37.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:37 smithi012 ceph-mon[29942]: pgmap v212: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.7 MiB/s wr, 282 op/s 2024-09-05T01:31:37.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:37 smithi145 ceph-mon[34376]: pgmap v212: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.7 MiB/s wr, 282 op/s 2024-09-05T01:31:37.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:37 smithi151 ceph-mon[35013]: pgmap v212: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.7 MiB/s wr, 282 op/s 2024-09-05T01:31:37.813 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T01:31:38.205 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:31:38.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:38 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:31:38.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:38 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:31:38.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:38 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:31:38.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.745+0000 7f22c1a00640 1 -- 172.21.15.12:0/668574106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22bc1049a0 msgr2=0x7f22bc1089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:38.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.745+0000 7f22c1a00640 1 --2- 172.21.15.12:0/668574106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22bc1049a0 0x7f22bc1089f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f22a4009900 tx=0x7f22a402a410 comp rx=0 tx=0).stop 2024-09-05T01:31:38.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.745+0000 7f22c1a00640 1 -- 172.21.15.12:0/668574106 shutdown_connections 2024-09-05T01:31:38.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.745+0000 7f22c1a00640 1 --2- 172.21.15.12:0/668574106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22bc109120 0x7f22bc110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.745+0000 7f22c1a00640 1 --2- 172.21.15.12:0/668574106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22bc1049a0 0x7f22bc1089f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.745+0000 7f22c1a00640 1 --2- 172.21.15.12:0/668574106 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22bc103ff0 0x7f22bc1043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.745+0000 7f22c1a00640 1 -- 172.21.15.12:0/668574106 >> 172.21.15.12:0/668574106 conn(0x7f22bc0ffa90 msgr2=0x7f22bc101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.746+0000 7f22c1a00640 1 -- 172.21.15.12:0/668574106 shutdown_connections 2024-09-05T01:31:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.746+0000 7f22c1a00640 1 -- 172.21.15.12:0/668574106 wait complete. 2024-09-05T01:31:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.747+0000 7f22c1a00640 1 Processor -- start 2024-09-05T01:31:38.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.747+0000 7f22c1a00640 1 -- start start 2024-09-05T01:31:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.747+0000 7f22c1a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22bc103ff0 0x7f22bc19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.747+0000 7f22c1a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22bc1049a0 0x7f22bc19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.747+0000 7f22c1a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22bc109120 0x7f22bc19eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.747+0000 7f22c1a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc114190 con 0x7f22bc1049a0 2024-09-05T01:31:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.747+0000 7f22c1a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc114010 con 0x7f22bc103ff0 2024-09-05T01:31:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.747+0000 7f22c1a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc114310 con 0x7f22bc109120 2024-09-05T01:31:38.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.747+0000 7f22b3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22bc1049a0 0x7f22bc19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:38.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.747+0000 7f22baa00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22bc103ff0 0x7f22bc19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:38.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.748+0000 7f22baa00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22bc103ff0 0x7f22bc19a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:47596/0 (socket says 172.21.15.12:47596) 2024-09-05T01:31:38.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.748+0000 7f22baa00640 1 -- 172.21.15.12:0/471014206 learned_addr learned my addr 172.21.15.12:0/471014206 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:38.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.748+0000 7f22bb400640 1 --2- 172.21.15.12:0/471014206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22bc109120 0x7f22bc19eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:38.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.748+0000 7f22baa00640 1 -- 172.21.15.12:0/471014206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22bc109120 msgr2=0x7f22bc19eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:38.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.748+0000 7f22baa00640 1 --2- 172.21.15.12:0/471014206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22bc109120 0x7f22bc19eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.748+0000 7f22baa00640 1 -- 172.21.15.12:0/471014206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22bc1049a0 msgr2=0x7f22bc19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:38.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.748+0000 7f22baa00640 1 --2- 172.21.15.12:0/471014206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22bc1049a0 0x7f22bc19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.748+0000 7f22baa00640 1 -- 172.21.15.12:0/471014206 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22bc19f5a0 con 0x7f22bc103ff0 2024-09-05T01:31:38.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.748+0000 7f22baa00640 1 --2- 172.21.15.12:0/471014206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22bc103ff0 0x7f22bc19a5f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00d950 tx=0x7f22ac00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:38.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.749+0000 7f22b3400640 1 -- 172.21.15.12:0/471014206 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac017070 con 0x7f22bc103ff0 2024-09-05T01:31:38.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.749+0000 7f22c1a00640 1 -- 172.21.15.12:0/471014206 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22bc19f890 con 0x7f22bc103ff0 2024-09-05T01:31:38.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.749+0000 7f22b3400640 1 -- 172.21.15.12:0/471014206 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22ac009c30 con 0x7f22bc103ff0 2024-09-05T01:31:38.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.749+0000 7f22b3400640 1 -- 172.21.15.12:0/471014206 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac00f6b0 con 0x7f22bc103ff0 2024-09-05T01:31:38.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.749+0000 7f22c1a00640 1 -- 172.21.15.12:0/471014206 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22bc1a7170 con 0x7f22bc103ff0 2024-09-05T01:31:38.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.752+0000 7f22c44cd740 1 Processor -- start 2024-09-05T01:31:38.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.752+0000 7f22c44cd740 1 -- start start 2024-09-05T01:31:38.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.752+0000 7f22b3400640 1 -- 172.21.15.12:0/471014206 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f22ac0109d0 con 0x7f22bc103ff0 2024-09-05T01:31:38.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.752+0000 7f22c44cd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef190b90 0x55ddef190f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:38.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.752+0000 7f22c44cd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef1914b0 0x55ddef19b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:38.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.752+0000 7f22c44cd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddef19bd70 0x55ddef19e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:38.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.752+0000 7f22c44cd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ddef0f73e0 con 0x55ddef190b90 2024-09-05T01:31:38.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.752+0000 7f22c44cd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55ddef09ed80 con 0x55ddef1914b0 2024-09-05T01:31:38.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.752+0000 7f22c44cd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ddef0f33a0 con 0x55ddef19bd70 2024-09-05T01:31:38.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.753+0000 7f22baa00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef1914b0 0x55ddef19b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:38.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.753+0000 7f22bb400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef190b90 0x55ddef190f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:38.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.753+0000 7f22baa00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef1914b0 0x55ddef19b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:47612/0 (socket says 172.21.15.12:47612) 2024-09-05T01:31:38.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.753+0000 7f22baa00640 1 -- 172.21.15.12:0/292504100 learned_addr learned my addr 172.21.15.12:0/292504100 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:38.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.753+0000 7f22b3e00640 1 --2- 172.21.15.12:0/292504100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddef19bd70 0x55ddef19e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:38.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.753+0000 7f22baa00640 1 -- 172.21.15.12:0/292504100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddef19bd70 msgr2=0x55ddef19e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:38.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.753+0000 7f22baa00640 1 --2- 172.21.15.12:0/292504100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddef19bd70 0x55ddef19e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.753+0000 7f22baa00640 1 -- 172.21.15.12:0/292504100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef190b90 msgr2=0x55ddef190f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:38.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.753+0000 7f22baa00640 1 --2- 172.21.15.12:0/292504100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef190b90 0x55ddef190f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.753+0000 7f22baa00640 1 -- 172.21.15.12:0/292504100 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddef0bdae0 con 0x55ddef1914b0 2024-09-05T01:31:38.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.754+0000 7f22baa00640 1 --2- 172.21.15.12:0/292504100 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef1914b0 0x55ddef19b830 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0cc6a0 tx=0x7f22ac0d7700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=807f69cfd7fc13d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:38.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.754+0000 7f22abe00640 1 -- 172.21.15.12:0/292504100 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac0e2070 con 0x55ddef1914b0 2024-09-05T01:31:38.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.754+0000 7f22b3400640 1 --2- 172.21.15.12:0/471014206 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f22a00a2cf0 0x7f22a00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:38.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.754+0000 7f22abe00640 1 -- 172.21.15.12:0/292504100 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22ac0d12e0 con 0x55ddef1914b0 2024-09-05T01:31:38.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.754+0000 7f22abe00640 1 -- 172.21.15.12:0/292504100 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac0dda50 con 0x55ddef1914b0 2024-09-05T01:31:38.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.754+0000 7f22b3400640 1 -- 172.21.15.12:0/471014206 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7f22ac0cf0b0 con 0x7f22bc103ff0 2024-09-05T01:31:38.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.755+0000 7f22bb400640 1 --2- 172.21.15.12:0/471014206 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f22a00a2cf0 0x7f22a00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:38.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.755+0000 7f22c44cd740 1 -- 172.21.15.12:0/292504100 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef1914b0 msgr2=0x55ddef19b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:38.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.755+0000 7f22c44cd740 1 --2- 172.21.15.12:0/292504100 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef1914b0 0x55ddef19b830 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0cc6a0 tx=0x7f22ac0d7700 comp rx=0 tx=0).stop 2024-09-05T01:31:38.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.755+0000 7f22c44cd740 1 -- 172.21.15.12:0/292504100 shutdown_connections 2024-09-05T01:31:38.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.755+0000 7f22c44cd740 1 --2- 172.21.15.12:0/292504100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddef19bd70 0x55ddef19e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.755+0000 7f22c44cd740 1 --2- 172.21.15.12:0/292504100 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef1914b0 0x55ddef19b830 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.755+0000 7f22c44cd740 1 --2- 172.21.15.12:0/292504100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef190b90 0x55ddef190f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.755+0000 7f22c44cd740 1 -- 172.21.15.12:0/292504100 >> 172.21.15.12:0/292504100 conn(0x55ddef18d120 msgr2=0x55ddef18d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:38.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.755+0000 7f22bb400640 1 --2- 172.21.15.12:0/471014206 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f22a00a2cf0 0x7f22a00a51b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f22b4005fd0 tx=0x7f22b4009600 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:38.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.755+0000 7f22c44cd740 1 -- 172.21.15.12:0/292504100 shutdown_connections 2024-09-05T01:31:38.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.755+0000 7f22c44cd740 1 -- 172.21.15.12:0/292504100 wait complete. 2024-09-05T01:31:38.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.756+0000 7f22c44cd740 1 -- start start 2024-09-05T01:31:38.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.756+0000 7f22c44cd740 1 Processor -- start 2024-09-05T01:31:38.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.756+0000 7f22c44cd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddef190b90 0x55ddef198c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:38.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.756+0000 7f22c44cd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef1914b0 0x55ddef199180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:38.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.757+0000 7f22c44cd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef19bd70 0x55ddef1996c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:38.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.757+0000 7f22c44cd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ddef19e9e0 con 0x55ddef19bd70 2024-09-05T01:31:38.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.757+0000 7f22c44cd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55ddef0b20f0 con 0x55ddef1914b0 2024-09-05T01:31:38.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.757+0000 7f22c44cd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ddef19eb60 con 0x55ddef190b90 2024-09-05T01:31:38.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.757+0000 7f22c44cd740 10 client.0 _ll_register_callbacks cb 0x55ddef0a39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:31:38.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.757+0000 7f22bb400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef19bd70 0x55ddef1996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:38.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.757+0000 7f22b3e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef1914b0 0x55ddef199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:38.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.757+0000 7f22bb400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef19bd70 0x55ddef1996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43998/0 (socket says 172.21.15.12:43998) 2024-09-05T01:31:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.757+0000 7f22bb400640 1 -- 172.21.15.12:0/2604162322 learned_addr learned my addr 172.21.15.12:0/2604162322 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.757+0000 7f22baa00640 1 --2- 172.21.15.12:0/2604162322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddef190b90 0x55ddef198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.757+0000 7f22b3e00640 1 -- 172.21.15.12:0/2604162322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddef190b90 msgr2=0x55ddef198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.757+0000 7f22b3e00640 1 --2- 172.21.15.12:0/2604162322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddef190b90 0x55ddef198c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.757+0000 7f22b3e00640 1 -- 172.21.15.12:0/2604162322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef19bd70 msgr2=0x55ddef1996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.757+0000 7f22b3e00640 1 --2- 172.21.15.12:0/2604162322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef19bd70 0x55ddef1996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.757+0000 7f22b3e00640 1 -- 172.21.15.12:0/2604162322 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddeee683c0 con 0x55ddef1914b0 2024-09-05T01:31:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.757+0000 7f22bb400640 1 --2- 172.21.15.12:0/2604162322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef19bd70 0x55ddef1996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:31:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.758+0000 7f22b3e00640 1 --2- 172.21.15.12:0/2604162322 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef1914b0 0x55ddef199180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f22a402aa00 tx=0x7f22a4004580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf3302bb7f2821b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.758+0000 7f22a8c00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:31:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.758+0000 7f22a8c00640 1 -- 172.21.15.12:0/2604162322 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a4035040 con 0x55ddef1914b0 2024-09-05T01:31:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.758+0000 7f22c44cd740 1 -- 172.21.15.12:0/2604162322 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22ac0d12e0 con 0x55ddef1914b0 2024-09-05T01:31:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.758+0000 7f22a8c00640 1 -- 172.21.15.12:0/2604162322 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7f22a40054d0 con 0x55ddef1914b0 2024-09-05T01:31:38.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.758+0000 7f22a8c00640 1 -- 172.21.15.12:0/2604162322 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f22a40046c0 con 0x55ddef1914b0 2024-09-05T01:31:38.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.758+0000 7f22c44cd740 10 client.25976 fetch_fsmap learned FSMap version 40 2024-09-05T01:31:38.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.758+0000 7f22c44cd740 1 -- 172.21.15.12:0/2604162322 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55ddef1aa6c0 con 0x55ddef1914b0 2024-09-05T01:31:38.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.759+0000 7f22a8c00640 1 -- 172.21.15.12:0/2604162322 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22ac0d12e0 con 0x55ddef1914b0 2024-09-05T01:31:38.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.759+0000 7f22a8c00640 1 -- 172.21.15.12:0/2604162322 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f22a4003c20 con 0x55ddef1914b0 2024-09-05T01:31:38.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.759+0000 7f22c44cd740 10 client.25976 fetch_fsmap finished waiting for FSMap version 40 2024-09-05T01:31:38.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.759+0000 7f22c44cd740 10 client.25976 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:31:38.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.759+0000 7f22c44cd740 20 client.25976 populate_metadata read hostname 'smithi012' 2024-09-05T01:31:38.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.759+0000 7f22c44cd740 1 --2- 172.21.15.12:0/2604162322 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ddef1abb50 0x55ddef1adf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:38.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.759+0000 7f22c44cd740 4 client.25976 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:31:38.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.759+0000 7f22c44cd740 1 -- 172.21.15.12:0/2604162322 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ddef104950 con 0x55ddef1abb50 2024-09-05T01:31:38.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.759+0000 7f22baa00640 1 --2- 172.21.15.12:0/2604162322 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ddef1abb50 0x55ddef1adf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:38.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.760+0000 7f22baa00640 1 --2- 172.21.15.12:0/2604162322 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ddef1abb50 0x55ddef1adf70 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cebd1b9287c95466 server_cookie=96a7702c3acf9871 in_seq=0 out_seq=0 2024-09-05T01:31:38.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.760+0000 7f22a8c00640 10 client.25976 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:31:38.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.761+0000 7f22a8c00640 1 -- 172.21.15.12:0/2604162322 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ddef104950 con 0x55ddef1abb50 2024-09-05T01:31:38.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.761+0000 7f22a8c00640 10 client.25976 handle_command_reply: tid=0 2024-09-05T01:31:38.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.761+0000 7f22c44cd740 1 client.25976 shutdown 2024-09-05T01:31:38.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.761+0000 7f22c44cd740 1 -- 172.21.15.12:0/2604162322 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef1914b0 msgr2=0x55ddef199180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:38.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.761+0000 7f22c44cd740 1 --2- 172.21.15.12:0/2604162322 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef1914b0 0x55ddef199180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f22a402aa00 tx=0x7f22a4004580 comp rx=0 tx=0).stop 2024-09-05T01:31:38.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.761+0000 7f22c44cd740 1 -- 172.21.15.12:0/2604162322 shutdown_connections 2024-09-05T01:31:38.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.761+0000 7f22c44cd740 1 --2- 172.21.15.12:0/2604162322 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ddef1abb50 0x55ddef1adf70 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.761+0000 7f22c44cd740 1 --2- 172.21.15.12:0/2604162322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef19bd70 0x55ddef1996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.761+0000 7f22c44cd740 1 --2- 172.21.15.12:0/2604162322 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef1914b0 0x55ddef199180 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.761+0000 7f22a8c00640 0 client.25976 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:31:38.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.761+0000 7f22c44cd740 1 --2- 172.21.15.12:0/2604162322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddef190b90 0x55ddef198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.761+0000 7f22c44cd740 1 -- 172.21.15.12:0/2604162322 >> 172.21.15.12:0/2604162322 conn(0x55ddef18d120 msgr2=0x55ddef192e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:38.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.761+0000 7f22c44cd740 1 -- 172.21.15.12:0/2604162322 shutdown_connections 2024-09-05T01:31:38.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.761+0000 7f22c44cd740 1 -- 172.21.15.12:0/2604162322 wait complete. 2024-09-05T01:31:38.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.761+0000 7f22c44cd740 20 client.25976 trim_cache size 0 max 16384 2024-09-05T01:31:38.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.779+0000 7f22c44cd740 1 Processor -- start 2024-09-05T01:31:38.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.780+0000 7f22c44cd740 1 -- start start 2024-09-05T01:31:38.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.780+0000 7f22c44cd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddef190b90 0x55ddef199510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:38.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.780+0000 7f22c44cd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef1914b0 0x55ddef1b3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:38.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.780+0000 7f22c44cd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef19bd70 0x55ddef1b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:38.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.780+0000 7f22c44cd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc1afbd0 con 0x55ddef1914b0 2024-09-05T01:31:38.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.780+0000 7f22c44cd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc1b18f0 con 0x55ddef19bd70 2024-09-05T01:31:38.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.780+0000 7f22c44cd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc1b02a0 con 0x55ddef190b90 2024-09-05T01:31:38.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.780+0000 7f22b3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef1914b0 0x55ddef1b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:38.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.780+0000 7f22b3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef1914b0 0x55ddef1b3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44002/0 (socket says 172.21.15.12:44002) 2024-09-05T01:31:38.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.780+0000 7f22b3e00640 1 -- 172.21.15.12:0/635036692 learned_addr learned my addr 172.21.15.12:0/635036692 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:38.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.780+0000 7f22baa00640 1 --2- 172.21.15.12:0/635036692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddef190b90 0x55ddef199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:38.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.780+0000 7f22bb400640 1 --2- 172.21.15.12:0/635036692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef19bd70 0x55ddef1b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:38.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.781+0000 7f22b3e00640 1 -- 172.21.15.12:0/635036692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddef190b90 msgr2=0x55ddef199510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:38.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.781+0000 7f22b3e00640 1 --2- 172.21.15.12:0/635036692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddef190b90 0x55ddef199510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.781+0000 7f22b3e00640 1 -- 172.21.15.12:0/635036692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef19bd70 msgr2=0x55ddef1b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:38.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.781+0000 7f22b3e00640 1 --2- 172.21.15.12:0/635036692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef19bd70 0x55ddef1b3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.781+0000 7f22b3e00640 1 -- 172.21.15.12:0/635036692 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddef18ddb0 con 0x55ddef1914b0 2024-09-05T01:31:38.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.781+0000 7f22baa00640 1 --2- 172.21.15.12:0/635036692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddef190b90 0x55ddef199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:31:38.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.781+0000 7f22b3e00640 1 --2- 172.21.15.12:0/635036692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef1914b0 0x55ddef1b3840 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f22a4006010 tx=0x7f22a4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c13548881d8a768 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:38.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.781+0000 7f22ab400640 1 -- 172.21.15.12:0/635036692 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a4035030 con 0x55ddef1914b0 2024-09-05T01:31:38.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.781+0000 7f22ab400640 1 -- 172.21.15.12:0/635036692 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22a4041070 con 0x55ddef1914b0 2024-09-05T01:31:38.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.781+0000 7f22ab400640 1 -- 172.21.15.12:0/635036692 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a4003850 con 0x55ddef1914b0 2024-09-05T01:31:38.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.782+0000 7f22c44cd740 1 -- 172.21.15.12:0/635036692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef1914b0 msgr2=0x55ddef1b3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:38.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.782+0000 7f22c44cd740 1 --2- 172.21.15.12:0/635036692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef1914b0 0x55ddef1b3840 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f22a4006010 tx=0x7f22a4001e70 comp rx=0 tx=0).stop 2024-09-05T01:31:38.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.782+0000 7f22c44cd740 1 -- 172.21.15.12:0/635036692 shutdown_connections 2024-09-05T01:31:38.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.782+0000 7f22c44cd740 1 --2- 172.21.15.12:0/635036692 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef19bd70 0x55ddef1b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.782+0000 7f22c44cd740 1 --2- 172.21.15.12:0/635036692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef1914b0 0x55ddef1b3840 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.782+0000 7f22c44cd740 1 --2- 172.21.15.12:0/635036692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddef190b90 0x55ddef199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.782+0000 7f22c44cd740 1 -- 172.21.15.12:0/635036692 >> 172.21.15.12:0/635036692 conn(0x55ddef18d120 msgr2=0x55ddef197d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:38.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.782+0000 7f22c44cd740 1 -- 172.21.15.12:0/635036692 shutdown_connections 2024-09-05T01:31:38.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.782+0000 7f22c44cd740 1 -- 172.21.15.12:0/635036692 wait complete. 2024-09-05T01:31:38.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.783+0000 7f22c44cd740 1 -- start start 2024-09-05T01:31:38.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.783+0000 7f22c44cd740 1 Processor -- start 2024-09-05T01:31:38.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.783+0000 7f22c44cd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef190b90 0x55ddef1a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:38.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.783+0000 7f22c44cd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef1914b0 0x55ddef1a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:38.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.783+0000 7f22c44cd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddef19bd70 0x55ddef19f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:38.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.783+0000 7f22c44cd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc1b1160 con 0x55ddef1914b0 2024-09-05T01:31:38.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.783+0000 7f22c44cd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc1b0a30 con 0x55ddef190b90 2024-09-05T01:31:38.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.783+0000 7f22c44cd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc1adbd0 con 0x55ddef19bd70 2024-09-05T01:31:38.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.784+0000 7f22c44cd740 10 client.0 _ll_register_callbacks cb 0x7f22a4004210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:31:38.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.784+0000 7f22b3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef1914b0 0x55ddef1a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:38.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.784+0000 7f22baa00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef190b90 0x55ddef1a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:38.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.784+0000 7f22baa00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef190b90 0x55ddef1a3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:47638/0 (socket says 172.21.15.12:47638) 2024-09-05T01:31:38.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.784+0000 7f22baa00640 1 -- 172.21.15.12:0/2700025719 learned_addr learned my addr 172.21.15.12:0/2700025719 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:38.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.784+0000 7f22bb400640 1 --2- 172.21.15.12:0/2700025719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddef19bd70 0x55ddef19f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:38.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.784+0000 7f22baa00640 1 -- 172.21.15.12:0/2700025719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddef19bd70 msgr2=0x55ddef19f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:38.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.784+0000 7f22baa00640 1 --2- 172.21.15.12:0/2700025719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddef19bd70 0x55ddef19f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.784+0000 7f22baa00640 1 -- 172.21.15.12:0/2700025719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef1914b0 msgr2=0x55ddef1a44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:38.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.784+0000 7f22baa00640 1 --2- 172.21.15.12:0/2700025719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef1914b0 0x55ddef1a44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.784+0000 7f22baa00640 1 -- 172.21.15.12:0/2700025719 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddef19fb70 con 0x55ddef190b90 2024-09-05T01:31:38.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.784+0000 7f22b3e00640 1 --2- 172.21.15.12:0/2700025719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef1914b0 0x55ddef1a44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:31:38.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.785+0000 7f22baa00640 1 --2- 172.21.15.12:0/2700025719 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef190b90 0x55ddef1a3f80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0cff40 tx=0x7f22ac0dd510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b20e019aa2e149fd server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:38.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.785+0000 7f22a8c00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:31:38.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.785+0000 7f22a8c00640 1 -- 172.21.15.12:0/2700025719 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac020040 con 0x55ddef190b90 2024-09-05T01:31:38.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.785+0000 7f22c44cd740 1 -- 172.21.15.12:0/2700025719 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22a4041070 con 0x55ddef190b90 2024-09-05T01:31:38.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.785+0000 7f22a8c00640 1 -- 172.21.15.12:0/2700025719 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7f22ac0998e0 con 0x55ddef190b90 2024-09-05T01:31:38.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.785+0000 7f22a8c00640 1 -- 172.21.15.12:0/2700025719 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f22ac0bb040 con 0x55ddef190b90 2024-09-05T01:31:38.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.785+0000 7f22c44cd740 10 client.25982 fetch_fsmap learned FSMap version 40 2024-09-05T01:31:38.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.785+0000 7f22c44cd740 1 -- 172.21.15.12:0/2700025719 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55ddef216330 con 0x55ddef190b90 2024-09-05T01:31:38.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.785+0000 7f22a8c00640 1 -- 172.21.15.12:0/2700025719 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22a4041070 con 0x55ddef190b90 2024-09-05T01:31:38.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.785+0000 7f22a8c00640 1 -- 172.21.15.12:0/2700025719 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f22ac097c50 con 0x55ddef190b90 2024-09-05T01:31:38.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.785+0000 7f22c44cd740 10 client.25982 fetch_fsmap finished waiting for FSMap version 40 2024-09-05T01:31:38.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.785+0000 7f22c44cd740 10 client.25982 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:31:38.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.785+0000 7f22c44cd740 20 client.25982 populate_metadata read hostname 'smithi012' 2024-09-05T01:31:38.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.785+0000 7f22c44cd740 1 --2- 172.21.15.12:0/2700025719 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ddef216610 0x55ddef218a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:38.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.786+0000 7f22c44cd740 4 client.25982 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T01:31:38.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.786+0000 7f22c44cd740 1 -- 172.21.15.12:0/2700025719 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ddef0fee60 con 0x55ddef216610 2024-09-05T01:31:38.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.786+0000 7f22b3e00640 1 --2- 172.21.15.12:0/2700025719 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ddef216610 0x55ddef218a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:38.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.786+0000 7f22b3e00640 1 --2- 172.21.15.12:0/2700025719 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ddef216610 0x55ddef218a00 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2ea8076578b6e server_cookie=97741ba2b1b6cd04 in_seq=0 out_seq=0 2024-09-05T01:31:38.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.786+0000 7f22a8c00640 10 client.25982 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:31:38.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.787+0000 7f22a8c00640 1 -- 172.21.15.12:0/2700025719 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ddef0fee60 con 0x55ddef216610 2024-09-05T01:31:38.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.787+0000 7f22a8c00640 10 client.25982 handle_command_reply: tid=0 2024-09-05T01:31:38.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.787+0000 7f22c44cd740 1 client.25982 shutdown 2024-09-05T01:31:38.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.787+0000 7f22c44cd740 1 -- 172.21.15.12:0/2700025719 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef190b90 msgr2=0x55ddef1a3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:38.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.787+0000 7f22c44cd740 1 --2- 172.21.15.12:0/2700025719 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef190b90 0x55ddef1a3f80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0cff40 tx=0x7f22ac0dd510 comp rx=0 tx=0).stop 2024-09-05T01:31:38.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.787+0000 7f22c44cd740 1 -- 172.21.15.12:0/2700025719 shutdown_connections 2024-09-05T01:31:38.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.787+0000 7f22c44cd740 1 --2- 172.21.15.12:0/2700025719 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ddef216610 0x55ddef218a00 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.792 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.787+0000 7f22c44cd740 1 --2- 172.21.15.12:0/2700025719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddef19bd70 0x55ddef19f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.787+0000 7f22c44cd740 1 --2- 172.21.15.12:0/2700025719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ddef1914b0 0x55ddef1a44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.787+0000 7f22c44cd740 1 --2- 172.21.15.12:0/2700025719 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ddef190b90 0x55ddef1a3f80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.787+0000 7f22c44cd740 1 -- 172.21.15.12:0/2700025719 >> 172.21.15.12:0/2700025719 conn(0x55ddef18d120 msgr2=0x55ddef18b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:38.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.787+0000 7f22a8c00640 0 client.25982 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:31:38.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.787+0000 7f22c44cd740 1 -- 172.21.15.12:0/2700025719 shutdown_connections 2024-09-05T01:31:38.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.787+0000 7f22c44cd740 1 -- 172.21.15.12:0/2700025719 wait complete. 2024-09-05T01:31:38.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.787+0000 7f22c44cd740 20 client.25982 trim_cache size 0 max 16384 2024-09-05T01:31:38.793 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:31:38.793 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-05T01:31:38.794 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-05T01:31:38.794 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:31:38.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.788+0000 7f22c1a00640 1 -- 172.21.15.12:0/471014206 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f22a00a2cf0 msgr2=0x7f22a00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:38.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.788+0000 7f22c1a00640 1 --2- 172.21.15.12:0/471014206 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f22a00a2cf0 0x7f22a00a51b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f22b4005fd0 tx=0x7f22b4009600 comp rx=0 tx=0).stop 2024-09-05T01:31:38.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.788+0000 7f22c1a00640 1 -- 172.21.15.12:0/471014206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22bc103ff0 msgr2=0x7f22bc19a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:38.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.788+0000 7f22c1a00640 1 --2- 172.21.15.12:0/471014206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22bc103ff0 0x7f22bc19a5f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00d950 tx=0x7f22ac00de10 comp rx=0 tx=0).stop 2024-09-05T01:31:38.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.788+0000 7f22c1a00640 1 -- 172.21.15.12:0/471014206 shutdown_connections 2024-09-05T01:31:38.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.788+0000 7f22c1a00640 1 --2- 172.21.15.12:0/471014206 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f22a00a2cf0 0x7f22a00a51b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.788+0000 7f22c1a00640 1 --2- 172.21.15.12:0/471014206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22bc109120 0x7f22bc19eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.788+0000 7f22c1a00640 1 --2- 172.21.15.12:0/471014206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22bc1049a0 0x7f22bc19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.788+0000 7f22c1a00640 1 --2- 172.21.15.12:0/471014206 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f22bc103ff0 0x7f22bc19a5f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:38.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.788+0000 7f22c1a00640 1 -- 172.21.15.12:0/471014206 >> 172.21.15.12:0/471014206 conn(0x7f22bc0ffa90 msgr2=0x7f22bc101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:38.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.788+0000 7f22c1a00640 1 -- 172.21.15.12:0/471014206 shutdown_connections 2024-09-05T01:31:38.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:38.788+0000 7f22c1a00640 1 -- 172.21.15.12:0/471014206 wait complete. 2024-09-05T01:31:39.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:39 smithi012 ceph-mon[29942]: pgmap v213: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.0 MiB/s wr, 289 op/s 2024-09-05T01:31:39.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:39 smithi145 ceph-mon[34376]: pgmap v213: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.0 MiB/s wr, 289 op/s 2024-09-05T01:31:39.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:39 smithi151 ceph-mon[35013]: pgmap v213: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.0 MiB/s wr, 289 op/s 2024-09-05T01:31:39.571 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-05T01:31:39.572 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:31:39.951 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:31:40.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.508+0000 7f3070a00640 1 -- 172.21.15.12:0/708987032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f306c1047e0 msgr2=0x7f306c108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:40.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.508+0000 7f3070a00640 1 --2- 172.21.15.12:0/708987032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f306c1047e0 0x7f306c108830 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3054009900 tx=0x7f305402a410 comp rx=0 tx=0).stop 2024-09-05T01:31:40.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.509+0000 7f3070a00640 1 -- 172.21.15.12:0/708987032 shutdown_connections 2024-09-05T01:31:40.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.509+0000 7f3070a00640 1 --2- 172.21.15.12:0/708987032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f306c108f60 0x7f306c110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:40.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.509+0000 7f3070a00640 1 --2- 172.21.15.12:0/708987032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f306c1047e0 0x7f306c108830 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:40.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.509+0000 7f3070a00640 1 --2- 172.21.15.12:0/708987032 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f306c103e30 0x7f306c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:40.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.509+0000 7f3070a00640 1 -- 172.21.15.12:0/708987032 >> 172.21.15.12:0/708987032 conn(0x7f306c0ff8d0 msgr2=0x7f306c101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:40.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.509+0000 7f3070a00640 1 -- 172.21.15.12:0/708987032 shutdown_connections 2024-09-05T01:31:40.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.509+0000 7f3070a00640 1 -- 172.21.15.12:0/708987032 wait complete. 2024-09-05T01:31:40.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.510+0000 7f3070a00640 1 Processor -- start 2024-09-05T01:31:40.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.510+0000 7f3070a00640 1 -- start start 2024-09-05T01:31:40.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.510+0000 7f3070a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f306c103e30 0x7f306c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:40.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.510+0000 7f3070a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f306c1047e0 0x7f306c19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:40.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.510+0000 7f3070a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f306c108f60 0x7f306c19ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:40.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.510+0000 7f3070a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f306c114010 con 0x7f306c103e30 2024-09-05T01:31:40.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.510+0000 7f3070a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f306c113e90 con 0x7f306c1047e0 2024-09-05T01:31:40.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.510+0000 7f3070a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f306c114190 con 0x7f306c108f60 2024-09-05T01:31:40.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.510+0000 7f306a800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f306c103e30 0x7f306c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:40.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.511+0000 7f306b200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f306c108f60 0x7f306c19ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:40.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.511+0000 7f306b200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f306c108f60 0x7f306c19ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:34394/0 (socket says 172.21.15.12:34394) 2024-09-05T01:31:40.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.511+0000 7f306b200640 1 -- 172.21.15.12:0/360746812 learned_addr learned my addr 172.21.15.12:0/360746812 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:40.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.511+0000 7f3063e00640 1 --2- 172.21.15.12:0/360746812 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f306c1047e0 0x7f306c19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:40.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.511+0000 7f306b200640 1 -- 172.21.15.12:0/360746812 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f306c1047e0 msgr2=0x7f306c19a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:40.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.511+0000 7f306b200640 1 --2- 172.21.15.12:0/360746812 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f306c1047e0 0x7f306c19a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:40.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.511+0000 7f306b200640 1 -- 172.21.15.12:0/360746812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f306c103e30 msgr2=0x7f306c19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:40.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.511+0000 7f306b200640 1 --2- 172.21.15.12:0/360746812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f306c103e30 0x7f306c19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:40.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.511+0000 7f306b200640 1 -- 172.21.15.12:0/360746812 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f306c19f420 con 0x7f306c108f60 2024-09-05T01:31:40.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.511+0000 7f306b200640 1 --2- 172.21.15.12:0/360746812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f306c108f60 0x7f306c19ed40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f306400eb10 tx=0x7f306400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:40.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.512+0000 7f3063400640 1 -- 172.21.15.12:0/360746812 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064004b20 con 0x7f306c108f60 2024-09-05T01:31:40.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.512+0000 7f3070a00640 1 -- 172.21.15.12:0/360746812 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f306c19f710 con 0x7f306c108f60 2024-09-05T01:31:40.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.512+0000 7f3063400640 1 -- 172.21.15.12:0/360746812 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3064004cc0 con 0x7f306c108f60 2024-09-05T01:31:40.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.512+0000 7f3063400640 1 -- 172.21.15.12:0/360746812 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064010760 con 0x7f306c108f60 2024-09-05T01:31:40.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.512+0000 7f3070a00640 1 -- 172.21.15.12:0/360746812 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f306c1a6ff0 con 0x7f306c108f60 2024-09-05T01:31:40.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.513+0000 7f3070a00640 1 -- 172.21.15.12:0/360746812 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f306c104210 con 0x7f306c108f60 2024-09-05T01:31:40.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.515+0000 7f3063400640 1 -- 172.21.15.12:0/360746812 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f3064010900 con 0x7f306c108f60 2024-09-05T01:31:40.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.516+0000 7f3063400640 1 --2- 172.21.15.12:0/360746812 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f30500a2cf0 0x7f30500a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:40.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.516+0000 7f3063400640 1 -- 172.21.15.12:0/360746812 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7f30640cff00 con 0x7f306c108f60 2024-09-05T01:31:40.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.516+0000 7f306a800640 1 --2- 172.21.15.12:0/360746812 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f30500a2cf0 0x7f30500a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:40.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.517+0000 7f306a800640 1 --2- 172.21.15.12:0/360746812 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f30500a2cf0 0x7f30500a51b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f305c009bd0 tx=0x7f305c005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:40.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.518+0000 7f3063400640 1 -- 172.21.15.12:0/360746812 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f306409ca80 con 0x7f306c108f60 2024-09-05T01:31:40.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.738+0000 7f3070a00640 1 -- 172.21.15.12:0/360746812 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f306c19b7d0 con 0x7f306c108f60 2024-09-05T01:31:40.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.739+0000 7f3063400640 1 -- 172.21.15.12:0/360746812 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+12010 (secure 0 0 0) 0x7f306c19b7d0 con 0x7f306c108f60 2024-09-05T01:31:40.741 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:31:40.741 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 40 2024-09-05T01:31:40.741 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":40,"btime":"2024-09-05T01:31:37:044768+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14532,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/2949711075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":2949711075},{"type":"v1","addr":"172.21.15.12:6839","nonce":2949711075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T01:22:35.979384+0000","modified":"2024-09-05T01:31:36.970991+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24529,"mds_2":24524,"mds_3":24517,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/497406458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":497406458},{"type":"v1","addr":"172.21.15.12:6841","nonce":497406458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":10,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.145:6839/1706431882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":1706431882},{"type":"v1","addr":"172.21.15.145:6839","nonce":1706431882}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24529,24524,24517,24460]},"id":1}]} 2024-09-05T01:31:40.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.742+0000 7f3070a00640 1 -- 172.21.15.12:0/360746812 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f30500a2cf0 msgr2=0x7f30500a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:40.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.742+0000 7f3070a00640 1 --2- 172.21.15.12:0/360746812 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f30500a2cf0 0x7f30500a51b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f305c009bd0 tx=0x7f305c005f90 comp rx=0 tx=0).stop 2024-09-05T01:31:40.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.742+0000 7f3070a00640 1 -- 172.21.15.12:0/360746812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f306c108f60 msgr2=0x7f306c19ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:40.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.742+0000 7f3070a00640 1 --2- 172.21.15.12:0/360746812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f306c108f60 0x7f306c19ed40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f306400eb10 tx=0x7f306400c2d0 comp rx=0 tx=0).stop 2024-09-05T01:31:40.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.742+0000 7f3070a00640 1 -- 172.21.15.12:0/360746812 shutdown_connections 2024-09-05T01:31:40.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.742+0000 7f3070a00640 1 --2- 172.21.15.12:0/360746812 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f30500a2cf0 0x7f30500a51b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:40.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.742+0000 7f3070a00640 1 --2- 172.21.15.12:0/360746812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f306c108f60 0x7f306c19ed40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:40.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.742+0000 7f3070a00640 1 --2- 172.21.15.12:0/360746812 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f306c1047e0 0x7f306c19a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:40.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.742+0000 7f3070a00640 1 --2- 172.21.15.12:0/360746812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f306c103e30 0x7f306c19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:40.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.742+0000 7f3070a00640 1 -- 172.21.15.12:0/360746812 >> 172.21.15.12:0/360746812 conn(0x7f306c0ff8d0 msgr2=0x7f306c100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:40.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.742+0000 7f3070a00640 1 -- 172.21.15.12:0/360746812 shutdown_connections 2024-09-05T01:31:40.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:40.742+0000 7f3070a00640 1 -- 172.21.15.12:0/360746812 wait complete. 2024-09-05T01:31:41.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:41 smithi012 ceph-mon[29942]: pgmap v214: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.5 MiB/s wr, 239 op/s 2024-09-05T01:31:41.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:41 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/360746812' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:31:41.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:41 smithi145 ceph-mon[34376]: pgmap v214: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.5 MiB/s wr, 239 op/s 2024-09-05T01:31:41.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:41 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/360746812' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:31:41.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:41 smithi151 ceph-mon[35013]: pgmap v214: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.5 MiB/s wr, 239 op/s 2024-09-05T01:31:41.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:41 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/360746812' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:31:41.539 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-05T01:31:41.926 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:31:42.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.506+0000 7f31e5800640 1 -- 172.21.15.12:0/2773432311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31e0103ff0 msgr2=0x7f31e01043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:42.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.506+0000 7f31e5800640 1 --2- 172.21.15.12:0/2773432311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31e0103ff0 0x7f31e01043d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009900 tx=0x7f31d002a410 comp rx=0 tx=0).stop 2024-09-05T01:31:42.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.507+0000 7f31e5800640 1 -- 172.21.15.12:0/2773432311 shutdown_connections 2024-09-05T01:31:42.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.507+0000 7f31e5800640 1 --2- 172.21.15.12:0/2773432311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31e0109120 0x7f31e0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.507+0000 7f31e5800640 1 --2- 172.21.15.12:0/2773432311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31e01049a0 0x7f31e01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.507+0000 7f31e5800640 1 --2- 172.21.15.12:0/2773432311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31e0103ff0 0x7f31e01043d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.507+0000 7f31e5800640 1 -- 172.21.15.12:0/2773432311 >> 172.21.15.12:0/2773432311 conn(0x7f31e00ffa90 msgr2=0x7f31e0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:42.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.507+0000 7f31e5800640 1 -- 172.21.15.12:0/2773432311 shutdown_connections 2024-09-05T01:31:42.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.507+0000 7f31e5800640 1 -- 172.21.15.12:0/2773432311 wait complete. 2024-09-05T01:31:42.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.508+0000 7f31e5800640 1 Processor -- start 2024-09-05T01:31:42.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.508+0000 7f31e5800640 1 -- start start 2024-09-05T01:31:42.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.508+0000 7f31e5800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31e0103ff0 0x7f31e019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:42.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.508+0000 7f31e5800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31e01049a0 0x7f31e019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:42.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.508+0000 7f31e5800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31e0109120 0x7f31e019eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:42.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.508+0000 7f31e5800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f31e0114120 con 0x7f31e0103ff0 2024-09-05T01:31:42.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.508+0000 7f31e5800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f31e0113fa0 con 0x7f31e01049a0 2024-09-05T01:31:42.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.508+0000 7f31e5800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f31e01142a0 con 0x7f31e0109120 2024-09-05T01:31:42.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.508+0000 7f31dea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31e0103ff0 0x7f31e019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:42.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.509+0000 7f31d7e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31e01049a0 0x7f31e019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:42.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.509+0000 7f31dea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31e0103ff0 0x7f31e019a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44054/0 (socket says 172.21.15.12:44054) 2024-09-05T01:31:42.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.509+0000 7f31dea00640 1 -- 172.21.15.12:0/3495270273 learned_addr learned my addr 172.21.15.12:0/3495270273 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:42.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.509+0000 7f31df400640 1 --2- 172.21.15.12:0/3495270273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31e0109120 0x7f31e019eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:42.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.509+0000 7f31d7e00640 1 -- 172.21.15.12:0/3495270273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31e0109120 msgr2=0x7f31e019eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:42.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.509+0000 7f31d7e00640 1 --2- 172.21.15.12:0/3495270273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31e0109120 0x7f31e019eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.509+0000 7f31d7e00640 1 -- 172.21.15.12:0/3495270273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31e0103ff0 msgr2=0x7f31e019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:42.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.509+0000 7f31d7e00640 1 --2- 172.21.15.12:0/3495270273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31e0103ff0 0x7f31e019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.509+0000 7f31d7e00640 1 -- 172.21.15.12:0/3495270273 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e019f590 con 0x7f31e01049a0 2024-09-05T01:31:42.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.509+0000 7f31dea00640 1 --2- 172.21.15.12:0/3495270273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31e0103ff0 0x7f31e019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:31:42.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.509+0000 7f31d7e00640 1 --2- 172.21.15.12:0/3495270273 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31e01049a0 0x7f31e019ab20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f31c800d6d0 tx=0x7f31c800db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:42.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.510+0000 7f31d7400640 1 -- 172.21.15.12:0/3495270273 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c8017070 con 0x7f31e01049a0 2024-09-05T01:31:42.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.510+0000 7f31e5800640 1 -- 172.21.15.12:0/3495270273 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31e019f880 con 0x7f31e01049a0 2024-09-05T01:31:42.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.510+0000 7f31d7400640 1 -- 172.21.15.12:0/3495270273 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31c8009820 con 0x7f31e01049a0 2024-09-05T01:31:42.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.510+0000 7f31e5800640 1 -- 172.21.15.12:0/3495270273 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31e01a7160 con 0x7f31e01049a0 2024-09-05T01:31:42.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.510+0000 7f31d7400640 1 -- 172.21.15.12:0/3495270273 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c8020060 con 0x7f31e01049a0 2024-09-05T01:31:42.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.513+0000 7f31e8461740 1 Processor -- start 2024-09-05T01:31:42.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.513+0000 7f31e8461740 1 -- start start 2024-09-05T01:31:42.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.513+0000 7f31d7400640 1 -- 172.21.15.12:0/3495270273 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f31c80099d0 con 0x7f31e01049a0 2024-09-05T01:31:42.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.514+0000 7f31e8461740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c3b5f79c70 0x55c3b5f7a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:42.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.514+0000 7f31e8461740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f7a590 0x55c3b5f84910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:42.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.514+0000 7f31e8461740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3b5f84e50 0x55c3b5f87240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:42.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.514+0000 7f31e8461740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c3b5ee03e0 con 0x55c3b5f84e50 2024-09-05T01:31:42.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.514+0000 7f31e8461740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c3b5e87d80 con 0x55c3b5f7a590 2024-09-05T01:31:42.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.514+0000 7f31e8461740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c3b5edc3a0 con 0x55c3b5f79c70 2024-09-05T01:31:42.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.514+0000 7f31dea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f7a590 0x55c3b5f84910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:42.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.514+0000 7f31dea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f7a590 0x55c3b5f84910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:47682/0 (socket says 172.21.15.12:47682) 2024-09-05T01:31:42.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.514+0000 7f31dea00640 1 -- 172.21.15.12:0/847728091 learned_addr learned my addr 172.21.15.12:0/847728091 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:42.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.514+0000 7f31df400640 1 --2- 172.21.15.12:0/847728091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c3b5f79c70 0x55c3b5f7a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:42.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.514+0000 7f31d7e00640 1 --2- 172.21.15.12:0/847728091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3b5f84e50 0x55c3b5f87240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:42.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.515+0000 7f31dea00640 1 -- 172.21.15.12:0/847728091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c3b5f79c70 msgr2=0x55c3b5f7a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:42.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.515+0000 7f31dea00640 1 --2- 172.21.15.12:0/847728091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c3b5f79c70 0x55c3b5f7a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.515+0000 7f31dea00640 1 -- 172.21.15.12:0/847728091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3b5f84e50 msgr2=0x55c3b5f87240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:42.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.515+0000 7f31dea00640 1 --2- 172.21.15.12:0/847728091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3b5f84e50 0x55c3b5f87240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.515+0000 7f31dea00640 1 -- 172.21.15.12:0/847728091 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3b5ea6ae0 con 0x55c3b5f7a590 2024-09-05T01:31:42.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.515+0000 7f31dea00640 1 --2- 172.21.15.12:0/847728091 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f7a590 0x55c3b5f84910 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009a20 tx=0x7f31d0031630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=874056dd850ecace server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:42.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.515+0000 7f31cfe00640 1 -- 172.21.15.12:0/847728091 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d0040070 con 0x55c3b5f7a590 2024-09-05T01:31:42.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.515+0000 7f31cfe00640 1 -- 172.21.15.12:0/847728091 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31d0005040 con 0x55c3b5f7a590 2024-09-05T01:31:42.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.515+0000 7f31d7400640 1 --2- 172.21.15.12:0/3495270273 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f31c40a2d70 0x7f31c40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:42.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.516+0000 7f31cfe00640 1 -- 172.21.15.12:0/847728091 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d0035040 con 0x55c3b5f7a590 2024-09-05T01:31:42.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.516+0000 7f31d7400640 1 -- 172.21.15.12:0/3495270273 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7f31c80cefc0 con 0x7f31e01049a0 2024-09-05T01:31:42.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.516+0000 7f31df400640 1 --2- 172.21.15.12:0/3495270273 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f31c40a2d70 0x7f31c40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:42.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.516+0000 7f31e8461740 1 -- 172.21.15.12:0/847728091 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f7a590 msgr2=0x55c3b5f84910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:42.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.516+0000 7f31e8461740 1 --2- 172.21.15.12:0/847728091 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f7a590 0x55c3b5f84910 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009a20 tx=0x7f31d0031630 comp rx=0 tx=0).stop 2024-09-05T01:31:42.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.517+0000 7f31df400640 1 --2- 172.21.15.12:0/3495270273 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f31c40a2d70 0x7f31c40a5230 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f31d8005fd0 tx=0x7f31d8009600 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:42.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.517+0000 7f31e8461740 1 -- 172.21.15.12:0/847728091 shutdown_connections 2024-09-05T01:31:42.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.517+0000 7f31e8461740 1 --2- 172.21.15.12:0/847728091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3b5f84e50 0x55c3b5f87240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.517+0000 7f31e8461740 1 --2- 172.21.15.12:0/847728091 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f7a590 0x55c3b5f84910 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.517+0000 7f31e8461740 1 --2- 172.21.15.12:0/847728091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c3b5f79c70 0x55c3b5f7a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.517+0000 7f31e8461740 1 -- 172.21.15.12:0/847728091 >> 172.21.15.12:0/847728091 conn(0x55c3b5f76200 msgr2=0x55c3b5f765e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:42.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.517+0000 7f31e8461740 1 -- 172.21.15.12:0/847728091 shutdown_connections 2024-09-05T01:31:42.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.517+0000 7f31e8461740 1 -- 172.21.15.12:0/847728091 wait complete. 2024-09-05T01:31:42.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.517+0000 7f31e8461740 1 -- start start 2024-09-05T01:31:42.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.518+0000 7f31e8461740 1 Processor -- start 2024-09-05T01:31:42.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.518+0000 7f31e8461740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c3b5f79c70 0x55c3b5f81cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:42.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.518+0000 7f31e8461740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f7a590 0x55c3b5f82230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:42.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.518+0000 7f31e8461740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3b5f84e50 0x55c3b5f82770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:42.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.518+0000 7f31e8461740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c3b5f87a20 con 0x55c3b5f84e50 2024-09-05T01:31:42.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.518+0000 7f31e8461740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c3b5e9b0f0 con 0x55c3b5f7a590 2024-09-05T01:31:42.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.518+0000 7f31e8461740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c3b5f87ba0 con 0x55c3b5f79c70 2024-09-05T01:31:42.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.518+0000 7f31e8461740 10 client.0 _ll_register_callbacks cb 0x55c3b5e82bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:31:42.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.518+0000 7f31d7e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f7a590 0x55c3b5f82230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:42.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.518+0000 7f31df400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3b5f84e50 0x55c3b5f82770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:42.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.519+0000 7f31d7e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f7a590 0x55c3b5f82230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:47694/0 (socket says 172.21.15.12:47694) 2024-09-05T01:31:42.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.519+0000 7f31d7e00640 1 -- 172.21.15.12:0/3865907616 learned_addr learned my addr 172.21.15.12:0/3865907616 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:42.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.519+0000 7f31dea00640 1 --2- 172.21.15.12:0/3865907616 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c3b5f79c70 0x55c3b5f81cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:42.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.519+0000 7f31d7e00640 1 -- 172.21.15.12:0/3865907616 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c3b5f79c70 msgr2=0x55c3b5f81cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:42.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.519+0000 7f31d7e00640 1 --2- 172.21.15.12:0/3865907616 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c3b5f79c70 0x55c3b5f81cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.519+0000 7f31d7e00640 1 -- 172.21.15.12:0/3865907616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3b5f84e50 msgr2=0x55c3b5f82770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:42.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.519+0000 7f31d7e00640 1 --2- 172.21.15.12:0/3865907616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3b5f84e50 0x55c3b5f82770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.519+0000 7f31d7e00640 1 -- 172.21.15.12:0/3865907616 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3b5c513c0 con 0x55c3b5f7a590 2024-09-05T01:31:42.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.519+0000 7f31dea00640 1 --2- 172.21.15.12:0/3865907616 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c3b5f79c70 0x55c3b5f81cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:31:42.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.519+0000 7f31d7e00640 1 --2- 172.21.15.12:0/3865907616 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f7a590 0x55c3b5f82230 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f31c809b480 tx=0x7f31c80d25a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e944c0999c71fa48 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:42.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.519+0000 7f31ccc00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:31:42.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.519+0000 7f31ccc00640 1 -- 172.21.15.12:0/3865907616 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c809b2c0 con 0x55c3b5f7a590 2024-09-05T01:31:42.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.520+0000 7f31ccc00640 1 -- 172.21.15.12:0/3865907616 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7f31c80cc8f0 con 0x55c3b5f7a590 2024-09-05T01:31:42.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.520+0000 7f31e8461740 1 -- 172.21.15.12:0/3865907616 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31d0005040 con 0x55c3b5f7a590 2024-09-05T01:31:42.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.520+0000 7f31ccc00640 1 -- 172.21.15.12:0/3865907616 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f31c809ae50 con 0x55c3b5f7a590 2024-09-05T01:31:42.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.520+0000 7f31e8461740 10 client.26000 fetch_fsmap learned FSMap version 40 2024-09-05T01:31:42.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.520+0000 7f31e8461740 1 -- 172.21.15.12:0/3865907616 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55c3b5f93a10 con 0x55c3b5f7a590 2024-09-05T01:31:42.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.520+0000 7f31ccc00640 1 -- 172.21.15.12:0/3865907616 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31d0005040 con 0x55c3b5f7a590 2024-09-05T01:31:42.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.520+0000 7f31ccc00640 1 -- 172.21.15.12:0/3865907616 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f31c80a3c20 con 0x55c3b5f7a590 2024-09-05T01:31:42.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.520+0000 7f31e8461740 10 client.26000 fetch_fsmap finished waiting for FSMap version 40 2024-09-05T01:31:42.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.520+0000 7f31e8461740 10 client.26000 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-05T01:31:42.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.520+0000 7f31e8461740 20 client.26000 populate_metadata read hostname 'smithi012' 2024-09-05T01:31:42.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.520+0000 7f31e8461740 1 --2- 172.21.15.12:0/3865907616 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55c3b5f94f70 0x55c3b5f973b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:42.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.520+0000 7f31e8461740 4 client.26000 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:31:42.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.520+0000 7f31e8461740 1 -- 172.21.15.12:0/3865907616 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3b5eed950 con 0x55c3b5f94f70 2024-09-05T01:31:42.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.521+0000 7f31dea00640 1 --2- 172.21.15.12:0/3865907616 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55c3b5f94f70 0x55c3b5f973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:42.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.521+0000 7f31dea00640 1 --2- 172.21.15.12:0/3865907616 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55c3b5f94f70 0x55c3b5f973b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b722caf4bdecd2dd server_cookie=a64d4c55206a4758 in_seq=0 out_seq=0 2024-09-05T01:31:42.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.521+0000 7f31ccc00640 10 client.26000 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:31:42.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.522+0000 7f31ccc00640 1 -- 172.21.15.12:0/3865907616 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c3b5eed950 con 0x55c3b5f94f70 2024-09-05T01:31:42.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.522+0000 7f31ccc00640 10 client.26000 handle_command_reply: tid=0 2024-09-05T01:31:42.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.522+0000 7f31e8461740 1 client.26000 shutdown 2024-09-05T01:31:42.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.522+0000 7f31e8461740 1 -- 172.21.15.12:0/3865907616 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f7a590 msgr2=0x55c3b5f82230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:42.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.522+0000 7f31e8461740 1 --2- 172.21.15.12:0/3865907616 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f7a590 0x55c3b5f82230 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f31c809b480 tx=0x7f31c80d25a0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.523+0000 7f31e8461740 1 -- 172.21.15.12:0/3865907616 shutdown_connections 2024-09-05T01:31:42.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.523+0000 7f31e8461740 1 --2- 172.21.15.12:0/3865907616 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55c3b5f94f70 0x55c3b5f973b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.523+0000 7f31e8461740 1 --2- 172.21.15.12:0/3865907616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3b5f84e50 0x55c3b5f82770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.523+0000 7f31e8461740 1 --2- 172.21.15.12:0/3865907616 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f7a590 0x55c3b5f82230 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.523+0000 7f31e8461740 1 --2- 172.21.15.12:0/3865907616 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c3b5f79c70 0x55c3b5f81cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.523+0000 7f31ccc00640 0 client.26000 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:31:42.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.523+0000 7f31e8461740 1 -- 172.21.15.12:0/3865907616 >> 172.21.15.12:0/3865907616 conn(0x55c3b5f76200 msgr2=0x55c3b5f75380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:42.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.523+0000 7f31e8461740 1 -- 172.21.15.12:0/3865907616 shutdown_connections 2024-09-05T01:31:42.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.523+0000 7f31e8461740 1 -- 172.21.15.12:0/3865907616 wait complete. 2024-09-05T01:31:42.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.523+0000 7f31e8461740 20 client.26000 trim_cache size 0 max 16384 2024-09-05T01:31:42.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.537+0000 7f31e8461740 1 Processor -- start 2024-09-05T01:31:42.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.537+0000 7f31e8461740 1 -- start start 2024-09-05T01:31:42.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.537+0000 7f31e8461740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c3b5f79c70 0x55c3b5f805c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:42.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.537+0000 7f31e8461740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3b5f7a590 0x55c3b5f9cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:42.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.537+0000 7f31e8461740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f84e50 0x55c3b5f9d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:42.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.537+0000 7f31e8461740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f31e01afb40 con 0x55c3b5f7a590 2024-09-05T01:31:42.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.537+0000 7f31e8461740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f31e01b1860 con 0x55c3b5f84e50 2024-09-05T01:31:42.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.537+0000 7f31e8461740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f31e01b0210 con 0x55c3b5f79c70 2024-09-05T01:31:42.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.538+0000 7f31d7e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3b5f7a590 0x55c3b5f9cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:42.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.538+0000 7f31df400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f84e50 0x55c3b5f9d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:42.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.538+0000 7f31d7e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3b5f7a590 0x55c3b5f9cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44092/0 (socket says 172.21.15.12:44092) 2024-09-05T01:31:42.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.538+0000 7f31d7e00640 1 -- 172.21.15.12:0/869402790 learned_addr learned my addr 172.21.15.12:0/869402790 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:42.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.538+0000 7f31dea00640 1 --2- 172.21.15.12:0/869402790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c3b5f79c70 0x55c3b5f805c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:42.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.538+0000 7f31d7e00640 1 -- 172.21.15.12:0/869402790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c3b5f79c70 msgr2=0x55c3b5f805c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:42.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.538+0000 7f31d7e00640 1 --2- 172.21.15.12:0/869402790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c3b5f79c70 0x55c3b5f805c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.538+0000 7f31d7e00640 1 -- 172.21.15.12:0/869402790 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f84e50 msgr2=0x55c3b5f9d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:42.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.538+0000 7f31d7e00640 1 --2- 172.21.15.12:0/869402790 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f84e50 0x55c3b5f9d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.538+0000 7f31d7e00640 1 -- 172.21.15.12:0/869402790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3b5f71770 con 0x55c3b5f7a590 2024-09-05T01:31:42.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.538+0000 7f31df400640 1 --2- 172.21.15.12:0/869402790 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f84e50 0x55c3b5f9d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:31:42.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.538+0000 7f31d7e00640 1 --2- 172.21.15.12:0/869402790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3b5f7a590 0x55c3b5f9cc80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f31c80997a0 tx=0x7f31c809ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48b6a42e7b07b49 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:42.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.539+0000 7f31cf400640 1 -- 172.21.15.12:0/869402790 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c809b030 con 0x55c3b5f7a590 2024-09-05T01:31:42.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.539+0000 7f31cf400640 1 -- 172.21.15.12:0/869402790 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31c80d2760 con 0x55c3b5f7a590 2024-09-05T01:31:42.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.539+0000 7f31cf400640 1 -- 172.21.15.12:0/869402790 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c80cc8f0 con 0x55c3b5f7a590 2024-09-05T01:31:42.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.539+0000 7f31e8461740 1 -- 172.21.15.12:0/869402790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3b5f7a590 msgr2=0x55c3b5f9cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:42.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.539+0000 7f31e8461740 1 --2- 172.21.15.12:0/869402790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3b5f7a590 0x55c3b5f9cc80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f31c80997a0 tx=0x7f31c809ad40 comp rx=0 tx=0).stop 2024-09-05T01:31:42.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.539+0000 7f31e8461740 1 -- 172.21.15.12:0/869402790 shutdown_connections 2024-09-05T01:31:42.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.539+0000 7f31e8461740 1 --2- 172.21.15.12:0/869402790 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f84e50 0x55c3b5f9d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.539+0000 7f31e8461740 1 --2- 172.21.15.12:0/869402790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3b5f7a590 0x55c3b5f9cc80 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.539+0000 7f31e8461740 1 --2- 172.21.15.12:0/869402790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c3b5f79c70 0x55c3b5f805c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.539+0000 7f31e8461740 1 -- 172.21.15.12:0/869402790 >> 172.21.15.12:0/869402790 conn(0x55c3b5f76200 msgr2=0x55c3b5f83d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:42.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.540+0000 7f31e8461740 1 -- 172.21.15.12:0/869402790 shutdown_connections 2024-09-05T01:31:42.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.540+0000 7f31e8461740 1 -- 172.21.15.12:0/869402790 wait complete. 2024-09-05T01:31:42.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.540+0000 7f31e8461740 1 -- start start 2024-09-05T01:31:42.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.540+0000 7f31e8461740 1 Processor -- start 2024-09-05T01:31:42.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.541+0000 7f31e8461740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f79c70 0x55c3b5f88b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:42.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.541+0000 7f31e8461740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3b5f7a590 0x55c3b5f890b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:42.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.541+0000 7f31e8461740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c3b5f84e50 0x55c3b5f895f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:42.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.541+0000 7f31e8461740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f31e01b10d0 con 0x55c3b5f7a590 2024-09-05T01:31:42.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.541+0000 7f31e8461740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f31e01b09a0 con 0x55c3b5f79c70 2024-09-05T01:31:42.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.541+0000 7f31e8461740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f31e01adb40 con 0x55c3b5f84e50 2024-09-05T01:31:42.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.541+0000 7f31e8461740 10 client.0 _ll_register_callbacks cb 0x7f31c80bb040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:31:42.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.541+0000 7f31d7e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3b5f7a590 0x55c3b5f890b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:42.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.541+0000 7f31d7e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3b5f7a590 0x55c3b5f890b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44104/0 (socket says 172.21.15.12:44104) 2024-09-05T01:31:42.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.541+0000 7f31d7e00640 1 -- 172.21.15.12:0/1597728199 learned_addr learned my addr 172.21.15.12:0/1597728199 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:42.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.541+0000 7f31df400640 1 --2- 172.21.15.12:0/1597728199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c3b5f84e50 0x55c3b5f895f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:42.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.541+0000 7f31dea00640 1 --2- 172.21.15.12:0/1597728199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f79c70 0x55c3b5f88b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:42.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.542+0000 7f31d7e00640 1 -- 172.21.15.12:0/1597728199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c3b5f84e50 msgr2=0x55c3b5f895f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:42.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.542+0000 7f31d7e00640 1 --2- 172.21.15.12:0/1597728199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c3b5f84e50 0x55c3b5f895f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.542+0000 7f31d7e00640 1 -- 172.21.15.12:0/1597728199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f79c70 msgr2=0x55c3b5f88b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:42.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.542+0000 7f31d7e00640 1 --2- 172.21.15.12:0/1597728199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f79c70 0x55c3b5f88b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.542+0000 7f31d7e00640 1 -- 172.21.15.12:0/1597728199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3b5f7cae0 con 0x55c3b5f7a590 2024-09-05T01:31:42.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.542+0000 7f31dea00640 1 --2- 172.21.15.12:0/1597728199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f79c70 0x55c3b5f88b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:31:42.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.542+0000 7f31d7e00640 1 --2- 172.21.15.12:0/1597728199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3b5f7a590 0x55c3b5f890b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f31c8005890 tx=0x7f31c80d2af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f568ec43a14e8a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:42.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.542+0000 7f31ccc00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:31:42.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.542+0000 7f31ccc00640 1 -- 172.21.15.12:0/1597728199 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c80ccb00 con 0x55c3b5f7a590 2024-09-05T01:31:42.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.542+0000 7f31ccc00640 1 -- 172.21.15.12:0/1597728199 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7f31c80a3e20 con 0x55c3b5f7a590 2024-09-05T01:31:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.542+0000 7f31e8461740 1 -- 172.21.15.12:0/1597728199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31c80d2760 con 0x55c3b5f7a590 2024-09-05T01:31:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.542+0000 7f31ccc00640 1 -- 172.21.15.12:0/1597728199 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f31c80a40b0 con 0x55c3b5f7a590 2024-09-05T01:31:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.543+0000 7f31e8461740 10 client.15948 fetch_fsmap learned FSMap version 40 2024-09-05T01:31:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.543+0000 7f31e8461740 1 -- 172.21.15.12:0/1597728199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55c3b5fffd70 con 0x55c3b5f7a590 2024-09-05T01:31:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.543+0000 7f31ccc00640 1 -- 172.21.15.12:0/1597728199 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f31c80d2760 con 0x55c3b5f7a590 2024-09-05T01:31:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.543+0000 7f31ccc00640 1 -- 172.21.15.12:0/1597728199 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7f31c8005340 con 0x55c3b5f7a590 2024-09-05T01:31:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.543+0000 7f31e8461740 10 client.15948 fetch_fsmap finished waiting for FSMap version 40 2024-09-05T01:31:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.543+0000 7f31e8461740 10 client.15948 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-05T01:31:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.543+0000 7f31e8461740 20 client.15948 populate_metadata read hostname 'smithi012' 2024-09-05T01:31:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.543+0000 7f31e8461740 1 --2- 172.21.15.12:0/1597728199 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55c3b6000250 0x55c3b6002670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.543+0000 7f31e8461740 4 client.15948 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:31:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.543+0000 7f31e8461740 1 -- 172.21.15.12:0/1597728199 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c3b5ee7e60 con 0x55c3b6000250 2024-09-05T01:31:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.543+0000 7f31dea00640 1 --2- 172.21.15.12:0/1597728199 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55c3b6000250 0x55c3b6002670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.544+0000 7f31dea00640 1 --2- 172.21.15.12:0/1597728199 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55c3b6000250 0x55c3b6002670 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e0b836f239617098 server_cookie=18191fc8d2876579 in_seq=0 out_seq=0 2024-09-05T01:31:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.544+0000 7f31ccc00640 10 client.15948 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:31:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.544+0000 7f31ccc00640 1 -- 172.21.15.12:0/1597728199 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c3b5ee7e60 con 0x55c3b6000250 2024-09-05T01:31:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.544+0000 7f31ccc00640 10 client.15948 handle_command_reply: tid=0 2024-09-05T01:31:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.544+0000 7f31e8461740 1 client.15948 shutdown 2024-09-05T01:31:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.544+0000 7f31e8461740 1 -- 172.21.15.12:0/1597728199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3b5f7a590 msgr2=0x55c3b5f890b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.544+0000 7f31e8461740 1 --2- 172.21.15.12:0/1597728199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3b5f7a590 0x55c3b5f890b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f31c8005890 tx=0x7f31c80d2af0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.544+0000 7f31e8461740 1 -- 172.21.15.12:0/1597728199 shutdown_connections 2024-09-05T01:31:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.544+0000 7f31e8461740 1 --2- 172.21.15.12:0/1597728199 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55c3b6000250 0x55c3b6002670 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.545+0000 7f31e8461740 1 --2- 172.21.15.12:0/1597728199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c3b5f84e50 0x55c3b5f895f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.545+0000 7f31e8461740 1 --2- 172.21.15.12:0/1597728199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c3b5f7a590 0x55c3b5f890b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.545+0000 7f31e8461740 1 --2- 172.21.15.12:0/1597728199 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c3b5f79c70 0x55c3b5f88b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.545+0000 7f31e8461740 1 -- 172.21.15.12:0/1597728199 >> 172.21.15.12:0/1597728199 conn(0x55c3b5f76200 msgr2=0x55c3b5f7b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:42.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.545+0000 7f31ccc00640 0 client.15948 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:31:42.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.545+0000 7f31e8461740 1 -- 172.21.15.12:0/1597728199 shutdown_connections 2024-09-05T01:31:42.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.545+0000 7f31e8461740 1 -- 172.21.15.12:0/1597728199 wait complete. 2024-09-05T01:31:42.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.545+0000 7f31e8461740 20 client.15948 trim_cache size 0 max 16384 2024-09-05T01:31:42.550 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:31:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.546+0000 7f31e5800640 1 -- 172.21.15.12:0/3495270273 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f31c40a2d70 msgr2=0x7f31c40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.546+0000 7f31e5800640 1 --2- 172.21.15.12:0/3495270273 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f31c40a2d70 0x7f31c40a5230 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f31d8005fd0 tx=0x7f31d8009600 comp rx=0 tx=0).stop 2024-09-05T01:31:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.546+0000 7f31e5800640 1 -- 172.21.15.12:0/3495270273 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31e01049a0 msgr2=0x7f31e019ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.546+0000 7f31e5800640 1 --2- 172.21.15.12:0/3495270273 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31e01049a0 0x7f31e019ab20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f31c800d6d0 tx=0x7f31c800db90 comp rx=0 tx=0).stop 2024-09-05T01:31:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.546+0000 7f31e5800640 1 -- 172.21.15.12:0/3495270273 shutdown_connections 2024-09-05T01:31:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.546+0000 7f31e5800640 1 --2- 172.21.15.12:0/3495270273 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f31c40a2d70 0x7f31c40a5230 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.546+0000 7f31e5800640 1 --2- 172.21.15.12:0/3495270273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31e0109120 0x7f31e019eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.546+0000 7f31e5800640 1 --2- 172.21.15.12:0/3495270273 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f31e01049a0 0x7f31e019ab20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.546+0000 7f31e5800640 1 --2- 172.21.15.12:0/3495270273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31e0103ff0 0x7f31e019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:42.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.546+0000 7f31e5800640 1 -- 172.21.15.12:0/3495270273 >> 172.21.15.12:0/3495270273 conn(0x7f31e00ffa90 msgr2=0x7f31e0100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:42.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.546+0000 7f31e5800640 1 -- 172.21.15.12:0/3495270273 shutdown_connections 2024-09-05T01:31:42.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:42.546+0000 7f31e5800640 1 -- 172.21.15.12:0/3495270273 wait complete. 2024-09-05T01:31:43.293 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:43 smithi012 ceph-mon[29942]: pgmap v215: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.5 MiB/s wr, 237 op/s 2024-09-05T01:31:43.331 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-05T01:31:43.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:43 smithi145 ceph-mon[34376]: pgmap v215: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.5 MiB/s wr, 237 op/s 2024-09-05T01:31:43.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:43 smithi151 ceph-mon[35013]: pgmap v215: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.5 MiB/s wr, 237 op/s 2024-09-05T01:31:43.722 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:31:44.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.287+0000 7faf17e00640 1 -- 172.21.15.12:0/395318279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf101049a0 msgr2=0x7faf101089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:44.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.287+0000 7faf17e00640 1 --2- 172.21.15.12:0/395318279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf101049a0 0x7faf101089f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7faefc009900 tx=0x7faefc02a3f0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.287+0000 7faf17e00640 1 -- 172.21.15.12:0/395318279 shutdown_connections 2024-09-05T01:31:44.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.287+0000 7faf17e00640 1 --2- 172.21.15.12:0/395318279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf10109120 0x7faf10110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.287+0000 7faf17e00640 1 --2- 172.21.15.12:0/395318279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf101049a0 0x7faf101089f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.287+0000 7faf17e00640 1 --2- 172.21.15.12:0/395318279 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf10103ff0 0x7faf101043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.287+0000 7faf17e00640 1 -- 172.21.15.12:0/395318279 >> 172.21.15.12:0/395318279 conn(0x7faf100ffa90 msgr2=0x7faf10101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:44.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.287+0000 7faf17e00640 1 -- 172.21.15.12:0/395318279 shutdown_connections 2024-09-05T01:31:44.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.287+0000 7faf17e00640 1 -- 172.21.15.12:0/395318279 wait complete. 2024-09-05T01:31:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.288+0000 7faf17e00640 1 Processor -- start 2024-09-05T01:31:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.288+0000 7faf17e00640 1 -- start start 2024-09-05T01:31:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.288+0000 7faf17e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf10103ff0 0x7faf1019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.288+0000 7faf17e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf101049a0 0x7faf1019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.288+0000 7faf17e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf10109120 0x7faf1019ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.288+0000 7faf17e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faf10114140 con 0x7faf10103ff0 2024-09-05T01:31:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.288+0000 7faf17e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7faf10113fc0 con 0x7faf10109120 2024-09-05T01:31:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.288+0000 7faf17e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7faf101142c0 con 0x7faf101049a0 2024-09-05T01:31:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.289+0000 7faf15400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf10103ff0 0x7faf1019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.289+0000 7faf14a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf101049a0 0x7faf1019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.289+0000 7faf15400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf10103ff0 0x7faf1019a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44118/0 (socket says 172.21.15.12:44118) 2024-09-05T01:31:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.289+0000 7faf15400640 1 -- 172.21.15.12:0/2136545504 learned_addr learned my addr 172.21.15.12:0/2136545504 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.289+0000 7faf15e00640 1 --2- 172.21.15.12:0/2136545504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf10109120 0x7faf1019ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.289+0000 7faf15400640 1 -- 172.21.15.12:0/2136545504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf101049a0 msgr2=0x7faf1019abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.289+0000 7faf15400640 1 --2- 172.21.15.12:0/2136545504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf101049a0 0x7faf1019abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.289+0000 7faf15400640 1 -- 172.21.15.12:0/2136545504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf10109120 msgr2=0x7faf1019ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.289+0000 7faf15400640 1 --2- 172.21.15.12:0/2136545504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf10109120 0x7faf1019ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.289+0000 7faf15400640 1 -- 172.21.15.12:0/2136545504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf1019f650 con 0x7faf10103ff0 2024-09-05T01:31:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.290+0000 7faf15400640 1 --2- 172.21.15.12:0/2136545504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf10103ff0 0x7faf1019a6a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7faf0400d950 tx=0x7faf0400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.290+0000 7faf0e000640 1 -- 172.21.15.12:0/2136545504 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf04017030 con 0x7faf10103ff0 2024-09-05T01:31:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.290+0000 7faf17e00640 1 -- 172.21.15.12:0/2136545504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf1019f940 con 0x7faf10103ff0 2024-09-05T01:31:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.290+0000 7faf0e000640 1 -- 172.21.15.12:0/2136545504 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf04004020 con 0x7faf10103ff0 2024-09-05T01:31:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.290+0000 7faf0e000640 1 -- 172.21.15.12:0/2136545504 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf040047a0 con 0x7faf10103ff0 2024-09-05T01:31:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.290+0000 7faf17e00640 1 -- 172.21.15.12:0/2136545504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf101a7220 con 0x7faf10103ff0 2024-09-05T01:31:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.293+0000 7faf1aa13740 1 Processor -- start 2024-09-05T01:31:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.293+0000 7faf1aa13740 1 -- start start 2024-09-05T01:31:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.293+0000 7faf0e000640 1 -- 172.21.15.12:0/2136545504 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7faf040041d0 con 0x7faf10103ff0 2024-09-05T01:31:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.293+0000 7faf1aa13740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56530e08cc70 0x56530e08d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.293+0000 7faf1aa13740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56530e08d590 0x56530e097910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.293+0000 7faf1aa13740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e097e50 0x56530e09a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.293+0000 7faf1aa13740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56530dff33e0 con 0x56530e097e50 2024-09-05T01:31:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.293+0000 7faf1aa13740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56530df9ad80 con 0x56530e08d590 2024-09-05T01:31:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.293+0000 7faf1aa13740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56530dfef3a0 con 0x56530e08cc70 2024-09-05T01:31:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.294+0000 7faf15e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56530e08cc70 0x56530e08d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.294+0000 7faf15e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56530e08cc70 0x56530e08d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:34476/0 (socket says 172.21.15.12:34476) 2024-09-05T01:31:44.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.294+0000 7faf15e00640 1 -- 172.21.15.12:0/3611624656 learned_addr learned my addr 172.21.15.12:0/3611624656 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:44.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.294+0000 7faf14a00640 1 --2- 172.21.15.12:0/3611624656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e097e50 0x56530e09a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:44.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.294+0000 7faf15400640 1 --2- 172.21.15.12:0/3611624656 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56530e08d590 0x56530e097910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:44.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.294+0000 7faf15e00640 1 -- 172.21.15.12:0/3611624656 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56530e08d590 msgr2=0x56530e097910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:44.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.294+0000 7faf15e00640 1 --2- 172.21.15.12:0/3611624656 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56530e08d590 0x56530e097910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.294+0000 7faf15e00640 1 -- 172.21.15.12:0/3611624656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e097e50 msgr2=0x56530e09a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:44.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.294+0000 7faf15e00640 1 --2- 172.21.15.12:0/3611624656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e097e50 0x56530e09a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.294+0000 7faf15e00640 1 -- 172.21.15.12:0/3611624656 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56530dfb9ae0 con 0x56530e08cc70 2024-09-05T01:31:44.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.295+0000 7faf15e00640 1 --2- 172.21.15.12:0/3611624656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56530e08cc70 0x56530e08d050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7faf08009f50 tx=0x7faf080118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=771630c2c760ec1 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:44.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.295+0000 7faf02600640 1 -- 172.21.15.12:0/3611624656 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08004d20 con 0x56530e08cc70 2024-09-05T01:31:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.295+0000 7faf02600640 1 -- 172.21.15.12:0/3611624656 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf08004050 con 0x56530e08cc70 2024-09-05T01:31:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.295+0000 7faf02600640 1 -- 172.21.15.12:0/3611624656 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08005280 con 0x56530e08cc70 2024-09-05T01:31:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.296+0000 7faf0e000640 1 --2- 172.21.15.12:0/2136545504 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7faef80a2d70 0x7faef80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.296+0000 7faf1aa13740 1 -- 172.21.15.12:0/3611624656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56530e08cc70 msgr2=0x56530e08d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.296+0000 7faf0e000640 1 -- 172.21.15.12:0/2136545504 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7faf040cedb0 con 0x7faf10103ff0 2024-09-05T01:31:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.296+0000 7faf1aa13740 1 --2- 172.21.15.12:0/3611624656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56530e08cc70 0x56530e08d050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7faf08009f50 tx=0x7faf080118d0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.296+0000 7faf15400640 1 --2- 172.21.15.12:0/2136545504 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7faef80a2d70 0x7faef80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.296+0000 7faf1aa13740 1 -- 172.21.15.12:0/3611624656 shutdown_connections 2024-09-05T01:31:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.296+0000 7faf1aa13740 1 --2- 172.21.15.12:0/3611624656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e097e50 0x56530e09a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.296+0000 7faf1aa13740 1 --2- 172.21.15.12:0/3611624656 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56530e08d590 0x56530e097910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.296+0000 7faf1aa13740 1 --2- 172.21.15.12:0/3611624656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56530e08cc70 0x56530e08d050 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.296+0000 7faf1aa13740 1 -- 172.21.15.12:0/3611624656 >> 172.21.15.12:0/3611624656 conn(0x56530e089200 msgr2=0x56530e0895e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.296+0000 7faf1aa13740 1 -- 172.21.15.12:0/3611624656 shutdown_connections 2024-09-05T01:31:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.296+0000 7faf1aa13740 1 -- 172.21.15.12:0/3611624656 wait complete. 2024-09-05T01:31:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.297+0000 7faf15400640 1 --2- 172.21.15.12:0/2136545504 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7faef80a2d70 0x7faef80a5230 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x56530e08a060 tx=0x7faf040d2860 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.297+0000 7faf1aa13740 1 -- start start 2024-09-05T01:31:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.297+0000 7faf1aa13740 1 Processor -- start 2024-09-05T01:31:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.297+0000 7faf1aa13740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e08cc70 0x56530e094d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.298+0000 7faf1aa13740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56530e08d590 0x56530e0952b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.298+0000 7faf1aa13740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56530e097e50 0x56530e0957f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.298+0000 7faf1aa13740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56530e09aa20 con 0x56530e08cc70 2024-09-05T01:31:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.298+0000 7faf1aa13740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56530dfae0f0 con 0x56530e08d590 2024-09-05T01:31:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.298+0000 7faf1aa13740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56530e09aba0 con 0x56530e097e50 2024-09-05T01:31:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.298+0000 7faf1aa13740 10 client.0 _ll_register_callbacks cb 0x56530df95bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:31:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.298+0000 7faf15e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e08cc70 0x56530e094d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.298+0000 7faf15e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e08cc70 0x56530e094d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44136/0 (socket says 172.21.15.12:44136) 2024-09-05T01:31:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.298+0000 7faf14a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56530e08d590 0x56530e0952b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.298+0000 7faf15e00640 1 -- 172.21.15.12:0/3912682475 learned_addr learned my addr 172.21.15.12:0/3912682475 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.298+0000 7faf15e00640 1 --2- 172.21.15.12:0/3912682475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56530e097e50 0x56530e0957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.298+0000 7faf14a00640 1 -- 172.21.15.12:0/3912682475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56530e097e50 msgr2=0x56530e0957f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.298+0000 7faf14a00640 1 --2- 172.21.15.12:0/3912682475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56530e097e50 0x56530e0957f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.298+0000 7faf14a00640 1 -- 172.21.15.12:0/3912682475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e08cc70 msgr2=0x56530e094d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.298+0000 7faf14a00640 1 --2- 172.21.15.12:0/3912682475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e08cc70 0x56530e094d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.298+0000 7faf14a00640 1 -- 172.21.15.12:0/3912682475 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56530dd643c0 con 0x56530e08d590 2024-09-05T01:31:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.298+0000 7faf15e00640 1 --2- 172.21.15.12:0/3912682475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56530e097e50 0x56530e0957f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:31:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.299+0000 7faf14a00640 1 --2- 172.21.15.12:0/3912682475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56530e08d590 0x56530e0952b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faefc006010 tx=0x7faefc0317e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41e66332f15cce4a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.299+0000 7faef6a00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:31:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.299+0000 7faef6a00640 1 -- 172.21.15.12:0/3912682475 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faefc035040 con 0x56530e08d590 2024-09-05T01:31:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.299+0000 7faf1aa13740 1 -- 172.21.15.12:0/3912682475 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf08004050 con 0x56530e08d590 2024-09-05T01:31:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.299+0000 7faef6a00640 1 -- 172.21.15.12:0/3912682475 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7faefc004460 con 0x56530e08d590 2024-09-05T01:31:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.300+0000 7faef6a00640 1 -- 172.21.15.12:0/3912682475 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7faefc005020 con 0x56530e08d590 2024-09-05T01:31:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.300+0000 7faf1aa13740 10 client.26018 fetch_fsmap learned FSMap version 40 2024-09-05T01:31:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.300+0000 7faf1aa13740 1 -- 172.21.15.12:0/3912682475 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x56530e0a6ae0 con 0x56530e08d590 2024-09-05T01:31:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.300+0000 7faef6a00640 1 -- 172.21.15.12:0/3912682475 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf08004050 con 0x56530e08d590 2024-09-05T01:31:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.300+0000 7faef6a00640 1 -- 172.21.15.12:0/3912682475 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7faefc0035f0 con 0x56530e08d590 2024-09-05T01:31:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.300+0000 7faf1aa13740 10 client.26018 fetch_fsmap finished waiting for FSMap version 40 2024-09-05T01:31:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.300+0000 7faf1aa13740 10 client.26018 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-05T01:31:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.300+0000 7faf1aa13740 20 client.26018 populate_metadata read hostname 'smithi012' 2024-09-05T01:31:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.300+0000 7faf1aa13740 1 --2- 172.21.15.12:0/3912682475 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x56530e0a7f40 0x56530e0aa390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.300+0000 7faf1aa13740 4 client.26018 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:31:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.300+0000 7faf1aa13740 1 -- 172.21.15.12:0/3912682475 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56530e000950 con 0x56530e0a7f40 2024-09-05T01:31:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.301+0000 7faf15e00640 1 --2- 172.21.15.12:0/3912682475 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x56530e0a7f40 0x56530e0aa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.301+0000 7faf15e00640 1 --2- 172.21.15.12:0/3912682475 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x56530e0a7f40 0x56530e0aa390 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=90da3a738b006003 server_cookie=a503e121af55eea3 in_seq=0 out_seq=0 2024-09-05T01:31:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.301+0000 7faef6a00640 10 client.26018 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:31:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.302+0000 7faef6a00640 1 -- 172.21.15.12:0/3912682475 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56530e000950 con 0x56530e0a7f40 2024-09-05T01:31:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.302+0000 7faef6a00640 10 client.26018 handle_command_reply: tid=0 2024-09-05T01:31:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.302+0000 7faf1aa13740 1 client.26018 shutdown 2024-09-05T01:31:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.302+0000 7faf1aa13740 1 -- 172.21.15.12:0/3912682475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56530e08d590 msgr2=0x56530e0952b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.302+0000 7faf1aa13740 1 --2- 172.21.15.12:0/3912682475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56530e08d590 0x56530e0952b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7faefc006010 tx=0x7faefc0317e0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.302+0000 7faf1aa13740 1 -- 172.21.15.12:0/3912682475 shutdown_connections 2024-09-05T01:31:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.302+0000 7faf1aa13740 1 --2- 172.21.15.12:0/3912682475 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x56530e0a7f40 0x56530e0aa390 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.302+0000 7faf1aa13740 1 --2- 172.21.15.12:0/3912682475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56530e097e50 0x56530e0957f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.302+0000 7faf1aa13740 1 --2- 172.21.15.12:0/3912682475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56530e08d590 0x56530e0952b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.302+0000 7faf1aa13740 1 --2- 172.21.15.12:0/3912682475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e08cc70 0x56530e094d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.302+0000 7faf1aa13740 1 -- 172.21.15.12:0/3912682475 >> 172.21.15.12:0/3912682475 conn(0x56530e089200 msgr2=0x56530e08eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.302+0000 7faef6a00640 0 client.26018 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:31:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.302+0000 7faf1aa13740 1 -- 172.21.15.12:0/3912682475 shutdown_connections 2024-09-05T01:31:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.303+0000 7faf1aa13740 1 -- 172.21.15.12:0/3912682475 wait complete. 2024-09-05T01:31:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.303+0000 7faf1aa13740 20 client.26018 trim_cache size 0 max 16384 2024-09-05T01:31:44.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.316+0000 7faf1aa13740 1 Processor -- start 2024-09-05T01:31:44.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.316+0000 7faf1aa13740 1 -- start start 2024-09-05T01:31:44.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.317+0000 7faf1aa13740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e08cc70 0x56530e096ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:44.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.317+0000 7faf1aa13740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56530e08d590 0x56530e0afca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:44.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.317+0000 7faf1aa13740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56530e097e50 0x56530e0b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:44.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.317+0000 7faf1aa13740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faf101afb60 con 0x56530e08cc70 2024-09-05T01:31:44.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.317+0000 7faf1aa13740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7faf101b1880 con 0x56530e08d590 2024-09-05T01:31:44.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.317+0000 7faf1aa13740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7faf101b0230 con 0x56530e097e50 2024-09-05T01:31:44.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.317+0000 7faf15e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e08cc70 0x56530e096ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:44.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.317+0000 7faf15e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e08cc70 0x56530e096ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44144/0 (socket says 172.21.15.12:44144) 2024-09-05T01:31:44.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.317+0000 7faf15e00640 1 -- 172.21.15.12:0/267130794 learned_addr learned my addr 172.21.15.12:0/267130794 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:44.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.317+0000 7faf14a00640 1 --2- 172.21.15.12:0/267130794 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56530e08d590 0x56530e0afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:44.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.317+0000 7faf15e00640 1 -- 172.21.15.12:0/267130794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56530e097e50 msgr2=0x56530e0b01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:44.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.317+0000 7faf15e00640 1 --2- 172.21.15.12:0/267130794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56530e097e50 0x56530e0b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.317+0000 7faf15e00640 1 -- 172.21.15.12:0/267130794 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56530e08d590 msgr2=0x56530e0afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:44.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.317+0000 7faf15e00640 1 --2- 172.21.15.12:0/267130794 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56530e08d590 0x56530e0afca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.317+0000 7faf15e00640 1 -- 172.21.15.12:0/267130794 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56530e084770 con 0x56530e08cc70 2024-09-05T01:31:44.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.318+0000 7faf15e00640 1 --2- 172.21.15.12:0/267130794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e08cc70 0x56530e096ce0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7faf0801b040 tx=0x7faf08009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c8818ce843b066 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:44.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.318+0000 7faf01c00640 1 -- 172.21.15.12:0/267130794 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08031020 con 0x56530e08cc70 2024-09-05T01:31:44.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.318+0000 7faf01c00640 1 -- 172.21.15.12:0/267130794 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf080043d0 con 0x56530e08cc70 2024-09-05T01:31:44.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.318+0000 7faf01c00640 1 -- 172.21.15.12:0/267130794 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0800fa50 con 0x56530e08cc70 2024-09-05T01:31:44.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.318+0000 7faf1aa13740 1 -- 172.21.15.12:0/267130794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e08cc70 msgr2=0x56530e096ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:44.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.318+0000 7faf1aa13740 1 --2- 172.21.15.12:0/267130794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e08cc70 0x56530e096ce0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7faf0801b040 tx=0x7faf08009500 comp rx=0 tx=0).stop 2024-09-05T01:31:44.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.319+0000 7faf1aa13740 1 -- 172.21.15.12:0/267130794 shutdown_connections 2024-09-05T01:31:44.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.319+0000 7faf1aa13740 1 --2- 172.21.15.12:0/267130794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56530e097e50 0x56530e0b01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.319+0000 7faf1aa13740 1 --2- 172.21.15.12:0/267130794 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56530e08d590 0x56530e0afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.319+0000 7faf1aa13740 1 --2- 172.21.15.12:0/267130794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e08cc70 0x56530e096ce0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.319+0000 7faf1aa13740 1 -- 172.21.15.12:0/267130794 >> 172.21.15.12:0/267130794 conn(0x56530e089200 msgr2=0x56530e0965d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:44.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.319+0000 7faf1aa13740 1 -- 172.21.15.12:0/267130794 shutdown_connections 2024-09-05T01:31:44.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.319+0000 7faf1aa13740 1 -- 172.21.15.12:0/267130794 wait complete. 2024-09-05T01:31:44.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.319+0000 7faf1aa13740 1 -- start start 2024-09-05T01:31:44.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.319+0000 7faf1aa13740 1 Processor -- start 2024-09-05T01:31:44.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.320+0000 7faf1aa13740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56530e08cc70 0x56530e091e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:44.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.320+0000 7faf1aa13740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56530e08d590 0x56530e092380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:44.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.320+0000 7faf1aa13740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e097e50 0x56530e0928c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:44.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.320+0000 7faf1aa13740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faf101b10f0 con 0x56530e097e50 2024-09-05T01:31:44.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.320+0000 7faf1aa13740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7faf101b09c0 con 0x56530e08d590 2024-09-05T01:31:44.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.320+0000 7faf1aa13740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7faf101adb60 con 0x56530e08cc70 2024-09-05T01:31:44.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.320+0000 7faf1aa13740 10 client.0 _ll_register_callbacks cb 0x7faefc005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:31:44.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.320+0000 7faf15e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e097e50 0x56530e0928c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:44.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.320+0000 7faf15e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e097e50 0x56530e0928c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44160/0 (socket says 172.21.15.12:44160) 2024-09-05T01:31:44.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.320+0000 7faf15e00640 1 -- 172.21.15.12:0/2481612158 learned_addr learned my addr 172.21.15.12:0/2481612158 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:44.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.320+0000 7faf15e00640 1 --2- 172.21.15.12:0/2481612158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56530e08cc70 0x56530e091e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:44.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.320+0000 7faf14a00640 1 --2- 172.21.15.12:0/2481612158 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56530e08d590 0x56530e092380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:44.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.321+0000 7faf15e00640 1 -- 172.21.15.12:0/2481612158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56530e08cc70 msgr2=0x56530e091e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:44.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.321+0000 7faf15e00640 1 --2- 172.21.15.12:0/2481612158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56530e08cc70 0x56530e091e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.321+0000 7faf15e00640 1 -- 172.21.15.12:0/2481612158 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56530e08d590 msgr2=0x56530e092380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:44.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.321+0000 7faf15e00640 1 --2- 172.21.15.12:0/2481612158 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56530e08d590 0x56530e092380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.321+0000 7faf15e00640 1 -- 172.21.15.12:0/2481612158 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56530e111d20 con 0x56530e097e50 2024-09-05T01:31:44.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.321+0000 7faf15e00640 1 --2- 172.21.15.12:0/2481612158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e097e50 0x56530e0928c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7faf08004910 tx=0x7faf08005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb0e72f7172e08f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:44.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.321+0000 7faef6a00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:31:44.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.321+0000 7faef6a00640 1 -- 172.21.15.12:0/2481612158 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf08031070 con 0x56530e097e50 2024-09-05T01:31:44.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.321+0000 7faf1aa13740 1 -- 172.21.15.12:0/2481612158 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf080043d0 con 0x56530e097e50 2024-09-05T01:31:44.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.321+0000 7faef6a00640 1 -- 172.21.15.12:0/2481612158 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7faf0800fe40 con 0x56530e097e50 2024-09-05T01:31:44.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.321+0000 7faef6a00640 1 -- 172.21.15.12:0/2481612158 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7faf08003a30 con 0x56530e097e50 2024-09-05T01:31:44.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.321+0000 7faf1aa13740 10 client.15966 fetch_fsmap learned FSMap version 40 2024-09-05T01:31:44.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.321+0000 7faf1aa13740 1 -- 172.21.15.12:0/2481612158 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x56530e113000 con 0x56530e097e50 2024-09-05T01:31:44.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.322+0000 7faef6a00640 1 -- 172.21.15.12:0/2481612158 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf080043d0 con 0x56530e097e50 2024-09-05T01:31:44.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.322+0000 7faef6a00640 1 -- 172.21.15.12:0/2481612158 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7faf08019430 con 0x56530e097e50 2024-09-05T01:31:44.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.322+0000 7faf1aa13740 10 client.15966 fetch_fsmap finished waiting for FSMap version 40 2024-09-05T01:31:44.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.322+0000 7faf1aa13740 10 client.15966 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-05T01:31:44.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.322+0000 7faf1aa13740 20 client.15966 populate_metadata read hostname 'smithi012' 2024-09-05T01:31:44.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.322+0000 7faf1aa13740 1 --2- 172.21.15.12:0/2481612158 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x56530e113550 0x56530e115970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:44.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.322+0000 7faf1aa13740 4 client.15966 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:31:44.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.322+0000 7faf1aa13740 1 -- 172.21.15.12:0/2481612158 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56530dffae60 con 0x56530e113550 2024-09-05T01:31:44.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.323+0000 7faf14a00640 1 --2- 172.21.15.12:0/2481612158 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x56530e113550 0x56530e115970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:44.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.323+0000 7faf14a00640 1 --2- 172.21.15.12:0/2481612158 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x56530e113550 0x56530e115970 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=97fae74a52e46279 server_cookie=ba0d3e020e91be9c in_seq=0 out_seq=0 2024-09-05T01:31:44.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.323+0000 7faef6a00640 10 client.15966 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:31:44.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.323+0000 7faef6a00640 1 -- 172.21.15.12:0/2481612158 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56530dffae60 con 0x56530e113550 2024-09-05T01:31:44.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.323+0000 7faef6a00640 10 client.15966 handle_command_reply: tid=0 2024-09-05T01:31:44.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.323+0000 7faf1aa13740 1 client.15966 shutdown 2024-09-05T01:31:44.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.323+0000 7faf1aa13740 1 -- 172.21.15.12:0/2481612158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e097e50 msgr2=0x56530e0928c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:44.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.323+0000 7faf1aa13740 1 --2- 172.21.15.12:0/2481612158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e097e50 0x56530e0928c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7faf08004910 tx=0x7faf08005fd0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.324+0000 7faf1aa13740 1 -- 172.21.15.12:0/2481612158 shutdown_connections 2024-09-05T01:31:44.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.324+0000 7faf1aa13740 1 --2- 172.21.15.12:0/2481612158 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x56530e113550 0x56530e115970 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.324+0000 7faf1aa13740 1 --2- 172.21.15.12:0/2481612158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56530e097e50 0x56530e0928c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.324+0000 7faf1aa13740 1 --2- 172.21.15.12:0/2481612158 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56530e08d590 0x56530e092380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.324+0000 7faf1aa13740 1 --2- 172.21.15.12:0/2481612158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56530e08cc70 0x56530e091e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.324+0000 7faf1aa13740 1 -- 172.21.15.12:0/2481612158 >> 172.21.15.12:0/2481612158 conn(0x56530e089200 msgr2=0x56530e095530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:44.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.324+0000 7faef6a00640 0 client.15966 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:31:44.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.324+0000 7faf1aa13740 1 -- 172.21.15.12:0/2481612158 shutdown_connections 2024-09-05T01:31:44.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.324+0000 7faf1aa13740 1 -- 172.21.15.12:0/2481612158 wait complete. 2024-09-05T01:31:44.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.324+0000 7faf1aa13740 20 client.15966 trim_cache size 0 max 16384 2024-09-05T01:31:44.337 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:31:44.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.325+0000 7faf17e00640 1 -- 172.21.15.12:0/2136545504 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7faef80a2d70 msgr2=0x7faef80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:44.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.325+0000 7faf17e00640 1 --2- 172.21.15.12:0/2136545504 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7faef80a2d70 0x7faef80a5230 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x56530e08a060 tx=0x7faf040d2860 comp rx=0 tx=0).stop 2024-09-05T01:31:44.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.325+0000 7faf17e00640 1 -- 172.21.15.12:0/2136545504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf10103ff0 msgr2=0x7faf1019a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:44.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.325+0000 7faf17e00640 1 --2- 172.21.15.12:0/2136545504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf10103ff0 0x7faf1019a6a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7faf0400d950 tx=0x7faf0400de10 comp rx=0 tx=0).stop 2024-09-05T01:31:44.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.325+0000 7faf17e00640 1 -- 172.21.15.12:0/2136545504 shutdown_connections 2024-09-05T01:31:44.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.325+0000 7faf17e00640 1 --2- 172.21.15.12:0/2136545504 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7faef80a2d70 0x7faef80a5230 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.325+0000 7faf17e00640 1 --2- 172.21.15.12:0/2136545504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf10109120 0x7faf1019ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.325+0000 7faf17e00640 1 --2- 172.21.15.12:0/2136545504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf101049a0 0x7faf1019abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.325+0000 7faf17e00640 1 --2- 172.21.15.12:0/2136545504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf10103ff0 0x7faf1019a6a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:44.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.325+0000 7faf17e00640 1 -- 172.21.15.12:0/2136545504 >> 172.21.15.12:0/2136545504 conn(0x7faf100ffa90 msgr2=0x7faf10100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:44.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.325+0000 7faf17e00640 1 -- 172.21.15.12:0/2136545504 shutdown_connections 2024-09-05T01:31:44.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:44.325+0000 7faf17e00640 1 -- 172.21.15.12:0/2136545504 wait complete. 2024-09-05T01:31:45.067 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-05T01:31:45.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:45 smithi012 ceph-mon[29942]: pgmap v216: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.7 MiB/s wr, 213 op/s 2024-09-05T01:31:45.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:45 smithi145 ceph-mon[34376]: pgmap v216: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.7 MiB/s wr, 213 op/s 2024-09-05T01:31:45.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:45 smithi151 ceph-mon[35013]: pgmap v216: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.7 MiB/s wr, 213 op/s 2024-09-05T01:31:45.449 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:31:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.969+0000 7fa31b600640 1 -- 172.21.15.12:0/3632827982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa314104010 msgr2=0x7fa3141043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.969+0000 7fa31b600640 1 --2- 172.21.15.12:0/3632827982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa314104010 0x7fa3141043f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa304009900 tx=0x7fa30402a3f0 comp rx=0 tx=0).stop 2024-09-05T01:31:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.969+0000 7fa31b600640 1 -- 172.21.15.12:0/3632827982 shutdown_connections 2024-09-05T01:31:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.969+0000 7fa31b600640 1 --2- 172.21.15.12:0/3632827982 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa314109140 0x7fa314110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.969+0000 7fa31b600640 1 --2- 172.21.15.12:0/3632827982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3141049c0 0x7fa314108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.969+0000 7fa31b600640 1 --2- 172.21.15.12:0/3632827982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa314104010 0x7fa3141043f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.969+0000 7fa31b600640 1 -- 172.21.15.12:0/3632827982 >> 172.21.15.12:0/3632827982 conn(0x7fa3140ffa50 msgr2=0x7fa314101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.969+0000 7fa31b600640 1 -- 172.21.15.12:0/3632827982 shutdown_connections 2024-09-05T01:31:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.969+0000 7fa31b600640 1 -- 172.21.15.12:0/3632827982 wait complete. 2024-09-05T01:31:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.970+0000 7fa31b600640 1 Processor -- start 2024-09-05T01:31:45.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.970+0000 7fa31b600640 1 -- start start 2024-09-05T01:31:45.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.970+0000 7fa31b600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa314104010 0x7fa31419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:45.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.970+0000 7fa31b600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3141049c0 0x7fa31419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:45.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.970+0000 7fa31b600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa314109140 0x7fa31419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:45.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.970+0000 7fa31b600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa314114140 con 0x7fa314104010 2024-09-05T01:31:45.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.970+0000 7fa31b600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa314113fc0 con 0x7fa314109140 2024-09-05T01:31:45.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.970+0000 7fa31b600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa3141142c0 con 0x7fa3141049c0 2024-09-05T01:31:45.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.971+0000 7fa318c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa314104010 0x7fa31419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:45.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.971+0000 7fa318c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa314104010 0x7fa31419a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44188/0 (socket says 172.21.15.12:44188) 2024-09-05T01:31:45.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.971+0000 7fa318c00640 1 -- 172.21.15.12:0/1039731144 learned_addr learned my addr 172.21.15.12:0/1039731144 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:45.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.971+0000 7fa30be00640 1 --2- 172.21.15.12:0/1039731144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3141049c0 0x7fa31419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:45.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.971+0000 7fa319600640 1 --2- 172.21.15.12:0/1039731144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa314109140 0x7fa31419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:45.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.971+0000 7fa318c00640 1 -- 172.21.15.12:0/1039731144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3141049c0 msgr2=0x7fa31419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:45.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.971+0000 7fa318c00640 1 --2- 172.21.15.12:0/1039731144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3141049c0 0x7fa31419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:45.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.971+0000 7fa318c00640 1 -- 172.21.15.12:0/1039731144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa314109140 msgr2=0x7fa31419eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:45.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.971+0000 7fa318c00640 1 --2- 172.21.15.12:0/1039731144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa314109140 0x7fa31419eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:45.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.971+0000 7fa318c00640 1 -- 172.21.15.12:0/1039731144 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa31419f5d0 con 0x7fa314104010 2024-09-05T01:31:45.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.972+0000 7fa318c00640 1 --2- 172.21.15.12:0/1039731144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa314104010 0x7fa31419a620 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa304006010 tx=0x7fa3040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:45.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.972+0000 7fa312000640 1 -- 172.21.15.12:0/1039731144 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30403f030 con 0x7fa314104010 2024-09-05T01:31:45.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.972+0000 7fa31b600640 1 -- 172.21.15.12:0/1039731144 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa31419f860 con 0x7fa314104010 2024-09-05T01:31:45.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.972+0000 7fa312000640 1 -- 172.21.15.12:0/1039731144 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa304003ce0 con 0x7fa314104010 2024-09-05T01:31:45.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.972+0000 7fa31b600640 1 -- 172.21.15.12:0/1039731144 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3141a71a0 con 0x7fa314104010 2024-09-05T01:31:45.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.972+0000 7fa312000640 1 -- 172.21.15.12:0/1039731144 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa304049060 con 0x7fa314104010 2024-09-05T01:31:45.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.975+0000 7fa312000640 1 -- 172.21.15.12:0/1039731144 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fa304042030 con 0x7fa314104010 2024-09-05T01:31:45.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.975+0000 7fa31e061740 1 Processor -- start 2024-09-05T01:31:45.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.975+0000 7fa31e061740 1 -- start start 2024-09-05T01:31:45.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.976+0000 7fa31e061740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c5d204ac70 0x55c5d204b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:45.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.976+0000 7fa31e061740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d204b590 0x55c5d2055910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:45.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.976+0000 7fa31e061740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5d2055e50 0x55c5d2058240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:45.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.976+0000 7fa31e061740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c5d1fb13e0 con 0x55c5d204b590 2024-09-05T01:31:45.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.976+0000 7fa31e061740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c5d1f58d80 con 0x55c5d204ac70 2024-09-05T01:31:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.976+0000 7fa31e061740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c5d1fad3a0 con 0x55c5d2055e50 2024-09-05T01:31:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.976+0000 7fa318c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d204b590 0x55c5d2055910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.976+0000 7fa319600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c5d204ac70 0x55c5d204b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.976+0000 7fa318c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d204b590 0x55c5d2055910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44204/0 (socket says 172.21.15.12:44204) 2024-09-05T01:31:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.976+0000 7fa319600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c5d204ac70 0x55c5d204b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:47772/0 (socket says 172.21.15.12:47772) 2024-09-05T01:31:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.976+0000 7fa318c00640 1 -- 172.21.15.12:0/2050846155 learned_addr learned my addr 172.21.15.12:0/2050846155 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.976+0000 7fa30be00640 1 --2- 172.21.15.12:0/2050846155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5d2055e50 0x55c5d2058240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.977+0000 7fa319600640 1 -- 172.21.15.12:0/2050846155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5d2055e50 msgr2=0x55c5d2058240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.977+0000 7fa319600640 1 --2- 172.21.15.12:0/2050846155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5d2055e50 0x55c5d2058240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.977+0000 7fa319600640 1 -- 172.21.15.12:0/2050846155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d204b590 msgr2=0x55c5d2055910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.977+0000 7fa319600640 1 --2- 172.21.15.12:0/2050846155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d204b590 0x55c5d2055910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.977+0000 7fa319600640 1 -- 172.21.15.12:0/2050846155 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5d1f77ae0 con 0x55c5d204ac70 2024-09-05T01:31:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.977+0000 7fa312000640 1 --2- 172.21.15.12:0/1039731144 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fa2f80a2cf0 0x7fa2f80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.977+0000 7fa319600640 1 --2- 172.21.15.12:0/2050846155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c5d204ac70 0x55c5d204b050 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009eb0 tx=0x7fa30c0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8de7528e641f25cb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:45.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.977+0000 7fa312000640 1 -- 172.21.15.12:0/1039731144 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7fa3040efd50 con 0x7fa314104010 2024-09-05T01:31:45.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.977+0000 7fa318c00640 1 --2- 172.21.15.12:0/1039731144 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fa2f80a2cf0 0x7fa2f80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:45.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.977+0000 7fa309c00640 1 -- 172.21.15.12:0/2050846155 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c003b70 con 0x55c5d204ac70 2024-09-05T01:31:45.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.977+0000 7fa309c00640 1 -- 172.21.15.12:0/2050846155 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa30c015070 con 0x55c5d204ac70 2024-09-05T01:31:45.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.977+0000 7fa309c00640 1 -- 172.21.15.12:0/2050846155 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c01a830 con 0x55c5d204ac70 2024-09-05T01:31:45.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.978+0000 7fa31e061740 1 -- 172.21.15.12:0/2050846155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c5d204ac70 msgr2=0x55c5d204b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:45.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.978+0000 7fa318c00640 1 --2- 172.21.15.12:0/1039731144 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fa2f80a2cf0 0x7fa2f80a51b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa3040bc2d0 tx=0x7fa3040f3800 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:45.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.978+0000 7fa31e061740 1 --2- 172.21.15.12:0/2050846155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c5d204ac70 0x55c5d204b050 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009eb0 tx=0x7fa30c0107a0 comp rx=0 tx=0).stop 2024-09-05T01:31:45.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.978+0000 7fa31e061740 1 -- 172.21.15.12:0/2050846155 shutdown_connections 2024-09-05T01:31:45.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.978+0000 7fa31e061740 1 --2- 172.21.15.12:0/2050846155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5d2055e50 0x55c5d2058240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:45.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.978+0000 7fa31e061740 1 --2- 172.21.15.12:0/2050846155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d204b590 0x55c5d2055910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:45.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.978+0000 7fa31e061740 1 --2- 172.21.15.12:0/2050846155 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c5d204ac70 0x55c5d204b050 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:45.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.978+0000 7fa31e061740 1 -- 172.21.15.12:0/2050846155 >> 172.21.15.12:0/2050846155 conn(0x55c5d2047200 msgr2=0x55c5d20475e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.978+0000 7fa31e061740 1 -- 172.21.15.12:0/2050846155 shutdown_connections 2024-09-05T01:31:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.979+0000 7fa31e061740 1 -- 172.21.15.12:0/2050846155 wait complete. 2024-09-05T01:31:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.979+0000 7fa31e061740 1 -- start start 2024-09-05T01:31:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.979+0000 7fa31e061740 1 Processor -- start 2024-09-05T01:31:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.980+0000 7fa31e061740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5d204ac70 0x55c5d2052d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.980+0000 7fa31e061740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d204b590 0x55c5d20532a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.980+0000 7fa31e061740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c5d2055e50 0x55c5d20537e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.980+0000 7fa31e061740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c5d2058a20 con 0x55c5d204b590 2024-09-05T01:31:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.980+0000 7fa31e061740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c5d1f6c0f0 con 0x55c5d2055e50 2024-09-05T01:31:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.980+0000 7fa31e061740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c5d2058ba0 con 0x55c5d204ac70 2024-09-05T01:31:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.980+0000 7fa31e061740 10 client.0 _ll_register_callbacks cb 0x55c5d1f53bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:31:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.980+0000 7fa30be00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d204b590 0x55c5d20532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.980+0000 7fa30be00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d204b590 0x55c5d20532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44216/0 (socket says 172.21.15.12:44216) 2024-09-05T01:31:45.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.980+0000 7fa30be00640 1 -- 172.21.15.12:0/2502176725 learned_addr learned my addr 172.21.15.12:0/2502176725 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:45.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.980+0000 7fa319600640 1 --2- 172.21.15.12:0/2502176725 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5d204ac70 0x55c5d2052d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:45.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.980+0000 7fa319600640 1 --2- 172.21.15.12:0/2502176725 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c5d2055e50 0x55c5d20537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:45.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.980+0000 7fa30be00640 1 -- 172.21.15.12:0/2502176725 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5d204ac70 msgr2=0x55c5d2052d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:45.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.980+0000 7fa30be00640 1 --2- 172.21.15.12:0/2502176725 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5d204ac70 0x55c5d2052d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:45.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.980+0000 7fa30be00640 1 -- 172.21.15.12:0/2502176725 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c5d2055e50 msgr2=0x55c5d20537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:45.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.980+0000 7fa30be00640 1 --2- 172.21.15.12:0/2502176725 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c5d2055e50 0x55c5d20537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:45.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.980+0000 7fa30be00640 1 -- 172.21.15.12:0/2502176725 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5d1d223c0 con 0x55c5d204b590 2024-09-05T01:31:45.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.980+0000 7fa319600640 1 --2- 172.21.15.12:0/2502176725 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c5d2055e50 0x55c5d20537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:31:45.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.981+0000 7fa30be00640 1 --2- 172.21.15.12:0/2502176725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d204b590 0x55c5d20532a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc00bf00 tx=0x7fa2fc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684794f145ea13df server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:45.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.981+0000 7fa302000640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:31:45.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.981+0000 7fa302000640 1 -- 172.21.15.12:0/2502176725 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc004020 con 0x55c5d204b590 2024-09-05T01:31:45.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.981+0000 7fa302000640 1 -- 172.21.15.12:0/2502176725 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7fa2fc0041c0 con 0x55c5d204b590 2024-09-05T01:31:45.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.981+0000 7fa31e061740 1 -- 172.21.15.12:0/2502176725 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa30c015070 con 0x55c5d204b590 2024-09-05T01:31:45.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.982+0000 7fa302000640 1 -- 172.21.15.12:0/2502176725 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fa2fc0043c0 con 0x55c5d204b590 2024-09-05T01:31:45.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.982+0000 7fa31e061740 10 client.15978 fetch_fsmap learned FSMap version 40 2024-09-05T01:31:45.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.982+0000 7fa31e061740 1 -- 172.21.15.12:0/2502176725 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55c5d2064a90 con 0x55c5d204b590 2024-09-05T01:31:45.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.982+0000 7fa302000640 1 -- 172.21.15.12:0/2502176725 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa30c015070 con 0x55c5d204b590 2024-09-05T01:31:45.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.982+0000 7fa302000640 1 -- 172.21.15.12:0/2502176725 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7fa2fc003a20 con 0x55c5d204b590 2024-09-05T01:31:45.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.982+0000 7fa31e061740 10 client.15978 fetch_fsmap finished waiting for FSMap version 40 2024-09-05T01:31:45.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.982+0000 7fa31e061740 10 client.15978 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T01:31:45.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.982+0000 7fa31e061740 20 client.15978 populate_metadata read hostname 'smithi012' 2024-09-05T01:31:45.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.982+0000 7fa31e061740 1 --2- 172.21.15.12:0/2502176725 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x55c5d2066010 0x55c5d2068450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:45.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.982+0000 7fa31e061740 4 client.15978 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:31:45.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.982+0000 7fa31e061740 1 -- 172.21.15.12:0/2502176725 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5d1fbe950 con 0x55c5d2066010 2024-09-05T01:31:45.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.983+0000 7fa319600640 1 --2- 172.21.15.12:0/2502176725 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x55c5d2066010 0x55c5d2068450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:45.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.983+0000 7fa319600640 1 --2- 172.21.15.12:0/2502176725 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x55c5d2066010 0x55c5d2068450 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b65a653ef7f34973 server_cookie=e063f8e30545d2ec in_seq=0 out_seq=0 2024-09-05T01:31:45.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.983+0000 7fa302000640 10 client.15978 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:31:45.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.984+0000 7fa302000640 1 -- 172.21.15.12:0/2502176725 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c5d1fbe950 con 0x55c5d2066010 2024-09-05T01:31:45.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.984+0000 7fa302000640 10 client.15978 handle_command_reply: tid=0 2024-09-05T01:31:45.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.984+0000 7fa31e061740 1 client.15978 shutdown 2024-09-05T01:31:45.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.984+0000 7fa31e061740 1 -- 172.21.15.12:0/2502176725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d204b590 msgr2=0x55c5d20532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:45.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.984+0000 7fa31e061740 1 --2- 172.21.15.12:0/2502176725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d204b590 0x55c5d20532a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc00bf00 tx=0x7fa2fc011810 comp rx=0 tx=0).stop 2024-09-05T01:31:45.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.985+0000 7fa31e061740 1 -- 172.21.15.12:0/2502176725 shutdown_connections 2024-09-05T01:31:45.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.985+0000 7fa31e061740 1 --2- 172.21.15.12:0/2502176725 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x55c5d2066010 0x55c5d2068450 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:45.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.985+0000 7fa31e061740 1 --2- 172.21.15.12:0/2502176725 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c5d2055e50 0x55c5d20537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:45.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.985+0000 7fa31e061740 1 --2- 172.21.15.12:0/2502176725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d204b590 0x55c5d20532a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:45.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.985+0000 7fa31e061740 1 --2- 172.21.15.12:0/2502176725 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5d204ac70 0x55c5d2052d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:45.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.985+0000 7fa31e061740 1 -- 172.21.15.12:0/2502176725 >> 172.21.15.12:0/2502176725 conn(0x55c5d2047200 msgr2=0x55c5d2046380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:45.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.985+0000 7fa302000640 0 client.15978 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:31:45.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.985+0000 7fa31e061740 1 -- 172.21.15.12:0/2502176725 shutdown_connections 2024-09-05T01:31:45.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.985+0000 7fa31e061740 1 -- 172.21.15.12:0/2502176725 wait complete. 2024-09-05T01:31:45.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:45.985+0000 7fa31e061740 20 client.15978 trim_cache size 0 max 16384 2024-09-05T01:31:46.001 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.000+0000 7fa31e061740 1 Processor -- start 2024-09-05T01:31:46.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.000+0000 7fa31e061740 1 -- start start 2024-09-05T01:31:46.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.000+0000 7fa31e061740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d204ac70 0x55c5d2053630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:46.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.000+0000 7fa31e061740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c5d204b590 0x55c5d206dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:46.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.000+0000 7fa31e061740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5d2055e50 0x55c5d206e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:46.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.000+0000 7fa31e061740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa3141afb80 con 0x55c5d204ac70 2024-09-05T01:31:46.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.000+0000 7fa31e061740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa3141b18a0 con 0x55c5d204b590 2024-09-05T01:31:46.002 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.000+0000 7fa31e061740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa3141b0250 con 0x55c5d2055e50 2024-09-05T01:31:46.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.001+0000 7fa319600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d204ac70 0x55c5d2053630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:46.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.001+0000 7fa319600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d204ac70 0x55c5d2053630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44220/0 (socket says 172.21.15.12:44220) 2024-09-05T01:31:46.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.001+0000 7fa319600640 1 -- 172.21.15.12:0/415110300 learned_addr learned my addr 172.21.15.12:0/415110300 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:46.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.001+0000 7fa30be00640 1 --2- 172.21.15.12:0/415110300 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c5d204b590 0x55c5d206dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:46.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.001+0000 7fa319600640 1 --2- 172.21.15.12:0/415110300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5d2055e50 0x55c5d206e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:46.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.001+0000 7fa319600640 1 -- 172.21.15.12:0/415110300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5d2055e50 msgr2=0x55c5d206e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:46.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.001+0000 7fa319600640 1 --2- 172.21.15.12:0/415110300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5d2055e50 0x55c5d206e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:46.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.001+0000 7fa319600640 1 -- 172.21.15.12:0/415110300 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c5d204b590 msgr2=0x55c5d206dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:46.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.001+0000 7fa319600640 1 --2- 172.21.15.12:0/415110300 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c5d204b590 0x55c5d206dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:46.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.001+0000 7fa319600640 1 -- 172.21.15.12:0/415110300 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5d2042770 con 0x55c5d204ac70 2024-09-05T01:31:46.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.002+0000 7fa319600640 1 --2- 172.21.15.12:0/415110300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d204ac70 0x55c5d2053630 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa30c002230 tx=0x7fa30c000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c59b469f940b2f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:46.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.002+0000 7fa309200640 1 -- 172.21.15.12:0/415110300 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c023040 con 0x55c5d204ac70 2024-09-05T01:31:46.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.002+0000 7fa309200640 1 -- 172.21.15.12:0/415110300 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa30c02e070 con 0x55c5d204ac70 2024-09-05T01:31:46.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.002+0000 7fa309200640 1 -- 172.21.15.12:0/415110300 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c0116a0 con 0x55c5d204ac70 2024-09-05T01:31:46.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.002+0000 7fa31e061740 1 -- 172.21.15.12:0/415110300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d204ac70 msgr2=0x55c5d2053630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:46.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.002+0000 7fa31e061740 1 --2- 172.21.15.12:0/415110300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d204ac70 0x55c5d2053630 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa30c002230 tx=0x7fa30c000f40 comp rx=0 tx=0).stop 2024-09-05T01:31:46.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.003+0000 7fa31e061740 1 -- 172.21.15.12:0/415110300 shutdown_connections 2024-09-05T01:31:46.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.003+0000 7fa31e061740 1 --2- 172.21.15.12:0/415110300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5d2055e50 0x55c5d206e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:46.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.003+0000 7fa31e061740 1 --2- 172.21.15.12:0/415110300 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c5d204b590 0x55c5d206dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:46.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.003+0000 7fa31e061740 1 --2- 172.21.15.12:0/415110300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d204ac70 0x55c5d2053630 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:46.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.003+0000 7fa31e061740 1 -- 172.21.15.12:0/415110300 >> 172.21.15.12:0/415110300 conn(0x55c5d2047200 msgr2=0x55c5d2054de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:46.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.003+0000 7fa31e061740 1 -- 172.21.15.12:0/415110300 shutdown_connections 2024-09-05T01:31:46.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.003+0000 7fa31e061740 1 -- 172.21.15.12:0/415110300 wait complete. 2024-09-05T01:31:46.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.003+0000 7fa31e061740 1 -- start start 2024-09-05T01:31:46.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.003+0000 7fa31e061740 1 Processor -- start 2024-09-05T01:31:46.007 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.004+0000 7fa31e061740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5d204ac70 0x55c5d2059580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:46.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.004+0000 7fa31e061740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c5d204b590 0x55c5d2059ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:46.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.004+0000 7fa31e061740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d2055e50 0x55c5d20c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:46.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.004+0000 7fa31e061740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa3141b1110 con 0x55c5d2055e50 2024-09-05T01:31:46.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.004+0000 7fa31e061740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa3141b09e0 con 0x55c5d204b590 2024-09-05T01:31:46.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.004+0000 7fa31e061740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa3141adb80 con 0x55c5d204ac70 2024-09-05T01:31:46.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.004+0000 7fa31e061740 10 client.0 _ll_register_callbacks cb 0x7fa2fc00bb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:31:46.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.004+0000 7fa319600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d2055e50 0x55c5d20c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:46.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.004+0000 7fa319600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d2055e50 0x55c5d20c8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44236/0 (socket says 172.21.15.12:44236) 2024-09-05T01:31:46.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.004+0000 7fa319600640 1 -- 172.21.15.12:0/2625022983 learned_addr learned my addr 172.21.15.12:0/2625022983 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:46.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.004+0000 7fa319600640 1 --2- 172.21.15.12:0/2625022983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5d204ac70 0x55c5d2059580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:46.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.004+0000 7fa30be00640 1 --2- 172.21.15.12:0/2625022983 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c5d204b590 0x55c5d2059ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:46.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.005+0000 7fa319600640 1 -- 172.21.15.12:0/2625022983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5d204ac70 msgr2=0x55c5d2059580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:46.008 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.005+0000 7fa319600640 1 --2- 172.21.15.12:0/2625022983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5d204ac70 0x55c5d2059580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:46.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.005+0000 7fa319600640 1 -- 172.21.15.12:0/2625022983 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c5d204b590 msgr2=0x55c5d2059ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:46.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.005+0000 7fa319600640 1 --2- 172.21.15.12:0/2625022983 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c5d204b590 0x55c5d2059ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:46.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.005+0000 7fa319600640 1 -- 172.21.15.12:0/2625022983 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5d204dae0 con 0x55c5d2055e50 2024-09-05T01:31:46.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.005+0000 7fa30be00640 1 --2- 172.21.15.12:0/2625022983 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c5d204b590 0x55c5d2059ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:31:46.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.005+0000 7fa319600640 1 --2- 172.21.15.12:0/2625022983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d2055e50 0x55c5d20c8cb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa30c003f50 tx=0x7fa30c02bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13be017defed885 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:46.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.005+0000 7fa302000640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:31:46.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.005+0000 7fa302000640 1 -- 172.21.15.12:0/2625022983 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c004310 con 0x55c5d2055e50 2024-09-05T01:31:46.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.005+0000 7fa302000640 1 -- 172.21.15.12:0/2625022983 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7fa30c0044b0 con 0x55c5d2055e50 2024-09-05T01:31:46.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.005+0000 7fa31e061740 1 -- 172.21.15.12:0/2625022983 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa30c02e070 con 0x55c5d2055e50 2024-09-05T01:31:46.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.005+0000 7fa302000640 1 -- 172.21.15.12:0/2625022983 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fa30c02b460 con 0x55c5d2055e50 2024-09-05T01:31:46.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.005+0000 7fa31e061740 10 client.15984 fetch_fsmap learned FSMap version 40 2024-09-05T01:31:46.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.006+0000 7fa31e061740 1 -- 172.21.15.12:0/2625022983 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55c5d20d04a0 con 0x55c5d2055e50 2024-09-05T01:31:46.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.006+0000 7fa302000640 1 -- 172.21.15.12:0/2625022983 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa30c02e070 con 0x55c5d2055e50 2024-09-05T01:31:46.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.006+0000 7fa302000640 1 -- 172.21.15.12:0/2625022983 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 40) ==== 8434+0+0 (secure 0 0 0) 0x7fa30c029040 con 0x55c5d2055e50 2024-09-05T01:31:46.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.006+0000 7fa31e061740 10 client.15984 fetch_fsmap finished waiting for FSMap version 40 2024-09-05T01:31:46.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.006+0000 7fa31e061740 10 client.15984 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T01:31:46.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.006+0000 7fa31e061740 20 client.15984 populate_metadata read hostname 'smithi012' 2024-09-05T01:31:46.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.006+0000 7fa31e061740 1 --2- 172.21.15.12:0/2625022983 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x55c5d20d0aa0 0x55c5d20d2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:46.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.006+0000 7fa31e061740 4 client.15984 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:31:46.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.006+0000 7fa31e061740 1 -- 172.21.15.12:0/2625022983 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c5d1fb8e60 con 0x55c5d20d0aa0 2024-09-05T01:31:46.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.006+0000 7fa30be00640 1 --2- 172.21.15.12:0/2625022983 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x55c5d20d0aa0 0x55c5d20d2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:46.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.007+0000 7fa30be00640 1 --2- 172.21.15.12:0/2625022983 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x55c5d20d0aa0 0x55c5d20d2ec0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=660d66b15b6df316 server_cookie=a7baabaf81d32878 in_seq=0 out_seq=0 2024-09-05T01:31:46.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.007+0000 7fa302000640 10 client.15984 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:31:46.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.007+0000 7fa302000640 1 -- 172.21.15.12:0/2625022983 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c5d1fb8e60 con 0x55c5d20d0aa0 2024-09-05T01:31:46.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.007+0000 7fa302000640 10 client.15984 handle_command_reply: tid=0 2024-09-05T01:31:46.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.007+0000 7fa31e061740 1 client.15984 shutdown 2024-09-05T01:31:46.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.007+0000 7fa31e061740 1 -- 172.21.15.12:0/2625022983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d2055e50 msgr2=0x55c5d20c8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:46.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.007+0000 7fa31e061740 1 --2- 172.21.15.12:0/2625022983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d2055e50 0x55c5d20c8cb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa30c003f50 tx=0x7fa30c02bb50 comp rx=0 tx=0).stop 2024-09-05T01:31:46.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.008+0000 7fa31e061740 1 -- 172.21.15.12:0/2625022983 shutdown_connections 2024-09-05T01:31:46.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.008+0000 7fa31e061740 1 --2- 172.21.15.12:0/2625022983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c5d2055e50 0x55c5d20c8cb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:46.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.008+0000 7fa31e061740 1 --2- 172.21.15.12:0/2625022983 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x55c5d20d0aa0 0x55c5d20d2ec0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.008+0000 7fa31e061740 1 --2- 172.21.15.12:0/2625022983 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c5d204b590 0x55c5d2059ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.008+0000 7fa31e061740 1 --2- 172.21.15.12:0/2625022983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5d204ac70 0x55c5d2059580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.008+0000 7fa31e061740 1 -- 172.21.15.12:0/2625022983 >> 172.21.15.12:0/2625022983 conn(0x55c5d2047200 msgr2=0x55c5d204c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.008+0000 7fa302000640 0 client.15984 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:31:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.008+0000 7fa31e061740 1 -- 172.21.15.12:0/2625022983 shutdown_connections 2024-09-05T01:31:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.008+0000 7fa31e061740 1 -- 172.21.15.12:0/2625022983 wait complete. 2024-09-05T01:31:46.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.008+0000 7fa31e061740 20 client.15984 trim_cache size 0 max 16384 2024-09-05T01:31:46.013 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:31:46.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.009+0000 7fa31b600640 1 -- 172.21.15.12:0/1039731144 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fa2f80a2cf0 msgr2=0x7fa2f80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:46.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.009+0000 7fa31b600640 1 --2- 172.21.15.12:0/1039731144 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fa2f80a2cf0 0x7fa2f80a51b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa3040bc2d0 tx=0x7fa3040f3800 comp rx=0 tx=0).stop 2024-09-05T01:31:46.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.009+0000 7fa31b600640 1 -- 172.21.15.12:0/1039731144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa314104010 msgr2=0x7fa31419a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:46.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.009+0000 7fa31b600640 1 --2- 172.21.15.12:0/1039731144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa314104010 0x7fa31419a620 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa304006010 tx=0x7fa3040042f0 comp rx=0 tx=0).stop 2024-09-05T01:31:46.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.009+0000 7fa31b600640 1 -- 172.21.15.12:0/1039731144 shutdown_connections 2024-09-05T01:31:46.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.009+0000 7fa31b600640 1 --2- 172.21.15.12:0/1039731144 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fa2f80a2cf0 0x7fa2f80a51b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:46.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.009+0000 7fa31b600640 1 --2- 172.21.15.12:0/1039731144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa314109140 0x7fa31419eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:46.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.009+0000 7fa31b600640 1 --2- 172.21.15.12:0/1039731144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3141049c0 0x7fa31419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:46.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.009+0000 7fa31b600640 1 --2- 172.21.15.12:0/1039731144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa314104010 0x7fa31419a620 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:46.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.009+0000 7fa31b600640 1 -- 172.21.15.12:0/1039731144 >> 172.21.15.12:0/1039731144 conn(0x7fa3140ffa50 msgr2=0x7fa314100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:46.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.009+0000 7fa31b600640 1 -- 172.21.15.12:0/1039731144 shutdown_connections 2024-09-05T01:31:46.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:46.009+0000 7fa31b600640 1 -- 172.21.15.12:0/1039731144 wait complete. 2024-09-05T01:31:46.881 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-05T01:31:47.268 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:31:47.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:47 smithi012 ceph-mon[29942]: pgmap v217: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 987 KiB/s wr, 63 op/s 2024-09-05T01:31:47.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:47 smithi145 ceph-mon[34376]: pgmap v217: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 987 KiB/s wr, 63 op/s 2024-09-05T01:31:47.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:47 smithi151 ceph-mon[35013]: pgmap v217: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 987 KiB/s wr, 63 op/s 2024-09-05T01:31:47.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.813+0000 7fc3bb200640 1 -- 172.21.15.12:0/1516346585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3b4102780 msgr2=0x7fc3b41067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:47.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.813+0000 7fc3bb200640 1 --2- 172.21.15.12:0/1516346585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3b4102780 0x7fc3b41067d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc39c009900 tx=0x7fc39c02a410 comp rx=0 tx=0).stop 2024-09-05T01:31:47.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.813+0000 7fc3bb200640 1 -- 172.21.15.12:0/1516346585 shutdown_connections 2024-09-05T01:31:47.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.813+0000 7fc3bb200640 1 --2- 172.21.15.12:0/1516346585 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3b4106f00 0x7fc3b410ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.813+0000 7fc3bb200640 1 --2- 172.21.15.12:0/1516346585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3b4102780 0x7fc3b41067d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.813+0000 7fc3bb200640 1 --2- 172.21.15.12:0/1516346585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3b4101dd0 0x7fc3b41021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.813+0000 7fc3bb200640 1 -- 172.21.15.12:0/1516346585 >> 172.21.15.12:0/1516346585 conn(0x7fc3b40fd8b0 msgr2=0x7fc3b40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:47.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.813+0000 7fc3bb200640 1 -- 172.21.15.12:0/1516346585 shutdown_connections 2024-09-05T01:31:47.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.813+0000 7fc3bb200640 1 -- 172.21.15.12:0/1516346585 wait complete. 2024-09-05T01:31:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.814+0000 7fc3bb200640 1 Processor -- start 2024-09-05T01:31:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.814+0000 7fc3bb200640 1 -- start start 2024-09-05T01:31:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.815+0000 7fc3bb200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3b4101dd0 0x7fc3b40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.815+0000 7fc3bb200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3b4102780 0x7fc3b4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.815+0000 7fc3bb200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3b4106f00 0x7fc3b4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.815+0000 7fc3bb200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b4111fb0 con 0x7fc3b4102780 2024-09-05T01:31:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.815+0000 7fc3bb200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b4111e30 con 0x7fc3b4101dd0 2024-09-05T01:31:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.815+0000 7fc3bb200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b4112130 con 0x7fc3b4106f00 2024-09-05T01:31:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.815+0000 7fc3ab400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3b4102780 0x7fc3b4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.815+0000 7fc3ab400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3b4102780 0x7fc3b4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33570/0 (socket says 172.21.15.12:33570) 2024-09-05T01:31:47.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.815+0000 7fc3ab400640 1 -- 172.21.15.12:0/2973473301 learned_addr learned my addr 172.21.15.12:0/2973473301 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:47.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.815+0000 7fc3b3e00640 1 --2- 172.21.15.12:0/2973473301 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3b4101dd0 0x7fc3b40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:47.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.815+0000 7fc3b9200640 1 --2- 172.21.15.12:0/2973473301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3b4106f00 0x7fc3b4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:47.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.815+0000 7fc3b3e00640 1 -- 172.21.15.12:0/2973473301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3b4106f00 msgr2=0x7fc3b4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:47.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.815+0000 7fc3b3e00640 1 --2- 172.21.15.12:0/2973473301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3b4106f00 0x7fc3b4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.815+0000 7fc3b3e00640 1 -- 172.21.15.12:0/2973473301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3b4102780 msgr2=0x7fc3b4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:47.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.815+0000 7fc3b3e00640 1 --2- 172.21.15.12:0/2973473301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3b4102780 0x7fc3b4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.815+0000 7fc3b3e00640 1 -- 172.21.15.12:0/2973473301 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b41a6990 con 0x7fc3b4101dd0 2024-09-05T01:31:47.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.816+0000 7fc3b3e00640 1 --2- 172.21.15.12:0/2973473301 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3b4101dd0 0x7fc3b40744f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400e9f0 tx=0x7fc3a400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:47.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.816+0000 7fc3b1600640 1 -- 172.21.15.12:0/2973473301 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a400ccc0 con 0x7fc3b4101dd0 2024-09-05T01:31:47.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.816+0000 7fc3bb200640 1 -- 172.21.15.12:0/2973473301 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b41a6c80 con 0x7fc3b4101dd0 2024-09-05T01:31:47.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.816+0000 7fc3b1600640 1 -- 172.21.15.12:0/2973473301 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3a4005020 con 0x7fc3b4101dd0 2024-09-05T01:31:47.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.816+0000 7fc3b1600640 1 -- 172.21.15.12:0/2973473301 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a401c070 con 0x7fc3b4101dd0 2024-09-05T01:31:47.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.816+0000 7fc3bb200640 1 -- 172.21.15.12:0/2973473301 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b41a71c0 con 0x7fc3b4101dd0 2024-09-05T01:31:47.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.819+0000 7fc3b1600640 1 -- 172.21.15.12:0/2973473301 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fc3a4005540 con 0x7fc3b4101dd0 2024-09-05T01:31:47.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.819+0000 7fc3bde08740 1 Processor -- start 2024-09-05T01:31:47.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.820+0000 7fc3bde08740 1 -- start start 2024-09-05T01:31:47.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.820+0000 7fc3bde08740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0f3c70 0x56422e0f4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:47.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.820+0000 7fc3bde08740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56422e0f4590 0x56422e0fe910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:47.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.820+0000 7fc3bde08740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56422e0fee50 0x56422e101240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:47.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.820+0000 7fc3bde08740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56422e05a3e0 con 0x56422e0f4590 2024-09-05T01:31:47.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.820+0000 7fc3bde08740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56422e001d80 con 0x56422e0f3c70 2024-09-05T01:31:47.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.820+0000 7fc3bde08740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56422e0563a0 con 0x56422e0fee50 2024-09-05T01:31:47.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.820+0000 7fc3b9200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0f3c70 0x56422e0f4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:47.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.820+0000 7fc3b9200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0f3c70 0x56422e0f4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:33662/0 (socket says 172.21.15.12:33662) 2024-09-05T01:31:47.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.820+0000 7fc3b3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56422e0f4590 0x56422e0fe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:47.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.820+0000 7fc3b9200640 1 -- 172.21.15.12:0/1401537884 learned_addr learned my addr 172.21.15.12:0/1401537884 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:47.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.820+0000 7fc3ab400640 1 --2- 172.21.15.12:0/1401537884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56422e0fee50 0x56422e101240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:47.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.821+0000 7fc3b9200640 1 -- 172.21.15.12:0/1401537884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56422e0fee50 msgr2=0x56422e101240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:47.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.821+0000 7fc3b9200640 1 --2- 172.21.15.12:0/1401537884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56422e0fee50 0x56422e101240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.821+0000 7fc3b9200640 1 -- 172.21.15.12:0/1401537884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56422e0f4590 msgr2=0x56422e0fe910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:47.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.821+0000 7fc3b9200640 1 --2- 172.21.15.12:0/1401537884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56422e0f4590 0x56422e0fe910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.821+0000 7fc3b9200640 1 -- 172.21.15.12:0/1401537884 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56422e020ae0 con 0x56422e0f3c70 2024-09-05T01:31:47.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.821+0000 7fc3b3e00640 1 --2- 172.21.15.12:0/1401537884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56422e0f4590 0x56422e0fe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:31:47.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.821+0000 7fc3b9200640 1 --2- 172.21.15.12:0/1401537884 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0f3c70 0x56422e0f4050 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac009f50 tx=0x7fc3ac0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9997b40506fb0189 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:47.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.821+0000 7fc3b1600640 1 --2- 172.21.15.12:0/2973473301 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc3980a2cf0 0x7fc3980a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:47.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.821+0000 7fc3a9600640 1 -- 172.21.15.12:0/1401537884 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac004d20 con 0x56422e0f3c70 2024-09-05T01:31:47.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.821+0000 7fc3a9600640 1 -- 172.21.15.12:0/1401537884 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3ac004050 con 0x56422e0f3c70 2024-09-05T01:31:47.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.821+0000 7fc3a9600640 1 -- 172.21.15.12:0/1401537884 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac005220 con 0x56422e0f3c70 2024-09-05T01:31:47.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.821+0000 7fc3b1600640 1 -- 172.21.15.12:0/2973473301 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7fc3a40cf470 con 0x7fc3b4101dd0 2024-09-05T01:31:47.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.822+0000 7fc3b3e00640 1 --2- 172.21.15.12:0/2973473301 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc3980a2cf0 0x7fc3980a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:47.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.822+0000 7fc3bde08740 1 -- 172.21.15.12:0/1401537884 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0f3c70 msgr2=0x56422e0f4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:47.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.822+0000 7fc3bde08740 1 --2- 172.21.15.12:0/1401537884 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0f3c70 0x56422e0f4050 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac009f50 tx=0x7fc3ac0118d0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.822+0000 7fc3bde08740 1 -- 172.21.15.12:0/1401537884 shutdown_connections 2024-09-05T01:31:47.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.822+0000 7fc3bde08740 1 --2- 172.21.15.12:0/1401537884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56422e0fee50 0x56422e101240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.822+0000 7fc3bde08740 1 --2- 172.21.15.12:0/1401537884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56422e0f4590 0x56422e0fe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.822+0000 7fc3bde08740 1 --2- 172.21.15.12:0/1401537884 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0f3c70 0x56422e0f4050 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.822+0000 7fc3bde08740 1 -- 172.21.15.12:0/1401537884 >> 172.21.15.12:0/1401537884 conn(0x56422e0f0200 msgr2=0x56422e0f05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:47.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.822+0000 7fc3b3e00640 1 --2- 172.21.15.12:0/2973473301 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc3980a2cf0 0x7fc3980a51b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x56422e0f1060 tx=0x7fc3a4009f60 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:47.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.822+0000 7fc3bde08740 1 -- 172.21.15.12:0/1401537884 shutdown_connections 2024-09-05T01:31:47.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.822+0000 7fc3bde08740 1 -- 172.21.15.12:0/1401537884 wait complete. 2024-09-05T01:31:47.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.823+0000 7fc3bde08740 1 -- start start 2024-09-05T01:31:47.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.823+0000 7fc3bde08740 1 Processor -- start 2024-09-05T01:31:47.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.824+0000 7fc3bde08740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0f3c70 0x56422e0fbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:47.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.824+0000 7fc3bde08740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56422e0f4590 0x56422e0fc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:47.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.824+0000 7fc3bde08740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56422e0fee50 0x56422e0fc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:47.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.824+0000 7fc3bde08740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56422e101a20 con 0x56422e0fee50 2024-09-05T01:31:47.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.824+0000 7fc3bde08740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56422e0150f0 con 0x56422e0f3c70 2024-09-05T01:31:47.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.824+0000 7fc3bde08740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56422e101ba0 con 0x56422e0f4590 2024-09-05T01:31:47.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.824+0000 7fc3bde08740 10 client.0 _ll_register_callbacks cb 0x56422dffcbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:31:47.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.824+0000 7fc3b9200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0f3c70 0x56422e0fbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:47.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.824+0000 7fc3b9200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0f3c70 0x56422e0fbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:33674/0 (socket says 172.21.15.12:33674) 2024-09-05T01:31:47.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.824+0000 7fc3b9200640 1 -- 172.21.15.12:0/207675758 learned_addr learned my addr 172.21.15.12:0/207675758 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:47.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.824+0000 7fc3b9200640 1 --2- 172.21.15.12:0/207675758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56422e0fee50 0x56422e0fc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:47.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.824+0000 7fc3ab400640 1 --2- 172.21.15.12:0/207675758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56422e0f4590 0x56422e0fc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:47.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.825+0000 7fc3b9200640 1 -- 172.21.15.12:0/207675758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56422e0f4590 msgr2=0x56422e0fc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:47.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.825+0000 7fc3b9200640 1 --2- 172.21.15.12:0/207675758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56422e0f4590 0x56422e0fc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.825+0000 7fc3b9200640 1 -- 172.21.15.12:0/207675758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56422e0fee50 msgr2=0x56422e0fc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:47.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.825+0000 7fc3b9200640 1 --2- 172.21.15.12:0/207675758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56422e0fee50 0x56422e0fc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.825+0000 7fc3b9200640 1 -- 172.21.15.12:0/207675758 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56422ddcb3c0 con 0x56422e0f3c70 2024-09-05T01:31:47.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.825+0000 7fc3b9200640 1 --2- 172.21.15.12:0/207675758 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0f3c70 0x56422e0fbc90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac009250 tx=0x7fc3ac0047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f50076420ea9c286 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:47.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.825+0000 7fc3a2000640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:31:47.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.825+0000 7fc3a2000640 1 -- 172.21.15.12:0/207675758 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac02b070 con 0x56422e0f3c70 2024-09-05T01:31:47.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.825+0000 7fc3bde08740 1 -- 172.21.15.12:0/207675758 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3ac004050 con 0x56422e0f3c70 2024-09-05T01:31:47.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.825+0000 7fc3a2000640 1 -- 172.21.15.12:0/207675758 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7fc3ac027640 con 0x56422e0f3c70 2024-09-05T01:31:47.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.826+0000 7fc3a2000640 1 -- 172.21.15.12:0/207675758 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fc3ac037050 con 0x56422e0f3c70 2024-09-05T01:31:47.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.826+0000 7fc3bde08740 10 client.26054 fetch_fsmap learned FSMap version 41 2024-09-05T01:31:47.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.826+0000 7fc3bde08740 1 -- 172.21.15.12:0/207675758 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x56422e10d9e0 con 0x56422e0f3c70 2024-09-05T01:31:47.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.826+0000 7fc3a2000640 1 -- 172.21.15.12:0/207675758 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3ac004050 con 0x56422e0f3c70 2024-09-05T01:31:47.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.826+0000 7fc3a2000640 1 -- 172.21.15.12:0/207675758 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 41) ==== 8430+0+0 (secure 0 0 0) 0x7fc3ac00f8d0 con 0x56422e0f3c70 2024-09-05T01:31:47.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.826+0000 7fc3bde08740 10 client.26054 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T01:31:47.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.826+0000 7fc3bde08740 10 client.26054 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T01:31:47.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.826+0000 7fc3bde08740 20 client.26054 populate_metadata read hostname 'smithi012' 2024-09-05T01:31:47.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.826+0000 7fc3bde08740 1 --2- 172.21.15.12:0/207675758 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x56422e10edf0 0x56422e1111e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:47.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.826+0000 7fc3bde08740 4 client.26054 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:31:47.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.826+0000 7fc3bde08740 1 -- 172.21.15.12:0/207675758 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56422e067950 con 0x56422e10edf0 2024-09-05T01:31:47.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.827+0000 7fc3ab400640 1 --2- 172.21.15.12:0/207675758 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x56422e10edf0 0x56422e1111e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:47.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.827+0000 7fc3ab400640 1 --2- 172.21.15.12:0/207675758 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x56422e10edf0 0x56422e1111e0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=59f153cdfda60667 server_cookie=9f15d13b26625c6d in_seq=0 out_seq=0 2024-09-05T01:31:47.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.827+0000 7fc3a2000640 10 client.26054 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:31:47.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.828+0000 7fc3a2000640 1 -- 172.21.15.12:0/207675758 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56422e067950 con 0x56422e10edf0 2024-09-05T01:31:47.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.828+0000 7fc3a2000640 10 client.26054 handle_command_reply: tid=0 2024-09-05T01:31:47.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.828+0000 7fc3bde08740 1 client.26054 shutdown 2024-09-05T01:31:47.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.828+0000 7fc3bde08740 1 -- 172.21.15.12:0/207675758 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0f3c70 msgr2=0x56422e0fbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:47.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.828+0000 7fc3bde08740 1 --2- 172.21.15.12:0/207675758 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0f3c70 0x56422e0fbc90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac009250 tx=0x7fc3ac0047b0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.828+0000 7fc3bde08740 1 -- 172.21.15.12:0/207675758 shutdown_connections 2024-09-05T01:31:47.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.828+0000 7fc3bde08740 1 --2- 172.21.15.12:0/207675758 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x56422e10edf0 0x56422e1111e0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.828+0000 7fc3bde08740 1 --2- 172.21.15.12:0/207675758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56422e0fee50 0x56422e0fc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.828+0000 7fc3bde08740 1 --2- 172.21.15.12:0/207675758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56422e0f4590 0x56422e0fc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.828+0000 7fc3bde08740 1 --2- 172.21.15.12:0/207675758 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0f3c70 0x56422e0fbc90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.828+0000 7fc3bde08740 1 -- 172.21.15.12:0/207675758 >> 172.21.15.12:0/207675758 conn(0x56422e0f0200 msgr2=0x56422e0ef380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:47.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.828+0000 7fc3a2000640 0 client.26054 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:31:47.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.828+0000 7fc3bde08740 1 -- 172.21.15.12:0/207675758 shutdown_connections 2024-09-05T01:31:47.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.828+0000 7fc3bde08740 1 -- 172.21.15.12:0/207675758 wait complete. 2024-09-05T01:31:47.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.828+0000 7fc3bde08740 20 client.26054 trim_cache size 0 max 16384 2024-09-05T01:31:47.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.842+0000 7fc3bde08740 1 Processor -- start 2024-09-05T01:31:47.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.843+0000 7fc3bde08740 1 -- start start 2024-09-05T01:31:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.843+0000 7fc3bde08740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0f3c70 0x56422e116900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.843+0000 7fc3bde08740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56422e0f4590 0x56422e116e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.843+0000 7fc3bde08740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56422e0fee50 0x56422e0eeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.843+0000 7fc3bde08740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b41afc70 con 0x56422e0f4590 2024-09-05T01:31:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.843+0000 7fc3bde08740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b41b1960 con 0x56422e0f3c70 2024-09-05T01:31:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.843+0000 7fc3bde08740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b41b0340 con 0x56422e0fee50 2024-09-05T01:31:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.843+0000 7fc3ab400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56422e0f4590 0x56422e116e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.843+0000 7fc3b9200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0f3c70 0x56422e116900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.843+0000 7fc3b9200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0f3c70 0x56422e116900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:33680/0 (socket says 172.21.15.12:33680) 2024-09-05T01:31:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.843+0000 7fc3ab400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56422e0f4590 0x56422e116e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33600/0 (socket says 172.21.15.12:33600) 2024-09-05T01:31:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.843+0000 7fc3b9200640 1 -- 172.21.15.12:0/718056187 learned_addr learned my addr 172.21.15.12:0/718056187 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:47.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.843+0000 7fc3b9200640 1 --2- 172.21.15.12:0/718056187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56422e0fee50 0x56422e0eeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:47.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.844+0000 7fc3ab400640 1 -- 172.21.15.12:0/718056187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56422e0fee50 msgr2=0x56422e0eeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:47.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.844+0000 7fc3ab400640 1 --2- 172.21.15.12:0/718056187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56422e0fee50 0x56422e0eeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.844+0000 7fc3ab400640 1 -- 172.21.15.12:0/718056187 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0f3c70 msgr2=0x56422e116900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:47.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.844+0000 7fc3ab400640 1 --2- 172.21.15.12:0/718056187 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0f3c70 0x56422e116900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.844+0000 7fc3ab400640 1 -- 172.21.15.12:0/718056187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56422e0f0030 con 0x56422e0f4590 2024-09-05T01:31:47.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.844+0000 7fc3b9200640 1 --2- 172.21.15.12:0/718056187 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0f3c70 0x56422e116900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:31:47.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.844+0000 7fc3ab400640 1 --2- 172.21.15.12:0/718056187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56422e0f4590 0x56422e116e40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc39c000c00 tx=0x7fc39c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f828d74ca201462 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.844+0000 7fc3a8c00640 1 -- 172.21.15.12:0/718056187 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c049020 con 0x56422e0f4590 2024-09-05T01:31:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.844+0000 7fc3a8c00640 1 -- 172.21.15.12:0/718056187 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc39c0044a0 con 0x56422e0f4590 2024-09-05T01:31:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.844+0000 7fc3a8c00640 1 -- 172.21.15.12:0/718056187 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c035040 con 0x56422e0f4590 2024-09-05T01:31:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.845+0000 7fc3bde08740 1 -- 172.21.15.12:0/718056187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56422e0f4590 msgr2=0x56422e116e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.845+0000 7fc3bde08740 1 --2- 172.21.15.12:0/718056187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56422e0f4590 0x56422e116e40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc39c000c00 tx=0x7fc39c0046c0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.845+0000 7fc3bde08740 1 -- 172.21.15.12:0/718056187 shutdown_connections 2024-09-05T01:31:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.845+0000 7fc3bde08740 1 --2- 172.21.15.12:0/718056187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56422e0fee50 0x56422e0eeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.845+0000 7fc3bde08740 1 --2- 172.21.15.12:0/718056187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56422e0f4590 0x56422e116e40 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.845+0000 7fc3bde08740 1 --2- 172.21.15.12:0/718056187 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0f3c70 0x56422e116900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.845+0000 7fc3bde08740 1 -- 172.21.15.12:0/718056187 >> 172.21.15.12:0/718056187 conn(0x56422e0f0200 msgr2=0x56422e0fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.845+0000 7fc3bde08740 1 -- 172.21.15.12:0/718056187 shutdown_connections 2024-09-05T01:31:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.845+0000 7fc3bde08740 1 -- 172.21.15.12:0/718056187 wait complete. 2024-09-05T01:31:47.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.846+0000 7fc3bde08740 1 -- start start 2024-09-05T01:31:47.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.846+0000 7fc3bde08740 1 Processor -- start 2024-09-05T01:31:47.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.846+0000 7fc3bde08740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56422e0f3c70 0x56422e107210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:47.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.846+0000 7fc3bde08740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56422e0f4590 0x56422e107750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:47.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.846+0000 7fc3bde08740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0fee50 0x56422e102790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:47.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.846+0000 7fc3bde08740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b41b11d0 con 0x56422e0f4590 2024-09-05T01:31:47.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.846+0000 7fc3bde08740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b41b0ad0 con 0x56422e0fee50 2024-09-05T01:31:47.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.846+0000 7fc3bde08740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b41adc70 con 0x56422e0f3c70 2024-09-05T01:31:47.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.846+0000 7fc3bde08740 10 client.0 _ll_register_callbacks cb 0x7fc3ac009e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:31:47.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.847+0000 7fc3b9200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56422e0f3c70 0x56422e107210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:47.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.847+0000 7fc3b9200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56422e0f3c70 0x56422e107210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:42048/0 (socket says 172.21.15.12:42048) 2024-09-05T01:31:47.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.847+0000 7fc3b9200640 1 -- 172.21.15.12:0/4243897576 learned_addr learned my addr 172.21.15.12:0/4243897576 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:47.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.847+0000 7fc3ab400640 1 --2- 172.21.15.12:0/4243897576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56422e0f4590 0x56422e107750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:47.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.847+0000 7fc3b9200640 1 --2- 172.21.15.12:0/4243897576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0fee50 0x56422e102790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:47.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.847+0000 7fc3b9200640 1 -- 172.21.15.12:0/4243897576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0fee50 msgr2=0x56422e102790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:47.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.847+0000 7fc3b9200640 1 --2- 172.21.15.12:0/4243897576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0fee50 0x56422e102790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.847+0000 7fc3b9200640 1 -- 172.21.15.12:0/4243897576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56422e0f4590 msgr2=0x56422e107750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:47.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.847+0000 7fc3b9200640 1 --2- 172.21.15.12:0/4243897576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56422e0f4590 0x56422e107750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.847+0000 7fc3b9200640 1 -- 172.21.15.12:0/4243897576 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56422e102fc0 con 0x56422e0f3c70 2024-09-05T01:31:47.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.847+0000 7fc3ab400640 1 --2- 172.21.15.12:0/4243897576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56422e0f4590 0x56422e107750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:31:47.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.847+0000 7fc3b9200640 1 --2- 172.21.15.12:0/4243897576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56422e0f3c70 0x56422e107210 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac004a70 tx=0x7fc3ac004700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=671d32ac3f605bbb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:47.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.847+0000 7fc3a2000640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:31:47.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.847+0000 7fc3a2000640 1 -- 172.21.15.12:0/4243897576 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac02b040 con 0x56422e0f3c70 2024-09-05T01:31:47.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.848+0000 7fc3bde08740 1 -- 172.21.15.12:0/4243897576 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc39c0044a0 con 0x56422e0f3c70 2024-09-05T01:31:47.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.848+0000 7fc3a2000640 1 -- 172.21.15.12:0/4243897576 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7fc3ac00f680 con 0x56422e0f3c70 2024-09-05T01:31:47.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.848+0000 7fc3a2000640 1 -- 172.21.15.12:0/4243897576 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fc3ac00f880 con 0x56422e0f3c70 2024-09-05T01:31:47.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.848+0000 7fc3bde08740 10 client.26053 fetch_fsmap learned FSMap version 41 2024-09-05T01:31:47.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.848+0000 7fc3bde08740 1 -- 172.21.15.12:0/4243897576 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x56422e179580 con 0x56422e0f3c70 2024-09-05T01:31:47.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.848+0000 7fc3a2000640 1 -- 172.21.15.12:0/4243897576 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc39c0044a0 con 0x56422e0f3c70 2024-09-05T01:31:47.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.848+0000 7fc3a2000640 1 -- 172.21.15.12:0/4243897576 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) ==== 8430+0+0 (secure 0 0 0) 0x7fc3ac044070 con 0x56422e0f3c70 2024-09-05T01:31:47.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.848+0000 7fc3bde08740 10 client.26053 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T01:31:47.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.848+0000 7fc3bde08740 10 client.26053 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T01:31:47.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.848+0000 7fc3bde08740 20 client.26053 populate_metadata read hostname 'smithi012' 2024-09-05T01:31:47.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.848+0000 7fc3bde08740 1 --2- 172.21.15.12:0/4243897576 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x56422e179b30 0x56422e17bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:47.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.848+0000 7fc3bde08740 4 client.26053 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:31:47.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.848+0000 7fc3bde08740 1 -- 172.21.15.12:0/4243897576 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56422e061e60 con 0x56422e179b30 2024-09-05T01:31:47.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.849+0000 7fc3ab400640 1 --2- 172.21.15.12:0/4243897576 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x56422e179b30 0x56422e17bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:47.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.849+0000 7fc3ab400640 1 --2- 172.21.15.12:0/4243897576 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x56422e179b30 0x56422e17bf20 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=389af65d28ddcce4 server_cookie=ae525756068100dc in_seq=0 out_seq=0 2024-09-05T01:31:47.854 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.849+0000 7fc3a2000640 10 client.26053 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:31:47.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.849+0000 7fc3a2000640 1 -- 172.21.15.12:0/4243897576 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56422e061e60 con 0x56422e179b30 2024-09-05T01:31:47.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.849+0000 7fc3a2000640 10 client.26053 handle_command_reply: tid=0 2024-09-05T01:31:47.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.849+0000 7fc3bde08740 1 client.26053 shutdown 2024-09-05T01:31:47.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.850+0000 7fc3bde08740 1 -- 172.21.15.12:0/4243897576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56422e0f3c70 msgr2=0x56422e107210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:47.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.850+0000 7fc3bde08740 1 --2- 172.21.15.12:0/4243897576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56422e0f3c70 0x56422e107210 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac004a70 tx=0x7fc3ac004700 comp rx=0 tx=0).stop 2024-09-05T01:31:47.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.850+0000 7fc3bde08740 1 -- 172.21.15.12:0/4243897576 shutdown_connections 2024-09-05T01:31:47.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.850+0000 7fc3bde08740 1 --2- 172.21.15.12:0/4243897576 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56422e0fee50 0x56422e102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.850+0000 7fc3bde08740 1 --2- 172.21.15.12:0/4243897576 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x56422e179b30 0x56422e17bf20 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.850+0000 7fc3bde08740 1 --2- 172.21.15.12:0/4243897576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56422e0f4590 0x56422e107750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.850+0000 7fc3bde08740 1 --2- 172.21.15.12:0/4243897576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56422e0f3c70 0x56422e107210 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.850+0000 7fc3bde08740 1 -- 172.21.15.12:0/4243897576 >> 172.21.15.12:0/4243897576 conn(0x56422e0f0200 msgr2=0x56422e0eeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:47.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.850+0000 7fc3a2000640 0 client.26053 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:31:47.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.850+0000 7fc3bde08740 1 -- 172.21.15.12:0/4243897576 shutdown_connections 2024-09-05T01:31:47.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.850+0000 7fc3bde08740 1 -- 172.21.15.12:0/4243897576 wait complete. 2024-09-05T01:31:47.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.850+0000 7fc3bde08740 20 client.26053 trim_cache size 0 max 16384 2024-09-05T01:31:47.856 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:31:47.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.851+0000 7fc3bb200640 1 -- 172.21.15.12:0/2973473301 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc3980a2cf0 msgr2=0x7fc3980a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:47.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.851+0000 7fc3bb200640 1 --2- 172.21.15.12:0/2973473301 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc3980a2cf0 0x7fc3980a51b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x56422e0f1060 tx=0x7fc3a4009f60 comp rx=0 tx=0).stop 2024-09-05T01:31:47.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.851+0000 7fc3bb200640 1 -- 172.21.15.12:0/2973473301 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3b4101dd0 msgr2=0x7fc3b40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:47.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.851+0000 7fc3bb200640 1 --2- 172.21.15.12:0/2973473301 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3b4101dd0 0x7fc3b40744f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400e9f0 tx=0x7fc3a400eeb0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.851+0000 7fc3bb200640 1 -- 172.21.15.12:0/2973473301 shutdown_connections 2024-09-05T01:31:47.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.851+0000 7fc3bb200640 1 --2- 172.21.15.12:0/2973473301 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc3980a2cf0 0x7fc3980a51b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.851+0000 7fc3bb200640 1 --2- 172.21.15.12:0/2973473301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3b4106f00 0x7fc3b4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.851+0000 7fc3bb200640 1 --2- 172.21.15.12:0/2973473301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3b4102780 0x7fc3b4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.851+0000 7fc3bb200640 1 --2- 172.21.15.12:0/2973473301 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc3b4101dd0 0x7fc3b40744f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:47.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.851+0000 7fc3bb200640 1 -- 172.21.15.12:0/2973473301 >> 172.21.15.12:0/2973473301 conn(0x7fc3b40fd8b0 msgr2=0x7fc3b40fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:47.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.851+0000 7fc3bb200640 1 -- 172.21.15.12:0/2973473301 shutdown_connections 2024-09-05T01:31:47.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:47.851+0000 7fc3bb200640 1 -- 172.21.15.12:0/2973473301 wait complete. 2024-09-05T01:31:48.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:48 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:31:48.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:48 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:31:48.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:48 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:31:48.647 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-05T01:31:49.029 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:31:49.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:49 smithi145 ceph-mon[34376]: pgmap v218: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 856 KiB/s wr, 57 op/s 2024-09-05T01:31:49.336 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:49 smithi012 ceph-mon[29942]: pgmap v218: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 856 KiB/s wr, 57 op/s 2024-09-05T01:31:49.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:49 smithi151 ceph-mon[35013]: pgmap v218: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 856 KiB/s wr, 57 op/s 2024-09-05T01:31:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.576+0000 7f281f600640 1 -- 172.21.15.12:0/347232568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2818109120 msgr2=0x7f2818110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.576+0000 7f281f600640 1 --2- 172.21.15.12:0/347232568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2818109120 0x7f2818110ca0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2810009ca0 tx=0x7f281002a8c0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.576+0000 7f281f600640 1 -- 172.21.15.12:0/347232568 shutdown_connections 2024-09-05T01:31:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.576+0000 7f281f600640 1 --2- 172.21.15.12:0/347232568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2818109120 0x7f2818110ca0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.576+0000 7f281f600640 1 --2- 172.21.15.12:0/347232568 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f28181049a0 0x7f28181089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.576+0000 7f281f600640 1 --2- 172.21.15.12:0/347232568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2818103ff0 0x7f28181043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.576+0000 7f281f600640 1 -- 172.21.15.12:0/347232568 >> 172.21.15.12:0/347232568 conn(0x7f28180ffa90 msgr2=0x7f2818101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:49.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.576+0000 7f281f600640 1 -- 172.21.15.12:0/347232568 shutdown_connections 2024-09-05T01:31:49.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.576+0000 7f281f600640 1 -- 172.21.15.12:0/347232568 wait complete. 2024-09-05T01:31:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.577+0000 7f281f600640 1 Processor -- start 2024-09-05T01:31:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.577+0000 7f281f600640 1 -- start start 2024-09-05T01:31:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.578+0000 7f281f600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2818103ff0 0x7f281819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.578+0000 7f281f600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28181049a0 0x7f281819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.578+0000 7f281f600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2818109120 0x7f281819ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.578+0000 7f281f600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f28181141a0 con 0x7f2818109120 2024-09-05T01:31:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.578+0000 7f281f600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2818114020 con 0x7f2818103ff0 2024-09-05T01:31:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.578+0000 7f281f600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2818114320 con 0x7f28181049a0 2024-09-05T01:31:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.578+0000 7f281d600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2818109120 0x7f281819ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.578+0000 7f281d600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2818109120 0x7f281819ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33642/0 (socket says 172.21.15.12:33642) 2024-09-05T01:31:49.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.578+0000 7f281cc00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2818103ff0 0x7f281819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.578+0000 7f281d600640 1 -- 172.21.15.12:0/1991487697 learned_addr learned my addr 172.21.15.12:0/1991487697 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.578+0000 7f280fe00640 1 --2- 172.21.15.12:0/1991487697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28181049a0 0x7f281819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.578+0000 7f281d600640 1 -- 172.21.15.12:0/1991487697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28181049a0 msgr2=0x7f281819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.579+0000 7f281d600640 1 --2- 172.21.15.12:0/1991487697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28181049a0 0x7f281819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.579+0000 7f281d600640 1 -- 172.21.15.12:0/1991487697 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2818103ff0 msgr2=0x7f281819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.579+0000 7f281d600640 1 --2- 172.21.15.12:0/1991487697 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2818103ff0 0x7f281819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.579+0000 7f281d600640 1 -- 172.21.15.12:0/1991487697 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f281819f570 con 0x7f2818109120 2024-09-05T01:31:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.579+0000 7f281d600640 1 --2- 172.21.15.12:0/1991487697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2818109120 0x7f281819ee90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2810033040 tx=0x7f2810003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.579+0000 7f2816000640 1 -- 172.21.15.12:0/1991487697 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2810031650 con 0x7f2818109120 2024-09-05T01:31:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.579+0000 7f2816000640 1 -- 172.21.15.12:0/1991487697 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28100317f0 con 0x7f2818109120 2024-09-05T01:31:49.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.579+0000 7f2816000640 1 -- 172.21.15.12:0/1991487697 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281002fa40 con 0x7f2818109120 2024-09-05T01:31:49.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.579+0000 7f281f600640 1 -- 172.21.15.12:0/1991487697 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f281819f800 con 0x7f2818109120 2024-09-05T01:31:49.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.579+0000 7f281f600640 1 -- 172.21.15.12:0/1991487697 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28181a7140 con 0x7f2818109120 2024-09-05T01:31:49.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.582+0000 7f2816000640 1 -- 172.21.15.12:0/1991487697 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f281002fc80 con 0x7f2818109120 2024-09-05T01:31:49.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.582+0000 7f28221dc740 1 Processor -- start 2024-09-05T01:31:49.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.583+0000 7f28221dc740 1 -- start start 2024-09-05T01:31:49.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.583+0000 7f28221dc740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e16f0cc70 0x555e16f0d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:49.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.583+0000 7f28221dc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f0d590 0x555e16f17910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:49.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.583+0000 7f28221dc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e16f17e50 0x555e16f1a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:49.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.583+0000 7f28221dc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555e16e733e0 con 0x555e16f0d590 2024-09-05T01:31:49.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.583+0000 7f28221dc740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555e16e1ad80 con 0x555e16f0cc70 2024-09-05T01:31:49.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.583+0000 7f28221dc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555e16e6f3a0 con 0x555e16f17e50 2024-09-05T01:31:49.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.583+0000 7f281cc00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f0d590 0x555e16f17910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:49.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.583+0000 7f280fe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e16f0cc70 0x555e16f0d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:49.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.583+0000 7f281cc00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f0d590 0x555e16f17910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33646/0 (socket says 172.21.15.12:33646) 2024-09-05T01:31:49.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.583+0000 7f281cc00640 1 -- 172.21.15.12:0/2055609283 learned_addr learned my addr 172.21.15.12:0/2055609283 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:49.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.584+0000 7f280fe00640 1 --2- 172.21.15.12:0/2055609283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e16f17e50 0x555e16f1a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:49.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.584+0000 7f2816000640 1 --2- 172.21.15.12:0/1991487697 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f27fc0a2d70 0x7f27fc0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:49.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.584+0000 7f281cc00640 1 -- 172.21.15.12:0/2055609283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e16f17e50 msgr2=0x555e16f1a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:49.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.584+0000 7f281cc00640 1 --2- 172.21.15.12:0/2055609283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e16f17e50 0x555e16f1a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.584+0000 7f281cc00640 1 -- 172.21.15.12:0/2055609283 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e16f0cc70 msgr2=0x555e16f0d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:49.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.584+0000 7f281cc00640 1 --2- 172.21.15.12:0/2055609283 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e16f0cc70 0x555e16f0d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.584+0000 7f281cc00640 1 -- 172.21.15.12:0/2055609283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e16e39ae0 con 0x555e16f0d590 2024-09-05T01:31:49.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.584+0000 7f2816000640 1 -- 172.21.15.12:0/1991487697 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7f28100f07d0 con 0x7f2818109120 2024-09-05T01:31:49.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.584+0000 7f281d600640 1 --2- 172.21.15.12:0/1991487697 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f27fc0a2d70 0x7f27fc0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:49.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.584+0000 7f281cc00640 1 --2- 172.21.15.12:0/2055609283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f0d590 0x555e16f17910 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2808009d20 tx=0x7f2808011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c533d91089138b0a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:49.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.585+0000 7f280dc00640 1 -- 172.21.15.12:0/2055609283 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280801e070 con 0x555e16f0d590 2024-09-05T01:31:49.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.585+0000 7f280dc00640 1 -- 172.21.15.12:0/2055609283 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2808019b10 con 0x555e16f0d590 2024-09-05T01:31:49.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.585+0000 7f280dc00640 1 -- 172.21.15.12:0/2055609283 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280800eb40 con 0x555e16f0d590 2024-09-05T01:31:49.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.585+0000 7f28221dc740 1 -- 172.21.15.12:0/2055609283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f0d590 msgr2=0x555e16f17910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:49.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.585+0000 7f281d600640 1 --2- 172.21.15.12:0/1991487697 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f27fc0a2d70 0x7f27fc0a5230 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2810006010 tx=0x7f281002ff70 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:49.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.585+0000 7f28221dc740 1 --2- 172.21.15.12:0/2055609283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f0d590 0x555e16f17910 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2808009d20 tx=0x7f2808011810 comp rx=0 tx=0).stop 2024-09-05T01:31:49.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.586+0000 7f28221dc740 1 -- 172.21.15.12:0/2055609283 shutdown_connections 2024-09-05T01:31:49.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.586+0000 7f28221dc740 1 --2- 172.21.15.12:0/2055609283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e16f17e50 0x555e16f1a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.586+0000 7f28221dc740 1 --2- 172.21.15.12:0/2055609283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f0d590 0x555e16f17910 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.586+0000 7f28221dc740 1 --2- 172.21.15.12:0/2055609283 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e16f0cc70 0x555e16f0d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.586+0000 7f28221dc740 1 -- 172.21.15.12:0/2055609283 >> 172.21.15.12:0/2055609283 conn(0x555e16f09200 msgr2=0x555e16f095e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:49.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.586+0000 7f28221dc740 1 -- 172.21.15.12:0/2055609283 shutdown_connections 2024-09-05T01:31:49.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.586+0000 7f28221dc740 1 -- 172.21.15.12:0/2055609283 wait complete. 2024-09-05T01:31:49.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.587+0000 7f28221dc740 1 -- start start 2024-09-05T01:31:49.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.587+0000 7f28221dc740 1 Processor -- start 2024-09-05T01:31:49.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.587+0000 7f28221dc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f0cc70 0x555e16f14dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:49.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.587+0000 7f28221dc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e16f0d590 0x555e16f15300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:49.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.587+0000 7f28221dc740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e16f17e50 0x555e16f15840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:49.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.587+0000 7f28221dc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555e16f1aa20 con 0x555e16f0cc70 2024-09-05T01:31:49.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.587+0000 7f28221dc740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555e16e2e0f0 con 0x555e16f17e50 2024-09-05T01:31:49.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.587+0000 7f28221dc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555e16f1aba0 con 0x555e16f0d590 2024-09-05T01:31:49.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.588+0000 7f28221dc740 10 client.0 _ll_register_callbacks cb 0x555e16e15bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:31:49.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.588+0000 7f280fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f0cc70 0x555e16f14dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:49.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.588+0000 7f281cc00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e16f0d590 0x555e16f15300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:49.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.588+0000 7f281cc00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e16f0d590 0x555e16f15300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:42062/0 (socket says 172.21.15.12:42062) 2024-09-05T01:31:49.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.588+0000 7f281cc00640 1 -- 172.21.15.12:0/1528108071 learned_addr learned my addr 172.21.15.12:0/1528108071 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:49.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.588+0000 7f281cc00640 1 -- 172.21.15.12:0/1528108071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e16f17e50 msgr2=0x555e16f15840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:49.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.588+0000 7f280fe00640 1 --2- 172.21.15.12:0/1528108071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e16f17e50 0x555e16f15840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:49.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.588+0000 7f281cc00640 1 --2- 172.21.15.12:0/1528108071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e16f17e50 0x555e16f15840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.588+0000 7f281cc00640 1 -- 172.21.15.12:0/1528108071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f0cc70 msgr2=0x555e16f14dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:49.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.588+0000 7f281cc00640 1 --2- 172.21.15.12:0/1528108071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f0cc70 0x555e16f14dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.588+0000 7f281cc00640 1 -- 172.21.15.12:0/1528108071 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e16be43c0 con 0x555e16f0d590 2024-09-05T01:31:49.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.588+0000 7f280fe00640 1 --2- 172.21.15.12:0/1528108071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e16f17e50 0x555e16f15840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:31:49.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.589+0000 7f281cc00640 1 --2- 172.21.15.12:0/1528108071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e16f0d590 0x555e16f15300 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2808011d10 tx=0x7f2808019660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=930ccec30f83efbf server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:49.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.589+0000 7f2806000640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:31:49.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.589+0000 7f2806000640 1 -- 172.21.15.12:0/1528108071 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280801e070 con 0x555e16f0d590 2024-09-05T01:31:49.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.589+0000 7f28221dc740 1 -- 172.21.15.12:0/1528108071 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2808019b10 con 0x555e16f0d590 2024-09-05T01:31:49.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.589+0000 7f2806000640 1 -- 172.21.15.12:0/1528108071 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7f280800ea80 con 0x555e16f0d590 2024-09-05T01:31:49.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.589+0000 7f2806000640 1 -- 172.21.15.12:0/1528108071 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f2808031050 con 0x555e16f0d590 2024-09-05T01:31:49.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.589+0000 7f28221dc740 10 client.26065 fetch_fsmap learned FSMap version 41 2024-09-05T01:31:49.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.589+0000 7f28221dc740 1 -- 172.21.15.12:0/1528108071 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x555e16f26ae0 con 0x555e16f0d590 2024-09-05T01:31:49.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.590+0000 7f2806000640 1 -- 172.21.15.12:0/1528108071 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2808019b10 con 0x555e16f0d590 2024-09-05T01:31:49.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.590+0000 7f2806000640 1 -- 172.21.15.12:0/1528108071 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) ==== 8430+0+0 (secure 0 0 0) 0x7f28080046c0 con 0x555e16f0d590 2024-09-05T01:31:49.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.590+0000 7f28221dc740 10 client.26065 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T01:31:49.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.590+0000 7f28221dc740 10 client.26065 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:31:49.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.590+0000 7f28221dc740 20 client.26065 populate_metadata read hostname 'smithi012' 2024-09-05T01:31:49.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.590+0000 7f28221dc740 1 --2- 172.21.15.12:0/1528108071 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x555e16f27ef0 0x555e16f2a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:49.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.590+0000 7f28221dc740 4 client.26065 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:31:49.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.590+0000 7f28221dc740 1 -- 172.21.15.12:0/1528108071 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e16e80950 con 0x555e16f27ef0 2024-09-05T01:31:49.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.590+0000 7f280fe00640 1 --2- 172.21.15.12:0/1528108071 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x555e16f27ef0 0x555e16f2a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:49.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.591+0000 7f280fe00640 1 --2- 172.21.15.12:0/1528108071 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x555e16f27ef0 0x555e16f2a2e0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb28b98a70ba4eb4 server_cookie=7e49124ee57f819e in_seq=0 out_seq=0 2024-09-05T01:31:49.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.591+0000 7f2806000640 10 client.26065 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:31:49.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.592+0000 7f2806000640 1 -- 172.21.15.12:0/1528108071 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555e16e80950 con 0x555e16f27ef0 2024-09-05T01:31:49.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.592+0000 7f2806000640 10 client.26065 handle_command_reply: tid=0 2024-09-05T01:31:49.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.592+0000 7f28221dc740 1 client.26065 shutdown 2024-09-05T01:31:49.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.592+0000 7f28221dc740 1 -- 172.21.15.12:0/1528108071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e16f0d590 msgr2=0x555e16f15300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:49.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.592+0000 7f28221dc740 1 --2- 172.21.15.12:0/1528108071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e16f0d590 0x555e16f15300 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2808011d10 tx=0x7f2808019660 comp rx=0 tx=0).stop 2024-09-05T01:31:49.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.592+0000 7f28221dc740 1 -- 172.21.15.12:0/1528108071 shutdown_connections 2024-09-05T01:31:49.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.592+0000 7f28221dc740 1 --2- 172.21.15.12:0/1528108071 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x555e16f27ef0 0x555e16f2a2e0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.592+0000 7f28221dc740 1 --2- 172.21.15.12:0/1528108071 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e16f17e50 0x555e16f15840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.592+0000 7f28221dc740 1 --2- 172.21.15.12:0/1528108071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e16f0d590 0x555e16f15300 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.592+0000 7f2806000640 0 client.26065 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:31:49.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.592+0000 7f28221dc740 1 --2- 172.21.15.12:0/1528108071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f0cc70 0x555e16f14dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.592+0000 7f28221dc740 1 -- 172.21.15.12:0/1528108071 >> 172.21.15.12:0/1528108071 conn(0x555e16f09200 msgr2=0x555e16f0ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:49.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.592+0000 7f28221dc740 1 -- 172.21.15.12:0/1528108071 shutdown_connections 2024-09-05T01:31:49.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.593+0000 7f28221dc740 1 -- 172.21.15.12:0/1528108071 wait complete. 2024-09-05T01:31:49.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.593+0000 7f28221dc740 20 client.26065 trim_cache size 0 max 16384 2024-09-05T01:31:49.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.606+0000 7f28221dc740 1 Processor -- start 2024-09-05T01:31:49.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.606+0000 7f28221dc740 1 -- start start 2024-09-05T01:31:49.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.607+0000 7f28221dc740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e16f0cc70 0x555e16f0f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:49.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.607+0000 7f28221dc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e16f0d590 0x555e16f16d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:49.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.607+0000 7f28221dc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f17e50 0x555e16f2faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:49.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.607+0000 7f28221dc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f28181afb50 con 0x555e16f17e50 2024-09-05T01:31:49.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.607+0000 7f28221dc740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f28181b1840 con 0x555e16f0cc70 2024-09-05T01:31:49.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.607+0000 7f28221dc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f28181b0220 con 0x555e16f0d590 2024-09-05T01:31:49.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.607+0000 7f280fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f17e50 0x555e16f2faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:49.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.607+0000 7f280fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f17e50 0x555e16f2faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33654/0 (socket says 172.21.15.12:33654) 2024-09-05T01:31:49.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.607+0000 7f280fe00640 1 -- 172.21.15.12:0/3824093902 learned_addr learned my addr 172.21.15.12:0/3824093902 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:49.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.607+0000 7f281cc00640 1 --2- 172.21.15.12:0/3824093902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e16f0d590 0x555e16f16d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:49.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.607+0000 7f280fe00640 1 --2- 172.21.15.12:0/3824093902 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e16f0cc70 0x555e16f0f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:49.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.608+0000 7f280fe00640 1 -- 172.21.15.12:0/3824093902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e16f0d590 msgr2=0x555e16f16d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:49.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.608+0000 7f280fe00640 1 --2- 172.21.15.12:0/3824093902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e16f0d590 0x555e16f16d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.608+0000 7f280fe00640 1 -- 172.21.15.12:0/3824093902 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e16f0cc70 msgr2=0x555e16f0f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:49.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.608+0000 7f280fe00640 1 --2- 172.21.15.12:0/3824093902 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e16f0cc70 0x555e16f0f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.608+0000 7f280fe00640 1 -- 172.21.15.12:0/3824093902 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e16f04770 con 0x555e16f17e50 2024-09-05T01:31:49.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.608+0000 7f281cc00640 1 --2- 172.21.15.12:0/3824093902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e16f0d590 0x555e16f16d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:31:49.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.608+0000 7f280fe00640 1 --2- 172.21.15.12:0/3824093902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f17e50 0x555e16f2faf0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2800012630 tx=0x7f280000b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9bcf46c01f14c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:49.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.608+0000 7f280d200640 1 -- 172.21.15.12:0/3824093902 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2800004020 con 0x555e16f17e50 2024-09-05T01:31:49.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.608+0000 7f280d200640 1 -- 172.21.15.12:0/3824093902 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28000041c0 con 0x555e16f17e50 2024-09-05T01:31:49.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.608+0000 7f280d200640 1 -- 172.21.15.12:0/3824093902 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28000054f0 con 0x555e16f17e50 2024-09-05T01:31:49.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.609+0000 7f28221dc740 1 -- 172.21.15.12:0/3824093902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f17e50 msgr2=0x555e16f2faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:49.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.609+0000 7f28221dc740 1 --2- 172.21.15.12:0/3824093902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f17e50 0x555e16f2faf0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2800012630 tx=0x7f280000b650 comp rx=0 tx=0).stop 2024-09-05T01:31:49.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.609+0000 7f28221dc740 1 -- 172.21.15.12:0/3824093902 shutdown_connections 2024-09-05T01:31:49.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.609+0000 7f28221dc740 1 --2- 172.21.15.12:0/3824093902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f17e50 0x555e16f2faf0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.609+0000 7f28221dc740 1 --2- 172.21.15.12:0/3824093902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e16f0d590 0x555e16f16d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.609+0000 7f28221dc740 1 --2- 172.21.15.12:0/3824093902 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e16f0cc70 0x555e16f0f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.609+0000 7f28221dc740 1 -- 172.21.15.12:0/3824093902 >> 172.21.15.12:0/3824093902 conn(0x555e16f09200 msgr2=0x555e16f16620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:49.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.609+0000 7f28221dc740 1 -- 172.21.15.12:0/3824093902 shutdown_connections 2024-09-05T01:31:49.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.609+0000 7f28221dc740 1 -- 172.21.15.12:0/3824093902 wait complete. 2024-09-05T01:31:49.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.610+0000 7f28221dc740 1 -- start start 2024-09-05T01:31:49.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.610+0000 7f28221dc740 1 Processor -- start 2024-09-05T01:31:49.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.610+0000 7f28221dc740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e16f0cc70 0x555e16f1b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:49.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.610+0000 7f28221dc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f0d590 0x555e16f1b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:49.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.610+0000 7f28221dc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e16f17e50 0x555e16f90ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:49.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.610+0000 7f28221dc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f28181b10b0 con 0x555e16f0d590 2024-09-05T01:31:49.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.610+0000 7f28221dc740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f28181b09b0 con 0x555e16f0cc70 2024-09-05T01:31:49.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.610+0000 7f28221dc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f28181adb50 con 0x555e16f17e50 2024-09-05T01:31:49.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.610+0000 7f28221dc740 10 client.0 _ll_register_callbacks cb 0x7f280801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:31:49.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.611+0000 7f281cc00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f0d590 0x555e16f1b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:49.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.611+0000 7f281cc00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f0d590 0x555e16f1b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33658/0 (socket says 172.21.15.12:33658) 2024-09-05T01:31:49.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.611+0000 7f281cc00640 1 -- 172.21.15.12:0/375725610 learned_addr learned my addr 172.21.15.12:0/375725610 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:49.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.611+0000 7f280fe00640 1 --2- 172.21.15.12:0/375725610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e16f0cc70 0x555e16f1b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:49.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.611+0000 7f280fe00640 1 --2- 172.21.15.12:0/375725610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e16f17e50 0x555e16f90ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:49.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.611+0000 7f281cc00640 1 -- 172.21.15.12:0/375725610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e16f17e50 msgr2=0x555e16f90ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:49.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.611+0000 7f281cc00640 1 --2- 172.21.15.12:0/375725610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e16f17e50 0x555e16f90ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.611+0000 7f281cc00640 1 -- 172.21.15.12:0/375725610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e16f0cc70 msgr2=0x555e16f1b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:49.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.611+0000 7f281cc00640 1 --2- 172.21.15.12:0/375725610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e16f0cc70 0x555e16f1b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.611+0000 7f281cc00640 1 -- 172.21.15.12:0/375725610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e16f910f0 con 0x555e16f0d590 2024-09-05T01:31:49.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.611+0000 7f280fe00640 1 --2- 172.21.15.12:0/375725610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e16f17e50 0x555e16f90ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:31:49.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.611+0000 7f281cc00640 1 --2- 172.21.15.12:0/375725610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f0d590 0x555e16f1b850 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2808004bb0 tx=0x7f280800e5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa00af8a9e316ab server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:49.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.611+0000 7f2806000640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:31:49.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.612+0000 7f2806000640 1 -- 172.21.15.12:0/375725610 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280803a060 con 0x555e16f0d590 2024-09-05T01:31:49.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.612+0000 7f2806000640 1 -- 172.21.15.12:0/375725610 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7f280800e7f0 con 0x555e16f0d590 2024-09-05T01:31:49.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.612+0000 7f28221dc740 1 -- 172.21.15.12:0/375725610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28000041c0 con 0x555e16f0d590 2024-09-05T01:31:49.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.612+0000 7f2806000640 1 -- 172.21.15.12:0/375725610 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f280801e040 con 0x555e16f0d590 2024-09-05T01:31:49.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.612+0000 7f28221dc740 10 client.16020 fetch_fsmap learned FSMap version 41 2024-09-05T01:31:49.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.612+0000 7f28221dc740 1 -- 172.21.15.12:0/375725610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x555e16f92390 con 0x555e16f0d590 2024-09-05T01:31:49.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.612+0000 7f2806000640 1 -- 172.21.15.12:0/375725610 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28000041c0 con 0x555e16f0d590 2024-09-05T01:31:49.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.613+0000 7f2806000640 1 -- 172.21.15.12:0/375725610 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 41) ==== 8430+0+0 (secure 0 0 0) 0x7f2808003680 con 0x555e16f0d590 2024-09-05T01:31:49.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.613+0000 7f28221dc740 10 client.16020 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T01:31:49.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.613+0000 7f28221dc740 10 client.16020 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:31:49.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.613+0000 7f28221dc740 20 client.16020 populate_metadata read hostname 'smithi012' 2024-09-05T01:31:49.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.613+0000 7f28221dc740 1 --2- 172.21.15.12:0/375725610 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x555e16f92b50 0x555e16f94f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:49.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.613+0000 7f28221dc740 4 client.16020 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:31:49.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.613+0000 7f28221dc740 1 -- 172.21.15.12:0/375725610 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555e16e7ae60 con 0x555e16f92b50 2024-09-05T01:31:49.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.613+0000 7f280fe00640 1 --2- 172.21.15.12:0/375725610 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x555e16f92b50 0x555e16f94f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:49.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.614+0000 7f280fe00640 1 --2- 172.21.15.12:0/375725610 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x555e16f92b50 0x555e16f94f70 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f95bb527823965d5 server_cookie=ebedcdcc6310e6c1 in_seq=0 out_seq=0 2024-09-05T01:31:49.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.614+0000 7f2806000640 10 client.16020 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:31:49.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.614+0000 7f2806000640 1 -- 172.21.15.12:0/375725610 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555e16e7ae60 con 0x555e16f92b50 2024-09-05T01:31:49.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.614+0000 7f2806000640 10 client.16020 handle_command_reply: tid=0 2024-09-05T01:31:49.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.614+0000 7f28221dc740 1 client.16020 shutdown 2024-09-05T01:31:49.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.614+0000 7f28221dc740 1 -- 172.21.15.12:0/375725610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f0d590 msgr2=0x555e16f1b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:49.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.614+0000 7f28221dc740 1 --2- 172.21.15.12:0/375725610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f0d590 0x555e16f1b850 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2808004bb0 tx=0x7f280800e5e0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.614+0000 7f28221dc740 1 -- 172.21.15.12:0/375725610 shutdown_connections 2024-09-05T01:31:49.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.614+0000 7f28221dc740 1 --2- 172.21.15.12:0/375725610 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x555e16f92b50 0x555e16f94f70 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.614+0000 7f28221dc740 1 --2- 172.21.15.12:0/375725610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e16f17e50 0x555e16f90ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.614+0000 7f28221dc740 1 --2- 172.21.15.12:0/375725610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e16f0d590 0x555e16f1b850 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.614+0000 7f28221dc740 1 --2- 172.21.15.12:0/375725610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555e16f0cc70 0x555e16f1b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.614+0000 7f28221dc740 1 -- 172.21.15.12:0/375725610 >> 172.21.15.12:0/375725610 conn(0x555e16f09200 msgr2=0x555e16f16620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:49.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.614+0000 7f2806000640 0 client.16020 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:31:49.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.614+0000 7f28221dc740 1 -- 172.21.15.12:0/375725610 shutdown_connections 2024-09-05T01:31:49.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.614+0000 7f28221dc740 1 -- 172.21.15.12:0/375725610 wait complete. 2024-09-05T01:31:49.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.614+0000 7f28221dc740 20 client.16020 trim_cache size 0 max 16384 2024-09-05T01:31:49.622 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:31:49.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.615+0000 7f281f600640 1 -- 172.21.15.12:0/1991487697 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f27fc0a2d70 msgr2=0x7f27fc0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:49.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.615+0000 7f281f600640 1 --2- 172.21.15.12:0/1991487697 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f27fc0a2d70 0x7f27fc0a5230 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2810006010 tx=0x7f281002ff70 comp rx=0 tx=0).stop 2024-09-05T01:31:49.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.615+0000 7f281f600640 1 -- 172.21.15.12:0/1991487697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2818109120 msgr2=0x7f281819ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:49.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.615+0000 7f281f600640 1 --2- 172.21.15.12:0/1991487697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2818109120 0x7f281819ee90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2810033040 tx=0x7f2810003f10 comp rx=0 tx=0).stop 2024-09-05T01:31:49.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.615+0000 7f281f600640 1 -- 172.21.15.12:0/1991487697 shutdown_connections 2024-09-05T01:31:49.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.615+0000 7f281f600640 1 --2- 172.21.15.12:0/1991487697 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f27fc0a2d70 0x7f27fc0a5230 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.615+0000 7f281f600640 1 --2- 172.21.15.12:0/1991487697 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2818109120 0x7f281819ee90 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.615+0000 7f281f600640 1 --2- 172.21.15.12:0/1991487697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28181049a0 0x7f281819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.615+0000 7f281f600640 1 --2- 172.21.15.12:0/1991487697 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2818103ff0 0x7f281819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:49.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.615+0000 7f281f600640 1 -- 172.21.15.12:0/1991487697 >> 172.21.15.12:0/1991487697 conn(0x7f28180ffa90 msgr2=0x7f28181005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:49.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.615+0000 7f281f600640 1 -- 172.21.15.12:0/1991487697 shutdown_connections 2024-09-05T01:31:49.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:49.616+0000 7f281f600640 1 -- 172.21.15.12:0/1991487697 wait complete. 2024-09-05T01:31:51.321 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-05T01:31:51.321 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-05T01:31:51.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:51 smithi151 ceph-mon[35013]: pgmap v219: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 683 KiB/s wr, 47 op/s 2024-09-05T01:31:51.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:51 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:31:51.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:51 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:31:51.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:51 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:31:51.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:51 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:31:51.371 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:51 smithi012 ceph-mon[29942]: pgmap v219: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 683 KiB/s wr, 47 op/s 2024-09-05T01:31:51.371 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:51 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:31:51.371 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:51 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:31:51.371 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:51 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:31:51.371 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:51 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:31:51.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:51 smithi145 ceph-mon[34376]: pgmap v219: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 683 KiB/s wr, 47 op/s 2024-09-05T01:31:51.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:51 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:31:51.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:51 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:31:51.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:51 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:31:51.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:51 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:31:51.699 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:31:52.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.373+0000 7f14f6e00640 1 -- 172.21.15.12:0/451453271 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f0105f20 msgr2=0x7f14f01063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:52.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.373+0000 7f14f6e00640 1 --2- 172.21.15.12:0/451453271 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f0105f20 0x7f14f01063b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f14e8009be0 tx=0x7f14e802a780 comp rx=0 tx=0).stop 2024-09-05T01:31:52.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.373+0000 7f14f6e00640 1 -- 172.21.15.12:0/451453271 shutdown_connections 2024-09-05T01:31:52.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.373+0000 7f14f6e00640 1 --2- 172.21.15.12:0/451453271 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f0105f20 0x7f14f01063b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.373+0000 7f14f6e00640 1 --2- 172.21.15.12:0/451453271 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14f0101430 0x7f14f0105900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.373+0000 7f14f6e00640 1 --2- 172.21.15.12:0/451453271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14f0100b10 0x7f14f0100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.373+0000 7f14f6e00640 1 -- 172.21.15.12:0/451453271 >> 172.21.15.12:0/451453271 conn(0x7f14f00fc780 msgr2=0x7f14f00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:52.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.374+0000 7f14f6e00640 1 -- 172.21.15.12:0/451453271 shutdown_connections 2024-09-05T01:31:52.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.374+0000 7f14f6e00640 1 -- 172.21.15.12:0/451453271 wait complete. 2024-09-05T01:31:52.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.376+0000 7f14f6e00640 1 Processor -- start 2024-09-05T01:31:52.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.376+0000 7f14f6e00640 1 -- start start 2024-09-05T01:31:52.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.378+0000 7f14f6e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14f0100b10 0x7f14f0114ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:52.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.378+0000 7f14f6e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f0101430 0x7f14f01151e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:52.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.379+0000 7f14ef400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f0101430 0x7f14f01151e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:52.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.379+0000 7f14ef400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f0101430 0x7f14f01151e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:42094/0 (socket says 172.21.15.12:42094) 2024-09-05T01:31:52.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.379+0000 7f14ef400640 1 -- 172.21.15.12:0/1099361390 learned_addr learned my addr 172.21.15.12:0/1099361390 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:52.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.379+0000 7f14f6e00640 1 --2- 172.21.15.12:0/1099361390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14f0105f20 0x7f14f010def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:52.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.380+0000 7f14f6e00640 1 -- 172.21.15.12:0/1099361390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f14f0118540 con 0x7f14f0100b10 2024-09-05T01:31:52.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.380+0000 7f14efe00640 1 --2- 172.21.15.12:0/1099361390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14f0100b10 0x7f14f0114ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:52.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.380+0000 7f14f6e00640 1 -- 172.21.15.12:0/1099361390 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f14f01183c0 con 0x7f14f0105f20 2024-09-05T01:31:52.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.380+0000 7f14f6e00640 1 -- 172.21.15.12:0/1099361390 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f14f01186c0 con 0x7f14f0101430 2024-09-05T01:31:52.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.381+0000 7f14f4e00640 1 --2- 172.21.15.12:0/1099361390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14f0105f20 0x7f14f010def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:52.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.382+0000 7f14ef400640 1 -- 172.21.15.12:0/1099361390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14f0105f20 msgr2=0x7f14f010def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:52.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.382+0000 7f14ef400640 1 --2- 172.21.15.12:0/1099361390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14f0105f20 0x7f14f010def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.382+0000 7f14ef400640 1 -- 172.21.15.12:0/1099361390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14f0100b10 msgr2=0x7f14f0114ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:52.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.382+0000 7f14ef400640 1 --2- 172.21.15.12:0/1099361390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14f0100b10 0x7f14f0114ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.382+0000 7f14ef400640 1 -- 172.21.15.12:0/1099361390 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f010e7b0 con 0x7f14f0101430 2024-09-05T01:31:52.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.382+0000 7f14f4e00640 1 --2- 172.21.15.12:0/1099361390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14f0105f20 0x7f14f010def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:31:52.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.383+0000 7f14efe00640 1 --2- 172.21.15.12:0/1099361390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14f0100b10 0x7f14f0114ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:31:52.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.383+0000 7f14ef400640 1 --2- 172.21.15.12:0/1099361390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f0101430 0x7f14f01151e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f14e000e790 tx=0x7f14e000ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:52.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.385+0000 7f14ecc00640 1 -- 172.21.15.12:0/1099361390 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e000eea0 con 0x7f14f0101430 2024-09-05T01:31:52.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.386+0000 7f14ecc00640 1 -- 172.21.15.12:0/1099361390 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14e0005500 con 0x7f14f0101430 2024-09-05T01:31:52.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.386+0000 7f14f6e00640 1 -- 172.21.15.12:0/1099361390 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f010eaa0 con 0x7f14f0101430 2024-09-05T01:31:52.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.386+0000 7f14f6e00640 1 -- 172.21.15.12:0/1099361390 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f0112ab0 con 0x7f14f0101430 2024-09-05T01:31:52.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.387+0000 7f14ecc00640 1 -- 172.21.15.12:0/1099361390 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e0010430 con 0x7f14f0101430 2024-09-05T01:31:52.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.407+0000 7f14ecc00640 1 -- 172.21.15.12:0/1099361390 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f14e00046c0 con 0x7f14f0101430 2024-09-05T01:31:52.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.408+0000 7f14f9887740 1 Processor -- start 2024-09-05T01:31:52.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.409+0000 7f14f9887740 1 -- start start 2024-09-05T01:31:52.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.409+0000 7f14f9887740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b66f40ac0 0x558b66f40ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:52.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.409+0000 7f14f9887740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f413e0 0x558b66f4b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:52.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.409+0000 7f14f9887740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b66f4bca0 0x558b66f4e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:52.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.409+0000 7f14f9887740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558b66ea7290 con 0x558b66f4bca0 2024-09-05T01:31:52.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.409+0000 7f14f9887740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x558b66e4eb40 con 0x558b66f40ac0 2024-09-05T01:31:52.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.409+0000 7f14f9887740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558b66ea3250 con 0x558b66f413e0 2024-09-05T01:31:52.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.411+0000 7f14ef400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b66f4bca0 0x558b66f4e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:52.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.411+0000 7f14ef400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b66f4bca0 0x558b66f4e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33688/0 (socket says 172.21.15.12:33688) 2024-09-05T01:31:52.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.411+0000 7f14ef400640 1 -- 172.21.15.12:0/1194000267 learned_addr learned my addr 172.21.15.12:0/1194000267 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:52.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.411+0000 7f14ecc00640 1 --2- 172.21.15.12:0/1099361390 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f14d40a2e80 0x7f14d40a5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:52.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.413+0000 7f14f4e00640 1 --2- 172.21.15.12:0/1194000267 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b66f40ac0 0x558b66f40ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:52.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.413+0000 7f14efe00640 1 --2- 172.21.15.12:0/1194000267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f413e0 0x558b66f4b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:52.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.414+0000 7f14ecc00640 1 -- 172.21.15.12:0/1099361390 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7f14e00cf590 con 0x7f14f0101430 2024-09-05T01:31:52.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.414+0000 7f14ef400640 1 -- 172.21.15.12:0/1194000267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f413e0 msgr2=0x558b66f4b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:52.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.414+0000 7f14ef400640 1 --2- 172.21.15.12:0/1194000267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f413e0 0x558b66f4b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.415+0000 7f14ef400640 1 -- 172.21.15.12:0/1194000267 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b66f40ac0 msgr2=0x558b66f40ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:52.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.415+0000 7f14ef400640 1 --2- 172.21.15.12:0/1194000267 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b66f40ac0 0x558b66f40ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.415+0000 7f14ef400640 1 -- 172.21.15.12:0/1194000267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b66c186a0 con 0x558b66f4bca0 2024-09-05T01:31:52.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.416+0000 7f14efe00640 1 --2- 172.21.15.12:0/1194000267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f413e0 0x558b66f4b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:31:52.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.417+0000 7f14f4e00640 1 --2- 172.21.15.12:0/1194000267 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b66f40ac0 0x558b66f40ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:31:52.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.417+0000 7f14f4e00640 1 --2- 172.21.15.12:0/1099361390 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f14d40a2e80 0x7f14d40a5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:52.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.418+0000 7f14ef400640 1 --2- 172.21.15.12:0/1194000267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b66f4bca0 0x558b66f4e090 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f14e0004a40 tx=0x7f14e009b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c50045c615d5967 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:52.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.419+0000 7f14f4e00640 1 --2- 172.21.15.12:0/1099361390 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f14d40a2e80 0x7f14d40a5340 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f14e8034040 tx=0x7f14e802a780 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:52.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.423+0000 7f14e5600640 1 -- 172.21.15.12:0/1194000267 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e009ba70 con 0x558b66f4bca0 2024-09-05T01:31:52.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.424+0000 7f14e5600640 1 -- 172.21.15.12:0/1194000267 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14e009fe20 con 0x558b66f4bca0 2024-09-05T01:31:52.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.424+0000 7f14e5600640 1 -- 172.21.15.12:0/1194000267 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e00980e0 con 0x558b66f4bca0 2024-09-05T01:31:52.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.427+0000 7f14f9887740 1 -- 172.21.15.12:0/1194000267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b66f4bca0 msgr2=0x558b66f4e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:52.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.427+0000 7f14f9887740 1 --2- 172.21.15.12:0/1194000267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b66f4bca0 0x558b66f4e090 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f14e0004a40 tx=0x7f14e009b5b0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.427+0000 7f14f9887740 1 -- 172.21.15.12:0/1194000267 shutdown_connections 2024-09-05T01:31:52.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.427+0000 7f14f9887740 1 --2- 172.21.15.12:0/1194000267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b66f4bca0 0x558b66f4e090 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.428+0000 7f14f9887740 1 --2- 172.21.15.12:0/1194000267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f413e0 0x558b66f4b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.428+0000 7f14f9887740 1 --2- 172.21.15.12:0/1194000267 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b66f40ac0 0x558b66f40ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.429+0000 7f14f9887740 1 -- 172.21.15.12:0/1194000267 >> 172.21.15.12:0/1194000267 conn(0x558b66f3d050 msgr2=0x558b66f3d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:52.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.429+0000 7f14f9887740 1 -- 172.21.15.12:0/1194000267 shutdown_connections 2024-09-05T01:31:52.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.429+0000 7f14f9887740 1 -- 172.21.15.12:0/1194000267 wait complete. 2024-09-05T01:31:52.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.430+0000 7f14f9887740 1 -- start start 2024-09-05T01:31:52.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.430+0000 7f14f9887740 1 Processor -- start 2024-09-05T01:31:52.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.431+0000 7f14f9887740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b66f40ac0 0x558b66f4b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:52.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.431+0000 7f14f9887740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f413e0 0x558b66f48860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:52.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.431+0000 7f14f9887740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b66f4bca0 0x558b66f48da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:52.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.431+0000 7f14f9887740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558b66f5f920 con 0x558b66f4bca0 2024-09-05T01:31:52.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.431+0000 7f14f9887740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x558b66e61fa0 con 0x558b66f40ac0 2024-09-05T01:31:52.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.431+0000 7f14f9887740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558b66f5faa0 con 0x558b66f413e0 2024-09-05T01:31:52.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.431+0000 7f14f9887740 10 client.0 _ll_register_callbacks cb 0x558b66bb5ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:31:52.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.431+0000 7f14efe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b66f40ac0 0x558b66f4b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:52.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.431+0000 7f14efe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b66f40ac0 0x558b66f4b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:33800/0 (socket says 172.21.15.12:33800) 2024-09-05T01:31:52.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.431+0000 7f14efe00640 1 -- 172.21.15.12:0/1341364482 learned_addr learned my addr 172.21.15.12:0/1341364482 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:52.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.432+0000 7f14ef400640 1 --2- 172.21.15.12:0/1341364482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f413e0 0x558b66f48860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:52.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.432+0000 7f14efe00640 1 -- 172.21.15.12:0/1341364482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f413e0 msgr2=0x558b66f48860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:52.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.432+0000 7f14efe00640 1 --2- 172.21.15.12:0/1341364482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f413e0 0x558b66f48860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.432+0000 7f14efe00640 1 -- 172.21.15.12:0/1341364482 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b66f4bca0 msgr2=0x558b66f48da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:52.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.432+0000 7f14efe00640 1 --2- 172.21.15.12:0/1341364482 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b66f4bca0 0x558b66f48da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.432+0000 7f14efe00640 1 -- 172.21.15.12:0/1341364482 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b66f495d0 con 0x558b66f40ac0 2024-09-05T01:31:52.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.432+0000 7f14ef400640 1 --2- 172.21.15.12:0/1341364482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f413e0 0x558b66f48860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:31:52.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.433+0000 7f14da000640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:31:52.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.433+0000 7f14efe00640 1 --2- 172.21.15.12:0/1341364482 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b66f40ac0 0x558b66f4b510 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0106a0 tx=0x7f14dc010b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a54154de3352d8df server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:52.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.433+0000 7f14da000640 1 -- 172.21.15.12:0/1341364482 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc00ead0 con 0x558b66f40ac0 2024-09-05T01:31:52.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.433+0000 7f14f9887740 1 -- 172.21.15.12:0/1341364482 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14e009fe20 con 0x558b66f40ac0 2024-09-05T01:31:52.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.433+0000 7f14da000640 1 -- 172.21.15.12:0/1341364482 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7f14dc00ec70 con 0x558b66f40ac0 2024-09-05T01:31:52.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.434+0000 7f14da000640 1 -- 172.21.15.12:0/1341364482 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f14dc00ee70 con 0x558b66f40ac0 2024-09-05T01:31:52.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.434+0000 7f14f9887740 10 client.26081 fetch_fsmap learned FSMap version 41 2024-09-05T01:31:52.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.434+0000 7f14f9887740 1 -- 172.21.15.12:0/1341364482 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x558b66f6b810 con 0x558b66f40ac0 2024-09-05T01:31:52.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.434+0000 7f14da000640 1 -- 172.21.15.12:0/1341364482 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14e009fe20 con 0x558b66f40ac0 2024-09-05T01:31:52.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.434+0000 7f14da000640 1 -- 172.21.15.12:0/1341364482 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 41) ==== 8430+0+0 (secure 0 0 0) 0x7f14dc00f040 con 0x558b66f40ac0 2024-09-05T01:31:52.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.435+0000 7f14f9887740 10 client.26081 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T01:31:52.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.435+0000 7f14f9887740 10 client.26081 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:31:52.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.435+0000 7f14f9887740 20 client.26081 populate_metadata read hostname 'smithi012' 2024-09-05T01:31:52.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.435+0000 7f14f9887740 1 --2- 172.21.15.12:0/1341364482 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558b66f6cd60 0x558b66f6f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:52.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.435+0000 7f14f9887740 4 client.26081 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:31:52.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.435+0000 7f14f9887740 1 -- 172.21.15.12:0/1341364482 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b66eb4800 con 0x558b66f6cd60 2024-09-05T01:31:52.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.435+0000 7f14ef400640 1 --2- 172.21.15.12:0/1341364482 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558b66f6cd60 0x558b66f6f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:52.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.436+0000 7f14ef400640 1 --2- 172.21.15.12:0/1341364482 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558b66f6cd60 0x558b66f6f220 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff2b94580f8602f6 server_cookie=163f75f3e7b44d01 in_seq=0 out_seq=0 2024-09-05T01:31:52.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.436+0000 7f14da000640 10 client.26081 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:31:52.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.436+0000 7f14da000640 1 -- 172.21.15.12:0/1341364482 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558b66eb4800 con 0x558b66f6cd60 2024-09-05T01:31:52.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.436+0000 7f14da000640 10 client.26081 handle_command_reply: tid=0 2024-09-05T01:31:52.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.437+0000 7f14f9887740 1 client.26081 shutdown 2024-09-05T01:31:52.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.437+0000 7f14f9887740 1 -- 172.21.15.12:0/1341364482 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b66f40ac0 msgr2=0x558b66f4b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:52.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.437+0000 7f14f9887740 1 --2- 172.21.15.12:0/1341364482 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b66f40ac0 0x558b66f4b510 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0106a0 tx=0x7f14dc010b60 comp rx=0 tx=0).stop 2024-09-05T01:31:52.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.438+0000 7f14f9887740 1 -- 172.21.15.12:0/1341364482 shutdown_connections 2024-09-05T01:31:52.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.438+0000 7f14f9887740 1 --2- 172.21.15.12:0/1341364482 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558b66f6cd60 0x558b66f6f220 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.438+0000 7f14f9887740 1 --2- 172.21.15.12:0/1341364482 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b66f4bca0 0x558b66f48da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.438+0000 7f14f9887740 1 --2- 172.21.15.12:0/1341364482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f413e0 0x558b66f48860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.438+0000 7f14f9887740 1 --2- 172.21.15.12:0/1341364482 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b66f40ac0 0x558b66f4b510 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.438+0000 7f14f9887740 1 -- 172.21.15.12:0/1341364482 >> 172.21.15.12:0/1341364482 conn(0x558b66f3d050 msgr2=0x558b66f3c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:52.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.438+0000 7f14da000640 0 client.26081 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:31:52.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.439+0000 7f14f9887740 1 -- 172.21.15.12:0/1341364482 shutdown_connections 2024-09-05T01:31:52.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.439+0000 7f14f9887740 1 -- 172.21.15.12:0/1341364482 wait complete. 2024-09-05T01:31:52.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.439+0000 7f14f9887740 20 client.26081 trim_cache size 0 max 16384 2024-09-05T01:31:52.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.483+0000 7f14f9887740 1 Processor -- start 2024-09-05T01:31:52.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.484+0000 7f14f9887740 1 -- start start 2024-09-05T01:31:52.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.484+0000 7f14f9887740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f40ac0 0x558b66f4a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:52.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.484+0000 7f14f9887740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b66f413e0 0x558b66f74b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:52.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.484+0000 7f14f9887740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b66f4bca0 0x558b66f75070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:52.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.484+0000 7f14f9887740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f14d000e860 con 0x558b66f413e0 2024-09-05T01:31:52.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.484+0000 7f14f9887740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f14d0010550 con 0x558b66f4bca0 2024-09-05T01:31:52.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.484+0000 7f14f9887740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f14d000ef30 con 0x558b66f40ac0 2024-09-05T01:31:52.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.485+0000 7f14efe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f40ac0 0x558b66f4a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:52.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.485+0000 7f14efe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f40ac0 0x558b66f4a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:42118/0 (socket says 172.21.15.12:42118) 2024-09-05T01:31:52.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.485+0000 7f14efe00640 1 -- 172.21.15.12:0/2343706118 learned_addr learned my addr 172.21.15.12:0/2343706118 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:52.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.485+0000 7f14f4e00640 1 --2- 172.21.15.12:0/2343706118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b66f4bca0 0x558b66f75070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:52.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.485+0000 7f14ef400640 1 --2- 172.21.15.12:0/2343706118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b66f413e0 0x558b66f74b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:52.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.486+0000 7f14efe00640 1 -- 172.21.15.12:0/2343706118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b66f4bca0 msgr2=0x558b66f75070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:52.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.486+0000 7f14efe00640 1 --2- 172.21.15.12:0/2343706118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b66f4bca0 0x558b66f75070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.486+0000 7f14efe00640 1 -- 172.21.15.12:0/2343706118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b66f413e0 msgr2=0x558b66f74b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:52.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.486+0000 7f14efe00640 1 --2- 172.21.15.12:0/2343706118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b66f413e0 0x558b66f74b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.486+0000 7f14efe00640 1 -- 172.21.15.12:0/2343706118 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b66f6b620 con 0x558b66f40ac0 2024-09-05T01:31:52.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.486+0000 7f14ef400640 1 --2- 172.21.15.12:0/2343706118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b66f413e0 0x558b66f74b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:31:52.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.487+0000 7f14efe00640 1 --2- 172.21.15.12:0/2343706118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f40ac0 0x558b66f4a6c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f14dc000c00 tx=0x7f14dc00e800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd27c306a64e164e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:52.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.488+0000 7f14e4c00640 1 -- 172.21.15.12:0/2343706118 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc010070 con 0x558b66f40ac0 2024-09-05T01:31:52.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.488+0000 7f14e4c00640 1 -- 172.21.15.12:0/2343706118 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14dc01a980 con 0x558b66f40ac0 2024-09-05T01:31:52.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.488+0000 7f14e4c00640 1 -- 172.21.15.12:0/2343706118 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14dc005600 con 0x558b66f40ac0 2024-09-05T01:31:52.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.489+0000 7f14f9887740 1 -- 172.21.15.12:0/2343706118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f40ac0 msgr2=0x558b66f4a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:52.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.489+0000 7f14f9887740 1 --2- 172.21.15.12:0/2343706118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f40ac0 0x558b66f4a6c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f14dc000c00 tx=0x7f14dc00e800 comp rx=0 tx=0).stop 2024-09-05T01:31:52.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.490+0000 7f14f9887740 1 -- 172.21.15.12:0/2343706118 shutdown_connections 2024-09-05T01:31:52.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.490+0000 7f14f9887740 1 --2- 172.21.15.12:0/2343706118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b66f4bca0 0x558b66f75070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.490+0000 7f14f9887740 1 --2- 172.21.15.12:0/2343706118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b66f413e0 0x558b66f74b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.490+0000 7f14f9887740 1 --2- 172.21.15.12:0/2343706118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f40ac0 0x558b66f4a6c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.490+0000 7f14f9887740 1 -- 172.21.15.12:0/2343706118 >> 172.21.15.12:0/2343706118 conn(0x558b66f3d050 msgr2=0x558b66f49fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:52.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.491+0000 7f14f9887740 1 -- 172.21.15.12:0/2343706118 shutdown_connections 2024-09-05T01:31:52.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.491+0000 7f14f9887740 1 -- 172.21.15.12:0/2343706118 wait complete. 2024-09-05T01:31:52.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.493+0000 7f14f9887740 1 -- start start 2024-09-05T01:31:52.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.493+0000 7f14f9887740 1 Processor -- start 2024-09-05T01:31:52.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.494+0000 7f14f9887740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b66f40ac0 0x558b66f65640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:52.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.494+0000 7f14f9887740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f413e0 0x558b66f457c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:52.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.494+0000 7f14efe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b66f40ac0 0x558b66f65640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:52.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.494+0000 7f14f9887740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b66f4bca0 0x558b66f45f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:52.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.494+0000 7f14f9887740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f14d000fdc0 con 0x558b66f4bca0 2024-09-05T01:31:52.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.494+0000 7f14f9887740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f14d000f6c0 con 0x558b66f40ac0 2024-09-05T01:31:52.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.494+0000 7f14f9887740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f14d000c860 con 0x558b66f413e0 2024-09-05T01:31:52.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.494+0000 7f14ef400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f413e0 0x558b66f457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:52.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.495+0000 7f14f9887740 10 client.0 _ll_register_callbacks cb 0x7f14dc00b4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:31:52.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.495+0000 7f14ef400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f413e0 0x558b66f457c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:42132/0 (socket says 172.21.15.12:42132) 2024-09-05T01:31:52.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.495+0000 7f14ef400640 1 -- 172.21.15.12:0/236657037 learned_addr learned my addr 172.21.15.12:0/236657037 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:52.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.495+0000 7f14f4e00640 1 --2- 172.21.15.12:0/236657037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b66f4bca0 0x558b66f45f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:52.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.496+0000 7f14ef400640 1 -- 172.21.15.12:0/236657037 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b66f40ac0 msgr2=0x558b66f65640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:52.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.496+0000 7f14ef400640 1 --2- 172.21.15.12:0/236657037 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b66f40ac0 0x558b66f65640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.496+0000 7f14ef400640 1 -- 172.21.15.12:0/236657037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b66f4bca0 msgr2=0x558b66f45f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:52.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.496+0000 7f14ef400640 1 --2- 172.21.15.12:0/236657037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b66f4bca0 0x558b66f45f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.496+0000 7f14ef400640 1 -- 172.21.15.12:0/236657037 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b66fd6b00 con 0x558b66f413e0 2024-09-05T01:31:52.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.496+0000 7f14f4e00640 1 --2- 172.21.15.12:0/236657037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b66f4bca0 0x558b66f45f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:31:52.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.498+0000 7f14ef400640 1 --2- 172.21.15.12:0/236657037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f413e0 0x558b66f457c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f14e00ccd50 tx=0x7f14e009c2b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b077280f7bf4452e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:52.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.498+0000 7f14da000640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:31:52.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.499+0000 7f14da000640 1 -- 172.21.15.12:0/236657037 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e009fe20 con 0x558b66f413e0 2024-09-05T01:31:52.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.499+0000 7f14da000640 1 -- 172.21.15.12:0/236657037 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7f14e0099d70 con 0x558b66f413e0 2024-09-05T01:31:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.499+0000 7f14f9887740 1 -- 172.21.15.12:0/236657037 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14dc01a980 con 0x558b66f413e0 2024-09-05T01:31:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.500+0000 7f14da000640 1 -- 172.21.15.12:0/236657037 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f14e009ba70 con 0x558b66f413e0 2024-09-05T01:31:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.500+0000 7f14f9887740 10 client.26083 fetch_fsmap learned FSMap version 41 2024-09-05T01:31:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.500+0000 7f14f9887740 1 -- 172.21.15.12:0/236657037 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x558b66fd7d60 con 0x558b66f413e0 2024-09-05T01:31:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.500+0000 7f14da000640 1 -- 172.21.15.12:0/236657037 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14dc01a980 con 0x558b66f413e0 2024-09-05T01:31:52.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.502+0000 7f14da000640 1 -- 172.21.15.12:0/236657037 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) ==== 8430+0+0 (secure 0 0 0) 0x7f14e00a42e0 con 0x558b66f413e0 2024-09-05T01:31:52.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.503+0000 7f14f9887740 10 client.26083 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T01:31:52.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.503+0000 7f14f9887740 10 client.26083 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:31:52.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.503+0000 7f14f9887740 20 client.26083 populate_metadata read hostname 'smithi012' 2024-09-05T01:31:52.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.503+0000 7f14f9887740 1 --2- 172.21.15.12:0/236657037 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558b66fd8050 0x558b66fda470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:52.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.503+0000 7f14f9887740 4 client.26083 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-05T01:31:52.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.503+0000 7f14f9887740 1 -- 172.21.15.12:0/236657037 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558b66eaed10 con 0x558b66fd8050 2024-09-05T01:31:52.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.503+0000 7f14efe00640 1 --2- 172.21.15.12:0/236657037 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558b66fd8050 0x558b66fda470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:52.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.504+0000 7f14efe00640 1 --2- 172.21.15.12:0/236657037 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558b66fd8050 0x558b66fda470 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e458db24f9d7040f server_cookie=c2cb961b7caccec0 in_seq=0 out_seq=0 2024-09-05T01:31:52.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.504+0000 7f14da000640 10 client.26083 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:31:52.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.505+0000 7f14da000640 1 -- 172.21.15.12:0/236657037 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558b66eaed10 con 0x558b66fd8050 2024-09-05T01:31:52.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.505+0000 7f14da000640 10 client.26083 handle_command_reply: tid=0 2024-09-05T01:31:52.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.505+0000 7f14f9887740 1 client.26083 shutdown 2024-09-05T01:31:52.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.505+0000 7f14f9887740 1 -- 172.21.15.12:0/236657037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f413e0 msgr2=0x558b66f457c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:52.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.505+0000 7f14f9887740 1 --2- 172.21.15.12:0/236657037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f413e0 0x558b66f457c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f14e00ccd50 tx=0x7f14e009c2b0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.505+0000 7f14f9887740 1 -- 172.21.15.12:0/236657037 shutdown_connections 2024-09-05T01:31:52.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.506+0000 7f14f9887740 1 --2- 172.21.15.12:0/236657037 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558b66fd8050 0x558b66fda470 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.506+0000 7f14f9887740 1 --2- 172.21.15.12:0/236657037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558b66f4bca0 0x558b66f45f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.506+0000 7f14f9887740 1 --2- 172.21.15.12:0/236657037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558b66f413e0 0x558b66f457c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.506+0000 7f14f9887740 1 --2- 172.21.15.12:0/236657037 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558b66f40ac0 0x558b66f65640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.506+0000 7f14da000640 0 client.26083 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:31:52.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.506+0000 7f14f9887740 1 -- 172.21.15.12:0/236657037 >> 172.21.15.12:0/236657037 conn(0x558b66f3d050 msgr2=0x558b66f42510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:52.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.506+0000 7f14f9887740 1 -- 172.21.15.12:0/236657037 shutdown_connections 2024-09-05T01:31:52.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.506+0000 7f14f9887740 1 -- 172.21.15.12:0/236657037 wait complete. 2024-09-05T01:31:52.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.506+0000 7f14f9887740 20 client.26083 trim_cache size 0 max 16384 2024-09-05T01:31:52.509 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:31:52.509 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-05T01:31:52.509 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "8bb6b8ea-1623-4e6f-99d9-e2d4fd8bca17", 2024-09-05T01:31:52.509 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-05T01:31:52.509 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:31:52.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.508+0000 7f14f6e00640 1 -- 172.21.15.12:0/1099361390 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f14d40a2e80 msgr2=0x7f14d40a5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:52.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.508+0000 7f14f6e00640 1 --2- 172.21.15.12:0/1099361390 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f14d40a2e80 0x7f14d40a5340 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f14e8034040 tx=0x7f14e802a780 comp rx=0 tx=0).stop 2024-09-05T01:31:52.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.508+0000 7f14f6e00640 1 -- 172.21.15.12:0/1099361390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f0101430 msgr2=0x7f14f01151e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:52.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.508+0000 7f14f6e00640 1 --2- 172.21.15.12:0/1099361390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f0101430 0x7f14f01151e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f14e000e790 tx=0x7f14e000ec50 comp rx=0 tx=0).stop 2024-09-05T01:31:52.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.508+0000 7f14f6e00640 1 -- 172.21.15.12:0/1099361390 shutdown_connections 2024-09-05T01:31:52.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.508+0000 7f14f6e00640 1 --2- 172.21.15.12:0/1099361390 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f14d40a2e80 0x7f14d40a5340 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.508+0000 7f14f6e00640 1 --2- 172.21.15.12:0/1099361390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14f0105f20 0x7f14f010def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.508+0000 7f14f6e00640 1 --2- 172.21.15.12:0/1099361390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f0101430 0x7f14f01151e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.508+0000 7f14f6e00640 1 --2- 172.21.15.12:0/1099361390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14f0100b10 0x7f14f0114ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:52.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.508+0000 7f14f6e00640 1 -- 172.21.15.12:0/1099361390 >> 172.21.15.12:0/1099361390 conn(0x7f14f00fc780 msgr2=0x7f14f01038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:52.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.509+0000 7f14f6e00640 1 -- 172.21.15.12:0/1099361390 shutdown_connections 2024-09-05T01:31:52.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:52.509+0000 7f14f6e00640 1 -- 172.21.15.12:0/1099361390 wait complete. 2024-09-05T01:31:53.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:53 smithi151 ceph-mon[35013]: pgmap v220: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 227 KiB/s wr, 27 op/s 2024-09-05T01:31:53.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:53 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:31:53.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:53 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:31:53.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:53 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:31:53.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:53 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:31:53.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:53 smithi012 ceph-mon[29942]: pgmap v220: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 227 KiB/s wr, 27 op/s 2024-09-05T01:31:53.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:53 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:31:53.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:53 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:31:53.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:53 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:31:53.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:53 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:31:53.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:53 smithi145 ceph-mon[34376]: pgmap v220: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 227 KiB/s wr, 27 op/s 2024-09-05T01:31:53.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:53 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:31:53.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:53 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:31:53.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:53 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:31:53.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:53 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:31:53.801 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T01:31:54.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:54 smithi151 ceph-mon[35013]: scrub queued for path: / 2024-09-05T01:31:54.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:54 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:54.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:54 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:31:54.414 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:31:54.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:54 smithi012 ceph-mon[29942]: scrub queued for path: / 2024-09-05T01:31:54.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:54 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:54.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:54 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:31:54.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:54 smithi145 ceph-mon[34376]: scrub queued for path: / 2024-09-05T01:31:54.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:54 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:54.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:54 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:31:55.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.146+0000 7f514a600640 1 -- 172.21.15.12:0/2451039498 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f514410e210 msgr2=0x7f5144110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:55.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.146+0000 7f514a600640 1 --2- 172.21.15.12:0/2451039498 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f514410e210 0x7f5144110660 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f513c009ca0 tx=0x7f513c02a940 comp rx=0 tx=0).stop 2024-09-05T01:31:55.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.146+0000 7f514a600640 1 -- 172.21.15.12:0/2451039498 shutdown_connections 2024-09-05T01:31:55.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.146+0000 7f514a600640 1 --2- 172.21.15.12:0/2451039498 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f514410e210 0x7f5144110660 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.146+0000 7f514a600640 1 --2- 172.21.15.12:0/2451039498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5144074f40 0x7f514410dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.146+0000 7f514a600640 1 --2- 172.21.15.12:0/2451039498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5144074620 0x7f5144074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.146+0000 7f514a600640 1 -- 172.21.15.12:0/2451039498 >> 172.21.15.12:0/2451039498 conn(0x7f51440fd710 msgr2=0x7f51440ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:55.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.146+0000 7f514a600640 1 -- 172.21.15.12:0/2451039498 shutdown_connections 2024-09-05T01:31:55.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.147+0000 7f514a600640 1 -- 172.21.15.12:0/2451039498 wait complete. 2024-09-05T01:31:55.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.148+0000 7f514a600640 1 Processor -- start 2024-09-05T01:31:55.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.148+0000 7f514a600640 1 -- start start 2024-09-05T01:31:55.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.149+0000 7f514a600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5144074620 0x7f514419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:55.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.149+0000 7f514a600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5144074f40 0x7f514419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:55.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.149+0000 7f514a600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f514410e210 0x7f514419ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:55.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.149+0000 7f514a600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5144114000 con 0x7f5144074f40 2024-09-05T01:31:55.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.149+0000 7f514a600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5144113e80 con 0x7f5144074620 2024-09-05T01:31:55.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.149+0000 7f514a600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5144114180 con 0x7f514410e210 2024-09-05T01:31:55.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.149+0000 7f5149200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5144074620 0x7f514419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:55.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.149+0000 7f5149200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5144074620 0x7f514419a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:33830/0 (socket says 172.21.15.12:33830) 2024-09-05T01:31:55.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.149+0000 7f5149200640 1 -- 172.21.15.12:0/2716486650 learned_addr learned my addr 172.21.15.12:0/2716486650 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:55.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.149+0000 7f5149c00640 1 --2- 172.21.15.12:0/2716486650 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f514410e210 0x7f514419ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:55.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.149+0000 7f5143e00640 1 --2- 172.21.15.12:0/2716486650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5144074f40 0x7f514419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:55.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.150+0000 7f5149200640 1 -- 172.21.15.12:0/2716486650 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f514410e210 msgr2=0x7f514419ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:55.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.150+0000 7f5149200640 1 --2- 172.21.15.12:0/2716486650 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f514410e210 0x7f514419ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.150+0000 7f5149200640 1 -- 172.21.15.12:0/2716486650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5144074f40 msgr2=0x7f514419a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:55.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.150+0000 7f5149200640 1 --2- 172.21.15.12:0/2716486650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5144074f40 0x7f514419a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.150+0000 7f5149200640 1 -- 172.21.15.12:0/2716486650 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f514419f450 con 0x7f5144074620 2024-09-05T01:31:55.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.150+0000 7f5149200640 1 --2- 172.21.15.12:0/2716486650 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5144074620 0x7f514419a4a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f513800d950 tx=0x7f513800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:55.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.151+0000 7f5141600640 1 -- 172.21.15.12:0/2716486650 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5138017070 con 0x7f5144074620 2024-09-05T01:31:55.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.151+0000 7f5141600640 1 -- 172.21.15.12:0/2716486650 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5138009c30 con 0x7f5144074620 2024-09-05T01:31:55.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.151+0000 7f5141600640 1 -- 172.21.15.12:0/2716486650 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513800f620 con 0x7f5144074620 2024-09-05T01:31:55.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.151+0000 7f514a600640 1 -- 172.21.15.12:0/2716486650 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f514419f740 con 0x7f5144074620 2024-09-05T01:31:55.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.152+0000 7f514a600640 1 -- 172.21.15.12:0/2716486650 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51441a7020 con 0x7f5144074620 2024-09-05T01:31:55.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.156+0000 7f5141600640 1 -- 172.21.15.12:0/2716486650 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f5138005070 con 0x7f5144074620 2024-09-05T01:31:55.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.158+0000 7f5141600640 1 --2- 172.21.15.12:0/2716486650 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f512c0a2dc0 0x7f512c0a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:55.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.158+0000 7f5141600640 1 -- 172.21.15.12:0/2716486650 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7f51380cea60 con 0x7f5144074620 2024-09-05T01:31:55.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.158+0000 7f514e67f740 1 Processor -- start 2024-09-05T01:31:55.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.158+0000 7f5143e00640 1 --2- 172.21.15.12:0/2716486650 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f512c0a2dc0 0x7f512c0a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:55.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.159+0000 7f514e67f740 1 -- start start 2024-09-05T01:31:55.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.159+0000 7f514e67f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56498cbb7d50 0x56498cbb8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:55.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.159+0000 7f514e67f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498cbb8670 0x56498cbc29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:55.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.159+0000 7f514e67f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbc2f30 0x56498cbc5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:55.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.159+0000 7f514e67f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56498cb1e3e0 con 0x56498cbb8670 2024-09-05T01:31:55.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.159+0000 7f514e67f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56498cac5d80 con 0x56498cbc2f30 2024-09-05T01:31:55.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.159+0000 7f514e67f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56498cb1a3a0 con 0x56498cbb7d50 2024-09-05T01:31:55.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.160+0000 7f5149c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbc2f30 0x56498cbc5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:55.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.160+0000 7f5149c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbc2f30 0x56498cbc5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:33844/0 (socket says 172.21.15.12:33844) 2024-09-05T01:31:55.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.160+0000 7f5149c00640 1 -- 172.21.15.12:0/2824921444 learned_addr learned my addr 172.21.15.12:0/2824921444 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:55.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.160+0000 7f5143e00640 1 --2- 172.21.15.12:0/2824921444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498cbb8670 0x56498cbc29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:55.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.160+0000 7f5149200640 1 --2- 172.21.15.12:0/2824921444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56498cbb7d50 0x56498cbb8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:55.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.161+0000 7f5143e00640 1 --2- 172.21.15.12:0/2716486650 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f512c0a2dc0 0x7f512c0a5280 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f514410f5a0 tx=0x7f5130008040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:55.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.161+0000 7f5149200640 1 -- 172.21.15.12:0/2824921444 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbc2f30 msgr2=0x56498cbc5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:55.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.161+0000 7f5149200640 1 --2- 172.21.15.12:0/2824921444 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbc2f30 0x56498cbc5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.161+0000 7f5149200640 1 -- 172.21.15.12:0/2824921444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498cbb8670 msgr2=0x56498cbc29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:55.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.161+0000 7f5149200640 1 --2- 172.21.15.12:0/2824921444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498cbb8670 0x56498cbc29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.161+0000 7f5149200640 1 -- 172.21.15.12:0/2824921444 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56498cae4ae0 con 0x56498cbb7d50 2024-09-05T01:31:55.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.161+0000 7f5149c00640 1 --2- 172.21.15.12:0/2824921444 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbc2f30 0x56498cbc5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:31:55.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.161+0000 7f5143e00640 1 --2- 172.21.15.12:0/2824921444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498cbb8670 0x56498cbc29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:31:55.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.162+0000 7f5149200640 1 --2- 172.21.15.12:0/2824921444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56498cbb7d50 0x56498cbb8130 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f51380cc110 tx=0x7f513800b6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b112327d7f3680b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:55.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.162+0000 7f5136000640 1 -- 172.21.15.12:0/2824921444 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5138020040 con 0x56498cbb7d50 2024-09-05T01:31:55.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.163+0000 7f5136000640 1 -- 172.21.15.12:0/2824921444 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f513809f290 con 0x56498cbb7d50 2024-09-05T01:31:55.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.163+0000 7f5136000640 1 -- 172.21.15.12:0/2824921444 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51380055c0 con 0x56498cbb7d50 2024-09-05T01:31:55.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.164+0000 7f514e67f740 1 -- 172.21.15.12:0/2824921444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56498cbb7d50 msgr2=0x56498cbb8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:55.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.164+0000 7f514e67f740 1 --2- 172.21.15.12:0/2824921444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56498cbb7d50 0x56498cbb8130 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f51380cc110 tx=0x7f513800b6f0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.164+0000 7f514e67f740 1 -- 172.21.15.12:0/2824921444 shutdown_connections 2024-09-05T01:31:55.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.164+0000 7f514e67f740 1 --2- 172.21.15.12:0/2824921444 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbc2f30 0x56498cbc5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.164+0000 7f514e67f740 1 --2- 172.21.15.12:0/2824921444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498cbb8670 0x56498cbc29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.164+0000 7f514e67f740 1 --2- 172.21.15.12:0/2824921444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56498cbb7d50 0x56498cbb8130 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.164+0000 7f514e67f740 1 -- 172.21.15.12:0/2824921444 >> 172.21.15.12:0/2824921444 conn(0x56498cbb42e0 msgr2=0x56498cbb46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:55.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.165+0000 7f514e67f740 1 -- 172.21.15.12:0/2824921444 shutdown_connections 2024-09-05T01:31:55.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.165+0000 7f514e67f740 1 -- 172.21.15.12:0/2824921444 wait complete. 2024-09-05T01:31:55.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.166+0000 7f514e67f740 1 -- start start 2024-09-05T01:31:55.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.166+0000 7f514e67f740 1 Processor -- start 2024-09-05T01:31:55.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.167+0000 7f514e67f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498cbb7d50 0x56498cbbff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:55.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.167+0000 7f514e67f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbb8670 0x56498cbc04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:55.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.167+0000 7f514e67f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56498cbc2f30 0x56498cbc09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:55.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.167+0000 7f514e67f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56498cbce3b0 con 0x56498cbb7d50 2024-09-05T01:31:55.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.167+0000 7f514e67f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56498cad90f0 con 0x56498cbb8670 2024-09-05T01:31:55.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.167+0000 7f514e67f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56498cbce530 con 0x56498cbc2f30 2024-09-05T01:31:55.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.167+0000 7f514e67f740 10 client.0 _ll_register_callbacks cb 0x56498caca9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:31:55.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.167+0000 7f5149c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56498cbc2f30 0x56498cbc09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:55.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.167+0000 7f5149c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56498cbc2f30 0x56498cbc09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:42174/0 (socket says 172.21.15.12:42174) 2024-09-05T01:31:55.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.167+0000 7f5149c00640 1 -- 172.21.15.12:0/1245629119 learned_addr learned my addr 172.21.15.12:0/1245629119 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:55.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.167+0000 7f5149200640 1 --2- 172.21.15.12:0/1245629119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498cbb7d50 0x56498cbbff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:55.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.167+0000 7f5143e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbb8670 0x56498cbc04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:55.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.168+0000 7f5149c00640 1 -- 172.21.15.12:0/1245629119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbb8670 msgr2=0x56498cbc04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:55.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.168+0000 7f5149c00640 1 --2- 172.21.15.12:0/1245629119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbb8670 0x56498cbc04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.168+0000 7f5149c00640 1 -- 172.21.15.12:0/1245629119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498cbb7d50 msgr2=0x56498cbbff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:55.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.168+0000 7f5149c00640 1 --2- 172.21.15.12:0/1245629119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498cbb7d50 0x56498cbbff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.168+0000 7f5149c00640 1 -- 172.21.15.12:0/1245629119 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56498c88f3c0 con 0x56498cbc2f30 2024-09-05T01:31:55.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.168+0000 7f5149200640 1 --2- 172.21.15.12:0/1245629119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498cbb7d50 0x56498cbbff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:31:55.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.169+0000 7f5149c00640 1 --2- 172.21.15.12:0/1245629119 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56498cbc2f30 0x56498cbc09f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f513c006010 tx=0x7f513c003ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=645f5eba510c3ef7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:55.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.169+0000 7f512aa00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:31:55.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.169+0000 7f512aa00640 1 -- 172.21.15.12:0/1245629119 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c049060 con 0x56498cbc2f30 2024-09-05T01:31:55.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.169+0000 7f514e67f740 1 -- 172.21.15.12:0/1245629119 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f513809f290 con 0x56498cbc2f30 2024-09-05T01:31:55.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.170+0000 7f512aa00640 1 -- 172.21.15.12:0/1245629119 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7f513c02fd40 con 0x56498cbc2f30 2024-09-05T01:31:55.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.170+0000 7f512aa00640 1 -- 172.21.15.12:0/1245629119 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f513c034040 con 0x56498cbc2f30 2024-09-05T01:31:55.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.170+0000 7f514e67f740 10 client.26092 fetch_fsmap learned FSMap version 41 2024-09-05T01:31:55.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.170+0000 7f514e67f740 1 -- 172.21.15.12:0/1245629119 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x56498cbda1f0 con 0x56498cbc2f30 2024-09-05T01:31:55.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.171+0000 7f512aa00640 1 -- 172.21.15.12:0/1245629119 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f513809f290 con 0x56498cbc2f30 2024-09-05T01:31:55.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.171+0000 7f512aa00640 1 -- 172.21.15.12:0/1245629119 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) ==== 8430+0+0 (secure 0 0 0) 0x7f513c02f070 con 0x56498cbc2f30 2024-09-05T01:31:55.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.172+0000 7f514e67f740 10 client.26092 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T01:31:55.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.172+0000 7f514e67f740 10 client.26092 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:31:55.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.172+0000 7f514e67f740 20 client.26092 populate_metadata read hostname 'smithi012' 2024-09-05T01:31:55.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.172+0000 7f514e67f740 1 --2- 172.21.15.12:0/1245629119 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x56498cbdb710 0x56498cbddb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:55.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.172+0000 7f514e67f740 4 client.26092 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:31:55.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.172+0000 7f514e67f740 1 -- 172.21.15.12:0/1245629119 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56498cb2b950 con 0x56498cbdb710 2024-09-05T01:31:55.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.173+0000 7f5149200640 1 --2- 172.21.15.12:0/1245629119 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x56498cbdb710 0x56498cbddb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:55.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.174+0000 7f5149200640 1 --2- 172.21.15.12:0/1245629119 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x56498cbdb710 0x56498cbddb60 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1147010bd40fc4d8 server_cookie=bbdbce3cc815a285 in_seq=0 out_seq=0 2024-09-05T01:31:55.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.174+0000 7f512aa00640 10 client.26092 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:31:55.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.175+0000 7f512aa00640 1 -- 172.21.15.12:0/1245629119 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56498cb2b950 con 0x56498cbdb710 2024-09-05T01:31:55.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.175+0000 7f512aa00640 10 client.26092 handle_command_reply: tid=0 2024-09-05T01:31:55.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.175+0000 7f514e67f740 1 client.26092 shutdown 2024-09-05T01:31:55.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.175+0000 7f514e67f740 1 -- 172.21.15.12:0/1245629119 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56498cbc2f30 msgr2=0x56498cbc09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:55.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.175+0000 7f514e67f740 1 --2- 172.21.15.12:0/1245629119 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56498cbc2f30 0x56498cbc09f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f513c006010 tx=0x7f513c003ce0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.175+0000 7f514e67f740 1 -- 172.21.15.12:0/1245629119 shutdown_connections 2024-09-05T01:31:55.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.175+0000 7f514e67f740 1 --2- 172.21.15.12:0/1245629119 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x56498cbdb710 0x56498cbddb60 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.175+0000 7f514e67f740 1 --2- 172.21.15.12:0/1245629119 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56498cbc2f30 0x56498cbc09f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.175+0000 7f514e67f740 1 --2- 172.21.15.12:0/1245629119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbb8670 0x56498cbc04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.175+0000 7f514e67f740 1 --2- 172.21.15.12:0/1245629119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498cbb7d50 0x56498cbbff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.175+0000 7f514e67f740 1 -- 172.21.15.12:0/1245629119 >> 172.21.15.12:0/1245629119 conn(0x56498cbb42e0 msgr2=0x56498cbba010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:55.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.175+0000 7f512aa00640 0 client.26092 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:31:55.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.175+0000 7f514e67f740 1 -- 172.21.15.12:0/1245629119 shutdown_connections 2024-09-05T01:31:55.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.176+0000 7f514e67f740 1 -- 172.21.15.12:0/1245629119 wait complete. 2024-09-05T01:31:55.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.176+0000 7f514e67f740 20 client.26092 trim_cache size 0 max 16384 2024-09-05T01:31:55.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.209+0000 7f514e67f740 1 Processor -- start 2024-09-05T01:31:55.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.209+0000 7f514e67f740 1 -- start start 2024-09-05T01:31:55.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.209+0000 7f514e67f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498cbb7d50 0x56498cbc1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:55.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.209+0000 7f514e67f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56498cbb8670 0x56498cbe3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:55.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.209+0000 7f514e67f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbc2f30 0x56498cbe3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:55.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.209+0000 7f514e67f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f51441ab6b0 con 0x56498cbb7d50 2024-09-05T01:31:55.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.209+0000 7f514e67f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f51441ad3a0 con 0x56498cbc2f30 2024-09-05T01:31:55.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.209+0000 7f514e67f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f51441abd80 con 0x56498cbb8670 2024-09-05T01:31:55.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.210+0000 7f5149200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498cbb7d50 0x56498cbc1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:55.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.210+0000 7f5149c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbc2f30 0x56498cbe3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:55.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.210+0000 7f5143e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56498cbb8670 0x56498cbe3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:55.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.210+0000 7f5149c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbc2f30 0x56498cbe3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:33868/0 (socket says 172.21.15.12:33868) 2024-09-05T01:31:55.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.210+0000 7f5149c00640 1 -- 172.21.15.12:0/3768520786 learned_addr learned my addr 172.21.15.12:0/3768520786 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:55.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.210+0000 7f5149c00640 1 -- 172.21.15.12:0/3768520786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56498cbb8670 msgr2=0x56498cbe3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:55.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.210+0000 7f5149c00640 1 --2- 172.21.15.12:0/3768520786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56498cbb8670 0x56498cbe3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.210+0000 7f5149c00640 1 -- 172.21.15.12:0/3768520786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498cbb7d50 msgr2=0x56498cbc1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:55.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.211+0000 7f5149c00640 1 --2- 172.21.15.12:0/3768520786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498cbb7d50 0x56498cbc1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.211+0000 7f5149c00640 1 -- 172.21.15.12:0/3768520786 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56498cbd7610 con 0x56498cbc2f30 2024-09-05T01:31:55.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.211+0000 7f5149c00640 1 --2- 172.21.15.12:0/3768520786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbc2f30 0x56498cbe3980 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f513c009a60 tx=0x7f513c02f7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d93c5028a889065 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:55.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.212+0000 7f5135600640 1 -- 172.21.15.12:0/3768520786 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c049070 con 0x56498cbc2f30 2024-09-05T01:31:55.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.212+0000 7f5135600640 1 -- 172.21.15.12:0/3768520786 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f513c004110 con 0x56498cbc2f30 2024-09-05T01:31:55.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.212+0000 7f5135600640 1 -- 172.21.15.12:0/3768520786 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513c049070 con 0x56498cbc2f30 2024-09-05T01:31:55.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.214+0000 7f514e67f740 1 -- 172.21.15.12:0/3768520786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbc2f30 msgr2=0x56498cbe3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:55.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.214+0000 7f514e67f740 1 --2- 172.21.15.12:0/3768520786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbc2f30 0x56498cbe3980 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f513c009a60 tx=0x7f513c02f7b0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.216 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:55 smithi012 ceph-mon[29942]: pgmap v221: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 2.4 MiB/s wr, 124 op/s 2024-09-05T01:31:55.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.214+0000 7f514e67f740 1 -- 172.21.15.12:0/3768520786 shutdown_connections 2024-09-05T01:31:55.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.214+0000 7f514e67f740 1 --2- 172.21.15.12:0/3768520786 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbc2f30 0x56498cbe3980 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.214+0000 7f514e67f740 1 --2- 172.21.15.12:0/3768520786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56498cbb8670 0x56498cbe3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.215+0000 7f514e67f740 1 --2- 172.21.15.12:0/3768520786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498cbb7d50 0x56498cbc1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.215+0000 7f514e67f740 1 -- 172.21.15.12:0/3768520786 >> 172.21.15.12:0/3768520786 conn(0x56498cbb42e0 msgr2=0x56498cbc17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:55.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.215+0000 7f514e67f740 1 -- 172.21.15.12:0/3768520786 shutdown_connections 2024-09-05T01:31:55.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.215+0000 7f514e67f740 1 -- 172.21.15.12:0/3768520786 wait complete. 2024-09-05T01:31:55.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.216+0000 7f514e67f740 1 -- start start 2024-09-05T01:31:55.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.217+0000 7f514e67f740 1 Processor -- start 2024-09-05T01:31:55.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.217+0000 7f514e67f740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbb7d50 0x56498cbd3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:55.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.217+0000 7f514e67f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498cbb8670 0x56498cbbcb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:55.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.217+0000 7f514e67f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56498cbc2f30 0x56498cbbd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:55.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.217+0000 7f514e67f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f51441acc10 con 0x56498cbb8670 2024-09-05T01:31:55.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.217+0000 7f514e67f740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f51441ac510 con 0x56498cbb7d50 2024-09-05T01:31:55.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.217+0000 7f514e67f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f51441a96d0 con 0x56498cbc2f30 2024-09-05T01:31:55.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.217+0000 7f514e67f740 10 client.0 _ll_register_callbacks cb 0x7f513c003970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:31:55.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.218+0000 7f5149200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbb7d50 0x56498cbd3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:55.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.218+0000 7f5149c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56498cbc2f30 0x56498cbbd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:55.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.218+0000 7f5149200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbb7d50 0x56498cbd3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:33884/0 (socket says 172.21.15.12:33884) 2024-09-05T01:31:55.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.218+0000 7f5149200640 1 -- 172.21.15.12:0/1367831118 learned_addr learned my addr 172.21.15.12:0/1367831118 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:31:55.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.218+0000 7f5143e00640 1 --2- 172.21.15.12:0/1367831118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498cbb8670 0x56498cbbcb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:55.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.219+0000 7f5149200640 1 -- 172.21.15.12:0/1367831118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56498cbc2f30 msgr2=0x56498cbbd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:55.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.219+0000 7f5149200640 1 --2- 172.21.15.12:0/1367831118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56498cbc2f30 0x56498cbbd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.219+0000 7f5149200640 1 -- 172.21.15.12:0/1367831118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498cbb8670 msgr2=0x56498cbbcb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:31:55.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.219+0000 7f5149200640 1 --2- 172.21.15.12:0/1367831118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498cbb8670 0x56498cbbcb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.219+0000 7f5149200640 1 -- 172.21.15.12:0/1367831118 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56498cbbd6e0 con 0x56498cbb7d50 2024-09-05T01:31:55.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.219+0000 7f5149c00640 1 --2- 172.21.15.12:0/1367831118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56498cbc2f30 0x56498cbbd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:31:55.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.219+0000 7f5143e00640 1 --2- 172.21.15.12:0/1367831118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498cbb8670 0x56498cbbcb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:31:55.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.219+0000 7f5149200640 1 --2- 172.21.15.12:0/1367831118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbb7d50 0x56498cbd3d30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f513809ae70 tx=0x7f513809acb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c6099a4828cebfe server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:31:55.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.219+0000 7f512aa00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:31:55.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.220+0000 7f512aa00640 1 -- 172.21.15.12:0/1367831118 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5138020040 con 0x56498cbb7d50 2024-09-05T01:31:55.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.220+0000 7f512aa00640 1 -- 172.21.15.12:0/1367831118 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8579+0+0 (secure 0 0 0) 0x7f5138097550 con 0x56498cbb7d50 2024-09-05T01:31:55.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.220+0000 7f514e67f740 1 -- 172.21.15.12:0/1367831118 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f513c004110 con 0x56498cbb7d50 2024-09-05T01:31:55.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.220+0000 7f512aa00640 1 -- 172.21.15.12:0/1367831118 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f513809f290 con 0x56498cbb7d50 2024-09-05T01:31:55.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.220+0000 7f514e67f740 10 client.26105 fetch_fsmap learned FSMap version 41 2024-09-05T01:31:55.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.220+0000 7f514e67f740 1 -- 172.21.15.12:0/1367831118 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x56498cc46290 con 0x56498cbb7d50 2024-09-05T01:31:55.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.221+0000 7f512aa00640 1 -- 172.21.15.12:0/1367831118 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f513c004110 con 0x56498cbb7d50 2024-09-05T01:31:55.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.221+0000 7f512aa00640 1 -- 172.21.15.12:0/1367831118 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 41) ==== 8430+0+0 (secure 0 0 0) 0x7f513809a330 con 0x56498cbb7d50 2024-09-05T01:31:55.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.221+0000 7f514e67f740 10 client.26105 fetch_fsmap finished waiting for FSMap version 41 2024-09-05T01:31:55.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.221+0000 7f514e67f740 10 client.26105 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:31:55.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.221+0000 7f514e67f740 20 client.26105 populate_metadata read hostname 'smithi012' 2024-09-05T01:31:55.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.221+0000 7f514e67f740 1 --2- 172.21.15.12:0/1367831118 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x56498cc46630 0x56498cc48a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:31:55.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.221+0000 7f514e67f740 4 client.26105 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T01:31:55.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.221+0000 7f514e67f740 1 -- 172.21.15.12:0/1367831118 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56498cb25e60 con 0x56498cc46630 2024-09-05T01:31:55.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.222+0000 7f5143e00640 1 --2- 172.21.15.12:0/1367831118 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x56498cc46630 0x56498cc48a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:31:55.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.223+0000 7f5143e00640 1 --2- 172.21.15.12:0/1367831118 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x56498cc46630 0x56498cc48a20 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e02fddbb4c65ca0 server_cookie=2895f10bf5b17e66 in_seq=0 out_seq=0 2024-09-05T01:31:55.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.223+0000 7f512aa00640 10 client.26105 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:31:55.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.224+0000 7f512aa00640 1 -- 172.21.15.12:0/1367831118 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x56498cb25e60 con 0x56498cc46630 2024-09-05T01:31:55.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.224+0000 7f512aa00640 10 client.26105 handle_command_reply: tid=0 2024-09-05T01:31:55.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.224+0000 7f514e67f740 1 client.26105 shutdown 2024-09-05T01:31:55.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.225+0000 7f514e67f740 1 -- 172.21.15.12:0/1367831118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbb7d50 msgr2=0x56498cbd3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:55.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.225+0000 7f514e67f740 1 --2- 172.21.15.12:0/1367831118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbb7d50 0x56498cbd3d30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f513809ae70 tx=0x7f513809acb0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.225+0000 7f514e67f740 1 -- 172.21.15.12:0/1367831118 shutdown_connections 2024-09-05T01:31:55.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.225+0000 7f514e67f740 1 --2- 172.21.15.12:0/1367831118 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x56498cc46630 0x56498cc48a20 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.225+0000 7f514e67f740 1 --2- 172.21.15.12:0/1367831118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56498cbc2f30 0x56498cbbd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.225+0000 7f514e67f740 1 --2- 172.21.15.12:0/1367831118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56498cbb8670 0x56498cbbcb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.225+0000 7f514e67f740 1 --2- 172.21.15.12:0/1367831118 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56498cbb7d50 0x56498cbd3d30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.225+0000 7f512aa00640 0 client.26105 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:31:55.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.225+0000 7f514e67f740 1 -- 172.21.15.12:0/1367831118 >> 172.21.15.12:0/1367831118 conn(0x56498cbb42e0 msgr2=0x56498cbd6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:55.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.225+0000 7f514e67f740 1 -- 172.21.15.12:0/1367831118 shutdown_connections 2024-09-05T01:31:55.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.226+0000 7f514e67f740 1 -- 172.21.15.12:0/1367831118 wait complete. 2024-09-05T01:31:55.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.226+0000 7f514e67f740 20 client.26105 trim_cache size 0 max 16384 2024-09-05T01:31:55.228 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:31:55.228 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "scrub active (7648 inodes in the stack)", 2024-09-05T01:31:55.228 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-05T01:31:55.228 INFO:teuthology.orchestra.run.smithi012.stdout: "8bb6b8ea-1623-4e6f-99d9-e2d4fd8bca17": { 2024-09-05T01:31:55.228 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-05T01:31:55.228 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "8bb6b8ea-1623-4e6f-99d9-e2d4fd8bca17", 2024-09-05T01:31:55.228 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-05T01:31:55.229 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:31:55.229 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:31:55.229 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:31:55.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.228+0000 7f514a600640 1 -- 172.21.15.12:0/2716486650 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f512c0a2dc0 msgr2=0x7f512c0a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:55.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.228+0000 7f514a600640 1 --2- 172.21.15.12:0/2716486650 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f512c0a2dc0 0x7f512c0a5280 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f514410f5a0 tx=0x7f5130008040 comp rx=0 tx=0).stop 2024-09-05T01:31:55.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.228+0000 7f514a600640 1 -- 172.21.15.12:0/2716486650 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5144074620 msgr2=0x7f514419a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:31:55.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.228+0000 7f514a600640 1 --2- 172.21.15.12:0/2716486650 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5144074620 0x7f514419a4a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f513800d950 tx=0x7f513800de10 comp rx=0 tx=0).stop 2024-09-05T01:31:55.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.228+0000 7f514a600640 1 -- 172.21.15.12:0/2716486650 shutdown_connections 2024-09-05T01:31:55.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.228+0000 7f514a600640 1 --2- 172.21.15.12:0/2716486650 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f512c0a2dc0 0x7f512c0a5280 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.228+0000 7f514a600640 1 --2- 172.21.15.12:0/2716486650 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f514410e210 0x7f514419ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.228+0000 7f514a600640 1 --2- 172.21.15.12:0/2716486650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5144074f40 0x7f514419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.228+0000 7f514a600640 1 --2- 172.21.15.12:0/2716486650 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5144074620 0x7f514419a4a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:31:55.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.228+0000 7f514a600640 1 -- 172.21.15.12:0/2716486650 >> 172.21.15.12:0/2716486650 conn(0x7f51440fd710 msgr2=0x7f51440fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:31:55.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.228+0000 7f514a600640 1 -- 172.21.15.12:0/2716486650 shutdown_connections 2024-09-05T01:31:55.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:31:55.228+0000 7f514a600640 1 -- 172.21.15.12:0/2716486650 wait complete. 2024-09-05T01:31:55.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:55 smithi151 ceph-mon[35013]: pgmap v221: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 2.4 MiB/s wr, 124 op/s 2024-09-05T01:31:55.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:55 smithi145 ceph-mon[34376]: pgmap v221: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 2.4 MiB/s wr, 124 op/s 2024-09-05T01:31:56.248 INFO:tasks.cephfs.filesystem:scrub status for tag:8bb6b8ea-1623-4e6f-99d9-e2d4fd8bca17 - {'path': '/', 'tag': '8bb6b8ea-1623-4e6f-99d9-e2d4fd8bca17', 'options': 'recursive,force'} 2024-09-05T01:31:56.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:56 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:56.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:56 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:56.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:56 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:57.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:57 smithi012 ceph-mon[29942]: pgmap v222: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 2.5 MiB/s wr, 120 op/s 2024-09-05T01:31:57.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:57 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:57.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:57 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:57.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:57 smithi145 ceph-mon[34376]: pgmap v222: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 2.5 MiB/s wr, 120 op/s 2024-09-05T01:31:57.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:57 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:57.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:57 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:57.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:57 smithi151 ceph-mon[35013]: pgmap v222: 97 pgs: 97 active+clean; 2.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 2.5 MiB/s wr, 120 op/s 2024-09-05T01:31:57.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:57 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:57.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:57 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:58.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:58 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:58.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:58 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:58.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:58 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:59.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:59 smithi012 ceph-mon[29942]: pgmap v223: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 2.8 MiB/s wr, 134 op/s 2024-09-05T01:31:59.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:31:59 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:59.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:59 smithi145 ceph-mon[34376]: pgmap v223: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 2.8 MiB/s wr, 134 op/s 2024-09-05T01:31:59.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:31:59 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:31:59.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:59 smithi151 ceph-mon[35013]: pgmap v223: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 2.8 MiB/s wr, 134 op/s 2024-09-05T01:31:59.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:31:59 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:32:01.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:01 smithi012 ceph-mon[29942]: pgmap v224: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 146 op/s 2024-09-05T01:32:01.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:01 smithi145 ceph-mon[34376]: pgmap v224: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 146 op/s 2024-09-05T01:32:01.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:01 smithi151 ceph-mon[35013]: pgmap v224: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 146 op/s 2024-09-05T01:32:03.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:03 smithi012 ceph-mon[29942]: pgmap v225: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 134 op/s 2024-09-05T01:32:03.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:03 smithi145 ceph-mon[34376]: pgmap v225: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 134 op/s 2024-09-05T01:32:03.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:03 smithi151 ceph-mon[35013]: pgmap v225: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 134 op/s 2024-09-05T01:32:05.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:05 smithi012 ceph-mon[29942]: pgmap v226: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.2 MiB/s wr, 153 op/s 2024-09-05T01:32:05.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:05 smithi145 ceph-mon[34376]: pgmap v226: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.2 MiB/s wr, 153 op/s 2024-09-05T01:32:05.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:05 smithi151 ceph-mon[35013]: pgmap v226: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.2 MiB/s wr, 153 op/s 2024-09-05T01:32:07.406 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:07 smithi151 ceph-mon[35013]: pgmap v227: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 70 op/s 2024-09-05T01:32:07.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:07 smithi012 ceph-mon[29942]: pgmap v227: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 70 op/s 2024-09-05T01:32:07.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:07 smithi145 ceph-mon[34376]: pgmap v227: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 70 op/s 2024-09-05T01:32:08.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:08 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:32:08.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:08 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:32:08.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:08 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:32:08.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:08 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:32:08.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:08 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:32:08.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:08 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:32:08.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:08 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:32:08.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:08 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:32:08.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:08 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:32:08.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:08 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:32:08.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:08 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:32:08.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:08 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:32:08.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:08 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:32:08.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:08 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:32:08.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:08 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:32:08.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:08 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:32:08.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:08 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:32:08.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:08 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:32:09.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:09 smithi012 ceph-mon[29942]: pgmap v228: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 69 op/s 2024-09-05T01:32:09.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:09 smithi145 ceph-mon[34376]: pgmap v228: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 69 op/s 2024-09-05T01:32:09.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:09 smithi151 ceph-mon[35013]: pgmap v228: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 69 op/s 2024-09-05T01:32:11.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:11 smithi012 ceph-mon[29942]: pgmap v229: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 65 op/s 2024-09-05T01:32:11.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:11 smithi145 ceph-mon[34376]: pgmap v229: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 65 op/s 2024-09-05T01:32:11.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:11 smithi151 ceph-mon[35013]: pgmap v229: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 65 op/s 2024-09-05T01:32:13.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:13 smithi012 ceph-mon[29942]: pgmap v230: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 50 op/s 2024-09-05T01:32:13.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:13 smithi145 ceph-mon[34376]: pgmap v230: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 50 op/s 2024-09-05T01:32:13.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:13 smithi151 ceph-mon[35013]: pgmap v230: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 50 op/s 2024-09-05T01:32:15.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:15 smithi012 ceph-mon[29942]: pgmap v231: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 57 op/s 2024-09-05T01:32:15.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:15 smithi145 ceph-mon[34376]: pgmap v231: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 57 op/s 2024-09-05T01:32:15.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:15 smithi151 ceph-mon[35013]: pgmap v231: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 57 op/s 2024-09-05T01:32:17.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:17 smithi012 ceph-mon[29942]: pgmap v232: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 285 KiB/s wr, 38 op/s 2024-09-05T01:32:17.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:17 smithi145 ceph-mon[34376]: pgmap v232: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 285 KiB/s wr, 38 op/s 2024-09-05T01:32:17.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:17 smithi151 ceph-mon[35013]: pgmap v232: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 285 KiB/s wr, 38 op/s 2024-09-05T01:32:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:19 smithi012 ceph-mon[29942]: pgmap v233: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 346 KiB/s wr, 33 op/s 2024-09-05T01:32:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:19 smithi012 ceph-mon[29942]: osdmap e89: 12 total, 12 up, 12 in 2024-09-05T01:32:19.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:19 smithi145 ceph-mon[34376]: pgmap v233: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 346 KiB/s wr, 33 op/s 2024-09-05T01:32:19.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:19 smithi145 ceph-mon[34376]: osdmap e89: 12 total, 12 up, 12 in 2024-09-05T01:32:19.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:19 smithi151 ceph-mon[35013]: pgmap v233: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 346 KiB/s wr, 33 op/s 2024-09-05T01:32:19.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:19 smithi151 ceph-mon[35013]: osdmap e89: 12 total, 12 up, 12 in 2024-09-05T01:32:21.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:21 smithi012 ceph-mon[29942]: pgmap v235: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 410 KiB/s wr, 38 op/s 2024-09-05T01:32:21.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:21 smithi145 ceph-mon[34376]: pgmap v235: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 410 KiB/s wr, 38 op/s 2024-09-05T01:32:21.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:21 smithi151 ceph-mon[35013]: pgmap v235: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 410 KiB/s wr, 38 op/s 2024-09-05T01:32:23.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:23 smithi012 ceph-mon[29942]: pgmap v236: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 410 KiB/s wr, 38 op/s 2024-09-05T01:32:23.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:23 smithi145 ceph-mon[34376]: pgmap v236: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 410 KiB/s wr, 38 op/s 2024-09-05T01:32:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:23 smithi151 ceph-mon[35013]: pgmap v236: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 410 KiB/s wr, 38 op/s 2024-09-05T01:32:25.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:25 smithi012 ceph-mon[29942]: pgmap v237: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 541 KiB/s wr, 41 op/s 2024-09-05T01:32:25.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:25 smithi145 ceph-mon[34376]: pgmap v237: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 541 KiB/s wr, 41 op/s 2024-09-05T01:32:25.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:25 smithi151 ceph-mon[35013]: pgmap v237: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 541 KiB/s wr, 41 op/s 2024-09-05T01:32:26.249 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T01:32:26.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:26 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:32:26.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:26 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:32:26.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:26 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:32:26.647 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:32:27.339 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:27 smithi012 ceph-mon[29942]: pgmap v238: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 541 KiB/s wr, 42 op/s 2024-09-05T01:32:27.339 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:27 smithi012 ceph-mon[29942]: osdmap e90: 12 total, 12 up, 12 in 2024-09-05T01:32:27.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.363+0000 7f12ccc00640 1 -- 172.21.15.12:0/3944421282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12c8076720 msgr2=0x7f12c8076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:27.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.363+0000 7f12ccc00640 1 --2- 172.21.15.12:0/3944421282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12c8076720 0x7f12c8076b00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f12b8009900 tx=0x7f12b802a410 comp rx=0 tx=0).stop 2024-09-05T01:32:27.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.363+0000 7f12ccc00640 1 -- 172.21.15.12:0/3944421282 shutdown_connections 2024-09-05T01:32:27.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.363+0000 7f12ccc00640 1 --2- 172.21.15.12:0/3944421282 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12c8112870 0x7f12c8114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.363+0000 7f12ccc00640 1 --2- 172.21.15.12:0/3944421282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12c8077040 0x7f12c8112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.363+0000 7f12ccc00640 1 --2- 172.21.15.12:0/3944421282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12c8076720 0x7f12c8076b00 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.363+0000 7f12ccc00640 1 -- 172.21.15.12:0/3944421282 >> 172.21.15.12:0/3944421282 conn(0x7f12c80ff8d0 msgr2=0x7f12c8101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:27.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.363+0000 7f12ccc00640 1 -- 172.21.15.12:0/3944421282 shutdown_connections 2024-09-05T01:32:27.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.363+0000 7f12ccc00640 1 -- 172.21.15.12:0/3944421282 wait complete. 2024-09-05T01:32:27.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.365+0000 7f12ccc00640 1 Processor -- start 2024-09-05T01:32:27.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.365+0000 7f12ccc00640 1 -- start start 2024-09-05T01:32:27.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.365+0000 7f12ccc00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12c8076720 0x7f12c81a4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:27.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.365+0000 7f12ccc00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12c8077040 0x7f12c81a4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:27.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.365+0000 7f12ccc00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12c8112870 0x7f12c819e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:27.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.365+0000 7f12ccc00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f12c8118450 con 0x7f12c8077040 2024-09-05T01:32:27.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.365+0000 7f12ccc00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f12c81182d0 con 0x7f12c8076720 2024-09-05T01:32:27.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.365+0000 7f12ccc00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f12c81185d0 con 0x7f12c8112870 2024-09-05T01:32:27.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.366+0000 7f12bfe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12c8077040 0x7f12c81a4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:27.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.366+0000 7f12c7400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12c8076720 0x7f12c81a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:27.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.366+0000 7f12c7400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12c8076720 0x7f12c81a4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:49432/0 (socket says 172.21.15.12:49432) 2024-09-05T01:32:27.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.366+0000 7f12c7400640 1 -- 172.21.15.12:0/1871609790 learned_addr learned my addr 172.21.15.12:0/1871609790 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:27.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.366+0000 7f12c7e00640 1 --2- 172.21.15.12:0/1871609790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12c8112870 0x7f12c819e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:27.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.366+0000 7f12c7400640 1 -- 172.21.15.12:0/1871609790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12c8112870 msgr2=0x7f12c819e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:27.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.366+0000 7f12c7400640 1 --2- 172.21.15.12:0/1871609790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12c8112870 0x7f12c819e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.366+0000 7f12c7400640 1 -- 172.21.15.12:0/1871609790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12c8077040 msgr2=0x7f12c81a4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:27.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.366+0000 7f12c7400640 1 --2- 172.21.15.12:0/1871609790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12c8077040 0x7f12c81a4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.366+0000 7f12c7400640 1 -- 172.21.15.12:0/1871609790 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c819ef50 con 0x7f12c8076720 2024-09-05T01:32:27.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.366+0000 7f12c7e00640 1 --2- 172.21.15.12:0/1871609790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12c8112870 0x7f12c819e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:32:27.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.366+0000 7f12bfe00640 1 --2- 172.21.15.12:0/1871609790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12c8077040 0x7f12c81a4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:32:27.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.367+0000 7f12c7400640 1 --2- 172.21.15.12:0/1871609790 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12c8076720 0x7f12c81a4610 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f12b8004770 tx=0x7f12b8003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:27.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.367+0000 7f12c4c00640 1 -- 172.21.15.12:0/1871609790 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b803f070 con 0x7f12c8076720 2024-09-05T01:32:27.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.367+0000 7f12c4c00640 1 -- 172.21.15.12:0/1871609790 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12b8031ca0 con 0x7f12c8076720 2024-09-05T01:32:27.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.367+0000 7f12ccc00640 1 -- 172.21.15.12:0/1871609790 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12c819f1e0 con 0x7f12c8076720 2024-09-05T01:32:27.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.367+0000 7f12c4c00640 1 -- 172.21.15.12:0/1871609790 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b8035030 con 0x7f12c8076720 2024-09-05T01:32:27.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.367+0000 7f12ccc00640 1 -- 172.21.15.12:0/1871609790 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12c81ab3c0 con 0x7f12c8076720 2024-09-05T01:32:27.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.370+0000 7f12d0dde740 1 Processor -- start 2024-09-05T01:32:27.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.370+0000 7f12c4c00640 1 -- 172.21.15.12:0/1871609790 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f12b8042070 con 0x7f12c8076720 2024-09-05T01:32:27.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.371+0000 7f12d0dde740 1 -- start start 2024-09-05T01:32:27.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.371+0000 7f12d0dde740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc5fc79d50 0x55cc5fc7a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:27.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.371+0000 7f12d0dde740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc5fc7a670 0x55cc5fc849f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:27.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.371+0000 7f12d0dde740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc84f30 0x55cc5fc87320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:27.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.371+0000 7f12d0dde740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cc5fbe03e0 con 0x55cc5fc7a670 2024-09-05T01:32:27.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.371+0000 7f12d0dde740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55cc5fb87d80 con 0x55cc5fc79d50 2024-09-05T01:32:27.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.371+0000 7f12d0dde740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55cc5fbdc3a0 con 0x55cc5fc84f30 2024-09-05T01:32:27.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.371+0000 7f12c7e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc5fc79d50 0x55cc5fc7a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:27.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.371+0000 7f12c7400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc5fc7a670 0x55cc5fc849f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:27.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.372+0000 7f12bfe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc84f30 0x55cc5fc87320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:27.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.372+0000 7f12c7400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc5fc7a670 0x55cc5fc849f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56338/0 (socket says 172.21.15.12:56338) 2024-09-05T01:32:27.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.372+0000 7f12bfe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc84f30 0x55cc5fc87320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:51884/0 (socket says 172.21.15.12:51884) 2024-09-05T01:32:27.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.372+0000 7f12c7e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc5fc79d50 0x55cc5fc7a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:49440/0 (socket says 172.21.15.12:49440) 2024-09-05T01:32:27.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.372+0000 7f12c7400640 1 -- 172.21.15.12:0/1019461211 learned_addr learned my addr 172.21.15.12:0/1019461211 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:27.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.372+0000 7f12bfe00640 1 -- 172.21.15.12:0/1019461211 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc5fc79d50 msgr2=0x55cc5fc7a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:27.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.372+0000 7f12bfe00640 1 --2- 172.21.15.12:0/1019461211 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc5fc79d50 0x55cc5fc7a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.372+0000 7f12bfe00640 1 -- 172.21.15.12:0/1019461211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc5fc7a670 msgr2=0x55cc5fc849f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:27.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.372+0000 7f12bfe00640 1 --2- 172.21.15.12:0/1019461211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc5fc7a670 0x55cc5fc849f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.372+0000 7f12bfe00640 1 -- 172.21.15.12:0/1019461211 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc5fba6ae0 con 0x55cc5fc84f30 2024-09-05T01:32:27.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.372+0000 7f12c7e00640 1 --2- 172.21.15.12:0/1019461211 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc5fc79d50 0x55cc5fc7a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:32:27.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.373+0000 7f12c4c00640 1 --2- 172.21.15.12:0/1871609790 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f12ac0a2cf0 0x7f12ac0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:27.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.373+0000 7f12bfe00640 1 --2- 172.21.15.12:0/1019461211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc84f30 0x55cc5fc87320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f12b0009fa0 tx=0x7f12b00118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65b803fe113dd201 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:27.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.373+0000 7f12c4c00640 1 -- 172.21.15.12:0/1871609790 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7f12b80ef760 con 0x7f12c8076720 2024-09-05T01:32:27.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.373+0000 7f12b7e00640 1 -- 172.21.15.12:0/1019461211 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b0004310 con 0x55cc5fc84f30 2024-09-05T01:32:27.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.373+0000 7f12b7e00640 1 -- 172.21.15.12:0/1019461211 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12b00044b0 con 0x55cc5fc84f30 2024-09-05T01:32:27.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.373+0000 7f12b7e00640 1 -- 172.21.15.12:0/1019461211 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b00035f0 con 0x55cc5fc84f30 2024-09-05T01:32:27.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.373+0000 7f12c7e00640 1 --2- 172.21.15.12:0/1871609790 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f12ac0a2cf0 0x7f12ac0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:27.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.374+0000 7f12d0dde740 1 -- 172.21.15.12:0/1019461211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc84f30 msgr2=0x55cc5fc87320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:27.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.374+0000 7f12d0dde740 1 --2- 172.21.15.12:0/1019461211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc84f30 0x55cc5fc87320 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f12b0009fa0 tx=0x7f12b00118d0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.374+0000 7f12c7e00640 1 --2- 172.21.15.12:0/1871609790 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f12ac0a2cf0 0x7f12ac0a51b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f12c806b3d0 tx=0x7f12c0009500 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:27.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.374+0000 7f12d0dde740 1 -- 172.21.15.12:0/1019461211 shutdown_connections 2024-09-05T01:32:27.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.374+0000 7f12d0dde740 1 --2- 172.21.15.12:0/1019461211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc84f30 0x55cc5fc87320 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.374+0000 7f12d0dde740 1 --2- 172.21.15.12:0/1019461211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc5fc7a670 0x55cc5fc849f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.374+0000 7f12d0dde740 1 --2- 172.21.15.12:0/1019461211 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc5fc79d50 0x55cc5fc7a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.374+0000 7f12d0dde740 1 -- 172.21.15.12:0/1019461211 >> 172.21.15.12:0/1019461211 conn(0x55cc5fc762e0 msgr2=0x55cc5fc766c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:27.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.374+0000 7f12d0dde740 1 -- 172.21.15.12:0/1019461211 shutdown_connections 2024-09-05T01:32:27.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.374+0000 7f12d0dde740 1 -- 172.21.15.12:0/1019461211 wait complete. 2024-09-05T01:32:27.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.374+0000 7f12d0dde740 1 -- start start 2024-09-05T01:32:27.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.375+0000 7f12d0dde740 1 Processor -- start 2024-09-05T01:32:27.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.375+0000 7f12d0dde740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc5fc79d50 0x55cc5fc81e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:27.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.375+0000 7f12d0dde740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc5fc7a670 0x55cc5fc82390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:27.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.375+0000 7f12d0dde740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc84f30 0x55cc5fc828d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:27.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.375+0000 7f12d0dde740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cc5fc87ba0 con 0x55cc5fc79d50 2024-09-05T01:32:27.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.375+0000 7f12d0dde740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55cc5fb9b0f0 con 0x55cc5fc7a670 2024-09-05T01:32:27.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.375+0000 7f12d0dde740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55cc5fc87d20 con 0x55cc5fc84f30 2024-09-05T01:32:27.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.375+0000 7f12d0dde740 10 client.0 _ll_register_callbacks cb 0x55cc5fb8c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:32:27.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.375+0000 7f12c7400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc5fc79d50 0x55cc5fc81e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:27.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.375+0000 7f12c7e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc84f30 0x55cc5fc828d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:27.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.375+0000 7f12bfe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc5fc7a670 0x55cc5fc82390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:27.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.376+0000 7f12bfe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc5fc7a670 0x55cc5fc82390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:49452/0 (socket says 172.21.15.12:49452) 2024-09-05T01:32:27.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.376+0000 7f12c7400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc5fc79d50 0x55cc5fc81e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56342/0 (socket says 172.21.15.12:56342) 2024-09-05T01:32:27.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.376+0000 7f12bfe00640 1 -- 172.21.15.12:0/2774083105 learned_addr learned my addr 172.21.15.12:0/2774083105 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:27.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.376+0000 7f12c7e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc84f30 0x55cc5fc828d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:51888/0 (socket says 172.21.15.12:51888) 2024-09-05T01:32:27.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.376+0000 7f12c7e00640 1 -- 172.21.15.12:0/2774083105 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc5fc7a670 msgr2=0x55cc5fc82390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:27.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.376+0000 7f12c7e00640 1 --2- 172.21.15.12:0/2774083105 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc5fc7a670 0x55cc5fc82390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.376+0000 7f12c7e00640 1 -- 172.21.15.12:0/2774083105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc5fc79d50 msgr2=0x55cc5fc81e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:27.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.376+0000 7f12c7e00640 1 --2- 172.21.15.12:0/2774083105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc5fc79d50 0x55cc5fc81e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.376+0000 7f12c7e00640 1 -- 172.21.15.12:0/2774083105 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc5f9513c0 con 0x55cc5fc84f30 2024-09-05T01:32:27.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.376+0000 7f12c7e00640 1 --2- 172.21.15.12:0/2774083105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc84f30 0x55cc5fc828d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f12c000ff40 tx=0x7f12c0004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2346b66ee1cbeeec server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:27.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.376+0000 7f12b4c00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:32:27.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.377+0000 7f12b4c00640 1 -- 172.21.15.12:0/2774083105 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c0003e00 con 0x55cc5fc84f30 2024-09-05T01:32:27.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.377+0000 7f12d0dde740 1 -- 172.21.15.12:0/2774083105 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12b00044b0 con 0x55cc5fc84f30 2024-09-05T01:32:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.377+0000 7f12b4c00640 1 -- 172.21.15.12:0/2774083105 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7f12c00047c0 con 0x55cc5fc84f30 2024-09-05T01:32:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.377+0000 7f12b4c00640 1 -- 172.21.15.12:0/2774083105 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f12c0029440 con 0x55cc5fc84f30 2024-09-05T01:32:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.377+0000 7f12d0dde740 10 client.26110 fetch_fsmap learned FSMap version 44 2024-09-05T01:32:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.377+0000 7f12d0dde740 1 -- 172.21.15.12:0/2774083105 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55cc5fc93960 con 0x55cc5fc84f30 2024-09-05T01:32:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.377+0000 7f12b4c00640 1 -- 172.21.15.12:0/2774083105 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12b00044b0 con 0x55cc5fc84f30 2024-09-05T01:32:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.377+0000 7f12b4c00640 1 -- 172.21.15.12:0/2774083105 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 44) ==== 8426+0+0 (secure 0 0 0) 0x7f12c0027020 con 0x55cc5fc84f30 2024-09-05T01:32:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.377+0000 7f12d0dde740 10 client.26110 fetch_fsmap finished waiting for FSMap version 44 2024-09-05T01:32:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.377+0000 7f12d0dde740 10 client.26110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:32:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.378+0000 7f12d0dde740 20 client.26110 populate_metadata read hostname 'smithi012' 2024-09-05T01:32:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.378+0000 7f12d0dde740 1 --2- 172.21.15.12:0/2774083105 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55cc5fc94e80 0x55cc5fc972f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.378+0000 7f12d0dde740 4 client.26110 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:32:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.378+0000 7f12d0dde740 1 -- 172.21.15.12:0/2774083105 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc5fbed950 con 0x55cc5fc94e80 2024-09-05T01:32:27.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.378+0000 7f12c7400640 1 --2- 172.21.15.12:0/2774083105 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55cc5fc94e80 0x55cc5fc972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:27.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.378+0000 7f12c7400640 1 --2- 172.21.15.12:0/2774083105 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55cc5fc94e80 0x55cc5fc972f0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df09323a2d602b6 server_cookie=3403c1fa7559fa90 in_seq=0 out_seq=0 2024-09-05T01:32:27.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.378+0000 7f12b4c00640 10 client.26110 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:32:27.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.379+0000 7f12b4c00640 1 -- 172.21.15.12:0/2774083105 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cc5fbed950 con 0x55cc5fc94e80 2024-09-05T01:32:27.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.380+0000 7f12b4c00640 10 client.26110 handle_command_reply: tid=0 2024-09-05T01:32:27.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.380+0000 7f12d0dde740 1 client.26110 shutdown 2024-09-05T01:32:27.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.380+0000 7f12d0dde740 1 -- 172.21.15.12:0/2774083105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc84f30 msgr2=0x55cc5fc828d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:27.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.380+0000 7f12d0dde740 1 --2- 172.21.15.12:0/2774083105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc84f30 0x55cc5fc828d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f12c000ff40 tx=0x7f12c0004ab0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.380+0000 7f12d0dde740 1 -- 172.21.15.12:0/2774083105 shutdown_connections 2024-09-05T01:32:27.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.380+0000 7f12d0dde740 1 --2- 172.21.15.12:0/2774083105 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55cc5fc94e80 0x55cc5fc972f0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.380+0000 7f12d0dde740 1 --2- 172.21.15.12:0/2774083105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc84f30 0x55cc5fc828d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.380+0000 7f12d0dde740 1 --2- 172.21.15.12:0/2774083105 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc5fc7a670 0x55cc5fc82390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.380+0000 7f12d0dde740 1 --2- 172.21.15.12:0/2774083105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc5fc79d50 0x55cc5fc81e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.380+0000 7f12b4c00640 0 client.26110 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:32:27.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.380+0000 7f12d0dde740 1 -- 172.21.15.12:0/2774083105 >> 172.21.15.12:0/2774083105 conn(0x55cc5fc762e0 msgr2=0x55cc5fc7c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:27.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.380+0000 7f12d0dde740 1 -- 172.21.15.12:0/2774083105 shutdown_connections 2024-09-05T01:32:27.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.380+0000 7f12d0dde740 1 -- 172.21.15.12:0/2774083105 wait complete. 2024-09-05T01:32:27.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.380+0000 7f12d0dde740 20 client.26110 trim_cache size 0 max 16384 2024-09-05T01:32:27.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.399+0000 7f12d0dde740 1 Processor -- start 2024-09-05T01:32:27.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.399+0000 7f12d0dde740 1 -- start start 2024-09-05T01:32:27.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.399+0000 7f12d0dde740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc5fc79d50 0x55cc5fc81710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:27.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.399+0000 7f12d0dde740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc5fc7a670 0x55cc5fc9cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:27.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.399+0000 7f12d0dde740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc84f30 0x55cc5fc9d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:27.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.399+0000 7f12d0dde740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f12c81b3df0 con 0x55cc5fc79d50 2024-09-05T01:32:27.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.399+0000 7f12d0dde740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f12c81b5ab0 con 0x55cc5fc7a670 2024-09-05T01:32:27.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.399+0000 7f12d0dde740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f12c81b44c0 con 0x55cc5fc84f30 2024-09-05T01:32:27.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.400+0000 7f12c7400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc5fc79d50 0x55cc5fc81710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:27.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.400+0000 7f12bfe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc5fc7a670 0x55cc5fc9cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:27.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.400+0000 7f12c7400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc5fc79d50 0x55cc5fc81710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56354/0 (socket says 172.21.15.12:56354) 2024-09-05T01:32:27.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.400+0000 7f12c7400640 1 -- 172.21.15.12:0/3899167294 learned_addr learned my addr 172.21.15.12:0/3899167294 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:27.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.400+0000 7f12c7e00640 1 --2- 172.21.15.12:0/3899167294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc84f30 0x55cc5fc9d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:27.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.400+0000 7f12c7400640 1 -- 172.21.15.12:0/3899167294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc84f30 msgr2=0x55cc5fc9d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:27.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.400+0000 7f12c7400640 1 --2- 172.21.15.12:0/3899167294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc84f30 0x55cc5fc9d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.400+0000 7f12c7400640 1 -- 172.21.15.12:0/3899167294 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc5fc7a670 msgr2=0x55cc5fc9cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:27.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.400+0000 7f12c7400640 1 --2- 172.21.15.12:0/3899167294 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc5fc7a670 0x55cc5fc9cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.400+0000 7f12c7400640 1 -- 172.21.15.12:0/3899167294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc5fc93770 con 0x55cc5fc79d50 2024-09-05T01:32:27.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.400+0000 7f12c7400640 1 --2- 172.21.15.12:0/3899167294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc5fc79d50 0x55cc5fc81710 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f12b80bbce0 tx=0x7f12b80f1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6724fb673d5812d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:27.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.401+0000 7f12b7400640 1 -- 172.21.15.12:0/3899167294 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b8049040 con 0x55cc5fc79d50 2024-09-05T01:32:27.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.401+0000 7f12b7400640 1 -- 172.21.15.12:0/3899167294 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12b80bbd50 con 0x55cc5fc79d50 2024-09-05T01:32:27.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.401+0000 7f12b7400640 1 -- 172.21.15.12:0/3899167294 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b80ba0e0 con 0x55cc5fc79d50 2024-09-05T01:32:27.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.401+0000 7f12d0dde740 1 -- 172.21.15.12:0/3899167294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc5fc79d50 msgr2=0x55cc5fc81710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:27.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.401+0000 7f12d0dde740 1 --2- 172.21.15.12:0/3899167294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc5fc79d50 0x55cc5fc81710 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f12b80bbce0 tx=0x7f12b80f1040 comp rx=0 tx=0).stop 2024-09-05T01:32:27.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.402+0000 7f12d0dde740 1 -- 172.21.15.12:0/3899167294 shutdown_connections 2024-09-05T01:32:27.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.402+0000 7f12d0dde740 1 --2- 172.21.15.12:0/3899167294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc84f30 0x55cc5fc9d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.402+0000 7f12d0dde740 1 --2- 172.21.15.12:0/3899167294 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc5fc7a670 0x55cc5fc9cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.402+0000 7f12d0dde740 1 --2- 172.21.15.12:0/3899167294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc5fc79d50 0x55cc5fc81710 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.402+0000 7f12d0dde740 1 -- 172.21.15.12:0/3899167294 >> 172.21.15.12:0/3899167294 conn(0x55cc5fc762e0 msgr2=0x55cc5fc766c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:27.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.402+0000 7f12d0dde740 1 -- 172.21.15.12:0/3899167294 shutdown_connections 2024-09-05T01:32:27.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.402+0000 7f12d0dde740 1 -- 172.21.15.12:0/3899167294 wait complete. 2024-09-05T01:32:27.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.402+0000 7f12d0dde740 1 -- start start 2024-09-05T01:32:27.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.402+0000 7f12d0dde740 1 Processor -- start 2024-09-05T01:32:27.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.403+0000 7f12d0dde740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc79d50 0x55cc5fc8d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:27.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.403+0000 7f12d0dde740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc5fc7a670 0x55cc5fc887e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:27.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.403+0000 7f12d0dde740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc5fc84f30 0x55cc5fc88d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:27.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.403+0000 7f12d0dde740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f12c81b5320 con 0x55cc5fc7a670 2024-09-05T01:32:27.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.403+0000 7f12d0dde740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f12c81b4c20 con 0x55cc5fc84f30 2024-09-05T01:32:27.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.403+0000 7f12d0dde740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f12c81b1df0 con 0x55cc5fc79d50 2024-09-05T01:32:27.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.403+0000 7f12d0dde740 10 client.0 _ll_register_callbacks cb 0x7f12c000fe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:32:27.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.403+0000 7f12c7400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc79d50 0x55cc5fc8d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:27.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.403+0000 7f12c7400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc79d50 0x55cc5fc8d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:51896/0 (socket says 172.21.15.12:51896) 2024-09-05T01:32:27.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.403+0000 7f12bfe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc5fc7a670 0x55cc5fc887e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:27.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.403+0000 7f12c7400640 1 -- 172.21.15.12:0/2498698816 learned_addr learned my addr 172.21.15.12:0/2498698816 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:27.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.403+0000 7f12c7e00640 1 --2- 172.21.15.12:0/2498698816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc5fc84f30 0x55cc5fc88d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:27.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.404+0000 7f12c7400640 1 -- 172.21.15.12:0/2498698816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc5fc84f30 msgr2=0x55cc5fc88d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:27.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.404+0000 7f12c7400640 1 --2- 172.21.15.12:0/2498698816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc5fc84f30 0x55cc5fc88d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.404+0000 7f12c7400640 1 -- 172.21.15.12:0/2498698816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc5fc7a670 msgr2=0x55cc5fc887e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:27.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.404+0000 7f12c7400640 1 --2- 172.21.15.12:0/2498698816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc5fc7a670 0x55cc5fc887e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.404+0000 7f12c7400640 1 -- 172.21.15.12:0/2498698816 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc5fc892e0 con 0x55cc5fc79d50 2024-09-05T01:32:27.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.404+0000 7f12c7400640 1 --2- 172.21.15.12:0/2498698816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc79d50 0x55cc5fc8d4b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f12b80f4010 tx=0x7f12b80bbbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d80ade6c82f93ef5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:27.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.404+0000 7f12b4c00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:32:27.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.404+0000 7f12b4c00640 1 -- 172.21.15.12:0/2498698816 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b8049070 con 0x55cc5fc79d50 2024-09-05T01:32:27.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.404+0000 7f12b4c00640 1 -- 172.21.15.12:0/2498698816 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7f12b80b83c0 con 0x55cc5fc79d50 2024-09-05T01:32:27.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.404+0000 7f12d0dde740 1 -- 172.21.15.12:0/2498698816 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12b80bbd50 con 0x55cc5fc79d50 2024-09-05T01:32:27.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.404+0000 7f12b4c00640 1 -- 172.21.15.12:0/2498698816 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f12b80bb890 con 0x55cc5fc79d50 2024-09-05T01:32:27.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.404+0000 7f12d0dde740 10 client.26116 fetch_fsmap learned FSMap version 44 2024-09-05T01:32:27.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.404+0000 7f12d0dde740 1 -- 172.21.15.12:0/2498698816 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55cc5fcff9b0 con 0x55cc5fc79d50 2024-09-05T01:32:27.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.405+0000 7f12b4c00640 1 -- 172.21.15.12:0/2498698816 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12b80bbd50 con 0x55cc5fc79d50 2024-09-05T01:32:27.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.405+0000 7f12b4c00640 1 -- 172.21.15.12:0/2498698816 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 44) ==== 8426+0+0 (secure 0 0 0) 0x7f12b80ed090 con 0x55cc5fc79d50 2024-09-05T01:32:27.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.405+0000 7f12d0dde740 10 client.26116 fetch_fsmap finished waiting for FSMap version 44 2024-09-05T01:32:27.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.405+0000 7f12d0dde740 10 client.26116 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:32:27.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.405+0000 7f12d0dde740 20 client.26116 populate_metadata read hostname 'smithi012' 2024-09-05T01:32:27.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.405+0000 7f12d0dde740 1 --2- 172.21.15.12:0/2498698816 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55cc5fd00110 0x55cc5fd02530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:27.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.405+0000 7f12d0dde740 4 client.26116 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T01:32:27.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.405+0000 7f12d0dde740 1 -- 172.21.15.12:0/2498698816 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cc5fbe7e60 con 0x55cc5fd00110 2024-09-05T01:32:27.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.405+0000 7f12bfe00640 1 --2- 172.21.15.12:0/2498698816 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55cc5fd00110 0x55cc5fd02530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:27.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.406+0000 7f12bfe00640 1 --2- 172.21.15.12:0/2498698816 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55cc5fd00110 0x55cc5fd02530 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d9a380d9944d512 server_cookie=e46cfd404d1cb0f1 in_seq=0 out_seq=0 2024-09-05T01:32:27.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.406+0000 7f12b4c00640 10 client.26116 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:32:27.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.407+0000 7f12b4c00640 1 -- 172.21.15.12:0/2498698816 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55cc5fbe7e60 con 0x55cc5fd00110 2024-09-05T01:32:27.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.407+0000 7f12b4c00640 10 client.26116 handle_command_reply: tid=0 2024-09-05T01:32:27.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.407+0000 7f12d0dde740 1 client.26116 shutdown 2024-09-05T01:32:27.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.407+0000 7f12d0dde740 1 -- 172.21.15.12:0/2498698816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc79d50 msgr2=0x55cc5fc8d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:27.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.407+0000 7f12d0dde740 1 --2- 172.21.15.12:0/2498698816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc79d50 0x55cc5fc8d4b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f12b80f4010 tx=0x7f12b80bbbe0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.407+0000 7f12d0dde740 1 -- 172.21.15.12:0/2498698816 shutdown_connections 2024-09-05T01:32:27.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.407+0000 7f12d0dde740 1 --2- 172.21.15.12:0/2498698816 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55cc5fd00110 0x55cc5fd02530 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.407+0000 7f12d0dde740 1 --2- 172.21.15.12:0/2498698816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55cc5fc84f30 0x55cc5fc88d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.407+0000 7f12d0dde740 1 --2- 172.21.15.12:0/2498698816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cc5fc7a670 0x55cc5fc887e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.407+0000 7f12d0dde740 1 --2- 172.21.15.12:0/2498698816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cc5fc79d50 0x55cc5fc8d4b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.407+0000 7f12b4c00640 0 client.26116 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:32:27.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.407+0000 7f12d0dde740 1 -- 172.21.15.12:0/2498698816 >> 172.21.15.12:0/2498698816 conn(0x55cc5fc762e0 msgr2=0x55cc5fc81e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:27.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.408+0000 7f12d0dde740 1 -- 172.21.15.12:0/2498698816 shutdown_connections 2024-09-05T01:32:27.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.408+0000 7f12d0dde740 1 -- 172.21.15.12:0/2498698816 wait complete. 2024-09-05T01:32:27.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.408+0000 7f12d0dde740 20 client.26116 trim_cache size 0 max 16384 2024-09-05T01:32:27.413 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:32:27.413 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-05T01:32:27.413 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-05T01:32:27.413 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:32:27.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.408+0000 7f12ccc00640 1 -- 172.21.15.12:0/1871609790 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f12ac0a2cf0 msgr2=0x7f12ac0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:27.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.408+0000 7f12ccc00640 1 --2- 172.21.15.12:0/1871609790 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f12ac0a2cf0 0x7f12ac0a51b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f12c806b3d0 tx=0x7f12c0009500 comp rx=0 tx=0).stop 2024-09-05T01:32:27.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.408+0000 7f12ccc00640 1 -- 172.21.15.12:0/1871609790 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12c8076720 msgr2=0x7f12c81a4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:27.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.408+0000 7f12ccc00640 1 --2- 172.21.15.12:0/1871609790 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12c8076720 0x7f12c81a4610 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f12b8004770 tx=0x7f12b8003c10 comp rx=0 tx=0).stop 2024-09-05T01:32:27.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.409+0000 7f12ccc00640 1 -- 172.21.15.12:0/1871609790 shutdown_connections 2024-09-05T01:32:27.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.409+0000 7f12ccc00640 1 --2- 172.21.15.12:0/1871609790 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f12ac0a2cf0 0x7f12ac0a51b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.409+0000 7f12ccc00640 1 --2- 172.21.15.12:0/1871609790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12c8112870 0x7f12c819e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.409+0000 7f12ccc00640 1 --2- 172.21.15.12:0/1871609790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12c8077040 0x7f12c81a4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.409+0000 7f12ccc00640 1 --2- 172.21.15.12:0/1871609790 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f12c8076720 0x7f12c81a4610 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:27.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.409+0000 7f12ccc00640 1 -- 172.21.15.12:0/1871609790 >> 172.21.15.12:0/1871609790 conn(0x7f12c80ff8d0 msgr2=0x7f12c8101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:27.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.409+0000 7f12ccc00640 1 -- 172.21.15.12:0/1871609790 shutdown_connections 2024-09-05T01:32:27.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:27.410+0000 7f12ccc00640 1 -- 172.21.15.12:0/1871609790 wait complete. 2024-09-05T01:32:27.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:27 smithi145 ceph-mon[34376]: pgmap v238: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 541 KiB/s wr, 42 op/s 2024-09-05T01:32:27.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:27 smithi145 ceph-mon[34376]: osdmap e90: 12 total, 12 up, 12 in 2024-09-05T01:32:27.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:27 smithi151 ceph-mon[35013]: pgmap v238: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 541 KiB/s wr, 42 op/s 2024-09-05T01:32:27.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:27 smithi151 ceph-mon[35013]: osdmap e90: 12 total, 12 up, 12 in 2024-09-05T01:32:28.281 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-05T01:32:28.281 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:32:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:28 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:32:28.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:28 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:32:28.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:28 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:32:28.663 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:32:29.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.203+0000 7f8a52400640 1 -- 172.21.15.12:0/4246750099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a4c103660 msgr2=0x7f8a4c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:29.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.203+0000 7f8a52400640 1 --2- 172.21.15.12:0/4246750099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a4c103660 0x7f8a4c10bb50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8a38009900 tx=0x7f8a3802a480 comp rx=0 tx=0).stop 2024-09-05T01:32:29.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.203+0000 7f8a52400640 1 -- 172.21.15.12:0/4246750099 shutdown_connections 2024-09-05T01:32:29.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.203+0000 7f8a52400640 1 --2- 172.21.15.12:0/4246750099 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a4c10c170 0x7f8a4c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:29.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.203+0000 7f8a52400640 1 --2- 172.21.15.12:0/4246750099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a4c103660 0x7f8a4c10bb50 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:29.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.203+0000 7f8a52400640 1 --2- 172.21.15.12:0/4246750099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a4c102d40 0x7f8a4c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:29.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.203+0000 7f8a52400640 1 -- 172.21.15.12:0/4246750099 >> 172.21.15.12:0/4246750099 conn(0x7f8a4c0fc7a0 msgr2=0x7f8a4c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:29.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.203+0000 7f8a52400640 1 -- 172.21.15.12:0/4246750099 shutdown_connections 2024-09-05T01:32:29.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.203+0000 7f8a52400640 1 -- 172.21.15.12:0/4246750099 wait complete. 2024-09-05T01:32:29.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.205+0000 7f8a52400640 1 Processor -- start 2024-09-05T01:32:29.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.205+0000 7f8a52400640 1 -- start start 2024-09-05T01:32:29.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.205+0000 7f8a52400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a4c102d40 0x7f8a4c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:29.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.205+0000 7f8a52400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a4c103660 0x7f8a4c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:29.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.205+0000 7f8a52400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a4c10c170 0x7f8a4c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:29.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.205+0000 7f8a52400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c111f70 con 0x7f8a4c103660 2024-09-05T01:32:29.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.205+0000 7f8a52400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c111df0 con 0x7f8a4c102d40 2024-09-05T01:32:29.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.205+0000 7f8a52400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c1120f0 con 0x7f8a4c10c170 2024-09-05T01:32:29.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.206+0000 7f8a4b400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a4c102d40 0x7f8a4c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:29.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.206+0000 7f8a4aa00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a4c103660 0x7f8a4c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:29.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.206+0000 7f8a4b400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a4c102d40 0x7f8a4c1009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:49490/0 (socket says 172.21.15.12:49490) 2024-09-05T01:32:29.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.206+0000 7f8a4be00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a4c10c170 0x7f8a4c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:29.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.206+0000 7f8a4b400640 1 -- 172.21.15.12:0/2646940212 learned_addr learned my addr 172.21.15.12:0/2646940212 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:29.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.206+0000 7f8a4be00640 1 -- 172.21.15.12:0/2646940212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a4c102d40 msgr2=0x7f8a4c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:29.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.206+0000 7f8a4be00640 1 --2- 172.21.15.12:0/2646940212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a4c102d40 0x7f8a4c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:29.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.206+0000 7f8a4be00640 1 -- 172.21.15.12:0/2646940212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a4c103660 msgr2=0x7f8a4c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:29.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.206+0000 7f8a4be00640 1 --2- 172.21.15.12:0/2646940212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a4c103660 0x7f8a4c100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:29.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.206+0000 7f8a4be00640 1 -- 172.21.15.12:0/2646940212 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4c1a68f0 con 0x7f8a4c10c170 2024-09-05T01:32:29.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.206+0000 7f8a4be00640 1 --2- 172.21.15.12:0/2646940212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a4c10c170 0x7f8a4c101420 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009fd0 tx=0x7f8a4400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:29.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.207+0000 7f8a43e00640 1 -- 172.21.15.12:0/2646940212 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4400ce20 con 0x7f8a4c10c170 2024-09-05T01:32:29.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.207+0000 7f8a52400640 1 -- 172.21.15.12:0/2646940212 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4c1a6be0 con 0x7f8a4c10c170 2024-09-05T01:32:29.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.207+0000 7f8a43e00640 1 -- 172.21.15.12:0/2646940212 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a44010430 con 0x7f8a4c10c170 2024-09-05T01:32:29.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.207+0000 7f8a43e00640 1 -- 172.21.15.12:0/2646940212 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4400f620 con 0x7f8a4c10c170 2024-09-05T01:32:29.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.207+0000 7f8a52400640 1 -- 172.21.15.12:0/2646940212 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a4c1a70f0 con 0x7f8a4c10c170 2024-09-05T01:32:29.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.208+0000 7f8a52400640 1 -- 172.21.15.12:0/2646940212 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a4c103120 con 0x7f8a4c10c170 2024-09-05T01:32:29.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.210+0000 7f8a43e00640 1 -- 172.21.15.12:0/2646940212 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f8a44010950 con 0x7f8a4c10c170 2024-09-05T01:32:29.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.211+0000 7f8a43e00640 1 --2- 172.21.15.12:0/2646940212 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8a300a2d70 0x7f8a300a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:29.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.211+0000 7f8a43e00640 1 -- 172.21.15.12:0/2646940212 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7f8a440cf730 con 0x7f8a4c10c170 2024-09-05T01:32:29.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.211+0000 7f8a4b400640 1 --2- 172.21.15.12:0/2646940212 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8a300a2d70 0x7f8a300a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:29.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.212+0000 7f8a4b400640 1 --2- 172.21.15.12:0/2646940212 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8a300a2d70 0x7f8a300a5230 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009c90 tx=0x7f8a3c005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:29.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.215+0000 7f8a43e00640 1 -- 172.21.15.12:0/2646940212 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8a4409c2b0 con 0x7f8a4c10c170 2024-09-05T01:32:29.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.439+0000 7f8a52400640 1 -- 172.21.15.12:0/2646940212 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a4c02d7c0 con 0x7f8a4c10c170 2024-09-05T01:32:29.440 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:29 smithi012 ceph-mon[29942]: pgmap v240: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 398 KiB/s wr, 36 op/s 2024-09-05T01:32:29.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.440+0000 7f8a43e00640 1 -- 172.21.15.12:0/2646940212 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+12006 (secure 0 0 0) 0x7f8a4409bbb0 con 0x7f8a4c10c170 2024-09-05T01:32:29.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:32:29.441 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 44 2024-09-05T01:32:29.441 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":44,"btime":"2024-09-05T01:32:27:185473+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14532,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/2949711075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":2949711075},{"type":"v1","addr":"172.21.15.12:6839","nonce":2949711075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":44,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T01:22:35.979384+0000","modified":"2024-09-05T01:32:26.970933+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24529,"mds_2":24524,"mds_3":24517,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/497406458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":497406458},{"type":"v1","addr":"172.21.15.12:6841","nonce":497406458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[0,1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":10,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.145:6839/1706431882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":1706431882},{"type":"v1","addr":"172.21.15.145:6839","nonce":1706431882}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24529,24524,24517,24460]},"id":1}]} 2024-09-05T01:32:29.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.442+0000 7f8a52400640 1 -- 172.21.15.12:0/2646940212 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8a300a2d70 msgr2=0x7f8a300a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:29.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.442+0000 7f8a52400640 1 --2- 172.21.15.12:0/2646940212 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8a300a2d70 0x7f8a300a5230 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009c90 tx=0x7f8a3c005f90 comp rx=0 tx=0).stop 2024-09-05T01:32:29.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.442+0000 7f8a52400640 1 -- 172.21.15.12:0/2646940212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a4c10c170 msgr2=0x7f8a4c101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:29.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.442+0000 7f8a52400640 1 --2- 172.21.15.12:0/2646940212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a4c10c170 0x7f8a4c101420 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009fd0 tx=0x7f8a4400ef10 comp rx=0 tx=0).stop 2024-09-05T01:32:29.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.442+0000 7f8a52400640 1 -- 172.21.15.12:0/2646940212 shutdown_connections 2024-09-05T01:32:29.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.442+0000 7f8a52400640 1 --2- 172.21.15.12:0/2646940212 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f8a300a2d70 0x7f8a300a5230 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:29.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.442+0000 7f8a52400640 1 --2- 172.21.15.12:0/2646940212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a4c10c170 0x7f8a4c101420 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:29.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.443+0000 7f8a52400640 1 --2- 172.21.15.12:0/2646940212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a4c103660 0x7f8a4c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:29.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.443+0000 7f8a52400640 1 --2- 172.21.15.12:0/2646940212 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8a4c102d40 0x7f8a4c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:29.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.443+0000 7f8a52400640 1 -- 172.21.15.12:0/2646940212 >> 172.21.15.12:0/2646940212 conn(0x7f8a4c0fc7a0 msgr2=0x7f8a4c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:29.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.443+0000 7f8a52400640 1 -- 172.21.15.12:0/2646940212 shutdown_connections 2024-09-05T01:32:29.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:29.443+0000 7f8a52400640 1 -- 172.21.15.12:0/2646940212 wait complete. 2024-09-05T01:32:29.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:29 smithi145 ceph-mon[34376]: pgmap v240: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 398 KiB/s wr, 36 op/s 2024-09-05T01:32:29.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:29 smithi151 ceph-mon[35013]: pgmap v240: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 398 KiB/s wr, 36 op/s 2024-09-05T01:32:30.067 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-05T01:32:30.475 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:32:30.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:30 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2646940212' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:32:30.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:30 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/2646940212' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:32:30.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:30 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/2646940212' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:32:31.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.206+0000 7f97d0a00640 1 -- 172.21.15.12:0/1138939845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97cc074f40 msgr2=0x7f97cc10de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:31.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.206+0000 7f97d0a00640 1 --2- 172.21.15.12:0/1138939845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97cc074f40 0x7f97cc10de80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f97b4009900 tx=0x7f97b402a480 comp rx=0 tx=0).stop 2024-09-05T01:32:31.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.206+0000 7f97d0a00640 1 -- 172.21.15.12:0/1138939845 shutdown_connections 2024-09-05T01:32:31.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.206+0000 7f97d0a00640 1 --2- 172.21.15.12:0/1138939845 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f97cc10e3c0 0x7f97cc110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.206+0000 7f97d0a00640 1 --2- 172.21.15.12:0/1138939845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97cc074f40 0x7f97cc10de80 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.206+0000 7f97d0a00640 1 --2- 172.21.15.12:0/1138939845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97cc074620 0x7f97cc074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.206+0000 7f97d0a00640 1 -- 172.21.15.12:0/1138939845 >> 172.21.15.12:0/1138939845 conn(0x7f97cc0fd8c0 msgr2=0x7f97cc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:31.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.206+0000 7f97d0a00640 1 -- 172.21.15.12:0/1138939845 shutdown_connections 2024-09-05T01:32:31.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.206+0000 7f97d0a00640 1 -- 172.21.15.12:0/1138939845 wait complete. 2024-09-05T01:32:31.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.207+0000 7f97d0a00640 1 Processor -- start 2024-09-05T01:32:31.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.207+0000 7f97d0a00640 1 -- start start 2024-09-05T01:32:31.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.208+0000 7f97d0a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f97cc074620 0x7f97cc19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:31.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.208+0000 7f97d0a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97cc074f40 0x7f97cc19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.208+0000 7f97d0a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97cc10e3c0 0x7f97cc19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.208+0000 7f97d0a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc1141b0 con 0x7f97cc074f40 2024-09-05T01:32:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.208+0000 7f97d0a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc114030 con 0x7f97cc074620 2024-09-05T01:32:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.208+0000 7f97d0a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc114330 con 0x7f97cc10e3c0 2024-09-05T01:32:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.208+0000 7f97c3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97cc074f40 0x7f97cc19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.208+0000 7f97c9e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f97cc074620 0x7f97cc19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.208+0000 7f97c3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97cc074f40 0x7f97cc19abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56402/0 (socket says 172.21.15.12:56402) 2024-09-05T01:32:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.208+0000 7f97c3e00640 1 -- 172.21.15.12:0/2165424321 learned_addr learned my addr 172.21.15.12:0/2165424321 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.208+0000 7f97ca800640 1 --2- 172.21.15.12:0/2165424321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97cc10e3c0 0x7f97cc19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.209+0000 7f97c9e00640 1 -- 172.21.15.12:0/2165424321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97cc10e3c0 msgr2=0x7f97cc19ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.209+0000 7f97c9e00640 1 --2- 172.21.15.12:0/2165424321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97cc10e3c0 0x7f97cc19ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.209+0000 7f97c9e00640 1 -- 172.21.15.12:0/2165424321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97cc074f40 msgr2=0x7f97cc19abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.209+0000 7f97c9e00640 1 --2- 172.21.15.12:0/2165424321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97cc074f40 0x7f97cc19abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.209+0000 7f97c9e00640 1 -- 172.21.15.12:0/2165424321 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97cc19f660 con 0x7f97cc074620 2024-09-05T01:32:31.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.209+0000 7f97c9e00640 1 --2- 172.21.15.12:0/2165424321 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f97cc074620 0x7f97cc19a6b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f97bc00d720 tx=0x7f97bc00dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:31.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.210+0000 7f97c2a00640 1 -- 172.21.15.12:0/2165424321 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc017070 con 0x7f97cc074620 2024-09-05T01:32:31.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.210+0000 7f97d0a00640 1 -- 172.21.15.12:0/2165424321 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97cc19f950 con 0x7f97cc074620 2024-09-05T01:32:31.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.210+0000 7f97c2a00640 1 -- 172.21.15.12:0/2165424321 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97bc00de30 con 0x7f97cc074620 2024-09-05T01:32:31.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.210+0000 7f97c2a00640 1 -- 172.21.15.12:0/2165424321 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc0047a0 con 0x7f97cc074620 2024-09-05T01:32:31.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.210+0000 7f97d0a00640 1 -- 172.21.15.12:0/2165424321 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97cc1a7230 con 0x7f97cc074620 2024-09-05T01:32:31.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.213+0000 7f97d34c5740 1 Processor -- start 2024-09-05T01:32:31.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.213+0000 7f97c2a00640 1 -- 172.21.15.12:0/2165424321 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f97bc0099d0 con 0x7f97cc074620 2024-09-05T01:32:31.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.213+0000 7f97d34c5740 1 -- start start 2024-09-05T01:32:31.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.213+0000 7f97d34c5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565b1c7bc70 0x5565b1c7c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:31.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.213+0000 7f97d34c5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565b1c7c590 0x5565b1c86910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:31.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.214+0000 7f97d34c5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c86e50 0x5565b1c89240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:31.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.214+0000 7f97d34c5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5565b1be23e0 con 0x5565b1c7c590 2024-09-05T01:32:31.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.214+0000 7f97d34c5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5565b1b89d80 con 0x5565b1c86e50 2024-09-05T01:32:31.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.214+0000 7f97d34c5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5565b1bde3a0 con 0x5565b1c7bc70 2024-09-05T01:32:31.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.214+0000 7f97c9e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565b1c7c590 0x5565b1c86910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:31.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.214+0000 7f97c9e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565b1c7c590 0x5565b1c86910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56416/0 (socket says 172.21.15.12:56416) 2024-09-05T01:32:31.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.214+0000 7f97c9e00640 1 -- 172.21.15.12:0/1569050017 learned_addr learned my addr 172.21.15.12:0/1569050017 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:31.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.214+0000 7f97ca800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565b1c7bc70 0x5565b1c7c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:31.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.214+0000 7f97c3e00640 1 --2- 172.21.15.12:0/1569050017 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c86e50 0x5565b1c89240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:31.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.214+0000 7f97ca800640 1 -- 172.21.15.12:0/1569050017 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c86e50 msgr2=0x5565b1c89240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:31.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.214+0000 7f97ca800640 1 --2- 172.21.15.12:0/1569050017 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c86e50 0x5565b1c89240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.214+0000 7f97ca800640 1 -- 172.21.15.12:0/1569050017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565b1c7c590 msgr2=0x5565b1c86910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:31.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.214+0000 7f97ca800640 1 --2- 172.21.15.12:0/1569050017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565b1c7c590 0x5565b1c86910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.214+0000 7f97ca800640 1 -- 172.21.15.12:0/1569050017 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565b1ba8ae0 con 0x5565b1c7bc70 2024-09-05T01:32:31.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.215+0000 7f97ca800640 1 --2- 172.21.15.12:0/1569050017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565b1c7bc70 0x5565b1c7c050 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f97c4009f00 tx=0x7f97c4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9308735b537b8d50 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:31.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.215+0000 7f97c2a00640 1 --2- 172.21.15.12:0/2165424321 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f97b00a2d70 0x7f97b00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:31.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.215+0000 7f97c2a00640 1 -- 172.21.15.12:0/2165424321 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7f97bc0cefe0 con 0x7f97cc074620 2024-09-05T01:32:31.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.215+0000 7f97bb000640 1 -- 172.21.15.12:0/1569050017 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c4004d20 con 0x5565b1c7bc70 2024-09-05T01:32:31.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.215+0000 7f97bb000640 1 -- 172.21.15.12:0/1569050017 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97c4004050 con 0x5565b1c7bc70 2024-09-05T01:32:31.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.215+0000 7f97bb000640 1 -- 172.21.15.12:0/1569050017 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c4005280 con 0x5565b1c7bc70 2024-09-05T01:32:31.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.215+0000 7f97c9e00640 1 --2- 172.21.15.12:0/2165424321 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f97b00a2d70 0x7f97b00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.216+0000 7f97d34c5740 1 -- 172.21.15.12:0/1569050017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565b1c7bc70 msgr2=0x5565b1c7c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.216+0000 7f97c9e00640 1 --2- 172.21.15.12:0/2165424321 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f97b00a2d70 0x7f97b00a5230 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f97bc09b180 tx=0x7f97bc0d2ab0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.216+0000 7f97d34c5740 1 --2- 172.21.15.12:0/1569050017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565b1c7bc70 0x5565b1c7c050 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f97c4009f00 tx=0x7f97c4011810 comp rx=0 tx=0).stop 2024-09-05T01:32:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.216+0000 7f97d34c5740 1 -- 172.21.15.12:0/1569050017 shutdown_connections 2024-09-05T01:32:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.216+0000 7f97d34c5740 1 --2- 172.21.15.12:0/1569050017 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c86e50 0x5565b1c89240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.216+0000 7f97d34c5740 1 --2- 172.21.15.12:0/1569050017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565b1c7c590 0x5565b1c86910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.216+0000 7f97d34c5740 1 --2- 172.21.15.12:0/1569050017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565b1c7bc70 0x5565b1c7c050 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.216+0000 7f97d34c5740 1 -- 172.21.15.12:0/1569050017 >> 172.21.15.12:0/1569050017 conn(0x5565b1c78200 msgr2=0x5565b1c785e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.216+0000 7f97d34c5740 1 -- 172.21.15.12:0/1569050017 shutdown_connections 2024-09-05T01:32:31.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.216+0000 7f97d34c5740 1 -- 172.21.15.12:0/1569050017 wait complete. 2024-09-05T01:32:31.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.217+0000 7f97d34c5740 1 -- start start 2024-09-05T01:32:31.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.217+0000 7f97d34c5740 1 Processor -- start 2024-09-05T01:32:31.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.217+0000 7f97d34c5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c7bc70 0x5565b1c83cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:31.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.217+0000 7f97d34c5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565b1c7c590 0x5565b1c84200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:31.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.217+0000 7f97d34c5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565b1c86e50 0x5565b1c84740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:31.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.217+0000 7f97d34c5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5565b1c89a20 con 0x5565b1c7c590 2024-09-05T01:32:31.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.217+0000 7f97d34c5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5565b1b9d0f0 con 0x5565b1c7bc70 2024-09-05T01:32:31.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.217+0000 7f97d34c5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5565b1c89ba0 con 0x5565b1c86e50 2024-09-05T01:32:31.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.217+0000 7f97d34c5740 10 client.0 _ll_register_callbacks cb 0x5565b1b84bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:32:31.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.218+0000 7f97ca800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c7bc70 0x5565b1c83cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:31.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.218+0000 7f97ca800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c7bc70 0x5565b1c83cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:49512/0 (socket says 172.21.15.12:49512) 2024-09-05T01:32:31.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.218+0000 7f97ca800640 1 -- 172.21.15.12:0/3988694805 learned_addr learned my addr 172.21.15.12:0/3988694805 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:31.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.218+0000 7f97c3e00640 1 --2- 172.21.15.12:0/3988694805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565b1c7c590 0x5565b1c84200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:31.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.218+0000 7f97ca800640 1 --2- 172.21.15.12:0/3988694805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565b1c86e50 0x5565b1c84740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:31.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.218+0000 7f97ca800640 1 -- 172.21.15.12:0/3988694805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565b1c86e50 msgr2=0x5565b1c84740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:31.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.218+0000 7f97ca800640 1 --2- 172.21.15.12:0/3988694805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565b1c86e50 0x5565b1c84740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.218+0000 7f97ca800640 1 -- 172.21.15.12:0/3988694805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565b1c7c590 msgr2=0x5565b1c84200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:31.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.218+0000 7f97ca800640 1 --2- 172.21.15.12:0/3988694805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565b1c7c590 0x5565b1c84200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.218+0000 7f97ca800640 1 -- 172.21.15.12:0/3988694805 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565b19533c0 con 0x5565b1c7bc70 2024-09-05T01:32:31.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.218+0000 7f97ca800640 1 --2- 172.21.15.12:0/3988694805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c7bc70 0x5565b1c83cc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f97c40045c0 tx=0x7f97c40046f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d972a8b0077a4269 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:31.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.218+0000 7f97af400640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:32:31.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.219+0000 7f97af400640 1 -- 172.21.15.12:0/3988694805 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c402c020 con 0x5565b1c7bc70 2024-09-05T01:32:31.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.219+0000 7f97d34c5740 1 -- 172.21.15.12:0/3988694805 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97c4004050 con 0x5565b1c7bc70 2024-09-05T01:32:31.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.219+0000 7f97af400640 1 -- 172.21.15.12:0/3988694805 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7f97c4004a40 con 0x5565b1c7bc70 2024-09-05T01:32:31.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.219+0000 7f97af400640 1 -- 172.21.15.12:0/3988694805 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f97c4037050 con 0x5565b1c7bc70 2024-09-05T01:32:31.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.219+0000 7f97d34c5740 10 client.26141 fetch_fsmap learned FSMap version 44 2024-09-05T01:32:31.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.219+0000 7f97d34c5740 1 -- 172.21.15.12:0/3988694805 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5565b1c95a10 con 0x5565b1c7bc70 2024-09-05T01:32:31.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.219+0000 7f97af400640 1 -- 172.21.15.12:0/3988694805 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97c4004050 con 0x5565b1c7bc70 2024-09-05T01:32:31.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.220+0000 7f97af400640 1 -- 172.21.15.12:0/3988694805 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 44) ==== 8426+0+0 (secure 0 0 0) 0x7f97c4028810 con 0x5565b1c7bc70 2024-09-05T01:32:31.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.220+0000 7f97d34c5740 10 client.26141 fetch_fsmap finished waiting for FSMap version 44 2024-09-05T01:32:31.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.220+0000 7f97d34c5740 10 client.26141 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-05T01:32:31.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.220+0000 7f97d34c5740 20 client.26141 populate_metadata read hostname 'smithi012' 2024-09-05T01:32:31.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.220+0000 7f97d34c5740 1 --2- 172.21.15.12:0/3988694805 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5565b1c96e20 0x5565b1c99210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:31.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.220+0000 7f97d34c5740 4 client.26141 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:32:31.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.220+0000 7f97d34c5740 1 -- 172.21.15.12:0/3988694805 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565b1bef950 con 0x5565b1c96e20 2024-09-05T01:32:31.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.220+0000 7f97c3e00640 1 --2- 172.21.15.12:0/3988694805 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5565b1c96e20 0x5565b1c99210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:31.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.221+0000 7f97c3e00640 1 --2- 172.21.15.12:0/3988694805 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5565b1c96e20 0x5565b1c99210 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b99a3ebf94b4ed6d server_cookie=69e7401772a6422b in_seq=0 out_seq=0 2024-09-05T01:32:31.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.221+0000 7f97af400640 10 client.26141 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:32:31.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.222+0000 7f97af400640 1 -- 172.21.15.12:0/3988694805 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5565b1bef950 con 0x5565b1c96e20 2024-09-05T01:32:31.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.222+0000 7f97af400640 10 client.26141 handle_command_reply: tid=0 2024-09-05T01:32:31.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.222+0000 7f97d34c5740 1 client.26141 shutdown 2024-09-05T01:32:31.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.222+0000 7f97d34c5740 1 -- 172.21.15.12:0/3988694805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c7bc70 msgr2=0x5565b1c83cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:31.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.222+0000 7f97d34c5740 1 --2- 172.21.15.12:0/3988694805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c7bc70 0x5565b1c83cc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f97c40045c0 tx=0x7f97c40046f0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.222+0000 7f97d34c5740 1 -- 172.21.15.12:0/3988694805 shutdown_connections 2024-09-05T01:32:31.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.222+0000 7f97d34c5740 1 --2- 172.21.15.12:0/3988694805 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5565b1c96e20 0x5565b1c99210 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.222+0000 7f97d34c5740 1 --2- 172.21.15.12:0/3988694805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565b1c86e50 0x5565b1c84740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.222+0000 7f97d34c5740 1 --2- 172.21.15.12:0/3988694805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565b1c7c590 0x5565b1c84200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.222+0000 7f97af400640 0 client.26141 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:32:31.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.222+0000 7f97d34c5740 1 --2- 172.21.15.12:0/3988694805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c7bc70 0x5565b1c83cc0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.222+0000 7f97d34c5740 1 -- 172.21.15.12:0/3988694805 >> 172.21.15.12:0/3988694805 conn(0x5565b1c78200 msgr2=0x5565b1c77380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:31.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.222+0000 7f97d34c5740 1 -- 172.21.15.12:0/3988694805 shutdown_connections 2024-09-05T01:32:31.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.223+0000 7f97d34c5740 1 -- 172.21.15.12:0/3988694805 wait complete. 2024-09-05T01:32:31.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.223+0000 7f97d34c5740 20 client.26141 trim_cache size 0 max 16384 2024-09-05T01:32:31.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.238+0000 7f97d34c5740 1 Processor -- start 2024-09-05T01:32:31.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.238+0000 7f97d34c5740 1 -- start start 2024-09-05T01:32:31.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.238+0000 7f97d34c5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565b1c7bc70 0x5565b1c9ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:31.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.238+0000 7f97d34c5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c7c590 0x5565b1c9ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:31.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.238+0000 7f97d34c5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565b1c86e50 0x5565b1c91ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:31.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.238+0000 7f97d34c5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc1afcb0 con 0x5565b1c86e50 2024-09-05T01:32:31.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.238+0000 7f97d34c5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc1b1970 con 0x5565b1c7c590 2024-09-05T01:32:31.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.238+0000 7f97d34c5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc1b0380 con 0x5565b1c7bc70 2024-09-05T01:32:31.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.238+0000 7f97c3e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c7c590 0x5565b1c9ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:31.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.238+0000 7f97c3e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c7c590 0x5565b1c9ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:49516/0 (socket says 172.21.15.12:49516) 2024-09-05T01:32:31.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.238+0000 7f97c3e00640 1 -- 172.21.15.12:0/4156670211 learned_addr learned my addr 172.21.15.12:0/4156670211 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:31.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.238+0000 7f97ca800640 1 --2- 172.21.15.12:0/4156670211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565b1c86e50 0x5565b1c91ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:31.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.239+0000 7f97ca800640 1 --2- 172.21.15.12:0/4156670211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565b1c7bc70 0x5565b1c9ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:31.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.239+0000 7f97c3e00640 1 -- 172.21.15.12:0/4156670211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565b1c7bc70 msgr2=0x5565b1c9ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:31.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.239+0000 7f97c3e00640 1 --2- 172.21.15.12:0/4156670211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565b1c7bc70 0x5565b1c9ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.239+0000 7f97c3e00640 1 -- 172.21.15.12:0/4156670211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565b1c86e50 msgr2=0x5565b1c91ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:31.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.239+0000 7f97c3e00640 1 --2- 172.21.15.12:0/4156670211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565b1c86e50 0x5565b1c91ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.239+0000 7f97c3e00640 1 -- 172.21.15.12:0/4156670211 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565b1c82210 con 0x5565b1c7c590 2024-09-05T01:32:31.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.239+0000 7f97c3e00640 1 --2- 172.21.15.12:0/4156670211 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c7c590 0x5565b1c9ef60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f97b4004770 tx=0x7f97b40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23206415ba94960b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:31.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.239+0000 7f97ba600640 1 -- 172.21.15.12:0/4156670211 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b404a030 con 0x5565b1c7c590 2024-09-05T01:32:31.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.239+0000 7f97ba600640 1 -- 172.21.15.12:0/4156670211 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97b40044d0 con 0x5565b1c7c590 2024-09-05T01:32:31.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.239+0000 7f97ba600640 1 -- 172.21.15.12:0/4156670211 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b4035040 con 0x5565b1c7c590 2024-09-05T01:32:31.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.240+0000 7f97d34c5740 1 -- 172.21.15.12:0/4156670211 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c7c590 msgr2=0x5565b1c9ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:31.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.240+0000 7f97d34c5740 1 --2- 172.21.15.12:0/4156670211 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c7c590 0x5565b1c9ef60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f97b4004770 tx=0x7f97b40046c0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.240+0000 7f97d34c5740 1 -- 172.21.15.12:0/4156670211 shutdown_connections 2024-09-05T01:32:31.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.240+0000 7f97d34c5740 1 --2- 172.21.15.12:0/4156670211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565b1c86e50 0x5565b1c91ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.240+0000 7f97d34c5740 1 --2- 172.21.15.12:0/4156670211 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c7c590 0x5565b1c9ef60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.240+0000 7f97d34c5740 1 --2- 172.21.15.12:0/4156670211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565b1c7bc70 0x5565b1c9ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.240+0000 7f97d34c5740 1 -- 172.21.15.12:0/4156670211 >> 172.21.15.12:0/4156670211 conn(0x5565b1c78200 msgr2=0x5565b1c7dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:31.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.240+0000 7f97d34c5740 1 -- 172.21.15.12:0/4156670211 shutdown_connections 2024-09-05T01:32:31.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.240+0000 7f97d34c5740 1 -- 172.21.15.12:0/4156670211 wait complete. 2024-09-05T01:32:31.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.240+0000 7f97d34c5740 1 -- start start 2024-09-05T01:32:31.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.241+0000 7f97d34c5740 1 Processor -- start 2024-09-05T01:32:31.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.241+0000 7f97d34c5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565b1c7bc70 0x5565b1c8f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:31.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.241+0000 7f97d34c5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565b1c7c590 0x5565b1c8f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:31.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.241+0000 7f97d34c5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c86e50 0x5565b1c8a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:31.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.241+0000 7f97d34c5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc1b11e0 con 0x5565b1c7c590 2024-09-05T01:32:31.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.241+0000 7f97d34c5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc1b0ae0 con 0x5565b1c86e50 2024-09-05T01:32:31.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.241+0000 7f97d34c5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc1adcb0 con 0x5565b1c7bc70 2024-09-05T01:32:31.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.241+0000 7f97d34c5740 10 client.0 _ll_register_callbacks cb 0x7f97bc0d2980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:32:31.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.241+0000 7f97c3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565b1c7c590 0x5565b1c8f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:31.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.241+0000 7f97ca800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565b1c7bc70 0x5565b1c8f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:31.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.241+0000 7f97c3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565b1c7c590 0x5565b1c8f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56444/0 (socket says 172.21.15.12:56444) 2024-09-05T01:32:31.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.241+0000 7f97c3e00640 1 -- 172.21.15.12:0/1566574727 learned_addr learned my addr 172.21.15.12:0/1566574727 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:31.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.242+0000 7f97ca800640 1 --2- 172.21.15.12:0/1566574727 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c86e50 0x5565b1c8a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:31.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.242+0000 7f97c3e00640 1 -- 172.21.15.12:0/1566574727 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565b1c7bc70 msgr2=0x5565b1c8f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:31.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.242+0000 7f97c3e00640 1 --2- 172.21.15.12:0/1566574727 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565b1c7bc70 0x5565b1c8f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.242+0000 7f97c3e00640 1 -- 172.21.15.12:0/1566574727 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c86e50 msgr2=0x5565b1c8a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:31.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.242+0000 7f97c3e00640 1 --2- 172.21.15.12:0/1566574727 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c86e50 0x5565b1c8a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.242+0000 7f97c3e00640 1 -- 172.21.15.12:0/1566574727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565b1c8af80 con 0x5565b1c7c590 2024-09-05T01:32:31.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.242+0000 7f97ca800640 1 --2- 172.21.15.12:0/1566574727 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c86e50 0x5565b1c8a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:32:31.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.242+0000 7f97c3e00640 1 --2- 172.21.15.12:0/1566574727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565b1c7c590 0x5565b1c8f710 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f97b402aa40 tx=0x7f97b4004eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d947f7cea743e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:31.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.242+0000 7f97af400640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:32:31.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.243+0000 7f97af400640 1 -- 172.21.15.12:0/1566574727 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b4053030 con 0x5565b1c7c590 2024-09-05T01:32:31.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.243+0000 7f97d34c5740 1 -- 172.21.15.12:0/1566574727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97b40044d0 con 0x5565b1c7c590 2024-09-05T01:32:31.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.243+0000 7f97af400640 1 -- 172.21.15.12:0/1566574727 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7f97b4004fa0 con 0x5565b1c7c590 2024-09-05T01:32:31.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.243+0000 7f97af400640 1 -- 172.21.15.12:0/1566574727 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f97b404a050 con 0x5565b1c7c590 2024-09-05T01:32:31.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.243+0000 7f97d34c5740 10 client.16092 fetch_fsmap learned FSMap version 44 2024-09-05T01:32:31.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.243+0000 7f97d34c5740 1 -- 172.21.15.12:0/1566574727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5565b1d015d0 con 0x5565b1c7c590 2024-09-05T01:32:31.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.243+0000 7f97af400640 1 -- 172.21.15.12:0/1566574727 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97b40044d0 con 0x5565b1c7c590 2024-09-05T01:32:31.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.243+0000 7f97af400640 1 -- 172.21.15.12:0/1566574727 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 44) ==== 8426+0+0 (secure 0 0 0) 0x7f97b4031c60 con 0x5565b1c7c590 2024-09-05T01:32:31.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.243+0000 7f97d34c5740 10 client.16092 fetch_fsmap finished waiting for FSMap version 44 2024-09-05T01:32:31.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.243+0000 7f97d34c5740 10 client.16092 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-05T01:32:31.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.243+0000 7f97d34c5740 20 client.16092 populate_metadata read hostname 'smithi012' 2024-09-05T01:32:31.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.244+0000 7f97d34c5740 1 --2- 172.21.15.12:0/1566574727 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5565b1d01ca0 0x5565b1d040c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:31.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.244+0000 7f97d34c5740 4 client.16092 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:32:31.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.244+0000 7f97d34c5740 1 -- 172.21.15.12:0/1566574727 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5565b1be9e60 con 0x5565b1d01ca0 2024-09-05T01:32:31.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.244+0000 7f97ca800640 1 --2- 172.21.15.12:0/1566574727 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5565b1d01ca0 0x5565b1d040c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:31.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.244+0000 7f97ca800640 1 --2- 172.21.15.12:0/1566574727 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5565b1d01ca0 0x5565b1d040c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9338e207aa1d8f39 server_cookie=86b235b9a103c9d4 in_seq=0 out_seq=0 2024-09-05T01:32:31.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.244+0000 7f97af400640 10 client.16092 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:32:31.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.245+0000 7f97af400640 1 -- 172.21.15.12:0/1566574727 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5565b1be9e60 con 0x5565b1d01ca0 2024-09-05T01:32:31.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.245+0000 7f97af400640 10 client.16092 handle_command_reply: tid=0 2024-09-05T01:32:31.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.245+0000 7f97d34c5740 1 client.16092 shutdown 2024-09-05T01:32:31.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.245+0000 7f97d34c5740 1 -- 172.21.15.12:0/1566574727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565b1c7c590 msgr2=0x5565b1c8f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:31.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.245+0000 7f97d34c5740 1 --2- 172.21.15.12:0/1566574727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565b1c7c590 0x5565b1c8f710 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f97b402aa40 tx=0x7f97b4004eb0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.245+0000 7f97d34c5740 1 -- 172.21.15.12:0/1566574727 shutdown_connections 2024-09-05T01:32:31.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.245+0000 7f97d34c5740 1 --2- 172.21.15.12:0/1566574727 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5565b1d01ca0 0x5565b1d040c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.245+0000 7f97d34c5740 1 --2- 172.21.15.12:0/1566574727 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5565b1c86e50 0x5565b1c8a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.245+0000 7f97d34c5740 1 --2- 172.21.15.12:0/1566574727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565b1c7c590 0x5565b1c8f710 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.245+0000 7f97d34c5740 1 --2- 172.21.15.12:0/1566574727 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565b1c7bc70 0x5565b1c8f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.245+0000 7f97d34c5740 1 -- 172.21.15.12:0/1566574727 >> 172.21.15.12:0/1566574727 conn(0x5565b1c78200 msgr2=0x5565b1c82460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:31.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.245+0000 7f97af400640 0 client.16092 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:32:31.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.245+0000 7f97d34c5740 1 -- 172.21.15.12:0/1566574727 shutdown_connections 2024-09-05T01:32:31.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.245+0000 7f97d34c5740 1 -- 172.21.15.12:0/1566574727 wait complete. 2024-09-05T01:32:31.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.245+0000 7f97d34c5740 20 client.16092 trim_cache size 0 max 16384 2024-09-05T01:32:31.250 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:32:31.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.246+0000 7f97d0a00640 1 -- 172.21.15.12:0/2165424321 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f97b00a2d70 msgr2=0x7f97b00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:31.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.246+0000 7f97d0a00640 1 --2- 172.21.15.12:0/2165424321 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f97b00a2d70 0x7f97b00a5230 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f97bc09b180 tx=0x7f97bc0d2ab0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.246+0000 7f97d0a00640 1 -- 172.21.15.12:0/2165424321 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f97cc074620 msgr2=0x7f97cc19a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:31.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.246+0000 7f97d0a00640 1 --2- 172.21.15.12:0/2165424321 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f97cc074620 0x7f97cc19a6b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f97bc00d720 tx=0x7f97bc00dbe0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.246+0000 7f97d0a00640 1 -- 172.21.15.12:0/2165424321 shutdown_connections 2024-09-05T01:32:31.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.246+0000 7f97d0a00640 1 --2- 172.21.15.12:0/2165424321 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f97b00a2d70 0x7f97b00a5230 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.246+0000 7f97d0a00640 1 --2- 172.21.15.12:0/2165424321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97cc10e3c0 0x7f97cc19ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.246+0000 7f97d0a00640 1 --2- 172.21.15.12:0/2165424321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97cc074f40 0x7f97cc19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.246+0000 7f97d0a00640 1 --2- 172.21.15.12:0/2165424321 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f97cc074620 0x7f97cc19a6b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:31.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.246+0000 7f97d0a00640 1 -- 172.21.15.12:0/2165424321 >> 172.21.15.12:0/2165424321 conn(0x7f97cc0fd8c0 msgr2=0x7f97cc0fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:31.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.246+0000 7f97d0a00640 1 -- 172.21.15.12:0/2165424321 shutdown_connections 2024-09-05T01:32:31.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:31.246+0000 7f97d0a00640 1 -- 172.21.15.12:0/2165424321 wait complete. 2024-09-05T01:32:31.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:31 smithi012 ceph-mon[29942]: pgmap v241: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 352 KiB/s wr, 35 op/s 2024-09-05T01:32:31.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:31 smithi145 ceph-mon[34376]: pgmap v241: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 352 KiB/s wr, 35 op/s 2024-09-05T01:32:31.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:31 smithi151 ceph-mon[35013]: pgmap v241: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 352 KiB/s wr, 35 op/s 2024-09-05T01:32:31.947 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-05T01:32:32.329 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:32:32.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.895+0000 7f30b8800640 1 -- 172.21.15.12:0/2666630894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30b0103ff0 msgr2=0x7f30b01043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:32.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.895+0000 7f30b8800640 1 --2- 172.21.15.12:0/2666630894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30b0103ff0 0x7f30b01043d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009900 tx=0x7f30a402a400 comp rx=0 tx=0).stop 2024-09-05T01:32:32.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.895+0000 7f30b8800640 1 -- 172.21.15.12:0/2666630894 shutdown_connections 2024-09-05T01:32:32.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.895+0000 7f30b8800640 1 --2- 172.21.15.12:0/2666630894 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30b0109120 0x7f30b0110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.895+0000 7f30b8800640 1 --2- 172.21.15.12:0/2666630894 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30b01049a0 0x7f30b01089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.895+0000 7f30b8800640 1 --2- 172.21.15.12:0/2666630894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30b0103ff0 0x7f30b01043d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.895+0000 7f30b8800640 1 -- 172.21.15.12:0/2666630894 >> 172.21.15.12:0/2666630894 conn(0x7f30b00ffa90 msgr2=0x7f30b0101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:32.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.895+0000 7f30b8800640 1 -- 172.21.15.12:0/2666630894 shutdown_connections 2024-09-05T01:32:32.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.895+0000 7f30b8800640 1 -- 172.21.15.12:0/2666630894 wait complete. 2024-09-05T01:32:32.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.896+0000 7f30b8800640 1 Processor -- start 2024-09-05T01:32:32.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.896+0000 7f30b8800640 1 -- start start 2024-09-05T01:32:32.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.897+0000 7f30b8800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30b0103ff0 0x7f30b019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:32.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.897+0000 7f30b8800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30b01049a0 0x7f30b019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:32.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.897+0000 7f30b8800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30b0109120 0x7f30b019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:32.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.897+0000 7f30b8800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f30b0114140 con 0x7f30b0109120 2024-09-05T01:32:32.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.897+0000 7f30b8800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f30b0113fc0 con 0x7f30b01049a0 2024-09-05T01:32:32.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.897+0000 7f30b8800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f30b01142c0 con 0x7f30b0103ff0 2024-09-05T01:32:32.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.897+0000 7f30b5e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30b0103ff0 0x7f30b019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:32.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.897+0000 7f30b6800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30b0109120 0x7f30b019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:32.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.897+0000 7f30b6800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30b0109120 0x7f30b019eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56454/0 (socket says 172.21.15.12:56454) 2024-09-05T01:32:32.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.897+0000 7f30b6800640 1 -- 172.21.15.12:0/3273712027 learned_addr learned my addr 172.21.15.12:0/3273712027 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:32.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.897+0000 7f30b5e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30b0103ff0 0x7f30b019a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:51994/0 (socket says 172.21.15.12:51994) 2024-09-05T01:32:32.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.897+0000 7f30b5400640 1 --2- 172.21.15.12:0/3273712027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30b01049a0 0x7f30b019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:32.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.898+0000 7f30b6800640 1 -- 172.21.15.12:0/3273712027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30b0103ff0 msgr2=0x7f30b019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:32.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.898+0000 7f30b6800640 1 --2- 172.21.15.12:0/3273712027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30b0103ff0 0x7f30b019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.898+0000 7f30b6800640 1 -- 172.21.15.12:0/3273712027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30b01049a0 msgr2=0x7f30b019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:32.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.898+0000 7f30b6800640 1 --2- 172.21.15.12:0/3273712027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30b01049a0 0x7f30b019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.898+0000 7f30b6800640 1 -- 172.21.15.12:0/3273712027 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b019f5b0 con 0x7f30b0109120 2024-09-05T01:32:32.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.898+0000 7f30b6800640 1 --2- 172.21.15.12:0/3273712027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30b0109120 0x7f30b019eed0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00eaa0 tx=0x7f30ac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:32.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.898+0000 7f30aaa00640 1 -- 172.21.15.12:0/3273712027 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac00cdb0 con 0x7f30b0109120 2024-09-05T01:32:32.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.898+0000 7f30aaa00640 1 -- 172.21.15.12:0/3273712027 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30ac005020 con 0x7f30b0109120 2024-09-05T01:32:32.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.898+0000 7f30b8800640 1 -- 172.21.15.12:0/3273712027 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b019f8a0 con 0x7f30b0109120 2024-09-05T01:32:32.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.898+0000 7f30aaa00640 1 -- 172.21.15.12:0/3273712027 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac0116b0 con 0x7f30b0109120 2024-09-05T01:32:32.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.898+0000 7f30b8800640 1 -- 172.21.15.12:0/3273712027 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b01a7180 con 0x7f30b0109120 2024-09-05T01:32:32.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.902+0000 7f30bb291740 1 Processor -- start 2024-09-05T01:32:32.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.902+0000 7f30aaa00640 1 -- 172.21.15.12:0/3273712027 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f30ac005560 con 0x7f30b0109120 2024-09-05T01:32:32.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.902+0000 7f30bb291740 1 -- start start 2024-09-05T01:32:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.902+0000 7f30bb291740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557886fa4c70 0x557886fa5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.902+0000 7f30bb291740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fa5590 0x557886faf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.902+0000 7f30bb291740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557886fafe50 0x557886fb2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.902+0000 7f30bb291740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557886f0b3e0 con 0x557886fa4c70 2024-09-05T01:32:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.902+0000 7f30bb291740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x557886eb2d80 con 0x557886fa5590 2024-09-05T01:32:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.902+0000 7f30bb291740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557886f073a0 con 0x557886fafe50 2024-09-05T01:32:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.902+0000 7f30b5400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557886fa4c70 0x557886fa5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.903+0000 7f30b5400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557886fa4c70 0x557886fa5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56466/0 (socket says 172.21.15.12:56466) 2024-09-05T01:32:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.903+0000 7f30b5400640 1 -- 172.21.15.12:0/1246620713 learned_addr learned my addr 172.21.15.12:0/1246620713 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.903+0000 7f30b5e00640 1 --2- 172.21.15.12:0/1246620713 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fa5590 0x557886faf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:32.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.903+0000 7f30b5400640 1 --2- 172.21.15.12:0/1246620713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557886fafe50 0x557886fb2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:32.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.903+0000 7f30b5e00640 1 -- 172.21.15.12:0/1246620713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557886fafe50 msgr2=0x557886fb2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:32.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.903+0000 7f30b5e00640 1 --2- 172.21.15.12:0/1246620713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557886fafe50 0x557886fb2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.903+0000 7f30b5e00640 1 -- 172.21.15.12:0/1246620713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557886fa4c70 msgr2=0x557886fa5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:32.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.903+0000 7f30b5e00640 1 --2- 172.21.15.12:0/1246620713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557886fa4c70 0x557886fa5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.903+0000 7f30b5e00640 1 -- 172.21.15.12:0/1246620713 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557886ed1ae0 con 0x557886fa5590 2024-09-05T01:32:32.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.903+0000 7f30aaa00640 1 --2- 172.21.15.12:0/3273712027 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f30980a2d70 0x7f30980a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:32.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.903+0000 7f30aaa00640 1 -- 172.21.15.12:0/3273712027 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7f30ac0cf270 con 0x7f30b0109120 2024-09-05T01:32:32.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.903+0000 7f30b5e00640 1 --2- 172.21.15.12:0/1246620713 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fa5590 0x557886faf910 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f30a4005940 tx=0x7f30a4005e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa19f04d7179da93 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:32.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.904+0000 7f30b5400640 1 --2- 172.21.15.12:0/3273712027 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f30980a2d70 0x7f30980a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:32.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.904+0000 7f309f000640 1 -- 172.21.15.12:0/1246620713 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4040070 con 0x557886fa5590 2024-09-05T01:32:32.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.904+0000 7f309f000640 1 -- 172.21.15.12:0/1246620713 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30a40318f0 con 0x557886fa5590 2024-09-05T01:32:32.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.904+0000 7f309f000640 1 -- 172.21.15.12:0/1246620713 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4035040 con 0x557886fa5590 2024-09-05T01:32:32.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.905+0000 7f30bb291740 1 -- 172.21.15.12:0/1246620713 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fa5590 msgr2=0x557886faf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:32.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.905+0000 7f30b5400640 1 --2- 172.21.15.12:0/3273712027 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f30980a2d70 0x7f30980a5230 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f30a0009fd0 tx=0x7f30a0015040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:32.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.905+0000 7f30bb291740 1 --2- 172.21.15.12:0/1246620713 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fa5590 0x557886faf910 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f30a4005940 tx=0x7f30a4005e00 comp rx=0 tx=0).stop 2024-09-05T01:32:32.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.905+0000 7f30bb291740 1 -- 172.21.15.12:0/1246620713 shutdown_connections 2024-09-05T01:32:32.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.905+0000 7f30bb291740 1 --2- 172.21.15.12:0/1246620713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557886fafe50 0x557886fb2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.905+0000 7f30bb291740 1 --2- 172.21.15.12:0/1246620713 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fa5590 0x557886faf910 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.905+0000 7f30bb291740 1 --2- 172.21.15.12:0/1246620713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557886fa4c70 0x557886fa5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.905+0000 7f30bb291740 1 -- 172.21.15.12:0/1246620713 >> 172.21.15.12:0/1246620713 conn(0x557886fa1200 msgr2=0x557886fa15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:32.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.905+0000 7f30bb291740 1 -- 172.21.15.12:0/1246620713 shutdown_connections 2024-09-05T01:32:32.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.905+0000 7f30bb291740 1 -- 172.21.15.12:0/1246620713 wait complete. 2024-09-05T01:32:32.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.905+0000 7f30bb291740 1 -- start start 2024-09-05T01:32:32.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.906+0000 7f30bb291740 1 Processor -- start 2024-09-05T01:32:32.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.906+0000 7f30bb291740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fa4c70 0x557886faccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:32.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.906+0000 7f30bb291740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557886fa5590 0x557886fad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:32.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.906+0000 7f30bb291740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557886fafe50 0x557886fad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:32.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.906+0000 7f30bb291740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557886fb2a20 con 0x557886fafe50 2024-09-05T01:32:32.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.906+0000 7f30bb291740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x557886ec60f0 con 0x557886fa4c70 2024-09-05T01:32:32.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.906+0000 7f30bb291740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557886fb2ba0 con 0x557886fa5590 2024-09-05T01:32:32.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.906+0000 7f30bb291740 10 client.0 _ll_register_callbacks cb 0x557886eadbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:32:32.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.906+0000 7f30b5e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fa4c70 0x557886faccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:32.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.906+0000 7f30b5400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557886fa5590 0x557886fad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:32.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.907+0000 7f30b5e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fa4c70 0x557886faccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:49552/0 (socket says 172.21.15.12:49552) 2024-09-05T01:32:32.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.907+0000 7f30b5e00640 1 -- 172.21.15.12:0/359246570 learned_addr learned my addr 172.21.15.12:0/359246570 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:32.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.907+0000 7f30b6800640 1 --2- 172.21.15.12:0/359246570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557886fafe50 0x557886fad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:32.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.907+0000 7f30b5e00640 1 -- 172.21.15.12:0/359246570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557886fa5590 msgr2=0x557886fad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:32.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.907+0000 7f30b5e00640 1 --2- 172.21.15.12:0/359246570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557886fa5590 0x557886fad1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.907+0000 7f30b5e00640 1 -- 172.21.15.12:0/359246570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557886fafe50 msgr2=0x557886fad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:32.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.907+0000 7f30b5e00640 1 --2- 172.21.15.12:0/359246570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557886fafe50 0x557886fad730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.907+0000 7f30b5e00640 1 -- 172.21.15.12:0/359246570 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557886c7c3c0 con 0x557886fa4c70 2024-09-05T01:32:32.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.907+0000 7f30b5e00640 1 --2- 172.21.15.12:0/359246570 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fa4c70 0x557886faccb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009900 tx=0x7f30a4005250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec10ef2be74c6b00 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:32.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.907+0000 7f3093400640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:32:32.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.908+0000 7f3093400640 1 -- 172.21.15.12:0/359246570 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4040070 con 0x557886fa4c70 2024-09-05T01:32:32.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.908+0000 7f30bb291740 1 -- 172.21.15.12:0/359246570 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30a40318f0 con 0x557886fa4c70 2024-09-05T01:32:32.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.908+0000 7f3093400640 1 -- 172.21.15.12:0/359246570 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7f30a40316f0 con 0x557886fa4c70 2024-09-05T01:32:32.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.908+0000 7f3093400640 1 -- 172.21.15.12:0/359246570 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f30a4035050 con 0x557886fa4c70 2024-09-05T01:32:32.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.908+0000 7f30bb291740 10 client.26159 fetch_fsmap learned FSMap version 45 2024-09-05T01:32:32.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.908+0000 7f30bb291740 1 -- 172.21.15.12:0/359246570 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x557886fbe9e0 con 0x557886fa4c70 2024-09-05T01:32:32.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.908+0000 7f3093400640 1 -- 172.21.15.12:0/359246570 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30a40318f0 con 0x557886fa4c70 2024-09-05T01:32:32.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.909+0000 7f3093400640 1 -- 172.21.15.12:0/359246570 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 45) ==== 8438+0+0 (secure 0 0 0) 0x7f30a4054030 con 0x557886fa4c70 2024-09-05T01:32:32.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.909+0000 7f30bb291740 10 client.26159 fetch_fsmap finished waiting for FSMap version 45 2024-09-05T01:32:32.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.909+0000 7f30bb291740 10 client.26159 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-05T01:32:32.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.909+0000 7f30bb291740 20 client.26159 populate_metadata read hostname 'smithi012' 2024-09-05T01:32:32.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.909+0000 7f30bb291740 1 --2- 172.21.15.12:0/359246570 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x557886fbfd30 0x557886fc2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:32.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.909+0000 7f30bb291740 4 client.26159 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:32:32.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.909+0000 7f30bb291740 1 -- 172.21.15.12:0/359246570 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557886f18950 con 0x557886fbfd30 2024-09-05T01:32:32.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.909+0000 7f30b5400640 1 --2- 172.21.15.12:0/359246570 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x557886fbfd30 0x557886fc2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:32.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.910+0000 7f30b5400640 1 --2- 172.21.15.12:0/359246570 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x557886fbfd30 0x557886fc2120 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=213d136adc97c1ad server_cookie=cc5515c71ac0829b in_seq=0 out_seq=0 2024-09-05T01:32:32.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.910+0000 7f3093400640 10 client.26159 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:32:32.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.911+0000 7f3093400640 1 -- 172.21.15.12:0/359246570 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557886f18950 con 0x557886fbfd30 2024-09-05T01:32:32.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.911+0000 7f3093400640 10 client.26159 handle_command_reply: tid=0 2024-09-05T01:32:32.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.911+0000 7f30bb291740 1 client.26159 shutdown 2024-09-05T01:32:32.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.911+0000 7f30bb291740 1 -- 172.21.15.12:0/359246570 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fa4c70 msgr2=0x557886faccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:32.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.911+0000 7f30bb291740 1 --2- 172.21.15.12:0/359246570 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fa4c70 0x557886faccb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009900 tx=0x7f30a4005250 comp rx=0 tx=0).stop 2024-09-05T01:32:32.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.911+0000 7f30bb291740 1 -- 172.21.15.12:0/359246570 shutdown_connections 2024-09-05T01:32:32.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.911+0000 7f30bb291740 1 --2- 172.21.15.12:0/359246570 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x557886fbfd30 0x557886fc2120 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.911+0000 7f30bb291740 1 --2- 172.21.15.12:0/359246570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557886fafe50 0x557886fad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.911+0000 7f30bb291740 1 --2- 172.21.15.12:0/359246570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557886fa5590 0x557886fad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.911+0000 7f3093400640 0 client.26159 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:32:32.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.911+0000 7f30bb291740 1 --2- 172.21.15.12:0/359246570 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fa4c70 0x557886faccb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.911+0000 7f30bb291740 1 -- 172.21.15.12:0/359246570 >> 172.21.15.12:0/359246570 conn(0x557886fa1200 msgr2=0x557886fa6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:32.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.911+0000 7f30bb291740 1 -- 172.21.15.12:0/359246570 shutdown_connections 2024-09-05T01:32:32.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.911+0000 7f30bb291740 1 -- 172.21.15.12:0/359246570 wait complete. 2024-09-05T01:32:32.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.911+0000 7f30bb291740 20 client.26159 trim_cache size 0 max 16384 2024-09-05T01:32:32.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.925+0000 7f30bb291740 1 Processor -- start 2024-09-05T01:32:32.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.925+0000 7f30bb291740 1 -- start start 2024-09-05T01:32:32.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.925+0000 7f30bb291740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557886fa4c70 0x557886fa76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:32.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.925+0000 7f30bb291740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557886fa5590 0x557886faec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:32.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.925+0000 7f30bb291740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fafe50 0x557886fc78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:32.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.925+0000 7f30bb291740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f30b01afb20 con 0x557886fa4c70 2024-09-05T01:32:32.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.925+0000 7f30bb291740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f30b01b1870 con 0x557886fafe50 2024-09-05T01:32:32.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.925+0000 7f30bb291740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f30b01b01f0 con 0x557886fa5590 2024-09-05T01:32:32.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.926+0000 7f30b6800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fafe50 0x557886fc78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:32.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.926+0000 7f30b5e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557886fa4c70 0x557886fa76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:32.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.926+0000 7f30b6800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fafe50 0x557886fc78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:49562/0 (socket says 172.21.15.12:49562) 2024-09-05T01:32:32.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.926+0000 7f30b6800640 1 -- 172.21.15.12:0/3637485218 learned_addr learned my addr 172.21.15.12:0/3637485218 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:32.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.926+0000 7f30b5400640 1 --2- 172.21.15.12:0/3637485218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557886fa5590 0x557886faec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:32.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.926+0000 7f30b6800640 1 -- 172.21.15.12:0/3637485218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557886fa5590 msgr2=0x557886faec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:32.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.926+0000 7f30b6800640 1 --2- 172.21.15.12:0/3637485218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557886fa5590 0x557886faec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.926+0000 7f30b6800640 1 -- 172.21.15.12:0/3637485218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557886fa4c70 msgr2=0x557886fa76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:32.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.926+0000 7f30b6800640 1 --2- 172.21.15.12:0/3637485218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557886fa4c70 0x557886fa76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.926+0000 7f30b6800640 1 -- 172.21.15.12:0/3637485218 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557886fa1030 con 0x557886fafe50 2024-09-05T01:32:32.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.926+0000 7f30b6800640 1 --2- 172.21.15.12:0/3637485218 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fafe50 0x557886fc78f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00efd0 tx=0x7f30ac09b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c2b8b71ecf410b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:32.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.926+0000 7f309e600640 1 -- 172.21.15.12:0/3637485218 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac0b3070 con 0x557886fafe50 2024-09-05T01:32:32.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.927+0000 7f309e600640 1 -- 172.21.15.12:0/3637485218 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30ac0ccba0 con 0x557886fafe50 2024-09-05T01:32:32.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.927+0000 7f309e600640 1 -- 172.21.15.12:0/3637485218 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac01f040 con 0x557886fafe50 2024-09-05T01:32:32.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.927+0000 7f30bb291740 1 -- 172.21.15.12:0/3637485218 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fafe50 msgr2=0x557886fc78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:32.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.927+0000 7f30bb291740 1 --2- 172.21.15.12:0/3637485218 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fafe50 0x557886fc78f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00efd0 tx=0x7f30ac09b8e0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.927+0000 7f30bb291740 1 -- 172.21.15.12:0/3637485218 shutdown_connections 2024-09-05T01:32:32.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.927+0000 7f30bb291740 1 --2- 172.21.15.12:0/3637485218 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fafe50 0x557886fc78f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.927+0000 7f30bb291740 1 --2- 172.21.15.12:0/3637485218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557886fa5590 0x557886faec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.927+0000 7f30bb291740 1 --2- 172.21.15.12:0/3637485218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557886fa4c70 0x557886fa76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.927+0000 7f30bb291740 1 -- 172.21.15.12:0/3637485218 >> 172.21.15.12:0/3637485218 conn(0x557886fa1200 msgr2=0x557886fae510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:32.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.927+0000 7f30bb291740 1 -- 172.21.15.12:0/3637485218 shutdown_connections 2024-09-05T01:32:32.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.927+0000 7f30bb291740 1 -- 172.21.15.12:0/3637485218 wait complete. 2024-09-05T01:32:32.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.928+0000 7f30bb291740 1 -- start start 2024-09-05T01:32:32.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.928+0000 7f30bb291740 1 Processor -- start 2024-09-05T01:32:32.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.928+0000 7f30bb291740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557886fa4c70 0x557886fb8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:32.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.928+0000 7f30bb291740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fa5590 0x557886fa99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:32.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.928+0000 7f30bb291740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557886fafe50 0x557886fa9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:32.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.928+0000 7f30bb291740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f30b01b10e0 con 0x557886fa4c70 2024-09-05T01:32:32.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.928+0000 7f30bb291740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f30b01b0950 con 0x557886fa5590 2024-09-05T01:32:32.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.928+0000 7f30bb291740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f30b01adb20 con 0x557886fafe50 2024-09-05T01:32:32.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.928+0000 7f30bb291740 10 client.0 _ll_register_callbacks cb 0x7f30a0009af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:32:32.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.929+0000 7f30b5e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557886fa4c70 0x557886fb8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:32.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.929+0000 7f30b5400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fa5590 0x557886fa99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:32.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.929+0000 7f30b5400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fa5590 0x557886fa99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:49572/0 (socket says 172.21.15.12:49572) 2024-09-05T01:32:32.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.929+0000 7f30b5400640 1 -- 172.21.15.12:0/3420788435 learned_addr learned my addr 172.21.15.12:0/3420788435 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:32.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.929+0000 7f30b5e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557886fa4c70 0x557886fb8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56478/0 (socket says 172.21.15.12:56478) 2024-09-05T01:32:32.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.929+0000 7f30b6800640 1 --2- 172.21.15.12:0/3420788435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557886fafe50 0x557886fa9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:32.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.929+0000 7f30b5e00640 1 -- 172.21.15.12:0/3420788435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557886fafe50 msgr2=0x557886fa9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:32.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.929+0000 7f30b5e00640 1 --2- 172.21.15.12:0/3420788435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557886fafe50 0x557886fa9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.929+0000 7f30b5e00640 1 -- 172.21.15.12:0/3420788435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fa5590 msgr2=0x557886fa99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:32.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.929+0000 7f30b5e00640 1 --2- 172.21.15.12:0/3420788435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fa5590 0x557886fa99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.929+0000 7f30b5e00640 1 -- 172.21.15.12:0/3420788435 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557886faa6f0 con 0x557886fa4c70 2024-09-05T01:32:32.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.929+0000 7f30b6800640 1 --2- 172.21.15.12:0/3420788435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557886fafe50 0x557886fa9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:32:32.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.929+0000 7f30b5400640 1 --2- 172.21.15.12:0/3420788435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fa5590 0x557886fa99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:32:32.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.929+0000 7f30b5e00640 1 --2- 172.21.15.12:0/3420788435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557886fa4c70 0x557886fb8500 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f30a402a920 tx=0x7f30a4009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5c91467d1b7bc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:32.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.929+0000 7f3093400640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:32:32.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.930+0000 7f3093400640 1 -- 172.21.15.12:0/3420788435 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4040070 con 0x557886fa4c70 2024-09-05T01:32:32.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.930+0000 7f30bb291740 1 -- 172.21.15.12:0/3420788435 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30ac0ccba0 con 0x557886fa4c70 2024-09-05T01:32:32.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.930+0000 7f3093400640 1 -- 172.21.15.12:0/3420788435 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7f30a40316f0 con 0x557886fa4c70 2024-09-05T01:32:32.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.930+0000 7f3093400640 1 -- 172.21.15.12:0/3420788435 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f30a4065050 con 0x557886fa4c70 2024-09-05T01:32:32.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.930+0000 7f30bb291740 10 client.16110 fetch_fsmap learned FSMap version 45 2024-09-05T01:32:32.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.930+0000 7f30bb291740 1 -- 172.21.15.12:0/3420788435 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55788702a900 con 0x557886fa4c70 2024-09-05T01:32:32.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.930+0000 7f3093400640 1 -- 172.21.15.12:0/3420788435 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30ac0ccba0 con 0x557886fa4c70 2024-09-05T01:32:32.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.930+0000 7f3093400640 1 -- 172.21.15.12:0/3420788435 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 45) ==== 8438+0+0 (secure 0 0 0) 0x7f30a405d020 con 0x557886fa4c70 2024-09-05T01:32:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.931+0000 7f30bb291740 10 client.16110 fetch_fsmap finished waiting for FSMap version 45 2024-09-05T01:32:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.931+0000 7f30bb291740 10 client.16110 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-05T01:32:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.931+0000 7f30bb291740 20 client.16110 populate_metadata read hostname 'smithi012' 2024-09-05T01:32:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.931+0000 7f30bb291740 1 --2- 172.21.15.12:0/3420788435 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55788702b0d0 0x55788702d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.931+0000 7f30bb291740 4 client.16110 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:32:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.931+0000 7f30bb291740 1 -- 172.21.15.12:0/3420788435 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557886f12e60 con 0x55788702b0d0 2024-09-05T01:32:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.931+0000 7f30b5400640 1 --2- 172.21.15.12:0/3420788435 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55788702b0d0 0x55788702d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.932+0000 7f30b5400640 1 --2- 172.21.15.12:0/3420788435 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55788702b0d0 0x55788702d4f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cc2b80e14789c5f4 server_cookie=1eb276afb252c004 in_seq=0 out_seq=0 2024-09-05T01:32:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.932+0000 7f3093400640 10 client.16110 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:32:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.932+0000 7f3093400640 1 -- 172.21.15.12:0/3420788435 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557886f12e60 con 0x55788702b0d0 2024-09-05T01:32:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.932+0000 7f3093400640 10 client.16110 handle_command_reply: tid=0 2024-09-05T01:32:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.932+0000 7f30bb291740 1 client.16110 shutdown 2024-09-05T01:32:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.932+0000 7f30bb291740 1 -- 172.21.15.12:0/3420788435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557886fa4c70 msgr2=0x557886fb8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:32.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.932+0000 7f30bb291740 1 --2- 172.21.15.12:0/3420788435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557886fa4c70 0x557886fb8500 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f30a402a920 tx=0x7f30a4009520 comp rx=0 tx=0).stop 2024-09-05T01:32:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.932+0000 7f30bb291740 1 -- 172.21.15.12:0/3420788435 shutdown_connections 2024-09-05T01:32:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.932+0000 7f30bb291740 1 --2- 172.21.15.12:0/3420788435 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55788702b0d0 0x55788702d4f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.932+0000 7f30bb291740 1 --2- 172.21.15.12:0/3420788435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557886fafe50 0x557886fa9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.932+0000 7f30bb291740 1 --2- 172.21.15.12:0/3420788435 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x557886fa5590 0x557886fa99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.932+0000 7f30bb291740 1 --2- 172.21.15.12:0/3420788435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557886fa4c70 0x557886fb8500 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.932+0000 7f30bb291740 1 -- 172.21.15.12:0/3420788435 >> 172.21.15.12:0/3420788435 conn(0x557886fa1200 msgr2=0x557886f9fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.932+0000 7f3093400640 0 client.16110 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:32:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.933+0000 7f30bb291740 1 -- 172.21.15.12:0/3420788435 shutdown_connections 2024-09-05T01:32:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.933+0000 7f30bb291740 1 -- 172.21.15.12:0/3420788435 wait complete. 2024-09-05T01:32:32.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.933+0000 7f30bb291740 20 client.16110 trim_cache size 0 max 16384 2024-09-05T01:32:32.936 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:32:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.934+0000 7f30b8800640 1 -- 172.21.15.12:0/3273712027 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f30980a2d70 msgr2=0x7f30980a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.934+0000 7f30b8800640 1 --2- 172.21.15.12:0/3273712027 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f30980a2d70 0x7f30980a5230 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f30a0009fd0 tx=0x7f30a0015040 comp rx=0 tx=0).stop 2024-09-05T01:32:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.934+0000 7f30b8800640 1 -- 172.21.15.12:0/3273712027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30b0109120 msgr2=0x7f30b019eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.934+0000 7f30b8800640 1 --2- 172.21.15.12:0/3273712027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30b0109120 0x7f30b019eed0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00eaa0 tx=0x7f30ac00ef60 comp rx=0 tx=0).stop 2024-09-05T01:32:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.934+0000 7f30b8800640 1 -- 172.21.15.12:0/3273712027 shutdown_connections 2024-09-05T01:32:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.934+0000 7f30b8800640 1 --2- 172.21.15.12:0/3273712027 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f30980a2d70 0x7f30980a5230 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.934+0000 7f30b8800640 1 --2- 172.21.15.12:0/3273712027 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30b0109120 0x7f30b019eed0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.934+0000 7f30b8800640 1 --2- 172.21.15.12:0/3273712027 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f30b01049a0 0x7f30b019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.934+0000 7f30b8800640 1 --2- 172.21.15.12:0/3273712027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30b0103ff0 0x7f30b019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:32.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.934+0000 7f30b8800640 1 -- 172.21.15.12:0/3273712027 >> 172.21.15.12:0/3273712027 conn(0x7f30b00ffa90 msgr2=0x7f30b0100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:32.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.934+0000 7f30b8800640 1 -- 172.21.15.12:0/3273712027 shutdown_connections 2024-09-05T01:32:32.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:32.934+0000 7f30b8800640 1 -- 172.21.15.12:0/3273712027 wait complete. 2024-09-05T01:32:33.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:33 smithi012 ceph-mon[29942]: pgmap v242: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 352 KiB/s wr, 35 op/s 2024-09-05T01:32:33.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:33 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:32:33.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:33 smithi145 ceph-mon[34376]: pgmap v242: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 352 KiB/s wr, 35 op/s 2024-09-05T01:32:33.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:33 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:32:33.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:33 smithi151 ceph-mon[35013]: pgmap v242: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 352 KiB/s wr, 35 op/s 2024-09-05T01:32:33.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:33 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:32:33.707 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-05T01:32:34.089 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:32:34.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.578+0000 7f4519a00640 1 -- 172.21.15.12:0/2769479858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45141019c0 msgr2=0x7f4514101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:34.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.578+0000 7f4519a00640 1 --2- 172.21.15.12:0/2769479858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45141019c0 0x7f4514101e20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f44fc009930 tx=0x7f44fc02a420 comp rx=0 tx=0).stop 2024-09-05T01:32:34.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.578+0000 7f4519a00640 1 -- 172.21.15.12:0/2769479858 shutdown_connections 2024-09-05T01:32:34.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.578+0000 7f4519a00640 1 --2- 172.21.15.12:0/2769479858 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4514102360 0x7f451410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.578+0000 7f4519a00640 1 --2- 172.21.15.12:0/2769479858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45141019c0 0x7f4514101e20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.578+0000 7f4519a00640 1 --2- 172.21.15.12:0/2769479858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45141079c0 0x7f4514107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.578+0000 7f4519a00640 1 -- 172.21.15.12:0/2769479858 >> 172.21.15.12:0/2769479858 conn(0x7f45140fd6e0 msgr2=0x7f45140ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:34.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.578+0000 7f4519a00640 1 -- 172.21.15.12:0/2769479858 shutdown_connections 2024-09-05T01:32:34.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.578+0000 7f4519a00640 1 -- 172.21.15.12:0/2769479858 wait complete. 2024-09-05T01:32:34.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.579+0000 7f4519a00640 1 Processor -- start 2024-09-05T01:32:34.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.579+0000 7f4519a00640 1 -- start start 2024-09-05T01:32:34.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.580+0000 7f4519a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45141019c0 0x7f451419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:34.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.580+0000 7f4519a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4514102360 0x7f451419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:34.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.580+0000 7f4519a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45141079c0 0x7f451419ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:34.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.580+0000 7f4519a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4514111e10 con 0x7f45141079c0 2024-09-05T01:32:34.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.580+0000 7f4519a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4514111c90 con 0x7f45141019c0 2024-09-05T01:32:34.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.580+0000 7f4519a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4514111f90 con 0x7f4514102360 2024-09-05T01:32:34.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.580+0000 7f4513e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45141019c0 0x7f451419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:34.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.580+0000 7f4519000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45141079c0 0x7f451419ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:34.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.580+0000 7f4513e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45141019c0 0x7f451419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:49582/0 (socket says 172.21.15.12:49582) 2024-09-05T01:32:34.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.580+0000 7f4513e00640 1 -- 172.21.15.12:0/2480058202 learned_addr learned my addr 172.21.15.12:0/2480058202 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:34.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.580+0000 7f450b400640 1 --2- 172.21.15.12:0/2480058202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4514102360 0x7f451419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:34.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.580+0000 7f4513e00640 1 -- 172.21.15.12:0/2480058202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4514102360 msgr2=0x7f451419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:34.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.580+0000 7f4513e00640 1 --2- 172.21.15.12:0/2480058202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4514102360 0x7f451419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.580+0000 7f4513e00640 1 -- 172.21.15.12:0/2480058202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45141079c0 msgr2=0x7f451419ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:34.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.580+0000 7f4513e00640 1 --2- 172.21.15.12:0/2480058202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45141079c0 0x7f451419ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.580+0000 7f4513e00640 1 -- 172.21.15.12:0/2480058202 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f451419f440 con 0x7f45141019c0 2024-09-05T01:32:34.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.581+0000 7f4513e00640 1 --2- 172.21.15.12:0/2480058202 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45141019c0 0x7f451419a490 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f450400eb90 tx=0x7f450400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:34.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.581+0000 7f4511600640 1 -- 172.21.15.12:0/2480058202 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4504004d20 con 0x7f45141019c0 2024-09-05T01:32:34.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.581+0000 7f4519a00640 1 -- 172.21.15.12:0/2480058202 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f451419f730 con 0x7f45141019c0 2024-09-05T01:32:34.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.581+0000 7f4511600640 1 -- 172.21.15.12:0/2480058202 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f450400ee90 con 0x7f45141019c0 2024-09-05T01:32:34.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.581+0000 7f4511600640 1 -- 172.21.15.12:0/2480058202 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4504010830 con 0x7f45141019c0 2024-09-05T01:32:34.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.581+0000 7f4519a00640 1 -- 172.21.15.12:0/2480058202 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45141a7010 con 0x7f45141019c0 2024-09-05T01:32:34.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.584+0000 7f451dc40740 1 Processor -- start 2024-09-05T01:32:34.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.584+0000 7f451dc40740 1 -- start start 2024-09-05T01:32:34.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.584+0000 7f4511600640 1 -- 172.21.15.12:0/2480058202 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f4504005020 con 0x7f45141019c0 2024-09-05T01:32:34.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.585+0000 7f451dc40740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd125e40 0x5642dd126220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:34.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.585+0000 7f451dc40740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd126760 0x5642dd130ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:34.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.585+0000 7f451dc40740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5642dd131020 0x5642dd133410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:34.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.585+0000 7f451dc40740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5642dd08c3e0 con 0x5642dd125e40 2024-09-05T01:32:34.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.585+0000 7f451dc40740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5642dd033d80 con 0x5642dd131020 2024-09-05T01:32:34.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.585+0000 7f451dc40740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5642dd0883a0 con 0x5642dd126760 2024-09-05T01:32:34.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.585+0000 7f4519000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd125e40 0x5642dd126220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:34.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.585+0000 7f4519000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd125e40 0x5642dd126220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56496/0 (socket says 172.21.15.12:56496) 2024-09-05T01:32:34.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.585+0000 7f4519000640 1 -- 172.21.15.12:0/2980902291 learned_addr learned my addr 172.21.15.12:0/2980902291 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:34.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.585+0000 7f450b400640 1 --2- 172.21.15.12:0/2980902291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5642dd131020 0x5642dd133410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:34.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.585+0000 7f4513e00640 1 --2- 172.21.15.12:0/2980902291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd126760 0x5642dd130ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:34.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.585+0000 7f4519000640 1 -- 172.21.15.12:0/2980902291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd126760 msgr2=0x5642dd130ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:34.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.585+0000 7f4519000640 1 --2- 172.21.15.12:0/2980902291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd126760 0x5642dd130ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.585+0000 7f4519000640 1 -- 172.21.15.12:0/2980902291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5642dd131020 msgr2=0x5642dd133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:34.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.585+0000 7f4519000640 1 --2- 172.21.15.12:0/2980902291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5642dd131020 0x5642dd133410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.585+0000 7f4519000640 1 -- 172.21.15.12:0/2980902291 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642dd052ae0 con 0x5642dd125e40 2024-09-05T01:32:34.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.586+0000 7f4519000640 1 --2- 172.21.15.12:0/2980902291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd125e40 0x5642dd126220 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f450c009ca0 tx=0x7f450c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bfe4b5fd815a0c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:34.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.586+0000 7f4509600640 1 -- 172.21.15.12:0/2980902291 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c01e070 con 0x5642dd125e40 2024-09-05T01:32:34.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.586+0000 7f4511600640 1 --2- 172.21.15.12:0/2480058202 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f44f80a2cf0 0x7f44f80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:34.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.586+0000 7f4509600640 1 -- 172.21.15.12:0/2980902291 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f450c009e50 con 0x5642dd125e40 2024-09-05T01:32:34.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.586+0000 7f4509600640 1 -- 172.21.15.12:0/2980902291 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c00eac0 con 0x5642dd125e40 2024-09-05T01:32:34.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.586+0000 7f4511600640 1 -- 172.21.15.12:0/2480058202 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7f45040cfab0 con 0x7f45141019c0 2024-09-05T01:32:34.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.586+0000 7f4513e00640 1 --2- 172.21.15.12:0/2480058202 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f44f80a2cf0 0x7f44f80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:34.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.587+0000 7f451dc40740 1 -- 172.21.15.12:0/2980902291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd125e40 msgr2=0x5642dd126220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:34.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.587+0000 7f451dc40740 1 --2- 172.21.15.12:0/2980902291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd125e40 0x5642dd126220 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f450c009ca0 tx=0x7f450c011810 comp rx=0 tx=0).stop 2024-09-05T01:32:34.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.587+0000 7f451dc40740 1 -- 172.21.15.12:0/2980902291 shutdown_connections 2024-09-05T01:32:34.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.587+0000 7f451dc40740 1 --2- 172.21.15.12:0/2980902291 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5642dd131020 0x5642dd133410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.587+0000 7f451dc40740 1 --2- 172.21.15.12:0/2980902291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd126760 0x5642dd130ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.587+0000 7f451dc40740 1 --2- 172.21.15.12:0/2980902291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd125e40 0x5642dd126220 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.587+0000 7f451dc40740 1 -- 172.21.15.12:0/2980902291 >> 172.21.15.12:0/2980902291 conn(0x5642dd1223d0 msgr2=0x5642dd1227b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:34.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.587+0000 7f4513e00640 1 --2- 172.21.15.12:0/2480058202 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f44f80a2cf0 0x7f44f80a51b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x5642dd123230 tx=0x7f450400cf90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:34.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.587+0000 7f451dc40740 1 -- 172.21.15.12:0/2980902291 shutdown_connections 2024-09-05T01:32:34.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.587+0000 7f451dc40740 1 -- 172.21.15.12:0/2980902291 wait complete. 2024-09-05T01:32:34.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.588+0000 7f451dc40740 1 -- start start 2024-09-05T01:32:34.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.588+0000 7f451dc40740 1 Processor -- start 2024-09-05T01:32:34.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.588+0000 7f451dc40740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd125e40 0x5642dd12df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:34.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.588+0000 7f451dc40740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd126760 0x5642dd12e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:34.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.588+0000 7f451dc40740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5642dd131020 0x5642dd12e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:34.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.588+0000 7f451dc40740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5642dd133bf0 con 0x5642dd126760 2024-09-05T01:32:34.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.588+0000 7f451dc40740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5642dd0470f0 con 0x5642dd131020 2024-09-05T01:32:34.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.588+0000 7f451dc40740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5642dd133d70 con 0x5642dd125e40 2024-09-05T01:32:34.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.588+0000 7f451dc40740 10 client.0 _ll_register_callbacks cb 0x5642dd02ebd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:32:34.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.589+0000 7f4519000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd125e40 0x5642dd12df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:34.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.589+0000 7f4519000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd125e40 0x5642dd12df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:52072/0 (socket says 172.21.15.12:52072) 2024-09-05T01:32:34.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.589+0000 7f4519000640 1 -- 172.21.15.12:0/1173405 learned_addr learned my addr 172.21.15.12:0/1173405 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:34.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.589+0000 7f450b400640 1 --2- 172.21.15.12:0/1173405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd126760 0x5642dd12e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:34.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.589+0000 7f4519000640 1 --2- 172.21.15.12:0/1173405 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5642dd131020 0x5642dd12e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:34.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.589+0000 7f4519000640 1 -- 172.21.15.12:0/1173405 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5642dd131020 msgr2=0x5642dd12e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:34.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.589+0000 7f4519000640 1 --2- 172.21.15.12:0/1173405 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5642dd131020 0x5642dd12e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.589+0000 7f4519000640 1 -- 172.21.15.12:0/1173405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd126760 msgr2=0x5642dd12e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:34.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.589+0000 7f4519000640 1 --2- 172.21.15.12:0/1173405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd126760 0x5642dd12e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.589+0000 7f4519000640 1 -- 172.21.15.12:0/1173405 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642dcdfd3c0 con 0x5642dd125e40 2024-09-05T01:32:34.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.589+0000 7f4519000640 1 --2- 172.21.15.12:0/1173405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd125e40 0x5642dd12df10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f450c0055b0 tx=0x7f450c00e660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a240578c5368a616 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:34.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.589+0000 7f4502000640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:32:34.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.590+0000 7f4502000640 1 -- 172.21.15.12:0/1173405 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c01e070 con 0x5642dd125e40 2024-09-05T01:32:34.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.590+0000 7f451dc40740 1 -- 172.21.15.12:0/1173405 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f450c009e50 con 0x5642dd125e40 2024-09-05T01:32:34.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.590+0000 7f4502000640 1 -- 172.21.15.12:0/1173405 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7f450c00ee40 con 0x5642dd125e40 2024-09-05T01:32:34.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.590+0000 7f4502000640 1 -- 172.21.15.12:0/1173405 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f450c037050 con 0x5642dd125e40 2024-09-05T01:32:34.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.590+0000 7f451dc40740 10 client.26170 fetch_fsmap learned FSMap version 45 2024-09-05T01:32:34.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.590+0000 7f451dc40740 1 -- 172.21.15.12:0/1173405 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5642dd13fc30 con 0x5642dd125e40 2024-09-05T01:32:34.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.590+0000 7f4502000640 1 -- 172.21.15.12:0/1173405 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f450c009e50 con 0x5642dd125e40 2024-09-05T01:32:34.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.590+0000 7f4502000640 1 -- 172.21.15.12:0/1173405 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 45) ==== 8438+0+0 (secure 0 0 0) 0x7f450c019690 con 0x5642dd125e40 2024-09-05T01:32:34.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.591+0000 7f451dc40740 10 client.26170 fetch_fsmap finished waiting for FSMap version 45 2024-09-05T01:32:34.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.591+0000 7f451dc40740 10 client.26170 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T01:32:34.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.591+0000 7f451dc40740 20 client.26170 populate_metadata read hostname 'smithi012' 2024-09-05T01:32:34.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.591+0000 7f451dc40740 1 --2- 172.21.15.12:0/1173405 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5642dd140fe0 0x5642dd1433d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:34.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.591+0000 7f451dc40740 4 client.26170 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:32:34.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.591+0000 7f451dc40740 1 -- 172.21.15.12:0/1173405 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642dd099950 con 0x5642dd140fe0 2024-09-05T01:32:34.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.591+0000 7f450b400640 1 --2- 172.21.15.12:0/1173405 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5642dd140fe0 0x5642dd1433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:34.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.592+0000 7f450b400640 1 --2- 172.21.15.12:0/1173405 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5642dd140fe0 0x5642dd1433d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d29bbfbb14258593 server_cookie=24a5554eb2727d14 in_seq=0 out_seq=0 2024-09-05T01:32:34.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.592+0000 7f4502000640 10 client.26170 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:32:34.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.593+0000 7f4502000640 1 -- 172.21.15.12:0/1173405 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5642dd099950 con 0x5642dd140fe0 2024-09-05T01:32:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.593+0000 7f4502000640 10 client.26170 handle_command_reply: tid=0 2024-09-05T01:32:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.593+0000 7f451dc40740 1 client.26170 shutdown 2024-09-05T01:32:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.593+0000 7f451dc40740 1 -- 172.21.15.12:0/1173405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd125e40 msgr2=0x5642dd12df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.593+0000 7f451dc40740 1 --2- 172.21.15.12:0/1173405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd125e40 0x5642dd12df10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f450c0055b0 tx=0x7f450c00e660 comp rx=0 tx=0).stop 2024-09-05T01:32:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.593+0000 7f451dc40740 1 -- 172.21.15.12:0/1173405 shutdown_connections 2024-09-05T01:32:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.593+0000 7f451dc40740 1 --2- 172.21.15.12:0/1173405 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5642dd140fe0 0x5642dd1433d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.593+0000 7f451dc40740 1 --2- 172.21.15.12:0/1173405 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5642dd131020 0x5642dd12e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.593+0000 7f451dc40740 1 --2- 172.21.15.12:0/1173405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd126760 0x5642dd12e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.593+0000 7f451dc40740 1 --2- 172.21.15.12:0/1173405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd125e40 0x5642dd12df10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.593+0000 7f4502000640 0 client.26170 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:32:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.593+0000 7f451dc40740 1 -- 172.21.15.12:0/1173405 >> 172.21.15.12:0/1173405 conn(0x5642dd1223d0 msgr2=0x5642dd1214b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.593+0000 7f451dc40740 1 -- 172.21.15.12:0/1173405 shutdown_connections 2024-09-05T01:32:34.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.593+0000 7f451dc40740 1 -- 172.21.15.12:0/1173405 wait complete. 2024-09-05T01:32:34.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.593+0000 7f451dc40740 20 client.26170 trim_cache size 0 max 16384 2024-09-05T01:32:34.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.607+0000 7f451dc40740 1 Processor -- start 2024-09-05T01:32:34.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.607+0000 7f451dc40740 1 -- start start 2024-09-05T01:32:34.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.608+0000 7f451dc40740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd125e40 0x5642dd148b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:34.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.608+0000 7f451dc40740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5642dd126760 0x5642dd1490a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:34.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.608+0000 7f451dc40740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd131020 0x5642dd12c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:34.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.608+0000 7f451dc40740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f45141afa60 con 0x5642dd125e40 2024-09-05T01:32:34.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.608+0000 7f451dc40740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f45141b17b0 con 0x5642dd126760 2024-09-05T01:32:34.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.608+0000 7f451dc40740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f45141b0130 con 0x5642dd131020 2024-09-05T01:32:34.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.608+0000 7f4519000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd125e40 0x5642dd148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:34.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.608+0000 7f4519000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd125e40 0x5642dd148b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56524/0 (socket says 172.21.15.12:56524) 2024-09-05T01:32:34.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.608+0000 7f4519000640 1 -- 172.21.15.12:0/164023607 learned_addr learned my addr 172.21.15.12:0/164023607 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:34.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.608+0000 7f450b400640 1 --2- 172.21.15.12:0/164023607 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5642dd126760 0x5642dd1490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:34.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.608+0000 7f4519000640 1 --2- 172.21.15.12:0/164023607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd131020 0x5642dd12c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:34.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.608+0000 7f4519000640 1 -- 172.21.15.12:0/164023607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd131020 msgr2=0x5642dd12c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:34.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.609+0000 7f4519000640 1 --2- 172.21.15.12:0/164023607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd131020 0x5642dd12c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.609+0000 7f4519000640 1 -- 172.21.15.12:0/164023607 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5642dd126760 msgr2=0x5642dd1490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:34.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.609+0000 7f4519000640 1 --2- 172.21.15.12:0/164023607 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5642dd126760 0x5642dd1490a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.609+0000 7f4519000640 1 -- 172.21.15.12:0/164023607 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642dd130880 con 0x5642dd125e40 2024-09-05T01:32:34.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.609+0000 7f4519000640 1 --2- 172.21.15.12:0/164023607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd125e40 0x5642dd148b60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f450c000c00 tx=0x7f450c0097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea04f958314489f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:34.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.609+0000 7f4508c00640 1 -- 172.21.15.12:0/164023607 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c041070 con 0x5642dd125e40 2024-09-05T01:32:34.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.609+0000 7f4508c00640 1 -- 172.21.15.12:0/164023607 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f450c02e070 con 0x5642dd125e40 2024-09-05T01:32:34.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.609+0000 7f4508c00640 1 -- 172.21.15.12:0/164023607 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c01e070 con 0x5642dd125e40 2024-09-05T01:32:34.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.610+0000 7f451dc40740 1 -- 172.21.15.12:0/164023607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd125e40 msgr2=0x5642dd148b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:34.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.610+0000 7f451dc40740 1 --2- 172.21.15.12:0/164023607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd125e40 0x5642dd148b60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f450c000c00 tx=0x7f450c0097c0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.610+0000 7f451dc40740 1 -- 172.21.15.12:0/164023607 shutdown_connections 2024-09-05T01:32:34.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.610+0000 7f451dc40740 1 --2- 172.21.15.12:0/164023607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd131020 0x5642dd12c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.610+0000 7f451dc40740 1 --2- 172.21.15.12:0/164023607 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5642dd126760 0x5642dd1490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.610+0000 7f451dc40740 1 --2- 172.21.15.12:0/164023607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd125e40 0x5642dd148b60 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.610+0000 7f451dc40740 1 -- 172.21.15.12:0/164023607 >> 172.21.15.12:0/164023607 conn(0x5642dd1223d0 msgr2=0x5642dd1214b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:34.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.610+0000 7f451dc40740 1 -- 172.21.15.12:0/164023607 shutdown_connections 2024-09-05T01:32:34.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.610+0000 7f451dc40740 1 -- 172.21.15.12:0/164023607 wait complete. 2024-09-05T01:32:34.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.610+0000 7f451dc40740 1 -- start start 2024-09-05T01:32:34.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.611+0000 7f451dc40740 1 Processor -- start 2024-09-05T01:32:34.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.611+0000 7f451dc40740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5642dd125e40 0x5642dd139350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:34.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.611+0000 7f451dc40740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd126760 0x5642dd139890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:34.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.611+0000 7f451dc40740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd131020 0x5642dd12ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:34.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.611+0000 7f451dc40740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f45141b1020 con 0x5642dd131020 2024-09-05T01:32:34.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.611+0000 7f451dc40740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f45141b0890 con 0x5642dd125e40 2024-09-05T01:32:34.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.611+0000 7f451dc40740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f45141ada60 con 0x5642dd126760 2024-09-05T01:32:34.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.611+0000 7f451dc40740 10 client.0 _ll_register_callbacks cb 0x7f450c01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:32:34.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.611+0000 7f450b400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd126760 0x5642dd139890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:34.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.612+0000 7f450b400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd126760 0x5642dd139890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:52090/0 (socket says 172.21.15.12:52090) 2024-09-05T01:32:34.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.612+0000 7f450b400640 1 -- 172.21.15.12:0/3991685242 learned_addr learned my addr 172.21.15.12:0/3991685242 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:34.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.612+0000 7f4519000640 1 --2- 172.21.15.12:0/3991685242 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5642dd125e40 0x5642dd139350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:34.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.612+0000 7f4519000640 1 --2- 172.21.15.12:0/3991685242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd131020 0x5642dd12ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:34.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.612+0000 7f450b400640 1 -- 172.21.15.12:0/3991685242 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5642dd125e40 msgr2=0x5642dd139350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:34.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.612+0000 7f450b400640 1 --2- 172.21.15.12:0/3991685242 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5642dd125e40 0x5642dd139350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.612+0000 7f450b400640 1 -- 172.21.15.12:0/3991685242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd131020 msgr2=0x5642dd12ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:34.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.612+0000 7f450b400640 1 --2- 172.21.15.12:0/3991685242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd131020 0x5642dd12ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.612+0000 7f450b400640 1 -- 172.21.15.12:0/3991685242 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642dd12b340 con 0x5642dd126760 2024-09-05T01:32:34.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.612+0000 7f4519000640 1 --2- 172.21.15.12:0/3991685242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd131020 0x5642dd12ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:32:34.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.612+0000 7f450b400640 1 --2- 172.21.15.12:0/3991685242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd126760 0x5642dd139890 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f44fc02a9e0 tx=0x7f44fc0043e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9198a73bb3b62a96 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:34.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.612+0000 7f4502000640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:32:34.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.613+0000 7f4502000640 1 -- 172.21.15.12:0/3991685242 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc035040 con 0x5642dd126760 2024-09-05T01:32:34.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.613+0000 7f451dc40740 1 -- 172.21.15.12:0/3991685242 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f450c02e070 con 0x5642dd126760 2024-09-05T01:32:34.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.613+0000 7f4502000640 1 -- 172.21.15.12:0/3991685242 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7f44fc005450 con 0x5642dd126760 2024-09-05T01:32:34.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.613+0000 7f4502000640 1 -- 172.21.15.12:0/3991685242 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f44fc005650 con 0x5642dd126760 2024-09-05T01:32:34.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.613+0000 7f451dc40740 10 client.26176 fetch_fsmap learned FSMap version 45 2024-09-05T01:32:34.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.613+0000 7f451dc40740 1 -- 172.21.15.12:0/3991685242 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5642dd1ab8b0 con 0x5642dd126760 2024-09-05T01:32:34.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.613+0000 7f4502000640 1 -- 172.21.15.12:0/3991685242 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f450c02e070 con 0x5642dd126760 2024-09-05T01:32:34.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.613+0000 7f4502000640 1 -- 172.21.15.12:0/3991685242 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 45) ==== 8438+0+0 (secure 0 0 0) 0x7f44fc0319f0 con 0x5642dd126760 2024-09-05T01:32:34.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.613+0000 7f451dc40740 10 client.26176 fetch_fsmap finished waiting for FSMap version 45 2024-09-05T01:32:34.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.613+0000 7f451dc40740 10 client.26176 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T01:32:34.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.613+0000 7f451dc40740 20 client.26176 populate_metadata read hostname 'smithi012' 2024-09-05T01:32:34.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.613+0000 7f451dc40740 1 --2- 172.21.15.12:0/3991685242 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5642dd1ac010 0x5642dd1ae430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:34.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.613+0000 7f451dc40740 4 client.26176 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:32:34.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.613+0000 7f451dc40740 1 -- 172.21.15.12:0/3991685242 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5642dd093e60 con 0x5642dd1ac010 2024-09-05T01:32:34.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.614+0000 7f4519000640 1 --2- 172.21.15.12:0/3991685242 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5642dd1ac010 0x5642dd1ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:34.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.614+0000 7f4519000640 1 --2- 172.21.15.12:0/3991685242 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5642dd1ac010 0x5642dd1ae430 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=777b45831e35e3ab server_cookie=cfbd03b1c58b106 in_seq=0 out_seq=0 2024-09-05T01:32:34.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.614+0000 7f4502000640 10 client.26176 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:32:34.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.615+0000 7f4502000640 1 -- 172.21.15.12:0/3991685242 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5642dd093e60 con 0x5642dd1ac010 2024-09-05T01:32:34.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.615+0000 7f4502000640 10 client.26176 handle_command_reply: tid=0 2024-09-05T01:32:34.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.615+0000 7f451dc40740 1 client.26176 shutdown 2024-09-05T01:32:34.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.615+0000 7f451dc40740 1 -- 172.21.15.12:0/3991685242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd126760 msgr2=0x5642dd139890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:34.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.615+0000 7f451dc40740 1 --2- 172.21.15.12:0/3991685242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd126760 0x5642dd139890 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f44fc02a9e0 tx=0x7f44fc0043e0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.615+0000 7f451dc40740 1 -- 172.21.15.12:0/3991685242 shutdown_connections 2024-09-05T01:32:34.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.615+0000 7f451dc40740 1 --2- 172.21.15.12:0/3991685242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5642dd131020 0x5642dd12ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.615+0000 7f451dc40740 1 --2- 172.21.15.12:0/3991685242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd126760 0x5642dd139890 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.615+0000 7f451dc40740 1 --2- 172.21.15.12:0/3991685242 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5642dd1ac010 0x5642dd1ae430 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.615+0000 7f451dc40740 1 --2- 172.21.15.12:0/3991685242 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5642dd125e40 0x5642dd139350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.615+0000 7f451dc40740 1 -- 172.21.15.12:0/3991685242 >> 172.21.15.12:0/3991685242 conn(0x5642dd1223d0 msgr2=0x5642dd12c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:34.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.615+0000 7f4502000640 0 client.26176 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:32:34.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.615+0000 7f451dc40740 1 -- 172.21.15.12:0/3991685242 shutdown_connections 2024-09-05T01:32:34.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.615+0000 7f451dc40740 1 -- 172.21.15.12:0/3991685242 wait complete. 2024-09-05T01:32:34.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.615+0000 7f451dc40740 20 client.26176 trim_cache size 0 max 16384 2024-09-05T01:32:34.621 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:32:34.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.616+0000 7f4519a00640 1 -- 172.21.15.12:0/2480058202 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f44f80a2cf0 msgr2=0x7f44f80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:34.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.616+0000 7f4519a00640 1 --2- 172.21.15.12:0/2480058202 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f44f80a2cf0 0x7f44f80a51b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x5642dd123230 tx=0x7f450400cf90 comp rx=0 tx=0).stop 2024-09-05T01:32:34.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.616+0000 7f4519a00640 1 -- 172.21.15.12:0/2480058202 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45141019c0 msgr2=0x7f451419a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:34.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.616+0000 7f4519a00640 1 --2- 172.21.15.12:0/2480058202 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45141019c0 0x7f451419a490 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f450400eb90 tx=0x7f450400c6a0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.616+0000 7f4519a00640 1 -- 172.21.15.12:0/2480058202 shutdown_connections 2024-09-05T01:32:34.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.616+0000 7f4519a00640 1 --2- 172.21.15.12:0/2480058202 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f44f80a2cf0 0x7f44f80a51b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.616+0000 7f4519a00640 1 --2- 172.21.15.12:0/2480058202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45141079c0 0x7f451419ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.616+0000 7f4519a00640 1 --2- 172.21.15.12:0/2480058202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4514102360 0x7f451419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.616+0000 7f4519a00640 1 --2- 172.21.15.12:0/2480058202 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f45141019c0 0x7f451419a490 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:34.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.616+0000 7f4519a00640 1 -- 172.21.15.12:0/2480058202 >> 172.21.15.12:0/2480058202 conn(0x7f45140fd6e0 msgr2=0x7f451410d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:34.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.616+0000 7f4519a00640 1 -- 172.21.15.12:0/2480058202 shutdown_connections 2024-09-05T01:32:34.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:34.616+0000 7f4519a00640 1 -- 172.21.15.12:0/2480058202 wait complete. 2024-09-05T01:32:35.300 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:35 smithi012 ceph-mon[29942]: pgmap v243: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 211 KiB/s wr, 33 op/s 2024-09-05T01:32:35.336 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-05T01:32:35.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:35 smithi145 ceph-mon[34376]: pgmap v243: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 211 KiB/s wr, 33 op/s 2024-09-05T01:32:35.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:35 smithi151 ceph-mon[35013]: pgmap v243: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 211 KiB/s wr, 33 op/s 2024-09-05T01:32:35.716 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:32:36.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.276+0000 7fda83e00640 1 -- 172.21.15.12:0/749986500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda84102360 msgr2=0x7fda8410e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:36.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.276+0000 7fda83e00640 1 --2- 172.21.15.12:0/749986500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda84102360 0x7fda8410e890 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fda7c009930 tx=0x7fda7c02a420 comp rx=0 tx=0).stop 2024-09-05T01:32:36.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.276+0000 7fda83e00640 1 -- 172.21.15.12:0/749986500 shutdown_connections 2024-09-05T01:32:36.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.276+0000 7fda83e00640 1 --2- 172.21.15.12:0/749986500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda84102360 0x7fda8410e890 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.276+0000 7fda83e00640 1 --2- 172.21.15.12:0/749986500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda841019c0 0x7fda84101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.276+0000 7fda83e00640 1 --2- 172.21.15.12:0/749986500 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda841079c0 0x7fda84107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.276+0000 7fda83e00640 1 -- 172.21.15.12:0/749986500 >> 172.21.15.12:0/749986500 conn(0x7fda840fd740 msgr2=0x7fda840ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:36.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.276+0000 7fda83e00640 1 -- 172.21.15.12:0/749986500 shutdown_connections 2024-09-05T01:32:36.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.276+0000 7fda83e00640 1 -- 172.21.15.12:0/749986500 wait complete. 2024-09-05T01:32:36.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.277+0000 7fda83e00640 1 Processor -- start 2024-09-05T01:32:36.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.278+0000 7fda83e00640 1 -- start start 2024-09-05T01:32:36.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.278+0000 7fda83e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda841019c0 0x7fda8419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:36.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.278+0000 7fda83e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda84102360 0x7fda8419a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:36.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.278+0000 7fda83e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda841079c0 0x7fda8419ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:36.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.278+0000 7fda83e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fda84111e10 con 0x7fda841079c0 2024-09-05T01:32:36.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.278+0000 7fda83e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fda84111c90 con 0x7fda841019c0 2024-09-05T01:32:36.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.278+0000 7fda83e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fda84111f90 con 0x7fda84102360 2024-09-05T01:32:36.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.278+0000 7fda83400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda841079c0 0x7fda8419ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:36.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.278+0000 7fda83400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda841079c0 0x7fda8419ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56550/0 (socket says 172.21.15.12:56550) 2024-09-05T01:32:36.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.278+0000 7fda83400640 1 -- 172.21.15.12:0/946596525 learned_addr learned my addr 172.21.15.12:0/946596525 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:36.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.279+0000 7fda82a00640 1 --2- 172.21.15.12:0/946596525 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda841019c0 0x7fda8419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:36.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.279+0000 7fda7a000640 1 --2- 172.21.15.12:0/946596525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda84102360 0x7fda8419a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:36.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.279+0000 7fda83400640 1 -- 172.21.15.12:0/946596525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda84102360 msgr2=0x7fda8419a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:36.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.279+0000 7fda83400640 1 --2- 172.21.15.12:0/946596525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda84102360 0x7fda8419a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.279+0000 7fda83400640 1 -- 172.21.15.12:0/946596525 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda841019c0 msgr2=0x7fda8419a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:36.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.279+0000 7fda83400640 1 --2- 172.21.15.12:0/946596525 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda841019c0 0x7fda8419a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.279+0000 7fda83400640 1 -- 172.21.15.12:0/946596525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda8419f460 con 0x7fda841079c0 2024-09-05T01:32:36.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.279+0000 7fda7a000640 1 --2- 172.21.15.12:0/946596525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda84102360 0x7fda8419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:32:36.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.279+0000 7fda83400640 1 --2- 172.21.15.12:0/946596525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda841079c0 0x7fda8419ed80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fda7c004770 tx=0x7fda7c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:36.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.279+0000 7fda7be00640 1 -- 172.21.15.12:0/946596525 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7c03f070 con 0x7fda841079c0 2024-09-05T01:32:36.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.279+0000 7fda7be00640 1 -- 172.21.15.12:0/946596525 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda7c031c90 con 0x7fda841079c0 2024-09-05T01:32:36.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.279+0000 7fda83e00640 1 -- 172.21.15.12:0/946596525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda8419f6f0 con 0x7fda841079c0 2024-09-05T01:32:36.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.279+0000 7fda7be00640 1 -- 172.21.15.12:0/946596525 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7c035030 con 0x7fda841079c0 2024-09-05T01:32:36.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.280+0000 7fda83e00640 1 -- 172.21.15.12:0/946596525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda841a7030 con 0x7fda841079c0 2024-09-05T01:32:36.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.283+0000 7fda7be00640 1 -- 172.21.15.12:0/946596525 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fda7c042070 con 0x7fda841079c0 2024-09-05T01:32:36.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.283+0000 7fda8c434740 1 Processor -- start 2024-09-05T01:32:36.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.283+0000 7fda8c434740 1 -- start start 2024-09-05T01:32:36.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.283+0000 7fda8c434740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec952bae40 0x55ec952bb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:36.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.283+0000 7fda8c434740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952bb760 0x55ec952c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:36.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.283+0000 7fda8c434740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec952c6020 0x55ec952c8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:36.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.283+0000 7fda8c434740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ec952213e0 con 0x55ec952bb760 2024-09-05T01:32:36.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.283+0000 7fda8c434740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55ec951c8d80 con 0x55ec952c6020 2024-09-05T01:32:36.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.283+0000 7fda8c434740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ec9521d3a0 con 0x55ec952bae40 2024-09-05T01:32:36.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.283+0000 7fda82a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952bb760 0x55ec952c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:36.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.283+0000 7fda82a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952bb760 0x55ec952c5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56566/0 (socket says 172.21.15.12:56566) 2024-09-05T01:32:36.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.283+0000 7fda82a00640 1 -- 172.21.15.12:0/305911614 learned_addr learned my addr 172.21.15.12:0/305911614 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:36.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.284+0000 7fda82a00640 1 -- 172.21.15.12:0/305911614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec952bae40 msgr2=0x55ec952bb220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:32:36.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.284+0000 7fda82a00640 1 --2- 172.21.15.12:0/305911614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec952bae40 0x55ec952bb220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.284+0000 7fda82a00640 1 -- 172.21.15.12:0/305911614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec952c6020 msgr2=0x55ec952c8410 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:32:36.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.284+0000 7fda82a00640 1 --2- 172.21.15.12:0/305911614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec952c6020 0x55ec952c8410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.284+0000 7fda82a00640 1 -- 172.21.15.12:0/305911614 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec951e7ae0 con 0x55ec952bb760 2024-09-05T01:32:36.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.284+0000 7fda82a00640 1 --2- 172.21.15.12:0/305911614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952bb760 0x55ec952c5ae0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fda74009fd0 tx=0x7fda740118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bfd113e96fca4c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:36.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.284+0000 7fda7be00640 1 --2- 172.21.15.12:0/946596525 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fda680a2cf0 0x7fda680a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:36.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.284+0000 7fda7be00640 1 -- 172.21.15.12:0/946596525 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7fda7c0efb30 con 0x7fda841079c0 2024-09-05T01:32:36.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.284+0000 7fda7a000640 1 --2- 172.21.15.12:0/946596525 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fda680a2cf0 0x7fda680a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:36.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.285+0000 7fda73e00640 1 -- 172.21.15.12:0/305911614 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7401e070 con 0x55ec952bb760 2024-09-05T01:32:36.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.285+0000 7fda73e00640 1 -- 172.21.15.12:0/305911614 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda74003c30 con 0x55ec952bb760 2024-09-05T01:32:36.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.285+0000 7fda73e00640 1 -- 172.21.15.12:0/305911614 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7400f9f0 con 0x55ec952bb760 2024-09-05T01:32:36.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.285+0000 7fda8c434740 1 -- 172.21.15.12:0/305911614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952bb760 msgr2=0x55ec952c5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:36.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.285+0000 7fda8c434740 1 --2- 172.21.15.12:0/305911614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952bb760 0x55ec952c5ae0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fda74009fd0 tx=0x7fda740118d0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.285+0000 7fda7a000640 1 --2- 172.21.15.12:0/946596525 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fda680a2cf0 0x7fda680a51b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0058c0 tx=0x7fda6c005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:36.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.285+0000 7fda8c434740 1 -- 172.21.15.12:0/305911614 shutdown_connections 2024-09-05T01:32:36.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.285+0000 7fda8c434740 1 --2- 172.21.15.12:0/305911614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec952c6020 0x55ec952c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.285+0000 7fda8c434740 1 --2- 172.21.15.12:0/305911614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952bb760 0x55ec952c5ae0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.285+0000 7fda8c434740 1 --2- 172.21.15.12:0/305911614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec952bae40 0x55ec952bb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.286+0000 7fda8c434740 1 -- 172.21.15.12:0/305911614 >> 172.21.15.12:0/305911614 conn(0x55ec952b73d0 msgr2=0x55ec952b77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:36.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.286+0000 7fda8c434740 1 -- 172.21.15.12:0/305911614 shutdown_connections 2024-09-05T01:32:36.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.286+0000 7fda8c434740 1 -- 172.21.15.12:0/305911614 wait complete. 2024-09-05T01:32:36.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.286+0000 7fda8c434740 1 -- start start 2024-09-05T01:32:36.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.286+0000 7fda8c434740 1 Processor -- start 2024-09-05T01:32:36.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.287+0000 7fda8c434740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec952bae40 0x55ec952c3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:36.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.287+0000 7fda8c434740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952bb760 0x55ec952c3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:36.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.287+0000 7fda8c434740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec952c6020 0x55ec952c3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:36.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.287+0000 7fda8c434740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ec952c8bf0 con 0x55ec952bb760 2024-09-05T01:32:36.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.287+0000 7fda8c434740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55ec951dc0f0 con 0x55ec952c6020 2024-09-05T01:32:36.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.287+0000 7fda8c434740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ec952c8d70 con 0x55ec952bae40 2024-09-05T01:32:36.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.287+0000 7fda8c434740 10 client.0 _ll_register_callbacks cb 0x55ec951c3bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:32:36.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.287+0000 7fda7a000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952bb760 0x55ec952c3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:36.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.287+0000 7fda7a000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952bb760 0x55ec952c3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56568/0 (socket says 172.21.15.12:56568) 2024-09-05T01:32:36.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.287+0000 7fda7a000640 1 -- 172.21.15.12:0/1845171080 learned_addr learned my addr 172.21.15.12:0/1845171080 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:36.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.287+0000 7fda82a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec952bae40 0x55ec952c3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:36.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.287+0000 7fda83400640 1 --2- 172.21.15.12:0/1845171080 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec952c6020 0x55ec952c3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:36.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.288+0000 7fda83400640 1 -- 172.21.15.12:0/1845171080 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec952bae40 msgr2=0x55ec952c3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:36.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.288+0000 7fda83400640 1 --2- 172.21.15.12:0/1845171080 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec952bae40 0x55ec952c3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.288+0000 7fda83400640 1 -- 172.21.15.12:0/1845171080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952bb760 msgr2=0x55ec952c3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:36.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.288+0000 7fda83400640 1 --2- 172.21.15.12:0/1845171080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952bb760 0x55ec952c3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.288+0000 7fda83400640 1 -- 172.21.15.12:0/1845171080 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec94f923c0 con 0x55ec952c6020 2024-09-05T01:32:36.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.288+0000 7fda82a00640 1 --2- 172.21.15.12:0/1845171080 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec952bae40 0x55ec952c3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:32:36.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.288+0000 7fda83400640 1 --2- 172.21.15.12:0/1845171080 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec952c6020 0x55ec952c3aa0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0ed1b0 tx=0x7fda7c0bbc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c68fe9708a11682f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:36.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.288+0000 7fda70c00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:32:36.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.288+0000 7fda70c00640 1 -- 172.21.15.12:0/1845171080 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7c049050 con 0x55ec952c6020 2024-09-05T01:32:36.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.288+0000 7fda8c434740 1 -- 172.21.15.12:0/1845171080 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda74003c30 con 0x55ec952c6020 2024-09-05T01:32:36.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.288+0000 7fda70c00640 1 -- 172.21.15.12:0/1845171080 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7fda7c0c0080 con 0x55ec952c6020 2024-09-05T01:32:36.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.288+0000 7fda70c00640 1 -- 172.21.15.12:0/1845171080 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fda7c0ab050 con 0x55ec952c6020 2024-09-05T01:32:36.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.288+0000 7fda8c434740 10 client.26192 fetch_fsmap learned FSMap version 45 2024-09-05T01:32:36.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.288+0000 7fda8c434740 1 -- 172.21.15.12:0/1845171080 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55ec952d4d50 con 0x55ec952c6020 2024-09-05T01:32:36.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.289+0000 7fda70c00640 1 -- 172.21.15.12:0/1845171080 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda74003c30 con 0x55ec952c6020 2024-09-05T01:32:36.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.289+0000 7fda70c00640 1 -- 172.21.15.12:0/1845171080 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 45) ==== 8438+0+0 (secure 0 0 0) 0x7fda7c03b460 con 0x55ec952c6020 2024-09-05T01:32:36.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.289+0000 7fda8c434740 10 client.26192 fetch_fsmap finished waiting for FSMap version 45 2024-09-05T01:32:36.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.289+0000 7fda8c434740 10 client.26192 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T01:32:36.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.289+0000 7fda8c434740 20 client.26192 populate_metadata read hostname 'smithi012' 2024-09-05T01:32:36.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.289+0000 7fda8c434740 1 --2- 172.21.15.12:0/1845171080 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55ec952d6290 0x55ec952d8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:36.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.289+0000 7fda8c434740 4 client.26192 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:32:36.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.289+0000 7fda8c434740 1 -- 172.21.15.12:0/1845171080 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec9522e950 con 0x55ec952d6290 2024-09-05T01:32:36.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.289+0000 7fda82a00640 1 --2- 172.21.15.12:0/1845171080 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55ec952d6290 0x55ec952d8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:36.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.290+0000 7fda82a00640 1 --2- 172.21.15.12:0/1845171080 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55ec952d6290 0x55ec952d8710 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ee1ed32f1afddef9 server_cookie=df5b2585b48fe055 in_seq=0 out_seq=0 2024-09-05T01:32:36.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.290+0000 7fda70c00640 10 client.26192 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:32:36.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.291+0000 7fda70c00640 1 -- 172.21.15.12:0/1845171080 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec9522e950 con 0x55ec952d6290 2024-09-05T01:32:36.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.291+0000 7fda70c00640 10 client.26192 handle_command_reply: tid=0 2024-09-05T01:32:36.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.291+0000 7fda8c434740 1 client.26192 shutdown 2024-09-05T01:32:36.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.291+0000 7fda8c434740 1 -- 172.21.15.12:0/1845171080 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec952c6020 msgr2=0x55ec952c3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:36.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.291+0000 7fda8c434740 1 --2- 172.21.15.12:0/1845171080 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec952c6020 0x55ec952c3aa0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0ed1b0 tx=0x7fda7c0bbc70 comp rx=0 tx=0).stop 2024-09-05T01:32:36.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.291+0000 7fda8c434740 1 -- 172.21.15.12:0/1845171080 shutdown_connections 2024-09-05T01:32:36.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.291+0000 7fda8c434740 1 --2- 172.21.15.12:0/1845171080 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec952c6020 0x55ec952c3aa0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.291+0000 7fda8c434740 1 --2- 172.21.15.12:0/1845171080 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55ec952d6290 0x55ec952d8710 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.291+0000 7fda8c434740 1 --2- 172.21.15.12:0/1845171080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952bb760 0x55ec952c3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.291+0000 7fda8c434740 1 --2- 172.21.15.12:0/1845171080 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec952bae40 0x55ec952c3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.291+0000 7fda70c00640 0 client.26192 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:32:36.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.291+0000 7fda8c434740 1 -- 172.21.15.12:0/1845171080 >> 172.21.15.12:0/1845171080 conn(0x55ec952b73d0 msgr2=0x55ec952bd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:36.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.291+0000 7fda8c434740 1 -- 172.21.15.12:0/1845171080 shutdown_connections 2024-09-05T01:32:36.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.291+0000 7fda8c434740 1 -- 172.21.15.12:0/1845171080 wait complete. 2024-09-05T01:32:36.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.292+0000 7fda8c434740 20 client.26192 trim_cache size 0 max 16384 2024-09-05T01:32:36.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.306+0000 7fda8c434740 1 Processor -- start 2024-09-05T01:32:36.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.306+0000 7fda8c434740 1 -- start start 2024-09-05T01:32:36.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.306+0000 7fda8c434740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec952bae40 0x55ec952c28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:36.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.306+0000 7fda8c434740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec952bb760 0x55ec952c36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:36.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.306+0000 7fda8c434740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952c6020 0x55ec952de020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:36.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.306+0000 7fda8c434740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fda841afa20 con 0x55ec952c6020 2024-09-05T01:32:36.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.306+0000 7fda8c434740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fda841b1770 con 0x55ec952bae40 2024-09-05T01:32:36.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.306+0000 7fda8c434740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fda841b00f0 con 0x55ec952bb760 2024-09-05T01:32:36.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.307+0000 7fda83400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952c6020 0x55ec952de020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:36.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.307+0000 7fda7a000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec952bb760 0x55ec952c36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:36.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.307+0000 7fda83400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952c6020 0x55ec952de020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56572/0 (socket says 172.21.15.12:56572) 2024-09-05T01:32:36.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.307+0000 7fda83400640 1 -- 172.21.15.12:0/255808630 learned_addr learned my addr 172.21.15.12:0/255808630 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:36.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.307+0000 7fda82a00640 1 --2- 172.21.15.12:0/255808630 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec952bae40 0x55ec952c28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:36.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.307+0000 7fda7a000640 1 -- 172.21.15.12:0/255808630 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec952bae40 msgr2=0x55ec952c28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:36.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.307+0000 7fda7a000640 1 --2- 172.21.15.12:0/255808630 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec952bae40 0x55ec952c28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.307+0000 7fda7a000640 1 -- 172.21.15.12:0/255808630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952c6020 msgr2=0x55ec952de020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:36.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.307+0000 7fda7a000640 1 --2- 172.21.15.12:0/255808630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952c6020 0x55ec952de020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.307+0000 7fda7a000640 1 -- 172.21.15.12:0/255808630 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec952c8ad0 con 0x55ec952bb760 2024-09-05T01:32:36.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.307+0000 7fda82a00640 1 --2- 172.21.15.12:0/255808630 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec952bae40 0x55ec952c28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:32:36.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.307+0000 7fda83400640 1 --2- 172.21.15.12:0/255808630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952c6020 0x55ec952de020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:32:36.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.307+0000 7fda7a000640 1 --2- 172.21.15.12:0/255808630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec952bb760 0x55ec952c36f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55ec952c4660 tx=0x7fda6c013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6e7a5e768de3439 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:36.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.308+0000 7fda73400640 1 -- 172.21.15.12:0/255808630 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6c005020 con 0x55ec952bb760 2024-09-05T01:32:36.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.308+0000 7fda73400640 1 -- 172.21.15.12:0/255808630 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda6c024070 con 0x55ec952bb760 2024-09-05T01:32:36.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.308+0000 7fda73400640 1 -- 172.21.15.12:0/255808630 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6c020690 con 0x55ec952bb760 2024-09-05T01:32:36.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.308+0000 7fda8c434740 1 -- 172.21.15.12:0/255808630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec952bb760 msgr2=0x55ec952c36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:36.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.308+0000 7fda8c434740 1 --2- 172.21.15.12:0/255808630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec952bb760 0x55ec952c36f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55ec952c4660 tx=0x7fda6c013000 comp rx=0 tx=0).stop 2024-09-05T01:32:36.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.308+0000 7fda8c434740 1 -- 172.21.15.12:0/255808630 shutdown_connections 2024-09-05T01:32:36.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.308+0000 7fda8c434740 1 --2- 172.21.15.12:0/255808630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952c6020 0x55ec952de020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.308+0000 7fda8c434740 1 --2- 172.21.15.12:0/255808630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec952bb760 0x55ec952c36f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.308+0000 7fda8c434740 1 --2- 172.21.15.12:0/255808630 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec952bae40 0x55ec952c28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.308+0000 7fda8c434740 1 -- 172.21.15.12:0/255808630 >> 172.21.15.12:0/255808630 conn(0x55ec952b73d0 msgr2=0x55ec952c2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:36.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.308+0000 7fda8c434740 1 -- 172.21.15.12:0/255808630 shutdown_connections 2024-09-05T01:32:36.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.309+0000 7fda8c434740 1 -- 172.21.15.12:0/255808630 wait complete. 2024-09-05T01:32:36.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.309+0000 7fda8c434740 1 -- start start 2024-09-05T01:32:36.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.309+0000 7fda8c434740 1 Processor -- start 2024-09-05T01:32:36.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.310+0000 7fda8c434740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec952bae40 0x55ec952ca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:36.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.310+0000 7fda8c434740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952bb760 0x55ec952ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:36.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.310+0000 7fda8c434740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec952c6020 0x55ec9533fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:36.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.310+0000 7fda8c434740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fda841b0fe0 con 0x55ec952bb760 2024-09-05T01:32:36.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.310+0000 7fda8c434740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fda841b0850 con 0x55ec952bae40 2024-09-05T01:32:36.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.310+0000 7fda8c434740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fda841ada20 con 0x55ec952c6020 2024-09-05T01:32:36.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.310+0000 7fda8c434740 10 client.0 _ll_register_callbacks cb 0x7fda7c005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:32:36.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.310+0000 7fda7a000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952bb760 0x55ec952ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:36.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.310+0000 7fda83400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec952c6020 0x55ec9533fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:36.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.310+0000 7fda82a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec952bae40 0x55ec952ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:36.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.310+0000 7fda7a000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952bb760 0x55ec952ca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56578/0 (socket says 172.21.15.12:56578) 2024-09-05T01:32:36.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.310+0000 7fda7a000640 1 -- 172.21.15.12:0/2245746666 learned_addr learned my addr 172.21.15.12:0/2245746666 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:36.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.310+0000 7fda83400640 1 -- 172.21.15.12:0/2245746666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec952bae40 msgr2=0x55ec952ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:36.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.310+0000 7fda83400640 1 --2- 172.21.15.12:0/2245746666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec952bae40 0x55ec952ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.310+0000 7fda83400640 1 -- 172.21.15.12:0/2245746666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952bb760 msgr2=0x55ec952ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:36.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.310+0000 7fda83400640 1 --2- 172.21.15.12:0/2245746666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952bb760 0x55ec952ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.310+0000 7fda83400640 1 -- 172.21.15.12:0/2245746666 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec95340530 con 0x55ec952c6020 2024-09-05T01:32:36.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.311+0000 7fda7a000640 1 --2- 172.21.15.12:0/2245746666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952bb760 0x55ec952ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:32:36.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.311+0000 7fda83400640 1 --2- 172.21.15.12:0/2245746666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec952c6020 0x55ec9533fff0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fda7c031550 tx=0x7fda7c03b800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdf11b9ac8d6226c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:36.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.311+0000 7fda70c00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:32:36.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.311+0000 7fda70c00640 1 -- 172.21.15.12:0/2245746666 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7c049070 con 0x55ec952c6020 2024-09-05T01:32:36.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.311+0000 7fda70c00640 1 -- 172.21.15.12:0/2245746666 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7fda7c0b6be0 con 0x55ec952c6020 2024-09-05T01:32:36.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.311+0000 7fda8c434740 1 -- 172.21.15.12:0/2245746666 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda6c024070 con 0x55ec952c6020 2024-09-05T01:32:36.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.311+0000 7fda70c00640 1 -- 172.21.15.12:0/2245746666 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fda7c0c0420 con 0x55ec952c6020 2024-09-05T01:32:36.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.311+0000 7fda8c434740 10 client.26188 fetch_fsmap learned FSMap version 45 2024-09-05T01:32:36.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.311+0000 7fda8c434740 1 -- 172.21.15.12:0/2245746666 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55ec95341730 con 0x55ec952c6020 2024-09-05T01:32:36.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.312+0000 7fda70c00640 1 -- 172.21.15.12:0/2245746666 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda6c024070 con 0x55ec952c6020 2024-09-05T01:32:36.329 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.312+0000 7fda70c00640 1 -- 172.21.15.12:0/2245746666 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 45) ==== 8438+0+0 (secure 0 0 0) 0x7fda7c0b5020 con 0x55ec952c6020 2024-09-05T01:32:36.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.312+0000 7fda8c434740 10 client.26188 fetch_fsmap finished waiting for FSMap version 45 2024-09-05T01:32:36.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.312+0000 7fda8c434740 10 client.26188 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T01:32:36.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.312+0000 7fda8c434740 20 client.26188 populate_metadata read hostname 'smithi012' 2024-09-05T01:32:36.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.312+0000 7fda8c434740 1 --2- 172.21.15.12:0/2245746666 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55ec95341d20 0x55ec95344140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:36.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.312+0000 7fda8c434740 4 client.26188 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:32:36.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.312+0000 7fda8c434740 1 -- 172.21.15.12:0/2245746666 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ec95228e60 con 0x55ec95341d20 2024-09-05T01:32:36.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.312+0000 7fda82a00640 1 --2- 172.21.15.12:0/2245746666 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55ec95341d20 0x55ec95344140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:36.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.313+0000 7fda82a00640 1 --2- 172.21.15.12:0/2245746666 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55ec95341d20 0x55ec95344140 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6d4e34a71d8e65a3 server_cookie=b09e14e3f2657843 in_seq=0 out_seq=0 2024-09-05T01:32:36.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.313+0000 7fda70c00640 10 client.26188 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:32:36.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.313+0000 7fda70c00640 1 -- 172.21.15.12:0/2245746666 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ec95228e60 con 0x55ec95341d20 2024-09-05T01:32:36.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.313+0000 7fda70c00640 10 client.26188 handle_command_reply: tid=0 2024-09-05T01:32:36.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.313+0000 7fda8c434740 1 client.26188 shutdown 2024-09-05T01:32:36.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.313+0000 7fda8c434740 1 -- 172.21.15.12:0/2245746666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec952c6020 msgr2=0x55ec9533fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:36.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.313+0000 7fda8c434740 1 --2- 172.21.15.12:0/2245746666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec952c6020 0x55ec9533fff0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fda7c031550 tx=0x7fda7c03b800 comp rx=0 tx=0).stop 2024-09-05T01:32:36.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.313+0000 7fda8c434740 1 -- 172.21.15.12:0/2245746666 shutdown_connections 2024-09-05T01:32:36.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.313+0000 7fda8c434740 1 --2- 172.21.15.12:0/2245746666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ec952c6020 0x55ec9533fff0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.313+0000 7fda8c434740 1 --2- 172.21.15.12:0/2245746666 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55ec95341d20 0x55ec95344140 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.313+0000 7fda8c434740 1 --2- 172.21.15.12:0/2245746666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ec952bb760 0x55ec952ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.313+0000 7fda8c434740 1 --2- 172.21.15.12:0/2245746666 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ec952bae40 0x55ec952ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.313+0000 7fda70c00640 0 client.26188 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:32:36.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.313+0000 7fda8c434740 1 -- 172.21.15.12:0/2245746666 >> 172.21.15.12:0/2245746666 conn(0x55ec952b73d0 msgr2=0x55ec952c50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:36.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.314+0000 7fda8c434740 1 -- 172.21.15.12:0/2245746666 shutdown_connections 2024-09-05T01:32:36.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.314+0000 7fda8c434740 1 -- 172.21.15.12:0/2245746666 wait complete. 2024-09-05T01:32:36.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.314+0000 7fda8c434740 20 client.26188 trim_cache size 0 max 16384 2024-09-05T01:32:36.332 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:32:36.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.314+0000 7fda83e00640 1 -- 172.21.15.12:0/946596525 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fda680a2cf0 msgr2=0x7fda680a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:36.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.314+0000 7fda83e00640 1 --2- 172.21.15.12:0/946596525 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fda680a2cf0 0x7fda680a51b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0058c0 tx=0x7fda6c005f90 comp rx=0 tx=0).stop 2024-09-05T01:32:36.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.314+0000 7fda83e00640 1 -- 172.21.15.12:0/946596525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda841079c0 msgr2=0x7fda8419ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:36.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.314+0000 7fda83e00640 1 --2- 172.21.15.12:0/946596525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda841079c0 0x7fda8419ed80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fda7c004770 tx=0x7fda7c003b90 comp rx=0 tx=0).stop 2024-09-05T01:32:36.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.314+0000 7fda83e00640 1 -- 172.21.15.12:0/946596525 shutdown_connections 2024-09-05T01:32:36.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.314+0000 7fda83e00640 1 --2- 172.21.15.12:0/946596525 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fda680a2cf0 0x7fda680a51b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.314+0000 7fda83e00640 1 --2- 172.21.15.12:0/946596525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda841079c0 0x7fda8419ed80 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.314+0000 7fda83e00640 1 --2- 172.21.15.12:0/946596525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda84102360 0x7fda8419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.314+0000 7fda83e00640 1 --2- 172.21.15.12:0/946596525 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fda841019c0 0x7fda8419a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:36.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.314+0000 7fda83e00640 1 -- 172.21.15.12:0/946596525 >> 172.21.15.12:0/946596525 conn(0x7fda840fd740 msgr2=0x7fda8410d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:36.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.315+0000 7fda83e00640 1 -- 172.21.15.12:0/946596525 shutdown_connections 2024-09-05T01:32:36.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:36.315+0000 7fda83e00640 1 -- 172.21.15.12:0/946596525 wait complete. 2024-09-05T01:32:37.197 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-05T01:32:37.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:37 smithi012 ceph-mon[29942]: pgmap v244: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 211 KiB/s wr, 32 op/s 2024-09-05T01:32:37.575 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:32:37.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:37 smithi145 ceph-mon[34376]: pgmap v244: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 211 KiB/s wr, 32 op/s 2024-09-05T01:32:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:37 smithi151 ceph-mon[35013]: pgmap v244: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 211 KiB/s wr, 32 op/s 2024-09-05T01:32:38.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.143+0000 7f608be00640 1 -- 172.21.15.12:0/3416791808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6084109120 msgr2=0x7f6084110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:38.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.143+0000 7f608be00640 1 --2- 172.21.15.12:0/3416791808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6084109120 0x7f6084110ca0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f607c009ca0 tx=0x7f607c02a8c0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.143+0000 7f608be00640 1 -- 172.21.15.12:0/3416791808 shutdown_connections 2024-09-05T01:32:38.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.143+0000 7f608be00640 1 --2- 172.21.15.12:0/3416791808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6084109120 0x7f6084110ca0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.143+0000 7f608be00640 1 --2- 172.21.15.12:0/3416791808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60841049a0 0x7f60841089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.143+0000 7f608be00640 1 --2- 172.21.15.12:0/3416791808 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6084103ff0 0x7f60841043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.143+0000 7f608be00640 1 -- 172.21.15.12:0/3416791808 >> 172.21.15.12:0/3416791808 conn(0x7f60840ffa90 msgr2=0x7f6084101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:38.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.143+0000 7f608be00640 1 -- 172.21.15.12:0/3416791808 shutdown_connections 2024-09-05T01:32:38.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.143+0000 7f608be00640 1 -- 172.21.15.12:0/3416791808 wait complete. 2024-09-05T01:32:38.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.144+0000 7f608be00640 1 Processor -- start 2024-09-05T01:32:38.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.144+0000 7f608be00640 1 -- start start 2024-09-05T01:32:38.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.145+0000 7f608be00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6084103ff0 0x7f608419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:38.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.145+0000 7f608be00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60841049a0 0x7f608419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:38.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.145+0000 7f608be00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6084109120 0x7f608419ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:38.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.145+0000 7f608be00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6084114130 con 0x7f6084109120 2024-09-05T01:32:38.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.145+0000 7f608be00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6084113fb0 con 0x7f60841049a0 2024-09-05T01:32:38.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.145+0000 7f608be00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f60841142b0 con 0x7f6084103ff0 2024-09-05T01:32:38.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.145+0000 7f6089e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6084109120 0x7f608419ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:38.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.145+0000 7f6089e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6084109120 0x7f608419ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53602/0 (socket says 172.21.15.12:53602) 2024-09-05T01:32:38.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.145+0000 7f6089e00640 1 -- 172.21.15.12:0/1911102056 learned_addr learned my addr 172.21.15.12:0/1911102056 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:38.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.145+0000 7f6089400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6084103ff0 0x7f608419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:38.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.145+0000 7f6088a00640 1 --2- 172.21.15.12:0/1911102056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60841049a0 0x7f608419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:38.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.145+0000 7f6089e00640 1 -- 172.21.15.12:0/1911102056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6084103ff0 msgr2=0x7f608419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:38.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.145+0000 7f6089e00640 1 --2- 172.21.15.12:0/1911102056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6084103ff0 0x7f608419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.145+0000 7f6089e00640 1 -- 172.21.15.12:0/1911102056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60841049a0 msgr2=0x7f608419aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:38.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.145+0000 7f6089e00640 1 --2- 172.21.15.12:0/1911102056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60841049a0 0x7f608419aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.145+0000 7f6089e00640 1 -- 172.21.15.12:0/1911102056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f608419f540 con 0x7f6084109120 2024-09-05T01:32:38.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.146+0000 7f6089e00640 1 --2- 172.21.15.12:0/1911102056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6084109120 0x7f608419ee60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f607c031a20 tx=0x7f607c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:38.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.146+0000 7f6082000640 1 -- 172.21.15.12:0/1911102056 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c003c30 con 0x7f6084109120 2024-09-05T01:32:38.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.146+0000 7f6082000640 1 -- 172.21.15.12:0/1911102056 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f607c003dd0 con 0x7f6084109120 2024-09-05T01:32:38.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.146+0000 7f6082000640 1 -- 172.21.15.12:0/1911102056 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c02fcf0 con 0x7f6084109120 2024-09-05T01:32:38.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.146+0000 7f608be00640 1 -- 172.21.15.12:0/1911102056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f608419f7d0 con 0x7f6084109120 2024-09-05T01:32:38.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.146+0000 7f608be00640 1 -- 172.21.15.12:0/1911102056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60841a7110 con 0x7f6084109120 2024-09-05T01:32:38.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.151+0000 7f608e7ff740 1 Processor -- start 2024-09-05T01:32:38.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.151+0000 7f6082000640 1 -- 172.21.15.12:0/1911102056 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f607c004050 con 0x7f6084109120 2024-09-05T01:32:38.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.151+0000 7f608e7ff740 1 -- start start 2024-09-05T01:32:38.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.151+0000 7f608e7ff740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4217b4c70 0x55c4217b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:38.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.151+0000 7f608e7ff740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b5590 0x55c4217bf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:38.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.151+0000 7f608e7ff740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217bfe50 0x55c4217c2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:38.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.151+0000 7f608e7ff740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c42171b3e0 con 0x55c4217bfe50 2024-09-05T01:32:38.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.151+0000 7f608e7ff740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c4216c2d80 con 0x55c4217b4c70 2024-09-05T01:32:38.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.151+0000 7f608e7ff740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c4217173a0 con 0x55c4217b5590 2024-09-05T01:32:38.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.152+0000 7f6088a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4217b4c70 0x55c4217b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:38.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.152+0000 7f6088a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217bfe50 0x55c4217c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:38.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.152+0000 7f6089400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b5590 0x55c4217bf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:38.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.152+0000 7f6089400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b5590 0x55c4217bf910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:51908/0 (socket says 172.21.15.12:51908) 2024-09-05T01:32:38.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.152+0000 7f6089400640 1 -- 172.21.15.12:0/4182219295 learned_addr learned my addr 172.21.15.12:0/4182219295 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:38.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.152+0000 7f6089400640 1 -- 172.21.15.12:0/4182219295 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4217b4c70 msgr2=0x55c4217b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:38.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.152+0000 7f6089400640 1 --2- 172.21.15.12:0/4182219295 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4217b4c70 0x55c4217b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.152+0000 7f6089400640 1 -- 172.21.15.12:0/4182219295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217bfe50 msgr2=0x55c4217c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:38.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.152+0000 7f6089400640 1 --2- 172.21.15.12:0/4182219295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217bfe50 0x55c4217c2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.152+0000 7f6089400640 1 -- 172.21.15.12:0/4182219295 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4216e1ae0 con 0x55c4217b5590 2024-09-05T01:32:38.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.153+0000 7f6089400640 1 --2- 172.21.15.12:0/4182219295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b5590 0x55c4217bf910 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f607800bcd0 tx=0x7f60780107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91d191ee64439b8f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:38.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.153+0000 7f6082000640 1 --2- 172.21.15.12:0/1911102056 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f606c0a2d70 0x7f606c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:38.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.153+0000 7f6076600640 1 -- 172.21.15.12:0/4182219295 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6078005220 con 0x55c4217b5590 2024-09-05T01:32:38.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.153+0000 7f6076600640 1 -- 172.21.15.12:0/4182219295 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6078004c80 con 0x55c4217b5590 2024-09-05T01:32:38.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.153+0000 7f6076600640 1 -- 172.21.15.12:0/4182219295 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6078011760 con 0x55c4217b5590 2024-09-05T01:32:38.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.153+0000 7f6082000640 1 -- 172.21.15.12:0/1911102056 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7f607c0f0880 con 0x7f6084109120 2024-09-05T01:32:38.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.153+0000 7f6088a00640 1 --2- 172.21.15.12:0/1911102056 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f606c0a2d70 0x7f606c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:38.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.154+0000 7f608e7ff740 1 -- 172.21.15.12:0/4182219295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b5590 msgr2=0x55c4217bf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:38.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.154+0000 7f608e7ff740 1 --2- 172.21.15.12:0/4182219295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b5590 0x55c4217bf910 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f607800bcd0 tx=0x7f60780107a0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.154+0000 7f6088a00640 1 --2- 172.21.15.12:0/1911102056 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f606c0a2d70 0x7f606c0a5230 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55c4217b2580 tx=0x7f6070004730 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:38.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.154+0000 7f608e7ff740 1 -- 172.21.15.12:0/4182219295 shutdown_connections 2024-09-05T01:32:38.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.154+0000 7f608e7ff740 1 --2- 172.21.15.12:0/4182219295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217bfe50 0x55c4217c2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.154+0000 7f608e7ff740 1 --2- 172.21.15.12:0/4182219295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b5590 0x55c4217bf910 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.154+0000 7f608e7ff740 1 --2- 172.21.15.12:0/4182219295 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4217b4c70 0x55c4217b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.154+0000 7f608e7ff740 1 -- 172.21.15.12:0/4182219295 >> 172.21.15.12:0/4182219295 conn(0x55c4217b1200 msgr2=0x55c4217b15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:38.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.154+0000 7f608e7ff740 1 -- 172.21.15.12:0/4182219295 shutdown_connections 2024-09-05T01:32:38.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.154+0000 7f608e7ff740 1 -- 172.21.15.12:0/4182219295 wait complete. 2024-09-05T01:32:38.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.154+0000 7f608e7ff740 1 -- start start 2024-09-05T01:32:38.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.155+0000 7f608e7ff740 1 Processor -- start 2024-09-05T01:32:38.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.155+0000 7f608e7ff740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b4c70 0x55c4217bcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:38.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.155+0000 7f608e7ff740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217b5590 0x55c4217bd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:38.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.155+0000 7f608e7ff740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4217bfe50 0x55c4217bd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:38.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.155+0000 7f608e7ff740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c4217c2a20 con 0x55c4217b5590 2024-09-05T01:32:38.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.155+0000 7f608e7ff740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55c4216d60f0 con 0x55c4217bfe50 2024-09-05T01:32:38.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.155+0000 7f608e7ff740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c4217c2ba0 con 0x55c4217b4c70 2024-09-05T01:32:38.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.155+0000 7f608e7ff740 10 client.0 _ll_register_callbacks cb 0x55c4216bdbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:32:38.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.155+0000 7f6088a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217b5590 0x55c4217bd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:38.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.155+0000 7f6088a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217b5590 0x55c4217bd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53622/0 (socket says 172.21.15.12:53622) 2024-09-05T01:32:38.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.155+0000 7f6088a00640 1 -- 172.21.15.12:0/714481765 learned_addr learned my addr 172.21.15.12:0/714481765 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:38.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.155+0000 7f6089400640 1 --2- 172.21.15.12:0/714481765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b4c70 0x55c4217bcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:38.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.156+0000 7f6089e00640 1 --2- 172.21.15.12:0/714481765 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4217bfe50 0x55c4217bd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:38.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.156+0000 7f6088a00640 1 -- 172.21.15.12:0/714481765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b4c70 msgr2=0x55c4217bcdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:38.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.156+0000 7f6088a00640 1 --2- 172.21.15.12:0/714481765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b4c70 0x55c4217bcdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.156+0000 7f6088a00640 1 -- 172.21.15.12:0/714481765 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4217bfe50 msgr2=0x55c4217bd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:38.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.156+0000 7f6088a00640 1 --2- 172.21.15.12:0/714481765 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4217bfe50 0x55c4217bd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.156+0000 7f6088a00640 1 -- 172.21.15.12:0/714481765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c42148c3c0 con 0x55c4217b5590 2024-09-05T01:32:38.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.156+0000 7f6089400640 1 --2- 172.21.15.12:0/714481765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b4c70 0x55c4217bcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:32:38.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.156+0000 7f6088a00640 1 --2- 172.21.15.12:0/714481765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217b5590 0x55c4217bd300 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f60700127d0 tx=0x7f60700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c65d91eb3b8ced server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:38.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.156+0000 7f606aa00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:32:38.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.157+0000 7f606aa00640 1 -- 172.21.15.12:0/714481765 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607002d060 con 0x55c4217b5590 2024-09-05T01:32:38.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.157+0000 7f608e7ff740 1 -- 172.21.15.12:0/714481765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6078004c80 con 0x55c4217b5590 2024-09-05T01:32:38.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.157+0000 7f606aa00640 1 -- 172.21.15.12:0/714481765 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7f6070020750 con 0x55c4217b5590 2024-09-05T01:32:38.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.157+0000 7f606aa00640 1 -- 172.21.15.12:0/714481765 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f6070020950 con 0x55c4217b5590 2024-09-05T01:32:38.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.157+0000 7f608e7ff740 10 client.16155 fetch_fsmap learned FSMap version 45 2024-09-05T01:32:38.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.157+0000 7f608e7ff740 1 -- 172.21.15.12:0/714481765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55c4217ceb90 con 0x55c4217b5590 2024-09-05T01:32:38.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.157+0000 7f606aa00640 1 -- 172.21.15.12:0/714481765 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6078004c80 con 0x55c4217b5590 2024-09-05T01:32:38.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.158+0000 7f606aa00640 1 -- 172.21.15.12:0/714481765 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 45) ==== 8438+0+0 (secure 0 0 0) 0x7f607001c040 con 0x55c4217b5590 2024-09-05T01:32:38.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.158+0000 7f608e7ff740 10 client.16155 fetch_fsmap finished waiting for FSMap version 45 2024-09-05T01:32:38.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.158+0000 7f608e7ff740 10 client.16155 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:32:38.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.158+0000 7f608e7ff740 20 client.16155 populate_metadata read hostname 'smithi012' 2024-09-05T01:32:38.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.158+0000 7f608e7ff740 1 --2- 172.21.15.12:0/714481765 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55c4217d0040 0x55c4217d2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:38.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.158+0000 7f608e7ff740 4 client.16155 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:32:38.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.158+0000 7f608e7ff740 1 -- 172.21.15.12:0/714481765 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c421728950 con 0x55c4217d0040 2024-09-05T01:32:38.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.158+0000 7f6089400640 1 --2- 172.21.15.12:0/714481765 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55c4217d0040 0x55c4217d2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:38.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.159+0000 7f6089400640 1 --2- 172.21.15.12:0/714481765 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55c4217d0040 0x55c4217d2480 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48880a7a14b0c643 server_cookie=e3d5681f8ffbf371 in_seq=0 out_seq=0 2024-09-05T01:32:38.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.159+0000 7f606aa00640 10 client.16155 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:32:38.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.160+0000 7f606aa00640 1 -- 172.21.15.12:0/714481765 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c421728950 con 0x55c4217d0040 2024-09-05T01:32:38.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.160+0000 7f606aa00640 10 client.16155 handle_command_reply: tid=0 2024-09-05T01:32:38.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.160+0000 7f608e7ff740 1 client.16155 shutdown 2024-09-05T01:32:38.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.160+0000 7f608e7ff740 1 -- 172.21.15.12:0/714481765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217b5590 msgr2=0x55c4217bd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:38.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.160+0000 7f608e7ff740 1 --2- 172.21.15.12:0/714481765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217b5590 0x55c4217bd300 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f60700127d0 tx=0x7f60700046c0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.160+0000 7f608e7ff740 1 -- 172.21.15.12:0/714481765 shutdown_connections 2024-09-05T01:32:38.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.160+0000 7f608e7ff740 1 --2- 172.21.15.12:0/714481765 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55c4217d0040 0x55c4217d2480 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.160+0000 7f608e7ff740 1 --2- 172.21.15.12:0/714481765 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4217bfe50 0x55c4217bd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.160+0000 7f608e7ff740 1 --2- 172.21.15.12:0/714481765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217b5590 0x55c4217bd300 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.160+0000 7f606aa00640 0 client.16155 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:32:38.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.160+0000 7f608e7ff740 1 --2- 172.21.15.12:0/714481765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b4c70 0x55c4217bcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.160+0000 7f608e7ff740 1 -- 172.21.15.12:0/714481765 >> 172.21.15.12:0/714481765 conn(0x55c4217b1200 msgr2=0x55c4217b6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:38.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.160+0000 7f608e7ff740 1 -- 172.21.15.12:0/714481765 shutdown_connections 2024-09-05T01:32:38.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.160+0000 7f608e7ff740 1 -- 172.21.15.12:0/714481765 wait complete. 2024-09-05T01:32:38.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.160+0000 7f608e7ff740 20 client.16155 trim_cache size 0 max 16384 2024-09-05T01:32:38.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.174+0000 7f608e7ff740 1 Processor -- start 2024-09-05T01:32:38.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.174+0000 7f608e7ff740 1 -- start start 2024-09-05T01:32:38.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.175+0000 7f608e7ff740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b4c70 0x55c4217d7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:38.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.175+0000 7f608e7ff740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217b5590 0x55c4217d8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:38.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.175+0000 7f608e7ff740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4217bfe50 0x55c4217be620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:38.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.175+0000 7f608e7ff740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f60841afb30 con 0x55c4217b5590 2024-09-05T01:32:38.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.175+0000 7f608e7ff740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f60841b1880 con 0x55c4217bfe50 2024-09-05T01:32:38.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.175+0000 7f608e7ff740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f60841b0200 con 0x55c4217b4c70 2024-09-05T01:32:38.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.175+0000 7f6088a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217b5590 0x55c4217d8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:38.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.175+0000 7f6088a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217b5590 0x55c4217d8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53630/0 (socket says 172.21.15.12:53630) 2024-09-05T01:32:38.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.175+0000 7f6088a00640 1 -- 172.21.15.12:0/3849897723 learned_addr learned my addr 172.21.15.12:0/3849897723 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:38.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.175+0000 7f6089400640 1 --2- 172.21.15.12:0/3849897723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b4c70 0x55c4217d7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:38.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.175+0000 7f6089e00640 1 --2- 172.21.15.12:0/3849897723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4217bfe50 0x55c4217be620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:38.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.175+0000 7f6088a00640 1 -- 172.21.15.12:0/3849897723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b4c70 msgr2=0x55c4217d7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:38.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.175+0000 7f6088a00640 1 --2- 172.21.15.12:0/3849897723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b4c70 0x55c4217d7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.175+0000 7f6088a00640 1 -- 172.21.15.12:0/3849897723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4217bfe50 msgr2=0x55c4217be620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:38.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.175+0000 7f6088a00640 1 --2- 172.21.15.12:0/3849897723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4217bfe50 0x55c4217be620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.175+0000 7f6088a00640 1 -- 172.21.15.12:0/3849897723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4217ac770 con 0x55c4217b5590 2024-09-05T01:32:38.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.175+0000 7f6089e00640 1 --2- 172.21.15.12:0/3849897723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4217bfe50 0x55c4217be620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:32:38.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.176+0000 7f6088a00640 1 --2- 172.21.15.12:0/3849897723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217b5590 0x55c4217d8290 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6070005d00 tx=0x7f607000bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a422c77d3e6eaf server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:38.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.176+0000 7f6075c00640 1 -- 172.21.15.12:0/3849897723 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607000b410 con 0x55c4217b5590 2024-09-05T01:32:38.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.176+0000 7f6075c00640 1 -- 172.21.15.12:0/3849897723 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6070020750 con 0x55c4217b5590 2024-09-05T01:32:38.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.176+0000 7f6075c00640 1 -- 172.21.15.12:0/3849897723 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607001ea30 con 0x55c4217b5590 2024-09-05T01:32:38.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.177+0000 7f608e7ff740 1 -- 172.21.15.12:0/3849897723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217b5590 msgr2=0x55c4217d8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:38.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.177+0000 7f608e7ff740 1 --2- 172.21.15.12:0/3849897723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217b5590 0x55c4217d8290 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6070005d00 tx=0x7f607000bee0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.177+0000 7f608e7ff740 1 -- 172.21.15.12:0/3849897723 shutdown_connections 2024-09-05T01:32:38.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.177+0000 7f608e7ff740 1 --2- 172.21.15.12:0/3849897723 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4217bfe50 0x55c4217be620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.177+0000 7f608e7ff740 1 --2- 172.21.15.12:0/3849897723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217b5590 0x55c4217d8290 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.177+0000 7f608e7ff740 1 --2- 172.21.15.12:0/3849897723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b4c70 0x55c4217d7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.177+0000 7f608e7ff740 1 -- 172.21.15.12:0/3849897723 >> 172.21.15.12:0/3849897723 conn(0x55c4217b1200 msgr2=0x55c4217bbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:38.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.177+0000 7f608e7ff740 1 -- 172.21.15.12:0/3849897723 shutdown_connections 2024-09-05T01:32:38.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.177+0000 7f608e7ff740 1 -- 172.21.15.12:0/3849897723 wait complete. 2024-09-05T01:32:38.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.177+0000 7f608e7ff740 1 -- start start 2024-09-05T01:32:38.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.177+0000 7f608e7ff740 1 Processor -- start 2024-09-05T01:32:38.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.178+0000 7f608e7ff740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b4c70 0x55c4217c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:38.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.178+0000 7f608e7ff740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217b5590 0x55c4217c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:38.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.178+0000 7f608e7ff740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4217bfe50 0x55c4217c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:38.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.178+0000 7f608e7ff740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f60841b10f0 con 0x55c4217b5590 2024-09-05T01:32:38.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.178+0000 7f608e7ff740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f60841b0960 con 0x55c4217bfe50 2024-09-05T01:32:38.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.178+0000 7f608e7ff740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f60841adb30 con 0x55c4217b4c70 2024-09-05T01:32:38.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.178+0000 7f608e7ff740 10 client.0 _ll_register_callbacks cb 0x7f6070012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:32:38.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.178+0000 7f6088a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217b5590 0x55c4217c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:38.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.178+0000 7f6089400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b4c70 0x55c4217c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:38.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.178+0000 7f6089400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b4c70 0x55c4217c84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:51922/0 (socket says 172.21.15.12:51922) 2024-09-05T01:32:38.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.178+0000 7f6089400640 1 -- 172.21.15.12:0/677863158 learned_addr learned my addr 172.21.15.12:0/677863158 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:38.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.178+0000 7f6089e00640 1 --2- 172.21.15.12:0/677863158 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4217bfe50 0x55c4217c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:38.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.179+0000 7f6088a00640 1 -- 172.21.15.12:0/677863158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b4c70 msgr2=0x55c4217c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:38.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.179+0000 7f6088a00640 1 --2- 172.21.15.12:0/677863158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b4c70 0x55c4217c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.179+0000 7f6088a00640 1 -- 172.21.15.12:0/677863158 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4217bfe50 msgr2=0x55c4217c3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:38.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.179+0000 7f6088a00640 1 --2- 172.21.15.12:0/677863158 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4217bfe50 0x55c4217c3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.179+0000 7f6088a00640 1 -- 172.21.15.12:0/677863158 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4217b1e90 con 0x55c4217b5590 2024-09-05T01:32:38.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.179+0000 7f6089400640 1 --2- 172.21.15.12:0/677863158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b4c70 0x55c4217c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:32:38.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.179+0000 7f6088a00640 1 --2- 172.21.15.12:0/677863158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217b5590 0x55c4217c37f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6070011ed0 tx=0x7f6070020e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386dda5106794b98 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:38.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.179+0000 7f606aa00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:32:38.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.179+0000 7f606aa00640 1 -- 172.21.15.12:0/677863158 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607002d040 con 0x55c4217b5590 2024-09-05T01:32:38.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.179+0000 7f606aa00640 1 -- 172.21.15.12:0/677863158 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7f6070004230 con 0x55c4217b5590 2024-09-05T01:32:38.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.179+0000 7f608e7ff740 1 -- 172.21.15.12:0/677863158 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6070020750 con 0x55c4217b5590 2024-09-05T01:32:38.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.180+0000 7f606aa00640 1 -- 172.21.15.12:0/677863158 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f607000b410 con 0x55c4217b5590 2024-09-05T01:32:38.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.180+0000 7f608e7ff740 10 client.16161 fetch_fsmap learned FSMap version 45 2024-09-05T01:32:38.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.180+0000 7f608e7ff740 1 -- 172.21.15.12:0/677863158 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55c42183aaf0 con 0x55c4217b5590 2024-09-05T01:32:38.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.180+0000 7f606aa00640 1 -- 172.21.15.12:0/677863158 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6070020750 con 0x55c4217b5590 2024-09-05T01:32:38.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.180+0000 7f606aa00640 1 -- 172.21.15.12:0/677863158 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 45) ==== 8438+0+0 (secure 0 0 0) 0x7f607001c040 con 0x55c4217b5590 2024-09-05T01:32:38.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.180+0000 7f608e7ff740 10 client.16161 fetch_fsmap finished waiting for FSMap version 45 2024-09-05T01:32:38.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.180+0000 7f608e7ff740 10 client.16161 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:32:38.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.180+0000 7f608e7ff740 20 client.16161 populate_metadata read hostname 'smithi012' 2024-09-05T01:32:38.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.180+0000 7f608e7ff740 1 --2- 172.21.15.12:0/677863158 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55c42183b1c0 0x55c42183d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:38.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.180+0000 7f608e7ff740 4 client.16161 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:32:38.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.180+0000 7f608e7ff740 1 -- 172.21.15.12:0/677863158 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c421722e60 con 0x55c42183b1c0 2024-09-05T01:32:38.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.180+0000 7f6089400640 1 --2- 172.21.15.12:0/677863158 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55c42183b1c0 0x55c42183d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:38.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.181+0000 7f6089400640 1 --2- 172.21.15.12:0/677863158 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55c42183b1c0 0x55c42183d5e0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5578bb7a7cd73f2e server_cookie=4078203b9b390c6d in_seq=0 out_seq=0 2024-09-05T01:32:38.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.181+0000 7f606aa00640 10 client.16161 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:32:38.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.181+0000 7f606aa00640 1 -- 172.21.15.12:0/677863158 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c421722e60 con 0x55c42183b1c0 2024-09-05T01:32:38.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.181+0000 7f606aa00640 10 client.16161 handle_command_reply: tid=0 2024-09-05T01:32:38.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.181+0000 7f608e7ff740 1 client.16161 shutdown 2024-09-05T01:32:38.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.181+0000 7f608e7ff740 1 -- 172.21.15.12:0/677863158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217b5590 msgr2=0x55c4217c37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:38.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.181+0000 7f608e7ff740 1 --2- 172.21.15.12:0/677863158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217b5590 0x55c4217c37f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6070011ed0 tx=0x7f6070020e20 comp rx=0 tx=0).stop 2024-09-05T01:32:38.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.182+0000 7f608e7ff740 1 -- 172.21.15.12:0/677863158 shutdown_connections 2024-09-05T01:32:38.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.182+0000 7f608e7ff740 1 --2- 172.21.15.12:0/677863158 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55c42183b1c0 0x55c42183d5e0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.182+0000 7f608e7ff740 1 --2- 172.21.15.12:0/677863158 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55c4217bfe50 0x55c4217c3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.182+0000 7f608e7ff740 1 --2- 172.21.15.12:0/677863158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c4217b5590 0x55c4217c37f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.182+0000 7f608e7ff740 1 --2- 172.21.15.12:0/677863158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4217b4c70 0x55c4217c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.182+0000 7f608e7ff740 1 -- 172.21.15.12:0/677863158 >> 172.21.15.12:0/677863158 conn(0x55c4217b1200 msgr2=0x55c4217afb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:38.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.182+0000 7f606aa00640 0 client.16161 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:32:38.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.182+0000 7f608e7ff740 1 -- 172.21.15.12:0/677863158 shutdown_connections 2024-09-05T01:32:38.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.182+0000 7f608e7ff740 1 -- 172.21.15.12:0/677863158 wait complete. 2024-09-05T01:32:38.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.182+0000 7f608e7ff740 20 client.16161 trim_cache size 0 max 16384 2024-09-05T01:32:38.188 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:32:38.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.183+0000 7f608be00640 1 -- 172.21.15.12:0/1911102056 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f606c0a2d70 msgr2=0x7f606c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:38.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.183+0000 7f608be00640 1 --2- 172.21.15.12:0/1911102056 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f606c0a2d70 0x7f606c0a5230 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55c4217b2580 tx=0x7f6070004730 comp rx=0 tx=0).stop 2024-09-05T01:32:38.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.183+0000 7f608be00640 1 -- 172.21.15.12:0/1911102056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6084109120 msgr2=0x7f608419ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:38.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.183+0000 7f608be00640 1 --2- 172.21.15.12:0/1911102056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6084109120 0x7f608419ee60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f607c031a20 tx=0x7f607c031a50 comp rx=0 tx=0).stop 2024-09-05T01:32:38.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.183+0000 7f608be00640 1 -- 172.21.15.12:0/1911102056 shutdown_connections 2024-09-05T01:32:38.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.183+0000 7f608be00640 1 --2- 172.21.15.12:0/1911102056 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f606c0a2d70 0x7f606c0a5230 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.183+0000 7f608be00640 1 --2- 172.21.15.12:0/1911102056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6084109120 0x7f608419ee60 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.183+0000 7f608be00640 1 --2- 172.21.15.12:0/1911102056 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f60841049a0 0x7f608419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.183+0000 7f608be00640 1 --2- 172.21.15.12:0/1911102056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6084103ff0 0x7f608419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:38.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.183+0000 7f608be00640 1 -- 172.21.15.12:0/1911102056 >> 172.21.15.12:0/1911102056 conn(0x7f60840ffa90 msgr2=0x7f6084101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:38.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.183+0000 7f608be00640 1 -- 172.21.15.12:0/1911102056 shutdown_connections 2024-09-05T01:32:38.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:38.183+0000 7f608be00640 1 -- 172.21.15.12:0/1911102056 wait complete. 2024-09-05T01:32:39.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:39 smithi012 ceph-mon[29942]: pgmap v245: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 200 KiB/s wr, 34 op/s 2024-09-05T01:32:39.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:39 smithi145 ceph-mon[34376]: pgmap v245: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 200 KiB/s wr, 34 op/s 2024-09-05T01:32:39.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:39 smithi151 ceph-mon[35013]: pgmap v245: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 200 KiB/s wr, 34 op/s 2024-09-05T01:32:40.071 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-05T01:32:40.071 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-05T01:32:40.469 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:32:40.473 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:40 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:32:40.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:40 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:32:40.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:40 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:32:41.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.029+0000 7f5f7ce00640 1 -- 172.21.15.12:0/939584749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f7810e3c0 msgr2=0x7f5f78110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:41.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.029+0000 7f5f7ce00640 1 --2- 172.21.15.12:0/939584749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f7810e3c0 0x7f5f78110810 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009be0 tx=0x7f5f7002a750 comp rx=0 tx=0).stop 2024-09-05T01:32:41.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.029+0000 7f5f7ce00640 1 -- 172.21.15.12:0/939584749 shutdown_connections 2024-09-05T01:32:41.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.029+0000 7f5f7ce00640 1 --2- 172.21.15.12:0/939584749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f7810e3c0 0x7f5f78110810 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.029+0000 7f5f7ce00640 1 --2- 172.21.15.12:0/939584749 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f78074f40 0x7f5f7810de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.029+0000 7f5f7ce00640 1 --2- 172.21.15.12:0/939584749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f78074620 0x7f5f78074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.029+0000 7f5f7ce00640 1 -- 172.21.15.12:0/939584749 >> 172.21.15.12:0/939584749 conn(0x7f5f780fd8c0 msgr2=0x7f5f780ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:41.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.029+0000 7f5f7ce00640 1 -- 172.21.15.12:0/939584749 shutdown_connections 2024-09-05T01:32:41.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.029+0000 7f5f7ce00640 1 -- 172.21.15.12:0/939584749 wait complete. 2024-09-05T01:32:41.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.030+0000 7f5f7ce00640 1 Processor -- start 2024-09-05T01:32:41.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.030+0000 7f5f7ce00640 1 -- start start 2024-09-05T01:32:41.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.031+0000 7f5f7ce00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f78074620 0x7f5f7819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:41.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.031+0000 7f5f7ce00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f78074f40 0x7f5f7819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:41.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.031+0000 7f5f7ce00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f7810e3c0 0x7f5f7819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:41.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.031+0000 7f5f7ce00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5f78114150 con 0x7f5f78074f40 2024-09-05T01:32:41.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.031+0000 7f5f7ce00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5f78113fd0 con 0x7f5f7810e3c0 2024-09-05T01:32:41.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.031+0000 7f5f7ce00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5f781142d0 con 0x7f5f78074620 2024-09-05T01:32:41.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.031+0000 7f5f6d400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f78074f40 0x7f5f7819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:41.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.031+0000 7f5f75e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f78074620 0x7f5f7819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:41.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.031+0000 7f5f6d400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f78074f40 0x7f5f7819ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53646/0 (socket says 172.21.15.12:53646) 2024-09-05T01:32:41.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.031+0000 7f5f6d400640 1 -- 172.21.15.12:0/3095879434 learned_addr learned my addr 172.21.15.12:0/3095879434 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:41.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.031+0000 7f5f76800640 1 --2- 172.21.15.12:0/3095879434 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f7810e3c0 0x7f5f7819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:41.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.032+0000 7f5f76800640 1 -- 172.21.15.12:0/3095879434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f78074620 msgr2=0x7f5f7819a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:41.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.032+0000 7f5f76800640 1 --2- 172.21.15.12:0/3095879434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f78074620 0x7f5f7819a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.032+0000 7f5f76800640 1 -- 172.21.15.12:0/3095879434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f78074f40 msgr2=0x7f5f7819ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:41.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.032+0000 7f5f76800640 1 --2- 172.21.15.12:0/3095879434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f78074f40 0x7f5f7819ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.032+0000 7f5f76800640 1 -- 172.21.15.12:0/3095879434 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f7819f5c0 con 0x7f5f7810e3c0 2024-09-05T01:32:41.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.032+0000 7f5f6d400640 1 --2- 172.21.15.12:0/3095879434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f78074f40 0x7f5f7819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:32:41.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.032+0000 7f5f76800640 1 --2- 172.21.15.12:0/3095879434 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f7810e3c0 0x7f5f7819eee0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009b30 tx=0x7f5f700305d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:41.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.032+0000 7f5f6f400640 1 -- 172.21.15.12:0/3095879434 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f70041020 con 0x7f5f7810e3c0 2024-09-05T01:32:41.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.032+0000 7f5f7ce00640 1 -- 172.21.15.12:0/3095879434 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f7819f850 con 0x7f5f7810e3c0 2024-09-05T01:32:41.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.032+0000 7f5f6f400640 1 -- 172.21.15.12:0/3095879434 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f70003e50 con 0x7f5f7810e3c0 2024-09-05T01:32:41.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.032+0000 7f5f6f400640 1 -- 172.21.15.12:0/3095879434 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f70036040 con 0x7f5f7810e3c0 2024-09-05T01:32:41.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.033+0000 7f5f7ce00640 1 -- 172.21.15.12:0/3095879434 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f781a7190 con 0x7f5f7810e3c0 2024-09-05T01:32:41.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.036+0000 7f5f6f400640 1 -- 172.21.15.12:0/3095879434 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f5f70044020 con 0x7f5f7810e3c0 2024-09-05T01:32:41.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.037+0000 7f5f7f9f5740 1 Processor -- start 2024-09-05T01:32:41.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.037+0000 7f5f6f400640 1 --2- 172.21.15.12:0/3095879434 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5f5c0a2cf0 0x7f5f5c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:41.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.037+0000 7f5f7f9f5740 1 -- start start 2024-09-05T01:32:41.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.038+0000 7f5f6f400640 1 -- 172.21.15.12:0/3095879434 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7f5f700efc40 con 0x7f5f7810e3c0 2024-09-05T01:32:41.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.038+0000 7f5f7f9f5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603a0a4bac0 0x5603a0a4bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:41.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.038+0000 7f5f6d400640 1 --2- 172.21.15.12:0/3095879434 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5f5c0a2cf0 0x7f5f5c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:41.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.038+0000 7f5f7f9f5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a4c3e0 0x5603a0a56760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:41.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.038+0000 7f5f7f9f5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a56ca0 0x5603a0a59090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:41.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.038+0000 7f5f7f9f5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5603a09b2290 con 0x5603a0a4c3e0 2024-09-05T01:32:41.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.038+0000 7f5f7f9f5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5603a0959b40 con 0x5603a0a56ca0 2024-09-05T01:32:41.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.038+0000 7f5f7f9f5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5603a09ae250 con 0x5603a0a4bac0 2024-09-05T01:32:41.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.038+0000 7f5f6d400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a4c3e0 0x5603a0a56760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:41.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.038+0000 7f5f75e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603a0a4bac0 0x5603a0a4bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:41.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.038+0000 7f5f6d400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a4c3e0 0x5603a0a56760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53648/0 (socket says 172.21.15.12:53648) 2024-09-05T01:32:41.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.038+0000 7f5f75e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603a0a4bac0 0x5603a0a4bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:51952/0 (socket says 172.21.15.12:51952) 2024-09-05T01:32:41.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.038+0000 7f5f6d400640 1 -- 172.21.15.12:0/2401730323 learned_addr learned my addr 172.21.15.12:0/2401730323 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:41.041 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.038+0000 7f5f76800640 1 --2- 172.21.15.12:0/2401730323 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a56ca0 0x5603a0a59090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:41.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.039+0000 7f5f76800640 1 -- 172.21.15.12:0/2401730323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603a0a4bac0 msgr2=0x5603a0a4bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:41.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.039+0000 7f5f76800640 1 --2- 172.21.15.12:0/2401730323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603a0a4bac0 0x5603a0a4bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.039+0000 7f5f76800640 1 -- 172.21.15.12:0/2401730323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a4c3e0 msgr2=0x5603a0a56760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:41.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.039+0000 7f5f76800640 1 --2- 172.21.15.12:0/2401730323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a4c3e0 0x5603a0a56760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.039+0000 7f5f76800640 1 -- 172.21.15.12:0/2401730323 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603a07236a0 con 0x5603a0a56ca0 2024-09-05T01:32:41.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.039+0000 7f5f76800640 1 --2- 172.21.15.12:0/2401730323 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a56ca0 0x5603a0a59090 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5f700ed2f0 tx=0x7f5f700bba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e240a836fcc87f1d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:41.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.039+0000 7f5f6d400640 1 --2- 172.21.15.12:0/3095879434 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5f5c0a2cf0 0x7f5f5c0a51b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5f60013df0 tx=0x7f5f60009f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:41.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.039+0000 7f5f67400640 1 -- 172.21.15.12:0/2401730323 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f700bc0c0 con 0x5603a0a56ca0 2024-09-05T01:32:41.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.039+0000 7f5f67400640 1 -- 172.21.15.12:0/2401730323 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f700c0470 con 0x5603a0a56ca0 2024-09-05T01:32:41.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.039+0000 7f5f67400640 1 -- 172.21.15.12:0/2401730323 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f700b8730 con 0x5603a0a56ca0 2024-09-05T01:32:41.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.040+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/2401730323 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a56ca0 msgr2=0x5603a0a59090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:41.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.040+0000 7f5f7f9f5740 1 --2- 172.21.15.12:0/2401730323 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a56ca0 0x5603a0a59090 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5f700ed2f0 tx=0x7f5f700bba20 comp rx=0 tx=0).stop 2024-09-05T01:32:41.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.040+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/2401730323 shutdown_connections 2024-09-05T01:32:41.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.040+0000 7f5f7f9f5740 1 --2- 172.21.15.12:0/2401730323 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a56ca0 0x5603a0a59090 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.040+0000 7f5f7f9f5740 1 --2- 172.21.15.12:0/2401730323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a4c3e0 0x5603a0a56760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.040+0000 7f5f7f9f5740 1 --2- 172.21.15.12:0/2401730323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603a0a4bac0 0x5603a0a4bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.040+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/2401730323 >> 172.21.15.12:0/2401730323 conn(0x5603a0a48050 msgr2=0x5603a0a48430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:41.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.041+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/2401730323 shutdown_connections 2024-09-05T01:32:41.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.041+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/2401730323 wait complete. 2024-09-05T01:32:41.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.041+0000 7f5f7f9f5740 1 -- start start 2024-09-05T01:32:41.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.042+0000 7f5f7f9f5740 1 Processor -- start 2024-09-05T01:32:41.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.042+0000 7f5f7f9f5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a4bac0 0x5603a0a565d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:41.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.042+0000 7f5f7f9f5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603a0a4c3e0 0x5603a0a53880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:41.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.042+0000 7f5f7f9f5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a56ca0 0x5603a0a53dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:41.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.042+0000 7f5f7f9f5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5603a0a59630 con 0x5603a0a56ca0 2024-09-05T01:32:41.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.042+0000 7f5f7f9f5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5603a096cfa0 con 0x5603a0a4bac0 2024-09-05T01:32:41.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.042+0000 7f5f7f9f5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5603a0a597b0 con 0x5603a0a4c3e0 2024-09-05T01:32:41.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.042+0000 7f5f7f9f5740 10 client.0 _ll_register_callbacks cb 0x5603a06c0ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:32:41.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.042+0000 7f5f76800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a56ca0 0x5603a0a53dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:41.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.042+0000 7f5f6d400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603a0a4c3e0 0x5603a0a53880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:41.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.043+0000 7f5f6d400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603a0a4c3e0 0x5603a0a53880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:51954/0 (socket says 172.21.15.12:51954) 2024-09-05T01:32:41.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.043+0000 7f5f6d400640 1 -- 172.21.15.12:0/2629245151 learned_addr learned my addr 172.21.15.12:0/2629245151 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:41.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.043+0000 7f5f75e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a4bac0 0x5603a0a565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:41.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.043+0000 7f5f6d400640 1 -- 172.21.15.12:0/2629245151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a4bac0 msgr2=0x5603a0a565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:41.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.043+0000 7f5f6d400640 1 --2- 172.21.15.12:0/2629245151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a4bac0 0x5603a0a565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.043+0000 7f5f6d400640 1 -- 172.21.15.12:0/2629245151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a56ca0 msgr2=0x5603a0a53dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:41.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.043+0000 7f5f6d400640 1 --2- 172.21.15.12:0/2629245151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a56ca0 0x5603a0a53dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.043+0000 7f5f6d400640 1 -- 172.21.15.12:0/2629245151 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603a0a545f0 con 0x5603a0a4c3e0 2024-09-05T01:32:41.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.043+0000 7f5f75e00640 1 --2- 172.21.15.12:0/2629245151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a4bac0 0x5603a0a565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:32:41.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.043+0000 7f5f76800640 1 --2- 172.21.15.12:0/2629245151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a56ca0 0x5603a0a53dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:32:41.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.043+0000 7f5f6d400640 1 --2- 172.21.15.12:0/2629245151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603a0a4c3e0 0x5603a0a53880 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5f60011fd0 tx=0x7f5f6001d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df2b3855a055c044 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:41.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.043+0000 7f5f5be00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:32:41.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.044+0000 7f5f5be00640 1 -- 172.21.15.12:0/2629245151 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f60021620 con 0x5603a0a4c3e0 2024-09-05T01:32:41.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.044+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/2629245151 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f700c0470 con 0x5603a0a4c3e0 2024-09-05T01:32:41.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.044+0000 7f5f5be00640 1 -- 172.21.15.12:0/2629245151 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7f5f600217c0 con 0x5603a0a4c3e0 2024-09-05T01:32:41.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.044+0000 7f5f5be00640 1 -- 172.21.15.12:0/2629245151 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f5f600219c0 con 0x5603a0a4c3e0 2024-09-05T01:32:41.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.044+0000 7f5f7f9f5740 10 client.26218 fetch_fsmap learned FSMap version 46 2024-09-05T01:32:41.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.044+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/2629245151 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x5603a0a65590 con 0x5603a0a4c3e0 2024-09-05T01:32:41.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.044+0000 7f5f5be00640 1 -- 172.21.15.12:0/2629245151 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f700c0470 con 0x5603a0a4c3e0 2024-09-05T01:32:41.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.045+0000 7f5f5be00640 1 -- 172.21.15.12:0/2629245151 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 46) ==== 8434+0+0 (secure 0 0 0) 0x7f5f60031030 con 0x5603a0a4c3e0 2024-09-05T01:32:41.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.045+0000 7f5f7f9f5740 10 client.26218 fetch_fsmap finished waiting for FSMap version 46 2024-09-05T01:32:41.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.045+0000 7f5f7f9f5740 10 client.26218 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:32:41.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.045+0000 7f5f7f9f5740 20 client.26218 populate_metadata read hostname 'smithi012' 2024-09-05T01:32:41.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.045+0000 7f5f7f9f5740 1 --2- 172.21.15.12:0/2629245151 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5603a0a66a60 0x5603a0a68ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:41.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.045+0000 7f5f7f9f5740 4 client.26218 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:32:41.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.045+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/2629245151 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603a09bf800 con 0x5603a0a66a60 2024-09-05T01:32:41.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.045+0000 7f5f75e00640 1 --2- 172.21.15.12:0/2629245151 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5603a0a66a60 0x5603a0a68ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:41.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.046+0000 7f5f75e00640 1 --2- 172.21.15.12:0/2629245151 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5603a0a66a60 0x5603a0a68ea0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c834cca2e419a00 server_cookie=402ab143650dcec8 in_seq=0 out_seq=0 2024-09-05T01:32:41.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.046+0000 7f5f5be00640 10 client.26218 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:32:41.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.047+0000 7f5f5be00640 1 -- 172.21.15.12:0/2629245151 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5603a09bf800 con 0x5603a0a66a60 2024-09-05T01:32:41.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.047+0000 7f5f5be00640 10 client.26218 handle_command_reply: tid=0 2024-09-05T01:32:41.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.047+0000 7f5f7f9f5740 1 client.26218 shutdown 2024-09-05T01:32:41.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.047+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/2629245151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603a0a4c3e0 msgr2=0x5603a0a53880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:41.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.047+0000 7f5f7f9f5740 1 --2- 172.21.15.12:0/2629245151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603a0a4c3e0 0x5603a0a53880 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5f60011fd0 tx=0x7f5f6001d000 comp rx=0 tx=0).stop 2024-09-05T01:32:41.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.047+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/2629245151 shutdown_connections 2024-09-05T01:32:41.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.047+0000 7f5f7f9f5740 1 --2- 172.21.15.12:0/2629245151 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5603a0a66a60 0x5603a0a68ea0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.047+0000 7f5f7f9f5740 1 --2- 172.21.15.12:0/2629245151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a56ca0 0x5603a0a53dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.047+0000 7f5f7f9f5740 1 --2- 172.21.15.12:0/2629245151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603a0a4c3e0 0x5603a0a53880 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.047+0000 7f5f7f9f5740 1 --2- 172.21.15.12:0/2629245151 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a4bac0 0x5603a0a565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.047+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/2629245151 >> 172.21.15.12:0/2629245151 conn(0x5603a0a48050 msgr2=0x5603a0a4dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:41.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.047+0000 7f5f5be00640 0 client.26218 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:32:41.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.047+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/2629245151 shutdown_connections 2024-09-05T01:32:41.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.047+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/2629245151 wait complete. 2024-09-05T01:32:41.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.048+0000 7f5f7f9f5740 20 client.26218 trim_cache size 0 max 16384 2024-09-05T01:32:41.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.068+0000 7f5f7f9f5740 1 Processor -- start 2024-09-05T01:32:41.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.068+0000 7f5f7f9f5740 1 -- start start 2024-09-05T01:32:41.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.068+0000 7f5f7f9f5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603a0a4bac0 0x5603a0a4ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:41.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.068+0000 7f5f7f9f5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a4c3e0 0x5603a0a6e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:41.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.068+0000 7f5f7f9f5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a56ca0 0x5603a0a6ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:41.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.068+0000 7f5f7f9f5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5f781ab760 con 0x5603a0a56ca0 2024-09-05T01:32:41.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.068+0000 7f5f7f9f5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5f781ad4b0 con 0x5603a0a4c3e0 2024-09-05T01:32:41.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.068+0000 7f5f7f9f5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5f781abe30 con 0x5603a0a4bac0 2024-09-05T01:32:41.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.068+0000 7f5f76800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a56ca0 0x5603a0a6ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:41.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.068+0000 7f5f6d400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a4c3e0 0x5603a0a6e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:41.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.069+0000 7f5f6d400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a4c3e0 0x5603a0a6e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:60040/0 (socket says 172.21.15.12:60040) 2024-09-05T01:32:41.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.069+0000 7f5f6d400640 1 -- 172.21.15.12:0/1922063516 learned_addr learned my addr 172.21.15.12:0/1922063516 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:41.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.069+0000 7f5f76800640 1 --2- 172.21.15.12:0/1922063516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a56ca0 0x5603a0a6ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53676/0 (socket says 172.21.15.12:53676) 2024-09-05T01:32:41.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.069+0000 7f5f75e00640 1 --2- 172.21.15.12:0/1922063516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603a0a4bac0 0x5603a0a4ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:41.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.069+0000 7f5f76800640 1 -- 172.21.15.12:0/1922063516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603a0a4bac0 msgr2=0x5603a0a4ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:41.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.069+0000 7f5f76800640 1 --2- 172.21.15.12:0/1922063516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603a0a4bac0 0x5603a0a4ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.069+0000 7f5f76800640 1 -- 172.21.15.12:0/1922063516 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a4c3e0 msgr2=0x5603a0a6e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:41.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.069+0000 7f5f76800640 1 --2- 172.21.15.12:0/1922063516 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a4c3e0 0x5603a0a6e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.069+0000 7f5f76800640 1 -- 172.21.15.12:0/1922063516 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603a0a593f0 con 0x5603a0a56ca0 2024-09-05T01:32:41.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.069+0000 7f5f6d400640 1 --2- 172.21.15.12:0/1922063516 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a4c3e0 0x5603a0a6e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:32:41.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.069+0000 7f5f76800640 1 --2- 172.21.15.12:0/1922063516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a56ca0 0x5603a0a6ecf0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5f700ed320 tx=0x7f5f700bbb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3edeea143e76b88 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:41.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.070+0000 7f5f66a00640 1 -- 172.21.15.12:0/1922063516 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f700bc0c0 con 0x5603a0a56ca0 2024-09-05T01:32:41.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.070+0000 7f5f66a00640 1 -- 172.21.15.12:0/1922063516 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f700ba3c0 con 0x5603a0a56ca0 2024-09-05T01:32:41.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.070+0000 7f5f66a00640 1 -- 172.21.15.12:0/1922063516 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f70031660 con 0x5603a0a56ca0 2024-09-05T01:32:41.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.070+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/1922063516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a56ca0 msgr2=0x5603a0a6ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:41.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.070+0000 7f5f7f9f5740 1 --2- 172.21.15.12:0/1922063516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a56ca0 0x5603a0a6ecf0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f5f700ed320 tx=0x7f5f700bbb50 comp rx=0 tx=0).stop 2024-09-05T01:32:41.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.071+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/1922063516 shutdown_connections 2024-09-05T01:32:41.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.071+0000 7f5f7f9f5740 1 --2- 172.21.15.12:0/1922063516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a56ca0 0x5603a0a6ecf0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.071+0000 7f5f7f9f5740 1 --2- 172.21.15.12:0/1922063516 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a4c3e0 0x5603a0a6e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.071+0000 7f5f7f9f5740 1 --2- 172.21.15.12:0/1922063516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603a0a4bac0 0x5603a0a4ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.071+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/1922063516 >> 172.21.15.12:0/1922063516 conn(0x5603a0a48050 msgr2=0x5603a0a4e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:41.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.071+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/1922063516 shutdown_connections 2024-09-05T01:32:41.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.071+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/1922063516 wait complete. 2024-09-05T01:32:41.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.071+0000 7f5f7f9f5740 1 -- start start 2024-09-05T01:32:41.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.071+0000 7f5f7f9f5740 1 Processor -- start 2024-09-05T01:32:41.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.072+0000 7f5f7f9f5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a4bac0 0x5603a0a5eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:41.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.072+0000 7f5f7f9f5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a4c3e0 0x5603a0a5f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:41.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.072+0000 7f5f7f9f5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603a0a56ca0 0x5603a0a59f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:41.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.072+0000 7f5f7f9f5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5f781acd20 con 0x5603a0a4c3e0 2024-09-05T01:32:41.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.072+0000 7f5f7f9f5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5f781ac590 con 0x5603a0a4bac0 2024-09-05T01:32:41.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.072+0000 7f5f7f9f5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5f781a9760 con 0x5603a0a56ca0 2024-09-05T01:32:41.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.072+0000 7f5f7f9f5740 10 client.0 _ll_register_callbacks cb 0x7f5f60009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:32:41.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.072+0000 7f5f6d400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a4c3e0 0x5603a0a5f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:41.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.072+0000 7f5f75e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a4bac0 0x5603a0a5eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:41.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.072+0000 7f5f6d400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a4c3e0 0x5603a0a5f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53678/0 (socket says 172.21.15.12:53678) 2024-09-05T01:32:41.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.072+0000 7f5f6d400640 1 -- 172.21.15.12:0/1568619095 learned_addr learned my addr 172.21.15.12:0/1568619095 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:41.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.072+0000 7f5f76800640 1 --2- 172.21.15.12:0/1568619095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603a0a56ca0 0x5603a0a59f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:41.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.073+0000 7f5f6d400640 1 -- 172.21.15.12:0/1568619095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603a0a56ca0 msgr2=0x5603a0a59f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:41.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.073+0000 7f5f6d400640 1 --2- 172.21.15.12:0/1568619095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603a0a56ca0 0x5603a0a59f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.073+0000 7f5f6d400640 1 -- 172.21.15.12:0/1568619095 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a4bac0 msgr2=0x5603a0a5eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:41.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.073+0000 7f5f6d400640 1 --2- 172.21.15.12:0/1568619095 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a4bac0 0x5603a0a5eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.073+0000 7f5f6d400640 1 -- 172.21.15.12:0/1568619095 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603a0a5a790 con 0x5603a0a4c3e0 2024-09-05T01:32:41.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.073+0000 7f5f75e00640 1 --2- 172.21.15.12:0/1568619095 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a4bac0 0x5603a0a5eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:32:41.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.073+0000 7f5f6d400640 1 --2- 172.21.15.12:0/1568619095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a4c3e0 0x5603a0a5f090 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5f60011fd0 tx=0x7f5f6001ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa27d210b0114c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:41.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.073+0000 7f5f5be00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:32:41.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.073+0000 7f5f5be00640 1 -- 172.21.15.12:0/1568619095 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f60021d60 con 0x5603a0a4c3e0 2024-09-05T01:32:41.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.073+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/1568619095 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f700ba3c0 con 0x5603a0a4c3e0 2024-09-05T01:32:41.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.073+0000 7f5f5be00640 1 -- 172.21.15.12:0/1568619095 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7f5f60013030 con 0x5603a0a4c3e0 2024-09-05T01:32:41.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.074+0000 7f5f5be00640 1 -- 172.21.15.12:0/1568619095 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f5f60043050 con 0x5603a0a4c3e0 2024-09-05T01:32:41.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.074+0000 7f5f7f9f5740 10 client.16179 fetch_fsmap learned FSMap version 46 2024-09-05T01:32:41.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.074+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/1568619095 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x5603a0ad1280 con 0x5603a0a4c3e0 2024-09-05T01:32:41.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.074+0000 7f5f5be00640 1 -- 172.21.15.12:0/1568619095 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f700ba3c0 con 0x5603a0a4c3e0 2024-09-05T01:32:41.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.074+0000 7f5f5be00640 1 -- 172.21.15.12:0/1568619095 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 46) ==== 8434+0+0 (secure 0 0 0) 0x7f5f6003a070 con 0x5603a0a4c3e0 2024-09-05T01:32:41.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.074+0000 7f5f7f9f5740 10 client.16179 fetch_fsmap finished waiting for FSMap version 46 2024-09-05T01:32:41.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.074+0000 7f5f7f9f5740 10 client.16179 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:32:41.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.074+0000 7f5f7f9f5740 20 client.16179 populate_metadata read hostname 'smithi012' 2024-09-05T01:32:41.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.074+0000 7f5f7f9f5740 1 --2- 172.21.15.12:0/1568619095 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5603a0ad1a00 0x5603a0ad3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:41.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.074+0000 7f5f7f9f5740 4 client.16179 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-05T01:32:41.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.074+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/1568619095 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5603a09b9d10 con 0x5603a0ad1a00 2024-09-05T01:32:41.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.075+0000 7f5f75e00640 1 --2- 172.21.15.12:0/1568619095 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5603a0ad1a00 0x5603a0ad3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:41.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.075+0000 7f5f75e00640 1 --2- 172.21.15.12:0/1568619095 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5603a0ad1a00 0x5603a0ad3e20 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4aa2837c3c43c8ff server_cookie=9c19b81bc8a7f7c2 in_seq=0 out_seq=0 2024-09-05T01:32:41.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.075+0000 7f5f5be00640 10 client.16179 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:32:41.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.077+0000 7f5f5be00640 1 -- 172.21.15.12:0/1568619095 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5603a09b9d10 con 0x5603a0ad1a00 2024-09-05T01:32:41.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.077+0000 7f5f5be00640 10 client.16179 handle_command_reply: tid=0 2024-09-05T01:32:41.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.077+0000 7f5f7f9f5740 1 client.16179 shutdown 2024-09-05T01:32:41.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.077+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/1568619095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a4c3e0 msgr2=0x5603a0a5f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:41.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.077+0000 7f5f7f9f5740 1 --2- 172.21.15.12:0/1568619095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a4c3e0 0x5603a0a5f090 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5f60011fd0 tx=0x7f5f6001ff00 comp rx=0 tx=0).stop 2024-09-05T01:32:41.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.077+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/1568619095 shutdown_connections 2024-09-05T01:32:41.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.077+0000 7f5f7f9f5740 1 --2- 172.21.15.12:0/1568619095 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5603a0ad1a00 0x5603a0ad3e20 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.077+0000 7f5f7f9f5740 1 --2- 172.21.15.12:0/1568619095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603a0a56ca0 0x5603a0a59f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.077+0000 7f5f7f9f5740 1 --2- 172.21.15.12:0/1568619095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5603a0a4c3e0 0x5603a0a5f090 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.077+0000 7f5f7f9f5740 1 --2- 172.21.15.12:0/1568619095 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5603a0a4bac0 0x5603a0a5eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.077+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/1568619095 >> 172.21.15.12:0/1568619095 conn(0x5603a0a48050 msgr2=0x5603a0a4eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:41.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.077+0000 7f5f5be00640 0 client.16179 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:32:41.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.077+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/1568619095 shutdown_connections 2024-09-05T01:32:41.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.078+0000 7f5f7f9f5740 1 -- 172.21.15.12:0/1568619095 wait complete. 2024-09-05T01:32:41.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.078+0000 7f5f7f9f5740 20 client.16179 trim_cache size 0 max 16384 2024-09-05T01:32:41.081 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:32:41.081 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-05T01:32:41.081 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "eda68acb-b370-4165-b17a-f89aa702281b", 2024-09-05T01:32:41.081 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-05T01:32:41.082 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:32:41.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.078+0000 7f5f7ce00640 1 -- 172.21.15.12:0/3095879434 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5f5c0a2cf0 msgr2=0x7f5f5c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:41.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.078+0000 7f5f7ce00640 1 --2- 172.21.15.12:0/3095879434 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5f5c0a2cf0 0x7f5f5c0a51b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5f60013df0 tx=0x7f5f60009f90 comp rx=0 tx=0).stop 2024-09-05T01:32:41.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.078+0000 7f5f7ce00640 1 -- 172.21.15.12:0/3095879434 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f7810e3c0 msgr2=0x7f5f7819eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:41.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.078+0000 7f5f7ce00640 1 --2- 172.21.15.12:0/3095879434 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f7810e3c0 0x7f5f7819eee0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009b30 tx=0x7f5f700305d0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.079+0000 7f5f7ce00640 1 -- 172.21.15.12:0/3095879434 shutdown_connections 2024-09-05T01:32:41.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.079+0000 7f5f7ce00640 1 --2- 172.21.15.12:0/3095879434 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5f5c0a2cf0 0x7f5f5c0a51b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.079+0000 7f5f7ce00640 1 --2- 172.21.15.12:0/3095879434 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5f7810e3c0 0x7f5f7819eee0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.079+0000 7f5f7ce00640 1 --2- 172.21.15.12:0/3095879434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f78074f40 0x7f5f7819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.079+0000 7f5f7ce00640 1 --2- 172.21.15.12:0/3095879434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f78074620 0x7f5f7819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:41.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.079+0000 7f5f7ce00640 1 -- 172.21.15.12:0/3095879434 >> 172.21.15.12:0/3095879434 conn(0x7f5f780fd8c0 msgr2=0x7f5f780fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:41.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.079+0000 7f5f7ce00640 1 -- 172.21.15.12:0/3095879434 shutdown_connections 2024-09-05T01:32:41.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:41.079+0000 7f5f7ce00640 1 -- 172.21.15.12:0/3095879434 wait complete. 2024-09-05T01:32:41.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:41 smithi012 ceph-mon[29942]: pgmap v246: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-05T01:32:41.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:41 smithi145 ceph-mon[34376]: pgmap v246: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-05T01:32:41.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:41 smithi151 ceph-mon[35013]: pgmap v246: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-09-05T01:32:41.988 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T01:32:42.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:42 smithi012 ceph-mon[29942]: scrub queued for path: / 2024-09-05T01:32:42.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:42 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:32:42.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:42 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:32:42.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:42 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:32:42.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:42 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:32:42.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:42 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:32:42.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:42 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:32:42.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:42 smithi145 ceph-mon[34376]: scrub queued for path: / 2024-09-05T01:32:42.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:42 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:32:42.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:42 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:32:42.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:42 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:32:42.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:42 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:32:42.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:42 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:32:42.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:42 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:32:42.596 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:32:42.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:42 smithi151 ceph-mon[35013]: scrub queued for path: / 2024-09-05T01:32:42.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:42 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:32:42.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:42 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:32:42.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:42 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:32:42.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:42 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:32:42.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:42 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:32:42.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:42 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:32:43.474 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:43 smithi012 ceph-mon[29942]: pgmap v247: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-05T01:32:43.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.546+0000 7f9ff9a00640 1 -- 172.21.15.12:0/2839933881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ff4103e30 msgr2=0x7f9ff4104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:43.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.546+0000 7f9ff9a00640 1 --2- 172.21.15.12:0/2839933881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ff4103e30 0x7f9ff4104210 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4009900 tx=0x7f9fe402a400 comp rx=0 tx=0).stop 2024-09-05T01:32:43.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.546+0000 7f9ff9a00640 1 -- 172.21.15.12:0/2839933881 shutdown_connections 2024-09-05T01:32:43.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.546+0000 7f9ff9a00640 1 --2- 172.21.15.12:0/2839933881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ff4108f60 0x7f9ff4110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.546+0000 7f9ff9a00640 1 --2- 172.21.15.12:0/2839933881 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ff41047e0 0x7f9ff4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.546+0000 7f9ff9a00640 1 --2- 172.21.15.12:0/2839933881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ff4103e30 0x7f9ff4104210 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.546+0000 7f9ff9a00640 1 -- 172.21.15.12:0/2839933881 >> 172.21.15.12:0/2839933881 conn(0x7f9ff40ff910 msgr2=0x7f9ff4101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:43.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.547+0000 7f9ff9a00640 1 -- 172.21.15.12:0/2839933881 shutdown_connections 2024-09-05T01:32:43.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.547+0000 7f9ff9a00640 1 -- 172.21.15.12:0/2839933881 wait complete. 2024-09-05T01:32:43.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.548+0000 7f9ff9a00640 1 Processor -- start 2024-09-05T01:32:43.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.549+0000 7f9ff9a00640 1 -- start start 2024-09-05T01:32:43.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.549+0000 7f9ff9a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ff4103e30 0x7f9ff4110980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:43.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.549+0000 7f9ff9a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ff41047e0 0x7f9ff410da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:43.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.549+0000 7f9ff9a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ff4108f60 0x7f9ff410df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:43.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.550+0000 7f9ff9000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ff4108f60 0x7f9ff410df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:43.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.550+0000 7f9ff9000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ff4108f60 0x7f9ff410df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:60080/0 (socket says 172.21.15.12:60080) 2024-09-05T01:32:43.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.550+0000 7f9ff9000640 1 -- 172.21.15.12:0/1785667704 learned_addr learned my addr 172.21.15.12:0/1785667704 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:43.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.550+0000 7f9ff9a00640 1 -- 172.21.15.12:0/1785667704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff4114010 con 0x7f9ff4103e30 2024-09-05T01:32:43.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.550+0000 7f9ff9a00640 1 -- 172.21.15.12:0/1785667704 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff4113e90 con 0x7f9ff4108f60 2024-09-05T01:32:43.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.550+0000 7f9ff9a00640 1 -- 172.21.15.12:0/1785667704 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff4114190 con 0x7f9ff41047e0 2024-09-05T01:32:43.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.550+0000 7f9ff3400640 1 --2- 172.21.15.12:0/1785667704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ff41047e0 0x7f9ff410da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:43.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.551+0000 7f9ff3e00640 1 --2- 172.21.15.12:0/1785667704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ff4103e30 0x7f9ff4110980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:43.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.552+0000 7f9ff9000640 1 -- 172.21.15.12:0/1785667704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ff41047e0 msgr2=0x7f9ff410da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:43.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.552+0000 7f9ff9000640 1 --2- 172.21.15.12:0/1785667704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ff41047e0 0x7f9ff410da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.552+0000 7f9ff9000640 1 -- 172.21.15.12:0/1785667704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ff4103e30 msgr2=0x7f9ff4110980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:43.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.552+0000 7f9ff9000640 1 --2- 172.21.15.12:0/1785667704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ff4103e30 0x7f9ff4110980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.552+0000 7f9ff9000640 1 -- 172.21.15.12:0/1785667704 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff410e830 con 0x7f9ff4108f60 2024-09-05T01:32:43.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.553+0000 7f9ff3400640 1 --2- 172.21.15.12:0/1785667704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ff41047e0 0x7f9ff410da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:32:43.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.553+0000 7f9ff9000640 1 --2- 172.21.15.12:0/1785667704 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ff4108f60 0x7f9ff410df70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9fec00eb10 tx=0x7f9fec00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:43.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.553+0000 7f9ff3e00640 1 --2- 172.21.15.12:0/1785667704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ff4103e30 0x7f9ff4110980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:32:43.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.553+0000 7f9ff0c00640 1 -- 172.21.15.12:0/1785667704 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec004b20 con 0x7f9ff4108f60 2024-09-05T01:32:43.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.553+0000 7f9ff0c00640 1 -- 172.21.15.12:0/1785667704 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fec004cc0 con 0x7f9ff4108f60 2024-09-05T01:32:43.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.553+0000 7f9ff0c00640 1 -- 172.21.15.12:0/1785667704 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec010790 con 0x7f9ff4108f60 2024-09-05T01:32:43.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.553+0000 7f9ff9a00640 1 -- 172.21.15.12:0/1785667704 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff41a05f0 con 0x7f9ff4108f60 2024-09-05T01:32:43.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.553+0000 7f9ff9a00640 1 -- 172.21.15.12:0/1785667704 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff41a0ae0 con 0x7f9ff4108f60 2024-09-05T01:32:43.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.559+0000 7f9ffdc34740 1 Processor -- start 2024-09-05T01:32:43.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.559+0000 7f9ff0c00640 1 -- 172.21.15.12:0/1785667704 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f9fec005020 con 0x7f9ff4108f60 2024-09-05T01:32:43.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.560+0000 7f9ffdc34740 1 -- start start 2024-09-05T01:32:43.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.560+0000 7f9ffdc34740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ee1ef7cd50 0x55ee1ef7d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:43.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.560+0000 7f9ffdc34740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee1ef7d670 0x55ee1ef879f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:43.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.560+0000 7f9ffdc34740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef87f30 0x55ee1ef8a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:43.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.561+0000 7f9ff3e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee1ef7d670 0x55ee1ef879f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:43.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.561+0000 7f9ffdc34740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ee1eee33e0 con 0x55ee1ef87f30 2024-09-05T01:32:43.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.561+0000 7f9ffdc34740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55ee1ee8ad80 con 0x55ee1ef7cd50 2024-09-05T01:32:43.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.561+0000 7f9ffdc34740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ee1eedf3a0 con 0x55ee1ef7d670 2024-09-05T01:32:43.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.561+0000 7f9ff3e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee1ef7d670 0x55ee1ef879f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:52014/0 (socket says 172.21.15.12:52014) 2024-09-05T01:32:43.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.561+0000 7f9ff3e00640 1 -- 172.21.15.12:0/1848748676 learned_addr learned my addr 172.21.15.12:0/1848748676 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:43.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.561+0000 7f9ff3400640 1 --2- 172.21.15.12:0/1848748676 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ee1ef7cd50 0x55ee1ef7d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:43.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.561+0000 7f9ff3400640 1 --2- 172.21.15.12:0/1848748676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef87f30 0x55ee1ef8a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:43.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.562+0000 7f9ff0c00640 1 --2- 172.21.15.12:0/1785667704 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f9fd80a2e40 0x7f9fd80a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:43.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.563+0000 7f9ff3400640 1 -- 172.21.15.12:0/1848748676 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee1ef7d670 msgr2=0x55ee1ef879f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:43.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.563+0000 7f9ff3400640 1 --2- 172.21.15.12:0/1848748676 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee1ef7d670 0x55ee1ef879f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.563+0000 7f9ff3400640 1 -- 172.21.15.12:0/1848748676 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ee1ef7cd50 msgr2=0x55ee1ef7d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:43.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.563+0000 7f9ff3400640 1 --2- 172.21.15.12:0/1848748676 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ee1ef7cd50 0x55ee1ef7d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.563+0000 7f9ff3400640 1 -- 172.21.15.12:0/1848748676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee1eea9ae0 con 0x55ee1ef87f30 2024-09-05T01:32:43.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.563+0000 7f9ff0c00640 1 -- 172.21.15.12:0/1785667704 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7f9fec0cfb10 con 0x7f9ff4108f60 2024-09-05T01:32:43.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.563+0000 7f9ff9000640 1 --2- 172.21.15.12:0/1785667704 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f9fd80a2e40 0x7f9fd80a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:43.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.564+0000 7f9ff3400640 1 --2- 172.21.15.12:0/1848748676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef87f30 0x55ee1ef8a320 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9ff410f280 tx=0x7f9fe0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9420aa9888bfbd11 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:43.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.564+0000 7f9ff9000640 1 --2- 172.21.15.12:0/1785667704 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f9fd80a2e40 0x7f9fd80a5300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0049d0 tx=0x7f9fec005970 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:43.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.564+0000 7f9fe9600640 1 -- 172.21.15.12:0/1848748676 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0004030 con 0x55ee1ef87f30 2024-09-05T01:32:43.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.565+0000 7f9fe9600640 1 -- 172.21.15.12:0/1848748676 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fe000dc20 con 0x55ee1ef87f30 2024-09-05T01:32:43.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.565+0000 7f9fe9600640 1 -- 172.21.15.12:0/1848748676 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0004030 con 0x55ee1ef87f30 2024-09-05T01:32:43.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.566+0000 7f9ffdc34740 1 -- 172.21.15.12:0/1848748676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef87f30 msgr2=0x55ee1ef8a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:43.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.566+0000 7f9ffdc34740 1 --2- 172.21.15.12:0/1848748676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef87f30 0x55ee1ef8a320 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9ff410f280 tx=0x7f9fe0005f90 comp rx=0 tx=0).stop 2024-09-05T01:32:43.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.566+0000 7f9ffdc34740 1 -- 172.21.15.12:0/1848748676 shutdown_connections 2024-09-05T01:32:43.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.566+0000 7f9ffdc34740 1 --2- 172.21.15.12:0/1848748676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef87f30 0x55ee1ef8a320 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.566+0000 7f9ffdc34740 1 --2- 172.21.15.12:0/1848748676 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee1ef7d670 0x55ee1ef879f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.566+0000 7f9ffdc34740 1 --2- 172.21.15.12:0/1848748676 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ee1ef7cd50 0x55ee1ef7d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.566+0000 7f9ffdc34740 1 -- 172.21.15.12:0/1848748676 >> 172.21.15.12:0/1848748676 conn(0x55ee1ef792e0 msgr2=0x55ee1ef796c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:43.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.567+0000 7f9ffdc34740 1 -- 172.21.15.12:0/1848748676 shutdown_connections 2024-09-05T01:32:43.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.567+0000 7f9ffdc34740 1 -- 172.21.15.12:0/1848748676 wait complete. 2024-09-05T01:32:43.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.567+0000 7f9ffdc34740 1 -- start start 2024-09-05T01:32:43.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.568+0000 7f9ffdc34740 1 Processor -- start 2024-09-05T01:32:43.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.568+0000 7f9ffdc34740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee1ef7cd50 0x55ee1ef84e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:43.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.568+0000 7f9ffdc34740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef7d670 0x55ee1ef85340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:43.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.568+0000 7f9ffdc34740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ee1ef87f30 0x55ee1ef85880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:43.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.569+0000 7f9ffdc34740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ee1ef9bc50 con 0x55ee1ef7d670 2024-09-05T01:32:43.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.569+0000 7f9ffdc34740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55ee1ee9e0f0 con 0x55ee1ef87f30 2024-09-05T01:32:43.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.569+0000 7f9ffdc34740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ee1ef9bdd0 con 0x55ee1ef7cd50 2024-09-05T01:32:43.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.569+0000 7f9ffdc34740 10 client.0 _ll_register_callbacks cb 0x55ee1ee8f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:32:43.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.569+0000 7f9ff3400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ee1ef87f30 0x55ee1ef85880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:43.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.569+0000 7f9ff3400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee1ef7cd50 0x55ee1ef84e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:43.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.569+0000 7f9ff3400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee1ef7cd50 0x55ee1ef84e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:52022/0 (socket says 172.21.15.12:52022) 2024-09-05T01:32:43.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.569+0000 7f9ff3400640 1 -- 172.21.15.12:0/3548805338 learned_addr learned my addr 172.21.15.12:0/3548805338 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:43.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.570+0000 7f9ff3e00640 1 --2- 172.21.15.12:0/3548805338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef7d670 0x55ee1ef85340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:43.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.571+0000 7f9ff3400640 1 -- 172.21.15.12:0/3548805338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ee1ef87f30 msgr2=0x55ee1ef85880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:43.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.571+0000 7f9ff3400640 1 --2- 172.21.15.12:0/3548805338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ee1ef87f30 0x55ee1ef85880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.571+0000 7f9ff3400640 1 -- 172.21.15.12:0/3548805338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef7d670 msgr2=0x55ee1ef85340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:43.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.571+0000 7f9ff3400640 1 --2- 172.21.15.12:0/3548805338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef7d670 0x55ee1ef85340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.571+0000 7f9ff3400640 1 -- 172.21.15.12:0/3548805338 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee1ec543c0 con 0x55ee1ef7cd50 2024-09-05T01:32:43.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.572+0000 7f9ff3e00640 1 --2- 172.21.15.12:0/3548805338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef7d670 0x55ee1ef85340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:32:43.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.573+0000 7f9ff3400640 1 --2- 172.21.15.12:0/3548805338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee1ef7cd50 0x55ee1ef84e00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0004650 tx=0x7f9fe0004590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6e8941da30955f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:43.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.573+0000 7f9fde000640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:32:43.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.573+0000 7f9fde000640 1 -- 172.21.15.12:0/3548805338 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00039a0 con 0x55ee1ef7cd50 2024-09-05T01:32:43.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.573+0000 7f9fde000640 1 -- 172.21.15.12:0/3548805338 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7f9fe0003b40 con 0x55ee1ef7cd50 2024-09-05T01:32:43.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.574+0000 7f9ffdc34740 1 -- 172.21.15.12:0/3548805338 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fe000dc20 con 0x55ee1ef7cd50 2024-09-05T01:32:43.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.575+0000 7f9fde000640 1 -- 172.21.15.12:0/3548805338 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f9fe0032050 con 0x55ee1ef7cd50 2024-09-05T01:32:43.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.575+0000 7f9ffdc34740 10 client.26236 fetch_fsmap learned FSMap version 46 2024-09-05T01:32:43.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.575+0000 7f9ffdc34740 1 -- 172.21.15.12:0/3548805338 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55ee1efa7930 con 0x55ee1ef7cd50 2024-09-05T01:32:43.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.576+0000 7f9fde000640 1 -- 172.21.15.12:0/3548805338 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fe000dc20 con 0x55ee1ef7cd50 2024-09-05T01:32:43.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.576+0000 7f9fde000640 1 -- 172.21.15.12:0/3548805338 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 46) ==== 8434+0+0 (secure 0 0 0) 0x7f9fe000f950 con 0x55ee1ef7cd50 2024-09-05T01:32:43.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.576+0000 7f9ffdc34740 10 client.26236 fetch_fsmap finished waiting for FSMap version 46 2024-09-05T01:32:43.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.576+0000 7f9ffdc34740 10 client.26236 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:32:43.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.576+0000 7f9ffdc34740 20 client.26236 populate_metadata read hostname 'smithi012' 2024-09-05T01:32:43.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.576+0000 7f9ffdc34740 1 --2- 172.21.15.12:0/3548805338 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ee1efa8ff0 0x55ee1efab410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:43.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.576+0000 7f9ffdc34740 4 client.26236 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:32:43.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.576+0000 7f9ffdc34740 1 -- 172.21.15.12:0/3548805338 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee1eef0950 con 0x55ee1efa8ff0 2024-09-05T01:32:43.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.577+0000 7f9ff3e00640 1 --2- 172.21.15.12:0/3548805338 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ee1efa8ff0 0x55ee1efab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:43.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.578+0000 7f9ff3e00640 1 --2- 172.21.15.12:0/3548805338 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ee1efa8ff0 0x55ee1efab410 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62d181b145eebdc5 server_cookie=d6dfcfeda41c100c in_seq=0 out_seq=0 2024-09-05T01:32:43.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.578+0000 7f9fde000640 10 client.26236 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:32:43.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.579+0000 7f9fde000640 1 -- 172.21.15.12:0/3548805338 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee1eef0950 con 0x55ee1efa8ff0 2024-09-05T01:32:43.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.579+0000 7f9fde000640 10 client.26236 handle_command_reply: tid=0 2024-09-05T01:32:43.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.579+0000 7f9ffdc34740 1 client.26236 shutdown 2024-09-05T01:32:43.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.580+0000 7f9ffdc34740 1 -- 172.21.15.12:0/3548805338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee1ef7cd50 msgr2=0x55ee1ef84e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:43.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.580+0000 7f9ffdc34740 1 --2- 172.21.15.12:0/3548805338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee1ef7cd50 0x55ee1ef84e00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0004650 tx=0x7f9fe0004590 comp rx=0 tx=0).stop 2024-09-05T01:32:43.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.580+0000 7f9ffdc34740 1 -- 172.21.15.12:0/3548805338 shutdown_connections 2024-09-05T01:32:43.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.580+0000 7f9ffdc34740 1 --2- 172.21.15.12:0/3548805338 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ee1efa8ff0 0x55ee1efab410 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.580+0000 7f9ffdc34740 1 --2- 172.21.15.12:0/3548805338 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ee1ef87f30 0x55ee1ef85880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.580+0000 7f9ffdc34740 1 --2- 172.21.15.12:0/3548805338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef7d670 0x55ee1ef85340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.580+0000 7f9ffdc34740 1 --2- 172.21.15.12:0/3548805338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee1ef7cd50 0x55ee1ef84e00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.580+0000 7f9fde000640 0 client.26236 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:32:43.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.580+0000 7f9ffdc34740 1 -- 172.21.15.12:0/3548805338 >> 172.21.15.12:0/3548805338 conn(0x55ee1ef792e0 msgr2=0x55ee1ef7efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:43.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.580+0000 7f9ffdc34740 1 -- 172.21.15.12:0/3548805338 shutdown_connections 2024-09-05T01:32:43.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.580+0000 7f9ffdc34740 1 -- 172.21.15.12:0/3548805338 wait complete. 2024-09-05T01:32:43.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.581+0000 7f9ffdc34740 20 client.26236 trim_cache size 0 max 16384 2024-09-05T01:32:43.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:43 smithi145 ceph-mon[34376]: pgmap v247: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-05T01:32:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:43 smithi151 ceph-mon[35013]: pgmap v247: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-05T01:32:43.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.611+0000 7f9ffdc34740 1 Processor -- start 2024-09-05T01:32:43.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.612+0000 7f9ffdc34740 1 -- start start 2024-09-05T01:32:43.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.612+0000 7f9ffdc34740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef7cd50 0x55ee1ef856d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:43.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.612+0000 7f9ffdc34740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee1ef7d670 0x55ee1efb0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:43.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.612+0000 7f9ffdc34740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ee1ef87f30 0x55ee1efb1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:43.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.612+0000 7f9ffdc34740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff4073570 con 0x55ee1ef7cd50 2024-09-05T01:32:43.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.612+0000 7f9ffdc34740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff41b5b50 con 0x55ee1ef87f30 2024-09-05T01:32:43.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.612+0000 7f9ffdc34740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff4073c40 con 0x55ee1ef7d670 2024-09-05T01:32:43.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.613+0000 7f9ff3400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef7cd50 0x55ee1ef856d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:43.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.613+0000 7f9ff3400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef7cd50 0x55ee1ef856d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53722/0 (socket says 172.21.15.12:53722) 2024-09-05T01:32:43.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.613+0000 7f9ff3400640 1 -- 172.21.15.12:0/3302199656 learned_addr learned my addr 172.21.15.12:0/3302199656 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:43.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.613+0000 7f9ff3400640 1 --2- 172.21.15.12:0/3302199656 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ee1ef87f30 0x55ee1efb1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:43.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.613+0000 7f9ff3e00640 1 --2- 172.21.15.12:0/3302199656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee1ef7d670 0x55ee1efb0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:43.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.613+0000 7f9ff3400640 1 -- 172.21.15.12:0/3302199656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee1ef7d670 msgr2=0x55ee1efb0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:43.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.613+0000 7f9ff3400640 1 --2- 172.21.15.12:0/3302199656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee1ef7d670 0x55ee1efb0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.613+0000 7f9ff3400640 1 -- 172.21.15.12:0/3302199656 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ee1ef87f30 msgr2=0x55ee1efb1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:43.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.613+0000 7f9ff3400640 1 --2- 172.21.15.12:0/3302199656 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ee1ef87f30 0x55ee1efb1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.613+0000 7f9ff3400640 1 -- 172.21.15.12:0/3302199656 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee1ef79110 con 0x55ee1ef7cd50 2024-09-05T01:32:43.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.614+0000 7f9ff3400640 1 --2- 172.21.15.12:0/3302199656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef7cd50 0x55ee1ef856d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00095b0 tx=0x7f9fe0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77cd2aef9e48badc server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:43.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.615+0000 7f9fe8c00640 1 -- 172.21.15.12:0/3302199656 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00035f0 con 0x55ee1ef7cd50 2024-09-05T01:32:43.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.615+0000 7f9fe8c00640 1 -- 172.21.15.12:0/3302199656 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fe0005500 con 0x55ee1ef7cd50 2024-09-05T01:32:43.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.615+0000 7f9fe8c00640 1 -- 172.21.15.12:0/3302199656 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0012290 con 0x55ee1ef7cd50 2024-09-05T01:32:43.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.617+0000 7f9ffdc34740 1 -- 172.21.15.12:0/3302199656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef7cd50 msgr2=0x55ee1ef856d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:43.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.617+0000 7f9ffdc34740 1 --2- 172.21.15.12:0/3302199656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef7cd50 0x55ee1ef856d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00095b0 tx=0x7f9fe0001e70 comp rx=0 tx=0).stop 2024-09-05T01:32:43.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.617+0000 7f9ffdc34740 1 -- 172.21.15.12:0/3302199656 shutdown_connections 2024-09-05T01:32:43.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.617+0000 7f9ffdc34740 1 --2- 172.21.15.12:0/3302199656 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ee1ef87f30 0x55ee1efb1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.617+0000 7f9ffdc34740 1 --2- 172.21.15.12:0/3302199656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee1ef7d670 0x55ee1efb0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.617+0000 7f9ffdc34740 1 --2- 172.21.15.12:0/3302199656 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef7cd50 0x55ee1ef856d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.617+0000 7f9ffdc34740 1 -- 172.21.15.12:0/3302199656 >> 172.21.15.12:0/3302199656 conn(0x55ee1ef792e0 msgr2=0x55ee1ef86e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:43.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.617+0000 7f9ffdc34740 1 -- 172.21.15.12:0/3302199656 shutdown_connections 2024-09-05T01:32:43.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.617+0000 7f9ffdc34740 1 -- 172.21.15.12:0/3302199656 wait complete. 2024-09-05T01:32:43.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.617+0000 7f9ffdc34740 1 -- start start 2024-09-05T01:32:43.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.618+0000 7f9ffdc34740 1 Processor -- start 2024-09-05T01:32:43.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.619+0000 7f9ffdc34740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee1ef7cd50 0x55ee1efa13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:43.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.619+0000 7f9ffdc34740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef7d670 0x55ee1efa1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:43.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.619+0000 7f9ffdc34740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ee1ef87f30 0x55ee1ef81a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:43.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.620+0000 7f9ffdc34740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff41b53c0 con 0x55ee1ef7d670 2024-09-05T01:32:43.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.620+0000 7f9ffdc34740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff41b4cb0 con 0x55ee1ef87f30 2024-09-05T01:32:43.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.620+0000 7f9ffdc34740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff4071570 con 0x55ee1ef7cd50 2024-09-05T01:32:43.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.620+0000 7f9ffdc34740 10 client.0 _ll_register_callbacks cb 0x7f9fe0009680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:32:43.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.620+0000 7f9ff3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef7d670 0x55ee1efa1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:43.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.620+0000 7f9ff3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef7d670 0x55ee1efa1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53734/0 (socket says 172.21.15.12:53734) 2024-09-05T01:32:43.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.620+0000 7f9ff3e00640 1 -- 172.21.15.12:0/3677671718 learned_addr learned my addr 172.21.15.12:0/3677671718 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:32:43.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.620+0000 7f9ff3400640 1 --2- 172.21.15.12:0/3677671718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee1ef7cd50 0x55ee1efa13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:43.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.621+0000 7f9ff3400640 1 --2- 172.21.15.12:0/3677671718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ee1ef87f30 0x55ee1ef81a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:43.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.621+0000 7f9ff3e00640 1 -- 172.21.15.12:0/3677671718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee1ef7cd50 msgr2=0x55ee1efa13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:43.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.621+0000 7f9ff3e00640 1 --2- 172.21.15.12:0/3677671718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee1ef7cd50 0x55ee1efa13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.621+0000 7f9ff3e00640 1 -- 172.21.15.12:0/3677671718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ee1ef87f30 msgr2=0x55ee1ef81a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:32:43.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.621+0000 7f9ff3e00640 1 --2- 172.21.15.12:0/3677671718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ee1ef87f30 0x55ee1ef81a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.621+0000 7f9ff3e00640 1 -- 172.21.15.12:0/3677671718 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee1ef79f70 con 0x55ee1ef7d670 2024-09-05T01:32:43.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.622+0000 7f9ff3e00640 1 --2- 172.21.15.12:0/3677671718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef7d670 0x55ee1efa1920 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4000c00 tx=0x7f9fe402ab00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83a3c060d8f35e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:32:43.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.622+0000 7f9fde000640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:32:43.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.622+0000 7f9fde000640 1 -- 172.21.15.12:0/3677671718 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4035040 con 0x55ee1ef7d670 2024-09-05T01:32:43.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.623+0000 7f9fde000640 1 -- 172.21.15.12:0/3677671718 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8579+0+0 (secure 0 0 0) 0x7f9fe40046c0 con 0x55ee1ef7d670 2024-09-05T01:32:43.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.623+0000 7f9ffdc34740 1 -- 172.21.15.12:0/3677671718 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fe0005500 con 0x55ee1ef7d670 2024-09-05T01:32:43.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.623+0000 7f9fde000640 1 -- 172.21.15.12:0/3677671718 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f9fe40048c0 con 0x55ee1ef7d670 2024-09-05T01:32:43.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.623+0000 7f9ffdc34740 10 client.16197 fetch_fsmap learned FSMap version 46 2024-09-05T01:32:43.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.623+0000 7f9ffdc34740 1 -- 172.21.15.12:0/3677671718 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55ee1f013780 con 0x55ee1ef7d670 2024-09-05T01:32:43.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.624+0000 7f9fde000640 1 -- 172.21.15.12:0/3677671718 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fe0005500 con 0x55ee1ef7d670 2024-09-05T01:32:43.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.624+0000 7f9fde000640 1 -- 172.21.15.12:0/3677671718 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 46) ==== 8434+0+0 (secure 0 0 0) 0x7f9fe404c070 con 0x55ee1ef7d670 2024-09-05T01:32:43.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.624+0000 7f9ffdc34740 10 client.16197 fetch_fsmap finished waiting for FSMap version 46 2024-09-05T01:32:43.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.624+0000 7f9ffdc34740 10 client.16197 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:32:43.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.624+0000 7f9ffdc34740 20 client.16197 populate_metadata read hostname 'smithi012' 2024-09-05T01:32:43.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.624+0000 7f9ffdc34740 1 --2- 172.21.15.12:0/3677671718 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ee1f013f70 0x55ee1f016390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:32:43.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.624+0000 7f9ffdc34740 4 client.16197 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T01:32:43.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.624+0000 7f9ffdc34740 1 -- 172.21.15.12:0/3677671718 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ee1eeeae60 con 0x55ee1f013f70 2024-09-05T01:32:43.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.625+0000 7f9ff3400640 1 --2- 172.21.15.12:0/3677671718 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ee1f013f70 0x55ee1f016390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:32:43.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.625+0000 7f9ff3400640 1 --2- 172.21.15.12:0/3677671718 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ee1f013f70 0x55ee1f016390 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6ac1fe7c2176792 server_cookie=7c23e4a640631336 in_seq=0 out_seq=0 2024-09-05T01:32:43.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.625+0000 7f9fde000640 10 client.16197 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:32:43.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.626+0000 7f9fde000640 1 -- 172.21.15.12:0/3677671718 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x55ee1eeeae60 con 0x55ee1f013f70 2024-09-05T01:32:43.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.626+0000 7f9fde000640 10 client.16197 handle_command_reply: tid=0 2024-09-05T01:32:43.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.626+0000 7f9ffdc34740 1 client.16197 shutdown 2024-09-05T01:32:43.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.626+0000 7f9ffdc34740 1 -- 172.21.15.12:0/3677671718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef7d670 msgr2=0x55ee1efa1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:43.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.626+0000 7f9ffdc34740 1 --2- 172.21.15.12:0/3677671718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef7d670 0x55ee1efa1920 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4000c00 tx=0x7f9fe402ab00 comp rx=0 tx=0).stop 2024-09-05T01:32:43.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.627+0000 7f9ffdc34740 1 -- 172.21.15.12:0/3677671718 shutdown_connections 2024-09-05T01:32:43.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.627+0000 7f9ffdc34740 1 --2- 172.21.15.12:0/3677671718 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55ee1f013f70 0x55ee1f016390 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.627+0000 7f9ffdc34740 1 --2- 172.21.15.12:0/3677671718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ee1ef87f30 0x55ee1ef81a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.627+0000 7f9ffdc34740 1 --2- 172.21.15.12:0/3677671718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ee1ef7d670 0x55ee1efa1920 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.627+0000 7f9ffdc34740 1 --2- 172.21.15.12:0/3677671718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee1ef7cd50 0x55ee1efa13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.627+0000 7f9ffdc34740 1 -- 172.21.15.12:0/3677671718 >> 172.21.15.12:0/3677671718 conn(0x55ee1ef792e0 msgr2=0x55ee1ef77b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:43.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.627+0000 7f9fde000640 0 client.16197 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:32:43.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.627+0000 7f9ffdc34740 1 -- 172.21.15.12:0/3677671718 shutdown_connections 2024-09-05T01:32:43.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.627+0000 7f9ffdc34740 1 -- 172.21.15.12:0/3677671718 wait complete. 2024-09-05T01:32:43.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.627+0000 7f9ffdc34740 20 client.16197 trim_cache size 0 max 16384 2024-09-05T01:32:43.630 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:32:43.630 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "scrub active (8413 inodes in the stack)", 2024-09-05T01:32:43.630 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-05T01:32:43.630 INFO:teuthology.orchestra.run.smithi012.stdout: "eda68acb-b370-4165-b17a-f89aa702281b": { 2024-09-05T01:32:43.630 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-05T01:32:43.630 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "eda68acb-b370-4165-b17a-f89aa702281b", 2024-09-05T01:32:43.630 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-05T01:32:43.630 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:32:43.631 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:32:43.631 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:32:43.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.628+0000 7f9ff9a00640 1 -- 172.21.15.12:0/1785667704 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f9fd80a2e40 msgr2=0x7f9fd80a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:43.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.628+0000 7f9ff9a00640 1 --2- 172.21.15.12:0/1785667704 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f9fd80a2e40 0x7f9fd80a5300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0049d0 tx=0x7f9fec005970 comp rx=0 tx=0).stop 2024-09-05T01:32:43.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.629+0000 7f9ff9a00640 1 -- 172.21.15.12:0/1785667704 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ff4108f60 msgr2=0x7f9ff410df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:32:43.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.629+0000 7f9ff9a00640 1 --2- 172.21.15.12:0/1785667704 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ff4108f60 0x7f9ff410df70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9fec00eb10 tx=0x7f9fec00c2d0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.629+0000 7f9ff9a00640 1 -- 172.21.15.12:0/1785667704 shutdown_connections 2024-09-05T01:32:43.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.629+0000 7f9ff9a00640 1 --2- 172.21.15.12:0/1785667704 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f9fd80a2e40 0x7f9fd80a5300 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.629+0000 7f9ff9a00640 1 --2- 172.21.15.12:0/1785667704 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9ff4108f60 0x7f9ff410df70 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.629+0000 7f9ff9a00640 1 --2- 172.21.15.12:0/1785667704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ff41047e0 0x7f9ff410da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.629+0000 7f9ff9a00640 1 --2- 172.21.15.12:0/1785667704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ff4103e30 0x7f9ff4110980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:32:43.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.629+0000 7f9ff9a00640 1 -- 172.21.15.12:0/1785667704 >> 172.21.15.12:0/1785667704 conn(0x7f9ff40ff910 msgr2=0x7f9ff4100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:32:43.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.630+0000 7f9ff9a00640 1 -- 172.21.15.12:0/1785667704 shutdown_connections 2024-09-05T01:32:43.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:32:43.630+0000 7f9ff9a00640 1 -- 172.21.15.12:0/1785667704 wait complete. 2024-09-05T01:32:44.399 INFO:tasks.cephfs.filesystem:scrub status for tag:eda68acb-b370-4165-b17a-f89aa702281b - {'path': '/', 'tag': 'eda68acb-b370-4165-b17a-f89aa702281b', 'options': 'recursive,force'} 2024-09-05T01:32:45.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:45 smithi012 ceph-mon[29942]: pgmap v248: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 34 KiB/s wr, 32 op/s 2024-09-05T01:32:45.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:45 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:32:45.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:45 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:32:45.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:45 smithi145 ceph-mon[34376]: pgmap v248: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 34 KiB/s wr, 32 op/s 2024-09-05T01:32:45.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:45 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:32:45.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:45 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:32:45.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:45 smithi151 ceph-mon[35013]: pgmap v248: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 34 KiB/s wr, 32 op/s 2024-09-05T01:32:45.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:45 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:32:45.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:45 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:32:46.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:46 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:32:46.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:46 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:32:46.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:46 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:32:46.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:46 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:32:46.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:46 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:32:46.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:46 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:32:46.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:46 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:32:46.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:46 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:32:46.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:46 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:32:47.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:47 smithi012 ceph-mon[29942]: pgmap v249: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-09-05T01:32:47.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:47 smithi145 ceph-mon[34376]: pgmap v249: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-09-05T01:32:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:47 smithi151 ceph-mon[35013]: pgmap v249: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-09-05T01:32:49.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:49 smithi012 ceph-mon[29942]: pgmap v250: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 28 KiB/s wr, 29 op/s 2024-09-05T01:32:49.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:49 smithi145 ceph-mon[34376]: pgmap v250: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 28 KiB/s wr, 29 op/s 2024-09-05T01:32:49.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:49 smithi151 ceph-mon[35013]: pgmap v250: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 28 KiB/s wr, 29 op/s 2024-09-05T01:32:51.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:51 smithi012 ceph-mon[29942]: pgmap v251: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 34 KiB/s wr, 30 op/s 2024-09-05T01:32:51.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:51 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:32:51.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:51 smithi145 ceph-mon[34376]: pgmap v251: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 34 KiB/s wr, 30 op/s 2024-09-05T01:32:51.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:51 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:32:51.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:51 smithi151 ceph-mon[35013]: pgmap v251: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 34 KiB/s wr, 30 op/s 2024-09-05T01:32:51.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:51 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:32:52.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:52 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:32:52.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:52 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:32:52.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:52 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:32:52.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:52 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:32:52.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:52 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:32:52.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:52 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:32:52.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:52 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:32:52.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:52 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:32:52.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:52 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:32:53.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:53 smithi012 ceph-mon[29942]: pgmap v252: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 27 KiB/s wr, 25 op/s 2024-09-05T01:32:53.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:53 smithi145 ceph-mon[34376]: pgmap v252: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 27 KiB/s wr, 25 op/s 2024-09-05T01:32:53.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:53 smithi151 ceph-mon[35013]: pgmap v252: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 27 KiB/s wr, 25 op/s 2024-09-05T01:32:55.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:55 smithi012 ceph-mon[29942]: pgmap v253: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 47 KiB/s wr, 32 op/s 2024-09-05T01:32:55.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:55 smithi145 ceph-mon[34376]: pgmap v253: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 47 KiB/s wr, 32 op/s 2024-09-05T01:32:55.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:55 smithi151 ceph-mon[35013]: pgmap v253: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 47 KiB/s wr, 32 op/s 2024-09-05T01:32:56.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:56 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:32:56.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:56 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:32:56.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:56 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:32:57.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:57 smithi012 ceph-mon[29942]: pgmap v254: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 19 op/s 2024-09-05T01:32:57.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:57 smithi145 ceph-mon[34376]: pgmap v254: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 19 op/s 2024-09-05T01:32:57.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:57 smithi151 ceph-mon[35013]: pgmap v254: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 19 op/s 2024-09-05T01:32:58.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:58 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:32:58.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:58 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:32:58.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:58 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:32:58.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:58 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:32:58.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:58 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:32:58.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:58 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:32:58.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:58 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:32:58.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:58 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:32:58.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:58 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:32:58.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:58 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:32:58.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:58 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:32:58.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:58 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:32:58.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:58 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:32:58.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:58 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:32:58.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:58 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:32:59.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:32:59 smithi012 ceph-mon[29942]: pgmap v255: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-09-05T01:32:59.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:32:59 smithi145 ceph-mon[34376]: pgmap v255: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-09-05T01:32:59.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:32:59 smithi151 ceph-mon[35013]: pgmap v255: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-09-05T01:33:01.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:01 smithi145 ceph-mon[34376]: pgmap v256: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 20 op/s 2024-09-05T01:33:01.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:01 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:33:01.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:01 smithi151 ceph-mon[35013]: pgmap v256: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 20 op/s 2024-09-05T01:33:01.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:01 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:33:01.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:01 smithi012 ceph-mon[29942]: pgmap v256: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 20 op/s 2024-09-05T01:33:01.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:01 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:33:03.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:03 smithi145 ceph-mon[34376]: pgmap v257: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 34 KiB/s wr, 15 op/s 2024-09-05T01:33:03.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:03 smithi151 ceph-mon[35013]: pgmap v257: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 34 KiB/s wr, 15 op/s 2024-09-05T01:33:03.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:03 smithi012 ceph-mon[29942]: pgmap v257: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 34 KiB/s wr, 15 op/s 2024-09-05T01:33:05.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:05 smithi145 ceph-mon[34376]: pgmap v258: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 58 KiB/s wr, 24 op/s 2024-09-05T01:33:05.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:05 smithi151 ceph-mon[35013]: pgmap v258: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 58 KiB/s wr, 24 op/s 2024-09-05T01:33:05.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:05 smithi012 ceph-mon[29942]: pgmap v258: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 58 KiB/s wr, 24 op/s 2024-09-05T01:33:07.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:07 smithi145 ceph-mon[34376]: pgmap v259: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 49 KiB/s wr, 30 op/s 2024-09-05T01:33:07.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:07 smithi151 ceph-mon[35013]: pgmap v259: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 49 KiB/s wr, 30 op/s 2024-09-05T01:33:07.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:07 smithi012 ceph-mon[29942]: pgmap v259: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 49 KiB/s wr, 30 op/s 2024-09-05T01:33:09.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:09 smithi151 ceph-mon[35013]: pgmap v260: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 50 KiB/s wr, 32 op/s 2024-09-05T01:33:09.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:09 smithi151 ceph-mon[35013]: osdmap e91: 12 total, 12 up, 12 in 2024-09-05T01:33:09.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:09 smithi012 ceph-mon[29942]: pgmap v260: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 50 KiB/s wr, 32 op/s 2024-09-05T01:33:09.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:09 smithi012 ceph-mon[29942]: osdmap e91: 12 total, 12 up, 12 in 2024-09-05T01:33:09.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:09 smithi145 ceph-mon[34376]: pgmap v260: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 50 KiB/s wr, 32 op/s 2024-09-05T01:33:09.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:09 smithi145 ceph-mon[34376]: osdmap e91: 12 total, 12 up, 12 in 2024-09-05T01:33:11.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:11 smithi151 ceph-mon[35013]: pgmap v262: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 80 KiB/s wr, 37 op/s 2024-09-05T01:33:11.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:11 smithi012 ceph-mon[29942]: pgmap v262: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 80 KiB/s wr, 37 op/s 2024-09-05T01:33:11.636 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:11 smithi145 ceph-mon[34376]: pgmap v262: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 80 KiB/s wr, 37 op/s 2024-09-05T01:33:13.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:13 smithi012 ceph-mon[29942]: pgmap v263: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 80 KiB/s wr, 37 op/s 2024-09-05T01:33:13.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:13 smithi151 ceph-mon[35013]: pgmap v263: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 80 KiB/s wr, 37 op/s 2024-09-05T01:33:13.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:13 smithi145 ceph-mon[34376]: pgmap v263: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 80 KiB/s wr, 37 op/s 2024-09-05T01:33:14.400 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T01:33:14.796 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:33:15.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.406+0000 7f6069a00640 1 -- 172.21.15.12:0/510224298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6064112870 msgr2=0x7f6064114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.406+0000 7f6069a00640 1 --2- 172.21.15.12:0/510224298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6064112870 0x7f6064114c60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f605c009ca0 tx=0x7f605c02a8c0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.407+0000 7f6069a00640 1 -- 172.21.15.12:0/510224298 shutdown_connections 2024-09-05T01:33:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.407+0000 7f6069a00640 1 --2- 172.21.15.12:0/510224298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6064112870 0x7f6064114c60 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.407+0000 7f6069a00640 1 --2- 172.21.15.12:0/510224298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6064077040 0x7f6064112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.407+0000 7f6069a00640 1 --2- 172.21.15.12:0/510224298 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6064076720 0x7f6064076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.407+0000 7f6069a00640 1 -- 172.21.15.12:0/510224298 >> 172.21.15.12:0/510224298 conn(0x7f60640ff8d0 msgr2=0x7f6064101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.407+0000 7f6069a00640 1 -- 172.21.15.12:0/510224298 shutdown_connections 2024-09-05T01:33:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.407+0000 7f6069a00640 1 -- 172.21.15.12:0/510224298 wait complete. 2024-09-05T01:33:15.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.408+0000 7f6069a00640 1 Processor -- start 2024-09-05T01:33:15.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.408+0000 7f6069a00640 1 -- start start 2024-09-05T01:33:15.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.408+0000 7f6069a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6064076720 0x7f60641a45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:15.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.408+0000 7f6069a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6064077040 0x7f60641a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:15.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.408+0000 7f6069a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6064112870 0x7f606419e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:15.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.408+0000 7f6069a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6064118400 con 0x7f6064112870 2024-09-05T01:33:15.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.408+0000 7f6069a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6064118280 con 0x7f6064076720 2024-09-05T01:33:15.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.408+0000 7f6069a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6064118580 con 0x7f6064077040 2024-09-05T01:33:15.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.408+0000 7f6069000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6064112870 0x7f606419e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:15.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.408+0000 7f6069000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6064112870 0x7f606419e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51274/0 (socket says 172.21.15.12:51274) 2024-09-05T01:33:15.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.409+0000 7f6069000640 1 -- 172.21.15.12:0/1081365690 learned_addr learned my addr 172.21.15.12:0/1081365690 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:15.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.409+0000 7f6063400640 1 --2- 172.21.15.12:0/1081365690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6064077040 0x7f60641a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:15.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.409+0000 7f6063e00640 1 --2- 172.21.15.12:0/1081365690 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6064076720 0x7f60641a45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:15.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.409+0000 7f6063400640 1 -- 172.21.15.12:0/1081365690 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6064076720 msgr2=0x7f60641a45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:15.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.409+0000 7f6063400640 1 --2- 172.21.15.12:0/1081365690 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6064076720 0x7f60641a45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.409+0000 7f6063400640 1 -- 172.21.15.12:0/1081365690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6064112870 msgr2=0x7f606419e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:15.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.409+0000 7f6063400640 1 --2- 172.21.15.12:0/1081365690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6064112870 0x7f606419e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.409+0000 7f6063400640 1 -- 172.21.15.12:0/1081365690 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f606419ef20 con 0x7f6064077040 2024-09-05T01:33:15.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.409+0000 7f6063400640 1 --2- 172.21.15.12:0/1081365690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6064077040 0x7f60641a4b20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f605000e9f0 tx=0x7f605000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:15.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.410+0000 7f6060c00640 1 -- 172.21.15.12:0/1081365690 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605000cd80 con 0x7f6064077040 2024-09-05T01:33:15.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.410+0000 7f6060c00640 1 -- 172.21.15.12:0/1081365690 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60500035f0 con 0x7f6064077040 2024-09-05T01:33:15.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.410+0000 7f6069a00640 1 -- 172.21.15.12:0/1081365690 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f606419f210 con 0x7f6064077040 2024-09-05T01:33:15.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.410+0000 7f6060c00640 1 -- 172.21.15.12:0/1081365690 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6050010670 con 0x7f6064077040 2024-09-05T01:33:15.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.410+0000 7f6069a00640 1 -- 172.21.15.12:0/1081365690 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60641ab560 con 0x7f6064077040 2024-09-05T01:33:15.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.413+0000 7f606dac5740 1 Processor -- start 2024-09-05T01:33:15.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.413+0000 7f606dac5740 1 -- start start 2024-09-05T01:33:15.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.413+0000 7f606dac5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a9053d50 0x5577a9054130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:15.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.413+0000 7f606dac5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577a9054670 0x5577a905e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:15.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.413+0000 7f606dac5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a905ef30 0x5577a9061320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:15.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.413+0000 7f606dac5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5577a8fba3e0 con 0x5577a905ef30 2024-09-05T01:33:15.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.413+0000 7f606dac5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5577a8f61d80 con 0x5577a9053d50 2024-09-05T01:33:15.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.413+0000 7f606dac5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5577a8fb63a0 con 0x5577a9054670 2024-09-05T01:33:15.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.413+0000 7f6060c00640 1 -- 172.21.15.12:0/1081365690 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f60500037a0 con 0x7f6064077040 2024-09-05T01:33:15.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.414+0000 7f6063e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577a9054670 0x5577a905e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:15.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.414+0000 7f6069000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a9053d50 0x5577a9054130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:15.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.414+0000 7f6069000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a9053d50 0x5577a9054130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:38678/0 (socket says 172.21.15.12:38678) 2024-09-05T01:33:15.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.414+0000 7f6069000640 1 -- 172.21.15.12:0/566677810 learned_addr learned my addr 172.21.15.12:0/566677810 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:15.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.414+0000 7f6063400640 1 --2- 172.21.15.12:0/566677810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a905ef30 0x5577a9061320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:15.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.414+0000 7f6069000640 1 -- 172.21.15.12:0/566677810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577a9054670 msgr2=0x5577a905e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:15.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.414+0000 7f6069000640 1 --2- 172.21.15.12:0/566677810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577a9054670 0x5577a905e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.414+0000 7f6069000640 1 -- 172.21.15.12:0/566677810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a905ef30 msgr2=0x5577a9061320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:15.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.414+0000 7f6069000640 1 --2- 172.21.15.12:0/566677810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a905ef30 0x5577a9061320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.414+0000 7f6069000640 1 -- 172.21.15.12:0/566677810 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577a8f80ae0 con 0x5577a9053d50 2024-09-05T01:33:15.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.414+0000 7f6069000640 1 --2- 172.21.15.12:0/566677810 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a9053d50 0x5577a9054130 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f605c005f80 tx=0x7f605c0093e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6772eaedb571239 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:15.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.415+0000 7f6059600640 1 -- 172.21.15.12:0/566677810 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605c031db0 con 0x5577a9053d50 2024-09-05T01:33:15.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.415+0000 7f6059600640 1 -- 172.21.15.12:0/566677810 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f605c036030 con 0x5577a9053d50 2024-09-05T01:33:15.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.415+0000 7f6059600640 1 -- 172.21.15.12:0/566677810 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605c004330 con 0x5577a9053d50 2024-09-05T01:33:15.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.415+0000 7f6060c00640 1 --2- 172.21.15.12:0/1081365690 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f60480a2cf0 0x7f60480a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:15.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.416+0000 7f6060c00640 1 -- 172.21.15.12:0/1081365690 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8623+0+0 (secure 0 0 0) 0x7f60500cf790 con 0x7f6064077040 2024-09-05T01:33:15.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.416+0000 7f6063e00640 1 --2- 172.21.15.12:0/1081365690 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f60480a2cf0 0x7f60480a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:15.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.416+0000 7f606dac5740 1 -- 172.21.15.12:0/566677810 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a9053d50 msgr2=0x5577a9054130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:15.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.416+0000 7f606dac5740 1 --2- 172.21.15.12:0/566677810 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a9053d50 0x5577a9054130 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f605c005f80 tx=0x7f605c0093e0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.416+0000 7f606dac5740 1 -- 172.21.15.12:0/566677810 shutdown_connections 2024-09-05T01:33:15.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.416+0000 7f606dac5740 1 --2- 172.21.15.12:0/566677810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a905ef30 0x5577a9061320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.416+0000 7f606dac5740 1 --2- 172.21.15.12:0/566677810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577a9054670 0x5577a905e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.416+0000 7f606dac5740 1 --2- 172.21.15.12:0/566677810 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a9053d50 0x5577a9054130 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.416+0000 7f606dac5740 1 -- 172.21.15.12:0/566677810 >> 172.21.15.12:0/566677810 conn(0x5577a90502e0 msgr2=0x5577a90506c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:15.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.416+0000 7f606dac5740 1 -- 172.21.15.12:0/566677810 shutdown_connections 2024-09-05T01:33:15.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.416+0000 7f606dac5740 1 -- 172.21.15.12:0/566677810 wait complete. 2024-09-05T01:33:15.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.416+0000 7f606dac5740 1 -- start start 2024-09-05T01:33:15.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.417+0000 7f606dac5740 1 Processor -- start 2024-09-05T01:33:15.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.417+0000 7f6063e00640 1 --2- 172.21.15.12:0/1081365690 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f60480a2cf0 0x7f60480a51b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x5577a9051140 tx=0x7f6054005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:15.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.417+0000 7f606dac5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577a9053d50 0x5577a905be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:15.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.417+0000 7f606dac5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a9054670 0x5577a905c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:15.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.417+0000 7f606dac5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a905ef30 0x5577a905c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:15.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.417+0000 7f606dac5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5577a9061a20 con 0x5577a9054670 2024-09-05T01:33:15.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.417+0000 7f606dac5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5577a8f750f0 con 0x5577a905ef30 2024-09-05T01:33:15.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.417+0000 7f606dac5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5577a9061ba0 con 0x5577a9053d50 2024-09-05T01:33:15.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.417+0000 7f606dac5740 10 client.0 _ll_register_callbacks cb 0x5577a8f669e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:33:15.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.418+0000 7f6063e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577a9053d50 0x5577a905be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:15.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.418+0000 7f6063400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a9054670 0x5577a905c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:15.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.418+0000 7f6069000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a905ef30 0x5577a905c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:15.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.418+0000 7f6063e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577a9053d50 0x5577a905be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:40404/0 (socket says 172.21.15.12:40404) 2024-09-05T01:33:15.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.418+0000 7f6063e00640 1 -- 172.21.15.12:0/4019543910 learned_addr learned my addr 172.21.15.12:0/4019543910 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:15.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.418+0000 7f6069000640 1 -- 172.21.15.12:0/4019543910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577a9053d50 msgr2=0x5577a905be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:15.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.418+0000 7f6069000640 1 --2- 172.21.15.12:0/4019543910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577a9053d50 0x5577a905be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.418+0000 7f6069000640 1 -- 172.21.15.12:0/4019543910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a9054670 msgr2=0x5577a905c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:15.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.418+0000 7f6069000640 1 --2- 172.21.15.12:0/4019543910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a9054670 0x5577a905c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.418+0000 7f6069000640 1 -- 172.21.15.12:0/4019543910 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577a8d2b3c0 con 0x5577a905ef30 2024-09-05T01:33:15.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.418+0000 7f6063400640 1 --2- 172.21.15.12:0/4019543910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a9054670 0x5577a905c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:33:15.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.418+0000 7f6069000640 1 --2- 172.21.15.12:0/4019543910 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a905ef30 0x5577a905c900 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f605c02ade0 tx=0x7f605c02a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c861e98b06d30136 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:15.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.418+0000 7f604e000640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:33:15.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.419+0000 7f604e000640 1 -- 172.21.15.12:0/4019543910 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605c04a040 con 0x5577a905ef30 2024-09-05T01:33:15.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.419+0000 7f606dac5740 1 -- 172.21.15.12:0/4019543910 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f605c036030 con 0x5577a905ef30 2024-09-05T01:33:15.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.419+0000 7f604e000640 1 -- 172.21.15.12:0/4019543910 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8623+0+0 (secure 0 0 0) 0x7f605c003970 con 0x5577a905ef30 2024-09-05T01:33:15.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.419+0000 7f604e000640 1 -- 172.21.15.12:0/4019543910 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f605c003bb0 con 0x5577a905ef30 2024-09-05T01:33:15.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.419+0000 7f606dac5740 10 client.26264 fetch_fsmap learned FSMap version 48 2024-09-05T01:33:15.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.419+0000 7f606dac5740 1 -- 172.21.15.12:0/4019543910 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5577a9061a20 con 0x5577a905ef30 2024-09-05T01:33:15.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.419+0000 7f604e000640 1 -- 172.21.15.12:0/4019543910 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f605c036030 con 0x5577a905ef30 2024-09-05T01:33:15.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.420+0000 7f604e000640 1 -- 172.21.15.12:0/4019543910 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 48) ==== 8426+0+0 (secure 0 0 0) 0x7f605c04d030 con 0x5577a905ef30 2024-09-05T01:33:15.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.420+0000 7f606dac5740 10 client.26264 fetch_fsmap finished waiting for FSMap version 48 2024-09-05T01:33:15.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.420+0000 7f606dac5740 10 client.26264 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:33:15.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.420+0000 7f606dac5740 20 client.26264 populate_metadata read hostname 'smithi012' 2024-09-05T01:33:15.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.420+0000 7f606dac5740 1 --2- 172.21.15.12:0/4019543910 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5577a906e900 0x5577a9070d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:15.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.420+0000 7f606dac5740 4 client.26264 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:33:15.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.420+0000 7f606dac5740 1 -- 172.21.15.12:0/4019543910 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577a8fc7950 con 0x5577a906e900 2024-09-05T01:33:15.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.420+0000 7f6063e00640 1 --2- 172.21.15.12:0/4019543910 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5577a906e900 0x5577a9070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:15.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.421+0000 7f6063e00640 1 --2- 172.21.15.12:0/4019543910 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5577a906e900 0x5577a9070d30 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d642882efaeed6da server_cookie=aaa6db3cb66dcfa in_seq=0 out_seq=0 2024-09-05T01:33:15.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.421+0000 7f604e000640 10 client.26264 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:33:15.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.421+0000 7f604e000640 1 -- 172.21.15.12:0/4019543910 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5577a8fc7950 con 0x5577a906e900 2024-09-05T01:33:15.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.421+0000 7f604e000640 10 client.26264 handle_command_reply: tid=0 2024-09-05T01:33:15.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.422+0000 7f606dac5740 1 client.26264 shutdown 2024-09-05T01:33:15.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.422+0000 7f606dac5740 1 -- 172.21.15.12:0/4019543910 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a905ef30 msgr2=0x5577a905c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:15.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.422+0000 7f606dac5740 1 --2- 172.21.15.12:0/4019543910 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a905ef30 0x5577a905c900 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f605c02ade0 tx=0x7f605c02a8c0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.422+0000 7f606dac5740 1 -- 172.21.15.12:0/4019543910 shutdown_connections 2024-09-05T01:33:15.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.422+0000 7f606dac5740 1 --2- 172.21.15.12:0/4019543910 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5577a906e900 0x5577a9070d30 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.422+0000 7f606dac5740 1 --2- 172.21.15.12:0/4019543910 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a905ef30 0x5577a905c900 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.422+0000 7f606dac5740 1 --2- 172.21.15.12:0/4019543910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a9054670 0x5577a905c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.422+0000 7f606dac5740 1 --2- 172.21.15.12:0/4019543910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577a9053d50 0x5577a905be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.422+0000 7f606dac5740 1 -- 172.21.15.12:0/4019543910 >> 172.21.15.12:0/4019543910 conn(0x5577a90502e0 msgr2=0x5577a9055fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:15.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.422+0000 7f604e000640 0 client.26264 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:33:15.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.422+0000 7f606dac5740 1 -- 172.21.15.12:0/4019543910 shutdown_connections 2024-09-05T01:33:15.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.422+0000 7f606dac5740 1 -- 172.21.15.12:0/4019543910 wait complete. 2024-09-05T01:33:15.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.422+0000 7f606dac5740 20 client.26264 trim_cache size 0 max 16384 2024-09-05T01:33:15.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.440+0000 7f606dac5740 1 Processor -- start 2024-09-05T01:33:15.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.440+0000 7f606dac5740 1 -- start start 2024-09-05T01:33:15.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.441+0000 7f606dac5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a9053d50 0x5577a90567b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:15.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.441+0000 7f606dac5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a9054670 0x5577a904f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:15.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.441+0000 7f606dac5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577a905ef30 0x5577a9076600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:15.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.441+0000 7f606dac5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f60641b3e60 con 0x5577a9054670 2024-09-05T01:33:15.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.441+0000 7f606dac5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f60641b5b50 con 0x5577a9053d50 2024-09-05T01:33:15.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.441+0000 7f606dac5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f60641b4530 con 0x5577a905ef30 2024-09-05T01:33:15.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.441+0000 7f6063e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a9053d50 0x5577a90567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:15.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.441+0000 7f6063400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a9054670 0x5577a904f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:15.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.441+0000 7f6063e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a9053d50 0x5577a90567b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:38698/0 (socket says 172.21.15.12:38698) 2024-09-05T01:33:15.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.441+0000 7f6063400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a9054670 0x5577a904f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51296/0 (socket says 172.21.15.12:51296) 2024-09-05T01:33:15.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.441+0000 7f6063e00640 1 -- 172.21.15.12:0/4087512614 learned_addr learned my addr 172.21.15.12:0/4087512614 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:15.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.441+0000 7f6069000640 1 --2- 172.21.15.12:0/4087512614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577a905ef30 0x5577a9076600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:15.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.441+0000 7f6063e00640 1 -- 172.21.15.12:0/4087512614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577a905ef30 msgr2=0x5577a9076600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:15.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.441+0000 7f6063e00640 1 --2- 172.21.15.12:0/4087512614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577a905ef30 0x5577a9076600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.441+0000 7f6063e00640 1 -- 172.21.15.12:0/4087512614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a9054670 msgr2=0x5577a904f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:15.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.441+0000 7f6063e00640 1 --2- 172.21.15.12:0/4087512614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a9054670 0x5577a904f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.441+0000 7f6063e00640 1 -- 172.21.15.12:0/4087512614 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577a9056cf0 con 0x5577a9053d50 2024-09-05T01:33:15.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.441+0000 7f6069000640 1 --2- 172.21.15.12:0/4087512614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577a905ef30 0x5577a9076600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:33:15.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.441+0000 7f6063400640 1 --2- 172.21.15.12:0/4087512614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a9054670 0x5577a904f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:33:15.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.442+0000 7f6063e00640 1 --2- 172.21.15.12:0/4087512614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a9053d50 0x5577a90567b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6054004570 tx=0x7f605401b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1b82eb21f2558f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:15.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.442+0000 7f6058c00640 1 -- 172.21.15.12:0/4087512614 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054005020 con 0x5577a9053d50 2024-09-05T01:33:15.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.442+0000 7f6058c00640 1 -- 172.21.15.12:0/4087512614 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60540047a0 con 0x5577a9053d50 2024-09-05T01:33:15.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.442+0000 7f6058c00640 1 -- 172.21.15.12:0/4087512614 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605402b770 con 0x5577a9053d50 2024-09-05T01:33:15.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.442+0000 7f606dac5740 1 -- 172.21.15.12:0/4087512614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a9053d50 msgr2=0x5577a90567b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:15.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.442+0000 7f606dac5740 1 --2- 172.21.15.12:0/4087512614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a9053d50 0x5577a90567b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6054004570 tx=0x7f605401b000 comp rx=0 tx=0).stop 2024-09-05T01:33:15.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.443+0000 7f606dac5740 1 -- 172.21.15.12:0/4087512614 shutdown_connections 2024-09-05T01:33:15.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.443+0000 7f606dac5740 1 --2- 172.21.15.12:0/4087512614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577a905ef30 0x5577a9076600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.443+0000 7f606dac5740 1 --2- 172.21.15.12:0/4087512614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a9054670 0x5577a904f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.443+0000 7f606dac5740 1 --2- 172.21.15.12:0/4087512614 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a9053d50 0x5577a90567b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.443+0000 7f606dac5740 1 -- 172.21.15.12:0/4087512614 >> 172.21.15.12:0/4087512614 conn(0x5577a90502e0 msgr2=0x5577a904eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:15.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.443+0000 7f606dac5740 1 -- 172.21.15.12:0/4087512614 shutdown_connections 2024-09-05T01:33:15.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.443+0000 7f606dac5740 1 -- 172.21.15.12:0/4087512614 wait complete. 2024-09-05T01:33:15.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.443+0000 7f606dac5740 1 -- start start 2024-09-05T01:33:15.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.443+0000 7f606dac5740 1 Processor -- start 2024-09-05T01:33:15.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.444+0000 7f606dac5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a9053d50 0x5577a9067700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:15.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.444+0000 7f606dac5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577a9054670 0x5577a9058d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:15.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.444+0000 7f606dac5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a905ef30 0x5577a9059490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:15.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.444+0000 7f606dac5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f60641b53c0 con 0x5577a9053d50 2024-09-05T01:33:15.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.444+0000 7f606dac5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f60641b4c30 con 0x5577a905ef30 2024-09-05T01:33:15.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.444+0000 7f606dac5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f60641b1e60 con 0x5577a9054670 2024-09-05T01:33:15.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.444+0000 7f606dac5740 10 client.0 _ll_register_callbacks cb 0x7f605c009bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:33:15.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.444+0000 7f6063e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a9053d50 0x5577a9067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:15.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.444+0000 7f6069000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a905ef30 0x5577a9059490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:15.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.444+0000 7f6063e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a9053d50 0x5577a9067700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51310/0 (socket says 172.21.15.12:51310) 2024-09-05T01:33:15.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.444+0000 7f6063e00640 1 -- 172.21.15.12:0/1395590985 learned_addr learned my addr 172.21.15.12:0/1395590985 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:15.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.444+0000 7f6063400640 1 --2- 172.21.15.12:0/1395590985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577a9054670 0x5577a9058d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:15.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.445+0000 7f6063400640 1 -- 172.21.15.12:0/1395590985 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a905ef30 msgr2=0x5577a9059490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:15.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.445+0000 7f6063400640 1 --2- 172.21.15.12:0/1395590985 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a905ef30 0x5577a9059490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.445+0000 7f6063400640 1 -- 172.21.15.12:0/1395590985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a9053d50 msgr2=0x5577a9067700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:15.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.445+0000 7f6063400640 1 --2- 172.21.15.12:0/1395590985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a9053d50 0x5577a9067700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.445+0000 7f6063400640 1 -- 172.21.15.12:0/1395590985 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577a90d85d0 con 0x5577a9054670 2024-09-05T01:33:15.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.445+0000 7f6063e00640 1 --2- 172.21.15.12:0/1395590985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a9053d50 0x5577a9067700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:33:15.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.445+0000 7f6063400640 1 --2- 172.21.15.12:0/1395590985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577a9054670 0x5577a9058d50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f60500cce20 tx=0x7f6050097f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e900a390ade5fa68 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:15.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.445+0000 7f604e000640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:33:15.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.445+0000 7f604e000640 1 -- 172.21.15.12:0/1395590985 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60500a4860 con 0x5577a9054670 2024-09-05T01:33:15.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.445+0000 7f604e000640 1 -- 172.21.15.12:0/1395590985 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8623+0+0 (secure 0 0 0) 0x7f60500cd0a0 con 0x5577a9054670 2024-09-05T01:33:15.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.445+0000 7f606dac5740 1 -- 172.21.15.12:0/1395590985 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60540047a0 con 0x5577a9054670 2024-09-05T01:33:15.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.445+0000 7f604e000640 1 -- 172.21.15.12:0/1395590985 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f60500cd2a0 con 0x5577a9054670 2024-09-05T01:33:15.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.445+0000 7f606dac5740 10 client.26260 fetch_fsmap learned FSMap version 48 2024-09-05T01:33:15.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.445+0000 7f606dac5740 1 -- 172.21.15.12:0/1395590985 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5577a90d97a0 con 0x5577a9054670 2024-09-05T01:33:15.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.446+0000 7f604e000640 1 -- 172.21.15.12:0/1395590985 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60540047a0 con 0x5577a9054670 2024-09-05T01:33:15.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.446+0000 7f604e000640 1 -- 172.21.15.12:0/1395590985 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 48) ==== 8426+0+0 (secure 0 0 0) 0x7f605009aab0 con 0x5577a9054670 2024-09-05T01:33:15.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.446+0000 7f606dac5740 10 client.26260 fetch_fsmap finished waiting for FSMap version 48 2024-09-05T01:33:15.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.446+0000 7f606dac5740 10 client.26260 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:33:15.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.446+0000 7f606dac5740 20 client.26260 populate_metadata read hostname 'smithi012' 2024-09-05T01:33:15.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.446+0000 7f606dac5740 1 --2- 172.21.15.12:0/1395590985 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5577a90da030 0x5577a90dc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:15.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.446+0000 7f606dac5740 4 client.26260 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T01:33:15.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.446+0000 7f606dac5740 1 -- 172.21.15.12:0/1395590985 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5577a8fc1e60 con 0x5577a90da030 2024-09-05T01:33:15.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.446+0000 7f6063e00640 1 --2- 172.21.15.12:0/1395590985 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5577a90da030 0x5577a90dc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:15.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.447+0000 7f6063e00640 1 --2- 172.21.15.12:0/1395590985 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5577a90da030 0x5577a90dc450 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56d948cacb104b5d server_cookie=bfe70de534e946e0 in_seq=0 out_seq=0 2024-09-05T01:33:15.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.447+0000 7f604e000640 10 client.26260 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:33:15.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.447+0000 7f604e000640 1 -- 172.21.15.12:0/1395590985 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5577a8fc1e60 con 0x5577a90da030 2024-09-05T01:33:15.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.447+0000 7f604e000640 10 client.26260 handle_command_reply: tid=0 2024-09-05T01:33:15.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.447+0000 7f606dac5740 1 client.26260 shutdown 2024-09-05T01:33:15.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.447+0000 7f606dac5740 1 -- 172.21.15.12:0/1395590985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577a9054670 msgr2=0x5577a9058d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:15.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.447+0000 7f606dac5740 1 --2- 172.21.15.12:0/1395590985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577a9054670 0x5577a9058d50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f60500cce20 tx=0x7f6050097f80 comp rx=0 tx=0).stop 2024-09-05T01:33:15.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.447+0000 7f606dac5740 1 -- 172.21.15.12:0/1395590985 shutdown_connections 2024-09-05T01:33:15.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.447+0000 7f606dac5740 1 --2- 172.21.15.12:0/1395590985 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5577a90da030 0x5577a90dc450 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.447+0000 7f606dac5740 1 --2- 172.21.15.12:0/1395590985 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5577a905ef30 0x5577a9059490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.447+0000 7f606dac5740 1 --2- 172.21.15.12:0/1395590985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577a9054670 0x5577a9058d50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.447+0000 7f604e000640 0 client.26260 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:33:15.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.447+0000 7f606dac5740 1 --2- 172.21.15.12:0/1395590985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5577a9053d50 0x5577a9067700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.447+0000 7f606dac5740 1 -- 172.21.15.12:0/1395590985 >> 172.21.15.12:0/1395590985 conn(0x5577a90502e0 msgr2=0x5577a905df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:15.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.448+0000 7f606dac5740 1 -- 172.21.15.12:0/1395590985 shutdown_connections 2024-09-05T01:33:15.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.448+0000 7f606dac5740 1 -- 172.21.15.12:0/1395590985 wait complete. 2024-09-05T01:33:15.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.448+0000 7f606dac5740 20 client.26260 trim_cache size 0 max 16384 2024-09-05T01:33:15.454 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:33:15.454 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-05T01:33:15.455 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-05T01:33:15.455 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:33:15.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.448+0000 7f6069a00640 1 -- 172.21.15.12:0/1081365690 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f60480a2cf0 msgr2=0x7f60480a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:15.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.448+0000 7f6069a00640 1 --2- 172.21.15.12:0/1081365690 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f60480a2cf0 0x7f60480a51b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x5577a9051140 tx=0x7f6054005f90 comp rx=0 tx=0).stop 2024-09-05T01:33:15.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.448+0000 7f6069a00640 1 -- 172.21.15.12:0/1081365690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6064077040 msgr2=0x7f60641a4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:15.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.448+0000 7f6069a00640 1 --2- 172.21.15.12:0/1081365690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6064077040 0x7f60641a4b20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f605000e9f0 tx=0x7f605000eeb0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.448+0000 7f6069a00640 1 -- 172.21.15.12:0/1081365690 shutdown_connections 2024-09-05T01:33:15.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.448+0000 7f6069a00640 1 --2- 172.21.15.12:0/1081365690 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f60480a2cf0 0x7f60480a51b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.448+0000 7f6069a00640 1 --2- 172.21.15.12:0/1081365690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6064112870 0x7f606419e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.448+0000 7f6069a00640 1 --2- 172.21.15.12:0/1081365690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6064077040 0x7f60641a4b20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.448+0000 7f6069a00640 1 --2- 172.21.15.12:0/1081365690 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6064076720 0x7f60641a45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:15.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.448+0000 7f6069a00640 1 -- 172.21.15.12:0/1081365690 >> 172.21.15.12:0/1081365690 conn(0x7f60640ff8d0 msgr2=0x7f6064101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:15.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.449+0000 7f6069a00640 1 -- 172.21.15.12:0/1081365690 shutdown_connections 2024-09-05T01:33:15.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:15.449+0000 7f6069a00640 1 -- 172.21.15.12:0/1081365690 wait complete. 2024-09-05T01:33:15.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:15 smithi012 ceph-mon[29942]: pgmap v264: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 120 KiB/s wr, 35 op/s 2024-09-05T01:33:15.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:15 smithi151 ceph-mon[35013]: pgmap v264: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 120 KiB/s wr, 35 op/s 2024-09-05T01:33:15.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:15 smithi145 ceph-mon[34376]: pgmap v264: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 120 KiB/s wr, 35 op/s 2024-09-05T01:33:16.493 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-05T01:33:16.493 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:33:16.871 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:33:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.471+0000 7f5ca9000640 1 -- 172.21.15.12:0/1275298424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ca4103ff0 msgr2=0x7f5ca41043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.471+0000 7f5ca9000640 1 --2- 172.21.15.12:0/1275298424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ca4103ff0 0x7f5ca41043d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5c94009900 tx=0x7f5c9402a3f0 comp rx=0 tx=0).stop 2024-09-05T01:33:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.471+0000 7f5ca9000640 1 -- 172.21.15.12:0/1275298424 shutdown_connections 2024-09-05T01:33:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.471+0000 7f5ca9000640 1 --2- 172.21.15.12:0/1275298424 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ca4109120 0x7f5ca4110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:17.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.471+0000 7f5ca9000640 1 --2- 172.21.15.12:0/1275298424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ca41049a0 0x7f5ca41089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:17.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.471+0000 7f5ca9000640 1 --2- 172.21.15.12:0/1275298424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ca4103ff0 0x7f5ca41043d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:17.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.471+0000 7f5ca9000640 1 -- 172.21.15.12:0/1275298424 >> 172.21.15.12:0/1275298424 conn(0x7f5ca40ffa90 msgr2=0x7f5ca4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:17.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.471+0000 7f5ca9000640 1 -- 172.21.15.12:0/1275298424 shutdown_connections 2024-09-05T01:33:17.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.471+0000 7f5ca9000640 1 -- 172.21.15.12:0/1275298424 wait complete. 2024-09-05T01:33:17.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.472+0000 7f5ca9000640 1 Processor -- start 2024-09-05T01:33:17.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.472+0000 7f5ca9000640 1 -- start start 2024-09-05T01:33:17.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.472+0000 7f5ca9000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ca4103ff0 0x7f5ca419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:17.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.473+0000 7f5ca9000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ca41049a0 0x7f5ca419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:17.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.473+0000 7f5ca9000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ca4109120 0x7f5ca419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:17.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.473+0000 7f5ca9000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca4114190 con 0x7f5ca4109120 2024-09-05T01:33:17.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.473+0000 7f5ca9000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca4114010 con 0x7f5ca4103ff0 2024-09-05T01:33:17.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.473+0000 7f5ca9000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca4114310 con 0x7f5ca41049a0 2024-09-05T01:33:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.473+0000 7f5ca1e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ca4103ff0 0x7f5ca419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.473+0000 7f5ca1e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ca4103ff0 0x7f5ca419a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:40576/0 (socket says 172.21.15.12:40576) 2024-09-05T01:33:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.473+0000 7f5ca1e00640 1 -- 172.21.15.12:0/3877781608 learned_addr learned my addr 172.21.15.12:0/3877781608 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.473+0000 7f5ca2800640 1 --2- 172.21.15.12:0/3877781608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ca4109120 0x7f5ca419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.473+0000 7f5ca1400640 1 --2- 172.21.15.12:0/3877781608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ca41049a0 0x7f5ca419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.473+0000 7f5ca1e00640 1 -- 172.21.15.12:0/3877781608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ca41049a0 msgr2=0x7f5ca419ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.473+0000 7f5ca1e00640 1 --2- 172.21.15.12:0/3877781608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ca41049a0 0x7f5ca419ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.473+0000 7f5ca1e00640 1 -- 172.21.15.12:0/3877781608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ca4109120 msgr2=0x7f5ca419eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.473+0000 7f5ca1e00640 1 --2- 172.21.15.12:0/3877781608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ca4109120 0x7f5ca419eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.473+0000 7f5ca1e00640 1 -- 172.21.15.12:0/3877781608 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca419f5c0 con 0x7f5ca4103ff0 2024-09-05T01:33:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.474+0000 7f5ca1e00640 1 --2- 172.21.15.12:0/3877781608 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ca4103ff0 0x7f5ca419a610 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5c94004770 tx=0x7f5c94003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.474+0000 7f5c9aa00640 1 -- 172.21.15.12:0/3877781608 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9403f070 con 0x7f5ca4103ff0 2024-09-05T01:33:17.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.474+0000 7f5ca9000640 1 -- 172.21.15.12:0/3877781608 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca419f850 con 0x7f5ca4103ff0 2024-09-05T01:33:17.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.474+0000 7f5c9aa00640 1 -- 172.21.15.12:0/3877781608 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c94031ca0 con 0x7f5ca4103ff0 2024-09-05T01:33:17.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.474+0000 7f5c9aa00640 1 -- 172.21.15.12:0/3877781608 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c94035030 con 0x7f5ca4103ff0 2024-09-05T01:33:17.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.474+0000 7f5ca9000640 1 -- 172.21.15.12:0/3877781608 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca41a7190 con 0x7f5ca4103ff0 2024-09-05T01:33:17.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.475+0000 7f5ca9000640 1 -- 172.21.15.12:0/3877781608 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ca41054d0 con 0x7f5ca4103ff0 2024-09-05T01:33:17.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.477+0000 7f5c9aa00640 1 -- 172.21.15.12:0/3877781608 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f5c94042070 con 0x7f5ca4103ff0 2024-09-05T01:33:17.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.479+0000 7f5c9aa00640 1 --2- 172.21.15.12:0/3877781608 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5c880a2cf0 0x7f5c880a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:17.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.479+0000 7f5c9aa00640 1 -- 172.21.15.12:0/3877781608 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8579+0+0 (secure 0 0 0) 0x7f5c940f0130 con 0x7f5ca4103ff0 2024-09-05T01:33:17.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.479+0000 7f5ca1400640 1 --2- 172.21.15.12:0/3877781608 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5c880a2cf0 0x7f5c880a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:17.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.480+0000 7f5ca1400640 1 --2- 172.21.15.12:0/3877781608 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5c880a2cf0 0x7f5c880a51b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5ca40fff20 tx=0x7f5c90005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:17.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.481+0000 7f5c9aa00640 1 -- 172.21.15.12:0/3877781608 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5c940bc660 con 0x7f5ca4103ff0 2024-09-05T01:33:17.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:17 smithi012 ceph-mon[29942]: pgmap v265: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 109 KiB/s wr, 21 op/s 2024-09-05T01:33:17.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:17 smithi012 ceph-mon[29942]: osdmap e92: 12 total, 12 up, 12 in 2024-09-05T01:33:17.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:17 smithi151 ceph-mon[35013]: pgmap v265: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 109 KiB/s wr, 21 op/s 2024-09-05T01:33:17.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:17 smithi151 ceph-mon[35013]: osdmap e92: 12 total, 12 up, 12 in 2024-09-05T01:33:17.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.706+0000 7f5ca9000640 1 -- 172.21.15.12:0/3877781608 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ca41043d0 con 0x7f5ca4103ff0 2024-09-05T01:33:17.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.707+0000 7f5c9aa00640 1 -- 172.21.15.12:0/3877781608 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+12006 (secure 0 0 0) 0x7f5ca41043d0 con 0x7f5ca4103ff0 2024-09-05T01:33:17.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:33:17.709 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":48,"btime":"2024-09-05T01:33:00:309496+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14532,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/2949711075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":2949711075},{"type":"v1","addr":"172.21.15.12:6839","nonce":2949711075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":48,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T01:22:35.979384+0000","modified":"2024-09-05T01:32:59.537574+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24529,"mds_2":24524,"mds_3":24517,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/497406458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":497406458},{"type":"v1","addr":"172.21.15.12:6841","nonce":497406458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[0,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":10,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.145:6839/1706431882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":1706431882},{"type":"v1","addr":"172.21.15.145:6839","nonce":1706431882}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24529,24524,24517,24460]},"id":1}]} 2024-09-05T01:33:17.709 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 48 2024-09-05T01:33:17.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.710+0000 7f5ca9000640 1 -- 172.21.15.12:0/3877781608 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5c880a2cf0 msgr2=0x7f5c880a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:17.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.710+0000 7f5ca9000640 1 --2- 172.21.15.12:0/3877781608 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5c880a2cf0 0x7f5c880a51b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5ca40fff20 tx=0x7f5c90005f90 comp rx=0 tx=0).stop 2024-09-05T01:33:17.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.710+0000 7f5ca9000640 1 -- 172.21.15.12:0/3877781608 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ca4103ff0 msgr2=0x7f5ca419a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:17.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.710+0000 7f5ca9000640 1 --2- 172.21.15.12:0/3877781608 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ca4103ff0 0x7f5ca419a610 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5c94004770 tx=0x7f5c94003c10 comp rx=0 tx=0).stop 2024-09-05T01:33:17.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.710+0000 7f5ca9000640 1 -- 172.21.15.12:0/3877781608 shutdown_connections 2024-09-05T01:33:17.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.710+0000 7f5ca9000640 1 --2- 172.21.15.12:0/3877781608 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f5c880a2cf0 0x7f5c880a51b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:17.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.710+0000 7f5ca9000640 1 --2- 172.21.15.12:0/3877781608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ca4109120 0x7f5ca419eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:17.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.710+0000 7f5ca9000640 1 --2- 172.21.15.12:0/3877781608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ca41049a0 0x7f5ca419ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:17.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.710+0000 7f5ca9000640 1 --2- 172.21.15.12:0/3877781608 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5ca4103ff0 0x7f5ca419a610 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:17.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.710+0000 7f5ca9000640 1 -- 172.21.15.12:0/3877781608 >> 172.21.15.12:0/3877781608 conn(0x7f5ca40ffa90 msgr2=0x7f5ca4100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:17.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.710+0000 7f5ca9000640 1 -- 172.21.15.12:0/3877781608 shutdown_connections 2024-09-05T01:33:17.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:17.710+0000 7f5ca9000640 1 -- 172.21.15.12:0/3877781608 wait complete. 2024-09-05T01:33:17.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:17 smithi145 ceph-mon[34376]: pgmap v265: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 109 KiB/s wr, 21 op/s 2024-09-05T01:33:17.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:17 smithi145 ceph-mon[34376]: osdmap e92: 12 total, 12 up, 12 in 2024-09-05T01:33:18.467 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-05T01:33:18.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:18 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3877781608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:33:18.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:18 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3877781608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:33:18.845 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:33:18.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:18 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3877781608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:33:19.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.391+0000 7fa317200640 1 -- 172.21.15.12:0/2867332326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa318108f60 msgr2=0x7fa318110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:19.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.391+0000 7fa317200640 1 --2- 172.21.15.12:0/2867332326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa318108f60 0x7fa318110ae0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa310009ca0 tx=0x7fa31002a8c0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.391+0000 7fa317200640 1 -- 172.21.15.12:0/2867332326 shutdown_connections 2024-09-05T01:33:19.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.391+0000 7fa317200640 1 --2- 172.21.15.12:0/2867332326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa318108f60 0x7fa318110ae0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.391+0000 7fa317200640 1 --2- 172.21.15.12:0/2867332326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3181047e0 0x7fa318108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.391+0000 7fa317200640 1 --2- 172.21.15.12:0/2867332326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa318103e30 0x7fa318104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.391+0000 7fa317200640 1 -- 172.21.15.12:0/2867332326 >> 172.21.15.12:0/2867332326 conn(0x7fa3180ff8d0 msgr2=0x7fa318101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:19.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.392+0000 7fa317200640 1 -- 172.21.15.12:0/2867332326 shutdown_connections 2024-09-05T01:33:19.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.392+0000 7fa317200640 1 -- 172.21.15.12:0/2867332326 wait complete. 2024-09-05T01:33:19.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.393+0000 7fa317200640 1 Processor -- start 2024-09-05T01:33:19.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.393+0000 7fa317200640 1 -- start start 2024-09-05T01:33:19.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.393+0000 7fa317200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa318103e30 0x7fa31819a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:19.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.393+0000 7fa317200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3181047e0 0x7fa31819a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:19.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.393+0000 7fa317200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa318108f60 0x7fa31819ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:19.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.393+0000 7fa317200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa318114010 con 0x7fa318103e30 2024-09-05T01:33:19.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.393+0000 7fa317200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa318113e90 con 0x7fa3181047e0 2024-09-05T01:33:19.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.393+0000 7fa317200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa318114190 con 0x7fa318108f60 2024-09-05T01:33:19.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.393+0000 7fa315e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa318103e30 0x7fa31819a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:19.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.394+0000 7fa316800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa318108f60 0x7fa31819ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:19.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.394+0000 7fa315e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa318103e30 0x7fa31819a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44062/0 (socket says 172.21.15.12:44062) 2024-09-05T01:33:19.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.394+0000 7fa315e00640 1 -- 172.21.15.12:0/3207980043 learned_addr learned my addr 172.21.15.12:0/3207980043 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:19.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.394+0000 7fa30fe00640 1 --2- 172.21.15.12:0/3207980043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3181047e0 0x7fa31819a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:19.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.394+0000 7fa315e00640 1 -- 172.21.15.12:0/3207980043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa318108f60 msgr2=0x7fa31819ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:19.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.394+0000 7fa315e00640 1 --2- 172.21.15.12:0/3207980043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa318108f60 0x7fa31819ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.394+0000 7fa315e00640 1 -- 172.21.15.12:0/3207980043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3181047e0 msgr2=0x7fa31819a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:19.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.394+0000 7fa315e00640 1 --2- 172.21.15.12:0/3207980043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3181047e0 0x7fa31819a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.394+0000 7fa315e00640 1 -- 172.21.15.12:0/3207980043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa31819f3a0 con 0x7fa318103e30 2024-09-05T01:33:19.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.394+0000 7fa316800640 1 --2- 172.21.15.12:0/3207980043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa318108f60 0x7fa31819ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:33:19.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.394+0000 7fa30fe00640 1 --2- 172.21.15.12:0/3207980043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3181047e0 0x7fa31819a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:33:19.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.394+0000 7fa315e00640 1 --2- 172.21.15.12:0/3207980043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa318103e30 0x7fa31819a3f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa30800e9f0 tx=0x7fa30800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:19.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.395+0000 7fa30ea00640 1 -- 172.21.15.12:0/3207980043 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30800cd80 con 0x7fa318103e30 2024-09-05T01:33:19.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.395+0000 7fa30ea00640 1 -- 172.21.15.12:0/3207980043 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa308010910 con 0x7fa318103e30 2024-09-05T01:33:19.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.395+0000 7fa317200640 1 -- 172.21.15.12:0/3207980043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa31819f690 con 0x7fa318103e30 2024-09-05T01:33:19.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.395+0000 7fa30ea00640 1 -- 172.21.15.12:0/3207980043 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa308018990 con 0x7fa318103e30 2024-09-05T01:33:19.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.395+0000 7fa317200640 1 -- 172.21.15.12:0/3207980043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3181a6f70 con 0x7fa318103e30 2024-09-05T01:33:19.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.398+0000 7fa30ea00640 1 -- 172.21.15.12:0/3207980043 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fa308010ac0 con 0x7fa318103e30 2024-09-05T01:33:19.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.398+0000 7fa31fa2c740 1 Processor -- start 2024-09-05T01:33:19.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.398+0000 7fa31fa2c740 1 -- start start 2024-09-05T01:33:19.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.398+0000 7fa31fa2c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae3fe40 0x55a32ae40220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:19.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.398+0000 7fa31fa2c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a32ae40760 0x55a32ae4aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:19.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.399+0000 7fa31fa2c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a32ae4b020 0x55a32ae4d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:19.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.399+0000 7fa31fa2c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a32ada63e0 con 0x55a32ae3fe40 2024-09-05T01:33:19.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.399+0000 7fa31fa2c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55a32ad4dd80 con 0x55a32ae40760 2024-09-05T01:33:19.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.399+0000 7fa31fa2c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a32ada23a0 con 0x55a32ae4b020 2024-09-05T01:33:19.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.399+0000 7fa316800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae3fe40 0x55a32ae40220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:19.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.399+0000 7fa316800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae3fe40 0x55a32ae40220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44072/0 (socket says 172.21.15.12:44072) 2024-09-05T01:33:19.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.399+0000 7fa316800640 1 -- 172.21.15.12:0/3426854207 learned_addr learned my addr 172.21.15.12:0/3426854207 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:19.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.399+0000 7fa315e00640 1 --2- 172.21.15.12:0/3426854207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a32ae40760 0x55a32ae4aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:19.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.399+0000 7fa30fe00640 1 --2- 172.21.15.12:0/3426854207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a32ae4b020 0x55a32ae4d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:19.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.399+0000 7fa316800640 1 -- 172.21.15.12:0/3426854207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a32ae4b020 msgr2=0x55a32ae4d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:19.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.399+0000 7fa316800640 1 --2- 172.21.15.12:0/3426854207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a32ae4b020 0x55a32ae4d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.399+0000 7fa316800640 1 -- 172.21.15.12:0/3426854207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a32ae40760 msgr2=0x55a32ae4aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:19.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.399+0000 7fa316800640 1 --2- 172.21.15.12:0/3426854207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a32ae40760 0x55a32ae4aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.399+0000 7fa316800640 1 -- 172.21.15.12:0/3426854207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a32ad6cae0 con 0x55a32ae3fe40 2024-09-05T01:33:19.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.400+0000 7fa30ea00640 1 --2- 172.21.15.12:0/3207980043 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fa2fc0a2d70 0x7fa2fc0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:19.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.400+0000 7fa316800640 1 --2- 172.21.15.12:0/3426854207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae3fe40 0x55a32ae40220 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa310009ca0 tx=0x7fa310033000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a88c652493acc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:19.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.400+0000 7fa30ea00640 1 -- 172.21.15.12:0/3207980043 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8579+0+0 (secure 0 0 0) 0x7fa3080cf760 con 0x7fa318103e30 2024-09-05T01:33:19.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.400+0000 7fa315e00640 1 --2- 172.21.15.12:0/3207980043 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fa2fc0a2d70 0x7fa2fc0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:19.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.400+0000 7fa307400640 1 -- 172.21.15.12:0/3426854207 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa310003b70 con 0x55a32ae3fe40 2024-09-05T01:33:19.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.400+0000 7fa307400640 1 -- 172.21.15.12:0/3426854207 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa310036040 con 0x55a32ae3fe40 2024-09-05T01:33:19.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.400+0000 7fa307400640 1 -- 172.21.15.12:0/3426854207 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa310004500 con 0x55a32ae3fe40 2024-09-05T01:33:19.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.401+0000 7fa31fa2c740 1 -- 172.21.15.12:0/3426854207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae3fe40 msgr2=0x55a32ae40220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:19.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.401+0000 7fa315e00640 1 --2- 172.21.15.12:0/3207980043 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fa2fc0a2d70 0x7fa2fc0a5230 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x55a32ae3d230 tx=0x7fa3080d5530 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:19.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.401+0000 7fa31fa2c740 1 --2- 172.21.15.12:0/3426854207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae3fe40 0x55a32ae40220 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa310009ca0 tx=0x7fa310033000 comp rx=0 tx=0).stop 2024-09-05T01:33:19.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.401+0000 7fa31fa2c740 1 -- 172.21.15.12:0/3426854207 shutdown_connections 2024-09-05T01:33:19.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.401+0000 7fa31fa2c740 1 --2- 172.21.15.12:0/3426854207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a32ae4b020 0x55a32ae4d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.401+0000 7fa31fa2c740 1 --2- 172.21.15.12:0/3426854207 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a32ae40760 0x55a32ae4aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.401+0000 7fa31fa2c740 1 --2- 172.21.15.12:0/3426854207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae3fe40 0x55a32ae40220 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.401+0000 7fa31fa2c740 1 -- 172.21.15.12:0/3426854207 >> 172.21.15.12:0/3426854207 conn(0x55a32ae3c3d0 msgr2=0x55a32ae3c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:19.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.401+0000 7fa31fa2c740 1 -- 172.21.15.12:0/3426854207 shutdown_connections 2024-09-05T01:33:19.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.401+0000 7fa31fa2c740 1 -- 172.21.15.12:0/3426854207 wait complete. 2024-09-05T01:33:19.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.402+0000 7fa31fa2c740 1 -- start start 2024-09-05T01:33:19.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.402+0000 7fa31fa2c740 1 Processor -- start 2024-09-05T01:33:19.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.403+0000 7fa31fa2c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a32ae3fe40 0x55a32ae47f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:19.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.403+0000 7fa31fa2c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae40760 0x55a32ae48490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:19.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.403+0000 7fa31fa2c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a32ae4b020 0x55a32ae489d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:19.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.403+0000 7fa31fa2c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a32ae4da70 con 0x55a32ae40760 2024-09-05T01:33:19.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.403+0000 7fa31fa2c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55a32ad610f0 con 0x55a32ae4b020 2024-09-05T01:33:19.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.403+0000 7fa31fa2c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a32ae4dbf0 con 0x55a32ae3fe40 2024-09-05T01:33:19.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.403+0000 7fa31fa2c740 10 client.0 _ll_register_callbacks cb 0x55a32ad48bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:33:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.403+0000 7fa30fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae40760 0x55a32ae48490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.403+0000 7fa316800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a32ae4b020 0x55a32ae489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.403+0000 7fa30fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae40760 0x55a32ae48490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44082/0 (socket says 172.21.15.12:44082) 2024-09-05T01:33:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.403+0000 7fa30fe00640 1 -- 172.21.15.12:0/3617284703 learned_addr learned my addr 172.21.15.12:0/3617284703 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.403+0000 7fa316800640 1 --2- 172.21.15.12:0/3617284703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a32ae3fe40 0x55a32ae47f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.403+0000 7fa30fe00640 1 -- 172.21.15.12:0/3617284703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a32ae3fe40 msgr2=0x55a32ae47f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.403+0000 7fa30fe00640 1 --2- 172.21.15.12:0/3617284703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a32ae3fe40 0x55a32ae47f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.403+0000 7fa30fe00640 1 -- 172.21.15.12:0/3617284703 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a32ae4b020 msgr2=0x55a32ae489d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.403+0000 7fa30fe00640 1 --2- 172.21.15.12:0/3617284703 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a32ae4b020 0x55a32ae489d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.403+0000 7fa30fe00640 1 -- 172.21.15.12:0/3617284703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a32ab173c0 con 0x55a32ae40760 2024-09-05T01:33:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.403+0000 7fa316800640 1 --2- 172.21.15.12:0/3617284703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a32ae3fe40 0x55a32ae47f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:33:19.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.404+0000 7fa30fe00640 1 --2- 172.21.15.12:0/3617284703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae40760 0x55a32ae48490 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa300012d50 tx=0x7fa30000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf22a365f9b6bc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:19.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.404+0000 7fa2fbe00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:33:19.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.404+0000 7fa2fbe00640 1 -- 172.21.15.12:0/3617284703 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3000120d0 con 0x55a32ae40760 2024-09-05T01:33:19.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.404+0000 7fa2fbe00640 1 -- 172.21.15.12:0/3617284703 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8579+0+0 (secure 0 0 0) 0x7fa300010430 con 0x55a32ae40760 2024-09-05T01:33:19.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.404+0000 7fa31fa2c740 1 -- 172.21.15.12:0/3617284703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa310036040 con 0x55a32ae40760 2024-09-05T01:33:19.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.404+0000 7fa2fbe00640 1 -- 172.21.15.12:0/3617284703 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fa300012270 con 0x55a32ae40760 2024-09-05T01:33:19.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.404+0000 7fa31fa2c740 10 client.16233 fetch_fsmap learned FSMap version 48 2024-09-05T01:33:19.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.404+0000 7fa31fa2c740 1 -- 172.21.15.12:0/3617284703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55a32ae59b60 con 0x55a32ae40760 2024-09-05T01:33:19.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.405+0000 7fa2fbe00640 1 -- 172.21.15.12:0/3617284703 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa310036040 con 0x55a32ae40760 2024-09-05T01:33:19.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.405+0000 7fa2fbe00640 1 -- 172.21.15.12:0/3617284703 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 48) ==== 8426+0+0 (secure 0 0 0) 0x7fa300022030 con 0x55a32ae40760 2024-09-05T01:33:19.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.405+0000 7fa31fa2c740 10 client.16233 fetch_fsmap finished waiting for FSMap version 48 2024-09-05T01:33:19.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.405+0000 7fa31fa2c740 10 client.16233 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-05T01:33:19.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.405+0000 7fa31fa2c740 20 client.16233 populate_metadata read hostname 'smithi012' 2024-09-05T01:33:19.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.405+0000 7fa31fa2c740 1 --2- 172.21.15.12:0/3617284703 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55a32ae5b160 0x55a32ae5d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:19.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.405+0000 7fa31fa2c740 4 client.16233 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:33:19.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.405+0000 7fa31fa2c740 1 -- 172.21.15.12:0/3617284703 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a32adb3950 con 0x55a32ae5b160 2024-09-05T01:33:19.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.405+0000 7fa316800640 1 --2- 172.21.15.12:0/3617284703 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55a32ae5b160 0x55a32ae5d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:19.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.406+0000 7fa316800640 1 --2- 172.21.15.12:0/3617284703 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55a32ae5b160 0x55a32ae5d580 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ebdc1d76d0b82d78 server_cookie=fd962da526cb492 in_seq=0 out_seq=0 2024-09-05T01:33:19.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.406+0000 7fa2fbe00640 10 client.16233 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:33:19.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.407+0000 7fa2fbe00640 1 -- 172.21.15.12:0/3617284703 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a32adb3950 con 0x55a32ae5b160 2024-09-05T01:33:19.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.407+0000 7fa2fbe00640 10 client.16233 handle_command_reply: tid=0 2024-09-05T01:33:19.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.407+0000 7fa31fa2c740 1 client.16233 shutdown 2024-09-05T01:33:19.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.407+0000 7fa31fa2c740 1 -- 172.21.15.12:0/3617284703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae40760 msgr2=0x55a32ae48490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:19.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.407+0000 7fa31fa2c740 1 --2- 172.21.15.12:0/3617284703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae40760 0x55a32ae48490 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa300012d50 tx=0x7fa30000f790 comp rx=0 tx=0).stop 2024-09-05T01:33:19.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.407+0000 7fa31fa2c740 1 -- 172.21.15.12:0/3617284703 shutdown_connections 2024-09-05T01:33:19.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.407+0000 7fa31fa2c740 1 --2- 172.21.15.12:0/3617284703 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55a32ae5b160 0x55a32ae5d580 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.407+0000 7fa31fa2c740 1 --2- 172.21.15.12:0/3617284703 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a32ae4b020 0x55a32ae489d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.407+0000 7fa31fa2c740 1 --2- 172.21.15.12:0/3617284703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae40760 0x55a32ae48490 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.407+0000 7fa31fa2c740 1 --2- 172.21.15.12:0/3617284703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a32ae3fe40 0x55a32ae47f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.407+0000 7fa31fa2c740 1 -- 172.21.15.12:0/3617284703 >> 172.21.15.12:0/3617284703 conn(0x55a32ae3c3d0 msgr2=0x55a32ae42100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:19.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.407+0000 7fa2fbe00640 0 client.16233 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:33:19.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.407+0000 7fa31fa2c740 1 -- 172.21.15.12:0/3617284703 shutdown_connections 2024-09-05T01:33:19.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.407+0000 7fa31fa2c740 1 -- 172.21.15.12:0/3617284703 wait complete. 2024-09-05T01:33:19.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.407+0000 7fa31fa2c740 20 client.16233 trim_cache size 0 max 16384 2024-09-05T01:33:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.421+0000 7fa31fa2c740 1 Processor -- start 2024-09-05T01:33:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.421+0000 7fa31fa2c740 1 -- start start 2024-09-05T01:33:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.421+0000 7fa31fa2c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a32ae3fe40 0x55a32ae62e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.421+0000 7fa31fa2c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a32ae40760 0x55a32ae63370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.422+0000 7fa31fa2c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae4b020 0x55a32ae3ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.422+0000 7fa31fa2c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa3181af920 con 0x55a32ae4b020 2024-09-05T01:33:19.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.422+0000 7fa31fa2c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa3181b1610 con 0x55a32ae3fe40 2024-09-05T01:33:19.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.422+0000 7fa31fa2c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa3181afff0 con 0x55a32ae40760 2024-09-05T01:33:19.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.422+0000 7fa316800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae4b020 0x55a32ae3ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:19.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.422+0000 7fa316800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae4b020 0x55a32ae3ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44084/0 (socket says 172.21.15.12:44084) 2024-09-05T01:33:19.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.422+0000 7fa316800640 1 -- 172.21.15.12:0/1800563191 learned_addr learned my addr 172.21.15.12:0/1800563191 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:19.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.422+0000 7fa30fe00640 1 --2- 172.21.15.12:0/1800563191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a32ae40760 0x55a32ae63370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:19.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.422+0000 7fa316800640 1 --2- 172.21.15.12:0/1800563191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a32ae3fe40 0x55a32ae62e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:19.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.422+0000 7fa316800640 1 -- 172.21.15.12:0/1800563191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a32ae40760 msgr2=0x55a32ae63370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:19.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.422+0000 7fa316800640 1 --2- 172.21.15.12:0/1800563191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a32ae40760 0x55a32ae63370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.422+0000 7fa316800640 1 -- 172.21.15.12:0/1800563191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a32ae3fe40 msgr2=0x55a32ae62e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:19.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.422+0000 7fa316800640 1 --2- 172.21.15.12:0/1800563191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a32ae3fe40 0x55a32ae62e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.422+0000 7fa316800640 1 -- 172.21.15.12:0/1800563191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a32ae3be70 con 0x55a32ae4b020 2024-09-05T01:33:19.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.423+0000 7fa316800640 1 --2- 172.21.15.12:0/1800563191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae4b020 0x55a32ae3ac70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa310004150 tx=0x7fa310033000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545385c99d9c25d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:19.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.423+0000 7fa306a00640 1 -- 172.21.15.12:0/1800563191 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa310003bb0 con 0x55a32ae4b020 2024-09-05T01:33:19.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.423+0000 7fa306a00640 1 -- 172.21.15.12:0/1800563191 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa310036070 con 0x55a32ae4b020 2024-09-05T01:33:19.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.423+0000 7fa306a00640 1 -- 172.21.15.12:0/1800563191 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3100047b0 con 0x55a32ae4b020 2024-09-05T01:33:19.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.423+0000 7fa31fa2c740 1 -- 172.21.15.12:0/1800563191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae4b020 msgr2=0x55a32ae3ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:19.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.423+0000 7fa31fa2c740 1 --2- 172.21.15.12:0/1800563191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae4b020 0x55a32ae3ac70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa310004150 tx=0x7fa310033000 comp rx=0 tx=0).stop 2024-09-05T01:33:19.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.424+0000 7fa31fa2c740 1 -- 172.21.15.12:0/1800563191 shutdown_connections 2024-09-05T01:33:19.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.424+0000 7fa31fa2c740 1 --2- 172.21.15.12:0/1800563191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae4b020 0x55a32ae3ac70 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.424+0000 7fa31fa2c740 1 --2- 172.21.15.12:0/1800563191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a32ae40760 0x55a32ae63370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.424+0000 7fa31fa2c740 1 --2- 172.21.15.12:0/1800563191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a32ae3fe40 0x55a32ae62e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.424+0000 7fa31fa2c740 1 -- 172.21.15.12:0/1800563191 >> 172.21.15.12:0/1800563191 conn(0x55a32ae3c3d0 msgr2=0x55a32ae47040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:19.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.424+0000 7fa31fa2c740 1 -- 172.21.15.12:0/1800563191 shutdown_connections 2024-09-05T01:33:19.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.424+0000 7fa31fa2c740 1 -- 172.21.15.12:0/1800563191 wait complete. 2024-09-05T01:33:19.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.424+0000 7fa31fa2c740 1 -- start start 2024-09-05T01:33:19.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.424+0000 7fa31fa2c740 1 Processor -- start 2024-09-05T01:33:19.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.425+0000 7fa31fa2c740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae3fe40 0x55a32ae53470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:19.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.425+0000 7fa31fa2c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a32ae40760 0x55a32ae4e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:19.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.425+0000 7fa31fa2c740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a32ae4b020 0x55a32ae4ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:19.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.425+0000 7fa31fa2c740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa3181b0e80 con 0x55a32ae3fe40 2024-09-05T01:33:19.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.425+0000 7fa31fa2c740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa3181b06f0 con 0x55a32ae4b020 2024-09-05T01:33:19.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.425+0000 7fa31fa2c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa3181ad920 con 0x55a32ae40760 2024-09-05T01:33:19.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.425+0000 7fa31fa2c740 10 client.0 _ll_register_callbacks cb 0x7fa300009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:33:19.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.425+0000 7fa316800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae3fe40 0x55a32ae53470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:19.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.425+0000 7fa30fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a32ae40760 0x55a32ae4e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:19.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.425+0000 7fa316800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae3fe40 0x55a32ae53470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44098/0 (socket says 172.21.15.12:44098) 2024-09-05T01:33:19.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.425+0000 7fa316800640 1 -- 172.21.15.12:0/1147701633 learned_addr learned my addr 172.21.15.12:0/1147701633 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:19.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.425+0000 7fa316800640 1 --2- 172.21.15.12:0/1147701633 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a32ae4b020 0x55a32ae4ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:19.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.426+0000 7fa30fe00640 1 -- 172.21.15.12:0/1147701633 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a32ae4b020 msgr2=0x55a32ae4ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:19.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.426+0000 7fa30fe00640 1 --2- 172.21.15.12:0/1147701633 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a32ae4b020 0x55a32ae4ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.426+0000 7fa30fe00640 1 -- 172.21.15.12:0/1147701633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae3fe40 msgr2=0x55a32ae53470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:19.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.426+0000 7fa30fe00640 1 --2- 172.21.15.12:0/1147701633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae3fe40 0x55a32ae53470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.426+0000 7fa30fe00640 1 -- 172.21.15.12:0/1147701633 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a32ae4f3d0 con 0x55a32ae40760 2024-09-05T01:33:19.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.426+0000 7fa316800640 1 --2- 172.21.15.12:0/1147701633 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a32ae4b020 0x55a32ae4ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:33:19.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.426+0000 7fa30fe00640 1 --2- 172.21.15.12:0/1147701633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a32ae40760 0x55a32ae4e7a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa30001c890 tx=0x7fa30001df70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a0953ccac9637bf server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:19.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.426+0000 7fa2fbe00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:33:19.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.426+0000 7fa2fbe00640 1 -- 172.21.15.12:0/1147701633 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa300005c50 con 0x55a32ae40760 2024-09-05T01:33:19.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.426+0000 7fa31fa2c740 1 -- 172.21.15.12:0/1147701633 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa310036070 con 0x55a32ae40760 2024-09-05T01:33:19.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.426+0000 7fa2fbe00640 1 -- 172.21.15.12:0/1147701633 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8579+0+0 (secure 0 0 0) 0x7fa300005070 con 0x55a32ae40760 2024-09-05T01:33:19.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.426+0000 7fa2fbe00640 1 -- 172.21.15.12:0/1147701633 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fa300033050 con 0x55a32ae40760 2024-09-05T01:33:19.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.426+0000 7fa31fa2c740 10 client.26284 fetch_fsmap learned FSMap version 48 2024-09-05T01:33:19.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.426+0000 7fa31fa2c740 1 -- 172.21.15.12:0/1147701633 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55a32aec5ce0 con 0x55a32ae40760 2024-09-05T01:33:19.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.427+0000 7fa2fbe00640 1 -- 172.21.15.12:0/1147701633 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa310036070 con 0x55a32ae40760 2024-09-05T01:33:19.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.427+0000 7fa2fbe00640 1 -- 172.21.15.12:0/1147701633 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 48) ==== 8426+0+0 (secure 0 0 0) 0x7fa30002b020 con 0x55a32ae40760 2024-09-05T01:33:19.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.427+0000 7fa31fa2c740 10 client.26284 fetch_fsmap finished waiting for FSMap version 48 2024-09-05T01:33:19.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.427+0000 7fa31fa2c740 10 client.26284 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-05T01:33:19.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.427+0000 7fa31fa2c740 20 client.26284 populate_metadata read hostname 'smithi012' 2024-09-05T01:33:19.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.427+0000 7fa31fa2c740 1 --2- 172.21.15.12:0/1147701633 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55a32aec6450 0x55a32aec8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:19.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.427+0000 7fa31fa2c740 4 client.26284 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:33:19.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.427+0000 7fa31fa2c740 1 -- 172.21.15.12:0/1147701633 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a32adade60 con 0x55a32aec6450 2024-09-05T01:33:19.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.427+0000 7fa316800640 1 --2- 172.21.15.12:0/1147701633 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55a32aec6450 0x55a32aec8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:19.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.428+0000 7fa316800640 1 --2- 172.21.15.12:0/1147701633 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55a32aec6450 0x55a32aec8870 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b86b9b475f934387 server_cookie=1436b7f8d7f5ef5d in_seq=0 out_seq=0 2024-09-05T01:33:19.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.428+0000 7fa2fbe00640 10 client.26284 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:33:19.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.428+0000 7fa2fbe00640 1 -- 172.21.15.12:0/1147701633 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a32adade60 con 0x55a32aec6450 2024-09-05T01:33:19.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.428+0000 7fa2fbe00640 10 client.26284 handle_command_reply: tid=0 2024-09-05T01:33:19.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.428+0000 7fa31fa2c740 1 client.26284 shutdown 2024-09-05T01:33:19.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.428+0000 7fa31fa2c740 1 -- 172.21.15.12:0/1147701633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a32ae40760 msgr2=0x55a32ae4e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:19.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.428+0000 7fa31fa2c740 1 --2- 172.21.15.12:0/1147701633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a32ae40760 0x55a32ae4e7a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa30001c890 tx=0x7fa30001df70 comp rx=0 tx=0).stop 2024-09-05T01:33:19.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.428+0000 7fa31fa2c740 1 -- 172.21.15.12:0/1147701633 shutdown_connections 2024-09-05T01:33:19.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.428+0000 7fa31fa2c740 1 --2- 172.21.15.12:0/1147701633 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55a32aec6450 0x55a32aec8870 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.428+0000 7fa31fa2c740 1 --2- 172.21.15.12:0/1147701633 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55a32ae4b020 0x55a32ae4ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.428+0000 7fa31fa2c740 1 --2- 172.21.15.12:0/1147701633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a32ae40760 0x55a32ae4e7a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.428+0000 7fa31fa2c740 1 --2- 172.21.15.12:0/1147701633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a32ae3fe40 0x55a32ae53470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.428+0000 7fa2fbe00640 0 client.26284 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:33:19.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.428+0000 7fa31fa2c740 1 -- 172.21.15.12:0/1147701633 >> 172.21.15.12:0/1147701633 conn(0x55a32ae3c3d0 msgr2=0x55a32ae497b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:19.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.429+0000 7fa31fa2c740 1 -- 172.21.15.12:0/1147701633 shutdown_connections 2024-09-05T01:33:19.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.429+0000 7fa31fa2c740 1 -- 172.21.15.12:0/1147701633 wait complete. 2024-09-05T01:33:19.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.429+0000 7fa31fa2c740 20 client.26284 trim_cache size 0 max 16384 2024-09-05T01:33:19.434 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:33:19.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.429+0000 7fa317200640 1 -- 172.21.15.12:0/3207980043 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fa2fc0a2d70 msgr2=0x7fa2fc0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:19.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.429+0000 7fa317200640 1 --2- 172.21.15.12:0/3207980043 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fa2fc0a2d70 0x7fa2fc0a5230 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x55a32ae3d230 tx=0x7fa3080d5530 comp rx=0 tx=0).stop 2024-09-05T01:33:19.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.429+0000 7fa317200640 1 -- 172.21.15.12:0/3207980043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa318103e30 msgr2=0x7fa31819a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:19.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.429+0000 7fa317200640 1 --2- 172.21.15.12:0/3207980043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa318103e30 0x7fa31819a3f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa30800e9f0 tx=0x7fa30800eeb0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.429+0000 7fa317200640 1 -- 172.21.15.12:0/3207980043 shutdown_connections 2024-09-05T01:33:19.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.429+0000 7fa317200640 1 --2- 172.21.15.12:0/3207980043 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fa2fc0a2d70 0x7fa2fc0a5230 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.429+0000 7fa317200640 1 --2- 172.21.15.12:0/3207980043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa318108f60 0x7fa31819ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.429+0000 7fa317200640 1 --2- 172.21.15.12:0/3207980043 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa3181047e0 0x7fa31819a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.429+0000 7fa317200640 1 --2- 172.21.15.12:0/3207980043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa318103e30 0x7fa31819a3f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:19.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.429+0000 7fa317200640 1 -- 172.21.15.12:0/3207980043 >> 172.21.15.12:0/3207980043 conn(0x7fa3180ff8d0 msgr2=0x7fa318101ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:19.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.430+0000 7fa317200640 1 -- 172.21.15.12:0/3207980043 shutdown_connections 2024-09-05T01:33:19.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:19.430+0000 7fa317200640 1 -- 172.21.15.12:0/3207980043 wait complete. 2024-09-05T01:33:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:19 smithi012 ceph-mon[29942]: pgmap v267: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 93 KiB/s wr, 19 op/s 2024-09-05T01:33:19.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:19 smithi145 ceph-mon[34376]: pgmap v267: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 93 KiB/s wr, 19 op/s 2024-09-05T01:33:19.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:19 smithi151 ceph-mon[35013]: pgmap v267: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 93 KiB/s wr, 19 op/s 2024-09-05T01:33:20.283 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-05T01:33:20.662 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:33:21.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.372+0000 7f4784000640 1 -- 172.21.15.12:0/3804432645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f477c104010 msgr2=0x7f477c1043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:21.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.372+0000 7f4784000640 1 --2- 172.21.15.12:0/3804432645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f477c104010 0x7f477c1043f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4770009900 tx=0x7f477002a410 comp rx=0 tx=0).stop 2024-09-05T01:33:21.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.372+0000 7f4784000640 1 -- 172.21.15.12:0/3804432645 shutdown_connections 2024-09-05T01:33:21.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.372+0000 7f4784000640 1 --2- 172.21.15.12:0/3804432645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477c109140 0x7f477c110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.372+0000 7f4784000640 1 --2- 172.21.15.12:0/3804432645 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f477c1049c0 0x7f477c108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.372+0000 7f4784000640 1 --2- 172.21.15.12:0/3804432645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f477c104010 0x7f477c1043f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.372+0000 7f4784000640 1 -- 172.21.15.12:0/3804432645 >> 172.21.15.12:0/3804432645 conn(0x7f477c0ffa50 msgr2=0x7f477c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:21.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.372+0000 7f4784000640 1 -- 172.21.15.12:0/3804432645 shutdown_connections 2024-09-05T01:33:21.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.372+0000 7f4784000640 1 -- 172.21.15.12:0/3804432645 wait complete. 2024-09-05T01:33:21.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.373+0000 7f4784000640 1 Processor -- start 2024-09-05T01:33:21.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.373+0000 7f4784000640 1 -- start start 2024-09-05T01:33:21.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.373+0000 7f4784000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477c104010 0x7f477c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:21.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.373+0000 7f4784000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f477c1049c0 0x7f477c19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:21.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.373+0000 7f4784000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f477c109140 0x7f477c19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:21.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.373+0000 7f4784000640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f477c1141b0 con 0x7f477c104010 2024-09-05T01:33:21.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.373+0000 7f4784000640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f477c114030 con 0x7f477c109140 2024-09-05T01:33:21.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.373+0000 7f4784000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f477c114330 con 0x7f477c1049c0 2024-09-05T01:33:21.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.374+0000 7f4781600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477c104010 0x7f477c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:21.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.374+0000 7f4781600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477c104010 0x7f477c19a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44116/0 (socket says 172.21.15.12:44116) 2024-09-05T01:33:21.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.374+0000 7f4781600640 1 -- 172.21.15.12:0/869392252 learned_addr learned my addr 172.21.15.12:0/869392252 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:21.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.374+0000 7f4780c00640 1 --2- 172.21.15.12:0/869392252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f477c1049c0 0x7f477c19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:21.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.374+0000 7f4782000640 1 --2- 172.21.15.12:0/869392252 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f477c109140 0x7f477c19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:21.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.374+0000 7f4780c00640 1 -- 172.21.15.12:0/869392252 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f477c109140 msgr2=0x7f477c19ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:21.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.374+0000 7f4780c00640 1 --2- 172.21.15.12:0/869392252 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f477c109140 0x7f477c19ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.374+0000 7f4780c00640 1 -- 172.21.15.12:0/869392252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477c104010 msgr2=0x7f477c19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:21.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.374+0000 7f4780c00640 1 --2- 172.21.15.12:0/869392252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477c104010 0x7f477c19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.374+0000 7f4780c00640 1 -- 172.21.15.12:0/869392252 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477c19f600 con 0x7f477c1049c0 2024-09-05T01:33:21.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.375+0000 7f4780c00640 1 --2- 172.21.15.12:0/869392252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f477c1049c0 0x7f477c19ab90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f476800e9f0 tx=0x7f476800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:21.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.375+0000 7f477a000640 1 -- 172.21.15.12:0/869392252 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476800ccc0 con 0x7f477c1049c0 2024-09-05T01:33:21.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.375+0000 7f477a000640 1 -- 172.21.15.12:0/869392252 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4768005020 con 0x7f477c1049c0 2024-09-05T01:33:21.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.375+0000 7f477a000640 1 -- 172.21.15.12:0/869392252 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47680049e0 con 0x7f477c1049c0 2024-09-05T01:33:21.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.375+0000 7f4784000640 1 -- 172.21.15.12:0/869392252 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f477c19f8f0 con 0x7f477c1049c0 2024-09-05T01:33:21.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.375+0000 7f4784000640 1 -- 172.21.15.12:0/869392252 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f477c1a71d0 con 0x7f477c1049c0 2024-09-05T01:33:21.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.379+0000 7f4786bd5740 1 Processor -- start 2024-09-05T01:33:21.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.379+0000 7f4786bd5740 1 -- start start 2024-09-05T01:33:21.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.380+0000 7f4786bd5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b20af54c70 0x55b20af55050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:21.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.380+0000 7f4786bd5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af55590 0x55b20af5f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:21.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.380+0000 7f4786bd5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b20af5fe50 0x55b20af62240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:21.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.380+0000 7f4786bd5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b20aebb3e0 con 0x55b20af55590 2024-09-05T01:33:21.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.380+0000 7f4786bd5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55b20ae62d80 con 0x55b20af5fe50 2024-09-05T01:33:21.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.380+0000 7f4786bd5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b20aeb73a0 con 0x55b20af54c70 2024-09-05T01:33:21.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.380+0000 7f4781600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af55590 0x55b20af5f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:21.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.380+0000 7f4782000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b20af54c70 0x55b20af55050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:21.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.380+0000 7f4781600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af55590 0x55b20af5f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44128/0 (socket says 172.21.15.12:44128) 2024-09-05T01:33:21.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.380+0000 7f4781600640 1 -- 172.21.15.12:0/1498358604 learned_addr learned my addr 172.21.15.12:0/1498358604 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:21.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.381+0000 7f477a000640 1 -- 172.21.15.12:0/869392252 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f4768005560 con 0x7f477c1049c0 2024-09-05T01:33:21.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.381+0000 7f4782000640 1 -- 172.21.15.12:0/1498358604 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b20af5fe50 msgr2=0x55b20af62240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:33:21.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.381+0000 7f4782000640 1 --2- 172.21.15.12:0/1498358604 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b20af5fe50 0x55b20af62240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.381+0000 7f4782000640 1 -- 172.21.15.12:0/1498358604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af55590 msgr2=0x55b20af5f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:21.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.381+0000 7f4782000640 1 --2- 172.21.15.12:0/1498358604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af55590 0x55b20af5f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.381+0000 7f4782000640 1 -- 172.21.15.12:0/1498358604 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b20ae81ae0 con 0x55b20af54c70 2024-09-05T01:33:21.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.381+0000 7f4781600640 1 --2- 172.21.15.12:0/1498358604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af55590 0x55b20af5f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:33:21.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.381+0000 7f4782000640 1 --2- 172.21.15.12:0/1498358604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b20af54c70 0x55b20af55050 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4774009f00 tx=0x7f4774011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2ed2bc3d5f75b81 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:21.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.381+0000 7f476e600640 1 -- 172.21.15.12:0/1498358604 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774004d20 con 0x55b20af54c70 2024-09-05T01:33:21.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.381+0000 7f476e600640 1 -- 172.21.15.12:0/1498358604 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4774004050 con 0x55b20af54c70 2024-09-05T01:33:21.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.381+0000 7f476e600640 1 -- 172.21.15.12:0/1498358604 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774005280 con 0x55b20af54c70 2024-09-05T01:33:21.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.382+0000 7f4786bd5740 1 -- 172.21.15.12:0/1498358604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b20af54c70 msgr2=0x55b20af55050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:21.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.382+0000 7f4786bd5740 1 --2- 172.21.15.12:0/1498358604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b20af54c70 0x55b20af55050 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4774009f00 tx=0x7f4774011810 comp rx=0 tx=0).stop 2024-09-05T01:33:21.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.382+0000 7f4786bd5740 1 -- 172.21.15.12:0/1498358604 shutdown_connections 2024-09-05T01:33:21.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.382+0000 7f4786bd5740 1 --2- 172.21.15.12:0/1498358604 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b20af5fe50 0x55b20af62240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.382+0000 7f4786bd5740 1 --2- 172.21.15.12:0/1498358604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af55590 0x55b20af5f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.382+0000 7f4786bd5740 1 --2- 172.21.15.12:0/1498358604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b20af54c70 0x55b20af55050 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.382+0000 7f4786bd5740 1 -- 172.21.15.12:0/1498358604 >> 172.21.15.12:0/1498358604 conn(0x55b20af51200 msgr2=0x55b20af515e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:21.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.382+0000 7f4786bd5740 1 -- 172.21.15.12:0/1498358604 shutdown_connections 2024-09-05T01:33:21.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.382+0000 7f4786bd5740 1 -- 172.21.15.12:0/1498358604 wait complete. 2024-09-05T01:33:21.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.383+0000 7f477a000640 1 --2- 172.21.15.12:0/869392252 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f47640a2ca0 0x7f47640a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:21.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.383+0000 7f4786bd5740 1 -- start start 2024-09-05T01:33:21.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.383+0000 7f477a000640 1 -- 172.21.15.12:0/869392252 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8579+0+0 (secure 0 0 0) 0x7f47680cf400 con 0x7f477c1049c0 2024-09-05T01:33:21.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.383+0000 7f4786bd5740 1 Processor -- start 2024-09-05T01:33:21.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.383+0000 7f4782000640 1 --2- 172.21.15.12:0/869392252 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f47640a2ca0 0x7f47640a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:21.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.384+0000 7f4786bd5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af54c70 0x55b20af5cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:21.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.384+0000 7f4786bd5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b20af55590 0x55b20af5d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:21.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.384+0000 7f4786bd5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b20af5fe50 0x55b20af5d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:21.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.384+0000 7f4786bd5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b20af62a20 con 0x55b20af54c70 2024-09-05T01:33:21.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.384+0000 7f4786bd5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55b20ae760f0 con 0x55b20af5fe50 2024-09-05T01:33:21.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.384+0000 7f4786bd5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b20af62ba0 con 0x55b20af55590 2024-09-05T01:33:21.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.384+0000 7f4786bd5740 10 client.0 _ll_register_callbacks cb 0x55b20ae5dbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:33:21.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.384+0000 7f4782000640 1 --2- 172.21.15.12:0/869392252 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f47640a2ca0 0x7f47640a5160 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4774006010 tx=0x7f4774009c00 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:21.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.384+0000 7f4780c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b20af55590 0x55b20af5d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:21.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.384+0000 7f4780c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b20af55590 0x55b20af5d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:48462/0 (socket says 172.21.15.12:48462) 2024-09-05T01:33:21.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.384+0000 7f4780c00640 1 -- 172.21.15.12:0/344984000 learned_addr learned my addr 172.21.15.12:0/344984000 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:21.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.384+0000 7f4781600640 1 --2- 172.21.15.12:0/344984000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af54c70 0x55b20af5cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:21.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.385+0000 7f4782000640 1 --2- 172.21.15.12:0/344984000 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b20af5fe50 0x55b20af5d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:21.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.385+0000 7f4780c00640 1 -- 172.21.15.12:0/344984000 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b20af5fe50 msgr2=0x55b20af5d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:21.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.385+0000 7f4780c00640 1 --2- 172.21.15.12:0/344984000 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b20af5fe50 0x55b20af5d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.385+0000 7f4780c00640 1 -- 172.21.15.12:0/344984000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af54c70 msgr2=0x55b20af5cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:21.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.385+0000 7f4780c00640 1 --2- 172.21.15.12:0/344984000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af54c70 0x55b20af5cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.385+0000 7f4780c00640 1 -- 172.21.15.12:0/344984000 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b20ac2c3c0 con 0x55b20af55590 2024-09-05T01:33:21.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.385+0000 7f4781600640 1 --2- 172.21.15.12:0/344984000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af54c70 0x55b20af5cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:33:21.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.385+0000 7f4780c00640 1 --2- 172.21.15.12:0/344984000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b20af55590 0x55b20af5d290 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f476809b810 tx=0x7f4768005290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f3e97fd8fe051b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:21.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.385+0000 7f4762a00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:33:21.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.385+0000 7f4762a00640 1 -- 172.21.15.12:0/344984000 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476801c070 con 0x55b20af55590 2024-09-05T01:33:21.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.385+0000 7f4762a00640 1 -- 172.21.15.12:0/344984000 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8579+0+0 (secure 0 0 0) 0x7f4768004de0 con 0x55b20af55590 2024-09-05T01:33:21.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.385+0000 7f4786bd5740 1 -- 172.21.15.12:0/344984000 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4774004050 con 0x55b20af55590 2024-09-05T01:33:21.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.385+0000 7f4762a00640 1 -- 172.21.15.12:0/344984000 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f47680ccf40 con 0x55b20af55590 2024-09-05T01:33:21.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.386+0000 7f4786bd5740 10 client.26296 fetch_fsmap learned FSMap version 48 2024-09-05T01:33:21.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.386+0000 7f4786bd5740 1 -- 172.21.15.12:0/344984000 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55b20af6eac0 con 0x55b20af55590 2024-09-05T01:33:21.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.386+0000 7f4762a00640 1 -- 172.21.15.12:0/344984000 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4774004050 con 0x55b20af55590 2024-09-05T01:33:21.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.386+0000 7f4762a00640 1 -- 172.21.15.12:0/344984000 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 48) ==== 8426+0+0 (secure 0 0 0) 0x7f47680a4060 con 0x55b20af55590 2024-09-05T01:33:21.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.386+0000 7f4786bd5740 10 client.26296 fetch_fsmap finished waiting for FSMap version 48 2024-09-05T01:33:21.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.386+0000 7f4786bd5740 10 client.26296 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-05T01:33:21.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.386+0000 7f4786bd5740 20 client.26296 populate_metadata read hostname 'smithi012' 2024-09-05T01:33:21.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.386+0000 7f4786bd5740 1 --2- 172.21.15.12:0/344984000 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55b20af70020 0x55b20af72430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:21.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.386+0000 7f4786bd5740 4 client.26296 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:33:21.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.386+0000 7f4786bd5740 1 -- 172.21.15.12:0/344984000 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b20aec8950 con 0x55b20af70020 2024-09-05T01:33:21.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.386+0000 7f4781600640 1 --2- 172.21.15.12:0/344984000 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55b20af70020 0x55b20af72430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:21.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.387+0000 7f4781600640 1 --2- 172.21.15.12:0/344984000 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55b20af70020 0x55b20af72430 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bde40ae895833253 server_cookie=4c62973807e2b323 in_seq=0 out_seq=0 2024-09-05T01:33:21.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.387+0000 7f4762a00640 10 client.26296 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:33:21.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.388+0000 7f4762a00640 1 -- 172.21.15.12:0/344984000 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b20aec8950 con 0x55b20af70020 2024-09-05T01:33:21.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.388+0000 7f4762a00640 10 client.26296 handle_command_reply: tid=0 2024-09-05T01:33:21.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.388+0000 7f4786bd5740 1 client.26296 shutdown 2024-09-05T01:33:21.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.388+0000 7f4786bd5740 1 -- 172.21.15.12:0/344984000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b20af55590 msgr2=0x55b20af5d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:21.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.388+0000 7f4786bd5740 1 --2- 172.21.15.12:0/344984000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b20af55590 0x55b20af5d290 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f476809b810 tx=0x7f4768005290 comp rx=0 tx=0).stop 2024-09-05T01:33:21.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.388+0000 7f4786bd5740 1 -- 172.21.15.12:0/344984000 shutdown_connections 2024-09-05T01:33:21.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.388+0000 7f4786bd5740 1 --2- 172.21.15.12:0/344984000 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55b20af70020 0x55b20af72430 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.388+0000 7f4786bd5740 1 --2- 172.21.15.12:0/344984000 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b20af5fe50 0x55b20af5d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.388+0000 7f4786bd5740 1 --2- 172.21.15.12:0/344984000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b20af55590 0x55b20af5d290 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.388+0000 7f4786bd5740 1 --2- 172.21.15.12:0/344984000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af54c70 0x55b20af5cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.388+0000 7f4762a00640 0 client.26296 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:33:21.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.388+0000 7f4786bd5740 1 -- 172.21.15.12:0/344984000 >> 172.21.15.12:0/344984000 conn(0x55b20af51200 msgr2=0x55b20af56f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:21.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.388+0000 7f4786bd5740 1 -- 172.21.15.12:0/344984000 shutdown_connections 2024-09-05T01:33:21.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.388+0000 7f4786bd5740 1 -- 172.21.15.12:0/344984000 wait complete. 2024-09-05T01:33:21.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.389+0000 7f4786bd5740 20 client.26296 trim_cache size 0 max 16384 2024-09-05T01:33:21.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.402+0000 7f4786bd5740 1 Processor -- start 2024-09-05T01:33:21.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.402+0000 7f4786bd5740 1 -- start start 2024-09-05T01:33:21.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.403+0000 7f4786bd5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af54c70 0x55b20af56dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:21.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.403+0000 7f4786bd5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b20af55590 0x55b20af77d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:21.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.403+0000 7f4786bd5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b20af5fe50 0x55b20af78280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:21.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.403+0000 7f4786bd5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f477c1afb30 con 0x55b20af54c70 2024-09-05T01:33:21.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.403+0000 7f4786bd5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f477c1b1820 con 0x55b20af55590 2024-09-05T01:33:21.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.403+0000 7f4786bd5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f477c1b0200 con 0x55b20af5fe50 2024-09-05T01:33:21.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.403+0000 7f4781600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af54c70 0x55b20af56dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:21.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.403+0000 7f4781600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af54c70 0x55b20af56dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44146/0 (socket says 172.21.15.12:44146) 2024-09-05T01:33:21.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.403+0000 7f4781600640 1 -- 172.21.15.12:0/3638062222 learned_addr learned my addr 172.21.15.12:0/3638062222 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:21.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.403+0000 7f4780c00640 1 --2- 172.21.15.12:0/3638062222 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b20af55590 0x55b20af77d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:21.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.403+0000 7f4782000640 1 --2- 172.21.15.12:0/3638062222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b20af5fe50 0x55b20af78280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:21.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.404+0000 7f4781600640 1 -- 172.21.15.12:0/3638062222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b20af5fe50 msgr2=0x55b20af78280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:21.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.404+0000 7f4781600640 1 --2- 172.21.15.12:0/3638062222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b20af5fe50 0x55b20af78280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.404+0000 7f4781600640 1 -- 172.21.15.12:0/3638062222 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b20af55590 msgr2=0x55b20af77d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:21.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.404+0000 7f4781600640 1 --2- 172.21.15.12:0/3638062222 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b20af55590 0x55b20af77d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.404+0000 7f4781600640 1 -- 172.21.15.12:0/3638062222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b20af51030 con 0x55b20af54c70 2024-09-05T01:33:21.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.404+0000 7f4781600640 1 --2- 172.21.15.12:0/3638062222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af54c70 0x55b20af56dd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f477002aa00 tx=0x7f47700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118f2c4bd70e05a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:21.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.404+0000 7f476dc00640 1 -- 172.21.15.12:0/3638062222 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4770035040 con 0x55b20af54c70 2024-09-05T01:33:21.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.404+0000 7f476dc00640 1 -- 172.21.15.12:0/3638062222 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4770004730 con 0x55b20af54c70 2024-09-05T01:33:21.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.404+0000 7f476dc00640 1 -- 172.21.15.12:0/3638062222 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47700318a0 con 0x55b20af54c70 2024-09-05T01:33:21.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.405+0000 7f4786bd5740 1 -- 172.21.15.12:0/3638062222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af54c70 msgr2=0x55b20af56dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:21.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.405+0000 7f4786bd5740 1 --2- 172.21.15.12:0/3638062222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af54c70 0x55b20af56dd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f477002aa00 tx=0x7f47700046c0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.405+0000 7f4786bd5740 1 -- 172.21.15.12:0/3638062222 shutdown_connections 2024-09-05T01:33:21.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.405+0000 7f4786bd5740 1 --2- 172.21.15.12:0/3638062222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b20af5fe50 0x55b20af78280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.405+0000 7f4786bd5740 1 --2- 172.21.15.12:0/3638062222 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b20af55590 0x55b20af77d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.405+0000 7f4786bd5740 1 --2- 172.21.15.12:0/3638062222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af54c70 0x55b20af56dd0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.405+0000 7f4786bd5740 1 -- 172.21.15.12:0/3638062222 >> 172.21.15.12:0/3638062222 conn(0x55b20af51200 msgr2=0x55b20af566c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:21.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.405+0000 7f4786bd5740 1 -- 172.21.15.12:0/3638062222 shutdown_connections 2024-09-05T01:33:21.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.405+0000 7f4786bd5740 1 -- 172.21.15.12:0/3638062222 wait complete. 2024-09-05T01:33:21.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.405+0000 7f4786bd5740 1 -- start start 2024-09-05T01:33:21.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.406+0000 7f4786bd5740 1 Processor -- start 2024-09-05T01:33:21.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.406+0000 7f4786bd5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b20af54c70 0x55b20af59d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:21.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.406+0000 7f4786bd5740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b20af55590 0x55b20af5a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:21.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.406+0000 7f4786bd5740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af5fe50 0x55b20af5a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:21.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.406+0000 7f4786bd5740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f477c1b1090 con 0x55b20af5fe50 2024-09-05T01:33:21.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.406+0000 7f4786bd5740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f477c1b0900 con 0x55b20af55590 2024-09-05T01:33:21.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.406+0000 7f4786bd5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f477c1adb30 con 0x55b20af54c70 2024-09-05T01:33:21.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.406+0000 7f4786bd5740 10 client.0 _ll_register_callbacks cb 0x7f47680046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:33:21.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.406+0000 7f4782000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af5fe50 0x55b20af5a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:21.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.406+0000 7f4781600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b20af54c70 0x55b20af59d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:21.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.406+0000 7f4782000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af5fe50 0x55b20af5a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44148/0 (socket says 172.21.15.12:44148) 2024-09-05T01:33:21.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.406+0000 7f4782000640 1 -- 172.21.15.12:0/3954406444 learned_addr learned my addr 172.21.15.12:0/3954406444 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:21.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.406+0000 7f4780c00640 1 --2- 172.21.15.12:0/3954406444 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b20af55590 0x55b20af5a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:21.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.407+0000 7f4780c00640 1 -- 172.21.15.12:0/3954406444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b20af54c70 msgr2=0x55b20af59d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:21.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.407+0000 7f4780c00640 1 --2- 172.21.15.12:0/3954406444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b20af54c70 0x55b20af59d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.407+0000 7f4780c00640 1 -- 172.21.15.12:0/3954406444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af5fe50 msgr2=0x55b20af5a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:21.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.407+0000 7f4780c00640 1 --2- 172.21.15.12:0/3954406444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af5fe50 0x55b20af5a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.407+0000 7f4780c00640 1 -- 172.21.15.12:0/3954406444 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b20afd9d10 con 0x55b20af55590 2024-09-05T01:33:21.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.407+0000 7f4781600640 1 --2- 172.21.15.12:0/3954406444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b20af54c70 0x55b20af59d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:33:21.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.407+0000 7f4780c00640 1 --2- 172.21.15.12:0/3954406444 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b20af55590 0x55b20af5a270 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f476800c6a0 tx=0x7f47680096e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bf1067a89fe45e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:21.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.407+0000 7f4762a00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:33:21.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.407+0000 7f4762a00640 1 -- 172.21.15.12:0/3954406444 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476801c040 con 0x55b20af55590 2024-09-05T01:33:21.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.407+0000 7f4786bd5740 1 -- 172.21.15.12:0/3954406444 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4770004730 con 0x55b20af55590 2024-09-05T01:33:21.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.408+0000 7f4762a00640 1 -- 172.21.15.12:0/3954406444 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8579+0+0 (secure 0 0 0) 0x7f476809acd0 con 0x55b20af55590 2024-09-05T01:33:21.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.408+0000 7f4762a00640 1 -- 172.21.15.12:0/3954406444 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f476809b1e0 con 0x55b20af55590 2024-09-05T01:33:21.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.408+0000 7f4786bd5740 10 client.26306 fetch_fsmap learned FSMap version 48 2024-09-05T01:33:21.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.408+0000 7f4786bd5740 1 -- 172.21.15.12:0/3954406444 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55b20afdafd0 con 0x55b20af55590 2024-09-05T01:33:21.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.408+0000 7f4762a00640 1 -- 172.21.15.12:0/3954406444 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4770004730 con 0x55b20af55590 2024-09-05T01:33:21.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.408+0000 7f4762a00640 1 -- 172.21.15.12:0/3954406444 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 48) ==== 8426+0+0 (secure 0 0 0) 0x7f47680971d0 con 0x55b20af55590 2024-09-05T01:33:21.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.408+0000 7f4786bd5740 10 client.26306 fetch_fsmap finished waiting for FSMap version 48 2024-09-05T01:33:21.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.408+0000 7f4786bd5740 10 client.26306 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-05T01:33:21.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.408+0000 7f4786bd5740 20 client.26306 populate_metadata read hostname 'smithi012' 2024-09-05T01:33:21.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.408+0000 7f4786bd5740 1 --2- 172.21.15.12:0/3954406444 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55b20afdb800 0x55b20afddc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:21.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.408+0000 7f4786bd5740 4 client.26306 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:33:21.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.408+0000 7f4786bd5740 1 -- 172.21.15.12:0/3954406444 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b20aec2e60 con 0x55b20afdb800 2024-09-05T01:33:21.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.409+0000 7f4781600640 1 --2- 172.21.15.12:0/3954406444 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55b20afdb800 0x55b20afddc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:21.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.409+0000 7f4781600640 1 --2- 172.21.15.12:0/3954406444 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55b20afdb800 0x55b20afddc20 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4f37032b8c8784ed server_cookie=515ab5ad6f31a6b3 in_seq=0 out_seq=0 2024-09-05T01:33:21.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.409+0000 7f4762a00640 10 client.26306 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:33:21.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.410+0000 7f4762a00640 1 -- 172.21.15.12:0/3954406444 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b20aec2e60 con 0x55b20afdb800 2024-09-05T01:33:21.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.410+0000 7f4762a00640 10 client.26306 handle_command_reply: tid=0 2024-09-05T01:33:21.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.410+0000 7f4786bd5740 1 client.26306 shutdown 2024-09-05T01:33:21.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.410+0000 7f4786bd5740 1 -- 172.21.15.12:0/3954406444 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b20af55590 msgr2=0x55b20af5a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:21.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.410+0000 7f4786bd5740 1 --2- 172.21.15.12:0/3954406444 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b20af55590 0x55b20af5a270 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f476800c6a0 tx=0x7f47680096e0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.410+0000 7f4786bd5740 1 -- 172.21.15.12:0/3954406444 shutdown_connections 2024-09-05T01:33:21.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.410+0000 7f4786bd5740 1 --2- 172.21.15.12:0/3954406444 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55b20afdb800 0x55b20afddc20 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.410+0000 7f4786bd5740 1 --2- 172.21.15.12:0/3954406444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b20af5fe50 0x55b20af5a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.410+0000 7f4786bd5740 1 --2- 172.21.15.12:0/3954406444 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55b20af55590 0x55b20af5a270 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.410+0000 7f4786bd5740 1 --2- 172.21.15.12:0/3954406444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b20af54c70 0x55b20af59d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.410+0000 7f4786bd5740 1 -- 172.21.15.12:0/3954406444 >> 172.21.15.12:0/3954406444 conn(0x55b20af51200 msgr2=0x55b20af5d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:21.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.410+0000 7f4762a00640 0 client.26306 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:33:21.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.410+0000 7f4786bd5740 1 -- 172.21.15.12:0/3954406444 shutdown_connections 2024-09-05T01:33:21.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.410+0000 7f4786bd5740 1 -- 172.21.15.12:0/3954406444 wait complete. 2024-09-05T01:33:21.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.410+0000 7f4786bd5740 20 client.26306 trim_cache size 0 max 16384 2024-09-05T01:33:21.416 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:33:21.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.411+0000 7f4784000640 1 -- 172.21.15.12:0/869392252 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f47640a2ca0 msgr2=0x7f47640a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:21.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.411+0000 7f4784000640 1 --2- 172.21.15.12:0/869392252 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f47640a2ca0 0x7f47640a5160 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4774006010 tx=0x7f4774009c00 comp rx=0 tx=0).stop 2024-09-05T01:33:21.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.411+0000 7f4784000640 1 -- 172.21.15.12:0/869392252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f477c1049c0 msgr2=0x7f477c19ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:21.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.411+0000 7f4784000640 1 --2- 172.21.15.12:0/869392252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f477c1049c0 0x7f477c19ab90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f476800e9f0 tx=0x7f476800eeb0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.411+0000 7f4784000640 1 -- 172.21.15.12:0/869392252 shutdown_connections 2024-09-05T01:33:21.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.411+0000 7f4784000640 1 --2- 172.21.15.12:0/869392252 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f47640a2ca0 0x7f47640a5160 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.411+0000 7f4784000640 1 --2- 172.21.15.12:0/869392252 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f477c109140 0x7f477c19ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.411+0000 7f4784000640 1 --2- 172.21.15.12:0/869392252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f477c1049c0 0x7f477c19ab90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.411+0000 7f4784000640 1 --2- 172.21.15.12:0/869392252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f477c104010 0x7f477c19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:21.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.411+0000 7f4784000640 1 -- 172.21.15.12:0/869392252 >> 172.21.15.12:0/869392252 conn(0x7f477c0ffa50 msgr2=0x7f477c100d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:21.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.411+0000 7f4784000640 1 -- 172.21.15.12:0/869392252 shutdown_connections 2024-09-05T01:33:21.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:21.411+0000 7f4784000640 1 -- 172.21.15.12:0/869392252 wait complete. 2024-09-05T01:33:21.712 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:21 smithi012 ceph-mon[29942]: pgmap v268: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 100 KiB/s wr, 22 op/s 2024-09-05T01:33:21.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:21 smithi145 ceph-mon[34376]: pgmap v268: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 100 KiB/s wr, 22 op/s 2024-09-05T01:33:21.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:21 smithi151 ceph-mon[35013]: pgmap v268: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 100 KiB/s wr, 22 op/s 2024-09-05T01:33:21.908 INFO:tasks.workunit.client.0.smithi012.stdout: 2024-09-05T01:33:21.908 INFO:tasks.workunit.client.0.smithi012.stdout:Final score for writes: 706 2024-09-05T01:33:21.908 INFO:tasks.workunit.client.0.smithi012.stdout:Final score for reads : 308882 2024-09-05T01:33:21.908 INFO:tasks.workunit.client.0.smithi012.stdout: 2024-09-05T01:33:21.912 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-05T01:33:21.912 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-05T01:33:22.424 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-05T01:33:22.810 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:33:23.451 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:33:23.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.355+0000 7fc095c00640 1 -- 172.21.15.12:0/66075278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc090103ff0 msgr2=0x7fc0901043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:23.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.355+0000 7fc095c00640 1 --2- 172.21.15.12:0/66075278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc090103ff0 0x7fc0901043d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc080009860 tx=0x7fc08002a340 comp rx=0 tx=0).stop 2024-09-05T01:33:23.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.355+0000 7fc095c00640 1 -- 172.21.15.12:0/66075278 shutdown_connections 2024-09-05T01:33:23.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.355+0000 7fc095c00640 1 --2- 172.21.15.12:0/66075278 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc090109120 0x7fc090110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.355+0000 7fc095c00640 1 --2- 172.21.15.12:0/66075278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0901049a0 0x7fc0901089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.355+0000 7fc095c00640 1 --2- 172.21.15.12:0/66075278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc090103ff0 0x7fc0901043d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.355+0000 7fc095c00640 1 -- 172.21.15.12:0/66075278 >> 172.21.15.12:0/66075278 conn(0x7fc0900ffa90 msgr2=0x7fc090101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:23.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.356+0000 7fc095c00640 1 -- 172.21.15.12:0/66075278 shutdown_connections 2024-09-05T01:33:23.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.356+0000 7fc095c00640 1 -- 172.21.15.12:0/66075278 wait complete. 2024-09-05T01:33:23.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.356+0000 7fc095c00640 1 Processor -- start 2024-09-05T01:33:23.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.357+0000 7fc095c00640 1 -- start start 2024-09-05T01:33:23.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.357+0000 7fc095c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc090103ff0 0x7fc09019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:23.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.357+0000 7fc095c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc0901049a0 0x7fc09019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:23.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.357+0000 7fc095c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc090109120 0x7fc09019eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:23.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.357+0000 7fc095c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc090114120 con 0x7fc090103ff0 2024-09-05T01:33:23.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.357+0000 7fc095c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc090113fa0 con 0x7fc0901049a0 2024-09-05T01:33:23.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.357+0000 7fc095c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc0901142a0 con 0x7fc090109120 2024-09-05T01:33:23.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.357+0000 7fc08ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc090103ff0 0x7fc09019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:23.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.357+0000 7fc08f400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc090109120 0x7fc09019eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:23.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.357+0000 7fc08f400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc090109120 0x7fc09019eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:48512/0 (socket says 172.21.15.12:48512) 2024-09-05T01:33:23.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.357+0000 7fc08f400640 1 -- 172.21.15.12:0/4127181171 learned_addr learned my addr 172.21.15.12:0/4127181171 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:23.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.358+0000 7fc087e00640 1 --2- 172.21.15.12:0/4127181171 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc0901049a0 0x7fc09019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:23.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.358+0000 7fc08ea00640 1 -- 172.21.15.12:0/4127181171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc090109120 msgr2=0x7fc09019eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:23.453 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.358+0000 7fc08ea00640 1 --2- 172.21.15.12:0/4127181171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc090109120 0x7fc09019eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.358+0000 7fc08ea00640 1 -- 172.21.15.12:0/4127181171 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc0901049a0 msgr2=0x7fc09019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.358+0000 7fc08ea00640 1 --2- 172.21.15.12:0/4127181171 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc0901049a0 0x7fc09019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.358+0000 7fc08ea00640 1 -- 172.21.15.12:0/4127181171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc09019f5d0 con 0x7fc090103ff0 2024-09-05T01:33:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.358+0000 7fc08f400640 1 --2- 172.21.15.12:0/4127181171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc090109120 0x7fc09019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:33:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.358+0000 7fc08ea00640 1 --2- 172.21.15.12:0/4127181171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc090103ff0 0x7fc09019a620 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc080035040 tx=0x7fc080033d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.359+0000 7fc087400640 1 -- 172.21.15.12:0/4127181171 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08003f020 con 0x7fc090103ff0 2024-09-05T01:33:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.359+0000 7fc087400640 1 -- 172.21.15.12:0/4127181171 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc080004240 con 0x7fc090103ff0 2024-09-05T01:33:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.359+0000 7fc087400640 1 -- 172.21.15.12:0/4127181171 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc080037040 con 0x7fc090103ff0 2024-09-05T01:33:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.359+0000 7fc095c00640 1 -- 172.21.15.12:0/4127181171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc09019f860 con 0x7fc090103ff0 2024-09-05T01:33:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.359+0000 7fc095c00640 1 -- 172.21.15.12:0/4127181171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc09019fcf0 con 0x7fc090103ff0 2024-09-05T01:33:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.362+0000 7fc087400640 1 -- 172.21.15.12:0/4127181171 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fc080042020 con 0x7fc090103ff0 2024-09-05T01:33:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.362+0000 7fc09885e740 1 Processor -- start 2024-09-05T01:33:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.362+0000 7fc09885e740 1 -- start start 2024-09-05T01:33:23.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.363+0000 7fc09885e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f7e0dc70 0x5584f7e0e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:23.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.363+0000 7fc09885e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e0e590 0x5584f7e18910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:23.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.363+0000 7fc09885e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e18e50 0x5584f7e1b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:23.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.363+0000 7fc09885e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5584f7d743e0 con 0x5584f7e0dc70 2024-09-05T01:33:23.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.363+0000 7fc09885e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5584f7d1bd80 con 0x5584f7e0e590 2024-09-05T01:33:23.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.363+0000 7fc09885e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5584f7d703a0 con 0x5584f7e18e50 2024-09-05T01:33:23.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.363+0000 7fc087e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e18e50 0x5584f7e1b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:23.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.363+0000 7fc08f400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f7e0dc70 0x5584f7e0e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:23.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.363+0000 7fc087e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e18e50 0x5584f7e1b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:48522/0 (socket says 172.21.15.12:48522) 2024-09-05T01:33:23.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.363+0000 7fc087e00640 1 -- 172.21.15.12:0/3231267446 learned_addr learned my addr 172.21.15.12:0/3231267446 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:23.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.363+0000 7fc08ea00640 1 --2- 172.21.15.12:0/3231267446 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e0e590 0x5584f7e18910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:23.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.364+0000 7fc087e00640 1 -- 172.21.15.12:0/3231267446 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e0e590 msgr2=0x5584f7e18910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:23.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.364+0000 7fc087e00640 1 --2- 172.21.15.12:0/3231267446 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e0e590 0x5584f7e18910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.364+0000 7fc087e00640 1 -- 172.21.15.12:0/3231267446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f7e0dc70 msgr2=0x5584f7e0e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:23.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.364+0000 7fc087e00640 1 --2- 172.21.15.12:0/3231267446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f7e0dc70 0x5584f7e0e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.364+0000 7fc087e00640 1 -- 172.21.15.12:0/3231267446 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584f7d3aae0 con 0x5584f7e18e50 2024-09-05T01:33:23.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.364+0000 7fc08ea00640 1 --2- 172.21.15.12:0/3231267446 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e0e590 0x5584f7e18910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:33:23.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.364+0000 7fc087400640 1 --2- 172.21.15.12:0/4127181171 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc0740a2d70 0x7fc0740a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:23.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.364+0000 7fc087e00640 1 --2- 172.21.15.12:0/3231267446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e18e50 0x5584f7e1b240 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc078009ca0 tx=0x7fc078011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=950b8687fb312ea server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:23.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.364+0000 7fc087400640 1 -- 172.21.15.12:0/4127181171 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8579+0+0 (secure 0 0 0) 0x7fc0800ef4f0 con 0x7fc090103ff0 2024-09-05T01:33:23.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.364+0000 7fc08f400640 1 --2- 172.21.15.12:0/4127181171 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc0740a2d70 0x7fc0740a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:23.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.365+0000 7fc08f400640 1 --2- 172.21.15.12:0/4127181171 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc0740a2d70 0x7fc0740a5230 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc088005c40 tx=0x7fc088009760 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:23.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.365+0000 7fc07fe00640 1 -- 172.21.15.12:0/3231267446 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc078004230 con 0x5584f7e18e50 2024-09-05T01:33:23.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.365+0000 7fc07fe00640 1 -- 172.21.15.12:0/3231267446 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0780043d0 con 0x5584f7e18e50 2024-09-05T01:33:23.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.365+0000 7fc07fe00640 1 -- 172.21.15.12:0/3231267446 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0780197e0 con 0x5584f7e18e50 2024-09-05T01:33:23.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.366+0000 7fc09885e740 1 -- 172.21.15.12:0/3231267446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e18e50 msgr2=0x5584f7e1b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:23.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.366+0000 7fc09885e740 1 --2- 172.21.15.12:0/3231267446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e18e50 0x5584f7e1b240 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc078009ca0 tx=0x7fc078011810 comp rx=0 tx=0).stop 2024-09-05T01:33:23.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.366+0000 7fc09885e740 1 -- 172.21.15.12:0/3231267446 shutdown_connections 2024-09-05T01:33:23.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.366+0000 7fc09885e740 1 --2- 172.21.15.12:0/3231267446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e18e50 0x5584f7e1b240 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.366+0000 7fc09885e740 1 --2- 172.21.15.12:0/3231267446 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e0e590 0x5584f7e18910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.366+0000 7fc09885e740 1 --2- 172.21.15.12:0/3231267446 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f7e0dc70 0x5584f7e0e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.366+0000 7fc09885e740 1 -- 172.21.15.12:0/3231267446 >> 172.21.15.12:0/3231267446 conn(0x5584f7e0a200 msgr2=0x5584f7e0a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:23.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.366+0000 7fc09885e740 1 -- 172.21.15.12:0/3231267446 shutdown_connections 2024-09-05T01:33:23.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.366+0000 7fc09885e740 1 -- 172.21.15.12:0/3231267446 wait complete. 2024-09-05T01:33:23.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.367+0000 7fc09885e740 1 -- start start 2024-09-05T01:33:23.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.367+0000 7fc09885e740 1 Processor -- start 2024-09-05T01:33:23.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.367+0000 7fc09885e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e0dc70 0x5584f7e15cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:23.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.367+0000 7fc09885e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e0e590 0x5584f7e161f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:23.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.367+0000 7fc09885e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f7e18e50 0x5584f7e16730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:23.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.367+0000 7fc09885e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5584f7e1ba20 con 0x5584f7e18e50 2024-09-05T01:33:23.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.367+0000 7fc09885e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5584f7d2f0f0 con 0x5584f7e0e590 2024-09-05T01:33:23.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.367+0000 7fc09885e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5584f7e1bba0 con 0x5584f7e0dc70 2024-09-05T01:33:23.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.367+0000 7fc09885e740 10 client.0 _ll_register_callbacks cb 0x5584f7d16bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:33:23.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.368+0000 7fc087e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e0e590 0x5584f7e161f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:23.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.368+0000 7fc08ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e0dc70 0x5584f7e15cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:23.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.368+0000 7fc087e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e0e590 0x5584f7e161f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:40704/0 (socket says 172.21.15.12:40704) 2024-09-05T01:33:23.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.368+0000 7fc087e00640 1 -- 172.21.15.12:0/642252873 learned_addr learned my addr 172.21.15.12:0/642252873 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:23.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.368+0000 7fc08f400640 1 --2- 172.21.15.12:0/642252873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f7e18e50 0x5584f7e16730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:23.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.368+0000 7fc087e00640 1 -- 172.21.15.12:0/642252873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e0dc70 msgr2=0x5584f7e15cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:23.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.368+0000 7fc087e00640 1 --2- 172.21.15.12:0/642252873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e0dc70 0x5584f7e15cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.368+0000 7fc087e00640 1 -- 172.21.15.12:0/642252873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f7e18e50 msgr2=0x5584f7e16730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:23.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.368+0000 7fc087e00640 1 --2- 172.21.15.12:0/642252873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f7e18e50 0x5584f7e16730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.368+0000 7fc087e00640 1 -- 172.21.15.12:0/642252873 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584f7ae53c0 con 0x5584f7e0e590 2024-09-05T01:33:23.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.368+0000 7fc087e00640 1 --2- 172.21.15.12:0/642252873 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e0e590 0x5584f7e161f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc078006010 tx=0x7fc078003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9499a40f135f7d4e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:23.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.368+0000 7fc07cc00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:33:23.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.369+0000 7fc07cc00640 1 -- 172.21.15.12:0/642252873 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc078028020 con 0x5584f7e0e590 2024-09-05T01:33:23.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.369+0000 7fc07cc00640 1 -- 172.21.15.12:0/642252873 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8579+0+0 (secure 0 0 0) 0x7fc078005040 con 0x5584f7e0e590 2024-09-05T01:33:23.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.369+0000 7fc09885e740 1 -- 172.21.15.12:0/642252873 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0780043d0 con 0x5584f7e0e590 2024-09-05T01:33:23.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.369+0000 7fc07cc00640 1 -- 172.21.15.12:0/642252873 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fc078033050 con 0x5584f7e0e590 2024-09-05T01:33:23.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.369+0000 7fc09885e740 10 client.26318 fetch_fsmap learned FSMap version 48 2024-09-05T01:33:23.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.369+0000 7fc09885e740 1 -- 172.21.15.12:0/642252873 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5584f7e279e0 con 0x5584f7e0e590 2024-09-05T01:33:23.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.369+0000 7fc07cc00640 1 -- 172.21.15.12:0/642252873 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0780043d0 con 0x5584f7e0e590 2024-09-05T01:33:23.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.369+0000 7fc07cc00640 1 -- 172.21.15.12:0/642252873 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 48) ==== 8426+0+0 (secure 0 0 0) 0x7fc078018070 con 0x5584f7e0e590 2024-09-05T01:33:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.369+0000 7fc09885e740 10 client.26318 fetch_fsmap finished waiting for FSMap version 48 2024-09-05T01:33:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.369+0000 7fc09885e740 10 client.26318 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T01:33:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.369+0000 7fc09885e740 20 client.26318 populate_metadata read hostname 'smithi012' 2024-09-05T01:33:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.369+0000 7fc09885e740 1 --2- 172.21.15.12:0/642252873 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5584f7e28d30 0x5584f7e2b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.370+0000 7fc09885e740 4 client.26318 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:33:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.370+0000 7fc09885e740 1 -- 172.21.15.12:0/642252873 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584f7d81950 con 0x5584f7e28d30 2024-09-05T01:33:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.370+0000 7fc08ea00640 1 --2- 172.21.15.12:0/642252873 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5584f7e28d30 0x5584f7e2b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.370+0000 7fc08ea00640 1 --2- 172.21.15.12:0/642252873 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5584f7e28d30 0x5584f7e2b120 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=78867398a406791a server_cookie=65b37a253d63ee42 in_seq=0 out_seq=0 2024-09-05T01:33:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.370+0000 7fc07cc00640 10 client.26318 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:33:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.371+0000 7fc07cc00640 1 -- 172.21.15.12:0/642252873 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5584f7d81950 con 0x5584f7e28d30 2024-09-05T01:33:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.371+0000 7fc07cc00640 10 client.26318 handle_command_reply: tid=0 2024-09-05T01:33:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.371+0000 7fc09885e740 1 client.26318 shutdown 2024-09-05T01:33:23.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.371+0000 7fc09885e740 1 -- 172.21.15.12:0/642252873 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e0e590 msgr2=0x5584f7e161f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.371+0000 7fc09885e740 1 --2- 172.21.15.12:0/642252873 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e0e590 0x5584f7e161f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc078006010 tx=0x7fc078003820 comp rx=0 tx=0).stop 2024-09-05T01:33:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.372+0000 7fc09885e740 1 -- 172.21.15.12:0/642252873 shutdown_connections 2024-09-05T01:33:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.372+0000 7fc09885e740 1 --2- 172.21.15.12:0/642252873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f7e18e50 0x5584f7e16730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.372+0000 7fc09885e740 1 --2- 172.21.15.12:0/642252873 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5584f7e28d30 0x5584f7e2b120 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.372+0000 7fc09885e740 1 --2- 172.21.15.12:0/642252873 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e0e590 0x5584f7e161f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.372+0000 7fc09885e740 1 --2- 172.21.15.12:0/642252873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e0dc70 0x5584f7e15cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.372+0000 7fc09885e740 1 -- 172.21.15.12:0/642252873 >> 172.21.15.12:0/642252873 conn(0x5584f7e0a200 msgr2=0x5584f7e0ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.372+0000 7fc07cc00640 0 client.26318 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:33:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.372+0000 7fc09885e740 1 -- 172.21.15.12:0/642252873 shutdown_connections 2024-09-05T01:33:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.372+0000 7fc09885e740 1 -- 172.21.15.12:0/642252873 wait complete. 2024-09-05T01:33:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.373+0000 7fc09885e740 20 client.26318 trim_cache size 0 max 16384 2024-09-05T01:33:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.387+0000 7fc09885e740 1 Processor -- start 2024-09-05T01:33:23.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.387+0000 7fc09885e740 1 -- start start 2024-09-05T01:33:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.388+0000 7fc09885e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e0dc70 0x5584f7e0fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.388+0000 7fc09885e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e0e590 0x5584f7e30900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.388+0000 7fc09885e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f7e18e50 0x5584f7e30e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.388+0000 7fc09885e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc0901afb70 con 0x5584f7e18e50 2024-09-05T01:33:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.388+0000 7fc09885e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc0901b1860 con 0x5584f7e0dc70 2024-09-05T01:33:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.388+0000 7fc09885e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc0901b0240 con 0x5584f7e0e590 2024-09-05T01:33:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.388+0000 7fc08f400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f7e18e50 0x5584f7e30e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.388+0000 7fc08f400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f7e18e50 0x5584f7e30e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44186/0 (socket says 172.21.15.12:44186) 2024-09-05T01:33:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.388+0000 7fc08f400640 1 -- 172.21.15.12:0/3221695394 learned_addr learned my addr 172.21.15.12:0/3221695394 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.388+0000 7fc08ea00640 1 --2- 172.21.15.12:0/3221695394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e0dc70 0x5584f7e0fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.389+0000 7fc08ea00640 1 -- 172.21.15.12:0/3221695394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e0e590 msgr2=0x5584f7e30900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:23.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.388+0000 7fc087e00640 1 --2- 172.21.15.12:0/3221695394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e0e590 0x5584f7e30900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.389+0000 7fc08ea00640 1 --2- 172.21.15.12:0/3221695394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e0e590 0x5584f7e30900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.389+0000 7fc08ea00640 1 -- 172.21.15.12:0/3221695394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f7e18e50 msgr2=0x5584f7e30e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.389+0000 7fc08ea00640 1 --2- 172.21.15.12:0/3221695394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f7e18e50 0x5584f7e30e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.389+0000 7fc08ea00640 1 -- 172.21.15.12:0/3221695394 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584f7e0e3c0 con 0x5584f7e0dc70 2024-09-05T01:33:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.389+0000 7fc08f400640 1 --2- 172.21.15.12:0/3221695394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f7e18e50 0x5584f7e30e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:33:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.389+0000 7fc087e00640 1 --2- 172.21.15.12:0/3221695394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e0e590 0x5584f7e30900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:33:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.389+0000 7fc08ea00640 1 --2- 172.21.15.12:0/3221695394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e0dc70 0x5584f7e0fdd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc0800eccb0 tx=0x7fc080005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c862ab62ea3c91a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.389+0000 7fc07f400640 1 -- 172.21.15.12:0/3221695394 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0800043f0 con 0x5584f7e0dc70 2024-09-05T01:33:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.389+0000 7fc07f400640 1 -- 172.21.15.12:0/3221695394 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0800bba80 con 0x5584f7e0dc70 2024-09-05T01:33:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.389+0000 7fc07f400640 1 -- 172.21.15.12:0/3221695394 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0800f2c90 con 0x5584f7e0dc70 2024-09-05T01:33:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.390+0000 7fc09885e740 1 -- 172.21.15.12:0/3221695394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e0dc70 msgr2=0x5584f7e0fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.390+0000 7fc09885e740 1 --2- 172.21.15.12:0/3221695394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e0dc70 0x5584f7e0fdd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc0800eccb0 tx=0x7fc080005f90 comp rx=0 tx=0).stop 2024-09-05T01:33:23.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.390+0000 7fc09885e740 1 -- 172.21.15.12:0/3221695394 shutdown_connections 2024-09-05T01:33:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.390+0000 7fc09885e740 1 --2- 172.21.15.12:0/3221695394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f7e18e50 0x5584f7e30e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.390+0000 7fc09885e740 1 --2- 172.21.15.12:0/3221695394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e0e590 0x5584f7e30900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.390+0000 7fc09885e740 1 --2- 172.21.15.12:0/3221695394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e0dc70 0x5584f7e0fdd0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.390+0000 7fc09885e740 1 -- 172.21.15.12:0/3221695394 >> 172.21.15.12:0/3221695394 conn(0x5584f7e0a200 msgr2=0x5584f7e0f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.390+0000 7fc09885e740 1 -- 172.21.15.12:0/3221695394 shutdown_connections 2024-09-05T01:33:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.390+0000 7fc09885e740 1 -- 172.21.15.12:0/3221695394 wait complete. 2024-09-05T01:33:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.391+0000 7fc09885e740 1 -- start start 2024-09-05T01:33:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.391+0000 7fc09885e740 1 Processor -- start 2024-09-05T01:33:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.391+0000 7fc09885e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e0dc70 0x5584f7e21470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.392+0000 7fc09885e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f7e0e590 0x5584f7e129c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.392+0000 7fc09885e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e18e50 0x5584f7e12f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.392+0000 7fc09885e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc0901b10d0 con 0x5584f7e0e590 2024-09-05T01:33:23.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.392+0000 7fc09885e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc0901b0940 con 0x5584f7e18e50 2024-09-05T01:33:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.392+0000 7fc09885e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc0901adb70 con 0x5584f7e0dc70 2024-09-05T01:33:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.392+0000 7fc09885e740 10 client.0 _ll_register_callbacks cb 0x7fc078009af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:33:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.392+0000 7fc08ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e0dc70 0x5584f7e21470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.392+0000 7fc08ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e0dc70 0x5584f7e21470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:48550/0 (socket says 172.21.15.12:48550) 2024-09-05T01:33:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.392+0000 7fc08ea00640 1 -- 172.21.15.12:0/273551922 learned_addr learned my addr 172.21.15.12:0/273551922 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.392+0000 7fc087e00640 1 --2- 172.21.15.12:0/273551922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f7e0e590 0x5584f7e129c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.392+0000 7fc08f400640 1 --2- 172.21.15.12:0/273551922 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e18e50 0x5584f7e12f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.392+0000 7fc087e00640 1 -- 172.21.15.12:0/273551922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e0dc70 msgr2=0x5584f7e21470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.392+0000 7fc087e00640 1 --2- 172.21.15.12:0/273551922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e0dc70 0x5584f7e21470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.392+0000 7fc087e00640 1 -- 172.21.15.12:0/273551922 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e18e50 msgr2=0x5584f7e12f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.392+0000 7fc087e00640 1 --2- 172.21.15.12:0/273551922 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e18e50 0x5584f7e12f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.392+0000 7fc087e00640 1 -- 172.21.15.12:0/273551922 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584f7e13690 con 0x5584f7e0e590 2024-09-05T01:33:23.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.393+0000 7fc08ea00640 1 --2- 172.21.15.12:0/273551922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e0dc70 0x5584f7e21470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:33:23.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.393+0000 7fc08f400640 1 --2- 172.21.15.12:0/273551922 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e18e50 0x5584f7e12f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:33:23.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.393+0000 7fc087e00640 1 --2- 172.21.15.12:0/273551922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f7e0e590 0x5584f7e129c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc078003fb0 tx=0x7fc078005df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb88082571bb22d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:23.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.393+0000 7fc07cc00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:33:23.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.393+0000 7fc07cc00640 1 -- 172.21.15.12:0/273551922 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc078028040 con 0x5584f7e0e590 2024-09-05T01:33:23.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.393+0000 7fc07cc00640 1 -- 172.21.15.12:0/273551922 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8579+0+0 (secure 0 0 0) 0x7fc078004640 con 0x5584f7e0e590 2024-09-05T01:33:23.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.393+0000 7fc09885e740 1 -- 172.21.15.12:0/273551922 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0800bba80 con 0x5584f7e0e590 2024-09-05T01:33:23.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.394+0000 7fc07cc00640 1 -- 172.21.15.12:0/273551922 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fc07801f040 con 0x5584f7e0e590 2024-09-05T01:33:23.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.394+0000 7fc09885e740 10 client.16275 fetch_fsmap learned FSMap version 48 2024-09-05T01:33:23.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.394+0000 7fc09885e740 1 -- 172.21.15.12:0/273551922 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5584f7e93810 con 0x5584f7e0e590 2024-09-05T01:33:23.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.394+0000 7fc07cc00640 1 -- 172.21.15.12:0/273551922 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0800bba80 con 0x5584f7e0e590 2024-09-05T01:33:23.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.394+0000 7fc07cc00640 1 -- 172.21.15.12:0/273551922 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 48) ==== 8426+0+0 (secure 0 0 0) 0x7fc07803d030 con 0x5584f7e0e590 2024-09-05T01:33:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.394+0000 7fc09885e740 10 client.16275 fetch_fsmap finished waiting for FSMap version 48 2024-09-05T01:33:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.394+0000 7fc09885e740 10 client.16275 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T01:33:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.394+0000 7fc09885e740 20 client.16275 populate_metadata read hostname 'smithi012' 2024-09-05T01:33:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.394+0000 7fc09885e740 1 --2- 172.21.15.12:0/273551922 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5584f7e93ec0 0x5584f7e962e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.394+0000 7fc09885e740 4 client.16275 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:33:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.394+0000 7fc09885e740 1 -- 172.21.15.12:0/273551922 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5584f7d7be60 con 0x5584f7e93ec0 2024-09-05T01:33:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.395+0000 7fc08ea00640 1 --2- 172.21.15.12:0/273551922 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5584f7e93ec0 0x5584f7e962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.395+0000 7fc08ea00640 1 --2- 172.21.15.12:0/273551922 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5584f7e93ec0 0x5584f7e962e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a35cc9db34201f10 server_cookie=3a4a210648549e78 in_seq=0 out_seq=0 2024-09-05T01:33:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.395+0000 7fc07cc00640 10 client.16275 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:33:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.395+0000 7fc07cc00640 1 -- 172.21.15.12:0/273551922 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5584f7d7be60 con 0x5584f7e93ec0 2024-09-05T01:33:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.395+0000 7fc07cc00640 10 client.16275 handle_command_reply: tid=0 2024-09-05T01:33:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.395+0000 7fc09885e740 1 client.16275 shutdown 2024-09-05T01:33:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.396+0000 7fc09885e740 1 -- 172.21.15.12:0/273551922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f7e0e590 msgr2=0x5584f7e129c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:23.467 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.396+0000 7fc09885e740 1 --2- 172.21.15.12:0/273551922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f7e0e590 0x5584f7e129c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc078003fb0 tx=0x7fc078005df0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.396+0000 7fc09885e740 1 -- 172.21.15.12:0/273551922 shutdown_connections 2024-09-05T01:33:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.396+0000 7fc09885e740 1 --2- 172.21.15.12:0/273551922 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x5584f7e93ec0 0x5584f7e962e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.396+0000 7fc09885e740 1 --2- 172.21.15.12:0/273551922 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5584f7e18e50 0x5584f7e12f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.396+0000 7fc09885e740 1 --2- 172.21.15.12:0/273551922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5584f7e0e590 0x5584f7e129c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.396+0000 7fc09885e740 1 --2- 172.21.15.12:0/273551922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584f7e0dc70 0x5584f7e21470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.396+0000 7fc09885e740 1 -- 172.21.15.12:0/273551922 >> 172.21.15.12:0/273551922 conn(0x5584f7e0a200 msgr2=0x5584f7e15c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.396+0000 7fc07cc00640 0 client.16275 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:33:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.396+0000 7fc09885e740 1 -- 172.21.15.12:0/273551922 shutdown_connections 2024-09-05T01:33:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.396+0000 7fc09885e740 1 -- 172.21.15.12:0/273551922 wait complete. 2024-09-05T01:33:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.396+0000 7fc09885e740 20 client.16275 trim_cache size 0 max 16384 2024-09-05T01:33:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.397+0000 7fc095c00640 1 -- 172.21.15.12:0/4127181171 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc0740a2d70 msgr2=0x7fc0740a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:23.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.397+0000 7fc095c00640 1 --2- 172.21.15.12:0/4127181171 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc0740a2d70 0x7fc0740a5230 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc088005c40 tx=0x7fc088009760 comp rx=0 tx=0).stop 2024-09-05T01:33:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.397+0000 7fc095c00640 1 -- 172.21.15.12:0/4127181171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc090103ff0 msgr2=0x7fc09019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.397+0000 7fc095c00640 1 --2- 172.21.15.12:0/4127181171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc090103ff0 0x7fc09019a620 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc080035040 tx=0x7fc080033d90 comp rx=0 tx=0).stop 2024-09-05T01:33:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.397+0000 7fc095c00640 1 -- 172.21.15.12:0/4127181171 shutdown_connections 2024-09-05T01:33:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.397+0000 7fc095c00640 1 --2- 172.21.15.12:0/4127181171 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc0740a2d70 0x7fc0740a5230 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.397+0000 7fc095c00640 1 --2- 172.21.15.12:0/4127181171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc090109120 0x7fc09019eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.397+0000 7fc095c00640 1 --2- 172.21.15.12:0/4127181171 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc0901049a0 0x7fc09019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.397+0000 7fc095c00640 1 --2- 172.21.15.12:0/4127181171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc090103ff0 0x7fc09019a620 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.397+0000 7fc095c00640 1 -- 172.21.15.12:0/4127181171 >> 172.21.15.12:0/4127181171 conn(0x7fc0900ffa90 msgr2=0x7fc090100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.397+0000 7fc095c00640 1 -- 172.21.15.12:0/4127181171 shutdown_connections 2024-09-05T01:33:23.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:23.397+0000 7fc095c00640 1 -- 172.21.15.12:0/4127181171 wait complete. 2024-09-05T01:33:23.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:23 smithi012 ceph-mon[29942]: pgmap v269: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 100 KiB/s wr, 22 op/s 2024-09-05T01:33:23.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:23 smithi145 ceph-mon[34376]: pgmap v269: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 100 KiB/s wr, 22 op/s 2024-09-05T01:33:23.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:23 smithi151 ceph-mon[35013]: pgmap v269: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 100 KiB/s wr, 22 op/s 2024-09-05T01:33:24.265 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-05T01:33:24.691 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:33:25.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.389+0000 7fb2db600640 1 -- 172.21.15.12:0/2125120857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2d4076720 msgr2=0x7fb2d4076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:25.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.389+0000 7fb2db600640 1 --2- 172.21.15.12:0/2125120857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2d4076720 0x7fb2d4076b00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009900 tx=0x7fb2c802a3f0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.389+0000 7fb2db600640 1 -- 172.21.15.12:0/2125120857 shutdown_connections 2024-09-05T01:33:25.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.389+0000 7fb2db600640 1 --2- 172.21.15.12:0/2125120857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2d4112a30 0x7fb2d4114e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.389+0000 7fb2db600640 1 --2- 172.21.15.12:0/2125120857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2d4077040 0x7fb2d41124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.389+0000 7fb2db600640 1 --2- 172.21.15.12:0/2125120857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2d4076720 0x7fb2d4076b00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.389+0000 7fb2db600640 1 -- 172.21.15.12:0/2125120857 >> 172.21.15.12:0/2125120857 conn(0x7fb2d40ffa90 msgr2=0x7fb2d4101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:25.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.390+0000 7fb2db600640 1 -- 172.21.15.12:0/2125120857 shutdown_connections 2024-09-05T01:33:25.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.390+0000 7fb2db600640 1 -- 172.21.15.12:0/2125120857 wait complete. 2024-09-05T01:33:25.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.391+0000 7fb2db600640 1 Processor -- start 2024-09-05T01:33:25.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.391+0000 7fb2db600640 1 -- start start 2024-09-05T01:33:25.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.391+0000 7fb2db600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2d4076720 0x7fb2d41a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:25.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.391+0000 7fb2db600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2d4077040 0x7fb2d41a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:25.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.391+0000 7fb2db600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2d4112a30 0x7fb2d419e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:25.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.391+0000 7fb2db600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d41185f0 con 0x7fb2d4076720 2024-09-05T01:33:25.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.391+0000 7fb2db600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d4118470 con 0x7fb2d4112a30 2024-09-05T01:33:25.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.391+0000 7fb2db600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d4118770 con 0x7fb2d4077040 2024-09-05T01:33:25.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.391+0000 7fb2d3e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2d4077040 0x7fb2d41a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:25.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.391+0000 7fb2d8c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2d4076720 0x7fb2d41a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:25.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.392+0000 7fb2d3e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2d4077040 0x7fb2d41a4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:48566/0 (socket says 172.21.15.12:48566) 2024-09-05T01:33:25.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.392+0000 7fb2d3e00640 1 -- 172.21.15.12:0/2771181421 learned_addr learned my addr 172.21.15.12:0/2771181421 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:25.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.392+0000 7fb2d9600640 1 --2- 172.21.15.12:0/2771181421 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2d4112a30 0x7fb2d419e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:25.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.392+0000 7fb2d3e00640 1 -- 172.21.15.12:0/2771181421 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2d4112a30 msgr2=0x7fb2d419e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:25.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.392+0000 7fb2d3e00640 1 --2- 172.21.15.12:0/2771181421 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2d4112a30 0x7fb2d419e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.392+0000 7fb2d3e00640 1 -- 172.21.15.12:0/2771181421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2d4076720 msgr2=0x7fb2d41a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:25.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.392+0000 7fb2d3e00640 1 --2- 172.21.15.12:0/2771181421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2d4076720 0x7fb2d41a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.392+0000 7fb2d3e00640 1 -- 172.21.15.12:0/2771181421 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d419ef90 con 0x7fb2d4077040 2024-09-05T01:33:25.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.392+0000 7fb2d3e00640 1 --2- 172.21.15.12:0/2771181421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2d4077040 0x7fb2d41a4be0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000e9f0 tx=0x7fb2c000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:25.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.392+0000 7fb2d1600640 1 -- 172.21.15.12:0/2771181421 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c000cd80 con 0x7fb2d4077040 2024-09-05T01:33:25.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.393+0000 7fb2d1600640 1 -- 172.21.15.12:0/2771181421 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2c0010910 con 0x7fb2d4077040 2024-09-05T01:33:25.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.393+0000 7fb2db600640 1 -- 172.21.15.12:0/2771181421 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d419f280 con 0x7fb2d4077040 2024-09-05T01:33:25.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.393+0000 7fb2d1600640 1 -- 172.21.15.12:0/2771181421 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0018990 con 0x7fb2d4077040 2024-09-05T01:33:25.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.393+0000 7fb2db600640 1 -- 172.21.15.12:0/2771181421 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d41ab570 con 0x7fb2d4077040 2024-09-05T01:33:25.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.396+0000 7fb2de0ce740 1 Processor -- start 2024-09-05T01:33:25.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.396+0000 7fb2de0ce740 1 -- start start 2024-09-05T01:33:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.396+0000 7fb2de0ce740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48fa3c70 0x55ca48fa4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.396+0000 7fb2de0ce740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca48fa4590 0x55ca48fae910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.396+0000 7fb2de0ce740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48faee50 0x55ca48fb1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.396+0000 7fb2de0ce740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ca48f0a3e0 con 0x55ca48faee50 2024-09-05T01:33:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.396+0000 7fb2de0ce740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55ca48eb1d80 con 0x55ca48fa4590 2024-09-05T01:33:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.396+0000 7fb2de0ce740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ca48f063a0 con 0x55ca48fa3c70 2024-09-05T01:33:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.396+0000 7fb2d1600640 1 -- 172.21.15.12:0/2771181421 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fb2c0010ac0 con 0x7fb2d4077040 2024-09-05T01:33:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.396+0000 7fb2d9600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48fa3c70 0x55ca48fa4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.396+0000 7fb2d9600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48fa3c70 0x55ca48fa4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:48568/0 (socket says 172.21.15.12:48568) 2024-09-05T01:33:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.396+0000 7fb2d9600640 1 -- 172.21.15.12:0/4053831295 learned_addr learned my addr 172.21.15.12:0/4053831295 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:25.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.396+0000 7fb2d8c00640 1 --2- 172.21.15.12:0/4053831295 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca48fa4590 0x55ca48fae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:25.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.397+0000 7fb2d3e00640 1 --2- 172.21.15.12:0/4053831295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48faee50 0x55ca48fb1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:25.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.397+0000 7fb2d9600640 1 -- 172.21.15.12:0/4053831295 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca48fa4590 msgr2=0x55ca48fae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:25.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.397+0000 7fb2d9600640 1 --2- 172.21.15.12:0/4053831295 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca48fa4590 0x55ca48fae910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.397+0000 7fb2d9600640 1 -- 172.21.15.12:0/4053831295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48faee50 msgr2=0x55ca48fb1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:25.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.397+0000 7fb2d9600640 1 --2- 172.21.15.12:0/4053831295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48faee50 0x55ca48fb1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.397+0000 7fb2d9600640 1 -- 172.21.15.12:0/4053831295 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca48ed0ae0 con 0x55ca48fa3c70 2024-09-05T01:33:25.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.397+0000 7fb2d3e00640 1 --2- 172.21.15.12:0/4053831295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48faee50 0x55ca48fb1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:33:25.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.397+0000 7fb2d9600640 1 --2- 172.21.15.12:0/4053831295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48fa3c70 0x55ca48fa4050 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc009ec0 tx=0x7fb2cc0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=700ebeccefe7c972 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:25.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.397+0000 7fb2c5c00640 1 -- 172.21.15.12:0/4053831295 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc004d20 con 0x55ca48fa3c70 2024-09-05T01:33:25.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.397+0000 7fb2c5c00640 1 -- 172.21.15.12:0/4053831295 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2cc003e50 con 0x55ca48fa3c70 2024-09-05T01:33:25.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.397+0000 7fb2c5c00640 1 -- 172.21.15.12:0/4053831295 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc005280 con 0x55ca48fa3c70 2024-09-05T01:33:25.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.398+0000 7fb2de0ce740 1 -- 172.21.15.12:0/4053831295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48fa3c70 msgr2=0x55ca48fa4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:25.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.398+0000 7fb2de0ce740 1 --2- 172.21.15.12:0/4053831295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48fa3c70 0x55ca48fa4050 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc009ec0 tx=0x7fb2cc0107a0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.398+0000 7fb2d1600640 1 --2- 172.21.15.12:0/2771181421 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fb2bc0a2d70 0x7fb2bc0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:25.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.398+0000 7fb2d1600640 1 -- 172.21.15.12:0/2771181421 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8579+0+0 (secure 0 0 0) 0x7fb2c00cf810 con 0x7fb2d4077040 2024-09-05T01:33:25.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.399+0000 7fb2de0ce740 1 -- 172.21.15.12:0/4053831295 shutdown_connections 2024-09-05T01:33:25.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.399+0000 7fb2de0ce740 1 --2- 172.21.15.12:0/4053831295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48faee50 0x55ca48fb1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.399+0000 7fb2de0ce740 1 --2- 172.21.15.12:0/4053831295 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca48fa4590 0x55ca48fae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.399+0000 7fb2d9600640 1 --2- 172.21.15.12:0/2771181421 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fb2bc0a2d70 0x7fb2bc0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:25.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.399+0000 7fb2de0ce740 1 --2- 172.21.15.12:0/4053831295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48fa3c70 0x55ca48fa4050 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.399+0000 7fb2de0ce740 1 -- 172.21.15.12:0/4053831295 >> 172.21.15.12:0/4053831295 conn(0x55ca48fa0200 msgr2=0x55ca48fa05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:25.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.399+0000 7fb2de0ce740 1 -- 172.21.15.12:0/4053831295 shutdown_connections 2024-09-05T01:33:25.402 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.399+0000 7fb2de0ce740 1 -- 172.21.15.12:0/4053831295 wait complete. 2024-09-05T01:33:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.399+0000 7fb2de0ce740 1 -- start start 2024-09-05T01:33:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.400+0000 7fb2d9600640 1 --2- 172.21.15.12:0/2771181421 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fb2bc0a2d70 0x7fb2bc0a5230 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc0045e0 tx=0x7fb2cc013040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.400+0000 7fb2de0ce740 1 Processor -- start 2024-09-05T01:33:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.400+0000 7fb2de0ce740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48fa3c70 0x55ca48fabc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.400+0000 7fb2de0ce740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca48fa4590 0x55ca48fac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.400+0000 7fb2de0ce740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48faee50 0x55ca48fac710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.400+0000 7fb2de0ce740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ca48fb1a20 con 0x55ca48fa3c70 2024-09-05T01:33:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.400+0000 7fb2de0ce740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55ca48ec50f0 con 0x55ca48fa4590 2024-09-05T01:33:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.400+0000 7fb2de0ce740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ca48fb1ba0 con 0x55ca48faee50 2024-09-05T01:33:25.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.400+0000 7fb2de0ce740 10 client.0 _ll_register_callbacks cb 0x55ca48eacbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:33:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.400+0000 7fb2d8c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48fa3c70 0x55ca48fabc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.401+0000 7fb2d8c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48fa3c70 0x55ca48fabc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44236/0 (socket says 172.21.15.12:44236) 2024-09-05T01:33:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.401+0000 7fb2d8c00640 1 -- 172.21.15.12:0/1488417998 learned_addr learned my addr 172.21.15.12:0/1488417998 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.401+0000 7fb2d3e00640 1 --2- 172.21.15.12:0/1488417998 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca48fa4590 0x55ca48fac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.401+0000 7fb2d9600640 1 --2- 172.21.15.12:0/1488417998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48faee50 0x55ca48fac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.401+0000 7fb2d8c00640 1 -- 172.21.15.12:0/1488417998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48faee50 msgr2=0x55ca48fac710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.401+0000 7fb2d8c00640 1 --2- 172.21.15.12:0/1488417998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48faee50 0x55ca48fac710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.401+0000 7fb2d8c00640 1 -- 172.21.15.12:0/1488417998 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca48fa4590 msgr2=0x55ca48fac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.401+0000 7fb2d8c00640 1 --2- 172.21.15.12:0/1488417998 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca48fa4590 0x55ca48fac1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.401+0000 7fb2d8c00640 1 -- 172.21.15.12:0/1488417998 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca48c7b3c0 con 0x55ca48fa3c70 2024-09-05T01:33:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.401+0000 7fb2d9600640 1 --2- 172.21.15.12:0/1488417998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48faee50 0x55ca48fac710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:33:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.401+0000 7fb2d3e00640 1 --2- 172.21.15.12:0/1488417998 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca48fa4590 0x55ca48fac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:33:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.402+0000 7fb2d8c00640 1 --2- 172.21.15.12:0/1488417998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48fa3c70 0x55ca48fabc90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009900 tx=0x7fb2c80043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51132bfebf0f8e79 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:25.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.402+0000 7fb2ba000640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:33:25.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.402+0000 7fb2ba000640 1 -- 172.21.15.12:0/1488417998 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8035040 con 0x55ca48fa3c70 2024-09-05T01:33:25.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.402+0000 7fb2ba000640 1 -- 172.21.15.12:0/1488417998 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8579+0+0 (secure 0 0 0) 0x7fb2c8005450 con 0x55ca48fa3c70 2024-09-05T01:33:25.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.402+0000 7fb2de0ce740 1 -- 172.21.15.12:0/1488417998 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2cc003e50 con 0x55ca48fa3c70 2024-09-05T01:33:25.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.402+0000 7fb2ba000640 1 -- 172.21.15.12:0/1488417998 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fb2c8005650 con 0x55ca48fa3c70 2024-09-05T01:33:25.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.402+0000 7fb2de0ce740 10 client.16284 fetch_fsmap learned FSMap version 48 2024-09-05T01:33:25.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.402+0000 7fb2de0ce740 1 -- 172.21.15.12:0/1488417998 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55ca48fbd920 con 0x55ca48fa3c70 2024-09-05T01:33:25.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.403+0000 7fb2ba000640 1 -- 172.21.15.12:0/1488417998 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2cc003e50 con 0x55ca48fa3c70 2024-09-05T01:33:25.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.403+0000 7fb2ba000640 1 -- 172.21.15.12:0/1488417998 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 48) ==== 8426+0+0 (secure 0 0 0) 0x7fb2c8003a30 con 0x55ca48fa3c70 2024-09-05T01:33:25.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.403+0000 7fb2de0ce740 10 client.16284 fetch_fsmap finished waiting for FSMap version 48 2024-09-05T01:33:25.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.403+0000 7fb2de0ce740 10 client.16284 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T01:33:25.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.403+0000 7fb2de0ce740 20 client.16284 populate_metadata read hostname 'smithi012' 2024-09-05T01:33:25.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.403+0000 7fb2de0ce740 1 --2- 172.21.15.12:0/1488417998 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55ca48fbee30 0x55ca48fc1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:25.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.403+0000 7fb2de0ce740 4 client.16284 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:33:25.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.403+0000 7fb2de0ce740 1 -- 172.21.15.12:0/1488417998 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca48f17950 con 0x55ca48fbee30 2024-09-05T01:33:25.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.403+0000 7fb2d3e00640 1 --2- 172.21.15.12:0/1488417998 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55ca48fbee30 0x55ca48fc1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:25.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.404+0000 7fb2d3e00640 1 --2- 172.21.15.12:0/1488417998 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55ca48fbee30 0x55ca48fc1290 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=371f057b4ec6840a server_cookie=e35798d18a891c64 in_seq=0 out_seq=0 2024-09-05T01:33:25.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.404+0000 7fb2ba000640 10 client.16284 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:33:25.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.404+0000 7fb2ba000640 1 -- 172.21.15.12:0/1488417998 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ca48f17950 con 0x55ca48fbee30 2024-09-05T01:33:25.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.405+0000 7fb2ba000640 10 client.16284 handle_command_reply: tid=0 2024-09-05T01:33:25.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.405+0000 7fb2de0ce740 1 client.16284 shutdown 2024-09-05T01:33:25.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.405+0000 7fb2de0ce740 1 -- 172.21.15.12:0/1488417998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48fa3c70 msgr2=0x55ca48fabc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:25.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.405+0000 7fb2de0ce740 1 --2- 172.21.15.12:0/1488417998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48fa3c70 0x55ca48fabc90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009900 tx=0x7fb2c80043b0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.405+0000 7fb2de0ce740 1 -- 172.21.15.12:0/1488417998 shutdown_connections 2024-09-05T01:33:25.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.405+0000 7fb2de0ce740 1 --2- 172.21.15.12:0/1488417998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48faee50 0x55ca48fac710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.405+0000 7fb2de0ce740 1 --2- 172.21.15.12:0/1488417998 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca48fa4590 0x55ca48fac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.405+0000 7fb2de0ce740 1 --2- 172.21.15.12:0/1488417998 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55ca48fbee30 0x55ca48fc1290 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.405+0000 7fb2de0ce740 1 --2- 172.21.15.12:0/1488417998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48fa3c70 0x55ca48fabc90 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.405+0000 7fb2de0ce740 1 -- 172.21.15.12:0/1488417998 >> 172.21.15.12:0/1488417998 conn(0x55ca48fa0200 msgr2=0x55ca48f9f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:25.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.405+0000 7fb2ba000640 0 client.16284 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:33:25.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.405+0000 7fb2de0ce740 1 -- 172.21.15.12:0/1488417998 shutdown_connections 2024-09-05T01:33:25.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.405+0000 7fb2de0ce740 1 -- 172.21.15.12:0/1488417998 wait complete. 2024-09-05T01:33:25.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.405+0000 7fb2de0ce740 20 client.16284 trim_cache size 0 max 16384 2024-09-05T01:33:25.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.419+0000 7fb2de0ce740 1 Processor -- start 2024-09-05T01:33:25.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.419+0000 7fb2de0ce740 1 -- start start 2024-09-05T01:33:25.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.420+0000 7fb2de0ce740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca48fa3c70 0x55ca48fa66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:25.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.420+0000 7fb2de0ce740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48fa4590 0x55ca48fc6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:25.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.420+0000 7fb2de0ce740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48faee50 0x55ca48fc70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:25.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.420+0000 7fb2de0ce740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d41b3f90 con 0x55ca48fa4590 2024-09-05T01:33:25.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.420+0000 7fb2de0ce740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d41b5c80 con 0x55ca48fa3c70 2024-09-05T01:33:25.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.420+0000 7fb2de0ce740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d41b4660 con 0x55ca48faee50 2024-09-05T01:33:25.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.420+0000 7fb2d3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48fa4590 0x55ca48fc6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:25.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.420+0000 7fb2d9600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48faee50 0x55ca48fc70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:25.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.420+0000 7fb2d9600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48faee50 0x55ca48fc70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:48578/0 (socket says 172.21.15.12:48578) 2024-09-05T01:33:25.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.420+0000 7fb2d3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48fa4590 0x55ca48fc6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44252/0 (socket says 172.21.15.12:44252) 2024-09-05T01:33:25.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.420+0000 7fb2d9600640 1 -- 172.21.15.12:0/2923158632 learned_addr learned my addr 172.21.15.12:0/2923158632 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:25.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.420+0000 7fb2d8c00640 1 --2- 172.21.15.12:0/2923158632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca48fa3c70 0x55ca48fa66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:25.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.420+0000 7fb2d9600640 1 -- 172.21.15.12:0/2923158632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca48fa3c70 msgr2=0x55ca48fa66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:25.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.420+0000 7fb2d9600640 1 --2- 172.21.15.12:0/2923158632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca48fa3c70 0x55ca48fa66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.420+0000 7fb2d9600640 1 -- 172.21.15.12:0/2923158632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48fa4590 msgr2=0x55ca48fc6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:25.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.420+0000 7fb2d9600640 1 --2- 172.21.15.12:0/2923158632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48fa4590 0x55ca48fc6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.420+0000 7fb2d9600640 1 -- 172.21.15.12:0/2923158632 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca48fa0030 con 0x55ca48faee50 2024-09-05T01:33:25.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.421+0000 7fb2d3e00640 1 --2- 172.21.15.12:0/2923158632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48fa4590 0x55ca48fc6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:33:25.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.421+0000 7fb2d9600640 1 --2- 172.21.15.12:0/2923158632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48faee50 0x55ca48fc70a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc009e60 tx=0x7fb2cc025000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8f9565b6f468377 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:25.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.421+0000 7fb2c5200640 1 -- 172.21.15.12:0/2923158632 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc005930 con 0x55ca48faee50 2024-09-05T01:33:25.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.421+0000 7fb2c5200640 1 -- 172.21.15.12:0/2923158632 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2cc004c50 con 0x55ca48faee50 2024-09-05T01:33:25.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.421+0000 7fb2c5200640 1 -- 172.21.15.12:0/2923158632 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc011920 con 0x55ca48faee50 2024-09-05T01:33:25.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.422+0000 7fb2de0ce740 1 -- 172.21.15.12:0/2923158632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48faee50 msgr2=0x55ca48fc70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:25.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.422+0000 7fb2de0ce740 1 --2- 172.21.15.12:0/2923158632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48faee50 0x55ca48fc70a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc009e60 tx=0x7fb2cc025000 comp rx=0 tx=0).stop 2024-09-05T01:33:25.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.422+0000 7fb2de0ce740 1 -- 172.21.15.12:0/2923158632 shutdown_connections 2024-09-05T01:33:25.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.422+0000 7fb2de0ce740 1 --2- 172.21.15.12:0/2923158632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48faee50 0x55ca48fc70a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.422+0000 7fb2de0ce740 1 --2- 172.21.15.12:0/2923158632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48fa4590 0x55ca48fc6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.422+0000 7fb2de0ce740 1 --2- 172.21.15.12:0/2923158632 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca48fa3c70 0x55ca48fa66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.422+0000 7fb2de0ce740 1 -- 172.21.15.12:0/2923158632 >> 172.21.15.12:0/2923158632 conn(0x55ca48fa0200 msgr2=0x55ca48faad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:25.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.422+0000 7fb2de0ce740 1 -- 172.21.15.12:0/2923158632 shutdown_connections 2024-09-05T01:33:25.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.422+0000 7fb2de0ce740 1 -- 172.21.15.12:0/2923158632 wait complete. 2024-09-05T01:33:25.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.422+0000 7fb2de0ce740 1 -- start start 2024-09-05T01:33:25.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.423+0000 7fb2de0ce740 1 Processor -- start 2024-09-05T01:33:25.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.423+0000 7fb2de0ce740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48fa3c70 0x55ca48fb6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:25.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.423+0000 7fb2de0ce740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca48fa4590 0x55ca48fb7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:25.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.423+0000 7fb2de0ce740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48faee50 0x55ca48fa82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:25.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.423+0000 7fb2de0ce740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d41b54f0 con 0x55ca48faee50 2024-09-05T01:33:25.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.423+0000 7fb2de0ce740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d41b4d60 con 0x55ca48fa4590 2024-09-05T01:33:25.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.423+0000 7fb2de0ce740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d41b1f90 con 0x55ca48fa3c70 2024-09-05T01:33:25.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.423+0000 7fb2de0ce740 10 client.0 _ll_register_callbacks cb 0x7fb2c8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:33:25.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.423+0000 7fb2d8c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48fa3c70 0x55ca48fb6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:25.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.424+0000 7fb2d3e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca48fa4590 0x55ca48fb7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:25.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.424+0000 7fb2d8c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48fa3c70 0x55ca48fb6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:48584/0 (socket says 172.21.15.12:48584) 2024-09-05T01:33:25.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.424+0000 7fb2d8c00640 1 -- 172.21.15.12:0/1487640521 learned_addr learned my addr 172.21.15.12:0/1487640521 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:25.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.424+0000 7fb2d9600640 1 --2- 172.21.15.12:0/1487640521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48faee50 0x55ca48fa82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:25.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.424+0000 7fb2d8c00640 1 -- 172.21.15.12:0/1487640521 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca48fa4590 msgr2=0x55ca48fb7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:25.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.424+0000 7fb2d8c00640 1 --2- 172.21.15.12:0/1487640521 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca48fa4590 0x55ca48fb7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.424+0000 7fb2d8c00640 1 -- 172.21.15.12:0/1487640521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48faee50 msgr2=0x55ca48fa82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:25.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.424+0000 7fb2d8c00640 1 --2- 172.21.15.12:0/1487640521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48faee50 0x55ca48fa82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.424+0000 7fb2d8c00640 1 -- 172.21.15.12:0/1487640521 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca48fa51f0 con 0x55ca48fa3c70 2024-09-05T01:33:25.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.424+0000 7fb2d3e00640 1 --2- 172.21.15.12:0/1487640521 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca48fa4590 0x55ca48fb7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:33:25.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.424+0000 7fb2d8c00640 1 --2- 172.21.15.12:0/1487640521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48fa3c70 0x55ca48fb6df0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb2c802a9e0 tx=0x7fb2c8005bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9db05f5e55cb5a1c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:25.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.424+0000 7fb2ba000640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:33:25.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.425+0000 7fb2ba000640 1 -- 172.21.15.12:0/1487640521 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8035070 con 0x55ca48fa3c70 2024-09-05T01:33:25.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.425+0000 7fb2ba000640 1 -- 172.21.15.12:0/1487640521 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8579+0+0 (secure 0 0 0) 0x7fb2c8031a50 con 0x55ca48fa3c70 2024-09-05T01:33:25.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.425+0000 7fb2de0ce740 1 -- 172.21.15.12:0/1487640521 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2cc004c50 con 0x55ca48fa3c70 2024-09-05T01:33:25.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.425+0000 7fb2ba000640 1 -- 172.21.15.12:0/1487640521 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fb2c8052040 con 0x55ca48fa3c70 2024-09-05T01:33:25.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.425+0000 7fb2de0ce740 10 client.26335 fetch_fsmap learned FSMap version 48 2024-09-05T01:33:25.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.425+0000 7fb2de0ce740 1 -- 172.21.15.12:0/1487640521 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55ca48f9b770 con 0x55ca48fa3c70 2024-09-05T01:33:25.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.425+0000 7fb2ba000640 1 -- 172.21.15.12:0/1487640521 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2cc004c50 con 0x55ca48fa3c70 2024-09-05T01:33:25.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.425+0000 7fb2ba000640 1 -- 172.21.15.12:0/1487640521 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 48) ==== 8426+0+0 (secure 0 0 0) 0x7fb2c80046c0 con 0x55ca48fa3c70 2024-09-05T01:33:25.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.425+0000 7fb2de0ce740 10 client.26335 fetch_fsmap finished waiting for FSMap version 48 2024-09-05T01:33:25.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.425+0000 7fb2de0ce740 10 client.26335 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T01:33:25.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.425+0000 7fb2de0ce740 20 client.26335 populate_metadata read hostname 'smithi012' 2024-09-05T01:33:25.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.425+0000 7fb2de0ce740 1 --2- 172.21.15.12:0/1487640521 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55ca49029700 0x55ca4902bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:25.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.425+0000 7fb2de0ce740 4 client.26335 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:33:25.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.425+0000 7fb2de0ce740 1 -- 172.21.15.12:0/1487640521 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ca48f11e60 con 0x55ca49029700 2024-09-05T01:33:25.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.426+0000 7fb2d3e00640 1 --2- 172.21.15.12:0/1487640521 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55ca49029700 0x55ca4902bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:25.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.426+0000 7fb2d3e00640 1 --2- 172.21.15.12:0/1487640521 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55ca49029700 0x55ca4902bb20 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ccbf5bfd9b66b249 server_cookie=dd69ef1635fb139c in_seq=0 out_seq=0 2024-09-05T01:33:25.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.426+0000 7fb2ba000640 10 client.26335 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:33:25.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.426+0000 7fb2ba000640 1 -- 172.21.15.12:0/1487640521 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ca48f11e60 con 0x55ca49029700 2024-09-05T01:33:25.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.426+0000 7fb2ba000640 10 client.26335 handle_command_reply: tid=0 2024-09-05T01:33:25.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.426+0000 7fb2de0ce740 1 client.26335 shutdown 2024-09-05T01:33:25.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.427+0000 7fb2de0ce740 1 -- 172.21.15.12:0/1487640521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48fa3c70 msgr2=0x55ca48fb6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:25.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.427+0000 7fb2de0ce740 1 --2- 172.21.15.12:0/1487640521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48fa3c70 0x55ca48fb6df0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb2c802a9e0 tx=0x7fb2c8005bc0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.427+0000 7fb2de0ce740 1 -- 172.21.15.12:0/1487640521 shutdown_connections 2024-09-05T01:33:25.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.427+0000 7fb2de0ce740 1 --2- 172.21.15.12:0/1487640521 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55ca49029700 0x55ca4902bb20 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.427+0000 7fb2de0ce740 1 --2- 172.21.15.12:0/1487640521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ca48faee50 0x55ca48fa82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.427+0000 7fb2de0ce740 1 --2- 172.21.15.12:0/1487640521 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55ca48fa4590 0x55ca48fb7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.427+0000 7fb2de0ce740 1 --2- 172.21.15.12:0/1487640521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca48fa3c70 0x55ca48fb6df0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.427+0000 7fb2de0ce740 1 -- 172.21.15.12:0/1487640521 >> 172.21.15.12:0/1487640521 conn(0x55ca48fa0200 msgr2=0x55ca48fad4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:25.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.427+0000 7fb2ba000640 0 client.26335 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:33:25.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.427+0000 7fb2de0ce740 1 -- 172.21.15.12:0/1487640521 shutdown_connections 2024-09-05T01:33:25.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.427+0000 7fb2de0ce740 1 -- 172.21.15.12:0/1487640521 wait complete. 2024-09-05T01:33:25.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.428+0000 7fb2de0ce740 20 client.26335 trim_cache size 0 max 16384 2024-09-05T01:33:25.433 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:33:25.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.428+0000 7fb2db600640 1 -- 172.21.15.12:0/2771181421 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fb2bc0a2d70 msgr2=0x7fb2bc0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:25.433 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.428+0000 7fb2db600640 1 --2- 172.21.15.12:0/2771181421 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fb2bc0a2d70 0x7fb2bc0a5230 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc0045e0 tx=0x7fb2cc013040 comp rx=0 tx=0).stop 2024-09-05T01:33:25.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.428+0000 7fb2db600640 1 -- 172.21.15.12:0/2771181421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2d4077040 msgr2=0x7fb2d41a4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:25.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.428+0000 7fb2db600640 1 --2- 172.21.15.12:0/2771181421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2d4077040 0x7fb2d41a4be0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000e9f0 tx=0x7fb2c000eeb0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.429+0000 7fb2db600640 1 -- 172.21.15.12:0/2771181421 shutdown_connections 2024-09-05T01:33:25.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.429+0000 7fb2db600640 1 --2- 172.21.15.12:0/2771181421 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fb2bc0a2d70 0x7fb2bc0a5230 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.429+0000 7fb2db600640 1 --2- 172.21.15.12:0/2771181421 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb2d4112a30 0x7fb2d419e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.429+0000 7fb2db600640 1 --2- 172.21.15.12:0/2771181421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2d4077040 0x7fb2d41a4be0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.429+0000 7fb2db600640 1 --2- 172.21.15.12:0/2771181421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2d4076720 0x7fb2d41a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:25.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.429+0000 7fb2db600640 1 -- 172.21.15.12:0/2771181421 >> 172.21.15.12:0/2771181421 conn(0x7fb2d40ffa90 msgr2=0x7fb2d4101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:25.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.429+0000 7fb2db600640 1 -- 172.21.15.12:0/2771181421 shutdown_connections 2024-09-05T01:33:25.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:25.429+0000 7fb2db600640 1 -- 172.21.15.12:0/2771181421 wait complete. 2024-09-05T01:33:25.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:25 smithi012 ceph-mon[29942]: pgmap v270: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 98 KiB/s wr, 26 op/s 2024-09-05T01:33:25.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:25 smithi145 ceph-mon[34376]: pgmap v270: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 98 KiB/s wr, 26 op/s 2024-09-05T01:33:25.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:25 smithi151 ceph-mon[35013]: pgmap v270: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 98 KiB/s wr, 26 op/s 2024-09-05T01:33:26.167 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-05T01:33:26.551 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:33:27.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.131+0000 7f6565c00640 1 -- 172.21.15.12:0/768796342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6560074e30 msgr2=0x7f656010df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:27.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.131+0000 7f6565c00640 1 --2- 172.21.15.12:0/768796342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6560074e30 0x7f656010df10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f654c009900 tx=0x7f654c02a480 comp rx=0 tx=0).stop 2024-09-05T01:33:27.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.131+0000 7f6565c00640 1 -- 172.21.15.12:0/768796342 shutdown_connections 2024-09-05T01:33:27.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.131+0000 7f6565c00640 1 --2- 172.21.15.12:0/768796342 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f656010e450 0x7f6560110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.131+0000 7f6565c00640 1 --2- 172.21.15.12:0/768796342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6560074e30 0x7f656010df10 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.131+0000 7f6565c00640 1 --2- 172.21.15.12:0/768796342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6560074510 0x7f65600748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.131+0000 7f6565c00640 1 -- 172.21.15.12:0/768796342 >> 172.21.15.12:0/768796342 conn(0x7f65600fd8b0 msgr2=0x7f65600ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:27.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.131+0000 7f6565c00640 1 -- 172.21.15.12:0/768796342 shutdown_connections 2024-09-05T01:33:27.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.131+0000 7f6565c00640 1 -- 172.21.15.12:0/768796342 wait complete. 2024-09-05T01:33:27.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.132+0000 7f6565c00640 1 Processor -- start 2024-09-05T01:33:27.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.133+0000 7f6565c00640 1 -- start start 2024-09-05T01:33:27.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.133+0000 7f6565c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6560074510 0x7f656019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:27.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.133+0000 7f6565c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6560074e30 0x7f656019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:27.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.133+0000 7f6565c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f656010e450 0x7f656019ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:27.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.133+0000 7f6565c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f65601141a0 con 0x7f656010e450 2024-09-05T01:33:27.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.133+0000 7f6565c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6560114020 con 0x7f6560074510 2024-09-05T01:33:27.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.133+0000 7f6565c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6560114320 con 0x7f6560074e30 2024-09-05T01:33:27.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.133+0000 7f655ea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6560074510 0x7f656019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:27.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.133+0000 7f655e000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6560074e30 0x7f656019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:27.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.133+0000 7f655ea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6560074510 0x7f656019a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:50740/0 (socket says 172.21.15.12:50740) 2024-09-05T01:33:27.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.133+0000 7f655ea00640 1 -- 172.21.15.12:0/259412690 learned_addr learned my addr 172.21.15.12:0/259412690 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:27.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.133+0000 7f655f400640 1 --2- 172.21.15.12:0/259412690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f656010e450 0x7f656019ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:27.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.134+0000 7f655e000640 1 -- 172.21.15.12:0/259412690 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6560074510 msgr2=0x7f656019a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:27.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.134+0000 7f655e000640 1 --2- 172.21.15.12:0/259412690 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6560074510 0x7f656019a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.134+0000 7f655e000640 1 -- 172.21.15.12:0/259412690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f656010e450 msgr2=0x7f656019ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:27.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.134+0000 7f655e000640 1 --2- 172.21.15.12:0/259412690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f656010e450 0x7f656019ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.134+0000 7f655e000640 1 -- 172.21.15.12:0/259412690 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f656019f630 con 0x7f6560074e30 2024-09-05T01:33:27.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.134+0000 7f655f400640 1 --2- 172.21.15.12:0/259412690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f656010e450 0x7f656019ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:33:27.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.134+0000 7f655e000640 1 --2- 172.21.15.12:0/259412690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6560074e30 0x7f656019abc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f654c02a9a0 tx=0x7f654c003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:27.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.134+0000 7f6557400640 1 -- 172.21.15.12:0/259412690 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654c03f070 con 0x7f6560074e30 2024-09-05T01:33:27.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.134+0000 7f6565c00640 1 -- 172.21.15.12:0/259412690 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f656019f8c0 con 0x7f6560074e30 2024-09-05T01:33:27.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.134+0000 7f6557400640 1 -- 172.21.15.12:0/259412690 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f654c031c90 con 0x7f6560074e30 2024-09-05T01:33:27.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.134+0000 7f6557400640 1 -- 172.21.15.12:0/259412690 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654c035030 con 0x7f6560074e30 2024-09-05T01:33:27.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.134+0000 7f6565c00640 1 -- 172.21.15.12:0/259412690 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65601a7200 con 0x7f6560074e30 2024-09-05T01:33:27.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.137+0000 7f65686b8740 1 Processor -- start 2024-09-05T01:33:27.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.138+0000 7f65686b8740 1 -- start start 2024-09-05T01:33:27.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.138+0000 7f6557400640 1 -- 172.21.15.12:0/259412690 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f654c042070 con 0x7f6560074e30 2024-09-05T01:33:27.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.138+0000 7f65686b8740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41d9c70 0x55f4c41da050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:27.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.138+0000 7f65686b8740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4c41da590 0x55f4c41e4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:27.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.138+0000 7f65686b8740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4c41e4e50 0x55f4c41e7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:27.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.138+0000 7f65686b8740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f4c41403e0 con 0x55f4c41da590 2024-09-05T01:33:27.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.138+0000 7f65686b8740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55f4c40e7d80 con 0x55f4c41d9c70 2024-09-05T01:33:27.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.138+0000 7f65686b8740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f4c413c3a0 con 0x55f4c41e4e50 2024-09-05T01:33:27.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.138+0000 7f655f400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41d9c70 0x55f4c41da050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:27.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.138+0000 7f655f400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41d9c70 0x55f4c41da050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:50756/0 (socket says 172.21.15.12:50756) 2024-09-05T01:33:27.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.138+0000 7f655f400640 1 -- 172.21.15.12:0/2134543718 learned_addr learned my addr 172.21.15.12:0/2134543718 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:27.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.138+0000 7f655ea00640 1 --2- 172.21.15.12:0/2134543718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4c41da590 0x55f4c41e4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:27.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.139+0000 7f655e000640 1 --2- 172.21.15.12:0/2134543718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4c41e4e50 0x55f4c41e7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:27.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.139+0000 7f655f400640 1 -- 172.21.15.12:0/2134543718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4c41e4e50 msgr2=0x55f4c41e7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:27.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.139+0000 7f655f400640 1 --2- 172.21.15.12:0/2134543718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4c41e4e50 0x55f4c41e7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.139+0000 7f655f400640 1 -- 172.21.15.12:0/2134543718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4c41da590 msgr2=0x55f4c41e4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:27.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.139+0000 7f655f400640 1 --2- 172.21.15.12:0/2134543718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4c41da590 0x55f4c41e4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.139+0000 7f655f400640 1 -- 172.21.15.12:0/2134543718 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4c4106ae0 con 0x55f4c41d9c70 2024-09-05T01:33:27.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.139+0000 7f655e000640 1 --2- 172.21.15.12:0/2134543718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4c41e4e50 0x55f4c41e7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:33:27.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.139+0000 7f655f400640 1 --2- 172.21.15.12:0/2134543718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41d9c70 0x55f4c41da050 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6558009fc0 tx=0x7f6558010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11180c2e3f2fa421 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:27.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.139+0000 7f654be00640 1 -- 172.21.15.12:0/2134543718 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6558011700 con 0x55f4c41d9c70 2024-09-05T01:33:27.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.140+0000 7f654be00640 1 -- 172.21.15.12:0/2134543718 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6558011d80 con 0x55f4c41d9c70 2024-09-05T01:33:27.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.140+0000 7f654be00640 1 -- 172.21.15.12:0/2134543718 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655801a380 con 0x55f4c41d9c70 2024-09-05T01:33:27.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.140+0000 7f6557400640 1 --2- 172.21.15.12:0/259412690 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f65440a2d70 0x7f65440a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:27.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.140+0000 7f6557400640 1 -- 172.21.15.12:0/259412690 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8579+0+0 (secure 0 0 0) 0x7f654c0efda0 con 0x7f6560074e30 2024-09-05T01:33:27.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.140+0000 7f655ea00640 1 --2- 172.21.15.12:0/259412690 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f65440a2d70 0x7f65440a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:27.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.140+0000 7f65686b8740 1 -- 172.21.15.12:0/2134543718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41d9c70 msgr2=0x55f4c41da050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:27.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.140+0000 7f65686b8740 1 --2- 172.21.15.12:0/2134543718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41d9c70 0x55f4c41da050 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6558009fc0 tx=0x7f6558010860 comp rx=0 tx=0).stop 2024-09-05T01:33:27.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.140+0000 7f65686b8740 1 -- 172.21.15.12:0/2134543718 shutdown_connections 2024-09-05T01:33:27.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.140+0000 7f65686b8740 1 --2- 172.21.15.12:0/2134543718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4c41e4e50 0x55f4c41e7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.140+0000 7f65686b8740 1 --2- 172.21.15.12:0/2134543718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4c41da590 0x55f4c41e4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.140+0000 7f65686b8740 1 --2- 172.21.15.12:0/2134543718 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41d9c70 0x55f4c41da050 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.140+0000 7f65686b8740 1 -- 172.21.15.12:0/2134543718 >> 172.21.15.12:0/2134543718 conn(0x55f4c41d6200 msgr2=0x55f4c41d65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:27.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.141+0000 7f65686b8740 1 -- 172.21.15.12:0/2134543718 shutdown_connections 2024-09-05T01:33:27.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.141+0000 7f65686b8740 1 -- 172.21.15.12:0/2134543718 wait complete. 2024-09-05T01:33:27.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.141+0000 7f655ea00640 1 --2- 172.21.15.12:0/259412690 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f65440a2d70 0x7f65440a5230 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55f4c41d7060 tx=0x7f6550005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:27.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.141+0000 7f65686b8740 1 -- start start 2024-09-05T01:33:27.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.141+0000 7f65686b8740 1 Processor -- start 2024-09-05T01:33:27.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.142+0000 7f65686b8740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41d9c70 0x55f4c41e1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:27.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.142+0000 7f65686b8740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4c41da590 0x55f4c41e22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:27.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.142+0000 7f65686b8740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4c41e4e50 0x55f4c41e2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:27.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.142+0000 7f65686b8740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f4c41e7a20 con 0x55f4c41e4e50 2024-09-05T01:33:27.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.142+0000 7f65686b8740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55f4c40fb0f0 con 0x55f4c41d9c70 2024-09-05T01:33:27.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.142+0000 7f65686b8740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f4c41e7ba0 con 0x55f4c41da590 2024-09-05T01:33:27.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.142+0000 7f65686b8740 10 client.0 _ll_register_callbacks cb 0x55f4c40e2bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:33:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.142+0000 7f655e000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4c41da590 0x55f4c41e22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.142+0000 7f655ea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41d9c70 0x55f4c41e1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.142+0000 7f655e000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4c41da590 0x55f4c41e22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:53584/0 (socket says 172.21.15.12:53584) 2024-09-05T01:33:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.142+0000 7f655e000640 1 -- 172.21.15.12:0/2625773191 learned_addr learned my addr 172.21.15.12:0/2625773191 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.142+0000 7f655ea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41d9c70 0x55f4c41e1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:50762/0 (socket says 172.21.15.12:50762) 2024-09-05T01:33:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.142+0000 7f655f400640 1 --2- 172.21.15.12:0/2625773191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4c41e4e50 0x55f4c41e2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.143+0000 7f655e000640 1 -- 172.21.15.12:0/2625773191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41d9c70 msgr2=0x55f4c41e1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.143+0000 7f655e000640 1 --2- 172.21.15.12:0/2625773191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41d9c70 0x55f4c41e1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.143+0000 7f655e000640 1 -- 172.21.15.12:0/2625773191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4c41e4e50 msgr2=0x55f4c41e2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.143+0000 7f655e000640 1 --2- 172.21.15.12:0/2625773191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4c41e4e50 0x55f4c41e2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.143+0000 7f655e000640 1 -- 172.21.15.12:0/2625773191 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4c3eb13c0 con 0x55f4c41da590 2024-09-05T01:33:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.143+0000 7f655ea00640 1 --2- 172.21.15.12:0/2625773191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41d9c70 0x55f4c41e1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:33:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.143+0000 7f655e000640 1 --2- 172.21.15.12:0/2625773191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4c41da590 0x55f4c41e22c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f654c0bbf80 tx=0x7f654c031490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8303949334127d6c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.143+0000 7f6548c00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:33:27.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.143+0000 7f6548c00640 1 -- 172.21.15.12:0/2625773191 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654c049030 con 0x55f4c41da590 2024-09-05T01:33:27.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.143+0000 7f6548c00640 1 -- 172.21.15.12:0/2625773191 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8579+0+0 (secure 0 0 0) 0x7f654c0ed730 con 0x55f4c41da590 2024-09-05T01:33:27.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.143+0000 7f65686b8740 1 -- 172.21.15.12:0/2625773191 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6558011d80 con 0x55f4c41da590 2024-09-05T01:33:27.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.143+0000 7f6548c00640 1 -- 172.21.15.12:0/2625773191 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f654c0bc280 con 0x55f4c41da590 2024-09-05T01:33:27.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.143+0000 7f65686b8740 10 client.26344 fetch_fsmap learned FSMap version 48 2024-09-05T01:33:27.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.143+0000 7f65686b8740 1 -- 172.21.15.12:0/2625773191 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55f4c41e7a80 con 0x55f4c41da590 2024-09-05T01:33:27.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.144+0000 7f6548c00640 1 -- 172.21.15.12:0/2625773191 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6558011d80 con 0x55f4c41da590 2024-09-05T01:33:27.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.144+0000 7f6548c00640 1 -- 172.21.15.12:0/2625773191 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 48) ==== 8426+0+0 (secure 0 0 0) 0x7f654c0b88f0 con 0x55f4c41da590 2024-09-05T01:33:27.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.144+0000 7f65686b8740 10 client.26344 fetch_fsmap finished waiting for FSMap version 48 2024-09-05T01:33:27.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.144+0000 7f65686b8740 10 client.26344 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:33:27.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.144+0000 7f65686b8740 20 client.26344 populate_metadata read hostname 'smithi012' 2024-09-05T01:33:27.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.144+0000 7f65686b8740 1 --2- 172.21.15.12:0/2625773191 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f4c41f4e10 0x55f4c41f72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:27.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.144+0000 7f65686b8740 4 client.26344 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:33:27.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.144+0000 7f65686b8740 1 -- 172.21.15.12:0/2625773191 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4c414d950 con 0x55f4c41f4e10 2024-09-05T01:33:27.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.145+0000 7f655ea00640 1 --2- 172.21.15.12:0/2625773191 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f4c41f4e10 0x55f4c41f72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:27.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.145+0000 7f655ea00640 1 --2- 172.21.15.12:0/2625773191 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f4c41f4e10 0x55f4c41f72b0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf18edbbfedebd8d server_cookie=7b1ed6d3deda5bd1 in_seq=0 out_seq=0 2024-09-05T01:33:27.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.145+0000 7f6548c00640 10 client.26344 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:33:27.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.146+0000 7f6548c00640 1 -- 172.21.15.12:0/2625773191 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f4c414d950 con 0x55f4c41f4e10 2024-09-05T01:33:27.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.146+0000 7f6548c00640 10 client.26344 handle_command_reply: tid=0 2024-09-05T01:33:27.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.146+0000 7f65686b8740 1 client.26344 shutdown 2024-09-05T01:33:27.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.146+0000 7f65686b8740 1 -- 172.21.15.12:0/2625773191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4c41da590 msgr2=0x55f4c41e22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:27.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.146+0000 7f65686b8740 1 --2- 172.21.15.12:0/2625773191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4c41da590 0x55f4c41e22c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f654c0bbf80 tx=0x7f654c031490 comp rx=0 tx=0).stop 2024-09-05T01:33:27.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.146+0000 7f65686b8740 1 -- 172.21.15.12:0/2625773191 shutdown_connections 2024-09-05T01:33:27.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.146+0000 7f65686b8740 1 --2- 172.21.15.12:0/2625773191 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f4c41f4e10 0x55f4c41f72b0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.146+0000 7f65686b8740 1 --2- 172.21.15.12:0/2625773191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4c41e4e50 0x55f4c41e2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.146+0000 7f65686b8740 1 --2- 172.21.15.12:0/2625773191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4c41da590 0x55f4c41e22c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.146+0000 7f65686b8740 1 --2- 172.21.15.12:0/2625773191 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41d9c70 0x55f4c41e1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.146+0000 7f6548c00640 0 client.26344 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:33:27.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.146+0000 7f65686b8740 1 -- 172.21.15.12:0/2625773191 >> 172.21.15.12:0/2625773191 conn(0x55f4c41d6200 msgr2=0x55f4c41dbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:27.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.146+0000 7f65686b8740 1 -- 172.21.15.12:0/2625773191 shutdown_connections 2024-09-05T01:33:27.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.146+0000 7f65686b8740 1 -- 172.21.15.12:0/2625773191 wait complete. 2024-09-05T01:33:27.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.146+0000 7f65686b8740 20 client.26344 trim_cache size 0 max 16384 2024-09-05T01:33:27.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.160+0000 7f65686b8740 1 Processor -- start 2024-09-05T01:33:27.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.160+0000 7f65686b8740 1 -- start start 2024-09-05T01:33:27.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.160+0000 7f65686b8740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41d9c70 0x55f4c41dc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:27.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.160+0000 7f65686b8740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4c41da590 0x55f4c41e3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:27.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.160+0000 7f65686b8740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4c41e4e50 0x55f4c41fcb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:27.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.160+0000 7f65686b8740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f65601afb30 con 0x55f4c41da590 2024-09-05T01:33:27.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.160+0000 7f65686b8740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f65601b1820 con 0x55f4c41d9c70 2024-09-05T01:33:27.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.160+0000 7f65686b8740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f65601b0200 con 0x55f4c41e4e50 2024-09-05T01:33:27.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.161+0000 7f655ea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41d9c70 0x55f4c41dc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:27.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.161+0000 7f655e000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4c41da590 0x55f4c41e3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:27.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.161+0000 7f655ea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41d9c70 0x55f4c41dc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:50778/0 (socket says 172.21.15.12:50778) 2024-09-05T01:33:27.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.161+0000 7f655f400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4c41e4e50 0x55f4c41fcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:27.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.161+0000 7f655ea00640 1 -- 172.21.15.12:0/2092662007 learned_addr learned my addr 172.21.15.12:0/2092662007 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:27.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.161+0000 7f655ea00640 1 -- 172.21.15.12:0/2092662007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4c41e4e50 msgr2=0x55f4c41fcb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:27.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.161+0000 7f655ea00640 1 --2- 172.21.15.12:0/2092662007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4c41e4e50 0x55f4c41fcb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.161+0000 7f655ea00640 1 -- 172.21.15.12:0/2092662007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4c41da590 msgr2=0x55f4c41e3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:27.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.161+0000 7f655ea00640 1 --2- 172.21.15.12:0/2092662007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4c41da590 0x55f4c41e3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.161+0000 7f655ea00640 1 -- 172.21.15.12:0/2092662007 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4c41d72b0 con 0x55f4c41d9c70 2024-09-05T01:33:27.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.161+0000 7f655ea00640 1 --2- 172.21.15.12:0/2092662007 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41d9c70 0x55f4c41dc720 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6550009b90 tx=0x7f655001b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=246edce74316b88 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:27.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.162+0000 7f654b400640 1 -- 172.21.15.12:0/2092662007 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6550039070 con 0x55f4c41d9c70 2024-09-05T01:33:27.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.162+0000 7f654b400640 1 -- 172.21.15.12:0/2092662007 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f655000f960 con 0x55f4c41d9c70 2024-09-05T01:33:27.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.162+0000 7f654b400640 1 -- 172.21.15.12:0/2092662007 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f655002ca90 con 0x55f4c41d9c70 2024-09-05T01:33:27.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.162+0000 7f65686b8740 1 -- 172.21.15.12:0/2092662007 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41d9c70 msgr2=0x55f4c41dc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:27.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.162+0000 7f65686b8740 1 --2- 172.21.15.12:0/2092662007 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41d9c70 0x55f4c41dc720 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6550009b90 tx=0x7f655001b000 comp rx=0 tx=0).stop 2024-09-05T01:33:27.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.162+0000 7f65686b8740 1 -- 172.21.15.12:0/2092662007 shutdown_connections 2024-09-05T01:33:27.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.162+0000 7f65686b8740 1 --2- 172.21.15.12:0/2092662007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4c41e4e50 0x55f4c41fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.162+0000 7f65686b8740 1 --2- 172.21.15.12:0/2092662007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4c41da590 0x55f4c41e3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.162+0000 7f65686b8740 1 --2- 172.21.15.12:0/2092662007 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41d9c70 0x55f4c41dc720 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.162+0000 7f65686b8740 1 -- 172.21.15.12:0/2092662007 >> 172.21.15.12:0/2092662007 conn(0x55f4c41d6200 msgr2=0x55f4c41e35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:27.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.163+0000 7f65686b8740 1 -- 172.21.15.12:0/2092662007 shutdown_connections 2024-09-05T01:33:27.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.163+0000 7f65686b8740 1 -- 172.21.15.12:0/2092662007 wait complete. 2024-09-05T01:33:27.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.163+0000 7f65686b8740 1 -- start start 2024-09-05T01:33:27.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.163+0000 7f65686b8740 1 Processor -- start 2024-09-05T01:33:27.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.164+0000 7f65686b8740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4c41d9c70 0x55f4c41ed4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:27.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.164+0000 7f65686b8740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41da590 0x55f4c41e8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:27.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.164+0000 7f65686b8740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4c41e4e50 0x55f4c41e8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:27.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.164+0000 7f65686b8740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f65601b1090 con 0x55f4c41d9c70 2024-09-05T01:33:27.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.164+0000 7f65686b8740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f65601b0900 con 0x55f4c41da590 2024-09-05T01:33:27.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.164+0000 7f65686b8740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f65601adb30 con 0x55f4c41e4e50 2024-09-05T01:33:27.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.164+0000 7f65686b8740 10 client.0 _ll_register_callbacks cb 0x7f654c005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:33:27.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.164+0000 7f655e000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41da590 0x55f4c41e8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:27.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.164+0000 7f655f400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4c41e4e50 0x55f4c41e8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:27.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.164+0000 7f655e000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41da590 0x55f4c41e8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:50784/0 (socket says 172.21.15.12:50784) 2024-09-05T01:33:27.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.164+0000 7f655ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4c41d9c70 0x55f4c41ed4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:27.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.164+0000 7f655e000640 1 -- 172.21.15.12:0/2384119400 learned_addr learned my addr 172.21.15.12:0/2384119400 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:27.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.164+0000 7f655e000640 1 -- 172.21.15.12:0/2384119400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4c41e4e50 msgr2=0x55f4c41e8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:27.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.164+0000 7f655e000640 1 --2- 172.21.15.12:0/2384119400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4c41e4e50 0x55f4c41e8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.164+0000 7f655e000640 1 -- 172.21.15.12:0/2384119400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4c41d9c70 msgr2=0x55f4c41ed4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:27.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.164+0000 7f655e000640 1 --2- 172.21.15.12:0/2384119400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4c41d9c70 0x55f4c41ed4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.164+0000 7f655e000640 1 -- 172.21.15.12:0/2384119400 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4c41d6e90 con 0x55f4c41da590 2024-09-05T01:33:27.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.164+0000 7f655f400640 1 --2- 172.21.15.12:0/2384119400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4c41e4e50 0x55f4c41e8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:33:27.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.165+0000 7f655e000640 1 --2- 172.21.15.12:0/2384119400 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41da590 0x55f4c41e8810 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f654c003fd0 tx=0x7f654c009680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e51255de19412947 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:27.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.165+0000 7f6548c00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:33:27.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.165+0000 7f6548c00640 1 -- 172.21.15.12:0/2384119400 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654c049050 con 0x55f4c41da590 2024-09-05T01:33:27.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.165+0000 7f6548c00640 1 -- 172.21.15.12:0/2384119400 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8579+0+0 (secure 0 0 0) 0x7f654c0b88f0 con 0x55f4c41da590 2024-09-05T01:33:27.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.165+0000 7f65686b8740 1 -- 172.21.15.12:0/2384119400 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f655000f960 con 0x55f4c41da590 2024-09-05T01:33:27.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.165+0000 7f6548c00640 1 -- 172.21.15.12:0/2384119400 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f654c0bc050 con 0x55f4c41da590 2024-09-05T01:33:27.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.165+0000 7f65686b8740 10 client.26360 fetch_fsmap learned FSMap version 48 2024-09-05T01:33:27.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.165+0000 7f65686b8740 1 -- 172.21.15.12:0/2384119400 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55f4c41d1770 con 0x55f4c41da590 2024-09-05T01:33:27.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.165+0000 7f6548c00640 1 -- 172.21.15.12:0/2384119400 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f655000f960 con 0x55f4c41da590 2024-09-05T01:33:27.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.165+0000 7f6548c00640 1 -- 172.21.15.12:0/2384119400 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 48) ==== 8426+0+0 (secure 0 0 0) 0x7f654c0f2070 con 0x55f4c41da590 2024-09-05T01:33:27.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.166+0000 7f65686b8740 10 client.26360 fetch_fsmap finished waiting for FSMap version 48 2024-09-05T01:33:27.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.166+0000 7f65686b8740 10 client.26360 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:33:27.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.166+0000 7f65686b8740 20 client.26360 populate_metadata read hostname 'smithi012' 2024-09-05T01:33:27.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.166+0000 7f65686b8740 1 --2- 172.21.15.12:0/2384119400 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f4c425fdb0 0x55f4c42621d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:27.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.166+0000 7f65686b8740 4 client.26360 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:33:27.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.166+0000 7f65686b8740 1 -- 172.21.15.12:0/2384119400 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f4c4147e60 con 0x55f4c425fdb0 2024-09-05T01:33:27.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.166+0000 7f655ea00640 1 --2- 172.21.15.12:0/2384119400 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f4c425fdb0 0x55f4c42621d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:27.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.166+0000 7f655ea00640 1 --2- 172.21.15.12:0/2384119400 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f4c425fdb0 0x55f4c42621d0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf7e23f186de5da2 server_cookie=abe322db6a812374 in_seq=0 out_seq=0 2024-09-05T01:33:27.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.166+0000 7f6548c00640 10 client.26360 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:33:27.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.167+0000 7f6548c00640 1 -- 172.21.15.12:0/2384119400 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f4c4147e60 con 0x55f4c425fdb0 2024-09-05T01:33:27.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.167+0000 7f6548c00640 10 client.26360 handle_command_reply: tid=0 2024-09-05T01:33:27.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.167+0000 7f65686b8740 1 client.26360 shutdown 2024-09-05T01:33:27.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.167+0000 7f65686b8740 1 -- 172.21.15.12:0/2384119400 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41da590 msgr2=0x55f4c41e8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:27.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.167+0000 7f65686b8740 1 --2- 172.21.15.12:0/2384119400 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41da590 0x55f4c41e8810 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f654c003fd0 tx=0x7f654c009680 comp rx=0 tx=0).stop 2024-09-05T01:33:27.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.167+0000 7f65686b8740 1 -- 172.21.15.12:0/2384119400 shutdown_connections 2024-09-05T01:33:27.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.167+0000 7f65686b8740 1 --2- 172.21.15.12:0/2384119400 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f4c425fdb0 0x55f4c42621d0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.167+0000 7f65686b8740 1 --2- 172.21.15.12:0/2384119400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4c41e4e50 0x55f4c41e8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.167+0000 7f65686b8740 1 --2- 172.21.15.12:0/2384119400 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f4c41da590 0x55f4c41e8810 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.167+0000 7f65686b8740 1 --2- 172.21.15.12:0/2384119400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4c41d9c70 0x55f4c41ed4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.167+0000 7f6548c00640 0 client.26360 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:33:27.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.167+0000 7f65686b8740 1 -- 172.21.15.12:0/2384119400 >> 172.21.15.12:0/2384119400 conn(0x55f4c41d6200 msgr2=0x55f4c41e3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:27.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.167+0000 7f65686b8740 1 -- 172.21.15.12:0/2384119400 shutdown_connections 2024-09-05T01:33:27.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.167+0000 7f65686b8740 1 -- 172.21.15.12:0/2384119400 wait complete. 2024-09-05T01:33:27.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.167+0000 7f65686b8740 20 client.26360 trim_cache size 0 max 16384 2024-09-05T01:33:27.172 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:33:27.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.168+0000 7f6565c00640 1 -- 172.21.15.12:0/259412690 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f65440a2d70 msgr2=0x7f65440a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:27.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.168+0000 7f6565c00640 1 --2- 172.21.15.12:0/259412690 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f65440a2d70 0x7f65440a5230 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55f4c41d7060 tx=0x7f6550005f90 comp rx=0 tx=0).stop 2024-09-05T01:33:27.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.168+0000 7f6565c00640 1 -- 172.21.15.12:0/259412690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6560074e30 msgr2=0x7f656019abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:27.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.168+0000 7f6565c00640 1 --2- 172.21.15.12:0/259412690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6560074e30 0x7f656019abc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f654c02a9a0 tx=0x7f654c003b20 comp rx=0 tx=0).stop 2024-09-05T01:33:27.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.168+0000 7f6565c00640 1 -- 172.21.15.12:0/259412690 shutdown_connections 2024-09-05T01:33:27.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.168+0000 7f6565c00640 1 --2- 172.21.15.12:0/259412690 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f65440a2d70 0x7f65440a5230 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.168+0000 7f6565c00640 1 --2- 172.21.15.12:0/259412690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f656010e450 0x7f656019ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.168+0000 7f6565c00640 1 --2- 172.21.15.12:0/259412690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6560074e30 0x7f656019abc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.168+0000 7f6565c00640 1 --2- 172.21.15.12:0/259412690 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6560074510 0x7f656019a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:27.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.168+0000 7f6565c00640 1 -- 172.21.15.12:0/259412690 >> 172.21.15.12:0/259412690 conn(0x7f65600fd8b0 msgr2=0x7f65600fef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:27.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.168+0000 7f6565c00640 1 -- 172.21.15.12:0/259412690 shutdown_connections 2024-09-05T01:33:27.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:27.168+0000 7f6565c00640 1 -- 172.21.15.12:0/259412690 wait complete. 2024-09-05T01:33:27.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:27 smithi012 ceph-mon[29942]: pgmap v271: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 314 KiB/s wr, 27 op/s 2024-09-05T01:33:27.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:27 smithi145 ceph-mon[34376]: pgmap v271: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 314 KiB/s wr, 27 op/s 2024-09-05T01:33:27.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:27 smithi151 ceph-mon[35013]: pgmap v271: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 314 KiB/s wr, 27 op/s 2024-09-05T01:33:29.312 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-05T01:33:29.313 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-05T01:33:29.738 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:33:29.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:29 smithi012 ceph-mon[29942]: pgmap v272: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 61 op/s 2024-09-05T01:33:29.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:29 smithi145 ceph-mon[34376]: pgmap v272: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 61 op/s 2024-09-05T01:33:29.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:29 smithi151 ceph-mon[35013]: pgmap v272: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 61 op/s 2024-09-05T01:33:30.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.261+0000 7f1dbea00640 1 -- 172.21.15.12:0/2078160017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1db8103ff0 msgr2=0x7f1db81043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:30.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.261+0000 7f1dbea00640 1 --2- 172.21.15.12:0/2078160017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1db8103ff0 0x7f1db81043d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1da8009860 tx=0x7f1da802a340 comp rx=0 tx=0).stop 2024-09-05T01:33:30.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.261+0000 7f1dbea00640 1 -- 172.21.15.12:0/2078160017 shutdown_connections 2024-09-05T01:33:30.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.261+0000 7f1dbea00640 1 --2- 172.21.15.12:0/2078160017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1db8109120 0x7f1db8110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.261+0000 7f1dbea00640 1 --2- 172.21.15.12:0/2078160017 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1db81049a0 0x7f1db81089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.261+0000 7f1dbea00640 1 --2- 172.21.15.12:0/2078160017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1db8103ff0 0x7f1db81043d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.261+0000 7f1dbea00640 1 -- 172.21.15.12:0/2078160017 >> 172.21.15.12:0/2078160017 conn(0x7f1db80ffa90 msgr2=0x7f1db8101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:30.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.261+0000 7f1dbea00640 1 -- 172.21.15.12:0/2078160017 shutdown_connections 2024-09-05T01:33:30.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.261+0000 7f1dbea00640 1 -- 172.21.15.12:0/2078160017 wait complete. 2024-09-05T01:33:30.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.262+0000 7f1dbea00640 1 Processor -- start 2024-09-05T01:33:30.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.262+0000 7f1dbea00640 1 -- start start 2024-09-05T01:33:30.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.263+0000 7f1dbea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1db8103ff0 0x7f1db819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:30.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.263+0000 7f1dbea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1db81049a0 0x7f1db819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:30.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.263+0000 7f1dbea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1db8109120 0x7f1db819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:30.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.263+0000 7f1dbea00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1db8114120 con 0x7f1db8103ff0 2024-09-05T01:33:30.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.263+0000 7f1dbea00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1db8113fa0 con 0x7f1db81049a0 2024-09-05T01:33:30.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.263+0000 7f1dbea00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1db81142a0 con 0x7f1db8109120 2024-09-05T01:33:30.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.263+0000 7f1db7e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1db8103ff0 0x7f1db819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:30.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.263+0000 7f1db7e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1db8103ff0 0x7f1db819a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38452/0 (socket says 172.21.15.12:38452) 2024-09-05T01:33:30.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.263+0000 7f1db7e00640 1 -- 172.21.15.12:0/3665561497 learned_addr learned my addr 172.21.15.12:0/3665561497 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:30.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.263+0000 7f1dbca00640 1 --2- 172.21.15.12:0/3665561497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1db8109120 0x7f1db819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:30.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.263+0000 7f1daf400640 1 --2- 172.21.15.12:0/3665561497 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1db81049a0 0x7f1db819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:30.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.263+0000 7f1db7e00640 1 -- 172.21.15.12:0/3665561497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1db8109120 msgr2=0x7f1db819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:30.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.263+0000 7f1db7e00640 1 --2- 172.21.15.12:0/3665561497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1db8109120 0x7f1db819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.263+0000 7f1db7e00640 1 -- 172.21.15.12:0/3665561497 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1db81049a0 msgr2=0x7f1db819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:30.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.263+0000 7f1db7e00640 1 --2- 172.21.15.12:0/3665561497 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1db81049a0 0x7f1db819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.263+0000 7f1db7e00640 1 -- 172.21.15.12:0/3665561497 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1db819f5d0 con 0x7f1db8103ff0 2024-09-05T01:33:30.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.264+0000 7f1db7e00640 1 --2- 172.21.15.12:0/3665561497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1db8103ff0 0x7f1db819a620 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1da8035040 tx=0x7f1da8033d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:30.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.264+0000 7f1db5600640 1 -- 172.21.15.12:0/3665561497 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da803f020 con 0x7f1db8103ff0 2024-09-05T01:33:30.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.264+0000 7f1db5600640 1 -- 172.21.15.12:0/3665561497 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1da8032770 con 0x7f1db8103ff0 2024-09-05T01:33:30.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.264+0000 7f1dbea00640 1 -- 172.21.15.12:0/3665561497 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1db819f860 con 0x7f1db8103ff0 2024-09-05T01:33:30.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.264+0000 7f1db5600640 1 -- 172.21.15.12:0/3665561497 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da8037040 con 0x7f1db8103ff0 2024-09-05T01:33:30.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.264+0000 7f1dbea00640 1 -- 172.21.15.12:0/3665561497 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1db81a71a0 con 0x7f1db8103ff0 2024-09-05T01:33:30.268 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.267+0000 7f1db5600640 1 -- 172.21.15.12:0/3665561497 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f1da8042020 con 0x7f1db8103ff0 2024-09-05T01:33:30.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.268+0000 7f1dc142e740 1 Processor -- start 2024-09-05T01:33:30.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.268+0000 7f1dc142e740 1 -- start start 2024-09-05T01:33:30.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.268+0000 7f1dc142e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768d6ac0 0x5646768d6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:30.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.268+0000 7f1dc142e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646768d73e0 0x5646768e1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:30.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.268+0000 7f1dc142e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646768e1ca0 0x5646768e4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:30.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.268+0000 7f1dc142e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56467683d290 con 0x5646768e1ca0 2024-09-05T01:33:30.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.268+0000 7f1dc142e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5646767e4b40 con 0x5646768d73e0 2024-09-05T01:33:30.271 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.268+0000 7f1dc142e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564676839250 con 0x5646768d6ac0 2024-09-05T01:33:30.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.269+0000 7f1dbca00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768d6ac0 0x5646768d6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:30.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.269+0000 7f1db7e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646768d73e0 0x5646768e1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:30.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.269+0000 7f1db5600640 1 --2- 172.21.15.12:0/3665561497 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1d980a2cf0 0x7f1d980a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:30.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.269+0000 7f1dbca00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768d6ac0 0x5646768d6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:53616/0 (socket says 172.21.15.12:53616) 2024-09-05T01:33:30.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.269+0000 7f1dbca00640 1 -- 172.21.15.12:0/3492086176 learned_addr learned my addr 172.21.15.12:0/3492086176 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:30.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.269+0000 7f1daf400640 1 --2- 172.21.15.12:0/3492086176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646768e1ca0 0x5646768e4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:30.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.269+0000 7f1dbca00640 1 --2- 172.21.15.12:0/3665561497 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1d980a2cf0 0x7f1d980a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:30.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.269+0000 7f1db7e00640 1 -- 172.21.15.12:0/3492086176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768d6ac0 msgr2=0x5646768d6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:30.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.269+0000 7f1db7e00640 1 --2- 172.21.15.12:0/3492086176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768d6ac0 0x5646768d6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.269+0000 7f1db7e00640 1 -- 172.21.15.12:0/3492086176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646768e1ca0 msgr2=0x5646768e4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:30.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.269+0000 7f1db7e00640 1 --2- 172.21.15.12:0/3492086176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646768e1ca0 0x5646768e4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.269+0000 7f1db7e00640 1 -- 172.21.15.12:0/3492086176 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646765ae6a0 con 0x5646768d73e0 2024-09-05T01:33:30.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.269+0000 7f1daf400640 1 --2- 172.21.15.12:0/3492086176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646768e1ca0 0x5646768e4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:33:30.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.269+0000 7f1db5600640 1 -- 172.21.15.12:0/3665561497 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8579+0+0 (secure 0 0 0) 0x7f1da80ef5a0 con 0x7f1db8103ff0 2024-09-05T01:33:30.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.270+0000 7f1db7e00640 1 --2- 172.21.15.12:0/3492086176 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646768d73e0 0x5646768e1760 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1da80ecd60 tx=0x7f1da807bc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e327fabd1efb569 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:30.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.270+0000 7f1dad200640 1 -- 172.21.15.12:0/3492086176 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da80bce60 con 0x5646768d73e0 2024-09-05T01:33:30.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.270+0000 7f1dad200640 1 -- 172.21.15.12:0/3492086176 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1da80bbb30 con 0x5646768d73e0 2024-09-05T01:33:30.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.270+0000 7f1dad200640 1 -- 172.21.15.12:0/3492086176 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da80b9c60 con 0x5646768d73e0 2024-09-05T01:33:30.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.271+0000 7f1dc142e740 1 -- 172.21.15.12:0/3492086176 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646768d73e0 msgr2=0x5646768e1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:30.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.271+0000 7f1dbca00640 1 --2- 172.21.15.12:0/3665561497 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1d980a2cf0 0x7f1d980a51b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1db0009820 tx=0x7f1db0004730 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:30.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.271+0000 7f1dc142e740 1 --2- 172.21.15.12:0/3492086176 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646768d73e0 0x5646768e1760 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1da80ecd60 tx=0x7f1da807bc00 comp rx=0 tx=0).stop 2024-09-05T01:33:30.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.271+0000 7f1dc142e740 1 -- 172.21.15.12:0/3492086176 shutdown_connections 2024-09-05T01:33:30.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.271+0000 7f1dc142e740 1 --2- 172.21.15.12:0/3492086176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646768e1ca0 0x5646768e4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.271+0000 7f1dc142e740 1 --2- 172.21.15.12:0/3492086176 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646768d73e0 0x5646768e1760 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.271+0000 7f1dc142e740 1 --2- 172.21.15.12:0/3492086176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768d6ac0 0x5646768d6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.271+0000 7f1dc142e740 1 -- 172.21.15.12:0/3492086176 >> 172.21.15.12:0/3492086176 conn(0x5646768d3050 msgr2=0x5646768d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:30.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.271+0000 7f1dc142e740 1 -- 172.21.15.12:0/3492086176 shutdown_connections 2024-09-05T01:33:30.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.271+0000 7f1dc142e740 1 -- 172.21.15.12:0/3492086176 wait complete. 2024-09-05T01:33:30.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.271+0000 7f1dc142e740 1 -- start start 2024-09-05T01:33:30.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.272+0000 7f1dc142e740 1 Processor -- start 2024-09-05T01:33:30.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.272+0000 7f1dc142e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768d6ac0 0x5646768e15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:30.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.272+0000 7f1dc142e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646768d73e0 0x5646768de880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:30.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.272+0000 7f1dc142e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646768e1ca0 0x5646768dedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:30.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.272+0000 7f1dc142e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5646768e4630 con 0x5646768e1ca0 2024-09-05T01:33:30.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.272+0000 7f1dc142e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5646767f7fa0 con 0x5646768d73e0 2024-09-05T01:33:30.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.272+0000 7f1dc142e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5646768e47b0 con 0x5646768d6ac0 2024-09-05T01:33:30.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.272+0000 7f1dc142e740 10 client.0 _ll_register_callbacks cb 0x56467654bba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:33:30.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.272+0000 7f1db7e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768d6ac0 0x5646768e15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:30.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.272+0000 7f1db7e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768d6ac0 0x5646768e15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:53630/0 (socket says 172.21.15.12:53630) 2024-09-05T01:33:30.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.272+0000 7f1db7e00640 1 -- 172.21.15.12:0/2371807504 learned_addr learned my addr 172.21.15.12:0/2371807504 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:30.277 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.272+0000 7f1daf400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646768d73e0 0x5646768de880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:30.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.272+0000 7f1dbca00640 1 --2- 172.21.15.12:0/2371807504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646768e1ca0 0x5646768dedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:30.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.273+0000 7f1db7e00640 1 -- 172.21.15.12:0/2371807504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646768d73e0 msgr2=0x5646768de880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:30.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.273+0000 7f1db7e00640 1 --2- 172.21.15.12:0/2371807504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646768d73e0 0x5646768de880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.273+0000 7f1db7e00640 1 -- 172.21.15.12:0/2371807504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646768e1ca0 msgr2=0x5646768dedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:30.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.273+0000 7f1db7e00640 1 --2- 172.21.15.12:0/2371807504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646768e1ca0 0x5646768dedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.273+0000 7f1db7e00640 1 -- 172.21.15.12:0/2371807504 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646768df5f0 con 0x5646768d6ac0 2024-09-05T01:33:30.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.273+0000 7f1daf400640 1 --2- 172.21.15.12:0/2371807504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646768d73e0 0x5646768de880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:33:30.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.273+0000 7f1db7e00640 1 --2- 172.21.15.12:0/2371807504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768d6ac0 0x5646768e15d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1da80bb830 tx=0x7f1da8005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=685c0f9c469b0a62 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:30.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.273+0000 7f1da5600640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:33:30.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.273+0000 7f1da5600640 1 -- 172.21.15.12:0/2371807504 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da80bce60 con 0x5646768d6ac0 2024-09-05T01:33:30.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.273+0000 7f1da5600640 1 -- 172.21.15.12:0/2371807504 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8579+0+0 (secure 0 0 0) 0x7f1da80c4310 con 0x5646768d6ac0 2024-09-05T01:33:30.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.273+0000 7f1dc142e740 1 -- 172.21.15.12:0/2371807504 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56467684a800 con 0x5646768d6ac0 2024-09-05T01:33:30.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.274+0000 7f1da5600640 1 -- 172.21.15.12:0/2371807504 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f1da80bfee0 con 0x5646768d6ac0 2024-09-05T01:33:30.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.274+0000 7f1dc142e740 10 client.26362 fetch_fsmap learned FSMap version 49 2024-09-05T01:33:30.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.274+0000 7f1dc142e740 1 -- 172.21.15.12:0/2371807504 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5646768e4630 con 0x5646768d6ac0 2024-09-05T01:33:30.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.274+0000 7f1da5600640 1 -- 172.21.15.12:0/2371807504 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56467684a800 con 0x5646768d6ac0 2024-09-05T01:33:30.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.274+0000 7f1da5600640 1 -- 172.21.15.12:0/2371807504 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 49) ==== 8422+0+0 (secure 0 0 0) 0x7f1da803a030 con 0x5646768d6ac0 2024-09-05T01:33:30.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.274+0000 7f1dc142e740 10 client.26362 fetch_fsmap finished waiting for FSMap version 49 2024-09-05T01:33:30.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.274+0000 7f1dc142e740 10 client.26362 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:33:30.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.274+0000 7f1dc142e740 20 client.26362 populate_metadata read hostname 'smithi012' 2024-09-05T01:33:30.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.274+0000 7f1dc142e740 1 --2- 172.21.15.12:0/2371807504 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5646768f19a0 0x5646768f3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:30.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.274+0000 7f1dc142e740 4 client.26362 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:33:30.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.274+0000 7f1dc142e740 1 -- 172.21.15.12:0/2371807504 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564676844d10 con 0x5646768f19a0 2024-09-05T01:33:30.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.275+0000 7f1daf400640 1 --2- 172.21.15.12:0/2371807504 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5646768f19a0 0x5646768f3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:30.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.275+0000 7f1daf400640 1 --2- 172.21.15.12:0/2371807504 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5646768f19a0 0x5646768f3e00 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f41c42550639db5 server_cookie=cda067e085894bce in_seq=0 out_seq=0 2024-09-05T01:33:30.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.275+0000 7f1da5600640 10 client.26362 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:33:30.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.276+0000 7f1da5600640 1 -- 172.21.15.12:0/2371807504 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564676844d10 con 0x5646768f19a0 2024-09-05T01:33:30.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.276+0000 7f1da5600640 10 client.26362 handle_command_reply: tid=0 2024-09-05T01:33:30.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.276+0000 7f1dc142e740 1 client.26362 shutdown 2024-09-05T01:33:30.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.276+0000 7f1dc142e740 1 -- 172.21.15.12:0/2371807504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768d6ac0 msgr2=0x5646768e15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:30.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.276+0000 7f1dc142e740 1 --2- 172.21.15.12:0/2371807504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768d6ac0 0x5646768e15d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1da80bb830 tx=0x7f1da8005dc0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.276+0000 7f1dc142e740 1 -- 172.21.15.12:0/2371807504 shutdown_connections 2024-09-05T01:33:30.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.276+0000 7f1dc142e740 1 --2- 172.21.15.12:0/2371807504 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5646768f19a0 0x5646768f3e00 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.276+0000 7f1dc142e740 1 --2- 172.21.15.12:0/2371807504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646768e1ca0 0x5646768dedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.276+0000 7f1dc142e740 1 --2- 172.21.15.12:0/2371807504 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646768d73e0 0x5646768de880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.276+0000 7f1da5600640 0 client.26362 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:33:30.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.276+0000 7f1dc142e740 1 --2- 172.21.15.12:0/2371807504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768d6ac0 0x5646768e15d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.276+0000 7f1dc142e740 1 -- 172.21.15.12:0/2371807504 >> 172.21.15.12:0/2371807504 conn(0x5646768d3050 msgr2=0x5646768d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:30.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.276+0000 7f1dc142e740 1 -- 172.21.15.12:0/2371807504 shutdown_connections 2024-09-05T01:33:30.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.276+0000 7f1dc142e740 1 -- 172.21.15.12:0/2371807504 wait complete. 2024-09-05T01:33:30.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.277+0000 7f1dc142e740 20 client.26362 trim_cache size 0 max 16384 2024-09-05T01:33:30.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.296+0000 7f1dc142e740 1 Processor -- start 2024-09-05T01:33:30.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.296+0000 7f1dc142e740 1 -- start start 2024-09-05T01:33:30.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.297+0000 7f1dc142e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646768d6ac0 0x5646768f96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:30.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.297+0000 7f1dc142e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646768d73e0 0x5646768f9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:30.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.297+0000 7f1dc142e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768e1ca0 0x5646768dbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:30.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.297+0000 7f1dc142e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1db81afad0 con 0x5646768d73e0 2024-09-05T01:33:30.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.297+0000 7f1dc142e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1db81b17c0 con 0x5646768d6ac0 2024-09-05T01:33:30.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.297+0000 7f1dc142e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1db81b01a0 con 0x5646768e1ca0 2024-09-05T01:33:30.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.297+0000 7f1dbca00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768e1ca0 0x5646768dbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:30.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.297+0000 7f1dbca00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768e1ca0 0x5646768dbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:53644/0 (socket says 172.21.15.12:53644) 2024-09-05T01:33:30.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.297+0000 7f1dbca00640 1 -- 172.21.15.12:0/2003299492 learned_addr learned my addr 172.21.15.12:0/2003299492 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:30.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.297+0000 7f1daf400640 1 --2- 172.21.15.12:0/2003299492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646768d73e0 0x5646768f9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:30.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.297+0000 7f1db7e00640 1 --2- 172.21.15.12:0/2003299492 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646768d6ac0 0x5646768f96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:30.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.297+0000 7f1dbca00640 1 -- 172.21.15.12:0/2003299492 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646768d6ac0 msgr2=0x5646768f96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:30.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.297+0000 7f1dbca00640 1 --2- 172.21.15.12:0/2003299492 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646768d6ac0 0x5646768f96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.297+0000 7f1dbca00640 1 -- 172.21.15.12:0/2003299492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646768d73e0 msgr2=0x5646768f9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:30.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.297+0000 7f1dbca00640 1 --2- 172.21.15.12:0/2003299492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646768d73e0 0x5646768f9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.298+0000 7f1dbca00640 1 -- 172.21.15.12:0/2003299492 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646768dd830 con 0x5646768e1ca0 2024-09-05T01:33:30.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.298+0000 7f1daf400640 1 --2- 172.21.15.12:0/2003299492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646768d73e0 0x5646768f9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:33:30.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.298+0000 7f1dbca00640 1 --2- 172.21.15.12:0/2003299492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768e1ca0 0x5646768dbb00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1db0012cb0 tx=0x7f1db0015070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a239a5fa64ad0c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:30.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.298+0000 7f1da7e00640 1 -- 172.21.15.12:0/2003299492 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db0010d00 con 0x5646768e1ca0 2024-09-05T01:33:30.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.298+0000 7f1da7e00640 1 -- 172.21.15.12:0/2003299492 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1db00218f0 con 0x5646768e1ca0 2024-09-05T01:33:30.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.298+0000 7f1da7e00640 1 -- 172.21.15.12:0/2003299492 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db00207f0 con 0x5646768e1ca0 2024-09-05T01:33:30.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.299+0000 7f1dc142e740 1 -- 172.21.15.12:0/2003299492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768e1ca0 msgr2=0x5646768dbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:30.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.299+0000 7f1dc142e740 1 --2- 172.21.15.12:0/2003299492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768e1ca0 0x5646768dbb00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1db0012cb0 tx=0x7f1db0015070 comp rx=0 tx=0).stop 2024-09-05T01:33:30.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.299+0000 7f1dc142e740 1 -- 172.21.15.12:0/2003299492 shutdown_connections 2024-09-05T01:33:30.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.299+0000 7f1dc142e740 1 --2- 172.21.15.12:0/2003299492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768e1ca0 0x5646768dbb00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.299+0000 7f1dc142e740 1 --2- 172.21.15.12:0/2003299492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646768d73e0 0x5646768f9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.299+0000 7f1dc142e740 1 --2- 172.21.15.12:0/2003299492 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646768d6ac0 0x5646768f96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.299+0000 7f1dc142e740 1 -- 172.21.15.12:0/2003299492 >> 172.21.15.12:0/2003299492 conn(0x5646768d3050 msgr2=0x5646768e0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:30.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.299+0000 7f1dc142e740 1 -- 172.21.15.12:0/2003299492 shutdown_connections 2024-09-05T01:33:30.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.299+0000 7f1dc142e740 1 -- 172.21.15.12:0/2003299492 wait complete. 2024-09-05T01:33:30.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.299+0000 7f1dc142e740 1 -- start start 2024-09-05T01:33:30.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.300+0000 7f1dc142e740 1 Processor -- start 2024-09-05T01:33:30.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.300+0000 7f1dc142e740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646768d6ac0 0x5646768e9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:30.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.300+0000 7f1dc142e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768d73e0 0x5646768ea1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:30.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.300+0000 7f1dc142e740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646768e1ca0 0x5646768e6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:30.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.300+0000 7f1dc142e740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1db81b1030 con 0x5646768d6ac0 2024-09-05T01:33:30.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.300+0000 7f1dc142e740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1db81b08a0 con 0x5646768e1ca0 2024-09-05T01:33:30.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.300+0000 7f1dc142e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1db81adad0 con 0x5646768d73e0 2024-09-05T01:33:30.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.300+0000 7f1dc142e740 10 client.0 _ll_register_callbacks cb 0x7f1db0009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:33:30.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.300+0000 7f1daf400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768d73e0 0x5646768ea1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:30.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.301+0000 7f1daf400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768d73e0 0x5646768ea1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:53654/0 (socket says 172.21.15.12:53654) 2024-09-05T01:33:30.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.301+0000 7f1daf400640 1 -- 172.21.15.12:0/1705419513 learned_addr learned my addr 172.21.15.12:0/1705419513 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:30.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.301+0000 7f1db7e00640 1 --2- 172.21.15.12:0/1705419513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646768d6ac0 0x5646768e9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:30.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.301+0000 7f1dbca00640 1 --2- 172.21.15.12:0/1705419513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646768e1ca0 0x5646768e6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:30.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.301+0000 7f1daf400640 1 -- 172.21.15.12:0/1705419513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646768e1ca0 msgr2=0x5646768e6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:30.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.301+0000 7f1daf400640 1 --2- 172.21.15.12:0/1705419513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646768e1ca0 0x5646768e6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.301+0000 7f1daf400640 1 -- 172.21.15.12:0/1705419513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646768d6ac0 msgr2=0x5646768e9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:30.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.301+0000 7f1daf400640 1 --2- 172.21.15.12:0/1705419513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646768d6ac0 0x5646768e9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.301+0000 7f1daf400640 1 -- 172.21.15.12:0/1705419513 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646768e7240 con 0x5646768d73e0 2024-09-05T01:33:30.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.301+0000 7f1db7e00640 1 --2- 172.21.15.12:0/1705419513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646768d6ac0 0x5646768e9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:33:30.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.301+0000 7f1daf400640 1 --2- 172.21.15.12:0/1705419513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768d73e0 0x5646768ea1d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1da0011770 tx=0x7f1da0012e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dec53e2b53d7b012 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:30.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.301+0000 7f1da5600640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:33:30.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.302+0000 7f1da5600640 1 -- 172.21.15.12:0/1705419513 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da0004d20 con 0x5646768d73e0 2024-09-05T01:33:30.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.302+0000 7f1da5600640 1 -- 172.21.15.12:0/1705419513 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8579+0+0 (secure 0 0 0) 0x7f1da0003970 con 0x5646768d73e0 2024-09-05T01:33:30.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.302+0000 7f1dc142e740 1 -- 172.21.15.12:0/1705419513 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1db00218f0 con 0x5646768d73e0 2024-09-05T01:33:30.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.302+0000 7f1da5600640 1 -- 172.21.15.12:0/1705419513 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f1da0003b70 con 0x5646768d73e0 2024-09-05T01:33:30.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.302+0000 7f1dc142e740 10 client.26368 fetch_fsmap learned FSMap version 49 2024-09-05T01:33:30.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.302+0000 7f1dc142e740 1 -- 172.21.15.12:0/1705419513 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x56467695d2b0 con 0x5646768d73e0 2024-09-05T01:33:30.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.302+0000 7f1da5600640 1 -- 172.21.15.12:0/1705419513 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1db00218f0 con 0x5646768d73e0 2024-09-05T01:33:30.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.302+0000 7f1da5600640 1 -- 172.21.15.12:0/1705419513 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 49) ==== 8422+0+0 (secure 0 0 0) 0x7f1da002c030 con 0x5646768d73e0 2024-09-05T01:33:30.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.302+0000 7f1dc142e740 10 client.26368 fetch_fsmap finished waiting for FSMap version 49 2024-09-05T01:33:30.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.302+0000 7f1dc142e740 10 client.26368 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:33:30.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.302+0000 7f1dc142e740 20 client.26368 populate_metadata read hostname 'smithi012' 2024-09-05T01:33:30.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.302+0000 7f1dc142e740 1 --2- 172.21.15.12:0/1705419513 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x56467695db20 0x56467695ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:30.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.302+0000 7f1dc142e740 4 client.26368 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-05T01:33:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.302+0000 7f1dc142e740 1 -- 172.21.15.12:0/1705419513 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5646767c0fb0 con 0x56467695db20 2024-09-05T01:33:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.303+0000 7f1db7e00640 1 --2- 172.21.15.12:0/1705419513 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x56467695db20 0x56467695ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.303+0000 7f1db7e00640 1 --2- 172.21.15.12:0/1705419513 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x56467695db20 0x56467695ff40 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7c9e6e9f189475a server_cookie=5c34666ef791ce43 in_seq=0 out_seq=0 2024-09-05T01:33:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.303+0000 7f1da5600640 10 client.26368 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:33:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.304+0000 7f1da5600640 1 -- 172.21.15.12:0/1705419513 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5646767c0fb0 con 0x56467695db20 2024-09-05T01:33:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.304+0000 7f1da5600640 10 client.26368 handle_command_reply: tid=0 2024-09-05T01:33:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.304+0000 7f1dc142e740 1 client.26368 shutdown 2024-09-05T01:33:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.304+0000 7f1dc142e740 1 -- 172.21.15.12:0/1705419513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768d73e0 msgr2=0x5646768ea1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.304+0000 7f1dc142e740 1 --2- 172.21.15.12:0/1705419513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768d73e0 0x5646768ea1d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1da0011770 tx=0x7f1da0012e20 comp rx=0 tx=0).stop 2024-09-05T01:33:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.304+0000 7f1dc142e740 1 -- 172.21.15.12:0/1705419513 shutdown_connections 2024-09-05T01:33:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.304+0000 7f1dc142e740 1 --2- 172.21.15.12:0/1705419513 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x56467695db20 0x56467695ff40 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.304+0000 7f1dc142e740 1 --2- 172.21.15.12:0/1705419513 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5646768e1ca0 0x5646768e6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.304+0000 7f1dc142e740 1 --2- 172.21.15.12:0/1705419513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646768d73e0 0x5646768ea1d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.304+0000 7f1dc142e740 1 --2- 172.21.15.12:0/1705419513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5646768d6ac0 0x5646768e9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.305+0000 7f1dc142e740 1 -- 172.21.15.12:0/1705419513 >> 172.21.15.12:0/1705419513 conn(0x5646768d3050 msgr2=0x5646768d19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:30.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.305+0000 7f1da5600640 0 client.26368 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:33:30.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.305+0000 7f1dc142e740 1 -- 172.21.15.12:0/1705419513 shutdown_connections 2024-09-05T01:33:30.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.305+0000 7f1dc142e740 1 -- 172.21.15.12:0/1705419513 wait complete. 2024-09-05T01:33:30.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.305+0000 7f1dc142e740 20 client.26368 trim_cache size 0 max 16384 2024-09-05T01:33:30.313 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:33:30.313 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-05T01:33:30.314 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "d3b3a44c-342a-42f6-a61e-f77a3e5d2675", 2024-09-05T01:33:30.314 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-05T01:33:30.314 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:33:30.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.306+0000 7f1dbea00640 1 -- 172.21.15.12:0/3665561497 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1d980a2cf0 msgr2=0x7f1d980a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:30.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.306+0000 7f1dbea00640 1 --2- 172.21.15.12:0/3665561497 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1d980a2cf0 0x7f1d980a51b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1db0009820 tx=0x7f1db0004730 comp rx=0 tx=0).stop 2024-09-05T01:33:30.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.306+0000 7f1dbea00640 1 -- 172.21.15.12:0/3665561497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1db8103ff0 msgr2=0x7f1db819a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:30.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.306+0000 7f1dbea00640 1 --2- 172.21.15.12:0/3665561497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1db8103ff0 0x7f1db819a620 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1da8035040 tx=0x7f1da8033d90 comp rx=0 tx=0).stop 2024-09-05T01:33:30.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.306+0000 7f1dbea00640 1 -- 172.21.15.12:0/3665561497 shutdown_connections 2024-09-05T01:33:30.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.306+0000 7f1dbea00640 1 --2- 172.21.15.12:0/3665561497 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1d980a2cf0 0x7f1d980a51b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.306+0000 7f1dbea00640 1 --2- 172.21.15.12:0/3665561497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1db8109120 0x7f1db819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.306+0000 7f1dbea00640 1 --2- 172.21.15.12:0/3665561497 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1db81049a0 0x7f1db819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.306+0000 7f1dbea00640 1 --2- 172.21.15.12:0/3665561497 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1db8103ff0 0x7f1db819a620 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:30.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.306+0000 7f1dbea00640 1 -- 172.21.15.12:0/3665561497 >> 172.21.15.12:0/3665561497 conn(0x7f1db80ffa90 msgr2=0x7f1db8100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:30.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.306+0000 7f1dbea00640 1 -- 172.21.15.12:0/3665561497 shutdown_connections 2024-09-05T01:33:30.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:30.306+0000 7f1dbea00640 1 -- 172.21.15.12:0/3665561497 wait complete. 2024-09-05T01:33:30.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:30 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:33:30.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:30 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:33:30.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:30 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:33:31.125 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T01:33:31.660 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:33:31.805 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:31 smithi012 ceph-mon[29942]: pgmap v273: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 135 op/s 2024-09-05T01:33:31.805 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:31 smithi012 ceph-mon[29942]: scrub queued for path: / 2024-09-05T01:33:31.805 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:31 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:31.805 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:31 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:33:31.805 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:31 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:33:31.805 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:31 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:33:31.805 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:31 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:33:31.805 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:31 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:33:31.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:31 smithi145 ceph-mon[34376]: pgmap v273: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 135 op/s 2024-09-05T01:33:31.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:31 smithi145 ceph-mon[34376]: scrub queued for path: / 2024-09-05T01:33:31.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:31 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:31.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:31 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:33:31.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:31 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:33:31.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:31 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:33:31.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:31 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:33:31.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:31 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:33:31.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:31 smithi151 ceph-mon[35013]: pgmap v273: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 135 op/s 2024-09-05T01:33:31.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:31 smithi151 ceph-mon[35013]: scrub queued for path: / 2024-09-05T01:33:31.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:31 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:31.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:31 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:33:31.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:31 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:33:31.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:31 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:33:31.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:31 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:33:31.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:31 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:33:32.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.341+0000 7fc16ac00640 1 -- 172.21.15.12:0/675882974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1641019c0 msgr2=0x7fc164101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:32.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.341+0000 7fc16ac00640 1 --2- 172.21.15.12:0/675882974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1641019c0 0x7fc164101e20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc150009900 tx=0x7fc15002a410 comp rx=0 tx=0).stop 2024-09-05T01:33:32.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.341+0000 7fc16ac00640 1 -- 172.21.15.12:0/675882974 shutdown_connections 2024-09-05T01:33:32.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.341+0000 7fc16ac00640 1 --2- 172.21.15.12:0/675882974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc164102360 0x7fc16410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.341+0000 7fc16ac00640 1 --2- 172.21.15.12:0/675882974 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1641019c0 0x7fc164101e20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.341+0000 7fc16ac00640 1 --2- 172.21.15.12:0/675882974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1641079c0 0x7fc164107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.341+0000 7fc16ac00640 1 -- 172.21.15.12:0/675882974 >> 172.21.15.12:0/675882974 conn(0x7fc1640fd6e0 msgr2=0x7fc1640ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:32.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.342+0000 7fc16ac00640 1 -- 172.21.15.12:0/675882974 shutdown_connections 2024-09-05T01:33:32.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.342+0000 7fc16ac00640 1 -- 172.21.15.12:0/675882974 wait complete. 2024-09-05T01:33:32.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.343+0000 7fc16ac00640 1 Processor -- start 2024-09-05T01:33:32.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.343+0000 7fc16ac00640 1 -- start start 2024-09-05T01:33:32.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.344+0000 7fc16ac00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1641019c0 0x7fc16419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:32.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.344+0000 7fc16ac00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc164102360 0x7fc16419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:32.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.344+0000 7fc16ac00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1641079c0 0x7fc16419ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:32.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.344+0000 7fc16ac00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc164111e10 con 0x7fc164102360 2024-09-05T01:33:32.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.344+0000 7fc16ac00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc164111c90 con 0x7fc1641019c0 2024-09-05T01:33:32.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.344+0000 7fc16ac00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc164111f90 con 0x7fc1641079c0 2024-09-05T01:33:32.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.344+0000 7fc169800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1641019c0 0x7fc16419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:32.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.344+0000 7fc16a200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1641079c0 0x7fc16419ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:32.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.344+0000 7fc168e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc164102360 0x7fc16419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:32.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.344+0000 7fc169800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1641019c0 0x7fc16419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:50864/0 (socket says 172.21.15.12:50864) 2024-09-05T01:33:32.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.344+0000 7fc169800640 1 -- 172.21.15.12:0/2453565225 learned_addr learned my addr 172.21.15.12:0/2453565225 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:32.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.345+0000 7fc16a200640 1 -- 172.21.15.12:0/2453565225 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1641019c0 msgr2=0x7fc16419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:32.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.345+0000 7fc16a200640 1 --2- 172.21.15.12:0/2453565225 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1641019c0 0x7fc16419a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.345+0000 7fc16a200640 1 -- 172.21.15.12:0/2453565225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc164102360 msgr2=0x7fc16419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:32.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.345+0000 7fc16a200640 1 --2- 172.21.15.12:0/2453565225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc164102360 0x7fc16419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.345+0000 7fc16a200640 1 -- 172.21.15.12:0/2453565225 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16419f440 con 0x7fc1641079c0 2024-09-05T01:33:32.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.345+0000 7fc169800640 1 --2- 172.21.15.12:0/2453565225 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1641019c0 0x7fc16419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:33:32.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.345+0000 7fc16a200640 1 --2- 172.21.15.12:0/2453565225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1641079c0 0x7fc16419ed60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc15c00da10 tx=0x7fc15c00ded0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:32.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.345+0000 7fc162000640 1 -- 172.21.15.12:0/2453565225 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c00bd70 con 0x7fc1641079c0 2024-09-05T01:33:32.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.345+0000 7fc16ac00640 1 -- 172.21.15.12:0/2453565225 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc16419f730 con 0x7fc1641079c0 2024-09-05T01:33:32.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.345+0000 7fc162000640 1 -- 172.21.15.12:0/2453565225 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc15c003e50 con 0x7fc1641079c0 2024-09-05T01:33:32.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.346+0000 7fc162000640 1 -- 172.21.15.12:0/2453565225 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c0106a0 con 0x7fc1641079c0 2024-09-05T01:33:32.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.346+0000 7fc16ac00640 1 -- 172.21.15.12:0/2453565225 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1641a7010 con 0x7fc1641079c0 2024-09-05T01:33:32.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.349+0000 7fc16ec43740 1 Processor -- start 2024-09-05T01:33:32.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.349+0000 7fc162000640 1 -- 172.21.15.12:0/2453565225 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fc15c003970 con 0x7fc1641079c0 2024-09-05T01:33:32.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.349+0000 7fc16ec43740 1 -- start start 2024-09-05T01:33:32.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.350+0000 7fc16ec43740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafdfd50 0x55d4fafe0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:32.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.350+0000 7fc16ec43740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d4fafe0670 0x55d4fafea9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:32.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.350+0000 7fc16ec43740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4fafeaf30 0x55d4fafed320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:32.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.350+0000 7fc16ec43740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d4faf463e0 con 0x55d4fafeaf30 2024-09-05T01:33:32.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.350+0000 7fc16ec43740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55d4faeedd80 con 0x55d4fafe0670 2024-09-05T01:33:32.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.350+0000 7fc16ec43740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d4faf423a0 con 0x55d4fafdfd50 2024-09-05T01:33:32.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.350+0000 7fc168e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafdfd50 0x55d4fafe0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:32.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.350+0000 7fc168e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafdfd50 0x55d4fafe0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:53678/0 (socket says 172.21.15.12:53678) 2024-09-05T01:33:32.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.350+0000 7fc168e00640 1 -- 172.21.15.12:0/2065665294 learned_addr learned my addr 172.21.15.12:0/2065665294 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:32.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.350+0000 7fc168e00640 1 --2- 172.21.15.12:0/2065665294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4fafeaf30 0x55d4fafed320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:32.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.350+0000 7fc169800640 1 --2- 172.21.15.12:0/2065665294 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d4fafe0670 0x55d4fafea9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.351+0000 7fc168e00640 1 -- 172.21.15.12:0/2065665294 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d4fafe0670 msgr2=0x55d4fafea9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.351+0000 7fc168e00640 1 --2- 172.21.15.12:0/2065665294 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d4fafe0670 0x55d4fafea9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.351+0000 7fc168e00640 1 -- 172.21.15.12:0/2065665294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4fafeaf30 msgr2=0x55d4fafed320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.351+0000 7fc168e00640 1 --2- 172.21.15.12:0/2065665294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4fafeaf30 0x55d4fafed320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.351+0000 7fc168e00640 1 -- 172.21.15.12:0/2065665294 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4faf0cae0 con 0x55d4fafdfd50 2024-09-05T01:33:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.351+0000 7fc169800640 1 --2- 172.21.15.12:0/2065665294 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d4fafe0670 0x55d4fafea9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:33:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.351+0000 7fc162000640 1 --2- 172.21.15.12:0/2453565225 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc14c0a2d70 0x7fc14c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.351+0000 7fc168e00640 1 --2- 172.21.15.12:0/2065665294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafdfd50 0x55d4fafe0130 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc150005c40 tx=0x7fc150005b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e7aa9219403b7ef server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.351+0000 7fc162000640 1 -- 172.21.15.12:0/2453565225 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8579+0+0 (secure 0 0 0) 0x7fc15c0cf850 con 0x7fc1641079c0 2024-09-05T01:33:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.351+0000 7fc169800640 1 --2- 172.21.15.12:0/2453565225 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc14c0a2d70 0x7fc14c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.351+0000 7fc156a00640 1 -- 172.21.15.12:0/2065665294 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150035030 con 0x55d4fafdfd50 2024-09-05T01:33:32.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.352+0000 7fc156a00640 1 -- 172.21.15.12:0/2065665294 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1500046c0 con 0x55d4fafdfd50 2024-09-05T01:33:32.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.352+0000 7fc156a00640 1 -- 172.21.15.12:0/2065665294 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150003900 con 0x55d4fafdfd50 2024-09-05T01:33:32.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.352+0000 7fc16ec43740 1 -- 172.21.15.12:0/2065665294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafdfd50 msgr2=0x55d4fafe0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:32.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.352+0000 7fc16ec43740 1 --2- 172.21.15.12:0/2065665294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafdfd50 0x55d4fafe0130 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc150005c40 tx=0x7fc150005b50 comp rx=0 tx=0).stop 2024-09-05T01:33:32.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.352+0000 7fc169800640 1 --2- 172.21.15.12:0/2453565225 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc14c0a2d70 0x7fc14c0a5230 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc158009640 tx=0x7fc158005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:32.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.352+0000 7fc16ec43740 1 -- 172.21.15.12:0/2065665294 shutdown_connections 2024-09-05T01:33:32.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.352+0000 7fc16ec43740 1 --2- 172.21.15.12:0/2065665294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4fafeaf30 0x55d4fafed320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.352+0000 7fc16ec43740 1 --2- 172.21.15.12:0/2065665294 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d4fafe0670 0x55d4fafea9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.352+0000 7fc16ec43740 1 --2- 172.21.15.12:0/2065665294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafdfd50 0x55d4fafe0130 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.352+0000 7fc16ec43740 1 -- 172.21.15.12:0/2065665294 >> 172.21.15.12:0/2065665294 conn(0x55d4fafdc2e0 msgr2=0x55d4fafdc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:32.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.353+0000 7fc16ec43740 1 -- 172.21.15.12:0/2065665294 shutdown_connections 2024-09-05T01:33:32.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.353+0000 7fc16ec43740 1 -- 172.21.15.12:0/2065665294 wait complete. 2024-09-05T01:33:32.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.353+0000 7fc16ec43740 1 -- start start 2024-09-05T01:33:32.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.353+0000 7fc16ec43740 1 Processor -- start 2024-09-05T01:33:32.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.354+0000 7fc16ec43740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafdfd50 0x55d4fafe7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:32.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.354+0000 7fc16ec43740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d4fafe0670 0x55d4fafe83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:32.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.354+0000 7fc16ec43740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4fafeaf30 0x55d4fafe8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:32.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.354+0000 7fc16ec43740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d4fafedba0 con 0x55d4fafeaf30 2024-09-05T01:33:32.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.354+0000 7fc16ec43740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55d4faf010f0 con 0x55d4fafe0670 2024-09-05T01:33:32.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.354+0000 7fc16ec43740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d4fafedd20 con 0x55d4fafdfd50 2024-09-05T01:33:32.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.354+0000 7fc16ec43740 10 client.0 _ll_register_callbacks cb 0x55d4faef29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:33:32.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.354+0000 7fc169800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafdfd50 0x55d4fafe7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:32.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.354+0000 7fc16a200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4fafeaf30 0x55d4fafe8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:32.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.354+0000 7fc169800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafdfd50 0x55d4fafe7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:53694/0 (socket says 172.21.15.12:53694) 2024-09-05T01:33:32.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.354+0000 7fc169800640 1 -- 172.21.15.12:0/1082921509 learned_addr learned my addr 172.21.15.12:0/1082921509 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:32.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.354+0000 7fc168e00640 1 --2- 172.21.15.12:0/1082921509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d4fafe0670 0x55d4fafe83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:32.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.355+0000 7fc16a200640 1 -- 172.21.15.12:0/1082921509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafdfd50 msgr2=0x55d4fafe7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:32.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.355+0000 7fc16a200640 1 --2- 172.21.15.12:0/1082921509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafdfd50 0x55d4fafe7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.355+0000 7fc16a200640 1 -- 172.21.15.12:0/1082921509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d4fafe0670 msgr2=0x55d4fafe83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:32.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.355+0000 7fc16a200640 1 --2- 172.21.15.12:0/1082921509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d4fafe0670 0x55d4fafe83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.355+0000 7fc16a200640 1 -- 172.21.15.12:0/1082921509 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4facb73c0 con 0x55d4fafeaf30 2024-09-05T01:33:32.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.355+0000 7fc16a200640 1 --2- 172.21.15.12:0/1082921509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4fafeaf30 0x55d4fafe8930 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0ccf00 tx=0x7fc15c09c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f417235165c6b692 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:32.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.355+0000 7fc14b400640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:33:32.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.355+0000 7fc14b400640 1 -- 172.21.15.12:0/1082921509 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c0a4940 con 0x55d4fafeaf30 2024-09-05T01:33:32.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.355+0000 7fc14b400640 1 -- 172.21.15.12:0/1082921509 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8579+0+0 (secure 0 0 0) 0x7fc15c0cd180 con 0x55d4fafeaf30 2024-09-05T01:33:32.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.355+0000 7fc16ec43740 1 -- 172.21.15.12:0/1082921509 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1500046c0 con 0x55d4fafeaf30 2024-09-05T01:33:32.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.355+0000 7fc14b400640 1 -- 172.21.15.12:0/1082921509 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fc15c003c60 con 0x55d4fafeaf30 2024-09-05T01:33:32.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.355+0000 7fc16ec43740 10 client.16338 fetch_fsmap learned FSMap version 49 2024-09-05T01:33:32.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.355+0000 7fc16ec43740 1 -- 172.21.15.12:0/1082921509 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55d4faff98d0 con 0x55d4fafeaf30 2024-09-05T01:33:32.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.356+0000 7fc14b400640 1 -- 172.21.15.12:0/1082921509 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1500046c0 con 0x55d4fafeaf30 2024-09-05T01:33:32.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.356+0000 7fc14b400640 1 -- 172.21.15.12:0/1082921509 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 49) ==== 8422+0+0 (secure 0 0 0) 0x7fc15c024060 con 0x55d4fafeaf30 2024-09-05T01:33:32.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.356+0000 7fc16ec43740 10 client.16338 fetch_fsmap finished waiting for FSMap version 49 2024-09-05T01:33:32.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.356+0000 7fc16ec43740 10 client.16338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:33:32.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.356+0000 7fc16ec43740 20 client.16338 populate_metadata read hostname 'smithi012' 2024-09-05T01:33:32.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.356+0000 7fc16ec43740 1 --2- 172.21.15.12:0/1082921509 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55d4faffad30 0x55d4faffd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:32.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.356+0000 7fc16ec43740 4 client.16338 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:33:32.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.356+0000 7fc16ec43740 1 -- 172.21.15.12:0/1082921509 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4faf53950 con 0x55d4faffad30 2024-09-05T01:33:32.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.356+0000 7fc169800640 1 --2- 172.21.15.12:0/1082921509 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55d4faffad30 0x55d4faffd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:32.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.357+0000 7fc169800640 1 --2- 172.21.15.12:0/1082921509 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55d4faffad30 0x55d4faffd170 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f610c3ebb52290d server_cookie=fdb15e0398650f85 in_seq=0 out_seq=0 2024-09-05T01:33:32.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.357+0000 7fc14b400640 10 client.16338 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:33:32.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.358+0000 7fc14b400640 1 -- 172.21.15.12:0/1082921509 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d4faf53950 con 0x55d4faffad30 2024-09-05T01:33:32.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.358+0000 7fc14b400640 10 client.16338 handle_command_reply: tid=0 2024-09-05T01:33:32.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.358+0000 7fc16ec43740 1 client.16338 shutdown 2024-09-05T01:33:32.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.358+0000 7fc16ec43740 1 -- 172.21.15.12:0/1082921509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4fafeaf30 msgr2=0x55d4fafe8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:32.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.358+0000 7fc16ec43740 1 --2- 172.21.15.12:0/1082921509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4fafeaf30 0x55d4fafe8930 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0ccf00 tx=0x7fc15c09c3d0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.358+0000 7fc16ec43740 1 -- 172.21.15.12:0/1082921509 shutdown_connections 2024-09-05T01:33:32.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.358+0000 7fc16ec43740 1 --2- 172.21.15.12:0/1082921509 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55d4faffad30 0x55d4faffd170 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.358+0000 7fc16ec43740 1 --2- 172.21.15.12:0/1082921509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4fafeaf30 0x55d4fafe8930 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.358+0000 7fc16ec43740 1 --2- 172.21.15.12:0/1082921509 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d4fafe0670 0x55d4fafe83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.358+0000 7fc14b400640 0 client.16338 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:33:32.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.358+0000 7fc16ec43740 1 --2- 172.21.15.12:0/1082921509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafdfd50 0x55d4fafe7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.359+0000 7fc16ec43740 1 -- 172.21.15.12:0/1082921509 >> 172.21.15.12:0/1082921509 conn(0x55d4fafdc2e0 msgr2=0x55d4fafe1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:32.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.359+0000 7fc16ec43740 1 -- 172.21.15.12:0/1082921509 shutdown_connections 2024-09-05T01:33:32.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.359+0000 7fc16ec43740 1 -- 172.21.15.12:0/1082921509 wait complete. 2024-09-05T01:33:32.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.359+0000 7fc16ec43740 20 client.16338 trim_cache size 0 max 16384 2024-09-05T01:33:32.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.377+0000 7fc16ec43740 1 Processor -- start 2024-09-05T01:33:32.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.377+0000 7fc16ec43740 1 -- start start 2024-09-05T01:33:32.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.377+0000 7fc16ec43740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d4fafdfd50 0x55d4fafe27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:32.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.377+0000 7fc16ec43740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4fafe0670 0x55d4fafe8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.377+0000 7fc16ec43740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafeaf30 0x55d4fb002a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.377+0000 7fc16ec43740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc1641afa40 con 0x55d4fafe0670 2024-09-05T01:33:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.377+0000 7fc16ec43740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc1641b1730 con 0x55d4fafdfd50 2024-09-05T01:33:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.377+0000 7fc16ec43740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc1641b0110 con 0x55d4fafeaf30 2024-09-05T01:33:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.377+0000 7fc168e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4fafe0670 0x55d4fafe8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.377+0000 7fc16a200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafeaf30 0x55d4fb002a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.377+0000 7fc168e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4fafe0670 0x55d4fafe8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38502/0 (socket says 172.21.15.12:38502) 2024-09-05T01:33:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.377+0000 7fc16a200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafeaf30 0x55d4fb002a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:53702/0 (socket says 172.21.15.12:53702) 2024-09-05T01:33:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.377+0000 7fc168e00640 1 -- 172.21.15.12:0/1974458055 learned_addr learned my addr 172.21.15.12:0/1974458055 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.378+0000 7fc169800640 1 --2- 172.21.15.12:0/1974458055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d4fafdfd50 0x55d4fafe27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.378+0000 7fc16a200640 1 -- 172.21.15.12:0/1974458055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d4fafdfd50 msgr2=0x55d4fafe27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.378+0000 7fc16a200640 1 --2- 172.21.15.12:0/1974458055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d4fafdfd50 0x55d4fafe27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.378+0000 7fc16a200640 1 -- 172.21.15.12:0/1974458055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4fafe0670 msgr2=0x55d4fafe8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.378+0000 7fc16a200640 1 --2- 172.21.15.12:0/1974458055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4fafe0670 0x55d4fafe8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.378+0000 7fc16a200640 1 -- 172.21.15.12:0/1974458055 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4fafe6400 con 0x55d4fafeaf30 2024-09-05T01:33:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.378+0000 7fc16a200640 1 --2- 172.21.15.12:0/1974458055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafeaf30 0x55d4fb002a40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc15c09b9d0 tx=0x7fc15c00bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3a7d3f84ffe34ce server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.378+0000 7fc156000640 1 -- 172.21.15.12:0/1974458055 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c014070 con 0x55d4fafeaf30 2024-09-05T01:33:32.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.378+0000 7fc156000640 1 -- 172.21.15.12:0/1974458055 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc15c0a4940 con 0x55d4fafeaf30 2024-09-05T01:33:32.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.378+0000 7fc156000640 1 -- 172.21.15.12:0/1974458055 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c098340 con 0x55d4fafeaf30 2024-09-05T01:33:32.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.379+0000 7fc16ec43740 1 -- 172.21.15.12:0/1974458055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafeaf30 msgr2=0x55d4fb002a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:32.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.379+0000 7fc16ec43740 1 --2- 172.21.15.12:0/1974458055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafeaf30 0x55d4fb002a40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc15c09b9d0 tx=0x7fc15c00bf10 comp rx=0 tx=0).stop 2024-09-05T01:33:32.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.379+0000 7fc16ec43740 1 -- 172.21.15.12:0/1974458055 shutdown_connections 2024-09-05T01:33:32.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.379+0000 7fc16ec43740 1 --2- 172.21.15.12:0/1974458055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafeaf30 0x55d4fb002a40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.379+0000 7fc16ec43740 1 --2- 172.21.15.12:0/1974458055 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4fafe0670 0x55d4fafe8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.379+0000 7fc16ec43740 1 --2- 172.21.15.12:0/1974458055 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d4fafdfd50 0x55d4fafe27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.379+0000 7fc16ec43740 1 -- 172.21.15.12:0/1974458055 >> 172.21.15.12:0/1974458055 conn(0x55d4fafdc2e0 msgr2=0x55d4fafe7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:32.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.379+0000 7fc16ec43740 1 -- 172.21.15.12:0/1974458055 shutdown_connections 2024-09-05T01:33:32.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.379+0000 7fc16ec43740 1 -- 172.21.15.12:0/1974458055 wait complete. 2024-09-05T01:33:32.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.380+0000 7fc16ec43740 1 -- start start 2024-09-05T01:33:32.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.380+0000 7fc16ec43740 1 Processor -- start 2024-09-05T01:33:32.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.380+0000 7fc16ec43740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4fafdfd50 0x55d4faff2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:32.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.380+0000 7fc16ec43740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafe0670 0x55d4faff34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:32.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.380+0000 7fc16ec43740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d4fafeaf30 0x55d4fafeff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:32.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.381+0000 7fc16ec43740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc1641b0fa0 con 0x55d4fafdfd50 2024-09-05T01:33:32.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.381+0000 7fc16ec43740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc1641b0810 con 0x55d4fafeaf30 2024-09-05T01:33:32.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.381+0000 7fc16ec43740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc1641ada40 con 0x55d4fafe0670 2024-09-05T01:33:32.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.381+0000 7fc16ec43740 10 client.0 _ll_register_callbacks cb 0x7fc15c09b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:33:32.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.381+0000 7fc168e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafe0670 0x55d4faff34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:32.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.381+0000 7fc168e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafe0670 0x55d4faff34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:53712/0 (socket says 172.21.15.12:53712) 2024-09-05T01:33:32.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.381+0000 7fc168e00640 1 -- 172.21.15.12:0/1067718333 learned_addr learned my addr 172.21.15.12:0/1067718333 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:33:32.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.381+0000 7fc16a200640 1 --2- 172.21.15.12:0/1067718333 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d4fafeaf30 0x55d4fafeff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:32.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.381+0000 7fc169800640 1 --2- 172.21.15.12:0/1067718333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4fafdfd50 0x55d4faff2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:32.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.381+0000 7fc168e00640 1 -- 172.21.15.12:0/1067718333 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d4fafeaf30 msgr2=0x55d4fafeff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:32.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.381+0000 7fc168e00640 1 --2- 172.21.15.12:0/1067718333 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d4fafeaf30 0x55d4fafeff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.381+0000 7fc168e00640 1 -- 172.21.15.12:0/1067718333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4fafdfd50 msgr2=0x55d4faff2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:33:32.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.381+0000 7fc168e00640 1 --2- 172.21.15.12:0/1067718333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4fafdfd50 0x55d4faff2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.381+0000 7fc168e00640 1 -- 172.21.15.12:0/1067718333 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4faff0480 con 0x55d4fafe0670 2024-09-05T01:33:32.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.381+0000 7fc169800640 1 --2- 172.21.15.12:0/1067718333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4fafdfd50 0x55d4faff2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:33:32.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.382+0000 7fc168e00640 1 --2- 172.21.15.12:0/1067718333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafe0670 0x55d4faff34b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc150000c00 tx=0x7fc1500056d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89da042d692ad699 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:33:32.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.382+0000 7fc14b400640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:33:32.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.382+0000 7fc14b400640 1 -- 172.21.15.12:0/1067718333 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc150052020 con 0x55d4fafe0670 2024-09-05T01:33:32.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.382+0000 7fc14b400640 1 -- 172.21.15.12:0/1067718333 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8579+0+0 (secure 0 0 0) 0x7fc150003b70 con 0x55d4fafe0670 2024-09-05T01:33:32.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.382+0000 7fc16ec43740 1 -- 172.21.15.12:0/1067718333 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc15c0a4940 con 0x55d4fafe0670 2024-09-05T01:33:32.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.382+0000 7fc14b400640 1 -- 172.21.15.12:0/1067718333 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fc15005d050 con 0x55d4fafe0670 2024-09-05T01:33:32.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.382+0000 7fc16ec43740 10 client.26386 fetch_fsmap learned FSMap version 49 2024-09-05T01:33:32.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.382+0000 7fc16ec43740 1 -- 172.21.15.12:0/1067718333 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55d4fb0660e0 con 0x55d4fafe0670 2024-09-05T01:33:32.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.383+0000 7fc14b400640 1 -- 172.21.15.12:0/1067718333 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc15c0a4940 con 0x55d4fafe0670 2024-09-05T01:33:32.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.383+0000 7fc14b400640 1 -- 172.21.15.12:0/1067718333 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 49) ==== 8422+0+0 (secure 0 0 0) 0x7fc15003d450 con 0x55d4fafe0670 2024-09-05T01:33:32.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.383+0000 7fc16ec43740 10 client.26386 fetch_fsmap finished waiting for FSMap version 49 2024-09-05T01:33:32.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.383+0000 7fc16ec43740 10 client.26386 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:33:32.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.383+0000 7fc16ec43740 20 client.26386 populate_metadata read hostname 'smithi012' 2024-09-05T01:33:32.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.383+0000 7fc16ec43740 1 --2- 172.21.15.12:0/1067718333 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55d4fb0664d0 0x55d4fb0688c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:33:32.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.383+0000 7fc16ec43740 4 client.26386 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T01:33:32.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.383+0000 7fc16ec43740 1 -- 172.21.15.12:0/1067718333 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d4faf4de60 con 0x55d4fb0664d0 2024-09-05T01:33:32.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.383+0000 7fc169800640 1 --2- 172.21.15.12:0/1067718333 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55d4fb0664d0 0x55d4fb0688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:33:32.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.384+0000 7fc169800640 1 --2- 172.21.15.12:0/1067718333 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55d4fb0664d0 0x55d4fb0688c0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a9b8d756a5bba10 server_cookie=7f02a8bb131e833a in_seq=0 out_seq=0 2024-09-05T01:33:32.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.384+0000 7fc14b400640 10 client.26386 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:33:32.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.384+0000 7fc14b400640 1 -- 172.21.15.12:0/1067718333 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+269 (crc 0 0 0) 0x55d4faf4de60 con 0x55d4fb0664d0 2024-09-05T01:33:32.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.384+0000 7fc14b400640 10 client.26386 handle_command_reply: tid=0 2024-09-05T01:33:32.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.384+0000 7fc16ec43740 1 client.26386 shutdown 2024-09-05T01:33:32.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.384+0000 7fc16ec43740 1 -- 172.21.15.12:0/1067718333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafe0670 msgr2=0x55d4faff34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:32.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.384+0000 7fc16ec43740 1 --2- 172.21.15.12:0/1067718333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafe0670 0x55d4faff34b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc150000c00 tx=0x7fc1500056d0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.384+0000 7fc16ec43740 1 -- 172.21.15.12:0/1067718333 shutdown_connections 2024-09-05T01:33:32.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.384+0000 7fc16ec43740 1 --2- 172.21.15.12:0/1067718333 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55d4fb0664d0 0x55d4fb0688c0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.384+0000 7fc16ec43740 1 --2- 172.21.15.12:0/1067718333 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d4fafeaf30 0x55d4fafeff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.384+0000 7fc16ec43740 1 --2- 172.21.15.12:0/1067718333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4fafe0670 0x55d4faff34b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.384+0000 7fc14b400640 0 client.26386 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:33:32.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.384+0000 7fc16ec43740 1 --2- 172.21.15.12:0/1067718333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d4fafdfd50 0x55d4faff2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.384+0000 7fc16ec43740 1 -- 172.21.15.12:0/1067718333 >> 172.21.15.12:0/1067718333 conn(0x55d4fafdc2e0 msgr2=0x55d4fafdb380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:32.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.385+0000 7fc16ec43740 1 -- 172.21.15.12:0/1067718333 shutdown_connections 2024-09-05T01:33:32.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.385+0000 7fc16ec43740 1 -- 172.21.15.12:0/1067718333 wait complete. 2024-09-05T01:33:32.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.385+0000 7fc16ec43740 20 client.26386 trim_cache size 0 max 16384 2024-09-05T01:33:32.389 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:33:32.389 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "scrub active (14400 inodes in the stack)", 2024-09-05T01:33:32.389 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-05T01:33:32.389 INFO:teuthology.orchestra.run.smithi012.stdout: "d3b3a44c-342a-42f6-a61e-f77a3e5d2675": { 2024-09-05T01:33:32.389 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-05T01:33:32.389 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "d3b3a44c-342a-42f6-a61e-f77a3e5d2675", 2024-09-05T01:33:32.389 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-05T01:33:32.390 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:33:32.390 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:33:32.390 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:33:32.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.385+0000 7fc16ac00640 1 -- 172.21.15.12:0/2453565225 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc14c0a2d70 msgr2=0x7fc14c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:32.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.385+0000 7fc16ac00640 1 --2- 172.21.15.12:0/2453565225 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc14c0a2d70 0x7fc14c0a5230 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc158009640 tx=0x7fc158005f90 comp rx=0 tx=0).stop 2024-09-05T01:33:32.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.385+0000 7fc16ac00640 1 -- 172.21.15.12:0/2453565225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1641079c0 msgr2=0x7fc16419ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:33:32.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.385+0000 7fc16ac00640 1 --2- 172.21.15.12:0/2453565225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1641079c0 0x7fc16419ed60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc15c00da10 tx=0x7fc15c00ded0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.386+0000 7fc16ac00640 1 -- 172.21.15.12:0/2453565225 shutdown_connections 2024-09-05T01:33:32.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.386+0000 7fc16ac00640 1 --2- 172.21.15.12:0/2453565225 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc14c0a2d70 0x7fc14c0a5230 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.386+0000 7fc16ac00640 1 --2- 172.21.15.12:0/2453565225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1641079c0 0x7fc16419ed60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.386+0000 7fc16ac00640 1 --2- 172.21.15.12:0/2453565225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc164102360 0x7fc16419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.386+0000 7fc16ac00640 1 --2- 172.21.15.12:0/2453565225 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc1641019c0 0x7fc16419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:33:32.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.386+0000 7fc16ac00640 1 -- 172.21.15.12:0/2453565225 >> 172.21.15.12:0/2453565225 conn(0x7fc1640fd6e0 msgr2=0x7fc16410d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:33:32.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.386+0000 7fc16ac00640 1 -- 172.21.15.12:0/2453565225 shutdown_connections 2024-09-05T01:33:32.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:33:32.386+0000 7fc16ac00640 1 -- 172.21.15.12:0/2453565225 wait complete. 2024-09-05T01:33:33.266 INFO:tasks.cephfs.filesystem:scrub status for tag:d3b3a44c-342a-42f6-a61e-f77a3e5d2675 - {'path': '/', 'tag': 'd3b3a44c-342a-42f6-a61e-f77a3e5d2675', 'options': 'recursive,force'} 2024-09-05T01:33:33.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:33 smithi012 ceph-mon[29942]: pgmap v274: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 146 op/s 2024-09-05T01:33:33.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:33 smithi145 ceph-mon[34376]: pgmap v274: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 146 op/s 2024-09-05T01:33:33.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:33 smithi151 ceph-mon[35013]: pgmap v274: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 146 op/s 2024-09-05T01:33:35.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:35 smithi012 ceph-mon[29942]: pgmap v275: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 273 op/s 2024-09-05T01:33:35.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:35 smithi145 ceph-mon[34376]: pgmap v275: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 273 op/s 2024-09-05T01:33:35.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:35 smithi151 ceph-mon[35013]: pgmap v275: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 273 op/s 2024-09-05T01:33:36.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:36.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:36.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:36.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:36.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:36.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:37.755 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:37 smithi151 ceph-mon[35013]: pgmap v276: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 268 op/s 2024-09-05T01:33:37.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:37 smithi012 ceph-mon[29942]: pgmap v276: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 268 op/s 2024-09-05T01:33:37.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:37 smithi145 ceph-mon[34376]: pgmap v276: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 268 op/s 2024-09-05T01:33:38.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:38 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:38.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:38 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:38.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:38 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:38.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:38 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:38.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:38 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:38.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:38 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:39.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:39 smithi012 ceph-mon[29942]: pgmap v277: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 288 op/s 2024-09-05T01:33:39.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:39 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:33:39.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:39 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:39.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:39 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:33:39.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:39 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:39.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:39 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:33:39.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:39 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:39.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:39 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:39.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:39 smithi145 ceph-mon[34376]: pgmap v277: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 288 op/s 2024-09-05T01:33:39.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:39 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:33:39.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:39 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:39.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:39 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:33:39.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:39 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:39.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:39 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:33:39.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:39 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:39.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:39 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:39.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:39 smithi151 ceph-mon[35013]: pgmap v277: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 288 op/s 2024-09-05T01:33:39.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:39 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:33:39.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:39 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:39.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:39 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:33:39.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:39 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:39.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:39 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:33:39.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:39 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:39.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:39 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:40.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:40 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:33:40.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:40 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:40.836 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:40 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:33:40.836 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:40 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:40.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:40 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:33:40.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:40 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:33:41.713 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:41 smithi012 ceph-mon[29942]: pgmap v278: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 327 op/s 2024-09-05T01:33:41.735 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:41 smithi145 ceph-mon[34376]: pgmap v278: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 327 op/s 2024-09-05T01:33:41.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:41 smithi151 ceph-mon[35013]: pgmap v278: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 327 op/s 2024-09-05T01:33:43.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:43 smithi012 ceph-mon[29942]: pgmap v279: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 255 op/s 2024-09-05T01:33:43.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:43 smithi145 ceph-mon[34376]: pgmap v279: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 255 op/s 2024-09-05T01:33:43.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:43 smithi151 ceph-mon[35013]: pgmap v279: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 255 op/s 2024-09-05T01:33:45.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:45 smithi012 ceph-mon[29942]: pgmap v280: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.0 MiB/s wr, 360 op/s 2024-09-05T01:33:45.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:45 smithi145 ceph-mon[34376]: pgmap v280: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.0 MiB/s wr, 360 op/s 2024-09-05T01:33:45.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:45 smithi151 ceph-mon[35013]: pgmap v280: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.0 MiB/s wr, 360 op/s 2024-09-05T01:33:47.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:47 smithi012 ceph-mon[29942]: pgmap v281: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.5 MiB/s wr, 241 op/s 2024-09-05T01:33:47.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:47 smithi145 ceph-mon[34376]: pgmap v281: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.5 MiB/s wr, 241 op/s 2024-09-05T01:33:47.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:47 smithi151 ceph-mon[35013]: pgmap v281: 97 pgs: 97 active+clean; 3.0 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.5 MiB/s wr, 241 op/s 2024-09-05T01:33:49.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:49 smithi012 ceph-mon[29942]: pgmap v282: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.9 MiB/s wr, 274 op/s 2024-09-05T01:33:49.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:49 smithi145 ceph-mon[34376]: pgmap v282: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.9 MiB/s wr, 274 op/s 2024-09-05T01:33:49.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:49 smithi151 ceph-mon[35013]: pgmap v282: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.9 MiB/s wr, 274 op/s 2024-09-05T01:33:51.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:51 smithi012 ceph-mon[29942]: pgmap v283: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 8.6 MiB/s wr, 377 op/s 2024-09-05T01:33:51.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:51 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:33:51.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:51 smithi145 ceph-mon[34376]: pgmap v283: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 8.6 MiB/s wr, 377 op/s 2024-09-05T01:33:51.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:51 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:33:51.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:51 smithi151 ceph-mon[35013]: pgmap v283: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 8.6 MiB/s wr, 377 op/s 2024-09-05T01:33:51.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:51 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:33:52.779 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:52 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:33:52.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:52 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:33:52.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:52 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:33:53.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:53 smithi012 ceph-mon[29942]: pgmap v284: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 8.0 MiB/s wr, 310 op/s 2024-09-05T01:33:53.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:53 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:33:53.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:53 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:33:53.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:53 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:33:53.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:53 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:33:53.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:53 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:33:53.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:53 smithi145 ceph-mon[34376]: pgmap v284: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 8.0 MiB/s wr, 310 op/s 2024-09-05T01:33:53.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:53 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:33:53.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:53 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:33:53.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:53 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:33:53.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:53 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:33:53.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:53 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:33:53.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:53 smithi151 ceph-mon[35013]: pgmap v284: 97 pgs: 97 active+clean; 3.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 8.0 MiB/s wr, 310 op/s 2024-09-05T01:33:53.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:53 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:33:53.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:53 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:33:53.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:53 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:33:53.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:53 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:33:53.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:53 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:33:55.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:55 smithi012 ceph-mon[29942]: pgmap v285: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 16 MiB/s wr, 350 op/s 2024-09-05T01:33:55.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:55 smithi145 ceph-mon[34376]: pgmap v285: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 16 MiB/s wr, 350 op/s 2024-09-05T01:33:55.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:55 smithi151 ceph-mon[35013]: pgmap v285: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 MiB/s rd, 16 MiB/s wr, 350 op/s 2024-09-05T01:33:57.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:57 smithi012 ceph-mon[29942]: pgmap v286: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 14 MiB/s wr, 232 op/s 2024-09-05T01:33:57.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:57 smithi145 ceph-mon[34376]: pgmap v286: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 14 MiB/s wr, 232 op/s 2024-09-05T01:33:57.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:57 smithi151 ceph-mon[35013]: pgmap v286: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 14 MiB/s wr, 232 op/s 2024-09-05T01:33:59.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:59 smithi012 ceph-mon[29942]: pgmap v287: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 14 MiB/s wr, 238 op/s 2024-09-05T01:33:59.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:59 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:33:59.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:59 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:33:59.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:33:59 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:33:59.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:59 smithi145 ceph-mon[34376]: pgmap v287: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 14 MiB/s wr, 238 op/s 2024-09-05T01:33:59.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:59 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:33:59.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:59 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:33:59.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:33:59 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:33:59.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:59 smithi151 ceph-mon[35013]: pgmap v287: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 14 MiB/s wr, 238 op/s 2024-09-05T01:33:59.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:59 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:33:59.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:59 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:33:59.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:33:59 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:34:01.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:00 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:34:01.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:00 smithi012 ceph-mon[29942]: pgmap v288: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 15 MiB/s wr, 266 op/s 2024-09-05T01:34:01.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:00 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:34:01.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:00 smithi145 ceph-mon[34376]: pgmap v288: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 15 MiB/s wr, 266 op/s 2024-09-05T01:34:01.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:00 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:34:01.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:00 smithi151 ceph-mon[35013]: pgmap v288: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 MiB/s rd, 15 MiB/s wr, 266 op/s 2024-09-05T01:34:03.267 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T01:34:03.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:02 smithi012 ceph-mon[29942]: pgmap v289: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 12 MiB/s wr, 157 op/s 2024-09-05T01:34:03.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:02 smithi145 ceph-mon[34376]: pgmap v289: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 12 MiB/s wr, 157 op/s 2024-09-05T01:34:03.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:02 smithi151 ceph-mon[35013]: pgmap v289: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 12 MiB/s wr, 157 op/s 2024-09-05T01:34:03.924 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:34:04.144 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:03 smithi012 ceph-mon[29942]: osdmap e93: 12 total, 12 up, 12 in 2024-09-05T01:34:04.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:03 smithi145 ceph-mon[34376]: osdmap e93: 12 total, 12 up, 12 in 2024-09-05T01:34:04.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:03 smithi151 ceph-mon[35013]: osdmap e93: 12 total, 12 up, 12 in 2024-09-05T01:34:04.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.680+0000 7f586dc00640 1 -- 172.21.15.12:0/2518755287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5868108f60 msgr2=0x7f5868110ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:04.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.680+0000 7f586dc00640 1 --2- 172.21.15.12:0/2518755287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5868108f60 0x7f5868110ae0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5860009900 tx=0x7f586002a410 comp rx=0 tx=0).stop 2024-09-05T01:34:04.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.681+0000 7f586dc00640 1 -- 172.21.15.12:0/2518755287 shutdown_connections 2024-09-05T01:34:04.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.681+0000 7f586dc00640 1 --2- 172.21.15.12:0/2518755287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5868108f60 0x7f5868110ae0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.681+0000 7f586dc00640 1 --2- 172.21.15.12:0/2518755287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58681047e0 0x7f5868108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.681+0000 7f586dc00640 1 --2- 172.21.15.12:0/2518755287 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5868103e30 0x7f5868104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.681+0000 7f586dc00640 1 -- 172.21.15.12:0/2518755287 >> 172.21.15.12:0/2518755287 conn(0x7f58680ff8d0 msgr2=0x7f5868101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:04.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.682+0000 7f586dc00640 1 -- 172.21.15.12:0/2518755287 shutdown_connections 2024-09-05T01:34:04.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.682+0000 7f586dc00640 1 -- 172.21.15.12:0/2518755287 wait complete. 2024-09-05T01:34:04.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.683+0000 7f586dc00640 1 Processor -- start 2024-09-05T01:34:04.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.684+0000 7f586dc00640 1 -- start start 2024-09-05T01:34:04.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.684+0000 7f586dc00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5868103e30 0x7f586819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:04.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.684+0000 7f586dc00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58681047e0 0x7f586819a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:04.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.684+0000 7f586dc00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5868108f60 0x7f586819eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:04.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.684+0000 7f586dc00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5868114010 con 0x7f5868103e30 2024-09-05T01:34:04.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.684+0000 7f586dc00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f5868113e90 con 0x7f5868108f60 2024-09-05T01:34:04.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.684+0000 7f586dc00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5868114190 con 0x7f58681047e0 2024-09-05T01:34:04.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.685+0000 7f585f400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58681047e0 0x7f586819a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:04.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.685+0000 7f585f400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58681047e0 0x7f586819a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:53324/0 (socket says 172.21.15.12:53324) 2024-09-05T01:34:04.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.685+0000 7f585f400640 1 -- 172.21.15.12:0/3978041333 learned_addr learned my addr 172.21.15.12:0/3978041333 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:04.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.685+0000 7f586d200640 1 --2- 172.21.15.12:0/3978041333 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5868108f60 0x7f586819eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:04.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.686+0000 7f585f400640 1 -- 172.21.15.12:0/3978041333 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5868108f60 msgr2=0x7f586819eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:04.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.686+0000 7f585f400640 1 --2- 172.21.15.12:0/3978041333 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5868108f60 0x7f586819eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.686+0000 7f585f400640 1 -- 172.21.15.12:0/3978041333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5868103e30 msgr2=0x7f586819a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:04.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.686+0000 7f585f400640 1 --2- 172.21.15.12:0/3978041333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5868103e30 0x7f586819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.686+0000 7f585f400640 1 -- 172.21.15.12:0/3978041333 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f586819f380 con 0x7f58681047e0 2024-09-05T01:34:04.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.687+0000 7f585f400640 1 --2- 172.21.15.12:0/3978041333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58681047e0 0x7f586819a910 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f585000e9f0 tx=0x7f585000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:04.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.688+0000 7f5865600640 1 -- 172.21.15.12:0/3978041333 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585000cd80 con 0x7f58681047e0 2024-09-05T01:34:04.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.688+0000 7f5865600640 1 -- 172.21.15.12:0/3978041333 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5850010910 con 0x7f58681047e0 2024-09-05T01:34:04.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.688+0000 7f5865600640 1 -- 172.21.15.12:0/3978041333 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5850018990 con 0x7f58681047e0 2024-09-05T01:34:04.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.688+0000 7f586dc00640 1 -- 172.21.15.12:0/3978041333 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f586819f670 con 0x7f58681047e0 2024-09-05T01:34:04.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.688+0000 7f586dc00640 1 -- 172.21.15.12:0/3978041333 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f586819fad0 con 0x7f58681047e0 2024-09-05T01:34:04.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.694+0000 7f5871de0740 1 Processor -- start 2024-09-05T01:34:04.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.694+0000 7f5871de0740 1 -- start start 2024-09-05T01:34:04.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.695+0000 7f5865600640 1 -- 172.21.15.12:0/3978041333 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f5850010ac0 con 0x7f58681047e0 2024-09-05T01:34:04.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.696+0000 7f5871de0740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d3d50 0x55f70b5d4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:04.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.696+0000 7f5871de0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f70b5d4670 0x55f70b5de9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:04.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.696+0000 7f5871de0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70b5def30 0x55f70b5e1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:04.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.696+0000 7f5871de0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f70b53a3e0 con 0x55f70b5def30 2024-09-05T01:34:04.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.696+0000 7f5871de0740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55f70b4e1d80 con 0x55f70b5d3d50 2024-09-05T01:34:04.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.696+0000 7f5871de0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f70b5363a0 con 0x55f70b5d4670 2024-09-05T01:34:04.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.696+0000 7f586d200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d3d50 0x55f70b5d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:04.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.696+0000 7f586d200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d3d50 0x55f70b5d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:50036/0 (socket says 172.21.15.12:50036) 2024-09-05T01:34:04.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.696+0000 7f586d200640 1 -- 172.21.15.12:0/2025768125 learned_addr learned my addr 172.21.15.12:0/2025768125 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:04.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.696+0000 7f5867e00640 1 --2- 172.21.15.12:0/2025768125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f70b5d4670 0x55f70b5de9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:04.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.697+0000 7f5865600640 1 --2- 172.21.15.12:0/3978041333 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f584c0a2df0 0x7f584c0a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:04.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.698+0000 7f5865600640 1 -- 172.21.15.12:0/3978041333 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8623+0+0 (secure 0 0 0) 0x7f58500cf7a0 con 0x7f58681047e0 2024-09-05T01:34:04.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.698+0000 7f586d200640 1 -- 172.21.15.12:0/2025768125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f70b5d4670 msgr2=0x55f70b5de9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:04.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.698+0000 7f586d200640 1 --2- 172.21.15.12:0/2025768125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f70b5d4670 0x55f70b5de9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.698+0000 7f586d200640 1 -- 172.21.15.12:0/2025768125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70b5def30 msgr2=0x55f70b5e1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:04.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.698+0000 7f586d200640 1 --2- 172.21.15.12:0/2025768125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70b5def30 0x55f70b5e1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.698+0000 7f586d200640 1 -- 172.21.15.12:0/2025768125 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f70b500ae0 con 0x55f70b5d3d50 2024-09-05T01:34:04.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.698+0000 7f586d200640 1 --2- 172.21.15.12:0/3978041333 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f584c0a2df0 0x7f584c0a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:04.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.700+0000 7f586d200640 1 --2- 172.21.15.12:0/2025768125 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d3d50 0x55f70b5d4130 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f586002aa00 tx=0x7f5860004110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89cafeafb503c61d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:04.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.701+0000 7f586d200640 1 --2- 172.21.15.12:0/3978041333 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f584c0a2df0 0x7f584c0a52b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f586004b000 tx=0x7f5860048000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:04.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.701+0000 7f585d600640 1 -- 172.21.15.12:0/2025768125 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5860035040 con 0x55f70b5d3d50 2024-09-05T01:34:04.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.701+0000 7f585d600640 1 -- 172.21.15.12:0/2025768125 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58600315b0 con 0x55f70b5d3d50 2024-09-05T01:34:04.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.701+0000 7f585d600640 1 -- 172.21.15.12:0/2025768125 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58600466a0 con 0x55f70b5d3d50 2024-09-05T01:34:04.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.702+0000 7f5871de0740 1 -- 172.21.15.12:0/2025768125 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d3d50 msgr2=0x55f70b5d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:04.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.702+0000 7f5871de0740 1 --2- 172.21.15.12:0/2025768125 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d3d50 0x55f70b5d4130 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f586002aa00 tx=0x7f5860004110 comp rx=0 tx=0).stop 2024-09-05T01:34:04.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.703+0000 7f5871de0740 1 -- 172.21.15.12:0/2025768125 shutdown_connections 2024-09-05T01:34:04.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.703+0000 7f5871de0740 1 --2- 172.21.15.12:0/2025768125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70b5def30 0x55f70b5e1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.703+0000 7f5871de0740 1 --2- 172.21.15.12:0/2025768125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f70b5d4670 0x55f70b5de9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.703+0000 7f5871de0740 1 --2- 172.21.15.12:0/2025768125 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d3d50 0x55f70b5d4130 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.703+0000 7f5871de0740 1 -- 172.21.15.12:0/2025768125 >> 172.21.15.12:0/2025768125 conn(0x55f70b5d02e0 msgr2=0x55f70b5d06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:04.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.703+0000 7f5871de0740 1 -- 172.21.15.12:0/2025768125 shutdown_connections 2024-09-05T01:34:04.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.704+0000 7f5871de0740 1 -- 172.21.15.12:0/2025768125 wait complete. 2024-09-05T01:34:04.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.704+0000 7f5871de0740 1 -- start start 2024-09-05T01:34:04.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.705+0000 7f5871de0740 1 Processor -- start 2024-09-05T01:34:04.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.706+0000 7f5871de0740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d3d50 0x55f70b5dbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:04.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.706+0000 7f5871de0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70b5d4670 0x55f70b5dc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:04.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.706+0000 7f5871de0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f70b5def30 0x55f70b5dc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:04.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.706+0000 7f5871de0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f70b5e1ba0 con 0x55f70b5d4670 2024-09-05T01:34:04.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.706+0000 7f5871de0740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55f70b4f50f0 con 0x55f70b5d3d50 2024-09-05T01:34:04.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.706+0000 7f5871de0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f70b5e1d20 con 0x55f70b5def30 2024-09-05T01:34:04.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.706+0000 7f5871de0740 10 client.0 _ll_register_callbacks cb 0x55f70b4e69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:34:04.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.707+0000 7f5867e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d3d50 0x55f70b5dbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:04.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.707+0000 7f586d200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f70b5def30 0x55f70b5dc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:04.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.707+0000 7f5867e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d3d50 0x55f70b5dbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:50044/0 (socket says 172.21.15.12:50044) 2024-09-05T01:34:04.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.707+0000 7f5867e00640 1 -- 172.21.15.12:0/2736956989 learned_addr learned my addr 172.21.15.12:0/2736956989 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:04.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.707+0000 7f586d200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f70b5def30 0x55f70b5dc960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:53352/0 (socket says 172.21.15.12:53352) 2024-09-05T01:34:04.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.708+0000 7f585f400640 1 --2- 172.21.15.12:0/2736956989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70b5d4670 0x55f70b5dc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:04.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.709+0000 7f586d200640 1 -- 172.21.15.12:0/2736956989 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d3d50 msgr2=0x55f70b5dbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:04.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.709+0000 7f586d200640 1 --2- 172.21.15.12:0/2736956989 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d3d50 0x55f70b5dbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.709+0000 7f586d200640 1 -- 172.21.15.12:0/2736956989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70b5d4670 msgr2=0x55f70b5dc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:04.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.709+0000 7f586d200640 1 --2- 172.21.15.12:0/2736956989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70b5d4670 0x55f70b5dc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.709+0000 7f586d200640 1 -- 172.21.15.12:0/2736956989 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f70b2ab3c0 con 0x55f70b5def30 2024-09-05T01:34:04.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.709+0000 7f585f400640 1 --2- 172.21.15.12:0/2736956989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70b5d4670 0x55f70b5dc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:34:04.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.710+0000 7f586d200640 1 --2- 172.21.15.12:0/2736956989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f70b5def30 0x55f70b5dc960 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5860009900 tx=0x7f5860031970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edd93290e5ac9706 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:04.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.710+0000 7f5856000640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:34:04.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.711+0000 7f5856000640 1 -- 172.21.15.12:0/2736956989 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5860003c20 con 0x55f70b5def30 2024-09-05T01:34:04.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.711+0000 7f5856000640 1 -- 172.21.15.12:0/2736956989 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8623+0+0 (secure 0 0 0) 0x7f586004d040 con 0x55f70b5def30 2024-09-05T01:34:04.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.711+0000 7f5871de0740 1 -- 172.21.15.12:0/2736956989 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58600315b0 con 0x55f70b5def30 2024-09-05T01:34:04.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.711+0000 7f5856000640 1 -- 172.21.15.12:0/2736956989 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f5860051480 con 0x55f70b5def30 2024-09-05T01:34:04.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.711+0000 7f5871de0740 10 client.26398 fetch_fsmap learned FSMap version 51 2024-09-05T01:34:04.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.712+0000 7f5871de0740 1 -- 172.21.15.12:0/2736956989 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55f70b5e1ba0 con 0x55f70b5def30 2024-09-05T01:34:04.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.712+0000 7f5856000640 1 -- 172.21.15.12:0/2736956989 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58600315b0 con 0x55f70b5def30 2024-09-05T01:34:04.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.712+0000 7f5856000640 1 -- 172.21.15.12:0/2736956989 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 51) ==== 8422+0+0 (secure 0 0 0) 0x7f5860044040 con 0x55f70b5def30 2024-09-05T01:34:04.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.712+0000 7f5871de0740 10 client.26398 fetch_fsmap finished waiting for FSMap version 51 2024-09-05T01:34:04.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.713+0000 7f5871de0740 10 client.26398 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:34:04.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.713+0000 7f5871de0740 20 client.26398 populate_metadata read hostname 'smithi012' 2024-09-05T01:34:04.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.713+0000 7f5871de0740 1 --2- 172.21.15.12:0/2736956989 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f70b5eeae0 0x55f70b5f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:04.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.713+0000 7f5871de0740 4 client.26398 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:34:04.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.713+0000 7f5871de0740 1 -- 172.21.15.12:0/2736956989 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f70b547950 con 0x55f70b5eeae0 2024-09-05T01:34:04.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.713+0000 7f5867e00640 1 --2- 172.21.15.12:0/2736956989 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f70b5eeae0 0x55f70b5f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:04.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.714+0000 7f5867e00640 1 --2- 172.21.15.12:0/2736956989 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f70b5eeae0 0x55f70b5f0ed0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d463c4b6f283ec3f server_cookie=f26af0e5cc331f48 in_seq=0 out_seq=0 2024-09-05T01:34:04.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.714+0000 7f5856000640 10 client.26398 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:34:04.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.715+0000 7f5856000640 1 -- 172.21.15.12:0/2736956989 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f70b547950 con 0x55f70b5eeae0 2024-09-05T01:34:04.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.715+0000 7f5856000640 10 client.26398 handle_command_reply: tid=0 2024-09-05T01:34:04.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.715+0000 7f5871de0740 1 client.26398 shutdown 2024-09-05T01:34:04.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.715+0000 7f5871de0740 1 -- 172.21.15.12:0/2736956989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f70b5def30 msgr2=0x55f70b5dc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:04.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.715+0000 7f5871de0740 1 --2- 172.21.15.12:0/2736956989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f70b5def30 0x55f70b5dc960 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5860009900 tx=0x7f5860031970 comp rx=0 tx=0).stop 2024-09-05T01:34:04.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.716+0000 7f5871de0740 1 -- 172.21.15.12:0/2736956989 shutdown_connections 2024-09-05T01:34:04.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.716+0000 7f5871de0740 1 --2- 172.21.15.12:0/2736956989 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f70b5eeae0 0x55f70b5f0ed0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.716+0000 7f5871de0740 1 --2- 172.21.15.12:0/2736956989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f70b5def30 0x55f70b5dc960 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.716+0000 7f5871de0740 1 --2- 172.21.15.12:0/2736956989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70b5d4670 0x55f70b5dc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.716+0000 7f5871de0740 1 --2- 172.21.15.12:0/2736956989 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d3d50 0x55f70b5dbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.716+0000 7f5871de0740 1 -- 172.21.15.12:0/2736956989 >> 172.21.15.12:0/2736956989 conn(0x55f70b5d02e0 msgr2=0x55f70b5d5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:04.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.716+0000 7f5856000640 0 client.26398 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:34:04.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.716+0000 7f5871de0740 1 -- 172.21.15.12:0/2736956989 shutdown_connections 2024-09-05T01:34:04.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.716+0000 7f5871de0740 1 -- 172.21.15.12:0/2736956989 wait complete. 2024-09-05T01:34:04.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.717+0000 7f5871de0740 20 client.26398 trim_cache size 0 max 16384 2024-09-05T01:34:04.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.758+0000 7f5871de0740 1 Processor -- start 2024-09-05T01:34:04.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.758+0000 7f5871de0740 1 -- start start 2024-09-05T01:34:04.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.759+0000 7f5871de0740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d3d50 0x55f70b5f6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:04.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.759+0000 7f5871de0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70b5d4670 0x55f70b5f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:04.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.759+0000 7f5871de0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f70b5def30 0x55f70b5e6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:04.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.759+0000 7f5871de0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f58681b3ef0 con 0x55f70b5d4670 2024-09-05T01:34:04.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.759+0000 7f5871de0740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f58681b5bb0 con 0x55f70b5d3d50 2024-09-05T01:34:04.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.759+0000 7f5871de0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f58681b45c0 con 0x55f70b5def30 2024-09-05T01:34:04.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.759+0000 7f5867e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d3d50 0x55f70b5f6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:04.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.759+0000 7f5867e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d3d50 0x55f70b5f6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:50060/0 (socket says 172.21.15.12:50060) 2024-09-05T01:34:04.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.759+0000 7f5867e00640 1 -- 172.21.15.12:0/2663904185 learned_addr learned my addr 172.21.15.12:0/2663904185 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:04.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.760+0000 7f5867e00640 1 -- 172.21.15.12:0/2663904185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f70b5def30 msgr2=0x55f70b5e6fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:34:04.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.760+0000 7f5867e00640 1 --2- 172.21.15.12:0/2663904185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f70b5def30 0x55f70b5e6fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.760+0000 7f5867e00640 1 -- 172.21.15.12:0/2663904185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70b5d4670 msgr2=0x55f70b5f6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:04.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.760+0000 7f5867e00640 1 --2- 172.21.15.12:0/2663904185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70b5d4670 0x55f70b5f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.760+0000 7f5867e00640 1 -- 172.21.15.12:0/2663904185 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f70b5de850 con 0x55f70b5d3d50 2024-09-05T01:34:04.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.760+0000 7f5867e00640 1 --2- 172.21.15.12:0/2663904185 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d3d50 0x55f70b5f6660 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55f70b5f1600 tx=0x7f58580128e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7142e1c676df934d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:04.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.762+0000 7f585cc00640 1 -- 172.21.15.12:0/2663904185 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58580120d0 con 0x55f70b5d3d50 2024-09-05T01:34:04.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.762+0000 7f585cc00640 1 -- 172.21.15.12:0/2663904185 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5858012270 con 0x55f70b5d3d50 2024-09-05T01:34:04.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.762+0000 7f585cc00640 1 -- 172.21.15.12:0/2663904185 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5858024980 con 0x55f70b5d3d50 2024-09-05T01:34:04.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.763+0000 7f5871de0740 1 -- 172.21.15.12:0/2663904185 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d3d50 msgr2=0x55f70b5f6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:04.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.763+0000 7f5871de0740 1 --2- 172.21.15.12:0/2663904185 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d3d50 0x55f70b5f6660 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55f70b5f1600 tx=0x7f58580128e0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.763+0000 7f5871de0740 1 -- 172.21.15.12:0/2663904185 shutdown_connections 2024-09-05T01:34:04.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.763+0000 7f5871de0740 1 --2- 172.21.15.12:0/2663904185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f70b5def30 0x55f70b5e6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.763+0000 7f5871de0740 1 --2- 172.21.15.12:0/2663904185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70b5d4670 0x55f70b5f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.763+0000 7f5871de0740 1 --2- 172.21.15.12:0/2663904185 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d3d50 0x55f70b5f6660 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.763+0000 7f5871de0740 1 -- 172.21.15.12:0/2663904185 >> 172.21.15.12:0/2663904185 conn(0x55f70b5d02e0 msgr2=0x55f70b5ddf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:04.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.766+0000 7f5871de0740 1 -- 172.21.15.12:0/2663904185 shutdown_connections 2024-09-05T01:34:04.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.766+0000 7f5871de0740 1 -- 172.21.15.12:0/2663904185 wait complete. 2024-09-05T01:34:04.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.767+0000 7f5871de0740 1 -- start start 2024-09-05T01:34:04.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.768+0000 7f5871de0740 1 Processor -- start 2024-09-05T01:34:04.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.768+0000 7f5871de0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f70b5d3d50 0x55f70b5e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:04.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.768+0000 7f5871de0740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d4670 0x55f70b5e4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:04.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.768+0000 7f5871de0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70b5def30 0x55f70b5e53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:04.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.769+0000 7f5867e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f70b5d3d50 0x55f70b5e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:04.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.769+0000 7f5867e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f70b5d3d50 0x55f70b5e78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:53362/0 (socket says 172.21.15.12:53362) 2024-09-05T01:34:04.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.769+0000 7f5867e00640 1 -- 172.21.15.12:0/1437831729 learned_addr learned my addr 172.21.15.12:0/1437831729 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:04.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.769+0000 7f5871de0740 1 -- 172.21.15.12:0/1437831729 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f58681b5420 con 0x55f70b5def30 2024-09-05T01:34:04.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.769+0000 7f5871de0740 1 -- 172.21.15.12:0/1437831729 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f58681b4c90 con 0x55f70b5d4670 2024-09-05T01:34:04.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.769+0000 7f5871de0740 1 -- 172.21.15.12:0/1437831729 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f58681b1ef0 con 0x55f70b5d3d50 2024-09-05T01:34:04.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.769+0000 7f5871de0740 10 client.0 _ll_register_callbacks cb 0x7f5860004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:34:04.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.769+0000 7f585f400640 1 --2- 172.21.15.12:0/1437831729 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d4670 0x55f70b5e4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:04.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.770+0000 7f5867e00640 1 -- 172.21.15.12:0/1437831729 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d4670 msgr2=0x55f70b5e4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:04.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.770+0000 7f5867e00640 1 --2- 172.21.15.12:0/1437831729 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d4670 0x55f70b5e4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.770+0000 7f5867e00640 1 -- 172.21.15.12:0/1437831729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70b5def30 msgr2=0x55f70b5e53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:04.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.770+0000 7f5867e00640 1 --2- 172.21.15.12:0/1437831729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70b5def30 0x55f70b5e53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.770+0000 7f5867e00640 1 -- 172.21.15.12:0/1437831729 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f70b658640 con 0x55f70b5d3d50 2024-09-05T01:34:04.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.770+0000 7f5867e00640 1 --2- 172.21.15.12:0/1437831729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f70b5d3d50 0x55f70b5e78e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5858024930 tx=0x7f5858024960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d008411edbb915d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:04.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.770+0000 7f5856000640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:34:04.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.770+0000 7f5856000640 1 -- 172.21.15.12:0/1437831729 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58580120d0 con 0x55f70b5d3d50 2024-09-05T01:34:04.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.771+0000 7f5856000640 1 -- 172.21.15.12:0/1437831729 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8623+0+0 (secure 0 0 0) 0x7f5858020050 con 0x55f70b5d3d50 2024-09-05T01:34:04.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.771+0000 7f5871de0740 1 -- 172.21.15.12:0/1437831729 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5858012270 con 0x55f70b5d3d50 2024-09-05T01:34:04.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.772+0000 7f5856000640 1 -- 172.21.15.12:0/1437831729 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f5858024c90 con 0x55f70b5d3d50 2024-09-05T01:34:04.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.772+0000 7f5871de0740 10 client.26401 fetch_fsmap learned FSMap version 51 2024-09-05T01:34:04.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.772+0000 7f5871de0740 1 -- 172.21.15.12:0/1437831729 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55f70b659830 con 0x55f70b5d3d50 2024-09-05T01:34:04.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.772+0000 7f5856000640 1 -- 172.21.15.12:0/1437831729 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5858012270 con 0x55f70b5d3d50 2024-09-05T01:34:04.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.773+0000 7f5856000640 1 -- 172.21.15.12:0/1437831729 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 51) ==== 8422+0+0 (secure 0 0 0) 0x7f5858004540 con 0x55f70b5d3d50 2024-09-05T01:34:04.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.773+0000 7f5871de0740 10 client.26401 fetch_fsmap finished waiting for FSMap version 51 2024-09-05T01:34:04.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.773+0000 7f5871de0740 10 client.26401 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:34:04.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.773+0000 7f5871de0740 20 client.26401 populate_metadata read hostname 'smithi012' 2024-09-05T01:34:04.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.773+0000 7f5871de0740 1 --2- 172.21.15.12:0/1437831729 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f70b659ec0 0x55f70b65c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:04.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.773+0000 7f5871de0740 4 client.26401 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T01:34:04.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.773+0000 7f5871de0740 1 -- 172.21.15.12:0/1437831729 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f70b541e60 con 0x55f70b659ec0 2024-09-05T01:34:04.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.774+0000 7f585f400640 1 --2- 172.21.15.12:0/1437831729 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f70b659ec0 0x55f70b65c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:04.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.774+0000 7f585f400640 1 --2- 172.21.15.12:0/1437831729 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f70b659ec0 0x55f70b65c2e0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=561f6851f7777ca4 server_cookie=d6090289faeac5ed in_seq=0 out_seq=0 2024-09-05T01:34:04.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.774+0000 7f5856000640 10 client.26401 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:34:04.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.775+0000 7f5856000640 1 -- 172.21.15.12:0/1437831729 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f70b541e60 con 0x55f70b659ec0 2024-09-05T01:34:04.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.775+0000 7f5856000640 10 client.26401 handle_command_reply: tid=0 2024-09-05T01:34:04.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.775+0000 7f5871de0740 1 client.26401 shutdown 2024-09-05T01:34:04.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.775+0000 7f5871de0740 1 -- 172.21.15.12:0/1437831729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f70b5d3d50 msgr2=0x55f70b5e78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:04.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.775+0000 7f5871de0740 1 --2- 172.21.15.12:0/1437831729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f70b5d3d50 0x55f70b5e78e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5858024930 tx=0x7f5858024960 comp rx=0 tx=0).stop 2024-09-05T01:34:04.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.776+0000 7f5871de0740 1 -- 172.21.15.12:0/1437831729 shutdown_connections 2024-09-05T01:34:04.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.776+0000 7f5871de0740 1 --2- 172.21.15.12:0/1437831729 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f70b659ec0 0x55f70b65c2e0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.776+0000 7f5856000640 0 client.26401 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:34:04.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.776+0000 7f5871de0740 1 --2- 172.21.15.12:0/1437831729 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f70b5def30 0x55f70b5e53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.776+0000 7f5871de0740 1 --2- 172.21.15.12:0/1437831729 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f70b5d4670 0x55f70b5e4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.776+0000 7f5871de0740 1 --2- 172.21.15.12:0/1437831729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f70b5d3d50 0x55f70b5e78e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.776+0000 7f5871de0740 1 -- 172.21.15.12:0/1437831729 >> 172.21.15.12:0/1437831729 conn(0x55f70b5d02e0 msgr2=0x55f70b5ceb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:04.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.776+0000 7f5871de0740 1 -- 172.21.15.12:0/1437831729 shutdown_connections 2024-09-05T01:34:04.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.777+0000 7f5871de0740 1 -- 172.21.15.12:0/1437831729 wait complete. 2024-09-05T01:34:04.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.777+0000 7f5871de0740 20 client.26401 trim_cache size 0 max 16384 2024-09-05T01:34:04.780 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:34:04.780 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-05T01:34:04.780 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-05T01:34:04.780 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:34:04.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.779+0000 7f586dc00640 1 -- 172.21.15.12:0/3978041333 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f584c0a2df0 msgr2=0x7f584c0a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:04.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.779+0000 7f586dc00640 1 --2- 172.21.15.12:0/3978041333 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f584c0a2df0 0x7f584c0a52b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f586004b000 tx=0x7f5860048000 comp rx=0 tx=0).stop 2024-09-05T01:34:04.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.779+0000 7f586dc00640 1 -- 172.21.15.12:0/3978041333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58681047e0 msgr2=0x7f586819a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:04.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.779+0000 7f586dc00640 1 --2- 172.21.15.12:0/3978041333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58681047e0 0x7f586819a910 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f585000e9f0 tx=0x7f585000eeb0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.780+0000 7f586dc00640 1 -- 172.21.15.12:0/3978041333 shutdown_connections 2024-09-05T01:34:04.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.780+0000 7f586dc00640 1 --2- 172.21.15.12:0/3978041333 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f584c0a2df0 0x7f584c0a52b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.780+0000 7f586dc00640 1 --2- 172.21.15.12:0/3978041333 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5868108f60 0x7f586819eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.780+0000 7f586dc00640 1 --2- 172.21.15.12:0/3978041333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58681047e0 0x7f586819a910 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.780+0000 7f586dc00640 1 --2- 172.21.15.12:0/3978041333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5868103e30 0x7f586819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:04.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.780+0000 7f586dc00640 1 -- 172.21.15.12:0/3978041333 >> 172.21.15.12:0/3978041333 conn(0x7f58680ff8d0 msgr2=0x7f5868100bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:04.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.781+0000 7f586dc00640 1 -- 172.21.15.12:0/3978041333 shutdown_connections 2024-09-05T01:34:04.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:04.781+0000 7f586dc00640 1 -- 172.21.15.12:0/3978041333 wait complete. 2024-09-05T01:34:05.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:04 smithi012 ceph-mon[29942]: pgmap v291: 97 pgs: 23 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 62 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 6.8 MiB/s wr, 313 op/s 2024-09-05T01:34:05.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:04 smithi145 ceph-mon[34376]: pgmap v291: 97 pgs: 23 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 62 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 6.8 MiB/s wr, 313 op/s 2024-09-05T01:34:05.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:04 smithi151 ceph-mon[35013]: pgmap v291: 97 pgs: 23 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 62 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 6.8 MiB/s wr, 313 op/s 2024-09-05T01:34:05.550 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-05T01:34:05.551 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:34:06.021 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:34:06.172 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:05 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:34:06.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:05 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:34:06.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:05 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:34:06.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.656+0000 7f1409200640 1 -- 172.21.15.12:0/2859098105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14041019c0 msgr2=0x7f1404101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:06.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.656+0000 7f1409200640 1 --2- 172.21.15.12:0/2859098105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14041019c0 0x7f1404101e20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f13f0009930 tx=0x7f13f002a440 comp rx=0 tx=0).stop 2024-09-05T01:34:06.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.656+0000 7f1409200640 1 -- 172.21.15.12:0/2859098105 shutdown_connections 2024-09-05T01:34:06.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.656+0000 7f1409200640 1 --2- 172.21.15.12:0/2859098105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1404102360 0x7f140410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:06.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.656+0000 7f1409200640 1 --2- 172.21.15.12:0/2859098105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14041019c0 0x7f1404101e20 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:06.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.656+0000 7f1409200640 1 --2- 172.21.15.12:0/2859098105 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14041079c0 0x7f1404107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:06.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.656+0000 7f1409200640 1 -- 172.21.15.12:0/2859098105 >> 172.21.15.12:0/2859098105 conn(0x7f14040fd740 msgr2=0x7f14040ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:06.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.656+0000 7f1409200640 1 -- 172.21.15.12:0/2859098105 shutdown_connections 2024-09-05T01:34:06.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.656+0000 7f1409200640 1 -- 172.21.15.12:0/2859098105 wait complete. 2024-09-05T01:34:06.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.657+0000 7f1409200640 1 Processor -- start 2024-09-05T01:34:06.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.657+0000 7f1409200640 1 -- start start 2024-09-05T01:34:06.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.658+0000 7f1409200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14041019c0 0x7f140419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:06.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.658+0000 7f1409200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1404102360 0x7f140419ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:06.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.658+0000 7f1409200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14041079c0 0x7f140419ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:06.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.658+0000 7f1409200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1404074e30 con 0x7f14041079c0 2024-09-05T01:34:06.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.658+0000 7f1409200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1404074cb0 con 0x7f14041019c0 2024-09-05T01:34:06.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.658+0000 7f1409200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1404074fb0 con 0x7f1404102360 2024-09-05T01:34:06.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.658+0000 7f1402a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1404102360 0x7f140419ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:06.660 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.658+0000 7f1402a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1404102360 0x7f140419ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:53376/0 (socket says 172.21.15.12:53376) 2024-09-05T01:34:06.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.658+0000 7f1402a00640 1 -- 172.21.15.12:0/1082493677 learned_addr learned my addr 172.21.15.12:0/1082493677 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:06.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.658+0000 7f1403400640 1 --2- 172.21.15.12:0/1082493677 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14041019c0 0x7f140419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:06.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.658+0000 7f1403e00640 1 --2- 172.21.15.12:0/1082493677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14041079c0 0x7f140419ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:06.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.659+0000 7f1402a00640 1 -- 172.21.15.12:0/1082493677 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14041019c0 msgr2=0x7f140419a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:06.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.659+0000 7f1402a00640 1 --2- 172.21.15.12:0/1082493677 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14041019c0 0x7f140419a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:06.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.659+0000 7f1402a00640 1 -- 172.21.15.12:0/1082493677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14041079c0 msgr2=0x7f140419ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:06.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.659+0000 7f1402a00640 1 --2- 172.21.15.12:0/1082493677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14041079c0 0x7f140419ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:06.661 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.659+0000 7f1402a00640 1 -- 172.21.15.12:0/1082493677 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140419f4c0 con 0x7f1404102360 2024-09-05T01:34:06.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.659+0000 7f1402a00640 1 --2- 172.21.15.12:0/1082493677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1404102360 0x7f140419ac30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f13f002a960 tx=0x7f13f0003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:06.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.659+0000 7f13fbe00640 1 -- 172.21.15.12:0/1082493677 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f003f070 con 0x7f1404102360 2024-09-05T01:34:06.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.659+0000 7f13fbe00640 1 -- 172.21.15.12:0/1082493677 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13f0031c90 con 0x7f1404102360 2024-09-05T01:34:06.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.659+0000 7f13fbe00640 1 -- 172.21.15.12:0/1082493677 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f0035030 con 0x7f1404102360 2024-09-05T01:34:06.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.659+0000 7f1409200640 1 -- 172.21.15.12:0/1082493677 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f140419f750 con 0x7f1404102360 2024-09-05T01:34:06.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.660+0000 7f1409200640 1 -- 172.21.15.12:0/1082493677 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14041a7090 con 0x7f1404102360 2024-09-05T01:34:06.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.661+0000 7f1409200640 1 -- 172.21.15.12:0/1082493677 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1404103100 con 0x7f1404102360 2024-09-05T01:34:06.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.663+0000 7f13fbe00640 1 -- 172.21.15.12:0/1082493677 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f13f0042070 con 0x7f1404102360 2024-09-05T01:34:06.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.664+0000 7f13fbe00640 1 --2- 172.21.15.12:0/1082493677 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f13e80a2cf0 0x7f13e80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:06.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.664+0000 7f13fbe00640 1 -- 172.21.15.12:0/1082493677 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8623+0+0 (secure 0 0 0) 0x7f13f00efb10 con 0x7f1404102360 2024-09-05T01:34:06.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.664+0000 7f1403400640 1 --2- 172.21.15.12:0/1082493677 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f13e80a2cf0 0x7f13e80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:06.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.665+0000 7f1403400640 1 --2- 172.21.15.12:0/1082493677 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f13e80a2cf0 0x7f13e80a51b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f13f4009b30 tx=0x7f13f4005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:06.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.668+0000 7f13fbe00640 1 -- 172.21.15.12:0/1082493677 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f13f00bc020 con 0x7f1404102360 2024-09-05T01:34:06.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.906+0000 7f1409200640 1 -- 172.21.15.12:0/1082493677 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14041a7260 con 0x7f1404102360 2024-09-05T01:34:06.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.907+0000 7f13fbe00640 1 -- 172.21.15.12:0/1082493677 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+12005 (secure 0 0 0) 0x7f13f00c0320 con 0x7f1404102360 2024-09-05T01:34:06.909 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:34:06.909 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":52,"btime":"2024-09-05T01:34:04:888289+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14532,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/2949711075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":2949711075},{"type":"v1","addr":"172.21.15.12:6839","nonce":2949711075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":52,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T01:22:35.979384+0000","modified":"2024-09-05T01:34:03.999192+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24529,"mds_2":24524,"mds_3":24517,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/497406458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":497406458},{"type":"v1","addr":"172.21.15.12:6841","nonce":497406458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":10,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.145:6839/1706431882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":1706431882},{"type":"v1","addr":"172.21.15.145:6839","nonce":1706431882}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24529,24524,24517,24460]},"id":1}]} 2024-09-05T01:34:06.909 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 52 2024-09-05T01:34:06.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.910+0000 7f1409200640 1 -- 172.21.15.12:0/1082493677 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f13e80a2cf0 msgr2=0x7f13e80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:06.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.910+0000 7f1409200640 1 --2- 172.21.15.12:0/1082493677 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f13e80a2cf0 0x7f13e80a51b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f13f4009b30 tx=0x7f13f4005f90 comp rx=0 tx=0).stop 2024-09-05T01:34:06.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.910+0000 7f1409200640 1 -- 172.21.15.12:0/1082493677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1404102360 msgr2=0x7f140419ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:06.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.910+0000 7f1409200640 1 --2- 172.21.15.12:0/1082493677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1404102360 0x7f140419ac30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f13f002a960 tx=0x7f13f0003b20 comp rx=0 tx=0).stop 2024-09-05T01:34:06.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.910+0000 7f1409200640 1 -- 172.21.15.12:0/1082493677 shutdown_connections 2024-09-05T01:34:06.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.910+0000 7f1409200640 1 --2- 172.21.15.12:0/1082493677 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f13e80a2cf0 0x7f13e80a51b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:06.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.910+0000 7f1409200640 1 --2- 172.21.15.12:0/1082493677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14041079c0 0x7f140419ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:06.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.910+0000 7f1409200640 1 --2- 172.21.15.12:0/1082493677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1404102360 0x7f140419ac30 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:06.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.910+0000 7f1409200640 1 --2- 172.21.15.12:0/1082493677 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f14041019c0 0x7f140419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:06.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.910+0000 7f1409200640 1 -- 172.21.15.12:0/1082493677 >> 172.21.15.12:0/1082493677 conn(0x7f14040fd740 msgr2=0x7f14040fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:06.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.910+0000 7f1409200640 1 -- 172.21.15.12:0/1082493677 shutdown_connections 2024-09-05T01:34:06.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:06.910+0000 7f1409200640 1 -- 172.21.15.12:0/1082493677 wait complete. 2024-09-05T01:34:07.255 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:06 smithi151 ceph-mon[35013]: pgmap v292: 97 pgs: 23 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 62 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 5.6 MiB/s wr, 331 op/s 2024-09-05T01:34:07.255 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:06 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/1082493677' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:34:07.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:06 smithi012 ceph-mon[29942]: pgmap v292: 97 pgs: 23 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 62 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 5.6 MiB/s wr, 331 op/s 2024-09-05T01:34:07.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:06 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/1082493677' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:34:07.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:06 smithi145 ceph-mon[34376]: pgmap v292: 97 pgs: 23 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 62 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 5.6 MiB/s wr, 331 op/s 2024-09-05T01:34:07.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:06 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/1082493677' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:34:07.768 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-05T01:34:08.248 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:34:08.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.864+0000 7f0fd7600640 1 -- 172.21.15.12:0/866264326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fd0104000 msgr2=0x7f0fd01043e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:08.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.864+0000 7f0fd7600640 1 --2- 172.21.15.12:0/866264326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fd0104000 0x7f0fd01043e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009900 tx=0x7f0fc402a410 comp rx=0 tx=0).stop 2024-09-05T01:34:08.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.864+0000 7f0fd7600640 1 -- 172.21.15.12:0/866264326 shutdown_connections 2024-09-05T01:34:08.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.864+0000 7f0fd7600640 1 --2- 172.21.15.12:0/866264326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0fd0109130 0x7f0fd0110cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.864+0000 7f0fd7600640 1 --2- 172.21.15.12:0/866264326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fd01049b0 0x7f0fd0108a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.864+0000 7f0fd7600640 1 --2- 172.21.15.12:0/866264326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fd0104000 0x7f0fd01043e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.864+0000 7f0fd7600640 1 -- 172.21.15.12:0/866264326 >> 172.21.15.12:0/866264326 conn(0x7f0fd00ffa20 msgr2=0x7f0fd0101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:08.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.864+0000 7f0fd7600640 1 -- 172.21.15.12:0/866264326 shutdown_connections 2024-09-05T01:34:08.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.864+0000 7f0fd7600640 1 -- 172.21.15.12:0/866264326 wait complete. 2024-09-05T01:34:08.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.865+0000 7f0fd7600640 1 Processor -- start 2024-09-05T01:34:08.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.865+0000 7f0fd7600640 1 -- start start 2024-09-05T01:34:08.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.865+0000 7f0fd7600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fd0104000 0x7f0fd019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:08.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.865+0000 7f0fd7600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0fd01049b0 0x7f0fd019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:08.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.865+0000 7f0fd7600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fd0109130 0x7f0fd019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:08.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.865+0000 7f0fd7600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd0114160 con 0x7f0fd0109130 2024-09-05T01:34:08.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.865+0000 7f0fd7600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd0113fe0 con 0x7f0fd01049b0 2024-09-05T01:34:08.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.865+0000 7f0fd7600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd01142e0 con 0x7f0fd0104000 2024-09-05T01:34:08.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.866+0000 7f0fd4c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fd0104000 0x7f0fd019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:08.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.866+0000 7f0fd5600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fd0109130 0x7f0fd019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:08.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.866+0000 7f0fd4c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fd0104000 0x7f0fd019a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:36934/0 (socket says 172.21.15.12:36934) 2024-09-05T01:34:08.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.866+0000 7f0fd4c00640 1 -- 172.21.15.12:0/3906731177 learned_addr learned my addr 172.21.15.12:0/3906731177 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:08.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.866+0000 7f0fcfe00640 1 --2- 172.21.15.12:0/3906731177 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0fd01049b0 0x7f0fd019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:08.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.866+0000 7f0fd4c00640 1 -- 172.21.15.12:0/3906731177 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0fd01049b0 msgr2=0x7f0fd019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:08.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.866+0000 7f0fd4c00640 1 --2- 172.21.15.12:0/3906731177 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0fd01049b0 0x7f0fd019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.866+0000 7f0fd4c00640 1 -- 172.21.15.12:0/3906731177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fd0109130 msgr2=0x7f0fd019eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:08.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.866+0000 7f0fd4c00640 1 --2- 172.21.15.12:0/3906731177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fd0109130 0x7f0fd019eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.866+0000 7f0fd4c00640 1 -- 172.21.15.12:0/3906731177 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fd019f5b0 con 0x7f0fd0104000 2024-09-05T01:34:08.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.867+0000 7f0fd4c00640 1 --2- 172.21.15.12:0/3906731177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fd0104000 0x7f0fd019a600 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4006010 tx=0x7f0fc4004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:08.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.867+0000 7f0fcd600640 1 -- 172.21.15.12:0/3906731177 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc403f030 con 0x7f0fd0104000 2024-09-05T01:34:08.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.867+0000 7f0fcd600640 1 -- 172.21.15.12:0/3906731177 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fc4004440 con 0x7f0fd0104000 2024-09-05T01:34:08.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.867+0000 7f0fcd600640 1 -- 172.21.15.12:0/3906731177 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4035070 con 0x7f0fd0104000 2024-09-05T01:34:08.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.867+0000 7f0fd7600640 1 -- 172.21.15.12:0/3906731177 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fd019f840 con 0x7f0fd0104000 2024-09-05T01:34:08.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.867+0000 7f0fd7600640 1 -- 172.21.15.12:0/3906731177 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fd019fcd0 con 0x7f0fd0104000 2024-09-05T01:34:08.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.871+0000 7f0fda064740 1 Processor -- start 2024-09-05T01:34:08.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.871+0000 7f0fda064740 1 -- start start 2024-09-05T01:34:08.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.872+0000 7f0fcd600640 1 -- 172.21.15.12:0/3906731177 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f0fc4042030 con 0x7f0fd0104000 2024-09-05T01:34:08.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.872+0000 7f0fda064740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bab71f0c70 0x55bab71f1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:08.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.872+0000 7f0fda064740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71f1590 0x55bab71fb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:08.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.872+0000 7f0fda064740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bab71fbe50 0x55bab71fe240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:08.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.872+0000 7f0fda064740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55bab71573e0 con 0x55bab71fbe50 2024-09-05T01:34:08.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.872+0000 7f0fda064740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55bab70fed80 con 0x55bab71f0c70 2024-09-05T01:34:08.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.872+0000 7f0fda064740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bab71533a0 con 0x55bab71f1590 2024-09-05T01:34:08.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.872+0000 7f0fd4c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71f1590 0x55bab71fb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:08.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.872+0000 7f0fd4c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71f1590 0x55bab71fb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:36940/0 (socket says 172.21.15.12:36940) 2024-09-05T01:34:08.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.872+0000 7f0fd4c00640 1 -- 172.21.15.12:0/3256786705 learned_addr learned my addr 172.21.15.12:0/3256786705 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:08.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.872+0000 7f0fd5600640 1 --2- 172.21.15.12:0/3256786705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bab71f0c70 0x55bab71f1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:08.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.872+0000 7f0fcfe00640 1 --2- 172.21.15.12:0/3256786705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bab71fbe50 0x55bab71fe240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:08.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.873+0000 7f0fd4c00640 1 -- 172.21.15.12:0/3256786705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bab71f0c70 msgr2=0x55bab71f1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:08.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.873+0000 7f0fd4c00640 1 --2- 172.21.15.12:0/3256786705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bab71f0c70 0x55bab71f1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.873+0000 7f0fd4c00640 1 -- 172.21.15.12:0/3256786705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bab71fbe50 msgr2=0x55bab71fe240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:08.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.873+0000 7f0fd4c00640 1 --2- 172.21.15.12:0/3256786705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bab71fbe50 0x55bab71fe240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.873+0000 7f0fd4c00640 1 -- 172.21.15.12:0/3256786705 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bab711dae0 con 0x55bab71f1590 2024-09-05T01:34:08.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.873+0000 7f0fcfe00640 1 --2- 172.21.15.12:0/3256786705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bab71fbe50 0x55bab71fe240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:34:08.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.873+0000 7f0fd5600640 1 --2- 172.21.15.12:0/3256786705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bab71f0c70 0x55bab71f1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:34:08.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.873+0000 7f0fd4c00640 1 --2- 172.21.15.12:0/3256786705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71f1590 0x55bab71fb910 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40ecdd0 tx=0x7f0fc40f5cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef87ec95cb5eed32 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:08.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.873+0000 7f0fc1c00640 1 -- 172.21.15.12:0/3256786705 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40f12e0 con 0x55bab71f1590 2024-09-05T01:34:08.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.873+0000 7f0fcd600640 1 --2- 172.21.15.12:0/3906731177 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f0fb80a2d70 0x7f0fb80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:08.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.873+0000 7f0fc1c00640 1 -- 172.21.15.12:0/3256786705 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fc40ff020 con 0x55bab71f1590 2024-09-05T01:34:08.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.873+0000 7f0fc1c00640 1 -- 172.21.15.12:0/3256786705 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40f9e50 con 0x55bab71f1590 2024-09-05T01:34:08.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.874+0000 7f0fcd600640 1 -- 172.21.15.12:0/3906731177 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8623+0+0 (secure 0 0 0) 0x7f0fc40ef770 con 0x7f0fd0104000 2024-09-05T01:34:08.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.874+0000 7f0fd5600640 1 --2- 172.21.15.12:0/3906731177 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f0fb80a2d70 0x7f0fb80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:08.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.874+0000 7f0fda064740 1 -- 172.21.15.12:0/3256786705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71f1590 msgr2=0x55bab71fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:08.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.874+0000 7f0fda064740 1 --2- 172.21.15.12:0/3256786705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71f1590 0x55bab71fb910 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40ecdd0 tx=0x7f0fc40f5cd0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.874+0000 7f0fda064740 1 -- 172.21.15.12:0/3256786705 shutdown_connections 2024-09-05T01:34:08.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.874+0000 7f0fda064740 1 --2- 172.21.15.12:0/3256786705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bab71fbe50 0x55bab71fe240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.874+0000 7f0fda064740 1 --2- 172.21.15.12:0/3256786705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71f1590 0x55bab71fb910 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.874+0000 7f0fda064740 1 --2- 172.21.15.12:0/3256786705 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bab71f0c70 0x55bab71f1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.874+0000 7f0fda064740 1 -- 172.21.15.12:0/3256786705 >> 172.21.15.12:0/3256786705 conn(0x55bab71ed200 msgr2=0x55bab71ed5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:08.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.875+0000 7f0fda064740 1 -- 172.21.15.12:0/3256786705 shutdown_connections 2024-09-05T01:34:08.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.875+0000 7f0fd5600640 1 --2- 172.21.15.12:0/3906731177 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f0fb80a2d70 0x7f0fb80a5230 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8009fd0 tx=0x7f0fc8009500 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:08.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.875+0000 7f0fda064740 1 -- 172.21.15.12:0/3256786705 wait complete. 2024-09-05T01:34:08.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.875+0000 7f0fda064740 1 -- start start 2024-09-05T01:34:08.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.875+0000 7f0fda064740 1 Processor -- start 2024-09-05T01:34:08.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.876+0000 7f0fda064740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bab71f0c70 0x55bab71f8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:08.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.876+0000 7f0fda064740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bab71f1590 0x55bab71f9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:08.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.876+0000 7f0fda064740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71fbe50 0x55bab71f9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:08.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.876+0000 7f0fda064740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55bab71fe7e0 con 0x55bab71f1590 2024-09-05T01:34:08.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.876+0000 7f0fda064740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55bab71120f0 con 0x55bab71f0c70 2024-09-05T01:34:08.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.876+0000 7f0fda064740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bab71fe960 con 0x55bab71fbe50 2024-09-05T01:34:08.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.876+0000 7f0fda064740 10 client.0 _ll_register_callbacks cb 0x55bab70f9bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:34:08.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.876+0000 7f0fd5600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71fbe50 0x55bab71f9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:08.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.876+0000 7f0fcfe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bab71f1590 0x55bab71f9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:08.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.876+0000 7f0fd5600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71fbe50 0x55bab71f9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:36942/0 (socket says 172.21.15.12:36942) 2024-09-05T01:34:08.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.876+0000 7f0fd5600640 1 -- 172.21.15.12:0/2711817394 learned_addr learned my addr 172.21.15.12:0/2711817394 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:08.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.876+0000 7f0fd4c00640 1 --2- 172.21.15.12:0/2711817394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bab71f0c70 0x55bab71f8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:08.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.877+0000 7f0fd5600640 1 -- 172.21.15.12:0/2711817394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bab71f0c70 msgr2=0x55bab71f8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:08.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.877+0000 7f0fd5600640 1 --2- 172.21.15.12:0/2711817394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bab71f0c70 0x55bab71f8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.877+0000 7f0fd5600640 1 -- 172.21.15.12:0/2711817394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bab71f1590 msgr2=0x55bab71f9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:08.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.877+0000 7f0fd5600640 1 --2- 172.21.15.12:0/2711817394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bab71f1590 0x55bab71f9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.877+0000 7f0fd5600640 1 -- 172.21.15.12:0/2711817394 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bab6ec83c0 con 0x55bab71fbe50 2024-09-05T01:34:08.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.877+0000 7f0fd5600640 1 --2- 172.21.15.12:0/2711817394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71fbe50 0x55bab71f9760 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8003ab0 tx=0x7f0fc8004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3eb48b96839f209f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:08.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.877+0000 7f0fb6000640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:34:08.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.877+0000 7f0fb6000640 1 -- 172.21.15.12:0/2711817394 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc8004480 con 0x55bab71fbe50 2024-09-05T01:34:08.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.877+0000 7f0fda064740 1 -- 172.21.15.12:0/2711817394 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fc40ff020 con 0x55bab71fbe50 2024-09-05T01:34:08.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.877+0000 7f0fb6000640 1 -- 172.21.15.12:0/2711817394 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8623+0+0 (secure 0 0 0) 0x7f0fc8004620 con 0x55bab71fbe50 2024-09-05T01:34:08.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.878+0000 7f0fb6000640 1 -- 172.21.15.12:0/2711817394 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f0fc8004820 con 0x55bab71fbe50 2024-09-05T01:34:08.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.878+0000 7f0fda064740 10 client.26419 fetch_fsmap learned FSMap version 52 2024-09-05T01:34:08.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.878+0000 7f0fda064740 1 -- 172.21.15.12:0/2711817394 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55bab720a7d0 con 0x55bab71fbe50 2024-09-05T01:34:08.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.878+0000 7f0fb6000640 1 -- 172.21.15.12:0/2711817394 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fc40ff020 con 0x55bab71fbe50 2024-09-05T01:34:08.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.878+0000 7f0fb6000640 1 -- 172.21.15.12:0/2711817394 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 52) ==== 8422+0+0 (secure 0 0 0) 0x7f0fc8029910 con 0x55bab71fbe50 2024-09-05T01:34:08.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.878+0000 7f0fda064740 10 client.26419 fetch_fsmap finished waiting for FSMap version 52 2024-09-05T01:34:08.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.878+0000 7f0fda064740 10 client.26419 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-05T01:34:08.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.878+0000 7f0fda064740 20 client.26419 populate_metadata read hostname 'smithi012' 2024-09-05T01:34:08.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.878+0000 7f0fda064740 1 --2- 172.21.15.12:0/2711817394 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55bab720bca0 0x55bab720e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:08.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.879+0000 7f0fda064740 4 client.26419 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:34:08.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.879+0000 7f0fda064740 1 -- 172.21.15.12:0/2711817394 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bab7164950 con 0x55bab720bca0 2024-09-05T01:34:08.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.879+0000 7f0fd4c00640 1 --2- 172.21.15.12:0/2711817394 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55bab720bca0 0x55bab720e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:08.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.879+0000 7f0fd4c00640 1 --2- 172.21.15.12:0/2711817394 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55bab720bca0 0x55bab720e0f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a3c4d4020f6503c1 server_cookie=489e1ffce8150738 in_seq=0 out_seq=0 2024-09-05T01:34:08.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.879+0000 7f0fb6000640 10 client.26419 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:34:08.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.880+0000 7f0fb6000640 1 -- 172.21.15.12:0/2711817394 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bab7164950 con 0x55bab720bca0 2024-09-05T01:34:08.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.880+0000 7f0fb6000640 10 client.26419 handle_command_reply: tid=0 2024-09-05T01:34:08.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.880+0000 7f0fda064740 1 client.26419 shutdown 2024-09-05T01:34:08.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.881+0000 7f0fda064740 1 -- 172.21.15.12:0/2711817394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71fbe50 msgr2=0x55bab71f9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.881+0000 7f0fda064740 1 --2- 172.21.15.12:0/2711817394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71fbe50 0x55bab71f9760 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8003ab0 tx=0x7f0fc8004ab0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.881+0000 7f0fda064740 1 -- 172.21.15.12:0/2711817394 shutdown_connections 2024-09-05T01:34:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.881+0000 7f0fda064740 1 --2- 172.21.15.12:0/2711817394 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55bab720bca0 0x55bab720e0f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.881+0000 7f0fda064740 1 --2- 172.21.15.12:0/2711817394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71fbe50 0x55bab71f9760 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.881+0000 7f0fda064740 1 --2- 172.21.15.12:0/2711817394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bab71f1590 0x55bab71f9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.881+0000 7f0fda064740 1 --2- 172.21.15.12:0/2711817394 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bab71f0c70 0x55bab71f8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.881+0000 7f0fb6000640 0 client.26419 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:34:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.881+0000 7f0fda064740 1 -- 172.21.15.12:0/2711817394 >> 172.21.15.12:0/2711817394 conn(0x55bab71ed200 msgr2=0x55bab71ec380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.881+0000 7f0fda064740 1 -- 172.21.15.12:0/2711817394 shutdown_connections 2024-09-05T01:34:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.881+0000 7f0fda064740 1 -- 172.21.15.12:0/2711817394 wait complete. 2024-09-05T01:34:08.885 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.881+0000 7f0fda064740 20 client.26419 trim_cache size 0 max 16384 2024-09-05T01:34:08.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.895+0000 7f0fda064740 1 Processor -- start 2024-09-05T01:34:08.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.895+0000 7f0fda064740 1 -- start start 2024-09-05T01:34:08.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.896+0000 7f0fda064740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bab71ed200 0x55bab71f36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:08.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.896+0000 7f0fda064740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71f0c70 0x55bab71f75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:08.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.896+0000 7f0fda064740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bab71f1590 0x55bab7213a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:08.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.896+0000 7f0fda064740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd01afc50 con 0x55bab71ed200 2024-09-05T01:34:08.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.896+0000 7f0fda064740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd01b1910 con 0x55bab71f1590 2024-09-05T01:34:08.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.896+0000 7f0fda064740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd01b0320 con 0x55bab71f0c70 2024-09-05T01:34:08.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.896+0000 7f0fd4c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bab71ed200 0x55bab71f36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:08.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.896+0000 7f0fcfe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71f0c70 0x55bab71f75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:08.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.896+0000 7f0fcfe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71f0c70 0x55bab71f75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:36958/0 (socket says 172.21.15.12:36958) 2024-09-05T01:34:08.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.896+0000 7f0fcfe00640 1 -- 172.21.15.12:0/941087704 learned_addr learned my addr 172.21.15.12:0/941087704 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:08.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.896+0000 7f0fd4c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bab71ed200 0x55bab71f36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55354/0 (socket says 172.21.15.12:55354) 2024-09-05T01:34:08.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.896+0000 7f0fd5600640 1 --2- 172.21.15.12:0/941087704 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bab71f1590 0x55bab7213a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:08.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.897+0000 7f0fd4c00640 1 -- 172.21.15.12:0/941087704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71f0c70 msgr2=0x55bab71f75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:08.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.897+0000 7f0fd4c00640 1 --2- 172.21.15.12:0/941087704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71f0c70 0x55bab71f75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.897+0000 7f0fd4c00640 1 -- 172.21.15.12:0/941087704 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bab71f1590 msgr2=0x55bab7213a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:08.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.897+0000 7f0fd4c00640 1 --2- 172.21.15.12:0/941087704 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bab71f1590 0x55bab7213a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.897+0000 7f0fd4c00640 1 -- 172.21.15.12:0/941087704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bab71e8770 con 0x55bab71ed200 2024-09-05T01:34:08.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.897+0000 7f0fd5600640 1 --2- 172.21.15.12:0/941087704 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bab71f1590 0x55bab7213a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:34:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.897+0000 7f0fd4c00640 1 --2- 172.21.15.12:0/941087704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bab71ed200 0x55bab71f36d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40bb9e0 tx=0x7f0fc40f99b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c549dd4ed39c7f0c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.897+0000 7f0fc1200640 1 -- 172.21.15.12:0/941087704 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4049040 con 0x55bab71ed200 2024-09-05T01:34:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.897+0000 7f0fc1200640 1 -- 172.21.15.12:0/941087704 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fc40f9740 con 0x55bab71ed200 2024-09-05T01:34:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.897+0000 7f0fc1200640 1 -- 172.21.15.12:0/941087704 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40fe040 con 0x55bab71ed200 2024-09-05T01:34:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.898+0000 7f0fda064740 1 -- 172.21.15.12:0/941087704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bab71ed200 msgr2=0x55bab71f36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.898+0000 7f0fda064740 1 --2- 172.21.15.12:0/941087704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bab71ed200 0x55bab71f36d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40bb9e0 tx=0x7f0fc40f99b0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.898+0000 7f0fda064740 1 -- 172.21.15.12:0/941087704 shutdown_connections 2024-09-05T01:34:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.898+0000 7f0fda064740 1 --2- 172.21.15.12:0/941087704 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bab71f1590 0x55bab7213a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.898+0000 7f0fda064740 1 --2- 172.21.15.12:0/941087704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71f0c70 0x55bab71f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.898+0000 7f0fda064740 1 --2- 172.21.15.12:0/941087704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bab71ed200 0x55bab71f36d0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.898+0000 7f0fda064740 1 -- 172.21.15.12:0/941087704 >> 172.21.15.12:0/941087704 conn(0x55bab71f46d0 msgr2=0x55bab71fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.898+0000 7f0fda064740 1 -- 172.21.15.12:0/941087704 shutdown_connections 2024-09-05T01:34:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.898+0000 7f0fda064740 1 -- 172.21.15.12:0/941087704 wait complete. 2024-09-05T01:34:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.899+0000 7f0fda064740 1 -- start start 2024-09-05T01:34:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.899+0000 7f0fda064740 1 Processor -- start 2024-09-05T01:34:08.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.899+0000 7f0fda064740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71ed200 0x55bab71ffa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:08.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.899+0000 7f0fda064740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bab71f0c70 0x55bab71fff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:08.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.899+0000 7f0fda064740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bab71f1590 0x55bab7200490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:08.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.899+0000 7f0fda064740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd01b1180 con 0x55bab71f1590 2024-09-05T01:34:08.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.899+0000 7f0fda064740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd01b09f0 con 0x55bab71f0c70 2024-09-05T01:34:08.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.899+0000 7f0fda064740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd01adc50 con 0x55bab71ed200 2024-09-05T01:34:08.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.899+0000 7f0fda064740 10 client.0 _ll_register_callbacks cb 0x7f0fc8009ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:34:08.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.899+0000 7f0fd4c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71ed200 0x55bab71ffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:08.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.900+0000 7f0fcfe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bab71f0c70 0x55bab71fff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:08.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.900+0000 7f0fd4c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71ed200 0x55bab71ffa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:36974/0 (socket says 172.21.15.12:36974) 2024-09-05T01:34:08.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.900+0000 7f0fd4c00640 1 -- 172.21.15.12:0/1133631051 learned_addr learned my addr 172.21.15.12:0/1133631051 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:08.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.900+0000 7f0fcfe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bab71f0c70 0x55bab71fff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:51252/0 (socket says 172.21.15.12:51252) 2024-09-05T01:34:08.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.900+0000 7f0fd5600640 1 --2- 172.21.15.12:0/1133631051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bab71f1590 0x55bab7200490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:08.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.900+0000 7f0fd4c00640 1 -- 172.21.15.12:0/1133631051 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bab71f0c70 msgr2=0x55bab71fff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:08.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.900+0000 7f0fd4c00640 1 --2- 172.21.15.12:0/1133631051 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bab71f0c70 0x55bab71fff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.900+0000 7f0fd4c00640 1 -- 172.21.15.12:0/1133631051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bab71f1590 msgr2=0x55bab7200490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:08.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.900+0000 7f0fd4c00640 1 --2- 172.21.15.12:0/1133631051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bab71f1590 0x55bab7200490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.900+0000 7f0fd4c00640 1 -- 172.21.15.12:0/1133631051 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bab7275b30 con 0x55bab71ed200 2024-09-05T01:34:08.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.900+0000 7f0fcfe00640 1 --2- 172.21.15.12:0/1133631051 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bab71f0c70 0x55bab71fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:34:08.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.900+0000 7f0fd4c00640 1 --2- 172.21.15.12:0/1133631051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71ed200 0x55bab71ffa10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40b8140 tx=0x7f0fc4005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c555bd4c6aaa3885 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:08.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.900+0000 7f0fb6000640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:34:08.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.900+0000 7f0fb6000640 1 -- 172.21.15.12:0/1133631051 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40fe070 con 0x55bab71ed200 2024-09-05T01:34:08.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.901+0000 7f0fb6000640 1 -- 172.21.15.12:0/1133631051 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8623+0+0 (secure 0 0 0) 0x7f0fc40b9fe0 con 0x55bab71ed200 2024-09-05T01:34:08.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.901+0000 7f0fda064740 1 -- 172.21.15.12:0/1133631051 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fc40f9740 con 0x55bab71ed200 2024-09-05T01:34:08.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.901+0000 7f0fb6000640 1 -- 172.21.15.12:0/1133631051 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f0fc4049050 con 0x55bab71ed200 2024-09-05T01:34:08.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.901+0000 7f0fda064740 10 client.26425 fetch_fsmap learned FSMap version 52 2024-09-05T01:34:08.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.901+0000 7f0fda064740 1 -- 172.21.15.12:0/1133631051 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55bab7276df0 con 0x55bab71ed200 2024-09-05T01:34:08.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.901+0000 7f0fb6000640 1 -- 172.21.15.12:0/1133631051 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0fc40f9740 con 0x55bab71ed200 2024-09-05T01:34:08.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.901+0000 7f0fb6000640 1 -- 172.21.15.12:0/1133631051 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 52) ==== 8422+0+0 (secure 0 0 0) 0x7f0fc40ed0e0 con 0x55bab71ed200 2024-09-05T01:34:08.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.901+0000 7f0fda064740 10 client.26425 fetch_fsmap finished waiting for FSMap version 52 2024-09-05T01:34:08.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.901+0000 7f0fda064740 10 client.26425 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-05T01:34:08.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.901+0000 7f0fda064740 20 client.26425 populate_metadata read hostname 'smithi012' 2024-09-05T01:34:08.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.901+0000 7f0fda064740 1 --2- 172.21.15.12:0/1133631051 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55bab71fbe50 0x55bab7279180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:08.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.901+0000 7f0fda064740 4 client.26425 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:34:08.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.901+0000 7f0fda064740 1 -- 172.21.15.12:0/1133631051 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bab715ee60 con 0x55bab71fbe50 2024-09-05T01:34:08.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.902+0000 7f0fcfe00640 1 --2- 172.21.15.12:0/1133631051 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55bab71fbe50 0x55bab7279180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:08.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.902+0000 7f0fcfe00640 1 --2- 172.21.15.12:0/1133631051 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55bab71fbe50 0x55bab7279180 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=aa90a77fd3896580 server_cookie=c1b03f41ad542499 in_seq=0 out_seq=0 2024-09-05T01:34:08.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.902+0000 7f0fb6000640 10 client.26425 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:34:08.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.902+0000 7f0fb6000640 1 -- 172.21.15.12:0/1133631051 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bab715ee60 con 0x55bab71fbe50 2024-09-05T01:34:08.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.902+0000 7f0fb6000640 10 client.26425 handle_command_reply: tid=0 2024-09-05T01:34:08.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.902+0000 7f0fda064740 1 client.26425 shutdown 2024-09-05T01:34:08.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.903+0000 7f0fda064740 1 -- 172.21.15.12:0/1133631051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71ed200 msgr2=0x55bab71ffa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:08.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.903+0000 7f0fda064740 1 --2- 172.21.15.12:0/1133631051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71ed200 0x55bab71ffa10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40b8140 tx=0x7f0fc4005c90 comp rx=0 tx=0).stop 2024-09-05T01:34:08.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.903+0000 7f0fda064740 1 -- 172.21.15.12:0/1133631051 shutdown_connections 2024-09-05T01:34:08.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.903+0000 7f0fda064740 1 --2- 172.21.15.12:0/1133631051 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55bab71fbe50 0x55bab7279180 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.903+0000 7f0fda064740 1 --2- 172.21.15.12:0/1133631051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bab71f1590 0x55bab7200490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.903+0000 7f0fda064740 1 --2- 172.21.15.12:0/1133631051 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55bab71f0c70 0x55bab71fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.903+0000 7f0fb6000640 0 client.26425 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:34:08.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.903+0000 7f0fda064740 1 --2- 172.21.15.12:0/1133631051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bab71ed200 0x55bab71ffa10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.903+0000 7f0fda064740 1 -- 172.21.15.12:0/1133631051 >> 172.21.15.12:0/1133631051 conn(0x55bab71f46d0 msgr2=0x55bab71ebb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:08.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.903+0000 7f0fda064740 1 -- 172.21.15.12:0/1133631051 shutdown_connections 2024-09-05T01:34:08.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.903+0000 7f0fda064740 1 -- 172.21.15.12:0/1133631051 wait complete. 2024-09-05T01:34:08.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.903+0000 7f0fda064740 20 client.26425 trim_cache size 0 max 16384 2024-09-05T01:34:08.908 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:34:08.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.904+0000 7f0fd7600640 1 -- 172.21.15.12:0/3906731177 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f0fb80a2d70 msgr2=0x7f0fb80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:08.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.904+0000 7f0fd7600640 1 --2- 172.21.15.12:0/3906731177 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f0fb80a2d70 0x7f0fb80a5230 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8009fd0 tx=0x7f0fc8009500 comp rx=0 tx=0).stop 2024-09-05T01:34:08.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.904+0000 7f0fd7600640 1 -- 172.21.15.12:0/3906731177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fd0104000 msgr2=0x7f0fd019a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:08.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.904+0000 7f0fd7600640 1 --2- 172.21.15.12:0/3906731177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fd0104000 0x7f0fd019a600 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4006010 tx=0x7f0fc4004040 comp rx=0 tx=0).stop 2024-09-05T01:34:08.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.904+0000 7f0fd7600640 1 -- 172.21.15.12:0/3906731177 shutdown_connections 2024-09-05T01:34:08.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.904+0000 7f0fd7600640 1 --2- 172.21.15.12:0/3906731177 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f0fb80a2d70 0x7f0fb80a5230 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.904+0000 7f0fd7600640 1 --2- 172.21.15.12:0/3906731177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fd0109130 0x7f0fd019eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.904+0000 7f0fd7600640 1 --2- 172.21.15.12:0/3906731177 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0fd01049b0 0x7f0fd019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.904+0000 7f0fd7600640 1 --2- 172.21.15.12:0/3906731177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fd0104000 0x7f0fd019a600 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:08.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.904+0000 7f0fd7600640 1 -- 172.21.15.12:0/3906731177 >> 172.21.15.12:0/3906731177 conn(0x7f0fd00ffa20 msgr2=0x7f0fd0100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:08.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.904+0000 7f0fd7600640 1 -- 172.21.15.12:0/3906731177 shutdown_connections 2024-09-05T01:34:08.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:08.904+0000 7f0fd7600640 1 -- 172.21.15.12:0/3906731177 wait complete. 2024-09-05T01:34:09.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:08 smithi012 ceph-mon[29942]: pgmap v293: 97 pgs: 23 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 62 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 5.5 MiB/s wr, 349 op/s 2024-09-05T01:34:09.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:08 smithi145 ceph-mon[34376]: pgmap v293: 97 pgs: 23 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 62 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 5.5 MiB/s wr, 349 op/s 2024-09-05T01:34:09.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:08 smithi151 ceph-mon[35013]: pgmap v293: 97 pgs: 23 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 62 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 5.5 MiB/s wr, 349 op/s 2024-09-05T01:34:09.625 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-05T01:34:10.053 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:34:10.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.660+0000 7f5081400640 1 -- 172.21.15.12:0/2640578089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f507c104010 msgr2=0x7f507c1043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:10.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.660+0000 7f5081400640 1 --2- 172.21.15.12:0/2640578089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f507c104010 0x7f507c1043f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5074009ca0 tx=0x7f507402a8c0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.660+0000 7f5081400640 1 -- 172.21.15.12:0/2640578089 shutdown_connections 2024-09-05T01:34:10.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.660+0000 7f5081400640 1 --2- 172.21.15.12:0/2640578089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f507c109140 0x7f507c110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.660+0000 7f5081400640 1 --2- 172.21.15.12:0/2640578089 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f507c1049c0 0x7f507c108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.662 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.660+0000 7f5081400640 1 --2- 172.21.15.12:0/2640578089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f507c104010 0x7f507c1043f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.660+0000 7f5081400640 1 -- 172.21.15.12:0/2640578089 >> 172.21.15.12:0/2640578089 conn(0x7f507c0ffa50 msgr2=0x7f507c101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:10.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.660+0000 7f5081400640 1 -- 172.21.15.12:0/2640578089 shutdown_connections 2024-09-05T01:34:10.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.660+0000 7f5081400640 1 -- 172.21.15.12:0/2640578089 wait complete. 2024-09-05T01:34:10.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.661+0000 7f5081400640 1 Processor -- start 2024-09-05T01:34:10.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.661+0000 7f5081400640 1 -- start start 2024-09-05T01:34:10.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.662+0000 7f5081400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f507c104010 0x7f507c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:10.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.662+0000 7f5081400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f507c1049c0 0x7f507c19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:10.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.662+0000 7f5081400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f507c109140 0x7f507c19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:10.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.662+0000 7f5081400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f507c114190 con 0x7f507c104010 2024-09-05T01:34:10.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.662+0000 7f5081400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f507c114010 con 0x7f507c109140 2024-09-05T01:34:10.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.662+0000 7f5081400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f507c114310 con 0x7f507c1049c0 2024-09-05T01:34:10.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.662+0000 7f5079e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f507c1049c0 0x7f507c19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:10.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.662+0000 7f507b200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f507c109140 0x7f507c19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:10.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.662+0000 7f507a800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f507c104010 0x7f507c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:10.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.662+0000 7f507b200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f507c109140 0x7f507c19ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:51262/0 (socket says 172.21.15.12:51262) 2024-09-05T01:34:10.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.662+0000 7f5079e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f507c1049c0 0x7f507c19abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:36984/0 (socket says 172.21.15.12:36984) 2024-09-05T01:34:10.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.662+0000 7f507b200640 1 -- 172.21.15.12:0/1409021031 learned_addr learned my addr 172.21.15.12:0/1409021031 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:10.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.662+0000 7f507b200640 1 -- 172.21.15.12:0/1409021031 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f507c1049c0 msgr2=0x7f507c19abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:10.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.662+0000 7f507b200640 1 --2- 172.21.15.12:0/1409021031 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f507c1049c0 0x7f507c19abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.662+0000 7f507b200640 1 -- 172.21.15.12:0/1409021031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f507c104010 msgr2=0x7f507c19a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:10.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.662+0000 7f507b200640 1 --2- 172.21.15.12:0/1409021031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f507c104010 0x7f507c19a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.662+0000 7f507b200640 1 -- 172.21.15.12:0/1409021031 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f507c19f660 con 0x7f507c109140 2024-09-05T01:34:10.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.663+0000 7f507b200640 1 --2- 172.21.15.12:0/1409021031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f507c109140 0x7f507c19ef80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f506400e970 tx=0x7f506400ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:10.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.663+0000 7f5073400640 1 -- 172.21.15.12:0/1409021031 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506400ccc0 con 0x7f507c109140 2024-09-05T01:34:10.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.663+0000 7f5073400640 1 -- 172.21.15.12:0/1409021031 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f506400ce60 con 0x7f507c109140 2024-09-05T01:34:10.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.663+0000 7f5081400640 1 -- 172.21.15.12:0/1409021031 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f507c19f950 con 0x7f507c109140 2024-09-05T01:34:10.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.663+0000 7f5073400640 1 -- 172.21.15.12:0/1409021031 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5064010490 con 0x7f507c109140 2024-09-05T01:34:10.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.663+0000 7f5081400640 1 -- 172.21.15.12:0/1409021031 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f507c1a7230 con 0x7f507c109140 2024-09-05T01:34:10.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.666+0000 7f5083fd7740 1 Processor -- start 2024-09-05T01:34:10.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.667+0000 7f5073400640 1 -- 172.21.15.12:0/1409021031 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f5064005020 con 0x7f507c109140 2024-09-05T01:34:10.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.667+0000 7f5083fd7740 1 -- start start 2024-09-05T01:34:10.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.667+0000 7f5083fd7740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 0x5570efbe1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:10.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.667+0000 7f5083fd7740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbe1590 0x5570efbeb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:10.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.667+0000 7f5083fd7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570efbebe50 0x5570efbee240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:10.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.667+0000 7f5083fd7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5570efb473e0 con 0x5570efbebe50 2024-09-05T01:34:10.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.667+0000 7f5083fd7740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5570efaeed80 con 0x5570efbe1590 2024-09-05T01:34:10.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.667+0000 7f5083fd7740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5570efb433a0 con 0x5570efbe0c70 2024-09-05T01:34:10.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.668+0000 7f507a800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbe1590 0x5570efbeb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:10.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.668+0000 7f5079e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 0x5570efbe1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:10.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.668+0000 7f507a800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbe1590 0x5570efbeb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:51272/0 (socket says 172.21.15.12:51272) 2024-09-05T01:34:10.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.668+0000 7f507a800640 1 -- 172.21.15.12:0/2544922250 learned_addr learned my addr 172.21.15.12:0/2544922250 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:10.670 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.668+0000 7f5079e00640 1 --2- 172.21.15.12:0/2544922250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570efbebe50 0x5570efbee240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:10.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.668+0000 7f507a800640 1 -- 172.21.15.12:0/2544922250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 msgr2=0x5570efbe1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:10.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.668+0000 7f507a800640 1 --2- 172.21.15.12:0/2544922250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 0x5570efbe1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.668+0000 7f507a800640 1 -- 172.21.15.12:0/2544922250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570efbebe50 msgr2=0x5570efbee240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:10.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.668+0000 7f507a800640 1 --2- 172.21.15.12:0/2544922250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570efbebe50 0x5570efbee240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.668+0000 7f507a800640 1 -- 172.21.15.12:0/2544922250 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570efb0dae0 con 0x5570efbe1590 2024-09-05T01:34:10.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.668+0000 7f5079e00640 1 --2- 172.21.15.12:0/2544922250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570efbebe50 0x5570efbee240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:34:10.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.668+0000 7f507a800640 1 --2- 172.21.15.12:0/2544922250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbe1590 0x5570efbeb910 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f507402ade0 tx=0x7f5074005fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e27a1bcc73892769 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:10.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.668+0000 7f5073400640 1 --2- 172.21.15.12:0/1409021031 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f50600a2d70 0x7f50600a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.669+0000 7f506b400640 1 -- 172.21.15.12:0/2544922250 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5074031db0 con 0x5570efbe1590 2024-09-05T01:34:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.669+0000 7f506b400640 1 -- 172.21.15.12:0/2544922250 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5074036030 con 0x5570efbe1590 2024-09-05T01:34:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.669+0000 7f506b400640 1 -- 172.21.15.12:0/2544922250 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50740042a0 con 0x5570efbe1590 2024-09-05T01:34:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.669+0000 7f5073400640 1 -- 172.21.15.12:0/1409021031 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8623+0+0 (secure 0 0 0) 0x7f50640cf8b0 con 0x7f507c109140 2024-09-05T01:34:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.669+0000 7f5079e00640 1 --2- 172.21.15.12:0/1409021031 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f50600a2d70 0x7f50600a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.669+0000 7f5083fd7740 1 -- 172.21.15.12:0/2544922250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbe1590 msgr2=0x5570efbeb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.669+0000 7f5083fd7740 1 --2- 172.21.15.12:0/2544922250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbe1590 0x5570efbeb910 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f507402ade0 tx=0x7f5074005fa0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.670+0000 7f5083fd7740 1 -- 172.21.15.12:0/2544922250 shutdown_connections 2024-09-05T01:34:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.670+0000 7f5083fd7740 1 --2- 172.21.15.12:0/2544922250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570efbebe50 0x5570efbee240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.670+0000 7f5083fd7740 1 --2- 172.21.15.12:0/2544922250 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbe1590 0x5570efbeb910 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.670+0000 7f5083fd7740 1 --2- 172.21.15.12:0/2544922250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 0x5570efbe1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.670+0000 7f5083fd7740 1 -- 172.21.15.12:0/2544922250 >> 172.21.15.12:0/2544922250 conn(0x5570efbdd200 msgr2=0x5570efbdd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:10.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.670+0000 7f5079e00640 1 --2- 172.21.15.12:0/1409021031 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f50600a2d70 0x7f50600a5230 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x5570efbde580 tx=0x7f506c013040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:10.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.670+0000 7f5083fd7740 1 -- 172.21.15.12:0/2544922250 shutdown_connections 2024-09-05T01:34:10.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.670+0000 7f5083fd7740 1 -- 172.21.15.12:0/2544922250 wait complete. 2024-09-05T01:34:10.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.670+0000 7f5083fd7740 1 -- start start 2024-09-05T01:34:10.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.670+0000 7f5083fd7740 1 Processor -- start 2024-09-05T01:34:10.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.671+0000 7f5083fd7740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 0x5570efbe8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:10.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.671+0000 7f5083fd7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570efbe1590 0x5570efbe91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:10.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.671+0000 7f5083fd7740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbebe50 0x5570efbe9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:10.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.671+0000 7f5083fd7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5570efbee8a0 con 0x5570efbe1590 2024-09-05T01:34:10.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.671+0000 7f5083fd7740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5570efb020f0 con 0x5570efbebe50 2024-09-05T01:34:10.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.671+0000 7f5083fd7740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5570efbeea20 con 0x5570efbe0c70 2024-09-05T01:34:10.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.671+0000 7f5083fd7740 10 client.0 _ll_register_callbacks cb 0x5570efae9bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:34:10.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.671+0000 7f507b200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbebe50 0x5570efbe9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:10.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.671+0000 7f507b200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbebe50 0x5570efbe9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:51276/0 (socket says 172.21.15.12:51276) 2024-09-05T01:34:10.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.671+0000 7f507b200640 1 -- 172.21.15.12:0/2874361914 learned_addr learned my addr 172.21.15.12:0/2874361914 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:10.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.671+0000 7f507a800640 1 --2- 172.21.15.12:0/2874361914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 0x5570efbe8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:10.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.671+0000 7f5079e00640 1 --2- 172.21.15.12:0/2874361914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570efbe1590 0x5570efbe91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:10.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.672+0000 7f507a800640 1 -- 172.21.15.12:0/2874361914 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbebe50 msgr2=0x5570efbe9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:10.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.672+0000 7f507a800640 1 --2- 172.21.15.12:0/2874361914 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbebe50 0x5570efbe9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.672+0000 7f507a800640 1 -- 172.21.15.12:0/2874361914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570efbe1590 msgr2=0x5570efbe91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.672+0000 7f507a800640 1 --2- 172.21.15.12:0/2874361914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570efbe1590 0x5570efbe91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.672+0000 7f507a800640 1 -- 172.21.15.12:0/2874361914 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570ef8b83c0 con 0x5570efbe0c70 2024-09-05T01:34:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.672+0000 7f5079e00640 1 --2- 172.21.15.12:0/2874361914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570efbe1590 0x5570efbe91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:34:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.672+0000 7f507b200640 1 --2- 172.21.15.12:0/2874361914 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbebe50 0x5570efbe9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:34:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.672+0000 7f507a800640 1 --2- 172.21.15.12:0/2874361914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 0x5570efbe8cb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5074004af0 tx=0x7f507402a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d48c22fb2681829 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.672+0000 7f505fe00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:34:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.672+0000 7f505fe00640 1 -- 172.21.15.12:0/2874361914 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507404a040 con 0x5570efbe0c70 2024-09-05T01:34:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.672+0000 7f5083fd7740 1 -- 172.21.15.12:0/2874361914 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5074036030 con 0x5570efbe0c70 2024-09-05T01:34:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.672+0000 7f505fe00640 1 -- 172.21.15.12:0/2874361914 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8623+0+0 (secure 0 0 0) 0x7f5074003b70 con 0x5570efbe0c70 2024-09-05T01:34:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.673+0000 7f505fe00640 1 -- 172.21.15.12:0/2874361914 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f50740098e0 con 0x5570efbe0c70 2024-09-05T01:34:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.673+0000 7f5083fd7740 10 client.26437 fetch_fsmap learned FSMap version 53 2024-09-05T01:34:10.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.673+0000 7f5083fd7740 1 -- 172.21.15.12:0/2874361914 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5570efbee8a0 con 0x5570efbe0c70 2024-09-05T01:34:10.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.673+0000 7f505fe00640 1 -- 172.21.15.12:0/2874361914 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5074036030 con 0x5570efbe0c70 2024-09-05T01:34:10.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.673+0000 7f505fe00640 1 -- 172.21.15.12:0/2874361914 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 53) ==== 8418+0+0 (secure 0 0 0) 0x7f507404d030 con 0x5570efbe0c70 2024-09-05T01:34:10.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.673+0000 7f5083fd7740 10 client.26437 fetch_fsmap finished waiting for FSMap version 53 2024-09-05T01:34:10.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.673+0000 7f5083fd7740 10 client.26437 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-05T01:34:10.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.673+0000 7f5083fd7740 20 client.26437 populate_metadata read hostname 'smithi012' 2024-09-05T01:34:10.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.673+0000 7f5083fd7740 1 --2- 172.21.15.12:0/2874361914 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x5570efbfbad0 0x5570efbfdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:10.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.673+0000 7f5083fd7740 4 client.26437 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:34:10.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.673+0000 7f5083fd7740 1 -- 172.21.15.12:0/2874361914 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570efb54950 con 0x5570efbfbad0 2024-09-05T01:34:10.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.673+0000 7f5079e00640 1 --2- 172.21.15.12:0/2874361914 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x5570efbfbad0 0x5570efbfdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:10.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.674+0000 7f5079e00640 1 --2- 172.21.15.12:0/2874361914 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x5570efbfbad0 0x5570efbfdf40 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a7f2bfd74459329c server_cookie=15e33192960aa3f3 in_seq=0 out_seq=0 2024-09-05T01:34:10.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.674+0000 7f505fe00640 10 client.26437 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:34:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.675+0000 7f505fe00640 1 -- 172.21.15.12:0/2874361914 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5570efb54950 con 0x5570efbfbad0 2024-09-05T01:34:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.675+0000 7f505fe00640 10 client.26437 handle_command_reply: tid=0 2024-09-05T01:34:10.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.675+0000 7f5083fd7740 1 client.26437 shutdown 2024-09-05T01:34:10.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.675+0000 7f5083fd7740 1 -- 172.21.15.12:0/2874361914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 msgr2=0x5570efbe8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:10.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.675+0000 7f5083fd7740 1 --2- 172.21.15.12:0/2874361914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 0x5570efbe8cb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5074004af0 tx=0x7f507402a8c0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.675+0000 7f5083fd7740 1 -- 172.21.15.12:0/2874361914 shutdown_connections 2024-09-05T01:34:10.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.675+0000 7f5083fd7740 1 --2- 172.21.15.12:0/2874361914 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x5570efbfbad0 0x5570efbfdf40 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.675+0000 7f5083fd7740 1 --2- 172.21.15.12:0/2874361914 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbebe50 0x5570efbe9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.675+0000 7f5083fd7740 1 --2- 172.21.15.12:0/2874361914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570efbe1590 0x5570efbe91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.675+0000 7f505fe00640 0 client.26437 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:34:10.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.675+0000 7f5083fd7740 1 --2- 172.21.15.12:0/2874361914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 0x5570efbe8cb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.675+0000 7f5083fd7740 1 -- 172.21.15.12:0/2874361914 >> 172.21.15.12:0/2874361914 conn(0x5570efbdd200 msgr2=0x5570efbdc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:10.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.675+0000 7f5083fd7740 1 -- 172.21.15.12:0/2874361914 shutdown_connections 2024-09-05T01:34:10.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.675+0000 7f5083fd7740 1 -- 172.21.15.12:0/2874361914 wait complete. 2024-09-05T01:34:10.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.675+0000 7f5083fd7740 20 client.26437 trim_cache size 0 max 16384 2024-09-05T01:34:10.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.692+0000 7f5083fd7740 1 Processor -- start 2024-09-05T01:34:10.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.692+0000 7f5083fd7740 1 -- start start 2024-09-05T01:34:10.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.692+0000 7f5083fd7740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 0x5570efc03810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:10.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.692+0000 7f5083fd7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570efbe1590 0x5570efc03d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:10.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.692+0000 7f5083fd7740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbebe50 0x5570efbe5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:10.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.692+0000 7f5083fd7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f507c1afbd0 con 0x5570efbe1590 2024-09-05T01:34:10.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.692+0000 7f5083fd7740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f507c1b1890 con 0x5570efbebe50 2024-09-05T01:34:10.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.692+0000 7f5083fd7740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f507c1b02a0 con 0x5570efbe0c70 2024-09-05T01:34:10.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.693+0000 7f507a800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 0x5570efc03810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:10.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.693+0000 7f507a800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 0x5570efc03810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:37008/0 (socket says 172.21.15.12:37008) 2024-09-05T01:34:10.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.693+0000 7f507a800640 1 -- 172.21.15.12:0/3959670224 learned_addr learned my addr 172.21.15.12:0/3959670224 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:10.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.693+0000 7f5079e00640 1 --2- 172.21.15.12:0/3959670224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570efbe1590 0x5570efc03d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:10.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.693+0000 7f507b200640 1 --2- 172.21.15.12:0/3959670224 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbebe50 0x5570efbe5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:10.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.693+0000 7f507a800640 1 -- 172.21.15.12:0/3959670224 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbebe50 msgr2=0x5570efbe5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:10.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.693+0000 7f507a800640 1 --2- 172.21.15.12:0/3959670224 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbebe50 0x5570efbe5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.693+0000 7f507a800640 1 -- 172.21.15.12:0/3959670224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570efbe1590 msgr2=0x5570efc03d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:10.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.693+0000 7f507a800640 1 --2- 172.21.15.12:0/3959670224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570efbe1590 0x5570efc03d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.693+0000 7f507a800640 1 -- 172.21.15.12:0/3959670224 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570efbd8770 con 0x5570efbe0c70 2024-09-05T01:34:10.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.693+0000 7f507b200640 1 --2- 172.21.15.12:0/3959670224 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbebe50 0x5570efbe5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:34:10.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.693+0000 7f5079e00640 1 --2- 172.21.15.12:0/3959670224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570efbe1590 0x5570efc03d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:34:10.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.693+0000 7f507a800640 1 --2- 172.21.15.12:0/3959670224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 0x5570efc03810 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f507402f690 tx=0x7f507402f6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fcf346459b546e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:10.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.694+0000 7f506aa00640 1 -- 172.21.15.12:0/3959670224 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5074032dd0 con 0x5570efbe0c70 2024-09-05T01:34:10.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.694+0000 7f506aa00640 1 -- 172.21.15.12:0/3959670224 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5074036040 con 0x5570efbe0c70 2024-09-05T01:34:10.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.694+0000 7f506aa00640 1 -- 172.21.15.12:0/3959670224 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5074004000 con 0x5570efbe0c70 2024-09-05T01:34:10.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.694+0000 7f5083fd7740 1 -- 172.21.15.12:0/3959670224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 msgr2=0x5570efc03810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.694+0000 7f5083fd7740 1 --2- 172.21.15.12:0/3959670224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 0x5570efc03810 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f507402f690 tx=0x7f507402f6c0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.694+0000 7f5083fd7740 1 -- 172.21.15.12:0/3959670224 shutdown_connections 2024-09-05T01:34:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.694+0000 7f5083fd7740 1 --2- 172.21.15.12:0/3959670224 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbebe50 0x5570efbe5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.694+0000 7f5083fd7740 1 --2- 172.21.15.12:0/3959670224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570efbe1590 0x5570efc03d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.694+0000 7f5083fd7740 1 --2- 172.21.15.12:0/3959670224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 0x5570efc03810 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.695+0000 7f5083fd7740 1 -- 172.21.15.12:0/3959670224 >> 172.21.15.12:0/3959670224 conn(0x5570efbdd200 msgr2=0x5570efbead30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.695+0000 7f5083fd7740 1 -- 172.21.15.12:0/3959670224 shutdown_connections 2024-09-05T01:34:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.695+0000 7f5083fd7740 1 -- 172.21.15.12:0/3959670224 wait complete. 2024-09-05T01:34:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.695+0000 7f5083fd7740 1 -- start start 2024-09-05T01:34:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.695+0000 7f5083fd7740 1 Processor -- start 2024-09-05T01:34:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.696+0000 7f5083fd7740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 0x5570efbf43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.696+0000 7f5083fd7740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbe1590 0x5570efbef6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:10.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.696+0000 7f5083fd7740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570efbebe50 0x5570efbefc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:10.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.696+0000 7f5083fd7740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f507c1b1100 con 0x5570efbebe50 2024-09-05T01:34:10.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.696+0000 7f5083fd7740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f507c1b0970 con 0x5570efbe1590 2024-09-05T01:34:10.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.696+0000 7f5083fd7740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f507c1adbd0 con 0x5570efbe0c70 2024-09-05T01:34:10.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.696+0000 7f5083fd7740 10 client.0 _ll_register_callbacks cb 0x7f506c0097f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:34:10.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.696+0000 7f507a800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 0x5570efbf43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:10.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.696+0000 7f507a800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 0x5570efbf43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:37012/0 (socket says 172.21.15.12:37012) 2024-09-05T01:34:10.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.696+0000 7f507a800640 1 -- 172.21.15.12:0/2518217353 learned_addr learned my addr 172.21.15.12:0/2518217353 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:10.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.696+0000 7f5079e00640 1 --2- 172.21.15.12:0/2518217353 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbe1590 0x5570efbef6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:10.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.696+0000 7f507b200640 1 --2- 172.21.15.12:0/2518217353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570efbebe50 0x5570efbefc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:10.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.696+0000 7f5079e00640 1 -- 172.21.15.12:0/2518217353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 msgr2=0x5570efbf43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.696+0000 7f5079e00640 1 --2- 172.21.15.12:0/2518217353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 0x5570efbf43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.696+0000 7f5079e00640 1 -- 172.21.15.12:0/2518217353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570efbebe50 msgr2=0x5570efbefc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.696+0000 7f5079e00640 1 --2- 172.21.15.12:0/2518217353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570efbebe50 0x5570efbefc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.696+0000 7f5079e00640 1 -- 172.21.15.12:0/2518217353 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570efbf0440 con 0x5570efbe1590 2024-09-05T01:34:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.696+0000 7f507a800640 1 --2- 172.21.15.12:0/2518217353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 0x5570efbf43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:34:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.697+0000 7f5079e00640 1 --2- 172.21.15.12:0/2518217353 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbe1590 0x5570efbef6d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x5570efbfe7b0 tx=0x7f506c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66b8991127b1a386 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.697+0000 7f505fe00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:34:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.697+0000 7f505fe00640 1 -- 172.21.15.12:0/2518217353 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506c031030 con 0x5570efbe1590 2024-09-05T01:34:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.697+0000 7f5083fd7740 1 -- 172.21.15.12:0/2518217353 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5074036040 con 0x5570efbe1590 2024-09-05T01:34:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.697+0000 7f505fe00640 1 -- 172.21.15.12:0/2518217353 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8623+0+0 (secure 0 0 0) 0x7f506c01a070 con 0x5570efbe1590 2024-09-05T01:34:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.698+0000 7f505fe00640 1 -- 172.21.15.12:0/2518217353 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f506c03b050 con 0x5570efbe1590 2024-09-05T01:34:10.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.698+0000 7f5083fd7740 10 client.26453 fetch_fsmap learned FSMap version 53 2024-09-05T01:34:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.698+0000 7f5083fd7740 1 -- 172.21.15.12:0/2518217353 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5570efc66880 con 0x5570efbe1590 2024-09-05T01:34:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.698+0000 7f505fe00640 1 -- 172.21.15.12:0/2518217353 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5074036040 con 0x5570efbe1590 2024-09-05T01:34:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.698+0000 7f505fe00640 1 -- 172.21.15.12:0/2518217353 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 53) ==== 8418+0+0 (secure 0 0 0) 0x7f506c0047a0 con 0x5570efbe1590 2024-09-05T01:34:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.698+0000 7f5083fd7740 10 client.26453 fetch_fsmap finished waiting for FSMap version 53 2024-09-05T01:34:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.698+0000 7f5083fd7740 10 client.26453 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-05T01:34:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.698+0000 7f5083fd7740 20 client.26453 populate_metadata read hostname 'smithi012' 2024-09-05T01:34:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.698+0000 7f5083fd7740 1 --2- 172.21.15.12:0/2518217353 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x5570efc67060 0x5570efc69480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.698+0000 7f5083fd7740 4 client.26453 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:34:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.698+0000 7f5083fd7740 1 -- 172.21.15.12:0/2518217353 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5570efb4ee60 con 0x5570efc67060 2024-09-05T01:34:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.698+0000 7f507a800640 1 --2- 172.21.15.12:0/2518217353 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x5570efc67060 0x5570efc69480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.699+0000 7f507a800640 1 --2- 172.21.15.12:0/2518217353 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x5570efc67060 0x5570efc69480 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d0add1d1c4a0833f server_cookie=9a9b74513d77be31 in_seq=0 out_seq=0 2024-09-05T01:34:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.699+0000 7f505fe00640 10 client.26453 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:34:10.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.699+0000 7f505fe00640 1 -- 172.21.15.12:0/2518217353 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5570efb4ee60 con 0x5570efc67060 2024-09-05T01:34:10.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.699+0000 7f505fe00640 10 client.26453 handle_command_reply: tid=0 2024-09-05T01:34:10.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.699+0000 7f5083fd7740 1 client.26453 shutdown 2024-09-05T01:34:10.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.699+0000 7f5083fd7740 1 -- 172.21.15.12:0/2518217353 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbe1590 msgr2=0x5570efbef6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:10.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.699+0000 7f5083fd7740 1 --2- 172.21.15.12:0/2518217353 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbe1590 0x5570efbef6d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x5570efbfe7b0 tx=0x7f506c004730 comp rx=0 tx=0).stop 2024-09-05T01:34:10.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.700+0000 7f5083fd7740 1 -- 172.21.15.12:0/2518217353 shutdown_connections 2024-09-05T01:34:10.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.700+0000 7f5083fd7740 1 --2- 172.21.15.12:0/2518217353 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x5570efc67060 0x5570efc69480 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.700+0000 7f5083fd7740 1 --2- 172.21.15.12:0/2518217353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5570efbebe50 0x5570efbefc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.700+0000 7f5083fd7740 1 --2- 172.21.15.12:0/2518217353 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5570efbe1590 0x5570efbef6d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.700+0000 7f5083fd7740 1 --2- 172.21.15.12:0/2518217353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5570efbe0c70 0x5570efbf43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.700+0000 7f505fe00640 0 client.26453 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:34:10.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.700+0000 7f5083fd7740 1 -- 172.21.15.12:0/2518217353 >> 172.21.15.12:0/2518217353 conn(0x5570efbdd200 msgr2=0x5570efbdbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:10.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.700+0000 7f5083fd7740 1 -- 172.21.15.12:0/2518217353 shutdown_connections 2024-09-05T01:34:10.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.700+0000 7f5083fd7740 1 -- 172.21.15.12:0/2518217353 wait complete. 2024-09-05T01:34:10.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.700+0000 7f5083fd7740 20 client.26453 trim_cache size 0 max 16384 2024-09-05T01:34:10.705 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:34:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.701+0000 7f5081400640 1 -- 172.21.15.12:0/1409021031 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f50600a2d70 msgr2=0x7f50600a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.701+0000 7f5081400640 1 --2- 172.21.15.12:0/1409021031 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f50600a2d70 0x7f50600a5230 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x5570efbde580 tx=0x7f506c013040 comp rx=0 tx=0).stop 2024-09-05T01:34:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.701+0000 7f5081400640 1 -- 172.21.15.12:0/1409021031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f507c109140 msgr2=0x7f507c19ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.701+0000 7f5081400640 1 --2- 172.21.15.12:0/1409021031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f507c109140 0x7f507c19ef80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f506400e970 tx=0x7f506400ed70 comp rx=0 tx=0).stop 2024-09-05T01:34:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.701+0000 7f5081400640 1 -- 172.21.15.12:0/1409021031 shutdown_connections 2024-09-05T01:34:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.701+0000 7f5081400640 1 --2- 172.21.15.12:0/1409021031 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f50600a2d70 0x7f50600a5230 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.701+0000 7f5081400640 1 --2- 172.21.15.12:0/1409021031 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f507c109140 0x7f507c19ef80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.701+0000 7f5081400640 1 --2- 172.21.15.12:0/1409021031 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f507c1049c0 0x7f507c19abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.701+0000 7f5081400640 1 --2- 172.21.15.12:0/1409021031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f507c104010 0x7f507c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.701+0000 7f5081400640 1 -- 172.21.15.12:0/1409021031 >> 172.21.15.12:0/1409021031 conn(0x7f507c0ffa50 msgr2=0x7f507c100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.701+0000 7f5081400640 1 -- 172.21.15.12:0/1409021031 shutdown_connections 2024-09-05T01:34:10.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:10.701+0000 7f5081400640 1 -- 172.21.15.12:0/1409021031 wait complete. 2024-09-05T01:34:11.206 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:10 smithi012 ceph-mon[29942]: pgmap v294: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.3 MiB/s wr, 432 op/s 2024-09-05T01:34:11.206 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:10 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:34:11.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:10 smithi145 ceph-mon[34376]: pgmap v294: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.3 MiB/s wr, 432 op/s 2024-09-05T01:34:11.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:10 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:34:11.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:10 smithi151 ceph-mon[35013]: pgmap v294: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.3 MiB/s wr, 432 op/s 2024-09-05T01:34:11.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:10 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:34:11.647 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-05T01:34:12.109 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:34:12.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.713+0000 7f86a0600640 1 -- 172.21.15.12:0/552829831 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8698109120 msgr2=0x7f8698110ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:12.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.713+0000 7f86a0600640 1 --2- 172.21.15.12:0/552829831 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8698109120 0x7f8698110ca0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8690009ca0 tx=0x7f869002a8c0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.713+0000 7f86a0600640 1 -- 172.21.15.12:0/552829831 shutdown_connections 2024-09-05T01:34:12.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.713+0000 7f86a0600640 1 --2- 172.21.15.12:0/552829831 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f8698109120 0x7f8698110ca0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.713+0000 7f86a0600640 1 --2- 172.21.15.12:0/552829831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86981049a0 0x7f86981089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.713+0000 7f86a0600640 1 --2- 172.21.15.12:0/552829831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8698103ff0 0x7f86981043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.713+0000 7f86a0600640 1 -- 172.21.15.12:0/552829831 >> 172.21.15.12:0/552829831 conn(0x7f86980ffa90 msgr2=0x7f8698101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:12.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.713+0000 7f86a0600640 1 -- 172.21.15.12:0/552829831 shutdown_connections 2024-09-05T01:34:12.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.713+0000 7f86a0600640 1 -- 172.21.15.12:0/552829831 wait complete. 2024-09-05T01:34:12.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.714+0000 7f86a0600640 1 Processor -- start 2024-09-05T01:34:12.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.715+0000 7f86a0600640 1 -- start start 2024-09-05T01:34:12.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.715+0000 7f86a0600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8698103ff0 0x7f869819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:12.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.715+0000 7f86a0600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86981049a0 0x7f869819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:12.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.715+0000 7f86a0600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8698109120 0x7f869819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:12.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.715+0000 7f86a0600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f86981141f0 con 0x7f8698103ff0 2024-09-05T01:34:12.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.715+0000 7f86a0600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f8698114070 con 0x7f86981049a0 2024-09-05T01:34:12.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.715+0000 7f86a0600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8698114370 con 0x7f8698109120 2024-09-05T01:34:12.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.715+0000 7f869dc00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8698103ff0 0x7f869819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:12.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.715+0000 7f869e600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8698109120 0x7f869819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:12.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.715+0000 7f869dc00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8698103ff0 0x7f869819a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55432/0 (socket says 172.21.15.12:55432) 2024-09-05T01:34:12.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.716+0000 7f869dc00640 1 -- 172.21.15.12:0/4280592598 learned_addr learned my addr 172.21.15.12:0/4280592598 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:12.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.716+0000 7f869d200640 1 --2- 172.21.15.12:0/4280592598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86981049a0 0x7f869819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:12.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.716+0000 7f869dc00640 1 -- 172.21.15.12:0/4280592598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8698109120 msgr2=0x7f869819eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:12.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.716+0000 7f869dc00640 1 --2- 172.21.15.12:0/4280592598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8698109120 0x7f869819eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.716+0000 7f869dc00640 1 -- 172.21.15.12:0/4280592598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86981049a0 msgr2=0x7f869819ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:12.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.716+0000 7f869dc00640 1 --2- 172.21.15.12:0/4280592598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86981049a0 0x7f869819ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.716+0000 7f869dc00640 1 -- 172.21.15.12:0/4280592598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f869819f5c0 con 0x7f8698103ff0 2024-09-05T01:34:12.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.716+0000 7f869dc00640 1 --2- 172.21.15.12:0/4280592598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8698103ff0 0x7f869819a610 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f868c00d950 tx=0x7f868c00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:12.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.717+0000 7f8696000640 1 -- 172.21.15.12:0/4280592598 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c017070 con 0x7f8698103ff0 2024-09-05T01:34:12.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.717+0000 7f8696000640 1 -- 172.21.15.12:0/4280592598 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f868c00de80 con 0x7f8698103ff0 2024-09-05T01:34:12.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.717+0000 7f86a0600640 1 -- 172.21.15.12:0/4280592598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f869819f8b0 con 0x7f8698103ff0 2024-09-05T01:34:12.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.717+0000 7f86a0600640 1 -- 172.21.15.12:0/4280592598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86981a7190 con 0x7f8698103ff0 2024-09-05T01:34:12.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.717+0000 7f8696000640 1 -- 172.21.15.12:0/4280592598 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c00f620 con 0x7f8698103ff0 2024-09-05T01:34:12.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.722+0000 7f8696000640 1 -- 172.21.15.12:0/4280592598 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f868c009c30 con 0x7f8698103ff0 2024-09-05T01:34:12.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.722+0000 7f86a30cb740 1 Processor -- start 2024-09-05T01:34:12.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.722+0000 7f86a30cb740 1 -- start start 2024-09-05T01:34:12.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.722+0000 7f86a30cb740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d6f521c70 0x563d6f522050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:12.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.722+0000 7f86a30cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563d6f522590 0x563d6f52c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:12.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.723+0000 7f86a30cb740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f52ce50 0x563d6f52f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:12.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.723+0000 7f86a30cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563d6f4883e0 con 0x563d6f522590 2024-09-05T01:34:12.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.723+0000 7f86a30cb740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x563d6f42fd80 con 0x563d6f521c70 2024-09-05T01:34:12.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.723+0000 7f86a30cb740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563d6f4843a0 con 0x563d6f52ce50 2024-09-05T01:34:12.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.723+0000 7f869e600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d6f521c70 0x563d6f522050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:12.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.723+0000 7f869e600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d6f521c70 0x563d6f522050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:51332/0 (socket says 172.21.15.12:51332) 2024-09-05T01:34:12.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.723+0000 7f869e600640 1 -- 172.21.15.12:0/1364423467 learned_addr learned my addr 172.21.15.12:0/1364423467 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:12.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.723+0000 7f869dc00640 1 --2- 172.21.15.12:0/1364423467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563d6f522590 0x563d6f52c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:12.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.723+0000 7f869d200640 1 --2- 172.21.15.12:0/1364423467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f52ce50 0x563d6f52f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:12.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.723+0000 7f869e600640 1 -- 172.21.15.12:0/1364423467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f52ce50 msgr2=0x563d6f52f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:12.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.723+0000 7f869e600640 1 --2- 172.21.15.12:0/1364423467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f52ce50 0x563d6f52f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.723+0000 7f869e600640 1 -- 172.21.15.12:0/1364423467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563d6f522590 msgr2=0x563d6f52c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:12.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.723+0000 7f869e600640 1 --2- 172.21.15.12:0/1364423467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563d6f522590 0x563d6f52c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.723+0000 7f869e600640 1 -- 172.21.15.12:0/1364423467 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d6f44eae0 con 0x563d6f521c70 2024-09-05T01:34:12.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.723+0000 7f869d200640 1 --2- 172.21.15.12:0/1364423467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f52ce50 0x563d6f52f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:34:12.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.723+0000 7f869dc00640 1 --2- 172.21.15.12:0/1364423467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563d6f522590 0x563d6f52c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:34:12.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.724+0000 7f869e600640 1 --2- 172.21.15.12:0/1364423467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d6f521c70 0x563d6f522050 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f869002aeb0 tx=0x7f869002f450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ad5ebc5597ce6d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:12.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.724+0000 7f8696000640 1 --2- 172.21.15.12:0/4280592598 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f86800a2cf0 0x7f86800a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:12.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.724+0000 7f868aa00640 1 -- 172.21.15.12:0/1364423467 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8690003970 con 0x563d6f521c70 2024-09-05T01:34:12.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.724+0000 7f8696000640 1 -- 172.21.15.12:0/4280592598 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f868c0cf0f0 con 0x7f8698103ff0 2024-09-05T01:34:12.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.724+0000 7f868aa00640 1 -- 172.21.15.12:0/1364423467 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8690036030 con 0x563d6f521c70 2024-09-05T01:34:12.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.724+0000 7f868aa00640 1 -- 172.21.15.12:0/1364423467 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86900043b0 con 0x563d6f521c70 2024-09-05T01:34:12.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.724+0000 7f869dc00640 1 --2- 172.21.15.12:0/4280592598 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f86800a2cf0 0x7f86800a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:12.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.725+0000 7f86a30cb740 1 -- 172.21.15.12:0/1364423467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d6f521c70 msgr2=0x563d6f522050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:12.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.725+0000 7f86a30cb740 1 --2- 172.21.15.12:0/1364423467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d6f521c70 0x563d6f522050 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f869002aeb0 tx=0x7f869002f450 comp rx=0 tx=0).stop 2024-09-05T01:34:12.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.725+0000 7f869dc00640 1 --2- 172.21.15.12:0/4280592598 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f86800a2cf0 0x7f86800a51b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x563d6f51f060 tx=0x7f868c005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:12.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.725+0000 7f86a30cb740 1 -- 172.21.15.12:0/1364423467 shutdown_connections 2024-09-05T01:34:12.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.725+0000 7f86a30cb740 1 --2- 172.21.15.12:0/1364423467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f52ce50 0x563d6f52f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.725+0000 7f86a30cb740 1 --2- 172.21.15.12:0/1364423467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563d6f522590 0x563d6f52c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.725+0000 7f86a30cb740 1 --2- 172.21.15.12:0/1364423467 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d6f521c70 0x563d6f522050 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.725+0000 7f86a30cb740 1 -- 172.21.15.12:0/1364423467 >> 172.21.15.12:0/1364423467 conn(0x563d6f51e200 msgr2=0x563d6f51e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:12.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.725+0000 7f86a30cb740 1 -- 172.21.15.12:0/1364423467 shutdown_connections 2024-09-05T01:34:12.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.726+0000 7f86a30cb740 1 -- 172.21.15.12:0/1364423467 wait complete. 2024-09-05T01:34:12.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.726+0000 7f86a30cb740 1 -- start start 2024-09-05T01:34:12.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.726+0000 7f86a30cb740 1 Processor -- start 2024-09-05T01:34:12.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.727+0000 7f86a30cb740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f521c70 0x563d6f529d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:12.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.727+0000 7f86a30cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563d6f522590 0x563d6f52a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:12.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.727+0000 7f86a30cb740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d6f52ce50 0x563d6f52a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:12.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.727+0000 7f86a30cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563d6f52f8a0 con 0x563d6f522590 2024-09-05T01:34:12.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.727+0000 7f86a30cb740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x563d6f4430f0 con 0x563d6f52ce50 2024-09-05T01:34:12.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.727+0000 7f86a30cb740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563d6f52fa20 con 0x563d6f521c70 2024-09-05T01:34:12.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.727+0000 7f86a30cb740 10 client.0 _ll_register_callbacks cb 0x563d6f42abd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:34:12.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.727+0000 7f869e600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f521c70 0x563d6f529d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:12.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.727+0000 7f869e600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f521c70 0x563d6f529d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:37054/0 (socket says 172.21.15.12:37054) 2024-09-05T01:34:12.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.727+0000 7f869e600640 1 -- 172.21.15.12:0/3683326833 learned_addr learned my addr 172.21.15.12:0/3683326833 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:12.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.727+0000 7f869d200640 1 --2- 172.21.15.12:0/3683326833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563d6f522590 0x563d6f52a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:12.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.727+0000 7f869e600640 1 --2- 172.21.15.12:0/3683326833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d6f52ce50 0x563d6f52a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:12.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.728+0000 7f869e600640 1 -- 172.21.15.12:0/3683326833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d6f52ce50 msgr2=0x563d6f52a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:12.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.728+0000 7f869e600640 1 --2- 172.21.15.12:0/3683326833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d6f52ce50 0x563d6f52a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.728+0000 7f869e600640 1 -- 172.21.15.12:0/3683326833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563d6f522590 msgr2=0x563d6f52a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:12.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.728+0000 7f869e600640 1 --2- 172.21.15.12:0/3683326833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563d6f522590 0x563d6f52a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.728+0000 7f869e600640 1 -- 172.21.15.12:0/3683326833 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d6f1f93c0 con 0x563d6f521c70 2024-09-05T01:34:12.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.728+0000 7f869d200640 1 --2- 172.21.15.12:0/3683326833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563d6f522590 0x563d6f52a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:34:12.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.728+0000 7f869e600640 1 --2- 172.21.15.12:0/3683326833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f521c70 0x563d6f529d20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8690004af0 tx=0x7f8690031b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4fe4ded13662810 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:12.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.728+0000 7f867f400640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:34:12.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.728+0000 7f867f400640 1 -- 172.21.15.12:0/3683326833 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8690059060 con 0x563d6f521c70 2024-09-05T01:34:12.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.728+0000 7f86a30cb740 1 -- 172.21.15.12:0/3683326833 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8690036030 con 0x563d6f521c70 2024-09-05T01:34:12.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.728+0000 7f867f400640 1 -- 172.21.15.12:0/3683326833 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f8690031860 con 0x563d6f521c70 2024-09-05T01:34:12.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.729+0000 7f867f400640 1 -- 172.21.15.12:0/3683326833 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f8690004b40 con 0x563d6f521c70 2024-09-05T01:34:12.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.729+0000 7f86a30cb740 10 client.26452 fetch_fsmap learned FSMap version 53 2024-09-05T01:34:12.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.729+0000 7f86a30cb740 1 -- 172.21.15.12:0/3683326833 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x563d6f52f8a0 con 0x563d6f521c70 2024-09-05T01:34:12.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.729+0000 7f867f400640 1 -- 172.21.15.12:0/3683326833 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8690036030 con 0x563d6f521c70 2024-09-05T01:34:12.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.729+0000 7f867f400640 1 -- 172.21.15.12:0/3683326833 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 53) ==== 8418+0+0 (secure 0 0 0) 0x7f8690043070 con 0x563d6f521c70 2024-09-05T01:34:12.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.729+0000 7f86a30cb740 10 client.26452 fetch_fsmap finished waiting for FSMap version 53 2024-09-05T01:34:12.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.729+0000 7f86a30cb740 10 client.26452 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T01:34:12.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.729+0000 7f86a30cb740 20 client.26452 populate_metadata read hostname 'smithi012' 2024-09-05T01:34:12.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.729+0000 7f86a30cb740 1 --2- 172.21.15.12:0/3683326833 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x563d6f53ca90 0x563d6f53ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:12.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.729+0000 7f86a30cb740 4 client.26452 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:34:12.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.729+0000 7f86a30cb740 1 -- 172.21.15.12:0/3683326833 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d6f495950 con 0x563d6f53ca90 2024-09-05T01:34:12.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.730+0000 7f869d200640 1 --2- 172.21.15.12:0/3683326833 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x563d6f53ca90 0x563d6f53ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:12.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.730+0000 7f869d200640 1 --2- 172.21.15.12:0/3683326833 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x563d6f53ca90 0x563d6f53ee80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c0a08f8257dc57a7 server_cookie=f6ec6d2a5c381d4 in_seq=0 out_seq=0 2024-09-05T01:34:12.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.730+0000 7f867f400640 10 client.26452 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:34:12.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.731+0000 7f867f400640 1 -- 172.21.15.12:0/3683326833 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563d6f495950 con 0x563d6f53ca90 2024-09-05T01:34:12.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.731+0000 7f867f400640 10 client.26452 handle_command_reply: tid=0 2024-09-05T01:34:12.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.731+0000 7f86a30cb740 1 client.26452 shutdown 2024-09-05T01:34:12.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.731+0000 7f86a30cb740 1 -- 172.21.15.12:0/3683326833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f521c70 msgr2=0x563d6f529d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:12.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.731+0000 7f86a30cb740 1 --2- 172.21.15.12:0/3683326833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f521c70 0x563d6f529d20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8690004af0 tx=0x7f8690031b10 comp rx=0 tx=0).stop 2024-09-05T01:34:12.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.732+0000 7f86a30cb740 1 -- 172.21.15.12:0/3683326833 shutdown_connections 2024-09-05T01:34:12.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.732+0000 7f86a30cb740 1 --2- 172.21.15.12:0/3683326833 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x563d6f53ca90 0x563d6f53ee80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.732+0000 7f86a30cb740 1 --2- 172.21.15.12:0/3683326833 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d6f52ce50 0x563d6f52a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.732+0000 7f86a30cb740 1 --2- 172.21.15.12:0/3683326833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563d6f522590 0x563d6f52a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.732+0000 7f86a30cb740 1 --2- 172.21.15.12:0/3683326833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f521c70 0x563d6f529d20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.732+0000 7f86a30cb740 1 -- 172.21.15.12:0/3683326833 >> 172.21.15.12:0/3683326833 conn(0x563d6f51e200 msgr2=0x563d6f51d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:12.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.732+0000 7f867f400640 0 client.26452 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:34:12.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.732+0000 7f86a30cb740 1 -- 172.21.15.12:0/3683326833 shutdown_connections 2024-09-05T01:34:12.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.732+0000 7f86a30cb740 1 -- 172.21.15.12:0/3683326833 wait complete. 2024-09-05T01:34:12.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.732+0000 7f86a30cb740 20 client.26452 trim_cache size 0 max 16384 2024-09-05T01:34:12.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.748+0000 7f86a30cb740 1 Processor -- start 2024-09-05T01:34:12.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.748+0000 7f86a30cb740 1 -- start start 2024-09-05T01:34:12.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.749+0000 7f86a30cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563d6f521c70 0x563d6f528c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:12.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.749+0000 7f86a30cb740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f522590 0x563d6f52a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:12.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.749+0000 7f86a30cb740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d6f52ce50 0x563d6f544700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:12.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.749+0000 7f86a30cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f86981afae0 con 0x563d6f521c70 2024-09-05T01:34:12.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.749+0000 7f86a30cb740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f86981b17a0 con 0x563d6f52ce50 2024-09-05T01:34:12.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.749+0000 7f86a30cb740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f86981b01b0 con 0x563d6f522590 2024-09-05T01:34:12.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.749+0000 7f869d200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f522590 0x563d6f52a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:12.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.749+0000 7f869d200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f522590 0x563d6f52a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:37070/0 (socket says 172.21.15.12:37070) 2024-09-05T01:34:12.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.749+0000 7f869d200640 1 -- 172.21.15.12:0/234803917 learned_addr learned my addr 172.21.15.12:0/234803917 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:12.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.749+0000 7f869e600640 1 --2- 172.21.15.12:0/234803917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563d6f521c70 0x563d6f528c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:12.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.750+0000 7f869e600640 1 --2- 172.21.15.12:0/234803917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d6f52ce50 0x563d6f544700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:12.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.750+0000 7f869d200640 1 -- 172.21.15.12:0/234803917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d6f52ce50 msgr2=0x563d6f544700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:12.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.750+0000 7f869d200640 1 --2- 172.21.15.12:0/234803917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d6f52ce50 0x563d6f544700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.750+0000 7f869d200640 1 -- 172.21.15.12:0/234803917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563d6f521c70 msgr2=0x563d6f528c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:12.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.750+0000 7f869d200640 1 --2- 172.21.15.12:0/234803917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563d6f521c70 0x563d6f528c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.750+0000 7f869d200640 1 -- 172.21.15.12:0/234803917 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d6f519770 con 0x563d6f522590 2024-09-05T01:34:12.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.750+0000 7f869e600640 1 --2- 172.21.15.12:0/234803917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563d6f521c70 0x563d6f528c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:34:12.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.750+0000 7f869d200640 1 --2- 172.21.15.12:0/234803917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f522590 0x563d6f52a5f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8684004810 tx=0x7f8684008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44e1b5a9e9358cbf server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:12.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.750+0000 7f868a000640 1 -- 172.21.15.12:0/234803917 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8684015540 con 0x563d6f522590 2024-09-05T01:34:12.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.751+0000 7f868a000640 1 -- 172.21.15.12:0/234803917 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8684021030 con 0x563d6f522590 2024-09-05T01:34:12.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.751+0000 7f868a000640 1 -- 172.21.15.12:0/234803917 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8684025810 con 0x563d6f522590 2024-09-05T01:34:12.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.751+0000 7f86a30cb740 1 -- 172.21.15.12:0/234803917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f522590 msgr2=0x563d6f52a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:12.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.751+0000 7f86a30cb740 1 --2- 172.21.15.12:0/234803917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f522590 0x563d6f52a5f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8684004810 tx=0x7f8684008040 comp rx=0 tx=0).stop 2024-09-05T01:34:12.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.751+0000 7f86a30cb740 1 -- 172.21.15.12:0/234803917 shutdown_connections 2024-09-05T01:34:12.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.751+0000 7f86a30cb740 1 --2- 172.21.15.12:0/234803917 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d6f52ce50 0x563d6f544700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.751+0000 7f86a30cb740 1 --2- 172.21.15.12:0/234803917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f522590 0x563d6f52a5f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.751+0000 7f86a30cb740 1 --2- 172.21.15.12:0/234803917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563d6f521c70 0x563d6f528c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.751+0000 7f86a30cb740 1 -- 172.21.15.12:0/234803917 >> 172.21.15.12:0/234803917 conn(0x563d6f51e200 msgr2=0x563d6f523f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:12.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.751+0000 7f86a30cb740 1 -- 172.21.15.12:0/234803917 shutdown_connections 2024-09-05T01:34:12.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.752+0000 7f86a30cb740 1 -- 172.21.15.12:0/234803917 wait complete. 2024-09-05T01:34:12.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.752+0000 7f86a30cb740 1 -- start start 2024-09-05T01:34:12.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.752+0000 7f86a30cb740 1 Processor -- start 2024-09-05T01:34:12.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.753+0000 7f86a30cb740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f521c70 0x563d6f5350f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:12.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.753+0000 7f86a30cb740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d6f522590 0x563d6f530420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:12.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.753+0000 7f86a30cb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563d6f52ce50 0x563d6f530960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:12.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.753+0000 7f86a30cb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f86981b1010 con 0x563d6f52ce50 2024-09-05T01:34:12.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.753+0000 7f86a30cb740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f86981b0880 con 0x563d6f522590 2024-09-05T01:34:12.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.753+0000 7f86a30cb740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f86981adae0 con 0x563d6f521c70 2024-09-05T01:34:12.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.753+0000 7f86a30cb740 10 client.0 _ll_register_callbacks cb 0x7f869002f3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:34:12.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.753+0000 7f869e600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f521c70 0x563d6f5350f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:12.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.753+0000 7f869d200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d6f522590 0x563d6f530420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:12.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.753+0000 7f869e600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f521c70 0x563d6f5350f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:37086/0 (socket says 172.21.15.12:37086) 2024-09-05T01:34:12.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.753+0000 7f869e600640 1 -- 172.21.15.12:0/1720966810 learned_addr learned my addr 172.21.15.12:0/1720966810 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:12.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.753+0000 7f869d200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d6f522590 0x563d6f530420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:51368/0 (socket says 172.21.15.12:51368) 2024-09-05T01:34:12.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.753+0000 7f869e600640 1 --2- 172.21.15.12:0/1720966810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563d6f52ce50 0x563d6f530960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:12.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.753+0000 7f869d200640 1 -- 172.21.15.12:0/1720966810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f521c70 msgr2=0x563d6f5350f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:12.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.753+0000 7f869d200640 1 --2- 172.21.15.12:0/1720966810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f521c70 0x563d6f5350f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.753+0000 7f869d200640 1 -- 172.21.15.12:0/1720966810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563d6f52ce50 msgr2=0x563d6f530960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:12.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.753+0000 7f869d200640 1 --2- 172.21.15.12:0/1720966810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563d6f52ce50 0x563d6f530960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.753+0000 7f869d200640 1 -- 172.21.15.12:0/1720966810 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d6f524ae0 con 0x563d6f522590 2024-09-05T01:34:12.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.754+0000 7f869d200640 1 --2- 172.21.15.12:0/1720966810 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d6f522590 0x563d6f530420 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x563d6f484440 tx=0x7f8684025530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=182409096b0ad3a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:12.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.754+0000 7f867f400640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:34:12.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.754+0000 7f867f400640 1 -- 172.21.15.12:0/1720966810 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868402c070 con 0x563d6f522590 2024-09-05T01:34:12.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.755+0000 7f867f400640 1 -- 172.21.15.12:0/1720966810 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f8684025990 con 0x563d6f522590 2024-09-05T01:34:12.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.755+0000 7f86a30cb740 1 -- 172.21.15.12:0/1720966810 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8684021030 con 0x563d6f522590 2024-09-05T01:34:12.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.755+0000 7f867f400640 1 -- 172.21.15.12:0/1720966810 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f8684038050 con 0x563d6f522590 2024-09-05T01:34:12.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.755+0000 7f86a30cb740 10 client.26471 fetch_fsmap learned FSMap version 53 2024-09-05T01:34:12.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.755+0000 7f86a30cb740 1 -- 172.21.15.12:0/1720966810 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x563d6f5a7230 con 0x563d6f522590 2024-09-05T01:34:12.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.755+0000 7f867f400640 1 -- 172.21.15.12:0/1720966810 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8684021030 con 0x563d6f522590 2024-09-05T01:34:12.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.756+0000 7f867f400640 1 -- 172.21.15.12:0/1720966810 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 53) ==== 8418+0+0 (secure 0 0 0) 0x7f8684031440 con 0x563d6f522590 2024-09-05T01:34:12.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.756+0000 7f86a30cb740 10 client.26471 fetch_fsmap finished waiting for FSMap version 53 2024-09-05T01:34:12.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.756+0000 7f86a30cb740 10 client.26471 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T01:34:12.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.756+0000 7f86a30cb740 20 client.26471 populate_metadata read hostname 'smithi012' 2024-09-05T01:34:12.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.756+0000 7f86a30cb740 1 --2- 172.21.15.12:0/1720966810 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x563d6f5a7840 0x563d6f5a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:12.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.756+0000 7f86a30cb740 4 client.26471 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:34:12.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.756+0000 7f86a30cb740 1 -- 172.21.15.12:0/1720966810 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563d6f48fe60 con 0x563d6f5a7840 2024-09-05T01:34:12.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.756+0000 7f869e600640 1 --2- 172.21.15.12:0/1720966810 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x563d6f5a7840 0x563d6f5a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:12.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.757+0000 7f869e600640 1 --2- 172.21.15.12:0/1720966810 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x563d6f5a7840 0x563d6f5a9c30 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=859e18100605793a server_cookie=efa87300798f4e4 in_seq=0 out_seq=0 2024-09-05T01:34:12.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.757+0000 7f867f400640 10 client.26471 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:34:12.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.757+0000 7f867f400640 1 -- 172.21.15.12:0/1720966810 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563d6f48fe60 con 0x563d6f5a7840 2024-09-05T01:34:12.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.757+0000 7f867f400640 10 client.26471 handle_command_reply: tid=0 2024-09-05T01:34:12.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.757+0000 7f86a30cb740 1 client.26471 shutdown 2024-09-05T01:34:12.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.757+0000 7f86a30cb740 1 -- 172.21.15.12:0/1720966810 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d6f522590 msgr2=0x563d6f530420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:12.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.757+0000 7f86a30cb740 1 --2- 172.21.15.12:0/1720966810 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d6f522590 0x563d6f530420 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x563d6f484440 tx=0x7f8684025530 comp rx=0 tx=0).stop 2024-09-05T01:34:12.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.757+0000 7f86a30cb740 1 -- 172.21.15.12:0/1720966810 shutdown_connections 2024-09-05T01:34:12.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.757+0000 7f86a30cb740 1 --2- 172.21.15.12:0/1720966810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563d6f52ce50 0x563d6f530960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.757+0000 7f86a30cb740 1 --2- 172.21.15.12:0/1720966810 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x563d6f5a7840 0x563d6f5a9c30 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.757+0000 7f86a30cb740 1 --2- 172.21.15.12:0/1720966810 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x563d6f522590 0x563d6f530420 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.757+0000 7f86a30cb740 1 --2- 172.21.15.12:0/1720966810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d6f521c70 0x563d6f5350f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.757+0000 7f867f400640 0 client.26471 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:34:12.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.757+0000 7f86a30cb740 1 -- 172.21.15.12:0/1720966810 >> 172.21.15.12:0/1720966810 conn(0x563d6f51e200 msgr2=0x563d6f51cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:12.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.757+0000 7f86a30cb740 1 -- 172.21.15.12:0/1720966810 shutdown_connections 2024-09-05T01:34:12.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.757+0000 7f86a30cb740 1 -- 172.21.15.12:0/1720966810 wait complete. 2024-09-05T01:34:12.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.758+0000 7f86a30cb740 20 client.26471 trim_cache size 0 max 16384 2024-09-05T01:34:12.762 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:34:12.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.758+0000 7f86a0600640 1 -- 172.21.15.12:0/4280592598 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f86800a2cf0 msgr2=0x7f86800a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:12.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.758+0000 7f86a0600640 1 --2- 172.21.15.12:0/4280592598 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f86800a2cf0 0x7f86800a51b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x563d6f51f060 tx=0x7f868c005f90 comp rx=0 tx=0).stop 2024-09-05T01:34:12.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.758+0000 7f86a0600640 1 -- 172.21.15.12:0/4280592598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8698103ff0 msgr2=0x7f869819a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:12.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.758+0000 7f86a0600640 1 --2- 172.21.15.12:0/4280592598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8698103ff0 0x7f869819a610 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f868c00d950 tx=0x7f868c00dd50 comp rx=0 tx=0).stop 2024-09-05T01:34:12.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.758+0000 7f86a0600640 1 -- 172.21.15.12:0/4280592598 shutdown_connections 2024-09-05T01:34:12.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.758+0000 7f86a0600640 1 --2- 172.21.15.12:0/4280592598 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f86800a2cf0 0x7f86800a51b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.758+0000 7f86a0600640 1 --2- 172.21.15.12:0/4280592598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8698109120 0x7f869819eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.758+0000 7f86a0600640 1 --2- 172.21.15.12:0/4280592598 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f86981049a0 0x7f869819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.758+0000 7f86a0600640 1 --2- 172.21.15.12:0/4280592598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8698103ff0 0x7f869819a610 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:12.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.758+0000 7f86a0600640 1 -- 172.21.15.12:0/4280592598 >> 172.21.15.12:0/4280592598 conn(0x7f86980ffa90 msgr2=0x7f86981005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:12.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.759+0000 7f86a0600640 1 -- 172.21.15.12:0/4280592598 shutdown_connections 2024-09-05T01:34:12.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:12.759+0000 7f86a0600640 1 -- 172.21.15.12:0/4280592598 wait complete. 2024-09-05T01:34:13.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:13 smithi151 ceph-mon[35013]: pgmap v295: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.3 MiB/s wr, 434 op/s 2024-09-05T01:34:13.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:13 smithi151 ceph-mon[35013]: osdmap e94: 12 total, 12 up, 12 in 2024-09-05T01:34:13.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:13 smithi012 ceph-mon[29942]: pgmap v295: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.3 MiB/s wr, 434 op/s 2024-09-05T01:34:13.357 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:13 smithi012 ceph-mon[29942]: osdmap e94: 12 total, 12 up, 12 in 2024-09-05T01:34:13.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:13 smithi145 ceph-mon[34376]: pgmap v295: 97 pgs: 97 active+clean; 3.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.3 MiB/s wr, 434 op/s 2024-09-05T01:34:13.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:13 smithi145 ceph-mon[34376]: osdmap e94: 12 total, 12 up, 12 in 2024-09-05T01:34:13.752 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-05T01:34:14.160 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:34:14.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.763+0000 7f070e400640 1 -- 172.21.15.12:0/1008470536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07081049c0 msgr2=0x7f0708108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:14.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.763+0000 7f070e400640 1 --2- 172.21.15.12:0/1008470536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07081049c0 0x7f0708108a10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009900 tx=0x7f06f402a400 comp rx=0 tx=0).stop 2024-09-05T01:34:14.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.763+0000 7f070e400640 1 -- 172.21.15.12:0/1008470536 shutdown_connections 2024-09-05T01:34:14.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.763+0000 7f070e400640 1 --2- 172.21.15.12:0/1008470536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f0708109140 0x7f0708110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.763+0000 7f070e400640 1 --2- 172.21.15.12:0/1008470536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07081049c0 0x7f0708108a10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.763+0000 7f070e400640 1 --2- 172.21.15.12:0/1008470536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0708104010 0x7f07081043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.763+0000 7f070e400640 1 -- 172.21.15.12:0/1008470536 >> 172.21.15.12:0/1008470536 conn(0x7f07080ffa50 msgr2=0x7f0708101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:14.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.763+0000 7f070e400640 1 -- 172.21.15.12:0/1008470536 shutdown_connections 2024-09-05T01:34:14.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.763+0000 7f070e400640 1 -- 172.21.15.12:0/1008470536 wait complete. 2024-09-05T01:34:14.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.764+0000 7f070e400640 1 Processor -- start 2024-09-05T01:34:14.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.764+0000 7f070e400640 1 -- start start 2024-09-05T01:34:14.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.764+0000 7f070e400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0708104010 0x7f070819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:14.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.764+0000 7f070e400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07081049c0 0x7f070819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:14.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.764+0000 7f070e400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0708109140 0x7f070819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:14.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.764+0000 7f070e400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0708114140 con 0x7f0708104010 2024-09-05T01:34:14.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.764+0000 7f070e400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f0708113fc0 con 0x7f07081049c0 2024-09-05T01:34:14.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.765+0000 7f070e400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f07081142c0 con 0x7f0708109140 2024-09-05T01:34:14.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.765+0000 7f0706a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07081049c0 0x7f070819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:14.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.765+0000 7f0707e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0708109140 0x7f070819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:14.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.765+0000 7f0707e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0708109140 0x7f070819eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:37116/0 (socket says 172.21.15.12:37116) 2024-09-05T01:34:14.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.765+0000 7f0707400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0708104010 0x7f070819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:14.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.765+0000 7f0706a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07081049c0 0x7f070819ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:51378/0 (socket says 172.21.15.12:51378) 2024-09-05T01:34:14.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.765+0000 7f0707e00640 1 -- 172.21.15.12:0/978412175 learned_addr learned my addr 172.21.15.12:0/978412175 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:14.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.765+0000 7f0707e00640 1 -- 172.21.15.12:0/978412175 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07081049c0 msgr2=0x7f070819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:14.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.765+0000 7f0707e00640 1 --2- 172.21.15.12:0/978412175 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07081049c0 0x7f070819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.765+0000 7f0707e00640 1 -- 172.21.15.12:0/978412175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0708104010 msgr2=0x7f070819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:14.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.765+0000 7f0707e00640 1 --2- 172.21.15.12:0/978412175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0708104010 0x7f070819a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.765+0000 7f0707e00640 1 -- 172.21.15.12:0/978412175 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070819f5d0 con 0x7f0708109140 2024-09-05T01:34:14.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.766+0000 7f0707e00640 1 --2- 172.21.15.12:0/978412175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0708109140 0x7f070819eef0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f070000eaa0 tx=0x7f070000ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:14.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.766+0000 7f06ffe00640 1 -- 172.21.15.12:0/978412175 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070000cdb0 con 0x7f0708109140 2024-09-05T01:34:14.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.766+0000 7f06ffe00640 1 -- 172.21.15.12:0/978412175 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0700005020 con 0x7f0708109140 2024-09-05T01:34:14.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.766+0000 7f06ffe00640 1 -- 172.21.15.12:0/978412175 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07000116b0 con 0x7f0708109140 2024-09-05T01:34:14.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.766+0000 7f070e400640 1 -- 172.21.15.12:0/978412175 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f070819f8c0 con 0x7f0708109140 2024-09-05T01:34:14.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.766+0000 7f070e400640 1 -- 172.21.15.12:0/978412175 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07081a71a0 con 0x7f0708109140 2024-09-05T01:34:14.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.769+0000 7f071100d740 1 Processor -- start 2024-09-05T01:34:14.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.769+0000 7f06ffe00640 1 -- 172.21.15.12:0/978412175 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f0700005560 con 0x7f0708109140 2024-09-05T01:34:14.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.769+0000 7f071100d740 1 -- start start 2024-09-05T01:34:14.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.770+0000 7f071100d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e98cb84c70 0x55e98cb85050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:14.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.770+0000 7f071100d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb85590 0x55e98cb8f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:14.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.770+0000 7f071100d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e98cb8fe50 0x55e98cb92240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:14.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.770+0000 7f071100d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e98caeb3e0 con 0x55e98cb84c70 2024-09-05T01:34:14.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.770+0000 7f071100d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55e98ca92d80 con 0x55e98cb85590 2024-09-05T01:34:14.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.770+0000 7f071100d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e98cae73a0 con 0x55e98cb8fe50 2024-09-05T01:34:14.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.770+0000 7f0707400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb85590 0x55e98cb8f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:14.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.770+0000 7f0707400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb85590 0x55e98cb8f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:51382/0 (socket says 172.21.15.12:51382) 2024-09-05T01:34:14.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.770+0000 7f0707400640 1 -- 172.21.15.12:0/3407444812 learned_addr learned my addr 172.21.15.12:0/3407444812 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:14.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.770+0000 7f0706a00640 1 --2- 172.21.15.12:0/3407444812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e98cb84c70 0x55e98cb85050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:14.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.771+0000 7f0707400640 1 -- 172.21.15.12:0/3407444812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e98cb8fe50 msgr2=0x55e98cb92240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:34:14.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.771+0000 7f0707400640 1 --2- 172.21.15.12:0/3407444812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e98cb8fe50 0x55e98cb92240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.771+0000 7f0707400640 1 -- 172.21.15.12:0/3407444812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e98cb84c70 msgr2=0x55e98cb85050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:14.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.771+0000 7f0707400640 1 --2- 172.21.15.12:0/3407444812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e98cb84c70 0x55e98cb85050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.771+0000 7f0707400640 1 -- 172.21.15.12:0/3407444812 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e98cab1ae0 con 0x55e98cb85590 2024-09-05T01:34:14.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.771+0000 7f0706a00640 1 --2- 172.21.15.12:0/3407444812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e98cb84c70 0x55e98cb85050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:34:14.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.771+0000 7f0707400640 1 --2- 172.21.15.12:0/3407444812 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb85590 0x55e98cb8f910 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009cf0 tx=0x7f06f8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=239f3e8bc90a1ea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:14.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.771+0000 7f06ffe00640 1 --2- 172.21.15.12:0/978412175 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f06ec0a2d70 0x7f06ec0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:14.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.771+0000 7f06fcc00640 1 -- 172.21.15.12:0/3407444812 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8004230 con 0x55e98cb85590 2024-09-05T01:34:14.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.771+0000 7f06fcc00640 1 -- 172.21.15.12:0/3407444812 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06f80043d0 con 0x55e98cb85590 2024-09-05T01:34:14.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.771+0000 7f06ffe00640 1 -- 172.21.15.12:0/978412175 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f07000cf5c0 con 0x7f0708109140 2024-09-05T01:34:14.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.771+0000 7f06fcc00640 1 -- 172.21.15.12:0/3407444812 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8019880 con 0x55e98cb85590 2024-09-05T01:34:14.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.771+0000 7f0706a00640 1 --2- 172.21.15.12:0/978412175 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f06ec0a2d70 0x7f06ec0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:14.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.772+0000 7f071100d740 1 -- 172.21.15.12:0/3407444812 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb85590 msgr2=0x55e98cb8f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:14.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.772+0000 7f071100d740 1 --2- 172.21.15.12:0/3407444812 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb85590 0x55e98cb8f910 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009cf0 tx=0x7f06f8011810 comp rx=0 tx=0).stop 2024-09-05T01:34:14.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.772+0000 7f071100d740 1 -- 172.21.15.12:0/3407444812 shutdown_connections 2024-09-05T01:34:14.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.772+0000 7f071100d740 1 --2- 172.21.15.12:0/3407444812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e98cb8fe50 0x55e98cb92240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.772+0000 7f071100d740 1 --2- 172.21.15.12:0/3407444812 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb85590 0x55e98cb8f910 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.772+0000 7f071100d740 1 --2- 172.21.15.12:0/3407444812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e98cb84c70 0x55e98cb85050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.772+0000 7f071100d740 1 -- 172.21.15.12:0/3407444812 >> 172.21.15.12:0/3407444812 conn(0x55e98cb81200 msgr2=0x55e98cb815e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:14.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.772+0000 7f071100d740 1 -- 172.21.15.12:0/3407444812 shutdown_connections 2024-09-05T01:34:14.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.773+0000 7f0706a00640 1 --2- 172.21.15.12:0/978412175 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f06ec0a2d70 0x7f06ec0a5230 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009230 tx=0x7f06f40058d0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:14.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.773+0000 7f071100d740 1 -- 172.21.15.12:0/3407444812 wait complete. 2024-09-05T01:34:14.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.773+0000 7f071100d740 1 -- start start 2024-09-05T01:34:14.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.774+0000 7f071100d740 1 Processor -- start 2024-09-05T01:34:14.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.774+0000 7f071100d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e98cb84c70 0x55e98cb8cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:14.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.774+0000 7f071100d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb85590 0x55e98cb8d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:14.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.774+0000 7f071100d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e98cb8fe50 0x55e98cb8d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:14.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.774+0000 7f071100d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e98cb92a20 con 0x55e98cb8fe50 2024-09-05T01:34:14.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.774+0000 7f071100d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55e98caa60f0 con 0x55e98cb85590 2024-09-05T01:34:14.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.774+0000 7f071100d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e98cb92ba0 con 0x55e98cb84c70 2024-09-05T01:34:14.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.774+0000 7f071100d740 10 client.0 _ll_register_callbacks cb 0x55e98ca8dbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:34:14.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.775+0000 7f0706a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb85590 0x55e98cb8d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:14.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.775+0000 7f0707400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e98cb84c70 0x55e98cb8cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:14.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.775+0000 7f0706a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb85590 0x55e98cb8d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:51388/0 (socket says 172.21.15.12:51388) 2024-09-05T01:34:14.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.775+0000 7f0706a00640 1 -- 172.21.15.12:0/1850122493 learned_addr learned my addr 172.21.15.12:0/1850122493 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:14.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.775+0000 7f0707400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e98cb84c70 0x55e98cb8cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:37130/0 (socket says 172.21.15.12:37130) 2024-09-05T01:34:14.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.775+0000 7f0707e00640 1 --2- 172.21.15.12:0/1850122493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e98cb8fe50 0x55e98cb8d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:14.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.775+0000 7f0706a00640 1 -- 172.21.15.12:0/1850122493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e98cb84c70 msgr2=0x55e98cb8cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:14.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.775+0000 7f0706a00640 1 --2- 172.21.15.12:0/1850122493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e98cb84c70 0x55e98cb8cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.775+0000 7f0706a00640 1 -- 172.21.15.12:0/1850122493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e98cb8fe50 msgr2=0x55e98cb8d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:14.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.775+0000 7f0706a00640 1 --2- 172.21.15.12:0/1850122493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e98cb8fe50 0x55e98cb8d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.775+0000 7f0706a00640 1 -- 172.21.15.12:0/1850122493 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e98c85c3c0 con 0x55e98cb85590 2024-09-05T01:34:14.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.775+0000 7f0707400640 1 --2- 172.21.15.12:0/1850122493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e98cb84c70 0x55e98cb8cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:34:14.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.776+0000 7f0706a00640 1 --2- 172.21.15.12:0/1850122493 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb85590 0x55e98cb8d2b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f06f4033000 tx=0x7f06f4009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d366d09cb8a0fb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:14.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.776+0000 7f06f1600640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:34:14.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.776+0000 7f06f1600640 1 -- 172.21.15.12:0/1850122493 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f404d070 con 0x55e98cb85590 2024-09-05T01:34:14.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.776+0000 7f071100d740 1 -- 172.21.15.12:0/1850122493 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06f80043d0 con 0x55e98cb85590 2024-09-05T01:34:14.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.776+0000 7f06f1600640 1 -- 172.21.15.12:0/1850122493 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f06f4003a00 con 0x55e98cb85590 2024-09-05T01:34:14.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.776+0000 7f06f1600640 1 -- 172.21.15.12:0/1850122493 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f06f4059050 con 0x55e98cb85590 2024-09-05T01:34:14.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.776+0000 7f071100d740 10 client.26483 fetch_fsmap learned FSMap version 54 2024-09-05T01:34:14.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.776+0000 7f071100d740 1 -- 172.21.15.12:0/1850122493 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55e98cb9eac0 con 0x55e98cb85590 2024-09-05T01:34:14.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.776+0000 7f06f1600640 1 -- 172.21.15.12:0/1850122493 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06f80043d0 con 0x55e98cb85590 2024-09-05T01:34:14.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.777+0000 7f06f1600640 1 -- 172.21.15.12:0/1850122493 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 54) ==== 8422+0+0 (secure 0 0 0) 0x7f06f403c440 con 0x55e98cb85590 2024-09-05T01:34:14.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.777+0000 7f071100d740 10 client.26483 fetch_fsmap finished waiting for FSMap version 54 2024-09-05T01:34:14.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.777+0000 7f071100d740 10 client.26483 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T01:34:14.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.777+0000 7f071100d740 20 client.26483 populate_metadata read hostname 'smithi012' 2024-09-05T01:34:14.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.777+0000 7f071100d740 1 --2- 172.21.15.12:0/1850122493 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55e98cb9ff40 0x55e98cba23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:14.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.777+0000 7f071100d740 4 client.26483 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:34:14.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.777+0000 7f071100d740 1 -- 172.21.15.12:0/1850122493 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e98caf8950 con 0x55e98cb9ff40 2024-09-05T01:34:14.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.777+0000 7f0707400640 1 --2- 172.21.15.12:0/1850122493 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55e98cb9ff40 0x55e98cba23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:14.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.778+0000 7f0707400640 1 --2- 172.21.15.12:0/1850122493 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55e98cb9ff40 0x55e98cba23d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f0103b943331bd29 server_cookie=ff67d40f758b1319 in_seq=0 out_seq=0 2024-09-05T01:34:14.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.778+0000 7f06f1600640 10 client.26483 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:34:14.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.779+0000 7f06f1600640 1 -- 172.21.15.12:0/1850122493 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e98caf8950 con 0x55e98cb9ff40 2024-09-05T01:34:14.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.779+0000 7f06f1600640 10 client.26483 handle_command_reply: tid=0 2024-09-05T01:34:14.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.779+0000 7f071100d740 1 client.26483 shutdown 2024-09-05T01:34:14.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.779+0000 7f071100d740 1 -- 172.21.15.12:0/1850122493 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb85590 msgr2=0x55e98cb8d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:14.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.779+0000 7f071100d740 1 --2- 172.21.15.12:0/1850122493 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb85590 0x55e98cb8d2b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f06f4033000 tx=0x7f06f4009260 comp rx=0 tx=0).stop 2024-09-05T01:34:14.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.779+0000 7f071100d740 1 -- 172.21.15.12:0/1850122493 shutdown_connections 2024-09-05T01:34:14.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.779+0000 7f071100d740 1 --2- 172.21.15.12:0/1850122493 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55e98cb9ff40 0x55e98cba23d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.779+0000 7f071100d740 1 --2- 172.21.15.12:0/1850122493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e98cb8fe50 0x55e98cb8d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.779+0000 7f071100d740 1 --2- 172.21.15.12:0/1850122493 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb85590 0x55e98cb8d2b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.779+0000 7f06f1600640 0 client.26483 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:34:14.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.779+0000 7f071100d740 1 --2- 172.21.15.12:0/1850122493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e98cb84c70 0x55e98cb8cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.779+0000 7f071100d740 1 -- 172.21.15.12:0/1850122493 >> 172.21.15.12:0/1850122493 conn(0x55e98cb81200 msgr2=0x55e98cb80380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:14.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.780+0000 7f071100d740 1 -- 172.21.15.12:0/1850122493 shutdown_connections 2024-09-05T01:34:14.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.780+0000 7f071100d740 1 -- 172.21.15.12:0/1850122493 wait complete. 2024-09-05T01:34:14.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.780+0000 7f071100d740 20 client.26483 trim_cache size 0 max 16384 2024-09-05T01:34:14.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.794+0000 7f071100d740 1 Processor -- start 2024-09-05T01:34:14.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.794+0000 7f071100d740 1 -- start start 2024-09-05T01:34:14.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.794+0000 7f071100d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb84c70 0x55e98cba7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:14.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.794+0000 7f071100d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e98cb85590 0x55e98cba8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:14.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.794+0000 7f071100d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e98cb8fe50 0x55e98cb7fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:14.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.794+0000 7f071100d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f07081afbb0 con 0x55e98cb8fe50 2024-09-05T01:34:14.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.794+0000 7f071100d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f07081b1870 con 0x55e98cb84c70 2024-09-05T01:34:14.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.794+0000 7f071100d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f07081b0280 con 0x55e98cb85590 2024-09-05T01:34:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.794+0000 7f0707400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb84c70 0x55e98cba7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.794+0000 7f0706a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e98cb85590 0x55e98cba8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.794+0000 7f0707400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb84c70 0x55e98cba7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:51402/0 (socket says 172.21.15.12:51402) 2024-09-05T01:34:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.794+0000 7f0707400640 1 -- 172.21.15.12:0/2387753929 learned_addr learned my addr 172.21.15.12:0/2387753929 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.794+0000 7f0707e00640 1 --2- 172.21.15.12:0/2387753929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e98cb8fe50 0x55e98cb7fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.795+0000 7f0707400640 1 -- 172.21.15.12:0/2387753929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e98cb85590 msgr2=0x55e98cba8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.795+0000 7f0707400640 1 --2- 172.21.15.12:0/2387753929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e98cb85590 0x55e98cba8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.795+0000 7f0707400640 1 -- 172.21.15.12:0/2387753929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e98cb8fe50 msgr2=0x55e98cb7fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.795+0000 7f0707400640 1 --2- 172.21.15.12:0/2387753929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e98cb8fe50 0x55e98cb7fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.795+0000 7f0707400640 1 -- 172.21.15.12:0/2387753929 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e98cb853c0 con 0x55e98cb84c70 2024-09-05T01:34:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.795+0000 7f0707e00640 1 --2- 172.21.15.12:0/2387753929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e98cb8fe50 0x55e98cb7fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:34:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.795+0000 7f0707400640 1 --2- 172.21.15.12:0/2387753929 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb84c70 0x55e98cba7d30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55e98cb82060 tx=0x7f06f8003f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f090770176c201a server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:14.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.795+0000 7f06f3e00640 1 -- 172.21.15.12:0/2387753929 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8031070 con 0x55e98cb84c70 2024-09-05T01:34:14.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.795+0000 7f06f3e00640 1 -- 172.21.15.12:0/2387753929 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06f8005640 con 0x55e98cb84c70 2024-09-05T01:34:14.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.795+0000 7f06f3e00640 1 -- 172.21.15.12:0/2387753929 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8019ce0 con 0x55e98cb84c70 2024-09-05T01:34:14.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.796+0000 7f071100d740 1 -- 172.21.15.12:0/2387753929 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb84c70 msgr2=0x55e98cba7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:14.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.796+0000 7f071100d740 1 --2- 172.21.15.12:0/2387753929 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb84c70 0x55e98cba7d30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55e98cb82060 tx=0x7f06f8003f50 comp rx=0 tx=0).stop 2024-09-05T01:34:14.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.796+0000 7f071100d740 1 -- 172.21.15.12:0/2387753929 shutdown_connections 2024-09-05T01:34:14.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.796+0000 7f071100d740 1 --2- 172.21.15.12:0/2387753929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e98cb8fe50 0x55e98cb7fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.796+0000 7f071100d740 1 --2- 172.21.15.12:0/2387753929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e98cb85590 0x55e98cba8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.796+0000 7f071100d740 1 --2- 172.21.15.12:0/2387753929 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb84c70 0x55e98cba7d30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.796+0000 7f071100d740 1 -- 172.21.15.12:0/2387753929 >> 172.21.15.12:0/2387753929 conn(0x55e98cb81200 msgr2=0x55e98cb8be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:14.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.796+0000 7f071100d740 1 -- 172.21.15.12:0/2387753929 shutdown_connections 2024-09-05T01:34:14.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.796+0000 7f071100d740 1 -- 172.21.15.12:0/2387753929 wait complete. 2024-09-05T01:34:14.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.796+0000 7f071100d740 1 -- start start 2024-09-05T01:34:14.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.797+0000 7f071100d740 1 Processor -- start 2024-09-05T01:34:14.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.797+0000 7f071100d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb84c70 0x55e98cb98540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:14.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.797+0000 7f071100d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e98cb85590 0x55e98cb89af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:14.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.797+0000 7f071100d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e98cb8fe50 0x55e98cb8a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:14.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.797+0000 7f071100d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f07081b10e0 con 0x55e98cb8fe50 2024-09-05T01:34:14.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.797+0000 7f071100d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f07081b0950 con 0x55e98cb84c70 2024-09-05T01:34:14.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.797+0000 7f071100d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f07081adbb0 con 0x55e98cb85590 2024-09-05T01:34:14.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.797+0000 7f071100d740 10 client.0 _ll_register_callbacks cb 0x7f06f4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:34:14.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.797+0000 7f0706a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e98cb85590 0x55e98cb89af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:14.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.797+0000 7f0706a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e98cb85590 0x55e98cb89af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:37150/0 (socket says 172.21.15.12:37150) 2024-09-05T01:34:14.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.798+0000 7f0706a00640 1 -- 172.21.15.12:0/4111661376 learned_addr learned my addr 172.21.15.12:0/4111661376 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:14.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.798+0000 7f0707400640 1 --2- 172.21.15.12:0/4111661376 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb84c70 0x55e98cb98540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:14.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.798+0000 7f0707e00640 1 --2- 172.21.15.12:0/4111661376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e98cb8fe50 0x55e98cb8a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:14.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.798+0000 7f0706a00640 1 -- 172.21.15.12:0/4111661376 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb84c70 msgr2=0x55e98cb98540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:14.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.798+0000 7f0706a00640 1 --2- 172.21.15.12:0/4111661376 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb84c70 0x55e98cb98540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.798+0000 7f0706a00640 1 -- 172.21.15.12:0/4111661376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e98cb8fe50 msgr2=0x55e98cb8a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:14.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.798+0000 7f0706a00640 1 --2- 172.21.15.12:0/4111661376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e98cb8fe50 0x55e98cb8a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.798+0000 7f0706a00640 1 -- 172.21.15.12:0/4111661376 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e98cb8a860 con 0x55e98cb85590 2024-09-05T01:34:14.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.798+0000 7f0706a00640 1 --2- 172.21.15.12:0/4111661376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e98cb85590 0x55e98cb89af0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f06f4031bf0 tx=0x7f06f403c6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dadfc5a6c6d70846 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:14.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.798+0000 7f06f1600640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:34:14.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.799+0000 7f06f1600640 1 -- 172.21.15.12:0/4111661376 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f4061020 con 0x55e98cb85590 2024-09-05T01:34:14.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.799+0000 7f071100d740 1 -- 172.21.15.12:0/4111661376 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06f8005640 con 0x55e98cb85590 2024-09-05T01:34:14.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.799+0000 7f06f1600640 1 -- 172.21.15.12:0/4111661376 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f06f4003a00 con 0x55e98cb85590 2024-09-05T01:34:14.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.799+0000 7f06f1600640 1 -- 172.21.15.12:0/4111661376 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f06f406c050 con 0x55e98cb85590 2024-09-05T01:34:14.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.799+0000 7f071100d740 10 client.26473 fetch_fsmap learned FSMap version 54 2024-09-05T01:34:14.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.799+0000 7f071100d740 1 -- 172.21.15.12:0/4111661376 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55e98cc0acd0 con 0x55e98cb85590 2024-09-05T01:34:14.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.799+0000 7f06f1600640 1 -- 172.21.15.12:0/4111661376 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06f8005640 con 0x55e98cb85590 2024-09-05T01:34:14.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.800+0000 7f06f1600640 1 -- 172.21.15.12:0/4111661376 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 54) ==== 8422+0+0 (secure 0 0 0) 0x7f06f4049930 con 0x55e98cb85590 2024-09-05T01:34:14.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.800+0000 7f071100d740 10 client.26473 fetch_fsmap finished waiting for FSMap version 54 2024-09-05T01:34:14.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.800+0000 7f071100d740 10 client.26473 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T01:34:14.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.800+0000 7f071100d740 20 client.26473 populate_metadata read hostname 'smithi012' 2024-09-05T01:34:14.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.800+0000 7f071100d740 1 --2- 172.21.15.12:0/4111661376 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55e98cc0b410 0x55e98cc0d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:14.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.800+0000 7f071100d740 4 client.26473 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:34:14.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.800+0000 7f071100d740 1 -- 172.21.15.12:0/4111661376 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e98caf2e60 con 0x55e98cc0b410 2024-09-05T01:34:14.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.800+0000 7f0707400640 1 --2- 172.21.15.12:0/4111661376 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55e98cc0b410 0x55e98cc0d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:14.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.800+0000 7f0707400640 1 --2- 172.21.15.12:0/4111661376 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55e98cc0b410 0x55e98cc0d850 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=36e362efb95c24fa server_cookie=fd80402c67ed2887 in_seq=0 out_seq=0 2024-09-05T01:34:14.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.800+0000 7f06f1600640 10 client.26473 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:34:14.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.801+0000 7f06f1600640 1 -- 172.21.15.12:0/4111661376 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e98caf2e60 con 0x55e98cc0b410 2024-09-05T01:34:14.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.801+0000 7f06f1600640 10 client.26473 handle_command_reply: tid=0 2024-09-05T01:34:14.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.801+0000 7f071100d740 1 client.26473 shutdown 2024-09-05T01:34:14.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.801+0000 7f071100d740 1 -- 172.21.15.12:0/4111661376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e98cb85590 msgr2=0x55e98cb89af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:14.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.801+0000 7f071100d740 1 --2- 172.21.15.12:0/4111661376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e98cb85590 0x55e98cb89af0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f06f4031bf0 tx=0x7f06f403c6f0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.801+0000 7f071100d740 1 -- 172.21.15.12:0/4111661376 shutdown_connections 2024-09-05T01:34:14.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.801+0000 7f071100d740 1 --2- 172.21.15.12:0/4111661376 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55e98cc0b410 0x55e98cc0d850 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.801+0000 7f071100d740 1 --2- 172.21.15.12:0/4111661376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e98cb8fe50 0x55e98cb8a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.801+0000 7f071100d740 1 --2- 172.21.15.12:0/4111661376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e98cb85590 0x55e98cb89af0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.801+0000 7f071100d740 1 --2- 172.21.15.12:0/4111661376 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e98cb84c70 0x55e98cb98540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.801+0000 7f06f1600640 0 client.26473 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:34:14.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.801+0000 7f071100d740 1 -- 172.21.15.12:0/4111661376 >> 172.21.15.12:0/4111661376 conn(0x55e98cb81200 msgr2=0x55e98cb8cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:14.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.801+0000 7f071100d740 1 -- 172.21.15.12:0/4111661376 shutdown_connections 2024-09-05T01:34:14.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.801+0000 7f071100d740 1 -- 172.21.15.12:0/4111661376 wait complete. 2024-09-05T01:34:14.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.801+0000 7f071100d740 20 client.26473 trim_cache size 0 max 16384 2024-09-05T01:34:14.813 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:34:14.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.802+0000 7f070e400640 1 -- 172.21.15.12:0/978412175 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f06ec0a2d70 msgr2=0x7f06ec0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:14.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.802+0000 7f070e400640 1 --2- 172.21.15.12:0/978412175 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f06ec0a2d70 0x7f06ec0a5230 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009230 tx=0x7f06f40058d0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.802+0000 7f070e400640 1 -- 172.21.15.12:0/978412175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0708109140 msgr2=0x7f070819eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:14.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.802+0000 7f070e400640 1 --2- 172.21.15.12:0/978412175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0708109140 0x7f070819eef0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f070000eaa0 tx=0x7f070000ef60 comp rx=0 tx=0).stop 2024-09-05T01:34:14.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.802+0000 7f070e400640 1 -- 172.21.15.12:0/978412175 shutdown_connections 2024-09-05T01:34:14.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.802+0000 7f070e400640 1 --2- 172.21.15.12:0/978412175 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f06ec0a2d70 0x7f06ec0a5230 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.802+0000 7f070e400640 1 --2- 172.21.15.12:0/978412175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0708109140 0x7f070819eef0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.802+0000 7f070e400640 1 --2- 172.21.15.12:0/978412175 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f07081049c0 0x7f070819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.802+0000 7f070e400640 1 --2- 172.21.15.12:0/978412175 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0708104010 0x7f070819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:14.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.802+0000 7f070e400640 1 -- 172.21.15.12:0/978412175 >> 172.21.15.12:0/978412175 conn(0x7f07080ffa50 msgr2=0x7f0708100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:14.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.803+0000 7f070e400640 1 -- 172.21.15.12:0/978412175 shutdown_connections 2024-09-05T01:34:14.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:14.803+0000 7f070e400640 1 -- 172.21.15.12:0/978412175 wait complete. 2024-09-05T01:34:15.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:15 smithi151 ceph-mon[35013]: pgmap v297: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 404 op/s 2024-09-05T01:34:15.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:15 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:34:15.363 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:15 smithi012 ceph-mon[29942]: pgmap v297: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 404 op/s 2024-09-05T01:34:15.363 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:15 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:34:15.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:15 smithi145 ceph-mon[34376]: pgmap v297: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 404 op/s 2024-09-05T01:34:15.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:15 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:34:15.902 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-05T01:34:16.294 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:34:16.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.943+0000 7f2f3fe00640 1 -- 172.21.15.12:0/1970195478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f401019c0 msgr2=0x7f2f40101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:16.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.943+0000 7f2f3fe00640 1 --2- 172.21.15.12:0/1970195478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f401019c0 0x7f2f40101e20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2f28009930 tx=0x7f2f2802a420 comp rx=0 tx=0).stop 2024-09-05T01:34:16.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.943+0000 7f2f3fe00640 1 -- 172.21.15.12:0/1970195478 shutdown_connections 2024-09-05T01:34:16.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.943+0000 7f2f3fe00640 1 --2- 172.21.15.12:0/1970195478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f40102360 0x7f2f4010e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.943+0000 7f2f3fe00640 1 --2- 172.21.15.12:0/1970195478 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f401019c0 0x7f2f40101e20 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.943+0000 7f2f3fe00640 1 --2- 172.21.15.12:0/1970195478 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f401079c0 0x7f2f40107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.943+0000 7f2f3fe00640 1 -- 172.21.15.12:0/1970195478 >> 172.21.15.12:0/1970195478 conn(0x7f2f400fd740 msgr2=0x7f2f400ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:16.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.943+0000 7f2f3fe00640 1 -- 172.21.15.12:0/1970195478 shutdown_connections 2024-09-05T01:34:16.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.943+0000 7f2f3fe00640 1 -- 172.21.15.12:0/1970195478 wait complete. 2024-09-05T01:34:16.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.944+0000 7f2f3fe00640 1 Processor -- start 2024-09-05T01:34:16.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.944+0000 7f2f3fe00640 1 -- start start 2024-09-05T01:34:16.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.945+0000 7f2f3fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f401019c0 0x7f2f400744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:16.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.945+0000 7f2f3fe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f40102360 0x7f2f40074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:16.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.945+0000 7f2f3fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f401079c0 0x7f2f40074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:16.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.945+0000 7f2f3fe00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2f40111dc0 con 0x7f2f401079c0 2024-09-05T01:34:16.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.945+0000 7f2f3fe00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2f40111c40 con 0x7f2f40102360 2024-09-05T01:34:16.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.945+0000 7f2f3fe00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2f40111f40 con 0x7f2f401019c0 2024-09-05T01:34:16.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.945+0000 7f2f3ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f401019c0 0x7f2f400744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:16.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.945+0000 7f2f3ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f401019c0 0x7f2f400744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:55862/0 (socket says 172.21.15.12:55862) 2024-09-05T01:34:16.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.945+0000 7f2f3ea00640 1 -- 172.21.15.12:0/3547965645 learned_addr learned my addr 172.21.15.12:0/3547965645 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:16.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.945+0000 7f2f37e00640 1 --2- 172.21.15.12:0/3547965645 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f40102360 0x7f2f40074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:16.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.945+0000 7f2f3f400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f401079c0 0x7f2f40074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:16.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.945+0000 7f2f3ea00640 1 -- 172.21.15.12:0/3547965645 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f40102360 msgr2=0x7f2f40074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:16.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.945+0000 7f2f3ea00640 1 --2- 172.21.15.12:0/3547965645 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f40102360 0x7f2f40074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.946+0000 7f2f3ea00640 1 -- 172.21.15.12:0/3547965645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f401079c0 msgr2=0x7f2f40074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:16.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.946+0000 7f2f3ea00640 1 --2- 172.21.15.12:0/3547965645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f401079c0 0x7f2f40074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.946+0000 7f2f3ea00640 1 -- 172.21.15.12:0/3547965645 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f401a6760 con 0x7f2f401019c0 2024-09-05T01:34:16.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.946+0000 7f2f37e00640 1 --2- 172.21.15.12:0/3547965645 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f40102360 0x7f2f40074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:34:16.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.946+0000 7f2f3ea00640 1 --2- 172.21.15.12:0/3547965645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f401019c0 0x7f2f400744f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000e9f0 tx=0x7f2f3000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:16.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.946+0000 7f2f44a00640 1 -- 172.21.15.12:0/3547965645 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3000cd80 con 0x7f2f401019c0 2024-09-05T01:34:16.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.946+0000 7f2f3fe00640 1 -- 172.21.15.12:0/3547965645 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f401a6a50 con 0x7f2f401019c0 2024-09-05T01:34:16.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.946+0000 7f2f44a00640 1 -- 172.21.15.12:0/3547965645 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f30010910 con 0x7f2f401019c0 2024-09-05T01:34:16.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.946+0000 7f2f44a00640 1 -- 172.21.15.12:0/3547965645 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f300188f0 con 0x7f2f401019c0 2024-09-05T01:34:16.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.946+0000 7f2f3fe00640 1 -- 172.21.15.12:0/3547965645 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f401a6fb0 con 0x7f2f401019c0 2024-09-05T01:34:16.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.949+0000 7f2f487bb740 1 Processor -- start 2024-09-05T01:34:16.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.949+0000 7f2f487bb740 1 -- start start 2024-09-05T01:34:16.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.950+0000 7f2f487bb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e6d95de40 0x561e6d95e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:16.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.950+0000 7f2f487bb740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e6d95e760 0x561e6d968ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:16.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.950+0000 7f2f487bb740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d969020 0x561e6d96b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:16.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.950+0000 7f2f487bb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561e6d8c43e0 con 0x561e6d95de40 2024-09-05T01:34:16.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.950+0000 7f2f487bb740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x561e6d86bd80 con 0x561e6d969020 2024-09-05T01:34:16.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.950+0000 7f2f487bb740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561e6d8c03a0 con 0x561e6d95e760 2024-09-05T01:34:16.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.950+0000 7f2f44a00640 1 -- 172.21.15.12:0/3547965645 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f2f30010ac0 con 0x7f2f401019c0 2024-09-05T01:34:16.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.950+0000 7f2f3ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e6d95e760 0x561e6d968ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:16.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.950+0000 7f2f37e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d969020 0x561e6d96b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:16.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.950+0000 7f2f3f400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e6d95de40 0x561e6d95e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:16.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.950+0000 7f2f3ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e6d95e760 0x561e6d968ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:55878/0 (socket says 172.21.15.12:55878) 2024-09-05T01:34:16.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.950+0000 7f2f37e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d969020 0x561e6d96b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:32796/0 (socket says 172.21.15.12:32796) 2024-09-05T01:34:16.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.950+0000 7f2f3ea00640 1 -- 172.21.15.12:0/1027984739 learned_addr learned my addr 172.21.15.12:0/1027984739 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:16.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.951+0000 7f2f37e00640 1 -- 172.21.15.12:0/1027984739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e6d95e760 msgr2=0x561e6d968ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:16.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.951+0000 7f2f37e00640 1 --2- 172.21.15.12:0/1027984739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e6d95e760 0x561e6d968ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.951+0000 7f2f37e00640 1 -- 172.21.15.12:0/1027984739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e6d95de40 msgr2=0x561e6d95e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:16.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.951+0000 7f2f37e00640 1 --2- 172.21.15.12:0/1027984739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e6d95de40 0x561e6d95e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.951+0000 7f2f37e00640 1 -- 172.21.15.12:0/1027984739 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e6d88aae0 con 0x561e6d969020 2024-09-05T01:34:16.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.951+0000 7f2f37e00640 1 --2- 172.21.15.12:0/1027984739 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d969020 0x561e6d96b410 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2f28005940 tx=0x7f2f28005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=266b73b31744b573 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:16.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.951+0000 7f2f2fe00640 1 -- 172.21.15.12:0/1027984739 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f28035040 con 0x561e6d969020 2024-09-05T01:34:16.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.951+0000 7f2f2fe00640 1 -- 172.21.15.12:0/1027984739 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f28031870 con 0x561e6d969020 2024-09-05T01:34:16.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.951+0000 7f2f2fe00640 1 -- 172.21.15.12:0/1027984739 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f280047a0 con 0x561e6d969020 2024-09-05T01:34:16.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.951+0000 7f2f44a00640 1 --2- 172.21.15.12:0/3547965645 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f2f240a2df0 0x7f2f240a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:16.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.952+0000 7f2f44a00640 1 -- 172.21.15.12:0/3547965645 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f2f300cf7c0 con 0x7f2f401019c0 2024-09-05T01:34:16.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.952+0000 7f2f3f400640 1 --2- 172.21.15.12:0/3547965645 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f2f240a2df0 0x7f2f240a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:16.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.952+0000 7f2f487bb740 1 -- 172.21.15.12:0/1027984739 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d969020 msgr2=0x561e6d96b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:16.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.952+0000 7f2f487bb740 1 --2- 172.21.15.12:0/1027984739 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d969020 0x561e6d96b410 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2f28005940 tx=0x7f2f28005c00 comp rx=0 tx=0).stop 2024-09-05T01:34:16.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.952+0000 7f2f487bb740 1 -- 172.21.15.12:0/1027984739 shutdown_connections 2024-09-05T01:34:16.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.952+0000 7f2f487bb740 1 --2- 172.21.15.12:0/1027984739 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d969020 0x561e6d96b410 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.952+0000 7f2f487bb740 1 --2- 172.21.15.12:0/1027984739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e6d95e760 0x561e6d968ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.952+0000 7f2f487bb740 1 --2- 172.21.15.12:0/1027984739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e6d95de40 0x561e6d95e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.952+0000 7f2f487bb740 1 -- 172.21.15.12:0/1027984739 >> 172.21.15.12:0/1027984739 conn(0x561e6d95a3d0 msgr2=0x561e6d95a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:16.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.952+0000 7f2f487bb740 1 -- 172.21.15.12:0/1027984739 shutdown_connections 2024-09-05T01:34:16.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.952+0000 7f2f487bb740 1 -- 172.21.15.12:0/1027984739 wait complete. 2024-09-05T01:34:16.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.953+0000 7f2f3f400640 1 --2- 172.21.15.12:0/3547965645 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f2f240a2df0 0x7f2f240a52b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2f38005fd0 tx=0x7f2f38009500 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:16.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.953+0000 7f2f487bb740 1 -- start start 2024-09-05T01:34:16.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.953+0000 7f2f487bb740 1 Processor -- start 2024-09-05T01:34:16.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.954+0000 7f2f487bb740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e6d95de40 0x561e6d965f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:16.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.954+0000 7f2f487bb740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d95e760 0x561e6d9664a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:16.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.954+0000 7f2f487bb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e6d969020 0x561e6d9669e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:16.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.954+0000 7f2f487bb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561e6d96bbf0 con 0x561e6d969020 2024-09-05T01:34:16.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.954+0000 7f2f487bb740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x561e6d87f0f0 con 0x561e6d95e760 2024-09-05T01:34:16.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.954+0000 7f2f487bb740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561e6d96bd70 con 0x561e6d95de40 2024-09-05T01:34:16.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.954+0000 7f2f487bb740 10 client.0 _ll_register_callbacks cb 0x561e6d866bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:34:16.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.954+0000 7f2f3ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e6d95de40 0x561e6d965f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:16.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.954+0000 7f2f3ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e6d95de40 0x561e6d965f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:55886/0 (socket says 172.21.15.12:55886) 2024-09-05T01:34:16.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.954+0000 7f2f3ea00640 1 -- 172.21.15.12:0/2936939271 learned_addr learned my addr 172.21.15.12:0/2936939271 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:16.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.954+0000 7f2f37e00640 1 --2- 172.21.15.12:0/2936939271 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d95e760 0x561e6d9664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:16.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.954+0000 7f2f3f400640 1 --2- 172.21.15.12:0/2936939271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e6d969020 0x561e6d9669e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:16.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.954+0000 7f2f3ea00640 1 -- 172.21.15.12:0/2936939271 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d95e760 msgr2=0x561e6d9664a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:16.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.954+0000 7f2f3ea00640 1 --2- 172.21.15.12:0/2936939271 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d95e760 0x561e6d9664a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.954+0000 7f2f3ea00640 1 -- 172.21.15.12:0/2936939271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e6d969020 msgr2=0x561e6d9669e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:16.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.954+0000 7f2f3ea00640 1 --2- 172.21.15.12:0/2936939271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e6d969020 0x561e6d9669e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.954+0000 7f2f3ea00640 1 -- 172.21.15.12:0/2936939271 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e6d6353c0 con 0x561e6d95de40 2024-09-05T01:34:16.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.955+0000 7f2f3ea00640 1 --2- 172.21.15.12:0/2936939271 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e6d95de40 0x561e6d965f60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2f30098150 tx=0x7f2f300ccee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5128227aff404266 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:16.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.955+0000 7f2f2cc00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:34:16.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.955+0000 7f2f2cc00640 1 -- 172.21.15.12:0/2936939271 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f300d5020 con 0x561e6d95de40 2024-09-05T01:34:16.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.955+0000 7f2f2cc00640 1 -- 172.21.15.12:0/2936939271 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f2f3009b340 con 0x561e6d95de40 2024-09-05T01:34:16.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.955+0000 7f2f487bb740 1 -- 172.21.15.12:0/2936939271 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f28031870 con 0x561e6d95de40 2024-09-05T01:34:16.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.955+0000 7f2f2cc00640 1 -- 172.21.15.12:0/2936939271 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f2f3009b650 con 0x561e6d95de40 2024-09-05T01:34:16.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.955+0000 7f2f487bb740 10 client.26485 fetch_fsmap learned FSMap version 54 2024-09-05T01:34:16.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.955+0000 7f2f487bb740 1 -- 172.21.15.12:0/2936939271 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x561e6d977ce0 con 0x561e6d95de40 2024-09-05T01:34:16.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.955+0000 7f2f2cc00640 1 -- 172.21.15.12:0/2936939271 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f28031870 con 0x561e6d95de40 2024-09-05T01:34:16.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.956+0000 7f2f2cc00640 1 -- 172.21.15.12:0/2936939271 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 54) ==== 8422+0+0 (secure 0 0 0) 0x7f2f3009abb0 con 0x561e6d95de40 2024-09-05T01:34:16.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.956+0000 7f2f487bb740 10 client.26485 fetch_fsmap finished waiting for FSMap version 54 2024-09-05T01:34:16.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.956+0000 7f2f487bb740 10 client.26485 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:34:16.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.956+0000 7f2f487bb740 20 client.26485 populate_metadata read hostname 'smithi012' 2024-09-05T01:34:16.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.956+0000 7f2f487bb740 1 --2- 172.21.15.12:0/2936939271 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x561e6d979520 0x561e6d97b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:16.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.956+0000 7f2f487bb740 4 client.26485 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:34:16.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.956+0000 7f2f487bb740 1 -- 172.21.15.12:0/2936939271 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e6d8d1950 con 0x561e6d979520 2024-09-05T01:34:16.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.956+0000 7f2f37e00640 1 --2- 172.21.15.12:0/2936939271 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x561e6d979520 0x561e6d97b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:16.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.957+0000 7f2f37e00640 1 --2- 172.21.15.12:0/2936939271 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x561e6d979520 0x561e6d97b910 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b31b3c9e35e7663a server_cookie=8cce714357a4a3fd in_seq=0 out_seq=0 2024-09-05T01:34:16.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.957+0000 7f2f2cc00640 10 client.26485 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:34:16.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.957+0000 7f2f2cc00640 1 -- 172.21.15.12:0/2936939271 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561e6d8d1950 con 0x561e6d979520 2024-09-05T01:34:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.957+0000 7f2f2cc00640 10 client.26485 handle_command_reply: tid=0 2024-09-05T01:34:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.958+0000 7f2f487bb740 1 client.26485 shutdown 2024-09-05T01:34:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.958+0000 7f2f487bb740 1 -- 172.21.15.12:0/2936939271 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e6d95de40 msgr2=0x561e6d965f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.958+0000 7f2f487bb740 1 --2- 172.21.15.12:0/2936939271 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e6d95de40 0x561e6d965f60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2f30098150 tx=0x7f2f300ccee0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.958+0000 7f2f487bb740 1 -- 172.21.15.12:0/2936939271 shutdown_connections 2024-09-05T01:34:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.958+0000 7f2f487bb740 1 --2- 172.21.15.12:0/2936939271 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x561e6d979520 0x561e6d97b910 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.958+0000 7f2f487bb740 1 --2- 172.21.15.12:0/2936939271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e6d969020 0x561e6d9669e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.958+0000 7f2f487bb740 1 --2- 172.21.15.12:0/2936939271 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d95e760 0x561e6d9664a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.958+0000 7f2f2cc00640 0 client.26485 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:34:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.958+0000 7f2f487bb740 1 --2- 172.21.15.12:0/2936939271 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e6d95de40 0x561e6d965f60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.958+0000 7f2f487bb740 1 -- 172.21.15.12:0/2936939271 >> 172.21.15.12:0/2936939271 conn(0x561e6d95a3d0 msgr2=0x561e6d960100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.958+0000 7f2f487bb740 1 -- 172.21.15.12:0/2936939271 shutdown_connections 2024-09-05T01:34:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.958+0000 7f2f487bb740 1 -- 172.21.15.12:0/2936939271 wait complete. 2024-09-05T01:34:16.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.958+0000 7f2f487bb740 20 client.26485 trim_cache size 0 max 16384 2024-09-05T01:34:16.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.972+0000 7f2f487bb740 1 Processor -- start 2024-09-05T01:34:16.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.972+0000 7f2f487bb740 1 -- start start 2024-09-05T01:34:16.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.972+0000 7f2f487bb740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d95de40 0x561e6d967ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:16.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.972+0000 7f2f487bb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e6d95e760 0x561e6d981020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:16.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.972+0000 7f2f487bb740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e6d969020 0x561e6d981560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:16.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.972+0000 7f2f487bb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2f401af9a0 con 0x561e6d95e760 2024-09-05T01:34:16.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.972+0000 7f2f487bb740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2f401b1660 con 0x561e6d95de40 2024-09-05T01:34:16.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.972+0000 7f2f487bb740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2f401b0070 con 0x561e6d969020 2024-09-05T01:34:16.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.973+0000 7f2f3ea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d95de40 0x561e6d967ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:16.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.973+0000 7f2f3ea00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d95de40 0x561e6d967ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:32822/0 (socket says 172.21.15.12:32822) 2024-09-05T01:34:16.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.973+0000 7f2f3ea00640 1 -- 172.21.15.12:0/3907437693 learned_addr learned my addr 172.21.15.12:0/3907437693 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:16.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.973+0000 7f2f37e00640 1 --2- 172.21.15.12:0/3907437693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e6d95e760 0x561e6d981020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:16.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.973+0000 7f2f3f400640 1 --2- 172.21.15.12:0/3907437693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e6d969020 0x561e6d981560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:16.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.973+0000 7f2f3ea00640 1 -- 172.21.15.12:0/3907437693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e6d969020 msgr2=0x561e6d981560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:16.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.973+0000 7f2f3ea00640 1 --2- 172.21.15.12:0/3907437693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e6d969020 0x561e6d981560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.973+0000 7f2f3ea00640 1 -- 172.21.15.12:0/3907437693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e6d95e760 msgr2=0x561e6d981020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:16.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.973+0000 7f2f3ea00640 1 --2- 172.21.15.12:0/3907437693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e6d95e760 0x561e6d981020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.973+0000 7f2f3ea00640 1 -- 172.21.15.12:0/3907437693 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e6d96bad0 con 0x561e6d95de40 2024-09-05T01:34:16.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.973+0000 7f2f3ea00640 1 --2- 172.21.15.12:0/3907437693 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d95de40 0x561e6d967ed0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2f3009b9f0 tx=0x7f2f300d5530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a16c83c730cf9f4b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:16.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.974+0000 7f2f2f400640 1 -- 172.21.15.12:0/3907437693 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3009bac0 con 0x561e6d95de40 2024-09-05T01:34:16.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.974+0000 7f2f2f400640 1 -- 172.21.15.12:0/3907437693 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f300d5220 con 0x561e6d95de40 2024-09-05T01:34:16.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.974+0000 7f2f2f400640 1 -- 172.21.15.12:0/3907437693 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3009b140 con 0x561e6d95de40 2024-09-05T01:34:16.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.974+0000 7f2f487bb740 1 -- 172.21.15.12:0/3907437693 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d95de40 msgr2=0x561e6d967ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:16.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.974+0000 7f2f487bb740 1 --2- 172.21.15.12:0/3907437693 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d95de40 0x561e6d967ed0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2f3009b9f0 tx=0x7f2f300d5530 comp rx=0 tx=0).stop 2024-09-05T01:34:16.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.974+0000 7f2f487bb740 1 -- 172.21.15.12:0/3907437693 shutdown_connections 2024-09-05T01:34:16.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.974+0000 7f2f487bb740 1 --2- 172.21.15.12:0/3907437693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e6d969020 0x561e6d981560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.974+0000 7f2f487bb740 1 --2- 172.21.15.12:0/3907437693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e6d95e760 0x561e6d981020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.974+0000 7f2f487bb740 1 --2- 172.21.15.12:0/3907437693 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d95de40 0x561e6d967ed0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.974+0000 7f2f487bb740 1 -- 172.21.15.12:0/3907437693 >> 172.21.15.12:0/3907437693 conn(0x561e6d95a3d0 msgr2=0x561e6d9677c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:16.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.974+0000 7f2f487bb740 1 -- 172.21.15.12:0/3907437693 shutdown_connections 2024-09-05T01:34:16.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.974+0000 7f2f487bb740 1 -- 172.21.15.12:0/3907437693 wait complete. 2024-09-05T01:34:16.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.975+0000 7f2f487bb740 1 -- start start 2024-09-05T01:34:16.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.975+0000 7f2f487bb740 1 Processor -- start 2024-09-05T01:34:16.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.976+0000 7f2f487bb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e6d95de40 0x561e6d971750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:16.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.976+0000 7f2f487bb740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d95e760 0x561e6d962d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:16.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.976+0000 7f2f487bb740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e6d969020 0x561e6d9632a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:16.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.976+0000 7f2f487bb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2f401b0ed0 con 0x561e6d95de40 2024-09-05T01:34:16.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.976+0000 7f2f487bb740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2f401b0740 con 0x561e6d95e760 2024-09-05T01:34:16.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.976+0000 7f2f487bb740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2f401ad9a0 con 0x561e6d969020 2024-09-05T01:34:16.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.976+0000 7f2f487bb740 10 client.0 _ll_register_callbacks cb 0x7f2f300cce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:34:16.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.976+0000 7f2f37e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d95e760 0x561e6d962d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:16.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.976+0000 7f2f3ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e6d95de40 0x561e6d971750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:16.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.976+0000 7f2f3f400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e6d969020 0x561e6d9632a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:16.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.976+0000 7f2f37e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d95e760 0x561e6d962d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:32830/0 (socket says 172.21.15.12:32830) 2024-09-05T01:34:16.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.976+0000 7f2f3ea00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e6d95de40 0x561e6d971750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40190/0 (socket says 172.21.15.12:40190) 2024-09-05T01:34:16.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.976+0000 7f2f37e00640 1 -- 172.21.15.12:0/3574752369 learned_addr learned my addr 172.21.15.12:0/3574752369 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:16.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.976+0000 7f2f37e00640 1 -- 172.21.15.12:0/3574752369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e6d969020 msgr2=0x561e6d9632a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:16.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.976+0000 7f2f37e00640 1 --2- 172.21.15.12:0/3574752369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e6d969020 0x561e6d9632a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.976+0000 7f2f37e00640 1 -- 172.21.15.12:0/3574752369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e6d95de40 msgr2=0x561e6d971750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:16.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.976+0000 7f2f37e00640 1 --2- 172.21.15.12:0/3574752369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e6d95de40 0x561e6d971750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.976+0000 7f2f37e00640 1 -- 172.21.15.12:0/3574752369 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e6d963ad0 con 0x561e6d95e760 2024-09-05T01:34:16.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.976+0000 7f2f3ea00640 1 --2- 172.21.15.12:0/3574752369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e6d95de40 0x561e6d971750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:34:16.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.977+0000 7f2f37e00640 1 --2- 172.21.15.12:0/3574752369 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d95e760 0x561e6d962d60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2f28031470 tx=0x7f2f28031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=595387e390b0147c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:16.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.977+0000 7f2f2cc00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:34:16.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.977+0000 7f2f2cc00640 1 -- 172.21.15.12:0/3574752369 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f28035040 con 0x561e6d95e760 2024-09-05T01:34:16.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.977+0000 7f2f487bb740 1 -- 172.21.15.12:0/3574752369 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f300d5220 con 0x561e6d95e760 2024-09-05T01:34:16.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.977+0000 7f2f2cc00640 1 -- 172.21.15.12:0/3574752369 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f2f28004040 con 0x561e6d95e760 2024-09-05T01:34:16.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.977+0000 7f2f2cc00640 1 -- 172.21.15.12:0/3574752369 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f2f28061050 con 0x561e6d95e760 2024-09-05T01:34:16.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.978+0000 7f2f487bb740 10 client.26507 fetch_fsmap learned FSMap version 54 2024-09-05T01:34:16.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.978+0000 7f2f487bb740 1 -- 172.21.15.12:0/3574752369 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x561e6d9e40e0 con 0x561e6d95e760 2024-09-05T01:34:16.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.978+0000 7f2f2cc00640 1 -- 172.21.15.12:0/3574752369 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f300d5220 con 0x561e6d95e760 2024-09-05T01:34:16.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.978+0000 7f2f2cc00640 1 -- 172.21.15.12:0/3574752369 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 54) ==== 8422+0+0 (secure 0 0 0) 0x7f2f28052b10 con 0x561e6d95e760 2024-09-05T01:34:16.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.978+0000 7f2f487bb740 10 client.26507 fetch_fsmap finished waiting for FSMap version 54 2024-09-05T01:34:16.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.978+0000 7f2f487bb740 10 client.26507 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:34:16.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.978+0000 7f2f487bb740 20 client.26507 populate_metadata read hostname 'smithi012' 2024-09-05T01:34:16.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.978+0000 7f2f487bb740 1 --2- 172.21.15.12:0/3574752369 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x561e6d9e4580 0x561e6d9e6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:16.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.978+0000 7f2f487bb740 4 client.26507 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:34:16.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.978+0000 7f2f487bb740 1 -- 172.21.15.12:0/3574752369 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561e6d8cbe60 con 0x561e6d9e4580 2024-09-05T01:34:16.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.978+0000 7f2f3ea00640 1 --2- 172.21.15.12:0/3574752369 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x561e6d9e4580 0x561e6d9e6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:16.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.979+0000 7f2f3ea00640 1 --2- 172.21.15.12:0/3574752369 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x561e6d9e4580 0x561e6d9e6970 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e79a7b34ffc17c5 server_cookie=133f9b6e9cecced6 in_seq=0 out_seq=0 2024-09-05T01:34:16.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.979+0000 7f2f2cc00640 10 client.26507 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:34:16.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.979+0000 7f2f2cc00640 1 -- 172.21.15.12:0/3574752369 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561e6d8cbe60 con 0x561e6d9e4580 2024-09-05T01:34:16.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.979+0000 7f2f2cc00640 10 client.26507 handle_command_reply: tid=0 2024-09-05T01:34:16.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.979+0000 7f2f487bb740 1 client.26507 shutdown 2024-09-05T01:34:16.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.979+0000 7f2f487bb740 1 -- 172.21.15.12:0/3574752369 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d95e760 msgr2=0x561e6d962d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:16.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.979+0000 7f2f487bb740 1 --2- 172.21.15.12:0/3574752369 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d95e760 0x561e6d962d60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2f28031470 tx=0x7f2f28031400 comp rx=0 tx=0).stop 2024-09-05T01:34:16.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.979+0000 7f2f487bb740 1 -- 172.21.15.12:0/3574752369 shutdown_connections 2024-09-05T01:34:16.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.979+0000 7f2f487bb740 1 --2- 172.21.15.12:0/3574752369 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x561e6d9e4580 0x561e6d9e6970 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.979+0000 7f2f487bb740 1 --2- 172.21.15.12:0/3574752369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e6d969020 0x561e6d9632a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.979+0000 7f2f487bb740 1 --2- 172.21.15.12:0/3574752369 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561e6d95e760 0x561e6d962d60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.979+0000 7f2f487bb740 1 --2- 172.21.15.12:0/3574752369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561e6d95de40 0x561e6d971750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.979+0000 7f2f2cc00640 0 client.26507 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:34:16.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.979+0000 7f2f487bb740 1 -- 172.21.15.12:0/3574752369 >> 172.21.15.12:0/3574752369 conn(0x561e6d95a3d0 msgr2=0x561e6d9600b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:16.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.980+0000 7f2f487bb740 1 -- 172.21.15.12:0/3574752369 shutdown_connections 2024-09-05T01:34:16.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.980+0000 7f2f487bb740 1 -- 172.21.15.12:0/3574752369 wait complete. 2024-09-05T01:34:16.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.980+0000 7f2f487bb740 20 client.26507 trim_cache size 0 max 16384 2024-09-05T01:34:16.985 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:34:16.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.980+0000 7f2f3fe00640 1 -- 172.21.15.12:0/3547965645 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f2f240a2df0 msgr2=0x7f2f240a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:16.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.980+0000 7f2f3fe00640 1 --2- 172.21.15.12:0/3547965645 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f2f240a2df0 0x7f2f240a52b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2f38005fd0 tx=0x7f2f38009500 comp rx=0 tx=0).stop 2024-09-05T01:34:16.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.980+0000 7f2f3fe00640 1 -- 172.21.15.12:0/3547965645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f401019c0 msgr2=0x7f2f400744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:16.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.980+0000 7f2f3fe00640 1 --2- 172.21.15.12:0/3547965645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f401019c0 0x7f2f400744f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000e9f0 tx=0x7f2f3000eeb0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.981+0000 7f2f3fe00640 1 -- 172.21.15.12:0/3547965645 shutdown_connections 2024-09-05T01:34:16.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.981+0000 7f2f3fe00640 1 --2- 172.21.15.12:0/3547965645 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f2f240a2df0 0x7f2f240a52b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.981+0000 7f2f3fe00640 1 --2- 172.21.15.12:0/3547965645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f401079c0 0x7f2f40074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.981+0000 7f2f3fe00640 1 --2- 172.21.15.12:0/3547965645 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f40102360 0x7f2f40074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.981+0000 7f2f3fe00640 1 --2- 172.21.15.12:0/3547965645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f401019c0 0x7f2f400744f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:16.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.981+0000 7f2f3fe00640 1 -- 172.21.15.12:0/3547965645 >> 172.21.15.12:0/3547965645 conn(0x7f2f400fd740 msgr2=0x7f2f400fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:16.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.981+0000 7f2f3fe00640 1 -- 172.21.15.12:0/3547965645 shutdown_connections 2024-09-05T01:34:16.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:16.981+0000 7f2f3fe00640 1 -- 172.21.15.12:0/3547965645 wait complete. 2024-09-05T01:34:17.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:17 smithi151 ceph-mon[35013]: pgmap v298: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 387 op/s 2024-09-05T01:34:17.364 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:17 smithi012 ceph-mon[29942]: pgmap v298: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 387 op/s 2024-09-05T01:34:17.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:17 smithi145 ceph-mon[34376]: pgmap v298: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.1 MiB/s wr, 387 op/s 2024-09-05T01:34:18.743 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-05T01:34:18.743 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-05T01:34:19.136 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:34:19.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:19 smithi151 ceph-mon[35013]: pgmap v299: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 393 op/s 2024-09-05T01:34:19.416 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:19 smithi012 ceph-mon[29942]: pgmap v299: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 393 op/s 2024-09-05T01:34:19.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:19 smithi145 ceph-mon[34376]: pgmap v299: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 393 op/s 2024-09-05T01:34:19.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.755+0000 7f6a97200640 1 -- 172.21.15.12:0/3108169475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a98102360 msgr2=0x7f6a9810e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:19.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.755+0000 7f6a97200640 1 --2- 172.21.15.12:0/3108169475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a98102360 0x7f6a9810e890 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6a90009be0 tx=0x7f6a9002a6d0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.755+0000 7f6a97200640 1 -- 172.21.15.12:0/3108169475 shutdown_connections 2024-09-05T01:34:19.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.755+0000 7f6a97200640 1 --2- 172.21.15.12:0/3108169475 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a98102360 0x7f6a9810e890 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.755+0000 7f6a97200640 1 --2- 172.21.15.12:0/3108169475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a981019c0 0x7f6a98101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.755+0000 7f6a97200640 1 --2- 172.21.15.12:0/3108169475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a981079c0 0x7f6a98107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.755+0000 7f6a97200640 1 -- 172.21.15.12:0/3108169475 >> 172.21.15.12:0/3108169475 conn(0x7f6a980fd740 msgr2=0x7f6a980ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:19.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.755+0000 7f6a97200640 1 -- 172.21.15.12:0/3108169475 shutdown_connections 2024-09-05T01:34:19.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.755+0000 7f6a97200640 1 -- 172.21.15.12:0/3108169475 wait complete. 2024-09-05T01:34:19.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.756+0000 7f6a97200640 1 Processor -- start 2024-09-05T01:34:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.756+0000 7f6a97200640 1 -- start start 2024-09-05T01:34:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.757+0000 7f6a97200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a981019c0 0x7f6a980744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.757+0000 7f6a97200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a98102360 0x7f6a98074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.757+0000 7f6a97200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a981079c0 0x7f6a98074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.757+0000 7f6a97200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6a98111d70 con 0x7f6a98102360 2024-09-05T01:34:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.757+0000 7f6a97200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6a98111bf0 con 0x7f6a981079c0 2024-09-05T01:34:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.757+0000 7f6a97200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6a98111ef0 con 0x7f6a981019c0 2024-09-05T01:34:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.757+0000 7f6a95e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a981019c0 0x7f6a980744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.757+0000 7f6a95e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a981019c0 0x7f6a980744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:55910/0 (socket says 172.21.15.12:55910) 2024-09-05T01:34:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.757+0000 7f6a95e00640 1 -- 172.21.15.12:0/2802262197 learned_addr learned my addr 172.21.15.12:0/2802262197 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:19.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.757+0000 7f6a96800640 1 --2- 172.21.15.12:0/2802262197 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a981079c0 0x7f6a98074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:19.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.757+0000 7f6a95400640 1 --2- 172.21.15.12:0/2802262197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a98102360 0x7f6a98074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:19.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.758+0000 7f6a95e00640 1 -- 172.21.15.12:0/2802262197 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a981079c0 msgr2=0x7f6a98074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:19.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.758+0000 7f6a95e00640 1 --2- 172.21.15.12:0/2802262197 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a981079c0 0x7f6a98074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.758+0000 7f6a95e00640 1 -- 172.21.15.12:0/2802262197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a98102360 msgr2=0x7f6a98074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:19.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.758+0000 7f6a95e00640 1 --2- 172.21.15.12:0/2802262197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a98102360 0x7f6a98074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.758+0000 7f6a95e00640 1 -- 172.21.15.12:0/2802262197 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a981a6750 con 0x7f6a981019c0 2024-09-05T01:34:19.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.758+0000 7f6a95e00640 1 --2- 172.21.15.12:0/2802262197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a981019c0 0x7f6a980744f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800e9f0 tx=0x7f6a8800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:19.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.758+0000 7f6a8ea00640 1 -- 172.21.15.12:0/2802262197 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8800cd80 con 0x7f6a981019c0 2024-09-05T01:34:19.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.758+0000 7f6a97200640 1 -- 172.21.15.12:0/2802262197 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a981a6a40 con 0x7f6a981019c0 2024-09-05T01:34:19.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.758+0000 7f6a8ea00640 1 -- 172.21.15.12:0/2802262197 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a88010910 con 0x7f6a981019c0 2024-09-05T01:34:19.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.758+0000 7f6a8ea00640 1 -- 172.21.15.12:0/2802262197 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a880188f0 con 0x7f6a981019c0 2024-09-05T01:34:19.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.758+0000 7f6a97200640 1 -- 172.21.15.12:0/2802262197 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a981a6fd0 con 0x7f6a981019c0 2024-09-05T01:34:19.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.762+0000 7f6a8ea00640 1 -- 172.21.15.12:0/2802262197 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f6a88010ac0 con 0x7f6a981019c0 2024-09-05T01:34:19.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.762+0000 7f6a9f9fd740 1 Processor -- start 2024-09-05T01:34:19.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.762+0000 7f6a9f9fd740 1 -- start start 2024-09-05T01:34:19.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.762+0000 7f6a9f9fd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c878cb0 0x55954c879090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:19.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.762+0000 7f6a9f9fd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55954c8795d0 0x55954c883950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:19.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.762+0000 7f6a9f9fd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954c883e90 0x55954c886280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:19.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.762+0000 7f6a9f9fd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55954c7df290 con 0x55954c8795d0 2024-09-05T01:34:19.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.762+0000 7f6a9f9fd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55954c786b40 con 0x55954c878cb0 2024-09-05T01:34:19.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.762+0000 7f6a9f9fd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55954c7db250 con 0x55954c883e90 2024-09-05T01:34:19.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.762+0000 7f6a95e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55954c8795d0 0x55954c883950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:19.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.762+0000 7f6a96800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c878cb0 0x55954c879090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:19.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.763+0000 7f6a96800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c878cb0 0x55954c879090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:32848/0 (socket says 172.21.15.12:32848) 2024-09-05T01:34:19.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.763+0000 7f6a96800640 1 -- 172.21.15.12:0/2251190119 learned_addr learned my addr 172.21.15.12:0/2251190119 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:19.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.763+0000 7f6a95400640 1 --2- 172.21.15.12:0/2251190119 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954c883e90 0x55954c886280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.763+0000 7f6a96800640 1 -- 172.21.15.12:0/2251190119 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954c883e90 msgr2=0x55954c886280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.763+0000 7f6a96800640 1 --2- 172.21.15.12:0/2251190119 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954c883e90 0x55954c886280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.763+0000 7f6a96800640 1 -- 172.21.15.12:0/2251190119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55954c8795d0 msgr2=0x55954c883950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.763+0000 7f6a96800640 1 --2- 172.21.15.12:0/2251190119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55954c8795d0 0x55954c883950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.763+0000 7f6a96800640 1 -- 172.21.15.12:0/2251190119 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55954c5506a0 con 0x55954c878cb0 2024-09-05T01:34:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.763+0000 7f6a8ea00640 1 --2- 172.21.15.12:0/2802262197 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6a7c0a2d70 0x7f6a7c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.763+0000 7f6a96800640 1 --2- 172.21.15.12:0/2251190119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c878cb0 0x55954c879090 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6a90033000 tx=0x7f6a900303a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=321be91f445d384e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.763+0000 7f6a8ea00640 1 -- 172.21.15.12:0/2802262197 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f6a880cf810 con 0x7f6a981019c0 2024-09-05T01:34:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.764+0000 7f6a95e00640 1 --2- 172.21.15.12:0/2802262197 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6a7c0a2d70 0x7f6a7c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.764+0000 7f6a83400640 1 -- 172.21.15.12:0/2251190119 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a90042070 con 0x55954c878cb0 2024-09-05T01:34:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.764+0000 7f6a83400640 1 -- 172.21.15.12:0/2251190119 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a90037040 con 0x55954c878cb0 2024-09-05T01:34:19.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.764+0000 7f6a83400640 1 -- 172.21.15.12:0/2251190119 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a90036070 con 0x55954c878cb0 2024-09-05T01:34:19.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.765+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/2251190119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c878cb0 msgr2=0x55954c879090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:19.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.765+0000 7f6a9f9fd740 1 --2- 172.21.15.12:0/2251190119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c878cb0 0x55954c879090 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6a90033000 tx=0x7f6a900303a0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.765+0000 7f6a95e00640 1 --2- 172.21.15.12:0/2802262197 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6a7c0a2d70 0x7f6a7c0a5230 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6a880ccfd0 tx=0x7f6a880d5550 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:19.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.765+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/2251190119 shutdown_connections 2024-09-05T01:34:19.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.765+0000 7f6a9f9fd740 1 --2- 172.21.15.12:0/2251190119 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954c883e90 0x55954c886280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.765+0000 7f6a9f9fd740 1 --2- 172.21.15.12:0/2251190119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55954c8795d0 0x55954c883950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.765+0000 7f6a9f9fd740 1 --2- 172.21.15.12:0/2251190119 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c878cb0 0x55954c879090 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.765+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/2251190119 >> 172.21.15.12:0/2251190119 conn(0x55954c875240 msgr2=0x55954c875620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:19.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.765+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/2251190119 shutdown_connections 2024-09-05T01:34:19.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.765+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/2251190119 wait complete. 2024-09-05T01:34:19.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.766+0000 7f6a9f9fd740 1 -- start start 2024-09-05T01:34:19.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.766+0000 7f6a9f9fd740 1 Processor -- start 2024-09-05T01:34:19.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.766+0000 7f6a9f9fd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954c878cb0 0x55954c883770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:19.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.766+0000 7f6a9f9fd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c8795d0 0x55954c880a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:19.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.766+0000 7f6a9f9fd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55954c883e90 0x55954c880f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:19.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.766+0000 7f6a9f9fd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55954c886b00 con 0x55954c883e90 2024-09-05T01:34:19.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.766+0000 7f6a9f9fd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55954c799fa0 con 0x55954c8795d0 2024-09-05T01:34:19.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.766+0000 7f6a9f9fd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55954c886c80 con 0x55954c878cb0 2024-09-05T01:34:19.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.767+0000 7f6a9f9fd740 10 client.0 _ll_register_callbacks cb 0x55954c4edba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:34:19.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.767+0000 7f6a96800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954c878cb0 0x55954c883770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:19.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.767+0000 7f6a95400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c8795d0 0x55954c880a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:19.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.767+0000 7f6a96800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954c878cb0 0x55954c883770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:55934/0 (socket says 172.21.15.12:55934) 2024-09-05T01:34:19.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.767+0000 7f6a95400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c8795d0 0x55954c880a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:32864/0 (socket says 172.21.15.12:32864) 2024-09-05T01:34:19.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.767+0000 7f6a96800640 1 -- 172.21.15.12:0/71005492 learned_addr learned my addr 172.21.15.12:0/71005492 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:19.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.767+0000 7f6a96800640 1 --2- 172.21.15.12:0/71005492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55954c883e90 0x55954c880f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:19.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.767+0000 7f6a95400640 1 -- 172.21.15.12:0/71005492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954c878cb0 msgr2=0x55954c883770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:19.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.767+0000 7f6a95400640 1 --2- 172.21.15.12:0/71005492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954c878cb0 0x55954c883770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.767+0000 7f6a95400640 1 -- 172.21.15.12:0/71005492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55954c883e90 msgr2=0x55954c880f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:19.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.767+0000 7f6a95400640 1 --2- 172.21.15.12:0/71005492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55954c883e90 0x55954c880f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.767+0000 7f6a95400640 1 -- 172.21.15.12:0/71005492 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55954c881740 con 0x55954c8795d0 2024-09-05T01:34:19.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.768+0000 7f6a95400640 1 --2- 172.21.15.12:0/71005492 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c8795d0 0x55954c880a20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6a98075f80 tx=0x7f6a840035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ea02ce49147f354 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:19.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.768+0000 7f6a77e00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:34:19.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.768+0000 7f6a77e00640 1 -- 172.21.15.12:0/71005492 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a84012650 con 0x55954c8795d0 2024-09-05T01:34:19.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.768+0000 7f6a77e00640 1 -- 172.21.15.12:0/71005492 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f6a840127f0 con 0x55954c8795d0 2024-09-05T01:34:19.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.768+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/71005492 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a90037040 con 0x55954c8795d0 2024-09-05T01:34:19.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.768+0000 7f6a77e00640 1 -- 172.21.15.12:0/71005492 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f6a84012a30 con 0x55954c8795d0 2024-09-05T01:34:19.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.768+0000 7f6a9f9fd740 10 client.26519 fetch_fsmap learned FSMap version 55 2024-09-05T01:34:19.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.768+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/71005492 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55954c892a20 con 0x55954c8795d0 2024-09-05T01:34:19.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.769+0000 7f6a77e00640 1 -- 172.21.15.12:0/71005492 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a90037040 con 0x55954c8795d0 2024-09-05T01:34:19.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.769+0000 7f6a77e00640 1 -- 172.21.15.12:0/71005492 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 55) ==== 8426+0+0 (secure 0 0 0) 0x7f6a8401a020 con 0x55954c8795d0 2024-09-05T01:34:19.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.769+0000 7f6a9f9fd740 10 client.26519 fetch_fsmap finished waiting for FSMap version 55 2024-09-05T01:34:19.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.769+0000 7f6a9f9fd740 10 client.26519 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:34:19.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.769+0000 7f6a9f9fd740 20 client.26519 populate_metadata read hostname 'smithi012' 2024-09-05T01:34:19.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.769+0000 7f6a9f9fd740 1 --2- 172.21.15.12:0/71005492 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55954c893f80 0x55954c8963a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:19.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.769+0000 7f6a9f9fd740 4 client.26519 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:34:19.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.769+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/71005492 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55954c7ec800 con 0x55954c893f80 2024-09-05T01:34:19.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.769+0000 7f6a96800640 1 --2- 172.21.15.12:0/71005492 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55954c893f80 0x55954c8963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:19.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.770+0000 7f6a96800640 1 --2- 172.21.15.12:0/71005492 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55954c893f80 0x55954c8963a0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13fe6f1ffa69d569 server_cookie=d83da8920f18de80 in_seq=0 out_seq=0 2024-09-05T01:34:19.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.770+0000 7f6a77e00640 10 client.26519 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:34:19.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.770+0000 7f6a77e00640 1 -- 172.21.15.12:0/71005492 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55954c7ec800 con 0x55954c893f80 2024-09-05T01:34:19.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.770+0000 7f6a77e00640 10 client.26519 handle_command_reply: tid=0 2024-09-05T01:34:19.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.771+0000 7f6a9f9fd740 1 client.26519 shutdown 2024-09-05T01:34:19.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.771+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/71005492 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c8795d0 msgr2=0x55954c880a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:19.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.771+0000 7f6a9f9fd740 1 --2- 172.21.15.12:0/71005492 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c8795d0 0x55954c880a20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6a98075f80 tx=0x7f6a840035f0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.771+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/71005492 shutdown_connections 2024-09-05T01:34:19.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.771+0000 7f6a9f9fd740 1 --2- 172.21.15.12:0/71005492 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55954c893f80 0x55954c8963a0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.771+0000 7f6a9f9fd740 1 --2- 172.21.15.12:0/71005492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55954c883e90 0x55954c880f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.771+0000 7f6a9f9fd740 1 --2- 172.21.15.12:0/71005492 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c8795d0 0x55954c880a20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.771+0000 7f6a9f9fd740 1 --2- 172.21.15.12:0/71005492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954c878cb0 0x55954c883770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.771+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/71005492 >> 172.21.15.12:0/71005492 conn(0x55954c875240 msgr2=0x55954c87af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:19.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.771+0000 7f6a77e00640 0 client.26519 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:34:19.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.771+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/71005492 shutdown_connections 2024-09-05T01:34:19.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.771+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/71005492 wait complete. 2024-09-05T01:34:19.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.771+0000 7f6a9f9fd740 20 client.26519 trim_cache size 0 max 16384 2024-09-05T01:34:19.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.791+0000 7f6a9f9fd740 1 Processor -- start 2024-09-05T01:34:19.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.791+0000 7f6a9f9fd740 1 -- start start 2024-09-05T01:34:19.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.791+0000 7f6a9f9fd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c878cb0 0x55954c87fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:19.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.791+0000 7f6a9f9fd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954c8795d0 0x55954c89bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:19.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.791+0000 7f6a9f9fd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55954c883e90 0x55954c89c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:19.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.791+0000 7f6a9f9fd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6a981af950 con 0x55954c883e90 2024-09-05T01:34:19.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.791+0000 7f6a9f9fd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6a981b1610 con 0x55954c878cb0 2024-09-05T01:34:19.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.791+0000 7f6a9f9fd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6a981b0020 con 0x55954c8795d0 2024-09-05T01:34:19.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.792+0000 7f6a96800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c878cb0 0x55954c87fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:19.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.792+0000 7f6a96800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c878cb0 0x55954c87fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:32876/0 (socket says 172.21.15.12:32876) 2024-09-05T01:34:19.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.792+0000 7f6a96800640 1 -- 172.21.15.12:0/1798319279 learned_addr learned my addr 172.21.15.12:0/1798319279 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:19.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.792+0000 7f6a95400640 1 --2- 172.21.15.12:0/1798319279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954c8795d0 0x55954c89bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:19.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.792+0000 7f6a96800640 1 --2- 172.21.15.12:0/1798319279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55954c883e90 0x55954c89c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:19.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.792+0000 7f6a95400640 1 -- 172.21.15.12:0/1798319279 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c878cb0 msgr2=0x55954c87fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:19.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.792+0000 7f6a95400640 1 --2- 172.21.15.12:0/1798319279 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c878cb0 0x55954c87fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.792+0000 7f6a95400640 1 -- 172.21.15.12:0/1798319279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55954c883e90 msgr2=0x55954c89c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:19.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.792+0000 7f6a95400640 1 --2- 172.21.15.12:0/1798319279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55954c883e90 0x55954c89c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.792+0000 7f6a95400640 1 -- 172.21.15.12:0/1798319279 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55954c896a20 con 0x55954c8795d0 2024-09-05T01:34:19.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.792+0000 7f6a96800640 1 --2- 172.21.15.12:0/1798319279 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c878cb0 0x55954c87fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:34:19.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.793+0000 7f6a95400640 1 --2- 172.21.15.12:0/1798319279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954c8795d0 0x55954c89bc70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6a8401cf10 tx=0x7f6a84011800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce870998ccf57590 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:19.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.793+0000 7f6a82a00640 1 -- 172.21.15.12:0/1798319279 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a84028070 con 0x55954c8795d0 2024-09-05T01:34:19.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.793+0000 7f6a82a00640 1 -- 172.21.15.12:0/1798319279 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a84012dd0 con 0x55954c8795d0 2024-09-05T01:34:19.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.793+0000 7f6a82a00640 1 -- 172.21.15.12:0/1798319279 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a84005540 con 0x55954c8795d0 2024-09-05T01:34:19.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.793+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/1798319279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954c8795d0 msgr2=0x55954c89bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:19.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.793+0000 7f6a9f9fd740 1 --2- 172.21.15.12:0/1798319279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954c8795d0 0x55954c89bc70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6a8401cf10 tx=0x7f6a84011800 comp rx=0 tx=0).stop 2024-09-05T01:34:19.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.793+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/1798319279 shutdown_connections 2024-09-05T01:34:19.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.793+0000 7f6a9f9fd740 1 --2- 172.21.15.12:0/1798319279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55954c883e90 0x55954c89c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.794+0000 7f6a9f9fd740 1 --2- 172.21.15.12:0/1798319279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954c8795d0 0x55954c89bc70 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.794+0000 7f6a9f9fd740 1 --2- 172.21.15.12:0/1798319279 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c878cb0 0x55954c87fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.794+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/1798319279 >> 172.21.15.12:0/1798319279 conn(0x55954c875240 msgr2=0x55954c87f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.794+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/1798319279 shutdown_connections 2024-09-05T01:34:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.794+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/1798319279 wait complete. 2024-09-05T01:34:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.794+0000 7f6a9f9fd740 1 -- start start 2024-09-05T01:34:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.794+0000 7f6a9f9fd740 1 Processor -- start 2024-09-05T01:34:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.795+0000 7f6a9f9fd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55954c878cb0 0x55954c887e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.795+0000 7f6a9f9fd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954c8795d0 0x55954c888350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.795+0000 7f6a9f9fd740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c883e90 0x55954c888890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.795+0000 7f6a9f9fd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6a981b0e80 con 0x55954c878cb0 2024-09-05T01:34:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.795+0000 7f6a9f9fd740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6a981b06f0 con 0x55954c883e90 2024-09-05T01:34:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.795+0000 7f6a9f9fd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6a981ad950 con 0x55954c8795d0 2024-09-05T01:34:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.795+0000 7f6a9f9fd740 10 client.0 _ll_register_callbacks cb 0x7f6a84009790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:34:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.795+0000 7f6a96800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55954c878cb0 0x55954c887e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.795+0000 7f6a95400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954c8795d0 0x55954c888350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.795+0000 7f6a95400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954c8795d0 0x55954c888350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:55956/0 (socket says 172.21.15.12:55956) 2024-09-05T01:34:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.795+0000 7f6a95400640 1 -- 172.21.15.12:0/3000967454 learned_addr learned my addr 172.21.15.12:0/3000967454 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.795+0000 7f6a95400640 1 -- 172.21.15.12:0/3000967454 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c883e90 msgr2=0x55954c888890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.795+0000 7f6a95400640 1 --2- 172.21.15.12:0/3000967454 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c883e90 0x55954c888890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.795+0000 7f6a95400640 1 -- 172.21.15.12:0/3000967454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55954c878cb0 msgr2=0x55954c887e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.795+0000 7f6a95400640 1 --2- 172.21.15.12:0/3000967454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55954c878cb0 0x55954c887e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.795+0000 7f6a95400640 1 -- 172.21.15.12:0/3000967454 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55954c906650 con 0x55954c8795d0 2024-09-05T01:34:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.796+0000 7f6a95400640 1 --2- 172.21.15.12:0/3000967454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954c8795d0 0x55954c888350 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6a84003630 tx=0x7f6a84005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=869ca8db93b37792 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.796+0000 7f6a77e00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:34:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.796+0000 7f6a77e00640 1 -- 172.21.15.12:0/3000967454 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8403b060 con 0x55954c8795d0 2024-09-05T01:34:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.796+0000 7f6a77e00640 1 -- 172.21.15.12:0/3000967454 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f6a84012660 con 0x55954c8795d0 2024-09-05T01:34:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.796+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/3000967454 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a84012dd0 con 0x55954c8795d0 2024-09-05T01:34:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.796+0000 7f6a77e00640 1 -- 172.21.15.12:0/3000967454 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f6a84028040 con 0x55954c8795d0 2024-09-05T01:34:19.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.796+0000 7f6a9f9fd740 10 client.26509 fetch_fsmap learned FSMap version 55 2024-09-05T01:34:19.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.796+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/3000967454 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55954c907950 con 0x55954c8795d0 2024-09-05T01:34:19.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.797+0000 7f6a77e00640 1 -- 172.21.15.12:0/3000967454 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a84012dd0 con 0x55954c8795d0 2024-09-05T01:34:19.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.797+0000 7f6a77e00640 1 -- 172.21.15.12:0/3000967454 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 55) ==== 8426+0+0 (secure 0 0 0) 0x7f6a8401a040 con 0x55954c8795d0 2024-09-05T01:34:19.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.797+0000 7f6a9f9fd740 10 client.26509 fetch_fsmap finished waiting for FSMap version 55 2024-09-05T01:34:19.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.797+0000 7f6a9f9fd740 10 client.26509 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:34:19.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.797+0000 7f6a9f9fd740 20 client.26509 populate_metadata read hostname 'smithi012' 2024-09-05T01:34:19.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.797+0000 7f6a9f9fd740 1 --2- 172.21.15.12:0/3000967454 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55954c908180 0x55954c90a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:19.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.797+0000 7f6a9f9fd740 4 client.26509 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-05T01:34:19.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.797+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/3000967454 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55954c8812f0 con 0x55954c908180 2024-09-05T01:34:19.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.798+0000 7f6a96800640 1 --2- 172.21.15.12:0/3000967454 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55954c908180 0x55954c90a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:19.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.798+0000 7f6a96800640 1 --2- 172.21.15.12:0/3000967454 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55954c908180 0x55954c90a5a0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e8e89cd85b8c15e server_cookie=dee699d06f776a in_seq=0 out_seq=0 2024-09-05T01:34:19.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.798+0000 7f6a77e00640 10 client.26509 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:34:19.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.799+0000 7f6a77e00640 1 -- 172.21.15.12:0/3000967454 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55954c8812f0 con 0x55954c908180 2024-09-05T01:34:19.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.799+0000 7f6a77e00640 10 client.26509 handle_command_reply: tid=0 2024-09-05T01:34:19.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.799+0000 7f6a9f9fd740 1 client.26509 shutdown 2024-09-05T01:34:19.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.799+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/3000967454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954c8795d0 msgr2=0x55954c888350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:19.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.799+0000 7f6a9f9fd740 1 --2- 172.21.15.12:0/3000967454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954c8795d0 0x55954c888350 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6a84003630 tx=0x7f6a84005740 comp rx=0 tx=0).stop 2024-09-05T01:34:19.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.799+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/3000967454 shutdown_connections 2024-09-05T01:34:19.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.799+0000 7f6a9f9fd740 1 --2- 172.21.15.12:0/3000967454 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55954c908180 0x55954c90a5a0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.799+0000 7f6a9f9fd740 1 --2- 172.21.15.12:0/3000967454 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55954c883e90 0x55954c888890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.799+0000 7f6a9f9fd740 1 --2- 172.21.15.12:0/3000967454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954c8795d0 0x55954c888350 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.799+0000 7f6a9f9fd740 1 --2- 172.21.15.12:0/3000967454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55954c878cb0 0x55954c887e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.799+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/3000967454 >> 172.21.15.12:0/3000967454 conn(0x55954c875240 msgr2=0x55954c87fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:19.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.799+0000 7f6a77e00640 0 client.26509 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:34:19.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.800+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/3000967454 shutdown_connections 2024-09-05T01:34:19.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.800+0000 7f6a9f9fd740 1 -- 172.21.15.12:0/3000967454 wait complete. 2024-09-05T01:34:19.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.800+0000 7f6a9f9fd740 20 client.26509 trim_cache size 0 max 16384 2024-09-05T01:34:19.805 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:34:19.805 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-05T01:34:19.805 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "742bf79e-330a-493d-be5d-2608da7e4fb0", 2024-09-05T01:34:19.805 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-05T01:34:19.805 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:34:19.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.800+0000 7f6a97200640 1 -- 172.21.15.12:0/2802262197 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6a7c0a2d70 msgr2=0x7f6a7c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:19.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.800+0000 7f6a97200640 1 --2- 172.21.15.12:0/2802262197 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6a7c0a2d70 0x7f6a7c0a5230 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6a880ccfd0 tx=0x7f6a880d5550 comp rx=0 tx=0).stop 2024-09-05T01:34:19.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.800+0000 7f6a97200640 1 -- 172.21.15.12:0/2802262197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a981019c0 msgr2=0x7f6a980744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:19.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.800+0000 7f6a97200640 1 --2- 172.21.15.12:0/2802262197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a981019c0 0x7f6a980744f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800e9f0 tx=0x7f6a8800eeb0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.802+0000 7f6a97200640 1 -- 172.21.15.12:0/2802262197 shutdown_connections 2024-09-05T01:34:19.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.802+0000 7f6a97200640 1 --2- 172.21.15.12:0/2802262197 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6a7c0a2d70 0x7f6a7c0a5230 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.802+0000 7f6a97200640 1 --2- 172.21.15.12:0/2802262197 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6a981079c0 0x7f6a98074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.802+0000 7f6a97200640 1 --2- 172.21.15.12:0/2802262197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a98102360 0x7f6a98074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.802+0000 7f6a97200640 1 --2- 172.21.15.12:0/2802262197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a981019c0 0x7f6a980744f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:19.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.802+0000 7f6a97200640 1 -- 172.21.15.12:0/2802262197 >> 172.21.15.12:0/2802262197 conn(0x7f6a980fd740 msgr2=0x7f6a980fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:19.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.802+0000 7f6a97200640 1 -- 172.21.15.12:0/2802262197 shutdown_connections 2024-09-05T01:34:19.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:19.802+0000 7f6a97200640 1 -- 172.21.15.12:0/2802262197 wait complete. 2024-09-05T01:34:20.503 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:20 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:34:20.503 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:20 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:20.555 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T01:34:20.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:20 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:34:20.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:20 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:20.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:20 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:34:20.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:20 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:21.070 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:34:21.437 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:21 smithi012 ceph-mon[29942]: scrub queued for path: / 2024-09-05T01:34:21.437 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:21 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:21.437 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:21 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:21.437 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:21 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:21.437 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:21 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:21.437 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:21 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:21.437 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:21 smithi012 ceph-mon[29942]: pgmap v300: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.1 MiB/s wr, 399 op/s 2024-09-05T01:34:21.438 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:21 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:21.438 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:21 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:21.438 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:21 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:21.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:21 smithi145 ceph-mon[34376]: scrub queued for path: / 2024-09-05T01:34:21.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:21 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:21.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:21 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:21.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:21 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:21.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:21 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:21.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:21 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:21.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:21 smithi145 ceph-mon[34376]: pgmap v300: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.1 MiB/s wr, 399 op/s 2024-09-05T01:34:21.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:21 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:21.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:21 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:21.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:21 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:21.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:21 smithi151 ceph-mon[35013]: scrub queued for path: / 2024-09-05T01:34:21.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:21 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:21.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:21 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:21.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:21 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:21.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:21 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:21.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:21 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:21.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:21 smithi151 ceph-mon[35013]: pgmap v300: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.1 MiB/s wr, 399 op/s 2024-09-05T01:34:21.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:21 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:21.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:21 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:21.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:21 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:21.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.757+0000 7fed9e800640 1 -- 172.21.15.12:0/3050544776 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed98109d70 msgr2=0x7fed9810e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:21.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.757+0000 7fed9e800640 1 --2- 172.21.15.12:0/3050544776 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed98109d70 0x7fed9810e7f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fed84009900 tx=0x7fed8402a400 comp rx=0 tx=0).stop 2024-09-05T01:34:21.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.758+0000 7fed9e800640 1 -- 172.21.15.12:0/3050544776 shutdown_connections 2024-09-05T01:34:21.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.758+0000 7fed9e800640 1 --2- 172.21.15.12:0/3050544776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed98113350 0x7fed98115740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.758+0000 7fed9e800640 1 --2- 172.21.15.12:0/3050544776 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed98109d70 0x7fed9810e7f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.758+0000 7fed9e800640 1 --2- 172.21.15.12:0/3050544776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed98069ab0 0x7fed9810e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.758+0000 7fed9e800640 1 -- 172.21.15.12:0/3050544776 >> 172.21.15.12:0/3050544776 conn(0x7fed98073660 msgr2=0x7fed98073a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:21.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.758+0000 7fed9e800640 1 -- 172.21.15.12:0/3050544776 shutdown_connections 2024-09-05T01:34:21.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.758+0000 7fed9e800640 1 -- 172.21.15.12:0/3050544776 wait complete. 2024-09-05T01:34:21.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.759+0000 7fed9e800640 1 Processor -- start 2024-09-05T01:34:21.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.760+0000 7fed9e800640 1 -- start start 2024-09-05T01:34:21.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.760+0000 7fed9e800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed98069ab0 0x7fed981a6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:21.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.760+0000 7fed9e800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed98109d70 0x7fed981a6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:21.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.760+0000 7fed9e800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed98113350 0x7fed981a08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:21.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.760+0000 7fed9e800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fed9811a5f0 con 0x7fed98069ab0 2024-09-05T01:34:21.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.760+0000 7fed9e800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fed9811a470 con 0x7fed98109d70 2024-09-05T01:34:21.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.760+0000 7fed9e800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fed9811a770 con 0x7fed98113350 2024-09-05T01:34:21.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.761+0000 7fed9ca00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed98109d70 0x7fed981a6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:21.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.761+0000 7fed9ca00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed98109d70 0x7fed981a6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:32896/0 (socket says 172.21.15.12:32896) 2024-09-05T01:34:21.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.761+0000 7fed9ca00640 1 -- 172.21.15.12:0/3782536805 learned_addr learned my addr 172.21.15.12:0/3782536805 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:21.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.761+0000 7fed9d400640 1 --2- 172.21.15.12:0/3782536805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed98069ab0 0x7fed981a6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:21.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.761+0000 7fed9de00640 1 --2- 172.21.15.12:0/3782536805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed98113350 0x7fed981a08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:21.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.762+0000 7fed9ca00640 1 -- 172.21.15.12:0/3782536805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed98113350 msgr2=0x7fed981a08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:21.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.762+0000 7fed9ca00640 1 --2- 172.21.15.12:0/3782536805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed98113350 0x7fed981a08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.762+0000 7fed9ca00640 1 -- 172.21.15.12:0/3782536805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed98069ab0 msgr2=0x7fed981a6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:21.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.762+0000 7fed9ca00640 1 --2- 172.21.15.12:0/3782536805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed98069ab0 0x7fed981a6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.762+0000 7fed9ca00640 1 -- 172.21.15.12:0/3782536805 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed981a1010 con 0x7fed98109d70 2024-09-05T01:34:21.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.762+0000 7fed9ca00640 1 --2- 172.21.15.12:0/3782536805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed98109d70 0x7fed981a6c60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fed84006010 tx=0x7fed840042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:21.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.763+0000 7fed96000640 1 -- 172.21.15.12:0/3782536805 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8403f030 con 0x7fed98109d70 2024-09-05T01:34:21.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.763+0000 7fed96000640 1 -- 172.21.15.12:0/3782536805 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed84003ce0 con 0x7fed98109d70 2024-09-05T01:34:21.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.763+0000 7fed96000640 1 -- 172.21.15.12:0/3782536805 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed84035070 con 0x7fed98109d70 2024-09-05T01:34:21.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.763+0000 7fed9e800640 1 -- 172.21.15.12:0/3782536805 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed981a12a0 con 0x7fed98109d70 2024-09-05T01:34:21.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.763+0000 7fed9e800640 1 -- 172.21.15.12:0/3782536805 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed98116d90 con 0x7fed98109d70 2024-09-05T01:34:21.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.768+0000 7fed96000640 1 -- 172.21.15.12:0/3782536805 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fed84042030 con 0x7fed98109d70 2024-09-05T01:34:21.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.768+0000 7feda2a11740 1 Processor -- start 2024-09-05T01:34:21.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.769+0000 7feda2a11740 1 -- start start 2024-09-05T01:34:21.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.770+0000 7fed96000640 1 --2- 172.21.15.12:0/3782536805 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fed800a2d70 0x7fed800a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:21.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.770+0000 7fed96000640 1 -- 172.21.15.12:0/3782536805 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7fed840ef920 con 0x7fed98109d70 2024-09-05T01:34:21.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.770+0000 7fed9de00640 1 --2- 172.21.15.12:0/3782536805 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fed800a2d70 0x7fed800a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:21.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.771+0000 7feda2a11740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b4a35bd50 0x555b4a35c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:21.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.771+0000 7feda2a11740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a35c670 0x555b4a3669f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:21.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.772+0000 7feda2a11740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b4a366f30 0x555b4a369320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:21.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.772+0000 7feda2a11740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555b4a2c23e0 con 0x555b4a366f30 2024-09-05T01:34:21.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.772+0000 7feda2a11740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555b4a269d80 con 0x555b4a35c670 2024-09-05T01:34:21.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.772+0000 7feda2a11740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555b4a2be3a0 con 0x555b4a35bd50 2024-09-05T01:34:21.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.772+0000 7fed9de00640 1 --2- 172.21.15.12:0/3782536805 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fed800a2d70 0x7fed800a5230 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fed9806b4a0 tx=0x7fed90009500 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:21.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.772+0000 7fed9ca00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a35c670 0x555b4a3669f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:21.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.772+0000 7fed9ca00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a35c670 0x555b4a3669f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:32902/0 (socket says 172.21.15.12:32902) 2024-09-05T01:34:21.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.772+0000 7fed9ca00640 1 -- 172.21.15.12:0/585225720 learned_addr learned my addr 172.21.15.12:0/585225720 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:21.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.772+0000 7fed9de00640 1 --2- 172.21.15.12:0/585225720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b4a366f30 0x555b4a369320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:21.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.773+0000 7fed9ca00640 1 -- 172.21.15.12:0/585225720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b4a35bd50 msgr2=0x555b4a35c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:21.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.773+0000 7fed9ca00640 1 --2- 172.21.15.12:0/585225720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b4a35bd50 0x555b4a35c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.773+0000 7fed9ca00640 1 -- 172.21.15.12:0/585225720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b4a366f30 msgr2=0x555b4a369320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:21.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.773+0000 7fed9ca00640 1 --2- 172.21.15.12:0/585225720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b4a366f30 0x555b4a369320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.773+0000 7fed9ca00640 1 -- 172.21.15.12:0/585225720 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4a288ae0 con 0x555b4a35c670 2024-09-05T01:34:21.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.773+0000 7fed9de00640 1 --2- 172.21.15.12:0/585225720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b4a366f30 0x555b4a369320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:34:21.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.774+0000 7fed9ca00640 1 --2- 172.21.15.12:0/585225720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a35c670 0x555b4a3669f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fed840bbc10 tx=0x7fed84003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26b9845a205afb09 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:21.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.774+0000 7fed8a600640 1 -- 172.21.15.12:0/585225720 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed840d9070 con 0x555b4a35c670 2024-09-05T01:34:21.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.775+0000 7fed8a600640 1 -- 172.21.15.12:0/585225720 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed840bbf10 con 0x555b4a35c670 2024-09-05T01:34:21.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.775+0000 7fed8a600640 1 -- 172.21.15.12:0/585225720 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed84049040 con 0x555b4a35c670 2024-09-05T01:34:21.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.776+0000 7feda2a11740 1 -- 172.21.15.12:0/585225720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a35c670 msgr2=0x555b4a3669f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:21.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.776+0000 7feda2a11740 1 --2- 172.21.15.12:0/585225720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a35c670 0x555b4a3669f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fed840bbc10 tx=0x7fed84003f10 comp rx=0 tx=0).stop 2024-09-05T01:34:21.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.776+0000 7feda2a11740 1 -- 172.21.15.12:0/585225720 shutdown_connections 2024-09-05T01:34:21.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.776+0000 7feda2a11740 1 --2- 172.21.15.12:0/585225720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b4a366f30 0x555b4a369320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.776+0000 7feda2a11740 1 --2- 172.21.15.12:0/585225720 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a35c670 0x555b4a3669f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.776+0000 7feda2a11740 1 --2- 172.21.15.12:0/585225720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b4a35bd50 0x555b4a35c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.776+0000 7feda2a11740 1 -- 172.21.15.12:0/585225720 >> 172.21.15.12:0/585225720 conn(0x555b4a3582e0 msgr2=0x555b4a3586c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:21.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.777+0000 7feda2a11740 1 -- 172.21.15.12:0/585225720 shutdown_connections 2024-09-05T01:34:21.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.777+0000 7feda2a11740 1 -- 172.21.15.12:0/585225720 wait complete. 2024-09-05T01:34:21.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.777+0000 7feda2a11740 1 -- start start 2024-09-05T01:34:21.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.778+0000 7feda2a11740 1 Processor -- start 2024-09-05T01:34:21.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.779+0000 7feda2a11740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a35bd50 0x555b4a363e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:21.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.779+0000 7feda2a11740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b4a35c670 0x555b4a364340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:21.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.779+0000 7feda2a11740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b4a366f30 0x555b4a364880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:21.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.779+0000 7feda2a11740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555b4a3698c0 con 0x555b4a35c670 2024-09-05T01:34:21.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.779+0000 7feda2a11740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x555b4a27d0f0 con 0x555b4a35bd50 2024-09-05T01:34:21.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.779+0000 7feda2a11740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555b4a369a40 con 0x555b4a366f30 2024-09-05T01:34:21.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.779+0000 7feda2a11740 10 client.0 _ll_register_callbacks cb 0x555b4a26e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:34:21.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.780+0000 7fed9d400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a35bd50 0x555b4a363e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:21.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.780+0000 7fed9d400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a35bd50 0x555b4a363e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:32908/0 (socket says 172.21.15.12:32908) 2024-09-05T01:34:21.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.780+0000 7fed9d400640 1 -- 172.21.15.12:0/346533177 learned_addr learned my addr 172.21.15.12:0/346533177 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:21.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.780+0000 7fed9de00640 1 --2- 172.21.15.12:0/346533177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b4a366f30 0x555b4a364880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:21.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.780+0000 7fed9ca00640 1 --2- 172.21.15.12:0/346533177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b4a35c670 0x555b4a364340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:21.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.780+0000 7fed9d400640 1 -- 172.21.15.12:0/346533177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b4a366f30 msgr2=0x555b4a364880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:21.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.780+0000 7fed9d400640 1 --2- 172.21.15.12:0/346533177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b4a366f30 0x555b4a364880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.780+0000 7fed9d400640 1 -- 172.21.15.12:0/346533177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b4a35c670 msgr2=0x555b4a364340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:21.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.780+0000 7fed9d400640 1 --2- 172.21.15.12:0/346533177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b4a35c670 0x555b4a364340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.780+0000 7fed9d400640 1 -- 172.21.15.12:0/346533177 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b4a0333c0 con 0x555b4a35bd50 2024-09-05T01:34:21.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.780+0000 7fed9d400640 1 --2- 172.21.15.12:0/346533177 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a35bd50 0x555b4a363e00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00d560 tx=0x7fed8c00da20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=348e01b75bee1ec0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:21.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.780+0000 7fed7ea00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:34:21.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.780+0000 7fed9ca00640 1 --2- 172.21.15.12:0/346533177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b4a35c670 0x555b4a364340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:34:21.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.781+0000 7fed7ea00640 1 -- 172.21.15.12:0/346533177 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c01d060 con 0x555b4a35bd50 2024-09-05T01:34:21.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.781+0000 7fed7ea00640 1 -- 172.21.15.12:0/346533177 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7fed8c009790 con 0x555b4a35bd50 2024-09-05T01:34:21.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.781+0000 7feda2a11740 1 -- 172.21.15.12:0/346533177 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed840bbf10 con 0x555b4a35bd50 2024-09-05T01:34:21.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.782+0000 7fed7ea00640 1 -- 172.21.15.12:0/346533177 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fed8c004020 con 0x555b4a35bd50 2024-09-05T01:34:21.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.782+0000 7feda2a11740 10 client.26534 fetch_fsmap learned FSMap version 55 2024-09-05T01:34:21.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.782+0000 7feda2a11740 1 -- 172.21.15.12:0/346533177 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x555b4a37de40 con 0x555b4a35bd50 2024-09-05T01:34:21.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.782+0000 7fed7ea00640 1 -- 172.21.15.12:0/346533177 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed840bbf10 con 0x555b4a35bd50 2024-09-05T01:34:21.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.783+0000 7fed7ea00640 1 -- 172.21.15.12:0/346533177 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 55) ==== 8426+0+0 (secure 0 0 0) 0x7fed8c003770 con 0x555b4a35bd50 2024-09-05T01:34:21.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.783+0000 7feda2a11740 10 client.26534 fetch_fsmap finished waiting for FSMap version 55 2024-09-05T01:34:21.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.783+0000 7feda2a11740 10 client.26534 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:34:21.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.783+0000 7feda2a11740 20 client.26534 populate_metadata read hostname 'smithi012' 2024-09-05T01:34:21.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.783+0000 7feda2a11740 1 --2- 172.21.15.12:0/346533177 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x555b4a37f300 0x555b4a381730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:21.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.783+0000 7feda2a11740 4 client.26534 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:34:21.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.783+0000 7feda2a11740 1 -- 172.21.15.12:0/346533177 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b4a2cf950 con 0x555b4a37f300 2024-09-05T01:34:21.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.784+0000 7fed9ca00640 1 --2- 172.21.15.12:0/346533177 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x555b4a37f300 0x555b4a381730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:21.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.785+0000 7fed9ca00640 1 --2- 172.21.15.12:0/346533177 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x555b4a37f300 0x555b4a381730 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=527e09ead7837a25 server_cookie=13f9f1492cb8703e in_seq=0 out_seq=0 2024-09-05T01:34:21.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.785+0000 7fed7ea00640 10 client.26534 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:34:21.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.786+0000 7fed7ea00640 1 -- 172.21.15.12:0/346533177 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555b4a2cf950 con 0x555b4a37f300 2024-09-05T01:34:21.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.786+0000 7fed7ea00640 10 client.26534 handle_command_reply: tid=0 2024-09-05T01:34:21.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.786+0000 7feda2a11740 1 client.26534 shutdown 2024-09-05T01:34:21.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.787+0000 7feda2a11740 1 -- 172.21.15.12:0/346533177 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a35bd50 msgr2=0x555b4a363e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:21.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.787+0000 7feda2a11740 1 --2- 172.21.15.12:0/346533177 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a35bd50 0x555b4a363e00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00d560 tx=0x7fed8c00da20 comp rx=0 tx=0).stop 2024-09-05T01:34:21.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.787+0000 7feda2a11740 1 -- 172.21.15.12:0/346533177 shutdown_connections 2024-09-05T01:34:21.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.787+0000 7feda2a11740 1 --2- 172.21.15.12:0/346533177 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x555b4a37f300 0x555b4a381730 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.787+0000 7feda2a11740 1 --2- 172.21.15.12:0/346533177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b4a366f30 0x555b4a364880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.787+0000 7feda2a11740 1 --2- 172.21.15.12:0/346533177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b4a35c670 0x555b4a364340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.787+0000 7feda2a11740 1 --2- 172.21.15.12:0/346533177 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a35bd50 0x555b4a363e00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.787+0000 7feda2a11740 1 -- 172.21.15.12:0/346533177 >> 172.21.15.12:0/346533177 conn(0x555b4a3582e0 msgr2=0x555b4a35dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:21.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.787+0000 7fed7ea00640 0 client.26534 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:34:21.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.788+0000 7feda2a11740 1 -- 172.21.15.12:0/346533177 shutdown_connections 2024-09-05T01:34:21.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.788+0000 7feda2a11740 1 -- 172.21.15.12:0/346533177 wait complete. 2024-09-05T01:34:21.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.788+0000 7feda2a11740 20 client.26534 trim_cache size 0 max 16384 2024-09-05T01:34:21.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.818+0000 7feda2a11740 1 Processor -- start 2024-09-05T01:34:21.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.818+0000 7feda2a11740 1 -- start start 2024-09-05T01:34:21.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.819+0000 7feda2a11740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a35c670 0x555b4a3646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:21.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.819+0000 7feda2a11740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b4a366f30 0x555b4a372250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:21.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.819+0000 7feda2a11740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b4a365e80 0x555b4a372790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:21.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.819+0000 7feda2a11740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fed981b3f20 con 0x555b4a366f30 2024-09-05T01:34:21.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.819+0000 7feda2a11740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fed981b5be0 con 0x555b4a35c670 2024-09-05T01:34:21.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.819+0000 7feda2a11740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fed981b45f0 con 0x555b4a365e80 2024-09-05T01:34:21.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.819+0000 7fed9d400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a35c670 0x555b4a3646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:21.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.819+0000 7fed9ca00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b4a366f30 0x555b4a372250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:21.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.819+0000 7fed9d400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a35c670 0x555b4a3646a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:32920/0 (socket says 172.21.15.12:32920) 2024-09-05T01:34:21.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.819+0000 7fed9d400640 1 -- 172.21.15.12:0/2748519166 learned_addr learned my addr 172.21.15.12:0/2748519166 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:21.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.819+0000 7fed9de00640 1 --2- 172.21.15.12:0/2748519166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b4a365e80 0x555b4a372790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:21.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.820+0000 7fed9ca00640 1 -- 172.21.15.12:0/2748519166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b4a365e80 msgr2=0x555b4a372790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:21.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.820+0000 7fed9ca00640 1 --2- 172.21.15.12:0/2748519166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b4a365e80 0x555b4a372790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.820+0000 7fed9ca00640 1 -- 172.21.15.12:0/2748519166 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a35c670 msgr2=0x555b4a3646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:21.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.820+0000 7fed9ca00640 1 --2- 172.21.15.12:0/2748519166 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a35c670 0x555b4a3646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.820+0000 7fed9ca00640 1 -- 172.21.15.12:0/2748519166 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4a357d80 con 0x555b4a366f30 2024-09-05T01:34:21.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.820+0000 7fed9d400640 1 --2- 172.21.15.12:0/2748519166 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a35c670 0x555b4a3646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:34:21.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.820+0000 7fed9ca00640 1 --2- 172.21.15.12:0/2748519166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b4a366f30 0x555b4a372250 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fed84000c00 tx=0x7fed8402a400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89903b8c9265e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:21.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.821+0000 7fed89c00640 1 -- 172.21.15.12:0/2748519166 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed840d9070 con 0x555b4a366f30 2024-09-05T01:34:21.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.821+0000 7fed89c00640 1 -- 172.21.15.12:0/2748519166 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed840c0210 con 0x555b4a366f30 2024-09-05T01:34:21.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.821+0000 7fed89c00640 1 -- 172.21.15.12:0/2748519166 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed84049040 con 0x555b4a366f30 2024-09-05T01:34:21.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.822+0000 7feda2a11740 1 -- 172.21.15.12:0/2748519166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b4a366f30 msgr2=0x555b4a372250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:21.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.822+0000 7feda2a11740 1 --2- 172.21.15.12:0/2748519166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b4a366f30 0x555b4a372250 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fed84000c00 tx=0x7fed8402a400 comp rx=0 tx=0).stop 2024-09-05T01:34:21.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.822+0000 7feda2a11740 1 -- 172.21.15.12:0/2748519166 shutdown_connections 2024-09-05T01:34:21.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.822+0000 7feda2a11740 1 --2- 172.21.15.12:0/2748519166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b4a365e80 0x555b4a372790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.822+0000 7feda2a11740 1 --2- 172.21.15.12:0/2748519166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b4a366f30 0x555b4a372250 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.822+0000 7feda2a11740 1 --2- 172.21.15.12:0/2748519166 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a35c670 0x555b4a3646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.822+0000 7feda2a11740 1 -- 172.21.15.12:0/2748519166 >> 172.21.15.12:0/2748519166 conn(0x555b4a3582e0 msgr2=0x555b4a371b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:21.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.823+0000 7feda2a11740 1 -- 172.21.15.12:0/2748519166 shutdown_connections 2024-09-05T01:34:21.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.823+0000 7feda2a11740 1 -- 172.21.15.12:0/2748519166 wait complete. 2024-09-05T01:34:21.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.823+0000 7feda2a11740 1 -- start start 2024-09-05T01:34:21.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.823+0000 7feda2a11740 1 Processor -- start 2024-09-05T01:34:21.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.824+0000 7feda2a11740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b4a35c670 0x555b4a36ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:21.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.824+0000 7feda2a11740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b4a365e80 0x555b4a36b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:21.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.824+0000 7feda2a11740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a366f30 0x555b4a3e9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:21.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.824+0000 7feda2a11740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fed981b5450 con 0x555b4a35c670 2024-09-05T01:34:21.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.824+0000 7feda2a11740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fed981b4cc0 con 0x555b4a366f30 2024-09-05T01:34:21.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.824+0000 7feda2a11740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fed981b1f20 con 0x555b4a365e80 2024-09-05T01:34:21.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.824+0000 7fed9de00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a366f30 0x555b4a3e9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:21.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.824+0000 7fed9de00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a366f30 0x555b4a3e9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:32930/0 (socket says 172.21.15.12:32930) 2024-09-05T01:34:21.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.824+0000 7fed9de00640 1 -- 172.21.15.12:0/3019747505 learned_addr learned my addr 172.21.15.12:0/3019747505 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:21.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.824+0000 7fed9ca00640 1 --2- 172.21.15.12:0/3019747505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b4a365e80 0x555b4a36b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:21.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.825+0000 7feda2a11740 10 client.0 _ll_register_callbacks cb 0x7fed8c00feb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:34:21.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.825+0000 7fed9d400640 1 --2- 172.21.15.12:0/3019747505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b4a35c670 0x555b4a36ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:21.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.825+0000 7fed9de00640 1 -- 172.21.15.12:0/3019747505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b4a365e80 msgr2=0x555b4a36b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:21.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.825+0000 7fed9de00640 1 --2- 172.21.15.12:0/3019747505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b4a365e80 0x555b4a36b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.825+0000 7fed9de00640 1 -- 172.21.15.12:0/3019747505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b4a35c670 msgr2=0x555b4a36ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:21.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.825+0000 7fed9de00640 1 --2- 172.21.15.12:0/3019747505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b4a35c670 0x555b4a36ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.825+0000 7fed9de00640 1 -- 172.21.15.12:0/3019747505 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b4a3e9550 con 0x555b4a366f30 2024-09-05T01:34:21.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.826+0000 7fed9de00640 1 --2- 172.21.15.12:0/3019747505 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a366f30 0x555b4a3e9010 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fed90004300 tx=0x7fed90004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96cf17bb910434ef server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:21.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.826+0000 7fed7ea00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:34:21.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.826+0000 7fed7ea00640 1 -- 172.21.15.12:0/3019747505 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9002c060 con 0x555b4a366f30 2024-09-05T01:34:21.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.826+0000 7fed7ea00640 1 -- 172.21.15.12:0/3019747505 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7fed9001ad50 con 0x555b4a366f30 2024-09-05T01:34:21.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.826+0000 7feda2a11740 1 -- 172.21.15.12:0/3019747505 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed840c0210 con 0x555b4a366f30 2024-09-05T01:34:21.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.827+0000 7fed7ea00640 1 -- 172.21.15.12:0/3019747505 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fed90027470 con 0x555b4a366f30 2024-09-05T01:34:21.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.827+0000 7feda2a11740 10 client.26540 fetch_fsmap learned FSMap version 55 2024-09-05T01:34:21.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.827+0000 7feda2a11740 1 -- 172.21.15.12:0/3019747505 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x555b4a3ea760 con 0x555b4a366f30 2024-09-05T01:34:21.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.827+0000 7fed7ea00640 1 -- 172.21.15.12:0/3019747505 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed840c0210 con 0x555b4a366f30 2024-09-05T01:34:21.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.827+0000 7fed7ea00640 1 -- 172.21.15.12:0/3019747505 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 55) ==== 8426+0+0 (secure 0 0 0) 0x7fed90018040 con 0x555b4a366f30 2024-09-05T01:34:21.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.827+0000 7feda2a11740 10 client.26540 fetch_fsmap finished waiting for FSMap version 55 2024-09-05T01:34:21.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.827+0000 7feda2a11740 10 client.26540 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:34:21.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.827+0000 7feda2a11740 20 client.26540 populate_metadata read hostname 'smithi012' 2024-09-05T01:34:21.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.827+0000 7feda2a11740 1 --2- 172.21.15.12:0/3019747505 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x555b4a3eaf80 0x555b4a3ed3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:21.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.827+0000 7feda2a11740 4 client.26540 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T01:34:21.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.827+0000 7feda2a11740 1 -- 172.21.15.12:0/3019747505 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555b4a2c9e60 con 0x555b4a3eaf80 2024-09-05T01:34:21.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.828+0000 7fed9d400640 1 --2- 172.21.15.12:0/3019747505 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x555b4a3eaf80 0x555b4a3ed3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:21.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.829+0000 7fed9d400640 1 --2- 172.21.15.12:0/3019747505 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x555b4a3eaf80 0x555b4a3ed3a0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=803d55fc74bd1ded server_cookie=101e1c5391333cd2 in_seq=0 out_seq=0 2024-09-05T01:34:21.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.829+0000 7fed7ea00640 10 client.26540 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:34:21.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.830+0000 7fed7ea00640 1 -- 172.21.15.12:0/3019747505 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+269 (crc 0 0 0) 0x555b4a2c9e60 con 0x555b4a3eaf80 2024-09-05T01:34:21.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.830+0000 7fed7ea00640 10 client.26540 handle_command_reply: tid=0 2024-09-05T01:34:21.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.830+0000 7feda2a11740 1 client.26540 shutdown 2024-09-05T01:34:21.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.830+0000 7feda2a11740 1 -- 172.21.15.12:0/3019747505 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a366f30 msgr2=0x555b4a3e9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:21.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.830+0000 7feda2a11740 1 --2- 172.21.15.12:0/3019747505 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a366f30 0x555b4a3e9010 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fed90004300 tx=0x7fed90004ab0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.830+0000 7feda2a11740 1 -- 172.21.15.12:0/3019747505 shutdown_connections 2024-09-05T01:34:21.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.830+0000 7feda2a11740 1 --2- 172.21.15.12:0/3019747505 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x555b4a3eaf80 0x555b4a3ed3a0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.830+0000 7feda2a11740 1 --2- 172.21.15.12:0/3019747505 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x555b4a366f30 0x555b4a3e9010 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.830+0000 7feda2a11740 1 --2- 172.21.15.12:0/3019747505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b4a365e80 0x555b4a36b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.830+0000 7feda2a11740 1 --2- 172.21.15.12:0/3019747505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555b4a35c670 0x555b4a36ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.830+0000 7feda2a11740 1 -- 172.21.15.12:0/3019747505 >> 172.21.15.12:0/3019747505 conn(0x555b4a3582e0 msgr2=0x555b4a371b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:21.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.830+0000 7fed7ea00640 0 client.26540 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:34:21.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.831+0000 7feda2a11740 1 -- 172.21.15.12:0/3019747505 shutdown_connections 2024-09-05T01:34:21.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.832+0000 7feda2a11740 1 -- 172.21.15.12:0/3019747505 wait complete. 2024-09-05T01:34:21.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.832+0000 7feda2a11740 20 client.26540 trim_cache size 0 max 16384 2024-09-05T01:34:21.832 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:34:21.832 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "scrub active (12641 inodes in the stack)", 2024-09-05T01:34:21.833 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-05T01:34:21.833 INFO:teuthology.orchestra.run.smithi012.stdout: "742bf79e-330a-493d-be5d-2608da7e4fb0": { 2024-09-05T01:34:21.833 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-05T01:34:21.833 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "742bf79e-330a-493d-be5d-2608da7e4fb0", 2024-09-05T01:34:21.833 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-05T01:34:21.833 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:34:21.833 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:34:21.833 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:34:21.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.833+0000 7fed9e800640 1 -- 172.21.15.12:0/3782536805 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fed800a2d70 msgr2=0x7fed800a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:21.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.833+0000 7fed9e800640 1 --2- 172.21.15.12:0/3782536805 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fed800a2d70 0x7fed800a5230 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fed9806b4a0 tx=0x7fed90009500 comp rx=0 tx=0).stop 2024-09-05T01:34:21.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.833+0000 7fed9e800640 1 -- 172.21.15.12:0/3782536805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed98109d70 msgr2=0x7fed981a6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:21.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.833+0000 7fed9e800640 1 --2- 172.21.15.12:0/3782536805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed98109d70 0x7fed981a6c60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fed84006010 tx=0x7fed840042f0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.833+0000 7fed9e800640 1 -- 172.21.15.12:0/3782536805 shutdown_connections 2024-09-05T01:34:21.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.833+0000 7fed9e800640 1 --2- 172.21.15.12:0/3782536805 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fed800a2d70 0x7fed800a5230 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.833+0000 7fed9e800640 1 --2- 172.21.15.12:0/3782536805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed98113350 0x7fed981a08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.833+0000 7fed9e800640 1 --2- 172.21.15.12:0/3782536805 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fed98109d70 0x7fed981a6c60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.833+0000 7fed9e800640 1 --2- 172.21.15.12:0/3782536805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fed98069ab0 0x7fed981a6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:21.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.833+0000 7fed9e800640 1 -- 172.21.15.12:0/3782536805 >> 172.21.15.12:0/3782536805 conn(0x7fed98073660 msgr2=0x7fed9810a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:21.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.834+0000 7fed9e800640 1 -- 172.21.15.12:0/3782536805 shutdown_connections 2024-09-05T01:34:21.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:21.834+0000 7fed9e800640 1 -- 172.21.15.12:0/3782536805 wait complete. 2024-09-05T01:34:22.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:22 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:22.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:22 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:22.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:22 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:22.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:22 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:22.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:22 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:22.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:22 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:22.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:22 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:22.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:22 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:22.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:22 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:22.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:22 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:22.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:22 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:22.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:22 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:22.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:22 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:22.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:22 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:22.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:22 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:22.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:22 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:22.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:22 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:22.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:22 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:22 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:22 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:22 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:22 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:22.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:22 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:22.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:22 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:22.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:22 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:22.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:22 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:22.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:22 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:22.832 INFO:tasks.cephfs.filesystem:scrub status for tag:742bf79e-330a-493d-be5d-2608da7e4fb0 - {'path': '/', 'tag': '742bf79e-330a-493d-be5d-2608da7e4fb0', 'options': 'recursive,force'} 2024-09-05T01:34:23.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:23 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:23.558 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:23 smithi012 ceph-mon[29942]: pgmap v301: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.1 MiB/s wr, 391 op/s 2024-09-05T01:34:23.558 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:23 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:23.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:23 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:23.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:23 smithi145 ceph-mon[34376]: pgmap v301: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.1 MiB/s wr, 391 op/s 2024-09-05T01:34:23.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:23 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:23 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:23 smithi151 ceph-mon[35013]: pgmap v301: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.1 MiB/s wr, 391 op/s 2024-09-05T01:34:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:23 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:24.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:24 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:24.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:24 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:24.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:24 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:24.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:24 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:24.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:24 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:24.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:24 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:24.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:24 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:24.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:24 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:24.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:24 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:25.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:25 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:25.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:25 smithi012 ceph-mon[29942]: pgmap v302: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.3 MiB/s wr, 414 op/s 2024-09-05T01:34:25.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:25 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:25.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:25 smithi145 ceph-mon[34376]: pgmap v302: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.3 MiB/s wr, 414 op/s 2024-09-05T01:34:25.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:25 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:25.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:25 smithi151 ceph-mon[35013]: pgmap v302: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.3 MiB/s wr, 414 op/s 2024-09-05T01:34:27.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:27 smithi012 ceph-mon[29942]: pgmap v303: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 275 op/s 2024-09-05T01:34:27.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:27 smithi145 ceph-mon[34376]: pgmap v303: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 275 op/s 2024-09-05T01:34:27.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:27 smithi151 ceph-mon[35013]: pgmap v303: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 275 op/s 2024-09-05T01:34:29.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:29 smithi012 ceph-mon[29942]: pgmap v304: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 279 op/s 2024-09-05T01:34:29.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:29 smithi145 ceph-mon[34376]: pgmap v304: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 279 op/s 2024-09-05T01:34:29.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:29 smithi151 ceph-mon[35013]: pgmap v304: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 279 op/s 2024-09-05T01:34:31.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: pgmap v305: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.1 MiB/s wr, 271 op/s 2024-09-05T01:34:31.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:31.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:31.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:31.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:31.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:31.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:31.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:31.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:31.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:31.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:31.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:31.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:31.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:31.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:31.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:31.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:31.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:31.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:31.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:31 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:31.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: pgmap v305: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.1 MiB/s wr, 271 op/s 2024-09-05T01:34:31.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:31.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:31.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:31.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:31.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:31.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:31.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:31.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:31.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:31.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:31.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:31.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:31.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:31.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:31.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:31.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:31.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:31.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:31.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:31 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:31.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: pgmap v305: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.1 MiB/s wr, 271 op/s 2024-09-05T01:34:31.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:31.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:31.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:31.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:31.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:31.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:31.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:31.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:31.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:31.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:31.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:31.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:31.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:31.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:31.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:31.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:31.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:31.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:31.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:31.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:31 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.504 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.521 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.552 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.552 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.552 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.552 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.552 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.552 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.552 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.552 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.552 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.552 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.552 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.552 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:32 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:32.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.611 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.611 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.611 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.611 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.611 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.611 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.611 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.611 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.611 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.611 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.611 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.611 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.611 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.611 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.617 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.617 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.617 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.617 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.617 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.617 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.617 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.617 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.617 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.617 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.617 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.617 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.618 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.618 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.618 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.618 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.618 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.618 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.618 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.618 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.618 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.618 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.618 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.618 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.618 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.621 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.621 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.622 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.622 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.622 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.622 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.622 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.622 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.622 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.622 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.622 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.625 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.625 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.625 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.625 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.625 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.625 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.625 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.625 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.625 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.625 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.625 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.625 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.625 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.625 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.631 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.631 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.631 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.631 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.631 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.631 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.631 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.631 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.631 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.631 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.631 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.631 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.631 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:32 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:32.633 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.633 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.633 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.633 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.633 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.633 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.633 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.633 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.633 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.633 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.633 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.633 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.635 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.635 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.635 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.635 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.635 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.635 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.635 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.635 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.635 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.635 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.635 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.635 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.635 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.635 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:32.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:32.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:32 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:33.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:33.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:33.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:33.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:33.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:33.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:33.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:33.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:33.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:33.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:33.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:33.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:33.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:33 smithi012 ceph-mon[29942]: pgmap v306: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 131 op/s 2024-09-05T01:34:33.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:33.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:33.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:33.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:33.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:33.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:33.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:33.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:33.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:33.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:33.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:33.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:33.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:33 smithi145 ceph-mon[34376]: pgmap v306: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 131 op/s 2024-09-05T01:34:33.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:33.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:33.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:33.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:33.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:33.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:33.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:33.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:33.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:33.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:33.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:33.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:33.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:33.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:33 smithi151 ceph-mon[35013]: pgmap v306: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 131 op/s 2024-09-05T01:34:34.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.317 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.317 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.317 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.317 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.317 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.317 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.317 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.317 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.317 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.318 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.318 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.318 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.318 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.318 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.318 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.318 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.318 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.318 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.318 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.318 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.318 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.318 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.319 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.319 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.319 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.319 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.319 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.319 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.319 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.319 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.319 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.319 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.319 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.319 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.319 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:34.320 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:34 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:34.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:34 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:34.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:34.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:34 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: pgmap v307: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.1 MiB/s wr, 284 op/s 2024-09-05T01:34:35.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:35.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:35 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: pgmap v307: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.1 MiB/s wr, 284 op/s 2024-09-05T01:34:35.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:35.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:35 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: pgmap v307: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.1 MiB/s wr, 284 op/s 2024-09-05T01:34:35.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:35.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:35.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:35 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:36.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:36 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:36.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:36 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:36.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:36.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:36 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.191 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.192 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.192 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.192 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.192 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.192 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.192 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.192 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.192 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.192 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.192 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.192 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.192 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.193 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.193 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.193 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.193 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.193 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.193 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.193 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.193 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.193 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.193 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.193 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.193 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: pgmap v308: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.6 MiB/s wr, 216 op/s 2024-09-05T01:34:37.193 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.194 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.194 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.194 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.194 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.194 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.194 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.194 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.194 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.194 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.194 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.194 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.194 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.194 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.195 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.195 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.195 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.195 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.195 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.195 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.195 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.195 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.195 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.195 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.195 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.195 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.195 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: pgmap v308: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.6 MiB/s wr, 216 op/s 2024-09-05T01:34:37.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:37 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:37.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: pgmap v308: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.6 MiB/s wr, 216 op/s 2024-09-05T01:34:37.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.587 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.588 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.589 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.590 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.591 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.592 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.593 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.594 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.595 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.596 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.597 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.598 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.599 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:37 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:37.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:37.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:37.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:37 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:38.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:38 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:38.314 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:38 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:38 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:38.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:38 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:38 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:38.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:38 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:38 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:38.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:38 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:38 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:38.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:38 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:38 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:38.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:38 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:38 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:38.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:38 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:38 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:38.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:38 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:38 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:38 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:34:38.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:38 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.316 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:38 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:38 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:38.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:38 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:38 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:38.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:38 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:38 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:38.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:38 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:38 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:38.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:38 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:38 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:38.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:38 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:38 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:38.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:38 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:38 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:38.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:38 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:38 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:38.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:38 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:38 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:38 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:34:38.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:38 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:38 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:38 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:38.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:38 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:38 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:38.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:38 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:38 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:38.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:38 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:38 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:38.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:38 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:38 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:38.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:38 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:38 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:38.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:38 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:38 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:38.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:38 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:38 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:38.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:38 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:38 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:38 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:34:38.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:38 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:38.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:38 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:34:39.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:39 smithi012 ceph-mon[29942]: pgmap v309: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.5 MiB/s wr, 264 op/s 2024-09-05T01:34:39.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:39 smithi145 ceph-mon[34376]: pgmap v309: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.5 MiB/s wr, 264 op/s 2024-09-05T01:34:39.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:39 smithi151 ceph-mon[35013]: pgmap v309: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.5 MiB/s wr, 264 op/s 2024-09-05T01:34:41.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:41 smithi012 ceph-mon[29942]: pgmap v310: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.0 MiB/s wr, 430 op/s 2024-09-05T01:34:41.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:41 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:34:41.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:41 smithi145 ceph-mon[34376]: pgmap v310: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.0 MiB/s wr, 430 op/s 2024-09-05T01:34:41.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:41 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:34:41.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:41 smithi151 ceph-mon[35013]: pgmap v310: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.0 MiB/s wr, 430 op/s 2024-09-05T01:34:41.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:41 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:34:43.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:43 smithi012 ceph-mon[29942]: pgmap v311: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 439 op/s 2024-09-05T01:34:43.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:43 smithi145 ceph-mon[34376]: pgmap v311: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 439 op/s 2024-09-05T01:34:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:43 smithi151 ceph-mon[35013]: pgmap v311: 97 pgs: 97 active+clean; 3.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 439 op/s 2024-09-05T01:34:45.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:45 smithi012 ceph-mon[29942]: pgmap v312: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 715 op/s 2024-09-05T01:34:45.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:45 smithi145 ceph-mon[34376]: pgmap v312: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 715 op/s 2024-09-05T01:34:45.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:45 smithi151 ceph-mon[35013]: pgmap v312: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 715 op/s 2024-09-05T01:34:47.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:47 smithi012 ceph-mon[29942]: pgmap v313: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 587 op/s 2024-09-05T01:34:47.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:47 smithi145 ceph-mon[34376]: pgmap v313: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 587 op/s 2024-09-05T01:34:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:47 smithi151 ceph-mon[35013]: pgmap v313: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 587 op/s 2024-09-05T01:34:48.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:48 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:34:48.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:48 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:34:48.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:48 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:34:48.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:48 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:34:48.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:48 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:34:48.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:48 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:34:48.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:48 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:34:48.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:48 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:34:48.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:48 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:34:48.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:48 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:34:48.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:48 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:34:48.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:48 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:34:48.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:48 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:34:48.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:48 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:34:48.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:48 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:34:49.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:49 smithi012 ceph-mon[29942]: pgmap v314: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 606 op/s 2024-09-05T01:34:49.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:49 smithi145 ceph-mon[34376]: pgmap v314: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 606 op/s 2024-09-05T01:34:49.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:49 smithi151 ceph-mon[35013]: pgmap v314: 97 pgs: 97 active+clean; 3.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 606 op/s 2024-09-05T01:34:51.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:51 smithi012 ceph-mon[29942]: pgmap v315: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 667 op/s 2024-09-05T01:34:51.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:51 smithi145 ceph-mon[34376]: pgmap v315: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 667 op/s 2024-09-05T01:34:51.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:51 smithi151 ceph-mon[35013]: pgmap v315: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 667 op/s 2024-09-05T01:34:52.833 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T01:34:53.260 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:34:53.499 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:53 smithi012 ceph-mon[29942]: pgmap v316: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 508 op/s 2024-09-05T01:34:53.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:53 smithi145 ceph-mon[34376]: pgmap v316: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 508 op/s 2024-09-05T01:34:53.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:53 smithi151 ceph-mon[35013]: pgmap v316: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 508 op/s 2024-09-05T01:34:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.798+0000 7f71b9800640 1 -- 172.21.15.12:0/588850220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71b4103e30 msgr2=0x7f71b4104210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.798+0000 7f71b9800640 1 --2- 172.21.15.12:0/588850220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71b4103e30 0x7f71b4104210 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009900 tx=0x7f71a402a3f0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.798+0000 7f71b9800640 1 -- 172.21.15.12:0/588850220 shutdown_connections 2024-09-05T01:34:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.798+0000 7f71b9800640 1 --2- 172.21.15.12:0/588850220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71b4108f60 0x7f71b4110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.798+0000 7f71b9800640 1 --2- 172.21.15.12:0/588850220 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71b41047e0 0x7f71b4108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.798+0000 7f71b9800640 1 --2- 172.21.15.12:0/588850220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71b4103e30 0x7f71b4104210 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.798+0000 7f71b9800640 1 -- 172.21.15.12:0/588850220 >> 172.21.15.12:0/588850220 conn(0x7f71b40ff8d0 msgr2=0x7f71b4101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.798+0000 7f71b9800640 1 -- 172.21.15.12:0/588850220 shutdown_connections 2024-09-05T01:34:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.798+0000 7f71b9800640 1 -- 172.21.15.12:0/588850220 wait complete. 2024-09-05T01:34:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.799+0000 7f71b9800640 1 Processor -- start 2024-09-05T01:34:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.800+0000 7f71b9800640 1 -- start start 2024-09-05T01:34:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.800+0000 7f71b9800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71b4103e30 0x7f71b419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.800+0000 7f71b9800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71b41047e0 0x7f71b419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.800+0000 7f71b9800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71b4108f60 0x7f71b419ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.800+0000 7f71b9800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f71b4114010 con 0x7f71b4108f60 2024-09-05T01:34:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.800+0000 7f71b9800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f71b4113e90 con 0x7f71b41047e0 2024-09-05T01:34:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.800+0000 7f71b9800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f71b4114190 con 0x7f71b4103e30 2024-09-05T01:34:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.800+0000 7f71b3e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71b4103e30 0x7f71b419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.800+0000 7f71b3e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71b4103e30 0x7f71b419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:43818/0 (socket says 172.21.15.12:43818) 2024-09-05T01:34:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.800+0000 7f71b3e00640 1 -- 172.21.15.12:0/1399435588 learned_addr learned my addr 172.21.15.12:0/1399435588 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:53.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.800+0000 7f71b3400640 1 --2- 172.21.15.12:0/1399435588 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71b41047e0 0x7f71b419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:53.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.800+0000 7f71b8e00640 1 --2- 172.21.15.12:0/1399435588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71b4108f60 0x7f71b419ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:53.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.801+0000 7f71b3e00640 1 -- 172.21.15.12:0/1399435588 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71b41047e0 msgr2=0x7f71b419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:53.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.801+0000 7f71b3e00640 1 --2- 172.21.15.12:0/1399435588 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71b41047e0 0x7f71b419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.801+0000 7f71b3e00640 1 -- 172.21.15.12:0/1399435588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71b4108f60 msgr2=0x7f71b419ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:53.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.801+0000 7f71b3e00640 1 --2- 172.21.15.12:0/1399435588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71b4108f60 0x7f71b419ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.801+0000 7f71b3e00640 1 -- 172.21.15.12:0/1399435588 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b419f440 con 0x7f71b4103e30 2024-09-05T01:34:53.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.801+0000 7f71b8e00640 1 --2- 172.21.15.12:0/1399435588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71b4108f60 0x7f71b419ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:34:53.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.801+0000 7f71b3e00640 1 --2- 172.21.15.12:0/1399435588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71b4103e30 0x7f71b419a490 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f71a4004770 tx=0x7f71a4003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:53.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.801+0000 7f71b0c00640 1 -- 172.21.15.12:0/1399435588 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a403f070 con 0x7f71b4103e30 2024-09-05T01:34:53.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.801+0000 7f71b0c00640 1 -- 172.21.15.12:0/1399435588 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71a4031ca0 con 0x7f71b4103e30 2024-09-05T01:34:53.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.801+0000 7f71b9800640 1 -- 172.21.15.12:0/1399435588 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71b419f6d0 con 0x7f71b4103e30 2024-09-05T01:34:53.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.801+0000 7f71b0c00640 1 -- 172.21.15.12:0/1399435588 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a4035030 con 0x7f71b4103e30 2024-09-05T01:34:53.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.802+0000 7f71b9800640 1 -- 172.21.15.12:0/1399435588 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71b41a7010 con 0x7f71b4103e30 2024-09-05T01:34:53.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.804+0000 7f71bda28740 1 Processor -- start 2024-09-05T01:34:53.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.805+0000 7f71bda28740 1 -- start start 2024-09-05T01:34:53.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.805+0000 7f71b0c00640 1 -- 172.21.15.12:0/1399435588 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f71a4042070 con 0x7f71b4103e30 2024-09-05T01:34:53.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.805+0000 7f71bda28740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ef91f7d50 0x560ef91f8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:53.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.805+0000 7f71bda28740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560ef91f8670 0x560ef92029f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:53.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.805+0000 7f71bda28740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef9202f30 0x560ef9205320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:53.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.805+0000 7f71bda28740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560ef915e3e0 con 0x560ef91f7d50 2024-09-05T01:34:53.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.805+0000 7f71bda28740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x560ef9105d80 con 0x560ef91f8670 2024-09-05T01:34:53.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.805+0000 7f71bda28740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560ef915a3a0 con 0x560ef9202f30 2024-09-05T01:34:53.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.805+0000 7f71b3e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560ef91f8670 0x560ef92029f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:53.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.806+0000 7f71b3400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef9202f30 0x560ef9205320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:53.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.806+0000 7f71b3e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560ef91f8670 0x560ef92029f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:48926/0 (socket says 172.21.15.12:48926) 2024-09-05T01:34:53.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.806+0000 7f71b3e00640 1 -- 172.21.15.12:0/3044009938 learned_addr learned my addr 172.21.15.12:0/3044009938 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:53.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.806+0000 7f71b8e00640 1 --2- 172.21.15.12:0/3044009938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ef91f7d50 0x560ef91f8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:53.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.806+0000 7f71b3400640 1 -- 172.21.15.12:0/3044009938 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560ef91f8670 msgr2=0x560ef92029f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:53.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.806+0000 7f71b3400640 1 --2- 172.21.15.12:0/3044009938 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560ef91f8670 0x560ef92029f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.806+0000 7f71b3400640 1 -- 172.21.15.12:0/3044009938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ef91f7d50 msgr2=0x560ef91f8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:53.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.806+0000 7f71b3400640 1 --2- 172.21.15.12:0/3044009938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ef91f7d50 0x560ef91f8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.806+0000 7f71b3400640 1 -- 172.21.15.12:0/3044009938 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ef9124ae0 con 0x560ef9202f30 2024-09-05T01:34:53.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.806+0000 7f71b3400640 1 --2- 172.21.15.12:0/3044009938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef9202f30 0x560ef9205320 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009bd0 tx=0x7f71a0011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b532a366ca43b7d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:53.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.807+0000 7f71a9600640 1 -- 172.21.15.12:0/3044009938 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a0004230 con 0x560ef9202f30 2024-09-05T01:34:53.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.807+0000 7f71a9600640 1 -- 172.21.15.12:0/3044009938 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71a0009e40 con 0x560ef9202f30 2024-09-05T01:34:53.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.807+0000 7f71a9600640 1 -- 172.21.15.12:0/3044009938 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a0004db0 con 0x560ef9202f30 2024-09-05T01:34:53.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.807+0000 7f71b0c00640 1 --2- 172.21.15.12:0/1399435588 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f71980a2cf0 0x7f71980a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:53.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.807+0000 7f71b0c00640 1 -- 172.21.15.12:0/1399435588 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f71a40efb80 con 0x7f71b4103e30 2024-09-05T01:34:53.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.807+0000 7f71b8e00640 1 --2- 172.21.15.12:0/1399435588 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f71980a2cf0 0x7f71980a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:53.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.807+0000 7f71bda28740 1 -- 172.21.15.12:0/3044009938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef9202f30 msgr2=0x560ef9205320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:53.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.807+0000 7f71bda28740 1 --2- 172.21.15.12:0/3044009938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef9202f30 0x560ef9205320 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009bd0 tx=0x7f71a0011810 comp rx=0 tx=0).stop 2024-09-05T01:34:53.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.807+0000 7f71bda28740 1 -- 172.21.15.12:0/3044009938 shutdown_connections 2024-09-05T01:34:53.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.808+0000 7f71bda28740 1 --2- 172.21.15.12:0/3044009938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef9202f30 0x560ef9205320 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.808+0000 7f71bda28740 1 --2- 172.21.15.12:0/3044009938 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560ef91f8670 0x560ef92029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.808+0000 7f71bda28740 1 --2- 172.21.15.12:0/3044009938 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ef91f7d50 0x560ef91f8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.808+0000 7f71bda28740 1 -- 172.21.15.12:0/3044009938 >> 172.21.15.12:0/3044009938 conn(0x560ef91f42e0 msgr2=0x560ef91f46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:53.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.808+0000 7f71bda28740 1 -- 172.21.15.12:0/3044009938 shutdown_connections 2024-09-05T01:34:53.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.808+0000 7f71bda28740 1 -- 172.21.15.12:0/3044009938 wait complete. 2024-09-05T01:34:53.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.808+0000 7f71b8e00640 1 --2- 172.21.15.12:0/1399435588 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f71980a2cf0 0x7f71980a51b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f71ac005fd0 tx=0x7f71ac009500 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:53.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.808+0000 7f71bda28740 1 -- start start 2024-09-05T01:34:53.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.809+0000 7f71bda28740 1 Processor -- start 2024-09-05T01:34:53.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.809+0000 7f71bda28740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ef91f7d50 0x560ef91ffe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:53.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.809+0000 7f71bda28740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560ef91f8670 0x560ef9200360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:53.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.809+0000 7f71bda28740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef9202f30 0x560ef92008a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:53.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.809+0000 7f71bda28740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560ef9205ba0 con 0x560ef91f7d50 2024-09-05T01:34:53.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.809+0000 7f71bda28740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x560ef91190f0 con 0x560ef91f8670 2024-09-05T01:34:53.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.809+0000 7f71bda28740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560ef9205d20 con 0x560ef9202f30 2024-09-05T01:34:53.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.809+0000 7f71bda28740 10 client.0 _ll_register_callbacks cb 0x560ef910a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:34:53.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.809+0000 7f71b3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ef91f7d50 0x560ef91ffe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:53.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.809+0000 7f71b8e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef9202f30 0x560ef92008a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:53.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.809+0000 7f71b3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ef91f7d50 0x560ef91ffe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34182/0 (socket says 172.21.15.12:34182) 2024-09-05T01:34:53.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.809+0000 7f71b3e00640 1 -- 172.21.15.12:0/3603769337 learned_addr learned my addr 172.21.15.12:0/3603769337 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:53.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.810+0000 7f71b3400640 1 --2- 172.21.15.12:0/3603769337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560ef91f8670 0x560ef9200360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:53.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.810+0000 7f71b3e00640 1 -- 172.21.15.12:0/3603769337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef9202f30 msgr2=0x560ef92008a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:53.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.810+0000 7f71b3e00640 1 --2- 172.21.15.12:0/3603769337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef9202f30 0x560ef92008a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.810+0000 7f71b3e00640 1 -- 172.21.15.12:0/3603769337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560ef91f8670 msgr2=0x560ef9200360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:53.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.810+0000 7f71b3e00640 1 --2- 172.21.15.12:0/3603769337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560ef91f8670 0x560ef9200360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.810+0000 7f71b3e00640 1 -- 172.21.15.12:0/3603769337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ef8ecf3c0 con 0x560ef91f7d50 2024-09-05T01:34:53.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.810+0000 7f71b8e00640 1 --2- 172.21.15.12:0/3603769337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef9202f30 0x560ef92008a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:34:53.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.810+0000 7f71b3400640 1 --2- 172.21.15.12:0/3603769337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560ef91f8670 0x560ef9200360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:34:53.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.810+0000 7f71b3e00640 1 --2- 172.21.15.12:0/3603769337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ef91f7d50 0x560ef91ffe20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f71a40b8520 tx=0x7f71a4031e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c8b062fc4652c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:53.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.810+0000 7f719e000640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:34:53.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.810+0000 7f719e000640 1 -- 172.21.15.12:0/3603769337 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a4049070 con 0x560ef91f7d50 2024-09-05T01:34:53.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.810+0000 7f719e000640 1 -- 172.21.15.12:0/3603769337 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f71a40b8730 con 0x560ef91f7d50 2024-09-05T01:34:53.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.810+0000 7f71bda28740 1 -- 172.21.15.12:0/3603769337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560ef916b950 con 0x560ef91f7d50 2024-09-05T01:34:53.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.811+0000 7f719e000640 1 -- 172.21.15.12:0/3603769337 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f71a40bba20 con 0x560ef91f7d50 2024-09-05T01:34:53.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.811+0000 7f71bda28740 10 client.16488 fetch_fsmap learned FSMap version 56 2024-09-05T01:34:53.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.811+0000 7f71bda28740 1 -- 172.21.15.12:0/3603769337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x560ef9211840 con 0x560ef91f7d50 2024-09-05T01:34:53.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.811+0000 7f719e000640 1 -- 172.21.15.12:0/3603769337 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x560ef916b950 con 0x560ef91f7d50 2024-09-05T01:34:53.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.811+0000 7f719e000640 1 -- 172.21.15.12:0/3603769337 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 56) ==== 8430+0+0 (secure 0 0 0) 0x7f71a40d8050 con 0x560ef91f7d50 2024-09-05T01:34:53.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.811+0000 7f71bda28740 10 client.16488 fetch_fsmap finished waiting for FSMap version 56 2024-09-05T01:34:53.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.811+0000 7f71bda28740 10 client.16488 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:34:53.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.811+0000 7f71bda28740 20 client.16488 populate_metadata read hostname 'smithi012' 2024-09-05T01:34:53.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.811+0000 7f71bda28740 1 --2- 172.21.15.12:0/3603769337 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x560ef9212d20 0x560ef92151e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:53.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.811+0000 7f71bda28740 4 client.16488 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:34:53.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.811+0000 7f71bda28740 1 -- 172.21.15.12:0/3603769337 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ef9165e60 con 0x560ef9212d20 2024-09-05T01:34:53.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.812+0000 7f71b3400640 1 --2- 172.21.15.12:0/3603769337 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x560ef9212d20 0x560ef92151e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:53.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.812+0000 7f71b3400640 1 --2- 172.21.15.12:0/3603769337 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x560ef9212d20 0x560ef92151e0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d81f67528af68386 server_cookie=f0c8293c06f96876 in_seq=0 out_seq=0 2024-09-05T01:34:53.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.812+0000 7f719e000640 10 client.16488 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:34:53.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.813+0000 7f719e000640 1 -- 172.21.15.12:0/3603769337 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560ef9165e60 con 0x560ef9212d20 2024-09-05T01:34:53.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.813+0000 7f719e000640 10 client.16488 handle_command_reply: tid=0 2024-09-05T01:34:53.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.813+0000 7f71bda28740 1 client.16488 shutdown 2024-09-05T01:34:53.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.813+0000 7f71bda28740 1 -- 172.21.15.12:0/3603769337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ef91f7d50 msgr2=0x560ef91ffe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:53.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.813+0000 7f71bda28740 1 --2- 172.21.15.12:0/3603769337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ef91f7d50 0x560ef91ffe20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f71a40b8520 tx=0x7f71a4031e50 comp rx=0 tx=0).stop 2024-09-05T01:34:53.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.814+0000 7f71bda28740 1 -- 172.21.15.12:0/3603769337 shutdown_connections 2024-09-05T01:34:53.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.814+0000 7f71bda28740 1 --2- 172.21.15.12:0/3603769337 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x560ef9212d20 0x560ef92151e0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.814+0000 7f71bda28740 1 --2- 172.21.15.12:0/3603769337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef9202f30 0x560ef92008a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.814+0000 7f719e000640 0 client.16488 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:34:53.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.814+0000 7f71bda28740 1 --2- 172.21.15.12:0/3603769337 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560ef91f8670 0x560ef9200360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.814+0000 7f71bda28740 1 --2- 172.21.15.12:0/3603769337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ef91f7d50 0x560ef91ffe20 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.814+0000 7f71bda28740 1 -- 172.21.15.12:0/3603769337 >> 172.21.15.12:0/3603769337 conn(0x560ef91f42e0 msgr2=0x560ef91fa010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:53.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.814+0000 7f71bda28740 1 -- 172.21.15.12:0/3603769337 shutdown_connections 2024-09-05T01:34:53.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.814+0000 7f71bda28740 1 -- 172.21.15.12:0/3603769337 wait complete. 2024-09-05T01:34:53.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.814+0000 7f71bda28740 20 client.16488 trim_cache size 0 max 16384 2024-09-05T01:34:53.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.833+0000 7f71bda28740 1 Processor -- start 2024-09-05T01:34:53.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.833+0000 7f71bda28740 1 -- start start 2024-09-05T01:34:53.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.834+0000 7f71bda28740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ef91f7d50 0x560ef91ef060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:53.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.834+0000 7f71bda28740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560ef91f8670 0x560ef921aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:53.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.834+0000 7f71bda28740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef9202f30 0x560ef921b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:53.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.834+0000 7f71bda28740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f71b41afa10 con 0x560ef91f7d50 2024-09-05T01:34:53.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.834+0000 7f71bda28740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f71b41b1700 con 0x560ef91f8670 2024-09-05T01:34:53.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.834+0000 7f71bda28740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f71b41b00e0 con 0x560ef9202f30 2024-09-05T01:34:53.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.834+0000 7f71b3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ef91f7d50 0x560ef91ef060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:53.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.834+0000 7f71b3e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ef91f7d50 0x560ef91ef060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34198/0 (socket says 172.21.15.12:34198) 2024-09-05T01:34:53.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.834+0000 7f71b3e00640 1 -- 172.21.15.12:0/1431054003 learned_addr learned my addr 172.21.15.12:0/1431054003 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:53.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.834+0000 7f71b8e00640 1 --2- 172.21.15.12:0/1431054003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef9202f30 0x560ef921b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:53.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.834+0000 7f71b3400640 1 --2- 172.21.15.12:0/1431054003 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560ef91f8670 0x560ef921aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:53.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.834+0000 7f71b3e00640 1 -- 172.21.15.12:0/1431054003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef9202f30 msgr2=0x560ef921b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:53.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.834+0000 7f71b3e00640 1 --2- 172.21.15.12:0/1431054003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef9202f30 0x560ef921b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.834+0000 7f71b3e00640 1 -- 172.21.15.12:0/1431054003 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560ef91f8670 msgr2=0x560ef921aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:53.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.834+0000 7f71b3e00640 1 --2- 172.21.15.12:0/1431054003 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560ef91f8670 0x560ef921aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.834+0000 7f71b3e00640 1 -- 172.21.15.12:0/1431054003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ef920fb60 con 0x560ef91f7d50 2024-09-05T01:34:53.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.834+0000 7f71b8e00640 1 --2- 172.21.15.12:0/1431054003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef9202f30 0x560ef921b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:34:53.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.834+0000 7f71b3400640 1 --2- 172.21.15.12:0/1431054003 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560ef91f8670 0x560ef921aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:34:53.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.835+0000 7f71b3e00640 1 --2- 172.21.15.12:0/1431054003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ef91f7d50 0x560ef91ef060 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f71a40bbdc0 tx=0x7f71a40ba5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e450bd09502c4b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:53.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.835+0000 7f71a8c00640 1 -- 172.21.15.12:0/1431054003 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a4049070 con 0x560ef91f7d50 2024-09-05T01:34:53.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.835+0000 7f71a8c00640 1 -- 172.21.15.12:0/1431054003 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71a40bc7c0 con 0x560ef91f7d50 2024-09-05T01:34:53.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.835+0000 7f71a8c00640 1 -- 172.21.15.12:0/1431054003 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a4005d50 con 0x560ef91f7d50 2024-09-05T01:34:53.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.836+0000 7f71bda28740 1 -- 172.21.15.12:0/1431054003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ef91f7d50 msgr2=0x560ef91ef060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:53.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.836+0000 7f71bda28740 1 --2- 172.21.15.12:0/1431054003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ef91f7d50 0x560ef91ef060 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f71a40bbdc0 tx=0x7f71a40ba5d0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.836+0000 7f71bda28740 1 -- 172.21.15.12:0/1431054003 shutdown_connections 2024-09-05T01:34:53.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.836+0000 7f71bda28740 1 --2- 172.21.15.12:0/1431054003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef9202f30 0x560ef921b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.836+0000 7f71bda28740 1 --2- 172.21.15.12:0/1431054003 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560ef91f8670 0x560ef921aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.836+0000 7f71bda28740 1 --2- 172.21.15.12:0/1431054003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ef91f7d50 0x560ef91ef060 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.836+0000 7f71bda28740 1 -- 172.21.15.12:0/1431054003 >> 172.21.15.12:0/1431054003 conn(0x560ef91f42e0 msgr2=0x560ef91fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:53.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.836+0000 7f71bda28740 1 -- 172.21.15.12:0/1431054003 shutdown_connections 2024-09-05T01:34:53.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.836+0000 7f71bda28740 1 -- 172.21.15.12:0/1431054003 wait complete. 2024-09-05T01:34:53.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.836+0000 7f71bda28740 1 -- start start 2024-09-05T01:34:53.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.836+0000 7f71bda28740 1 Processor -- start 2024-09-05T01:34:53.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.837+0000 7f71bda28740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560ef91f7d50 0x560ef920af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:53.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.837+0000 7f71bda28740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef91f8670 0x560ef920b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:53.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.837+0000 7f71bda28740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ef9202f30 0x560ef91fc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:53.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.837+0000 7f71bda28740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f71b41b0f70 con 0x560ef9202f30 2024-09-05T01:34:53.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.837+0000 7f71bda28740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f71b41b07e0 con 0x560ef91f7d50 2024-09-05T01:34:53.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.837+0000 7f71bda28740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f71b41ada10 con 0x560ef91f8670 2024-09-05T01:34:53.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.837+0000 7f71bda28740 10 client.0 _ll_register_callbacks cb 0x7f71a4009260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:34:53.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.837+0000 7f71b3e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560ef91f7d50 0x560ef920af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:53.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.837+0000 7f71b3400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef91f8670 0x560ef920b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:53.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.837+0000 7f71b8e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ef9202f30 0x560ef91fc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:53.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.837+0000 7f71b3400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef91f8670 0x560ef920b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:43846/0 (socket says 172.21.15.12:43846) 2024-09-05T01:34:53.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.837+0000 7f71b3400640 1 -- 172.21.15.12:0/3088647890 learned_addr learned my addr 172.21.15.12:0/3088647890 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:53.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.837+0000 7f71b3e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560ef91f7d50 0x560ef920af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:48956/0 (socket says 172.21.15.12:48956) 2024-09-05T01:34:53.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.838+0000 7f71b3400640 1 -- 172.21.15.12:0/3088647890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560ef91f7d50 msgr2=0x560ef920af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:53.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.838+0000 7f71b3400640 1 --2- 172.21.15.12:0/3088647890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560ef91f7d50 0x560ef920af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.838+0000 7f71b3400640 1 -- 172.21.15.12:0/3088647890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ef9202f30 msgr2=0x560ef91fc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:53.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.838+0000 7f71b3400640 1 --2- 172.21.15.12:0/3088647890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ef9202f30 0x560ef91fc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.838+0000 7f71b3400640 1 -- 172.21.15.12:0/3088647890 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ef91fddf0 con 0x560ef91f8670 2024-09-05T01:34:53.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.838+0000 7f71b3400640 1 --2- 172.21.15.12:0/3088647890 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef91f8670 0x560ef920b4b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009bd0 tx=0x7f71a0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e40f513a4301e4d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:53.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.838+0000 7f719e000640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:34:53.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.838+0000 7f719e000640 1 -- 172.21.15.12:0/3088647890 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a001e040 con 0x560ef91f8670 2024-09-05T01:34:53.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.838+0000 7f719e000640 1 -- 172.21.15.12:0/3088647890 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f71a0004440 con 0x560ef91f8670 2024-09-05T01:34:53.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.838+0000 7f71bda28740 1 -- 172.21.15.12:0/3088647890 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71a40bc7c0 con 0x560ef91f8670 2024-09-05T01:34:53.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.839+0000 7f719e000640 1 -- 172.21.15.12:0/3088647890 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f71a0036450 con 0x560ef91f8670 2024-09-05T01:34:53.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.839+0000 7f71bda28740 10 client.26539 fetch_fsmap learned FSMap version 56 2024-09-05T01:34:53.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.839+0000 7f71bda28740 1 -- 172.21.15.12:0/3088647890 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x560ef927d040 con 0x560ef91f8670 2024-09-05T01:34:53.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.839+0000 7f719e000640 1 -- 172.21.15.12:0/3088647890 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71a40bc7c0 con 0x560ef91f8670 2024-09-05T01:34:53.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.839+0000 7f719e000640 1 -- 172.21.15.12:0/3088647890 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 56) ==== 8430+0+0 (secure 0 0 0) 0x7f71a0018070 con 0x560ef91f8670 2024-09-05T01:34:53.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.839+0000 7f71bda28740 10 client.26539 fetch_fsmap finished waiting for FSMap version 56 2024-09-05T01:34:53.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.839+0000 7f71bda28740 10 client.26539 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:34:53.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.839+0000 7f71bda28740 20 client.26539 populate_metadata read hostname 'smithi012' 2024-09-05T01:34:53.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.839+0000 7f71bda28740 1 --2- 172.21.15.12:0/3088647890 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x560ef927d750 0x560ef927fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:53.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.839+0000 7f71bda28740 4 client.26539 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T01:34:53.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.839+0000 7f71bda28740 1 -- 172.21.15.12:0/3088647890 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560ef90e20c0 con 0x560ef927d750 2024-09-05T01:34:53.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.839+0000 7f71b3e00640 1 --2- 172.21.15.12:0/3088647890 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x560ef927d750 0x560ef927fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:53.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.840+0000 7f71b3e00640 1 --2- 172.21.15.12:0/3088647890 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x560ef927d750 0x560ef927fb70 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2baa392e3a77c162 server_cookie=66f4217e2fb6da45 in_seq=0 out_seq=0 2024-09-05T01:34:53.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.840+0000 7f719e000640 10 client.26539 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:34:53.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.840+0000 7f719e000640 1 -- 172.21.15.12:0/3088647890 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560ef90e20c0 con 0x560ef927d750 2024-09-05T01:34:53.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.840+0000 7f719e000640 10 client.26539 handle_command_reply: tid=0 2024-09-05T01:34:53.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.840+0000 7f71bda28740 1 client.26539 shutdown 2024-09-05T01:34:53.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.840+0000 7f71bda28740 1 -- 172.21.15.12:0/3088647890 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef91f8670 msgr2=0x560ef920b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:53.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.840+0000 7f71bda28740 1 --2- 172.21.15.12:0/3088647890 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef91f8670 0x560ef920b4b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009bd0 tx=0x7f71a0009780 comp rx=0 tx=0).stop 2024-09-05T01:34:53.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.840+0000 7f71bda28740 1 -- 172.21.15.12:0/3088647890 shutdown_connections 2024-09-05T01:34:53.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.840+0000 7f71bda28740 1 --2- 172.21.15.12:0/3088647890 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x560ef927d750 0x560ef927fb70 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.840+0000 7f71bda28740 1 --2- 172.21.15.12:0/3088647890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560ef9202f30 0x560ef91fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.840+0000 7f71bda28740 1 --2- 172.21.15.12:0/3088647890 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ef91f8670 0x560ef920b4b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.840+0000 7f719e000640 0 client.26539 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:34:53.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.840+0000 7f71bda28740 1 --2- 172.21.15.12:0/3088647890 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x560ef91f7d50 0x560ef920af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.840+0000 7f71bda28740 1 -- 172.21.15.12:0/3088647890 >> 172.21.15.12:0/3088647890 conn(0x560ef91f42e0 msgr2=0x560ef91feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:53.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.841+0000 7f71bda28740 1 -- 172.21.15.12:0/3088647890 shutdown_connections 2024-09-05T01:34:53.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.841+0000 7f71bda28740 1 -- 172.21.15.12:0/3088647890 wait complete. 2024-09-05T01:34:53.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.841+0000 7f71bda28740 20 client.26539 trim_cache size 0 max 16384 2024-09-05T01:34:53.846 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:34:53.846 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-05T01:34:53.846 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-05T01:34:53.846 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:34:53.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.841+0000 7f71b9800640 1 -- 172.21.15.12:0/1399435588 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f71980a2cf0 msgr2=0x7f71980a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:53.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.841+0000 7f71b9800640 1 --2- 172.21.15.12:0/1399435588 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f71980a2cf0 0x7f71980a51b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f71ac005fd0 tx=0x7f71ac009500 comp rx=0 tx=0).stop 2024-09-05T01:34:53.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.841+0000 7f71b9800640 1 -- 172.21.15.12:0/1399435588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71b4103e30 msgr2=0x7f71b419a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:53.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.841+0000 7f71b9800640 1 --2- 172.21.15.12:0/1399435588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71b4103e30 0x7f71b419a490 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f71a4004770 tx=0x7f71a4003c10 comp rx=0 tx=0).stop 2024-09-05T01:34:53.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.842+0000 7f71b9800640 1 -- 172.21.15.12:0/1399435588 shutdown_connections 2024-09-05T01:34:53.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.842+0000 7f71b9800640 1 --2- 172.21.15.12:0/1399435588 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f71980a2cf0 0x7f71980a51b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.842+0000 7f71b9800640 1 --2- 172.21.15.12:0/1399435588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71b4108f60 0x7f71b419ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.842+0000 7f71b9800640 1 --2- 172.21.15.12:0/1399435588 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f71b41047e0 0x7f71b419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.842+0000 7f71b9800640 1 --2- 172.21.15.12:0/1399435588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71b4103e30 0x7f71b419a490 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:53.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.842+0000 7f71b9800640 1 -- 172.21.15.12:0/1399435588 >> 172.21.15.12:0/1399435588 conn(0x7f71b40ff8d0 msgr2=0x7f71b4100bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:53.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.842+0000 7f71b9800640 1 -- 172.21.15.12:0/1399435588 shutdown_connections 2024-09-05T01:34:53.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:53.842+0000 7f71b9800640 1 -- 172.21.15.12:0/1399435588 wait complete. 2024-09-05T01:34:55.093 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-05T01:34:55.094 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:34:55.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:55 smithi012 ceph-mon[29942]: pgmap v317: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 581 op/s 2024-09-05T01:34:55.498 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:34:55.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:55 smithi145 ceph-mon[34376]: pgmap v317: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 581 op/s 2024-09-05T01:34:55.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:55 smithi151 ceph-mon[35013]: pgmap v317: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 581 op/s 2024-09-05T01:34:56.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.204+0000 7f1b11200640 1 -- 172.21.15.12:0/2117381850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b0c1047e0 msgr2=0x7f1b0c108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:56.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.204+0000 7f1b11200640 1 --2- 172.21.15.12:0/2117381850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b0c1047e0 0x7f1b0c108830 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1af8009860 tx=0x7f1af802a340 comp rx=0 tx=0).stop 2024-09-05T01:34:56.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.204+0000 7f1b11200640 1 -- 172.21.15.12:0/2117381850 shutdown_connections 2024-09-05T01:34:56.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.204+0000 7f1b11200640 1 --2- 172.21.15.12:0/2117381850 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b0c108f60 0x7f1b0c110ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:56.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.204+0000 7f1b11200640 1 --2- 172.21.15.12:0/2117381850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b0c1047e0 0x7f1b0c108830 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:56.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.204+0000 7f1b11200640 1 --2- 172.21.15.12:0/2117381850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b0c103e30 0x7f1b0c104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:56.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.204+0000 7f1b11200640 1 -- 172.21.15.12:0/2117381850 >> 172.21.15.12:0/2117381850 conn(0x7f1b0c0ff910 msgr2=0x7f1b0c101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:56.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.204+0000 7f1b11200640 1 -- 172.21.15.12:0/2117381850 shutdown_connections 2024-09-05T01:34:56.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.204+0000 7f1b11200640 1 -- 172.21.15.12:0/2117381850 wait complete. 2024-09-05T01:34:56.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.205+0000 7f1b11200640 1 Processor -- start 2024-09-05T01:34:56.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.205+0000 7f1b11200640 1 -- start start 2024-09-05T01:34:56.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.206+0000 7f1b11200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b0c103e30 0x7f1b0c19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:56.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.206+0000 7f1b11200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b0c1047e0 0x7f1b0c19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:56.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.206+0000 7f1b11200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b0c108f60 0x7f1b0c19ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:56.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.206+0000 7f1b11200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c113fc0 con 0x7f1b0c108f60 2024-09-05T01:34:56.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.206+0000 7f1b11200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c113e40 con 0x7f1b0c1047e0 2024-09-05T01:34:56.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.206+0000 7f1b11200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c114140 con 0x7f1b0c103e30 2024-09-05T01:34:56.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.206+0000 7f1b0b400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b0c103e30 0x7f1b0c19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:56.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.206+0000 7f1b0be00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b0c108f60 0x7f1b0c19ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:56.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.206+0000 7f1b0b400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b0c103e30 0x7f1b0c19a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:43868/0 (socket says 172.21.15.12:43868) 2024-09-05T01:34:56.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.206+0000 7f1b0b400640 1 -- 172.21.15.12:0/3104259737 learned_addr learned my addr 172.21.15.12:0/3104259737 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:56.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.206+0000 7f1b0aa00640 1 --2- 172.21.15.12:0/3104259737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b0c1047e0 0x7f1b0c19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:56.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.207+0000 7f1b0b400640 1 -- 172.21.15.12:0/3104259737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b0c1047e0 msgr2=0x7f1b0c19aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:56.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.207+0000 7f1b0b400640 1 --2- 172.21.15.12:0/3104259737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b0c1047e0 0x7f1b0c19aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:56.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.207+0000 7f1b0b400640 1 -- 172.21.15.12:0/3104259737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b0c108f60 msgr2=0x7f1b0c19ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:56.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.207+0000 7f1b0b400640 1 --2- 172.21.15.12:0/3104259737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b0c108f60 0x7f1b0c19ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:56.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.207+0000 7f1b0b400640 1 -- 172.21.15.12:0/3104259737 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0c19f470 con 0x7f1b0c103e30 2024-09-05T01:34:56.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.207+0000 7f1b0b400640 1 --2- 172.21.15.12:0/3104259737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b0c103e30 0x7f1b0c19a4c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1afc00e9c0 tx=0x7f1afc00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:56.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.207+0000 7f1b03e00640 1 -- 172.21.15.12:0/3104259737 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc00cde0 con 0x7f1b0c103e30 2024-09-05T01:34:56.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.207+0000 7f1b03e00640 1 -- 172.21.15.12:0/3104259737 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1afc0035f0 con 0x7f1b0c103e30 2024-09-05T01:34:56.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.207+0000 7f1b11200640 1 -- 172.21.15.12:0/3104259737 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b0c19f760 con 0x7f1b0c103e30 2024-09-05T01:34:56.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.207+0000 7f1b03e00640 1 -- 172.21.15.12:0/3104259737 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc010690 con 0x7f1b0c103e30 2024-09-05T01:34:56.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.207+0000 7f1b11200640 1 -- 172.21.15.12:0/3104259737 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b0c1a7040 con 0x7f1b0c103e30 2024-09-05T01:34:56.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.209+0000 7f1b11200640 1 -- 172.21.15.12:0/3104259737 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b0c105310 con 0x7f1b0c103e30 2024-09-05T01:34:56.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.211+0000 7f1b03e00640 1 -- 172.21.15.12:0/3104259737 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f1afc0037a0 con 0x7f1b0c103e30 2024-09-05T01:34:56.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.212+0000 7f1b03e00640 1 --2- 172.21.15.12:0/3104259737 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1af00a2d70 0x7f1af00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:56.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.212+0000 7f1b03e00640 1 -- 172.21.15.12:0/3104259737 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f1afc0cf770 con 0x7f1b0c103e30 2024-09-05T01:34:56.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.212+0000 7f1b0aa00640 1 --2- 172.21.15.12:0/3104259737 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1af00a2d70 0x7f1af00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:56.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.213+0000 7f1b0aa00640 1 --2- 172.21.15.12:0/3104259737 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1af00a2d70 0x7f1af00a5230 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1af802a930 tx=0x7f1af80056d0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:56.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.217+0000 7f1b03e00640 1 -- 172.21.15.12:0/3104259737 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1afc09c2f0 con 0x7f1b0c103e30 2024-09-05T01:34:56.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.459+0000 7f1b11200640 1 -- 172.21.15.12:0/3104259737 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b0c10c1a0 con 0x7f1b0c103e30 2024-09-05T01:34:56.460 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:56 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:34:56.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.460+0000 7f1b03e00640 1 -- 172.21.15.12:0/3104259737 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+12010 (secure 0 0 0) 0x7f1afc09bbf0 con 0x7f1b0c103e30 2024-09-05T01:34:56.461 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:34:56.462 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 57 2024-09-05T01:34:56.462 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":57,"btime":"2024-09-05T01:34:55:222411+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14532,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/2949711075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":2949711075},{"type":"v1","addr":"172.21.15.12:6839","nonce":2949711075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":57,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T01:22:35.979384+0000","modified":"2024-09-05T01:34:54.540435+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24529,"mds_2":24524,"mds_3":24517,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/497406458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":497406458},{"type":"v1","addr":"172.21.15.12:6841","nonce":497406458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":10,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.145:6839/1706431882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":1706431882},{"type":"v1","addr":"172.21.15.145:6839","nonce":1706431882}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24460,24517,24524,24529,24560]},"id":1}]} 2024-09-05T01:34:56.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.463+0000 7f1b11200640 1 -- 172.21.15.12:0/3104259737 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1af00a2d70 msgr2=0x7f1af00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:56.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.463+0000 7f1b11200640 1 --2- 172.21.15.12:0/3104259737 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1af00a2d70 0x7f1af00a5230 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1af802a930 tx=0x7f1af80056d0 comp rx=0 tx=0).stop 2024-09-05T01:34:56.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.463+0000 7f1b11200640 1 -- 172.21.15.12:0/3104259737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b0c103e30 msgr2=0x7f1b0c19a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:56.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.463+0000 7f1b11200640 1 --2- 172.21.15.12:0/3104259737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b0c103e30 0x7f1b0c19a4c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1afc00e9c0 tx=0x7f1afc00ee80 comp rx=0 tx=0).stop 2024-09-05T01:34:56.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.463+0000 7f1b11200640 1 -- 172.21.15.12:0/3104259737 shutdown_connections 2024-09-05T01:34:56.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.463+0000 7f1b11200640 1 --2- 172.21.15.12:0/3104259737 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f1af00a2d70 0x7f1af00a5230 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:56.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.463+0000 7f1b11200640 1 --2- 172.21.15.12:0/3104259737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b0c108f60 0x7f1b0c19ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:56.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.463+0000 7f1b11200640 1 --2- 172.21.15.12:0/3104259737 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f1b0c1047e0 0x7f1b0c19aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:56.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.463+0000 7f1b11200640 1 --2- 172.21.15.12:0/3104259737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b0c103e30 0x7f1b0c19a4c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:56.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.463+0000 7f1b11200640 1 -- 172.21.15.12:0/3104259737 >> 172.21.15.12:0/3104259737 conn(0x7f1b0c0ff910 msgr2=0x7f1b0c100c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:56.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.464+0000 7f1b11200640 1 -- 172.21.15.12:0/3104259737 shutdown_connections 2024-09-05T01:34:56.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:56.464+0000 7f1b11200640 1 -- 172.21.15.12:0/3104259737 wait complete. 2024-09-05T01:34:56.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:56 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:34:56.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:56 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:34:57.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:57 smithi012 ceph-mon[29942]: pgmap v318: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 332 op/s 2024-09-05T01:34:57.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:57 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3104259737' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:34:57.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:57 smithi145 ceph-mon[34376]: pgmap v318: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 332 op/s 2024-09-05T01:34:57.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:57 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3104259737' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:34:57.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:57 smithi151 ceph-mon[35013]: pgmap v318: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 332 op/s 2024-09-05T01:34:57.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:57 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3104259737' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:34:57.728 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-05T01:34:58.184 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:34:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.828+0000 7f2f3dc00640 1 -- 172.21.15.12:0/1799752266 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f380745c0 msgr2=0x7f2f380749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.828+0000 7f2f3dc00640 1 --2- 172.21.15.12:0/1799752266 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f380745c0 0x7f2f380749a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2f28009900 tx=0x7f2f2802a480 comp rx=0 tx=0).stop 2024-09-05T01:34:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.828+0000 7f2f3dc00640 1 -- 172.21.15.12:0/1799752266 shutdown_connections 2024-09-05T01:34:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.828+0000 7f2f3dc00640 1 --2- 172.21.15.12:0/1799752266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f3810e260 0x7f2f38110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.828+0000 7f2f3dc00640 1 --2- 172.21.15.12:0/1799752266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f38074ee0 0x7f2f3810dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.828+0000 7f2f3dc00640 1 --2- 172.21.15.12:0/1799752266 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f380745c0 0x7f2f380749a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.828+0000 7f2f3dc00640 1 -- 172.21.15.12:0/1799752266 >> 172.21.15.12:0/1799752266 conn(0x7f2f380fd740 msgr2=0x7f2f380ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.828+0000 7f2f3dc00640 1 -- 172.21.15.12:0/1799752266 shutdown_connections 2024-09-05T01:34:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.828+0000 7f2f3dc00640 1 -- 172.21.15.12:0/1799752266 wait complete. 2024-09-05T01:34:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.830+0000 7f2f3dc00640 1 Processor -- start 2024-09-05T01:34:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.830+0000 7f2f3dc00640 1 -- start start 2024-09-05T01:34:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.830+0000 7f2f3dc00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f380745c0 0x7f2f3819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.830+0000 7f2f3dc00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f38074ee0 0x7f2f3819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.830+0000 7f2f3dc00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f3810e260 0x7f2f3819ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.830+0000 7f2f3dc00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2f38113fb0 con 0x7f2f380745c0 2024-09-05T01:34:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.830+0000 7f2f3dc00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2f38113e30 con 0x7f2f3810e260 2024-09-05T01:34:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.830+0000 7f2f3dc00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2f38114130 con 0x7f2f38074ee0 2024-09-05T01:34:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.831+0000 7f2f2fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f38074ee0 0x7f2f3819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.831+0000 7f2f2fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f38074ee0 0x7f2f3819a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:57386/0 (socket says 172.21.15.12:57386) 2024-09-05T01:34:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.831+0000 7f2f2fe00640 1 -- 172.21.15.12:0/1048168120 learned_addr learned my addr 172.21.15.12:0/1048168120 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.831+0000 7f2f3d200640 1 --2- 172.21.15.12:0/1048168120 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f3810e260 0x7f2f3819ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.831+0000 7f2f37e00640 1 --2- 172.21.15.12:0/1048168120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f380745c0 0x7f2f3819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.831+0000 7f2f2fe00640 1 -- 172.21.15.12:0/1048168120 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f3810e260 msgr2=0x7f2f3819ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.831+0000 7f2f2fe00640 1 --2- 172.21.15.12:0/1048168120 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f3810e260 0x7f2f3819ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.831+0000 7f2f2fe00640 1 -- 172.21.15.12:0/1048168120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f380745c0 msgr2=0x7f2f3819a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.831+0000 7f2f2fe00640 1 --2- 172.21.15.12:0/1048168120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f380745c0 0x7f2f3819a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.831+0000 7f2f2fe00640 1 -- 172.21.15.12:0/1048168120 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f3819f460 con 0x7f2f38074ee0 2024-09-05T01:34:58.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.832+0000 7f2f2fe00640 1 --2- 172.21.15.12:0/1048168120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f38074ee0 0x7f2f3819a9f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000e9f0 tx=0x7f2f2000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:58.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.832+0000 7f2f35600640 1 -- 172.21.15.12:0/1048168120 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2000cd80 con 0x7f2f38074ee0 2024-09-05T01:34:58.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.832+0000 7f2f35600640 1 -- 172.21.15.12:0/1048168120 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f20010910 con 0x7f2f38074ee0 2024-09-05T01:34:58.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.832+0000 7f2f3dc00640 1 -- 172.21.15.12:0/1048168120 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f3819f750 con 0x7f2f38074ee0 2024-09-05T01:34:58.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.832+0000 7f2f35600640 1 -- 172.21.15.12:0/1048168120 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f20018990 con 0x7f2f38074ee0 2024-09-05T01:34:58.834 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.833+0000 7f2f3dc00640 1 -- 172.21.15.12:0/1048168120 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f381a7030 con 0x7f2f38074ee0 2024-09-05T01:34:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.836+0000 7f2f35600640 1 -- 172.21.15.12:0/1048168120 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f2f20010ac0 con 0x7f2f38074ee0 2024-09-05T01:34:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.836+0000 7f2f41e03740 1 Processor -- start 2024-09-05T01:34:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.836+0000 7f2f41e03740 1 -- start start 2024-09-05T01:34:58.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.837+0000 7f2f41e03740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556958325e40 0x556958326220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:58.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.837+0000 7f2f41e03740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556958326760 0x556958330ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:58.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.837+0000 7f2f41e03740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556958331020 0x556958333410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:58.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.837+0000 7f2f41e03740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55695828c3e0 con 0x556958325e40 2024-09-05T01:34:58.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.837+0000 7f2f41e03740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x556958233d80 con 0x556958331020 2024-09-05T01:34:58.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.837+0000 7f2f41e03740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5569582883a0 con 0x556958326760 2024-09-05T01:34:58.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.837+0000 7f2f3d200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556958325e40 0x556958326220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:58.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.837+0000 7f2f3d200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556958325e40 0x556958326220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43902/0 (socket says 172.21.15.12:43902) 2024-09-05T01:34:58.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.837+0000 7f2f3d200640 1 -- 172.21.15.12:0/1242922275 learned_addr learned my addr 172.21.15.12:0/1242922275 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:58.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.837+0000 7f2f37e00640 1 --2- 172.21.15.12:0/1242922275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556958326760 0x556958330ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:58.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.838+0000 7f2f2fe00640 1 --2- 172.21.15.12:0/1242922275 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556958331020 0x556958333410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:58.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.838+0000 7f2f3d200640 1 -- 172.21.15.12:0/1242922275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556958326760 msgr2=0x556958330ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:58.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.838+0000 7f2f3d200640 1 --2- 172.21.15.12:0/1242922275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556958326760 0x556958330ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.838+0000 7f2f3d200640 1 -- 172.21.15.12:0/1242922275 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556958331020 msgr2=0x556958333410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:58.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.838+0000 7f2f3d200640 1 --2- 172.21.15.12:0/1242922275 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556958331020 0x556958333410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.838+0000 7f2f3d200640 1 -- 172.21.15.12:0/1242922275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556958252ae0 con 0x556958325e40 2024-09-05T01:34:58.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.838+0000 7f2f35600640 1 --2- 172.21.15.12:0/1048168120 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f2f1c0a2d70 0x7f2f1c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:58.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.838+0000 7f2f3d200640 1 --2- 172.21.15.12:0/1242922275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556958325e40 0x556958326220 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2f30009f00 tx=0x7f2f300107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777ba8a2d10beaec server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:58.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.838+0000 7f2f35600640 1 -- 172.21.15.12:0/1048168120 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f2f200cf8c0 con 0x7f2f38074ee0 2024-09-05T01:34:58.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.839+0000 7f2f37e00640 1 --2- 172.21.15.12:0/1048168120 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f2f1c0a2d70 0x7f2f1c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:58.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.839+0000 7f2f2d600640 1 -- 172.21.15.12:0/1242922275 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f30003b70 con 0x556958325e40 2024-09-05T01:34:58.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.839+0000 7f2f2d600640 1 -- 172.21.15.12:0/1242922275 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f30003d10 con 0x556958325e40 2024-09-05T01:34:58.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.839+0000 7f2f2d600640 1 -- 172.21.15.12:0/1242922275 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f30011a40 con 0x556958325e40 2024-09-05T01:34:58.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.840+0000 7f2f41e03740 1 -- 172.21.15.12:0/1242922275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556958325e40 msgr2=0x556958326220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:58.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.840+0000 7f2f41e03740 1 --2- 172.21.15.12:0/1242922275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556958325e40 0x556958326220 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2f30009f00 tx=0x7f2f300107a0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.840+0000 7f2f37e00640 1 --2- 172.21.15.12:0/1048168120 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f2f1c0a2d70 0x7f2f1c0a5230 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2f28005940 tx=0x7f2f280058b0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:58.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.840+0000 7f2f41e03740 1 -- 172.21.15.12:0/1242922275 shutdown_connections 2024-09-05T01:34:58.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.840+0000 7f2f41e03740 1 --2- 172.21.15.12:0/1242922275 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556958331020 0x556958333410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.840+0000 7f2f41e03740 1 --2- 172.21.15.12:0/1242922275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556958326760 0x556958330ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.840+0000 7f2f41e03740 1 --2- 172.21.15.12:0/1242922275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556958325e40 0x556958326220 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.840+0000 7f2f41e03740 1 -- 172.21.15.12:0/1242922275 >> 172.21.15.12:0/1242922275 conn(0x5569583223d0 msgr2=0x5569583227b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:58.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.840+0000 7f2f41e03740 1 -- 172.21.15.12:0/1242922275 shutdown_connections 2024-09-05T01:34:58.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.840+0000 7f2f41e03740 1 -- 172.21.15.12:0/1242922275 wait complete. 2024-09-05T01:34:58.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.841+0000 7f2f41e03740 1 -- start start 2024-09-05T01:34:58.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.841+0000 7f2f41e03740 1 Processor -- start 2024-09-05T01:34:58.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.842+0000 7f2f41e03740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556958325e40 0x55695832df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:58.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.842+0000 7f2f41e03740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556958326760 0x55695832e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:58.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.842+0000 7f2f41e03740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556958331020 0x55695832e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:58.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.842+0000 7f2f41e03740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556958333bf0 con 0x556958325e40 2024-09-05T01:34:58.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.842+0000 7f2f41e03740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5569582470f0 con 0x556958326760 2024-09-05T01:34:58.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.842+0000 7f2f41e03740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556958333d70 con 0x556958331020 2024-09-05T01:34:58.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.842+0000 7f2f41e03740 10 client.0 _ll_register_callbacks cb 0x55695822ebd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:34:58.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.842+0000 7f2f3d200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556958331020 0x55695832e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:58.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.842+0000 7f2f3d200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556958331020 0x55695832e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:57396/0 (socket says 172.21.15.12:57396) 2024-09-05T01:34:58.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.842+0000 7f2f3d200640 1 -- 172.21.15.12:0/3336219044 learned_addr learned my addr 172.21.15.12:0/3336219044 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:58.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.842+0000 7f2f2fe00640 1 --2- 172.21.15.12:0/3336219044 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556958326760 0x55695832e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:58.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.842+0000 7f2f37e00640 1 --2- 172.21.15.12:0/3336219044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556958325e40 0x55695832df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:58.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.843+0000 7f2f3d200640 1 -- 172.21.15.12:0/3336219044 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556958326760 msgr2=0x55695832e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:58.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.843+0000 7f2f3d200640 1 --2- 172.21.15.12:0/3336219044 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556958326760 0x55695832e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.843+0000 7f2f3d200640 1 -- 172.21.15.12:0/3336219044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556958325e40 msgr2=0x55695832df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:58.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.843+0000 7f2f3d200640 1 --2- 172.21.15.12:0/3336219044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556958325e40 0x55695832df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.843+0000 7f2f3d200640 1 -- 172.21.15.12:0/3336219044 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556957ffd3c0 con 0x556958331020 2024-09-05T01:34:58.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.843+0000 7f2f2fe00640 1 --2- 172.21.15.12:0/3336219044 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556958326760 0x55695832e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:34:58.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.843+0000 7f2f37e00640 1 --2- 172.21.15.12:0/3336219044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556958325e40 0x55695832df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:34:58.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.843+0000 7f2f3d200640 1 --2- 172.21.15.12:0/3336219044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556958331020 0x55695832e9d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2f30006010 tx=0x7f2f30011970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e432332fa6c9c9e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:58.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.843+0000 7f2f26000640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:34:58.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.843+0000 7f2f26000640 1 -- 172.21.15.12:0/3336219044 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f30011cf0 con 0x556958331020 2024-09-05T01:34:58.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.844+0000 7f2f41e03740 1 -- 172.21.15.12:0/3336219044 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f30003d10 con 0x556958331020 2024-09-05T01:34:58.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.844+0000 7f2f26000640 1 -- 172.21.15.12:0/3336219044 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f2f30004000 con 0x556958331020 2024-09-05T01:34:58.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.844+0000 7f2f26000640 1 -- 172.21.15.12:0/3336219044 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f2f30004200 con 0x556958331020 2024-09-05T01:34:58.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.844+0000 7f2f41e03740 10 client.26557 fetch_fsmap learned FSMap version 57 2024-09-05T01:34:58.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.844+0000 7f2f41e03740 1 -- 172.21.15.12:0/3336219044 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) -- 0x55695833fc80 con 0x556958331020 2024-09-05T01:34:58.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.844+0000 7f2f26000640 1 -- 172.21.15.12:0/3336219044 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f30003d10 con 0x556958331020 2024-09-05T01:34:58.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.845+0000 7f2f26000640 1 -- 172.21.15.12:0/3336219044 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 57) ==== 8434+0+0 (secure 0 0 0) 0x7f2f30027b20 con 0x556958331020 2024-09-05T01:34:58.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.845+0000 7f2f41e03740 10 client.26557 fetch_fsmap finished waiting for FSMap version 57 2024-09-05T01:34:58.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.845+0000 7f2f41e03740 10 client.26557 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-05T01:34:58.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.845+0000 7f2f41e03740 20 client.26557 populate_metadata read hostname 'smithi012' 2024-09-05T01:34:58.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.845+0000 7f2f41e03740 1 --2- 172.21.15.12:0/3336219044 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x556958341090 0x556958343480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:58.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.845+0000 7f2f41e03740 4 client.26557 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:34:58.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.845+0000 7f2f41e03740 1 -- 172.21.15.12:0/3336219044 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556958299950 con 0x556958341090 2024-09-05T01:34:58.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.845+0000 7f2f37e00640 1 --2- 172.21.15.12:0/3336219044 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x556958341090 0x556958343480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:58.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.846+0000 7f2f37e00640 1 --2- 172.21.15.12:0/3336219044 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x556958341090 0x556958343480 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e0ce987933c1b6b5 server_cookie=d6a89fb9567d84cc in_seq=0 out_seq=0 2024-09-05T01:34:58.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.846+0000 7f2f26000640 10 client.26557 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:34:58.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.847+0000 7f2f26000640 1 -- 172.21.15.12:0/3336219044 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556958299950 con 0x556958341090 2024-09-05T01:34:58.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.847+0000 7f2f26000640 10 client.26557 handle_command_reply: tid=0 2024-09-05T01:34:58.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.847+0000 7f2f41e03740 1 client.26557 shutdown 2024-09-05T01:34:58.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.847+0000 7f2f41e03740 1 -- 172.21.15.12:0/3336219044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556958331020 msgr2=0x55695832e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:58.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.847+0000 7f2f41e03740 1 --2- 172.21.15.12:0/3336219044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556958331020 0x55695832e9d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2f30006010 tx=0x7f2f30011970 comp rx=0 tx=0).stop 2024-09-05T01:34:58.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.847+0000 7f2f41e03740 1 -- 172.21.15.12:0/3336219044 shutdown_connections 2024-09-05T01:34:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.847+0000 7f2f41e03740 1 --2- 172.21.15.12:0/3336219044 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x556958341090 0x556958343480 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.847+0000 7f2f41e03740 1 --2- 172.21.15.12:0/3336219044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556958331020 0x55695832e9d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.847+0000 7f2f41e03740 1 --2- 172.21.15.12:0/3336219044 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556958326760 0x55695832e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.847+0000 7f2f41e03740 1 --2- 172.21.15.12:0/3336219044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556958325e40 0x55695832df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.847+0000 7f2f26000640 0 client.26557 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:34:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.847+0000 7f2f41e03740 1 -- 172.21.15.12:0/3336219044 >> 172.21.15.12:0/3336219044 conn(0x5569583223d0 msgr2=0x556958328100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.847+0000 7f2f41e03740 1 -- 172.21.15.12:0/3336219044 shutdown_connections 2024-09-05T01:34:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.848+0000 7f2f41e03740 1 -- 172.21.15.12:0/3336219044 wait complete. 2024-09-05T01:34:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.848+0000 7f2f41e03740 20 client.26557 trim_cache size 0 max 16384 2024-09-05T01:34:58.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.862+0000 7f2f41e03740 1 Processor -- start 2024-09-05T01:34:58.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.862+0000 7f2f41e03740 1 -- start start 2024-09-05T01:34:58.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.862+0000 7f2f41e03740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556958325e40 0x5569583288a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:58.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.862+0000 7f2f41e03740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556958326760 0x55695832fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:58.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.862+0000 7f2f41e03740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556958331020 0x556958348ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:58.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.862+0000 7f2f41e03740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2f381afa50 con 0x556958331020 2024-09-05T01:34:58.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.862+0000 7f2f41e03740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2f381b1770 con 0x556958326760 2024-09-05T01:34:58.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.862+0000 7f2f41e03740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2f381b0120 con 0x556958325e40 2024-09-05T01:34:58.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.863+0000 7f2f3d200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556958331020 0x556958348ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:58.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.863+0000 7f2f3d200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556958331020 0x556958348ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43908/0 (socket says 172.21.15.12:43908) 2024-09-05T01:34:58.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.863+0000 7f2f3d200640 1 -- 172.21.15.12:0/3821932370 learned_addr learned my addr 172.21.15.12:0/3821932370 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:58.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.863+0000 7f2f2fe00640 1 --2- 172.21.15.12:0/3821932370 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556958326760 0x55695832fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:58.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.863+0000 7f2f37e00640 1 --2- 172.21.15.12:0/3821932370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556958325e40 0x5569583288a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:58.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.863+0000 7f2f3d200640 1 -- 172.21.15.12:0/3821932370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556958325e40 msgr2=0x5569583288a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:58.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.863+0000 7f2f3d200640 1 --2- 172.21.15.12:0/3821932370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556958325e40 0x5569583288a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.863+0000 7f2f3d200640 1 -- 172.21.15.12:0/3821932370 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556958326760 msgr2=0x55695832fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:58.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.863+0000 7f2f3d200640 1 --2- 172.21.15.12:0/3821932370 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556958326760 0x55695832fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.863+0000 7f2f3d200640 1 -- 172.21.15.12:0/3821932370 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556958333770 con 0x556958331020 2024-09-05T01:34:58.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.864+0000 7f2f3d200640 1 --2- 172.21.15.12:0/3821932370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556958331020 0x556958348ae0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2f30010ca0 tx=0x7f2f30005f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ddb0a9217e35d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:58.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.864+0000 7f2f2cc00640 1 -- 172.21.15.12:0/3821932370 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3001f070 con 0x556958331020 2024-09-05T01:34:58.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.864+0000 7f2f2cc00640 1 -- 172.21.15.12:0/3821932370 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f30003d10 con 0x556958331020 2024-09-05T01:34:58.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.864+0000 7f2f2cc00640 1 -- 172.21.15.12:0/3821932370 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3000d5a0 con 0x556958331020 2024-09-05T01:34:58.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.865+0000 7f2f41e03740 1 -- 172.21.15.12:0/3821932370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556958331020 msgr2=0x556958348ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:58.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.865+0000 7f2f41e03740 1 --2- 172.21.15.12:0/3821932370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556958331020 0x556958348ae0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2f30010ca0 tx=0x7f2f30005f50 comp rx=0 tx=0).stop 2024-09-05T01:34:58.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.865+0000 7f2f41e03740 1 -- 172.21.15.12:0/3821932370 shutdown_connections 2024-09-05T01:34:58.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.865+0000 7f2f41e03740 1 --2- 172.21.15.12:0/3821932370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556958331020 0x556958348ae0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.865+0000 7f2f41e03740 1 --2- 172.21.15.12:0/3821932370 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556958326760 0x55695832fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.865+0000 7f2f41e03740 1 --2- 172.21.15.12:0/3821932370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556958325e40 0x5569583288a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.865+0000 7f2f41e03740 1 -- 172.21.15.12:0/3821932370 >> 172.21.15.12:0/3821932370 conn(0x5569583223d0 msgr2=0x55695832f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:58.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.865+0000 7f2f41e03740 1 -- 172.21.15.12:0/3821932370 shutdown_connections 2024-09-05T01:34:58.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.865+0000 7f2f41e03740 1 -- 172.21.15.12:0/3821932370 wait complete. 2024-09-05T01:34:58.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.866+0000 7f2f41e03740 1 -- start start 2024-09-05T01:34:58.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.866+0000 7f2f41e03740 1 Processor -- start 2024-09-05T01:34:58.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.867+0000 7f2f41e03740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556958325e40 0x5569583393a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:58.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.867+0000 7f2f41e03740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556958326760 0x5569583398e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:58.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.867+0000 7f2f41e03740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556958331020 0x556958334920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:58.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.867+0000 7f2f41e03740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2f381b0fe0 con 0x556958325e40 2024-09-05T01:34:58.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.867+0000 7f2f41e03740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2f381b0850 con 0x556958331020 2024-09-05T01:34:58.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.867+0000 7f2f41e03740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2f381ada50 con 0x556958326760 2024-09-05T01:34:58.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.867+0000 7f2f41e03740 10 client.0 _ll_register_callbacks cb 0x7f2f300093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:34:58.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.867+0000 7f2f3d200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556958331020 0x556958334920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:58.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.867+0000 7f2f2fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556958326760 0x5569583398e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:58.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.867+0000 7f2f3d200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556958331020 0x556958334920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:37616/0 (socket says 172.21.15.12:37616) 2024-09-05T01:34:58.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.867+0000 7f2f2fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556958326760 0x5569583398e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:57400/0 (socket says 172.21.15.12:57400) 2024-09-05T01:34:58.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.867+0000 7f2f3d200640 1 -- 172.21.15.12:0/3810093578 learned_addr learned my addr 172.21.15.12:0/3810093578 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:34:58.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.868+0000 7f2f3d200640 1 -- 172.21.15.12:0/3810093578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556958326760 msgr2=0x5569583398e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:58.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.868+0000 7f2f3d200640 1 --2- 172.21.15.12:0/3810093578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556958326760 0x5569583398e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.868+0000 7f2f3d200640 1 -- 172.21.15.12:0/3810093578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556958325e40 msgr2=0x5569583393a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:34:58.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.868+0000 7f2f3d200640 1 --2- 172.21.15.12:0/3810093578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556958325e40 0x5569583393a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.868+0000 7f2f3d200640 1 -- 172.21.15.12:0/3810093578 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556958335150 con 0x556958331020 2024-09-05T01:34:58.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.868+0000 7f2f3d200640 1 --2- 172.21.15.12:0/3810093578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556958331020 0x556958334920 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2f3001b580 tx=0x7f2f30004170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da26d3716d6fa391 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:34:58.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.868+0000 7f2f26000640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:34:58.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.868+0000 7f2f26000640 1 -- 172.21.15.12:0/3810093578 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f3001f040 con 0x556958331020 2024-09-05T01:34:58.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.869+0000 7f2f41e03740 1 -- 172.21.15.12:0/3810093578 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f30003d10 con 0x556958331020 2024-09-05T01:34:58.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.869+0000 7f2f26000640 1 -- 172.21.15.12:0/3810093578 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f2f300045b0 con 0x556958331020 2024-09-05T01:34:58.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.869+0000 7f2f26000640 1 -- 172.21.15.12:0/3810093578 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f2f30046050 con 0x556958331020 2024-09-05T01:34:58.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.869+0000 7f2f41e03740 10 client.26582 fetch_fsmap learned FSMap version 57 2024-09-05T01:34:58.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.869+0000 7f2f41e03740 1 -- 172.21.15.12:0/3810093578 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) -- 0x5569583b3f70 con 0x556958331020 2024-09-05T01:34:58.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.869+0000 7f2f26000640 1 -- 172.21.15.12:0/3810093578 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f30003d10 con 0x556958331020 2024-09-05T01:34:58.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.869+0000 7f2f26000640 1 -- 172.21.15.12:0/3810093578 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 57) ==== 8434+0+0 (secure 0 0 0) 0x7f2f3001b890 con 0x556958331020 2024-09-05T01:34:58.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.869+0000 7f2f41e03740 10 client.26582 fetch_fsmap finished waiting for FSMap version 57 2024-09-05T01:34:58.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.869+0000 7f2f41e03740 10 client.26582 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-05T01:34:58.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.869+0000 7f2f41e03740 20 client.26582 populate_metadata read hostname 'smithi012' 2024-09-05T01:34:58.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.870+0000 7f2f41e03740 1 --2- 172.21.15.12:0/3810093578 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5569583b4600 0x5569583b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:34:58.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.870+0000 7f2f41e03740 4 client.26582 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:34:58.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.870+0000 7f2f41e03740 1 -- 172.21.15.12:0/3810093578 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556958293e60 con 0x5569583b4600 2024-09-05T01:34:58.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.870+0000 7f2f37e00640 1 --2- 172.21.15.12:0/3810093578 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5569583b4600 0x5569583b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:34:58.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.871+0000 7f2f37e00640 1 --2- 172.21.15.12:0/3810093578 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5569583b4600 0x5569583b6a40 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a9731718e019333b server_cookie=43a3653b2a09c008 in_seq=0 out_seq=0 2024-09-05T01:34:58.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.871+0000 7f2f26000640 10 client.26582 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:34:58.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.872+0000 7f2f26000640 1 -- 172.21.15.12:0/3810093578 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556958293e60 con 0x5569583b4600 2024-09-05T01:34:58.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.872+0000 7f2f26000640 10 client.26582 handle_command_reply: tid=0 2024-09-05T01:34:58.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.872+0000 7f2f41e03740 1 client.26582 shutdown 2024-09-05T01:34:58.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.872+0000 7f2f41e03740 1 -- 172.21.15.12:0/3810093578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556958331020 msgr2=0x556958334920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:58.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.872+0000 7f2f41e03740 1 --2- 172.21.15.12:0/3810093578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556958331020 0x556958334920 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2f3001b580 tx=0x7f2f30004170 comp rx=0 tx=0).stop 2024-09-05T01:34:58.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.872+0000 7f2f41e03740 1 -- 172.21.15.12:0/3810093578 shutdown_connections 2024-09-05T01:34:58.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.872+0000 7f2f41e03740 1 --2- 172.21.15.12:0/3810093578 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x5569583b4600 0x5569583b6a40 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.872+0000 7f2f41e03740 1 --2- 172.21.15.12:0/3810093578 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x556958331020 0x556958334920 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.872+0000 7f2f41e03740 1 --2- 172.21.15.12:0/3810093578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556958326760 0x5569583398e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.872+0000 7f2f41e03740 1 --2- 172.21.15.12:0/3810093578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556958325e40 0x5569583393a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.872+0000 7f2f26000640 0 client.26582 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:34:58.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.872+0000 7f2f41e03740 1 -- 172.21.15.12:0/3810093578 >> 172.21.15.12:0/3810093578 conn(0x5569583223d0 msgr2=0x5569583214b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:58.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.872+0000 7f2f41e03740 1 -- 172.21.15.12:0/3810093578 shutdown_connections 2024-09-05T01:34:58.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.873+0000 7f2f41e03740 1 -- 172.21.15.12:0/3810093578 wait complete. 2024-09-05T01:34:58.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.873+0000 7f2f41e03740 20 client.26582 trim_cache size 0 max 16384 2024-09-05T01:34:58.876 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:34:58.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.873+0000 7f2f3dc00640 1 -- 172.21.15.12:0/1048168120 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f2f1c0a2d70 msgr2=0x7f2f1c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:58.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.873+0000 7f2f3dc00640 1 --2- 172.21.15.12:0/1048168120 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f2f1c0a2d70 0x7f2f1c0a5230 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2f28005940 tx=0x7f2f280058b0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.873+0000 7f2f3dc00640 1 -- 172.21.15.12:0/1048168120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f38074ee0 msgr2=0x7f2f3819a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:34:58.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.873+0000 7f2f3dc00640 1 --2- 172.21.15.12:0/1048168120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f38074ee0 0x7f2f3819a9f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000e9f0 tx=0x7f2f2000eeb0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.874+0000 7f2f3dc00640 1 -- 172.21.15.12:0/1048168120 shutdown_connections 2024-09-05T01:34:58.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.874+0000 7f2f3dc00640 1 --2- 172.21.15.12:0/1048168120 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f2f1c0a2d70 0x7f2f1c0a5230 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.874+0000 7f2f3dc00640 1 --2- 172.21.15.12:0/1048168120 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2f3810e260 0x7f2f3819ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.874+0000 7f2f3dc00640 1 --2- 172.21.15.12:0/1048168120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f38074ee0 0x7f2f3819a9f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.874+0000 7f2f3dc00640 1 --2- 172.21.15.12:0/1048168120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f380745c0 0x7f2f3819a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:34:58.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.874+0000 7f2f3dc00640 1 -- 172.21.15.12:0/1048168120 >> 172.21.15.12:0/1048168120 conn(0x7f2f380fd740 msgr2=0x7f2f380fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:34:58.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.874+0000 7f2f3dc00640 1 -- 172.21.15.12:0/1048168120 shutdown_connections 2024-09-05T01:34:58.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:34:58.874+0000 7f2f3dc00640 1 -- 172.21.15.12:0/1048168120 wait complete. 2024-09-05T01:34:59.547 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:59 smithi145 ceph-mon[34376]: pgmap v319: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 325 op/s 2024-09-05T01:34:59.547 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:34:59 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:34:59.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:59 smithi012 ceph-mon[29942]: pgmap v319: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 325 op/s 2024-09-05T01:34:59.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:34:59 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:34:59.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:59 smithi151 ceph-mon[35013]: pgmap v319: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 325 op/s 2024-09-05T01:34:59.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:34:59 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:34:59.684 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-05T01:35:00.786 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:35:01.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.385+0000 7f6f6a400640 1 -- 172.21.15.12:0/1661886020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f64103ff0 msgr2=0x7f6f641043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:01.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.385+0000 7f6f6a400640 1 --2- 172.21.15.12:0/1661886020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f64103ff0 0x7f6f641043d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009860 tx=0x7f6f5402a340 comp rx=0 tx=0).stop 2024-09-05T01:35:01.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.385+0000 7f6f6a400640 1 -- 172.21.15.12:0/1661886020 shutdown_connections 2024-09-05T01:35:01.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.385+0000 7f6f6a400640 1 --2- 172.21.15.12:0/1661886020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f64109120 0x7f6f64110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.385+0000 7f6f6a400640 1 --2- 172.21.15.12:0/1661886020 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f641049a0 0x7f6f641089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.385+0000 7f6f6a400640 1 --2- 172.21.15.12:0/1661886020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f64103ff0 0x7f6f641043d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.385+0000 7f6f6a400640 1 -- 172.21.15.12:0/1661886020 >> 172.21.15.12:0/1661886020 conn(0x7f6f640ffa90 msgr2=0x7f6f64101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:01.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.386+0000 7f6f6a400640 1 -- 172.21.15.12:0/1661886020 shutdown_connections 2024-09-05T01:35:01.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.386+0000 7f6f6a400640 1 -- 172.21.15.12:0/1661886020 wait complete. 2024-09-05T01:35:01.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.387+0000 7f6f6a400640 1 Processor -- start 2024-09-05T01:35:01.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.387+0000 7f6f6a400640 1 -- start start 2024-09-05T01:35:01.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.387+0000 7f6f6a400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f64103ff0 0x7f6f6419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:01.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.387+0000 7f6f6a400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f641049a0 0x7f6f6419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:01.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.387+0000 7f6f6a400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f64109120 0x7f6f6419eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:01.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.387+0000 7f6f6a400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6f64114140 con 0x7f6f64103ff0 2024-09-05T01:35:01.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.387+0000 7f6f6a400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6f64113fc0 con 0x7f6f64109120 2024-09-05T01:35:01.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.387+0000 7f6f6a400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6f641142c0 con 0x7f6f641049a0 2024-09-05T01:35:01.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.387+0000 7f6f62a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f641049a0 0x7f6f6419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:01.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.387+0000 7f6f62a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f641049a0 0x7f6f6419ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:57424/0 (socket says 172.21.15.12:57424) 2024-09-05T01:35:01.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.387+0000 7f6f62a00640 1 -- 172.21.15.12:0/1952128311 learned_addr learned my addr 172.21.15.12:0/1952128311 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:01.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.387+0000 7f6f63400640 1 --2- 172.21.15.12:0/1952128311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f64103ff0 0x7f6f6419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:01.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.388+0000 7f6f63e00640 1 --2- 172.21.15.12:0/1952128311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f64109120 0x7f6f6419eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:01.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.388+0000 7f6f62a00640 1 -- 172.21.15.12:0/1952128311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f64109120 msgr2=0x7f6f6419eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:01.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.388+0000 7f6f62a00640 1 --2- 172.21.15.12:0/1952128311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f64109120 0x7f6f6419eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.388+0000 7f6f62a00640 1 -- 172.21.15.12:0/1952128311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f64103ff0 msgr2=0x7f6f6419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:01.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.388+0000 7f6f62a00640 1 --2- 172.21.15.12:0/1952128311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f64103ff0 0x7f6f6419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.388+0000 7f6f62a00640 1 -- 172.21.15.12:0/1952128311 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f6419f5b0 con 0x7f6f641049a0 2024-09-05T01:35:01.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.388+0000 7f6f63e00640 1 --2- 172.21.15.12:0/1952128311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f64109120 0x7f6f6419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:35:01.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.388+0000 7f6f62a00640 1 --2- 172.21.15.12:0/1952128311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f641049a0 0x7f6f6419ab40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000e9f0 tx=0x7f6f5000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:01.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.389+0000 7f6f5be00640 1 -- 172.21.15.12:0/1952128311 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5000cd80 con 0x7f6f641049a0 2024-09-05T01:35:01.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.389+0000 7f6f5be00640 1 -- 172.21.15.12:0/1952128311 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f50005500 con 0x7f6f641049a0 2024-09-05T01:35:01.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.389+0000 7f6f6a400640 1 -- 172.21.15.12:0/1952128311 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f6419f8a0 con 0x7f6f641049a0 2024-09-05T01:35:01.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.389+0000 7f6f5be00640 1 -- 172.21.15.12:0/1952128311 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f50010690 con 0x7f6f641049a0 2024-09-05T01:35:01.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.389+0000 7f6f6a400640 1 -- 172.21.15.12:0/1952128311 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f641a7180 con 0x7f6f641049a0 2024-09-05T01:35:01.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.392+0000 7f6f6cde2740 1 Processor -- start 2024-09-05T01:35:01.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.392+0000 7f6f5be00640 1 -- 172.21.15.12:0/1952128311 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f6f500046c0 con 0x7f6f641049a0 2024-09-05T01:35:01.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.392+0000 7f6f6cde2740 1 -- start start 2024-09-05T01:35:01.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.393+0000 7f6f6cde2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f91c70 0x558258f92050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:01.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.393+0000 7f6f6cde2740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558258f92590 0x558258f9c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:01.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.393+0000 7f6f6cde2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558258f9ce50 0x558258f9f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:01.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.393+0000 7f6f6cde2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558258ef83e0 con 0x558258f9ce50 2024-09-05T01:35:01.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.393+0000 7f6f6cde2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x558258e9fd80 con 0x558258f91c70 2024-09-05T01:35:01.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.393+0000 7f6f6cde2740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558258ef43a0 con 0x558258f92590 2024-09-05T01:35:01.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.393+0000 7f6f63e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f91c70 0x558258f92050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:01.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.393+0000 7f6f63e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f91c70 0x558258f92050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:37628/0 (socket says 172.21.15.12:37628) 2024-09-05T01:35:01.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.393+0000 7f6f63e00640 1 -- 172.21.15.12:0/4163377383 learned_addr learned my addr 172.21.15.12:0/4163377383 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:01.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.393+0000 7f6f63400640 1 --2- 172.21.15.12:0/4163377383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558258f92590 0x558258f9c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:01.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.393+0000 7f6f62a00640 1 --2- 172.21.15.12:0/4163377383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558258f9ce50 0x558258f9f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:01.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.393+0000 7f6f63e00640 1 -- 172.21.15.12:0/4163377383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558258f92590 msgr2=0x558258f9c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:01.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.393+0000 7f6f63e00640 1 --2- 172.21.15.12:0/4163377383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558258f92590 0x558258f9c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.393+0000 7f6f63e00640 1 -- 172.21.15.12:0/4163377383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558258f9ce50 msgr2=0x558258f9f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:01.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.393+0000 7f6f63e00640 1 --2- 172.21.15.12:0/4163377383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558258f9ce50 0x558258f9f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.394+0000 7f6f63e00640 1 -- 172.21.15.12:0/4163377383 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558258ebeae0 con 0x558258f91c70 2024-09-05T01:35:01.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.394+0000 7f6f62a00640 1 --2- 172.21.15.12:0/4163377383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558258f9ce50 0x558258f9f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:35:01.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.394+0000 7f6f63e00640 1 --2- 172.21.15.12:0/4163377383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f91c70 0x558258f92050 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00e870 tx=0x7f6f5c0095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d70cd7af3c18944f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:01.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.394+0000 7f6f5be00640 1 --2- 172.21.15.12:0/1952128311 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6f480a2d70 0x7f6f480a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:01.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.394+0000 7f6f58c00640 1 -- 172.21.15.12:0/4163377383 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c00ddd0 con 0x558258f91c70 2024-09-05T01:35:01.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.394+0000 7f6f58c00640 1 -- 172.21.15.12:0/4163377383 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f5c01c070 con 0x558258f91c70 2024-09-05T01:35:01.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.394+0000 7f6f58c00640 1 -- 172.21.15.12:0/4163377383 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c016700 con 0x558258f91c70 2024-09-05T01:35:01.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.394+0000 7f6f5be00640 1 -- 172.21.15.12:0/1952128311 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f6f500cf830 con 0x7f6f641049a0 2024-09-05T01:35:01.398 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.395+0000 7f6f63400640 1 --2- 172.21.15.12:0/1952128311 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6f480a2d70 0x7f6f480a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:01.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.395+0000 7f6f6cde2740 1 -- 172.21.15.12:0/4163377383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f91c70 msgr2=0x558258f92050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:01.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.395+0000 7f6f6cde2740 1 --2- 172.21.15.12:0/4163377383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f91c70 0x558258f92050 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00e870 tx=0x7f6f5c0095c0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.395+0000 7f6f63400640 1 --2- 172.21.15.12:0/1952128311 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6f480a2d70 0x7f6f480a5230 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6f5402a930 tx=0x7f6f540058d0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:01.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.395+0000 7f6f6cde2740 1 -- 172.21.15.12:0/4163377383 shutdown_connections 2024-09-05T01:35:01.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.395+0000 7f6f6cde2740 1 --2- 172.21.15.12:0/4163377383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558258f9ce50 0x558258f9f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.395+0000 7f6f6cde2740 1 --2- 172.21.15.12:0/4163377383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558258f92590 0x558258f9c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.395+0000 7f6f6cde2740 1 --2- 172.21.15.12:0/4163377383 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f91c70 0x558258f92050 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.395+0000 7f6f6cde2740 1 -- 172.21.15.12:0/4163377383 >> 172.21.15.12:0/4163377383 conn(0x558258f8e200 msgr2=0x558258f8e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:01.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.396+0000 7f6f6cde2740 1 -- 172.21.15.12:0/4163377383 shutdown_connections 2024-09-05T01:35:01.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.396+0000 7f6f6cde2740 1 -- 172.21.15.12:0/4163377383 wait complete. 2024-09-05T01:35:01.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.396+0000 7f6f6cde2740 1 -- start start 2024-09-05T01:35:01.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.396+0000 7f6f6cde2740 1 Processor -- start 2024-09-05T01:35:01.399 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.397+0000 7f6f6cde2740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558258f91c70 0x558258f99d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:01.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.397+0000 7f6f6cde2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f92590 0x558258f9a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:01.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.397+0000 7f6f6cde2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558258f9ce50 0x558258f9a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:01.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.397+0000 7f6f6cde2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558258f9fa20 con 0x558258f9ce50 2024-09-05T01:35:01.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.397+0000 7f6f6cde2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x558258eb30f0 con 0x558258f92590 2024-09-05T01:35:01.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.397+0000 7f6f6cde2740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558258f9fba0 con 0x558258f91c70 2024-09-05T01:35:01.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.397+0000 7f6f6cde2740 10 client.0 _ll_register_callbacks cb 0x558258e9abd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:35:01.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.397+0000 7f6f63400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558258f91c70 0x558258f99d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:01.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.397+0000 7f6f63400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558258f91c70 0x558258f99d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:57448/0 (socket says 172.21.15.12:57448) 2024-09-05T01:35:01.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.397+0000 7f6f63400640 1 -- 172.21.15.12:0/1266093471 learned_addr learned my addr 172.21.15.12:0/1266093471 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:01.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.397+0000 7f6f62a00640 1 --2- 172.21.15.12:0/1266093471 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f92590 0x558258f9a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:01.400 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.397+0000 7f6f63e00640 1 --2- 172.21.15.12:0/1266093471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558258f9ce50 0x558258f9a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:01.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.398+0000 7f6f63400640 1 -- 172.21.15.12:0/1266093471 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f92590 msgr2=0x558258f9a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:01.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.398+0000 7f6f63400640 1 --2- 172.21.15.12:0/1266093471 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f92590 0x558258f9a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.398+0000 7f6f63400640 1 -- 172.21.15.12:0/1266093471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558258f9ce50 msgr2=0x558258f9a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:01.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.398+0000 7f6f63400640 1 --2- 172.21.15.12:0/1266093471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558258f9ce50 0x558258f9a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.398+0000 7f6f63400640 1 -- 172.21.15.12:0/1266093471 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558258c693c0 con 0x558258f91c70 2024-09-05T01:35:01.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.398+0000 7f6f63e00640 1 --2- 172.21.15.12:0/1266093471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558258f9ce50 0x558258f9a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:35:01.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.398+0000 7f6f62a00640 1 --2- 172.21.15.12:0/1266093471 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f92590 0x558258f9a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:35:01.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.398+0000 7f6f63400640 1 --2- 172.21.15.12:0/1266093471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558258f91c70 0x558258f99d00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009860 tx=0x7f6f5402a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23daf004e61c56e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:01.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.398+0000 7f6f4d600640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:35:01.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.398+0000 7f6f4d600640 1 -- 172.21.15.12:0/1266093471 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f54037040 con 0x558258f91c70 2024-09-05T01:35:01.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.398+0000 7f6f6cde2740 1 -- 172.21.15.12:0/1266093471 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f5c01c070 con 0x558258f91c70 2024-09-05T01:35:01.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.398+0000 7f6f4d600640 1 -- 172.21.15.12:0/1266093471 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f6f54003a00 con 0x558258f91c70 2024-09-05T01:35:01.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.399+0000 7f6f4d600640 1 -- 172.21.15.12:0/1266093471 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f6f54057050 con 0x558258f91c70 2024-09-05T01:35:01.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.399+0000 7f6f6cde2740 10 client.26575 fetch_fsmap learned FSMap version 57 2024-09-05T01:35:01.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.399+0000 7f6f6cde2740 1 -- 172.21.15.12:0/1266093471 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) -- 0x558258faba80 con 0x558258f91c70 2024-09-05T01:35:01.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.399+0000 7f6f4d600640 1 -- 172.21.15.12:0/1266093471 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f5c01c070 con 0x558258f91c70 2024-09-05T01:35:01.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.399+0000 7f6f4d600640 1 -- 172.21.15.12:0/1266093471 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 57) ==== 8434+0+0 (secure 0 0 0) 0x7f6f54049ba0 con 0x558258f91c70 2024-09-05T01:35:01.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.399+0000 7f6f6cde2740 10 client.26575 fetch_fsmap finished waiting for FSMap version 57 2024-09-05T01:35:01.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.399+0000 7f6f6cde2740 10 client.26575 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-05T01:35:01.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.399+0000 7f6f6cde2740 20 client.26575 populate_metadata read hostname 'smithi012' 2024-09-05T01:35:01.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.399+0000 7f6f6cde2740 1 --2- 172.21.15.12:0/1266093471 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x558258facf80 0x558258faf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:01.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.399+0000 7f6f6cde2740 4 client.26575 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:35:01.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.399+0000 7f6f6cde2740 1 -- 172.21.15.12:0/1266093471 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558258f05950 con 0x558258facf80 2024-09-05T01:35:01.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.400+0000 7f6f62a00640 1 --2- 172.21.15.12:0/1266093471 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x558258facf80 0x558258faf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:01.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.400+0000 7f6f62a00640 1 --2- 172.21.15.12:0/1266093471 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x558258facf80 0x558258faf400 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=88f6ff0ffbed42a9 server_cookie=fd842a4d69ddb915 in_seq=0 out_seq=0 2024-09-05T01:35:01.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.400+0000 7f6f4d600640 10 client.26575 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:35:01.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.401+0000 7f6f4d600640 1 -- 172.21.15.12:0/1266093471 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558258f05950 con 0x558258facf80 2024-09-05T01:35:01.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.401+0000 7f6f4d600640 10 client.26575 handle_command_reply: tid=0 2024-09-05T01:35:01.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.401+0000 7f6f6cde2740 1 client.26575 shutdown 2024-09-05T01:35:01.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.401+0000 7f6f6cde2740 1 -- 172.21.15.12:0/1266093471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558258f91c70 msgr2=0x558258f99d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:01.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.401+0000 7f6f6cde2740 1 --2- 172.21.15.12:0/1266093471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558258f91c70 0x558258f99d00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009860 tx=0x7f6f5402a340 comp rx=0 tx=0).stop 2024-09-05T01:35:01.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.401+0000 7f6f6cde2740 1 -- 172.21.15.12:0/1266093471 shutdown_connections 2024-09-05T01:35:01.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.401+0000 7f6f6cde2740 1 --2- 172.21.15.12:0/1266093471 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x558258facf80 0x558258faf400 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.401+0000 7f6f6cde2740 1 --2- 172.21.15.12:0/1266093471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558258f9ce50 0x558258f9a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.401+0000 7f6f6cde2740 1 --2- 172.21.15.12:0/1266093471 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f92590 0x558258f9a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.401+0000 7f6f6cde2740 1 --2- 172.21.15.12:0/1266093471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558258f91c70 0x558258f99d00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.401+0000 7f6f6cde2740 1 -- 172.21.15.12:0/1266093471 >> 172.21.15.12:0/1266093471 conn(0x558258f8e200 msgr2=0x558258f8d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:01.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.401+0000 7f6f4d600640 0 client.26575 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:35:01.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.401+0000 7f6f6cde2740 1 -- 172.21.15.12:0/1266093471 shutdown_connections 2024-09-05T01:35:01.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.401+0000 7f6f6cde2740 1 -- 172.21.15.12:0/1266093471 wait complete. 2024-09-05T01:35:01.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.402+0000 7f6f6cde2740 20 client.26575 trim_cache size 0 max 16384 2024-09-05T01:35:01.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.416+0000 7f6f6cde2740 1 Processor -- start 2024-09-05T01:35:01.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.416+0000 7f6f6cde2740 1 -- start start 2024-09-05T01:35:01.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.416+0000 7f6f6cde2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558258f91c70 0x558258f946d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:01.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.416+0000 7f6f6cde2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f92590 0x558258fb4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:01.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.416+0000 7f6f6cde2740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558258f9ce50 0x558258fb5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.416+0000 7f6f6cde2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6f641afb20 con 0x558258f91c70 2024-09-05T01:35:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.416+0000 7f6f6cde2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6f641b1840 con 0x558258f92590 2024-09-05T01:35:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.416+0000 7f6f6cde2740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6f641b01f0 con 0x558258f9ce50 2024-09-05T01:35:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.417+0000 7f6f62a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f92590 0x558258fb4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.417+0000 7f6f63400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558258f91c70 0x558258f946d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.417+0000 7f6f62a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f92590 0x558258fb4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:37646/0 (socket says 172.21.15.12:37646) 2024-09-05T01:35:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.417+0000 7f6f62a00640 1 -- 172.21.15.12:0/1565928711 learned_addr learned my addr 172.21.15.12:0/1565928711 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.417+0000 7f6f63e00640 1 --2- 172.21.15.12:0/1565928711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558258f9ce50 0x558258fb5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.417+0000 7f6f62a00640 1 -- 172.21.15.12:0/1565928711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558258f9ce50 msgr2=0x558258fb5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.417+0000 7f6f62a00640 1 --2- 172.21.15.12:0/1565928711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558258f9ce50 0x558258fb5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.417+0000 7f6f62a00640 1 -- 172.21.15.12:0/1565928711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558258f91c70 msgr2=0x558258f946d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:01.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.417+0000 7f6f62a00640 1 --2- 172.21.15.12:0/1565928711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558258f91c70 0x558258f946d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.417+0000 7f6f62a00640 1 -- 172.21.15.12:0/1565928711 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558258f923c0 con 0x558258f92590 2024-09-05T01:35:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.418+0000 7f6f62a00640 1 --2- 172.21.15.12:0/1565928711 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f92590 0x558258fb4cd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6f500986c0 tx=0x7f6f50004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0a03fb04eed2102 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.418+0000 7f6f4fe00640 1 -- 172.21.15.12:0/1565928711 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5009bcf0 con 0x558258f92590 2024-09-05T01:35:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.418+0000 7f6f4fe00640 1 -- 172.21.15.12:0/1565928711 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f500d2e50 con 0x558258f92590 2024-09-05T01:35:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.418+0000 7f6f4fe00640 1 -- 172.21.15.12:0/1565928711 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f500a4730 con 0x558258f92590 2024-09-05T01:35:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.419+0000 7f6f6cde2740 1 -- 172.21.15.12:0/1565928711 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f92590 msgr2=0x558258fb4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.419+0000 7f6f6cde2740 1 --2- 172.21.15.12:0/1565928711 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f92590 0x558258fb4cd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6f500986c0 tx=0x7f6f50004a40 comp rx=0 tx=0).stop 2024-09-05T01:35:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.419+0000 7f6f6cde2740 1 -- 172.21.15.12:0/1565928711 shutdown_connections 2024-09-05T01:35:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.419+0000 7f6f6cde2740 1 --2- 172.21.15.12:0/1565928711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558258f9ce50 0x558258fb5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.419+0000 7f6f6cde2740 1 --2- 172.21.15.12:0/1565928711 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f92590 0x558258fb4cd0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.419+0000 7f6f6cde2740 1 --2- 172.21.15.12:0/1565928711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558258f91c70 0x558258f946d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.419+0000 7f6f6cde2740 1 -- 172.21.15.12:0/1565928711 >> 172.21.15.12:0/1565928711 conn(0x558258f8e200 msgr2=0x558258f98df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:01.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.419+0000 7f6f6cde2740 1 -- 172.21.15.12:0/1565928711 shutdown_connections 2024-09-05T01:35:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.419+0000 7f6f6cde2740 1 -- 172.21.15.12:0/1565928711 wait complete. 2024-09-05T01:35:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.419+0000 7f6f6cde2740 1 -- start start 2024-09-05T01:35:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.420+0000 7f6f6cde2740 1 Processor -- start 2024-09-05T01:35:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.420+0000 7f6f6cde2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558258f91c70 0x558258fa4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.420+0000 7f6f6cde2740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f92590 0x558258fa5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.420+0000 7f6f6cde2740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558258f9ce50 0x558258f96150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.420+0000 7f6f6cde2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6f641b10b0 con 0x558258f91c70 2024-09-05T01:35:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.420+0000 7f6f6cde2740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6f641b0920 con 0x558258f92590 2024-09-05T01:35:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.420+0000 7f6f6cde2740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6f641adb20 con 0x558258f9ce50 2024-09-05T01:35:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.420+0000 7f6f6cde2740 10 client.0 _ll_register_callbacks cb 0x7f6f50005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:35:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.420+0000 7f6f63e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558258f9ce50 0x558258f96150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:01.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.420+0000 7f6f63e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558258f9ce50 0x558258f96150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:57460/0 (socket says 172.21.15.12:57460) 2024-09-05T01:35:01.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.420+0000 7f6f63e00640 1 -- 172.21.15.12:0/4123964936 learned_addr learned my addr 172.21.15.12:0/4123964936 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:01.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.420+0000 7f6f63400640 1 --2- 172.21.15.12:0/4123964936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558258f91c70 0x558258fa4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:01.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.420+0000 7f6f62a00640 1 --2- 172.21.15.12:0/4123964936 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f92590 0x558258fa5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:01.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.421+0000 7f6f63e00640 1 -- 172.21.15.12:0/4123964936 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f92590 msgr2=0x558258fa5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:01.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.421+0000 7f6f63e00640 1 --2- 172.21.15.12:0/4123964936 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f92590 0x558258fa5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.421+0000 7f6f63e00640 1 -- 172.21.15.12:0/4123964936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558258f91c70 msgr2=0x558258fa4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:01.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.421+0000 7f6f63e00640 1 --2- 172.21.15.12:0/4123964936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558258f91c70 0x558258fa4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.421+0000 7f6f63e00640 1 -- 172.21.15.12:0/4123964936 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558258f96690 con 0x558258f9ce50 2024-09-05T01:35:01.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.421+0000 7f6f63400640 1 --2- 172.21.15.12:0/4123964936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558258f91c70 0x558258fa4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:35:01.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.421+0000 7f6f63e00640 1 --2- 172.21.15.12:0/4123964936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558258f9ce50 0x558258f96150 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00e870 tx=0x7f6f5c00de70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=382f2051db2a0aa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:01.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.421+0000 7f6f4d600640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:35:01.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.421+0000 7f6f4d600640 1 -- 172.21.15.12:0/4123964936 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c003d80 con 0x558258f9ce50 2024-09-05T01:35:01.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.421+0000 7f6f4d600640 1 -- 172.21.15.12:0/4123964936 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f6f5c005040 con 0x558258f9ce50 2024-09-05T01:35:01.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.421+0000 7f6f6cde2740 1 -- 172.21.15.12:0/4123964936 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f500d2e50 con 0x558258f9ce50 2024-09-05T01:35:01.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.422+0000 7f6f4d600640 1 -- 172.21.15.12:0/4123964936 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) ==== 24+0+0 (secure 0 0 0) 0x7f6f5c005240 con 0x558258f9ce50 2024-09-05T01:35:01.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.422+0000 7f6f6cde2740 10 client.26581 fetch_fsmap learned FSMap version 57 2024-09-05T01:35:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.422+0000 7f6f6cde2740 1 -- 172.21.15.12:0/4123964936 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) -- 0x558259017440 con 0x558258f9ce50 2024-09-05T01:35:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.422+0000 7f6f4d600640 1 -- 172.21.15.12:0/4123964936 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f500d2e50 con 0x558258f9ce50 2024-09-05T01:35:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.422+0000 7f6f4d600640 1 -- 172.21.15.12:0/4123964936 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 57) ==== 8434+0+0 (secure 0 0 0) 0x7f6f5c02a020 con 0x558258f9ce50 2024-09-05T01:35:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.422+0000 7f6f6cde2740 10 client.26581 fetch_fsmap finished waiting for FSMap version 57 2024-09-05T01:35:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.422+0000 7f6f6cde2740 10 client.26581 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-05T01:35:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.422+0000 7f6f6cde2740 20 client.26581 populate_metadata read hostname 'smithi012' 2024-09-05T01:35:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.422+0000 7f6f6cde2740 1 --2- 172.21.15.12:0/4123964936 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x558259017a60 0x558259019e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.422+0000 7f6f6cde2740 4 client.26581 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:35:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.422+0000 7f6f6cde2740 1 -- 172.21.15.12:0/4123964936 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558258effe60 con 0x558259017a60 2024-09-05T01:35:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.423+0000 7f6f63400640 1 --2- 172.21.15.12:0/4123964936 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x558259017a60 0x558259019e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.423+0000 7f6f63400640 1 --2- 172.21.15.12:0/4123964936 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x558259017a60 0x558259019e80 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f56b0351b3a5b994 server_cookie=525b8d6427d265fb in_seq=0 out_seq=0 2024-09-05T01:35:01.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.423+0000 7f6f4d600640 10 client.26581 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:35:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.423+0000 7f6f4d600640 1 -- 172.21.15.12:0/4123964936 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558258effe60 con 0x558259017a60 2024-09-05T01:35:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.423+0000 7f6f4d600640 10 client.26581 handle_command_reply: tid=0 2024-09-05T01:35:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.423+0000 7f6f6cde2740 1 client.26581 shutdown 2024-09-05T01:35:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.424+0000 7f6f6cde2740 1 -- 172.21.15.12:0/4123964936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558258f9ce50 msgr2=0x558258f96150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.424+0000 7f6f6cde2740 1 --2- 172.21.15.12:0/4123964936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558258f9ce50 0x558258f96150 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00e870 tx=0x7f6f5c00de70 comp rx=0 tx=0).stop 2024-09-05T01:35:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.424+0000 7f6f6cde2740 1 -- 172.21.15.12:0/4123964936 shutdown_connections 2024-09-05T01:35:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.424+0000 7f6f6cde2740 1 --2- 172.21.15.12:0/4123964936 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x558259017a60 0x558259019e80 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.424+0000 7f6f6cde2740 1 --2- 172.21.15.12:0/4123964936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558258f9ce50 0x558258f96150 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.424+0000 7f6f6cde2740 1 --2- 172.21.15.12:0/4123964936 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558258f92590 0x558258fa5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.424+0000 7f6f6cde2740 1 --2- 172.21.15.12:0/4123964936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558258f91c70 0x558258fa4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.424+0000 7f6f6cde2740 1 -- 172.21.15.12:0/4123964936 >> 172.21.15.12:0/4123964936 conn(0x558258f8e200 msgr2=0x558258f9b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.424+0000 7f6f4d600640 0 client.26581 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:35:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.424+0000 7f6f6cde2740 1 -- 172.21.15.12:0/4123964936 shutdown_connections 2024-09-05T01:35:01.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.424+0000 7f6f6cde2740 1 -- 172.21.15.12:0/4123964936 wait complete. 2024-09-05T01:35:01.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.424+0000 7f6f6cde2740 20 client.26581 trim_cache size 0 max 16384 2024-09-05T01:35:01.431 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:35:01.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.425+0000 7f6f6a400640 1 -- 172.21.15.12:0/1952128311 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6f480a2d70 msgr2=0x7f6f480a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:01.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.425+0000 7f6f6a400640 1 --2- 172.21.15.12:0/1952128311 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6f480a2d70 0x7f6f480a5230 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6f5402a930 tx=0x7f6f540058d0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.425+0000 7f6f6a400640 1 -- 172.21.15.12:0/1952128311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f641049a0 msgr2=0x7f6f6419ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:01.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.425+0000 7f6f6a400640 1 --2- 172.21.15.12:0/1952128311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f641049a0 0x7f6f6419ab40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000e9f0 tx=0x7f6f5000edf0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.425+0000 7f6f6a400640 1 -- 172.21.15.12:0/1952128311 shutdown_connections 2024-09-05T01:35:01.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.425+0000 7f6f6a400640 1 --2- 172.21.15.12:0/1952128311 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6f480a2d70 0x7f6f480a5230 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.425+0000 7f6f6a400640 1 --2- 172.21.15.12:0/1952128311 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6f64109120 0x7f6f6419eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.425+0000 7f6f6a400640 1 --2- 172.21.15.12:0/1952128311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f641049a0 0x7f6f6419ab40 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.425+0000 7f6f6a400640 1 --2- 172.21.15.12:0/1952128311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f64103ff0 0x7f6f6419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:01.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.425+0000 7f6f6a400640 1 -- 172.21.15.12:0/1952128311 >> 172.21.15.12:0/1952128311 conn(0x7f6f640ffa90 msgr2=0x7f6f64100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:01.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.426+0000 7f6f6a400640 1 -- 172.21.15.12:0/1952128311 shutdown_connections 2024-09-05T01:35:01.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:01.426+0000 7f6f6a400640 1 -- 172.21.15.12:0/1952128311 wait complete. 2024-09-05T01:35:01.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:01 smithi012 ceph-mon[29942]: pgmap v320: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 420 op/s 2024-09-05T01:35:01.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:01 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:35:01.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:01 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:35:01.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:01 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:01 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:01 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:01 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:01 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:01 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:01 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:01 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:01 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:35:01.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:01 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:35:01.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:01 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:01 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:01 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:01 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:01 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:01 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:01 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:01 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:01 smithi145 ceph-mon[34376]: pgmap v320: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 420 op/s 2024-09-05T01:35:01.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:01 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:35:01.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:01 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:35:01.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:01 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:01 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:01 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:01 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:01 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:01 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:01 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:01 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:01 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:35:01.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:01 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:35:01.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:01 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:01 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:01 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:01 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.835 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:01 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.836 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:01 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.836 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:01 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.836 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:01 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:01 smithi151 ceph-mon[35013]: pgmap v320: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 420 op/s 2024-09-05T01:35:01.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:01 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:35:01.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:01 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:35:01.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:01 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:01 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:01 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:01 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:01 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:01 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:01 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:01 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:01 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:35:01.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:01 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:35:01.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:01 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:01 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:01 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:01 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.856 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:01 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.856 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:01 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.856 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:01 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:01.856 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:01 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:02.526 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-05T01:35:02.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:02 smithi012 ceph-mon[29942]: Adjusting osd_memory_target on smithi145 to 176.0M 2024-09-05T01:35:02.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:02 smithi012 ceph-mon[29942]: Unable to set osd_memory_target on smithi145 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-05T01:35:02.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:02 smithi012 ceph-mon[29942]: Adjusting osd_memory_target on smithi151 to 176.0M 2024-09-05T01:35:02.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:02 smithi012 ceph-mon[29942]: Unable to set osd_memory_target on smithi151 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-05T01:35:02.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:02 smithi145 ceph-mon[34376]: Adjusting osd_memory_target on smithi145 to 176.0M 2024-09-05T01:35:02.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:02 smithi145 ceph-mon[34376]: Unable to set osd_memory_target on smithi145 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-05T01:35:02.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:02 smithi145 ceph-mon[34376]: Adjusting osd_memory_target on smithi151 to 176.0M 2024-09-05T01:35:02.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:02 smithi145 ceph-mon[34376]: Unable to set osd_memory_target on smithi151 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-05T01:35:02.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:02 smithi151 ceph-mon[35013]: Adjusting osd_memory_target on smithi145 to 176.0M 2024-09-05T01:35:02.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:02 smithi151 ceph-mon[35013]: Unable to set osd_memory_target on smithi145 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-05T01:35:02.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:02 smithi151 ceph-mon[35013]: Adjusting osd_memory_target on smithi151 to 176.0M 2024-09-05T01:35:02.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:02 smithi151 ceph-mon[35013]: Unable to set osd_memory_target on smithi151 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-05T01:35:02.924 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:35:03.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:03 smithi012 ceph-mon[29942]: pgmap v321: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 321 op/s 2024-09-05T01:35:03.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:03 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:35:03.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:03 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:35:03.727 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:03 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:35:03.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.735+0000 7f87e5400640 1 -- 172.21.15.12:0/2435933235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87e0104010 msgr2=0x7f87e01043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:03.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.735+0000 7f87e5400640 1 --2- 172.21.15.12:0/2435933235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87e0104010 0x7f87e01043f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f87d0009900 tx=0x7f87d002a410 comp rx=0 tx=0).stop 2024-09-05T01:35:03.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.735+0000 7f87e5400640 1 -- 172.21.15.12:0/2435933235 shutdown_connections 2024-09-05T01:35:03.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.735+0000 7f87e5400640 1 --2- 172.21.15.12:0/2435933235 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87e0109140 0x7f87e0110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.735+0000 7f87e5400640 1 --2- 172.21.15.12:0/2435933235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87e01049c0 0x7f87e0108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.735+0000 7f87e5400640 1 --2- 172.21.15.12:0/2435933235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87e0104010 0x7f87e01043f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.735+0000 7f87e5400640 1 -- 172.21.15.12:0/2435933235 >> 172.21.15.12:0/2435933235 conn(0x7f87e00ffa50 msgr2=0x7f87e0101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:03.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.735+0000 7f87e5400640 1 -- 172.21.15.12:0/2435933235 shutdown_connections 2024-09-05T01:35:03.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.735+0000 7f87e5400640 1 -- 172.21.15.12:0/2435933235 wait complete. 2024-09-05T01:35:03.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.736+0000 7f87e5400640 1 Processor -- start 2024-09-05T01:35:03.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.737+0000 7f87e5400640 1 -- start start 2024-09-05T01:35:03.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.737+0000 7f87e5400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87e0104010 0x7f87e019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:03.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.737+0000 7f87e5400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87e01049c0 0x7f87e019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:03.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.737+0000 7f87e5400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87e0109140 0x7f87e019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:03.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.737+0000 7f87e5400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f87e01141b0 con 0x7f87e01049c0 2024-09-05T01:35:03.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.737+0000 7f87e5400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f87e0114030 con 0x7f87e0104010 2024-09-05T01:35:03.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.737+0000 7f87e5400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f87e0114330 con 0x7f87e0109140 2024-09-05T01:35:03.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.737+0000 7f87dde00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87e01049c0 0x7f87e019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:03.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.738+0000 7f87dde00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87e01049c0 0x7f87e019abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43990/0 (socket says 172.21.15.12:43990) 2024-09-05T01:35:03.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.738+0000 7f87dde00640 1 -- 172.21.15.12:0/3315037784 learned_addr learned my addr 172.21.15.12:0/3315037784 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:03.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.738+0000 7f87de800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87e0104010 0x7f87e019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:03.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.738+0000 7f87df200640 1 --2- 172.21.15.12:0/3315037784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87e0109140 0x7f87e019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:03.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.738+0000 7f87dde00640 1 -- 172.21.15.12:0/3315037784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87e0109140 msgr2=0x7f87e019ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:03.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.738+0000 7f87dde00640 1 --2- 172.21.15.12:0/3315037784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87e0109140 0x7f87e019ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.738+0000 7f87dde00640 1 -- 172.21.15.12:0/3315037784 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87e0104010 msgr2=0x7f87e019a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:03.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.738+0000 7f87dde00640 1 --2- 172.21.15.12:0/3315037784 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87e0104010 0x7f87e019a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.738+0000 7f87dde00640 1 -- 172.21.15.12:0/3315037784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e019f640 con 0x7f87e01049c0 2024-09-05T01:35:03.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.738+0000 7f87df200640 1 --2- 172.21.15.12:0/3315037784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87e0109140 0x7f87e019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:35:03.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.738+0000 7f87de800640 1 --2- 172.21.15.12:0/3315037784 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87e0104010 0x7f87e019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:35:03.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.739+0000 7f87dde00640 1 --2- 172.21.15.12:0/3315037784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87e01049c0 0x7f87e019abd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f87cc00e9f0 tx=0x7f87cc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:03.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.739+0000 7f87d7400640 1 -- 172.21.15.12:0/3315037784 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87cc00cd80 con 0x7f87e01049c0 2024-09-05T01:35:03.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.739+0000 7f87e5400640 1 -- 172.21.15.12:0/3315037784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87e019f930 con 0x7f87e01049c0 2024-09-05T01:35:03.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.739+0000 7f87d7400640 1 -- 172.21.15.12:0/3315037784 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87cc005500 con 0x7f87e01049c0 2024-09-05T01:35:03.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.739+0000 7f87d7400640 1 -- 172.21.15.12:0/3315037784 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87cc010690 con 0x7f87e01049c0 2024-09-05T01:35:03.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.739+0000 7f87e5400640 1 -- 172.21.15.12:0/3315037784 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87e01a7210 con 0x7f87e01049c0 2024-09-05T01:35:03.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.742+0000 7f87e805d740 1 Processor -- start 2024-09-05T01:35:03.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.743+0000 7f87e805d740 1 -- start start 2024-09-05T01:35:03.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.743+0000 7f87d7400640 1 -- 172.21.15.12:0/3315037784 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f87cc0046c0 con 0x7f87e01049c0 2024-09-05T01:35:03.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.743+0000 7f87e805d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565281a25c70 0x565281a26050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:03.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.743+0000 7f87e805d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565281a26590 0x565281a30910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:03.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.743+0000 7f87e805d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565281a30e50 0x565281a33240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:03.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.743+0000 7f87e805d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56528198c3e0 con 0x565281a30e50 2024-09-05T01:35:03.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.743+0000 7f87e805d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x565281933d80 con 0x565281a25c70 2024-09-05T01:35:03.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.743+0000 7f87e805d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5652819883a0 con 0x565281a26590 2024-09-05T01:35:03.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.744+0000 7f87de800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565281a26590 0x565281a30910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:03.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.744+0000 7f87de800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565281a26590 0x565281a30910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:57488/0 (socket says 172.21.15.12:57488) 2024-09-05T01:35:03.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.744+0000 7f87de800640 1 -- 172.21.15.12:0/1868872417 learned_addr learned my addr 172.21.15.12:0/1868872417 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:03.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.744+0000 7f87df200640 1 --2- 172.21.15.12:0/1868872417 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565281a25c70 0x565281a26050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:03.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.744+0000 7f87de800640 1 -- 172.21.15.12:0/1868872417 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565281a25c70 msgr2=0x565281a26050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:03.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.744+0000 7f87de800640 1 --2- 172.21.15.12:0/1868872417 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565281a25c70 0x565281a26050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.744+0000 7f87de800640 1 -- 172.21.15.12:0/1868872417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565281a30e50 msgr2=0x565281a33240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:03.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.744+0000 7f87de800640 1 --2- 172.21.15.12:0/1868872417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565281a30e50 0x565281a33240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.744+0000 7f87de800640 1 -- 172.21.15.12:0/1868872417 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565281952ae0 con 0x565281a26590 2024-09-05T01:35:03.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.744+0000 7f87df200640 1 --2- 172.21.15.12:0/1868872417 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565281a25c70 0x565281a26050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:35:03.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.745+0000 7f87de800640 1 --2- 172.21.15.12:0/1868872417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565281a26590 0x565281a30910 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f87d0009900 tx=0x7f87d00043f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=783563ab117113fa server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:03.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.745+0000 7f87cb400640 1 -- 172.21.15.12:0/1868872417 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d0035040 con 0x565281a26590 2024-09-05T01:35:03.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.745+0000 7f87cb400640 1 -- 172.21.15.12:0/1868872417 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87d0004760 con 0x565281a26590 2024-09-05T01:35:03.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.745+0000 7f87cb400640 1 -- 172.21.15.12:0/1868872417 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d00039e0 con 0x565281a26590 2024-09-05T01:35:03.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.745+0000 7f87d7400640 1 --2- 172.21.15.12:0/3315037784 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f87c40a2d70 0x7f87c40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:03.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.746+0000 7f87d7400640 1 -- 172.21.15.12:0/3315037784 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f87cc0cf980 con 0x7f87e01049c0 2024-09-05T01:35:03.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.746+0000 7f87e805d740 1 -- 172.21.15.12:0/1868872417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565281a26590 msgr2=0x565281a30910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:03.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.746+0000 7f87e805d740 1 --2- 172.21.15.12:0/1868872417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565281a26590 0x565281a30910 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f87d0009900 tx=0x7f87d00043f0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.746+0000 7f87df200640 1 --2- 172.21.15.12:0/3315037784 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f87c40a2d70 0x7f87c40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:03.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.746+0000 7f87e805d740 1 -- 172.21.15.12:0/1868872417 shutdown_connections 2024-09-05T01:35:03.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.746+0000 7f87e805d740 1 --2- 172.21.15.12:0/1868872417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565281a30e50 0x565281a33240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.746+0000 7f87e805d740 1 --2- 172.21.15.12:0/1868872417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565281a26590 0x565281a30910 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.746+0000 7f87e805d740 1 --2- 172.21.15.12:0/1868872417 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565281a25c70 0x565281a26050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.746+0000 7f87e805d740 1 -- 172.21.15.12:0/1868872417 >> 172.21.15.12:0/1868872417 conn(0x565281a22200 msgr2=0x565281a225e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:03.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.746+0000 7f87e805d740 1 -- 172.21.15.12:0/1868872417 shutdown_connections 2024-09-05T01:35:03.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.746+0000 7f87e805d740 1 -- 172.21.15.12:0/1868872417 wait complete. 2024-09-05T01:35:03.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.747+0000 7f87df200640 1 --2- 172.21.15.12:0/3315037784 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f87c40a2d70 0x7f87c40a5230 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f87d8005fd0 tx=0x7f87d8009540 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:03.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.747+0000 7f87e805d740 1 -- start start 2024-09-05T01:35:03.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.747+0000 7f87e805d740 1 Processor -- start 2024-09-05T01:35:03.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.748+0000 7f87e805d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565281a25c70 0x565281a2de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:03.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.748+0000 7f87e805d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565281a26590 0x565281a2e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:03.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.748+0000 7f87e805d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565281a30e50 0x565281a2e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:03.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.748+0000 7f87e805d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x565281a33a20 con 0x565281a25c70 2024-09-05T01:35:03.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.748+0000 7f87e805d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5652819470f0 con 0x565281a30e50 2024-09-05T01:35:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.748+0000 7f87e805d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x565281a33ba0 con 0x565281a26590 2024-09-05T01:35:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.748+0000 7f87e805d740 10 client.0 _ll_register_callbacks cb 0x56528192ebd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:35:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.748+0000 7f87de800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565281a25c70 0x565281a2de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.748+0000 7f87de800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565281a25c70 0x565281a2de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44012/0 (socket says 172.21.15.12:44012) 2024-09-05T01:35:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.748+0000 7f87de800640 1 -- 172.21.15.12:0/4221579849 learned_addr learned my addr 172.21.15.12:0/4221579849 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.748+0000 7f87df200640 1 --2- 172.21.15.12:0/4221579849 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565281a30e50 0x565281a2e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.748+0000 7f87dde00640 1 --2- 172.21.15.12:0/4221579849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565281a26590 0x565281a2e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.749+0000 7f87de800640 1 -- 172.21.15.12:0/4221579849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565281a26590 msgr2=0x565281a2e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.749+0000 7f87de800640 1 --2- 172.21.15.12:0/4221579849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565281a26590 0x565281a2e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.749+0000 7f87de800640 1 -- 172.21.15.12:0/4221579849 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565281a30e50 msgr2=0x565281a2e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.749+0000 7f87de800640 1 --2- 172.21.15.12:0/4221579849 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565281a30e50 0x565281a2e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.749+0000 7f87de800640 1 -- 172.21.15.12:0/4221579849 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652816fd3c0 con 0x565281a25c70 2024-09-05T01:35:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.749+0000 7f87de800640 1 --2- 172.21.15.12:0/4221579849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565281a25c70 0x565281a2de40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f87d0004b40 tx=0x7f87d0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e90f661a3fbcfbf server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:03.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.749+0000 7f87bfe00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:35:03.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.749+0000 7f87bfe00640 1 -- 172.21.15.12:0/4221579849 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d0052060 con 0x565281a25c70 2024-09-05T01:35:03.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.749+0000 7f87bfe00640 1 -- 172.21.15.12:0/4221579849 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f87d0005130 con 0x565281a25c70 2024-09-05T01:35:03.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.749+0000 7f87e805d740 1 -- 172.21.15.12:0/4221579849 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87d0004760 con 0x565281a25c70 2024-09-05T01:35:03.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.750+0000 7f87bfe00640 1 -- 172.21.15.12:0/4221579849 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f87d0035070 con 0x565281a25c70 2024-09-05T01:35:03.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.750+0000 7f87e805d740 10 client.16539 fetch_fsmap learned FSMap version 58 2024-09-05T01:35:03.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.750+0000 7f87e805d740 1 -- 172.21.15.12:0/4221579849 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x565281a3fb00 con 0x565281a25c70 2024-09-05T01:35:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.750+0000 7f87bfe00640 1 -- 172.21.15.12:0/4221579849 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87d0004760 con 0x565281a25c70 2024-09-05T01:35:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.750+0000 7f87bfe00640 1 -- 172.21.15.12:0/4221579849 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 58) ==== 8430+0+0 (secure 0 0 0) 0x7f87d00315b0 con 0x565281a25c70 2024-09-05T01:35:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.751+0000 7f87e805d740 10 client.16539 fetch_fsmap finished waiting for FSMap version 58 2024-09-05T01:35:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.751+0000 7f87e805d740 10 client.16539 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T01:35:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.751+0000 7f87e805d740 20 client.16539 populate_metadata read hostname 'smithi012' 2024-09-05T01:35:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.751+0000 7f87e805d740 1 --2- 172.21.15.12:0/4221579849 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x565281a40e50 0x565281a43240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.751+0000 7f87e805d740 4 client.16539 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:35:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.751+0000 7f87e805d740 1 -- 172.21.15.12:0/4221579849 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565281999950 con 0x565281a40e50 2024-09-05T01:35:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.751+0000 7f87dde00640 1 --2- 172.21.15.12:0/4221579849 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x565281a40e50 0x565281a43240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.752+0000 7f87dde00640 1 --2- 172.21.15.12:0/4221579849 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x565281a40e50 0x565281a43240 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=35960ad5c4eb5e20 server_cookie=e42e11e1087b0a3b in_seq=0 out_seq=0 2024-09-05T01:35:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.752+0000 7f87bfe00640 10 client.16539 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:35:03.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.752+0000 7f87bfe00640 1 -- 172.21.15.12:0/4221579849 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565281999950 con 0x565281a40e50 2024-09-05T01:35:03.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.752+0000 7f87bfe00640 10 client.16539 handle_command_reply: tid=0 2024-09-05T01:35:03.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.752+0000 7f87e805d740 1 client.16539 shutdown 2024-09-05T01:35:03.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.753+0000 7f87e805d740 1 -- 172.21.15.12:0/4221579849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565281a25c70 msgr2=0x565281a2de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:03.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.753+0000 7f87e805d740 1 --2- 172.21.15.12:0/4221579849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565281a25c70 0x565281a2de40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f87d0004b40 tx=0x7f87d0000bc0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.753+0000 7f87e805d740 1 -- 172.21.15.12:0/4221579849 shutdown_connections 2024-09-05T01:35:03.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.753+0000 7f87e805d740 1 --2- 172.21.15.12:0/4221579849 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x565281a40e50 0x565281a43240 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.753+0000 7f87e805d740 1 --2- 172.21.15.12:0/4221579849 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565281a30e50 0x565281a2e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.753+0000 7f87e805d740 1 --2- 172.21.15.12:0/4221579849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565281a26590 0x565281a2e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.753+0000 7f87e805d740 1 --2- 172.21.15.12:0/4221579849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565281a25c70 0x565281a2de40 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.753+0000 7f87e805d740 1 -- 172.21.15.12:0/4221579849 >> 172.21.15.12:0/4221579849 conn(0x565281a22200 msgr2=0x565281a27ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:03.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.753+0000 7f87bfe00640 0 client.16539 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:35:03.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.753+0000 7f87e805d740 1 -- 172.21.15.12:0/4221579849 shutdown_connections 2024-09-05T01:35:03.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.753+0000 7f87e805d740 1 -- 172.21.15.12:0/4221579849 wait complete. 2024-09-05T01:35:03.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.754+0000 7f87e805d740 20 client.16539 trim_cache size 0 max 16384 2024-09-05T01:35:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.768+0000 7f87e805d740 1 Processor -- start 2024-09-05T01:35:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.768+0000 7f87e805d740 1 -- start start 2024-09-05T01:35:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.768+0000 7f87e805d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565281a25c70 0x565281a2e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:03.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.768+0000 7f87e805d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565281a26590 0x565281a45e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:03.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.768+0000 7f87e805d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565281a30e50 0x565281a463c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:03.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.768+0000 7f87e805d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f87e01afb00 con 0x565281a25c70 2024-09-05T01:35:03.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.768+0000 7f87e805d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f87e01b17f0 con 0x565281a26590 2024-09-05T01:35:03.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.768+0000 7f87e805d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f87e01b01d0 con 0x565281a30e50 2024-09-05T01:35:03.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.768+0000 7f87de800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565281a25c70 0x565281a2e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:03.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.769+0000 7f87de800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565281a25c70 0x565281a2e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44022/0 (socket says 172.21.15.12:44022) 2024-09-05T01:35:03.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.769+0000 7f87de800640 1 -- 172.21.15.12:0/1999011230 learned_addr learned my addr 172.21.15.12:0/1999011230 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:03.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.769+0000 7f87dde00640 1 --2- 172.21.15.12:0/1999011230 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565281a26590 0x565281a45e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:03.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.769+0000 7f87df200640 1 --2- 172.21.15.12:0/1999011230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565281a30e50 0x565281a463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:03.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.769+0000 7f87dde00640 1 -- 172.21.15.12:0/1999011230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565281a30e50 msgr2=0x565281a463c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:03.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.769+0000 7f87dde00640 1 --2- 172.21.15.12:0/1999011230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565281a30e50 0x565281a463c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.769+0000 7f87dde00640 1 -- 172.21.15.12:0/1999011230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565281a25c70 msgr2=0x565281a2e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.769+0000 7f87dde00640 1 --2- 172.21.15.12:0/1999011230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565281a25c70 0x565281a2e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.769+0000 7f87dde00640 1 -- 172.21.15.12:0/1999011230 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565281a1d770 con 0x565281a26590 2024-09-05T01:35:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.769+0000 7f87de800640 1 --2- 172.21.15.12:0/1999011230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565281a25c70 0x565281a2e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:35:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.769+0000 7f87dde00640 1 --2- 172.21.15.12:0/1999011230 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565281a26590 0x565281a45e80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f87cc0cd030 tx=0x7f87cc009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f555d92fd911059 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.770+0000 7f87caa00640 1 -- 172.21.15.12:0/1999011230 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87cc0a01b0 con 0x565281a26590 2024-09-05T01:35:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.770+0000 7f87caa00640 1 -- 172.21.15.12:0/1999011230 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87cc0a4a70 con 0x565281a26590 2024-09-05T01:35:03.772 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.770+0000 7f87caa00640 1 -- 172.21.15.12:0/1999011230 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87cc09b250 con 0x565281a26590 2024-09-05T01:35:03.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.770+0000 7f87e805d740 1 -- 172.21.15.12:0/1999011230 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565281a26590 msgr2=0x565281a45e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:03.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.770+0000 7f87e805d740 1 --2- 172.21.15.12:0/1999011230 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565281a26590 0x565281a45e80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f87cc0cd030 tx=0x7f87cc009310 comp rx=0 tx=0).stop 2024-09-05T01:35:03.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.771+0000 7f87e805d740 1 -- 172.21.15.12:0/1999011230 shutdown_connections 2024-09-05T01:35:03.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.771+0000 7f87e805d740 1 --2- 172.21.15.12:0/1999011230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565281a30e50 0x565281a463c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.771+0000 7f87e805d740 1 --2- 172.21.15.12:0/1999011230 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565281a26590 0x565281a45e80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.771+0000 7f87e805d740 1 --2- 172.21.15.12:0/1999011230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565281a25c70 0x565281a2e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.771+0000 7f87e805d740 1 -- 172.21.15.12:0/1999011230 >> 172.21.15.12:0/1999011230 conn(0x565281a22200 msgr2=0x565281a2de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:03.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.771+0000 7f87e805d740 1 -- 172.21.15.12:0/1999011230 shutdown_connections 2024-09-05T01:35:03.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.771+0000 7f87e805d740 1 -- 172.21.15.12:0/1999011230 wait complete. 2024-09-05T01:35:03.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.771+0000 7f87e805d740 1 -- start start 2024-09-05T01:35:03.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.772+0000 7f87e805d740 1 Processor -- start 2024-09-05T01:35:03.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.772+0000 7f87e805d740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565281a25c70 0x565281a45e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:03.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.772+0000 7f87e805d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565281a26590 0x565281a463d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.772+0000 7f87e805d740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565281a30e50 0x565281a44410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.772+0000 7f87e805d740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f87e01b1090 con 0x565281a30e50 2024-09-05T01:35:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.772+0000 7f87e805d740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f87e01b0900 con 0x565281a25c70 2024-09-05T01:35:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.772+0000 7f87e805d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f87e01adb00 con 0x565281a26590 2024-09-05T01:35:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.772+0000 7f87e805d740 10 client.0 _ll_register_callbacks cb 0x7f87d0005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:35:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.772+0000 7f87de800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565281a25c70 0x565281a45e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.772+0000 7f87de800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565281a25c70 0x565281a45e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:37708/0 (socket says 172.21.15.12:37708) 2024-09-05T01:35:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.772+0000 7f87dde00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565281a26590 0x565281a463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.772+0000 7f87de800640 1 -- 172.21.15.12:0/2156994916 learned_addr learned my addr 172.21.15.12:0/2156994916 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.773+0000 7f87de800640 1 -- 172.21.15.12:0/2156994916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565281a26590 msgr2=0x565281a463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.773+0000 7f87de800640 1 --2- 172.21.15.12:0/2156994916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565281a26590 0x565281a463d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.773+0000 7f87de800640 1 -- 172.21.15.12:0/2156994916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565281a30e50 msgr2=0x565281a44410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.773+0000 7f87de800640 1 --2- 172.21.15.12:0/2156994916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565281a30e50 0x565281a44410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.773+0000 7f87de800640 1 -- 172.21.15.12:0/2156994916 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565281a23390 con 0x565281a25c70 2024-09-05T01:35:03.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.773+0000 7f87dde00640 1 --2- 172.21.15.12:0/2156994916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565281a26590 0x565281a463d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:35:03.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.773+0000 7f87de800640 1 --2- 172.21.15.12:0/2156994916 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565281a25c70 0x565281a45e90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f87d0031a00 tx=0x7f87d0031e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e34def3015f06f2b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:03.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.773+0000 7f87bfe00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:35:03.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.773+0000 7f87bfe00640 1 -- 172.21.15.12:0/2156994916 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87d0052030 con 0x565281a25c70 2024-09-05T01:35:03.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.774+0000 7f87bfe00640 1 -- 172.21.15.12:0/2156994916 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f87d0005340 con 0x565281a25c70 2024-09-05T01:35:03.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.774+0000 7f87e805d740 1 -- 172.21.15.12:0/2156994916 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87cc0a4a70 con 0x565281a25c70 2024-09-05T01:35:03.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.774+0000 7f87bfe00640 1 -- 172.21.15.12:0/2156994916 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f87d0065050 con 0x565281a25c70 2024-09-05T01:35:03.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.774+0000 7f87e805d740 10 client.26615 fetch_fsmap learned FSMap version 58 2024-09-05T01:35:03.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.774+0000 7f87e805d740 1 -- 172.21.15.12:0/2156994916 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x565281ab48b0 con 0x565281a25c70 2024-09-05T01:35:03.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.774+0000 7f87bfe00640 1 -- 172.21.15.12:0/2156994916 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87cc0a4a70 con 0x565281a25c70 2024-09-05T01:35:03.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.775+0000 7f87bfe00640 1 -- 172.21.15.12:0/2156994916 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 58) ==== 8430+0+0 (secure 0 0 0) 0x7f87d0003ad0 con 0x565281a25c70 2024-09-05T01:35:03.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.775+0000 7f87e805d740 10 client.26615 fetch_fsmap finished waiting for FSMap version 58 2024-09-05T01:35:03.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.775+0000 7f87e805d740 10 client.26615 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T01:35:03.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.775+0000 7f87e805d740 20 client.26615 populate_metadata read hostname 'smithi012' 2024-09-05T01:35:03.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.775+0000 7f87e805d740 1 --2- 172.21.15.12:0/2156994916 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x565281ab5050 0x565281ab7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:03.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.775+0000 7f87e805d740 4 client.26615 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:35:03.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.775+0000 7f87e805d740 1 -- 172.21.15.12:0/2156994916 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "damage ls"}) -- 0x565281993e60 con 0x565281ab5050 2024-09-05T01:35:03.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.775+0000 7f87dde00640 1 --2- 172.21.15.12:0/2156994916 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x565281ab5050 0x565281ab7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:03.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.776+0000 7f87dde00640 1 --2- 172.21.15.12:0/2156994916 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x565281ab5050 0x565281ab7470 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=53c4e9e6fa9e2e4c server_cookie=aee076cf69b1470d in_seq=0 out_seq=0 2024-09-05T01:35:03.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.776+0000 7f87bfe00640 10 client.26615 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:35:03.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.776+0000 7f87bfe00640 1 -- 172.21.15.12:0/2156994916 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x565281993e60 con 0x565281ab5050 2024-09-05T01:35:03.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.776+0000 7f87bfe00640 10 client.26615 handle_command_reply: tid=0 2024-09-05T01:35:03.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.776+0000 7f87e805d740 1 client.26615 shutdown 2024-09-05T01:35:03.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.776+0000 7f87e805d740 1 -- 172.21.15.12:0/2156994916 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565281a25c70 msgr2=0x565281a45e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:03.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.776+0000 7f87e805d740 1 --2- 172.21.15.12:0/2156994916 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565281a25c70 0x565281a45e90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f87d0031a00 tx=0x7f87d0031e20 comp rx=0 tx=0).stop 2024-09-05T01:35:03.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.776+0000 7f87e805d740 1 -- 172.21.15.12:0/2156994916 shutdown_connections 2024-09-05T01:35:03.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.776+0000 7f87e805d740 1 --2- 172.21.15.12:0/2156994916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565281a30e50 0x565281a44410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.776+0000 7f87e805d740 1 --2- 172.21.15.12:0/2156994916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565281a26590 0x565281a463d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.776+0000 7f87e805d740 1 --2- 172.21.15.12:0/2156994916 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x565281ab5050 0x565281ab7470 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.776+0000 7f87e805d740 1 --2- 172.21.15.12:0/2156994916 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x565281a25c70 0x565281a45e90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.776+0000 7f87e805d740 1 -- 172.21.15.12:0/2156994916 >> 172.21.15.12:0/2156994916 conn(0x565281a22200 msgr2=0x565281a2e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:03.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.777+0000 7f87bfe00640 0 client.26615 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:35:03.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.777+0000 7f87e805d740 1 -- 172.21.15.12:0/2156994916 shutdown_connections 2024-09-05T01:35:03.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.777+0000 7f87e805d740 1 -- 172.21.15.12:0/2156994916 wait complete. 2024-09-05T01:35:03.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.777+0000 7f87e805d740 20 client.26615 trim_cache size 0 max 16384 2024-09-05T01:35:03.781 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:35:03.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.778+0000 7f87e5400640 1 -- 172.21.15.12:0/3315037784 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f87c40a2d70 msgr2=0x7f87c40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:03.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.778+0000 7f87e5400640 1 --2- 172.21.15.12:0/3315037784 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f87c40a2d70 0x7f87c40a5230 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f87d8005fd0 tx=0x7f87d8009540 comp rx=0 tx=0).stop 2024-09-05T01:35:03.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.778+0000 7f87e5400640 1 -- 172.21.15.12:0/3315037784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87e01049c0 msgr2=0x7f87e019abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:03.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.778+0000 7f87e5400640 1 --2- 172.21.15.12:0/3315037784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87e01049c0 0x7f87e019abd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f87cc00e9f0 tx=0x7f87cc00edf0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.778+0000 7f87e5400640 1 -- 172.21.15.12:0/3315037784 shutdown_connections 2024-09-05T01:35:03.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.778+0000 7f87e5400640 1 --2- 172.21.15.12:0/3315037784 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f87c40a2d70 0x7f87c40a5230 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.778+0000 7f87e5400640 1 --2- 172.21.15.12:0/3315037784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87e0109140 0x7f87e019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.778+0000 7f87e5400640 1 --2- 172.21.15.12:0/3315037784 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87e01049c0 0x7f87e019abd0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.778+0000 7f87e5400640 1 --2- 172.21.15.12:0/3315037784 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f87e0104010 0x7f87e019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:03.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.778+0000 7f87e5400640 1 -- 172.21.15.12:0/3315037784 >> 172.21.15.12:0/3315037784 conn(0x7f87e00ffa50 msgr2=0x7f87e0100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:03.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.778+0000 7f87e5400640 1 -- 172.21.15.12:0/3315037784 shutdown_connections 2024-09-05T01:35:03.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:03.778+0000 7f87e5400640 1 -- 172.21.15.12:0/3315037784 wait complete. 2024-09-05T01:35:03.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:03 smithi145 ceph-mon[34376]: pgmap v321: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 321 op/s 2024-09-05T01:35:03.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:03 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:35:03.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:03 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:35:03.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:03 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:35:03.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:03 smithi151 ceph-mon[35013]: pgmap v321: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 321 op/s 2024-09-05T01:35:03.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:03 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:35:03.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:03 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:35:03.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:03 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:35:04.574 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-05T01:35:04.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:04 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:04.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:04 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:04.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:04 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:04.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:04 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:04.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:04 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:04.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:04 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:04.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:04 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:04.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:04 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:04.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:04 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:35:04.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:04 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:35:04.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:04 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:35:04.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:04 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:04.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:04 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:04.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:04 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:04.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:04 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:04.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:04 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:04.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:04 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:04.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:04 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:04.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:04 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:04.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:04 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:35:04.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:04 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:35:04.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:04 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:35:04.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:04 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:04.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:04 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:04.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:04 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:04.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:04 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:04.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:04 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:04.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:04 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:04.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:04 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:04.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:04 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-05T01:35:04.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:04 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:35:04.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:04 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:35:04.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:04 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:35:04.989 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:35:05.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.552+0000 7f7349c00640 1 -- 172.21.15.12:0/2940268521 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f734410d530 msgr2=0x7f73441150b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:05.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.552+0000 7f7349c00640 1 --2- 172.21.15.12:0/2940268521 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f734410d530 0x7f73441150b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f733c009ca0 tx=0x7f733c02a8b0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.552+0000 7f7349c00640 1 -- 172.21.15.12:0/2940268521 shutdown_connections 2024-09-05T01:35:05.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.552+0000 7f7349c00640 1 --2- 172.21.15.12:0/2940268521 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f734410d530 0x7f73441150b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.552+0000 7f7349c00640 1 --2- 172.21.15.12:0/2940268521 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7344108e00 0x7f734410ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.552+0000 7f7349c00640 1 --2- 172.21.15.12:0/2940268521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7344108450 0x7f7344108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.552+0000 7f7349c00640 1 -- 172.21.15.12:0/2940268521 >> 172.21.15.12:0/2940268521 conn(0x7f7344077ba0 msgr2=0x7f7344079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:05.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.552+0000 7f7349c00640 1 -- 172.21.15.12:0/2940268521 shutdown_connections 2024-09-05T01:35:05.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.552+0000 7f7349c00640 1 -- 172.21.15.12:0/2940268521 wait complete. 2024-09-05T01:35:05.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.553+0000 7f7349c00640 1 Processor -- start 2024-09-05T01:35:05.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.554+0000 7f7349c00640 1 -- start start 2024-09-05T01:35:05.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.554+0000 7f7349c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7344108450 0x7f73441a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:05.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.554+0000 7f7349c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7344108e00 0x7f73441a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:05.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.554+0000 7f7349c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f734410d530 0x7f734419e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:05.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.554+0000 7f7349c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f73441185b0 con 0x7f7344108e00 2024-09-05T01:35:05.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.554+0000 7f7349c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7344118430 con 0x7f734410d530 2024-09-05T01:35:05.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.554+0000 7f7349c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7344118730 con 0x7f7344108450 2024-09-05T01:35:05.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.554+0000 7f7343400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f734410d530 0x7f734419e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:05.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.554+0000 7f7343400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f734410d530 0x7f734419e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:37724/0 (socket says 172.21.15.12:37724) 2024-09-05T01:35:05.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.554+0000 7f7343400640 1 -- 172.21.15.12:0/111810266 learned_addr learned my addr 172.21.15.12:0/111810266 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:05.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.554+0000 7f7342000640 1 --2- 172.21.15.12:0/111810266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7344108e00 0x7f73441a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:05.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.554+0000 7f7342a00640 1 --2- 172.21.15.12:0/111810266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7344108450 0x7f73441a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:05.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.555+0000 7f7343400640 1 -- 172.21.15.12:0/111810266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7344108450 msgr2=0x7f73441a4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:05.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.555+0000 7f7343400640 1 --2- 172.21.15.12:0/111810266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7344108450 0x7f73441a4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.555+0000 7f7343400640 1 -- 172.21.15.12:0/111810266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7344108e00 msgr2=0x7f73441a4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:05.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.555+0000 7f7343400640 1 --2- 172.21.15.12:0/111810266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7344108e00 0x7f73441a4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.555+0000 7f7343400640 1 -- 172.21.15.12:0/111810266 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734419ef90 con 0x7f734410d530 2024-09-05T01:35:05.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.555+0000 7f7343400640 1 --2- 172.21.15.12:0/111810266 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f734410d530 0x7f734419e7f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f733c003e60 tx=0x7f733c003e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:05.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.556+0000 7f733b400640 1 -- 172.21.15.12:0/111810266 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c030e00 con 0x7f734410d530 2024-09-05T01:35:05.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.556+0000 7f733b400640 1 -- 172.21.15.12:0/111810266 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f733c040070 con 0x7f734410d530 2024-09-05T01:35:05.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.556+0000 7f7349c00640 1 -- 172.21.15.12:0/111810266 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f734419f220 con 0x7f734410d530 2024-09-05T01:35:05.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.556+0000 7f733b400640 1 -- 172.21.15.12:0/111810266 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c045a40 con 0x7f734410d530 2024-09-05T01:35:05.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.556+0000 7f7349c00640 1 -- 172.21.15.12:0/111810266 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73441ab4d0 con 0x7f734410d530 2024-09-05T01:35:05.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.559+0000 7f734c5c0740 1 Processor -- start 2024-09-05T01:35:05.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.559+0000 7f733b400640 1 -- 172.21.15.12:0/111810266 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f733c004040 con 0x7f734410d530 2024-09-05T01:35:05.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.559+0000 7f734c5c0740 1 -- start start 2024-09-05T01:35:05.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.560+0000 7f734c5c0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f110bc70 0x5606f110c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:05.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.560+0000 7f734c5c0740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f110c590 0x5606f1116910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:05.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.560+0000 7f734c5c0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606f1116e50 0x5606f1119240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:05.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.560+0000 7f734c5c0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5606f10723e0 con 0x5606f110bc70 2024-09-05T01:35:05.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.560+0000 7f734c5c0740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5606f1019d80 con 0x5606f110c590 2024-09-05T01:35:05.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.560+0000 7f734c5c0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5606f106e3a0 con 0x5606f1116e50 2024-09-05T01:35:05.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.560+0000 7f7342a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f110c590 0x5606f1116910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:05.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.560+0000 7f7342a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f110c590 0x5606f1116910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:37728/0 (socket says 172.21.15.12:37728) 2024-09-05T01:35:05.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.560+0000 7f7342a00640 1 -- 172.21.15.12:0/2621546386 learned_addr learned my addr 172.21.15.12:0/2621546386 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:05.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.560+0000 7f7342000640 1 --2- 172.21.15.12:0/2621546386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f110bc70 0x5606f110c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:05.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.561+0000 7f7342000640 1 --2- 172.21.15.12:0/2621546386 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606f1116e50 0x5606f1119240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:05.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.561+0000 7f7342a00640 1 -- 172.21.15.12:0/2621546386 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606f1116e50 msgr2=0x5606f1119240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:05.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.561+0000 7f7342a00640 1 --2- 172.21.15.12:0/2621546386 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606f1116e50 0x5606f1119240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.561+0000 7f7342a00640 1 -- 172.21.15.12:0/2621546386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f110bc70 msgr2=0x5606f110c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:05.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.561+0000 7f7342a00640 1 --2- 172.21.15.12:0/2621546386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f110bc70 0x5606f110c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.561+0000 7f7342a00640 1 -- 172.21.15.12:0/2621546386 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606f1038ae0 con 0x5606f110c590 2024-09-05T01:35:05.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.561+0000 7f7342000640 1 --2- 172.21.15.12:0/2621546386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f110bc70 0x5606f110c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:35:05.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.561+0000 7f7342a00640 1 --2- 172.21.15.12:0/2621546386 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f110c590 0x5606f1116910 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7334009d20 tx=0x7f7334011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd17c9a055113fa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:05.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.561+0000 7f733b400640 1 --2- 172.21.15.12:0/111810266 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f73280a2e40 0x7f73280a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:05.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.561+0000 7f732fe00640 1 -- 172.21.15.12:0/2621546386 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733401e070 con 0x5606f110c590 2024-09-05T01:35:05.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.561+0000 7f732fe00640 1 -- 172.21.15.12:0/2621546386 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7334019b10 con 0x5606f110c590 2024-09-05T01:35:05.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.561+0000 7f732fe00640 1 -- 172.21.15.12:0/2621546386 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733400eb90 con 0x5606f110c590 2024-09-05T01:35:05.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.561+0000 7f733b400640 1 -- 172.21.15.12:0/111810266 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f733c0f0380 con 0x7f734410d530 2024-09-05T01:35:05.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.562+0000 7f7342000640 1 --2- 172.21.15.12:0/111810266 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f73280a2e40 0x7f73280a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:05.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.562+0000 7f734c5c0740 1 -- 172.21.15.12:0/2621546386 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f110c590 msgr2=0x5606f1116910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:05.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.562+0000 7f734c5c0740 1 --2- 172.21.15.12:0/2621546386 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f110c590 0x5606f1116910 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7334009d20 tx=0x7f7334011810 comp rx=0 tx=0).stop 2024-09-05T01:35:05.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.562+0000 7f734c5c0740 1 -- 172.21.15.12:0/2621546386 shutdown_connections 2024-09-05T01:35:05.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.562+0000 7f734c5c0740 1 --2- 172.21.15.12:0/2621546386 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606f1116e50 0x5606f1119240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.562+0000 7f734c5c0740 1 --2- 172.21.15.12:0/2621546386 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f110c590 0x5606f1116910 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.562+0000 7f734c5c0740 1 --2- 172.21.15.12:0/2621546386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f110bc70 0x5606f110c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.562+0000 7f734c5c0740 1 -- 172.21.15.12:0/2621546386 >> 172.21.15.12:0/2621546386 conn(0x5606f1108200 msgr2=0x5606f11085e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:05.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.562+0000 7f7342000640 1 --2- 172.21.15.12:0/111810266 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f73280a2e40 0x7f73280a5300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x5606f1109580 tx=0x7f7330009770 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:05.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.562+0000 7f734c5c0740 1 -- 172.21.15.12:0/2621546386 shutdown_connections 2024-09-05T01:35:05.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.562+0000 7f734c5c0740 1 -- 172.21.15.12:0/2621546386 wait complete. 2024-09-05T01:35:05.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.563+0000 7f734c5c0740 1 -- start start 2024-09-05T01:35:05.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.563+0000 7f734c5c0740 1 Processor -- start 2024-09-05T01:35:05.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.564+0000 7f734c5c0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f110bc70 0x5606f1113cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:05.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.564+0000 7f734c5c0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606f110c590 0x5606f11141f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:05.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.564+0000 7f734c5c0740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f1116e50 0x5606f1114730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:05.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.564+0000 7f734c5c0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5606f1119a20 con 0x5606f110bc70 2024-09-05T01:35:05.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.564+0000 7f734c5c0740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5606f102d0f0 con 0x5606f1116e50 2024-09-05T01:35:05.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.564+0000 7f734c5c0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5606f1119ba0 con 0x5606f110c590 2024-09-05T01:35:05.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.564+0000 7f734c5c0740 10 client.0 _ll_register_callbacks cb 0x5606f1014bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:35:05.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.564+0000 7f7342a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f110bc70 0x5606f1113cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:05.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.564+0000 7f7342a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f110bc70 0x5606f1113cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44074/0 (socket says 172.21.15.12:44074) 2024-09-05T01:35:05.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.564+0000 7f7342a00640 1 -- 172.21.15.12:0/2333674183 learned_addr learned my addr 172.21.15.12:0/2333674183 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:05.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.564+0000 7f7342000640 1 --2- 172.21.15.12:0/2333674183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606f110c590 0x5606f11141f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:05.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.564+0000 7f7343400640 1 --2- 172.21.15.12:0/2333674183 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f1116e50 0x5606f1114730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:05.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.565+0000 7f7342a00640 1 -- 172.21.15.12:0/2333674183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606f110c590 msgr2=0x5606f11141f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:05.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.565+0000 7f7342a00640 1 --2- 172.21.15.12:0/2333674183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606f110c590 0x5606f11141f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.565+0000 7f7342a00640 1 -- 172.21.15.12:0/2333674183 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f1116e50 msgr2=0x5606f1114730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:05.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.565+0000 7f7342a00640 1 --2- 172.21.15.12:0/2333674183 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f1116e50 0x5606f1114730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.565+0000 7f7342a00640 1 -- 172.21.15.12:0/2333674183 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606f0de33c0 con 0x5606f110bc70 2024-09-05T01:35:05.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.565+0000 7f7342a00640 1 --2- 172.21.15.12:0/2333674183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f110bc70 0x5606f1113cb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7334019660 tx=0x7f7334019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ffc47d537d1719 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:05.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.565+0000 7f732cc00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:35:05.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.565+0000 7f732cc00640 1 -- 172.21.15.12:0/2333674183 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7334027020 con 0x5606f110bc70 2024-09-05T01:35:05.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.565+0000 7f732cc00640 1 -- 172.21.15.12:0/2333674183 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f733400eaf0 con 0x5606f110bc70 2024-09-05T01:35:05.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.565+0000 7f734c5c0740 1 -- 172.21.15.12:0/2333674183 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7334019b10 con 0x5606f110bc70 2024-09-05T01:35:05.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.566+0000 7f732cc00640 1 -- 172.21.15.12:0/2333674183 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f7334032050 con 0x5606f110bc70 2024-09-05T01:35:05.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.566+0000 7f734c5c0740 10 client.16554 fetch_fsmap learned FSMap version 58 2024-09-05T01:35:05.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.566+0000 7f734c5c0740 1 -- 172.21.15.12:0/2333674183 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x5606f1125a10 con 0x5606f110bc70 2024-09-05T01:35:05.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.566+0000 7f732cc00640 1 -- 172.21.15.12:0/2333674183 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7334019b10 con 0x5606f110bc70 2024-09-05T01:35:05.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.566+0000 7f732cc00640 1 -- 172.21.15.12:0/2333674183 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 58) ==== 8430+0+0 (secure 0 0 0) 0x7f7334004750 con 0x5606f110bc70 2024-09-05T01:35:05.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.566+0000 7f734c5c0740 10 client.16554 fetch_fsmap finished waiting for FSMap version 58 2024-09-05T01:35:05.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.566+0000 7f734c5c0740 10 client.16554 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T01:35:05.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.566+0000 7f734c5c0740 20 client.16554 populate_metadata read hostname 'smithi012' 2024-09-05T01:35:05.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.566+0000 7f734c5c0740 1 --2- 172.21.15.12:0/2333674183 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x5606f1126e70 0x5606f11292a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:05.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.566+0000 7f734c5c0740 4 client.16554 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:35:05.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.566+0000 7f734c5c0740 1 -- 172.21.15.12:0/2333674183 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606f107f950 con 0x5606f1126e70 2024-09-05T01:35:05.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.567+0000 7f7342000640 1 --2- 172.21.15.12:0/2333674183 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x5606f1126e70 0x5606f11292a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:05.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.567+0000 7f7342000640 1 --2- 172.21.15.12:0/2333674183 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x5606f1126e70 0x5606f11292a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=535f8ae6fdb3b7e4 server_cookie=b021f6314acf40ab in_seq=0 out_seq=0 2024-09-05T01:35:05.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.567+0000 7f732cc00640 10 client.16554 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:35:05.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.568+0000 7f732cc00640 1 -- 172.21.15.12:0/2333674183 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5606f107f950 con 0x5606f1126e70 2024-09-05T01:35:05.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.568+0000 7f732cc00640 10 client.16554 handle_command_reply: tid=0 2024-09-05T01:35:05.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.569+0000 7f734c5c0740 1 client.16554 shutdown 2024-09-05T01:35:05.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.569+0000 7f734c5c0740 1 -- 172.21.15.12:0/2333674183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f110bc70 msgr2=0x5606f1113cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:05.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.569+0000 7f734c5c0740 1 --2- 172.21.15.12:0/2333674183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f110bc70 0x5606f1113cb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7334019660 tx=0x7f7334019690 comp rx=0 tx=0).stop 2024-09-05T01:35:05.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.569+0000 7f734c5c0740 1 -- 172.21.15.12:0/2333674183 shutdown_connections 2024-09-05T01:35:05.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.569+0000 7f734c5c0740 1 --2- 172.21.15.12:0/2333674183 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f1116e50 0x5606f1114730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.569+0000 7f734c5c0740 1 --2- 172.21.15.12:0/2333674183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606f110c590 0x5606f11141f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.569+0000 7f734c5c0740 1 --2- 172.21.15.12:0/2333674183 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x5606f1126e70 0x5606f11292a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.569+0000 7f734c5c0740 1 --2- 172.21.15.12:0/2333674183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f110bc70 0x5606f1113cb0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.569+0000 7f734c5c0740 1 -- 172.21.15.12:0/2333674183 >> 172.21.15.12:0/2333674183 conn(0x5606f1108200 msgr2=0x5606f110df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:05.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.569+0000 7f732cc00640 0 client.16554 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:35:05.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.569+0000 7f734c5c0740 1 -- 172.21.15.12:0/2333674183 shutdown_connections 2024-09-05T01:35:05.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.569+0000 7f734c5c0740 1 -- 172.21.15.12:0/2333674183 wait complete. 2024-09-05T01:35:05.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.569+0000 7f734c5c0740 20 client.16554 trim_cache size 0 max 16384 2024-09-05T01:35:05.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.583+0000 7f734c5c0740 1 Processor -- start 2024-09-05T01:35:05.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.583+0000 7f734c5c0740 1 -- start start 2024-09-05T01:35:05.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.583+0000 7f734c5c0740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f110bc70 0x5606f1115c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:05.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.584+0000 7f734c5c0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606f110c590 0x5606f112eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:05.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.584+0000 7f734c5c0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f1116e50 0x5606f112f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:05.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.584+0000 7f734c5c0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f73441b3ea0 con 0x5606f1116e50 2024-09-05T01:35:05.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.584+0000 7f734c5c0740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f73441b5b90 con 0x5606f110bc70 2024-09-05T01:35:05.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.584+0000 7f734c5c0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f73441b4570 con 0x5606f110c590 2024-09-05T01:35:05.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.584+0000 7f7342a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f110bc70 0x5606f1115c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:05.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.584+0000 7f7343400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f1116e50 0x5606f112f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:05.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.584+0000 7f7342a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f110bc70 0x5606f1115c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:37746/0 (socket says 172.21.15.12:37746) 2024-09-05T01:35:05.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.584+0000 7f7342a00640 1 -- 172.21.15.12:0/881142610 learned_addr learned my addr 172.21.15.12:0/881142610 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:05.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.584+0000 7f7342000640 1 --2- 172.21.15.12:0/881142610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606f110c590 0x5606f112eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:05.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.584+0000 7f7343400640 1 -- 172.21.15.12:0/881142610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606f110c590 msgr2=0x5606f112eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:05.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.584+0000 7f7343400640 1 --2- 172.21.15.12:0/881142610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606f110c590 0x5606f112eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.584+0000 7f7343400640 1 -- 172.21.15.12:0/881142610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f110bc70 msgr2=0x5606f1115c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:05.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.584+0000 7f7343400640 1 --2- 172.21.15.12:0/881142610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f110bc70 0x5606f1115c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.584+0000 7f7343400640 1 -- 172.21.15.12:0/881142610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606f1108030 con 0x5606f1116e50 2024-09-05T01:35:05.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.584+0000 7f7342a00640 1 --2- 172.21.15.12:0/881142610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f110bc70 0x5606f1115c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:35:05.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.585+0000 7f7343400640 1 --2- 172.21.15.12:0/881142610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f1116e50 0x5606f112f0b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f733c0edb40 tx=0x7f733c045470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e800b4bdecb53909 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:05.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.585+0000 7f732f400640 1 -- 172.21.15.12:0/881142610 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c0d4020 con 0x5606f1116e50 2024-09-05T01:35:05.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.585+0000 7f732f400640 1 -- 172.21.15.12:0/881142610 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f733c0ef070 con 0x5606f1116e50 2024-09-05T01:35:05.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.585+0000 7f732f400640 1 -- 172.21.15.12:0/881142610 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c045be0 con 0x5606f1116e50 2024-09-05T01:35:05.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.585+0000 7f734c5c0740 1 -- 172.21.15.12:0/881142610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f1116e50 msgr2=0x5606f112f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:05.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.585+0000 7f734c5c0740 1 --2- 172.21.15.12:0/881142610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f1116e50 0x5606f112f0b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f733c0edb40 tx=0x7f733c045470 comp rx=0 tx=0).stop 2024-09-05T01:35:05.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.586+0000 7f734c5c0740 1 -- 172.21.15.12:0/881142610 shutdown_connections 2024-09-05T01:35:05.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.586+0000 7f734c5c0740 1 --2- 172.21.15.12:0/881142610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f1116e50 0x5606f112f0b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.586+0000 7f734c5c0740 1 --2- 172.21.15.12:0/881142610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606f110c590 0x5606f112eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.586+0000 7f734c5c0740 1 --2- 172.21.15.12:0/881142610 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f110bc70 0x5606f1115c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.586+0000 7f734c5c0740 1 -- 172.21.15.12:0/881142610 >> 172.21.15.12:0/881142610 conn(0x5606f1108200 msgr2=0x5606f1115510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:05.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.586+0000 7f734c5c0740 1 -- 172.21.15.12:0/881142610 shutdown_connections 2024-09-05T01:35:05.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.586+0000 7f734c5c0740 1 -- 172.21.15.12:0/881142610 wait complete. 2024-09-05T01:35:05.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.586+0000 7f734c5c0740 1 -- start start 2024-09-05T01:35:05.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.586+0000 7f734c5c0740 1 Processor -- start 2024-09-05T01:35:05.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.587+0000 7f734c5c0740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f110bc70 0x5606f111f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:05.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.587+0000 7f734c5c0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606f110c590 0x5606f111a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:05.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.587+0000 7f734c5c0740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f1116e50 0x5606f111ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:05.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.587+0000 7f734c5c0740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f73441b5430 con 0x5606f1116e50 2024-09-05T01:35:05.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.587+0000 7f734c5c0740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f73441b4ca0 con 0x5606f110bc70 2024-09-05T01:35:05.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.587+0000 7f734c5c0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f73441b1ea0 con 0x5606f110c590 2024-09-05T01:35:05.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.587+0000 7f734c5c0740 10 client.0 _ll_register_callbacks cb 0x7f733401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:35:05.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.587+0000 7f7342a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f110bc70 0x5606f111f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:05.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.587+0000 7f7342a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f110bc70 0x5606f111f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:37754/0 (socket says 172.21.15.12:37754) 2024-09-05T01:35:05.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.587+0000 7f7342a00640 1 -- 172.21.15.12:0/3613050074 learned_addr learned my addr 172.21.15.12:0/3613050074 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:05.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.587+0000 7f7342000640 1 --2- 172.21.15.12:0/3613050074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606f110c590 0x5606f111a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:05.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.587+0000 7f7343400640 1 --2- 172.21.15.12:0/3613050074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f1116e50 0x5606f111ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:05.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.587+0000 7f7342a00640 1 -- 172.21.15.12:0/3613050074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606f110c590 msgr2=0x5606f111a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:05.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.587+0000 7f7342a00640 1 --2- 172.21.15.12:0/3613050074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606f110c590 0x5606f111a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.587+0000 7f7342a00640 1 -- 172.21.15.12:0/3613050074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f1116e50 msgr2=0x5606f111ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:05.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.587+0000 7f7342a00640 1 --2- 172.21.15.12:0/3613050074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f1116e50 0x5606f111ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.588+0000 7f7342a00640 1 -- 172.21.15.12:0/3613050074 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606f111b650 con 0x5606f110bc70 2024-09-05T01:35:05.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.588+0000 7f7342a00640 1 --2- 172.21.15.12:0/3613050074 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f110bc70 0x5606f111f590 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7334004ba0 tx=0x7f7334009be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83155c04d24538cd server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:05.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.588+0000 7f732cc00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:35:05.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.588+0000 7f732cc00640 1 -- 172.21.15.12:0/3613050074 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733403b060 con 0x5606f110bc70 2024-09-05T01:35:05.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.588+0000 7f734c5c0740 1 -- 172.21.15.12:0/3613050074 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f733c0ef070 con 0x5606f110bc70 2024-09-05T01:35:05.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.588+0000 7f732cc00640 1 -- 172.21.15.12:0/3613050074 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8579+0+0 (secure 0 0 0) 0x7f7334019ac0 con 0x5606f110bc70 2024-09-05T01:35:05.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.588+0000 7f732cc00640 1 -- 172.21.15.12:0/3613050074 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f7334027040 con 0x5606f110bc70 2024-09-05T01:35:05.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.588+0000 7f734c5c0740 10 client.26633 fetch_fsmap learned FSMap version 58 2024-09-05T01:35:05.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.588+0000 7f734c5c0740 1 -- 172.21.15.12:0/3613050074 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x5606f1191b70 con 0x5606f110bc70 2024-09-05T01:35:05.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.589+0000 7f732cc00640 1 -- 172.21.15.12:0/3613050074 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f733c0ef070 con 0x5606f110bc70 2024-09-05T01:35:05.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.589+0000 7f732cc00640 1 -- 172.21.15.12:0/3613050074 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 58) ==== 8430+0+0 (secure 0 0 0) 0x7f7334019cc0 con 0x5606f110bc70 2024-09-05T01:35:05.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.589+0000 7f734c5c0740 10 client.26633 fetch_fsmap finished waiting for FSMap version 58 2024-09-05T01:35:05.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.589+0000 7f734c5c0740 10 client.26633 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T01:35:05.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.589+0000 7f734c5c0740 20 client.26633 populate_metadata read hostname 'smithi012' 2024-09-05T01:35:05.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.589+0000 7f734c5c0740 1 --2- 172.21.15.12:0/3613050074 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x5606f1192270 0x5606f1194690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:05.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.589+0000 7f734c5c0740 4 client.26633 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:35:05.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.589+0000 7f734c5c0740 1 -- 172.21.15.12:0/3613050074 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5606f1079e60 con 0x5606f1192270 2024-09-05T01:35:05.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.589+0000 7f7342000640 1 --2- 172.21.15.12:0/3613050074 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x5606f1192270 0x5606f1194690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:05.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.590+0000 7f7342000640 1 --2- 172.21.15.12:0/3613050074 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x5606f1192270 0x5606f1194690 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=764fb976fef54300 server_cookie=338a5c6733486496 in_seq=0 out_seq=0 2024-09-05T01:35:05.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.590+0000 7f732cc00640 10 client.26633 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:35:05.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.590+0000 7f732cc00640 1 -- 172.21.15.12:0/3613050074 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5606f1079e60 con 0x5606f1192270 2024-09-05T01:35:05.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.590+0000 7f732cc00640 10 client.26633 handle_command_reply: tid=0 2024-09-05T01:35:05.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.590+0000 7f734c5c0740 1 client.26633 shutdown 2024-09-05T01:35:05.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.591+0000 7f734c5c0740 1 -- 172.21.15.12:0/3613050074 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f110bc70 msgr2=0x5606f111f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:05.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.591+0000 7f734c5c0740 1 --2- 172.21.15.12:0/3613050074 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f110bc70 0x5606f111f590 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7334004ba0 tx=0x7f7334009be0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.591+0000 7f734c5c0740 1 -- 172.21.15.12:0/3613050074 shutdown_connections 2024-09-05T01:35:05.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.591+0000 7f734c5c0740 1 --2- 172.21.15.12:0/3613050074 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x5606f1192270 0x5606f1194690 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.591+0000 7f734c5c0740 1 --2- 172.21.15.12:0/3613050074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5606f1116e50 0x5606f111ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.591+0000 7f734c5c0740 1 --2- 172.21.15.12:0/3613050074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606f110c590 0x5606f111a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.591+0000 7f734c5c0740 1 --2- 172.21.15.12:0/3613050074 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5606f110bc70 0x5606f111f590 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.591+0000 7f732cc00640 0 client.26633 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:35:05.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.591+0000 7f734c5c0740 1 -- 172.21.15.12:0/3613050074 >> 172.21.15.12:0/3613050074 conn(0x5606f1108200 msgr2=0x5606f1107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:05.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.591+0000 7f734c5c0740 1 -- 172.21.15.12:0/3613050074 shutdown_connections 2024-09-05T01:35:05.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.591+0000 7f734c5c0740 1 -- 172.21.15.12:0/3613050074 wait complete. 2024-09-05T01:35:05.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.591+0000 7f734c5c0740 20 client.26633 trim_cache size 0 max 16384 2024-09-05T01:35:05.596 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:35:05.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.592+0000 7f7349c00640 1 -- 172.21.15.12:0/111810266 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f73280a2e40 msgr2=0x7f73280a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:05.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.592+0000 7f7349c00640 1 --2- 172.21.15.12:0/111810266 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f73280a2e40 0x7f73280a5300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x5606f1109580 tx=0x7f7330009770 comp rx=0 tx=0).stop 2024-09-05T01:35:05.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.592+0000 7f7349c00640 1 -- 172.21.15.12:0/111810266 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f734410d530 msgr2=0x7f734419e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:05.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.592+0000 7f7349c00640 1 --2- 172.21.15.12:0/111810266 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f734410d530 0x7f734419e7f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f733c003e60 tx=0x7f733c003e90 comp rx=0 tx=0).stop 2024-09-05T01:35:05.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.592+0000 7f7349c00640 1 -- 172.21.15.12:0/111810266 shutdown_connections 2024-09-05T01:35:05.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.592+0000 7f7349c00640 1 --2- 172.21.15.12:0/111810266 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f73280a2e40 0x7f73280a5300 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.592+0000 7f7349c00640 1 --2- 172.21.15.12:0/111810266 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f734410d530 0x7f734419e7f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.592+0000 7f7349c00640 1 --2- 172.21.15.12:0/111810266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7344108e00 0x7f73441a4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.592+0000 7f7349c00640 1 --2- 172.21.15.12:0/111810266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7344108450 0x7f73441a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:05.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.592+0000 7f7349c00640 1 -- 172.21.15.12:0/111810266 >> 172.21.15.12:0/111810266 conn(0x7f7344077ba0 msgr2=0x7f7344079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:05.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.592+0000 7f7349c00640 1 -- 172.21.15.12:0/111810266 shutdown_connections 2024-09-05T01:35:05.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:05.592+0000 7f7349c00640 1 -- 172.21.15.12:0/111810266 wait complete. 2024-09-05T01:35:05.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:05 smithi012 ceph-mon[29942]: pgmap v322: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 382 op/s 2024-09-05T01:35:05.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:05 smithi012 ceph-mon[29942]: Adjusting osd_memory_target on smithi012 to 177.5M 2024-09-05T01:35:05.719 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:05 smithi012 ceph-mon[29942]: Unable to set osd_memory_target on smithi012 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-05T01:35:05.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:05 smithi145 ceph-mon[34376]: pgmap v322: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 382 op/s 2024-09-05T01:35:05.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:05 smithi145 ceph-mon[34376]: Adjusting osd_memory_target on smithi012 to 177.5M 2024-09-05T01:35:05.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:05 smithi145 ceph-mon[34376]: Unable to set osd_memory_target on smithi012 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-05T01:35:05.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:05 smithi151 ceph-mon[35013]: pgmap v322: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 382 op/s 2024-09-05T01:35:05.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:05 smithi151 ceph-mon[35013]: Adjusting osd_memory_target on smithi012 to 177.5M 2024-09-05T01:35:05.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:05 smithi151 ceph-mon[35013]: Unable to set osd_memory_target on smithi012 to 186147225: error parsing value: Value '186147225' is below minimum 939524096 2024-09-05T01:35:06.488 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-05T01:35:06.921 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:35:07.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.582+0000 7f9047a00640 1 -- 172.21.15.12:0/1071511671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9040109b10 msgr2=0x7f9040116960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:07.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.582+0000 7f9047a00640 1 --2- 172.21.15.12:0/1071511671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9040109b10 0x7f9040116960 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f902c009900 tx=0x7f902c02a440 comp rx=0 tx=0).stop 2024-09-05T01:35:07.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.584+0000 7f9047a00640 1 -- 172.21.15.12:0/1071511671 shutdown_connections 2024-09-05T01:35:07.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.584+0000 7f9047a00640 1 --2- 172.21.15.12:0/1071511671 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9040116ea0 0x7f9040119290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.584+0000 7f9047a00640 1 --2- 172.21.15.12:0/1071511671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9040109b10 0x7f9040116960 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.584+0000 7f9047a00640 1 --2- 172.21.15.12:0/1071511671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90401091f0 0x7f90401095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.584+0000 7f9047a00640 1 -- 172.21.15.12:0/1071511671 >> 172.21.15.12:0/1071511671 conn(0x7f904006e140 msgr2=0x7f904006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:07.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.584+0000 7f9047a00640 1 -- 172.21.15.12:0/1071511671 shutdown_connections 2024-09-05T01:35:07.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.585+0000 7f9047a00640 1 -- 172.21.15.12:0/1071511671 wait complete. 2024-09-05T01:35:07.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.586+0000 7f9047a00640 1 Processor -- start 2024-09-05T01:35:07.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.587+0000 7f9047a00640 1 -- start start 2024-09-05T01:35:07.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.587+0000 7f9047a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90401091f0 0x7f9040111ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:07.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.587+0000 7f9047a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9040109b10 0x7f9040111ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:07.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.587+0000 7f9047a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9040116ea0 0x7f9040122b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:07.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.587+0000 7f9047a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f904010d810 con 0x7f9040116ea0 2024-09-05T01:35:07.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.587+0000 7f9047a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f904010d690 con 0x7f9040109b10 2024-09-05T01:35:07.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.587+0000 7f9047a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f904010d990 con 0x7f90401091f0 2024-09-05T01:35:07.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.588+0000 7f9045a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9040116ea0 0x7f9040122b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:07.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.588+0000 7f9045a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9040116ea0 0x7f9040122b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41400/0 (socket says 172.21.15.12:41400) 2024-09-05T01:35:07.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.588+0000 7f9045a00640 1 -- 172.21.15.12:0/1387463684 learned_addr learned my addr 172.21.15.12:0/1387463684 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:07.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.588+0000 7f903fe00640 1 --2- 172.21.15.12:0/1387463684 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9040109b10 0x7f9040111ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:07.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.588+0000 7f9045000640 1 --2- 172.21.15.12:0/1387463684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90401091f0 0x7f9040111ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:07.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.589+0000 7f9045a00640 1 -- 172.21.15.12:0/1387463684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90401091f0 msgr2=0x7f9040111ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:07.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.589+0000 7f9045a00640 1 --2- 172.21.15.12:0/1387463684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90401091f0 0x7f9040111ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.589+0000 7f9045a00640 1 -- 172.21.15.12:0/1387463684 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9040109b10 msgr2=0x7f9040111ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:07.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.589+0000 7f9045a00640 1 --2- 172.21.15.12:0/1387463684 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9040109b10 0x7f9040111ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.589+0000 7f9045a00640 1 -- 172.21.15.12:0/1387463684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9040123410 con 0x7f9040116ea0 2024-09-05T01:35:07.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.590+0000 7f903fe00640 1 --2- 172.21.15.12:0/1387463684 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9040109b10 0x7f9040111ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:35:07.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.591+0000 7f9045000640 1 --2- 172.21.15.12:0/1387463684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90401091f0 0x7f9040111ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:35:07.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.592+0000 7f9045a00640 1 --2- 172.21.15.12:0/1387463684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9040116ea0 0x7f9040122b50 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f903800eb40 tx=0x7f903800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:07.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.592+0000 7f903d600640 1 -- 172.21.15.12:0/1387463684 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9038004b20 con 0x7f9040116ea0 2024-09-05T01:35:07.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.593+0000 7f9047a00640 1 -- 172.21.15.12:0/1387463684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9040123700 con 0x7f9040116ea0 2024-09-05T01:35:07.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.593+0000 7f903d600640 1 -- 172.21.15.12:0/1387463684 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9038004cc0 con 0x7f9040116ea0 2024-09-05T01:35:07.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.593+0000 7f903d600640 1 -- 172.21.15.12:0/1387463684 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9038010850 con 0x7f9040116ea0 2024-09-05T01:35:07.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.593+0000 7f9047a00640 1 -- 172.21.15.12:0/1387463684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9040115990 con 0x7f9040116ea0 2024-09-05T01:35:07.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.601+0000 7f904a429740 1 Processor -- start 2024-09-05T01:35:07.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.603+0000 7f903d600640 1 -- 172.21.15.12:0/1387463684 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f9038005020 con 0x7f9040116ea0 2024-09-05T01:35:07.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.605+0000 7f904a429740 1 -- start start 2024-09-05T01:35:07.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.605+0000 7f904a429740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5583a984fc70 0x5583a9850050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:07.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.605+0000 7f904a429740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583a9850590 0x5583a985a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:07.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.605+0000 7f904a429740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5583a985ae50 0x5583a985d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:07.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.605+0000 7f904a429740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5583a97b63e0 con 0x5583a9850590 2024-09-05T01:35:07.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.605+0000 7f904a429740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5583a975dd80 con 0x5583a984fc70 2024-09-05T01:35:07.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.605+0000 7f904a429740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5583a97b23a0 con 0x5583a985ae50 2024-09-05T01:35:07.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.606+0000 7f903d600640 1 --2- 172.21.15.12:0/1387463684 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f90280a2d70 0x7f90280a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:07.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.606+0000 7f903d600640 1 -- 172.21.15.12:0/1387463684 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8623+0+0 (secure 0 0 0) 0x7f90380cfcc0 con 0x7f9040116ea0 2024-09-05T01:35:07.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.607+0000 7f9045a00640 1 --2- 172.21.15.12:0/1387463684 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f90280a2d70 0x7f90280a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:07.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.607+0000 7f903fe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5583a984fc70 0x5583a9850050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:07.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.607+0000 7f9045000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583a9850590 0x5583a985a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:07.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.607+0000 7f903fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5583a985ae50 0x5583a985d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:07.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.607+0000 7f903fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5583a985ae50 0x5583a985d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:45838/0 (socket says 172.21.15.12:45838) 2024-09-05T01:35:07.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.607+0000 7f903fe00640 1 -- 172.21.15.12:0/2642535108 learned_addr learned my addr 172.21.15.12:0/2642535108 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:07.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.609+0000 7f9045000640 1 -- 172.21.15.12:0/2642535108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5583a985ae50 msgr2=0x5583a985d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:07.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.609+0000 7f9045000640 1 --2- 172.21.15.12:0/2642535108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5583a985ae50 0x5583a985d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.609+0000 7f9045000640 1 -- 172.21.15.12:0/2642535108 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5583a984fc70 msgr2=0x5583a9850050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:07.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.609+0000 7f9045000640 1 --2- 172.21.15.12:0/2642535108 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5583a984fc70 0x5583a9850050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.609+0000 7f9045000640 1 -- 172.21.15.12:0/2642535108 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583a977cae0 con 0x5583a9850590 2024-09-05T01:35:07.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.609+0000 7f903fe00640 1 --2- 172.21.15.12:0/2642535108 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5583a984fc70 0x5583a9850050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:35:07.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.609+0000 7f9045a00640 1 --2- 172.21.15.12:0/1387463684 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f90280a2d70 0x7f90280a5230 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9038098b50 tx=0x7f9038004a40 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:07.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.610+0000 7f9045000640 1 --2- 172.21.15.12:0/2642535108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583a9850590 0x5583a985a910 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9034009be0 tx=0x7f903400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9988e4c56ea59a9f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:07.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.611+0000 7f9032000640 1 -- 172.21.15.12:0/2642535108 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9034016070 con 0x5583a9850590 2024-09-05T01:35:07.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.611+0000 7f9032000640 1 -- 172.21.15.12:0/2642535108 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9034005500 con 0x5583a9850590 2024-09-05T01:35:07.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.611+0000 7f9032000640 1 -- 172.21.15.12:0/2642535108 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90340116d0 con 0x5583a9850590 2024-09-05T01:35:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.612+0000 7f904a429740 1 -- 172.21.15.12:0/2642535108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583a9850590 msgr2=0x5583a985a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.612+0000 7f904a429740 1 --2- 172.21.15.12:0/2642535108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583a9850590 0x5583a985a910 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9034009be0 tx=0x7f903400e6c0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.613+0000 7f904a429740 1 -- 172.21.15.12:0/2642535108 shutdown_connections 2024-09-05T01:35:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.613+0000 7f904a429740 1 --2- 172.21.15.12:0/2642535108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5583a985ae50 0x5583a985d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.613+0000 7f904a429740 1 --2- 172.21.15.12:0/2642535108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583a9850590 0x5583a985a910 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.613+0000 7f904a429740 1 --2- 172.21.15.12:0/2642535108 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5583a984fc70 0x5583a9850050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.613+0000 7f904a429740 1 -- 172.21.15.12:0/2642535108 >> 172.21.15.12:0/2642535108 conn(0x5583a984c200 msgr2=0x5583a984c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.613+0000 7f904a429740 1 -- 172.21.15.12:0/2642535108 shutdown_connections 2024-09-05T01:35:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.613+0000 7f904a429740 1 -- 172.21.15.12:0/2642535108 wait complete. 2024-09-05T01:35:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.614+0000 7f904a429740 1 -- start start 2024-09-05T01:35:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.614+0000 7f904a429740 1 Processor -- start 2024-09-05T01:35:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.615+0000 7f904a429740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5583a984fc70 0x5583a9857d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.615+0000 7f904a429740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5583a9850590 0x5583a98582a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.615+0000 7f904a429740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583a985ae50 0x5583a98587e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.615+0000 7f904a429740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5583a985da20 con 0x5583a985ae50 2024-09-05T01:35:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.615+0000 7f904a429740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x5583a97710f0 con 0x5583a9850590 2024-09-05T01:35:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.615+0000 7f904a429740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5583a985dba0 con 0x5583a984fc70 2024-09-05T01:35:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.615+0000 7f904a429740 10 client.0 _ll_register_callbacks cb 0x5583a9758bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:35:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.616+0000 7f9045000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5583a9850590 0x5583a98582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.616+0000 7f9045000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5583a9850590 0x5583a98582a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:35578/0 (socket says 172.21.15.12:35578) 2024-09-05T01:35:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.616+0000 7f9045000640 1 -- 172.21.15.12:0/1437967171 learned_addr learned my addr 172.21.15.12:0/1437967171 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.616+0000 7f9045000640 1 -- 172.21.15.12:0/1437967171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5583a984fc70 msgr2=0x5583a9857d60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:35:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.616+0000 7f9045000640 1 --2- 172.21.15.12:0/1437967171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5583a984fc70 0x5583a9857d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.616+0000 7f9045000640 1 -- 172.21.15.12:0/1437967171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583a985ae50 msgr2=0x5583a98587e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:35:07.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.617+0000 7f903fe00640 1 --2- 172.21.15.12:0/1437967171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583a985ae50 0x5583a98587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:07.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.617+0000 7f9045000640 1 --2- 172.21.15.12:0/1437967171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583a985ae50 0x5583a98587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.617+0000 7f9045000640 1 -- 172.21.15.12:0/1437967171 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583a95273c0 con 0x5583a9850590 2024-09-05T01:35:07.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.618+0000 7f903fe00640 1 --2- 172.21.15.12:0/1437967171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583a985ae50 0x5583a98587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:35:07.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.619+0000 7f9045000640 1 --2- 172.21.15.12:0/1437967171 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5583a9850590 0x5583a98582a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f903400efe0 tx=0x7f90340048f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=401a11e9deb4f258 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:07.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.619+0000 7f9026a00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:35:07.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.622+0000 7f9026a00640 1 -- 172.21.15.12:0/1437967171 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9034016040 con 0x5583a9850590 2024-09-05T01:35:07.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.622+0000 7f9026a00640 1 -- 172.21.15.12:0/1437967171 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8623+0+0 (secure 0 0 0) 0x7f9034005030 con 0x5583a9850590 2024-09-05T01:35:07.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.622+0000 7f904a429740 1 -- 172.21.15.12:0/1437967171 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9034005500 con 0x5583a9850590 2024-09-05T01:35:07.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.624+0000 7f9026a00640 1 -- 172.21.15.12:0/1437967171 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f903402a050 con 0x5583a9850590 2024-09-05T01:35:07.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.624+0000 7f904a429740 10 client.26639 fetch_fsmap learned FSMap version 58 2024-09-05T01:35:07.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.624+0000 7f904a429740 1 -- 172.21.15.12:0/1437967171 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x5583a988ba70 con 0x5583a9850590 2024-09-05T01:35:07.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.625+0000 7f9026a00640 1 -- 172.21.15.12:0/1437967171 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9034005500 con 0x5583a9850590 2024-09-05T01:35:07.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.625+0000 7f9026a00640 1 -- 172.21.15.12:0/1437967171 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 58) ==== 8430+0+0 (secure 0 0 0) 0x7f903400f040 con 0x5583a9850590 2024-09-05T01:35:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.626+0000 7f904a429740 10 client.26639 fetch_fsmap finished waiting for FSMap version 58 2024-09-05T01:35:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.626+0000 7f904a429740 10 client.26639 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:35:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.626+0000 7f904a429740 20 client.26639 populate_metadata read hostname 'smithi012' 2024-09-05T01:35:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.626+0000 7f904a429740 1 --2- 172.21.15.12:0/1437967171 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5583a988cf30 0x5583a988f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.626+0000 7f904a429740 4 client.26639 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:35:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.626+0000 7f904a429740 1 -- 172.21.15.12:0/1437967171 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583a97c3950 con 0x5583a988cf30 2024-09-05T01:35:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.626+0000 7f903fe00640 1 --2- 172.21.15.12:0/1437967171 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5583a988cf30 0x5583a988f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.627+0000 7f9026a00640 10 client.26639 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:35:07.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.628+0000 7f903fe00640 1 --2- 172.21.15.12:0/1437967171 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5583a988cf30 0x5583a988f320 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9fb6fd3cceb4fc7 server_cookie=7c1911183300421f in_seq=0 out_seq=0 2024-09-05T01:35:07.632 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.631+0000 7f9026a00640 1 -- 172.21.15.12:0/1437967171 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5583a97c3950 con 0x5583a988cf30 2024-09-05T01:35:07.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.631+0000 7f9026a00640 10 client.26639 handle_command_reply: tid=0 2024-09-05T01:35:07.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.631+0000 7f904a429740 1 client.26639 shutdown 2024-09-05T01:35:07.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.632+0000 7f904a429740 1 -- 172.21.15.12:0/1437967171 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5583a9850590 msgr2=0x5583a98582a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:07.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.632+0000 7f904a429740 1 --2- 172.21.15.12:0/1437967171 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5583a9850590 0x5583a98582a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f903400efe0 tx=0x7f90340048f0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.633+0000 7f904a429740 1 -- 172.21.15.12:0/1437967171 shutdown_connections 2024-09-05T01:35:07.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.633+0000 7f904a429740 1 --2- 172.21.15.12:0/1437967171 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5583a988cf30 0x5583a988f320 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.633+0000 7f904a429740 1 --2- 172.21.15.12:0/1437967171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583a985ae50 0x5583a98587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.633+0000 7f904a429740 1 --2- 172.21.15.12:0/1437967171 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5583a9850590 0x5583a98582a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.633+0000 7f904a429740 1 --2- 172.21.15.12:0/1437967171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5583a984fc70 0x5583a9857d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.633+0000 7f904a429740 1 -- 172.21.15.12:0/1437967171 >> 172.21.15.12:0/1437967171 conn(0x5583a984c200 msgr2=0x5583a984b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:07.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.633+0000 7f9026a00640 0 client.26639 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:35:07.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.634+0000 7f904a429740 1 -- 172.21.15.12:0/1437967171 shutdown_connections 2024-09-05T01:35:07.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.634+0000 7f904a429740 1 -- 172.21.15.12:0/1437967171 wait complete. 2024-09-05T01:35:07.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.634+0000 7f904a429740 20 client.26639 trim_cache size 0 max 16384 2024-09-05T01:35:07.663 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.662+0000 7f904a429740 1 Processor -- start 2024-09-05T01:35:07.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.663+0000 7f904a429740 1 -- start start 2024-09-05T01:35:07.664 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:07 smithi012 ceph-mon[29942]: pgmap v323: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 301 op/s 2024-09-05T01:35:07.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.663+0000 7f904a429740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583a984fc70 0x5583a98526d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:07.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.663+0000 7f904a429740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5583a9850590 0x5583a9859cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:07.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.664+0000 7f903fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583a984fc70 0x5583a98526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:07.665 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.664+0000 7f903fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583a984fc70 0x5583a98526d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41428/0 (socket says 172.21.15.12:41428) 2024-09-05T01:35:07.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.665+0000 7f9045000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5583a9850590 0x5583a9859cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:07.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.665+0000 7f903fe00640 1 -- 172.21.15.12:0/2609741550 learned_addr learned my addr 172.21.15.12:0/2609741550 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:07.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.665+0000 7f904a429740 1 --2- 172.21.15.12:0/2609741550 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5583a985ae50 0x5583a9894a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:07.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.665+0000 7f904a429740 1 -- 172.21.15.12:0/2609741550 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f904012b510 con 0x5583a984fc70 2024-09-05T01:35:07.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.665+0000 7f904a429740 1 -- 172.21.15.12:0/2609741550 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f904012d200 con 0x5583a985ae50 2024-09-05T01:35:07.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.665+0000 7f904a429740 1 -- 172.21.15.12:0/2609741550 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f904012bbe0 con 0x5583a9850590 2024-09-05T01:35:07.667 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.666+0000 7f903fe00640 1 --2- 172.21.15.12:0/2609741550 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5583a985ae50 0x5583a9894a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:07.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.667+0000 7f9045000640 1 -- 172.21.15.12:0/2609741550 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5583a985ae50 msgr2=0x5583a9894a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:07.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.667+0000 7f9045000640 1 --2- 172.21.15.12:0/2609741550 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5583a985ae50 0x5583a9894a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.667+0000 7f9045000640 1 -- 172.21.15.12:0/2609741550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583a984fc70 msgr2=0x5583a98526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:07.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.667+0000 7f9045000640 1 --2- 172.21.15.12:0/2609741550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583a984fc70 0x5583a98526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.668 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.667+0000 7f9045000640 1 -- 172.21.15.12:0/2609741550 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583a9847770 con 0x5583a9850590 2024-09-05T01:35:07.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.667+0000 7f9045000640 1 --2- 172.21.15.12:0/2609741550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5583a9850590 0x5583a9859cd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f903400ebc0 tx=0x7f903400e6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4acc6d1e3b25958 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:07.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.668+0000 7f9031600640 1 -- 172.21.15.12:0/2609741550 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9034016070 con 0x5583a9850590 2024-09-05T01:35:07.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.668+0000 7f9031600640 1 -- 172.21.15.12:0/2609741550 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9034009760 con 0x5583a9850590 2024-09-05T01:35:07.669 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.668+0000 7f9031600640 1 -- 172.21.15.12:0/2609741550 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90340249e0 con 0x5583a9850590 2024-09-05T01:35:07.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.669+0000 7f904a429740 1 -- 172.21.15.12:0/2609741550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5583a9850590 msgr2=0x5583a9859cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:07.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.669+0000 7f904a429740 1 --2- 172.21.15.12:0/2609741550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5583a9850590 0x5583a9859cd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f903400ebc0 tx=0x7f903400e6c0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.670+0000 7f904a429740 1 -- 172.21.15.12:0/2609741550 shutdown_connections 2024-09-05T01:35:07.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.670+0000 7f904a429740 1 --2- 172.21.15.12:0/2609741550 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5583a985ae50 0x5583a9894a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.670+0000 7f904a429740 1 --2- 172.21.15.12:0/2609741550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5583a9850590 0x5583a9859cd0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.670+0000 7f904a429740 1 --2- 172.21.15.12:0/2609741550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583a984fc70 0x5583a98526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.670+0000 7f904a429740 1 -- 172.21.15.12:0/2609741550 >> 172.21.15.12:0/2609741550 conn(0x5583a984c200 msgr2=0x5583a98595c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:07.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.671+0000 7f904a429740 1 -- 172.21.15.12:0/2609741550 shutdown_connections 2024-09-05T01:35:07.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.671+0000 7f904a429740 1 -- 172.21.15.12:0/2609741550 wait complete. 2024-09-05T01:35:07.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.672+0000 7f904a429740 1 -- start start 2024-09-05T01:35:07.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.672+0000 7f904a429740 1 Processor -- start 2024-09-05T01:35:07.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.674+0000 7f904a429740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583a984fc70 0x5583a9863240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:07.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.674+0000 7f904a429740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5583a9850590 0x5583a985e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:07.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.674+0000 7f904a429740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5583a985ae50 0x5583a985eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:07.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.674+0000 7f904a429740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f904012caa0 con 0x5583a984fc70 2024-09-05T01:35:07.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.674+0000 7f904a429740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f904012c310 con 0x5583a9850590 2024-09-05T01:35:07.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.674+0000 7f904a429740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9040129510 con 0x5583a985ae50 2024-09-05T01:35:07.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.674+0000 7f904a429740 10 client.0 _ll_register_callbacks cb 0x7f90340099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:35:07.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.675+0000 7f9045000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5583a9850590 0x5583a985e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:07.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.675+0000 7f903fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5583a985ae50 0x5583a985eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:07.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.675+0000 7f903fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583a984fc70 0x5583a9863240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:07.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.675+0000 7f903fe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583a984fc70 0x5583a9863240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41438/0 (socket says 172.21.15.12:41438) 2024-09-05T01:35:07.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.675+0000 7f903fe00640 1 -- 172.21.15.12:0/3101563743 learned_addr learned my addr 172.21.15.12:0/3101563743 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:07.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.676+0000 7f903fe00640 1 -- 172.21.15.12:0/3101563743 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5583a9850590 msgr2=0x5583a985e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:07.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.676+0000 7f903fe00640 1 --2- 172.21.15.12:0/3101563743 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5583a9850590 0x5583a985e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.676+0000 7f903fe00640 1 -- 172.21.15.12:0/3101563743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583a984fc70 msgr2=0x5583a9863240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:07.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.676+0000 7f903fe00640 1 --2- 172.21.15.12:0/3101563743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583a984fc70 0x5583a9863240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.676+0000 7f903fe00640 1 -- 172.21.15.12:0/3101563743 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583a985eff0 con 0x5583a985ae50 2024-09-05T01:35:07.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.676+0000 7f903fe00640 1 --2- 172.21.15.12:0/3101563743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5583a985ae50 0x5583a985eab0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f902c009850 tx=0x7f902c009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=844a3a2439378da5 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:07.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.676+0000 7f9026a00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:35:07.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.677+0000 7f9026a00640 1 -- 172.21.15.12:0/3101563743 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c005410 con 0x5583a985ae50 2024-09-05T01:35:07.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.677+0000 7f9026a00640 1 -- 172.21.15.12:0/3101563743 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8623+0+0 (secure 0 0 0) 0x7f902c0055b0 con 0x5583a985ae50 2024-09-05T01:35:07.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.677+0000 7f904a429740 1 -- 172.21.15.12:0/3101563743 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9034009760 con 0x5583a985ae50 2024-09-05T01:35:07.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.677+0000 7f9026a00640 1 -- 172.21.15.12:0/3101563743 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f902c03f440 con 0x5583a985ae50 2024-09-05T01:35:07.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.678+0000 7f904a429740 10 client.26629 fetch_fsmap learned FSMap version 58 2024-09-05T01:35:07.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.678+0000 7f904a429740 1 -- 172.21.15.12:0/3101563743 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x5583a98f7720 con 0x5583a985ae50 2024-09-05T01:35:07.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.678+0000 7f9026a00640 1 -- 172.21.15.12:0/3101563743 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9034009760 con 0x5583a985ae50 2024-09-05T01:35:07.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.679+0000 7f9026a00640 1 -- 172.21.15.12:0/3101563743 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 58) ==== 8430+0+0 (secure 0 0 0) 0x7f902c0316a0 con 0x5583a985ae50 2024-09-05T01:35:07.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.679+0000 7f904a429740 10 client.26629 fetch_fsmap finished waiting for FSMap version 58 2024-09-05T01:35:07.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.679+0000 7f904a429740 10 client.26629 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:35:07.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.679+0000 7f904a429740 20 client.26629 populate_metadata read hostname 'smithi012' 2024-09-05T01:35:07.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.679+0000 7f904a429740 1 --2- 172.21.15.12:0/3101563743 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5583a98f7e80 0x5583a98fa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:07.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.679+0000 7f904a429740 4 client.26629 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:35:07.681 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.679+0000 7f904a429740 1 -- 172.21.15.12:0/3101563743 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5583a97bde60 con 0x5583a98f7e80 2024-09-05T01:35:07.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.680+0000 7f9045000640 1 --2- 172.21.15.12:0/3101563743 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5583a98f7e80 0x5583a98fa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:07.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.682+0000 7f9045000640 1 --2- 172.21.15.12:0/3101563743 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5583a98f7e80 0x5583a98fa2a0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3e99d0e6ce8455e server_cookie=40cf84206c99da53 in_seq=0 out_seq=0 2024-09-05T01:35:07.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.682+0000 7f9026a00640 10 client.26629 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:35:07.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.684+0000 7f9026a00640 1 -- 172.21.15.12:0/3101563743 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5583a97bde60 con 0x5583a98f7e80 2024-09-05T01:35:07.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.684+0000 7f9026a00640 10 client.26629 handle_command_reply: tid=0 2024-09-05T01:35:07.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.684+0000 7f904a429740 1 client.26629 shutdown 2024-09-05T01:35:07.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.684+0000 7f904a429740 1 -- 172.21.15.12:0/3101563743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5583a985ae50 msgr2=0x5583a985eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:07.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.684+0000 7f904a429740 1 --2- 172.21.15.12:0/3101563743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5583a985ae50 0x5583a985eab0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f902c009850 tx=0x7f902c009260 comp rx=0 tx=0).stop 2024-09-05T01:35:07.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.684+0000 7f904a429740 1 -- 172.21.15.12:0/3101563743 shutdown_connections 2024-09-05T01:35:07.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.684+0000 7f904a429740 1 --2- 172.21.15.12:0/3101563743 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x5583a98f7e80 0x5583a98fa2a0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.684+0000 7f904a429740 1 --2- 172.21.15.12:0/3101563743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5583a985ae50 0x5583a985eab0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.684+0000 7f904a429740 1 --2- 172.21.15.12:0/3101563743 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x5583a9850590 0x5583a985e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.684+0000 7f904a429740 1 --2- 172.21.15.12:0/3101563743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5583a984fc70 0x5583a9863240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.684+0000 7f904a429740 1 -- 172.21.15.12:0/3101563743 >> 172.21.15.12:0/3101563743 conn(0x5583a984c200 msgr2=0x5583a9859de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:07.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.685+0000 7f9026a00640 0 client.26629 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:35:07.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.685+0000 7f904a429740 1 -- 172.21.15.12:0/3101563743 shutdown_connections 2024-09-05T01:35:07.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.685+0000 7f904a429740 1 -- 172.21.15.12:0/3101563743 wait complete. 2024-09-05T01:35:07.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.686+0000 7f904a429740 20 client.26629 trim_cache size 0 max 16384 2024-09-05T01:35:07.687 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:35:07.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.687+0000 7f9047a00640 1 -- 172.21.15.12:0/1387463684 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f90280a2d70 msgr2=0x7f90280a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:07.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.687+0000 7f9047a00640 1 --2- 172.21.15.12:0/1387463684 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f90280a2d70 0x7f90280a5230 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9038098b50 tx=0x7f9038004a40 comp rx=0 tx=0).stop 2024-09-05T01:35:07.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.687+0000 7f9047a00640 1 -- 172.21.15.12:0/1387463684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9040116ea0 msgr2=0x7f9040122b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:07.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.687+0000 7f9047a00640 1 --2- 172.21.15.12:0/1387463684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9040116ea0 0x7f9040122b50 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f903800eb40 tx=0x7f903800c2d0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.687+0000 7f9047a00640 1 -- 172.21.15.12:0/1387463684 shutdown_connections 2024-09-05T01:35:07.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.687+0000 7f9047a00640 1 --2- 172.21.15.12:0/1387463684 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f90280a2d70 0x7f90280a5230 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.687+0000 7f9047a00640 1 --2- 172.21.15.12:0/1387463684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9040116ea0 0x7f9040122b50 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.687+0000 7f9047a00640 1 --2- 172.21.15.12:0/1387463684 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9040109b10 0x7f9040111ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.687+0000 7f9047a00640 1 --2- 172.21.15.12:0/1387463684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90401091f0 0x7f9040111ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.687+0000 7f9047a00640 1 -- 172.21.15.12:0/1387463684 >> 172.21.15.12:0/1387463684 conn(0x7f904006e140 msgr2=0x7f90401174c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.688+0000 7f9047a00640 1 -- 172.21.15.12:0/1387463684 shutdown_connections 2024-09-05T01:35:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:07.688+0000 7f9047a00640 1 -- 172.21.15.12:0/1387463684 wait complete. 2024-09-05T01:35:07.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:07 smithi145 ceph-mon[34376]: pgmap v323: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 301 op/s 2024-09-05T01:35:07.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:07 smithi151 ceph-mon[35013]: pgmap v323: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 301 op/s 2024-09-05T01:35:08.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:08 smithi012 ceph-mon[29942]: osdmap e95: 12 total, 12 up, 12 in 2024-09-05T01:35:08.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:08 smithi145 ceph-mon[34376]: osdmap e95: 12 total, 12 up, 12 in 2024-09-05T01:35:08.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:08 smithi151 ceph-mon[35013]: osdmap e95: 12 total, 12 up, 12 in 2024-09-05T01:35:09.654 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-05T01:35:09.655 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-05T01:35:09.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:09 smithi012 ceph-mon[29942]: pgmap v325: 97 pgs: 4 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 91 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 310 op/s 2024-09-05T01:35:09.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:09 smithi145 ceph-mon[34376]: pgmap v325: 97 pgs: 4 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 91 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 310 op/s 2024-09-05T01:35:09.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:09 smithi151 ceph-mon[35013]: pgmap v325: 97 pgs: 4 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 91 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 310 op/s 2024-09-05T01:35:10.310 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:35:11.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.051+0000 7f7f8b400640 1 -- 172.21.15.12:0/1003877462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f84102d30 msgr2=0x7f7f84103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:11.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.051+0000 7f7f8b400640 1 --2- 172.21.15.12:0/1003877462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f84102d30 0x7f7f84103110 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7f74009900 tx=0x7f7f7402a410 comp rx=0 tx=0).stop 2024-09-05T01:35:11.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.053+0000 7f7f8b400640 1 -- 172.21.15.12:0/1003877462 shutdown_connections 2024-09-05T01:35:11.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.053+0000 7f7f8b400640 1 --2- 172.21.15.12:0/1003877462 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f841082a0 0x7f7f8410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.053+0000 7f7f8b400640 1 --2- 172.21.15.12:0/1003877462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f841036e0 0x7f7f84107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.053+0000 7f7f8b400640 1 --2- 172.21.15.12:0/1003877462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f84102d30 0x7f7f84103110 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.053+0000 7f7f8b400640 1 -- 172.21.15.12:0/1003877462 >> 172.21.15.12:0/1003877462 conn(0x7f7f840fc7d0 msgr2=0x7f7f840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:11.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.053+0000 7f7f8b400640 1 -- 172.21.15.12:0/1003877462 shutdown_connections 2024-09-05T01:35:11.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.053+0000 7f7f8b400640 1 -- 172.21.15.12:0/1003877462 wait complete. 2024-09-05T01:35:11.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.055+0000 7f7f8b400640 1 Processor -- start 2024-09-05T01:35:11.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.056+0000 7f7f8b400640 1 -- start start 2024-09-05T01:35:11.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.056+0000 7f7f8b400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f84102d30 0x7f7f84103c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:11.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.056+0000 7f7f8b400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f841036e0 0x7f7f84104160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:11.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.056+0000 7f7f8b400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f841082a0 0x7f7f841046a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:11.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.056+0000 7f7f8b400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7f841120e0 con 0x7f7f841082a0 2024-09-05T01:35:11.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.056+0000 7f7f8b400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7f84111f60 con 0x7f7f841036e0 2024-09-05T01:35:11.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.056+0000 7f7f8b400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7f84112260 con 0x7f7f84102d30 2024-09-05T01:35:11.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.057+0000 7f7f88a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f84102d30 0x7f7f84103c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:11.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.057+0000 7f7f88a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f84102d30 0x7f7f84103c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:45882/0 (socket says 172.21.15.12:45882) 2024-09-05T01:35:11.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.057+0000 7f7f88a00640 1 -- 172.21.15.12:0/3452362544 learned_addr learned my addr 172.21.15.12:0/3452362544 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:11.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.058+0000 7f7f89400640 1 --2- 172.21.15.12:0/3452362544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f841082a0 0x7f7f841046a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:11.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.058+0000 7f7f88a00640 1 -- 172.21.15.12:0/3452362544 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f841036e0 msgr2=0x7f7f84104160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:11.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.058+0000 7f7f88a00640 1 --2- 172.21.15.12:0/3452362544 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f841036e0 0x7f7f84104160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.058+0000 7f7f88a00640 1 -- 172.21.15.12:0/3452362544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f841082a0 msgr2=0x7f7f841046a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:11.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.058+0000 7f7f88a00640 1 --2- 172.21.15.12:0/3452362544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f841082a0 0x7f7f841046a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.058+0000 7f7f88a00640 1 -- 172.21.15.12:0/3452362544 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8419a530 con 0x7f7f84102d30 2024-09-05T01:35:11.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.059+0000 7f7f88a00640 1 --2- 172.21.15.12:0/3452362544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f84102d30 0x7f7f84103c20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7f7402aa00 tx=0x7f7f74003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:11.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.060+0000 7f7f82000640 1 -- 172.21.15.12:0/3452362544 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7403f070 con 0x7f7f84102d30 2024-09-05T01:35:11.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.060+0000 7f7f82000640 1 -- 172.21.15.12:0/3452362544 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f74031c20 con 0x7f7f84102d30 2024-09-05T01:35:11.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.060+0000 7f7f82000640 1 -- 172.21.15.12:0/3452362544 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f74035030 con 0x7f7f84102d30 2024-09-05T01:35:11.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.060+0000 7f7f8b400640 1 -- 172.21.15.12:0/3452362544 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f8419a7c0 con 0x7f7f84102d30 2024-09-05T01:35:11.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.060+0000 7f7f8b400640 1 -- 172.21.15.12:0/3452362544 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f8419ac50 con 0x7f7f84102d30 2024-09-05T01:35:11.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.066+0000 7f7f8ddfc740 1 Processor -- start 2024-09-05T01:35:11.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.066+0000 7f7f8ddfc740 1 -- start start 2024-09-05T01:35:11.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.067+0000 7f7f8ddfc740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d634587ac0 0x55d634587ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:11.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.067+0000 7f7f8ddfc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d6345883e0 0x55d634592760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:11.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.068+0000 7f7f89400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d634587ac0 0x55d634587ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:11.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.068+0000 7f7f89400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d634587ac0 0x55d634587ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:35610/0 (socket says 172.21.15.12:35610) 2024-09-05T01:35:11.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.068+0000 7f7f8ddfc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d634592ca0 0x55d634595090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:11.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.068+0000 7f7f89400640 1 -- 172.21.15.12:0/957035138 learned_addr learned my addr 172.21.15.12:0/957035138 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:11.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.068+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/957035138 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d6344ee290 con 0x55d6345883e0 2024-09-05T01:35:11.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.068+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/957035138 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55d634495b40 con 0x55d634587ac0 2024-09-05T01:35:11.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.068+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/957035138 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d6344ea250 con 0x55d634592ca0 2024-09-05T01:35:11.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.069+0000 7f7f7be00640 1 --2- 172.21.15.12:0/957035138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d634592ca0 0x55d634595090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:11.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.069+0000 7f7f89400640 1 -- 172.21.15.12:0/957035138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d634592ca0 msgr2=0x55d634595090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:11.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.069+0000 7f7f89400640 1 --2- 172.21.15.12:0/957035138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d634592ca0 0x55d634595090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.069+0000 7f7f89400640 1 -- 172.21.15.12:0/957035138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d6345883e0 msgr2=0x55d634592760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-05T01:35:11.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.069+0000 7f7f89400640 1 --2- 172.21.15.12:0/957035138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d6345883e0 0x55d634592760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.069+0000 7f7f89400640 1 -- 172.21.15.12:0/957035138 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d63425f6a0 con 0x55d634587ac0 2024-09-05T01:35:11.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.070+0000 7f7f89400640 1 --2- 172.21.15.12:0/957035138 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d634587ac0 0x55d634587ea0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c009b90 tx=0x7f7f7c0117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7051ae56c3d4a59b server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:11.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.070+0000 7f7f82000640 1 -- 172.21.15.12:0/3452362544 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f7f74042070 con 0x7f7f84102d30 2024-09-05T01:35:11.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.070+0000 7f7f79c00640 1 -- 172.21.15.12:0/957035138 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c012450 con 0x55d634587ac0 2024-09-05T01:35:11.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.070+0000 7f7f79c00640 1 -- 172.21.15.12:0/957035138 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f7c012ad0 con 0x55d634587ac0 2024-09-05T01:35:11.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.070+0000 7f7f79c00640 1 -- 172.21.15.12:0/957035138 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c00fbb0 con 0x55d634587ac0 2024-09-05T01:35:11.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.071+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/957035138 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d634587ac0 msgr2=0x55d634587ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:11.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.071+0000 7f7f8ddfc740 1 --2- 172.21.15.12:0/957035138 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d634587ac0 0x55d634587ea0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c009b90 tx=0x7f7f7c0117b0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.073+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/957035138 shutdown_connections 2024-09-05T01:35:11.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.073+0000 7f7f8ddfc740 1 --2- 172.21.15.12:0/957035138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d634592ca0 0x55d634595090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.073+0000 7f7f8ddfc740 1 --2- 172.21.15.12:0/957035138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d6345883e0 0x55d634592760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.073+0000 7f7f8ddfc740 1 --2- 172.21.15.12:0/957035138 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d634587ac0 0x55d634587ea0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.073+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/957035138 >> 172.21.15.12:0/957035138 conn(0x55d634584050 msgr2=0x55d634584430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:11.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.073+0000 7f7f82000640 1 --2- 172.21.15.12:0/3452362544 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7f680a2e40 0x7f7f680a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:11.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.074+0000 7f7f82000640 1 -- 172.21.15.12:0/3452362544 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8623+0+0 (secure 0 0 0) 0x7f7f740efb80 con 0x7f7f84102d30 2024-09-05T01:35:11.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.074+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/957035138 shutdown_connections 2024-09-05T01:35:11.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.074+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/957035138 wait complete. 2024-09-05T01:35:11.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.074+0000 7f7f7be00640 1 --2- 172.21.15.12:0/3452362544 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7f680a2e40 0x7f7f680a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:11.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.075+0000 7f7f8ddfc740 1 -- start start 2024-09-05T01:35:11.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.075+0000 7f7f8ddfc740 1 Processor -- start 2024-09-05T01:35:11.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.076+0000 7f7f7be00640 1 --2- 172.21.15.12:0/3452362544 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7f680a2e40 0x7f7f680a5300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55d6345853d0 tx=0x7f7f6c009200 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:11.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.076+0000 7f7f8ddfc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d634587ac0 0x55d6345926d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:11.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.076+0000 7f7f8ddfc740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d6345883e0 0x55d63458f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:11.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.076+0000 7f7f8ddfc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d634592ca0 0x55d634590110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:11.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.076+0000 7f7f8ddfc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d634595910 con 0x55d634592ca0 2024-09-05T01:35:11.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.076+0000 7f7f8ddfc740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55d6344a8fa0 con 0x55d6345883e0 2024-09-05T01:35:11.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.076+0000 7f7f8ddfc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d634595a90 con 0x55d634587ac0 2024-09-05T01:35:11.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.076+0000 7f7f8ddfc740 10 client.0 _ll_register_callbacks cb 0x55d6341fcba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:35:11.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.076+0000 7f7f88a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d634587ac0 0x55d6345926d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:11.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.076+0000 7f7f7be00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d6345883e0 0x55d63458f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:11.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.076+0000 7f7f88a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d634587ac0 0x55d6345926d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:45902/0 (socket says 172.21.15.12:45902) 2024-09-05T01:35:11.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.076+0000 7f7f7be00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d6345883e0 0x55d63458f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:35616/0 (socket says 172.21.15.12:35616) 2024-09-05T01:35:11.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.076+0000 7f7f88a00640 1 -- 172.21.15.12:0/524855465 learned_addr learned my addr 172.21.15.12:0/524855465 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:11.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.077+0000 7f7f7be00640 1 -- 172.21.15.12:0/524855465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d634587ac0 msgr2=0x55d6345926d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:11.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.077+0000 7f7f7be00640 1 --2- 172.21.15.12:0/524855465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d634587ac0 0x55d6345926d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.077+0000 7f7f7be00640 1 -- 172.21.15.12:0/524855465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d634592ca0 msgr2=0x55d634590110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:11.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.077+0000 7f7f7be00640 1 --2- 172.21.15.12:0/524855465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d634592ca0 0x55d634590110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.077+0000 7f7f7be00640 1 -- 172.21.15.12:0/524855465 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d63459ed80 con 0x55d6345883e0 2024-09-05T01:35:11.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.078+0000 7f7f7be00640 1 --2- 172.21.15.12:0/524855465 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d6345883e0 0x55d63458f980 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7f841053e0 tx=0x7f7f6c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40a9e373a08122d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:11.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.078+0000 7f7f72000640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:35:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.080+0000 7f7f72000640 1 -- 172.21.15.12:0/524855465 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c003b70 con 0x55d6345883e0 2024-09-05T01:35:11.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.080+0000 7f7f72000640 1 -- 172.21.15.12:0/524855465 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8623+0+0 (secure 0 0 0) 0x7f7f6c003d10 con 0x55d6345883e0 2024-09-05T01:35:11.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.080+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/524855465 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f7c012ad0 con 0x55d6345883e0 2024-09-05T01:35:11.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.080+0000 7f7f72000640 1 -- 172.21.15.12:0/524855465 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f7f6c004b20 con 0x55d6345883e0 2024-09-05T01:35:11.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.081+0000 7f7f8ddfc740 10 client.26654 fetch_fsmap learned FSMap version 59 2024-09-05T01:35:11.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.081+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/524855465 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x55d6345a1970 con 0x55d6345883e0 2024-09-05T01:35:11.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.082+0000 7f7f72000640 1 -- 172.21.15.12:0/524855465 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f7c012ad0 con 0x55d6345883e0 2024-09-05T01:35:11.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.082+0000 7f7f72000640 1 -- 172.21.15.12:0/524855465 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 59) ==== 8434+0+0 (secure 0 0 0) 0x7f7f6c004290 con 0x55d6345883e0 2024-09-05T01:35:11.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.082+0000 7f7f8ddfc740 10 client.26654 fetch_fsmap finished waiting for FSMap version 59 2024-09-05T01:35:11.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.082+0000 7f7f8ddfc740 10 client.26654 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:35:11.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.082+0000 7f7f8ddfc740 20 client.26654 populate_metadata read hostname 'smithi012' 2024-09-05T01:35:11.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.082+0000 7f7f8ddfc740 1 --2- 172.21.15.12:0/524855465 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55d6345a2e80 0x55d6345a5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:11.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.082+0000 7f7f8ddfc740 4 client.26654 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:35:11.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.082+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/524855465 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6344fb800 con 0x55d6345a2e80 2024-09-05T01:35:11.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.083+0000 7f7f88a00640 1 --2- 172.21.15.12:0/524855465 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55d6345a2e80 0x55d6345a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:11.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.085+0000 7f7f88a00640 1 --2- 172.21.15.12:0/524855465 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55d6345a2e80 0x55d6345a5300 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77bec631bc92a387 server_cookie=81f47c1b2c3001a6 in_seq=0 out_seq=0 2024-09-05T01:35:11.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.085+0000 7f7f72000640 10 client.26654 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:35:11.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.087+0000 7f7f72000640 1 -- 172.21.15.12:0/524855465 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d6344fb800 con 0x55d6345a2e80 2024-09-05T01:35:11.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.087+0000 7f7f72000640 10 client.26654 handle_command_reply: tid=0 2024-09-05T01:35:11.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.087+0000 7f7f8ddfc740 1 client.26654 shutdown 2024-09-05T01:35:11.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.091+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/524855465 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d6345883e0 msgr2=0x55d63458f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:11.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.091+0000 7f7f8ddfc740 1 --2- 172.21.15.12:0/524855465 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d6345883e0 0x55d63458f980 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7f841053e0 tx=0x7f7f6c004a40 comp rx=0 tx=0).stop 2024-09-05T01:35:11.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.092+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/524855465 shutdown_connections 2024-09-05T01:35:11.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.092+0000 7f7f8ddfc740 1 --2- 172.21.15.12:0/524855465 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55d6345a2e80 0x55d6345a5300 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.092+0000 7f7f72000640 0 client.26654 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:35:11.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.092+0000 7f7f8ddfc740 1 --2- 172.21.15.12:0/524855465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d634592ca0 0x55d634590110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.092+0000 7f7f8ddfc740 1 --2- 172.21.15.12:0/524855465 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d6345883e0 0x55d63458f980 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.092+0000 7f7f8ddfc740 1 --2- 172.21.15.12:0/524855465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d634587ac0 0x55d6345926d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.092+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/524855465 >> 172.21.15.12:0/524855465 conn(0x55d634584050 msgr2=0x55d634589d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:11.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.093+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/524855465 shutdown_connections 2024-09-05T01:35:11.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.093+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/524855465 wait complete. 2024-09-05T01:35:11.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.093+0000 7f7f8ddfc740 20 client.26654 trim_cache size 0 max 16384 2024-09-05T01:35:11.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.128+0000 7f7f8ddfc740 1 Processor -- start 2024-09-05T01:35:11.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.128+0000 7f7f8ddfc740 1 -- start start 2024-09-05T01:35:11.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.129+0000 7f7f8ddfc740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d634587ac0 0x55d6345839b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:11.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.129+0000 7f7f8ddfc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6345883e0 0x55d63459e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:11.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.129+0000 7f7f8ddfc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d634592ca0 0x55d63459e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:11.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.130+0000 7f7f88a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d634587ac0 0x55d6345839b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:11.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.130+0000 7f7f88a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d634587ac0 0x55d6345839b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:35622/0 (socket says 172.21.15.12:35622) 2024-09-05T01:35:11.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.130+0000 7f7f89400640 1 --2- 172.21.15.12:0/2582897539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d634592ca0 0x55d63459e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:11.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.130+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/2582897539 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7f841bca20 con 0x55d634592ca0 2024-09-05T01:35:11.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.130+0000 7f7f7be00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6345883e0 0x55d63459e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:11.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.130+0000 7f7f88a00640 1 -- 172.21.15.12:0/2582897539 learned_addr learned my addr 172.21.15.12:0/2582897539 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:11.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.131+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/2582897539 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7f841be740 con 0x55d634587ac0 2024-09-05T01:35:11.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.131+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/2582897539 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7f841bd0f0 con 0x55d6345883e0 2024-09-05T01:35:11.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.131+0000 7f7f88a00640 1 -- 172.21.15.12:0/2582897539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6345883e0 msgr2=0x55d63459e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:11.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.131+0000 7f7f88a00640 1 --2- 172.21.15.12:0/2582897539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6345883e0 0x55d63459e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.131+0000 7f7f88a00640 1 -- 172.21.15.12:0/2582897539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d634592ca0 msgr2=0x55d63459e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:11.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.131+0000 7f7f88a00640 1 --2- 172.21.15.12:0/2582897539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d634592ca0 0x55d63459e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.131+0000 7f7f88a00640 1 -- 172.21.15.12:0/2582897539 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d634592070 con 0x55d634587ac0 2024-09-05T01:35:11.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.131+0000 7f7f7be00640 1 --2- 172.21.15.12:0/2582897539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6345883e0 0x55d63459e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:35:11.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.131+0000 7f7f89400640 1 --2- 172.21.15.12:0/2582897539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d634592ca0 0x55d63459e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:35:11.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.133+0000 7f7f88a00640 1 --2- 172.21.15.12:0/2582897539 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d634587ac0 0x55d6345839b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7f7402a980 tx=0x7f7f7402a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=816cb4de89fc741e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:11.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.133+0000 7f7f79200640 1 -- 172.21.15.12:0/2582897539 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f740d4070 con 0x55d634587ac0 2024-09-05T01:35:11.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.134+0000 7f7f79200640 1 -- 172.21.15.12:0/2582897539 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f740bbfe0 con 0x55d634587ac0 2024-09-05T01:35:11.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.134+0000 7f7f79200640 1 -- 172.21.15.12:0/2582897539 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f740ba370 con 0x55d634587ac0 2024-09-05T01:35:11.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.135+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/2582897539 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d634587ac0 msgr2=0x55d6345839b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:11.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.135+0000 7f7f8ddfc740 1 --2- 172.21.15.12:0/2582897539 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d634587ac0 0x55d6345839b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7f7402a980 tx=0x7f7f7402a410 comp rx=0 tx=0).stop 2024-09-05T01:35:11.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.135+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/2582897539 shutdown_connections 2024-09-05T01:35:11.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.135+0000 7f7f8ddfc740 1 --2- 172.21.15.12:0/2582897539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d634592ca0 0x55d63459e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.135+0000 7f7f8ddfc740 1 --2- 172.21.15.12:0/2582897539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6345883e0 0x55d63459e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.135+0000 7f7f8ddfc740 1 --2- 172.21.15.12:0/2582897539 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d634587ac0 0x55d6345839b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.135+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/2582897539 >> 172.21.15.12:0/2582897539 conn(0x55d634584050 msgr2=0x55d63459db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:11.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.136+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/2582897539 shutdown_connections 2024-09-05T01:35:11.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.136+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/2582897539 wait complete. 2024-09-05T01:35:11.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.137+0000 7f7f8ddfc740 1 -- start start 2024-09-05T01:35:11.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.138+0000 7f7f8ddfc740 1 Processor -- start 2024-09-05T01:35:11.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.138+0000 7f7f8ddfc740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d634587ac0 0x55d63459b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:11.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.139+0000 7f7f8ddfc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6345883e0 0x55d63459b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:11.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.139+0000 7f7f8ddfc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d634592ca0 0x55d634599510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:11.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.139+0000 7f7f8ddfc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7f841bdfe0 con 0x55d634592ca0 2024-09-05T01:35:11.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.139+0000 7f7f8ddfc740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7f841bd850 con 0x55d634587ac0 2024-09-05T01:35:11.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.139+0000 7f7f8ddfc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7f841a1920 con 0x55d6345883e0 2024-09-05T01:35:11.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.139+0000 7f7f8ddfc740 10 client.0 _ll_register_callbacks cb 0x7f7f6c009a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:35:11.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.139+0000 7f7f88a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d634587ac0 0x55d63459b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:11.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.139+0000 7f7f88a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d634587ac0 0x55d63459b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:35638/0 (socket says 172.21.15.12:35638) 2024-09-05T01:35:11.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.139+0000 7f7f88a00640 1 -- 172.21.15.12:0/1758302857 learned_addr learned my addr 172.21.15.12:0/1758302857 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:11.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.140+0000 7f7f7be00640 1 --2- 172.21.15.12:0/1758302857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6345883e0 0x55d63459b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:11.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.140+0000 7f7f89400640 1 --2- 172.21.15.12:0/1758302857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d634592ca0 0x55d634599510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:11.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.140+0000 7f7f7be00640 1 -- 172.21.15.12:0/1758302857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d634587ac0 msgr2=0x55d63459b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:11.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.140+0000 7f7f7be00640 1 --2- 172.21.15.12:0/1758302857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d634587ac0 0x55d63459b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.140+0000 7f7f7be00640 1 -- 172.21.15.12:0/1758302857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d634592ca0 msgr2=0x55d634599510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:11.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.140+0000 7f7f7be00640 1 --2- 172.21.15.12:0/1758302857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d634592ca0 0x55d634599510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.140+0000 7f7f7be00640 1 -- 172.21.15.12:0/1758302857 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d634599d10 con 0x55d6345883e0 2024-09-05T01:35:11.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.140+0000 7f7f89400640 1 --2- 172.21.15.12:0/1758302857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d634592ca0 0x55d634599510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:35:11.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.141+0000 7f7f72000640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:35:11.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.141+0000 7f7f7be00640 1 --2- 172.21.15.12:0/1758302857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6345883e0 0x55d63459b560 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55d634588990 tx=0x7f7f6c004f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed5563034c5d2f18 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:11.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.141+0000 7f7f72000640 1 -- 172.21.15.12:0/1758302857 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c00e750 con 0x55d6345883e0 2024-09-05T01:35:11.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.142+0000 7f7f72000640 1 -- 172.21.15.12:0/1758302857 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8623+0+0 (secure 0 0 0) 0x7f7f6c01c980 con 0x55d6345883e0 2024-09-05T01:35:11.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.142+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/1758302857 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f740bbfe0 con 0x55d6345883e0 2024-09-05T01:35:11.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.142+0000 7f7f72000640 1 -- 172.21.15.12:0/1758302857 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f7f6c00e750 con 0x55d6345883e0 2024-09-05T01:35:11.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.142+0000 7f7f8ddfc740 10 client.26644 fetch_fsmap learned FSMap version 59 2024-09-05T01:35:11.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.142+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/1758302857 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x55d63461f800 con 0x55d6345883e0 2024-09-05T01:35:11.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.144+0000 7f7f72000640 1 -- 172.21.15.12:0/1758302857 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f6c01cb80 con 0x55d6345883e0 2024-09-05T01:35:11.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.144+0000 7f7f72000640 1 -- 172.21.15.12:0/1758302857 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 59) ==== 8434+0+0 (secure 0 0 0) 0x7f7f6c039070 con 0x55d6345883e0 2024-09-05T01:35:11.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.144+0000 7f7f8ddfc740 10 client.26644 fetch_fsmap finished waiting for FSMap version 59 2024-09-05T01:35:11.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.144+0000 7f7f8ddfc740 10 client.26644 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:35:11.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.144+0000 7f7f8ddfc740 20 client.26644 populate_metadata read hostname 'smithi012' 2024-09-05T01:35:11.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.144+0000 7f7f8ddfc740 1 --2- 172.21.15.12:0/1758302857 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55d6345a2e80 0x55d634622080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:11.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.144+0000 7f7f8ddfc740 4 client.26644 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-05T01:35:11.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.144+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/1758302857 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f7f740bbfe0 con 0x55d6345a2e80 2024-09-05T01:35:11.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.145+0000 7f7f88a00640 1 --2- 172.21.15.12:0/1758302857 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55d6345a2e80 0x55d634622080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:11.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.146+0000 7f7f72000640 10 client.26644 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:35:11.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.146+0000 7f7f88a00640 1 --2- 172.21.15.12:0/1758302857 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55d6345a2e80 0x55d634622080 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80987a6d32bb79f5 server_cookie=e3f3b0cd97edffdc in_seq=0 out_seq=0 2024-09-05T01:35:11.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.149+0000 7f7f72000640 1 -- 172.21.15.12:0/1758302857 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f7f740bbfe0 con 0x55d6345a2e80 2024-09-05T01:35:11.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.149+0000 7f7f72000640 10 client.26644 handle_command_reply: tid=0 2024-09-05T01:35:11.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.149+0000 7f7f8ddfc740 1 client.26644 shutdown 2024-09-05T01:35:11.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.150+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/1758302857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6345883e0 msgr2=0x55d63459b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:11.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.150+0000 7f7f8ddfc740 1 --2- 172.21.15.12:0/1758302857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6345883e0 0x55d63459b560 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55d634588990 tx=0x7f7f6c004f70 comp rx=0 tx=0).stop 2024-09-05T01:35:11.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.151+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/1758302857 shutdown_connections 2024-09-05T01:35:11.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.151+0000 7f7f8ddfc740 1 --2- 172.21.15.12:0/1758302857 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55d6345a2e80 0x55d634622080 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.151+0000 7f7f72000640 0 client.26644 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:35:11.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.151+0000 7f7f8ddfc740 1 --2- 172.21.15.12:0/1758302857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d634592ca0 0x55d634599510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.151+0000 7f7f8ddfc740 1 --2- 172.21.15.12:0/1758302857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6345883e0 0x55d63459b560 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.151+0000 7f7f8ddfc740 1 --2- 172.21.15.12:0/1758302857 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d634587ac0 0x55d63459b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.152+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/1758302857 >> 172.21.15.12:0/1758302857 conn(0x55d634584050 msgr2=0x55d63459e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:11.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.152+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/1758302857 shutdown_connections 2024-09-05T01:35:11.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.152+0000 7f7f8ddfc740 1 -- 172.21.15.12:0/1758302857 wait complete. 2024-09-05T01:35:11.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.152+0000 7f7f8ddfc740 20 client.26644 trim_cache size 0 max 16384 2024-09-05T01:35:11.154 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:35:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: "return_code": 0, 2024-09-05T01:35:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_tag": "b26ade98-013f-441e-85ac-fcd7a1d1c6fd", 2024-09-05T01:35:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": "asynchronous" 2024-09-05T01:35:11.155 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:35:11.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.154+0000 7f7f8b400640 1 -- 172.21.15.12:0/3452362544 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7f680a2e40 msgr2=0x7f7f680a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:11.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.154+0000 7f7f8b400640 1 --2- 172.21.15.12:0/3452362544 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7f680a2e40 0x7f7f680a5300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55d6345853d0 tx=0x7f7f6c009200 comp rx=0 tx=0).stop 2024-09-05T01:35:11.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.154+0000 7f7f8b400640 1 -- 172.21.15.12:0/3452362544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f84102d30 msgr2=0x7f7f84103c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:11.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.154+0000 7f7f8b400640 1 --2- 172.21.15.12:0/3452362544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f84102d30 0x7f7f84103c20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7f7402aa00 tx=0x7f7f74003b90 comp rx=0 tx=0).stop 2024-09-05T01:35:11.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.154+0000 7f7f8b400640 1 -- 172.21.15.12:0/3452362544 shutdown_connections 2024-09-05T01:35:11.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.154+0000 7f7f8b400640 1 --2- 172.21.15.12:0/3452362544 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7f680a2e40 0x7f7f680a5300 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.154+0000 7f7f8b400640 1 --2- 172.21.15.12:0/3452362544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f841082a0 0x7f7f841046a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.154+0000 7f7f8b400640 1 --2- 172.21.15.12:0/3452362544 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7f841036e0 0x7f7f84104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.154+0000 7f7f8b400640 1 --2- 172.21.15.12:0/3452362544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f84102d30 0x7f7f84103c20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:11.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.154+0000 7f7f8b400640 1 -- 172.21.15.12:0/3452362544 >> 172.21.15.12:0/3452362544 conn(0x7f7f840fc7d0 msgr2=0x7f7f84101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:11.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.154+0000 7f7f8b400640 1 -- 172.21.15.12:0/3452362544 shutdown_connections 2024-09-05T01:35:11.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:11.157+0000 7f7f8b400640 1 -- 172.21.15.12:0/3452362544 wait complete. 2024-09-05T01:35:11.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:11 smithi012 ceph-mon[29942]: pgmap v326: 97 pgs: 22 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 41 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 259 op/s 2024-09-05T01:35:11.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:11 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:35:11.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:11 smithi012 ceph-mon[29942]: scrub queued for path: / 2024-09-05T01:35:11.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:11 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:11.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:11 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:11.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:11 smithi145 ceph-mon[34376]: pgmap v326: 97 pgs: 22 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 41 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 259 op/s 2024-09-05T01:35:11.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:11 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:35:11.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:11 smithi145 ceph-mon[34376]: scrub queued for path: / 2024-09-05T01:35:11.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:11 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:11.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:11 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:11.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:11 smithi151 ceph-mon[35013]: pgmap v326: 97 pgs: 22 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 41 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 259 op/s 2024-09-05T01:35:11.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:11 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:35:11.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:11 smithi151 ceph-mon[35013]: scrub queued for path: / 2024-09-05T01:35:11.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:11 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:11.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:11 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:11.956 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T01:35:12.627 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:35:12.806 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:12 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:12.806 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:12 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:12.806 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:12 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:12.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:12 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:12.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:12 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:12.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:12 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:12.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:12 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:12.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:12 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:12.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:12 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:13.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.400+0000 7fb17b200640 1 -- 172.21.15.12:0/1324321067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb174076720 msgr2=0x7fb174076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:13.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.400+0000 7fb17b200640 1 --2- 172.21.15.12:0/1324321067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb174076720 0x7fb174076b00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb15c009860 tx=0x7fb15c02a340 comp rx=0 tx=0).stop 2024-09-05T01:35:13.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.401+0000 7fb17b200640 1 -- 172.21.15.12:0/1324321067 shutdown_connections 2024-09-05T01:35:13.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.401+0000 7fb17b200640 1 --2- 172.21.15.12:0/1324321067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb174112a50 0x7fb174114e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.401+0000 7fb17b200640 1 --2- 172.21.15.12:0/1324321067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb174077040 0x7fb174112510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.401+0000 7fb17b200640 1 --2- 172.21.15.12:0/1324321067 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb174076720 0x7fb174076b00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.401+0000 7fb17b200640 1 -- 172.21.15.12:0/1324321067 >> 172.21.15.12:0/1324321067 conn(0x7fb1740ffa50 msgr2=0x7fb174101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:13.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.401+0000 7fb17b200640 1 -- 172.21.15.12:0/1324321067 shutdown_connections 2024-09-05T01:35:13.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.401+0000 7fb17b200640 1 -- 172.21.15.12:0/1324321067 wait complete. 2024-09-05T01:35:13.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.403+0000 7fb17b200640 1 Processor -- start 2024-09-05T01:35:13.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.405+0000 7fb17b200640 1 -- start start 2024-09-05T01:35:13.407 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.406+0000 7fb17b200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb174076720 0x7fb1741a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:13.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.406+0000 7fb17b200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb174077040 0x7fb1741a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:13.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.406+0000 7fb17b200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb174112a50 0x7fb17419e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:13.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.406+0000 7fb17b200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb1741185c0 con 0x7fb174077040 2024-09-05T01:35:13.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.406+0000 7fb17b200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb174118440 con 0x7fb174112a50 2024-09-05T01:35:13.408 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.406+0000 7fb17b200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb174118740 con 0x7fb174076720 2024-09-05T01:35:13.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.407+0000 7fb173400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb174077040 0x7fb1741a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:13.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.407+0000 7fb173400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb174077040 0x7fb1741a4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41508/0 (socket says 172.21.15.12:41508) 2024-09-05T01:35:13.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.407+0000 7fb173400640 1 -- 172.21.15.12:0/3680839693 learned_addr learned my addr 172.21.15.12:0/3680839693 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:13.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.407+0000 7fb173400640 1 -- 172.21.15.12:0/3680839693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb174076720 msgr2=0x7fb1741a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:13.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.407+0000 7fb173400640 1 --2- 172.21.15.12:0/3680839693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb174076720 0x7fb1741a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.407+0000 7fb173400640 1 -- 172.21.15.12:0/3680839693 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb174112a50 msgr2=0x7fb17419e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:13.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.407+0000 7fb173400640 1 --2- 172.21.15.12:0/3680839693 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb174112a50 0x7fb17419e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.407+0000 7fb173400640 1 -- 172.21.15.12:0/3680839693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17419efe0 con 0x7fb174077040 2024-09-05T01:35:13.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.408+0000 7fb173400640 1 --2- 172.21.15.12:0/3680839693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb174077040 0x7fb1741a4c30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00efb0 tx=0x7fb16c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:13.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.408+0000 7fb170c00640 1 -- 172.21.15.12:0/3680839693 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c01b070 con 0x7fb174077040 2024-09-05T01:35:13.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.408+0000 7fb170c00640 1 -- 172.21.15.12:0/3680839693 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb16c00ba50 con 0x7fb174077040 2024-09-05T01:35:13.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.408+0000 7fb170c00640 1 -- 172.21.15.12:0/3680839693 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c016c00 con 0x7fb174077040 2024-09-05T01:35:13.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.409+0000 7fb17b200640 1 -- 172.21.15.12:0/3680839693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb17419f2d0 con 0x7fb174077040 2024-09-05T01:35:13.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.410+0000 7fb17b200640 1 -- 172.21.15.12:0/3680839693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1741ab5c0 con 0x7fb174077040 2024-09-05T01:35:13.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.416+0000 7fb17de58740 1 Processor -- start 2024-09-05T01:35:13.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.417+0000 7fb17de58740 1 -- start start 2024-09-05T01:35:13.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.417+0000 7fb17de58740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c59b90 0x558c51c59f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:13.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.417+0000 7fb17de58740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558c51c5a4b0 0x558c51c64830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:13.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.417+0000 7fb17de58740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c51c64d70 0x558c51c67160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:13.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.417+0000 7fb17de58740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558c51bc03e0 con 0x558c51c64d70 2024-09-05T01:35:13.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.417+0000 7fb17de58740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x558c51b67d80 con 0x558c51c5a4b0 2024-09-05T01:35:13.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.417+0000 7fb17de58740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558c51bbc3a0 con 0x558c51c59b90 2024-09-05T01:35:13.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.418+0000 7fb170c00640 1 -- 172.21.15.12:0/3680839693 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fb16c01e070 con 0x7fb174077040 2024-09-05T01:35:13.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.418+0000 7fb173e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558c51c5a4b0 0x558c51c64830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:13.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.418+0000 7fb173e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558c51c5a4b0 0x558c51c64830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:35676/0 (socket says 172.21.15.12:35676) 2024-09-05T01:35:13.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.418+0000 7fb173e00640 1 -- 172.21.15.12:0/1827781238 learned_addr learned my addr 172.21.15.12:0/1827781238 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:13.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.419+0000 7fb179200640 1 --2- 172.21.15.12:0/1827781238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c59b90 0x558c51c59f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:13.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.419+0000 7fb173e00640 1 -- 172.21.15.12:0/1827781238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c59b90 msgr2=0x558c51c59f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:13.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.419+0000 7fb173400640 1 --2- 172.21.15.12:0/1827781238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c51c64d70 0x558c51c67160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:13.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.419+0000 7fb173e00640 1 --2- 172.21.15.12:0/1827781238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c59b90 0x558c51c59f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.419+0000 7fb173e00640 1 -- 172.21.15.12:0/1827781238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c51c64d70 msgr2=0x558c51c67160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:13.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.420+0000 7fb173e00640 1 --2- 172.21.15.12:0/1827781238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c51c64d70 0x558c51c67160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.420+0000 7fb173e00640 1 -- 172.21.15.12:0/1827781238 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c51b86ae0 con 0x558c51c5a4b0 2024-09-05T01:35:13.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.420+0000 7fb170c00640 1 --2- 172.21.15.12:0/3680839693 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fb1580a2d70 0x7fb1580a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:13.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.420+0000 7fb179200640 1 --2- 172.21.15.12:0/1827781238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c59b90 0x558c51c59f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:35:13.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.421+0000 7fb170c00640 1 -- 172.21.15.12:0/3680839693 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8623+0+0 (secure 0 0 0) 0x7fb16c0cf760 con 0x7fb174077040 2024-09-05T01:35:13.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.421+0000 7fb173400640 1 --2- 172.21.15.12:0/1827781238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c51c64d70 0x558c51c67160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:35:13.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.421+0000 7fb173e00640 1 --2- 172.21.15.12:0/1827781238 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558c51c5a4b0 0x558c51c64830 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb15c009780 tx=0x7fb15c005c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23305de3ec09014 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:13.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.422+0000 7fb179200640 1 --2- 172.21.15.12:0/3680839693 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fb1580a2d70 0x7fb1580a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:13.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.422+0000 7fb169600640 1 -- 172.21.15.12:0/1827781238 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c037040 con 0x558c51c5a4b0 2024-09-05T01:35:13.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.422+0000 7fb169600640 1 -- 172.21.15.12:0/1827781238 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb15c040070 con 0x558c51c5a4b0 2024-09-05T01:35:13.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.422+0000 7fb169600640 1 -- 172.21.15.12:0/1827781238 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c003850 con 0x558c51c5a4b0 2024-09-05T01:35:13.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.423+0000 7fb179200640 1 --2- 172.21.15.12:0/3680839693 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fb1580a2d70 0x7fb1580a5230 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb164005940 tx=0x7fb164005cd0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:13.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.424+0000 7fb17de58740 1 -- 172.21.15.12:0/1827781238 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558c51c5a4b0 msgr2=0x558c51c64830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:13.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.424+0000 7fb17de58740 1 --2- 172.21.15.12:0/1827781238 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558c51c5a4b0 0x558c51c64830 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb15c009780 tx=0x7fb15c005c90 comp rx=0 tx=0).stop 2024-09-05T01:35:13.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.424+0000 7fb17de58740 1 -- 172.21.15.12:0/1827781238 shutdown_connections 2024-09-05T01:35:13.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.424+0000 7fb17de58740 1 --2- 172.21.15.12:0/1827781238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c51c64d70 0x558c51c67160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.424+0000 7fb17de58740 1 --2- 172.21.15.12:0/1827781238 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558c51c5a4b0 0x558c51c64830 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.424+0000 7fb17de58740 1 --2- 172.21.15.12:0/1827781238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c59b90 0x558c51c59f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.424+0000 7fb17de58740 1 -- 172.21.15.12:0/1827781238 >> 172.21.15.12:0/1827781238 conn(0x558c51c56120 msgr2=0x558c51c56500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:13.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.425+0000 7fb17de58740 1 -- 172.21.15.12:0/1827781238 shutdown_connections 2024-09-05T01:35:13.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.425+0000 7fb17de58740 1 -- 172.21.15.12:0/1827781238 wait complete. 2024-09-05T01:35:13.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.425+0000 7fb17de58740 1 -- start start 2024-09-05T01:35:13.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.426+0000 7fb17de58740 1 Processor -- start 2024-09-05T01:35:13.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.428+0000 7fb17de58740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558c51c59b90 0x558c51c61b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:13.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.428+0000 7fb17de58740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c5a4b0 0x558c51c620c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:13.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.428+0000 7fb17de58740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c51c64d70 0x558c51c62600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:13.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.428+0000 7fb173400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c5a4b0 0x558c51c620c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:13.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.428+0000 7fb17de58740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558c51c789f0 con 0x558c51c64d70 2024-09-05T01:35:13.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.428+0000 7fb17de58740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x558c51b7b0f0 con 0x558c51c59b90 2024-09-05T01:35:13.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.428+0000 7fb173400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c5a4b0 0x558c51c620c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:45940/0 (socket says 172.21.15.12:45940) 2024-09-05T01:35:13.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.428+0000 7fb17de58740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558c51c78b70 con 0x558c51c5a4b0 2024-09-05T01:35:13.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.428+0000 7fb173400640 1 -- 172.21.15.12:0/3570303662 learned_addr learned my addr 172.21.15.12:0/3570303662 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:13.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.428+0000 7fb17de58740 10 client.0 _ll_register_callbacks cb 0x558c51b6c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:35:13.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.428+0000 7fb173e00640 1 --2- 172.21.15.12:0/3570303662 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558c51c59b90 0x558c51c61b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:13.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.429+0000 7fb179200640 1 --2- 172.21.15.12:0/3570303662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c51c64d70 0x558c51c62600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:13.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.429+0000 7fb173e00640 1 -- 172.21.15.12:0/3570303662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c5a4b0 msgr2=0x558c51c620c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:13.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.429+0000 7fb173e00640 1 --2- 172.21.15.12:0/3570303662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c5a4b0 0x558c51c620c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.429+0000 7fb173e00640 1 -- 172.21.15.12:0/3570303662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c51c64d70 msgr2=0x558c51c62600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:13.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.429+0000 7fb173e00640 1 --2- 172.21.15.12:0/3570303662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c51c64d70 0x558c51c62600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.429+0000 7fb173e00640 1 -- 172.21.15.12:0/3570303662 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c519313c0 con 0x558c51c59b90 2024-09-05T01:35:13.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.429+0000 7fb173400640 1 --2- 172.21.15.12:0/3570303662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c5a4b0 0x558c51c620c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:35:13.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.430+0000 7fb173e00640 1 --2- 172.21.15.12:0/3570303662 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558c51c59b90 0x558c51c61b80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb15c02a930 tx=0x7fb15c0303c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=648e564067495de3 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:13.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.430+0000 7fb162000640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:35:13.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.432+0000 7fb162000640 1 -- 172.21.15.12:0/3570303662 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c04a070 con 0x558c51c59b90 2024-09-05T01:35:13.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.433+0000 7fb162000640 1 -- 172.21.15.12:0/3570303662 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8623+0+0 (secure 0 0 0) 0x7fb15c004240 con 0x558c51c59b90 2024-09-05T01:35:13.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.433+0000 7fb17de58740 1 -- 172.21.15.12:0/3570303662 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb15c040070 con 0x558c51c59b90 2024-09-05T01:35:13.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.433+0000 7fb162000640 1 -- 172.21.15.12:0/3570303662 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fb15c037040 con 0x558c51c59b90 2024-09-05T01:35:13.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.434+0000 7fb17de58740 10 client.26669 fetch_fsmap learned FSMap version 59 2024-09-05T01:35:13.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.434+0000 7fb17de58740 1 -- 172.21.15.12:0/3570303662 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x558c51c84560 con 0x558c51c59b90 2024-09-05T01:35:13.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.434+0000 7fb162000640 1 -- 172.21.15.12:0/3570303662 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb15c040070 con 0x558c51c59b90 2024-09-05T01:35:13.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.435+0000 7fb162000640 1 -- 172.21.15.12:0/3570303662 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 59) ==== 8434+0+0 (secure 0 0 0) 0x7fb15c03a070 con 0x558c51c59b90 2024-09-05T01:35:13.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.435+0000 7fb17de58740 10 client.26669 fetch_fsmap finished waiting for FSMap version 59 2024-09-05T01:35:13.437 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.435+0000 7fb17de58740 10 client.26669 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:35:13.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.435+0000 7fb17de58740 20 client.26669 populate_metadata read hostname 'smithi012' 2024-09-05T01:35:13.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.435+0000 7fb17de58740 1 --2- 172.21.15.12:0/3570303662 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558c51c858b0 0x558c51c87ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:13.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.435+0000 7fb17de58740 4 client.26669 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:35:13.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.435+0000 7fb17de58740 1 -- 172.21.15.12:0/3570303662 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c51bcd950 con 0x558c51c858b0 2024-09-05T01:35:13.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.436+0000 7fb173400640 1 --2- 172.21.15.12:0/3570303662 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558c51c858b0 0x558c51c87ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:13.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.437+0000 7fb173400640 1 --2- 172.21.15.12:0/3570303662 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558c51c858b0 0x558c51c87ca0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5e6301e5f2d52af server_cookie=e77185abfe3b6742 in_seq=0 out_seq=0 2024-09-05T01:35:13.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.437+0000 7fb162000640 10 client.26669 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:35:13.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.438+0000 7fb162000640 1 -- 172.21.15.12:0/3570303662 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c51bcd950 con 0x558c51c858b0 2024-09-05T01:35:13.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.438+0000 7fb162000640 10 client.26669 handle_command_reply: tid=0 2024-09-05T01:35:13.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.439+0000 7fb17de58740 1 client.26669 shutdown 2024-09-05T01:35:13.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.439+0000 7fb17de58740 1 -- 172.21.15.12:0/3570303662 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558c51c59b90 msgr2=0x558c51c61b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:13.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.439+0000 7fb17de58740 1 --2- 172.21.15.12:0/3570303662 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558c51c59b90 0x558c51c61b80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb15c02a930 tx=0x7fb15c0303c0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.439+0000 7fb17de58740 1 -- 172.21.15.12:0/3570303662 shutdown_connections 2024-09-05T01:35:13.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.439+0000 7fb17de58740 1 --2- 172.21.15.12:0/3570303662 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558c51c858b0 0x558c51c87ca0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.439+0000 7fb17de58740 1 --2- 172.21.15.12:0/3570303662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c51c64d70 0x558c51c62600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.439+0000 7fb17de58740 1 --2- 172.21.15.12:0/3570303662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c5a4b0 0x558c51c620c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.439+0000 7fb17de58740 1 --2- 172.21.15.12:0/3570303662 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558c51c59b90 0x558c51c61b80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.439+0000 7fb17de58740 1 -- 172.21.15.12:0/3570303662 >> 172.21.15.12:0/3570303662 conn(0x558c51c56120 msgr2=0x558c51c5be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:13.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.440+0000 7fb162000640 0 client.26669 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:35:13.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.441+0000 7fb17de58740 1 -- 172.21.15.12:0/3570303662 shutdown_connections 2024-09-05T01:35:13.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.441+0000 7fb17de58740 1 -- 172.21.15.12:0/3570303662 wait complete. 2024-09-05T01:35:13.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.441+0000 7fb17de58740 20 client.26669 trim_cache size 0 max 16384 2024-09-05T01:35:13.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.477+0000 7fb17de58740 1 Processor -- start 2024-09-05T01:35:13.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.478+0000 7fb17de58740 1 -- start start 2024-09-05T01:35:13.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.478+0000 7fb17de58740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c51c5a4b0 0x558c51c5c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:13.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.478+0000 7fb17de58740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c64d70 0x558c51c62450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:13.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.478+0000 7fb17de58740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558c51c5ede0 0x558c51c5f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:13.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.478+0000 7fb17de58740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb1741ab970 con 0x558c51c5a4b0 2024-09-05T01:35:13.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.478+0000 7fb17de58740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb1741ad690 con 0x558c51c5ede0 2024-09-05T01:35:13.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.478+0000 7fb17de58740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb1741ac040 con 0x558c51c64d70 2024-09-05T01:35:13.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.478+0000 7fb173400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c64d70 0x558c51c62450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:13.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.479+0000 7fb173400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c64d70 0x558c51c62450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:45950/0 (socket says 172.21.15.12:45950) 2024-09-05T01:35:13.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.479+0000 7fb173400640 1 -- 172.21.15.12:0/2800330294 learned_addr learned my addr 172.21.15.12:0/2800330294 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:13.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.479+0000 7fb173400640 1 -- 172.21.15.12:0/2800330294 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558c51c5ede0 msgr2=0x558c51c5f270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:35:13.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.479+0000 7fb173400640 1 --2- 172.21.15.12:0/2800330294 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558c51c5ede0 0x558c51c5f270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.479+0000 7fb173400640 1 -- 172.21.15.12:0/2800330294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c51c5a4b0 msgr2=0x558c51c5c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:13.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.480+0000 7fb173e00640 1 --2- 172.21.15.12:0/2800330294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c51c5a4b0 0x558c51c5c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:13.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.481+0000 7fb173400640 1 --2- 172.21.15.12:0/2800330294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c51c5a4b0 0x558c51c5c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.481+0000 7fb173400640 1 -- 172.21.15.12:0/2800330294 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c51c600d0 con 0x558c51c64d70 2024-09-05T01:35:13.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.481+0000 7fb173e00640 1 --2- 172.21.15.12:0/2800330294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c51c5a4b0 0x558c51c5c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:35:13.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.482+0000 7fb173400640 1 --2- 172.21.15.12:0/2800330294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c64d70 0x558c51c62450 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb16c098540 tx=0x7fb16c00bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47e422c585be6dee server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:13.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.482+0000 7fb168c00640 1 -- 172.21.15.12:0/2800330294 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c099c60 con 0x558c51c64d70 2024-09-05T01:35:13.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.483+0000 7fb168c00640 1 -- 172.21.15.12:0/2800330294 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb16c099ec0 con 0x558c51c64d70 2024-09-05T01:35:13.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.483+0000 7fb168c00640 1 -- 172.21.15.12:0/2800330294 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c0cfe40 con 0x558c51c64d70 2024-09-05T01:35:13.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.484+0000 7fb17de58740 1 -- 172.21.15.12:0/2800330294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c64d70 msgr2=0x558c51c62450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:13.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.484+0000 7fb17de58740 1 --2- 172.21.15.12:0/2800330294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c64d70 0x558c51c62450 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb16c098540 tx=0x7fb16c00bf90 comp rx=0 tx=0).stop 2024-09-05T01:35:13.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.486+0000 7fb17de58740 1 -- 172.21.15.12:0/2800330294 shutdown_connections 2024-09-05T01:35:13.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.486+0000 7fb17de58740 1 --2- 172.21.15.12:0/2800330294 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558c51c5ede0 0x558c51c5f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.486+0000 7fb17de58740 1 --2- 172.21.15.12:0/2800330294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c64d70 0x558c51c62450 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.486+0000 7fb17de58740 1 --2- 172.21.15.12:0/2800330294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c51c5a4b0 0x558c51c5c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.486+0000 7fb17de58740 1 -- 172.21.15.12:0/2800330294 >> 172.21.15.12:0/2800330294 conn(0x558c51c56120 msgr2=0x558c51c63c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.486+0000 7fb17de58740 1 -- 172.21.15.12:0/2800330294 shutdown_connections 2024-09-05T01:35:13.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.486+0000 7fb17de58740 1 -- 172.21.15.12:0/2800330294 wait complete. 2024-09-05T01:35:13.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.487+0000 7fb17de58740 1 -- start start 2024-09-05T01:35:13.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.487+0000 7fb17de58740 1 Processor -- start 2024-09-05T01:35:13.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.488+0000 7fb17de58740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c5a4b0 0x558c51c8af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.488+0000 7fb17de58740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558c51c5ede0 0x558c51c882e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.488+0000 7fb17de58740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c51c64d70 0x558c51c88820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.488+0000 7fb17de58740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb1741acf30 con 0x558c51c64d70 2024-09-05T01:35:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.488+0000 7fb17de58740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fb1741ac7a0 con 0x558c51c5ede0 2024-09-05T01:35:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.488+0000 7fb17de58740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb17410bfe0 con 0x558c51c5a4b0 2024-09-05T01:35:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.489+0000 7fb17de58740 10 client.0 _ll_register_callbacks cb 0x7fb15c005f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:35:13.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.490+0000 7fb173e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c5a4b0 0x558c51c8af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:13.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.490+0000 7fb173400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558c51c5ede0 0x558c51c882e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:13.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.490+0000 7fb173e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c5a4b0 0x558c51c8af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:45958/0 (socket says 172.21.15.12:45958) 2024-09-05T01:35:13.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.490+0000 7fb173e00640 1 -- 172.21.15.12:0/3733880455 learned_addr learned my addr 172.21.15.12:0/3733880455 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:13.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.490+0000 7fb179200640 1 --2- 172.21.15.12:0/3733880455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c51c64d70 0x558c51c88820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:13.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.491+0000 7fb173400640 1 -- 172.21.15.12:0/3733880455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c5a4b0 msgr2=0x558c51c8af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:13.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.491+0000 7fb173400640 1 --2- 172.21.15.12:0/3733880455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c5a4b0 0x558c51c8af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.491+0000 7fb173400640 1 -- 172.21.15.12:0/3733880455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c51c64d70 msgr2=0x558c51c88820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:13.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.491+0000 7fb173400640 1 --2- 172.21.15.12:0/3733880455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c51c64d70 0x558c51c88820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.491+0000 7fb173400640 1 -- 172.21.15.12:0/3733880455 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c51c88f80 con 0x558c51c5ede0 2024-09-05T01:35:13.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.491+0000 7fb173e00640 1 --2- 172.21.15.12:0/3733880455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c5a4b0 0x558c51c8af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:35:13.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.492+0000 7fb173400640 1 --2- 172.21.15.12:0/3733880455 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558c51c5ede0 0x558c51c882e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00cd00 tx=0x7fb16c016410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a243d0051b0f6414 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:13.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.492+0000 7fb162000640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:35:13.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.494+0000 7fb162000640 1 -- 172.21.15.12:0/3733880455 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c0cd270 con 0x558c51c5ede0 2024-09-05T01:35:13.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.495+0000 7fb162000640 1 -- 172.21.15.12:0/3733880455 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8623+0+0 (secure 0 0 0) 0x7fb16c0ba300 con 0x558c51c5ede0 2024-09-05T01:35:13.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.495+0000 7fb17de58740 1 -- 172.21.15.12:0/3733880455 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb16c099ec0 con 0x558c51c5ede0 2024-09-05T01:35:13.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.497+0000 7fb162000640 1 -- 172.21.15.12:0/3733880455 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fb16c0ba500 con 0x558c51c5ede0 2024-09-05T01:35:13.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.497+0000 7fb17de58740 10 client.26672 fetch_fsmap learned FSMap version 59 2024-09-05T01:35:13.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.497+0000 7fb17de58740 1 -- 172.21.15.12:0/3733880455 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x558c51d010d0 con 0x558c51c5ede0 2024-09-05T01:35:13.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.498+0000 7fb162000640 1 -- 172.21.15.12:0/3733880455 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb16c099ec0 con 0x558c51c5ede0 2024-09-05T01:35:13.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.498+0000 7fb162000640 1 -- 172.21.15.12:0/3733880455 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 59) ==== 8434+0+0 (secure 0 0 0) 0x7fb16c00b040 con 0x558c51c5ede0 2024-09-05T01:35:13.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.499+0000 7fb17de58740 10 client.26672 fetch_fsmap finished waiting for FSMap version 59 2024-09-05T01:35:13.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.499+0000 7fb17de58740 10 client.26672 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:35:13.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.499+0000 7fb17de58740 20 client.26672 populate_metadata read hostname 'smithi012' 2024-09-05T01:35:13.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.499+0000 7fb17de58740 1 --2- 172.21.15.12:0/3733880455 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558c51d01830 0x558c51d03c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:13.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.499+0000 7fb17de58740 4 client.26672 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T01:35:13.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.499+0000 7fb17de58740 1 -- 172.21.15.12:0/3733880455 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558c51bc7e60 con 0x558c51d01830 2024-09-05T01:35:13.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.501+0000 7fb173e00640 1 --2- 172.21.15.12:0/3733880455 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558c51d01830 0x558c51d03c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:13.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.502+0000 7fb173e00640 1 --2- 172.21.15.12:0/3733880455 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558c51d01830 0x558c51d03c50 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f23e83b8037d05ce server_cookie=45d1568fcdcfc231 in_seq=0 out_seq=0 2024-09-05T01:35:13.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.502+0000 7fb162000640 10 client.26672 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:35:13.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.504+0000 7fb162000640 1 -- 172.21.15.12:0/3733880455 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+269 (crc 0 0 0) 0x558c51bc7e60 con 0x558c51d01830 2024-09-05T01:35:13.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.504+0000 7fb162000640 10 client.26672 handle_command_reply: tid=0 2024-09-05T01:35:13.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.504+0000 7fb17de58740 1 client.26672 shutdown 2024-09-05T01:35:13.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.504+0000 7fb17de58740 1 -- 172.21.15.12:0/3733880455 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558c51c5ede0 msgr2=0x558c51c882e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:13.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.504+0000 7fb17de58740 1 --2- 172.21.15.12:0/3733880455 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558c51c5ede0 0x558c51c882e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00cd00 tx=0x7fb16c016410 comp rx=0 tx=0).stop 2024-09-05T01:35:13.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.505+0000 7fb17de58740 1 -- 172.21.15.12:0/3733880455 shutdown_connections 2024-09-05T01:35:13.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.505+0000 7fb17de58740 1 --2- 172.21.15.12:0/3733880455 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x558c51d01830 0x558c51d03c50 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.505+0000 7fb17de58740 1 --2- 172.21.15.12:0/3733880455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c51c64d70 0x558c51c88820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.505+0000 7fb17de58740 1 --2- 172.21.15.12:0/3733880455 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x558c51c5ede0 0x558c51c882e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.505+0000 7fb17de58740 1 --2- 172.21.15.12:0/3733880455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558c51c5a4b0 0x558c51c8af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.505+0000 7fb162000640 0 client.26672 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:35:13.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.505+0000 7fb17de58740 1 -- 172.21.15.12:0/3733880455 >> 172.21.15.12:0/3733880455 conn(0x558c51c56120 msgr2=0x558c51c63c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:13.508 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:35:13.508 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "scrub active (27411 inodes in the stack)", 2024-09-05T01:35:13.509 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": { 2024-09-05T01:35:13.509 INFO:teuthology.orchestra.run.smithi012.stdout: "b26ade98-013f-441e-85ac-fcd7a1d1c6fd": { 2024-09-05T01:35:13.509 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/", 2024-09-05T01:35:13.509 INFO:teuthology.orchestra.run.smithi012.stdout: "tag": "b26ade98-013f-441e-85ac-fcd7a1d1c6fd", 2024-09-05T01:35:13.509 INFO:teuthology.orchestra.run.smithi012.stdout: "options": "recursive,force" 2024-09-05T01:35:13.509 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:35:13.509 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:35:13.509 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:35:13.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.506+0000 7fb17de58740 1 -- 172.21.15.12:0/3733880455 shutdown_connections 2024-09-05T01:35:13.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.506+0000 7fb17de58740 1 -- 172.21.15.12:0/3733880455 wait complete. 2024-09-05T01:35:13.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.506+0000 7fb17de58740 20 client.26672 trim_cache size 0 max 16384 2024-09-05T01:35:13.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.507+0000 7fb17b200640 1 -- 172.21.15.12:0/3680839693 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fb1580a2d70 msgr2=0x7fb1580a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:13.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.507+0000 7fb17b200640 1 --2- 172.21.15.12:0/3680839693 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fb1580a2d70 0x7fb1580a5230 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb164005940 tx=0x7fb164005cd0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.507+0000 7fb17b200640 1 -- 172.21.15.12:0/3680839693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb174077040 msgr2=0x7fb1741a4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:13.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.507+0000 7fb17b200640 1 --2- 172.21.15.12:0/3680839693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb174077040 0x7fb1741a4c30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00efb0 tx=0x7fb16c00c800 comp rx=0 tx=0).stop 2024-09-05T01:35:13.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.508+0000 7fb17b200640 1 -- 172.21.15.12:0/3680839693 shutdown_connections 2024-09-05T01:35:13.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.508+0000 7fb17b200640 1 --2- 172.21.15.12:0/3680839693 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fb1580a2d70 0x7fb1580a5230 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.508+0000 7fb17b200640 1 --2- 172.21.15.12:0/3680839693 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fb174112a50 0x7fb17419e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.508+0000 7fb17b200640 1 --2- 172.21.15.12:0/3680839693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb174077040 0x7fb1741a4c30 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.508+0000 7fb17b200640 1 --2- 172.21.15.12:0/3680839693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb174076720 0x7fb1741a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:13.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.508+0000 7fb17b200640 1 -- 172.21.15.12:0/3680839693 >> 172.21.15.12:0/3680839693 conn(0x7fb1740ffa50 msgr2=0x7fb174101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:13.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.508+0000 7fb17b200640 1 -- 172.21.15.12:0/3680839693 shutdown_connections 2024-09-05T01:35:13.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:13.508+0000 7fb17b200640 1 -- 172.21.15.12:0/3680839693 wait complete. 2024-09-05T01:35:13.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:13 smithi012 ceph-mon[29942]: pgmap v327: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 258 op/s 2024-09-05T01:35:13.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:13 smithi145 ceph-mon[34376]: pgmap v327: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 258 op/s 2024-09-05T01:35:13.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:13 smithi151 ceph-mon[35013]: pgmap v327: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 258 op/s 2024-09-05T01:35:15.014 INFO:tasks.cephfs.filesystem:scrub status for tag:b26ade98-013f-441e-85ac-fcd7a1d1c6fd - {'path': '/', 'tag': 'b26ade98-013f-441e-85ac-fcd7a1d1c6fd', 'options': 'recursive,force'} 2024-09-05T01:35:15.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:15 smithi012 ceph-mon[29942]: pgmap v328: 97 pgs: 19 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 44 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 277 op/s 2024-09-05T01:35:15.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:15 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:15.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:15 smithi145 ceph-mon[34376]: pgmap v328: 97 pgs: 19 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 44 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 277 op/s 2024-09-05T01:35:15.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:15 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:15.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:15 smithi151 ceph-mon[35013]: pgmap v328: 97 pgs: 19 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 44 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.1 MiB/s wr, 277 op/s 2024-09-05T01:35:15.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:15 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:17.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:17 smithi012 ceph-mon[29942]: pgmap v329: 97 pgs: 17 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 47 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 276 op/s 2024-09-05T01:35:17.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:17 smithi145 ceph-mon[34376]: pgmap v329: 97 pgs: 17 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 47 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 276 op/s 2024-09-05T01:35:17.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:17 smithi151 ceph-mon[35013]: pgmap v329: 97 pgs: 17 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 47 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 276 op/s 2024-09-05T01:35:18.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:18 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:18.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:18 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:18.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:18 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:18.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:18 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:18.863 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:18 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:18.864 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:18 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:19.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:19 smithi145 ceph-mon[34376]: pgmap v330: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 327 op/s 2024-09-05T01:35:19.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:19 smithi151 ceph-mon[35013]: pgmap v330: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 327 op/s 2024-09-05T01:35:20.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:19 smithi012 ceph-mon[29942]: pgmap v330: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 327 op/s 2024-09-05T01:35:20.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:20 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:20.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:20 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:20.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:20 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:20.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:20 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:20.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:20 smithi145 ceph-mon[34376]: pgmap v331: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 502 op/s 2024-09-05T01:35:20.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:20 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:20.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:20 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:20.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:20 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:20.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:20 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:20.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:20 smithi151 ceph-mon[35013]: pgmap v331: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 502 op/s 2024-09-05T01:35:21.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:20 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:21.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:20 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:21.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:20 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:21.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:20 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:21.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:20 smithi012 ceph-mon[29942]: pgmap v331: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 502 op/s 2024-09-05T01:35:23.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:23 smithi012 ceph-mon[29942]: pgmap v332: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 446 op/s 2024-09-05T01:35:23.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:23 smithi012 ceph-mon[29942]: osdmap e96: 12 total, 12 up, 12 in 2024-09-05T01:35:23.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:23 smithi145 ceph-mon[34376]: pgmap v332: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 446 op/s 2024-09-05T01:35:23.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:23 smithi145 ceph-mon[34376]: osdmap e96: 12 total, 12 up, 12 in 2024-09-05T01:35:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:23 smithi151 ceph-mon[35013]: pgmap v332: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 446 op/s 2024-09-05T01:35:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:23 smithi151 ceph-mon[35013]: osdmap e96: 12 total, 12 up, 12 in 2024-09-05T01:35:24.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:24 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:35:24.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:24 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:35:24.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:24 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:35:25.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:25 smithi012 ceph-mon[29942]: pgmap v334: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 582 op/s 2024-09-05T01:35:25.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:25 smithi145 ceph-mon[34376]: pgmap v334: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 582 op/s 2024-09-05T01:35:25.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:25 smithi151 ceph-mon[35013]: pgmap v334: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 582 op/s 2024-09-05T01:35:26.044 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:25 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:25.785+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001aaa [4,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-37.xml auth{0=1} v1271 ap=1 s=20214 n(v0 rc2024-09-05T01:26:43.123148+0000 b20214 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5343f4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001aaa:[<0x10000001a52/article-37.xml v742>,<0x10000000399/blog-42 v172245>,<0x10000000208/blogtest_in v2744>,<0x10000000201/src v2455>,<0x10000000006/blogbench-1.0 v2057>,<0x10000000005/tmp v662>,<0x100000001fb/client.0 v670>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v646>,<0x10000000001/sv_1 v684>,<0x10000000000/qa v641>,<0x1/volumes v653>]//[]","memoryvalue":"(3)0x10000001aaa:[<0x10000001a52/article-37.xml v1271>,<0x10000000399/blog-42 v215285>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:26.044 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:26.043+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a5a [4,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-64.xml auth{0=1} v1277 ap=1 s=2872 n(v0 rc2024-09-05T01:26:42.923150+0000 b2872 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5343f3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a5a:[<0x10000001a52/article-64.xml v748>,<0x10000000399/blog-42 v172245>,<0x10000000208/blogtest_in v2744>,<0x10000000201/src v2455>,<0x10000000006/blogbench-1.0 v2057>,<0x10000000005/tmp v662>,<0x100000001fb/client.0 v670>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v646>,<0x10000000001/sv_1 v684>,<0x10000000000/qa v641>,<0x1/volumes v653>]//[]","memoryvalue":"(3)0x10000001a5a:[<0x10000001a52/article-64.xml v1277>,<0x10000000399/blog-42 v215285>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:26.334 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:26.050+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b37 [4,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-27.jpg auth{0=1} v1251 ap=1 s=8744 n(v0 rc2024-09-05T01:26:43.489145+0000 b8744 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5343f5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b37:[<0x10000001a52/picture-27.jpg v768>,<0x10000000399/blog-42 v172245>,<0x10000000208/blogtest_in v2744>,<0x10000000201/src v2455>,<0x10000000006/blogbench-1.0 v2057>,<0x10000000005/tmp v662>,<0x100000001fb/client.0 v670>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v646>,<0x10000000001/sv_1 v684>,<0x10000000000/qa v641>,<0x1/volumes v653>]//[]","memoryvalue":"(3)0x10000001b37:[<0x10000001a52/picture-27.jpg v1251>,<0x10000000399/blog-42 v215285>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:26.334 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:26.051+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001aa4 [4,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-39.xml auth{0=1} v1273 ap=1 s=24705 n(v0 rc2024-09-05T01:26:43.109149+0000 b24705 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5343f5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001aa4:[<0x10000001a52/article-39.xml v744>,<0x10000000399/blog-42 v172245>,<0x10000000208/blogtest_in v2744>,<0x10000000201/src v2455>,<0x10000000006/blogbench-1.0 v2057>,<0x10000000005/tmp v662>,<0x100000001fb/client.0 v670>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v646>,<0x10000000001/sv_1 v684>,<0x10000000000/qa v641>,<0x1/volumes v653>]//[]","memoryvalue":"(3)0x10000001aa4:[<0x10000001a52/article-39.xml v1273>,<0x10000000399/blog-42 v215285>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:26.334 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:26.051+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000233d [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-36.xml auth{0=1} v1247 ap=1 s=4671 n(v0 rc2024-09-05T01:26:55.416035+0000 b4671 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5312cc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000233d:[<0x10000001a52/article-36.xml v1055>,<0x10000000399/blog-42 v201871>,<0x10000000208/blogtest_in v2760>,<0x10000000201/src v2457>,<0x10000000006/blogbench-1.0 v2059>,<0x10000000005/tmp v664>,<0x100000001fb/client.0 v672>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v648>,<0x10000000001/sv_1 v686>,<0x10000000000/qa v643>,<0x1/volumes v655>]//[]","memoryvalue":"(3)0x1000000233d:[<0x10000001a52/article-36.xml v1247>,<0x10000000399/blog-42 v215285>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:26.335 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:26.051+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001aeb [4,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-12.xml auth{0=1} v1265 ap=1 s=22225 n(v0 rc2024-09-05T01:26:43.282147+0000 b22225 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5312cc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001aeb:[<0x10000001a52/article-12.xml v754>,<0x10000000399/blog-42 v172245>,<0x10000000208/blogtest_in v2744>,<0x10000000201/src v2455>,<0x10000000006/blogbench-1.0 v2057>,<0x10000000005/tmp v662>,<0x100000001fb/client.0 v670>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v646>,<0x10000000001/sv_1 v684>,<0x10000000000/qa v641>,<0x1/volumes v653>]//[]","memoryvalue":"(3)0x10000001aeb:[<0x10000001a52/article-12.xml v1265>,<0x10000000399/blog-42 v215285>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:26.335 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:26.052+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b05 [4,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-52.jpg auth{0=1} v1259 ap=1 s=42329 n(v0 rc2024-09-05T01:26:43.346146+0000 b42329 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5312ccb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b05:[<0x10000001a52/picture-52.jpg v766>,<0x10000000399/blog-42 v172245>,<0x10000000208/blogtest_in v2744>,<0x10000000201/src v2455>,<0x10000000006/blogbench-1.0 v2057>,<0x10000000005/tmp v662>,<0x100000001fb/client.0 v670>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v646>,<0x10000000001/sv_1 v684>,<0x10000000000/qa v641>,<0x1/volumes v653>]//[]","memoryvalue":"(3)0x10000001b05:[<0x10000001a52/picture-52.jpg v1259>,<0x10000000399/blog-42 v215285>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:26.335 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:26.053+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b29 [4,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-34.jpg auth{0=1} v1255 ap=1 s=63319 n(v0 rc2024-09-05T01:26:43.456145+0000 b63319 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5312cdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b29:[<0x10000001a52/picture-34.jpg v760>,<0x10000000399/blog-42 v172245>,<0x10000000208/blogtest_in v2744>,<0x10000000201/src v2455>,<0x10000000006/blogbench-1.0 v2057>,<0x10000000005/tmp v662>,<0x100000001fb/client.0 v670>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v646>,<0x10000000001/sv_1 v684>,<0x10000000000/qa v641>,<0x1/volumes v653>]//[]","memoryvalue":"(3)0x10000001b29:[<0x10000001a52/picture-34.jpg v1255>,<0x10000000399/blog-42 v215285>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:26.335 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:26.053+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b01 [4,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-1.xml auth{0=1} v1263 ap=1 s=31206 n(v0 rc2024-09-05T01:26:43.334147+0000 b31206 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5312cd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b01:[<0x10000001a52/article-1.xml v752>,<0x10000000399/blog-42 v172245>,<0x10000000208/blogtest_in v2744>,<0x10000000201/src v2455>,<0x10000000006/blogbench-1.0 v2057>,<0x10000000005/tmp v662>,<0x100000001fb/client.0 v670>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v646>,<0x10000000001/sv_1 v684>,<0x10000000000/qa v641>,<0x1/volumes v653>]//[]","memoryvalue":"(3)0x10000001b01:[<0x10000001a52/article-1.xml v1263>,<0x10000000399/blog-42 v215285>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:26.335 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:26.053+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b03 [4,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-53.jpg auth{0=1} v1261 ap=1 s=48311 n(v0 rc2024-09-05T01:26:43.339146+0000 b48311 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5312ce100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b03:[<0x10000001a52/picture-53.jpg v772>,<0x10000000399/blog-42 v172245>,<0x10000000208/blogtest_in v2744>,<0x10000000201/src v2455>,<0x10000000006/blogbench-1.0 v2057>,<0x10000000005/tmp v662>,<0x100000001fb/client.0 v670>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v646>,<0x10000000001/sv_1 v684>,<0x10000000000/qa v641>,<0x1/volumes v653>]//[]","memoryvalue":"(3)0x10000001b03:[<0x10000001a52/picture-53.jpg v1261>,<0x10000000399/blog-42 v215285>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:26.335 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:26.060+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a54 [4,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-66.xml auth{0=1} v1279 ap=1 s=29521 n(v0 rc2024-09-05T01:26:42.908150+0000 b29521 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5312cf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a54:[<0x10000001a52/article-66.xml v750>,<0x10000000399/blog-42 v172245>,<0x10000000208/blogtest_in v2744>,<0x10000000201/src v2455>,<0x10000000006/blogbench-1.0 v2057>,<0x10000000005/tmp v662>,<0x100000001fb/client.0 v670>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v646>,<0x10000000001/sv_1 v684>,<0x10000000000/qa v641>,<0x1/volumes v653>]//[]","memoryvalue":"(3)0x10000001a54:[<0x10000001a52/article-66.xml v1279>,<0x10000000399/blog-42 v215285>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:26.336 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:26.060+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b4d [4,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-16.jpg auth{0=1} v1249 ap=1 s=23451 n(v0 rc2024-09-05T01:26:43.546145+0000 b23451 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5312cf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b4d:[<0x10000001a52/picture-16.jpg v756>,<0x10000000399/blog-42 v172245>,<0x10000000208/blogtest_in v2744>,<0x10000000201/src v2455>,<0x10000000006/blogbench-1.0 v2057>,<0x10000000005/tmp v662>,<0x100000001fb/client.0 v670>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v646>,<0x10000000001/sv_1 v684>,<0x10000000000/qa v641>,<0x1/volumes v653>]//[]","memoryvalue":"(3)0x10000001b4d:[<0x10000001a52/picture-16.jpg v1249>,<0x10000000399/blog-42 v215285>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:26.336 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:26.061+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000320f [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/comment-49.xml auth{0=1} v1241 ap=1 s=8790 n(v0 rc2024-09-05T01:27:13.016873+0000 b8790 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c531868580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000320f:[<0x10000001a52/comment-49.xml v1241>,<0x10000000399/blog-42 v215285>,<0x10000000208/blogtest_in v2844>,<0x10000000201/src v2526>,<0x10000000006/blogbench-1.0 v2116>,<0x10000000005/tmp v704>,<0x100000001fb/client.0 v713>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v684>,<0x10000000001/sv_1 v724>,<0x10000000000/qa v681>,<0x1/volumes v695>]//[]","memoryvalue":"(3)0x1000000320f:[<0x10000001a52/comment-49.xml v1241>,<0x10000000399/blog-42 v215285>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:26.336 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:26.061+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000290b [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/comment-65.xml auth{0=1} v1245 ap=1 s=2235 n(v0 rc2024-09-05T01:27:05.637941+0000 b2235 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c531869080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000290b:[<0x10000001a52/comment-65.xml v1057>,<0x10000000399/blog-42 v210731>,<0x10000000208/blogtest_in v2766>,<0x10000000201/src v2463>,<0x10000000006/blogbench-1.0 v2065>,<0x10000000005/tmp v670>,<0x100000001fb/client.0 v678>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v654>,<0x10000000001/sv_1 v692>,<0x10000000000/qa v651>,<0x1/volumes v663>]//[]","memoryvalue":"(3)0x1000000290b:[<0x10000001a52/comment-65.xml v1245>,<0x10000000399/blog-42 v215285>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:26.336 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:26.063+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ad4 [4,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-23.xml auth{0=1} v1269 ap=1 s=28418 n(v0 rc2024-09-05T01:26:43.227148+0000 b28418 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c531869600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ad4:[<0x10000001a52/article-23.xml v764>,<0x10000000399/blog-42 v172245>,<0x10000000208/blogtest_in v2744>,<0x10000000201/src v2455>,<0x10000000006/blogbench-1.0 v2057>,<0x10000000005/tmp v662>,<0x100000001fb/client.0 v670>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v646>,<0x10000000001/sv_1 v684>,<0x10000000000/qa v641>,<0x1/volumes v653>]//[]","memoryvalue":"(3)0x10000001ad4:[<0x10000001a52/article-23.xml v1269>,<0x10000000399/blog-42 v215285>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:26.336 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:26.063+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ae1 [4,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-17.xml auth{0=1} v1267 ap=1 s=29008 n(v0 rc2024-09-05T01:26:43.259147+0000 b29008 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c531869b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ae1:[<0x10000001a52/article-17.xml v758>,<0x10000000399/blog-42 v172245>,<0x10000000208/blogtest_in v2744>,<0x10000000201/src v2455>,<0x10000000006/blogbench-1.0 v2057>,<0x10000000005/tmp v662>,<0x100000001fb/client.0 v670>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v646>,<0x10000000001/sv_1 v684>,<0x10000000000/qa v641>,<0x1/volumes v653>]//[]","memoryvalue":"(3)0x10000001ae1:[<0x10000001a52/article-17.xml v1267>,<0x10000000399/blog-42 v215285>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:26.336 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:26.064+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b2d [4,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-32.jpg auth{0=1} v1253 ap=1 s=30223 n(v0 rc2024-09-05T01:26:43.466145+0000 b30223 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53186a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b2d:[<0x10000001a52/picture-32.jpg v762>,<0x10000000399/blog-42 v172245>,<0x10000000208/blogtest_in v2744>,<0x10000000201/src v2455>,<0x10000000006/blogbench-1.0 v2057>,<0x10000000005/tmp v662>,<0x100000001fb/client.0 v670>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v646>,<0x10000000001/sv_1 v684>,<0x10000000000/qa v641>,<0x1/volumes v653>]//[]","memoryvalue":"(3)0x10000001b2d:[<0x10000001a52/picture-32.jpg v1253>,<0x10000000399/blog-42 v215285>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:26.336 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:26.064+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a5d [4,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-63.xml auth{0=1} v1275 ap=1 s=22813 n(v0 rc2024-09-05T01:26:42.930150+0000 b22813 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53186a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a5d:[<0x10000001a52/article-63.xml v746>,<0x10000000399/blog-42 v172245>,<0x10000000208/blogtest_in v2744>,<0x10000000201/src v2455>,<0x10000000006/blogbench-1.0 v2057>,<0x10000000005/tmp v662>,<0x100000001fb/client.0 v670>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v646>,<0x10000000001/sv_1 v684>,<0x10000000000/qa v641>,<0x1/volumes v653>]//[]","memoryvalue":"(3)0x10000001a5d:[<0x10000001a52/article-63.xml v1275>,<0x10000000399/blog-42 v215285>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:26.336 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:26.064+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b0d [4,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-48.jpg auth{0=1} v1257 ap=1 s=12154 n(v0 rc2024-09-05T01:26:43.375146+0000 b12154 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53186ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b0d:[<0x10000001a52/picture-48.jpg v770>,<0x10000000399/blog-42 v172245>,<0x10000000208/blogtest_in v2744>,<0x10000000201/src v2455>,<0x10000000006/blogbench-1.0 v2057>,<0x10000000005/tmp v662>,<0x100000001fb/client.0 v670>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v646>,<0x10000000001/sv_1 v684>,<0x10000000000/qa v641>,<0x1/volumes v653>]//[]","memoryvalue":"(3)0x10000001b0d:[<0x10000001a52/picture-48.jpg v1257>,<0x10000000399/blog-42 v215285>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:26.336 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:26.065+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003209 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/comment-51.xml auth{0=1} v1243 ap=1 s=9703 n(v0 rc2024-09-05T01:27:12.990873+0000 b9703 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53186b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003209:[<0x10000001a52/comment-51.xml v1243>,<0x10000000399/blog-42 v215285>,<0x10000000208/blogtest_in v2844>,<0x10000000201/src v2526>,<0x10000000006/blogbench-1.0 v2116>,<0x10000000005/tmp v704>,<0x100000001fb/client.0 v713>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v684>,<0x10000000001/sv_1 v724>,<0x10000000000/qa v681>,<0x1/volumes v695>]//[]","memoryvalue":"(3)0x10000003209:[<0x10000001a52/comment-51.xml v1243>,<0x10000000399/blog-42 v215285>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.153 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.153 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000001aaa (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-37.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.154 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: pgmap v335: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 594 op/s 2024-09-05T01:35:27.154 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000001a5a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-64.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.154 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.154 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.154 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000001b37 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.154 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.154 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.154 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000001aa4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-39.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.154 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000233d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-36.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.154 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000001aeb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-12.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.155 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.155 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.155 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000001b05 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.155 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.155 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.155 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000001b29 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.155 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000001b01 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.155 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000001b03 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.155 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.155 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.155 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.155 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.155 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000001a54 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-66.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.156 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000001b4d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.156 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000320f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/comment-49.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.156 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.156 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.156 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000290b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/comment-65.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.156 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.156 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.156 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000001ad4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-23.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.156 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000001ae1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-17.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.156 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.156 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.156 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000001b2d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.157 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000001a5d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-63.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.157 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000001b0d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.157 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.157 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.157 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003209 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/comment-51.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.157 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.157 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.157 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.157 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.157 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.157 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.157 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.158 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.158 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.158 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.158 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.158 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.158 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.158 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.158 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.158 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.158 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.158 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.160 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.160 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.160 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.160 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.160 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.160 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.160 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.160 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.160 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.160 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.160 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.161 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.161 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.161 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.161 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.161 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.161 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.161 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.161 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.161 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.161 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.161 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.161 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.161 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.162 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.162 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.162 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.162 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.162 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.162 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.162 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.162 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.162 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.162 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.162 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.162 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.162 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.163 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.163 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.163 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.163 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.163 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.163 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.163 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.163 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.163 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.163 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.163 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.163 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.163 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.164 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.164 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.164 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.164 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.164 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.164 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.164 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.164 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.164 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.164 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.164 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.164 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.164 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.165 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.165 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.165 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.165 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.165 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.165 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.165 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.165 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.165 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.165 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.165 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.165 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.165 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.165 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.166 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.166 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.166 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.166 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.166 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.166 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.166 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.166 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.166 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.166 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.166 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.166 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.166 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.166 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.167 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.167 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.167 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.167 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.167 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.167 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.167 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.167 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.167 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.167 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.167 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.168 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.168 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.168 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.168 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.168 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.168 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.168 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.168 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.168 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.168 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.168 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.168 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.169 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.169 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.169 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.169 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.169 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.169 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.169 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.169 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.169 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.169 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.169 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.169 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.170 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.170 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.170 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.170 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.170 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.170 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.170 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.170 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.170 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.170 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.170 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.170 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.170 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.171 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.171 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.171 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.171 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.171 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.171 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.171 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.171 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.171 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.171 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.171 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.171 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.171 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.172 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.172 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.172 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.172 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.172 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.172 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.172 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.172 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.172 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.172 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.172 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.172 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.172 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.173 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.173 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.173 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.173 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.173 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.173 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.173 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.173 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.173 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.173 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.173 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.173 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.174 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.174 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.174 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.174 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.174 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.174 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.174 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.174 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.174 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.174 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.174 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.174 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.174 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.174 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.175 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.175 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.175 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.175 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.175 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.175 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.175 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.175 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.175 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.175 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.175 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.175 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.175 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.176 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.176 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.176 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.176 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.176 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.176 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.176 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.176 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.176 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.176 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.176 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.176 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.176 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.176 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.177 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.177 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.177 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.177 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.177 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.177 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.177 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.177 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.177 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.177 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.177 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.177 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.177 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.178 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.178 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.178 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.178 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.178 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.178 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.178 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.178 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.178 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.178 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.178 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.178 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.178 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.178 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.179 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.179 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.179 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.179 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.179 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.179 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.179 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.179 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.179 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.179 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.179 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.179 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.179 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.179 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.185 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.185 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.185 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.185 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.185 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.185 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.185 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.185 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.185 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.185 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.185 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.185 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.185 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.186 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.186 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.186 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.186 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.186 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.186 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.186 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.186 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.186 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.186 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.186 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.186 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.186 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.186 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.186 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.190 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.190 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.190 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.190 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.190 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.190 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.190 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.190 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.190 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.190 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.190 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.190 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.190 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.190 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.191 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.191 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.191 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.191 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.191 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.191 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.191 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.191 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.191 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.191 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.191 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.191 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.191 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.191 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.196 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.196 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.196 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.196 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.196 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.196 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.196 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.196 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.196 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.196 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.196 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.196 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.196 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.197 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.197 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.197 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.197 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.197 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.197 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.197 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.197 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.197 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.197 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.197 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.197 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.197 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.200 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.200 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.200 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.200 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.200 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.200 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.200 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.200 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.200 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.200 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.200 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.200 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.200 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.202 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.202 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.202 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.202 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.202 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.202 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.202 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.202 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.202 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.202 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.202 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.202 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.202 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.202 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.203 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.203 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.203 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.203 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.203 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.203 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.203 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.203 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.203 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.203 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.203 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.203 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.203 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.203 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.203 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.206 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.206 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.206 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.206 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.206 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.206 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.207 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.207 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.207 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.208 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.208 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.208 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.208 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.208 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.208 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.208 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.208 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.208 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.208 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.213 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.213 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.213 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.213 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.213 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.213 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.213 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.213 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.213 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.213 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.213 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.213 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.213 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.213 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.213 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.214 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.214 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.214 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.214 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.214 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.214 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.214 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.214 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.214 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.214 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.214 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.214 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.214 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.215 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.215 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.215 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.215 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.215 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.215 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.215 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.215 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.215 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.215 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.215 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.215 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.216 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.216 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.216 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.216 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.216 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.216 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.216 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:27.216 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000001aaa (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-37.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: pgmap v335: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 594 op/s 2024-09-05T01:35:27.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000001a5a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-64.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000001b37 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000001aa4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-39.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000233d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-36.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000001aeb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-12.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000001b05 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000001b29 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000001b01 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000001b03 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000001a54 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-66.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000001b4d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000320f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/comment-49.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000290b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/comment-65.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000001ad4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-23.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000001ae1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-17.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000001b2d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000001a5d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-63.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000001b0d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003209 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/comment-51.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.587 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.587 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.587 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.587 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.587 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.587 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.587 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.587 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.587 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.587 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.587 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.587 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.588 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.588 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.588 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.592 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.592 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.592 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.592 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.592 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.592 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.592 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.592 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.592 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.592 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.593 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.593 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.593 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.593 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.593 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.593 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.593 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.593 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.593 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.593 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.593 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.598 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.599 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.599 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.599 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.599 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.599 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.599 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.599 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.599 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.599 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.599 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.599 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.599 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.600 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.600 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.600 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.600 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.600 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.600 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.600 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.600 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.600 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.600 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.600 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.601 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.601 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.601 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.601 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.601 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.601 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.601 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.601 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.601 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.601 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.602 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.602 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.602 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.602 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.602 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.602 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.602 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.602 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.603 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.604 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.605 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.605 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.605 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.605 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.605 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.605 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.605 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.605 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.605 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.607 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.608 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.609 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.609 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.609 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.609 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.609 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.609 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.609 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.609 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.609 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.609 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.610 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.610 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.610 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.610 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.610 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.610 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.610 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.610 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.610 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.610 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.610 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.611 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.611 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.611 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.611 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.611 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.611 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.611 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.611 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.612 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.613 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.614 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.617 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.618 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.619 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.619 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.619 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.619 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.619 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.619 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.619 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.619 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.619 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.619 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.619 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.620 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.620 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.620 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.620 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.620 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.620 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.620 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.620 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.620 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.620 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.620 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.621 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.621 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.621 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.621 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.621 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.621 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.621 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.621 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.621 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.622 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.622 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.622 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.622 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.622 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.622 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.622 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.622 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.622 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.622 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.622 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.623 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.623 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.623 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.623 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.623 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.623 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.623 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.623 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.623 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.623 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.623 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.623 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.624 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.624 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.624 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.624 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.624 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.624 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.624 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.624 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.624 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.624 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.625 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.625 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.625 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.625 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.625 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.625 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.625 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.625 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.625 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.625 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.625 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.625 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.626 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.626 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.626 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.626 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.626 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.626 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.626 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.626 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.626 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.626 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.626 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.626 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.626 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.627 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.627 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.627 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.627 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.627 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.627 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.627 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.627 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.627 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.627 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.627 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.627 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.627 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.628 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.629 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.630 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.631 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.632 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.632 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.632 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.632 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.632 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.632 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.632 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.632 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.632 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.632 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.632 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.632 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.633 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.633 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.633 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.633 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.633 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.633 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.633 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.633 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.633 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.633 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.633 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.634 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.634 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.634 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.634 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.634 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.634 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.634 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.634 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.634 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.634 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.634 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.634 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.634 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.635 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.635 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.635 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.635 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.635 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.635 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.635 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.635 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.635 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.635 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.635 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.635 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.636 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.636 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.636 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.636 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.636 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.636 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.636 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.636 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.636 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.636 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.636 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.636 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.636 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.637 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.637 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.637 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.637 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.637 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.637 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.637 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.637 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.637 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.637 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:27.637 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:27 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000001aaa (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-37.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: pgmap v335: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 594 op/s 2024-09-05T01:35:27.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000001a5a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-64.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000001b37 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000001aa4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-39.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000233d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-36.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000001aeb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-12.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000001b05 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000001b29 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000001b01 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000001b03 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000001a54 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-66.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000001b4d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000320f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/comment-49.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000290b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/comment-65.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000001ad4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-23.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000001ae1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-17.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000001b2d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000001a5d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-63.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000001b0d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003209 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/comment-51.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:27.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.679 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.679 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.679 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.679 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.679 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.679 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.679 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.679 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.679 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.679 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.679 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.679 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.679 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.680 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.680 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.680 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.680 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.680 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.680 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.680 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.680 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.680 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.680 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.680 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.681 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.681 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.681 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.681 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.681 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.681 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.681 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.681 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.681 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.681 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.681 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.681 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.682 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.682 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.682 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.682 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.682 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.682 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.682 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.682 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.682 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.682 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.682 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.682 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.682 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.683 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.683 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.683 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.683 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.683 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.683 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.683 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.683 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.683 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.683 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.683 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.683 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.683 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.684 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.684 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.684 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.684 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.684 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.684 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.684 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.684 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.684 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.684 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.685 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.685 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.685 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.685 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.685 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.685 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.685 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.685 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.685 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.685 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.685 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.685 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.686 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.686 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.686 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.686 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.686 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.686 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.686 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.686 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.686 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.686 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.686 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.686 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.686 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.687 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.687 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.687 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.687 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.687 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.687 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.687 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.687 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.687 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.687 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.687 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.687 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.687 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.688 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.688 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.688 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.688 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.688 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.688 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.688 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.688 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.688 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.688 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.688 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.689 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.689 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.689 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.689 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.689 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.689 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.689 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.689 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.689 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.689 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.689 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.689 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.690 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.690 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.690 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.690 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.690 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.690 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.690 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.690 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.690 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.690 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.690 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.690 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.690 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.691 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.691 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.691 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.691 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.691 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.691 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.691 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.691 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.691 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.691 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.691 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.691 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.691 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.692 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.692 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.692 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.692 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.692 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.692 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.692 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.692 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.692 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.692 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.693 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.693 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.693 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.693 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.693 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.693 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.693 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.693 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.693 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.693 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.693 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.694 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.694 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.694 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.694 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.694 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.694 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.694 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.694 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.694 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.694 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.694 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.694 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.694 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.695 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.695 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.695 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.695 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.695 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.695 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.695 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.695 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.695 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.695 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.695 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.695 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.695 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.696 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.696 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.696 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.696 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.696 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.696 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.696 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.696 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.696 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.696 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.696 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.696 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.697 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.697 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.697 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.697 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.697 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.697 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.697 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.697 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.697 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.697 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.697 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.697 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.698 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.698 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.698 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.698 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.698 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.698 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.698 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.698 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.698 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.698 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.698 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.698 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.698 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.699 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.699 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.699 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.699 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.699 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.699 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.699 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.699 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.699 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.699 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.699 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.700 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.700 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.700 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.700 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.700 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.700 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.700 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.700 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.700 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.700 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.700 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.701 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.701 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.701 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.701 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.701 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.701 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.701 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.701 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.701 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.701 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.701 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.701 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.702 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.702 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.702 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.702 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.702 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.702 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.702 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.702 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.702 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.702 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.702 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.703 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.703 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.703 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.703 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.703 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.703 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.703 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.703 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.703 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.703 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.703 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.703 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.704 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.704 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.704 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.704 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.704 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.704 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.704 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.704 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.704 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.704 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.704 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.707 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.707 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.707 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.707 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.707 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.707 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.707 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.707 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.707 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.707 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.707 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.708 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.708 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.708 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.708 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.708 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.708 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.708 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.708 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.708 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.708 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.708 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:27.709 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:27 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:27.710 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.168+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044fa [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-18.jpg auth{0=1} v596 ap=1 s=50938 n(v0 rc2024-09-05T01:27:48.909542+0000 b50938 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c52c7e0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044fa:[<0x100000044bf/picture-18.jpg v596>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044fa:[<0x100000044bf/picture-18.jpg v596>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.710 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.168+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044f9 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-19.jpg auth{0=1} v632 ap=1 s=37300 n(v0 rc2024-09-05T01:27:48.906542+0000 b37300 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c52c7e1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044f9:[<0x100000044bf/picture-19.jpg v632>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044f9:[<0x100000044bf/picture-19.jpg v632>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.711 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.169+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044e9 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-35.jpg auth{0=1} v710 ap=1 s=27261 n(v0 rc2024-09-05T01:27:48.731543+0000 b27261 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c52c7e2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044e9:[<0x100000044bf/picture-35.jpg v710>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044e9:[<0x100000044bf/picture-35.jpg v710>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.711 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.169+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004508 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-4.jpg auth{0=1} v734 ap=1 s=23204 n(v0 rc2024-09-05T01:27:48.959541+0000 b23204 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c52c7e1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004508:[<0x100000044bf/picture-4.jpg v734>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004508:[<0x100000044bf/picture-4.jpg v734>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.711 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.169+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000450a [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-2.jpg auth{0=1} v732 ap=1 s=36810 n(v0 rc2024-09-05T01:27:48.969541+0000 b36810 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c52c7e2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000450a:[<0x100000044bf/picture-2.jpg v732>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000450a:[<0x100000044bf/picture-2.jpg v732>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.711 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.170+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044fe [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-14.jpg auth{0=1} v714 ap=1 s=44144 n(v0 rc2024-09-05T01:27:48.920542+0000 b44144 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c52c7e3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044fe:[<0x100000044bf/picture-14.jpg v714>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044fe:[<0x100000044bf/picture-14.jpg v714>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.711 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.170+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044cf [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-61.jpg auth{0=1} v604 ap=1 s=55925 n(v0 rc2024-09-05T01:27:48.599545+0000 b55925 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c52c7ec580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044cf:[<0x100000044bf/picture-61.jpg v604>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044cf:[<0x100000044bf/picture-61.jpg v604>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.711 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.170+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004505 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-7.jpg auth{0=1} v736 ap=1 s=8960 n(v0 rc2024-09-05T01:27:48.941542+0000 b8960 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c52c7ecb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004505:[<0x100000044bf/picture-7.jpg v736>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004505:[<0x100000044bf/picture-7.jpg v736>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.711 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.171+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004503 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-9.jpg auth{0=1} v738 ap=1 s=64809 n(v0 rc2024-09-05T01:27:48.937542+0000 b64809 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c52c7ed080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004503:[<0x100000044bf/picture-9.jpg v738>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004503:[<0x100000044bf/picture-9.jpg v738>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.712 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.171+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044cc [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-64.jpg auth{0=1} v588 ap=1 s=41869 n(v0 rc2024-09-05T01:27:48.583545+0000 b41869 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c52c7edb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044cc:[<0x100000044bf/picture-64.jpg v588>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044cc:[<0x100000044bf/picture-64.jpg v588>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.712 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.171+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004502 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-10.jpg auth{0=1} v740 ap=1 s=11056 n(v0 rc2024-09-05T01:27:48.932542+0000 b11056 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c52c7ee680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004502:[<0x100000044bf/picture-10.jpg v740>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004502:[<0x100000044bf/picture-10.jpg v740>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.712 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.172+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000450b [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-1.jpg auth{0=1} v736 ap=1 s=61940 n(v0 rc2024-09-05T01:27:48.981541+0000 b61940 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c52c7eec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000450b:[<0x100000044bf/picture-1.jpg v736>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000450b:[<0x100000044bf/picture-1.jpg v736>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.712 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.172+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044c3 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-9.xml auth{0=1} v746 ap=1 s=18156 n(v0 rc2024-09-05T01:27:48.552545+0000 b18156 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c52c7ef180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044c3:[<0x100000044bf/article-9.xml v746>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044c3:[<0x100000044bf/article-9.xml v746>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.712 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.172+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004506 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-6.jpg auth{0=1} v738 ap=1 s=30983 n(v0 rc2024-09-05T01:27:48.946541+0000 b30983 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c52c7ef700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004506:[<0x100000044bf/picture-6.jpg v738>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004506:[<0x100000044bf/picture-6.jpg v738>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.712 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.172+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044e7 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-37.jpg auth{0=1} v670 ap=1 s=53048 n(v0 rc2024-09-05T01:27:48.717544+0000 b53048 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5347b1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044e7:[<0x100000044bf/picture-37.jpg v670>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044e7:[<0x100000044bf/picture-37.jpg v670>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.712 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.173+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044f0 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-28.jpg auth{0=1} v652 ap=1 s=22544 n(v0 rc2024-09-05T01:27:48.776543+0000 b22544 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5347b0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044f0:[<0x100000044bf/picture-28.jpg v652>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044f0:[<0x100000044bf/picture-28.jpg v652>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.712 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.173+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044fb [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-17.jpg auth{0=1} v572 ap=1 s=57253 n(v0 rc2024-09-05T01:27:48.912542+0000 b57253 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5347b1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044fb:[<0x100000044bf/picture-17.jpg v572>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044fb:[<0x100000044bf/picture-17.jpg v572>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.712 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.173+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044c9 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-3.xml auth{0=1} v742 ap=1 s=7899 n(v0 rc2024-09-05T01:27:48.576545+0000 b7899 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5347b2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044c9:[<0x100000044bf/article-3.xml v742>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044c9:[<0x100000044bf/article-3.xml v742>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.712 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.173+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044f4 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-24.jpg auth{0=1} v678 ap=1 s=18171 n(v0 rc2024-09-05T01:27:48.894542+0000 b18171 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5347b2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044f4:[<0x100000044bf/picture-24.jpg v678>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044f4:[<0x100000044bf/picture-24.jpg v678>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.713 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.173+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044eb [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-33.jpg auth{0=1} v612 ap=1 s=22076 n(v0 rc2024-09-05T01:27:48.764543+0000 b22076 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5347b3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044eb:[<0x100000044bf/picture-33.jpg v612>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044eb:[<0x100000044bf/picture-33.jpg v612>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.713 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.173+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044d3 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-57.jpg auth{0=1} v528 ap=1 s=33939 n(v0 rc2024-09-05T01:27:48.611545+0000 b33939 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5354f2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044d3:[<0x100000044bf/picture-57.jpg v528>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044d3:[<0x100000044bf/picture-57.jpg v528>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.713 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.175+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044c5 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-7.xml auth{0=1} v744 ap=1 s=20700 n(v0 rc2024-09-05T01:27:48.557545+0000 b20700 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5354f2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044c5:[<0x100000044bf/article-7.xml v744>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044c5:[<0x100000044bf/article-7.xml v744>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.713 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.175+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044e2 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-42.jpg auth{0=1} v690 ap=1 s=51506 n(v0 rc2024-09-05T01:27:48.677544+0000 b51506 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5354f3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044e2:[<0x100000044bf/picture-42.jpg v690>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044e2:[<0x100000044bf/picture-42.jpg v690>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.713 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.175+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044f3 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-25.jpg auth{0=1} v584 ap=1 s=14004 n(v0 rc2024-09-05T01:27:48.892542+0000 b14004 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5354f4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044f3:[<0x100000044bf/picture-25.jpg v584>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044f3:[<0x100000044bf/picture-25.jpg v584>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.713 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.175+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044e5 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-39.jpg auth{0=1} v686 ap=1 s=57047 n(v0 rc2024-09-05T01:27:48.712544+0000 b57047 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5354f4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044e5:[<0x100000044bf/picture-39.jpg v686>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044e5:[<0x100000044bf/picture-39.jpg v686>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.713 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.176+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044c4 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-8.xml auth{0=1} v743 ap=1 s=11526 n(v0 rc2024-09-05T01:27:48.555545+0000 b11526 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5354f5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044c4:[<0x100000044bf/article-8.xml v743>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044c4:[<0x100000044bf/article-8.xml v743>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.713 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.178+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004504 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-8.jpg auth{0=1} v737 ap=1 s=35672 n(v0 rc2024-09-05T01:27:48.939542+0000 b35672 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5354fd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004504:[<0x100000044bf/picture-8.jpg v737>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004504:[<0x100000044bf/picture-8.jpg v737>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.713 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.178+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044db [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-49.jpg auth{0=1} v636 ap=1 s=9457 n(v0 rc2024-09-05T01:27:48.646544+0000 b9457 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5354fd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044db:[<0x100000044bf/picture-49.jpg v636>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044db:[<0x100000044bf/picture-49.jpg v636>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.714 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.178+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044f2 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-26.jpg auth{0=1} v556 ap=1 s=46162 n(v0 rc2024-09-05T01:27:48.884542+0000 b46162 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5354fe100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044f2:[<0x100000044bf/picture-26.jpg v556>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044f2:[<0x100000044bf/picture-26.jpg v556>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.714 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.179+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044c6 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-6.xml auth{0=1} v741 ap=1 s=5260 n(v0 rc2024-09-05T01:27:48.559545+0000 b5260 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5354fec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044c6:[<0x100000044bf/article-6.xml v741>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044c6:[<0x100000044bf/article-6.xml v741>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.714 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.179+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044d6 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-54.jpg auth{0=1} v552 ap=1 s=34219 n(v0 rc2024-09-05T01:27:48.626544+0000 b34219 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535502000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044d6:[<0x100000044bf/picture-54.jpg v552>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044d6:[<0x100000044bf/picture-54.jpg v552>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.714 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.179+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044ca [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-2.xml auth{0=1} v739 ap=1 s=7471 n(v0 rc2024-09-05T01:27:48.579545+0000 b7471 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5354ff180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044ca:[<0x100000044bf/article-2.xml v739>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044ca:[<0x100000044bf/article-2.xml v739>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.714 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.179+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044ef [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-29.jpg auth{0=1} v568 ap=1 s=44077 n(v0 rc2024-09-05T01:27:48.773543+0000 b44077 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535502b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044ef:[<0x100000044bf/picture-29.jpg v568>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044ef:[<0x100000044bf/picture-29.jpg v568>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.714 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.180+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004507 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-5.jpg auth{0=1} v726 ap=1 s=11217 n(v0 rc2024-09-05T01:27:48.955541+0000 b11217 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c535503080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004507:[<0x100000044bf/picture-5.jpg v726>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004507:[<0x100000044bf/picture-5.jpg v726>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.714 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.182+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044da [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-50.jpg auth{0=1} v564 ap=1 s=46864 n(v0 rc2024-09-05T01:27:48.644544+0000 b46864 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535503b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044da:[<0x100000044bf/picture-50.jpg v564>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044da:[<0x100000044bf/picture-50.jpg v564>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.714 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.182+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044d2 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-58.jpg auth{0=1} v718 ap=1 s=19715 n(v0 rc2024-09-05T01:27:48.605545+0000 b19715 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535504680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044d2:[<0x100000044bf/picture-58.jpg v718>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044d2:[<0x100000044bf/picture-58.jpg v718>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.714 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.183+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044d9 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-51.jpg auth{0=1} v516 ap=1 s=17992 n(v0 rc2024-09-05T01:27:48.641544+0000 b17992 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535505700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044d9:[<0x100000044bf/picture-51.jpg v516>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044d9:[<0x100000044bf/picture-51.jpg v516>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.715 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.183+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044ce [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-62.jpg auth{0=1} v662 ap=1 s=18667 n(v0 rc2024-09-05T01:27:48.596545+0000 b18667 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53556c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044ce:[<0x100000044bf/picture-62.jpg v662>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044ce:[<0x100000044bf/picture-62.jpg v662>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.715 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.183+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044de [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-46.jpg auth{0=1} v624 ap=1 s=55605 n(v0 rc2024-09-05T01:27:48.668544+0000 b55605 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53556d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044de:[<0x100000044bf/picture-46.jpg v624>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044de:[<0x100000044bf/picture-46.jpg v624>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.715 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.183+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004509 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-3.jpg auth{0=1} v725 ap=1 s=20865 n(v0 rc2024-09-05T01:27:48.963541+0000 b20865 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53556d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004509:[<0x100000044bf/picture-3.jpg v725>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004509:[<0x100000044bf/picture-3.jpg v725>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.715 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.183+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044d5 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-55.jpg auth{0=1} v644 ap=1 s=19578 n(v0 rc2024-09-05T01:27:48.623544+0000 b19578 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53556e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044d5:[<0x100000044bf/picture-55.jpg v644>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044d5:[<0x100000044bf/picture-55.jpg v644>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.715 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.184+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004501 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-11.jpg auth{0=1} v727 ap=1 s=23427 n(v0 rc2024-09-05T01:27:48.929542+0000 b23427 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53556e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004501:[<0x100000044bf/picture-11.jpg v727>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004501:[<0x100000044bf/picture-11.jpg v727>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.715 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.184+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044c7 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-5.xml auth{0=1} v729 ap=1 s=26061 n(v0 rc2024-09-05T01:27:48.572545+0000 b26061 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53556ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044c7:[<0x100000044bf/article-5.xml v729>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044c7:[<0x100000044bf/article-5.xml v729>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.715 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.186+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044cd [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-63.jpg auth{0=1} v674 ap=1 s=64366 n(v0 rc2024-09-05T01:27:48.594545+0000 b64366 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53556f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044cd:[<0x100000044bf/picture-63.jpg v674>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044cd:[<0x100000044bf/picture-63.jpg v674>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.715 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.186+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044e4 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-40.jpg auth{0=1} v666 ap=1 s=14197 n(v0 rc2024-09-05T01:27:48.708544+0000 b14197 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535586580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044e4:[<0x100000044bf/picture-40.jpg v666>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044e4:[<0x100000044bf/picture-40.jpg v666>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.715 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.186+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044f5 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-23.jpg auth{0=1} v620 ap=1 s=31695 n(v0 rc2024-09-05T01:27:48.897542+0000 b31695 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535587080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044f5:[<0x100000044bf/picture-23.jpg v620>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044f5:[<0x100000044bf/picture-23.jpg v620>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.715 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.186+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044df [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-45.jpg auth{0=1} v616 ap=1 s=51561 n(v0 rc2024-09-05T01:27:48.670544+0000 b51561 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535587b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044df:[<0x100000044bf/picture-45.jpg v616>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044df:[<0x100000044bf/picture-45.jpg v616>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.716 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.187+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044d0 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-60.jpg auth{0=1} v656 ap=1 s=46080 n(v0 rc2024-09-05T01:27:48.601545+0000 b46080 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535589700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044d0:[<0x100000044bf/picture-60.jpg v656>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044d0:[<0x100000044bf/picture-60.jpg v656>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.716 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.189+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044f6 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-22.jpg auth{0=1} v608 ap=1 s=25052 n(v0 rc2024-09-05T01:27:48.899542+0000 b25052 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535592580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044f6:[<0x100000044bf/picture-22.jpg v608>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044f6:[<0x100000044bf/picture-22.jpg v608>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.716 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.189+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044c1 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-11.xml auth{0=1} v743 ap=1 s=27900 n(v0 rc2024-09-05T01:27:48.543545+0000 b27900 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c535592b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044c1:[<0x100000044bf/article-11.xml v743>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044c1:[<0x100000044bf/article-11.xml v743>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.716 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.190+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044fd [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-15.jpg auth{0=1} v698 ap=1 s=29884 n(v0 rc2024-09-05T01:27:48.917542+0000 b29884 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535593b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044fd:[<0x100000044bf/picture-15.jpg v698>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044fd:[<0x100000044bf/picture-15.jpg v698>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.716 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.190+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044d4 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-56.jpg auth{0=1} v702 ap=1 s=45177 n(v0 rc2024-09-05T01:27:48.621544+0000 b45177 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535594680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044d4:[<0x100000044bf/picture-56.jpg v702>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044d4:[<0x100000044bf/picture-56.jpg v702>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.716 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.192+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044dd [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-47.jpg auth{0=1} v536 ap=1 s=61739 n(v0 rc2024-09-05T01:27:48.651544+0000 b61739 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535595180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044dd:[<0x100000044bf/picture-47.jpg v536>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044dd:[<0x100000044bf/picture-47.jpg v536>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.716 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.192+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044c2 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-10.xml auth{0=1} v741 ap=1 s=6263 n(v0 rc2024-09-05T01:27:48.550545+0000 b6263 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c535595700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044c2:[<0x100000044bf/article-10.xml v741>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044c2:[<0x100000044bf/article-10.xml v741>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.716 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.192+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004500 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-12.jpg auth{0=1} v737 ap=1 s=39458 n(v0 rc2024-09-05T01:27:48.924542+0000 b39458 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5354de000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004500:[<0x100000044bf/picture-12.jpg v737>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004500:[<0x100000044bf/picture-12.jpg v737>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.716 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.192+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044e0 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-44.jpg auth{0=1} v524 ap=1 s=61036 n(v0 rc2024-09-05T01:27:48.672544+0000 b61036 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5354deb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044e0:[<0x100000044bf/picture-44.jpg v524>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044e0:[<0x100000044bf/picture-44.jpg v524>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.717 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.193+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044d1 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-59.jpg auth{0=1} v532 ap=1 s=10408 n(v0 rc2024-09-05T01:27:48.603545+0000 b10408 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5354dfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044d1:[<0x100000044bf/picture-59.jpg v532>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044d1:[<0x100000044bf/picture-59.jpg v532>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.717 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.193+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044c8 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-4.xml auth{0=1} v739 ap=1 s=31358 n(v0 rc2024-09-05T01:27:48.574545+0000 b31358 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5354df080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044c8:[<0x100000044bf/article-4.xml v739>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044c8:[<0x100000044bf/article-4.xml v739>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.717 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.193+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044f7 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-21.jpg auth{0=1} v640 ap=1 s=25096 n(v0 rc2024-09-05T01:27:48.901542+0000 b25096 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5354e0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044f7:[<0x100000044bf/picture-21.jpg v640>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044f7:[<0x100000044bf/picture-21.jpg v640>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.717 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.193+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044e8 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-36.jpg auth{0=1} v548 ap=1 s=59828 n(v0 rc2024-09-05T01:27:48.719544+0000 b59828 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5354ea000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044e8:[<0x100000044bf/picture-36.jpg v548>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044e8:[<0x100000044bf/picture-36.jpg v548>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.717 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.193+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044ee [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-30.jpg auth{0=1} v540 ap=1 s=23072 n(v0 rc2024-09-05T01:27:48.770543+0000 b23072 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5354e1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044ee:[<0x100000044bf/picture-30.jpg v540>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044ee:[<0x100000044bf/picture-30.jpg v540>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.717 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.194+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044e1 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-43.jpg auth{0=1} v544 ap=1 s=49936 n(v0 rc2024-09-05T01:27:48.675544+0000 b49936 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5354eab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044e1:[<0x100000044bf/picture-43.jpg v544>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044e1:[<0x100000044bf/picture-43.jpg v544>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.717 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.194+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044f8 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-20.jpg auth{0=1} v628 ap=1 s=50651 n(v0 rc2024-09-05T01:27:48.904542+0000 b50651 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5354eb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044f8:[<0x100000044bf/picture-20.jpg v628>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044f8:[<0x100000044bf/picture-20.jpg v628>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.717 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.195+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044e6 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-38.jpg auth{0=1} v706 ap=1 s=53923 n(v0 rc2024-09-05T01:27:48.715544+0000 b53923 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5354ec100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044e6:[<0x100000044bf/picture-38.jpg v706>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044e6:[<0x100000044bf/picture-38.jpg v706>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.717 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.195+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044c0 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-12.xml auth{0=1} v737 ap=1 s=22940 n(v0 rc2024-09-05T01:27:48.541545+0000 b22940 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5354ed700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044c0:[<0x100000044bf/article-12.xml v737>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044c0:[<0x100000044bf/article-12.xml v737>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.717 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.195+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044f1 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-27.jpg auth{0=1} v682 ap=1 s=23604 n(v0 rc2024-09-05T01:27:48.826543+0000 b23604 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5354ed180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044f1:[<0x100000044bf/picture-27.jpg v682>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044f1:[<0x100000044bf/picture-27.jpg v682>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.718 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.196+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044d8 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-52.jpg auth{0=1} v576 ap=1 s=46691 n(v0 rc2024-09-05T01:27:48.639544+0000 b46691 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535ca8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044d8:[<0x100000044bf/picture-52.jpg v576>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044d8:[<0x100000044bf/picture-52.jpg v576>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.718 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.196+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044cb [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-1.xml auth{0=1} v735 ap=1 s=20801 n(v0 rc2024-09-05T01:27:48.581545+0000 b20801 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c535ca8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044cb:[<0x100000044bf/article-1.xml v735>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044cb:[<0x100000044bf/article-1.xml v735>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.718 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.196+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044ea [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-34.jpg auth{0=1} v694 ap=1 s=63067 n(v0 rc2024-09-05T01:27:48.760543+0000 b63067 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535ca9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044ea:[<0x100000044bf/picture-34.jpg v694>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044ea:[<0x100000044bf/picture-34.jpg v694>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.718 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.198+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044d7 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-53.jpg auth{0=1} v520 ap=1 s=21049 n(v0 rc2024-09-05T01:27:48.628544+0000 b21049 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535caa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044d7:[<0x100000044bf/picture-53.jpg v520>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044d7:[<0x100000044bf/picture-53.jpg v520>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.718 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.198+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044fc [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-16.jpg auth{0=1} v560 ap=1 s=36401 n(v0 rc2024-09-05T01:27:48.914542+0000 b36401 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535caac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044fc:[<0x100000044bf/picture-16.jpg v560>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044fc:[<0x100000044bf/picture-16.jpg v560>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.718 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.199+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044ec [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-32.jpg auth{0=1} v600 ap=1 s=25431 n(v0 rc2024-09-05T01:27:48.766543+0000 b25431 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535cb2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044ec:[<0x100000044bf/picture-32.jpg v600>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044ec:[<0x100000044bf/picture-32.jpg v600>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.718 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.199+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000044dc [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-48.jpg auth{0=1} v592 ap=1 s=63923 n(v0 rc2024-09-05T01:27:48.648544+0000 b63923 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535cb2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000044dc:[<0x100000044bf/picture-48.jpg v592>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000044dc:[<0x100000044bf/picture-48.jpg v592>,<0x10000000399/blog-204 v213745>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.718 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.199+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004306 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-13.jpg auth{0=1} v246 ap=1 s=32436 n(v0 rc2024-09-05T01:27:46.016568+0000 b32436 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535cb3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004306:[<0x100000042f3/picture-13.jpg v246>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004306:[<0x100000042f3/picture-13.jpg v246>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.718 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.199+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004301 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-18.jpg auth{0=1} v188 ap=1 s=37853 n(v0 rc2024-09-05T01:27:45.995569+0000 b37853 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535cb3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004301:[<0x100000042f3/picture-18.jpg v188>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004301:[<0x100000042f3/picture-18.jpg v188>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.719 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.201+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000430f [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-4.jpg auth{0=1} v314 ap=1 s=54286 n(v0 rc2024-09-05T01:27:46.044568+0000 b54286 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535cb4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000430f:[<0x100000042f3/picture-4.jpg v314>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000430f:[<0x100000042f3/picture-4.jpg v314>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.719 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.201+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004300 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-19.jpg auth{0=1} v238 ap=1 s=58928 n(v0 rc2024-09-05T01:27:45.992569+0000 b58928 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535cb3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004300:[<0x100000042f3/picture-19.jpg v238>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004300:[<0x100000042f3/picture-19.jpg v238>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.719 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.201+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004311 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-2.jpg auth{0=1} v310 ap=1 s=36838 n(v0 rc2024-09-05T01:27:46.049568+0000 b36838 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535cb4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004311:[<0x100000042f3/picture-2.jpg v310>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004311:[<0x100000042f3/picture-2.jpg v310>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.719 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.202+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004305 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-14.jpg auth{0=1} v218 ap=1 s=28882 n(v0 rc2024-09-05T01:27:46.013568+0000 b28882 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535cb5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004305:[<0x100000042f3/picture-14.jpg v218>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004305:[<0x100000042f3/picture-14.jpg v218>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.719 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.204+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000430a [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-9.jpg auth{0=1} v222 ap=1 s=23606 n(v0 rc2024-09-05T01:27:46.025568+0000 b23606 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53117e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000430a:[<0x100000042f3/picture-9.jpg v222>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000430a:[<0x100000042f3/picture-9.jpg v222>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.719 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.204+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004309 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-10.jpg auth{0=1} v224 ap=1 s=63609 n(v0 rc2024-09-05T01:27:46.022568+0000 b63609 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53117eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004309:[<0x100000042f3/picture-10.jpg v224>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004309:[<0x100000042f3/picture-10.jpg v224>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.719 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.204+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004312 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-1.jpg auth{0=1} v308 ap=1 s=22863 n(v0 rc2024-09-05T01:27:46.051568+0000 b22863 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53117f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004312:[<0x100000042f3/picture-1.jpg v308>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004312:[<0x100000042f3/picture-1.jpg v308>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.719 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.204+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000430d [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-6.jpg auth{0=1} v234 ap=1 s=38993 n(v0 rc2024-09-05T01:27:46.033568+0000 b38993 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53117f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000430d:[<0x100000042f3/picture-6.jpg v234>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000430d:[<0x100000042f3/picture-6.jpg v234>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.719 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.205+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000042f7 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-28.jpg auth{0=1} v204 ap=1 s=46449 n(v0 rc2024-09-05T01:27:45.954569+0000 b46449 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53117fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000042f7:[<0x100000042f3/picture-28.jpg v204>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000042f7:[<0x100000042f3/picture-28.jpg v204>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.720 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.206+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004302 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-17.jpg auth{0=1} v232 ap=1 s=32129 n(v0 rc2024-09-05T01:27:45.998569+0000 b32129 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c531180100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004302:[<0x100000042f3/picture-17.jpg v232>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004302:[<0x100000042f3/picture-17.jpg v232>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.720 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.206+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000042f4 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/article-3.xml auth{0=1} v320 ap=1 s=28989 n(v0 rc2024-09-05T01:27:45.943569+0000 b28989 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c531180680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000042f4:[<0x100000042f3/article-3.xml v320>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000042f4:[<0x100000042f3/article-3.xml v320>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.720 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.206+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000042fa [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-25.jpg auth{0=1} v220 ap=1 s=50572 n(v0 rc2024-09-05T01:27:45.969569+0000 b50572 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c531181180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000042fa:[<0x100000042f3/picture-25.jpg v220>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000042fa:[<0x100000042f3/picture-25.jpg v220>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.720 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.207+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000430b [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-8.jpg auth{0=1} v210 ap=1 s=21599 n(v0 rc2024-09-05T01:27:46.027568+0000 b21599 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c531181700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000430b:[<0x100000042f3/picture-8.jpg v210>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000430b:[<0x100000042f3/picture-8.jpg v210>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.720 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.207+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000042f9 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-26.jpg auth{0=1} v226 ap=1 s=17692 n(v0 rc2024-09-05T01:27:45.967569+0000 b17692 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53118c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000042f9:[<0x100000042f3/picture-26.jpg v226>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000042f9:[<0x100000042f3/picture-26.jpg v226>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.720 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.209+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000042f5 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/article-2.xml auth{0=1} v318 ap=1 s=4486 n(v0 rc2024-09-05T01:27:45.945569+0000 b4486 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53118cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000042f5:[<0x100000042f3/article-2.xml v318>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000042f5:[<0x100000042f3/article-2.xml v318>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.720 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.209+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000430e [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-5.jpg auth{0=1} v236 ap=1 s=20172 n(v0 rc2024-09-05T01:27:46.041568+0000 b20172 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53118d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000430e:[<0x100000042f3/picture-5.jpg v236>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000430e:[<0x100000042f3/picture-5.jpg v236>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.720 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.210+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004310 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-3.jpg auth{0=1} v312 ap=1 s=11795 n(v0 rc2024-09-05T01:27:46.046568+0000 b11795 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53118db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004310:[<0x100000042f3/picture-3.jpg v312>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004310:[<0x100000042f3/picture-3.jpg v312>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.720 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.210+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004308 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-11.jpg auth{0=1} v228 ap=1 s=41451 n(v0 rc2024-09-05T01:27:46.020568+0000 b41451 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53118e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004308:[<0x100000042f3/picture-11.jpg v228>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004308:[<0x100000042f3/picture-11.jpg v228>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.721 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.212+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000042fc [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-23.jpg auth{0=1} v244 ap=1 s=31622 n(v0 rc2024-09-05T01:27:45.974569+0000 b31622 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53118f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000042fc:[<0x100000042f3/picture-23.jpg v244>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000042fc:[<0x100000042f3/picture-23.jpg v244>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.721 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.212+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000042fd [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-22.jpg auth{0=1} v240 ap=1 s=41473 n(v0 rc2024-09-05T01:27:45.977569+0000 b41473 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53118f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000042fd:[<0x100000042f3/picture-22.jpg v240>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000042fd:[<0x100000042f3/picture-22.jpg v240>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.721 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.212+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004304 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-15.jpg auth{0=1} v208 ap=1 s=54949 n(v0 rc2024-09-05T01:27:46.002568+0000 b54949 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535eb0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004304:[<0x100000042f3/picture-15.jpg v208>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004304:[<0x100000042f3/picture-15.jpg v208>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.721 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.213+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004307 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-12.jpg auth{0=1} v216 ap=1 s=32862 n(v0 rc2024-09-05T01:27:46.018568+0000 b32862 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535eb0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004307:[<0x100000042f3/picture-12.jpg v216>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004307:[<0x100000042f3/picture-12.jpg v216>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.721 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.215+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000042fe [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-21.jpg auth{0=1} v230 ap=1 s=47832 n(v0 rc2024-09-05T01:27:45.979569+0000 b47832 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535eb0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000042fe:[<0x100000042f3/picture-21.jpg v230>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000042fe:[<0x100000042f3/picture-21.jpg v230>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.721 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.215+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000042ff [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-20.jpg auth{0=1} v242 ap=1 s=63903 n(v0 rc2024-09-05T01:27:45.982569+0000 b63903 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535eb1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000042ff:[<0x100000042f3/picture-20.jpg v242>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000042ff:[<0x100000042f3/picture-20.jpg v242>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.721 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.215+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000042f8 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-27.jpg auth{0=1} v248 ap=1 s=31251 n(v0 rc2024-09-05T01:27:45.957569+0000 b31251 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535eb1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000042f8:[<0x100000042f3/picture-27.jpg v248>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000042f8:[<0x100000042f3/picture-27.jpg v248>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.721 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.215+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000042f6 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/article-1.xml auth{0=1} v316 ap=1 s=18523 n(v0 rc2024-09-05T01:27:45.952569+0000 b18523 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535eb1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000042f6:[<0x100000042f3/article-1.xml v316>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x100000042f6:[<0x100000042f3/article-1.xml v316>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:27.721 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.216+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004303 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-16.jpg auth{0=1} v212 ap=1 s=49425 n(v0 rc2024-09-05T01:27:46.000569+0000 b49425 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c535eb2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004303:[<0x100000042f3/picture-16.jpg v212>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004303:[<0x100000042f3/picture-16.jpg v212>,<0x10000000399/blog-192 v213873>,<0x10000000208/blogtest_in v2916>,<0x10000000201/src v2560>,<0x10000000006/blogbench-1.0 v2143>,<0x10000000005/tmp v729>,<0x100000001fb/client.0 v717>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v378>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.179 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.927+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039c6 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-13.jpg auth{0=1} v822 ap=1 s=37198 n(v0 rc2024-09-05T01:27:19.019817+0000 b37198 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a58100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039c6:[<0x10000003930/picture-13.jpg v822>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039c6:[<0x10000003930/picture-13.jpg v822>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.179 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.927+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039c1 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-18.jpg auth{0=1} v832 ap=1 s=50076 n(v0 rc2024-09-05T01:27:18.950818+0000 b50076 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a58680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039c1:[<0x10000003930/picture-18.jpg v832>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039c1:[<0x10000003930/picture-18.jpg v832>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.179 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.927+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039bf [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-19.jpg auth{0=1} v672 ap=1 s=34273 n(v0 rc2024-09-05T01:27:18.939818+0000 b34273 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a58c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039bf:[<0x10000003930/picture-19.jpg v672>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039bf:[<0x10000003930/picture-19.jpg v672>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.179 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.928+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039cf [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-4.jpg auth{0=1} v804 ap=1 s=53141 n(v0 rc2024-09-05T01:27:19.061817+0000 b53141 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a59180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039cf:[<0x10000003930/picture-4.jpg v804>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039cf:[<0x10000003930/picture-4.jpg v804>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.179 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.928+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039d1 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-2.jpg auth{0=1} v800 ap=1 s=24274 n(v0 rc2024-09-05T01:27:19.068817+0000 b24274 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a64000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039d1:[<0x10000003930/picture-2.jpg v800>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039d1:[<0x10000003930/picture-2.jpg v800>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.179 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.928+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039a7 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-35.jpg auth{0=1} v694 ap=1 s=49363 n(v0 rc2024-09-05T01:27:18.864819+0000 b49363 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a59700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039a7:[<0x10000003930/picture-35.jpg v694>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039a7:[<0x10000003930/picture-35.jpg v694>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.179 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.928+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039c5 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-14.jpg auth{0=1} v824 ap=1 s=55156 n(v0 rc2024-09-05T01:27:19.009817+0000 b55156 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a64580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039c5:[<0x10000003930/picture-14.jpg v824>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039c5:[<0x10000003930/picture-14.jpg v824>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.179 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.928+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039cc [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-7.jpg auth{0=1} v810 ap=1 s=32838 n(v0 rc2024-09-05T01:27:19.053817+0000 b32838 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a65600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039cc:[<0x10000003930/picture-7.jpg v810>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039cc:[<0x10000003930/picture-7.jpg v810>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.180 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.929+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003974 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-61.jpg auth{0=1} v722 ap=1 s=52402 n(v0 rc2024-09-05T01:27:18.683820+0000 b52402 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a65080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003974:[<0x10000003930/picture-61.jpg v722>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003974:[<0x10000003930/picture-61.jpg v722>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.180 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.181 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.182 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.183 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.184 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.184 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.184 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.929+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039ca [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-9.jpg auth{0=1} v814 ap=1 s=57145 n(v0 rc2024-09-05T01:27:19.042817+0000 b57145 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a65b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039ca:[<0x10000003930/picture-9.jpg v814>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039ca:[<0x10000003930/picture-9.jpg v814>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.185 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.929+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000396e [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-64.jpg auth{0=1} v740 ap=1 s=59351 n(v0 rc2024-09-05T01:27:18.669821+0000 b59351 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a66100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000396e:[<0x10000003930/picture-64.jpg v740>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x1000000396e:[<0x10000003930/picture-64.jpg v740>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.185 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.929+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039c9 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-10.jpg auth{0=1} v816 ap=1 s=52945 n(v0 rc2024-09-05T01:27:19.039817+0000 b52945 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a66680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039c9:[<0x10000003930/picture-10.jpg v816>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039c9:[<0x10000003930/picture-10.jpg v816>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.185 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.929+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039d2 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-1.jpg auth{0=1} v798 ap=1 s=36162 n(v0 rc2024-09-05T01:27:19.074817+0000 b36162 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a66c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039d2:[<0x10000003930/picture-1.jpg v798>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039d2:[<0x10000003930/picture-1.jpg v798>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.185 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.930+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003940 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-9.xml auth{0=1} v848 ap=1 s=28679 n(v0 rc2024-09-05T01:27:18.510822+0000 b28679 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a67180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003940:[<0x10000003930/article-9.xml v848>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003940:[<0x10000003930/article-9.xml v848>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.185 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.930+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039cd [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-6.jpg auth{0=1} v808 ap=1 s=10237 n(v0 rc2024-09-05T01:27:19.056817+0000 b10237 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a70000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039cd:[<0x10000003930/picture-6.jpg v808>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039cd:[<0x10000003930/picture-6.jpg v808>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.185 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.930+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039b2 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-28.jpg auth{0=1} v650 ap=1 s=9822 n(v0 rc2024-09-05T01:27:18.894818+0000 b9822 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a70b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039b2:[<0x10000003930/picture-28.jpg v650>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039b2:[<0x10000003930/picture-28.jpg v650>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.185 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.930+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039a4 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-37.jpg auth{0=1} v590 ap=1 s=19739 n(v0 rc2024-09-05T01:27:18.856819+0000 b19739 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a71080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039a4:[<0x10000003930/picture-37.jpg v590>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039a4:[<0x10000003930/picture-37.jpg v590>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.185 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.931+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039c2 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-17.jpg auth{0=1} v830 ap=1 s=25527 n(v0 rc2024-09-05T01:27:18.961818+0000 b25527 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a71600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039c2:[<0x10000003930/picture-17.jpg v830>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039c2:[<0x10000003930/picture-17.jpg v830>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.185 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.931+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000394a [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-3.xml auth{0=1} v838 ap=1 s=28615 n(v0 rc2024-09-05T01:27:18.549822+0000 b28615 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a71b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000394a:[<0x10000003930/article-3.xml v838>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x1000000394a:[<0x10000003930/article-3.xml v838>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.185 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.931+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039b7 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-24.jpg auth{0=1} v700 ap=1 s=57174 n(v0 rc2024-09-05T01:27:18.913818+0000 b57174 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a72100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039b7:[<0x10000003930/picture-24.jpg v700>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039b7:[<0x10000003930/picture-24.jpg v700>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.185 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.931+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039aa [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-33.jpg auth{0=1} v668 ap=1 s=52823 n(v0 rc2024-09-05T01:27:18.873819+0000 b52823 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a72680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039aa:[<0x10000003930/picture-33.jpg v668>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039aa:[<0x10000003930/picture-33.jpg v668>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.186 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.931+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000397e [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-57.jpg auth{0=1} v634 ap=1 s=53306 n(v0 rc2024-09-05T01:27:18.728820+0000 b53306 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a72c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000397e:[<0x10000003930/picture-57.jpg v634>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x1000000397e:[<0x10000003930/picture-57.jpg v634>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.186 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.186 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.186 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.186 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.186 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.186 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.186 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.186 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.186 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.187 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.188 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.189 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.190 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.932+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000399b [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-42.jpg auth{0=1} v738 ap=1 s=30693 n(v0 rc2024-09-05T01:27:18.832819+0000 b30693 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a73700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000399b:[<0x10000003930/picture-42.jpg v738>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x1000000399b:[<0x10000003930/picture-42.jpg v738>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.190 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.932+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003944 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-7.xml auth{0=1} v844 ap=1 s=31091 n(v0 rc2024-09-05T01:27:18.524822+0000 b31091 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a73180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003944:[<0x10000003930/article-7.xml v844>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003944:[<0x10000003930/article-7.xml v844>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.190 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.932+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003963 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-68.jpg auth{0=1} v666 ap=1 s=31442 n(v0 rc2024-09-05T01:27:18.642821+0000 b31442 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a7c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003963:[<0x10000003930/picture-68.jpg v666>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003963:[<0x10000003930/picture-68.jpg v666>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.191 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.932+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039a1 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-39.jpg auth{0=1} v648 ap=1 s=11832 n(v0 rc2024-09-05T01:27:18.848819+0000 b11832 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a7c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039a1:[<0x10000003930/picture-39.jpg v648>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039a1:[<0x10000003930/picture-39.jpg v648>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.191 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.932+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039b6 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-25.jpg auth{0=1} v728 ap=1 s=32584 n(v0 rc2024-09-05T01:27:18.909818+0000 b32584 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a7cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039b6:[<0x10000003930/picture-25.jpg v728>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039b6:[<0x10000003930/picture-25.jpg v728>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.191 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.932+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003942 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-8.xml auth{0=1} v846 ap=1 s=9137 n(v0 rc2024-09-05T01:27:18.517822+0000 b9137 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a7d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003942:[<0x10000003930/article-8.xml v846>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003942:[<0x10000003930/article-8.xml v846>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.191 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.933+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039ad [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-31.jpg auth{0=1} v670 ap=1 s=46394 n(v0 rc2024-09-05T01:27:18.881819+0000 b46394 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a7d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039ad:[<0x10000003930/picture-31.jpg v670>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039ad:[<0x10000003930/picture-31.jpg v670>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.191 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.933+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000398e [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-49.jpg auth{0=1} v688 ap=1 s=33404 n(v0 rc2024-09-05T01:27:18.785819+0000 b33404 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a7db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000398e:[<0x10000003930/picture-49.jpg v688>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x1000000398e:[<0x10000003930/picture-49.jpg v688>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.191 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.933+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039cb [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-8.jpg auth{0=1} v812 ap=1 s=15212 n(v0 rc2024-09-05T01:27:19.045817+0000 b15212 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a7e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039cb:[<0x10000003930/picture-8.jpg v812>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039cb:[<0x10000003930/picture-8.jpg v812>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.191 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.933+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039b5 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-26.jpg auth{0=1} v690 ap=1 s=55463 n(v0 rc2024-09-05T01:27:18.906818+0000 b55463 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a7e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039b5:[<0x10000003930/picture-26.jpg v690>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039b5:[<0x10000003930/picture-26.jpg v690>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.191 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.933+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000393a [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-13.xml auth{0=1} v856 ap=1 s=19570 n(v0 rc2024-09-05T01:27:18.472822+0000 b19570 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a7ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000393a:[<0x10000003930/article-13.xml v856>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x1000000393a:[<0x10000003930/article-13.xml v856>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.191 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.934+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003946 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-6.xml auth{0=1} v842 ap=1 s=10271 n(v0 rc2024-09-05T01:27:18.530822+0000 b10271 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a7f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003946:[<0x10000003930/article-6.xml v842>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003946:[<0x10000003930/article-6.xml v842>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.192 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.193 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.194 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.195 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.196 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.934+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000394c [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-2.xml auth{0=1} v836 ap=1 s=31344 n(v0 rc2024-09-05T01:27:18.571821+0000 b31344 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a7f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000394c:[<0x10000003930/article-2.xml v836>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x1000000394c:[<0x10000003930/article-2.xml v836>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.196 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.934+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003981 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-54.jpg auth{0=1} v652 ap=1 s=39503 n(v0 rc2024-09-05T01:27:18.737820+0000 b39503 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a88000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003981:[<0x10000003930/picture-54.jpg v652>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003981:[<0x10000003930/picture-54.jpg v652>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.196 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.934+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039b0 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-29.jpg auth{0=1} v708 ap=1 s=47878 n(v0 rc2024-09-05T01:27:18.889819+0000 b47878 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a88580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039b0:[<0x10000003930/picture-29.jpg v708>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039b0:[<0x10000003930/picture-29.jpg v708>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.196 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.934+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039ce [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-5.jpg auth{0=1} v806 ap=1 s=23704 n(v0 rc2024-09-05T01:27:19.058817+0000 b23704 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a88b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039ce:[<0x10000003930/picture-5.jpg v806>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039ce:[<0x10000003930/picture-5.jpg v806>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.196 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.935+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000398b [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-50.jpg auth{0=1} v686 ap=1 s=33689 n(v0 rc2024-09-05T01:27:18.778820+0000 b33689 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a89080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000398b:[<0x10000003930/picture-50.jpg v686>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x1000000398b:[<0x10000003930/picture-50.jpg v686>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.197 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.935+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000397c [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-58.jpg auth{0=1} v704 ap=1 s=57217 n(v0 rc2024-09-05T01:27:18.723820+0000 b57217 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a89600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000397c:[<0x10000003930/picture-58.jpg v704>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x1000000397c:[<0x10000003930/picture-58.jpg v704>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.197 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.935+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000396a [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-65.jpg auth{0=1} v654 ap=1 s=15447 n(v0 rc2024-09-05T01:27:18.660821+0000 b15447 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a89b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000396a:[<0x10000003930/picture-65.jpg v654>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x1000000396a:[<0x10000003930/picture-65.jpg v654>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.197 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.935+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003961 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-69.jpg auth{0=1} v702 ap=1 s=61574 n(v0 rc2024-09-05T01:27:18.635821+0000 b61574 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a8a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003961:[<0x10000003930/picture-69.jpg v702>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003961:[<0x10000003930/picture-69.jpg v702>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.197 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.935+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003989 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-51.jpg auth{0=1} v662 ap=1 s=16446 n(v0 rc2024-09-05T01:27:18.766820+0000 b16446 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a8a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003989:[<0x10000003930/picture-51.jpg v662>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003989:[<0x10000003930/picture-51.jpg v662>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.197 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.936+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003972 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-62.jpg auth{0=1} v734 ap=1 s=62888 n(v0 rc2024-09-05T01:27:18.678820+0000 b62888 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a8ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003972:[<0x10000003930/picture-62.jpg v734>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003972:[<0x10000003930/picture-62.jpg v734>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.197 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.936+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003995 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-46.jpg auth{0=1} v642 ap=1 s=45247 n(v0 rc2024-09-05T01:27:18.816819+0000 b45247 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a8b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003995:[<0x10000003930/picture-46.jpg v642>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003995:[<0x10000003930/picture-46.jpg v642>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.197 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.936+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039d0 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-3.jpg auth{0=1} v802 ap=1 s=39402 n(v0 rc2024-09-05T01:27:19.065817+0000 b39402 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a8b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039d0:[<0x10000003930/picture-3.jpg v802>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039d0:[<0x10000003930/picture-3.jpg v802>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.197 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.197 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.198 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.199 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.200 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.200 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.200 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.200 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.200 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.200 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.200 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.200 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.200 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.201 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.202 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.936+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003980 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-55.jpg auth{0=1} v718 ap=1 s=36065 n(v0 rc2024-09-05T01:27:18.734820+0000 b36065 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a90000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003980:[<0x10000003930/picture-55.jpg v718>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003980:[<0x10000003930/picture-55.jpg v718>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.202 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.936+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039c8 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-11.jpg auth{0=1} v818 ap=1 s=53522 n(v0 rc2024-09-05T01:27:19.024817+0000 b53522 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a90580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039c8:[<0x10000003930/picture-11.jpg v818>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039c8:[<0x10000003930/picture-11.jpg v818>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.203 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.936+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000395c [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-70.jpg auth{0=1} v696 ap=1 s=50683 n(v0 rc2024-09-05T01:27:18.622821+0000 b50683 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a90b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000395c:[<0x10000003930/picture-70.jpg v696>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x1000000395c:[<0x10000003930/picture-70.jpg v696>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.203 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.937+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003970 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-63.jpg auth{0=1} v680 ap=1 s=14801 n(v0 rc2024-09-05T01:27:18.674821+0000 b14801 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a92100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003970:[<0x10000003930/picture-63.jpg v680>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003970:[<0x10000003930/picture-63.jpg v680>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.203 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.937+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000395a [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-71.jpg auth{0=1} v720 ap=1 s=29274 n(v0 rc2024-09-05T01:27:18.617821+0000 b29274 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a91b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000395a:[<0x10000003930/picture-71.jpg v720>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x1000000395a:[<0x10000003930/picture-71.jpg v720>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.203 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.937+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000399f [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-40.jpg auth{0=1} v742 ap=1 s=36936 n(v0 rc2024-09-05T01:27:18.845819+0000 b36936 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a92680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000399f:[<0x10000003930/picture-40.jpg v742>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x1000000399f:[<0x10000003930/picture-40.jpg v742>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.203 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.937+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039b9 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-23.jpg auth{0=1} v658 ap=1 s=59620 n(v0 rc2024-09-05T01:27:18.920818+0000 b59620 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a92c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039b9:[<0x10000003930/picture-23.jpg v658>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039b9:[<0x10000003930/picture-23.jpg v658>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.203 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.937+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003938 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-14.xml auth{0=1} v858 ap=1 s=19656 n(v0 rc2024-09-05T01:27:18.469822+0000 b19656 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a93180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003938:[<0x10000003930/article-14.xml v858>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003938:[<0x10000003930/article-14.xml v858>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.203 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.938+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003997 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-45.jpg auth{0=1} v674 ap=1 s=29240 n(v0 rc2024-09-05T01:27:18.822819+0000 b29240 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537a93700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003997:[<0x10000003930/picture-45.jpg v674>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003997:[<0x10000003930/picture-45.jpg v674>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.203 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.938+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000399d [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-41.jpg auth{0=1} v664 ap=1 s=9897 n(v0 rc2024-09-05T01:27:18.839819+0000 b9897 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537aa2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000399d:[<0x10000003930/picture-41.jpg v664>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x1000000399d:[<0x10000003930/picture-41.jpg v664>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.203 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.938+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003979 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-60.jpg auth{0=1} v640 ap=1 s=42480 n(v0 rc2024-09-05T01:27:18.715820+0000 b42480 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537aa2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003979:[<0x10000003930/picture-60.jpg v640>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003979:[<0x10000003930/picture-60.jpg v640>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.203 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.938+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003967 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-66.jpg auth{0=1} v732 ap=1 s=52066 n(v0 rc2024-09-05T01:27:18.653821+0000 b52066 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537aa2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003967:[<0x10000003930/picture-66.jpg v732>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003967:[<0x10000003930/picture-66.jpg v732>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.204 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.205 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.206 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.206 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.206 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.206 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.206 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.206 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.206 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.206 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.206 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.206 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.206 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.206 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.206 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.206 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.206 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.206 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.207 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.207 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.207 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.207 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.207 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.207 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.207 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.208 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.939+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039ba [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-22.jpg auth{0=1} v684 ap=1 s=50851 n(v0 rc2024-09-05T01:27:18.923818+0000 b50851 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537aa3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039ba:[<0x10000003930/picture-22.jpg v684>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039ba:[<0x10000003930/picture-22.jpg v684>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.208 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.939+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000393e [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-11.xml auth{0=1} v852 ap=1 s=8992 n(v0 rc2024-09-05T01:27:18.500822+0000 b8992 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537aa3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000393e:[<0x10000003930/article-11.xml v852>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x1000000393e:[<0x10000003930/article-11.xml v852>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.208 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.939+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003934 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-16.xml auth{0=1} v862 ap=1 s=19671 n(v0 rc2024-09-05T01:27:18.452823+0000 b19671 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537aa4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003934:[<0x10000003930/article-16.xml v862>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003934:[<0x10000003930/article-16.xml v862>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.208 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.939+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039c4 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-15.jpg auth{0=1} v826 ap=1 s=40800 n(v0 rc2024-09-05T01:27:18.989818+0000 b40800 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537aa4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039c4:[<0x10000003930/picture-15.jpg v826>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039c4:[<0x10000003930/picture-15.jpg v826>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.208 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.939+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000397f [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-56.jpg auth{0=1} v712 ap=1 s=61761 n(v0 rc2024-09-05T01:27:18.732820+0000 b61761 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537aa4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000397f:[<0x10000003930/picture-56.jpg v712>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x1000000397f:[<0x10000003930/picture-56.jpg v712>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.208 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.940+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003993 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-47.jpg auth{0=1} v632 ap=1 s=56545 n(v0 rc2024-09-05T01:27:18.809819+0000 b56545 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537aa5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003993:[<0x10000003930/picture-47.jpg v632>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003993:[<0x10000003930/picture-47.jpg v632>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.208 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.940+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000393f [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-10.xml auth{0=1} v850 ap=1 s=20032 n(v0 rc2024-09-05T01:27:18.504822+0000 b20032 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537aa5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000393f:[<0x10000003930/article-10.xml v850>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x1000000393f:[<0x10000003930/article-10.xml v850>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.208 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.940+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039c7 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-12.jpg auth{0=1} v820 ap=1 s=10252 n(v0 rc2024-09-05T01:27:19.021817+0000 b10252 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537aaa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039c7:[<0x10000003930/picture-12.jpg v820>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039c7:[<0x10000003930/picture-12.jpg v820>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.208 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.940+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003958 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-72.jpg auth{0=1} v678 ap=1 s=63378 n(v0 rc2024-09-05T01:27:18.612821+0000 b63378 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537aab080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003958:[<0x10000003930/picture-72.jpg v678>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003958:[<0x10000003930/picture-72.jpg v678>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.208 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.940+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003948 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-4.xml auth{0=1} v840 ap=1 s=4478 n(v0 rc2024-09-05T01:27:18.541822+0000 b4478 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537aaab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003948:[<0x10000003930/article-4.xml v840>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003948:[<0x10000003930/article-4.xml v840>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.209 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.210 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.211 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.212 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.213 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.213 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.213 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.213 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.214 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.940+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003999 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-44.jpg auth{0=1} v730 ap=1 s=48356 n(v0 rc2024-09-05T01:27:18.826819+0000 b48356 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537aaa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003999:[<0x10000003930/picture-44.jpg v730>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003999:[<0x10000003930/picture-44.jpg v730>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.214 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.941+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003956 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-73.jpg auth{0=1} v724 ap=1 s=30294 n(v0 rc2024-09-05T01:27:18.607821+0000 b30294 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537aac100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003956:[<0x10000003930/picture-73.jpg v724>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003956:[<0x10000003930/picture-73.jpg v724>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.214 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.941+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039bc [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-21.jpg auth{0=1} v710 ap=1 s=21264 n(v0 rc2024-09-05T01:27:18.928818+0000 b21264 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537aac680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039bc:[<0x10000003930/picture-21.jpg v710>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039bc:[<0x10000003930/picture-21.jpg v710>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.214 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.941+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003952 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-75.jpg auth{0=1} v646 ap=1 s=10436 n(v0 rc2024-09-05T01:27:18.596821+0000 b10436 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537aacc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003952:[<0x10000003930/picture-75.jpg v646>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003952:[<0x10000003930/picture-75.jpg v646>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.214 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.941+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039af [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-30.jpg auth{0=1} v714 ap=1 s=13449 n(v0 rc2024-09-05T01:27:18.884819+0000 b13449 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537aad180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039af:[<0x10000003930/picture-30.jpg v714>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039af:[<0x10000003930/picture-30.jpg v714>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.214 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.942+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003936 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-15.xml auth{0=1} v860 ap=1 s=24875 n(v0 rc2024-09-05T01:27:18.458823+0000 b24875 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537aad700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003936:[<0x10000003930/article-15.xml v860>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003936:[<0x10000003930/article-15.xml v860>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.215 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.942+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039a5 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-36.jpg auth{0=1} v636 ap=1 s=56008 n(v0 rc2024-09-05T01:27:18.859819+0000 b56008 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537ab8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039a5:[<0x10000003930/picture-36.jpg v636>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039a5:[<0x10000003930/picture-36.jpg v636>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.215 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.942+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000399a [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-43.jpg auth{0=1} v660 ap=1 s=59795 n(v0 rc2024-09-05T01:27:18.829819+0000 b59795 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537ab8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000399a:[<0x10000003930/picture-43.jpg v660>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x1000000399a:[<0x10000003930/picture-43.jpg v660>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.215 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.942+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039bd [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-20.jpg auth{0=1} v644 ap=1 s=15813 n(v0 rc2024-09-05T01:27:18.934818+0000 b15813 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537ab8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039bd:[<0x10000003930/picture-20.jpg v644>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039bd:[<0x10000003930/picture-20.jpg v644>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.215 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.942+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039a2 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-38.jpg auth{0=1} v744 ap=1 s=41274 n(v0 rc2024-09-05T01:27:18.852819+0000 b41274 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537ab9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039a2:[<0x10000003930/picture-38.jpg v744>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039a2:[<0x10000003930/picture-38.jpg v744>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.215 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.943+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039b3 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-27.jpg auth{0=1} v726 ap=1 s=16654 n(v0 rc2024-09-05T01:27:18.899818+0000 b16654 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537ab9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039b3:[<0x10000003930/picture-27.jpg v726>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039b3:[<0x10000003930/picture-27.jpg v726>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.215 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.943+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000393c [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-12.xml auth{0=1} v854 ap=1 s=12396 n(v0 rc2024-09-05T01:27:18.496822+0000 b12396 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537ab9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000393c:[<0x10000003930/article-12.xml v854>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x1000000393c:[<0x10000003930/article-12.xml v854>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.215 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.215 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.216 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.216 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.216 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.216 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.216 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.216 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.216 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.216 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.216 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.216 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.216 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.216 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.216 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.216 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.217 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.217 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.217 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.217 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.217 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.217 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.217 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.217 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.217 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.217 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.217 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.217 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.217 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.218 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.218 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.218 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.218 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.218 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.218 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.218 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.218 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.218 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.218 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.218 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.218 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.218 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.218 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.218 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.218 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.219 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.219 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.219 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.219 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.219 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.219 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.219 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.220 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.943+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003984 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-52.jpg auth{0=1} v692 ap=1 s=34776 n(v0 rc2024-09-05T01:27:18.760820+0000 b34776 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537aba100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003984:[<0x10000003930/picture-52.jpg v692>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003984:[<0x10000003930/picture-52.jpg v692>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.220 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.943+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000394e [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-1.xml auth{0=1} v834 ap=1 s=20328 n(v0 rc2024-09-05T01:27:18.578821+0000 b20328 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537aba680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000394e:[<0x10000003930/article-1.xml v834>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x1000000394e:[<0x10000003930/article-1.xml v834>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.220 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.943+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039a9 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-34.jpg auth{0=1} v638 ap=1 s=23289 n(v0 rc2024-09-05T01:27:18.869819+0000 b23289 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537abac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039a9:[<0x10000003930/picture-34.jpg v638>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039a9:[<0x10000003930/picture-34.jpg v638>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.220 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.944+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003983 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-53.jpg auth{0=1} v656 ap=1 s=65513 n(v0 rc2024-09-05T01:27:18.744820+0000 b65513 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537abb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003983:[<0x10000003930/picture-53.jpg v656>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003983:[<0x10000003930/picture-53.jpg v656>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.220 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.944+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003965 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-67.jpg auth{0=1} v676 ap=1 s=16836 n(v0 rc2024-09-05T01:27:18.646821+0000 b16836 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537abb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003965:[<0x10000003930/picture-67.jpg v676>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003965:[<0x10000003930/picture-67.jpg v676>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.220 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.944+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039c3 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-16.jpg auth{0=1} v828 ap=1 s=29089 n(v0 rc2024-09-05T01:27:18.976818+0000 b29089 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537ac2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039c3:[<0x10000003930/picture-16.jpg v828>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039c3:[<0x10000003930/picture-16.jpg v828>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.220 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.944+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003954 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-74.jpg auth{0=1} v682 ap=1 s=63983 n(v0 rc2024-09-05T01:27:18.602821+0000 b63983 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537ac2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003954:[<0x10000003930/picture-74.jpg v682>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003954:[<0x10000003930/picture-74.jpg v682>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.220 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.945+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003932 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-17.xml auth{0=1} v864 ap=1 s=10722 n(v0 rc2024-09-05T01:27:18.447823+0000 b10722 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537ac2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003932:[<0x10000003930/article-17.xml v864>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003932:[<0x10000003930/article-17.xml v864>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.220 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.945+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003950 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-76.jpg auth{0=1} v698 ap=1 s=35780 n(v0 rc2024-09-05T01:27:18.588821+0000 b35780 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537ac3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003950:[<0x10000003930/picture-76.jpg v698>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003950:[<0x10000003930/picture-76.jpg v698>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.220 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.945+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000039ac [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-32.jpg auth{0=1} v706 ap=1 s=56669 n(v0 rc2024-09-05T01:27:18.877819+0000 b56669 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537ac3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000039ac:[<0x10000003930/picture-32.jpg v706>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x100000039ac:[<0x10000003930/picture-32.jpg v706>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.220 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:27.945+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003991 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-48.jpg auth{0=1} v736 ap=1 s=36195 n(v0 rc2024-09-05T01:27:18.799819+0000 b36195 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c537ac3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003991:[<0x10000003930/picture-48.jpg v736>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2881>,<0x10000000201/src v2541>,<0x10000000006/blogbench-1.0 v2130>,<0x10000000005/tmp v717>,<0x100000001fb/client.0 v727>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v699>,<0x10000000001/sv_1 v738>,<0x10000000000/qa v695>,<0x1/volumes v709>]//[]","memoryvalue":"(3)0x10000003991:[<0x10000003930/picture-48.jpg v736>,<0x10000000399/blog-115 v214669>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.222 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.223 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.223 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.223 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.223 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.223 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.223 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.223 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.223 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.223 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.223 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.223 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.223 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.224 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.225 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.225 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.225 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.225 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.225 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.225 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.225 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.225 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.225 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.225 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.225 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.225 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.225 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.226 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.226 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.226 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.226 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.226 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.226 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.226 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.226 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.226 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.226 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.226 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.226 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.226 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.226 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.227 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.227 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.227 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.227 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.227 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.227 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.227 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.227 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.227 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.227 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.227 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.227 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.227 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.227 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.228 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.228 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.228 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.228 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.228 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.228 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.228 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.228 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.228 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.228 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.228 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.228 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.229 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.229 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.229 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.229 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.229 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.229 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.229 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.229 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.229 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.229 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.229 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.229 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.229 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.229 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.230 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.230 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.230 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.230 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.230 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.230 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.230 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.230 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.230 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.230 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.230 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.230 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.230 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.231 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.231 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.231 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.231 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.231 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.231 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.231 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.231 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.231 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.231 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.231 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.231 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.232 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.232 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.232 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.232 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.232 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.232 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.232 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.232 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.232 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.232 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.232 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.232 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.233 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.233 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.233 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.233 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.233 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.233 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.233 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.233 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.233 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.233 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.233 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.233 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.233 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.233 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.234 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.234 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.234 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.234 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.234 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.234 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.234 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.234 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.234 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.234 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.234 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.234 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.234 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.235 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.235 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.235 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.235 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.235 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.235 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.235 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.235 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.235 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.235 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.235 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.235 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.235 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.236 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.236 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.236 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.236 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.236 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.236 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.236 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.236 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.236 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.236 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.236 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.236 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.236 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.236 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.237 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.237 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.237 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.237 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.237 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.237 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.237 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.237 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.237 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.237 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.237 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.237 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.237 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.238 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.238 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.238 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.238 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.238 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.238 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.238 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.238 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.238 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.238 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.238 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.238 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.238 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.238 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.239 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.239 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.239 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.239 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.239 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.239 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.239 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.239 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.239 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.239 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.239 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.239 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.239 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.239 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.239 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.239 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.240 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.240 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.240 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.240 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.240 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.240 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.240 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.240 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.240 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.240 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.240 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.240 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.240 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.240 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.241 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.241 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.241 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.241 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.241 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.241 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.241 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.241 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.241 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.241 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.241 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.241 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.241 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.241 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.241 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.242 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.242 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.242 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.242 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.242 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.242 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.242 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.242 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.242 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.242 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.242 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.242 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.242 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.242 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.242 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.243 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.243 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.243 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.243 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.243 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.243 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.243 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.243 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.243 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.243 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.243 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.243 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.243 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.243 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.243 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.243 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.244 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.244 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.244 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.244 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.244 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.244 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.244 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.244 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.244 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.244 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.244 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.244 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.244 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.244 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.244 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.245 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.245 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.245 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.245 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.245 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.245 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.245 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.245 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.245 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.245 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.245 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.245 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.245 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.246 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.246 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.246 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.246 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044fa (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.246 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044f9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.246 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044e9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.246 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004508 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.246 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000450a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.246 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.246 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.246 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044fe (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.246 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044cf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-61.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.246 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004505 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.246 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.247 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.247 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004503 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.247 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044cc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-64.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.247 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004502 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.247 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000450b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.247 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044c3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-9.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.247 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004506 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.247 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044e7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.247 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044f0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.247 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044fb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.247 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044c9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-3.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.247 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044f4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.247 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044eb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.247 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044d3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.248 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.248 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.248 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044c5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-7.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.248 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044e2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.248 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044f3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.248 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044e5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.248 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.248 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.248 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044c4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-8.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.248 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.248 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.248 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004504 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.248 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044db (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.249 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044f2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.249 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.249 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.249 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044c6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-6.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.249 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044d6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.249 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044ca (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-2.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.249 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044ef (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.249 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.249 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.249 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004507 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.249 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.249 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.250 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044da (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.250 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044d2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.250 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044d9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.250 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044ce (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-62.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.250 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044de (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.250 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004509 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.250 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044d5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.250 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.250 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.250 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004501 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.250 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044c7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-5.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.250 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.250 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.251 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044cd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-63.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.251 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044e4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.251 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044f5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.251 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044df (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.251 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.251 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.251 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044d0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.251 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.251 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.251 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044f6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.251 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044c1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-11.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.251 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.251 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.251 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044fd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044d4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044dd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044c2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-10.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004500 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044e0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044d1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044c8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-4.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044f7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.252 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044e8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044ee (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044e1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044f8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044e6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044c0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-12.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044f1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044d8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044cb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.253 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044ea (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044d7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044fc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044ec (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000044dc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004306 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004301 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000430f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.254 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004300 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004311 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004305 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000430a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004309 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004312 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000430d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000042f7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.255 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004302 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000042f4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/article-3.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000042fa (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000430b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000042f9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000042f5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/article-2.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000430e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.256 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004310 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004308 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000042fc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000042fd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004304 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004307 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.257 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000042fe (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000042ff (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000042f8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000042f6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004303 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.258 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.259 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.259 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.259 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.259 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.259 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.259 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.259 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.259 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.259 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.259 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.259 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.259 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.259 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.259 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.260 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.260 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.260 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.260 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.260 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.260 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.260 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.260 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.260 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.260 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.260 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.260 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.260 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.260 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.261 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.261 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.261 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.261 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.261 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.261 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.261 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.261 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.261 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.261 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.261 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.261 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.262 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.262 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.262 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.262 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.262 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.262 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.262 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.262 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.262 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.262 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.262 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.262 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.262 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.262 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.263 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.263 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.263 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.263 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.263 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.263 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.263 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.263 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.263 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.263 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.264 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.264 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.264 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.264 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.264 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.264 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.264 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.264 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.264 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.264 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.264 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.264 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.264 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.265 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.265 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.265 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.265 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.265 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.265 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.265 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.265 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.265 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.265 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.265 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.265 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.265 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.265 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.266 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.266 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.266 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.266 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.266 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.266 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.266 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.266 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.266 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.266 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.266 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.266 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.266 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.267 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.267 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.267 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.267 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.267 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.267 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.267 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.267 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.267 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.267 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.267 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.267 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.267 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.268 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.268 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.268 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.268 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.268 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.268 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.268 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.268 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.268 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:28.492 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.493 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.493 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.493 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.493 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.493 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.493 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.493 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.493 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.493 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.493 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.493 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.493 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.494 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.494 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.494 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.494 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.494 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.494 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.494 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.494 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.494 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.494 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.494 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.494 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.494 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.494 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.495 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.495 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.495 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.495 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.495 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.495 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.495 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.495 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.495 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.495 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.495 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.495 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.495 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.495 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.496 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.496 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.496 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.496 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.496 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.496 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.496 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.496 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.496 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.496 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.496 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.497 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.497 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.497 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.497 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.498 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.498 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.498 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.498 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.498 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.498 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.498 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.498 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.498 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.498 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.498 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.498 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.498 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.498 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.499 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.499 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.499 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.499 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.499 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.499 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.499 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.499 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.499 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.499 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.499 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.499 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.499 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.500 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.500 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.500 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.500 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.500 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.500 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.500 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.500 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.500 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.500 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.500 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.500 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.500 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.501 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.501 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.501 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.501 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.501 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.501 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.501 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.501 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.501 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.501 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.501 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.501 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.501 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.501 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.502 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.502 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.502 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.502 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.502 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.502 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.502 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.502 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.502 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.502 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.502 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.502 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.502 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.502 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.503 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.503 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.503 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.503 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.503 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.503 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.503 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.503 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.503 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.503 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.503 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.503 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.503 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.504 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.504 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.504 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.504 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.504 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.504 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.504 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.504 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.504 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.504 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.504 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.504 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.504 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.504 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.505 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.506 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.507 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.508 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.509 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.510 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.511 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.512 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.513 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.514 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.516 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.517 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.518 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.519 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.520 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.522 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.523 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.524 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.525 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.526 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.528 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.529 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.530 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.531 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.532 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.533 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.534 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.536 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.537 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.538 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.539 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.540 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.541 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.542 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.543 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.544 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.545 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044fa (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044f9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044e9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004508 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000450a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.546 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044fe (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044cf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-61.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004505 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004503 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044cc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-64.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004502 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000450b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044c3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-9.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004506 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044e7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044f0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.547 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044fb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044c9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-3.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044f4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044eb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044d3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044c5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-7.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044e2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044f3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044e5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.548 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044c4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-8.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004504 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044db (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044f2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044c6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-6.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044d6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044ca (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-2.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044ef (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.549 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004507 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044da (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044d2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044d9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044ce (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-62.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044de (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004509 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044d5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004501 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044c7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-5.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.550 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044cd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-63.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044e4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044f5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044df (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044d0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044f6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044c1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-11.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.551 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.552 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044fd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.552 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044d4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.552 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.552 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.552 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044dd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.552 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044c2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-10.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.552 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004500 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.552 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044e0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.552 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.552 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044d1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044c8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-4.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044f7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044e8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044ee (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044e1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044f8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044e6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044c0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-12.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044f1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.553 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.554 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044d8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.554 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044cb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.554 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044ea (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.554 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.554 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.554 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044d7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.554 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044fc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.554 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.554 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.554 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044ec (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.554 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000044dc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.554 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004306 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.554 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004301 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.554 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.555 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.555 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000430f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.555 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004300 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.555 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004311 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.555 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.555 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.555 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004305 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.555 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.555 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.555 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000430a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.555 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004309 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.555 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004312 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.555 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000430d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.555 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000042f7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004302 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000042f4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/article-3.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000042fa (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000430b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000042f9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.556 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000042f5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/article-2.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000430e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004310 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004308 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000042fc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000042fd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004304 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.557 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.558 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.558 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004307 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.558 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.558 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.558 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000042fe (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.558 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000042ff (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.558 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000042f8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.558 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000042f6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.558 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.558 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.558 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004303 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.558 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.558 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.558 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.558 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.559 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.559 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.559 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.559 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.559 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.559 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.559 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.559 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.559 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.559 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.559 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.559 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.559 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.559 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.559 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.560 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.560 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.560 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.560 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.560 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.560 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.560 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.560 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.560 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.560 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.560 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.560 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.560 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.560 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.560 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.561 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:28 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:28.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.607 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.608 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.609 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.610 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.611 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.612 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.615 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.616 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.617 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.618 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.619 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.620 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.621 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.624 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.625 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.627 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.628 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.631 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.631 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.631 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.631 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.631 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.631 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.631 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.631 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.631 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.631 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.631 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.631 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.631 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.633 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.635 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.635 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044fa (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044f9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044e9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004508 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000450a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044fe (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044cf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-61.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004505 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004503 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044cc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-64.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004502 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000450b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044c3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-9.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004506 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044e7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044f0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044fb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044c9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-3.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044f4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044eb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044d3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044c5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-7.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044e2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044f3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044e5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044c4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-8.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004504 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044db (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044f2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044c6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-6.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044d6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044ca (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-2.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044ef (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004507 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044da (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044d2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044d9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044ce (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-62.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044de (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004509 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044d5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004501 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044c7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-5.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044cd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-63.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044e4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044f5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044df (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044d0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044f6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044c1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-11.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044fd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044d4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044dd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044c2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-10.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004500 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044e0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044d1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044c8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-4.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044f7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044e8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044ee (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044e1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044f8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044e6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044c0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-12.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044f1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044d8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044cb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044ea (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044d7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044fc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044ec (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000044dc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004306 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004301 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000430f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004300 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004311 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004305 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000430a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004309 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004312 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000430d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000042f7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004302 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000042f4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/article-3.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000042fa (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000430b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000042f9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000042f5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/article-2.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000430e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004310 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004308 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000042fc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000042fd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004304 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004307 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000042fe (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000042ff (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000042f8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000042f6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.669 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004303 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:28.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.670 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.671 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.672 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.673 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.674 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.675 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.676 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.678 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.679 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.679 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.679 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.679 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:28.679 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:28 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:28.922 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.653+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c77 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-13.jpg auth{0=1} v712 ap=1 s=41124 n(v0 rc2024-09-05T01:27:32.009698+0000 b41124 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538085180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c77:[<0x10000003c0c/picture-13.jpg v712>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c77:[<0x10000003c0c/picture-13.jpg v712>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.922 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.654+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c72 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-18.jpg auth{0=1} v716 ap=1 s=58397 n(v0 rc2024-09-05T01:27:31.977698+0000 b58397 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538085700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c72:[<0x10000003c0c/picture-18.jpg v716>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c72:[<0x10000003c0c/picture-18.jpg v716>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.922 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.654+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c29 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-18.xml auth{0=1} v722 ap=1 s=2731 n(v0 rc2024-09-05T01:27:31.600701+0000 b2731 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53808c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c29:[<0x10000003c0c/article-18.xml v722>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c29:[<0x10000003c0c/article-18.xml v722>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.923 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.654+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c71 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-19.jpg auth{0=1} v718 ap=1 s=20698 n(v0 rc2024-09-05T01:27:31.972698+0000 b20698 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53808c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c71:[<0x10000003c0c/picture-19.jpg v718>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c71:[<0x10000003c0c/picture-19.jpg v718>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.923 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.654+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c20 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-27.xml auth{0=1} v726 ap=1 s=30276 n(v0 rc2024-09-05T01:27:31.581701+0000 b30276 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53808cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c20:[<0x10000003c0c/article-27.xml v726>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c20:[<0x10000003c0c/article-27.xml v726>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.923 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.655+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c80 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-4.jpg auth{0=1} v706 ap=1 s=61188 n(v0 rc2024-09-05T01:27:32.064697+0000 b61188 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53808d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c80:[<0x10000003c0c/picture-4.jpg v706>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c80:[<0x10000003c0c/picture-4.jpg v706>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.923 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.655+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c61 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-35.jpg auth{0=1} v720 ap=1 s=13412 n(v0 rc2024-09-05T01:27:31.872699+0000 b13412 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53808d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c61:[<0x10000003c0c/picture-35.jpg v720>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c61:[<0x10000003c0c/picture-35.jpg v720>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.923 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.655+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c82 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-2.jpg auth{0=1} v704 ap=1 s=8297 n(v0 rc2024-09-05T01:27:32.070697+0000 b8297 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53808db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c82:[<0x10000003c0c/picture-2.jpg v704>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c82:[<0x10000003c0c/picture-2.jpg v704>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.923 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.655+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c27 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-20.xml auth{0=1} v724 ap=1 s=21596 n(v0 rc2024-09-05T01:27:31.596701+0000 b21596 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53808e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c27:[<0x10000003c0c/article-20.xml v724>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c27:[<0x10000003c0c/article-20.xml v724>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.924 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.655+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c76 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-14.jpg auth{0=1} v714 ap=1 s=8788 n(v0 rc2024-09-05T01:27:32.003698+0000 b8788 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53808e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c76:[<0x10000003c0c/picture-14.jpg v714>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c76:[<0x10000003c0c/picture-14.jpg v714>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.924 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.656+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c47 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-61.jpg auth{0=1} v676 ap=1 s=40075 n(v0 rc2024-09-05T01:27:31.739700+0000 b40075 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53808f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c47:[<0x10000003c0c/picture-61.jpg v676>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c47:[<0x10000003c0c/picture-61.jpg v676>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.924 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.656+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c7d [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-7.jpg auth{0=1} v708 ap=1 s=45857 n(v0 rc2024-09-05T01:27:32.053697+0000 b45857 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53808f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c7d:[<0x10000003c0c/picture-7.jpg v708>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c7d:[<0x10000003c0c/picture-7.jpg v708>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.924 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.656+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c12 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-31.xml auth{0=1} v728 ap=1 s=3610 n(v0 rc2024-09-05T01:27:31.530702+0000 b3610 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538096000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c12:[<0x10000003c0c/article-31.xml v728>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c12:[<0x10000003c0c/article-31.xml v728>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.924 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.656+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c7b [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-9.jpg auth{0=1} v710 ap=1 s=11954 n(v0 rc2024-09-05T01:27:32.049697+0000 b11954 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538096580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c7b:[<0x10000003c0c/picture-9.jpg v710>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c7b:[<0x10000003c0c/picture-9.jpg v710>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.925 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.657+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c44 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-64.jpg auth{0=1} v676 ap=1 s=52105 n(v0 rc2024-09-05T01:27:31.700700+0000 b52105 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538096b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c44:[<0x10000003c0c/picture-64.jpg v676>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c44:[<0x10000003c0c/picture-64.jpg v676>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.925 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.657+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c7a [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-10.jpg auth{0=1} v711 ap=1 s=56257 n(v0 rc2024-09-05T01:27:32.021697+0000 b56257 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538097080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c7a:[<0x10000003c0c/picture-10.jpg v711>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c7a:[<0x10000003c0c/picture-10.jpg v711>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.925 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.657+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c83 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-1.jpg auth{0=1} v707 ap=1 s=57741 n(v0 rc2024-09-05T01:27:32.080697+0000 b57741 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538097600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c83:[<0x10000003c0c/picture-1.jpg v707>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c83:[<0x10000003c0c/picture-1.jpg v707>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.925 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.657+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c32 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-9.xml auth{0=1} v723 ap=1 s=17715 n(v0 rc2024-09-05T01:27:31.624701+0000 b17715 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538097b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c32:[<0x10000003c0c/article-9.xml v723>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c32:[<0x10000003c0c/article-9.xml v723>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.925 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.657+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c7e [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-6.jpg auth{0=1} v709 ap=1 s=40576 n(v0 rc2024-09-05T01:27:32.057697+0000 b40576 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538098100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c7e:[<0x10000003c0c/picture-6.jpg v709>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c7e:[<0x10000003c0c/picture-6.jpg v709>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.925 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.658+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c23 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-24.xml auth{0=1} v725 ap=1 s=19805 n(v0 rc2024-09-05T01:27:31.587701+0000 b19805 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538099180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c23:[<0x10000003c0c/article-24.xml v725>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c23:[<0x10000003c0c/article-24.xml v725>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.925 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.658+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c68 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-28.jpg auth{0=1} v715 ap=1 s=28637 n(v0 rc2024-09-05T01:27:31.914698+0000 b28637 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538099700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c68:[<0x10000003c0c/picture-28.jpg v715>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c68:[<0x10000003c0c/picture-28.jpg v715>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.925 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.658+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c5f [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-37.jpg auth{0=1} v682 ap=1 s=9078 n(v0 rc2024-09-05T01:27:31.864699+0000 b9078 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380a4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c5f:[<0x10000003c0c/picture-37.jpg v682>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c5f:[<0x10000003c0c/picture-37.jpg v682>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.925 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.659+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c38 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-3.xml auth{0=1} v719 ap=1 s=27066 n(v0 rc2024-09-05T01:27:31.650701+0000 b27066 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380a5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c38:[<0x10000003c0c/article-3.xml v719>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c38:[<0x10000003c0c/article-3.xml v719>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.925 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.659+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c6c [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-24.jpg auth{0=1} v713 ap=1 s=59493 n(v0 rc2024-09-05T01:27:31.943698+0000 b59493 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380a5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c6c:[<0x10000003c0c/picture-24.jpg v713>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c6c:[<0x10000003c0c/picture-24.jpg v713>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.925 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.659+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c63 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-33.jpg auth{0=1} v717 ap=1 s=37947 n(v0 rc2024-09-05T01:27:31.879699+0000 b37947 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380a6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c63:[<0x10000003c0c/picture-33.jpg v717>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c63:[<0x10000003c0c/picture-33.jpg v717>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.926 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.659+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c4b [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-57.jpg auth{0=1} v674 ap=1 s=10888 n(v0 rc2024-09-05T01:27:31.777700+0000 b10888 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380a6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c4b:[<0x10000003c0c/picture-57.jpg v674>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c4b:[<0x10000003c0c/picture-57.jpg v674>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.926 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.660+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c34 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-7.xml auth{0=1} v721 ap=1 s=20225 n(v0 rc2024-09-05T01:27:31.637701+0000 b20225 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380a6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c34:[<0x10000003c0c/article-7.xml v721>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c34:[<0x10000003c0c/article-7.xml v721>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.926 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.660+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c5a [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-42.jpg auth{0=1} v672 ap=1 s=20954 n(v0 rc2024-09-05T01:27:31.849699+0000 b20954 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380a7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c5a:[<0x10000003c0c/picture-42.jpg v672>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c5a:[<0x10000003c0c/picture-42.jpg v672>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.926 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.660+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c40 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-68.jpg auth{0=1} v678 ap=1 s=14388 n(v0 rc2024-09-05T01:27:31.681701+0000 b14388 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380a7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c40:[<0x10000003c0c/picture-68.jpg v678>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c40:[<0x10000003c0c/picture-68.jpg v678>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.926 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.660+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c5d [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-39.jpg auth{0=1} v680 ap=1 s=45411 n(v0 rc2024-09-05T01:27:31.856699+0000 b45411 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380b2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c5d:[<0x10000003c0c/picture-39.jpg v680>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c5d:[<0x10000003c0c/picture-39.jpg v680>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.926 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.661+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c6b [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-25.jpg auth{0=1} v684 ap=1 s=39726 n(v0 rc2024-09-05T01:27:31.937698+0000 b39726 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380b2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c6b:[<0x10000003c0c/picture-25.jpg v684>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c6b:[<0x10000003c0c/picture-25.jpg v684>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.929 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.661+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c33 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-8.xml auth{0=1} v696 ap=1 s=17347 n(v0 rc2024-09-05T01:27:31.628701+0000 b17347 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380b2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c33:[<0x10000003c0c/article-8.xml v696>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c33:[<0x10000003c0c/article-8.xml v696>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.929 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.661+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c65 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-31.jpg auth{0=1} v690 ap=1 s=22087 n(v0 rc2024-09-05T01:27:31.898699+0000 b22087 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380b3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c65:[<0x10000003c0c/picture-31.jpg v690>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c65:[<0x10000003c0c/picture-31.jpg v690>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.929 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.661+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c53 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-49.jpg auth{0=1} v674 ap=1 s=26806 n(v0 rc2024-09-05T01:27:31.802699+0000 b26806 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380b3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c53:[<0x10000003c0c/picture-49.jpg v674>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c53:[<0x10000003c0c/picture-49.jpg v674>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.929 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.661+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c6a [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-26.jpg auth{0=1} v686 ap=1 s=65473 n(v0 rc2024-09-05T01:27:31.926698+0000 b65473 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380b4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c6a:[<0x10000003c0c/picture-26.jpg v686>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c6a:[<0x10000003c0c/picture-26.jpg v686>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.929 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.661+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c7c [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-8.jpg auth{0=1} v682 ap=1 s=51371 n(v0 rc2024-09-05T01:27:32.051697+0000 b51371 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380b3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c7c:[<0x10000003c0c/picture-8.jpg v682>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c7c:[<0x10000003c0c/picture-8.jpg v682>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.929 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.662+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c11 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-32.xml auth{0=1} v704 ap=1 s=5786 n(v0 rc2024-09-05T01:27:31.527702+0000 b5786 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380b4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c11:[<0x10000003c0c/article-32.xml v704>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c11:[<0x10000003c0c/article-32.xml v704>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.929 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.662+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c26 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-21.xml auth{0=1} v700 ap=1 s=27837 n(v0 rc2024-09-05T01:27:31.594701+0000 b27837 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380b4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c26:[<0x10000003c0c/article-21.xml v700>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c26:[<0x10000003c0c/article-21.xml v700>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.929 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.662+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c1d [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-30.xml auth{0=1} v702 ap=1 s=21988 n(v0 rc2024-09-05T01:27:31.568702+0000 b21988 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380b5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c1d:[<0x10000003c0c/article-30.xml v702>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c1d:[<0x10000003c0c/article-30.xml v702>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.930 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.662+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c2e [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-13.xml auth{0=1} v698 ap=1 s=12838 n(v0 rc2024-09-05T01:27:31.611701+0000 b12838 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380b5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c2e:[<0x10000003c0c/article-13.xml v698>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c2e:[<0x10000003c0c/article-13.xml v698>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.930 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.662+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c35 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-6.xml auth{0=1} v694 ap=1 s=31635 n(v0 rc2024-09-05T01:27:31.640701+0000 b31635 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380be000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c35:[<0x10000003c0c/article-6.xml v694>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c35:[<0x10000003c0c/article-6.xml v694>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.930 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.663+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c39 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-2.xml auth{0=1} v692 ap=1 s=21547 n(v0 rc2024-09-05T01:27:31.653701+0000 b21547 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380be580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c39:[<0x10000003c0c/article-2.xml v692>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c39:[<0x10000003c0c/article-2.xml v692>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.930 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.663+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c4e [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-54.jpg auth{0=1} v676 ap=1 s=33489 n(v0 rc2024-09-05T01:27:31.785700+0000 b33489 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380beb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c4e:[<0x10000003c0c/picture-54.jpg v676>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c4e:[<0x10000003c0c/picture-54.jpg v676>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.930 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.663+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c67 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-29.jpg auth{0=1} v688 ap=1 s=52667 n(v0 rc2024-09-05T01:27:31.907698+0000 b52667 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380bf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c67:[<0x10000003c0c/picture-29.jpg v688>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c67:[<0x10000003c0c/picture-29.jpg v688>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.930 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.663+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c10 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-33.xml auth{0=1} v681 ap=1 s=26067 n(v0 rc2024-09-05T01:27:31.523702+0000 b26067 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380bfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c10:[<0x10000003c0c/article-33.xml v681>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c10:[<0x10000003c0c/article-33.xml v681>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.930 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.664+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c7f [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-5.jpg auth{0=1} v677 ap=1 s=26516 n(v0 rc2024-09-05T01:27:32.062697+0000 b26516 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380c0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c7f:[<0x10000003c0c/picture-5.jpg v677>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c7f:[<0x10000003c0c/picture-5.jpg v677>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.930 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.664+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c52 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-50.jpg auth{0=1} v668 ap=1 s=38194 n(v0 rc2024-09-05T01:27:31.800699+0000 b38194 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380c0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c52:[<0x10000003c0c/picture-50.jpg v668>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c52:[<0x10000003c0c/picture-50.jpg v668>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.930 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.664+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c4a [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-58.jpg auth{0=1} v652 ap=1 s=47767 n(v0 rc2024-09-05T01:27:31.774700+0000 b47767 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380c0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c4a:[<0x10000003c0c/picture-58.jpg v652>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c4a:[<0x10000003c0c/picture-58.jpg v652>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.930 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.664+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c43 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-65.jpg auth{0=1} v660 ap=1 s=45222 n(v0 rc2024-09-05T01:27:31.693700+0000 b45222 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380c1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c43:[<0x10000003c0c/picture-65.jpg v660>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c43:[<0x10000003c0c/picture-65.jpg v660>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.930 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.664+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c1f [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-28.xml auth{0=1} v679 ap=1 s=13482 n(v0 rc2024-09-05T01:27:31.578702+0000 b13482 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380c1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c1f:[<0x10000003c0c/article-28.xml v679>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c1f:[<0x10000003c0c/article-28.xml v679>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.930 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.664+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c3f [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-69.jpg auth{0=1} v658 ap=1 s=42244 n(v0 rc2024-09-05T01:27:31.677701+0000 b42244 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380ca000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c3f:[<0x10000003c0c/picture-69.jpg v658>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c3f:[<0x10000003c0c/picture-69.jpg v658>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.931 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.665+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c51 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-51.jpg auth{0=1} v664 ap=1 s=63111 n(v0 rc2024-09-05T01:27:31.798699+0000 b63111 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380ca580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c51:[<0x10000003c0c/picture-51.jpg v664>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c51:[<0x10000003c0c/picture-51.jpg v664>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.931 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.665+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c46 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-62.jpg auth{0=1} v662 ap=1 s=21691 n(v0 rc2024-09-05T01:27:31.718700+0000 b21691 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380cab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c46:[<0x10000003c0c/picture-62.jpg v662>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c46:[<0x10000003c0c/picture-62.jpg v662>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.931 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.665+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c4d [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-55.jpg auth{0=1} v668 ap=1 s=24852 n(v0 rc2024-09-05T01:27:31.782700+0000 b24852 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380cbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c4d:[<0x10000003c0c/picture-55.jpg v668>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c4d:[<0x10000003c0c/picture-55.jpg v668>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.931 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.665+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c81 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-3.jpg auth{0=1} v684 ap=1 s=43217 n(v0 rc2024-09-05T01:27:32.067697+0000 b43217 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380cb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c81:[<0x10000003c0c/picture-3.jpg v684>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c81:[<0x10000003c0c/picture-3.jpg v684>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.931 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.665+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c56 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-46.jpg auth{0=1} v666 ap=1 s=46800 n(v0 rc2024-09-05T01:27:31.812699+0000 b46800 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380cb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c56:[<0x10000003c0c/picture-46.jpg v666>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c56:[<0x10000003c0c/picture-46.jpg v666>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.931 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.666+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c79 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-11.jpg auth{0=1} v686 ap=1 s=63951 n(v0 rc2024-09-05T01:27:32.016697+0000 b63951 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380cc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c79:[<0x10000003c0c/picture-11.jpg v686>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c79:[<0x10000003c0c/picture-11.jpg v686>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.931 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.666+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c3e [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-70.jpg auth{0=1} v670 ap=1 s=32873 n(v0 rc2024-09-05T01:27:31.674701+0000 b32873 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380cc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c3e:[<0x10000003c0c/picture-70.jpg v670>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c3e:[<0x10000003c0c/picture-70.jpg v670>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.931 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.666+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c36 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-5.xml auth{0=1} v688 ap=1 s=26887 n(v0 rc2024-09-05T01:27:31.643701+0000 b26887 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380ccc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c36:[<0x10000003c0c/article-5.xml v688>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c36:[<0x10000003c0c/article-5.xml v688>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.931 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.666+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c0e [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-34.xml auth{0=1} v694 ap=1 s=30986 n(v0 rc2024-09-05T01:27:31.520702+0000 b30986 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380cd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c0e:[<0x10000003c0c/article-34.xml v694>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c0e:[<0x10000003c0c/article-34.xml v694>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.931 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.666+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c3d [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-71.jpg auth{0=1} v662 ap=1 s=54151 n(v0 rc2024-09-05T01:27:31.670701+0000 b54151 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380cd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c3d:[<0x10000003c0c/picture-71.jpg v662>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c3d:[<0x10000003c0c/picture-71.jpg v662>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.931 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.667+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c1e [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-29.xml auth{0=1} v692 ap=1 s=31059 n(v0 rc2024-09-05T01:27:31.576702+0000 b31059 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380d4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c1e:[<0x10000003c0c/article-29.xml v692>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c1e:[<0x10000003c0c/article-29.xml v692>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.931 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.667+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c45 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-63.jpg auth{0=1} v666 ap=1 s=59801 n(v0 rc2024-09-05T01:27:31.704700+0000 b59801 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380d4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c45:[<0x10000003c0c/picture-63.jpg v666>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c45:[<0x10000003c0c/picture-63.jpg v666>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.931 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.667+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c25 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-22.xml auth{0=1} v690 ap=1 s=25982 n(v0 rc2024-09-05T01:27:31.591701+0000 b25982 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380d5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c25:[<0x10000003c0c/article-22.xml v690>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c25:[<0x10000003c0c/article-22.xml v690>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.932 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.667+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c2d [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-14.xml auth{0=1} v717 ap=1 s=25111 n(v0 rc2024-09-05T01:27:31.609701+0000 b25111 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380d6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c2d:[<0x10000003c0c/article-14.xml v717>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c2d:[<0x10000003c0c/article-14.xml v717>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.932 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.668+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c57 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-45.jpg auth{0=1} v668 ap=1 s=46777 n(v0 rc2024-09-05T01:27:31.814699+0000 b46777 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380d6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c57:[<0x10000003c0c/picture-45.jpg v668>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c57:[<0x10000003c0c/picture-45.jpg v668>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.932 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.668+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c6d [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-23.jpg auth{0=1} v709 ap=1 s=58013 n(v0 rc2024-09-05T01:27:31.949698+0000 b58013 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380d5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c6d:[<0x10000003c0c/picture-23.jpg v709>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c6d:[<0x10000003c0c/picture-23.jpg v709>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.932 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.668+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c5b [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-41.jpg auth{0=1} v666 ap=1 s=35180 n(v0 rc2024-09-05T01:27:31.851699+0000 b35180 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380d6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c5b:[<0x10000003c0c/picture-41.jpg v666>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c5b:[<0x10000003c0c/picture-41.jpg v666>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.932 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.668+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c48 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-60.jpg auth{0=1} v682 ap=1 s=51043 n(v0 rc2024-09-05T01:27:31.751700+0000 b51043 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380d7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c48:[<0x10000003c0c/picture-60.jpg v682>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c48:[<0x10000003c0c/picture-60.jpg v682>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.932 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.669+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c42 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-66.jpg auth{0=1} v680 ap=1 s=58005 n(v0 rc2024-09-05T01:27:31.690700+0000 b58005 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380d7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c42:[<0x10000003c0c/picture-66.jpg v680>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c42:[<0x10000003c0c/picture-66.jpg v680>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.932 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.669+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c2b [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-16.xml auth{0=1} v719 ap=1 s=26386 n(v0 rc2024-09-05T01:27:31.605701+0000 b26386 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380e3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c2b:[<0x10000003c0c/article-16.xml v719>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c2b:[<0x10000003c0c/article-16.xml v719>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.932 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.669+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c30 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-11.xml auth{0=1} v715 ap=1 s=26617 n(v0 rc2024-09-05T01:27:31.617701+0000 b26617 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380e2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c30:[<0x10000003c0c/article-11.xml v715>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c30:[<0x10000003c0c/article-11.xml v715>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.932 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.669+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c75 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-15.jpg auth{0=1} v707 ap=1 s=35096 n(v0 rc2024-09-05T01:27:31.996698+0000 b35096 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380e3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c75:[<0x10000003c0c/picture-15.jpg v707>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c75:[<0x10000003c0c/picture-15.jpg v707>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.932 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.670+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c21 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-26.xml auth{0=1} v723 ap=1 s=24410 n(v0 rc2024-09-05T01:27:31.583701+0000 b24410 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380e3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c21:[<0x10000003c0c/article-26.xml v723>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c21:[<0x10000003c0c/article-26.xml v723>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.932 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.670+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c4c [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-56.jpg auth{0=1} v678 ap=1 s=45093 n(v0 rc2024-09-05T01:27:31.779700+0000 b45093 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380e4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c4c:[<0x10000003c0c/picture-56.jpg v678>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c4c:[<0x10000003c0c/picture-56.jpg v678>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.932 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.670+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c58 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-44.jpg auth{0=1} v684 ap=1 s=9130 n(v0 rc2024-09-05T01:27:31.817699+0000 b9130 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380e5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c58:[<0x10000003c0c/picture-44.jpg v684>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c58:[<0x10000003c0c/picture-44.jpg v684>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.932 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.670+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c55 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-47.jpg auth{0=1} v688 ap=1 s=46368 n(v0 rc2024-09-05T01:27:31.810699+0000 b46368 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380e4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c55:[<0x10000003c0c/picture-47.jpg v688>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c55:[<0x10000003c0c/picture-47.jpg v688>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.933 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.671+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c31 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-10.xml auth{0=1} v713 ap=1 s=9824 n(v0 rc2024-09-05T01:27:31.621701+0000 b9824 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380e4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c31:[<0x10000003c0c/article-10.xml v713>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c31:[<0x10000003c0c/article-10.xml v713>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.933 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.671+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c37 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-4.xml auth{0=1} v711 ap=1 s=32303 n(v0 rc2024-09-05T01:27:31.646701+0000 b32303 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380ee000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c37:[<0x10000003c0c/article-4.xml v711>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c37:[<0x10000003c0c/article-4.xml v711>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.933 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.671+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c78 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-12.jpg auth{0=1} v705 ap=1 s=63385 n(v0 rc2024-09-05T01:27:32.012698+0000 b63385 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380e5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c78:[<0x10000003c0c/picture-12.jpg v705>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c78:[<0x10000003c0c/picture-12.jpg v705>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.933 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.671+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c22 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-25.xml auth{0=1} v721 ap=1 s=6240 n(v0 rc2024-09-05T01:27:31.585701+0000 b6240 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380ee580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c22:[<0x10000003c0c/article-25.xml v721>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c22:[<0x10000003c0c/article-25.xml v721>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.933 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.672+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c3c [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-72.jpg auth{0=1} v662 ap=1 s=34638 n(v0 rc2024-09-05T01:27:31.664701+0000 b34638 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380eeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c3c:[<0x10000003c0c/picture-72.jpg v662>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c3c:[<0x10000003c0c/picture-72.jpg v662>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.933 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.672+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c49 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-59.jpg auth{0=1} v686 ap=1 s=46817 n(v0 rc2024-09-05T01:27:31.772700+0000 b46817 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380ef080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c49:[<0x10000003c0c/picture-59.jpg v686>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c49:[<0x10000003c0c/picture-59.jpg v686>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.933 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.672+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c3b [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-73.jpg auth{0=1} v650 ap=1 s=52254 n(v0 rc2024-09-05T01:27:31.661701+0000 b52254 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380efb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c3b:[<0x10000003c0c/picture-73.jpg v650>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c3b:[<0x10000003c0c/picture-73.jpg v650>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.933 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.672+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c0d [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-35.xml auth{0=1} v719 ap=1 s=6148 n(v0 rc2024-09-05T01:27:31.516702+0000 b6148 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380f0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c0d:[<0x10000003c0c/article-35.xml v719>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c0d:[<0x10000003c0c/article-35.xml v719>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.933 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.673+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c6f [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-21.jpg auth{0=1} v709 ap=1 s=22784 n(v0 rc2024-09-05T01:27:31.967698+0000 b22784 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380f0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c6f:[<0x10000003c0c/picture-21.jpg v709>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c6f:[<0x10000003c0c/picture-21.jpg v709>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.933 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.673+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c66 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-30.jpg auth{0=1} v711 ap=1 s=63605 n(v0 rc2024-09-05T01:27:31.901699+0000 b63605 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380f0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c66:[<0x10000003c0c/picture-30.jpg v711>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c66:[<0x10000003c0c/picture-30.jpg v711>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.933 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.673+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c60 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-36.jpg auth{0=1} v713 ap=1 s=36661 n(v0 rc2024-09-05T01:27:31.868699+0000 b36661 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380fa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c60:[<0x10000003c0c/picture-36.jpg v713>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c60:[<0x10000003c0c/picture-36.jpg v713>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.941 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.674+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c28 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-19.xml auth{0=1} v717 ap=1 s=15696 n(v0 rc2024-09-05T01:27:31.598701+0000 b15696 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380fb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c28:[<0x10000003c0c/article-19.xml v717>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c28:[<0x10000003c0c/article-19.xml v717>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.941 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.674+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c70 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-20.jpg auth{0=1} v707 ap=1 s=9072 n(v0 rc2024-09-05T01:27:31.969698+0000 b9072 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380fb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c70:[<0x10000003c0c/picture-20.jpg v707>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c70:[<0x10000003c0c/picture-20.jpg v707>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.941 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.674+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c5e [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-38.jpg auth{0=1} v668 ap=1 s=33762 n(v0 rc2024-09-05T01:27:31.860699+0000 b33762 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380fbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c5e:[<0x10000003c0c/picture-38.jpg v668>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c5e:[<0x10000003c0c/picture-38.jpg v668>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.942 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.675+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c69 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-27.jpg auth{0=1} v691 ap=1 s=39932 n(v0 rc2024-09-05T01:27:31.917698+0000 b39932 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380fcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c69:[<0x10000003c0c/picture-27.jpg v691>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c69:[<0x10000003c0c/picture-27.jpg v691>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.942 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.675+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c2f [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-12.xml auth{0=1} v699 ap=1 s=7074 n(v0 rc2024-09-05T01:27:31.614701+0000 b7074 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380fd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c2f:[<0x10000003c0c/article-12.xml v699>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c2f:[<0x10000003c0c/article-12.xml v699>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.942 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.675+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c50 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-52.jpg auth{0=1} v666 ap=1 s=49678 n(v0 rc2024-09-05T01:27:31.792700+0000 b49678 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380fd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c50:[<0x10000003c0c/picture-52.jpg v666>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c50:[<0x10000003c0c/picture-52.jpg v666>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.942 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.675+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c3a [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-1.xml auth{0=1} v697 ap=1 s=23415 n(v0 rc2024-09-05T01:27:31.656701+0000 b23415 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538104000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c3a:[<0x10000003c0c/article-1.xml v697>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c3a:[<0x10000003c0c/article-1.xml v697>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.942 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.676+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c62 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-34.jpg auth{0=1} v695 ap=1 s=44296 n(v0 rc2024-09-05T01:27:31.875699+0000 b44296 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538104580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c62:[<0x10000003c0c/picture-34.jpg v695>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c62:[<0x10000003c0c/picture-34.jpg v695>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.942 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.676+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c4f [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-53.jpg auth{0=1} v672 ap=1 s=53403 n(v0 rc2024-09-05T01:27:31.788700+0000 b53403 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538104b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c4f:[<0x10000003c0c/picture-53.jpg v672>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c4f:[<0x10000003c0c/picture-53.jpg v672>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.942 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.676+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c74 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-16.jpg auth{0=1} v689 ap=1 s=29742 n(v0 rc2024-09-05T01:27:31.988698+0000 b29742 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538105600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c74:[<0x10000003c0c/picture-16.jpg v689>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c74:[<0x10000003c0c/picture-16.jpg v689>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.942 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.676+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c24 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-23.xml auth{0=1} v703 ap=1 s=14228 n(v0 rc2024-09-05T01:27:31.589701+0000 b14228 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538105b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c24:[<0x10000003c0c/article-23.xml v703>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c24:[<0x10000003c0c/article-23.xml v703>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.942 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.677+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c41 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-67.jpg auth{0=1} v670 ap=1 s=54488 n(v0 rc2024-09-05T01:27:31.688700+0000 b54488 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538105080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c41:[<0x10000003c0c/picture-67.jpg v670>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c41:[<0x10000003c0c/picture-67.jpg v670>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.942 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.677+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c2a [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-17.xml auth{0=1} v701 ap=1 s=31065 n(v0 rc2024-09-05T01:27:31.602701+0000 b31065 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538106100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c2a:[<0x10000003c0c/article-17.xml v701>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c2a:[<0x10000003c0c/article-17.xml v701>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.942 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.677+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c64 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-32.jpg auth{0=1} v693 ap=1 s=65100 n(v0 rc2024-09-05T01:27:31.885699+0000 b65100 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538106680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c64:[<0x10000003c0c/picture-32.jpg v693>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c64:[<0x10000003c0c/picture-32.jpg v693>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.942 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.677+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c54 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-48.jpg auth{0=1} v668 ap=1 s=9332 n(v0 rc2024-09-05T01:27:31.805699+0000 b9332 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538106c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c54:[<0x10000003c0c/picture-48.jpg v668>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c54:[<0x10000003c0c/picture-48.jpg v668>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v732>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.943 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.685+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c2c [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-15.xml auth{0=1} v715 ap=1 s=11013 n(v0 rc2024-09-05T01:27:31.607701+0000 b11013 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5380f1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c2c:[<0x10000003c0c/article-15.xml v715>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c2c:[<0x10000003c0c/article-15.xml v715>,<0x10000000399/blog-134 v214449>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.943 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.779+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000456f [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-64.jpg auth{0=1} v1188 ap=1 s=38815 n(v0 rc2024-09-05T01:27:51.208521+0000 b38815 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538468b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000456f:[<0x10000002b08/picture-64.jpg v1188>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000456f:[<0x10000002b08/picture-64.jpg v1188>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.943 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.779+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d0f [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-10.jpg auth{0=1} v1194 ap=1 s=16310 n(v0 rc2024-09-05T01:27:08.783912+0000 b16310 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538469b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d0f:[<0x10000002b08/picture-10.jpg v1194>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2785>,<0x10000000201/src v2501>,<0x10000000006/blogbench-1.0 v2097>,<0x10000000005/tmp v684>,<0x100000001fb/client.0 v692>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v668>,<0x10000000001/sv_1 v708>,<0x10000000000/qa v665>,<0x1/volumes v678>]//[]","memoryvalue":"(3)0x10000002d0f:[<0x10000002b08/picture-10.jpg v1194>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.943 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.779+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d29 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-1.jpg auth{0=1} v1190 ap=1 s=45340 n(v0 rc2024-09-05T01:27:08.826911+0000 b45340 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53846a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d29:[<0x10000002b08/picture-1.jpg v1190>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2785>,<0x10000000201/src v2501>,<0x10000000006/blogbench-1.0 v2097>,<0x10000000005/tmp v684>,<0x100000001fb/client.0 v692>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v668>,<0x10000000001/sv_1 v708>,<0x10000000000/qa v665>,<0x1/volumes v678>]//[]","memoryvalue":"(3)0x10000002d29:[<0x10000002b08/picture-1.jpg v1190>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.943 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.781+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d1a [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-6.jpg auth{0=1} v1192 ap=1 s=44844 n(v0 rc2024-09-05T01:27:08.800912+0000 b44844 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538474000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d1a:[<0x10000002b08/picture-6.jpg v1192>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2785>,<0x10000000201/src v2501>,<0x10000000006/blogbench-1.0 v2097>,<0x10000000005/tmp v684>,<0x100000001fb/client.0 v692>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v668>,<0x10000000001/sv_1 v708>,<0x10000000000/qa v665>,<0x1/volumes v678>]//[]","memoryvalue":"(3)0x10000002d1a:[<0x10000002b08/picture-6.jpg v1192>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.943 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.782+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cfa [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-17.jpg auth{0=1} v1196 ap=1 s=39427 n(v0 rc2024-09-05T01:27:08.741912+0000 b39427 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538477700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002cfa:[<0x10000002b08/picture-17.jpg v1196>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2785>,<0x10000000201/src v2501>,<0x10000000006/blogbench-1.0 v2097>,<0x10000000005/tmp v684>,<0x100000001fb/client.0 v692>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v668>,<0x10000000001/sv_1 v708>,<0x10000000000/qa v665>,<0x1/volumes v678>]//[]","memoryvalue":"(3)0x10000002cfa:[<0x10000002b08/picture-17.jpg v1196>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.943 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.786+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d00 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-15.jpg auth{0=1} v1204 ap=1 s=32742 n(v0 rc2024-09-05T01:27:08.758912+0000 b32742 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5384f0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d00:[<0x10000002b08/picture-15.jpg v1204>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2785>,<0x10000000201/src v2501>,<0x10000000006/blogbench-1.0 v2097>,<0x10000000005/tmp v684>,<0x100000001fb/client.0 v692>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v668>,<0x10000000001/sv_1 v708>,<0x10000000000/qa v665>,<0x1/volumes v678>]//[]","memoryvalue":"(3)0x10000002d00:[<0x10000002b08/picture-15.jpg v1204>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.943 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.787+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d0a [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-12.jpg auth{0=1} v1202 ap=1 s=12462 n(v0 rc2024-09-05T01:27:08.775912+0000 b12462 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5384f6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d0a:[<0x10000002b08/picture-12.jpg v1202>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2785>,<0x10000000201/src v2501>,<0x10000000006/blogbench-1.0 v2097>,<0x10000000005/tmp v684>,<0x100000001fb/client.0 v692>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v668>,<0x10000000001/sv_1 v708>,<0x10000000000/qa v665>,<0x1/volumes v678>]//[]","memoryvalue":"(3)0x10000002d0a:[<0x10000002b08/picture-12.jpg v1202>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.943 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.788+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d23 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-3.jpg auth{0=1} v1185 ap=1 s=61399 n(v0 rc2024-09-05T01:27:08.815911+0000 b61399 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5384c8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d23:[<0x10000002b08/picture-3.jpg v1185>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2785>,<0x10000000201/src v2501>,<0x10000000006/blogbench-1.0 v2097>,<0x10000000005/tmp v684>,<0x100000001fb/client.0 v692>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v668>,<0x10000000001/sv_1 v708>,<0x10000000000/qa v665>,<0x1/volumes v678>]//[]","memoryvalue":"(3)0x10000002d23:[<0x10000002b08/picture-3.jpg v1185>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.943 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.789+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d0d [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-11.jpg auth{0=1} v1187 ap=1 s=47816 n(v0 rc2024-09-05T01:27:08.780912+0000 b47816 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5384c9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d0d:[<0x10000002b08/picture-11.jpg v1187>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2785>,<0x10000000201/src v2501>,<0x10000000006/blogbench-1.0 v2097>,<0x10000000005/tmp v684>,<0x100000001fb/client.0 v692>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v668>,<0x10000000001/sv_1 v708>,<0x10000000000/qa v665>,<0x1/volumes v678>]//[]","memoryvalue":"(3)0x10000002d0d:[<0x10000002b08/picture-11.jpg v1187>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.943 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.790+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004572 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-29.xml auth{0=1} v1183 ap=1 s=12670 n(v0 rc2024-09-05T01:27:51.212521+0000 b12670 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5384d4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004572:[<0x10000002b08/article-29.xml v1183>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004572:[<0x10000002b08/article-29.xml v1183>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.943 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.793+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d1d [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-5.jpg auth{0=1} v1224 ap=1 s=44677 n(v0 rc2024-09-05T01:27:08.804912+0000 b44677 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5384b0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d1d:[<0x10000002b08/picture-5.jpg v1224>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2785>,<0x10000000201/src v2501>,<0x10000000006/blogbench-1.0 v2097>,<0x10000000005/tmp v684>,<0x100000001fb/client.0 v692>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v668>,<0x10000000001/sv_1 v708>,<0x10000000000/qa v665>,<0x1/volumes v678>]//[]","memoryvalue":"(3)0x10000002d1d:[<0x10000002b08/picture-5.jpg v1224>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.944 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.796+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cda [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-21.jpg auth{0=1} v1193 ap=1 s=32508 n(v0 rc2024-09-05T01:27:08.619913+0000 b32508 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538502b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002cda:[<0x10000002b08/picture-21.jpg v1193>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2785>,<0x10000000201/src v2501>,<0x10000000006/blogbench-1.0 v2097>,<0x10000000005/tmp v684>,<0x100000001fb/client.0 v692>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v668>,<0x10000000001/sv_1 v708>,<0x10000000000/qa v665>,<0x1/volumes v678>]//[]","memoryvalue":"(3)0x10000002cda:[<0x10000002b08/picture-21.jpg v1193>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.944 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.797+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004565 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-40.xml auth{0=1} v1189 ap=1 s=3300 n(v0 rc2024-09-05T01:27:51.053522+0000 b3300 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538504680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004565:[<0x10000002b08/article-40.xml v1189>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004565:[<0x10000002b08/article-40.xml v1189>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.944 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.799+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cf2 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-20.jpg auth{0=1} v1191 ap=1 s=47182 n(v0 rc2024-09-05T01:27:08.720912+0000 b47182 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538510100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002cf2:[<0x10000002b08/picture-20.jpg v1191>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2785>,<0x10000000201/src v2501>,<0x10000000006/blogbench-1.0 v2097>,<0x10000000005/tmp v684>,<0x100000001fb/client.0 v692>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v668>,<0x10000000001/sv_1 v708>,<0x10000000000/qa v665>,<0x1/volumes v678>]//[]","memoryvalue":"(3)0x10000002cf2:[<0x10000002b08/picture-20.jpg v1191>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.944 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.809+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d07 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-13.jpg auth{0=1} v1210 ap=1 s=58236 n(v0 rc2024-09-05T01:27:08.768912+0000 b58236 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538443600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d07:[<0x10000002b08/picture-13.jpg v1210>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2785>,<0x10000000201/src v2501>,<0x10000000006/blogbench-1.0 v2097>,<0x10000000005/tmp v684>,<0x100000001fb/client.0 v692>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v668>,<0x10000000001/sv_1 v708>,<0x10000000000/qa v665>,<0x1/volumes v678>]//[]","memoryvalue":"(3)0x10000002d07:[<0x10000002b08/picture-13.jpg v1210>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.944 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.809+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cf7 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-18.jpg auth{0=1} v1214 ap=1 s=20951 n(v0 rc2024-09-05T01:27:08.733912+0000 b20951 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538443b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002cf7:[<0x10000002b08/picture-18.jpg v1214>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2785>,<0x10000000201/src v2501>,<0x10000000006/blogbench-1.0 v2097>,<0x10000000005/tmp v684>,<0x100000001fb/client.0 v692>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v668>,<0x10000000001/sv_1 v708>,<0x10000000000/qa v665>,<0x1/volumes v678>]//[]","memoryvalue":"(3)0x10000002cf7:[<0x10000002b08/picture-18.jpg v1214>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.944 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.809+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cf4 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-19.jpg auth{0=1} v1216 ap=1 s=42921 n(v0 rc2024-09-05T01:27:08.725912+0000 b42921 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538445180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002cf4:[<0x10000002b08/picture-19.jpg v1216>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2785>,<0x10000000201/src v2501>,<0x10000000006/blogbench-1.0 v2097>,<0x10000000005/tmp v684>,<0x100000001fb/client.0 v692>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v668>,<0x10000000001/sv_1 v708>,<0x10000000000/qa v665>,<0x1/volumes v678>]//[]","memoryvalue":"(3)0x10000002cf4:[<0x10000002b08/picture-19.jpg v1216>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.944 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.810+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d1f [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-4.jpg auth{0=1} v1206 ap=1 s=59604 n(v0 rc2024-09-05T01:27:08.808912+0000 b59604 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538451080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d1f:[<0x10000002b08/picture-4.jpg v1206>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2785>,<0x10000000201/src v2501>,<0x10000000006/blogbench-1.0 v2097>,<0x10000000005/tmp v684>,<0x100000001fb/client.0 v692>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v668>,<0x10000000001/sv_1 v708>,<0x10000000000/qa v665>,<0x1/volumes v678>]//[]","memoryvalue":"(3)0x10000002d1f:[<0x10000002b08/picture-4.jpg v1206>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.944 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.811+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d26 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-2.jpg auth{0=1} v1204 ap=1 s=23758 n(v0 rc2024-09-05T01:27:08.820911+0000 b23758 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538451b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d26:[<0x10000002b08/picture-2.jpg v1204>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2785>,<0x10000000201/src v2501>,<0x10000000006/blogbench-1.0 v2097>,<0x10000000005/tmp v684>,<0x100000001fb/client.0 v692>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v668>,<0x10000000001/sv_1 v708>,<0x10000000000/qa v665>,<0x1/volumes v678>]//[]","memoryvalue":"(3)0x10000002d26:[<0x10000002b08/picture-2.jpg v1204>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.944 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.811+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d03 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-14.jpg auth{0=1} v1212 ap=1 s=9744 n(v0 rc2024-09-05T01:27:08.764912+0000 b9744 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538453180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d03:[<0x10000002b08/picture-14.jpg v1212>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2785>,<0x10000000201/src v2501>,<0x10000000006/blogbench-1.0 v2097>,<0x10000000005/tmp v684>,<0x100000001fb/client.0 v692>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v668>,<0x10000000001/sv_1 v708>,<0x10000000000/qa v665>,<0x1/volumes v678>]//[]","memoryvalue":"(3)0x10000002d03:[<0x10000002b08/picture-14.jpg v1212>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.944 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.813+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d11 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-9.jpg auth{0=1} v1208 ap=1 s=62029 n(v0 rc2024-09-05T01:27:08.786912+0000 b62029 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53845d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d11:[<0x10000002b08/picture-9.jpg v1208>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2785>,<0x10000000201/src v2501>,<0x10000000006/blogbench-1.0 v2097>,<0x10000000005/tmp v684>,<0x100000001fb/client.0 v692>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v668>,<0x10000000001/sv_1 v708>,<0x10000000000/qa v665>,<0x1/volumes v678>]//[]","memoryvalue":"(3)0x10000002d11:[<0x10000002b08/picture-9.jpg v1208>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.944 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.813+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000467d [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-13.jpg auth{0=1} v802 ap=1 s=12090 n(v0 rc2024-09-05T01:27:53.057504+0000 b12090 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538598000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000467d:[<0x10000004618/picture-13.jpg v802>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000467d:[<0x10000004618/picture-13.jpg v802>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.944 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.813+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004657 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-18.jpg auth{0=1} v806 ap=1 s=43533 n(v0 rc2024-09-05T01:27:52.941505+0000 b43533 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538598b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004657:[<0x10000004618/picture-18.jpg v806>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004657:[<0x10000004618/picture-18.jpg v806>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.944 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.814+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000463f [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-18.xml auth{0=1} v810 ap=1 s=16658 n(v0 rc2024-09-05T01:27:52.859506+0000 b16658 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538599600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000463f:[<0x10000004618/article-18.xml v810>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000463f:[<0x10000004618/article-18.xml v810>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.945 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.814+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004656 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-19.jpg auth{0=1} v808 ap=1 s=27959 n(v0 rc2024-09-05T01:27:52.936505+0000 b27959 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53859a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004656:[<0x10000004618/picture-19.jpg v808>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004656:[<0x10000004618/picture-19.jpg v808>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.945 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.814+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000461e [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-51.xml auth{0=1} v820 ap=1 s=29721 n(v0 rc2024-09-05T01:27:52.776506+0000 b29721 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53859ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000461e:[<0x10000004618/article-51.xml v820>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000461e:[<0x10000004618/article-51.xml v820>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.945 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.814+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004636 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-27.xml auth{0=1} v814 ap=1 s=8834 n(v0 rc2024-09-05T01:27:52.839506+0000 b8834 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385a0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004636:[<0x10000004618/article-27.xml v814>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004636:[<0x10000004618/article-27.xml v814>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.945 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.814+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000046c6 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-4.jpg auth{0=1} v796 ap=1 s=33319 n(v0 rc2024-09-05T01:27:53.470500+0000 b33319 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385a0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000046c6:[<0x10000004618/picture-4.jpg v796>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x100000046c6:[<0x10000004618/picture-4.jpg v796>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.945 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.815+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000046ca [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-2.jpg auth{0=1} v794 ap=1 s=41510 n(v0 rc2024-09-05T01:27:53.485500+0000 b41510 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385a1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000046ca:[<0x10000004618/picture-2.jpg v794>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x100000046ca:[<0x10000004618/picture-2.jpg v794>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.945 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.815+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000463d [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-20.xml auth{0=1} v812 ap=1 s=1507 n(v0 rc2024-09-05T01:27:52.854506+0000 b1507 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385a2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000463d:[<0x10000004618/article-20.xml v812>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000463d:[<0x10000004618/article-20.xml v812>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.945 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.815+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000465f [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-14.jpg auth{0=1} v804 ap=1 s=38369 n(v0 rc2024-09-05T01:27:53.038504+0000 b38369 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385a2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000465f:[<0x10000004618/picture-14.jpg v804>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000465f:[<0x10000004618/picture-14.jpg v804>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.945 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.816+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004624 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-45.xml auth{0=1} v818 ap=1 s=10111 n(v0 rc2024-09-05T01:27:52.795506+0000 b10111 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385ae580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004624:[<0x10000004618/article-45.xml v818>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004624:[<0x10000004618/article-45.xml v818>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.945 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.816+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000046bb [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-7.jpg auth{0=1} v798 ap=1 s=61790 n(v0 rc2024-09-05T01:27:53.410501+0000 b61790 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385af080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000046bb:[<0x10000004618/picture-7.jpg v798>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x100000046bb:[<0x10000004618/picture-7.jpg v798>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.945 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.816+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004632 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-31.xml auth{0=1} v816 ap=1 s=25236 n(v0 rc2024-09-05T01:27:52.826506+0000 b25236 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385afb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004632:[<0x10000004618/article-31.xml v816>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004632:[<0x10000004618/article-31.xml v816>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.945 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.816+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000046ab [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-9.jpg auth{0=1} v800 ap=1 s=49499 n(v0 rc2024-09-05T01:27:53.297502+0000 b49499 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385b0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000046ab:[<0x10000004618/picture-9.jpg v800>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x100000046ab:[<0x10000004618/picture-9.jpg v800>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.945 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.816+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000046a7 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-10.jpg auth{0=1} v787 ap=1 s=8765 n(v0 rc2024-09-05T01:27:53.248502+0000 b8765 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385b1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000046a7:[<0x10000004618/picture-10.jpg v787>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x100000046a7:[<0x10000004618/picture-10.jpg v787>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.946 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.816+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000046cd [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-1.jpg auth{0=1} v783 ap=1 s=46060 n(v0 rc2024-09-05T01:27:53.490500+0000 b46060 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385b8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000046cd:[<0x10000004618/picture-1.jpg v783>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x100000046cd:[<0x10000004618/picture-1.jpg v783>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.946 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.817+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004649 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-9.xml auth{0=1} v795 ap=1 s=5527 n(v0 rc2024-09-05T01:27:52.884505+0000 b5527 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385b8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004649:[<0x10000004618/article-9.xml v795>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004649:[<0x10000004618/article-9.xml v795>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.946 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.817+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004625 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-44.xml auth{0=1} v799 ap=1 s=31578 n(v0 rc2024-09-05T01:27:52.797506+0000 b31578 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385b9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004625:[<0x10000004618/article-44.xml v799>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004625:[<0x10000004618/article-44.xml v799>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.946 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.817+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000046c1 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-6.jpg auth{0=1} v785 ap=1 s=32664 n(v0 rc2024-09-05T01:27:53.426500+0000 b32664 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385ba100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000046c1:[<0x10000004618/picture-6.jpg v785>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x100000046c1:[<0x10000004618/picture-6.jpg v785>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.946 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.817+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004639 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-24.xml auth{0=1} v797 ap=1 s=24500 n(v0 rc2024-09-05T01:27:52.845506+0000 b24500 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385bac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004639:[<0x10000004618/article-24.xml v797>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004639:[<0x10000004618/article-24.xml v797>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.946 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.817+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004658 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-17.jpg auth{0=1} v789 ap=1 s=61865 n(v0 rc2024-09-05T01:27:52.944505+0000 b61865 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385bb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004658:[<0x10000004618/picture-17.jpg v789>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004658:[<0x10000004618/picture-17.jpg v789>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.946 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.818+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004650 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-3.xml auth{0=1} v791 ap=1 s=12074 n(v0 rc2024-09-05T01:27:52.919505+0000 b12074 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385c4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004650:[<0x10000004618/article-3.xml v791>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004650:[<0x10000004618/article-3.xml v791>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.946 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.818+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000464b [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-7.xml auth{0=1} v793 ap=1 s=10455 n(v0 rc2024-09-05T01:27:52.889505+0000 b10455 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385c5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000464b:[<0x10000004618/article-7.xml v793>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000464b:[<0x10000004618/article-7.xml v793>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.946 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.818+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000461a [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-55.xml auth{0=1} v826 ap=1 s=12370 n(v0 rc2024-09-05T01:27:52.758507+0000 b12370 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385c5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000461a:[<0x10000004618/article-55.xml v826>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000461a:[<0x10000004618/article-55.xml v826>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.946 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.818+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000464a [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-8.xml auth{0=1} v818 ap=1 s=31444 n(v0 rc2024-09-05T01:27:52.887505+0000 b31444 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385c6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000464a:[<0x10000004618/article-8.xml v818>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000464a:[<0x10000004618/article-8.xml v818>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.946 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.818+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000046b0 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-8.jpg auth{0=1} v812 ap=1 s=22108 n(v0 rc2024-09-05T01:27:53.389501+0000 b22108 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385c7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000046b0:[<0x10000004618/picture-8.jpg v812>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x100000046b0:[<0x10000004618/picture-8.jpg v812>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.947 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.819+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000463c [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-21.xml auth{0=1} v820 ap=1 s=30306 n(v0 rc2024-09-05T01:27:52.852506+0000 b30306 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385d3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000463c:[<0x10000004618/article-21.xml v820>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000463c:[<0x10000004618/article-21.xml v820>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.947 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.819+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004633 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-30.xml auth{0=1} v822 ap=1 s=8289 n(v0 rc2024-09-05T01:27:52.828506+0000 b8289 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385d4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004633:[<0x10000004618/article-30.xml v822>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004633:[<0x10000004618/article-30.xml v822>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.947 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.819+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000461f [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-50.xml auth{0=1} v824 ap=1 s=30267 n(v0 rc2024-09-05T01:27:52.780506+0000 b30267 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385da000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000461f:[<0x10000004618/article-50.xml v824>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000461f:[<0x10000004618/article-50.xml v824>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.947 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.819+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000464c [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-6.xml auth{0=1} v816 ap=1 s=32544 n(v0 rc2024-09-05T01:27:52.912505+0000 b32544 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385dab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000464c:[<0x10000004618/article-6.xml v816>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000464c:[<0x10000004618/article-6.xml v816>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.947 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.820+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004651 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-2.xml auth{0=1} v814 ap=1 s=5810 n(v0 rc2024-09-05T01:27:52.922505+0000 b5810 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385db600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004651:[<0x10000004618/article-2.xml v814>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004651:[<0x10000004618/article-2.xml v814>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.947 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.820+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004619 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-56.xml auth{0=1} v828 ap=1 s=30805 n(v0 rc2024-09-05T01:27:52.756507+0000 b30805 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385dc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004619:[<0x10000004618/article-56.xml v828>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004619:[<0x10000004618/article-56.xml v828>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.947 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.820+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004626 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-43.xml auth{0=1} v797 ap=1 s=27515 n(v0 rc2024-09-05T01:27:52.799506+0000 b27515 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385dcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004626:[<0x10000004618/article-43.xml v797>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004626:[<0x10000004618/article-43.xml v797>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.947 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.820+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004630 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-33.xml auth{0=1} v795 ap=1 s=9094 n(v0 rc2024-09-05T01:27:52.822506+0000 b9094 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385dd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004630:[<0x10000004618/article-33.xml v795>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004630:[<0x10000004618/article-33.xml v795>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.947 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.820+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000046c5 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-5.jpg auth{0=1} v791 ap=1 s=14533 n(v0 rc2024-09-05T01:27:53.467500+0000 b14533 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385e8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000046c5:[<0x10000004618/picture-5.jpg v791>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x100000046c5:[<0x10000004618/picture-5.jpg v791>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.947 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.821+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000461c [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-53.xml auth{0=1} v801 ap=1 s=1719 n(v0 rc2024-09-05T01:27:52.768506+0000 b1719 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385e9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000461c:[<0x10000004618/article-53.xml v801>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000461c:[<0x10000004618/article-53.xml v801>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.947 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.821+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004635 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-28.xml auth{0=1} v793 ap=1 s=25901 n(v0 rc2024-09-05T01:27:52.837506+0000 b25901 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385ea100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004635:[<0x10000004618/article-28.xml v793>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004635:[<0x10000004618/article-28.xml v793>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.947 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.821+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000461d [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-52.xml auth{0=1} v799 ap=1 s=26040 n(v0 rc2024-09-05T01:27:52.771506+0000 b26040 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385eac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000461d:[<0x10000004618/article-52.xml v799>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000461d:[<0x10000004618/article-52.xml v799>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.948 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.821+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000046c7 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-3.jpg auth{0=1} v799 ap=1 s=45340 n(v0 rc2024-09-05T01:27:53.473500+0000 b45340 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385eb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000046c7:[<0x10000004618/picture-3.jpg v799>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x100000046c7:[<0x10000004618/picture-3.jpg v799>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.948 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.822+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004690 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-11.jpg auth{0=1} v801 ap=1 s=29290 n(v0 rc2024-09-05T01:27:53.215502+0000 b29290 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385f4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004690:[<0x10000004618/picture-11.jpg v801>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004690:[<0x10000004618/picture-11.jpg v801>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.948 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.822+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000464e [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-5.xml auth{0=1} v803 ap=1 s=29966 n(v0 rc2024-09-05T01:27:52.914505+0000 b29966 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385f5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000464e:[<0x10000004618/article-5.xml v803>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000464e:[<0x10000004618/article-5.xml v803>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.948 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.822+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000462f [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-34.xml auth{0=1} v809 ap=1 s=10756 n(v0 rc2024-09-05T01:27:52.819506+0000 b10756 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385f5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000462f:[<0x10000004618/article-34.xml v809>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000462f:[<0x10000004618/article-34.xml v809>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.948 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.822+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004634 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-29.xml auth{0=1} v807 ap=1 s=22823 n(v0 rc2024-09-05T01:27:52.830506+0000 b22823 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385f6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004634:[<0x10000004618/article-29.xml v807>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004634:[<0x10000004618/article-29.xml v807>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.948 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.823+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000463b [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-22.xml auth{0=1} v805 ap=1 s=12963 n(v0 rc2024-09-05T01:27:52.850506+0000 b12963 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385f7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000463b:[<0x10000004618/article-22.xml v805>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000463b:[<0x10000004618/article-22.xml v805>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.948 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.823+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004620 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-49.xml auth{0=1} v811 ap=1 s=6831 n(v0 rc2024-09-05T01:27:52.784506+0000 b6831 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385fe580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004620:[<0x10000004618/article-49.xml v811>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004620:[<0x10000004618/article-49.xml v811>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.948 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.823+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004643 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-14.xml auth{0=1} v816 ap=1 s=21394 n(v0 rc2024-09-05T01:27:52.872506+0000 b21394 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385ff080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004643:[<0x10000004618/article-14.xml v816>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004643:[<0x10000004618/article-14.xml v816>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.948 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.823+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004623 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-46.xml auth{0=1} v826 ap=1 s=20968 n(v0 rc2024-09-05T01:27:52.790506+0000 b20968 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5385ffb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004623:[<0x10000004618/article-46.xml v826>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004623:[<0x10000004618/article-46.xml v826>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.949 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.824+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004622 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-47.xml auth{0=1} v828 ap=1 s=16948 n(v0 rc2024-09-05T01:27:52.788506+0000 b16948 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538600680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004622:[<0x10000004618/article-47.xml v828>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004622:[<0x10000004618/article-47.xml v828>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.949 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.824+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004653 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-22.jpg auth{0=1} v810 ap=1 s=25013 n(v0 rc2024-09-05T01:27:52.927505+0000 b25013 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538601180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004653:[<0x10000004618/picture-22.jpg v810>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004653:[<0x10000004618/picture-22.jpg v810>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.949 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.824+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004647 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-11.xml auth{0=1} v814 ap=1 s=23516 n(v0 rc2024-09-05T01:27:52.879505+0000 b23516 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53860a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004647:[<0x10000004618/article-11.xml v814>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004647:[<0x10000004618/article-11.xml v814>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.949 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.824+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004641 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-16.xml auth{0=1} v818 ap=1 s=18808 n(v0 rc2024-09-05T01:27:52.867506+0000 b18808 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53860ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004641:[<0x10000004618/article-16.xml v818>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004641:[<0x10000004618/article-16.xml v818>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.949 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.824+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000461b [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-54.xml auth{0=1} v832 ap=1 s=28784 n(v0 rc2024-09-05T01:27:52.766506+0000 b28784 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53860b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000461b:[<0x10000004618/article-54.xml v832>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000461b:[<0x10000004618/article-54.xml v832>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.949 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.825+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004637 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-26.xml auth{0=1} v822 ap=1 s=3825 n(v0 rc2024-09-05T01:27:52.841506+0000 b3825 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53860c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004637:[<0x10000004618/article-26.xml v822>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004637:[<0x10000004618/article-26.xml v822>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.949 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.825+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000465d [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-15.jpg auth{0=1} v808 ap=1 s=45451 n(v0 rc2024-09-05T01:27:52.953505+0000 b45451 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53860cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000465d:[<0x10000004618/picture-15.jpg v808>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000465d:[<0x10000004618/picture-15.jpg v808>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.949 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.825+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004682 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-12.jpg auth{0=1} v806 ap=1 s=29729 n(v0 rc2024-09-05T01:27:53.086504+0000 b29729 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538615080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004682:[<0x10000004618/picture-12.jpg v806>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004682:[<0x10000004618/picture-12.jpg v806>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.949 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.825+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004621 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-48.xml auth{0=1} v830 ap=1 s=14010 n(v0 rc2024-09-05T01:27:52.786506+0000 b14010 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538615b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004621:[<0x10000004618/article-48.xml v830>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004621:[<0x10000004618/article-48.xml v830>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.949 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.825+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000464f [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-4.xml auth{0=1} v812 ap=1 s=5903 n(v0 rc2024-09-05T01:27:52.917505+0000 b5903 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538616680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000464f:[<0x10000004618/article-4.xml v812>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000464f:[<0x10000004618/article-4.xml v812>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.949 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.826+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004638 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-25.xml auth{0=1} v820 ap=1 s=6222 n(v0 rc2024-09-05T01:27:52.843506+0000 b6222 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538617180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004638:[<0x10000004618/article-25.xml v820>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004638:[<0x10000004618/article-25.xml v820>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.949 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.826+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000462b [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-38.xml auth{0=1} v824 ap=1 s=4291 n(v0 rc2024-09-05T01:27:52.810506+0000 b4291 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538622000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000462b:[<0x10000004618/article-38.xml v824>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000462b:[<0x10000004618/article-38.xml v824>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.950 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.826+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004654 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-21.jpg auth{0=1} v793 ap=1 s=34588 n(v0 rc2024-09-05T01:27:52.930505+0000 b34588 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538622b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004654:[<0x10000004618/picture-21.jpg v793>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004654:[<0x10000004618/picture-21.jpg v793>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.950 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.826+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000462e [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-35.xml auth{0=1} v799 ap=1 s=28195 n(v0 rc2024-09-05T01:27:52.817506+0000 b28195 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538623600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000462e:[<0x10000004618/article-35.xml v799>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000462e:[<0x10000004618/article-35.xml v799>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.950 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.826+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004629 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-40.xml auth{0=1} v801 ap=1 s=6262 n(v0 rc2024-09-05T01:27:52.806506+0000 b6262 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538624100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004629:[<0x10000004618/article-40.xml v801>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004629:[<0x10000004618/article-40.xml v801>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.950 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.827+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004642 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-15.xml auth{0=1} v795 ap=1 s=9414 n(v0 rc2024-09-05T01:27:52.869506+0000 b9414 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538624c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004642:[<0x10000004618/article-15.xml v795>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004642:[<0x10000004618/article-15.xml v795>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.950 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.827+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000463e [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-19.xml auth{0=1} v797 ap=1 s=12885 n(v0 rc2024-09-05T01:27:52.857506+0000 b12885 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538625700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000463e:[<0x10000004618/article-19.xml v797>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000463e:[<0x10000004618/article-19.xml v797>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.950 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.827+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004655 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-20.jpg auth{0=1} v791 ap=1 s=26148 n(v0 rc2024-09-05T01:27:52.934505+0000 b26148 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53862a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004655:[<0x10000004618/picture-20.jpg v791>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004655:[<0x10000004618/picture-20.jpg v791>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.950 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.827+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004627 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-42.xml auth{0=1} v803 ap=1 s=12219 n(v0 rc2024-09-05T01:27:52.802506+0000 b12219 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53862b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004627:[<0x10000004618/article-42.xml v803>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004627:[<0x10000004618/article-42.xml v803>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.950 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.827+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000462c [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-37.xml auth{0=1} v795 ap=1 s=32648 n(v0 rc2024-09-05T01:27:52.813506+0000 b32648 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53862bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000462c:[<0x10000004618/article-37.xml v795>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000462c:[<0x10000004618/article-37.xml v795>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.950 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.828+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000462a [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-39.xml auth{0=1} v797 ap=1 s=25325 n(v0 rc2024-09-05T01:27:52.808506+0000 b25325 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53862c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000462a:[<0x10000004618/article-39.xml v797>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000462a:[<0x10000004618/article-39.xml v797>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.950 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.828+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000462d [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-36.xml auth{0=1} v793 ap=1 s=30580 n(v0 rc2024-09-05T01:27:52.815506+0000 b30580 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53862d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000462d:[<0x10000004618/article-36.xml v793>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000462d:[<0x10000004618/article-36.xml v793>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.950 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.828+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004646 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-12.xml auth{0=1} v787 ap=1 s=30920 n(v0 rc2024-09-05T01:27:52.877505+0000 b30920 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538636000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004646:[<0x10000004618/article-12.xml v787>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004646:[<0x10000004618/article-12.xml v787>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.950 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.828+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004652 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-1.xml auth{0=1} v785 ap=1 s=6183 n(v0 rc2024-09-05T01:27:52.924505+0000 b6183 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538636b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004652:[<0x10000004618/article-1.xml v785>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004652:[<0x10000004618/article-1.xml v785>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.951 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.828+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000465a [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-16.jpg auth{0=1} v783 ap=1 s=59473 n(v0 rc2024-09-05T01:27:52.950505+0000 b59473 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538637600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000465a:[<0x10000004618/picture-16.jpg v783>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000465a:[<0x10000004618/picture-16.jpg v783>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.951 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.829+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000463a [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-23.xml auth{0=1} v791 ap=1 s=18710 n(v0 rc2024-09-05T01:27:52.848506+0000 b18710 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538638100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000463a:[<0x10000004618/article-23.xml v791>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x1000000463a:[<0x10000004618/article-23.xml v791>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.951 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.829+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004640 [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-17.xml auth{0=1} v789 ap=1 s=25598 n(v0 rc2024-09-05T01:27:52.865506+0000 b25598 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538638c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004640:[<0x10000004618/article-17.xml v789>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2932>,<0x10000000201/src v2566>,<0x10000000006/blogbench-1.0 v2149>,<0x10000000005/tmp v735>,<0x100000001fb/client.0 v743>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v715>,<0x10000000001/sv_1 v754>,<0x10000000000/qa v711>,<0x1/volumes v725>]//[]","memoryvalue":"(3)0x10000004640:[<0x10000004618/article-17.xml v789>,<0x10000000399/blog-215 v213691>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.951 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.830+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d14 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-8.jpg auth{0=1} v1180 ap=1 s=40920 n(v0 rc2024-09-05T01:27:08.789912+0000 b40920 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53848c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d14:[<0x10000002b08/picture-8.jpg v1180>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2785>,<0x10000000201/src v2501>,<0x10000000006/blogbench-1.0 v2097>,<0x10000000005/tmp v684>,<0x100000001fb/client.0 v692>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v668>,<0x10000000001/sv_1 v708>,<0x10000000000/qa v665>,<0x1/volumes v678>]//[]","memoryvalue":"(3)0x10000002d14:[<0x10000002b08/picture-8.jpg v1180>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.951 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.860+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cfd [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-16.jpg auth{0=1} v1216 ap=1 s=34746 n(v0 rc2024-09-05T01:27:08.750912+0000 b34746 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53852ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002cfd:[<0x10000002b08/picture-16.jpg v1216>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2785>,<0x10000000201/src v2501>,<0x10000000006/blogbench-1.0 v2097>,<0x10000000005/tmp v684>,<0x100000001fb/client.0 v692>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v668>,<0x10000000001/sv_1 v708>,<0x10000000000/qa v665>,<0x1/volumes v678>]//[]","memoryvalue":"(3)0x10000002cfd:[<0x10000002b08/picture-16.jpg v1216>,<0x10000000399/blog-83 v215003>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.951 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.862+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004342 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-13.jpg auth{0=1} v883 ap=1 s=13702 n(v0 rc2024-09-05T01:27:46.245566+0000 b13702 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53874e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004342:[<0x10000004313/picture-13.jpg v883>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004342:[<0x10000004313/picture-13.jpg v883>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.951 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.862+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000433d [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-18.jpg auth{0=1} v887 ap=1 s=28120 n(v0 rc2024-09-05T01:27:46.224566+0000 b28120 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53874f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000433d:[<0x10000004313/picture-18.jpg v887>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000433d:[<0x10000004313/picture-18.jpg v887>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.951 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.862+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004320 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-18.xml auth{0=1} v891 ap=1 s=13976 n(v0 rc2024-09-05T01:27:46.099568+0000 b13976 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53874f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004320:[<0x10000004313/article-18.xml v891>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004320:[<0x10000004313/article-18.xml v891>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.951 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.863+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000433c [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-19.jpg auth{0=1} v889 ap=1 s=51469 n(v0 rc2024-09-05T01:27:46.217567+0000 b51469 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538750100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000433c:[<0x10000004313/picture-19.jpg v889>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000433c:[<0x10000004313/picture-19.jpg v889>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.951 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.863+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004317 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-27.xml auth{0=1} v895 ap=1 s=7813 n(v0 rc2024-09-05T01:27:46.061568+0000 b7813 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538750c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004317:[<0x10000004313/article-27.xml v895>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004317:[<0x10000004313/article-27.xml v895>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.951 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.863+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000434b [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-4.jpg auth{0=1} v877 ap=1 s=52377 n(v0 rc2024-09-05T01:27:46.275566+0000 b52377 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538751180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000434b:[<0x10000004313/picture-4.jpg v877>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000434b:[<0x10000004313/picture-4.jpg v877>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.951 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.863+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000434d [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-2.jpg auth{0=1} v875 ap=1 s=16352 n(v0 rc2024-09-05T01:27:46.286566+0000 b16352 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538751700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000434d:[<0x10000004313/picture-2.jpg v875>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000434d:[<0x10000004313/picture-2.jpg v875>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.952 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.864+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004341 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-14.jpg auth{0=1} v885 ap=1 s=51627 n(v0 rc2024-09-05T01:27:46.239566+0000 b51627 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538758580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004341:[<0x10000004313/picture-14.jpg v885>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004341:[<0x10000004313/picture-14.jpg v885>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.952 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.864+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000431e [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-20.xml auth{0=1} v893 ap=1 s=30880 n(v0 rc2024-09-05T01:27:46.080568+0000 b30880 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538758000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000431e:[<0x10000004313/article-20.xml v893>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000431e:[<0x10000004313/article-20.xml v893>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.952 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.864+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004348 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-7.jpg auth{0=1} v879 ap=1 s=43334 n(v0 rc2024-09-05T01:27:46.265566+0000 b43334 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538758b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004348:[<0x10000004313/picture-7.jpg v879>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004348:[<0x10000004313/picture-7.jpg v879>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.952 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.864+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004346 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-9.jpg auth{0=1} v881 ap=1 s=40379 n(v0 rc2024-09-05T01:27:46.260566+0000 b40379 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538759080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004346:[<0x10000004313/picture-9.jpg v881>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004346:[<0x10000004313/picture-9.jpg v881>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.952 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.865+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004345 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-10.jpg auth{0=1} v903 ap=1 s=46982 n(v0 rc2024-09-05T01:27:46.258566+0000 b46982 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53875a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004345:[<0x10000004313/picture-10.jpg v903>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004345:[<0x10000004313/picture-10.jpg v903>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.952 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.865+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000434e [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-1.jpg auth{0=1} v899 ap=1 s=46021 n(v0 rc2024-09-05T01:27:46.289566+0000 b46021 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53875ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000434e:[<0x10000004313/picture-1.jpg v899>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000434e:[<0x10000004313/picture-1.jpg v899>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.952 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.865+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004329 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-9.xml auth{0=1} v913 ap=1 s=27872 n(v0 rc2024-09-05T01:27:46.131567+0000 b27872 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53875b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004329:[<0x10000004313/article-9.xml v913>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004329:[<0x10000004313/article-9.xml v913>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.952 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.866+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004349 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-6.jpg auth{0=1} v901 ap=1 s=43619 n(v0 rc2024-09-05T01:27:46.270566+0000 b43619 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538762000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004349:[<0x10000004313/picture-6.jpg v901>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004349:[<0x10000004313/picture-6.jpg v901>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.952 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.866+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000431a [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-24.xml auth{0=1} v915 ap=1 s=17610 n(v0 rc2024-09-05T01:27:46.069568+0000 b17610 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538763600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000431a:[<0x10000004313/article-24.xml v915>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000431a:[<0x10000004313/article-24.xml v915>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.952 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.867+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004333 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-28.jpg auth{0=1} v909 ap=1 s=30484 n(v0 rc2024-09-05T01:27:46.180567+0000 b30484 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538764680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004333:[<0x10000004313/picture-28.jpg v909>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004333:[<0x10000004313/picture-28.jpg v909>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.952 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.867+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000433e [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-17.jpg auth{0=1} v905 ap=1 s=17031 n(v0 rc2024-09-05T01:27:46.226566+0000 b17031 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538765180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000433e:[<0x10000004313/picture-17.jpg v905>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000433e:[<0x10000004313/picture-17.jpg v905>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.952 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.867+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000432f [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-3.xml auth{0=1} v911 ap=1 s=8949 n(v0 rc2024-09-05T01:27:46.163567+0000 b8949 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538765700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000432f:[<0x10000004313/article-3.xml v911>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000432f:[<0x10000004313/article-3.xml v911>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.953 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.867+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004337 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-24.jpg auth{0=1} v907 ap=1 s=48607 n(v0 rc2024-09-05T01:27:46.205567+0000 b48607 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538770000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004337:[<0x10000004313/picture-24.jpg v907>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004337:[<0x10000004313/picture-24.jpg v907>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.953 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.868+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004336 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-25.jpg auth{0=1} v881 ap=1 s=25118 n(v0 rc2024-09-05T01:27:46.203567+0000 b25118 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538771b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004336:[<0x10000004313/picture-25.jpg v881>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004336:[<0x10000004313/picture-25.jpg v881>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.953 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.869+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004347 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-8.jpg auth{0=1} v879 ap=1 s=43122 n(v0 rc2024-09-05T01:27:46.263566+0000 b43122 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538773700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004347:[<0x10000004313/picture-8.jpg v879>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004347:[<0x10000004313/picture-8.jpg v879>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.953 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.869+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004335 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-26.jpg auth{0=1} v883 ap=1 s=35560 n(v0 rc2024-09-05T01:27:46.198567+0000 b35560 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53877a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004335:[<0x10000004313/picture-26.jpg v883>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004335:[<0x10000004313/picture-26.jpg v883>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.953 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.869+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000431d [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-21.xml auth{0=1} v893 ap=1 s=21894 n(v0 rc2024-09-05T01:27:46.077568+0000 b21894 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53877a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000431d:[<0x10000004313/article-21.xml v893>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000431d:[<0x10000004313/article-21.xml v893>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.953 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.869+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004314 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-30.xml auth{0=1} v895 ap=1 s=1917 n(v0 rc2024-09-05T01:27:46.055568+0000 b1917 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53877ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004314:[<0x10000004313/article-30.xml v895>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004314:[<0x10000004313/article-30.xml v895>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.953 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.869+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004325 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-13.xml auth{0=1} v891 ap=1 s=3399 n(v0 rc2024-09-05T01:27:46.117567+0000 b3399 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53877b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004325:[<0x10000004313/article-13.xml v891>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004325:[<0x10000004313/article-13.xml v891>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.953 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.870+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000432c [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-6.xml auth{0=1} v889 ap=1 s=11291 n(v0 rc2024-09-05T01:27:46.156567+0000 b11291 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53877c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000432c:[<0x10000004313/article-6.xml v889>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000432c:[<0x10000004313/article-6.xml v889>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.953 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.870+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004330 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-2.xml auth{0=1} v887 ap=1 s=15440 n(v0 rc2024-09-05T01:27:46.167567+0000 b15440 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53877c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004330:[<0x10000004313/article-2.xml v887>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004330:[<0x10000004313/article-2.xml v887>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.953 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.870+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004332 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-29.jpg auth{0=1} v885 ap=1 s=54810 n(v0 rc2024-09-05T01:27:46.177567+0000 b54810 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53877d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004332:[<0x10000004313/picture-29.jpg v885>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004332:[<0x10000004313/picture-29.jpg v885>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.953 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.871+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000434a [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-5.jpg auth{0=1} v899 ap=1 s=42128 n(v0 rc2024-09-05T01:27:46.272566+0000 b42128 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538787080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000434a:[<0x10000004313/picture-5.jpg v899>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000434a:[<0x10000004313/picture-5.jpg v899>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.953 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.872+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000453e [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-79.xml auth{0=1} v482 ap=1 s=19933 n(v0 rc2024-09-05T01:27:50.845524+0000 b19933 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538788c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000453e:[<0x10000004313/article-79.xml v482>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000453e:[<0x10000004313/article-79.xml v482>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.954 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.873+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004316 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-28.xml auth{0=1} v901 ap=1 s=22700 n(v0 rc2024-09-05T01:27:46.059568+0000 b22700 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538792580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004316:[<0x10000004313/article-28.xml v901>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004316:[<0x10000004313/article-28.xml v901>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.954 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.873+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000434c [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-3.jpg auth{0=1} v883 ap=1 s=50827 n(v0 rc2024-09-05T01:27:46.284566+0000 b50827 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538793b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000434c:[<0x10000004313/picture-3.jpg v883>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000434c:[<0x10000004313/picture-3.jpg v883>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.954 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.874+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004344 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-11.jpg auth{0=1} v885 ap=1 s=55058 n(v0 rc2024-09-05T01:27:46.254566+0000 b55058 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538794c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004344:[<0x10000004313/picture-11.jpg v885>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004344:[<0x10000004313/picture-11.jpg v885>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.954 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.874+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000432d [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-5.xml auth{0=1} v887 ap=1 s=24101 n(v0 rc2024-09-05T01:27:46.158567+0000 b24101 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538795180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000432d:[<0x10000004313/article-5.xml v887>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000432d:[<0x10000004313/article-5.xml v887>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.954 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.875+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004315 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-29.xml auth{0=1} v891 ap=1 s=14469 n(v0 rc2024-09-05T01:27:46.057568+0000 b14469 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5387a0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004315:[<0x10000004313/article-29.xml v891>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004315:[<0x10000004313/article-29.xml v891>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.954 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.875+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000431c [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-22.xml auth{0=1} v889 ap=1 s=28443 n(v0 rc2024-09-05T01:27:46.075568+0000 b28443 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5387a1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000431c:[<0x10000004313/article-22.xml v889>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000431c:[<0x10000004313/article-22.xml v889>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.954 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.875+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004338 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-23.jpg auth{0=1} v892 ap=1 s=19219 n(v0 rc2024-09-05T01:27:46.207567+0000 b19219 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5387a2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004338:[<0x10000004313/picture-23.jpg v892>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004338:[<0x10000004313/picture-23.jpg v892>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.954 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.876+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004324 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-14.xml auth{0=1} v900 ap=1 s=12217 n(v0 rc2024-09-05T01:27:46.115567+0000 b12217 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5387a2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004324:[<0x10000004313/article-14.xml v900>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004324:[<0x10000004313/article-14.xml v900>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.954 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.876+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004339 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-22.jpg auth{0=1} v890 ap=1 s=61944 n(v0 rc2024-09-05T01:27:46.209567+0000 b61944 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5387a3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004339:[<0x10000004313/picture-22.jpg v890>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004339:[<0x10000004313/picture-22.jpg v890>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.957 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.876+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004327 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-11.xml auth{0=1} v898 ap=1 s=6796 n(v0 rc2024-09-05T01:27:46.127567+0000 b6796 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5387aa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004327:[<0x10000004313/article-11.xml v898>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004327:[<0x10000004313/article-11.xml v898>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.957 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.876+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004322 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-16.xml auth{0=1} v902 ap=1 s=23783 n(v0 rc2024-09-05T01:27:46.106568+0000 b23783 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5387aab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004322:[<0x10000004313/article-16.xml v902>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004322:[<0x10000004313/article-16.xml v902>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.957 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.877+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004318 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-26.xml auth{0=1} v906 ap=1 s=7187 n(v0 rc2024-09-05T01:27:46.065568+0000 b7187 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5387ab080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004318:[<0x10000004313/article-26.xml v906>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004318:[<0x10000004313/article-26.xml v906>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.957 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.877+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004340 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-15.jpg auth{0=1} v888 ap=1 s=40698 n(v0 rc2024-09-05T01:27:46.235566+0000 b40698 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5387ab600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004340:[<0x10000004313/picture-15.jpg v888>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004340:[<0x10000004313/picture-15.jpg v888>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.957 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.877+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004328 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-10.xml auth{0=1} v896 ap=1 s=29740 n(v0 rc2024-09-05T01:27:46.129567+0000 b29740 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5387abb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004328:[<0x10000004313/article-10.xml v896>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004328:[<0x10000004313/article-10.xml v896>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.957 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.877+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004343 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-12.jpg auth{0=1} v886 ap=1 s=64088 n(v0 rc2024-09-05T01:27:46.251566+0000 b64088 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5387ac100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004343:[<0x10000004313/picture-12.jpg v886>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004343:[<0x10000004313/picture-12.jpg v886>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.958 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.878+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000432e [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-4.xml auth{0=1} v894 ap=1 s=8409 n(v0 rc2024-09-05T01:27:46.160567+0000 b8409 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5387ad180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000432e:[<0x10000004313/article-4.xml v894>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000432e:[<0x10000004313/article-4.xml v894>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.958 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.878+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004319 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-25.xml auth{0=1} v904 ap=1 s=3271 n(v0 rc2024-09-05T01:27:46.067568+0000 b3271 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5387ad700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004319:[<0x10000004313/article-25.xml v904>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004319:[<0x10000004313/article-25.xml v904>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.958 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.878+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000433a [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-21.jpg auth{0=1} v881 ap=1 s=27473 n(v0 rc2024-09-05T01:27:46.212567+0000 b27473 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5387ba580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000433a:[<0x10000004313/picture-21.jpg v881>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000433a:[<0x10000004313/picture-21.jpg v881>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.958 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.879+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004323 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-15.xml auth{0=1} v883 ap=1 s=32624 n(v0 rc2024-09-05T01:27:46.110567+0000 b32624 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5387bb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004323:[<0x10000004313/article-15.xml v883>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004323:[<0x10000004313/article-15.xml v883>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.958 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.879+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000431f [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-19.xml auth{0=1} v885 ap=1 s=25075 n(v0 rc2024-09-05T01:27:46.085568+0000 b25075 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5387bcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000431f:[<0x10000004313/article-19.xml v885>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000431f:[<0x10000004313/article-19.xml v885>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.958 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.880+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000433b [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-20.jpg auth{0=1} v879 ap=1 s=64375 n(v0 rc2024-09-05T01:27:46.214567+0000 b64375 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5387bd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000433b:[<0x10000004313/picture-20.jpg v879>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000433b:[<0x10000004313/picture-20.jpg v879>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.958 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.881+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004334 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-27.jpg auth{0=1} v893 ap=1 s=10313 n(v0 rc2024-09-05T01:27:46.182567+0000 b10313 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5387c5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004334:[<0x10000004313/picture-27.jpg v893>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004334:[<0x10000004313/picture-27.jpg v893>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.958 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.881+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004326 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-12.xml auth{0=1} v897 ap=1 s=17734 n(v0 rc2024-09-05T01:27:46.125567+0000 b17734 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5387c5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004326:[<0x10000004313/article-12.xml v897>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004326:[<0x10000004313/article-12.xml v897>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.958 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.881+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004331 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-1.xml auth{0=1} v895 ap=1 s=25311 n(v0 rc2024-09-05T01:27:46.174567+0000 b25311 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5387c6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004331:[<0x10000004313/article-1.xml v895>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004331:[<0x10000004313/article-1.xml v895>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.958 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.882+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000433f [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-16.jpg auth{0=1} v891 ap=1 s=51765 n(v0 rc2024-09-05T01:27:46.228566+0000 b51765 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5387c7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000433f:[<0x10000004313/picture-16.jpg v891>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000433f:[<0x10000004313/picture-16.jpg v891>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.958 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.882+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000431b [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-23.xml auth{0=1} v901 ap=1 s=4547 n(v0 rc2024-09-05T01:27:46.073568+0000 b4547 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5387cf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000431b:[<0x10000004313/article-23.xml v901>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000431b:[<0x10000004313/article-23.xml v901>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.958 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.883+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000004321 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-17.xml auth{0=1} v899 ap=1 s=22291 n(v0 rc2024-09-05T01:27:46.104568+0000 b22291 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5387cf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000004321:[<0x10000004313/article-17.xml v899>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2918>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x10000004321:[<0x10000004313/article-17.xml v899>,<0x10000000399/blog-193 v213859>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.959 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.920+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ccd [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-13.jpg auth{0=1} v1051 ap=1 s=10022 n(v0 rc2024-09-05T01:27:32.985689+0000 b10022 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538940000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ccd:[<0x10000003ca9/picture-13.jpg v1051>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003ccd:[<0x10000003ca9/picture-13.jpg v1051>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.959 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.921+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cc8 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-18.jpg auth{0=1} v518 ap=1 s=57124 n(v0 rc2024-09-05T01:27:32.972689+0000 b57124 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538940b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cc8:[<0x10000003ca9/picture-18.jpg v518>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cc8:[<0x10000003ca9/picture-18.jpg v518>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.959 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.921+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cc7 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-19.jpg auth{0=1} v526 ap=1 s=43006 n(v0 rc2024-09-05T01:27:32.969689+0000 b43006 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538942100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cc7:[<0x10000003ca9/picture-19.jpg v526>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cc7:[<0x10000003ca9/picture-19.jpg v526>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.959 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.922+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cd6 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-4.jpg auth{0=1} v1045 ap=1 s=14864 n(v0 rc2024-09-05T01:27:33.005688+0000 b14864 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538943700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cd6:[<0x10000003ca9/picture-4.jpg v1045>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cd6:[<0x10000003ca9/picture-4.jpg v1045>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.959 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.922+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cd8 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-2.jpg auth{0=1} v1043 ap=1 s=43471 n(v0 rc2024-09-05T01:27:33.139687+0000 b43471 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53894e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cd8:[<0x10000003ca9/picture-2.jpg v1043>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cd8:[<0x10000003ca9/picture-2.jpg v1043>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.959 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.922+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ccc [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-14.jpg auth{0=1} v1053 ap=1 s=65415 n(v0 rc2024-09-05T01:27:32.982689+0000 b65415 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53894e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ccc:[<0x10000003ca9/picture-14.jpg v1053>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003ccc:[<0x10000003ca9/picture-14.jpg v1053>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.959 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.922+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cd3 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-7.jpg auth{0=1} v1047 ap=1 s=16496 n(v0 rc2024-09-05T01:27:32.998688+0000 b16496 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53894eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cd3:[<0x10000003ca9/picture-7.jpg v1047>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cd3:[<0x10000003ca9/picture-7.jpg v1047>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.959 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.922+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cd1 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-9.jpg auth{0=1} v1049 ap=1 s=8516 n(v0 rc2024-09-05T01:27:32.994688+0000 b8516 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53894f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cd1:[<0x10000003ca9/picture-9.jpg v1049>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cd1:[<0x10000003ca9/picture-9.jpg v1049>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.959 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.923+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cd0 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-10.jpg auth{0=1} v1063 ap=1 s=42842 n(v0 rc2024-09-05T01:27:32.991688+0000 b42842 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538958580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cd0:[<0x10000003ca9/picture-10.jpg v1063>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cd0:[<0x10000003ca9/picture-10.jpg v1063>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.959 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.923+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cd9 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-1.jpg auth{0=1} v1059 ap=1 s=34206 n(v0 rc2024-09-05T01:27:33.177687+0000 b34206 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538958b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cd9:[<0x10000003ca9/picture-1.jpg v1059>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cd9:[<0x10000003ca9/picture-1.jpg v1059>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.959 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.924+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003caf [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-9.xml auth{0=1} v1069 ap=1 s=7732 n(v0 rc2024-09-05T01:27:32.879690+0000 b7732 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53895a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003caf:[<0x10000003ca9/article-9.xml v1069>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003caf:[<0x10000003ca9/article-9.xml v1069>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.959 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.924+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cd4 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-6.jpg auth{0=1} v1061 ap=1 s=25319 n(v0 rc2024-09-05T01:27:33.000688+0000 b25319 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53895a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cd4:[<0x10000003ca9/picture-6.jpg v1061>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cd4:[<0x10000003ca9/picture-6.jpg v1061>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.960 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.925+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cbe [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-28.jpg auth{0=1} v510 ap=1 s=51371 n(v0 rc2024-09-05T01:27:32.947689+0000 b51371 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538965080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cbe:[<0x10000003ca9/picture-28.jpg v510>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cbe:[<0x10000003ca9/picture-28.jpg v510>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.960 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.926+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cc9 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-17.jpg auth{0=1} v520 ap=1 s=45296 n(v0 rc2024-09-05T01:27:32.974689+0000 b45296 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538966100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cc9:[<0x10000003ca9/picture-17.jpg v520>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cc9:[<0x10000003ca9/picture-17.jpg v520>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.960 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.926+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cb5 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-3.xml auth{0=1} v1065 ap=1 s=32303 n(v0 rc2024-09-05T01:27:32.913689+0000 b32303 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538966680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cb5:[<0x10000003ca9/article-3.xml v1065>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cb5:[<0x10000003ca9/article-3.xml v1065>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.960 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.926+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cc2 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-24.jpg auth{0=1} v498 ap=1 s=17059 n(v0 rc2024-09-05T01:27:32.957689+0000 b17059 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538966c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cc2:[<0x10000003ca9/picture-24.jpg v498>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cc2:[<0x10000003ca9/picture-24.jpg v498>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.960 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.926+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cb9 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-33.jpg auth{0=1} v494 ap=1 s=59073 n(v0 rc2024-09-05T01:27:32.929689+0000 b59073 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538967180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cb9:[<0x10000003ca9/picture-33.jpg v494>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cb9:[<0x10000003ca9/picture-33.jpg v494>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.960 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.927+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cb1 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-7.xml auth{0=1} v1067 ap=1 s=23783 n(v0 rc2024-09-05T01:27:32.890689+0000 b23783 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538967700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cb1:[<0x10000003ca9/article-7.xml v1067>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cb1:[<0x10000003ca9/article-7.xml v1067>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.960 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.927+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cc1 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-25.jpg auth{0=1} v516 ap=1 s=37619 n(v0 rc2024-09-05T01:27:32.955689+0000 b37619 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538976100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cc1:[<0x10000003ca9/picture-25.jpg v516>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cc1:[<0x10000003ca9/picture-25.jpg v516>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.960 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.927+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cb0 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-8.xml auth{0=1} v1073 ap=1 s=23243 n(v0 rc2024-09-05T01:27:32.881689+0000 b23243 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538976680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cb0:[<0x10000003ca9/article-8.xml v1073>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cb0:[<0x10000003ca9/article-8.xml v1073>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.960 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.928+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cbb [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-31.jpg auth{0=1} v506 ap=1 s=58983 n(v0 rc2024-09-05T01:27:32.936689+0000 b58983 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538977700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cbb:[<0x10000003ca9/picture-31.jpg v506>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cbb:[<0x10000003ca9/picture-31.jpg v506>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.960 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.928+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cd2 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-8.jpg auth{0=1} v1067 ap=1 s=33479 n(v0 rc2024-09-05T01:27:32.996688+0000 b33479 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53897e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cd2:[<0x10000003ca9/picture-8.jpg v1067>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cd2:[<0x10000003ca9/picture-8.jpg v1067>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.960 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.929+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cc0 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-26.jpg auth{0=1} v492 ap=1 s=21524 n(v0 rc2024-09-05T01:27:32.952689+0000 b21524 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53897eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cc0:[<0x10000003ca9/picture-26.jpg v492>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cc0:[<0x10000003ca9/picture-26.jpg v492>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.960 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.929+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cab [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-13.xml auth{0=1} v1075 ap=1 s=3409 n(v0 rc2024-09-05T01:27:32.868690+0000 b3409 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538980c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cab:[<0x10000003ca9/article-13.xml v1075>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cab:[<0x10000003ca9/article-13.xml v1075>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.961 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.930+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cb2 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-6.xml auth{0=1} v1071 ap=1 s=9725 n(v0 rc2024-09-05T01:27:32.897689+0000 b9725 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53898d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cb2:[<0x10000003ca9/article-6.xml v1071>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cb2:[<0x10000003ca9/article-6.xml v1071>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.961 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.930+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cb6 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-2.xml auth{0=1} v1069 ap=1 s=4751 n(v0 rc2024-09-05T01:27:32.916689+0000 b4751 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53898d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cb6:[<0x10000003ca9/article-2.xml v1069>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cb6:[<0x10000003ca9/article-2.xml v1069>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.961 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.931+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cbd [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-29.jpg auth{0=1} v512 ap=1 s=9858 n(v0 rc2024-09-05T01:27:32.944689+0000 b9858 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53898f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cbd:[<0x10000003ca9/picture-29.jpg v512>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cbd:[<0x10000003ca9/picture-29.jpg v512>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.961 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.932+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cd5 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-5.jpg auth{0=1} v1075 ap=1 s=23783 n(v0 rc2024-09-05T01:27:33.002688+0000 b23783 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538999180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cd5:[<0x10000003ca9/picture-5.jpg v1075>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cd5:[<0x10000003ca9/picture-5.jpg v1075>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.961 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.935+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ccf [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-11.jpg auth{0=1} v1086 ap=1 s=59709 n(v0 rc2024-09-05T01:27:32.989689+0000 b59709 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5389bf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ccf:[<0x10000003ca9/picture-11.jpg v1086>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003ccf:[<0x10000003ca9/picture-11.jpg v1086>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.961 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.935+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cb3 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-5.xml auth{0=1} v1088 ap=1 s=7931 n(v0 rc2024-09-05T01:27:32.906689+0000 b7931 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5389bf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cb3:[<0x10000003ca9/article-5.xml v1088>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cb3:[<0x10000003ca9/article-5.xml v1088>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.961 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.936+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cc3 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-23.jpg auth{0=1} v514 ap=1 s=19836 n(v0 rc2024-09-05T01:27:32.959689+0000 b19836 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5389d8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cc3:[<0x10000003ca9/picture-23.jpg v514>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cc3:[<0x10000003ca9/picture-23.jpg v514>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.961 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.936+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003caa [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-14.xml auth{0=1} v1014 ap=1 s=1818 n(v0 rc2024-09-05T01:27:32.863690+0000 b1818 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5389d8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003caa:[<0x10000003ca9/article-14.xml v1014>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003caa:[<0x10000003ca9/article-14.xml v1014>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.961 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.937+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cc4 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-22.jpg auth{0=1} v528 ap=1 s=15603 n(v0 rc2024-09-05T01:27:32.961689+0000 b15603 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5389d9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cc4:[<0x10000003ca9/picture-22.jpg v528>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cc4:[<0x10000003ca9/picture-22.jpg v528>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.961 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.937+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cad [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-11.xml auth{0=1} v1012 ap=1 s=21295 n(v0 rc2024-09-05T01:27:32.874690+0000 b21295 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5389d9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cad:[<0x10000003ca9/article-11.xml v1012>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cad:[<0x10000003ca9/article-11.xml v1012>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.961 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.937+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003ccb [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-15.jpg auth{0=1} v1006 ap=1 s=44571 n(v0 rc2024-09-05T01:27:32.980689+0000 b44571 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5389dac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003ccb:[<0x10000003ca9/picture-15.jpg v1006>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003ccb:[<0x10000003ca9/picture-15.jpg v1006>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.961 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.938+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cae [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-10.xml auth{0=1} v1010 ap=1 s=28437 n(v0 rc2024-09-05T01:27:32.876690+0000 b28437 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5389db180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cae:[<0x10000003ca9/article-10.xml v1010>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cae:[<0x10000003ca9/article-10.xml v1010>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.962 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.938+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cce [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-12.jpg auth{0=1} v1004 ap=1 s=42498 n(v0 rc2024-09-05T01:27:32.987689+0000 b42498 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5389db700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cce:[<0x10000003ca9/picture-12.jpg v1004>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cce:[<0x10000003ca9/picture-12.jpg v1004>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.962 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.938+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cb4 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-4.xml auth{0=1} v1008 ap=1 s=18915 n(v0 rc2024-09-05T01:27:32.910689+0000 b18915 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5389e4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cb4:[<0x10000003ca9/article-4.xml v1008>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cb4:[<0x10000003ca9/article-4.xml v1008>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.962 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.939+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cc5 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-21.jpg auth{0=1} v504 ap=1 s=25606 n(v0 rc2024-09-05T01:27:32.963689+0000 b25606 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5389e6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cc5:[<0x10000003ca9/picture-21.jpg v504>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cc5:[<0x10000003ca9/picture-21.jpg v504>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.962 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.940+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cbc [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-30.jpg auth{0=1} v522 ap=1 s=35581 n(v0 rc2024-09-05T01:27:32.940689+0000 b35581 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5389f2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cbc:[<0x10000003ca9/picture-30.jpg v522>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cbc:[<0x10000003ca9/picture-30.jpg v522>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.962 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.941+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cc6 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-20.jpg auth{0=1} v524 ap=1 s=33944 n(v0 rc2024-09-05T01:27:32.967689+0000 b33944 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5389f5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cc6:[<0x10000003ca9/picture-20.jpg v524>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cc6:[<0x10000003ca9/picture-20.jpg v524>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.962 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.943+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cbf [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-27.jpg auth{0=1} v502 ap=1 s=40815 n(v0 rc2024-09-05T01:27:32.950689+0000 b40815 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538a0eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cbf:[<0x10000003ca9/picture-27.jpg v502>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cbf:[<0x10000003ca9/picture-27.jpg v502>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.962 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.943+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cac [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-12.xml auth{0=1} v1076 ap=1 s=4609 n(v0 rc2024-09-05T01:27:32.872690+0000 b4609 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538a0fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cac:[<0x10000003ca9/article-12.xml v1076>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cac:[<0x10000003ca9/article-12.xml v1076>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.962 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.944+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cb7 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-1.xml auth{0=1} v1074 ap=1 s=12958 n(v0 rc2024-09-05T01:27:32.919689+0000 b12958 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c538a10100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cb7:[<0x10000003ca9/article-1.xml v1074>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cb7:[<0x10000003ca9/article-1.xml v1074>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.962 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.944+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cb8 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-34.jpg auth{0=1} v496 ap=1 s=41883 n(v0 rc2024-09-05T01:27:32.923689+0000 b41883 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538a11180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cb8:[<0x10000003ca9/picture-34.jpg v496>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cb8:[<0x10000003ca9/picture-34.jpg v496>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:28.962 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.944+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cca [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-16.jpg auth{0=1} v508 ap=1 s=36025 n(v0 rc2024-09-05T01:27:32.976689+0000 b36025 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538a19b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cca:[<0x10000003ca9/picture-16.jpg v508>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cca:[<0x10000003ca9/picture-16.jpg v508>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.334 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:28.946+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003cba [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-32.jpg auth{0=1} v500 ap=1 s=9271 n(v0 rc2024-09-05T01:27:32.932689+0000 b9271 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c538a24b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003cba:[<0x10000003ca9/picture-32.jpg v500>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003cba:[<0x10000003ca9/picture-32.jpg v500>,<0x10000000399/blog-139 v214289>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.334 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.079+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c0a [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-13.jpg auth{0=1} v813 ap=1 s=22967 n(v0 rc2024-09-05T01:27:31.506702+0000 b22967 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53903e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c0a:[<0x10000003bb0/picture-13.jpg v813>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c0a:[<0x10000003bb0/picture-13.jpg v813>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: pgmap v336: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 563 op/s 2024-09-05T01:35:29.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039c6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039c1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039bf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039cf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039d1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039a7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039c5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039cc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003974 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-61.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039ca (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000396e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-64.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039c9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039d2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003940 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-9.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.335 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039cd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.336 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.080+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c05 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-18.jpg auth{0=1} v817 ap=1 s=38154 n(v0 rc2024-09-05T01:27:31.460703+0000 b38154 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53903eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c05:[<0x10000003bb0/picture-18.jpg v817>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c05:[<0x10000003bb0/picture-18.jpg v817>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.336 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.080+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bcc [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-18.xml auth{0=1} v823 ap=1 s=2162 n(v0 rc2024-09-05T01:27:30.966707+0000 b2162 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53903f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bcc:[<0x10000003bb0/article-18.xml v823>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bcc:[<0x10000003bb0/article-18.xml v823>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039b2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039a4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039c2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000394a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-3.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.336 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039b7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039aa (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000397e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000399b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003944 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-7.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003963 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-68.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039a1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039b6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003942 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-8.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039ad (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000398e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039cb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.337 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039b5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.338 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.080+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c04 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-19.jpg auth{0=1} v819 ap=1 s=20904 n(v0 rc2024-09-05T01:27:31.456703+0000 b20904 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53903fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c04:[<0x10000003bb0/picture-19.jpg v819>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c04:[<0x10000003bb0/picture-19.jpg v819>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.338 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.080+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bc3 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-27.xml auth{0=1} v827 ap=1 s=7865 n(v0 rc2024-09-05T01:27:30.901708+0000 b7865 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c539040680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bc3:[<0x10000003bb0/article-27.xml v827>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bc3:[<0x10000003bb0/article-27.xml v827>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.338 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.081+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c19 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-4.jpg auth{0=1} v807 ap=1 s=32234 n(v0 rc2024-09-05T01:27:31.551702+0000 b32234 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c539040c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c19:[<0x10000003bb0/picture-4.jpg v807>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c19:[<0x10000003bb0/picture-4.jpg v807>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.338 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.081+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bf4 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-35.jpg auth{0=1} v821 ap=1 s=53694 n(v0 rc2024-09-05T01:27:31.377703+0000 b53694 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c539041180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bf4:[<0x10000003bb0/picture-35.jpg v821>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bf4:[<0x10000003bb0/picture-35.jpg v821>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.338 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.081+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c1b [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-2.jpg auth{0=1} v805 ap=1 s=41617 n(v0 rc2024-09-05T01:27:31.556702+0000 b41617 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c539041700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c1b:[<0x10000003bb0/picture-2.jpg v805>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c1b:[<0x10000003bb0/picture-2.jpg v805>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.338 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000393a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-13.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.338 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003946 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-6.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.338 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000394c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-2.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.338 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003981 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.339 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039b0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.339 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039ce (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.339 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000398b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.339 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000397c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.339 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000396a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-65.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.339 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003961 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-69.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.339 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003989 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.339 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003972 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-62.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.339 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003995 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.339 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039d0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.339 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003980 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.339 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039c8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.340 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.081+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bca [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-20.xml auth{0=1} v825 ap=1 s=18402 n(v0 rc2024-09-05T01:27:30.928708+0000 b18402 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53904c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bca:[<0x10000003bb0/article-20.xml v825>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bca:[<0x10000003bb0/article-20.xml v825>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.340 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.081+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c09 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-14.jpg auth{0=1} v815 ap=1 s=29355 n(v0 rc2024-09-05T01:27:31.499702+0000 b29355 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53904c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c09:[<0x10000003bb0/picture-14.jpg v815>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c09:[<0x10000003bb0/picture-14.jpg v815>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.340 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.081+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bb5 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-41.xml auth{0=1} v831 ap=1 s=9838 n(v0 rc2024-09-05T01:27:30.798709+0000 b9838 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53904cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bb5:[<0x10000003bb0/article-41.xml v831>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bb5:[<0x10000003bb0/article-41.xml v831>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.340 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.082+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c16 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-7.jpg auth{0=1} v809 ap=1 s=21949 n(v0 rc2024-09-05T01:27:31.542702+0000 b21949 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53904db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c16:[<0x10000003bb0/picture-7.jpg v809>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c16:[<0x10000003bb0/picture-7.jpg v809>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.340 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.082+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bbf [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-31.xml auth{0=1} v829 ap=1 s=8531 n(v0 rc2024-09-05T01:27:30.891708+0000 b8531 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53904e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bbf:[<0x10000003bb0/article-31.xml v829>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bbf:[<0x10000003bb0/article-31.xml v829>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.340 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000395c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-70.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.340 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003970 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-63.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.341 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000395a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-71.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.341 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000399f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.341 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039b9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.341 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003938 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-14.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.341 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003997 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.341 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000399d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.341 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003979 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.341 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003967 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-66.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.341 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039ba (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.341 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000393e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-11.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.341 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003934 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-16.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.341 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039c4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.341 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000397f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.342 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003993 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.342 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.082+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c14 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-9.jpg auth{0=1} v811 ap=1 s=48174 n(v0 rc2024-09-05T01:27:31.534702+0000 b48174 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c53904e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c14:[<0x10000003bb0/picture-9.jpg v811>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c14:[<0x10000003bb0/picture-9.jpg v811>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.342 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.083+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c13 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-10.jpg auth{0=1} v834 ap=1 s=46400 n(v0 rc2024-09-05T01:27:31.530702+0000 b46400 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539058580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c13:[<0x10000003bb0/picture-10.jpg v834>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c13:[<0x10000003bb0/picture-10.jpg v834>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.342 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.083+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c1c [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-1.jpg auth{0=1} v830 ap=1 s=16366 n(v0 rc2024-09-05T01:27:31.558702+0000 b16366 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539058b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c1c:[<0x10000003bb0/picture-1.jpg v830>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c1c:[<0x10000003bb0/picture-1.jpg v830>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.342 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.084+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bd5 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-9.xml auth{0=1} v854 ap=1 s=30607 n(v0 rc2024-09-05T01:27:31.033707+0000 b30607 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539059600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bd5:[<0x10000003bb0/article-9.xml v854>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bd5:[<0x10000003bb0/article-9.xml v854>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.342 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.084+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bb2 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-44.xml auth{0=1} v858 ap=1 s=20181 n(v0 rc2024-09-05T01:27:30.759709+0000 b20181 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539059b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bb2:[<0x10000003bb0/article-44.xml v858>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bb2:[<0x10000003bb0/article-44.xml v858>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.343 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000393f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-10.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.343 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039c7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.343 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003958 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-72.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.343 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003948 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-4.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.343 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003999 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.343 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003956 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-73.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.343 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039bc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.343 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003952 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-75.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.343 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039af (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.343 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003936 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-15.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.343 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039a5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.343 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000399a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.343 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039bd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.343 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039a2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.343 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039b3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.344 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000393c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-12.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.344 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003984 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.344 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.084+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c17 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-6.jpg auth{0=1} v832 ap=1 s=63741 n(v0 rc2024-09-05T01:27:31.544702+0000 b63741 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53905a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c17:[<0x10000003bb0/picture-6.jpg v832>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c17:[<0x10000003bb0/picture-6.jpg v832>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.344 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.084+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bc6 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-24.xml auth{0=1} v856 ap=1 s=8779 n(v0 rc2024-09-05T01:27:30.919708+0000 b8779 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53905b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bc6:[<0x10000003bb0/article-24.xml v856>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bc6:[<0x10000003bb0/article-24.xml v856>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.344 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.085+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bfb [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-28.jpg auth{0=1} v840 ap=1 s=62813 n(v0 rc2024-09-05T01:27:31.416703+0000 b62813 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539066580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bfb:[<0x10000003bb0/picture-28.jpg v840>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bfb:[<0x10000003bb0/picture-28.jpg v840>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.344 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.086+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bf2 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-37.jpg auth{0=1} v844 ap=1 s=14326 n(v0 rc2024-09-05T01:27:31.367703+0000 b14326 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539067b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bf2:[<0x10000003bb0/picture-37.jpg v844>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bf2:[<0x10000003bb0/picture-37.jpg v844>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.344 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.086+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c06 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-17.jpg auth{0=1} v836 ap=1 s=19475 n(v0 rc2024-09-05T01:27:31.463703+0000 b19475 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539068100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c06:[<0x10000003bb0/picture-17.jpg v836>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c06:[<0x10000003bb0/picture-17.jpg v836>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.345 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000394e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.345 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039a9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.345 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003983 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.345 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003965 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-67.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.345 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039c3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.345 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003954 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-74.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.345 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003932 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-17.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.345 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003950 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-76.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.345 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000039ac (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.345 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003991 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.345 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:29.345 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: scrub summary: active paths [/] 2024-09-05T01:35:29.346 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c77 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.346 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c72 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.346 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c29 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-18.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.346 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c71 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.346 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c20 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-27.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.346 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c80 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.346 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.086+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bff [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-24.jpg auth{0=1} v838 ap=1 s=55412 n(v0 rc2024-09-05T01:27:31.437703+0000 b55412 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539068c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bff:[<0x10000003bb0/picture-24.jpg v838>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bff:[<0x10000003bb0/picture-24.jpg v838>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.346 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.086+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bde [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-57.jpg auth{0=1} v648 ap=1 s=15956 n(v0 rc2024-09-05T01:27:31.072706+0000 b15956 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539069700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bde:[<0x10000003bb0/picture-57.jpg v648>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bde:[<0x10000003bb0/picture-57.jpg v648>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.347 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c61 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.347 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c82 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.347 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c27 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-20.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.347 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c76 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.347 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c47 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-61.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.347 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c7d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.347 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c12 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-31.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.347 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c7b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.351 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.086+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bf6 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-33.jpg auth{0=1} v842 ap=1 s=55384 n(v0 rc2024-09-05T01:27:31.386703+0000 b55384 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539069180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bf6:[<0x10000003bb0/picture-33.jpg v842>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bf6:[<0x10000003bb0/picture-33.jpg v842>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.351 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.086+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bdb [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-3.xml auth{0=1} v850 ap=1 s=5334 n(v0 rc2024-09-05T01:27:31.053706+0000 b5334 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539068680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bdb:[<0x10000003bb0/article-3.xml v850>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bdb:[<0x10000003bb0/article-3.xml v850>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.351 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.087+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bd7 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-7.xml auth{0=1} v852 ap=1 s=2700 n(v0 rc2024-09-05T01:27:31.044706+0000 b2700 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539072000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bd7:[<0x10000003bb0/article-7.xml v852>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bd7:[<0x10000003bb0/article-7.xml v852>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.351 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.087+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bed [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-42.jpg auth{0=1} v848 ap=1 s=22136 n(v0 rc2024-09-05T01:27:31.347704+0000 b22136 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539072580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bed:[<0x10000003bb0/picture-42.jpg v848>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bed:[<0x10000003bb0/picture-42.jpg v848>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.351 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.087+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bf0 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-39.jpg auth{0=1} v846 ap=1 s=52097 n(v0 rc2024-09-05T01:27:31.361704+0000 b52097 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539072b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bf0:[<0x10000003bb0/picture-39.jpg v846>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bf0:[<0x10000003bb0/picture-39.jpg v846>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.351 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.088+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bd6 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-8.xml auth{0=1} v851 ap=1 s=8251 n(v0 rc2024-09-05T01:27:31.042706+0000 b8251 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539074680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bd6:[<0x10000003bb0/article-8.xml v851>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bd6:[<0x10000003bb0/article-8.xml v851>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.351 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.088+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bf8 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-31.jpg auth{0=1} v845 ap=1 s=49442 n(v0 rc2024-09-05T01:27:31.406703+0000 b49442 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539075700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bf8:[<0x10000003bb0/picture-31.jpg v845>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bf8:[<0x10000003bb0/picture-31.jpg v845>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.351 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.088+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003be6 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-49.jpg auth{0=1} v640 ap=1 s=45361 n(v0 rc2024-09-05T01:27:31.184705+0000 b45361 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53907e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003be6:[<0x10000003bb0/picture-49.jpg v640>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003be6:[<0x10000003bb0/picture-49.jpg v640>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.352 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.089+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c15 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-8.jpg auth{0=1} v839 ap=1 s=51757 n(v0 rc2024-09-05T01:27:31.537702+0000 b51757 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53907eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c15:[<0x10000003bb0/picture-8.jpg v839>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c15:[<0x10000003bb0/picture-8.jpg v839>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.352 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.089+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bfd [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-26.jpg auth{0=1} v841 ap=1 s=10609 n(v0 rc2024-09-05T01:27:31.432703+0000 b10609 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53907f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bfd:[<0x10000003bb0/picture-26.jpg v841>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bfd:[<0x10000003bb0/picture-26.jpg v841>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.352 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.089+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bbe [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-32.xml auth{0=1} v859 ap=1 s=29216 n(v0 rc2024-09-05T01:27:30.889708+0000 b29216 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53907f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bbe:[<0x10000003bb0/article-32.xml v859>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bbe:[<0x10000003bb0/article-32.xml v859>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.352 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.089+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bc9 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-21.xml auth{0=1} v855 ap=1 s=19406 n(v0 rc2024-09-05T01:27:30.926708+0000 b19406 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539080680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bc9:[<0x10000003bb0/article-21.xml v855>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bc9:[<0x10000003bb0/article-21.xml v855>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.352 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.090+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bc0 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-30.xml auth{0=1} v857 ap=1 s=12724 n(v0 rc2024-09-05T01:27:30.893708+0000 b12724 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539080c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bc0:[<0x10000003bb0/article-30.xml v857>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bc0:[<0x10000003bb0/article-30.xml v857>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.352 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.090+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bd1 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-13.xml auth{0=1} v853 ap=1 s=32735 n(v0 rc2024-09-05T01:27:31.001707+0000 b32735 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53908eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bd1:[<0x10000003bb0/article-13.xml v853>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bd1:[<0x10000003bb0/article-13.xml v853>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.352 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.091+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bd8 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-6.xml auth{0=1} v849 ap=1 s=4310 n(v0 rc2024-09-05T01:27:31.047706+0000 b4310 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539090100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bd8:[<0x10000003bb0/article-6.xml v849>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bd8:[<0x10000003bb0/article-6.xml v849>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.352 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.091+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bdc [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-2.xml auth{0=1} v847 ap=1 s=7181 n(v0 rc2024-09-05T01:27:31.056706+0000 b7181 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539090680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bdc:[<0x10000003bb0/article-2.xml v847>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bdc:[<0x10000003bb0/article-2.xml v847>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.352 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.092+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003be1 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-54.jpg auth{0=1} v638 ap=1 s=64929 n(v0 rc2024-09-05T01:27:31.114706+0000 b64929 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539091700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003be1:[<0x10000003bb0/picture-54.jpg v638>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003be1:[<0x10000003bb0/picture-54.jpg v638>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.352 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.092+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bfa [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-29.jpg auth{0=1} v843 ap=1 s=37693 n(v0 rc2024-09-05T01:27:31.413703+0000 b37693 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539098000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bfa:[<0x10000003bb0/picture-29.jpg v843>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bfa:[<0x10000003bb0/picture-29.jpg v843>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.352 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.093+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bb3 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-43.xml auth{0=1} v829 ap=1 s=14022 n(v0 rc2024-09-05T01:27:30.791709+0000 b14022 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539099b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bb3:[<0x10000003bb0/article-43.xml v829>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bb3:[<0x10000003bb0/article-43.xml v829>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.353 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.093+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bbd [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-33.xml auth{0=1} v827 ap=1 s=11340 n(v0 rc2024-09-05T01:27:30.887708+0000 b11340 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53909a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bbd:[<0x10000003bb0/article-33.xml v827>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bbd:[<0x10000003bb0/article-33.xml v827>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.353 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.093+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c18 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-5.jpg auth{0=1} v821 ap=1 s=26019 n(v0 rc2024-09-05T01:27:31.547702+0000 b26019 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53909a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c18:[<0x10000003bb0/picture-5.jpg v821>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c18:[<0x10000003bb0/picture-5.jpg v821>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.353 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.093+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003be5 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-50.jpg auth{0=1} v627 ap=1 s=10050 n(v0 rc2024-09-05T01:27:31.178705+0000 b10050 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53909b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003be5:[<0x10000003bb0/picture-50.jpg v627>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003be5:[<0x10000003bb0/picture-50.jpg v627>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.353 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.094+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000455b [6,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-53.xml auth{0=1} v633 ap=1 s=6480 n(v0 rc2024-09-05T01:27:50.946523+0000 b6480 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390a7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000455b:[<0x10000003bb0/article-53.xml v633>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2924>,<0x10000000201/src v2562>,<0x10000000006/blogbench-1.0 v2145>,<0x10000000005/tmp v731>,<0x100000001fb/client.0 v739>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v711>,<0x10000000001/sv_1 v750>,<0x10000000000/qa v707>,<0x1/volumes v721>]//[]","memoryvalue":"(3)0x1000000455b:[<0x10000003bb0/article-53.xml v633>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.353 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.095+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bc2 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-28.xml auth{0=1} v825 ap=1 s=15387 n(v0 rc2024-09-05T01:27:30.899708+0000 b15387 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390a8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bc2:[<0x10000003bb0/article-28.xml v825>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bc2:[<0x10000003bb0/article-28.xml v825>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.353 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.095+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003be4 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-51.jpg auth{0=1} v629 ap=1 s=65342 n(v0 rc2024-09-05T01:27:31.161705+0000 b65342 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390a9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003be4:[<0x10000003bb0/picture-51.jpg v629>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003be4:[<0x10000003bb0/picture-51.jpg v629>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.353 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.096+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003be9 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-46.jpg auth{0=1} v823 ap=1 s=38937 n(v0 rc2024-09-05T01:27:31.256704+0000 b38937 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390b6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003be9:[<0x10000003bb0/picture-46.jpg v823>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003be9:[<0x10000003bb0/picture-46.jpg v823>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.353 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.096+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c1a [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-3.jpg auth{0=1} v837 ap=1 s=32607 n(v0 rc2024-09-05T01:27:31.553702+0000 b32607 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390b7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c1a:[<0x10000003bb0/picture-3.jpg v837>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c1a:[<0x10000003bb0/picture-3.jpg v837>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.353 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.097+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003be0 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-55.jpg auth{0=1} v628 ap=1 s=22359 n(v0 rc2024-09-05T01:27:31.096706+0000 b22359 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390b8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003be0:[<0x10000003bb0/picture-55.jpg v628>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003be0:[<0x10000003bb0/picture-55.jpg v628>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.353 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.097+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bd9 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-5.xml auth{0=1} v841 ap=1 s=28955 n(v0 rc2024-09-05T01:27:31.049706+0000 b28955 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390c0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bd9:[<0x10000003bb0/article-5.xml v841>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bd9:[<0x10000003bb0/article-5.xml v841>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.353 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.097+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bbc [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-34.xml auth{0=1} v847 ap=1 s=15663 n(v0 rc2024-09-05T01:27:30.885708+0000 b15663 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390c0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bbc:[<0x10000003bb0/article-34.xml v847>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bbc:[<0x10000003bb0/article-34.xml v847>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.354 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.098+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bc1 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-29.xml auth{0=1} v845 ap=1 s=14600 n(v0 rc2024-09-05T01:27:30.895708+0000 b14600 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390c2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bc1:[<0x10000003bb0/article-29.xml v845>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bc1:[<0x10000003bb0/article-29.xml v845>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.354 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.098+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bef [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-40.jpg auth{0=1} v839 ap=1 s=27482 n(v0 rc2024-09-05T01:27:31.356704+0000 b27482 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390c2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bef:[<0x10000003bb0/picture-40.jpg v839>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bef:[<0x10000003bb0/picture-40.jpg v839>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.354 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.098+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bc8 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-22.xml auth{0=1} v843 ap=1 s=9909 n(v0 rc2024-09-05T01:27:30.924708+0000 b9909 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390c3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bc8:[<0x10000003bb0/article-22.xml v843>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bc8:[<0x10000003bb0/article-22.xml v843>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.354 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.099+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c00 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-23.jpg auth{0=1} v828 ap=1 s=43898 n(v0 rc2024-09-05T01:27:31.440703+0000 b43898 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390d1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c00:[<0x10000003bb0/picture-23.jpg v828>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c00:[<0x10000003bb0/picture-23.jpg v828>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.354 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.099+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bd0 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-14.xml auth{0=1} v842 ap=1 s=16566 n(v0 rc2024-09-05T01:27:30.998707+0000 b16566 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390d1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bd0:[<0x10000003bb0/article-14.xml v842>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bd0:[<0x10000003bb0/article-14.xml v842>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.354 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.100+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bea [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-45.jpg auth{0=1} v834 ap=1 s=55742 n(v0 rc2024-09-05T01:27:31.275704+0000 b55742 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390d1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bea:[<0x10000003bb0/picture-45.jpg v834>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bea:[<0x10000003bb0/picture-45.jpg v834>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.354 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.100+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bee [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-41.jpg auth{0=1} v830 ap=1 s=16051 n(v0 rc2024-09-05T01:27:31.352704+0000 b16051 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390d2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bee:[<0x10000003bb0/picture-41.jpg v830>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bee:[<0x10000003bb0/picture-41.jpg v830>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.354 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.100+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c01 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-22.jpg auth{0=1} v826 ap=1 s=56629 n(v0 rc2024-09-05T01:27:31.445703+0000 b56629 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390d2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c01:[<0x10000003bb0/picture-22.jpg v826>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c01:[<0x10000003bb0/picture-22.jpg v826>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.354 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.100+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bd3 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-11.xml auth{0=1} v840 ap=1 s=6058 n(v0 rc2024-09-05T01:27:31.010707+0000 b6058 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390d3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bd3:[<0x10000003bb0/article-11.xml v840>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bd3:[<0x10000003bb0/article-11.xml v840>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.354 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.101+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bce [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-16.xml auth{0=1} v844 ap=1 s=8344 n(v0 rc2024-09-05T01:27:30.992707+0000 b8344 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390de000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bce:[<0x10000003bb0/article-16.xml v844>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bce:[<0x10000003bb0/article-16.xml v844>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.354 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.101+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bdf [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-56.jpg auth{0=1} v620 ap=1 s=32915 n(v0 rc2024-09-05T01:27:31.079706+0000 b32915 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390df600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bdf:[<0x10000003bb0/picture-56.jpg v620>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bdf:[<0x10000003bb0/picture-56.jpg v620>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.354 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.101+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bc4 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-26.xml auth{0=1} v848 ap=1 s=4602 n(v0 rc2024-09-05T01:27:30.906708+0000 b4602 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390deb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bc4:[<0x10000003bb0/article-26.xml v848>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bc4:[<0x10000003bb0/article-26.xml v848>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.354 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.101+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c08 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-15.jpg auth{0=1} v824 ap=1 s=42585 n(v0 rc2024-09-05T01:27:31.494702+0000 b42585 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390df080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c08:[<0x10000003bb0/picture-15.jpg v824>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c08:[<0x10000003bb0/picture-15.jpg v824>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.355 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.102+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003be8 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-47.jpg auth{0=1} v642 ap=1 s=57562 n(v0 rc2024-09-05T01:27:31.228705+0000 b57562 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390dfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003be8:[<0x10000003bb0/picture-47.jpg v642>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003be8:[<0x10000003bb0/picture-47.jpg v642>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.355 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.102+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bd4 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-10.xml auth{0=1} v838 ap=1 s=1316 n(v0 rc2024-09-05T01:27:31.013707+0000 b1316 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390e0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bd4:[<0x10000003bb0/article-10.xml v838>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bd4:[<0x10000003bb0/article-10.xml v838>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.355 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.102+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c0b [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-12.jpg auth{0=1} v822 ap=1 s=51362 n(v0 rc2024-09-05T01:27:31.517702+0000 b51362 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390e0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c0b:[<0x10000003bb0/picture-12.jpg v822>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c0b:[<0x10000003bb0/picture-12.jpg v822>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.355 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.102+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003beb [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-44.jpg auth{0=1} v832 ap=1 s=33754 n(v0 rc2024-09-05T01:27:31.302704+0000 b33754 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390e0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003beb:[<0x10000003bb0/picture-44.jpg v832>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003beb:[<0x10000003bb0/picture-44.jpg v832>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.355 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.103+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bc5 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-25.xml auth{0=1} v846 ap=1 s=26173 n(v0 rc2024-09-05T01:27:30.917708+0000 b26173 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390ecb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bc5:[<0x10000003bb0/article-25.xml v846>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bc5:[<0x10000003bb0/article-25.xml v846>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.355 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.103+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bda [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-4.xml auth{0=1} v836 ap=1 s=19022 n(v0 rc2024-09-05T01:27:31.051706+0000 b19022 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390ec580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bda:[<0x10000003bb0/article-4.xml v836>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bda:[<0x10000003bb0/article-4.xml v836>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.355 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.103+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bb8 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-38.xml auth{0=1} v850 ap=1 s=9567 n(v0 rc2024-09-05T01:27:30.845708+0000 b9567 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c5390ed080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bb8:[<0x10000003bb0/article-38.xml v850>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bb8:[<0x10000003bb0/article-38.xml v850>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.355 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.104+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c02 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-21.jpg auth{0=1} v839 ap=1 s=36362 n(v0 rc2024-09-05T01:27:31.450703+0000 b36362 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5390edb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c02:[<0x10000003bb0/picture-21.jpg v839>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c02:[<0x10000003bb0/picture-21.jpg v839>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.355 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.104+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bbb [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-35.xml auth{0=1} v853 ap=1 s=2992 n(v0 rc2024-09-05T01:27:30.877708+0000 b2992 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5390ee100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bbb:[<0x10000003bb0/article-35.xml v853>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bbb:[<0x10000003bb0/article-35.xml v853>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.355 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.105+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bb6 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-40.xml auth{0=1} v855 ap=1 s=14015 n(v0 rc2024-09-05T01:27:30.801709+0000 b14015 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5390fa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bb6:[<0x10000003bb0/article-40.xml v855>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bb6:[<0x10000003bb0/article-40.xml v855>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.355 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.105+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bf9 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-30.jpg auth{0=1} v841 ap=1 s=13904 n(v0 rc2024-09-05T01:27:31.409703+0000 b13904 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5390fa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bf9:[<0x10000003bb0/picture-30.jpg v841>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bf9:[<0x10000003bb0/picture-30.jpg v841>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.355 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.105+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bcf [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-15.xml auth{0=1} v849 ap=1 s=3616 n(v0 rc2024-09-05T01:27:30.995707+0000 b3616 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5390fb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bcf:[<0x10000003bb0/article-15.xml v849>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bcf:[<0x10000003bb0/article-15.xml v849>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.355 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.106+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bf3 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-36.jpg auth{0=1} v843 ap=1 s=33789 n(v0 rc2024-09-05T01:27:31.372703+0000 b33789 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5390fd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bf3:[<0x10000003bb0/picture-36.jpg v843>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bf3:[<0x10000003bb0/picture-36.jpg v843>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.356 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.106+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bec [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-43.jpg auth{0=1} v847 ap=1 s=55216 n(v0 rc2024-09-05T01:27:31.327704+0000 b55216 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c5390fd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bec:[<0x10000003bb0/picture-43.jpg v847>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bec:[<0x10000003bb0/picture-43.jpg v847>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.356 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.107+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bb4 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-42.xml auth{0=1} v857 ap=1 s=9619 n(v0 rc2024-09-05T01:27:30.795709+0000 b9619 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c539106100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bb4:[<0x10000003bb0/article-42.xml v857>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bb4:[<0x10000003bb0/article-42.xml v857>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.356 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.107+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bf1 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-38.jpg auth{0=1} v845 ap=1 s=48813 n(v0 rc2024-09-05T01:27:31.364703+0000 b48813 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c539106680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bf1:[<0x10000003bb0/picture-38.jpg v845>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bf1:[<0x10000003bb0/picture-38.jpg v845>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.356 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.108+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bb9 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-37.xml auth{0=1} v849 ap=1 s=23617 n(v0 rc2024-09-05T01:27:30.858708+0000 b23617 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53910e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bb9:[<0x10000003bb0/article-37.xml v849>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bb9:[<0x10000003bb0/article-37.xml v849>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.356 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.108+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bfc [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-27.jpg auth{0=1} v835 ap=1 s=14802 n(v0 rc2024-09-05T01:27:31.424703+0000 b14802 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53910e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bfc:[<0x10000003bb0/picture-27.jpg v835>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bfc:[<0x10000003bb0/picture-27.jpg v835>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.356 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.108+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bb7 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-39.xml auth{0=1} v851 ap=1 s=27757 n(v0 rc2024-09-05T01:27:30.806709+0000 b27757 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53910eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bb7:[<0x10000003bb0/article-39.xml v851>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bb7:[<0x10000003bb0/article-39.xml v851>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.356 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.108+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bba [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-36.xml auth{0=1} v847 ap=1 s=21554 n(v0 rc2024-09-05T01:27:30.869708+0000 b21554 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53910f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bba:[<0x10000003bb0/article-36.xml v847>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bba:[<0x10000003bb0/article-36.xml v847>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.356 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.109+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003be3 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-52.jpg auth{0=1} v640 ap=1 s=47104 n(v0 rc2024-09-05T01:27:31.119706+0000 b47104 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539110100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003be3:[<0x10000003bb0/picture-52.jpg v640>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003be3:[<0x10000003bb0/picture-52.jpg v640>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.356 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.109+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bdd [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-1.xml auth{0=1} v841 ap=1 s=20818 n(v0 rc2024-09-05T01:27:31.058706+0000 b20818 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539110680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bdd:[<0x10000003bb0/article-1.xml v841>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bdd:[<0x10000003bb0/article-1.xml v841>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.356 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.109+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bf5 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-34.jpg auth{0=1} v839 ap=1 s=33845 n(v0 rc2024-09-05T01:27:31.383703+0000 b33845 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539111180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bf5:[<0x10000003bb0/picture-34.jpg v839>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bf5:[<0x10000003bb0/picture-34.jpg v839>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.356 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.109+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003be2 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-53.jpg auth{0=1} v636 ap=1 s=29215 n(v0 rc2024-09-05T01:27:31.116706+0000 b29215 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c539111700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003be2:[<0x10000003bb0/picture-53.jpg v636>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003be2:[<0x10000003bb0/picture-53.jpg v636>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.357 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.110+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c07 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-16.jpg auth{0=1} v833 ap=1 s=53360 n(v0 rc2024-09-05T01:27:31.475702+0000 b53360 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53911ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c07:[<0x10000003bb0/picture-16.jpg v833>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c07:[<0x10000003bb0/picture-16.jpg v833>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.357 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.111+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bc7 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-23.xml auth{0=1} v845 ap=1 s=24030 n(v0 rc2024-09-05T01:27:30.922708+0000 b24030 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53911cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bc7:[<0x10000003bb0/article-23.xml v845>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bc7:[<0x10000003bb0/article-23.xml v845>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.357 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.111+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bcd [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-17.xml auth{0=1} v843 ap=1 s=11151 n(v0 rc2024-09-05T01:27:30.979707+0000 b11151 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53911d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bcd:[<0x10000003bb0/article-17.xml v843>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bcd:[<0x10000003bb0/article-17.xml v843>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.357 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.111+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bf7 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-32.jpg auth{0=1} v837 ap=1 s=63672 n(v0 rc2024-09-05T01:27:31.400703+0000 b63672 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53911d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bf7:[<0x10000003bb0/picture-32.jpg v837>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bf7:[<0x10000003bb0/picture-32.jpg v837>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.357 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.111+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003be7 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-48.jpg auth{0=1} v638 ap=1 s=46735 n(v0 rc2024-09-05T01:27:31.203705+0000 b46735 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55c53912a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003be7:[<0x10000003bb0/picture-48.jpg v638>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003be7:[<0x10000003bb0/picture-48.jpg v638>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.357 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.146+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003c03 [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-20.jpg auth{0=1} v837 ap=1 s=22810 n(v0 rc2024-09-05T01:27:31.453703+0000 b22810 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c539104580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003c03:[<0x10000003bb0/picture-20.jpg v837>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003c03:[<0x10000003bb0/picture-20.jpg v837>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.357 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:35:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:35:29.147+0000 7fa3991df640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000003bcb [5,head] /volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-19.xml auth{0=1} v851 ap=1 s=13919 n(v0 rc2024-09-05T01:27:30.957707+0000 b13919 1=1+0) caps={25157=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55c539104000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000003bcb:[<0x10000003bb0/article-19.xml v851>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2901>,<0x10000000201/src v2553>,<0x10000000006/blogbench-1.0 v2136>,<0x10000000005/tmp v723>,<0x100000001fb/client.0 v733>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v705>,<0x10000000001/sv_1 v744>,<0x10000000000/qa v701>,<0x1/volumes v715>]//[]","memoryvalue":"(3)0x10000003bcb:[<0x10000003bb0/article-19.xml v851>,<0x10000000399/blog-132 v214601>,<0x10000000208/blogtest_in v2957>,<0x10000000201/src v2577>,<0x10000000006/blogbench-1.0 v2160>,<0x10000000005/tmp v745>,<0x100000001fb/client.0 v753>,<0x100000001fa/7156e7f8-5c39-449c-8c2a-7be3d13af491 v682>,<0x10000000001/sv_1 v762>,<0x10000000000/qa v659>,<0x1/volumes v733>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-05T01:35:29.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: pgmap v336: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 563 op/s 2024-09-05T01:35:29.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039c6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039c1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039bf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039cf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039d1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039a7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039c5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039cc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003974 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-61.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039ca (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000396e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-64.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039c9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039d2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003940 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-9.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039cd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039b2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039a4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039c2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000394a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-3.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039b7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039aa (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000397e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000399b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003944 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-7.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003963 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-68.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039a1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039b6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003942 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-8.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039ad (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000398e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039cb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039b5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000393a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-13.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003946 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-6.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000394c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-2.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003981 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039b0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039ce (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000398b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000397c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000396a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-65.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003961 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-69.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003989 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003972 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-62.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.567 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003995 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039d0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003980 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039c8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000395c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-70.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003970 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-63.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000395a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-71.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000399f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039b9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003938 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-14.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003997 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000399d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003979 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003967 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-66.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039ba (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000393e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-11.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003934 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-16.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039c4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000397f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003993 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000393f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-10.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039c7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003958 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-72.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003948 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-4.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003999 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003956 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-73.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039bc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003952 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-75.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039af (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003936 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-15.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039a5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000399a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039bd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039a2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039b3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000393c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-12.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003984 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000394e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039a9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003983 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003965 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-67.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039c3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003954 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-74.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003932 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-17.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003950 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-76.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000039ac (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003991 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:29.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: scrub summary: active paths [/] 2024-09-05T01:35:29.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c77 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c72 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c29 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-18.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c71 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c20 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-27.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c80 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c61 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c82 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c27 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-20.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c76 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c47 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-61.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c7d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c12 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-31.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:29 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c7b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: pgmap v336: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 563 op/s 2024-09-05T01:35:29.699 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039c6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.699 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039c1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.699 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039bf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.700 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039cf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.700 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039d1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.700 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039a7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.700 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039c5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.700 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039cc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.700 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003974 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-61.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.700 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039ca (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.700 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000396e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-64.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.700 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039c9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.700 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039d2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.700 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003940 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-9.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.700 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039cd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.701 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039b2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.701 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039a4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.701 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039c2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.701 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000394a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-3.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.701 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039b7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.701 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039aa (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.701 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000397e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.701 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000399b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.701 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003944 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-7.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.701 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003963 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-68.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.701 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039a1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.701 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039b6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.702 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003942 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-8.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.702 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039ad (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.702 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000398e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.702 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039cb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.702 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039b5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.703 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000393a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-13.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.703 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003946 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-6.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.703 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000394c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-2.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.703 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003981 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.704 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039b0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.704 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039ce (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.704 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000398b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.704 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000397c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.704 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000396a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-65.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.704 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003961 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-69.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.704 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003989 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.704 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003972 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-62.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.704 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003995 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.704 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039d0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.704 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003980 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.704 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039c8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.704 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000395c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-70.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003970 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-63.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000395a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-71.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000399f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039b9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003938 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-14.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003997 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000399d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003979 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003967 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-66.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039ba (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000393e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-11.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003934 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-16.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039c4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000397f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.705 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003993 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000393f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-10.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039c7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003958 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-72.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003948 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-4.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003999 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003956 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-73.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039bc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003952 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-75.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039af (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003936 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-15.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039a5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000399a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.707 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039bd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.707 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039a2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.707 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039b3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.707 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000393c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-12.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.707 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003984 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.707 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000394e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.707 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039a9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.707 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003983 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.707 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003965 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-67.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.708 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039c3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.708 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003954 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-74.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.708 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003932 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-17.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.708 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003950 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-76.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.708 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000039ac (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.708 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003991 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.708 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:29.708 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: scrub summary: active paths [/] 2024-09-05T01:35:29.708 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c77 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.708 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c72 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.708 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c29 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-18.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.708 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c71 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.709 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c20 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-27.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.709 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c80 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.709 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c61 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.709 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c82 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.709 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c27 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-20.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.709 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c76 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.709 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c47 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-61.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.709 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c7d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.709 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c12 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-31.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:29.709 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:29 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c7b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c44 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-64.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c7a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c83 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c32 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-9.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c7e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c23 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-24.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c68 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c5f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c38 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-3.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c6c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c63 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c4b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c34 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-7.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c5a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c40 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-68.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c5d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c6b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c33 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-8.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c65 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c53 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c6a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c7c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c11 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-32.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c26 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-21.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c1d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-30.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c2e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-13.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c35 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-6.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c39 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-2.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c4e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c67 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c10 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-33.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c7f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c52 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c4a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c43 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-65.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c1f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-28.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c3f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-69.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c51 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.568 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c46 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-62.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c4d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c81 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c56 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c79 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c3e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-70.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c36 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-5.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c0e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-34.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c3d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-71.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.569 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c1e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-29.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c45 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-63.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c25 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-22.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c2d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-14.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c57 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c6d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c5b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c48 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c42 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-66.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c2b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-16.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c30 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-11.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c75 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c21 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-26.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c4c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.570 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c58 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c55 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c31 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-10.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c37 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-4.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c78 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c22 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-25.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c3c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-72.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c49 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c3b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-73.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c0d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-35.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c6f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c66 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c60 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.571 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c28 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-19.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c70 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c5e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c69 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c2f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-12.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c50 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c3a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c62 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c4f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c74 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c24 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-23.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c41 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-67.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c2a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-17.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.572 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c64 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c54 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c2c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-15.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000456f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-64.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000002d0f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000002d29 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000002d1a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000002cfa (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000002d00 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000002d0a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000002d23 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000002d0d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004572 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-29.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.573 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000002d1d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000002cda (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004565 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-40.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000002cf2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000002d07 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000002cf7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000002cf4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000002d1f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000002d26 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000002d03 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000002d11 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000467d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004657 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.574 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000463f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-18.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004656 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000461e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-51.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004636 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-27.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000046c6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000046ca (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000463d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-20.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000465f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004624 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-45.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000046bb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004632 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-31.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000046ab (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000046a7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000046cd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004649 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-9.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.575 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004625 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-44.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000046c1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004639 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-24.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004658 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004650 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-3.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000464b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-7.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000461a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-55.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000464a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-8.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.576 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000046b0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000463c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-21.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004633 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-30.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000461f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-50.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000464c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-6.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004651 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-2.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004619 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-56.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004626 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-43.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004630 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-33.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000046c5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000461c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-53.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004635 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-28.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000461d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-52.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.577 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x100000046c7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004690 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000464e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-5.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000462f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-34.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004634 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-29.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000463b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-22.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004620 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-49.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004643 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-14.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004623 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-46.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004622 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-47.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004653 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004647 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-11.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004641 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-16.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.578 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000461b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-54.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004637 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-26.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000465d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004682 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004621 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-48.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000464f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-4.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004638 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-25.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000462b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-38.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004654 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000462e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-35.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004629 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-40.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004642 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-15.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.579 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000463e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-19.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004655 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004627 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-42.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000462c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-37.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000462a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-39.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000462d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-36.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004646 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-12.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004652 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000465a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000463a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-23.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004640 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-17.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000002d14 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000002cfd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004342 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.580 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000433d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004320 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-18.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000433c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004317 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-27.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000434b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000434d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004341 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000431e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-20.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004348 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.581 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004346 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004345 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000434e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004329 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-9.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004349 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000431a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-24.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004333 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000433e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000432f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-3.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004337 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004336 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004347 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004335 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.582 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000431d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-21.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004314 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-30.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004325 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-13.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000432c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-6.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004330 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-2.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004332 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000434a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000453e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-79.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004316 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-28.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000434c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004344 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000432d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-5.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004315 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-29.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.583 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000431c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-22.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004338 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004324 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-14.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004339 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004327 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-11.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004322 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-16.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004318 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-26.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004340 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004328 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-10.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004343 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000432e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-4.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004319 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-25.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000433a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.584 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004323 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-15.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000431f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-19.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000433b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004334 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004326 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-12.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004331 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000433f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000431b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-23.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000004321 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-17.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003ccd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cc8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cc7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.585 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cd6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cd8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003ccc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cd3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cd1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cd0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cd9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003caf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-9.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cd4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cbe (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cc9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cb5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-3.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cc2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.586 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cb9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.587 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cb1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-7.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.587 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cc1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.587 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cb0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-8.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.587 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cbb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.587 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cd2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.587 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cc0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.587 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cab (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-13.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.587 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cb2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-6.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.587 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cb6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-2.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.588 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cbd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.588 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cd5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.588 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003ccf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.588 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cb3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-5.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.588 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cc3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.588 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003caa (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-14.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.588 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cc4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.588 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cad (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-11.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.588 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003ccb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.588 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cae (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-10.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.588 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cce (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.588 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cb4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-4.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.588 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cc5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.589 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cbc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.589 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cc6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.589 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cbf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.589 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cac (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-12.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.589 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cb7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.589 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cb8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.589 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cca (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.589 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003cba (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.589 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c0a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.589 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c05 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.589 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bcc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-18.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.589 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c04 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bc3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-27.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c19 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bf4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c1b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bca (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-20.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c09 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bb5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-41.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c16 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bbf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-31.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c14 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c13 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.590 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c1c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bd5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-9.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bb2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-44.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c17 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bc6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-24.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bfb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bf2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c06 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bff (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bde (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bf6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bdb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-3.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bd7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-7.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bed (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.591 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bf0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.592 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bd6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-8.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.592 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bf8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.592 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003be6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.592 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c15 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.592 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bfd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.592 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bbe (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-32.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.592 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bc9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-21.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.592 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bc0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-30.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.592 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bd1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-13.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.592 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bd8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-6.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.592 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bdc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-2.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.592 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003be1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.592 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bfa (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.593 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bb3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-43.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.593 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bbd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-33.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.593 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c18 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.593 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003be5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.593 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x1000000455b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-53.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.593 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bc2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-28.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.593 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003be4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.593 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003be9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.593 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c1a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.593 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003be0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.593 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bd9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-5.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.593 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bbc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-34.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.593 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bc1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-29.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bef (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bc8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-22.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c00 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bd0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-14.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bea (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bee (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c01 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bd3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-11.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bce (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-16.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bdf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bc4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-26.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c08 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003be8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.594 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bd4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-10.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c0b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003beb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bc5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-25.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bda (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-4.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bb8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-38.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c02 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bbb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-35.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bb6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-40.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bf9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bcf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-15.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bf3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.595 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bec (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bb4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-42.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bf1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bb9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-37.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bfc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bb7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-39.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bba (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-36.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003be3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bdd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bf5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003be2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c07 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bc7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-23.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.596 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bcd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-17.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bf7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003be7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:30.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003c03 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: Scrub error on inode 0x10000003bcb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-19.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.597 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:30 smithi012 ceph-mon[29942]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:30.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c44 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-64.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c7a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c83 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c32 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-9.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c7e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c23 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-24.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c68 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c5f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.600 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c38 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-3.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c6c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c63 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c4b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c34 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-7.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c5a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c40 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-68.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c5d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c6b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c33 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-8.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c65 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c53 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c6a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.601 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c7c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c11 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-32.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c26 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-21.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c1d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-30.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c2e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-13.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c35 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-6.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c39 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-2.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c4e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c67 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c10 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-33.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c7f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c52 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c4a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.602 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c43 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-65.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c1f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-28.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c3f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-69.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c51 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c46 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-62.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c4d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c81 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c56 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c79 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c3e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-70.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c36 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-5.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c0e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-34.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c3d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-71.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c1e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-29.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c45 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-63.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c25 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-22.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c2d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-14.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c57 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c6d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c5b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c48 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c42 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-66.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c2b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-16.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c30 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-11.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c75 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.604 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c21 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-26.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c4c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c58 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c55 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c31 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-10.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c37 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-4.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c78 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c22 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-25.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c3c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-72.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.605 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c49 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c3b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-73.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c0d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-35.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c6f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c66 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c60 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c28 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-19.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c70 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c5e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c69 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c2f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-12.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c50 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c3a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.606 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c62 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c4f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c74 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c24 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-23.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c41 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-67.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c2a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-17.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c64 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c54 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c2c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-15.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.607 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000456f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-64.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000002d0f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000002d29 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000002d1a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000002cfa (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000002d00 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000002d0a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000002d23 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000002d0d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004572 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-29.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000002d1d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000002cda (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.608 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004565 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-40.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000002cf2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000002d07 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000002cf7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000002cf4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000002d1f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000002d26 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000002d03 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000002d11 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000467d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004657 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000463f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-18.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004656 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.609 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000461e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-51.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004636 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-27.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000046c6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000046ca (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000463d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-20.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000465f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004624 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-45.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000046bb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004632 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-31.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000046ab (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000046a7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.610 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000046cd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.611 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004649 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-9.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.611 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004625 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-44.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.611 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000046c1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.611 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004639 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-24.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.611 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004658 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.611 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004650 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-3.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.611 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000464b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-7.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.611 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000461a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-55.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000464a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-8.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000046b0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000463c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-21.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004633 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-30.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000461f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-50.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000464c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-6.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004651 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-2.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004619 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-56.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004626 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-43.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004630 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-33.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000046c5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.612 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000461c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-53.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004635 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-28.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000461d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-52.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x100000046c7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004690 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000464e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-5.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000462f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-34.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004634 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-29.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000463b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-22.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004620 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-49.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004643 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-14.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004623 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-46.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004622 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-47.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.613 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004653 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004647 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-11.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004641 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-16.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000461b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-54.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004637 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-26.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000465d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004682 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004621 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-48.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000464f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-4.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004638 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-25.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000462b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-38.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004654 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000462e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-35.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004629 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-40.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.614 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004642 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-15.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000463e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-19.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004655 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004627 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-42.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000462c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-37.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000462a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-39.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000462d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-36.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004646 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-12.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004652 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000465a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000463a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-23.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004640 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-17.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000002d14 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.615 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000002cfd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004342 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000433d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004320 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-18.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000433c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004317 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-27.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000434b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000434d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004341 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000431e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-20.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004348 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004346 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004345 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.616 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000434e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.617 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004329 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-9.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.617 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004349 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.617 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000431a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-24.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.617 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004333 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.617 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000433e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.617 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000432f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-3.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.617 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004337 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.617 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004336 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.617 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004347 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.618 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004335 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.618 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000431d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-21.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.618 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004314 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-30.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.618 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004325 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-13.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.618 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000432c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-6.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.618 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004330 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-2.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.618 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004332 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.618 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000434a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.618 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000453e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-79.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004316 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-28.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000434c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004344 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000432d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-5.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004315 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-29.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000431c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-22.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004338 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004324 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-14.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004339 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004327 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-11.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004322 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-16.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004318 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-26.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.619 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004340 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004328 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-10.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004343 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000432e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-4.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004319 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-25.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000433a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004323 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-15.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000431f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-19.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000433b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004334 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004326 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-12.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.620 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004331 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.621 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000433f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.621 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000431b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-23.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.621 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000004321 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-17.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.621 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003ccd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.621 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cc8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.621 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cc7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.621 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cd6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.621 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cd8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.621 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003ccc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.621 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cd3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.621 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cd1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.621 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cd0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.621 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cd9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.622 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003caf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-9.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.622 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cd4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.622 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cbe (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.622 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cc9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.622 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cb5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-3.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.622 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cc2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.622 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cb9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.622 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cb1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-7.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.622 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cc1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.622 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cb0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-8.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.622 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cbb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.622 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cd2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cc0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cab (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-13.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cb2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-6.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cb6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-2.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cbd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cd5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003ccf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cb3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-5.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cc3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003caa (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-14.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cc4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cad (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-11.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003ccb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.623 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cae (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-10.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cce (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cb4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-4.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cc5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cbc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cc6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cbf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cac (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-12.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cb7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cb8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cca (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003cba (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.624 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c0a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.625 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c05 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.625 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bcc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-18.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.625 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c04 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.625 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bc3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-27.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.625 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c19 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.625 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bf4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.625 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c1b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.625 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bca (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-20.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.625 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c09 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bb5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-41.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c16 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bbf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-31.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c14 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c13 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c1c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bd5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-9.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bb2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-44.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c17 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bc6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-24.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bfb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bf2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.626 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c06 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bff (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bde (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bf6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bdb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-3.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bd7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-7.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bed (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bf0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bd6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-8.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bf8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003be6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c15 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bfd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bbe (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-32.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.627 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bc9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-21.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bc0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-30.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bd1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-13.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bd8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-6.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bdc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-2.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003be1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bfa (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bb3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-43.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bbd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-33.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c18 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003be5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x1000000455b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-53.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bc2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-28.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.628 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003be4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003be9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c1a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003be0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bd9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-5.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bbc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-34.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bc1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-29.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bef (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bc8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-22.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c00 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bd0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-14.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bea (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bee (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.629 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c01 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bd3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-11.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bce (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-16.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bdf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bc4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-26.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c08 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003be8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bd4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-10.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c0b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003beb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bc5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-25.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bda (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-4.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bb8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-38.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.630 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c02 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.631 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bbb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-35.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.631 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bb6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-40.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.631 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bf9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.631 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bcf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-15.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.631 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bf3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.631 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bec (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.631 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bb4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-42.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.631 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bf1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.631 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bb9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-37.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.631 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bfc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.632 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bb7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-39.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.632 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bba (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-36.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.632 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003be3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.632 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bdd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.632 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bf5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.632 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003be2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.632 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c07 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.632 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bc7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-23.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.632 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bcd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-17.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.633 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bf7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.633 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003be7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.633 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:30.633 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003c03 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.633 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: Scrub error on inode 0x10000003bcb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-19.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.633 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:30 smithi145 ceph-mon[34376]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:30.636 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c44 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-64.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c7a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c83 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c32 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-9.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c7e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c23 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-24.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c68 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c5f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c38 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-3.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c6c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.637 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c63 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c4b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c34 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-7.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c5a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c40 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-68.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c5d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c6b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c33 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-8.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c65 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c53 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c6a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c7c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c11 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-32.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c26 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-21.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.638 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c1d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-30.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c2e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-13.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c35 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-6.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c39 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-2.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c4e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c67 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c10 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-33.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c7f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c52 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c4a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c43 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-65.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c1f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-28.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c3f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-69.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.639 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c51 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c46 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-62.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c4d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c81 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c56 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c79 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c3e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-70.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c36 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-5.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c0e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-34.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c3d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-71.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c1e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-29.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c45 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-63.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c25 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-22.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c2d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-14.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c57 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c6d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c5b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c48 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c42 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-66.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c2b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-16.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c30 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-11.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c75 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c21 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-26.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c4c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c58 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.641 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c55 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c31 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-10.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c37 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-4.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c78 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c22 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-25.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c3c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-72.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c49 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c3b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-73.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c0d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-35.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c6f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c66 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.642 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c60 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c28 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-19.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c70 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c5e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c69 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c2f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-12.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c50 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c3a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c62 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c4f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c74 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c24 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-23.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.643 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c41 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-67.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c2a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-17.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c64 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c54 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c2c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-15.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000456f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-64.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000002d0f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000002d29 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000002d1a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000002cfa (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000002d00 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.644 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000002d0a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000002d23 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000002d0d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004572 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-29.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000002d1d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000002cda (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004565 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-40.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000002cf2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000002d07 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000002cf7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000002cf4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000002d1f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.645 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000002d26 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000002d03 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000002d11 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000467d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004657 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000463f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-18.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004656 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000461e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-51.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004636 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-27.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000046c6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000046ca (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000463d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-20.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000465f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.646 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004624 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-45.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000046bb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004632 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-31.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000046ab (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000046a7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000046cd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004649 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-9.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004625 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-44.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000046c1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004639 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-24.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004658 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004650 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-3.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000464b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-7.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.647 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000461a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-55.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000464a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-8.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000046b0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000463c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-21.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004633 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-30.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000461f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-50.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000464c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-6.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004651 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-2.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004619 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-56.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004626 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-43.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004630 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-33.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.648 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000046c5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000461c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-53.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004635 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-28.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000461d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-52.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x100000046c7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004690 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000464e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-5.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000462f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-34.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004634 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-29.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000463b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-22.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004620 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-49.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004643 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-14.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004623 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-46.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004622 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-47.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004653 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004647 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-11.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004641 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-16.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000461b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-54.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004637 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-26.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000465d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004682 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004621 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-48.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000464f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-4.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004638 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-25.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000462b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-38.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004654 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000462e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-35.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004629 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-40.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004642 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-15.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000463e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-19.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004655 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004627 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-42.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000462c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-37.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000462a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-39.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000462d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-36.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004646 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-12.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004652 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000465a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000463a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-23.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004640 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-17.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000002d14 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.651 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000002cfd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004342 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000433d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004320 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-18.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000433c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004317 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-27.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000434b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000434d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004341 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000431e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-20.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004348 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004346 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.652 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004345 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000434e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004329 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-9.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004349 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000431a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-24.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004333 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000433e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000432f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-3.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004337 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004336 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004347 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004335 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000431d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-21.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.653 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004314 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-30.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004325 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-13.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000432c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-6.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004330 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-2.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004332 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000434a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000453e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-79.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004316 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-28.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000434c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004344 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.654 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000432d (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-5.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004315 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-29.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000431c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-22.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004338 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004324 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-14.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004339 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004327 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-11.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004322 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-16.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004318 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-26.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004340 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004328 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-10.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004343 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000432e (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-4.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.655 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004319 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-25.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000433a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004323 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-15.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000431f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-19.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000433b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004334 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004326 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-12.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004331 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000433f (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000431b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-23.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000004321 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-17.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003ccd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cc8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cc7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cd6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cd8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003ccc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cd3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cd1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cd0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cd9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003caf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-9.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cd4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cbe (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cc9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cb5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-3.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cc2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cb9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cb1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-7.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cc1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cb0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-8.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cbb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cd2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cc0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cab (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-13.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cb2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-6.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cb6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-2.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.658 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cbd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cd5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003ccf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cb3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-5.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cc3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003caa (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-14.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cc4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cad (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-11.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003ccb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cae (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-10.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cce (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cb4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-4.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.659 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cc5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cbc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cc6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cbf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cac (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-12.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cb7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cb8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cca (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003cba (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c0a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.660 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c05 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bcc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-18.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c04 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bc3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-27.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c19 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bf4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c1b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bca (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-20.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c09 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bb5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-41.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c16 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bbf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-31.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c14 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.661 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c13 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c1c (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bd5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-9.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bb2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-44.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c17 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bc6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-24.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bfb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bf2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c06 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bff (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bde (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bf6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bdb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-3.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bd7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-7.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bed (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bf0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bd6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-8.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bf8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003be6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c15 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bfd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bbe (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-32.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bc9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-21.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bc0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-30.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bd1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-13.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bd8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-6.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bdc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-2.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003be1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bfa (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bb3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-43.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bbd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-33.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c18 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003be5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x1000000455b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-53.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bc2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-28.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003be4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003be9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c1a (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003be0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.664 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bd9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-5.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bbc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-34.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bc1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-29.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bef (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bc8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-22.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c00 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bd0 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-14.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bea (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bee (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c01 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bd3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-11.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bce (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-16.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bdf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.665 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bc4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-26.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c08 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003be8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bd4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-10.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c0b (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003beb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bc5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-25.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bda (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-4.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bb8 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-38.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c02 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bbb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-35.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bb6 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-40.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bf9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.666 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bcf (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-15.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bf3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bec (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bb4 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-42.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bf1 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bb9 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-37.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bfc (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bb7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-39.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bba (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-36.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003be3 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bdd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-1.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bf5 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003be2 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.667 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c07 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bc7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-23.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bcd (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-17.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bf7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003be7 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:30.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003c03 (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: Scrub error on inode 0x10000003bcb (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-19.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:35:30.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:30 smithi151 ceph-mon[35013]: scrub summary: idle+waiting paths [/] 2024-09-05T01:35:31.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:31 smithi012 ceph-mon[29942]: pgmap v337: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.2 MiB/s wr, 392 op/s 2024-09-05T01:35:31.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:31 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:35:31.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:31 smithi145 ceph-mon[34376]: pgmap v337: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.2 MiB/s wr, 392 op/s 2024-09-05T01:35:31.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:31 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:35:31.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:31 smithi151 ceph-mon[35013]: pgmap v337: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.2 MiB/s wr, 392 op/s 2024-09-05T01:35:31.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:31 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:35:33.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:33 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-a[29938]: 2024-09-05T01:35:33.162+0000 7f4037200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-05T01:35:33.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:33 smithi012 ceph-mon[29942]: pgmap v338: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.2 MiB/s wr, 381 op/s 2024-09-05T01:35:33.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:33 smithi145 ceph-mon[34376]: pgmap v338: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.2 MiB/s wr, 381 op/s 2024-09-05T01:35:33.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:33 smithi151 ceph-mon[35013]: pgmap v338: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.2 MiB/s wr, 381 op/s 2024-09-05T01:35:34.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:34 smithi012 ceph-mon[29942]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-05T01:35:34.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:34 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] up:active 2024-09-05T01:35:34.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:34 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:35:34.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:34 smithi145 ceph-mon[34376]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-05T01:35:34.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:34 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] up:active 2024-09-05T01:35:34.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:34 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:35:34.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:34 smithi151 ceph-mon[35013]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-05T01:35:34.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:34 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] up:active 2024-09-05T01:35:34.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:34 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:35:35.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:35 smithi012 ceph-mon[29942]: pgmap v339: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.3 MiB/s wr, 458 op/s 2024-09-05T01:35:35.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:35 smithi145 ceph-mon[34376]: pgmap v339: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.3 MiB/s wr, 458 op/s 2024-09-05T01:35:35.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:35 smithi151 ceph-mon[35013]: pgmap v339: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.3 MiB/s wr, 458 op/s 2024-09-05T01:35:37.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:37 smithi012 ceph-mon[29942]: pgmap v340: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.2 MiB/s wr, 324 op/s 2024-09-05T01:35:37.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:37 smithi145 ceph-mon[34376]: pgmap v340: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.2 MiB/s wr, 324 op/s 2024-09-05T01:35:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:37 smithi151 ceph-mon[35013]: pgmap v340: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.2 MiB/s wr, 324 op/s 2024-09-05T01:35:38.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:38 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:35:38.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:38 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:35:38.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:38 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:35:38.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:38 smithi012 ceph-mon[29942]: scrub summary: idle 2024-09-05T01:35:38.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:38 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:35:38.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:38 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:35:38.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:38 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:35:38.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:38 smithi145 ceph-mon[34376]: scrub summary: idle 2024-09-05T01:35:38.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:38 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:35:38.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:38 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:35:38.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:38 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:35:38.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:38 smithi151 ceph-mon[35013]: scrub summary: idle 2024-09-05T01:35:39.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:39 smithi012 ceph-mon[29942]: pgmap v341: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.8 MiB/s wr, 321 op/s 2024-09-05T01:35:39.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:39 smithi145 ceph-mon[34376]: pgmap v341: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.8 MiB/s wr, 321 op/s 2024-09-05T01:35:39.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:39 smithi151 ceph-mon[35013]: pgmap v341: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.8 MiB/s wr, 321 op/s 2024-09-05T01:35:41.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:41 smithi012 ceph-mon[29942]: pgmap v342: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.7 MiB/s wr, 431 op/s 2024-09-05T01:35:41.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:41 smithi145 ceph-mon[34376]: pgmap v342: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.7 MiB/s wr, 431 op/s 2024-09-05T01:35:41.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:41 smithi151 ceph-mon[35013]: pgmap v342: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 4.7 MiB/s wr, 431 op/s 2024-09-05T01:35:43.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:43 smithi012 ceph-mon[29942]: pgmap v343: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 358 op/s 2024-09-05T01:35:43.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:43 smithi145 ceph-mon[34376]: pgmap v343: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 358 op/s 2024-09-05T01:35:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:43 smithi151 ceph-mon[35013]: pgmap v343: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 358 op/s 2024-09-05T01:35:45.015 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-05T01:35:45.445 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:35:45.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:45 smithi012 ceph-mon[29942]: pgmap v344: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 465 op/s 2024-09-05T01:35:45.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:45 smithi145 ceph-mon[34376]: pgmap v344: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 465 op/s 2024-09-05T01:35:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:45 smithi151 ceph-mon[35013]: pgmap v344: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 465 op/s 2024-09-05T01:35:46.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.081+0000 7f43e3800640 1 -- 172.21.15.12:0/3831915499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43dc074510 msgr2=0x7f43dc0748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:46.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.081+0000 7f43e3800640 1 --2- 172.21.15.12:0/3831915499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43dc074510 0x7f43dc0748f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009900 tx=0x7f43d002a480 comp rx=0 tx=0).stop 2024-09-05T01:35:46.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.082+0000 7f43e3800640 1 -- 172.21.15.12:0/3831915499 shutdown_connections 2024-09-05T01:35:46.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.082+0000 7f43e3800640 1 --2- 172.21.15.12:0/3831915499 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f43dc10e450 0x7f43dc110840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.082+0000 7f43e3800640 1 --2- 172.21.15.12:0/3831915499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43dc074e30 0x7f43dc10df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.082+0000 7f43e3800640 1 --2- 172.21.15.12:0/3831915499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43dc074510 0x7f43dc0748f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.082+0000 7f43e3800640 1 -- 172.21.15.12:0/3831915499 >> 172.21.15.12:0/3831915499 conn(0x7f43dc0fd8b0 msgr2=0x7f43dc0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:46.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.082+0000 7f43e3800640 1 -- 172.21.15.12:0/3831915499 shutdown_connections 2024-09-05T01:35:46.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.082+0000 7f43e3800640 1 -- 172.21.15.12:0/3831915499 wait complete. 2024-09-05T01:35:46.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.083+0000 7f43e3800640 1 Processor -- start 2024-09-05T01:35:46.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.083+0000 7f43e3800640 1 -- start start 2024-09-05T01:35:46.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.083+0000 7f43e3800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43dc074510 0x7f43dc19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:46.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.083+0000 7f43e3800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f43dc074e30 0x7f43dc19ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:46.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.083+0000 7f43e3800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43dc10e450 0x7f43dc19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:46.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.083+0000 7f43e3800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc114160 con 0x7f43dc10e450 2024-09-05T01:35:46.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.083+0000 7f43e3800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc113fe0 con 0x7f43dc074e30 2024-09-05T01:35:46.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.083+0000 7f43e3800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc1142e0 con 0x7f43dc074510 2024-09-05T01:35:46.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.084+0000 7f43e1800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43dc10e450 0x7f43dc19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:46.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.084+0000 7f43e1800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43dc10e450 0x7f43dc19efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50942/0 (socket says 172.21.15.12:50942) 2024-09-05T01:35:46.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.084+0000 7f43e1800640 1 -- 172.21.15.12:0/4154045091 learned_addr learned my addr 172.21.15.12:0/4154045091 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:46.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.084+0000 7f43e1800640 1 -- 172.21.15.12:0/4154045091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43dc074510 msgr2=0x7f43dc19a6e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-05T01:35:46.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.084+0000 7f43e1800640 1 --2- 172.21.15.12:0/4154045091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43dc074510 0x7f43dc19a6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.084+0000 7f43e1800640 1 -- 172.21.15.12:0/4154045091 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f43dc074e30 msgr2=0x7f43dc19ac20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-05T01:35:46.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.084+0000 7f43e1800640 1 --2- 172.21.15.12:0/4154045091 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f43dc074e30 0x7f43dc19ac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.084+0000 7f43e1800640 1 -- 172.21.15.12:0/4154045091 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43dc19f690 con 0x7f43dc10e450 2024-09-05T01:35:46.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.084+0000 7f43e1800640 1 --2- 172.21.15.12:0/4154045091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43dc10e450 0x7f43dc19efb0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f43d400eb40 tx=0x7f43d400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:46.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.085+0000 7f43d9600640 1 -- 172.21.15.12:0/4154045091 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d4004b20 con 0x7f43dc10e450 2024-09-05T01:35:46.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.085+0000 7f43d9600640 1 -- 172.21.15.12:0/4154045091 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43d4004cc0 con 0x7f43dc10e450 2024-09-05T01:35:46.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.085+0000 7f43d9600640 1 -- 172.21.15.12:0/4154045091 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d4010850 con 0x7f43dc10e450 2024-09-05T01:35:46.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.085+0000 7f43e3800640 1 -- 172.21.15.12:0/4154045091 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43dc19f980 con 0x7f43dc10e450 2024-09-05T01:35:46.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.085+0000 7f43e3800640 1 -- 172.21.15.12:0/4154045091 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43dc1a7260 con 0x7f43dc10e450 2024-09-05T01:35:46.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.088+0000 7f43d9600640 1 -- 172.21.15.12:0/4154045091 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f43d4005020 con 0x7f43dc10e450 2024-09-05T01:35:46.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.088+0000 7f43e6293740 1 Processor -- start 2024-09-05T01:35:46.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.088+0000 7f43e6293740 1 -- start start 2024-09-05T01:35:46.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.088+0000 7f43e6293740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561652f03b90 0x561652f03f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:46.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.089+0000 7f43e6293740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561652f044b0 0x561652f0e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:46.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.089+0000 7f43e6293740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561652f0ed70 0x561652f11160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:46.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.089+0000 7f43e6293740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561652e6a3e0 con 0x561652f044b0 2024-09-05T01:35:46.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.089+0000 7f43e6293740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x561652e11d80 con 0x561652f03b90 2024-09-05T01:35:46.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.089+0000 7f43e6293740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561652e663a0 con 0x561652f0ed70 2024-09-05T01:35:46.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.089+0000 7f43e0e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561652f044b0 0x561652f0e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:46.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.089+0000 7f43dbe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561652f0ed70 0x561652f11160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:46.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.089+0000 7f43e0e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561652f044b0 0x561652f0e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50956/0 (socket says 172.21.15.12:50956) 2024-09-05T01:35:46.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.089+0000 7f43e0e00640 1 -- 172.21.15.12:0/3378733732 learned_addr learned my addr 172.21.15.12:0/3378733732 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:46.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.089+0000 7f43e0e00640 1 -- 172.21.15.12:0/3378733732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561652f0ed70 msgr2=0x561652f11160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:46.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.089+0000 7f43e0e00640 1 --2- 172.21.15.12:0/3378733732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561652f0ed70 0x561652f11160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.089+0000 7f43e0e00640 1 -- 172.21.15.12:0/3378733732 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561652f03b90 msgr2=0x561652f03f70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:35:46.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.089+0000 7f43e0e00640 1 --2- 172.21.15.12:0/3378733732 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561652f03b90 0x561652f03f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.089+0000 7f43e0e00640 1 -- 172.21.15.12:0/3378733732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561652e30ae0 con 0x561652f044b0 2024-09-05T01:35:46.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.089+0000 7f43d9600640 1 --2- 172.21.15.12:0/4154045091 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f43c40a2d70 0x7f43c40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:46.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.090+0000 7f43d9600640 1 -- 172.21.15.12:0/4154045091 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8579+0+0 (secure 0 0 0) 0x7f43d40cfd20 con 0x7f43dc10e450 2024-09-05T01:35:46.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.090+0000 7f43e0e00640 1 --2- 172.21.15.12:0/3378733732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561652f044b0 0x561652f0e830 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f43d002a9a0 tx=0x7f43d0031510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb1771939404519 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:46.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.090+0000 7f43dbe00640 1 --2- 172.21.15.12:0/4154045091 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f43c40a2d70 0x7f43c40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:46.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.090+0000 7f43ce000640 1 -- 172.21.15.12:0/3378733732 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d003e070 con 0x561652f044b0 2024-09-05T01:35:46.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.090+0000 7f43ce000640 1 -- 172.21.15.12:0/3378733732 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43d0031870 con 0x561652f044b0 2024-09-05T01:35:46.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.090+0000 7f43ce000640 1 -- 172.21.15.12:0/3378733732 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d0035040 con 0x561652f044b0 2024-09-05T01:35:46.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.091+0000 7f43e6293740 1 -- 172.21.15.12:0/3378733732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561652f044b0 msgr2=0x561652f0e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:46.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.091+0000 7f43dbe00640 1 --2- 172.21.15.12:0/4154045091 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f43c40a2d70 0x7f43c40a5230 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x561652f014a0 tx=0x7f43c8005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:46.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.091+0000 7f43e6293740 1 --2- 172.21.15.12:0/3378733732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561652f044b0 0x561652f0e830 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f43d002a9a0 tx=0x7f43d0031510 comp rx=0 tx=0).stop 2024-09-05T01:35:46.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.091+0000 7f43e6293740 1 -- 172.21.15.12:0/3378733732 shutdown_connections 2024-09-05T01:35:46.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.091+0000 7f43e6293740 1 --2- 172.21.15.12:0/3378733732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561652f0ed70 0x561652f11160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.091+0000 7f43e6293740 1 --2- 172.21.15.12:0/3378733732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561652f044b0 0x561652f0e830 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.091+0000 7f43e6293740 1 --2- 172.21.15.12:0/3378733732 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561652f03b90 0x561652f03f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.091+0000 7f43e6293740 1 -- 172.21.15.12:0/3378733732 >> 172.21.15.12:0/3378733732 conn(0x561652f00120 msgr2=0x561652f00500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:46.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.091+0000 7f43e6293740 1 -- 172.21.15.12:0/3378733732 shutdown_connections 2024-09-05T01:35:46.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.091+0000 7f43e6293740 1 -- 172.21.15.12:0/3378733732 wait complete. 2024-09-05T01:35:46.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.092+0000 7f43e6293740 1 -- start start 2024-09-05T01:35:46.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.092+0000 7f43e6293740 1 Processor -- start 2024-09-05T01:35:46.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.092+0000 7f43e6293740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561652f03b90 0x561652f0bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:46.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.092+0000 7f43e6293740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561652f044b0 0x561652f0c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:46.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.092+0000 7f43e6293740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561652f0ed70 0x561652f0c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:46.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.092+0000 7f43e6293740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561652f119e0 con 0x561652f03b90 2024-09-05T01:35:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.092+0000 7f43e6293740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x561652e250f0 con 0x561652f044b0 2024-09-05T01:35:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.092+0000 7f43e6293740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561652f11b60 con 0x561652f0ed70 2024-09-05T01:35:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.092+0000 7f43e6293740 10 client.0 _ll_register_callbacks cb 0x561652e169e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:35:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.093+0000 7f43e0e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561652f03b90 0x561652f0bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.093+0000 7f43e0e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561652f03b90 0x561652f0bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50966/0 (socket says 172.21.15.12:50966) 2024-09-05T01:35:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.093+0000 7f43e0e00640 1 -- 172.21.15.12:0/4058421536 learned_addr learned my addr 172.21.15.12:0/4058421536 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.093+0000 7f43e0e00640 1 -- 172.21.15.12:0/4058421536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561652f0ed70 msgr2=0x561652f0c6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:35:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.093+0000 7f43e0e00640 1 --2- 172.21.15.12:0/4058421536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561652f0ed70 0x561652f0c6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.093+0000 7f43e0e00640 1 -- 172.21.15.12:0/4058421536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561652f044b0 msgr2=0x561652f0c190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:35:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.093+0000 7f43e0e00640 1 --2- 172.21.15.12:0/4058421536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561652f044b0 0x561652f0c190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.093+0000 7f43e0e00640 1 -- 172.21.15.12:0/4058421536 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561652bdb3c0 con 0x561652f03b90 2024-09-05T01:35:46.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.093+0000 7f43e0e00640 1 --2- 172.21.15.12:0/4058421536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561652f03b90 0x561652f0bc50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f43d00096c0 tx=0x7f43d0005300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ffe33eb544bfc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:46.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.093+0000 7f43c2a00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:35:46.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.094+0000 7f43c2a00640 1 -- 172.21.15.12:0/4058421536 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d004b020 con 0x561652f03b90 2024-09-05T01:35:46.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.094+0000 7f43c2a00640 1 -- 172.21.15.12:0/4058421536 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8579+0+0 (secure 0 0 0) 0x7f43d0004250 con 0x561652f03b90 2024-09-05T01:35:46.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.094+0000 7f43e6293740 1 -- 172.21.15.12:0/4058421536 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43d0031870 con 0x561652f03b90 2024-09-05T01:35:46.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.094+0000 7f43c2a00640 1 -- 172.21.15.12:0/4058421536 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f43d0056050 con 0x561652f03b90 2024-09-05T01:35:46.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.094+0000 7f43e6293740 10 client.16602 fetch_fsmap learned FSMap version 62 2024-09-05T01:35:46.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.094+0000 7f43e6293740 1 -- 172.21.15.12:0/4058421536 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x561652f1d690 con 0x561652f03b90 2024-09-05T01:35:46.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.094+0000 7f43c2a00640 1 -- 172.21.15.12:0/4058421536 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43d0031870 con 0x561652f03b90 2024-09-05T01:35:46.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.094+0000 7f43c2a00640 1 -- 172.21.15.12:0/4058421536 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 62) ==== 8442+0+0 (secure 0 0 0) 0x7f43d0003850 con 0x561652f03b90 2024-09-05T01:35:46.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.095+0000 7f43e6293740 10 client.16602 fetch_fsmap finished waiting for FSMap version 62 2024-09-05T01:35:46.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.095+0000 7f43e6293740 10 client.16602 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:35:46.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.095+0000 7f43e6293740 20 client.16602 populate_metadata read hostname 'smithi012' 2024-09-05T01:35:46.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.095+0000 7f43e6293740 1 --2- 172.21.15.12:0/4058421536 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x561652f1e9e0 0x561652f20dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:46.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.095+0000 7f43e6293740 4 client.16602 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:35:46.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.095+0000 7f43e6293740 1 -- 172.21.15.12:0/4058421536 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561652e77950 con 0x561652f1e9e0 2024-09-05T01:35:46.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.095+0000 7f43dbe00640 1 --2- 172.21.15.12:0/4058421536 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x561652f1e9e0 0x561652f20dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:46.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.096+0000 7f43dbe00640 1 --2- 172.21.15.12:0/4058421536 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x561652f1e9e0 0x561652f20dd0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1de3f5da4aef3c2 server_cookie=fb5fd3ccb318f43e in_seq=0 out_seq=0 2024-09-05T01:35:46.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.096+0000 7f43c2a00640 10 client.16602 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:35:46.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.097+0000 7f43c2a00640 1 -- 172.21.15.12:0/4058421536 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561652e77950 con 0x561652f1e9e0 2024-09-05T01:35:46.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.097+0000 7f43c2a00640 10 client.16602 handle_command_reply: tid=0 2024-09-05T01:35:46.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.097+0000 7f43e6293740 1 client.16602 shutdown 2024-09-05T01:35:46.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.097+0000 7f43e6293740 1 -- 172.21.15.12:0/4058421536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561652f03b90 msgr2=0x561652f0bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:46.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.097+0000 7f43e6293740 1 --2- 172.21.15.12:0/4058421536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561652f03b90 0x561652f0bc50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f43d00096c0 tx=0x7f43d0005300 comp rx=0 tx=0).stop 2024-09-05T01:35:46.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.097+0000 7f43e6293740 1 -- 172.21.15.12:0/4058421536 shutdown_connections 2024-09-05T01:35:46.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.097+0000 7f43e6293740 1 --2- 172.21.15.12:0/4058421536 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x561652f1e9e0 0x561652f20dd0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.097+0000 7f43e6293740 1 --2- 172.21.15.12:0/4058421536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561652f0ed70 0x561652f0c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.097+0000 7f43e6293740 1 --2- 172.21.15.12:0/4058421536 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561652f044b0 0x561652f0c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.097+0000 7f43e6293740 1 --2- 172.21.15.12:0/4058421536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561652f03b90 0x561652f0bc50 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.097+0000 7f43c2a00640 0 client.16602 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:35:46.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.097+0000 7f43e6293740 1 -- 172.21.15.12:0/4058421536 >> 172.21.15.12:0/4058421536 conn(0x561652f00120 msgr2=0x561652f05e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:46.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.097+0000 7f43e6293740 1 -- 172.21.15.12:0/4058421536 shutdown_connections 2024-09-05T01:35:46.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.097+0000 7f43e6293740 1 -- 172.21.15.12:0/4058421536 wait complete. 2024-09-05T01:35:46.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.097+0000 7f43e6293740 20 client.16602 trim_cache size 0 max 16384 2024-09-05T01:35:46.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.116+0000 7f43e6293740 1 Processor -- start 2024-09-05T01:35:46.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.117+0000 7f43e6293740 1 -- start start 2024-09-05T01:35:46.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.117+0000 7f43e6293740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561652f03b90 0x561652f26510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:46.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.117+0000 7f43e6293740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561652f044b0 0x561652f26a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:46.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.117+0000 7f43e6293740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561652f0ed70 0x561652efe9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:46.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.117+0000 7f43e6293740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc1afac0 con 0x561652f044b0 2024-09-05T01:35:46.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.117+0000 7f43e6293740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc1b1840 con 0x561652f0ed70 2024-09-05T01:35:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.117+0000 7f43e6293740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc1b0190 con 0x561652f03b90 2024-09-05T01:35:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.117+0000 7f43e0e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561652f03b90 0x561652f26510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.117+0000 7f43e0e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561652f03b90 0x561652f26510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:40104/0 (socket says 172.21.15.12:40104) 2024-09-05T01:35:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.117+0000 7f43e0e00640 1 -- 172.21.15.12:0/526730016 learned_addr learned my addr 172.21.15.12:0/526730016 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.117+0000 7f43dbe00640 1 --2- 172.21.15.12:0/526730016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561652f044b0 0x561652f26a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.117+0000 7f43e1800640 1 --2- 172.21.15.12:0/526730016 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561652f0ed70 0x561652efe9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.118+0000 7f43e0e00640 1 -- 172.21.15.12:0/526730016 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561652f0ed70 msgr2=0x561652efe9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.118+0000 7f43e0e00640 1 --2- 172.21.15.12:0/526730016 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561652f0ed70 0x561652efe9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.118+0000 7f43e0e00640 1 -- 172.21.15.12:0/526730016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561652f044b0 msgr2=0x561652f26a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.118+0000 7f43e0e00640 1 --2- 172.21.15.12:0/526730016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561652f044b0 0x561652f26a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.118+0000 7f43e0e00640 1 -- 172.21.15.12:0/526730016 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561652f0e5c0 con 0x561652f03b90 2024-09-05T01:35:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.118+0000 7f43e0e00640 1 --2- 172.21.15.12:0/526730016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561652f03b90 0x561652f26510 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f43d002a9a0 tx=0x7f43d0031510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a92ab251bfabac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.118+0000 7f43cd600640 1 -- 172.21.15.12:0/526730016 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d004b040 con 0x561652f03b90 2024-09-05T01:35:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.118+0000 7f43cd600640 1 -- 172.21.15.12:0/526730016 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43d0005570 con 0x561652f03b90 2024-09-05T01:35:46.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.118+0000 7f43cd600640 1 -- 172.21.15.12:0/526730016 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d003e070 con 0x561652f03b90 2024-09-05T01:35:46.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.119+0000 7f43e6293740 1 -- 172.21.15.12:0/526730016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561652f03b90 msgr2=0x561652f26510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:46.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.119+0000 7f43e6293740 1 --2- 172.21.15.12:0/526730016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561652f03b90 0x561652f26510 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f43d002a9a0 tx=0x7f43d0031510 comp rx=0 tx=0).stop 2024-09-05T01:35:46.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.119+0000 7f43e6293740 1 -- 172.21.15.12:0/526730016 shutdown_connections 2024-09-05T01:35:46.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.119+0000 7f43e6293740 1 --2- 172.21.15.12:0/526730016 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561652f0ed70 0x561652efe9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.119+0000 7f43e6293740 1 --2- 172.21.15.12:0/526730016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561652f044b0 0x561652f26a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.119+0000 7f43e6293740 1 --2- 172.21.15.12:0/526730016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561652f03b90 0x561652f26510 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.119+0000 7f43e6293740 1 -- 172.21.15.12:0/526730016 >> 172.21.15.12:0/526730016 conn(0x561652f00120 msgr2=0x561652f0ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.119+0000 7f43e6293740 1 -- 172.21.15.12:0/526730016 shutdown_connections 2024-09-05T01:35:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.119+0000 7f43e6293740 1 -- 172.21.15.12:0/526730016 wait complete. 2024-09-05T01:35:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.120+0000 7f43e6293740 1 -- start start 2024-09-05T01:35:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.120+0000 7f43e6293740 1 Processor -- start 2024-09-05T01:35:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.120+0000 7f43e6293740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561652f03b90 0x561652f12510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.120+0000 7f43e6293740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561652f044b0 0x561652f12a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.120+0000 7f43e6293740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561652f0ed70 0x561652f814a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.120+0000 7f43e6293740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc1b10b0 con 0x561652f0ed70 2024-09-05T01:35:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.120+0000 7f43e6293740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc1b0920 con 0x561652f03b90 2024-09-05T01:35:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.120+0000 7f43e6293740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc1adac0 con 0x561652f044b0 2024-09-05T01:35:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.120+0000 7f43e6293740 10 client.0 _ll_register_callbacks cb 0x7f43d0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:35:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.121+0000 7f43dbe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561652f044b0 0x561652f12a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.121+0000 7f43dbe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561652f044b0 0x561652f12a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:40108/0 (socket says 172.21.15.12:40108) 2024-09-05T01:35:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.121+0000 7f43dbe00640 1 -- 172.21.15.12:0/1766415916 learned_addr learned my addr 172.21.15.12:0/1766415916 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.121+0000 7f43e0e00640 1 --2- 172.21.15.12:0/1766415916 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561652f03b90 0x561652f12510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.121+0000 7f43e1800640 1 --2- 172.21.15.12:0/1766415916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561652f0ed70 0x561652f814a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.121+0000 7f43dbe00640 1 -- 172.21.15.12:0/1766415916 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561652f03b90 msgr2=0x561652f12510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.121+0000 7f43dbe00640 1 --2- 172.21.15.12:0/1766415916 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561652f03b90 0x561652f12510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.121+0000 7f43dbe00640 1 -- 172.21.15.12:0/1766415916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561652f0ed70 msgr2=0x561652f814a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.121+0000 7f43dbe00640 1 --2- 172.21.15.12:0/1766415916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561652f0ed70 0x561652f814a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.121+0000 7f43dbe00640 1 -- 172.21.15.12:0/1766415916 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561652f81b40 con 0x561652f044b0 2024-09-05T01:35:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.121+0000 7f43dbe00640 1 --2- 172.21.15.12:0/1766415916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561652f044b0 0x561652f12a50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f43c8011ee0 tx=0x7f43c8013040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac139bb6465be24e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.121+0000 7f43c2a00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:35:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.122+0000 7f43c2a00640 1 -- 172.21.15.12:0/1766415916 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c802e630 con 0x561652f044b0 2024-09-05T01:35:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.122+0000 7f43c2a00640 1 -- 172.21.15.12:0/1766415916 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8579+0+0 (secure 0 0 0) 0x7f43c802e7d0 con 0x561652f044b0 2024-09-05T01:35:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.122+0000 7f43e6293740 1 -- 172.21.15.12:0/1766415916 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43d0005570 con 0x561652f044b0 2024-09-05T01:35:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.122+0000 7f43c2a00640 1 -- 172.21.15.12:0/1766415916 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f43c802e9d0 con 0x561652f044b0 2024-09-05T01:35:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.122+0000 7f43e6293740 10 client.26668 fetch_fsmap learned FSMap version 62 2024-09-05T01:35:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.122+0000 7f43e6293740 1 -- 172.21.15.12:0/1766415916 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x561652f88f80 con 0x561652f044b0 2024-09-05T01:35:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.122+0000 7f43c2a00640 1 -- 172.21.15.12:0/1766415916 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43d0005570 con 0x561652f044b0 2024-09-05T01:35:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.123+0000 7f43c2a00640 1 -- 172.21.15.12:0/1766415916 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 62) ==== 8442+0+0 (secure 0 0 0) 0x7f43c8036c80 con 0x561652f044b0 2024-09-05T01:35:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.123+0000 7f43e6293740 10 client.26668 fetch_fsmap finished waiting for FSMap version 62 2024-09-05T01:35:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.123+0000 7f43e6293740 10 client.26668 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:35:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.123+0000 7f43e6293740 20 client.26668 populate_metadata read hostname 'smithi012' 2024-09-05T01:35:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.123+0000 7f43e6293740 1 --2- 172.21.15.12:0/1766415916 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x561652f897a0 0x561652f8bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.123+0000 7f43e6293740 4 client.26668 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-05T01:35:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.123+0000 7f43e6293740 1 -- 172.21.15.12:0/1766415916 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561652e71e60 con 0x561652f897a0 2024-09-05T01:35:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.123+0000 7f43e0e00640 1 --2- 172.21.15.12:0/1766415916 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x561652f897a0 0x561652f8bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.123+0000 7f43e0e00640 1 --2- 172.21.15.12:0/1766415916 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x561652f897a0 0x561652f8bbc0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0d2ae8b8c3aeb8 server_cookie=a24c15fa593ffbee in_seq=0 out_seq=0 2024-09-05T01:35:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.123+0000 7f43c2a00640 10 client.26668 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:35:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.124+0000 7f43c2a00640 1 -- 172.21.15.12:0/1766415916 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561652e71e60 con 0x561652f897a0 2024-09-05T01:35:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.124+0000 7f43c2a00640 10 client.26668 handle_command_reply: tid=0 2024-09-05T01:35:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.124+0000 7f43e6293740 1 client.26668 shutdown 2024-09-05T01:35:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.124+0000 7f43e6293740 1 -- 172.21.15.12:0/1766415916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561652f044b0 msgr2=0x561652f12a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.124+0000 7f43e6293740 1 --2- 172.21.15.12:0/1766415916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561652f044b0 0x561652f12a50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f43c8011ee0 tx=0x7f43c8013040 comp rx=0 tx=0).stop 2024-09-05T01:35:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.124+0000 7f43e6293740 1 -- 172.21.15.12:0/1766415916 shutdown_connections 2024-09-05T01:35:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.124+0000 7f43e6293740 1 --2- 172.21.15.12:0/1766415916 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x561652f897a0 0x561652f8bbc0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.124+0000 7f43e6293740 1 --2- 172.21.15.12:0/1766415916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561652f0ed70 0x561652f814a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.124+0000 7f43e6293740 1 --2- 172.21.15.12:0/1766415916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561652f044b0 0x561652f12a50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.124+0000 7f43e6293740 1 --2- 172.21.15.12:0/1766415916 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x561652f03b90 0x561652f12510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.124+0000 7f43e6293740 1 -- 172.21.15.12:0/1766415916 >> 172.21.15.12:0/1766415916 conn(0x561652f00120 msgr2=0x561652f0bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.124+0000 7f43c2a00640 0 client.26668 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:35:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.124+0000 7f43e6293740 1 -- 172.21.15.12:0/1766415916 shutdown_connections 2024-09-05T01:35:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.124+0000 7f43e6293740 1 -- 172.21.15.12:0/1766415916 wait complete. 2024-09-05T01:35:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.124+0000 7f43e6293740 20 client.26668 trim_cache size 0 max 16384 2024-09-05T01:35:46.130 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:35:46.130 INFO:teuthology.orchestra.run.smithi012.stdout: "status": "no active scrubs running", 2024-09-05T01:35:46.130 INFO:teuthology.orchestra.run.smithi012.stdout: "scrubs": {} 2024-09-05T01:35:46.130 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:35:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.125+0000 7f43e3800640 1 -- 172.21.15.12:0/4154045091 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f43c40a2d70 msgr2=0x7f43c40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.125+0000 7f43e3800640 1 --2- 172.21.15.12:0/4154045091 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f43c40a2d70 0x7f43c40a5230 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x561652f014a0 tx=0x7f43c8005f90 comp rx=0 tx=0).stop 2024-09-05T01:35:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.125+0000 7f43e3800640 1 -- 172.21.15.12:0/4154045091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43dc10e450 msgr2=0x7f43dc19efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.125+0000 7f43e3800640 1 --2- 172.21.15.12:0/4154045091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43dc10e450 0x7f43dc19efb0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f43d400eb40 tx=0x7f43d400c2d0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.126+0000 7f43e3800640 1 -- 172.21.15.12:0/4154045091 shutdown_connections 2024-09-05T01:35:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.126+0000 7f43e3800640 1 --2- 172.21.15.12:0/4154045091 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f43c40a2d70 0x7f43c40a5230 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.126+0000 7f43e3800640 1 --2- 172.21.15.12:0/4154045091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43dc10e450 0x7f43dc19efb0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.126+0000 7f43e3800640 1 --2- 172.21.15.12:0/4154045091 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f43dc074e30 0x7f43dc19ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.126+0000 7f43e3800640 1 --2- 172.21.15.12:0/4154045091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43dc074510 0x7f43dc19a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.126+0000 7f43e3800640 1 -- 172.21.15.12:0/4154045091 >> 172.21.15.12:0/4154045091 conn(0x7f43dc0fd8b0 msgr2=0x7f43dc0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:46.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.126+0000 7f43e3800640 1 -- 172.21.15.12:0/4154045091 shutdown_connections 2024-09-05T01:35:46.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:46.126+0000 7f43e3800640 1 -- 172.21.15.12:0/4154045091 wait complete. 2024-09-05T01:35:46.983 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-05T01:35:46.983 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:35:47.410 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:35:47.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:47 smithi012 ceph-mon[29942]: pgmap v345: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 358 op/s 2024-09-05T01:35:47.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:47 smithi145 ceph-mon[34376]: pgmap v345: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 358 op/s 2024-09-05T01:35:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:47 smithi151 ceph-mon[35013]: pgmap v345: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 358 op/s 2024-09-05T01:35:48.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.008+0000 7f6474a00640 1 -- 172.21.15.12:0/365595534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6470104010 msgr2=0x7f64701043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:48.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.008+0000 7f6474a00640 1 --2- 172.21.15.12:0/365595534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6470104010 0x7f64701043f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6460009900 tx=0x7f646002a3f0 comp rx=0 tx=0).stop 2024-09-05T01:35:48.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.008+0000 7f6474a00640 1 -- 172.21.15.12:0/365595534 shutdown_connections 2024-09-05T01:35:48.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.008+0000 7f6474a00640 1 --2- 172.21.15.12:0/365595534 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6470109140 0x7f6470110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:48.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.008+0000 7f6474a00640 1 --2- 172.21.15.12:0/365595534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64701049c0 0x7f6470108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:48.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.008+0000 7f6474a00640 1 --2- 172.21.15.12:0/365595534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6470104010 0x7f64701043f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:48.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.008+0000 7f6474a00640 1 -- 172.21.15.12:0/365595534 >> 172.21.15.12:0/365595534 conn(0x7f64700ffa50 msgr2=0x7f6470101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:48.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.008+0000 7f6474a00640 1 -- 172.21.15.12:0/365595534 shutdown_connections 2024-09-05T01:35:48.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.008+0000 7f6474a00640 1 -- 172.21.15.12:0/365595534 wait complete. 2024-09-05T01:35:48.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.009+0000 7f6474a00640 1 Processor -- start 2024-09-05T01:35:48.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.009+0000 7f6474a00640 1 -- start start 2024-09-05T01:35:48.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.009+0000 7f6474a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6470104010 0x7f647019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:48.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.009+0000 7f6474a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64701049c0 0x7f647019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:48.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.009+0000 7f6474a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6470109140 0x7f647019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:48.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.009+0000 7f6474a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6470114190 con 0x7f6470104010 2024-09-05T01:35:48.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.009+0000 7f6474a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6470114010 con 0x7f6470109140 2024-09-05T01:35:48.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.009+0000 7f6474a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6470114310 con 0x7f64701049c0 2024-09-05T01:35:48.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.010+0000 7f6465400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64701049c0 0x7f647019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:48.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.010+0000 7f646de00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6470104010 0x7f647019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:48.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.010+0000 7f6465400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64701049c0 0x7f647019ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:57816/0 (socket says 172.21.15.12:57816) 2024-09-05T01:35:48.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.010+0000 7f6465400640 1 -- 172.21.15.12:0/3088652800 learned_addr learned my addr 172.21.15.12:0/3088652800 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:48.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.010+0000 7f646e800640 1 --2- 172.21.15.12:0/3088652800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6470109140 0x7f647019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:48.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.010+0000 7f6465400640 1 -- 172.21.15.12:0/3088652800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6470109140 msgr2=0x7f647019eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:48.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.010+0000 7f6465400640 1 --2- 172.21.15.12:0/3088652800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6470109140 0x7f647019eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:48.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.010+0000 7f6465400640 1 -- 172.21.15.12:0/3088652800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6470104010 msgr2=0x7f647019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:48.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.010+0000 7f6465400640 1 --2- 172.21.15.12:0/3088652800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6470104010 0x7f647019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:48.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.010+0000 7f6465400640 1 -- 172.21.15.12:0/3088652800 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647019f5b0 con 0x7f64701049c0 2024-09-05T01:35:48.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.010+0000 7f646e800640 1 --2- 172.21.15.12:0/3088652800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6470109140 0x7f647019eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:35:48.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.010+0000 7f6465400640 1 --2- 172.21.15.12:0/3088652800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64701049c0 0x7f647019ab40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f645800e9f0 tx=0x7f645800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:48.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.011+0000 7f6467400640 1 -- 172.21.15.12:0/3088652800 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645800cd80 con 0x7f64701049c0 2024-09-05T01:35:48.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.011+0000 7f6474a00640 1 -- 172.21.15.12:0/3088652800 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647019f8a0 con 0x7f64701049c0 2024-09-05T01:35:48.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.011+0000 7f6467400640 1 -- 172.21.15.12:0/3088652800 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6458010910 con 0x7f64701049c0 2024-09-05T01:35:48.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.011+0000 7f6467400640 1 -- 172.21.15.12:0/3088652800 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64580188f0 con 0x7f64701049c0 2024-09-05T01:35:48.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.011+0000 7f6474a00640 1 -- 172.21.15.12:0/3088652800 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64701a7180 con 0x7f64701049c0 2024-09-05T01:35:48.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.012+0000 7f6474a00640 1 -- 172.21.15.12:0/3088652800 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64701043f0 con 0x7f64701049c0 2024-09-05T01:35:48.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.014+0000 7f6467400640 1 -- 172.21.15.12:0/3088652800 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f6458010ac0 con 0x7f64701049c0 2024-09-05T01:35:48.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.015+0000 7f6467400640 1 --2- 172.21.15.12:0/3088652800 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f64540a2cf0 0x7f64540a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:48.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.015+0000 7f6467400640 1 -- 172.21.15.12:0/3088652800 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8579+0+0 (secure 0 0 0) 0x7f64580cfe10 con 0x7f64701049c0 2024-09-05T01:35:48.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.016+0000 7f646de00640 1 --2- 172.21.15.12:0/3088652800 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f64540a2cf0 0x7f64540a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:48.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.016+0000 7f646de00640 1 --2- 172.21.15.12:0/3088652800 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f64540a2cf0 0x7f64540a51b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6460000c00 tx=0x7f6460005b50 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:48.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.017+0000 7f6467400640 1 -- 172.21.15.12:0/3088652800 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f645809c990 con 0x7f64701049c0 2024-09-05T01:35:48.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.259+0000 7f6474a00640 1 -- 172.21.15.12:0/3088652800 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f647019b960 con 0x7f64701049c0 2024-09-05T01:35:48.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.260+0000 7f6467400640 1 -- 172.21.15.12:0/3088652800 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+12015 (secure 0 0 0) 0x7f647019b960 con 0x7f64701049c0 2024-09-05T01:35:48.262 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:35:48.262 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":62,"btime":"2024-09-05T01:35:33:162995+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14532,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/2949711075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":2949711075},{"type":"v1","addr":"172.21.15.12:6839","nonce":2949711075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":62,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T01:22:35.979384+0000","modified":"2024-09-05T01:35:33.132391+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24529,"mds_2":24524,"mds_3":24517,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/497406458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":497406458},{"type":"v1","addr":"172.21.15.12:6841","nonce":497406458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":202,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":10,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.145:6839/1706431882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":1706431882},{"type":"v1","addr":"172.21.15.145:6839","nonce":1706431882}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24560,24529,24524,24517,24460]},"id":1}]} 2024-09-05T01:35:48.263 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 62 2024-09-05T01:35:48.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.263+0000 7f6474a00640 1 -- 172.21.15.12:0/3088652800 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f64540a2cf0 msgr2=0x7f64540a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:48.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.263+0000 7f6474a00640 1 --2- 172.21.15.12:0/3088652800 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f64540a2cf0 0x7f64540a51b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6460000c00 tx=0x7f6460005b50 comp rx=0 tx=0).stop 2024-09-05T01:35:48.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.263+0000 7f6474a00640 1 -- 172.21.15.12:0/3088652800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64701049c0 msgr2=0x7f647019ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:48.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.263+0000 7f6474a00640 1 --2- 172.21.15.12:0/3088652800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64701049c0 0x7f647019ab40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f645800e9f0 tx=0x7f645800eeb0 comp rx=0 tx=0).stop 2024-09-05T01:35:48.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.263+0000 7f6474a00640 1 -- 172.21.15.12:0/3088652800 shutdown_connections 2024-09-05T01:35:48.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.263+0000 7f6474a00640 1 --2- 172.21.15.12:0/3088652800 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f64540a2cf0 0x7f64540a51b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:48.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.263+0000 7f6474a00640 1 --2- 172.21.15.12:0/3088652800 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6470109140 0x7f647019eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:48.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.263+0000 7f6474a00640 1 --2- 172.21.15.12:0/3088652800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64701049c0 0x7f647019ab40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:48.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.263+0000 7f6474a00640 1 --2- 172.21.15.12:0/3088652800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6470104010 0x7f647019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:48.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.263+0000 7f6474a00640 1 -- 172.21.15.12:0/3088652800 >> 172.21.15.12:0/3088652800 conn(0x7f64700ffa50 msgr2=0x7f6470100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:48.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.263+0000 7f6474a00640 1 -- 172.21.15.12:0/3088652800 shutdown_connections 2024-09-05T01:35:48.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:48.263+0000 7f6474a00640 1 -- 172.21.15.12:0/3088652800 wait complete. 2024-09-05T01:35:49.070 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-05T01:35:49.282 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:49 smithi012 ceph-mon[29942]: pgmap v346: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 372 op/s 2024-09-05T01:35:49.282 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:49 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3088652800' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:35:49.536 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:35:49.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:49 smithi145 ceph-mon[34376]: pgmap v346: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 372 op/s 2024-09-05T01:35:49.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:49 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3088652800' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:35:49.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:49 smithi151 ceph-mon[35013]: pgmap v346: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.0 MiB/s wr, 372 op/s 2024-09-05T01:35:49.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:49 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3088652800' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:35:50.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.110+0000 7f9a6b800640 1 -- 172.21.15.12:0/1237249534 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a641049a0 msgr2=0x7f9a641089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:50.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.110+0000 7f9a6b800640 1 --2- 172.21.15.12:0/1237249534 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a641049a0 0x7f9a641089f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9a50009900 tx=0x7f9a5002a3f0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.112+0000 7f9a6b800640 1 -- 172.21.15.12:0/1237249534 shutdown_connections 2024-09-05T01:35:50.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.112+0000 7f9a6b800640 1 --2- 172.21.15.12:0/1237249534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a64109120 0x7f9a64110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.112+0000 7f9a6b800640 1 --2- 172.21.15.12:0/1237249534 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a641049a0 0x7f9a641089f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.112+0000 7f9a6b800640 1 --2- 172.21.15.12:0/1237249534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a64103ff0 0x7f9a641043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.112+0000 7f9a6b800640 1 -- 172.21.15.12:0/1237249534 >> 172.21.15.12:0/1237249534 conn(0x7f9a640ffa90 msgr2=0x7f9a64101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:50.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.112+0000 7f9a6b800640 1 -- 172.21.15.12:0/1237249534 shutdown_connections 2024-09-05T01:35:50.276 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.112+0000 7f9a6b800640 1 -- 172.21.15.12:0/1237249534 wait complete. 2024-09-05T01:35:50.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.123+0000 7f9a6b800640 1 Processor -- start 2024-09-05T01:35:50.285 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.123+0000 7f9a6b800640 1 -- start start 2024-09-05T01:35:50.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.123+0000 7f9a6b800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a64103ff0 0x7f9a6419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:50.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.123+0000 7f9a6b800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a641049a0 0x7f9a6419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:50.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.123+0000 7f9a6b800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a64109120 0x7f9a6419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:50.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.123+0000 7f9a6b800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9a64114170 con 0x7f9a641049a0 2024-09-05T01:35:50.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.123+0000 7f9a6b800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9a64113ff0 con 0x7f9a64103ff0 2024-09-05T01:35:50.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.123+0000 7f9a6b800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9a641142f0 con 0x7f9a64109120 2024-09-05T01:35:50.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.123+0000 7f9a63e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a641049a0 0x7f9a6419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:50.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.123+0000 7f9a68e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a64103ff0 0x7f9a6419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:50.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.123+0000 7f9a63e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a641049a0 0x7f9a6419ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41404/0 (socket says 172.21.15.12:41404) 2024-09-05T01:35:50.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.123+0000 7f9a63e00640 1 -- 172.21.15.12:0/3139763202 learned_addr learned my addr 172.21.15.12:0/3139763202 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:50.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.123+0000 7f9a68e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a64103ff0 0x7f9a6419a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:57458/0 (socket says 172.21.15.12:57458) 2024-09-05T01:35:50.286 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.123+0000 7f9a69800640 1 --2- 172.21.15.12:0/3139763202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a64109120 0x7f9a6419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:50.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a69800640 1 -- 172.21.15.12:0/3139763202 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a64103ff0 msgr2=0x7f9a6419a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:50.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a69800640 1 --2- 172.21.15.12:0/3139763202 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a64103ff0 0x7f9a6419a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a69800640 1 -- 172.21.15.12:0/3139763202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a641049a0 msgr2=0x7f9a6419ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:50.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a69800640 1 --2- 172.21.15.12:0/3139763202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a641049a0 0x7f9a6419ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a69800640 1 -- 172.21.15.12:0/3139763202 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6419f600 con 0x7f9a64109120 2024-09-05T01:35:50.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a63e00640 1 --2- 172.21.15.12:0/3139763202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a641049a0 0x7f9a6419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:35:50.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a68e00640 1 --2- 172.21.15.12:0/3139763202 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a64103ff0 0x7f9a6419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:35:50.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a69800640 1 --2- 172.21.15.12:0/3139763202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a64109120 0x7f9a6419ef20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00ec50 tx=0x7f9a5c00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:50.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a61600640 1 -- 172.21.15.12:0/3139763202 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c003b70 con 0x7f9a64109120 2024-09-05T01:35:50.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a6b800640 1 -- 172.21.15.12:0/3139763202 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a6419f8f0 con 0x7f9a64109120 2024-09-05T01:35:50.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a61600640 1 -- 172.21.15.12:0/3139763202 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a5c003d10 con 0x7f9a64109120 2024-09-05T01:35:50.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a61600640 1 -- 172.21.15.12:0/3139763202 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c010890 con 0x7f9a64109120 2024-09-05T01:35:50.287 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a6b800640 1 -- 172.21.15.12:0/3139763202 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a641a71d0 con 0x7f9a64109120 2024-09-05T01:35:50.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a6e454740 1 Processor -- start 2024-09-05T01:35:50.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a61600640 1 -- 172.21.15.12:0/3139763202 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f9a5c003fc0 con 0x7f9a64109120 2024-09-05T01:35:50.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a6e454740 1 -- start start 2024-09-05T01:35:50.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a6e454740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0933edc70 0x55e0933ee050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:50.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a6e454740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933ee590 0x55e0933f8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:50.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a6e454740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0933f8e50 0x55e0933fb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:50.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a6e454740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e0933543e0 con 0x55e0933f8e50 2024-09-05T01:35:50.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a6e454740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55e0932fbd80 con 0x55e0933ee590 2024-09-05T01:35:50.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a6e454740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e0933503a0 con 0x55e0933edc70 2024-09-05T01:35:50.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a68e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933ee590 0x55e0933f8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:50.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a68e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933ee590 0x55e0933f8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:57472/0 (socket says 172.21.15.12:57472) 2024-09-05T01:35:50.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a68e00640 1 -- 172.21.15.12:0/247973069 learned_addr learned my addr 172.21.15.12:0/247973069 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:50.288 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a63e00640 1 --2- 172.21.15.12:0/247973069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0933edc70 0x55e0933ee050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:50.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a63e00640 1 --2- 172.21.15.12:0/247973069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0933f8e50 0x55e0933fb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:50.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a68e00640 1 -- 172.21.15.12:0/247973069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0933edc70 msgr2=0x55e0933ee050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:50.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a68e00640 1 --2- 172.21.15.12:0/247973069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0933edc70 0x55e0933ee050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a68e00640 1 -- 172.21.15.12:0/247973069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0933f8e50 msgr2=0x55e0933fb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:50.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a68e00640 1 --2- 172.21.15.12:0/247973069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0933f8e50 0x55e0933fb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a68e00640 1 -- 172.21.15.12:0/247973069 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e09331aae0 con 0x55e0933ee590 2024-09-05T01:35:50.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a63e00640 1 --2- 172.21.15.12:0/247973069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0933f8e50 0x55e0933fb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:35:50.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.124+0000 7f9a68e00640 1 --2- 172.21.15.12:0/247973069 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933ee590 0x55e0933f8910 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9a58010480 tx=0x7f9a58010940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef2caf5480a6b365 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:50.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a61600640 1 --2- 172.21.15.12:0/3139763202 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f9a4c0a2cf0 0x7f9a4c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:50.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a56000640 1 -- 172.21.15.12:0/247973069 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a58011760 con 0x55e0933ee590 2024-09-05T01:35:50.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a56000640 1 -- 172.21.15.12:0/247973069 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a58011de0 con 0x55e0933ee590 2024-09-05T01:35:50.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a56000640 1 -- 172.21.15.12:0/247973069 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5800e430 con 0x55e0933ee590 2024-09-05T01:35:50.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a61600640 1 -- 172.21.15.12:0/3139763202 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8579+0+0 (secure 0 0 0) 0x7f9a5c0cfa30 con 0x7f9a64109120 2024-09-05T01:35:50.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a63e00640 1 --2- 172.21.15.12:0/3139763202 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f9a4c0a2cf0 0x7f9a4c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a6e454740 1 -- 172.21.15.12:0/247973069 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933ee590 msgr2=0x55e0933f8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a6e454740 1 --2- 172.21.15.12:0/247973069 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933ee590 0x55e0933f8910 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9a58010480 tx=0x7f9a58010940 comp rx=0 tx=0).stop 2024-09-05T01:35:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a6e454740 1 -- 172.21.15.12:0/247973069 shutdown_connections 2024-09-05T01:35:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a6e454740 1 --2- 172.21.15.12:0/247973069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0933f8e50 0x55e0933fb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a6e454740 1 --2- 172.21.15.12:0/247973069 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933ee590 0x55e0933f8910 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a6e454740 1 --2- 172.21.15.12:0/247973069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0933edc70 0x55e0933ee050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a6e454740 1 -- 172.21.15.12:0/247973069 >> 172.21.15.12:0/247973069 conn(0x55e0933ea200 msgr2=0x55e0933ea5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a6e454740 1 -- 172.21.15.12:0/247973069 shutdown_connections 2024-09-05T01:35:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a63e00640 1 --2- 172.21.15.12:0/3139763202 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f9a4c0a2cf0 0x7f9a4c0a51b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9a50031520 tx=0x7f9a500046c0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a6e454740 1 -- 172.21.15.12:0/247973069 wait complete. 2024-09-05T01:35:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a6e454740 1 -- start start 2024-09-05T01:35:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a6e454740 1 Processor -- start 2024-09-05T01:35:50.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a6e454740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0933edc70 0x55e0933f5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:50.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a6e454740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0933ee590 0x55e0933f6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:50.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a6e454740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933f8e50 0x55e0933f6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:50.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a6e454740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e0933fba20 con 0x55e0933edc70 2024-09-05T01:35:50.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a6e454740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55e09330f0f0 con 0x55e0933f8e50 2024-09-05T01:35:50.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a6e454740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e0933fbba0 con 0x55e0933ee590 2024-09-05T01:35:50.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a6e454740 10 client.0 _ll_register_callbacks cb 0x55e0932f6bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:35:50.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a63e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0933ee590 0x55e0933f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:50.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a63e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0933ee590 0x55e0933f6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:57864/0 (socket says 172.21.15.12:57864) 2024-09-05T01:35:50.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a63e00640 1 -- 172.21.15.12:0/4149450936 learned_addr learned my addr 172.21.15.12:0/4149450936 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:50.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a68e00640 1 --2- 172.21.15.12:0/4149450936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0933edc70 0x55e0933f5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:50.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a69800640 1 --2- 172.21.15.12:0/4149450936 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933f8e50 0x55e0933f6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:50.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a63e00640 1 -- 172.21.15.12:0/4149450936 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933f8e50 msgr2=0x55e0933f6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:50.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a63e00640 1 --2- 172.21.15.12:0/4149450936 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933f8e50 0x55e0933f6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a63e00640 1 -- 172.21.15.12:0/4149450936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0933edc70 msgr2=0x55e0933f5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:50.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a63e00640 1 --2- 172.21.15.12:0/4149450936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0933edc70 0x55e0933f5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.130+0000 7f9a63e00640 1 -- 172.21.15.12:0/4149450936 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0930c53c0 con 0x55e0933ee590 2024-09-05T01:35:50.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.135+0000 7f9a63e00640 1 --2- 172.21.15.12:0/4149450936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0933ee590 0x55e0933f6210 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9a50003b20 tx=0x7f9a500314b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76540b4ab614664d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:50.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.135+0000 7f9a4aa00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:35:50.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.135+0000 7f9a4aa00640 1 -- 172.21.15.12:0/4149450936 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a50050070 con 0x55e0933ee590 2024-09-05T01:35:50.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.135+0000 7f9a4aa00640 1 -- 172.21.15.12:0/4149450936 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8579+0+0 (secure 0 0 0) 0x7f9a50031cf0 con 0x55e0933ee590 2024-09-05T01:35:50.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.135+0000 7f9a6e454740 1 -- 172.21.15.12:0/4149450936 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a58011de0 con 0x55e0933ee590 2024-09-05T01:35:50.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.135+0000 7f9a4aa00640 1 -- 172.21.15.12:0/4149450936 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f9a5005c050 con 0x55e0933ee590 2024-09-05T01:35:50.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.135+0000 7f9a6e454740 10 client.26686 fetch_fsmap learned FSMap version 62 2024-09-05T01:35:50.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.135+0000 7f9a6e454740 1 -- 172.21.15.12:0/4149450936 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55e0934079f0 con 0x55e0933ee590 2024-09-05T01:35:50.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.135+0000 7f9a4aa00640 1 -- 172.21.15.12:0/4149450936 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a58011de0 con 0x55e0933ee590 2024-09-05T01:35:50.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.135+0000 7f9a4aa00640 1 -- 172.21.15.12:0/4149450936 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 62) ==== 8442+0+0 (secure 0 0 0) 0x7f9a5003b550 con 0x55e0933ee590 2024-09-05T01:35:50.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.135+0000 7f9a6e454740 10 client.26686 fetch_fsmap finished waiting for FSMap version 62 2024-09-05T01:35:50.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.135+0000 7f9a6e454740 10 client.26686 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-05T01:35:50.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.136+0000 7f9a6e454740 20 client.26686 populate_metadata read hostname 'smithi012' 2024-09-05T01:35:50.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.136+0000 7f9a6e454740 1 --2- 172.21.15.12:0/4149450936 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55e093408ec0 0x55e09340b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:50.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.136+0000 7f9a6e454740 4 client.26686 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:35:50.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.136+0000 7f9a6e454740 1 -- 172.21.15.12:0/4149450936 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e093361950 con 0x55e093408ec0 2024-09-05T01:35:50.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.136+0000 7f9a68e00640 1 --2- 172.21.15.12:0/4149450936 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55e093408ec0 0x55e09340b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:50.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.136+0000 7f9a68e00640 1 --2- 172.21.15.12:0/4149450936 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55e093408ec0 0x55e09340b360 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=90b6378d931bd762 server_cookie=cf3c678d5076bc77 in_seq=0 out_seq=0 2024-09-05T01:35:50.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.136+0000 7f9a4aa00640 10 client.26686 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:35:50.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.137+0000 7f9a4aa00640 1 -- 172.21.15.12:0/4149450936 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e093361950 con 0x55e093408ec0 2024-09-05T01:35:50.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.137+0000 7f9a4aa00640 10 client.26686 handle_command_reply: tid=0 2024-09-05T01:35:50.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.137+0000 7f9a6e454740 1 client.26686 shutdown 2024-09-05T01:35:50.293 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.137+0000 7f9a6e454740 1 -- 172.21.15.12:0/4149450936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0933ee590 msgr2=0x55e0933f6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:50.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.137+0000 7f9a6e454740 1 --2- 172.21.15.12:0/4149450936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0933ee590 0x55e0933f6210 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9a50003b20 tx=0x7f9a500314b0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.138+0000 7f9a6e454740 1 -- 172.21.15.12:0/4149450936 shutdown_connections 2024-09-05T01:35:50.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.138+0000 7f9a6e454740 1 --2- 172.21.15.12:0/4149450936 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55e093408ec0 0x55e09340b360 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.138+0000 7f9a6e454740 1 --2- 172.21.15.12:0/4149450936 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933f8e50 0x55e0933f6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.138+0000 7f9a6e454740 1 --2- 172.21.15.12:0/4149450936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0933ee590 0x55e0933f6210 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.138+0000 7f9a6e454740 1 --2- 172.21.15.12:0/4149450936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0933edc70 0x55e0933f5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.138+0000 7f9a4aa00640 0 client.26686 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:35:50.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.138+0000 7f9a6e454740 1 -- 172.21.15.12:0/4149450936 >> 172.21.15.12:0/4149450936 conn(0x55e0933ea200 msgr2=0x55e0933efee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:50.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.138+0000 7f9a6e454740 1 -- 172.21.15.12:0/4149450936 shutdown_connections 2024-09-05T01:35:50.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.138+0000 7f9a6e454740 1 -- 172.21.15.12:0/4149450936 wait complete. 2024-09-05T01:35:50.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.138+0000 7f9a6e454740 20 client.26686 trim_cache size 0 max 16384 2024-09-05T01:35:50.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.152+0000 7f9a6e454740 1 Processor -- start 2024-09-05T01:35:50.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.153+0000 7f9a6e454740 1 -- start start 2024-09-05T01:35:50.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.153+0000 7f9a6e454740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933edc70 0x55e093410c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.153+0000 7f9a6e454740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0933ee590 0x55e0934111b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.153+0000 7f9a6e454740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0933f8e50 0x55e0933f2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.153+0000 7f9a6e454740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9a641afb40 con 0x55e0933ee590 2024-09-05T01:35:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.153+0000 7f9a6e454740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9a641b18c0 con 0x55e0933edc70 2024-09-05T01:35:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.153+0000 7f9a6e454740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9a641b0210 con 0x55e0933f8e50 2024-09-05T01:35:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.153+0000 7f9a68e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933edc70 0x55e093410c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.153+0000 7f9a68e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933edc70 0x55e093410c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:57494/0 (socket says 172.21.15.12:57494) 2024-09-05T01:35:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.153+0000 7f9a68e00640 1 -- 172.21.15.12:0/203328834 learned_addr learned my addr 172.21.15.12:0/203328834 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.153+0000 7f9a69800640 1 --2- 172.21.15.12:0/203328834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0933f8e50 0x55e0933f2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.153+0000 7f9a63e00640 1 --2- 172.21.15.12:0/203328834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0933ee590 0x55e0934111b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.154+0000 7f9a68e00640 1 -- 172.21.15.12:0/203328834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0933f8e50 msgr2=0x55e0933f2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.154+0000 7f9a68e00640 1 --2- 172.21.15.12:0/203328834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0933f8e50 0x55e0933f2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.154+0000 7f9a68e00640 1 -- 172.21.15.12:0/203328834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0933ee590 msgr2=0x55e0934111b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:50.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.154+0000 7f9a68e00640 1 --2- 172.21.15.12:0/203328834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0933ee590 0x55e0934111b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.154+0000 7f9a68e00640 1 -- 172.21.15.12:0/203328834 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0933e5770 con 0x55e0933edc70 2024-09-05T01:35:50.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.154+0000 7f9a68e00640 1 --2- 172.21.15.12:0/203328834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933edc70 0x55e093410c70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9a58013010 tx=0x7f9a58013040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2c27f4cd36049e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:50.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.154+0000 7f9a55600640 1 -- 172.21.15.12:0/203328834 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a58004020 con 0x55e0933edc70 2024-09-05T01:35:50.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.154+0000 7f9a55600640 1 -- 172.21.15.12:0/203328834 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a58005510 con 0x55e0933edc70 2024-09-05T01:35:50.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.154+0000 7f9a55600640 1 -- 172.21.15.12:0/203328834 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a58004b00 con 0x55e0933edc70 2024-09-05T01:35:50.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.155+0000 7f9a6e454740 1 -- 172.21.15.12:0/203328834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933edc70 msgr2=0x55e093410c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:50.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.155+0000 7f9a6e454740 1 --2- 172.21.15.12:0/203328834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933edc70 0x55e093410c70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9a58013010 tx=0x7f9a58013040 comp rx=0 tx=0).stop 2024-09-05T01:35:50.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.155+0000 7f9a6e454740 1 -- 172.21.15.12:0/203328834 shutdown_connections 2024-09-05T01:35:50.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.155+0000 7f9a6e454740 1 --2- 172.21.15.12:0/203328834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0933f8e50 0x55e0933f2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.155+0000 7f9a6e454740 1 --2- 172.21.15.12:0/203328834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0933ee590 0x55e0934111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.155+0000 7f9a6e454740 1 --2- 172.21.15.12:0/203328834 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933edc70 0x55e093410c70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.296 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.155+0000 7f9a6e454740 1 -- 172.21.15.12:0/203328834 >> 172.21.15.12:0/203328834 conn(0x55e0933ea200 msgr2=0x55e0933f7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:50.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.155+0000 7f9a6e454740 1 -- 172.21.15.12:0/203328834 shutdown_connections 2024-09-05T01:35:50.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.155+0000 7f9a6e454740 1 -- 172.21.15.12:0/203328834 wait complete. 2024-09-05T01:35:50.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.155+0000 7f9a6e454740 1 -- start start 2024-09-05T01:35:50.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.156+0000 7f9a6e454740 1 Processor -- start 2024-09-05T01:35:50.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.156+0000 7f9a6e454740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933edc70 0x55e0933f2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:50.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.156+0000 7f9a6e454740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0933ee590 0x55e0933f3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:50.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.156+0000 7f9a6e454740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0933f8e50 0x55e0933f37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:50.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.156+0000 7f9a6e454740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9a641b1130 con 0x55e0933ee590 2024-09-05T01:35:50.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.156+0000 7f9a6e454740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f9a641b09a0 con 0x55e0933edc70 2024-09-05T01:35:50.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.156+0000 7f9a6e454740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9a641adb40 con 0x55e0933f8e50 2024-09-05T01:35:50.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.156+0000 7f9a6e454740 10 client.0 _ll_register_callbacks cb 0x7f9a50009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:35:50.297 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.156+0000 7f9a69800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0933f8e50 0x55e0933f37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.156+0000 7f9a68e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933edc70 0x55e0933f2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.156+0000 7f9a69800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0933f8e50 0x55e0933f37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:57882/0 (socket says 172.21.15.12:57882) 2024-09-05T01:35:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.156+0000 7f9a69800640 1 -- 172.21.15.12:0/2943137312 learned_addr learned my addr 172.21.15.12:0/2943137312 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.157+0000 7f9a63e00640 1 --2- 172.21.15.12:0/2943137312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0933ee590 0x55e0933f3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.157+0000 7f9a69800640 1 -- 172.21.15.12:0/2943137312 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933edc70 msgr2=0x55e0933f2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.157+0000 7f9a69800640 1 --2- 172.21.15.12:0/2943137312 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933edc70 0x55e0933f2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.157+0000 7f9a69800640 1 -- 172.21.15.12:0/2943137312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0933ee590 msgr2=0x55e0933f3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.157+0000 7f9a69800640 1 --2- 172.21.15.12:0/2943137312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0933ee590 0x55e0933f3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.157+0000 7f9a69800640 1 -- 172.21.15.12:0/2943137312 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e093472c70 con 0x55e0933f8e50 2024-09-05T01:35:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.157+0000 7f9a68e00640 1 --2- 172.21.15.12:0/2943137312 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933edc70 0x55e0933f2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:35:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.157+0000 7f9a69800640 1 --2- 172.21.15.12:0/2943137312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0933f8e50 0x55e0933f37a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c098310 tx=0x7f9a5c009820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fd4ba9a0efc690f server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.157+0000 7f9a4aa00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:35:50.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.157+0000 7f9a4aa00640 1 -- 172.21.15.12:0/2943137312 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c0a0260 con 0x55e0933f8e50 2024-09-05T01:35:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.157+0000 7f9a6e454740 1 -- 172.21.15.12:0/2943137312 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a58005510 con 0x55e0933f8e50 2024-09-05T01:35:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.157+0000 7f9a4aa00640 1 -- 172.21.15.12:0/2943137312 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8579+0+0 (secure 0 0 0) 0x7f9a5c0a4690 con 0x55e0933f8e50 2024-09-05T01:35:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.158+0000 7f9a4aa00640 1 -- 172.21.15.12:0/2943137312 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f9a5c0a4b20 con 0x55e0933f8e50 2024-09-05T01:35:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.158+0000 7f9a6e454740 10 client.26692 fetch_fsmap learned FSMap version 62 2024-09-05T01:35:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.158+0000 7f9a6e454740 1 -- 172.21.15.12:0/2943137312 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55e093473fe0 con 0x55e0933f8e50 2024-09-05T01:35:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.158+0000 7f9a4aa00640 1 -- 172.21.15.12:0/2943137312 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a58005510 con 0x55e0933f8e50 2024-09-05T01:35:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.158+0000 7f9a4aa00640 1 -- 172.21.15.12:0/2943137312 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 62) ==== 8442+0+0 (secure 0 0 0) 0x7f9a5c0ba020 con 0x55e0933f8e50 2024-09-05T01:35:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.158+0000 7f9a6e454740 10 client.26692 fetch_fsmap finished waiting for FSMap version 62 2024-09-05T01:35:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.158+0000 7f9a6e454740 10 client.26692 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.l 2024-09-05T01:35:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.158+0000 7f9a6e454740 20 client.26692 populate_metadata read hostname 'smithi012' 2024-09-05T01:35:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.158+0000 7f9a6e454740 1 --2- 172.21.15.12:0/2943137312 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55e0934747f0 0x55e093476c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.158+0000 7f9a6e454740 4 client.26692 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:35:50.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.158+0000 7f9a6e454740 1 -- 172.21.15.12:0/2943137312 --> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e09335be60 con 0x55e0934747f0 2024-09-05T01:35:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.159+0000 7f9a68e00640 1 --2- 172.21.15.12:0/2943137312 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55e0934747f0 0x55e093476c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.159+0000 7f9a68e00640 1 --2- 172.21.15.12:0/2943137312 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55e0934747f0 0x55e093476c10 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=98ecd882e7440746 server_cookie=961a670d666017ea in_seq=0 out_seq=0 2024-09-05T01:35:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.159+0000 7f9a4aa00640 10 client.26692 ms_handle_connect on v2:172.21.15.151:6832/1259141438 2024-09-05T01:35:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.159+0000 7f9a4aa00640 1 -- 172.21.15.12:0/2943137312 <== mds.4 v2:172.21.15.151:6832/1259141438 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e09335be60 con 0x55e0934747f0 2024-09-05T01:35:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.159+0000 7f9a4aa00640 10 client.26692 handle_command_reply: tid=0 2024-09-05T01:35:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.159+0000 7f9a6e454740 1 client.26692 shutdown 2024-09-05T01:35:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.160+0000 7f9a6e454740 1 -- 172.21.15.12:0/2943137312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0933f8e50 msgr2=0x55e0933f37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.160+0000 7f9a6e454740 1 --2- 172.21.15.12:0/2943137312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0933f8e50 0x55e0933f37a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c098310 tx=0x7f9a5c009820 comp rx=0 tx=0).stop 2024-09-05T01:35:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.160+0000 7f9a6e454740 1 -- 172.21.15.12:0/2943137312 shutdown_connections 2024-09-05T01:35:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.160+0000 7f9a6e454740 1 --2- 172.21.15.12:0/2943137312 >> [v2:172.21.15.151:6832/1259141438,v1:172.21.15.151:6833/1259141438] conn(0x55e0934747f0 0x55e093476c10 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.160+0000 7f9a6e454740 1 --2- 172.21.15.12:0/2943137312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0933f8e50 0x55e0933f37a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.160+0000 7f9a6e454740 1 --2- 172.21.15.12:0/2943137312 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0933ee590 0x55e0933f3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.160+0000 7f9a6e454740 1 --2- 172.21.15.12:0/2943137312 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55e0933edc70 0x55e0933f2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.160+0000 7f9a6e454740 1 -- 172.21.15.12:0/2943137312 >> 172.21.15.12:0/2943137312 conn(0x55e0933ea200 msgr2=0x55e0933f5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:50.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.160+0000 7f9a4aa00640 0 client.26692 ms_handle_reset on v2:172.21.15.151:6832/1259141438 2024-09-05T01:35:50.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.160+0000 7f9a6e454740 1 -- 172.21.15.12:0/2943137312 shutdown_connections 2024-09-05T01:35:50.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.160+0000 7f9a6e454740 1 -- 172.21.15.12:0/2943137312 wait complete. 2024-09-05T01:35:50.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.160+0000 7f9a6e454740 20 client.26692 trim_cache size 0 max 16384 2024-09-05T01:35:50.301 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:35:50.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.161+0000 7f9a6b800640 1 -- 172.21.15.12:0/3139763202 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f9a4c0a2cf0 msgr2=0x7f9a4c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:50.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.161+0000 7f9a6b800640 1 --2- 172.21.15.12:0/3139763202 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f9a4c0a2cf0 0x7f9a4c0a51b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9a50031520 tx=0x7f9a500046c0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.161+0000 7f9a6b800640 1 -- 172.21.15.12:0/3139763202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a64109120 msgr2=0x7f9a6419ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:50.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.161+0000 7f9a6b800640 1 --2- 172.21.15.12:0/3139763202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a64109120 0x7f9a6419ef20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00ec50 tx=0x7f9a5c00c6a0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.161+0000 7f9a6b800640 1 -- 172.21.15.12:0/3139763202 shutdown_connections 2024-09-05T01:35:50.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.161+0000 7f9a6b800640 1 --2- 172.21.15.12:0/3139763202 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f9a4c0a2cf0 0x7f9a4c0a51b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.161+0000 7f9a6b800640 1 --2- 172.21.15.12:0/3139763202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a64109120 0x7f9a6419ef20 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.161+0000 7f9a6b800640 1 --2- 172.21.15.12:0/3139763202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a641049a0 0x7f9a6419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.161+0000 7f9a6b800640 1 --2- 172.21.15.12:0/3139763202 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f9a64103ff0 0x7f9a6419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:50.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.161+0000 7f9a6b800640 1 -- 172.21.15.12:0/3139763202 >> 172.21.15.12:0/3139763202 conn(0x7f9a640ffa90 msgr2=0x7f9a64100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:50.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.161+0000 7f9a6b800640 1 -- 172.21.15.12:0/3139763202 shutdown_connections 2024-09-05T01:35:50.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:50.161+0000 7f9a6b800640 1 -- 172.21.15.12:0/3139763202 wait complete. 2024-09-05T01:35:51.042 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-05T01:35:51.438 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:35:51.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:51 smithi012 ceph-mon[29942]: pgmap v347: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.4 MiB/s wr, 462 op/s 2024-09-05T01:35:51.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:51 smithi145 ceph-mon[34376]: pgmap v347: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.4 MiB/s wr, 462 op/s 2024-09-05T01:35:51.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:51 smithi151 ceph-mon[35013]: pgmap v347: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.4 MiB/s wr, 462 op/s 2024-09-05T01:35:52.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.060+0000 7fe999e00640 1 -- 172.21.15.12:0/3141751762 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe994109140 msgr2=0x7fe994110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:52.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.060+0000 7fe999e00640 1 --2- 172.21.15.12:0/3141751762 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe994109140 0x7fe994110cc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009ca0 tx=0x7fe98c02a8b0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.060+0000 7fe999e00640 1 -- 172.21.15.12:0/3141751762 shutdown_connections 2024-09-05T01:35:52.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.060+0000 7fe999e00640 1 --2- 172.21.15.12:0/3141751762 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe994109140 0x7fe994110cc0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.060+0000 7fe999e00640 1 --2- 172.21.15.12:0/3141751762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9941049c0 0x7fe994108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.060+0000 7fe999e00640 1 --2- 172.21.15.12:0/3141751762 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe994104010 0x7fe9941043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.060+0000 7fe999e00640 1 -- 172.21.15.12:0/3141751762 >> 172.21.15.12:0/3141751762 conn(0x7fe9940ffa50 msgr2=0x7fe994101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:52.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.060+0000 7fe999e00640 1 -- 172.21.15.12:0/3141751762 shutdown_connections 2024-09-05T01:35:52.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.060+0000 7fe999e00640 1 -- 172.21.15.12:0/3141751762 wait complete. 2024-09-05T01:35:52.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.061+0000 7fe999e00640 1 Processor -- start 2024-09-05T01:35:52.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.061+0000 7fe999e00640 1 -- start start 2024-09-05T01:35:52.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.062+0000 7fe999e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe994104010 0x7fe99419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:52.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.062+0000 7fe999e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe9941049c0 0x7fe99419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:52.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.062+0000 7fe999e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe994109140 0x7fe99419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:52.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.062+0000 7fe999e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe994114150 con 0x7fe994109140 2024-09-05T01:35:52.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.062+0000 7fe999e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe994113fd0 con 0x7fe9941049c0 2024-09-05T01:35:52.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.062+0000 7fe999e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941142d0 con 0x7fe994104010 2024-09-05T01:35:52.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.062+0000 7fe992000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe9941049c0 0x7fe99419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:52.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.062+0000 7fe992000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe9941049c0 0x7fe99419ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:57520/0 (socket says 172.21.15.12:57520) 2024-09-05T01:35:52.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.062+0000 7fe993400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe994109140 0x7fe99419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:52.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.062+0000 7fe992000640 1 -- 172.21.15.12:0/1775475343 learned_addr learned my addr 172.21.15.12:0/1775475343 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:52.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.062+0000 7fe992a00640 1 --2- 172.21.15.12:0/1775475343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe994104010 0x7fe99419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:52.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.063+0000 7fe992000640 1 -- 172.21.15.12:0/1775475343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe994104010 msgr2=0x7fe99419a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:52.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.063+0000 7fe992000640 1 --2- 172.21.15.12:0/1775475343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe994104010 0x7fe99419a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.063+0000 7fe992000640 1 -- 172.21.15.12:0/1775475343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe994109140 msgr2=0x7fe99419eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:52.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.063+0000 7fe992000640 1 --2- 172.21.15.12:0/1775475343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe994109140 0x7fe99419eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.063+0000 7fe992000640 1 -- 172.21.15.12:0/1775475343 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99419f5c0 con 0x7fe9941049c0 2024-09-05T01:35:52.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.063+0000 7fe992000640 1 --2- 172.21.15.12:0/1775475343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe9941049c0 0x7fe99419ab50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe98000ea60 tx=0x7fe98000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:52.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.063+0000 7fe998a00640 1 -- 172.21.15.12:0/1775475343 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98000cde0 con 0x7fe9941049c0 2024-09-05T01:35:52.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.063+0000 7fe999e00640 1 -- 172.21.15.12:0/1775475343 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe99419f8b0 con 0x7fe9941049c0 2024-09-05T01:35:52.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.063+0000 7fe998a00640 1 -- 172.21.15.12:0/1775475343 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9800035f0 con 0x7fe9941049c0 2024-09-05T01:35:52.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.063+0000 7fe998a00640 1 -- 172.21.15.12:0/1775475343 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe980010670 con 0x7fe9941049c0 2024-09-05T01:35:52.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.063+0000 7fe999e00640 1 -- 172.21.15.12:0/1775475343 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9941a7190 con 0x7fe9941049c0 2024-09-05T01:35:52.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.066+0000 7fe99c827740 1 Processor -- start 2024-09-05T01:35:52.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.066+0000 7fe99c827740 1 -- start start 2024-09-05T01:35:52.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.067+0000 7fe99c827740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75709fc70 0x55d7570a0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:52.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.067+0000 7fe99c827740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7570a0590 0x55d7570aa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:52.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.067+0000 7fe99c827740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7570aae50 0x55d7570ad240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:52.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.067+0000 7fe99c827740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d7570063e0 con 0x55d75709fc70 2024-09-05T01:35:52.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.067+0000 7fe99c827740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55d756fadd80 con 0x55d7570aae50 2024-09-05T01:35:52.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.067+0000 7fe99c827740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d7570023a0 con 0x55d7570a0590 2024-09-05T01:35:52.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.067+0000 7fe993400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75709fc70 0x55d7570a0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:52.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.067+0000 7fe993400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75709fc70 0x55d7570a0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41464/0 (socket says 172.21.15.12:41464) 2024-09-05T01:35:52.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.067+0000 7fe993400640 1 -- 172.21.15.12:0/2738848912 learned_addr learned my addr 172.21.15.12:0/2738848912 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:52.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.067+0000 7fe998a00640 1 -- 172.21.15.12:0/1775475343 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fe9800037a0 con 0x7fe9941049c0 2024-09-05T01:35:52.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.067+0000 7fe992a00640 1 --2- 172.21.15.12:0/2738848912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7570a0590 0x55d7570aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:52.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.067+0000 7fe992000640 1 --2- 172.21.15.12:0/2738848912 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7570aae50 0x55d7570ad240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:52.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.068+0000 7fe992a00640 1 -- 172.21.15.12:0/2738848912 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7570aae50 msgr2=0x55d7570ad240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:52.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.068+0000 7fe992a00640 1 --2- 172.21.15.12:0/2738848912 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7570aae50 0x55d7570ad240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.068+0000 7fe992a00640 1 -- 172.21.15.12:0/2738848912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75709fc70 msgr2=0x55d7570a0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:52.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.068+0000 7fe992a00640 1 --2- 172.21.15.12:0/2738848912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75709fc70 0x55d7570a0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.068+0000 7fe992a00640 1 -- 172.21.15.12:0/2738848912 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d756fccae0 con 0x55d7570a0590 2024-09-05T01:35:52.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.068+0000 7fe993400640 1 --2- 172.21.15.12:0/2738848912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75709fc70 0x55d7570a0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:35:52.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.068+0000 7fe992a00640 1 --2- 172.21.15.12:0/2738848912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7570a0590 0x55d7570aa910 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe984009c20 tx=0x7fe984011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2def240c269341e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:52.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.068+0000 7fe97fe00640 1 -- 172.21.15.12:0/2738848912 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98401e070 con 0x55d7570a0590 2024-09-05T01:35:52.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.068+0000 7fe97fe00640 1 -- 172.21.15.12:0/2738848912 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe984009dd0 con 0x55d7570a0590 2024-09-05T01:35:52.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.068+0000 7fe97fe00640 1 -- 172.21.15.12:0/2738848912 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9840187a0 con 0x55d7570a0590 2024-09-05T01:35:52.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.069+0000 7fe99c827740 1 -- 172.21.15.12:0/2738848912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7570a0590 msgr2=0x55d7570aa910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:52.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.069+0000 7fe99c827740 1 --2- 172.21.15.12:0/2738848912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7570a0590 0x55d7570aa910 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe984009c20 tx=0x7fe984011810 comp rx=0 tx=0).stop 2024-09-05T01:35:52.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.069+0000 7fe99c827740 1 -- 172.21.15.12:0/2738848912 shutdown_connections 2024-09-05T01:35:52.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.069+0000 7fe99c827740 1 --2- 172.21.15.12:0/2738848912 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7570aae50 0x55d7570ad240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.069+0000 7fe99c827740 1 --2- 172.21.15.12:0/2738848912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7570a0590 0x55d7570aa910 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.069+0000 7fe99c827740 1 --2- 172.21.15.12:0/2738848912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75709fc70 0x55d7570a0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.069+0000 7fe99c827740 1 -- 172.21.15.12:0/2738848912 >> 172.21.15.12:0/2738848912 conn(0x55d75709c200 msgr2=0x55d75709c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:52.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.069+0000 7fe99c827740 1 -- 172.21.15.12:0/2738848912 shutdown_connections 2024-09-05T01:35:52.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.069+0000 7fe99c827740 1 -- 172.21.15.12:0/2738848912 wait complete. 2024-09-05T01:35:52.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.069+0000 7fe998a00640 1 --2- 172.21.15.12:0/1775475343 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe9780a2ca0 0x7fe9780a5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:52.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.070+0000 7fe998a00640 1 -- 172.21.15.12:0/1775475343 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8579+0+0 (secure 0 0 0) 0x7fe9800cf710 con 0x7fe9941049c0 2024-09-05T01:35:52.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.070+0000 7fe99c827740 1 -- start start 2024-09-05T01:35:52.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.070+0000 7fe993400640 1 --2- 172.21.15.12:0/1775475343 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe9780a2ca0 0x7fe9780a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:52.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.070+0000 7fe99c827740 1 Processor -- start 2024-09-05T01:35:52.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.071+0000 7fe99c827740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75709fc70 0x55d7570a7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:52.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.071+0000 7fe99c827740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7570a0590 0x55d7570a8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:52.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.071+0000 7fe99c827740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7570aae50 0x55d7570a8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:52.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.071+0000 7fe99c827740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d7570ada20 con 0x55d75709fc70 2024-09-05T01:35:52.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.071+0000 7fe99c827740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55d756fc10f0 con 0x55d7570a0590 2024-09-05T01:35:52.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.071+0000 7fe993400640 1 --2- 172.21.15.12:0/1775475343 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe9780a2ca0 0x7fe9780a5160 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe98c006010 tx=0x7fe98c009360 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:52.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.071+0000 7fe99c827740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d7570adba0 con 0x55d7570aae50 2024-09-05T01:35:52.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.071+0000 7fe99c827740 10 client.0 _ll_register_callbacks cb 0x55d756fa8bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:35:52.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.071+0000 7fe992000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7570a0590 0x55d7570a8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:52.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.071+0000 7fe992000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7570a0590 0x55d7570a8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:57536/0 (socket says 172.21.15.12:57536) 2024-09-05T01:35:52.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.071+0000 7fe992000640 1 -- 172.21.15.12:0/2756547944 learned_addr learned my addr 172.21.15.12:0/2756547944 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:52.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.071+0000 7fe993400640 1 --2- 172.21.15.12:0/2756547944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7570aae50 0x55d7570a8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:52.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.071+0000 7fe992a00640 1 --2- 172.21.15.12:0/2756547944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75709fc70 0x55d7570a7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:52.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.071+0000 7fe992000640 1 -- 172.21.15.12:0/2756547944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7570aae50 msgr2=0x55d7570a8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:52.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.071+0000 7fe992000640 1 --2- 172.21.15.12:0/2756547944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7570aae50 0x55d7570a8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.071+0000 7fe992000640 1 -- 172.21.15.12:0/2756547944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75709fc70 msgr2=0x55d7570a7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:52.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.071+0000 7fe992000640 1 --2- 172.21.15.12:0/2756547944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75709fc70 0x55d7570a7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.071+0000 7fe992000640 1 -- 172.21.15.12:0/2756547944 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d756d773c0 con 0x55d7570a0590 2024-09-05T01:35:52.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.071+0000 7fe992a00640 1 --2- 172.21.15.12:0/2756547944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75709fc70 0x55d7570a7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:35:52.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.072+0000 7fe992000640 1 --2- 172.21.15.12:0/2756547944 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7570a0590 0x55d7570a8230 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe98000ea30 tx=0x7fe98009b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20db4757b4e50acb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:52.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.072+0000 7fe97cc00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:35:52.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.072+0000 7fe97cc00640 1 -- 172.21.15.12:0/2756547944 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98009bb90 con 0x55d7570a0590 2024-09-05T01:35:52.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.072+0000 7fe97cc00640 1 -- 172.21.15.12:0/2756547944 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8579+0+0 (secure 0 0 0) 0x7fe9800cd040 con 0x55d7570a0590 2024-09-05T01:35:52.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.072+0000 7fe99c827740 1 -- 172.21.15.12:0/2756547944 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe984009dd0 con 0x55d7570a0590 2024-09-05T01:35:52.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.072+0000 7fe97cc00640 1 -- 172.21.15.12:0/2756547944 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fe9800cd240 con 0x55d7570a0590 2024-09-05T01:35:52.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.072+0000 7fe99c827740 10 client.26717 fetch_fsmap learned FSMap version 62 2024-09-05T01:35:52.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.072+0000 7fe99c827740 1 -- 172.21.15.12:0/2756547944 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55d7570b9a10 con 0x55d7570a0590 2024-09-05T01:35:52.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.072+0000 7fe97cc00640 1 -- 172.21.15.12:0/2756547944 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe984009dd0 con 0x55d7570a0590 2024-09-05T01:35:52.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.072+0000 7fe97cc00640 1 -- 172.21.15.12:0/2756547944 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 62) ==== 8442+0+0 (secure 0 0 0) 0x7fe9800ba300 con 0x55d7570a0590 2024-09-05T01:35:52.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.073+0000 7fe99c827740 10 client.26717 fetch_fsmap finished waiting for FSMap version 62 2024-09-05T01:35:52.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.073+0000 7fe99c827740 10 client.26717 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-05T01:35:52.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.073+0000 7fe99c827740 20 client.26717 populate_metadata read hostname 'smithi012' 2024-09-05T01:35:52.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.073+0000 7fe99c827740 1 --2- 172.21.15.12:0/2756547944 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55d7570baf70 0x55d7570bd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:52.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.073+0000 7fe99c827740 4 client.26717 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:35:52.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.073+0000 7fe99c827740 1 -- 172.21.15.12:0/2756547944 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d757013950 con 0x55d7570baf70 2024-09-05T01:35:52.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.073+0000 7fe992a00640 1 --2- 172.21.15.12:0/2756547944 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55d7570baf70 0x55d7570bd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:52.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.074+0000 7fe992a00640 1 --2- 172.21.15.12:0/2756547944 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55d7570baf70 0x55d7570bd3c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a3ee8ff676a37619 server_cookie=a4c03b987e12f9c4 in_seq=0 out_seq=0 2024-09-05T01:35:52.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.074+0000 7fe97cc00640 10 client.26717 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:35:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.074+0000 7fe97cc00640 1 -- 172.21.15.12:0/2756547944 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d757013950 con 0x55d7570baf70 2024-09-05T01:35:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.074+0000 7fe97cc00640 10 client.26717 handle_command_reply: tid=0 2024-09-05T01:35:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.074+0000 7fe99c827740 1 client.26717 shutdown 2024-09-05T01:35:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.075+0000 7fe99c827740 1 -- 172.21.15.12:0/2756547944 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7570a0590 msgr2=0x55d7570a8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.075+0000 7fe99c827740 1 --2- 172.21.15.12:0/2756547944 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7570a0590 0x55d7570a8230 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe98000ea30 tx=0x7fe98009b790 comp rx=0 tx=0).stop 2024-09-05T01:35:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.075+0000 7fe99c827740 1 -- 172.21.15.12:0/2756547944 shutdown_connections 2024-09-05T01:35:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.075+0000 7fe99c827740 1 --2- 172.21.15.12:0/2756547944 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55d7570baf70 0x55d7570bd3c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.075+0000 7fe99c827740 1 --2- 172.21.15.12:0/2756547944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7570aae50 0x55d7570a8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.075+0000 7fe99c827740 1 --2- 172.21.15.12:0/2756547944 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7570a0590 0x55d7570a8230 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.075+0000 7fe99c827740 1 --2- 172.21.15.12:0/2756547944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75709fc70 0x55d7570a7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.075+0000 7fe97cc00640 0 client.26717 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:35:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.075+0000 7fe99c827740 1 -- 172.21.15.12:0/2756547944 >> 172.21.15.12:0/2756547944 conn(0x55d75709c200 msgr2=0x55d7570a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:52.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.075+0000 7fe99c827740 1 -- 172.21.15.12:0/2756547944 shutdown_connections 2024-09-05T01:35:52.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.075+0000 7fe99c827740 1 -- 172.21.15.12:0/2756547944 wait complete. 2024-09-05T01:35:52.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.075+0000 7fe99c827740 20 client.26717 trim_cache size 0 max 16384 2024-09-05T01:35:52.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.090+0000 7fe99c827740 1 Processor -- start 2024-09-05T01:35:52.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.090+0000 7fe99c827740 1 -- start start 2024-09-05T01:35:52.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.090+0000 7fe99c827740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d75709fc70 0x55d75709b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:52.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.091+0000 7fe99c827740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7570a0590 0x55d7570c2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:52.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.091+0000 7fe99c827740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7570aae50 0x55d7570c3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:52.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.091+0000 7fe99c827740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941afc10 con 0x55d7570a0590 2024-09-05T01:35:52.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.091+0000 7fe99c827740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941b1990 con 0x55d7570aae50 2024-09-05T01:35:52.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.091+0000 7fe99c827740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941b02e0 con 0x55d75709fc70 2024-09-05T01:35:52.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.091+0000 7fe992000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7570a0590 0x55d7570c2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:52.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.091+0000 7fe992a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d75709fc70 0x55d75709b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:52.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.091+0000 7fe992000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7570a0590 0x55d7570c2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41496/0 (socket says 172.21.15.12:41496) 2024-09-05T01:35:52.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.091+0000 7fe993400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7570aae50 0x55d7570c3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:52.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.091+0000 7fe992a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d75709fc70 0x55d75709b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:57932/0 (socket says 172.21.15.12:57932) 2024-09-05T01:35:52.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.091+0000 7fe992a00640 1 -- 172.21.15.12:0/1800760551 learned_addr learned my addr 172.21.15.12:0/1800760551 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:52.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.091+0000 7fe993400640 1 -- 172.21.15.12:0/1800760551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d75709fc70 msgr2=0x55d75709b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:52.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.091+0000 7fe993400640 1 --2- 172.21.15.12:0/1800760551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d75709fc70 0x55d75709b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.091+0000 7fe993400640 1 -- 172.21.15.12:0/1800760551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7570a0590 msgr2=0x55d7570c2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:52.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.091+0000 7fe993400640 1 --2- 172.21.15.12:0/1800760551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7570a0590 0x55d7570c2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.091+0000 7fe993400640 1 -- 172.21.15.12:0/1800760551 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d75709c030 con 0x55d7570aae50 2024-09-05T01:35:52.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.091+0000 7fe992000640 1 --2- 172.21.15.12:0/1800760551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7570a0590 0x55d7570c2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:35:52.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.091+0000 7fe992a00640 1 --2- 172.21.15.12:0/1800760551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d75709fc70 0x55d75709b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:35:52.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.092+0000 7fe993400640 1 --2- 172.21.15.12:0/1800760551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7570aae50 0x55d7570c3210 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe98c02add0 tx=0x7fe98c041000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9df618d117d8cea2 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:52.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.092+0000 7fe97f400640 1 -- 172.21.15.12:0/1800760551 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c030bb0 con 0x55d7570aae50 2024-09-05T01:35:52.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.092+0000 7fe97f400640 1 -- 172.21.15.12:0/1800760551 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe98c036050 con 0x55d7570aae50 2024-09-05T01:35:52.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.092+0000 7fe97f400640 1 -- 172.21.15.12:0/1800760551 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c0046a0 con 0x55d7570aae50 2024-09-05T01:35:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.093+0000 7fe99c827740 1 -- 172.21.15.12:0/1800760551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7570aae50 msgr2=0x55d7570c3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.093+0000 7fe99c827740 1 --2- 172.21.15.12:0/1800760551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7570aae50 0x55d7570c3210 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe98c02add0 tx=0x7fe98c041000 comp rx=0 tx=0).stop 2024-09-05T01:35:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.093+0000 7fe99c827740 1 -- 172.21.15.12:0/1800760551 shutdown_connections 2024-09-05T01:35:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.093+0000 7fe99c827740 1 --2- 172.21.15.12:0/1800760551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7570aae50 0x55d7570c3210 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.093+0000 7fe99c827740 1 --2- 172.21.15.12:0/1800760551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d7570a0590 0x55d7570c2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.093+0000 7fe99c827740 1 --2- 172.21.15.12:0/1800760551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d75709fc70 0x55d75709b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.093+0000 7fe99c827740 1 -- 172.21.15.12:0/1800760551 >> 172.21.15.12:0/1800760551 conn(0x55d75709c200 msgr2=0x55d75709ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.093+0000 7fe99c827740 1 -- 172.21.15.12:0/1800760551 shutdown_connections 2024-09-05T01:35:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.093+0000 7fe99c827740 1 -- 172.21.15.12:0/1800760551 wait complete. 2024-09-05T01:35:52.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.093+0000 7fe99c827740 1 -- start start 2024-09-05T01:35:52.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.094+0000 7fe99c827740 1 Processor -- start 2024-09-05T01:35:52.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.094+0000 7fe99c827740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75709fc70 0x55d7570b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:52.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.094+0000 7fe99c827740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7570a0590 0x55d7570b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:52.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.094+0000 7fe99c827740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7570aae50 0x55d7570afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:52.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.094+0000 7fe99c827740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941b1200 con 0x55d75709fc70 2024-09-05T01:35:52.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.094+0000 7fe99c827740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941b0a70 con 0x55d7570aae50 2024-09-05T01:35:52.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.094+0000 7fe99c827740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe9941adc10 con 0x55d7570a0590 2024-09-05T01:35:52.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.094+0000 7fe99c827740 10 client.0 _ll_register_callbacks cb 0x7fe980003e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:35:52.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.094+0000 7fe992a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75709fc70 0x55d7570b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:52.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.094+0000 7fe992000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7570a0590 0x55d7570b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:52.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.094+0000 7fe992000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7570a0590 0x55d7570b3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:57938/0 (socket says 172.21.15.12:57938) 2024-09-05T01:35:52.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.094+0000 7fe992000640 1 -- 172.21.15.12:0/3390565818 learned_addr learned my addr 172.21.15.12:0/3390565818 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:52.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.094+0000 7fe992a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75709fc70 0x55d7570b2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41506/0 (socket says 172.21.15.12:41506) 2024-09-05T01:35:52.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.094+0000 7fe993400640 1 --2- 172.21.15.12:0/3390565818 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7570aae50 0x55d7570afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:52.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.095+0000 7fe992a00640 1 -- 172.21.15.12:0/3390565818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7570a0590 msgr2=0x55d7570b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:52.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.095+0000 7fe992a00640 1 --2- 172.21.15.12:0/3390565818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7570a0590 0x55d7570b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.095+0000 7fe992a00640 1 -- 172.21.15.12:0/3390565818 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7570aae50 msgr2=0x55d7570afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:52.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.095+0000 7fe992a00640 1 --2- 172.21.15.12:0/3390565818 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7570aae50 0x55d7570afdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.095+0000 7fe992a00640 1 -- 172.21.15.12:0/3390565818 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d75709ce90 con 0x55d75709fc70 2024-09-05T01:35:52.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.095+0000 7fe993400640 1 --2- 172.21.15.12:0/3390565818 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7570aae50 0x55d7570afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:35:52.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.095+0000 7fe992000640 1 --2- 172.21.15.12:0/3390565818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7570a0590 0x55d7570b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:35:52.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.095+0000 7fe992a00640 1 --2- 172.21.15.12:0/3390565818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75709fc70 0x55d7570b2df0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe984014040 tx=0x7fe984004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c077c46cec35476 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:52.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.095+0000 7fe97cc00640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:35:52.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.096+0000 7fe97cc00640 1 -- 172.21.15.12:0/3390565818 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98401e040 con 0x55d75709fc70 2024-09-05T01:35:52.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.096+0000 7fe97cc00640 1 -- 172.21.15.12:0/3390565818 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8579+0+0 (secure 0 0 0) 0x7fe9840053b0 con 0x55d75709fc70 2024-09-05T01:35:52.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.096+0000 7fe99c827740 1 -- 172.21.15.12:0/3390565818 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe98c036050 con 0x55d75709fc70 2024-09-05T01:35:52.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.096+0000 7fe97cc00640 1 -- 172.21.15.12:0/3390565818 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fe9840055d0 con 0x55d75709fc70 2024-09-05T01:35:52.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.096+0000 7fe99c827740 10 client.16650 fetch_fsmap learned FSMap version 62 2024-09-05T01:35:52.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.096+0000 7fe99c827740 1 -- 172.21.15.12:0/3390565818 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55d757097770 con 0x55d75709fc70 2024-09-05T01:35:52.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.096+0000 7fe97cc00640 1 -- 172.21.15.12:0/3390565818 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe98c036050 con 0x55d75709fc70 2024-09-05T01:35:52.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.096+0000 7fe97cc00640 1 -- 172.21.15.12:0/3390565818 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 62) ==== 8442+0+0 (secure 0 0 0) 0x7fe984035030 con 0x55d75709fc70 2024-09-05T01:35:52.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.097+0000 7fe99c827740 10 client.16650 fetch_fsmap finished waiting for FSMap version 62 2024-09-05T01:35:52.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.097+0000 7fe99c827740 10 client.16650 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-09-05T01:35:52.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.097+0000 7fe99c827740 20 client.16650 populate_metadata read hostname 'smithi012' 2024-09-05T01:35:52.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.097+0000 7fe99c827740 1 --2- 172.21.15.12:0/3390565818 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55d757126740 0x55d757128b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:52.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.097+0000 7fe99c827740 4 client.16650 mds_command: new command op to 24517 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:35:52.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.097+0000 7fe99c827740 1 -- 172.21.15.12:0/3390565818 --> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d75700de60 con 0x55d757126740 2024-09-05T01:35:52.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.097+0000 7fe992000640 1 --2- 172.21.15.12:0/3390565818 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55d757126740 0x55d757128b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:52.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.098+0000 7fe992000640 1 --2- 172.21.15.12:0/3390565818 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55d757126740 0x55d757128b60 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c755d4290a63abcf server_cookie=585bc3aaffa871a9 in_seq=0 out_seq=0 2024-09-05T01:35:52.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.098+0000 7fe97cc00640 10 client.16650 ms_handle_connect on v2:172.21.15.151:6836/3977122893 2024-09-05T01:35:52.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.098+0000 7fe97cc00640 1 -- 172.21.15.12:0/3390565818 <== mds.3 v2:172.21.15.151:6836/3977122893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d75700de60 con 0x55d757126740 2024-09-05T01:35:52.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.098+0000 7fe97cc00640 10 client.16650 handle_command_reply: tid=0 2024-09-05T01:35:52.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.098+0000 7fe99c827740 1 client.16650 shutdown 2024-09-05T01:35:52.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.098+0000 7fe99c827740 1 -- 172.21.15.12:0/3390565818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75709fc70 msgr2=0x55d7570b2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:52.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.098+0000 7fe99c827740 1 --2- 172.21.15.12:0/3390565818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75709fc70 0x55d7570b2df0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe984014040 tx=0x7fe984004040 comp rx=0 tx=0).stop 2024-09-05T01:35:52.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.098+0000 7fe99c827740 1 -- 172.21.15.12:0/3390565818 shutdown_connections 2024-09-05T01:35:52.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.098+0000 7fe99c827740 1 --2- 172.21.15.12:0/3390565818 >> [v2:172.21.15.151:6836/3977122893,v1:172.21.15.151:6837/3977122893] conn(0x55d757126740 0x55d757128b60 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.098+0000 7fe99c827740 1 --2- 172.21.15.12:0/3390565818 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55d7570aae50 0x55d7570afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.098+0000 7fe99c827740 1 --2- 172.21.15.12:0/3390565818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7570a0590 0x55d7570b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.098+0000 7fe99c827740 1 --2- 172.21.15.12:0/3390565818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75709fc70 0x55d7570b2df0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.098+0000 7fe99c827740 1 -- 172.21.15.12:0/3390565818 >> 172.21.15.12:0/3390565818 conn(0x55d75709c200 msgr2=0x55d7570a1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:52.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.098+0000 7fe97cc00640 0 client.16650 ms_handle_reset on v2:172.21.15.151:6836/3977122893 2024-09-05T01:35:52.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.098+0000 7fe99c827740 1 -- 172.21.15.12:0/3390565818 shutdown_connections 2024-09-05T01:35:52.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.098+0000 7fe99c827740 1 -- 172.21.15.12:0/3390565818 wait complete. 2024-09-05T01:35:52.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.099+0000 7fe99c827740 20 client.16650 trim_cache size 0 max 16384 2024-09-05T01:35:52.104 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:35:52.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.099+0000 7fe999e00640 1 -- 172.21.15.12:0/1775475343 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe9780a2ca0 msgr2=0x7fe9780a5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:52.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.099+0000 7fe999e00640 1 --2- 172.21.15.12:0/1775475343 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe9780a2ca0 0x7fe9780a5160 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe98c006010 tx=0x7fe98c009360 comp rx=0 tx=0).stop 2024-09-05T01:35:52.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.099+0000 7fe999e00640 1 -- 172.21.15.12:0/1775475343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe9941049c0 msgr2=0x7fe99419ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:52.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.099+0000 7fe999e00640 1 --2- 172.21.15.12:0/1775475343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe9941049c0 0x7fe99419ab50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe98000ea60 tx=0x7fe98000ef20 comp rx=0 tx=0).stop 2024-09-05T01:35:52.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.099+0000 7fe999e00640 1 -- 172.21.15.12:0/1775475343 shutdown_connections 2024-09-05T01:35:52.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.099+0000 7fe999e00640 1 --2- 172.21.15.12:0/1775475343 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fe9780a2ca0 0x7fe9780a5160 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.099+0000 7fe999e00640 1 --2- 172.21.15.12:0/1775475343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe994109140 0x7fe99419eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.099+0000 7fe999e00640 1 --2- 172.21.15.12:0/1775475343 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fe9941049c0 0x7fe99419ab50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.099+0000 7fe999e00640 1 --2- 172.21.15.12:0/1775475343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe994104010 0x7fe99419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:52.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.099+0000 7fe999e00640 1 -- 172.21.15.12:0/1775475343 >> 172.21.15.12:0/1775475343 conn(0x7fe9940ffa50 msgr2=0x7fe994100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:52.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.100+0000 7fe999e00640 1 -- 172.21.15.12:0/1775475343 shutdown_connections 2024-09-05T01:35:52.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:52.100+0000 7fe999e00640 1 -- 172.21.15.12:0/1775475343 wait complete. 2024-09-05T01:35:52.970 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-05T01:35:53.374 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:35:53.515 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:53 smithi012 ceph-mon[29942]: pgmap v348: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 340 op/s 2024-09-05T01:35:53.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:53 smithi145 ceph-mon[34376]: pgmap v348: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 340 op/s 2024-09-05T01:35:53.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:53 smithi151 ceph-mon[35013]: pgmap v348: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 340 op/s 2024-09-05T01:35:54.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.022+0000 7fc572200640 1 -- 172.21.15.12:0/336754901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc56c1091f0 msgr2=0x7fc56c1095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:54.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.022+0000 7fc572200640 1 --2- 172.21.15.12:0/336754901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc56c1091f0 0x7fc56c1095d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc560009860 tx=0x7fc56002a360 comp rx=0 tx=0).stop 2024-09-05T01:35:54.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.022+0000 7fc572200640 1 -- 172.21.15.12:0/336754901 shutdown_connections 2024-09-05T01:35:54.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.022+0000 7fc572200640 1 --2- 172.21.15.12:0/336754901 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc56c114ab0 0x7fc56c116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.022+0000 7fc572200640 1 --2- 172.21.15.12:0/336754901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc56c109b10 0x7fc56c114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.022+0000 7fc572200640 1 --2- 172.21.15.12:0/336754901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc56c1091f0 0x7fc56c1095d0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.022+0000 7fc572200640 1 -- 172.21.15.12:0/336754901 >> 172.21.15.12:0/336754901 conn(0x7fc56c073660 msgr2=0x7fc56c073a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:54.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.022+0000 7fc572200640 1 -- 172.21.15.12:0/336754901 shutdown_connections 2024-09-05T01:35:54.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.023+0000 7fc572200640 1 -- 172.21.15.12:0/336754901 wait complete. 2024-09-05T01:35:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.024+0000 7fc572200640 1 Processor -- start 2024-09-05T01:35:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.025+0000 7fc572200640 1 -- start start 2024-09-05T01:35:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.025+0000 7fc572200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc56c1091f0 0x7fc56c112f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.025+0000 7fc572200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc56c109b10 0x7fc56c1134a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.025+0000 7fc572200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc56c114ab0 0x7fc56c1b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.025+0000 7fc572200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c118550 con 0x7fc56c1091f0 2024-09-05T01:35:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.025+0000 7fc572200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c1183d0 con 0x7fc56c109b10 2024-09-05T01:35:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.025+0000 7fc572200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c1186d0 con 0x7fc56c114ab0 2024-09-05T01:35:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.025+0000 7fc571800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc56c114ab0 0x7fc56c1b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.026+0000 7fc571800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc56c114ab0 0x7fc56c1b2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:57962/0 (socket says 172.21.15.12:57962) 2024-09-05T01:35:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.026+0000 7fc571800640 1 -- 172.21.15.12:0/390035145 learned_addr learned my addr 172.21.15.12:0/390035145 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:54.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.026+0000 7fc56be00640 1 --2- 172.21.15.12:0/390035145 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc56c109b10 0x7fc56c1134a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.026+0000 7fc571800640 1 -- 172.21.15.12:0/390035145 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc56c109b10 msgr2=0x7fc56c1134a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.026+0000 7fc571800640 1 --2- 172.21.15.12:0/390035145 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc56c109b10 0x7fc56c1134a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.026+0000 7fc571800640 1 -- 172.21.15.12:0/390035145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc56c1091f0 msgr2=0x7fc56c112f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.026+0000 7fc571800640 1 --2- 172.21.15.12:0/390035145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc56c1091f0 0x7fc56c112f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.026+0000 7fc571800640 1 -- 172.21.15.12:0/390035145 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56c1b3580 con 0x7fc56c114ab0 2024-09-05T01:35:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.026+0000 7fc571800640 1 --2- 172.21.15.12:0/390035145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc56c114ab0 0x7fc56c1b2ee0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc564009f80 tx=0x7fc56400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.027+0000 7fc569600640 1 -- 172.21.15.12:0/390035145 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc564004b20 con 0x7fc56c114ab0 2024-09-05T01:35:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.027+0000 7fc569600640 1 -- 172.21.15.12:0/390035145 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc564003e50 con 0x7fc56c114ab0 2024-09-05T01:35:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.027+0000 7fc569600640 1 -- 172.21.15.12:0/390035145 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56400b570 con 0x7fc56c114ab0 2024-09-05T01:35:54.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.027+0000 7fc572200640 1 -- 172.21.15.12:0/390035145 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc56c1b3870 con 0x7fc56c114ab0 2024-09-05T01:35:54.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.028+0000 7fc572200640 1 -- 172.21.15.12:0/390035145 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc56c1b3d60 con 0x7fc56c114ab0 2024-09-05T01:35:54.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.031+0000 7fc569600640 1 -- 172.21.15.12:0/390035145 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fc56401d020 con 0x7fc56c114ab0 2024-09-05T01:35:54.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.034+0000 7fc569600640 1 --2- 172.21.15.12:0/390035145 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc5540a2f00 0x7fc5540a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:54.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.034+0000 7fc569600640 1 -- 172.21.15.12:0/390035145 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8579+0+0 (secure 0 0 0) 0x7fc5640cf460 con 0x7fc56c114ab0 2024-09-05T01:35:54.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.035+0000 7fc570e00640 1 --2- 172.21.15.12:0/390035145 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc5540a2f00 0x7fc5540a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:54.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.036+0000 7fc575f22740 1 Processor -- start 2024-09-05T01:35:54.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.036+0000 7fc575f22740 1 -- start start 2024-09-05T01:35:54.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.036+0000 7fc575f22740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56013dc4ee40 0x56013dc4f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:54.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.036+0000 7fc575f22740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56013dc4f760 0x56013dc59ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:54.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.036+0000 7fc575f22740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56013dc5a020 0x56013dc5c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:54.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.036+0000 7fc575f22740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56013dbb53e0 con 0x56013dc4f760 2024-09-05T01:35:54.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.036+0000 7fc575f22740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56013db5cd80 con 0x56013dc5a020 2024-09-05T01:35:54.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.036+0000 7fc575f22740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56013dbb13a0 con 0x56013dc4ee40 2024-09-05T01:35:54.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.037+0000 7fc56be00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56013dc4f760 0x56013dc59ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:54.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.037+0000 7fc571800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56013dc5a020 0x56013dc5c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:54.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.037+0000 7fc571800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56013dc5a020 0x56013dc5c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:57582/0 (socket says 172.21.15.12:57582) 2024-09-05T01:35:54.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.037+0000 7fc571800640 1 -- 172.21.15.12:0/4137539754 learned_addr learned my addr 172.21.15.12:0/4137539754 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:54.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.037+0000 7fc570e00640 1 --2- 172.21.15.12:0/390035145 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc5540a2f00 0x7fc5540a53c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc5600304c0 tx=0x7fc5600303d0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:54.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.037+0000 7fc56be00640 1 -- 172.21.15.12:0/4137539754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56013dc4ee40 msgr2=0x56013dc4f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:54.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.037+0000 7fc56be00640 1 --2- 172.21.15.12:0/4137539754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56013dc4ee40 0x56013dc4f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.037+0000 7fc56be00640 1 -- 172.21.15.12:0/4137539754 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56013dc5a020 msgr2=0x56013dc5c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:54.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.037+0000 7fc56be00640 1 --2- 172.21.15.12:0/4137539754 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56013dc5a020 0x56013dc5c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.037+0000 7fc56be00640 1 -- 172.21.15.12:0/4137539754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56013db7bae0 con 0x56013dc4f760 2024-09-05T01:35:54.040 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.038+0000 7fc56be00640 1 --2- 172.21.15.12:0/4137539754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56013dc4f760 0x56013dc59ae0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc558009b40 tx=0x7fc5580113e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f192a30be02007 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:54.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.040+0000 7fc55e000640 1 -- 172.21.15.12:0/4137539754 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc558011e10 con 0x56013dc4f760 2024-09-05T01:35:54.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.041+0000 7fc55e000640 1 -- 172.21.15.12:0/4137539754 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc558012930 con 0x56013dc4f760 2024-09-05T01:35:54.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.041+0000 7fc55e000640 1 -- 172.21.15.12:0/4137539754 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55800fb60 con 0x56013dc4f760 2024-09-05T01:35:54.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.042+0000 7fc575f22740 1 -- 172.21.15.12:0/4137539754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56013dc4f760 msgr2=0x56013dc59ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:54.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.042+0000 7fc575f22740 1 --2- 172.21.15.12:0/4137539754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56013dc4f760 0x56013dc59ae0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc558009b40 tx=0x7fc5580113e0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.042+0000 7fc575f22740 1 -- 172.21.15.12:0/4137539754 shutdown_connections 2024-09-05T01:35:54.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.042+0000 7fc575f22740 1 --2- 172.21.15.12:0/4137539754 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56013dc5a020 0x56013dc5c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.042+0000 7fc575f22740 1 --2- 172.21.15.12:0/4137539754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56013dc4f760 0x56013dc59ae0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.042+0000 7fc575f22740 1 --2- 172.21.15.12:0/4137539754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56013dc4ee40 0x56013dc4f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.042+0000 7fc575f22740 1 -- 172.21.15.12:0/4137539754 >> 172.21.15.12:0/4137539754 conn(0x56013dc4b3d0 msgr2=0x56013dc4b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:54.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.043+0000 7fc575f22740 1 -- 172.21.15.12:0/4137539754 shutdown_connections 2024-09-05T01:35:54.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.043+0000 7fc575f22740 1 -- 172.21.15.12:0/4137539754 wait complete. 2024-09-05T01:35:54.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.043+0000 7fc575f22740 1 -- start start 2024-09-05T01:35:54.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.044+0000 7fc575f22740 1 Processor -- start 2024-09-05T01:35:54.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.044+0000 7fc575f22740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56013dc4ee40 0x56013dc57010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:54.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.044+0000 7fc575f22740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56013dc4f760 0x56013dc57550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:54.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.044+0000 7fc575f22740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56013dc5a020 0x56013dc57a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:54.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.044+0000 7fc575f22740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56013dc5cbf0 con 0x56013dc4ee40 2024-09-05T01:35:54.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.044+0000 7fc575f22740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x56013db700f0 con 0x56013dc5a020 2024-09-05T01:35:54.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.044+0000 7fc575f22740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56013dc5cd70 con 0x56013dc4f760 2024-09-05T01:35:54.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.045+0000 7fc575f22740 10 client.0 _ll_register_callbacks cb 0x56013db57bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:35:54.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.045+0000 7fc570e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56013dc4ee40 0x56013dc57010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:54.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.045+0000 7fc570e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56013dc4ee40 0x56013dc57010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41540/0 (socket says 172.21.15.12:41540) 2024-09-05T01:35:54.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.045+0000 7fc570e00640 1 -- 172.21.15.12:0/1297659903 learned_addr learned my addr 172.21.15.12:0/1297659903 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:54.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.046+0000 7fc56be00640 1 --2- 172.21.15.12:0/1297659903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56013dc4f760 0x56013dc57550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:54.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.046+0000 7fc56be00640 1 -- 172.21.15.12:0/1297659903 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56013dc5a020 msgr2=0x56013dc57a90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-05T01:35:54.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.046+0000 7fc56be00640 1 --2- 172.21.15.12:0/1297659903 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56013dc5a020 0x56013dc57a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.046+0000 7fc56be00640 1 -- 172.21.15.12:0/1297659903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56013dc4ee40 msgr2=0x56013dc57010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:54.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.047+0000 7fc56be00640 1 --2- 172.21.15.12:0/1297659903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56013dc4ee40 0x56013dc57010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.047+0000 7fc56be00640 1 -- 172.21.15.12:0/1297659903 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56013d9263c0 con 0x56013dc4f760 2024-09-05T01:35:54.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.047+0000 7fc570e00640 1 --2- 172.21.15.12:0/1297659903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56013dc4ee40 0x56013dc57010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:35:54.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.048+0000 7fc56be00640 1 --2- 172.21.15.12:0/1297659903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56013dc4f760 0x56013dc57550 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc55801c040 tx=0x7fc558012d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9760a662b7172870 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:54.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.048+0000 7fc552a00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:35:54.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.049+0000 7fc552a00640 1 -- 172.21.15.12:0/1297659903 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc558005030 con 0x56013dc4f760 2024-09-05T01:35:54.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.049+0000 7fc552a00640 1 -- 172.21.15.12:0/1297659903 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8579+0+0 (secure 0 0 0) 0x7fc5580051d0 con 0x56013dc4f760 2024-09-05T01:35:54.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.049+0000 7fc575f22740 1 -- 172.21.15.12:0/1297659903 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc558012930 con 0x56013dc4f760 2024-09-05T01:35:54.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.049+0000 7fc552a00640 1 -- 172.21.15.12:0/1297659903 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fc5580053d0 con 0x56013dc4f760 2024-09-05T01:35:54.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.050+0000 7fc575f22740 10 client.26719 fetch_fsmap learned FSMap version 62 2024-09-05T01:35:54.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.050+0000 7fc575f22740 1 -- 172.21.15.12:0/1297659903 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x56013dc79d40 con 0x56013dc4f760 2024-09-05T01:35:54.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.050+0000 7fc552a00640 1 -- 172.21.15.12:0/1297659903 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc558012930 con 0x56013dc4f760 2024-09-05T01:35:54.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.050+0000 7fc552a00640 1 -- 172.21.15.12:0/1297659903 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 62) ==== 8442+0+0 (secure 0 0 0) 0x7fc558003710 con 0x56013dc4f760 2024-09-05T01:35:54.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.051+0000 7fc575f22740 10 client.26719 fetch_fsmap finished waiting for FSMap version 62 2024-09-05T01:35:54.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.051+0000 7fc575f22740 10 client.26719 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T01:35:54.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.051+0000 7fc575f22740 20 client.26719 populate_metadata read hostname 'smithi012' 2024-09-05T01:35:54.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.051+0000 7fc575f22740 1 --2- 172.21.15.12:0/1297659903 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x56013dc7b0f0 0x56013dc7d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:54.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.051+0000 7fc575f22740 4 client.26719 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:35:54.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.051+0000 7fc575f22740 1 -- 172.21.15.12:0/1297659903 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56013dbc2950 con 0x56013dc7b0f0 2024-09-05T01:35:54.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.051+0000 7fc570e00640 1 --2- 172.21.15.12:0/1297659903 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x56013dc7b0f0 0x56013dc7d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:54.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.052+0000 7fc570e00640 1 --2- 172.21.15.12:0/1297659903 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x56013dc7b0f0 0x56013dc7d4e0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=444a8836e1408fe6 server_cookie=916e9d72a48d7b51 in_seq=0 out_seq=0 2024-09-05T01:35:54.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.052+0000 7fc552a00640 10 client.26719 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:35:54.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.053+0000 7fc552a00640 1 -- 172.21.15.12:0/1297659903 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56013dbc2950 con 0x56013dc7b0f0 2024-09-05T01:35:54.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.053+0000 7fc552a00640 10 client.26719 handle_command_reply: tid=0 2024-09-05T01:35:54.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.054+0000 7fc575f22740 1 client.26719 shutdown 2024-09-05T01:35:54.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.054+0000 7fc575f22740 1 -- 172.21.15.12:0/1297659903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56013dc4f760 msgr2=0x56013dc57550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:54.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.054+0000 7fc575f22740 1 --2- 172.21.15.12:0/1297659903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56013dc4f760 0x56013dc57550 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc55801c040 tx=0x7fc558012d10 comp rx=0 tx=0).stop 2024-09-05T01:35:54.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.054+0000 7fc575f22740 1 -- 172.21.15.12:0/1297659903 shutdown_connections 2024-09-05T01:35:54.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.054+0000 7fc575f22740 1 --2- 172.21.15.12:0/1297659903 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x56013dc7b0f0 0x56013dc7d4e0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.054+0000 7fc552a00640 0 client.26719 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:35:54.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.054+0000 7fc575f22740 1 --2- 172.21.15.12:0/1297659903 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56013dc5a020 0x56013dc57a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.054+0000 7fc575f22740 1 --2- 172.21.15.12:0/1297659903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56013dc4f760 0x56013dc57550 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.054+0000 7fc575f22740 1 --2- 172.21.15.12:0/1297659903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56013dc4ee40 0x56013dc57010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.054+0000 7fc575f22740 1 -- 172.21.15.12:0/1297659903 >> 172.21.15.12:0/1297659903 conn(0x56013dc4b3d0 msgr2=0x56013dc51100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:54.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.054+0000 7fc575f22740 1 -- 172.21.15.12:0/1297659903 shutdown_connections 2024-09-05T01:35:54.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.055+0000 7fc575f22740 1 -- 172.21.15.12:0/1297659903 wait complete. 2024-09-05T01:35:54.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.055+0000 7fc575f22740 20 client.26719 trim_cache size 0 max 16384 2024-09-05T01:35:54.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.073+0000 7fc575f22740 1 Processor -- start 2024-09-05T01:35:54.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.073+0000 7fc575f22740 1 -- start start 2024-09-05T01:35:54.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.073+0000 7fc575f22740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56013dc4ee40 0x56013dc578e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:54.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.073+0000 7fc575f22740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56013dc4f760 0x56013dc51860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:54.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.073+0000 7fc575f22740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56013dc5a020 0x56013dc82b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:54.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.073+0000 7fc575f22740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c1b4080 con 0x56013dc4ee40 2024-09-05T01:35:54.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.073+0000 7fc575f22740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c1b5d30 con 0x56013dc4f760 2024-09-05T01:35:54.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.073+0000 7fc575f22740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c1b4680 con 0x56013dc5a020 2024-09-05T01:35:54.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.074+0000 7fc570e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56013dc4ee40 0x56013dc578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:54.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.074+0000 7fc571800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56013dc5a020 0x56013dc82b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:54.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.074+0000 7fc56be00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56013dc4f760 0x56013dc51860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:54.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.074+0000 7fc571800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56013dc5a020 0x56013dc82b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:57978/0 (socket says 172.21.15.12:57978) 2024-09-05T01:35:54.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.074+0000 7fc571800640 1 -- 172.21.15.12:0/2497764346 learned_addr learned my addr 172.21.15.12:0/2497764346 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:54.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.074+0000 7fc56be00640 1 -- 172.21.15.12:0/2497764346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56013dc5a020 msgr2=0x56013dc82b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:54.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.074+0000 7fc56be00640 1 --2- 172.21.15.12:0/2497764346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56013dc5a020 0x56013dc82b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.074+0000 7fc56be00640 1 -- 172.21.15.12:0/2497764346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56013dc4ee40 msgr2=0x56013dc578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:54.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.074+0000 7fc56be00640 1 --2- 172.21.15.12:0/2497764346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56013dc4ee40 0x56013dc578e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.074+0000 7fc56be00640 1 -- 172.21.15.12:0/2497764346 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56013dc52bf0 con 0x56013dc4f760 2024-09-05T01:35:54.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.075+0000 7fc56be00640 1 --2- 172.21.15.12:0/2497764346 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56013dc4f760 0x56013dc51860 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc558003b10 tx=0x7fc558009a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73302bb2f24c417 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:54.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.075+0000 7fc55d600640 1 -- 172.21.15.12:0/2497764346 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55803a020 con 0x56013dc4f760 2024-09-05T01:35:54.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.075+0000 7fc55d600640 1 -- 172.21.15.12:0/2497764346 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc558009760 con 0x56013dc4f760 2024-09-05T01:35:54.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.075+0000 7fc55d600640 1 -- 172.21.15.12:0/2497764346 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc558012660 con 0x56013dc4f760 2024-09-05T01:35:54.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.076+0000 7fc575f22740 1 -- 172.21.15.12:0/2497764346 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56013dc4f760 msgr2=0x56013dc51860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:54.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.076+0000 7fc575f22740 1 --2- 172.21.15.12:0/2497764346 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56013dc4f760 0x56013dc51860 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc558003b10 tx=0x7fc558009a50 comp rx=0 tx=0).stop 2024-09-05T01:35:54.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.076+0000 7fc575f22740 1 -- 172.21.15.12:0/2497764346 shutdown_connections 2024-09-05T01:35:54.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.076+0000 7fc575f22740 1 --2- 172.21.15.12:0/2497764346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56013dc5a020 0x56013dc82b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.076+0000 7fc575f22740 1 --2- 172.21.15.12:0/2497764346 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56013dc4f760 0x56013dc51860 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.076+0000 7fc575f22740 1 --2- 172.21.15.12:0/2497764346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56013dc4ee40 0x56013dc578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.076+0000 7fc575f22740 1 -- 172.21.15.12:0/2497764346 >> 172.21.15.12:0/2497764346 conn(0x56013dc4b3d0 msgr2=0x56013dc59090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:54.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.076+0000 7fc575f22740 1 -- 172.21.15.12:0/2497764346 shutdown_connections 2024-09-05T01:35:54.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.076+0000 7fc575f22740 1 -- 172.21.15.12:0/2497764346 wait complete. 2024-09-05T01:35:54.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.076+0000 7fc575f22740 1 -- start start 2024-09-05T01:35:54.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.077+0000 7fc575f22740 1 Processor -- start 2024-09-05T01:35:54.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.077+0000 7fc575f22740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56013dc4ee40 0x56013dc6e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:54.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.077+0000 7fc575f22740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56013dc4f760 0x56013dc6eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:54.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.078+0000 7fc575f22740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56013dc5a020 0x56013dce3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:54.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.078+0000 7fc575f22740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c1b55a0 con 0x56013dc4ee40 2024-09-05T01:35:54.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.078+0000 7fc575f22740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c1b4e10 con 0x56013dc5a020 2024-09-05T01:35:54.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.078+0000 7fc575f22740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc56c1095d0 con 0x56013dc4f760 2024-09-05T01:35:54.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.078+0000 7fc575f22740 10 client.0 _ll_register_callbacks cb 0x7fc564004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:35:54.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.078+0000 7fc571800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56013dc5a020 0x56013dce3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:54.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.078+0000 7fc571800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56013dc5a020 0x56013dce3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:57608/0 (socket says 172.21.15.12:57608) 2024-09-05T01:35:54.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.078+0000 7fc571800640 1 -- 172.21.15.12:0/294976641 learned_addr learned my addr 172.21.15.12:0/294976641 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:54.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.078+0000 7fc570e00640 1 --2- 172.21.15.12:0/294976641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56013dc4ee40 0x56013dc6e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:54.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.078+0000 7fc56be00640 1 --2- 172.21.15.12:0/294976641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56013dc4f760 0x56013dc6eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:54.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.078+0000 7fc571800640 1 -- 172.21.15.12:0/294976641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56013dc4f760 msgr2=0x56013dc6eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:54.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.078+0000 7fc571800640 1 --2- 172.21.15.12:0/294976641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56013dc4f760 0x56013dc6eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.078+0000 7fc571800640 1 -- 172.21.15.12:0/294976641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56013dc4ee40 msgr2=0x56013dc6e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:54.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.078+0000 7fc571800640 1 --2- 172.21.15.12:0/294976641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56013dc4ee40 0x56013dc6e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.078+0000 7fc571800640 1 -- 172.21.15.12:0/294976641 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56013dce4010 con 0x56013dc5a020 2024-09-05T01:35:54.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.079+0000 7fc571800640 1 --2- 172.21.15.12:0/294976641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56013dc5a020 0x56013dce3ad0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc564009fd0 tx=0x7fc564097ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6be9278980d6d18 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:54.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.079+0000 7fc552a00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:35:54.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.079+0000 7fc552a00640 1 -- 172.21.15.12:0/294976641 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56401a040 con 0x56013dc5a020 2024-09-05T01:35:54.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.079+0000 7fc575f22740 1 -- 172.21.15.12:0/294976641 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc558009760 con 0x56013dc5a020 2024-09-05T01:35:54.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.079+0000 7fc552a00640 1 -- 172.21.15.12:0/294976641 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8579+0+0 (secure 0 0 0) 0x7fc5640a4220 con 0x56013dc5a020 2024-09-05T01:35:54.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.080+0000 7fc552a00640 1 -- 172.21.15.12:0/294976641 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fc56409b1a0 con 0x56013dc5a020 2024-09-05T01:35:54.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.080+0000 7fc575f22740 10 client.26738 fetch_fsmap learned FSMap version 62 2024-09-05T01:35:54.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.080+0000 7fc575f22740 1 -- 172.21.15.12:0/294976641 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x56013dce5390 con 0x56013dc5a020 2024-09-05T01:35:54.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.080+0000 7fc552a00640 1 -- 172.21.15.12:0/294976641 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc558009760 con 0x56013dc5a020 2024-09-05T01:35:54.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.081+0000 7fc552a00640 1 -- 172.21.15.12:0/294976641 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 62) ==== 8442+0+0 (secure 0 0 0) 0x7fc56400b040 con 0x56013dc5a020 2024-09-05T01:35:54.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.081+0000 7fc575f22740 10 client.26738 fetch_fsmap finished waiting for FSMap version 62 2024-09-05T01:35:54.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.081+0000 7fc575f22740 10 client.26738 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-05T01:35:54.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.081+0000 7fc575f22740 20 client.26738 populate_metadata read hostname 'smithi012' 2024-09-05T01:35:54.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.081+0000 7fc575f22740 1 --2- 172.21.15.12:0/294976641 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x56013dce5b50 0x56013dce7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:54.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.081+0000 7fc575f22740 4 client.26738 mds_command: new command op to 24524 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:35:54.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.081+0000 7fc575f22740 1 -- 172.21.15.12:0/294976641 --> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56013dbbce60 con 0x56013dce5b50 2024-09-05T01:35:54.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.081+0000 7fc570e00640 1 --2- 172.21.15.12:0/294976641 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x56013dce5b50 0x56013dce7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:54.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.081+0000 7fc570e00640 1 --2- 172.21.15.12:0/294976641 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x56013dce5b50 0x56013dce7f70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c0817f2269807bc7 server_cookie=15cc67a6e620c349 in_seq=0 out_seq=0 2024-09-05T01:35:54.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.081+0000 7fc552a00640 10 client.26738 ms_handle_connect on v2:172.21.15.145:6836/3765112395 2024-09-05T01:35:54.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.086+0000 7fc552a00640 1 -- 172.21.15.12:0/294976641 <== mds.2 v2:172.21.15.145:6836/3765112395 1 ==== command_reply(tid 0: 0 ) ==== 8+0+150446 (crc 0 0 0) 0x56013dbbce60 con 0x56013dce5b50 2024-09-05T01:35:54.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.086+0000 7fc552a00640 10 client.26738 handle_command_reply: tid=0 2024-09-05T01:35:54.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.086+0000 7fc575f22740 1 client.26738 shutdown 2024-09-05T01:35:54.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.086+0000 7fc575f22740 1 -- 172.21.15.12:0/294976641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56013dc5a020 msgr2=0x56013dce3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:54.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.086+0000 7fc575f22740 1 --2- 172.21.15.12:0/294976641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56013dc5a020 0x56013dce3ad0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc564009fd0 tx=0x7fc564097ba0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.086+0000 7fc575f22740 1 -- 172.21.15.12:0/294976641 shutdown_connections 2024-09-05T01:35:54.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.086+0000 7fc575f22740 1 --2- 172.21.15.12:0/294976641 >> [v2:172.21.15.145:6836/3765112395,v1:172.21.15.145:6837/3765112395] conn(0x56013dce5b50 0x56013dce7f70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.086+0000 7fc575f22740 1 --2- 172.21.15.12:0/294976641 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x56013dc5a020 0x56013dce3ad0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.086+0000 7fc575f22740 1 --2- 172.21.15.12:0/294976641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56013dc4f760 0x56013dc6eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.086+0000 7fc575f22740 1 --2- 172.21.15.12:0/294976641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56013dc4ee40 0x56013dc6e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.086+0000 7fc575f22740 1 -- 172.21.15.12:0/294976641 >> 172.21.15.12:0/294976641 conn(0x56013dc4b3d0 msgr2=0x56013dc58870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:54.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.086+0000 7fc552a00640 0 client.26738 ms_handle_reset on v2:172.21.15.145:6836/3765112395 2024-09-05T01:35:54.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.087+0000 7fc575f22740 1 -- 172.21.15.12:0/294976641 shutdown_connections 2024-09-05T01:35:54.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.087+0000 7fc575f22740 1 -- 172.21.15.12:0/294976641 wait complete. 2024-09-05T01:35:54.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.087+0000 7fc575f22740 20 client.26738 trim_cache size 0 max 16384 2024-09-05T01:35:54.091 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2024-09-05T01:35:54.091 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.091 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.091 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3705631, 2024-09-05T01:35:54.091 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643266, 2024-09-05T01:35:54.091 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-2.jpg" 2024-09-05T01:35:54.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 44795501, 2024-09-05T01:35:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643231, 2024-09-05T01:35:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-37.jpg" 2024-09-05T01:35:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 46616242, 2024-09-05T01:35:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643233, 2024-09-05T01:35:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-35.jpg" 2024-09-05T01:35:54.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 46797308, 2024-09-05T01:35:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643138, 2024-09-05T01:35:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-21.jpg" 2024-09-05T01:35:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 50522209, 2024-09-05T01:35:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643224, 2024-09-05T01:35:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-44.jpg" 2024-09-05T01:35:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.093 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 53465077, 2024-09-05T01:35:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645405, 2024-09-05T01:35:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-47.jpg" 2024-09-05T01:35:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 53952416, 2024-09-05T01:35:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642533, 2024-09-05T01:35:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-36.jpg" 2024-09-05T01:35:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.094 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 54430217, 2024-09-05T01:35:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642566, 2024-09-05T01:35:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-13.jpg" 2024-09-05T01:35:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 55620739, 2024-09-05T01:35:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642430, 2024-09-05T01:35:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-11.xml" 2024-09-05T01:35:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 68937294, 2024-09-05T01:35:54.095 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643171, 2024-09-05T01:35:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-24.xml" 2024-09-05T01:35:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 72903412, 2024-09-05T01:35:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511634525, 2024-09-05T01:35:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-63.xml" 2024-09-05T01:35:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 76748340, 2024-09-05T01:35:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643329, 2024-09-05T01:35:54.096 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-25.jpg" 2024-09-05T01:35:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 83349398, 2024-09-05T01:35:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645408, 2024-09-05T01:35:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-44.jpg" 2024-09-05T01:35:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 96145705, 2024-09-05T01:35:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642444, 2024-09-05T01:35:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-2.xml" 2024-09-05T01:35:54.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 98241088, 2024-09-05T01:35:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643097, 2024-09-05T01:35:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-5.xml" 2024-09-05T01:35:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 100596892, 2024-09-05T01:35:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644958, 2024-09-05T01:35:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-20.xml" 2024-09-05T01:35:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.098 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 115612977, 2024-09-05T01:35:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643159, 2024-09-05T01:35:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-6.jpg" 2024-09-05T01:35:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 129446171, 2024-09-05T01:35:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511639282, 2024-09-05T01:35:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-20.jpg" 2024-09-05T01:35:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.099 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 139834395, 2024-09-05T01:35:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643334, 2024-09-05T01:35:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-20.jpg" 2024-09-05T01:35:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 147790518, 2024-09-05T01:35:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643073, 2024-09-05T01:35:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-29.xml" 2024-09-05T01:35:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.100 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 169741288, 2024-09-05T01:35:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644922, 2024-09-05T01:35:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-25.jpg" 2024-09-05T01:35:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 169764931, 2024-09-05T01:35:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644934, 2024-09-05T01:35:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-13.jpg" 2024-09-05T01:35:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.101 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 179965584, 2024-09-05T01:35:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644933, 2024-09-05T01:35:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-14.jpg" 2024-09-05T01:35:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 197393267, 2024-09-05T01:35:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645894, 2024-09-05T01:35:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-4.jpg" 2024-09-05T01:35:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 223130593, 2024-09-05T01:35:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644953, 2024-09-05T01:35:54.102 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-25.xml" 2024-09-05T01:35:54.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.103 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.103 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 231808305, 2024-09-05T01:35:54.103 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643328, 2024-09-05T01:35:54.103 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-26.jpg" 2024-09-05T01:35:54.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.103 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.103 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.103 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 245857096, 2024-09-05T01:35:54.103 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642420, 2024-09-05T01:35:54.103 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-16.xml" 2024-09-05T01:35:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 246017044, 2024-09-05T01:35:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643208, 2024-09-05T01:35:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-60.jpg" 2024-09-05T01:35:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 246825737, 2024-09-05T01:35:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643137, 2024-09-05T01:35:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-22.jpg" 2024-09-05T01:35:54.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.105 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.105 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.105 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 271093013, 2024-09-05T01:35:54.105 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645422, 2024-09-05T01:35:54.105 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-30.jpg" 2024-09-05T01:35:54.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.105 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.105 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.105 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 277210305, 2024-09-05T01:35:54.105 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643238, 2024-09-05T01:35:54.105 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-30.jpg" 2024-09-05T01:35:54.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 282931385, 2024-09-05T01:35:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511639309, 2024-09-05T01:35:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-11.jpg" 2024-09-05T01:35:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 287339330, 2024-09-05T01:35:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643211, 2024-09-05T01:35:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-57.jpg" 2024-09-05T01:35:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.106 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.107 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 287528581, 2024-09-05T01:35:54.107 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645746, 2024-09-05T01:35:54.107 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-31.xml" 2024-09-05T01:35:54.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.107 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.107 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.107 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 291422525, 2024-09-05T01:35:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643102, 2024-09-05T01:35:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-57.jpg" 2024-09-05T01:35:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 300527867, 2024-09-05T01:35:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643262, 2024-09-05T01:35:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-6.jpg" 2024-09-05T01:35:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.108 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 303455109, 2024-09-05T01:35:54.109 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645784, 2024-09-05T01:35:54.109 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-17.jpg" 2024-09-05T01:35:54.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.109 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.109 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.109 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 304757829, 2024-09-05T01:35:54.109 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645401, 2024-09-05T01:35:54.109 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-51.jpg" 2024-09-05T01:35:54.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.109 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.109 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.109 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 315488910, 2024-09-05T01:35:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642523, 2024-09-05T01:35:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-42.jpg" 2024-09-05T01:35:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 318858066, 2024-09-05T01:35:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511639303, 2024-09-05T01:35:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-13.jpg" 2024-09-05T01:35:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 325987793, 2024-09-05T01:35:54.110 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642541, 2024-09-05T01:35:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-31.jpg" 2024-09-05T01:35:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 329127596, 2024-09-05T01:35:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645779, 2024-09-05T01:35:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-22.jpg" 2024-09-05T01:35:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 333218878, 2024-09-05T01:35:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643153, 2024-09-05T01:35:54.111 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-32.xml" 2024-09-05T01:35:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 333573372, 2024-09-05T01:35:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643198, 2024-09-05T01:35:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-70.jpg" 2024-09-05T01:35:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 340238015, 2024-09-05T01:35:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642448, 2024-09-05T01:35:54.112 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-76.jpg" 2024-09-05T01:35:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 359813749, 2024-09-05T01:35:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643207, 2024-09-05T01:35:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-61.jpg" 2024-09-05T01:35:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 361046240, 2024-09-05T01:35:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643324, 2024-09-05T01:35:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-30.jpg" 2024-09-05T01:35:54.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 366439638, 2024-09-05T01:35:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643099, 2024-09-05T01:35:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-3.xml" 2024-09-05T01:35:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 374034466, 2024-09-05T01:35:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645402, 2024-09-05T01:35:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-50.jpg" 2024-09-05T01:35:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.114 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 378796278, 2024-09-05T01:35:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511634644, 2024-09-05T01:35:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-23.xml" 2024-09-05T01:35:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 382084177, 2024-09-05T01:35:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645002, 2024-09-05T01:35:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-5.jpg" 2024-09-05T01:35:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.115 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 385795723, 2024-09-05T01:35:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643105, 2024-09-05T01:35:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-54.jpg" 2024-09-05T01:35:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 391604634, 2024-09-05T01:35:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643066, 2024-09-05T01:35:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-36.xml" 2024-09-05T01:35:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.116 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 394360384, 2024-09-05T01:35:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645749, 2024-09-05T01:35:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-28.xml" 2024-09-05T01:35:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 416180532, 2024-09-05T01:35:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643117, 2024-09-05T01:35:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-42.jpg" 2024-09-05T01:35:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 416725241, 2024-09-05T01:35:54.117 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643338, 2024-09-05T01:35:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-16.jpg" 2024-09-05T01:35:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 421039238, 2024-09-05T01:35:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645893, 2024-09-05T01:35:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-5.jpg" 2024-09-05T01:35:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 421221564, 2024-09-05T01:35:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643196, 2024-09-05T01:35:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-72.jpg" 2024-09-05T01:35:54.118 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 428130248, 2024-09-05T01:35:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645446, 2024-09-05T01:35:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-6.jpg" 2024-09-05T01:35:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 440277329, 2024-09-05T01:35:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643114, 2024-09-05T01:35:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-45.jpg" 2024-09-05T01:35:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.119 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 445825404, 2024-09-05T01:35:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511639316, 2024-09-05T01:35:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-8.jpg" 2024-09-05T01:35:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 466399938, 2024-09-05T01:35:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642551, 2024-09-05T01:35:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-24.jpg" 2024-09-05T01:35:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.120 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 466581276, 2024-09-05T01:35:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645382, 2024-09-05T01:35:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-6.xml" 2024-09-05T01:35:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 471462720, 2024-09-05T01:35:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645724, 2024-09-05T01:35:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-53.xml" 2024-09-05T01:35:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.121 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 477229173, 2024-09-05T01:35:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644951, 2024-09-05T01:35:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-27.xml" 2024-09-05T01:35:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 490170566, 2024-09-05T01:35:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645744, 2024-09-05T01:35:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-33.xml" 2024-09-05T01:35:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 503251657, 2024-09-05T01:35:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645776, 2024-09-05T01:35:54.122 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-3.xml" 2024-09-05T01:35:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 503560737, 2024-09-05T01:35:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642484, 2024-09-05T01:35:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-61.jpg" 2024-09-05T01:35:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 522249158, 2024-09-05T01:35:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642572, 2024-09-05T01:35:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-7.jpg" 2024-09-05T01:35:54.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.124 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.124 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.124 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 523203650, 2024-09-05T01:35:54.124 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511639322, 2024-09-05T01:35:54.124 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-6.jpg" 2024-09-05T01:35:54.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.124 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.124 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.124 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 526759248, 2024-09-05T01:35:54.124 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643162, 2024-09-05T01:35:54.124 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-3.jpg" 2024-09-05T01:35:54.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.125 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.125 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 526854189, 2024-09-05T01:35:54.125 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645781, 2024-09-05T01:35:54.125 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-20.jpg" 2024-09-05T01:35:54.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.125 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.125 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 529899080, 2024-09-05T01:35:54.125 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643058, 2024-09-05T01:35:54.125 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-44.xml" 2024-09-05T01:35:54.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.125 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.126 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.126 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 530164471, 2024-09-05T01:35:54.126 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644972, 2024-09-05T01:35:54.126 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-6.xml" 2024-09-05T01:35:54.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.126 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.126 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.126 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 531299158, 2024-09-05T01:35:54.126 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642442, 2024-09-05T01:35:54.126 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-3.xml" 2024-09-05T01:35:54.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.126 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.126 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.127 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 534855357, 2024-09-05T01:35:54.127 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645386, 2024-09-05T01:35:54.127 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-2.xml" 2024-09-05T01:35:54.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.127 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.127 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.127 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 537538936, 2024-09-05T01:35:54.127 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643252, 2024-09-05T01:35:54.127 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-16.jpg" 2024-09-05T01:35:54.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.127 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.127 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.127 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 547883740, 2024-09-05T01:35:54.128 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511639306, 2024-09-05T01:35:54.128 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-12.jpg" 2024-09-05T01:35:54.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.128 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.128 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.128 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 551091996, 2024-09-05T01:35:54.128 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643141, 2024-09-05T01:35:54.128 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-18.jpg" 2024-09-05T01:35:54.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.128 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.128 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.128 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 559993032, 2024-09-05T01:35:54.128 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511636797, 2024-09-05T01:35:54.129 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-36.xml" 2024-09-05T01:35:54.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.129 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.129 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.129 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 576264899, 2024-09-05T01:35:54.129 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643089, 2024-09-05T01:35:54.129 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-13.xml" 2024-09-05T01:35:54.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.129 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.129 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.129 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 580138181, 2024-09-05T01:35:54.129 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645424, 2024-09-05T01:35:54.129 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-28.jpg" 2024-09-05T01:35:54.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.130 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.130 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 583717103, 2024-09-05T01:35:54.130 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642446, 2024-09-05T01:35:54.130 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-1.xml" 2024-09-05T01:35:54.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.130 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.130 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 597679101, 2024-09-05T01:35:54.130 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643255, 2024-09-05T01:35:54.130 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-13.jpg" 2024-09-05T01:35:54.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.131 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.131 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.131 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 610481446, 2024-09-05T01:35:54.131 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644998, 2024-09-05T01:35:54.131 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-9.jpg" 2024-09-05T01:35:54.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.131 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.131 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.131 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 618047023, 2024-09-05T01:35:54.131 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645392, 2024-09-05T01:35:54.131 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-60.jpg" 2024-09-05T01:35:54.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.131 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.132 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.132 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 629768233, 2024-09-05T01:35:54.132 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645726, 2024-09-05T01:35:54.132 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-51.xml" 2024-09-05T01:35:54.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.132 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.132 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 631252146, 2024-09-05T01:35:54.132 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645391, 2024-09-05T01:35:54.132 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-61.jpg" 2024-09-05T01:35:54.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.132 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.133 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.133 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 635231524, 2024-09-05T01:35:54.133 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643091, 2024-09-05T01:35:54.133 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-11.xml" 2024-09-05T01:35:54.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.133 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.133 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.133 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 639769150, 2024-09-05T01:35:54.133 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642438, 2024-09-05T01:35:54.133 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-6.xml" 2024-09-05T01:35:54.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.133 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.133 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.134 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 640973948, 2024-09-05T01:35:54.134 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643081, 2024-09-05T01:35:54.134 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-21.xml" 2024-09-05T01:35:54.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.134 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.134 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 644223014, 2024-09-05T01:35:54.134 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645895, 2024-09-05T01:35:54.134 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-3.jpg" 2024-09-05T01:35:54.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.134 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.134 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 659585596, 2024-09-05T01:35:54.135 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644959, 2024-09-05T01:35:54.135 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-19.xml" 2024-09-05T01:35:54.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.135 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.135 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.135 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 664033468, 2024-09-05T01:35:54.135 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642418, 2024-09-05T01:35:54.135 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-17.xml" 2024-09-05T01:35:54.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.135 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.135 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.135 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 688323206, 2024-09-05T01:35:54.135 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511638283, 2024-09-05T01:35:54.136 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/comment-65.xml" 2024-09-05T01:35:54.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.136 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.136 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.136 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 690807005, 2024-09-05T01:35:54.136 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645872, 2024-09-05T01:35:54.136 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-8.jpg" 2024-09-05T01:35:54.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.136 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.136 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.136 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 693214415, 2024-09-05T01:35:54.136 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644981, 2024-09-05T01:35:54.136 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-26.jpg" 2024-09-05T01:35:54.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.137 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.137 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.137 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 697904967, 2024-09-05T01:35:54.137 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645414, 2024-09-05T01:35:54.137 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-38.jpg" 2024-09-05T01:35:54.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.137 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.137 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.137 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 701698504, 2024-09-05T01:35:54.137 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642530, 2024-09-05T01:35:54.137 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-38.jpg" 2024-09-05T01:35:54.137 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.138 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.138 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.138 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 708125913, 2024-09-05T01:35:54.138 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642546, 2024-09-05T01:35:54.138 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-28.jpg" 2024-09-05T01:35:54.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.138 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.138 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.138 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 709835429, 2024-09-05T01:35:54.138 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643096, 2024-09-05T01:35:54.138 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-6.xml" 2024-09-05T01:35:54.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.138 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.138 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.139 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 713811930, 2024-09-05T01:35:54.139 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645722, 2024-09-05T01:35:54.139 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-55.xml" 2024-09-05T01:35:54.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.140 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.140 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.140 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 714552164, 2024-09-05T01:35:54.140 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642482, 2024-09-05T01:35:54.140 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-62.jpg" 2024-09-05T01:35:54.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.140 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.140 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.140 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 719185201, 2024-09-05T01:35:54.140 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511639313, 2024-09-05T01:35:54.140 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-9.jpg" 2024-09-05T01:35:54.141 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.141 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.141 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.141 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 720918049, 2024-09-05T01:35:54.141 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644932, 2024-09-05T01:35:54.141 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-15.jpg" 2024-09-05T01:35:54.141 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.141 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.141 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.141 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 725910950, 2024-09-05T01:35:54.141 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644989, 2024-09-05T01:35:54.141 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-18.jpg" 2024-09-05T01:35:54.141 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.142 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.142 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.142 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 725913995, 2024-09-05T01:35:54.142 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642424, 2024-09-05T01:35:54.142 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-14.xml" 2024-09-05T01:35:54.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.142 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.142 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.142 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 728801391, 2024-09-05T01:35:54.142 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645742, 2024-09-05T01:35:54.142 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-35.xml" 2024-09-05T01:35:54.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.142 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.143 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.143 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 747158252, 2024-09-05T01:35:54.143 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645898, 2024-09-05T01:35:54.143 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-2.jpg" 2024-09-05T01:35:54.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.143 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.143 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.143 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 749000218, 2024-09-05T01:35:54.143 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643084, 2024-09-05T01:35:54.143 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-18.xml" 2024-09-05T01:35:54.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.143 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.143 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.144 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 750125796, 2024-09-05T01:35:54.144 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645395, 2024-09-05T01:35:54.144 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-57.jpg" 2024-09-05T01:35:54.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.144 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.144 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.144 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 750839426, 2024-09-05T01:35:54.144 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644948, 2024-09-05T01:35:54.144 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-30.xml" 2024-09-05T01:35:54.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.144 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.144 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.145 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 755915924, 2024-09-05T01:35:54.145 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643125, 2024-09-05T01:35:54.145 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-34.jpg" 2024-09-05T01:35:54.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.145 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.145 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 765279051, 2024-09-05T01:35:54.145 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643161, 2024-09-05T01:35:54.145 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-4.jpg" 2024-09-05T01:35:54.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.145 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.145 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.145 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 774789775, 2024-09-05T01:35:54.146 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645863, 2024-09-05T01:35:54.146 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-10.jpg" 2024-09-05T01:35:54.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.146 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.146 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.146 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 783735906, 2024-09-05T01:35:54.146 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643076, 2024-09-05T01:35:54.146 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-26.xml" 2024-09-05T01:35:54.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.146 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.146 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.146 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 785422354, 2024-09-05T01:35:54.146 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511639299, 2024-09-05T01:35:54.147 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-14.jpg" 2024-09-05T01:35:54.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.147 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.147 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.147 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 786339058, 2024-09-05T01:35:54.147 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642538, 2024-09-05T01:35:54.147 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-33.jpg" 2024-09-05T01:35:54.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.147 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.147 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.147 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 807916857, 2024-09-05T01:35:54.147 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643318, 2024-09-05T01:35:54.147 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-2.xml" 2024-09-05T01:35:54.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.148 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.148 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.148 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 808756345, 2024-09-05T01:35:54.148 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645728, 2024-09-05T01:35:54.148 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-49.xml" 2024-09-05T01:35:54.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.148 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.148 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.148 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 816857026, 2024-09-05T01:35:54.148 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643256, 2024-09-05T01:35:54.148 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-12.jpg" 2024-09-05T01:35:54.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.148 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.149 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.149 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 818585990, 2024-09-05T01:35:54.149 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645723, 2024-09-05T01:35:54.149 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-54.xml" 2024-09-05T01:35:54.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.149 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.149 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 825557394, 2024-09-05T01:35:54.149 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642510, 2024-09-05T01:35:54.149 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-49.jpg" 2024-09-05T01:35:54.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.149 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.149 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.149 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 841550082, 2024-09-05T01:35:54.150 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644920, 2024-09-05T01:35:54.150 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-27.jpg" 2024-09-05T01:35:54.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.150 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.150 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.150 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 851354392, 2024-09-05T01:35:54.150 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643342, 2024-09-05T01:35:54.150 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-12.jpg" 2024-09-05T01:35:54.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.150 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.150 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.150 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 856550922, 2024-09-05T01:35:54.150 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643060, 2024-09-05T01:35:54.151 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-42.xml" 2024-09-05T01:35:54.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.151 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.151 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.151 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 861450705, 2024-09-05T01:35:54.151 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643147, 2024-09-05T01:35:54.151 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-12.jpg" 2024-09-05T01:35:54.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.151 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.151 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.151 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 878710876, 2024-09-05T01:35:54.151 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644978, 2024-09-05T01:35:54.151 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-29.jpg" 2024-09-05T01:35:54.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.152 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.152 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.152 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 882937923, 2024-09-05T01:35:54.152 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643109, 2024-09-05T01:35:54.152 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-50.jpg" 2024-09-05T01:35:54.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.152 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.152 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.152 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 892355228, 2024-09-05T01:35:54.152 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645001, 2024-09-05T01:35:54.152 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-6.jpg" 2024-09-05T01:35:54.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.153 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.153 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.153 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 893368716, 2024-09-05T01:35:54.153 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642519, 2024-09-05T01:35:54.153 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-45.jpg" 2024-09-05T01:35:54.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.153 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.153 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.153 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 894330622, 2024-09-05T01:35:54.153 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643150, 2024-09-05T01:35:54.153 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-34.xml" 2024-09-05T01:35:54.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.154 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.154 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.154 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 906692714, 2024-09-05T01:35:54.154 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643146, 2024-09-05T01:35:54.154 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-13.jpg" 2024-09-05T01:35:54.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.154 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.154 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.154 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 907478396, 2024-09-05T01:35:54.154 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643247, 2024-09-05T01:35:54.154 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-21.jpg" 2024-09-05T01:35:54.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.155 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.155 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.155 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 914864257, 2024-09-05T01:35:54.155 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642568, 2024-09-05T01:35:54.155 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-11.jpg" 2024-09-05T01:35:54.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.155 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.155 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.155 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 925744662, 2024-09-05T01:35:54.155 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643075, 2024-09-05T01:35:54.155 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-27.xml" 2024-09-05T01:35:54.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.155 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.156 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.156 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 929023443, 2024-09-05T01:35:54.156 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644973, 2024-09-05T01:35:54.156 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-5.xml" 2024-09-05T01:35:54.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.156 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.156 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 934750578, 2024-09-05T01:35:54.156 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643265, 2024-09-05T01:35:54.156 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-3.jpg" 2024-09-05T01:35:54.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.156 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.156 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.157 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 936856608, 2024-09-05T01:35:54.157 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643260, 2024-09-05T01:35:54.157 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-8.jpg" 2024-09-05T01:35:54.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.157 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.157 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.157 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 946667766, 2024-09-05T01:35:54.157 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644988, 2024-09-05T01:35:54.157 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-19.jpg" 2024-09-05T01:35:54.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.157 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.157 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.158 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 949977052, 2024-09-05T01:35:54.158 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643241, 2024-09-05T01:35:54.158 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-27.jpg" 2024-09-05T01:35:54.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.158 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.158 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 975855133, 2024-09-05T01:35:54.158 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642532, 2024-09-05T01:35:54.158 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-37.jpg" 2024-09-05T01:35:54.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.158 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.158 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.158 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 983065179, 2024-09-05T01:35:54.159 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644943, 2024-09-05T01:35:54.159 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-4.jpg" 2024-09-05T01:35:54.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.159 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.159 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 983202854, 2024-09-05T01:35:54.159 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645730, 2024-09-05T01:35:54.159 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-47.xml" 2024-09-05T01:35:54.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.159 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.159 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 986237632, 2024-09-05T01:35:54.159 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642478, 2024-09-05T01:35:54.160 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-64.jpg" 2024-09-05T01:35:54.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.160 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.160 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.160 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 991297753, 2024-09-05T01:35:54.160 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643115, 2024-09-05T01:35:54.160 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-44.jpg" 2024-09-05T01:35:54.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.160 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.160 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.160 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 991412647, 2024-09-05T01:35:54.160 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511634667, 2024-09-05T01:35:54.161 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-12.xml" 2024-09-05T01:35:54.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.161 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.161 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.161 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 994978648, 2024-09-05T01:35:54.161 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643087, 2024-09-05T01:35:54.161 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-15.xml" 2024-09-05T01:35:54.161 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.161 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.161 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.161 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1001658310, 2024-09-05T01:35:54.161 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644964, 2024-09-05T01:35:54.161 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-14.xml" 2024-09-05T01:35:54.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.162 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.162 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.162 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1004590833, 2024-09-05T01:35:54.162 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645782, 2024-09-05T01:35:54.162 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-19.jpg" 2024-09-05T01:35:54.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.162 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.162 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.162 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1017247819, 2024-09-05T01:35:54.162 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642563, 2024-09-05T01:35:54.162 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-16.jpg" 2024-09-05T01:35:54.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.163 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.163 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.163 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1019593330, 2024-09-05T01:35:54.163 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645889, 2024-09-05T01:35:54.163 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-6.jpg" 2024-09-05T01:35:54.163 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.163 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.163 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.163 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1027545380, 2024-09-05T01:35:54.163 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645394, 2024-09-05T01:35:54.163 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-58.jpg" 2024-09-05T01:35:54.163 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.163 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.164 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.164 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1039198437, 2024-09-05T01:35:54.164 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645449, 2024-09-05T01:35:54.164 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-3.jpg" 2024-09-05T01:35:54.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.164 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.164 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.164 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1058339831, 2024-09-05T01:35:54.164 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643112, 2024-09-05T01:35:54.164 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-47.jpg" 2024-09-05T01:35:54.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.164 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.164 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.165 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1065902261, 2024-09-05T01:35:54.165 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644928, 2024-09-05T01:35:54.165 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-19.jpg" 2024-09-05T01:35:54.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.165 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.165 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.165 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1069796797, 2024-09-05T01:35:54.165 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643353, 2024-09-05T01:35:54.165 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-1.jpg" 2024-09-05T01:35:54.165 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.165 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.165 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.165 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1076491562, 2024-09-05T01:35:54.166 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642434, 2024-09-05T01:35:54.166 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-8.xml" 2024-09-05T01:35:54.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.166 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.166 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.166 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1077617576, 2024-09-05T01:35:54.166 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643201, 2024-09-05T01:35:54.166 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-67.jpg" 2024-09-05T01:35:54.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.166 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.166 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.166 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1081107260, 2024-09-05T01:35:54.167 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644954, 2024-09-05T01:35:54.167 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-24.xml" 2024-09-05T01:35:54.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.167 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.167 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.167 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1084257029, 2024-09-05T01:35:54.167 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643325, 2024-09-05T01:35:54.167 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-29.jpg" 2024-09-05T01:35:54.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.167 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.167 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.167 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1085394889, 2024-09-05T01:35:54.167 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645430, 2024-09-05T01:35:54.168 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-22.jpg" 2024-09-05T01:35:54.168 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.168 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.168 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.168 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1088052003, 2024-09-05T01:35:54.168 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645423, 2024-09-05T01:35:54.168 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-29.jpg" 2024-09-05T01:35:54.168 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.168 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.168 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.168 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1104202488, 2024-09-05T01:35:54.168 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511639325, 2024-09-05T01:35:54.168 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-5.jpg" 2024-09-05T01:35:54.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.169 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.169 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.169 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1110060682, 2024-09-05T01:35:54.169 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643067, 2024-09-05T01:35:54.169 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-35.xml" 2024-09-05T01:35:54.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.169 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.169 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.169 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1117700442, 2024-09-05T01:35:54.169 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644987, 2024-09-05T01:35:54.169 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-20.jpg" 2024-09-05T01:35:54.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.169 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.170 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.170 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1127938979, 2024-09-05T01:35:54.170 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645738, 2024-09-05T01:35:54.170 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-39.xml" 2024-09-05T01:35:54.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.170 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.170 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.170 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1131212617, 2024-09-05T01:35:54.170 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645418, 2024-09-05T01:35:54.170 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-34.jpg" 2024-09-05T01:35:54.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.170 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.170 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.171 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1135876017, 2024-09-05T01:35:54.171 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645826, 2024-09-05T01:35:54.171 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-12.jpg" 2024-09-05T01:35:54.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.171 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.171 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.171 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1137131174, 2024-09-05T01:35:54.171 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644918, 2024-09-05T01:35:54.171 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/article-1.xml" 2024-09-05T01:35:54.171 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.171 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.171 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.172 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1146721109, 2024-09-05T01:35:54.172 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643348, 2024-09-05T01:35:54.172 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-6.jpg" 2024-09-05T01:35:54.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.172 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.172 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.172 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1152417527, 2024-09-05T01:35:54.172 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642436, 2024-09-05T01:35:54.172 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-7.xml" 2024-09-05T01:35:54.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.172 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.172 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.172 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1155679249, 2024-09-05T01:35:54.173 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642469, 2024-09-05T01:35:54.173 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-67.jpg" 2024-09-05T01:35:54.173 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.173 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.173 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.173 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1182578809, 2024-09-05T01:35:54.173 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642450, 2024-09-05T01:35:54.173 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-75.jpg" 2024-09-05T01:35:54.173 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.173 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.173 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.173 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1184205590, 2024-09-05T01:35:54.173 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642494, 2024-09-05T01:35:54.174 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-57.jpg" 2024-09-05T01:35:54.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.174 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.174 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.174 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1189663676, 2024-09-05T01:35:54.174 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511639290, 2024-09-05T01:35:54.174 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-17.jpg" 2024-09-05T01:35:54.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.174 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.175 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.175 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1191208736, 2024-09-05T01:35:54.175 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642574, 2024-09-05T01:35:54.175 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-5.jpg" 2024-09-05T01:35:54.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.175 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.175 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.175 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1192362721, 2024-09-05T01:35:54.175 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643216, 2024-09-05T01:35:54.175 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-52.jpg" 2024-09-05T01:35:54.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.176 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.176 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.176 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1197922482, 2024-09-05T01:35:54.176 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644977, 2024-09-05T01:35:54.176 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-1.xml" 2024-09-05T01:35:54.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.176 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.176 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.176 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1204271520, 2024-09-05T01:35:54.176 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643170, 2024-09-05T01:35:54.176 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-25.xml" 2024-09-05T01:35:54.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.177 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.177 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.177 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1205439650, 2024-09-05T01:35:54.177 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644996, 2024-09-05T01:35:54.177 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-11.jpg" 2024-09-05T01:35:54.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.177 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.177 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.177 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1207207932, 2024-09-05T01:35:54.177 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644925, 2024-09-05T01:35:54.177 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-22.jpg" 2024-09-05T01:35:54.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.178 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.178 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.178 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1237310590, 2024-09-05T01:35:54.178 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643110, 2024-09-05T01:35:54.178 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-49.jpg" 2024-09-05T01:35:54.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.178 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.178 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.178 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1237537246, 2024-09-05T01:35:54.178 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643131, 2024-09-05T01:35:54.178 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-28.jpg" 2024-09-05T01:35:54.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.178 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.179 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.179 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1252185687, 2024-09-05T01:35:54.179 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642521, 2024-09-05T01:35:54.179 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-44.jpg" 2024-09-05T01:35:54.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.179 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.179 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.179 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1258147627, 2024-09-05T01:35:54.179 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511634743, 2024-09-05T01:35:54.179 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-27.jpg" 2024-09-05T01:35:54.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.179 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.179 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.180 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1258372475, 2024-09-05T01:35:54.180 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645431, 2024-09-05T01:35:54.180 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-21.jpg" 2024-09-05T01:35:54.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.180 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.180 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.180 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1261694385, 2024-09-05T01:35:54.180 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645393, 2024-09-05T01:35:54.180 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-59.jpg" 2024-09-05T01:35:54.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.180 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.180 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.180 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1268473528, 2024-09-05T01:35:54.181 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645531, 2024-09-05T01:35:54.181 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-53.xml" 2024-09-05T01:35:54.181 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.181 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.181 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.181 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1281472738, 2024-09-05T01:35:54.181 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643142, 2024-09-05T01:35:54.181 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-17.jpg" 2024-09-05T01:35:54.181 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.181 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.181 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.181 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1282386525, 2024-09-05T01:35:54.182 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642522, 2024-09-05T01:35:54.182 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-43.jpg" 2024-09-05T01:35:54.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.182 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.182 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.182 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1300644419, 2024-09-05T01:35:54.182 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643254, 2024-09-05T01:35:54.182 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-14.jpg" 2024-09-05T01:35:54.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.182 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.182 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.182 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1326346557, 2024-09-05T01:35:54.182 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643139, 2024-09-05T01:35:54.183 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-20.jpg" 2024-09-05T01:35:54.183 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.183 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.183 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.183 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1339959307, 2024-09-05T01:35:54.183 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643128, 2024-09-05T01:35:54.183 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-31.jpg" 2024-09-05T01:35:54.183 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.183 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.183 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.183 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1351252848, 2024-09-05T01:35:54.183 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643214, 2024-09-05T01:35:54.183 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-54.jpg" 2024-09-05T01:35:54.184 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.184 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.184 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.184 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1362847849, 2024-09-05T01:35:54.184 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645409, 2024-09-05T01:35:54.184 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-43.jpg" 2024-09-05T01:35:54.184 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.184 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.184 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.184 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1364693229, 2024-09-05T01:35:54.184 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645721, 2024-09-05T01:35:54.184 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-56.xml" 2024-09-05T01:35:54.184 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.185 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.185 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.185 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1367845157, 2024-09-05T01:35:54.185 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643175, 2024-09-05T01:35:54.185 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-20.xml" 2024-09-05T01:35:54.185 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.185 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.185 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.185 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1380936779, 2024-09-05T01:35:54.185 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644975, 2024-09-05T01:35:54.185 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-3.xml" 2024-09-05T01:35:54.185 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.185 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.186 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.186 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1381327308, 2024-09-05T01:35:54.186 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645425, 2024-09-05T01:35:54.186 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-27.jpg" 2024-09-05T01:35:54.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.186 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.186 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.186 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1385082346, 2024-09-05T01:35:54.186 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511640591, 2024-09-05T01:35:54.186 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/comment-49.xml" 2024-09-05T01:35:54.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.186 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.186 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.186 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1391186692, 2024-09-05T01:35:54.187 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642432, 2024-09-05T01:35:54.187 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-9.xml" 2024-09-05T01:35:54.187 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.187 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.187 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.187 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1393981661, 2024-09-05T01:35:54.188 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645759, 2024-09-05T01:35:54.188 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-18.xml" 2024-09-05T01:35:54.188 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.188 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.188 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.188 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1397014027, 2024-09-05T01:35:54.188 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642467, 2024-09-05T01:35:54.189 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-68.jpg" 2024-09-05T01:35:54.189 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.189 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.189 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.189 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1404078427, 2024-09-05T01:35:54.189 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643135, 2024-09-05T01:35:54.189 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-24.jpg" 2024-09-05T01:35:54.189 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.189 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.189 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.189 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1404854426, 2024-09-05T01:35:54.189 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645758, 2024-09-05T01:35:54.189 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-19.xml" 2024-09-05T01:35:54.190 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.190 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.190 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.190 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1414375292, 2024-09-05T01:35:54.190 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645502, 2024-09-05T01:35:54.190 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-79.xml" 2024-09-05T01:35:54.190 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.190 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.190 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.190 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1418935322, 2024-09-05T01:35:54.190 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645786, 2024-09-05T01:35:54.190 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-16.jpg" 2024-09-05T01:35:54.190 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.191 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.191 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.191 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1434371521, 2024-09-05T01:35:54.191 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645428, 2024-09-05T01:35:54.191 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-24.jpg" 2024-09-05T01:35:54.191 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.191 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.191 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.191 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1440685159, 2024-09-05T01:35:54.191 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645775, 2024-09-05T01:35:54.191 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-4.xml" 2024-09-05T01:35:54.191 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.192 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.192 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.192 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1442531955, 2024-09-05T01:35:54.192 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511639293, 2024-09-05T01:35:54.192 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-16.jpg" 2024-09-05T01:35:54.192 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.192 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.192 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.192 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1443668306, 2024-09-05T01:35:54.192 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642570, 2024-09-05T01:35:54.192 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-9.jpg" 2024-09-05T01:35:54.192 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.193 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.193 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.193 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1446913810, 2024-09-05T01:35:54.193 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642505, 2024-09-05T01:35:54.193 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-51.jpg" 2024-09-05T01:35:54.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.193 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.193 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.193 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1451322121, 2024-09-05T01:35:54.193 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643187, 2024-09-05T01:35:54.193 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-8.xml" 2024-09-05T01:35:54.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.193 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.194 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.194 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1466086173, 2024-09-05T01:35:54.194 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643183, 2024-09-05T01:35:54.194 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-12.xml" 2024-09-05T01:35:54.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.194 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.194 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.194 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1482129201, 2024-09-05T01:35:54.194 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645396, 2024-09-05T01:35:54.194 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-56.jpg" 2024-09-05T01:35:54.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.194 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.195 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.195 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1484685246, 2024-09-05T01:35:54.195 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645399, 2024-09-05T01:35:54.195 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-53.jpg" 2024-09-05T01:35:54.195 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.195 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.195 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.195 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1505352147, 2024-09-05T01:35:54.195 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643062, 2024-09-05T01:35:54.195 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-40.xml" 2024-09-05T01:35:54.195 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.195 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.195 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.195 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1508472908, 2024-09-05T01:35:54.196 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642547, 2024-09-05T01:35:54.196 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-27.jpg" 2024-09-05T01:35:54.196 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.196 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.196 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.196 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1509200987, 2024-09-05T01:35:54.196 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642527, 2024-09-05T01:35:54.196 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-40.jpg" 2024-09-05T01:35:54.196 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.196 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.196 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.196 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1512303086, 2024-09-05T01:35:54.196 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645867, 2024-09-05T01:35:54.197 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-9.jpg" 2024-09-05T01:35:54.197 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.197 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.197 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.197 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1526260417, 2024-09-05T01:35:54.197 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645554, 2024-09-05T01:35:54.197 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-29.xml" 2024-09-05T01:35:54.197 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.197 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.197 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.197 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1533385221, 2024-09-05T01:35:54.197 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642456, 2024-09-05T01:35:54.197 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-72.jpg" 2024-09-05T01:35:54.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.198 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.198 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.198 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1544756088, 2024-09-05T01:35:54.198 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644982, 2024-09-05T01:35:54.198 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-25.jpg" 2024-09-05T01:35:54.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.198 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.198 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.198 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1553777883, 2024-09-05T01:35:54.198 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642571, 2024-09-05T01:35:54.198 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-8.jpg" 2024-09-05T01:35:54.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.198 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.199 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.199 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1555392763, 2024-09-05T01:35:54.199 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643143, 2024-09-05T01:35:54.199 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-16.jpg" 2024-09-05T01:35:54.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.199 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.199 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.199 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1566556094, 2024-09-05T01:35:54.199 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644935, 2024-09-05T01:35:54.199 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-12.jpg" 2024-09-05T01:35:54.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.199 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.199 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.200 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1576898059, 2024-09-05T01:35:54.200 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643267, 2024-09-05T01:35:54.200 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-1.jpg" 2024-09-05T01:35:54.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.200 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.200 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.200 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1581198277, 2024-09-05T01:35:54.200 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644974, 2024-09-05T01:35:54.200 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-4.xml" 2024-09-05T01:35:54.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.200 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.200 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.200 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1586302946, 2024-09-05T01:35:54.201 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642564, 2024-09-05T01:35:54.201 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-15.jpg" 2024-09-05T01:35:54.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.201 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.201 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.201 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1587281970, 2024-09-05T01:35:54.201 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643123, 2024-09-05T01:35:54.201 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-36.jpg" 2024-09-05T01:35:54.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.201 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.201 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.201 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1590798267, 2024-09-05T01:35:54.201 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642544, 2024-09-05T01:35:54.202 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-29.jpg" 2024-09-05T01:35:54.202 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.202 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.202 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.202 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1595975215, 2024-09-05T01:35:54.202 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643103, 2024-09-05T01:35:54.202 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-56.jpg" 2024-09-05T01:35:54.202 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.202 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.202 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.202 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1597832766, 2024-09-05T01:35:54.202 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642454, 2024-09-05T01:35:54.202 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-73.jpg" 2024-09-05T01:35:54.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.203 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.203 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.203 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1606096248, 2024-09-05T01:35:54.203 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644961, 2024-09-05T01:35:54.203 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-17.xml" 2024-09-05T01:35:54.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.203 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.203 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.203 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1622057255, 2024-09-05T01:35:54.203 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644967, 2024-09-05T01:35:54.203 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-11.xml" 2024-09-05T01:35:54.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.204 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.204 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.204 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1623379771, 2024-09-05T01:35:54.204 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645740, 2024-09-05T01:35:54.204 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-37.xml" 2024-09-05T01:35:54.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.204 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.204 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.204 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1642115472, 2024-09-05T01:35:54.204 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645432, 2024-09-05T01:35:54.204 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-20.jpg" 2024-09-05T01:35:54.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.204 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.205 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.205 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1658182732, 2024-09-05T01:35:54.205 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511639311, 2024-09-05T01:35:54.205 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-10.jpg" 2024-09-05T01:35:54.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.205 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.205 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.205 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1663639526, 2024-09-05T01:35:54.205 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645783, 2024-09-05T01:35:54.205 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-18.jpg" 2024-09-05T01:35:54.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.205 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.206 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.206 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1667018674, 2024-09-05T01:35:54.206 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645760, 2024-09-05T01:35:54.206 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-17.xml" 2024-09-05T01:35:54.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.206 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.206 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.206 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1673027214, 2024-09-05T01:35:54.206 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643120, 2024-09-05T01:35:54.206 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-39.jpg" 2024-09-05T01:35:54.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.206 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.206 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.207 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1677588225, 2024-09-05T01:35:54.207 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643316, 2024-09-05T01:35:54.207 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-4.xml" 2024-09-05T01:35:54.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.207 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.207 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.207 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1679770760, 2024-09-05T01:35:54.207 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643244, 2024-09-05T01:35:54.207 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-24.jpg" 2024-09-05T01:35:54.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.207 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.207 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.207 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1681647617, 2024-09-05T01:35:54.207 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643346, 2024-09-05T01:35:54.208 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-8.jpg" 2024-09-05T01:35:54.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.208 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.208 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.208 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1690283550, 2024-09-05T01:35:54.208 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645762, 2024-09-05T01:35:54.208 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-15.xml" 2024-09-05T01:35:54.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.208 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.208 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.208 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1701963986, 2024-09-05T01:35:54.208 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645419, 2024-09-05T01:35:54.208 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-33.jpg" 2024-09-05T01:35:54.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.209 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.209 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.209 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1703695792, 2024-09-05T01:35:54.209 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511634602, 2024-09-05T01:35:54.209 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-37.xml" 2024-09-05T01:35:54.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.209 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.209 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.209 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1708916356, 2024-09-05T01:35:54.209 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511634729, 2024-09-05T01:35:54.209 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-34.jpg" 2024-09-05T01:35:54.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.209 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.210 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.210 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1709455173, 2024-09-05T01:35:54.210 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645427, 2024-09-05T01:35:54.210 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-25.jpg" 2024-09-05T01:35:54.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.210 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.210 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.210 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1710890648, 2024-09-05T01:35:54.210 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643106, 2024-09-05T01:35:54.210 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-53.jpg" 2024-09-05T01:35:54.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.210 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.210 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.210 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1716472432, 2024-09-05T01:35:54.211 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645000, 2024-09-05T01:35:54.211 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-7.jpg" 2024-09-05T01:35:54.211 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.211 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.211 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.211 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1721918617, 2024-09-05T01:35:54.211 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644986, 2024-09-05T01:35:54.211 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-21.jpg" 2024-09-05T01:35:54.211 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.211 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.211 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.211 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1738266783, 2024-09-05T01:35:54.211 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643158, 2024-09-05T01:35:54.211 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-7.jpg" 2024-09-05T01:35:54.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.212 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.212 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.212 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1746623973, 2024-09-05T01:35:54.212 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644946, 2024-09-05T01:35:54.212 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-1.jpg" 2024-09-05T01:35:54.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.212 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.212 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.212 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1752124428, 2024-09-05T01:35:54.212 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643069, 2024-09-05T01:35:54.212 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-33.xml" 2024-09-05T01:35:54.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.213 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.213 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.213 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1757711461, 2024-09-05T01:35:54.213 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643261, 2024-09-05T01:35:54.213 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-7.jpg" 2024-09-05T01:35:54.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.213 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.213 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.213 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1764529259, 2024-09-05T01:35:54.213 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643168, 2024-09-05T01:35:54.213 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-27.xml" 2024-09-05T01:35:54.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.213 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.214 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.214 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1771345906, 2024-09-05T01:35:54.214 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645376, 2024-09-05T01:35:54.214 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-12.xml" 2024-09-05T01:35:54.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.214 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.214 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.214 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1771629175, 2024-09-05T01:35:54.214 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511640585, 2024-09-05T01:35:54.214 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/comment-51.xml" 2024-09-05T01:35:54.214 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.214 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.214 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.214 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1789073462, 2024-09-05T01:35:54.215 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643121, 2024-09-05T01:35:54.215 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-38.jpg" 2024-09-05T01:35:54.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.215 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.215 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.215 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1796921785, 2024-09-05T01:35:54.215 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643136, 2024-09-05T01:35:54.215 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-23.jpg" 2024-09-05T01:35:54.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.215 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.215 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.215 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1800187281, 2024-09-05T01:35:54.215 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643314, 2024-09-05T01:35:54.216 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-6.xml" 2024-09-05T01:35:54.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.216 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.216 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.216 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1800970734, 2024-09-05T01:35:54.216 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644992, 2024-09-05T01:35:54.216 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-15.jpg" 2024-09-05T01:35:54.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.216 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.216 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.216 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1813451696, 2024-09-05T01:35:54.216 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643307, 2024-09-05T01:35:54.216 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-13.xml" 2024-09-05T01:35:54.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.217 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.217 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.217 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1817724799, 2024-09-05T01:35:54.217 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511634765, 2024-09-05T01:35:54.217 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-16.jpg" 2024-09-05T01:35:54.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.217 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.217 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.217 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1820057242, 2024-09-05T01:35:54.217 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643350, 2024-09-05T01:35:54.217 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-4.jpg" 2024-09-05T01:35:54.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.218 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.218 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.218 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1836269129, 2024-09-05T01:35:54.218 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511634693, 2024-09-05T01:35:54.218 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-52.jpg" 2024-09-05T01:35:54.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.218 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.218 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.218 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1841374309, 2024-09-05T01:35:54.218 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644979, 2024-09-05T01:35:54.218 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-28.jpg" 2024-09-05T01:35:54.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.219 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.219 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.219 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1845168880, 2024-09-05T01:35:54.219 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643249, 2024-09-05T01:35:54.219 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-19.jpg" 2024-09-05T01:35:54.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.219 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.219 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.219 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1846423677, 2024-09-05T01:35:54.219 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642550, 2024-09-05T01:35:54.219 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-25.jpg" 2024-09-05T01:35:54.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.219 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.219 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.220 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1869268054, 2024-09-05T01:35:54.220 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643079, 2024-09-05T01:35:54.220 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-23.xml" 2024-09-05T01:35:54.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.220 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.220 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.220 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1884440679, 2024-09-05T01:35:54.220 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645390, 2024-09-05T01:35:54.220 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-62.jpg" 2024-09-05T01:35:54.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.220 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.220 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.220 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1886935508, 2024-09-05T01:35:54.221 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645883, 2024-09-05T01:35:54.221 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-7.jpg" 2024-09-05T01:35:54.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.221 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.221 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.221 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1892038148, 2024-09-05T01:35:54.221 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644990, 2024-09-05T01:35:54.221 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-17.jpg" 2024-09-05T01:35:54.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.221 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.221 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.221 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1892656968, 2024-09-05T01:35:54.222 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643306, 2024-09-05T01:35:54.222 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-14.xml" 2024-09-05T01:35:54.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.222 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.222 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.222 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1893621760, 2024-09-05T01:35:54.222 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643264, 2024-09-05T01:35:54.222 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-4.jpg" 2024-09-05T01:35:54.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.222 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.222 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.222 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1897177958, 2024-09-05T01:35:54.222 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644960, 2024-09-05T01:35:54.222 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-18.xml" 2024-09-05T01:35:54.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.223 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.223 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.223 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1912365036, 2024-09-05T01:35:54.223 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644927, 2024-09-05T01:35:54.223 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-20.jpg" 2024-09-05T01:35:54.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.223 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.223 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.223 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1932087972, 2024-09-05T01:35:54.223 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644984, 2024-09-05T01:35:54.223 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-23.jpg" 2024-09-05T01:35:54.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.223 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.224 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.224 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1940284143, 2024-09-05T01:35:54.224 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645006, 2024-09-05T01:35:54.224 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-1.jpg" 2024-09-05T01:35:54.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.224 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.224 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.224 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1944823815, 2024-09-05T01:35:54.224 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645754, 2024-09-05T01:35:54.224 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-23.xml" 2024-09-05T01:35:54.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.224 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.224 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.225 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1948834755, 2024-09-05T01:35:54.225 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511634596, 2024-09-05T01:35:54.225 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-39.xml" 2024-09-05T01:35:54.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.225 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.225 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.225 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1950629472, 2024-09-05T01:35:54.225 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642525, 2024-09-05T01:35:54.225 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-41.jpg" 2024-09-05T01:35:54.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.225 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.225 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.226 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1951135473, 2024-09-05T01:35:54.226 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643111, 2024-09-05T01:35:54.226 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-48.jpg" 2024-09-05T01:35:54.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.226 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.226 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.226 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1964141804, 2024-09-05T01:35:54.226 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643193, 2024-09-05T01:35:54.226 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-2.xml" 2024-09-05T01:35:54.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.226 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.226 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.226 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1976281262, 2024-09-05T01:35:54.227 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644945, 2024-09-05T01:35:54.227 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-2.jpg" 2024-09-05T01:35:54.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.227 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.227 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.227 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 1981779882, 2024-09-05T01:35:54.227 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643310, 2024-09-05T01:35:54.227 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-10.xml" 2024-09-05T01:35:54.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.227 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.227 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.227 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2006188093, 2024-09-05T01:35:54.227 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645406, 2024-09-05T01:35:54.228 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-46.jpg" 2024-09-05T01:35:54.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.228 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.228 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.228 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2026159898, 2024-09-05T01:35:54.228 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645727, 2024-09-05T01:35:54.228 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-50.xml" 2024-09-05T01:35:54.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.228 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.228 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.228 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2027757649, 2024-09-05T01:35:54.228 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643245, 2024-09-05T01:35:54.228 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-23.jpg" 2024-09-05T01:35:54.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.229 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.229 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2034770028, 2024-09-05T01:35:54.229 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643182, 2024-09-05T01:35:54.229 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-13.xml" 2024-09-05T01:35:54.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.229 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.229 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2037014901, 2024-09-05T01:35:54.229 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642460, 2024-09-05T01:35:54.229 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-70.jpg" 2024-09-05T01:35:54.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.229 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.230 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.230 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2042976239, 2024-09-05T01:35:54.230 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644952, 2024-09-05T01:35:54.230 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-26.xml" 2024-09-05T01:35:54.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.230 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.230 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2045367634, 2024-09-05T01:35:54.230 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643077, 2024-09-05T01:35:54.230 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-25.xml" 2024-09-05T01:35:54.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.230 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.230 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2048006510, 2024-09-05T01:35:54.231 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642577, 2024-09-05T01:35:54.231 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-2.jpg" 2024-09-05T01:35:54.231 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.231 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.231 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.231 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2059580972, 2024-09-05T01:35:54.231 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645437, 2024-09-05T01:35:54.231 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-15.jpg" 2024-09-05T01:35:54.231 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.231 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.231 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.231 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2059637123, 2024-09-05T01:35:54.231 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643330, 2024-09-05T01:35:54.232 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-24.jpg" 2024-09-05T01:35:54.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.232 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.232 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.232 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2064237593, 2024-09-05T01:35:54.232 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643145, 2024-09-05T01:35:54.232 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-14.jpg" 2024-09-05T01:35:54.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.232 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.232 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.232 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2069063377, 2024-09-05T01:35:54.232 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645415, 2024-09-05T01:35:54.232 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-37.jpg" 2024-09-05T01:35:54.233 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.233 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.233 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.233 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2083262966, 2024-09-05T01:35:54.233 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643071, 2024-09-05T01:35:54.233 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-31.xml" 2024-09-05T01:35:54.233 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.233 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.233 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.233 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2088165089, 2024-09-05T01:35:54.233 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642543, 2024-09-05T01:35:54.233 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-30.jpg" 2024-09-05T01:35:54.233 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.234 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.234 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.234 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2091626371, 2024-09-05T01:35:54.234 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643118, 2024-09-05T01:35:54.234 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-41.jpg" 2024-09-05T01:35:54.234 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.234 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.234 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.234 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2092406453, 2024-09-05T01:35:54.234 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645777, 2024-09-05T01:35:54.234 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-2.xml" 2024-09-05T01:35:54.234 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.234 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.234 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.235 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2094526103, 2024-09-05T01:35:54.235 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645901, 2024-09-05T01:35:54.235 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-1.jpg" 2024-09-05T01:35:54.235 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.235 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.235 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.235 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2096702700, 2024-09-05T01:35:54.235 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645397, 2024-09-05T01:35:54.235 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-55.jpg" 2024-09-05T01:35:54.235 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.235 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.235 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.235 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2103134068, 2024-09-05T01:35:54.235 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645407, 2024-09-05T01:35:54.236 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-45.jpg" 2024-09-05T01:35:54.236 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.236 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.236 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.236 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2119199064, 2024-09-05T01:35:54.236 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643204, 2024-09-05T01:35:54.236 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-64.jpg" 2024-09-05T01:35:54.236 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.236 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.236 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.236 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2131318232, 2024-09-05T01:35:54.236 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644968, 2024-09-05T01:35:54.236 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-10.xml" 2024-09-05T01:35:54.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.237 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.237 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.237 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2132659372, 2024-09-05T01:35:54.237 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643185, 2024-09-05T01:35:54.237 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-10.xml" 2024-09-05T01:35:54.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.237 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.237 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.237 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2134287593, 2024-09-05T01:35:54.237 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642556, 2024-09-05T01:35:54.237 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-21.jpg" 2024-09-05T01:35:54.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.238 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.238 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2142818051, 2024-09-05T01:35:54.238 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643347, 2024-09-05T01:35:54.238 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-7.jpg" 2024-09-05T01:35:54.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.238 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.238 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2145270860, 2024-09-05T01:35:54.238 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644976, 2024-09-05T01:35:54.238 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-2.xml" 2024-09-05T01:35:54.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.239 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.239 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.239 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2161316347, 2024-09-05T01:35:54.239 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642422, 2024-09-05T01:35:54.239 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-15.xml" 2024-09-05T01:35:54.239 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.239 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.239 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.239 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2167673359, 2024-09-05T01:35:54.239 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644999, 2024-09-05T01:35:54.239 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-8.jpg" 2024-09-05T01:35:54.239 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.239 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.240 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.240 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2186395788, 2024-09-05T01:35:54.240 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643197, 2024-09-05T01:35:54.240 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-71.jpg" 2024-09-05T01:35:54.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.240 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.240 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.240 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2187850925, 2024-09-05T01:35:54.240 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643312, 2024-09-05T01:35:54.240 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-8.xml" 2024-09-05T01:35:54.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.240 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.240 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.241 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2205584534, 2024-09-05T01:35:54.241 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643191, 2024-09-05T01:35:54.241 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-4.xml" 2024-09-05T01:35:54.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.241 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.241 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.241 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2215095804, 2024-09-05T01:35:54.241 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511634516, 2024-09-05T01:35:54.241 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-66.xml" 2024-09-05T01:35:54.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.241 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.241 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.241 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2224815379, 2024-09-05T01:35:54.241 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511639337, 2024-09-05T01:35:54.242 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-1.jpg" 2024-09-05T01:35:54.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.242 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.242 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2229451464, 2024-09-05T01:35:54.242 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643352, 2024-09-05T01:35:54.242 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-2.jpg" 2024-09-05T01:35:54.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.242 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.242 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.242 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2245011074, 2024-09-05T01:35:54.242 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645438, 2024-09-05T01:35:54.242 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-14.jpg" 2024-09-05T01:35:54.242 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.243 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.243 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.243 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2254740754, 2024-09-05T01:35:54.243 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643203, 2024-09-05T01:35:54.243 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-65.jpg" 2024-09-05T01:35:54.243 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.243 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.243 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.243 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2255807426, 2024-09-05T01:35:54.243 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644944, 2024-09-05T01:35:54.243 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-3.jpg" 2024-09-05T01:35:54.243 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.243 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.244 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.244 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2268914610, 2024-09-05T01:35:54.244 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642492, 2024-09-05T01:35:54.244 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-58.jpg" 2024-09-05T01:35:54.244 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.244 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.244 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.244 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2273452419, 2024-09-05T01:35:54.244 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644937, 2024-09-05T01:35:54.244 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-10.jpg" 2024-09-05T01:35:54.244 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.244 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.245 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.245 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2274854866, 2024-09-05T01:35:54.245 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643343, 2024-09-05T01:35:54.245 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-11.jpg" 2024-09-05T01:35:54.245 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.245 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.245 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.245 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2291561282, 2024-09-05T01:35:54.245 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645403, 2024-09-05T01:35:54.245 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-49.jpg" 2024-09-05T01:35:54.245 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.245 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.245 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.245 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2302796010, 2024-09-05T01:35:54.246 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645413, 2024-09-05T01:35:54.246 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-39.jpg" 2024-09-05T01:35:54.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.246 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.246 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.246 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2314982014, 2024-09-05T01:35:54.246 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645440, 2024-09-05T01:35:54.246 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-12.jpg" 2024-09-05T01:35:54.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.246 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.246 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.246 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2316827884, 2024-09-05T01:35:54.246 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644980, 2024-09-05T01:35:54.247 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-27.jpg" 2024-09-05T01:35:54.247 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.247 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.247 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.247 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2332290826, 2024-09-05T01:35:54.247 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645389, 2024-09-05T01:35:54.247 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-63.jpg" 2024-09-05T01:35:54.247 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.247 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.247 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.247 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2337241573, 2024-09-05T01:35:54.247 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511639331, 2024-09-05T01:35:54.247 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-3.jpg" 2024-09-05T01:35:54.247 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.248 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.248 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.248 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2338205361, 2024-09-05T01:35:54.248 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645005, 2024-09-05T01:35:54.248 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-2.jpg" 2024-09-05T01:35:54.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.248 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.248 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.248 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2338847121, 2024-09-05T01:35:54.248 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642559, 2024-09-05T01:35:54.248 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-19.jpg" 2024-09-05T01:35:54.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.248 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.248 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.248 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2353125085, 2024-09-05T01:35:54.249 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644941, 2024-09-05T01:35:54.249 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-6.jpg" 2024-09-05T01:35:54.249 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.249 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.249 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.249 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2354659654, 2024-09-05T01:35:54.249 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643250, 2024-09-05T01:35:54.250 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-18.jpg" 2024-09-05T01:35:54.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.250 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.250 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.250 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2365261014, 2024-09-05T01:35:54.250 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643098, 2024-09-05T01:35:54.250 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-4.xml" 2024-09-05T01:35:54.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.251 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.251 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2368721401, 2024-09-05T01:35:54.251 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645378, 2024-09-05T01:35:54.251 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-10.xml" 2024-09-05T01:35:54.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.251 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.251 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2384176778, 2024-09-05T01:35:54.251 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643229, 2024-09-05T01:35:54.251 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-39.jpg" 2024-09-05T01:35:54.251 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.251 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.252 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.252 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2396200535, 2024-09-05T01:35:54.252 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643188, 2024-09-05T01:35:54.252 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-7.xml" 2024-09-05T01:35:54.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.252 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.252 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.252 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2398399399, 2024-09-05T01:35:54.252 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642465, 2024-09-05T01:35:54.252 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-69.jpg" 2024-09-05T01:35:54.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.252 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.252 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.252 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2404198926, 2024-09-05T01:35:54.253 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643113, 2024-09-05T01:35:54.253 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-46.jpg" 2024-09-05T01:35:54.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.253 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.253 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.253 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2416388024, 2024-09-05T01:35:54.253 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642471, 2024-09-05T01:35:54.253 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-66.jpg" 2024-09-05T01:35:54.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.253 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.253 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.253 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2420491379, 2024-09-05T01:35:54.253 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642549, 2024-09-05T01:35:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-26.jpg" 2024-09-05T01:35:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2437818000, 2024-09-05T01:35:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645732, 2024-09-05T01:35:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-45.xml" 2024-09-05T01:35:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2440067168, 2024-09-05T01:35:54.254 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643149, 2024-09-05T01:35:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-35.xml" 2024-09-05T01:35:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2442785348, 2024-09-05T01:35:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643335, 2024-09-05T01:35:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-19.jpg" 2024-09-05T01:35:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2445327132, 2024-09-05T01:35:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643144, 2024-09-05T01:35:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-15.jpg" 2024-09-05T01:35:54.255 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2453243110, 2024-09-05T01:35:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643317, 2024-09-05T01:35:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-3.xml" 2024-09-05T01:35:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2458154005, 2024-09-05T01:35:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643179, 2024-09-05T01:35:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-16.xml" 2024-09-05T01:35:54.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2476648965, 2024-09-05T01:35:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645416, 2024-09-05T01:35:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-36.jpg" 2024-09-05T01:35:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2479979131, 2024-09-05T01:35:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645410, 2024-09-05T01:35:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-42.jpg" 2024-09-05T01:35:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.257 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2482868220, 2024-09-05T01:35:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643327, 2024-09-05T01:35:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-27.jpg" 2024-09-05T01:35:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2486898175, 2024-09-05T01:35:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643163, 2024-09-05T01:35:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-2.jpg" 2024-09-05T01:35:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.258 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2503093975, 2024-09-05T01:35:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645398, 2024-09-05T01:35:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-54.jpg" 2024-09-05T01:35:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2506876262, 2024-09-05T01:35:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645379, 2024-09-05T01:35:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-9.xml" 2024-09-05T01:35:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2508638065, 2024-09-05T01:35:54.259 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644919, 2024-09-05T01:35:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-28.jpg" 2024-09-05T01:35:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2522517930, 2024-09-05T01:35:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642557, 2024-09-05T01:35:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-20.jpg" 2024-09-05T01:35:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2527598631, 2024-09-05T01:35:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645445, 2024-09-05T01:35:54.260 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-7.jpg" 2024-09-05T01:35:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2534823824, 2024-09-05T01:35:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642576, 2024-09-05T01:35:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-3.jpg" 2024-09-05T01:35:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2541538885, 2024-09-05T01:35:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643243, 2024-09-05T01:35:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-25.jpg" 2024-09-05T01:35:54.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2561041278, 2024-09-05T01:35:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643199, 2024-09-05T01:35:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-69.jpg" 2024-09-05T01:35:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2569910660, 2024-09-05T01:35:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643088, 2024-09-05T01:35:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-14.xml" 2024-09-05T01:35:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.262 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.263 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.263 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2571721911, 2024-09-05T01:35:54.263 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643257, 2024-09-05T01:35:54.263 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-11.jpg" 2024-09-05T01:35:54.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.263 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.263 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.263 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2572731420, 2024-09-05T01:35:54.263 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644995, 2024-09-05T01:35:54.263 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-12.jpg" 2024-09-05T01:35:54.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.263 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.263 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.264 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2584213559, 2024-09-05T01:35:54.264 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644997, 2024-09-05T01:35:54.264 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-10.jpg" 2024-09-05T01:35:54.264 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.264 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.264 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.264 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2598565669, 2024-09-05T01:35:54.264 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643130, 2024-09-05T01:35:54.264 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-29.jpg" 2024-09-05T01:35:54.264 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.264 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.264 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.264 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2609543084, 2024-09-05T01:35:54.265 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643122, 2024-09-05T01:35:54.265 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-37.jpg" 2024-09-05T01:35:54.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.265 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.265 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2613220339, 2024-09-05T01:35:54.265 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511634522, 2024-09-05T01:35:54.265 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-64.xml" 2024-09-05T01:35:54.265 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.265 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.265 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.265 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2621949068, 2024-09-05T01:35:54.265 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645434, 2024-09-05T01:35:54.266 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-18.jpg" 2024-09-05T01:35:54.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.266 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.266 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.266 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2624505453, 2024-09-05T01:35:54.266 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643166, 2024-09-05T01:35:54.266 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-29.xml" 2024-09-05T01:35:54.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.266 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.266 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.266 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2651564053, 2024-09-05T01:35:54.266 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643189, 2024-09-05T01:35:54.266 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-6.xml" 2024-09-05T01:35:54.267 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.267 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.267 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.267 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2653584727, 2024-09-05T01:35:54.267 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642554, 2024-09-05T01:35:54.267 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-22.jpg" 2024-09-05T01:35:54.267 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.267 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.267 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.267 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2654843209, 2024-09-05T01:35:54.267 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642452, 2024-09-05T01:35:54.267 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-74.jpg" 2024-09-05T01:35:54.268 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.268 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.268 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.268 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2658044907, 2024-09-05T01:35:54.268 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643344, 2024-09-05T01:35:54.268 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-10.jpg" 2024-09-05T01:35:54.268 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.268 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.268 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.268 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2662426144, 2024-09-05T01:35:54.268 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645780, 2024-09-05T01:35:54.268 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-21.jpg" 2024-09-05T01:35:54.268 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.269 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.269 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.269 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2663928957, 2024-09-05T01:35:54.269 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643133, 2024-09-05T01:35:54.269 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-26.jpg" 2024-09-05T01:35:54.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.269 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.269 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.269 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2666863102, 2024-09-05T01:35:54.269 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643169, 2024-09-05T01:35:54.269 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-26.xml" 2024-09-05T01:35:54.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.269 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.270 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.270 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2666978861, 2024-09-05T01:35:54.270 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643101, 2024-09-05T01:35:54.270 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-1.xml" 2024-09-05T01:35:54.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.270 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.270 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2679328932, 2024-09-05T01:35:54.270 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645448, 2024-09-05T01:35:54.270 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-4.jpg" 2024-09-05T01:35:54.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.270 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.270 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.271 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2680264272, 2024-09-05T01:35:54.271 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642529, 2024-09-05T01:35:54.271 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-39.jpg" 2024-09-05T01:35:54.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.271 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.271 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.271 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2684464208, 2024-09-05T01:35:54.271 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511639258, 2024-09-05T01:35:54.271 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-21.jpg" 2024-09-05T01:35:54.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.271 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.271 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.271 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2688311896, 2024-09-05T01:35:54.271 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643192, 2024-09-05T01:35:54.272 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-3.xml" 2024-09-05T01:35:54.272 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.272 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.272 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.272 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2688625090, 2024-09-05T01:35:54.272 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644955, 2024-09-05T01:35:54.272 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-23.xml" 2024-09-05T01:35:54.272 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.272 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.272 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.272 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2692900413, 2024-09-05T01:35:54.272 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645743, 2024-09-05T01:35:54.272 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-34.xml" 2024-09-05T01:35:54.273 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.273 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.273 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.273 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2716967573, 2024-09-05T01:35:54.273 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643172, 2024-09-05T01:35:54.273 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-23.xml" 2024-09-05T01:35:54.273 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.273 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.273 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.273 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2725760830, 2024-09-05T01:35:54.273 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644956, 2024-09-05T01:35:54.273 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-22.xml" 2024-09-05T01:35:54.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.274 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.274 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.274 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2737176519, 2024-09-05T01:35:54.274 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642573, 2024-09-05T01:35:54.274 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-6.jpg" 2024-09-05T01:35:54.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.274 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.274 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.274 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2738236138, 2024-09-05T01:35:54.274 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644949, 2024-09-05T01:35:54.274 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-29.xml" 2024-09-05T01:35:54.275 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.275 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.275 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.275 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2743791792, 2024-09-05T01:35:54.275 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645435, 2024-09-05T01:35:54.275 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-17.jpg" 2024-09-05T01:35:54.275 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.275 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.275 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.275 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2746447872, 2024-09-05T01:35:54.275 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645748, 2024-09-05T01:35:54.275 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-29.xml" 2024-09-05T01:35:54.275 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.276 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.276 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.276 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2767110358, 2024-09-05T01:35:54.276 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645766, 2024-09-05T01:35:54.276 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-12.xml" 2024-09-05T01:35:54.276 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.276 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.276 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.276 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2767199301, 2024-09-05T01:35:54.276 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645385, 2024-09-05T01:35:54.276 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-3.xml" 2024-09-05T01:35:54.276 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.276 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.277 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.277 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2774187568, 2024-09-05T01:35:54.277 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645433, 2024-09-05T01:35:54.277 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-19.jpg" 2024-09-05T01:35:54.277 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.277 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.277 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.277 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2785309413, 2024-09-05T01:35:54.277 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642517, 2024-09-05T01:35:54.277 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-46.jpg" 2024-09-05T01:35:54.277 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.277 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.277 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.278 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2786125559, 2024-09-05T01:35:54.278 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643323, 2024-09-05T01:35:54.278 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-31.jpg" 2024-09-05T01:35:54.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.278 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.278 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.278 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2792255708, 2024-09-05T01:35:54.278 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643212, 2024-09-05T01:35:54.278 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-56.jpg" 2024-09-05T01:35:54.278 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.278 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.278 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.278 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2796944754, 2024-09-05T01:35:54.279 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643220, 2024-09-05T01:35:54.279 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-48.jpg" 2024-09-05T01:35:54.279 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.279 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.279 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.279 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2796969613, 2024-09-05T01:35:54.279 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645778, 2024-09-05T01:35:54.279 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-1.xml" 2024-09-05T01:35:54.279 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.279 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.279 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.279 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2802193327, 2024-09-05T01:35:54.279 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643240, 2024-09-05T01:35:54.280 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-28.jpg" 2024-09-05T01:35:54.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.280 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.280 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.280 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2804922662, 2024-09-05T01:35:54.280 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645791, 2024-09-05T01:35:54.280 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-14.jpg" 2024-09-05T01:35:54.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.280 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.280 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.280 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2822960230, 2024-09-05T01:35:54.280 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643217, 2024-09-05T01:35:54.280 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-51.jpg" 2024-09-05T01:35:54.281 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.281 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.281 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.281 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2823727994, 2024-09-05T01:35:54.281 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643315, 2024-09-05T01:35:54.281 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-5.xml" 2024-09-05T01:35:54.281 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.281 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.183+0000 7fc572200640 1 -- 172.21.15.12:0/390035145 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc5540a2f00 msgr2=0x7fc5540a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:54.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.183+0000 7fc572200640 1 --2- 172.21.15.12:0/390035145 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc5540a2f00 0x7fc5540a53c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc5600304c0 tx=0x7fc5600303d0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.183+0000 7fc572200640 1 -- 172.21.15.12:0/390035145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc56c114ab0 msgr2=0x7fc56c1b2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:54.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.183+0000 7fc572200640 1 --2- 172.21.15.12:0/390035145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc56c114ab0 0x7fc56c1b2ee0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc564009f80 tx=0x7fc56400c800 comp rx=0 tx=0).stop 2024-09-05T01:35:54.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.183+0000 7fc572200640 1 -- 172.21.15.12:0/390035145 shutdown_connections 2024-09-05T01:35:54.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.183+0000 7fc572200640 1 --2- 172.21.15.12:0/390035145 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc5540a2f00 0x7fc5540a53c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.183+0000 7fc572200640 1 --2- 172.21.15.12:0/390035145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc56c114ab0 0x7fc56c1b2ee0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.183+0000 7fc572200640 1 --2- 172.21.15.12:0/390035145 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc56c109b10 0x7fc56c1134a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.183+0000 7fc572200640 1 --2- 172.21.15.12:0/390035145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc56c1091f0 0x7fc56c112f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:54.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.183+0000 7fc572200640 1 -- 172.21.15.12:0/390035145 >> 172.21.15.12:0/390035145 conn(0x7fc56c073660 msgr2=0x7fc56c119230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:54.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.183+0000 7fc572200640 1 -- 172.21.15.12:0/390035145 shutdown_connections 2024-09-05T01:35:54.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:54.183+0000 7fc572200640 1 -- 172.21.15.12:0/390035145 wait complete. 2024-09-05T01:35:54.284 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.284 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2827658742, 2024-09-05T01:35:54.284 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643061, 2024-09-05T01:35:54.284 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-41.xml" 2024-09-05T01:35:54.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.284 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.284 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.284 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2830027780, 2024-09-05T01:35:54.284 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645004, 2024-09-05T01:35:54.284 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-3.jpg" 2024-09-05T01:35:54.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.284 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.285 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.285 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2833411200, 2024-09-05T01:35:54.285 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643160, 2024-09-05T01:35:54.285 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-5.jpg" 2024-09-05T01:35:54.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.285 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.285 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.285 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2838972686, 2024-09-05T01:35:54.285 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643180, 2024-09-05T01:35:54.285 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-15.xml" 2024-09-05T01:35:54.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.285 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.285 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.285 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2840726672, 2024-09-05T01:35:54.286 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643074, 2024-09-05T01:35:54.286 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-28.xml" 2024-09-05T01:35:54.286 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.286 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.286 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.286 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2845293993, 2024-09-05T01:35:54.286 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644983, 2024-09-05T01:35:54.286 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-24.jpg" 2024-09-05T01:35:54.286 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.286 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.286 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.286 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2862158863, 2024-09-05T01:35:54.287 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643190, 2024-09-05T01:35:54.287 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-5.xml" 2024-09-05T01:35:54.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.287 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.287 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.287 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2867882166, 2024-09-05T01:35:54.287 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511634733, 2024-09-05T01:35:54.287 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-32.jpg" 2024-09-05T01:35:54.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.287 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.287 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.287 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2878817645, 2024-09-05T01:35:54.287 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643263, 2024-09-05T01:35:54.287 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-5.jpg" 2024-09-05T01:35:54.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.288 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.288 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.288 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2879032742, 2024-09-05T01:35:54.288 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643336, 2024-09-05T01:35:54.288 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-18.jpg" 2024-09-05T01:35:54.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.288 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.288 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.288 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2895441509, 2024-09-05T01:35:54.288 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645388, 2024-09-05T01:35:54.288 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-64.jpg" 2024-09-05T01:35:54.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.288 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.288 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.289 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2903166041, 2024-09-05T01:35:54.289 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643127, 2024-09-05T01:35:54.289 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-32.jpg" 2024-09-05T01:35:54.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.289 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.289 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.289 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2912528493, 2024-09-05T01:35:54.289 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643195, 2024-09-05T01:35:54.289 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-73.jpg" 2024-09-05T01:35:54.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.289 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.289 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.289 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2914314752, 2024-09-05T01:35:54.290 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645752, 2024-09-05T01:35:54.290 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-25.xml" 2024-09-05T01:35:54.290 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.290 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.290 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.290 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2920554627, 2024-09-05T01:35:54.290 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643210, 2024-09-05T01:35:54.290 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-58.jpg" 2024-09-05T01:35:54.290 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.290 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.290 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.290 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2931937980, 2024-09-05T01:35:54.290 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642489, 2024-09-05T01:35:54.291 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-60.jpg" 2024-09-05T01:35:54.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.291 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.291 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.291 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2943983603, 2024-09-05T01:35:54.291 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642431, 2024-09-05T01:35:54.291 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-10.xml" 2024-09-05T01:35:54.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.291 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.291 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.291 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2949387123, 2024-09-05T01:35:54.291 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642507, 2024-09-05T01:35:54.291 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-50.jpg" 2024-09-05T01:35:54.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.292 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.292 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.292 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2950364655, 2024-09-05T01:35:54.292 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643222, 2024-09-05T01:35:54.292 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-46.jpg" 2024-09-05T01:35:54.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.292 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.292 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.292 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2951195725, 2024-09-05T01:35:54.292 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644963, 2024-09-05T01:35:54.292 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-15.xml" 2024-09-05T01:35:54.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.292 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.292 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.293 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2953078794, 2024-09-05T01:35:54.293 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511639334, 2024-09-05T01:35:54.293 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-2.jpg" 2024-09-05T01:35:54.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.293 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.293 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.293 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2957512785, 2024-09-05T01:35:54.293 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643309, 2024-09-05T01:35:54.293 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-11.xml" 2024-09-05T01:35:54.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.293 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.293 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.293 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2976957398, 2024-09-05T01:35:54.294 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643157, 2024-09-05T01:35:54.294 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-8.jpg" 2024-09-05T01:35:54.294 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.294 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.294 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.294 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 2980459034, 2024-09-05T01:35:54.294 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643093, 2024-09-05T01:35:54.294 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-9.xml" 2024-09-05T01:35:54.294 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.294 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.294 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.294 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3009373823, 2024-09-05T01:35:54.294 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645436, 2024-09-05T01:35:54.294 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-16.jpg" 2024-09-05T01:35:54.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.295 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.295 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.295 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3009437245, 2024-09-05T01:35:54.295 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643085, 2024-09-05T01:35:54.295 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-17.xml" 2024-09-05T01:35:54.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.295 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.295 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.295 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3016437326, 2024-09-05T01:35:54.295 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642496, 2024-09-05T01:35:54.295 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-55.jpg" 2024-09-05T01:35:54.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.295 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.296 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.296 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3021748178, 2024-09-05T01:35:54.296 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643339, 2024-09-05T01:35:54.296 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-15.jpg" 2024-09-05T01:35:54.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.296 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.296 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.296 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3023341961, 2024-09-05T01:35:54.296 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643100, 2024-09-05T01:35:54.296 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-2.xml" 2024-09-05T01:35:54.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.296 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.296 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.296 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3040856509, 2024-09-05T01:35:54.297 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643332, 2024-09-05T01:35:54.297 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-22.jpg" 2024-09-05T01:35:54.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.297 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.297 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.297 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3043128192, 2024-09-05T01:35:54.297 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643194, 2024-09-05T01:35:54.297 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-1.xml" 2024-09-05T01:35:54.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.297 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.297 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.297 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3043528230, 2024-09-05T01:35:54.297 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643108, 2024-09-05T01:35:54.298 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-51.jpg" 2024-09-05T01:35:54.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.298 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.298 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.298 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3043928672, 2024-09-05T01:35:54.298 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643176, 2024-09-05T01:35:54.298 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-19.xml" 2024-09-05T01:35:54.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.298 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.298 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.298 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3062092935, 2024-09-05T01:35:54.298 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643064, 2024-09-05T01:35:54.298 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-38.xml" 2024-09-05T01:35:54.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.299 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.299 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.299 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3063334809, 2024-09-05T01:35:54.299 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643326, 2024-09-05T01:35:54.299 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-28.jpg" 2024-09-05T01:35:54.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.299 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.299 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.299 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3082805165, 2024-09-05T01:35:54.299 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645747, 2024-09-05T01:35:54.299 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-30.xml" 2024-09-05T01:35:54.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.300 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.300 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.300 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3105469291, 2024-09-05T01:35:54.300 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644936, 2024-09-05T01:35:54.300 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-11.jpg" 2024-09-05T01:35:54.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.300 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.300 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.300 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3114351851, 2024-09-05T01:35:54.300 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642565, 2024-09-05T01:35:54.300 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-14.jpg" 2024-09-05T01:35:54.300 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.300 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.301 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.301 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3117691315, 2024-09-05T01:35:54.301 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644962, 2024-09-05T01:35:54.301 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-16.xml" 2024-09-05T01:35:54.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.301 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.301 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.301 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3126278128, 2024-09-05T01:35:54.301 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643152, 2024-09-05T01:35:54.301 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-33.xml" 2024-09-05T01:35:54.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.301 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.301 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.302 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3163947433, 2024-09-05T01:35:54.302 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643092, 2024-09-05T01:35:54.302 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-10.xml" 2024-09-05T01:35:54.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.302 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.302 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.302 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3167495597, 2024-09-05T01:35:54.302 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645443, 2024-09-05T01:35:54.302 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-9.jpg" 2024-09-05T01:35:54.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.302 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.302 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.302 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3170411460, 2024-09-05T01:35:54.303 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642426, 2024-09-05T01:35:54.303 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-13.xml" 2024-09-05T01:35:54.303 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.303 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.303 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.303 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3174544189, 2024-09-05T01:35:54.303 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644965, 2024-09-05T01:35:54.303 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-13.xml" 2024-09-05T01:35:54.303 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.303 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.303 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.303 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3178376571, 2024-09-05T01:35:54.303 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643070, 2024-09-05T01:35:54.304 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-32.xml" 2024-09-05T01:35:54.304 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.304 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.304 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.304 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3185406219, 2024-09-05T01:35:54.304 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642578, 2024-09-05T01:35:54.304 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-1.jpg" 2024-09-05T01:35:54.304 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.304 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.304 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.304 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3187298757, 2024-09-05T01:35:54.304 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642540, 2024-09-05T01:35:54.304 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-32.jpg" 2024-09-05T01:35:54.305 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.305 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.305 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.305 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3194462942, 2024-09-05T01:35:54.305 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645377, 2024-09-05T01:35:54.305 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-11.xml" 2024-09-05T01:35:54.305 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.305 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.305 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.305 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3198683624, 2024-09-05T01:35:54.305 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643235, 2024-09-05T01:35:54.305 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-33.jpg" 2024-09-05T01:35:54.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.306 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.306 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3209212513, 2024-09-05T01:35:54.306 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511639284, 2024-09-05T01:35:54.306 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-19.jpg" 2024-09-05T01:35:54.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.306 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.306 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3215674984, 2024-09-05T01:35:54.306 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643104, 2024-09-05T01:35:54.306 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-55.jpg" 2024-09-05T01:35:54.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.306 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.307 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.307 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3224941229, 2024-09-05T01:35:54.307 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643232, 2024-09-05T01:35:54.307 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-36.jpg" 2024-09-05T01:35:54.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.307 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.307 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.307 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3226193023, 2024-09-05T01:35:54.307 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645400, 2024-09-05T01:35:54.307 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-52.jpg" 2024-09-05T01:35:54.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.307 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.307 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.308 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3230636294, 2024-09-05T01:35:54.308 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645729, 2024-09-05T01:35:54.308 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-48.xml" 2024-09-05T01:35:54.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.308 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.308 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.308 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3231069976, 2024-09-05T01:35:54.308 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643107, 2024-09-05T01:35:54.308 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-52.jpg" 2024-09-05T01:35:54.308 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.308 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.308 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.308 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3235620368, 2024-09-05T01:35:54.309 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642497, 2024-09-05T01:35:54.309 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-54.jpg" 2024-09-05T01:35:54.309 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.309 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.309 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.309 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3240232081, 2024-09-05T01:35:54.309 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643072, 2024-09-05T01:35:54.309 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-30.xml" 2024-09-05T01:35:54.309 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.309 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.309 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.309 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3246568947, 2024-09-05T01:35:54.309 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643140, 2024-09-05T01:35:54.310 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-19.jpg" 2024-09-05T01:35:54.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.310 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.310 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.310 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3264978566, 2024-09-05T01:35:54.310 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643205, 2024-09-05T01:35:54.310 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-63.jpg" 2024-09-05T01:35:54.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.310 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.310 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.310 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3268644555, 2024-09-05T01:35:54.310 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645774, 2024-09-05T01:35:54.310 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-5.xml" 2024-09-05T01:35:54.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.311 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.311 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.311 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3268897348, 2024-09-05T01:35:54.311 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645383, 2024-09-05T01:35:54.311 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-5.xml" 2024-09-05T01:35:54.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.311 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.311 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.311 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3276461395, 2024-09-05T01:35:54.311 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644917, 2024-09-05T01:35:54.311 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/article-2.xml" 2024-09-05T01:35:54.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.311 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.312 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.312 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3290658170, 2024-09-05T01:35:54.312 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642458, 2024-09-05T01:35:54.312 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-71.jpg" 2024-09-05T01:35:54.312 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.312 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.312 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.312 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3291860787, 2024-09-05T01:35:54.312 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645541, 2024-09-05T01:35:54.312 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-40.xml" 2024-09-05T01:35:54.312 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.312 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.312 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.313 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3299905369, 2024-09-05T01:35:54.313 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642440, 2024-09-05T01:35:54.313 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-4.xml" 2024-09-05T01:35:54.313 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.313 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.313 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.313 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3304636119, 2024-09-05T01:35:54.313 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645772, 2024-09-05T01:35:54.313 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-6.xml" 2024-09-05T01:35:54.313 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.313 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.313 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.313 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3306807723, 2024-09-05T01:35:54.313 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643082, 2024-09-05T01:35:54.314 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-20.xml" 2024-09-05T01:35:54.314 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.314 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.314 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.314 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3324713210, 2024-09-05T01:35:54.314 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642474, 2024-09-05T01:35:54.314 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-65.jpg" 2024-09-05T01:35:54.314 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.314 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.314 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.314 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3327260657, 2024-09-05T01:35:54.314 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643319, 2024-09-05T01:35:54.314 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-1.xml" 2024-09-05T01:35:54.315 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.315 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.315 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.315 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3329934863, 2024-09-05T01:35:54.315 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643083, 2024-09-05T01:35:54.315 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-19.xml" 2024-09-05T01:35:54.315 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.315 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.315 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.315 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3334808600, 2024-09-05T01:35:54.315 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643164, 2024-09-05T01:35:54.315 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-1.jpg" 2024-09-05T01:35:54.315 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3337065890, 2024-09-05T01:35:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645770, 2024-09-05T01:35:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-8.xml" 2024-09-05T01:35:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3349522722, 2024-09-05T01:35:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642535, 2024-09-05T01:35:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-35.jpg" 2024-09-05T01:35:54.316 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3374902859, 2024-09-05T01:35:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643311, 2024-09-05T01:35:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-9.xml" 2024-09-05T01:35:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3379693896, 2024-09-05T01:35:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645442, 2024-09-05T01:35:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-10.jpg" 2024-09-05T01:35:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.317 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3402022887, 2024-09-05T01:35:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511634691, 2024-09-05T01:35:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-53.jpg" 2024-09-05T01:35:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3402574412, 2024-09-05T01:35:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643226, 2024-09-05T01:35:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-42.jpg" 2024-09-05T01:35:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.318 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3403607134, 2024-09-05T01:35:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644930, 2024-09-05T01:35:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-17.jpg" 2024-09-05T01:35:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3407613043, 2024-09-05T01:35:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645737, 2024-09-05T01:35:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-40.xml" 2024-09-05T01:35:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.319 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3410504027, 2024-09-05T01:35:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644931, 2024-09-05T01:35:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-16.jpg" 2024-09-05T01:35:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3420310799, 2024-09-05T01:35:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644921, 2024-09-05T01:35:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-26.jpg" 2024-09-05T01:35:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.320 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3427610851, 2024-09-05T01:35:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643322, 2024-09-05T01:35:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-32.jpg" 2024-09-05T01:35:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3433193878, 2024-09-05T01:35:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643253, 2024-09-05T01:35:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-15.jpg" 2024-09-05T01:35:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3442508564, 2024-09-05T01:35:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645756, 2024-09-05T01:35:54.321 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-21.xml" 2024-09-05T01:35:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3447350516, 2024-09-05T01:35:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645750, 2024-09-05T01:35:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-27.xml" 2024-09-05T01:35:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3457833921, 2024-09-05T01:35:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643340, 2024-09-05T01:35:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-14.jpg" 2024-09-05T01:35:54.322 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3461234340, 2024-09-05T01:35:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643078, 2024-09-05T01:35:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-24.xml" 2024-09-05T01:35:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3468182635, 2024-09-05T01:35:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643165, 2024-09-05T01:35:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-30.xml" 2024-09-05T01:35:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.323 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3486973445, 2024-09-05T01:35:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642480, 2024-09-05T01:35:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-63.jpg" 2024-09-05T01:35:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3489371751, 2024-09-05T01:35:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643116, 2024-09-05T01:35:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-43.jpg" 2024-09-05T01:35:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3502688956, 2024-09-05T01:35:54.324 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645003, 2024-09-05T01:35:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-4.jpg" 2024-09-05T01:35:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3503427652, 2024-09-05T01:35:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645387, 2024-09-05T01:35:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-1.xml" 2024-09-05T01:35:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3506513754, 2024-09-05T01:35:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644966, 2024-09-05T01:35:54.325 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-12.xml" 2024-09-05T01:35:54.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.326 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.326 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.326 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3514227798, 2024-09-05T01:35:54.326 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645420, 2024-09-05T01:35:54.326 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-32.jpg" 2024-09-05T01:35:54.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.326 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.326 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.326 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3517724188, 2024-09-05T01:35:54.326 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643215, 2024-09-05T01:35:54.326 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-53.jpg" 2024-09-05T01:35:54.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.326 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3532967051, 2024-09-05T01:35:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643258, 2024-09-05T01:35:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-10.jpg" 2024-09-05T01:35:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3533818943, 2024-09-05T01:35:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644950, 2024-09-05T01:35:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-28.xml" 2024-09-05T01:35:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.327 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3534299333, 2024-09-05T01:35:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643155, 2024-09-05T01:35:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-10.jpg" 2024-09-05T01:35:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3541184194, 2024-09-05T01:35:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643308, 2024-09-05T01:35:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-12.xml" 2024-09-05T01:35:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.328 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3563867272, 2024-09-05T01:35:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644929, 2024-09-05T01:35:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-18.jpg" 2024-09-05T01:35:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3566183707, 2024-09-05T01:35:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643320, 2024-09-05T01:35:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-34.jpg" 2024-09-05T01:35:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3567231874, 2024-09-05T01:35:54.329 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645751, 2024-09-05T01:35:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-26.xml" 2024-09-05T01:35:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3571390051, 2024-09-05T01:35:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643333, 2024-09-05T01:35:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-21.jpg" 2024-09-05T01:35:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3578399467, 2024-09-05T01:35:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642561, 2024-09-05T01:35:54.330 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-18.jpg" 2024-09-05T01:35:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3580015078, 2024-09-05T01:35:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643337, 2024-09-05T01:35:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-17.jpg" 2024-09-05T01:35:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3583102704, 2024-09-05T01:35:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643321, 2024-09-05T01:35:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-33.jpg" 2024-09-05T01:35:54.331 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3588480953, 2024-09-05T01:35:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644969, 2024-09-05T01:35:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-9.xml" 2024-09-05T01:35:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3593833465, 2024-09-05T01:35:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644993, 2024-09-05T01:35:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-14.jpg" 2024-09-05T01:35:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.332 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3596751854, 2024-09-05T01:35:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643234, 2024-09-05T01:35:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-34.jpg" 2024-09-05T01:35:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3603541537, 2024-09-05T01:35:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645840, 2024-09-05T01:35:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-11.jpg" 2024-09-05T01:35:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.333 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3610528834, 2024-09-05T01:35:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643227, 2024-09-05T01:35:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-41.jpg" 2024-09-05T01:35:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3614950349, 2024-09-05T01:35:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645441, 2024-09-05T01:35:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-11.jpg" 2024-09-05T01:35:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.334 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3621403564, 2024-09-05T01:35:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645450, 2024-09-05T01:35:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-2.jpg" 2024-09-05T01:35:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3633271767, 2024-09-05T01:35:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645426, 2024-09-05T01:35:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-26.jpg" 2024-09-05T01:35:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3638068691, 2024-09-05T01:35:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511634701, 2024-09-05T01:35:54.335 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-48.jpg" 2024-09-05T01:35:54.336 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.336 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.336 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.336 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3638171539, 2024-09-05T01:35:54.336 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645739, 2024-09-05T01:35:54.336 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-38.xml" 2024-09-05T01:35:54.336 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.336 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.336 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.336 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3643252588, 2024-09-05T01:35:54.336 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511634657, 2024-09-05T01:35:54.336 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-17.xml" 2024-09-05T01:35:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3643405523, 2024-09-05T01:35:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645444, 2024-09-05T01:35:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-8.jpg" 2024-09-05T01:35:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3650256158, 2024-09-05T01:35:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643230, 2024-09-05T01:35:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-38.jpg" 2024-09-05T01:35:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.337 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3653194106, 2024-09-05T01:35:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643094, 2024-09-05T01:35:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-8.xml" 2024-09-05T01:35:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3659655138, 2024-09-05T01:35:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644985, 2024-09-05T01:35:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-22.jpg" 2024-09-05T01:35:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.338 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3660948983, 2024-09-05T01:35:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643181, 2024-09-05T01:35:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-14.xml" 2024-09-05T01:35:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3668122464, 2024-09-05T01:35:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643059, 2024-09-05T01:35:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-43.xml" 2024-09-05T01:35:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3675697335, 2024-09-05T01:35:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644939, 2024-09-05T01:35:54.339 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-8.jpg" 2024-09-05T01:35:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3684650961, 2024-09-05T01:35:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642428, 2024-09-05T01:35:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-12.xml" 2024-09-05T01:35:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3690923867, 2024-09-05T01:35:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643219, 2024-09-05T01:35:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-49.jpg" 2024-09-05T01:35:54.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3693680659, 2024-09-05T01:35:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511639296, 2024-09-05T01:35:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-15.jpg" 2024-09-05T01:35:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3696801719, 2024-09-05T01:35:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511634689, 2024-09-05T01:35:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-1.xml" 2024-09-05T01:35:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.341 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3728839533, 2024-09-05T01:35:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645821, 2024-09-05T01:35:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-13.jpg" 2024-09-05T01:35:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3733391319, 2024-09-05T01:35:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644926, 2024-09-05T01:35:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-21.jpg" 2024-09-05T01:35:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.342 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3735888938, 2024-09-05T01:35:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643132, 2024-09-05T01:35:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-27.jpg" 2024-09-05T01:35:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3763695893, 2024-09-05T01:35:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642500, 2024-09-05T01:35:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-52.jpg" 2024-09-05T01:35:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3765038206, 2024-09-05T01:35:54.343 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645381, 2024-09-05T01:35:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-7.xml" 2024-09-05T01:35:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3769917322, 2024-09-05T01:35:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643221, 2024-09-05T01:35:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-47.jpg" 2024-09-05T01:35:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3770065955, 2024-09-05T01:35:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642499, 2024-09-05T01:35:54.344 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-53.jpg" 2024-09-05T01:35:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3773795367, 2024-09-05T01:35:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643086, 2024-09-05T01:35:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-16.xml" 2024-09-05T01:35:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3782780709, 2024-09-05T01:35:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642537, 2024-09-05T01:35:54.345 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-34.jpg" 2024-09-05T01:35:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3785664639, 2024-09-05T01:35:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645789, 2024-09-05T01:35:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-15.jpg" 2024-09-05T01:35:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3799609671, 2024-09-05T01:35:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643095, 2024-09-05T01:35:54.346 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-7.xml" 2024-09-05T01:35:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3804093538, 2024-09-05T01:35:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645753, 2024-09-05T01:35:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-24.xml" 2024-09-05T01:35:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3810038586, 2024-09-05T01:35:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645725, 2024-09-05T01:35:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-52.xml" 2024-09-05T01:35:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.347 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3824216681, 2024-09-05T01:35:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644991, 2024-09-05T01:35:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-16.jpg" 2024-09-05T01:35:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3830152196, 2024-09-05T01:35:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645755, 2024-09-05T01:35:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-22.xml" 2024-09-05T01:35:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.348 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3837181325, 2024-09-05T01:35:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645731, 2024-09-05T01:35:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-46.xml" 2024-09-05T01:35:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3838081936, 2024-09-05T01:35:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643080, 2024-09-05T01:35:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-22.xml" 2024-09-05T01:35:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3864933534, 2024-09-05T01:35:54.349 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643156, 2024-09-05T01:35:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-9.jpg" 2024-09-05T01:35:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3870126577, 2024-09-05T01:35:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643313, 2024-09-05T01:35:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-7.xml" 2024-09-05T01:35:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3889364476, 2024-09-05T01:35:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643237, 2024-09-05T01:35:54.350 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-31.jpg" 2024-09-05T01:35:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3892054482, 2024-09-05T01:35:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643124, 2024-09-05T01:35:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-35.jpg" 2024-09-05T01:35:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3892816373, 2024-09-05T01:35:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643174, 2024-09-05T01:35:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-21.xml" 2024-09-05T01:35:54.351 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3894937939, 2024-09-05T01:35:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642567, 2024-09-05T01:35:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-12.jpg" 2024-09-05T01:35:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3911536247, 2024-09-05T01:35:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643213, 2024-09-05T01:35:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-55.jpg" 2024-09-05T01:35:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.352 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3912100545, 2024-09-05T01:35:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645412, 2024-09-05T01:35:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-40.jpg" 2024-09-05T01:35:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3919160184, 2024-09-05T01:35:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642553, 2024-09-05T01:35:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-23.jpg" 2024-09-05T01:35:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.353 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3920644286, 2024-09-05T01:35:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643065, 2024-09-05T01:35:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-37.xml" 2024-09-05T01:35:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3922506557, 2024-09-05T01:35:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645735, 2024-09-05T01:35:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-42.xml" 2024-09-05T01:35:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3926398410, 2024-09-05T01:35:54.354 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642569, 2024-09-05T01:35:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-10.jpg" 2024-09-05T01:35:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3935839840, 2024-09-05T01:35:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643236, 2024-09-05T01:35:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-32.jpg" 2024-09-05T01:35:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3945442059, 2024-09-05T01:35:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645767, 2024-09-05T01:35:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-11.xml" 2024-09-05T01:35:54.355 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3958295948, 2024-09-05T01:35:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645404, 2024-09-05T01:35:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-48.jpg" 2024-09-05T01:35:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3963477404, 2024-09-05T01:35:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643341, 2024-09-05T01:35:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-13.jpg" 2024-09-05T01:35:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3964630989, 2024-09-05T01:35:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643218, 2024-09-05T01:35:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-50.jpg" 2024-09-05T01:35:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3966596023, 2024-09-05T01:35:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645384, 2024-09-05T01:35:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-4.xml" 2024-09-05T01:35:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.357 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3969467422, 2024-09-05T01:35:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643349, 2024-09-05T01:35:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-5.jpg" 2024-09-05T01:35:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3981601690, 2024-09-05T01:35:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643178, 2024-09-05T01:35:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-17.xml" 2024-09-05T01:35:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.358 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3983951819, 2024-09-05T01:35:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642513, 2024-09-05T01:35:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-48.jpg" 2024-09-05T01:35:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 3995292716, 2024-09-05T01:35:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643200, 2024-09-05T01:35:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-68.jpg" 2024-09-05T01:35:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4004596380, 2024-09-05T01:35:54.359 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511639287, 2024-09-05T01:35:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-18.jpg" 2024-09-05T01:35:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4025486236, 2024-09-05T01:35:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642562, 2024-09-05T01:35:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-17.jpg" 2024-09-05T01:35:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4033552890, 2024-09-05T01:35:54.360 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645551, 2024-09-05T01:35:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-64.jpg" 2024-09-05T01:35:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4038322572, 2024-09-05T01:35:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643167, 2024-09-05T01:35:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-28.xml" 2024-09-05T01:35:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4070920448, 2024-09-05T01:35:54.361 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643248, 2024-09-05T01:35:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-20.jpg" 2024-09-05T01:35:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4079336859, 2024-09-05T01:35:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645763, 2024-09-05T01:35:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-14.xml" 2024-09-05T01:35:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4089813275, 2024-09-05T01:35:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511639327, 2024-09-05T01:35:54.362 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-4.jpg" 2024-09-05T01:35:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4091753064, 2024-09-05T01:35:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643154, 2024-09-05T01:35:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-31.xml" 2024-09-05T01:35:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4098808373, 2024-09-05T01:35:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643173, 2024-09-05T01:35:54.363 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-22.xml" 2024-09-05T01:35:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4104755017, 2024-09-05T01:35:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643068, 2024-09-05T01:35:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-34.xml" 2024-09-05T01:35:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4105506351, 2024-09-05T01:35:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643331, 2024-09-05T01:35:54.364 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-23.jpg" 2024-09-05T01:35:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4106217186, 2024-09-05T01:35:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642495, 2024-09-05T01:35:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-56.jpg" 2024-09-05T01:35:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4114831856, 2024-09-05T01:35:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643063, 2024-09-05T01:35:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-39.xml" 2024-09-05T01:35:54.365 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4116099646, 2024-09-05T01:35:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645733, 2024-09-05T01:35:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-44.xml" 2024-09-05T01:35:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4130021956, 2024-09-05T01:35:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644994, 2024-09-05T01:35:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-13.jpg" 2024-09-05T01:35:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.366 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4132798420, 2024-09-05T01:35:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643129, 2024-09-05T01:35:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-30.jpg" 2024-09-05T01:35:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4140957031, 2024-09-05T01:35:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645769, 2024-09-05T01:35:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-9.xml" 2024-09-05T01:35:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4143910970, 2024-09-05T01:35:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643259, 2024-09-05T01:35:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-9.jpg" 2024-09-05T01:35:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4151252259, 2024-09-05T01:35:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643242, 2024-09-05T01:35:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-26.jpg" 2024-09-05T01:35:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.368 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4151943645, 2024-09-05T01:35:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643206, 2024-09-05T01:35:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-62.jpg" 2024-09-05T01:35:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4155955877, 2024-09-05T01:35:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643223, 2024-09-05T01:35:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-45.jpg" 2024-09-05T01:35:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4165366331, 2024-09-05T01:35:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643186, 2024-09-05T01:35:54.369 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-9.xml" 2024-09-05T01:35:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4170399066, 2024-09-05T01:35:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644916, 2024-09-05T01:35:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/article-3.xml" 2024-09-05T01:35:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4174905726, 2024-09-05T01:35:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645451, 2024-09-05T01:35:54.370 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-1.jpg" 2024-09-05T01:35:54.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.371 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.371 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.371 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4176464411, 2024-09-05T01:35:54.371 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643202, 2024-09-05T01:35:54.371 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-66.jpg" 2024-09-05T01:35:54.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.371 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.371 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.371 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4179112204, 2024-09-05T01:35:54.371 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645429, 2024-09-05T01:35:54.371 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-23.jpg" 2024-09-05T01:35:54.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.372 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.372 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.372 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4182744635, 2024-09-05T01:35:54.372 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644924, 2024-09-05T01:35:54.372 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-23.jpg" 2024-09-05T01:35:54.372 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.372 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.372 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.372 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4189644347, 2024-09-05T01:35:54.372 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645761, 2024-09-05T01:35:54.372 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-16.xml" 2024-09-05T01:35:54.372 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.372 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.373 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.373 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4194740331, 2024-09-05T01:35:54.373 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643345, 2024-09-05T01:35:54.373 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-9.jpg" 2024-09-05T01:35:54.373 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.373 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.373 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.373 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4210986087, 2024-09-05T01:35:54.373 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645417, 2024-09-05T01:35:54.373 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-35.jpg" 2024-09-05T01:35:54.373 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.373 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4216335262, 2024-09-05T01:35:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645380, 2024-09-05T01:35:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-8.xml" 2024-09-05T01:35:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4226576899, 2024-09-05T01:35:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645734, 2024-09-05T01:35:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-43.xml" 2024-09-05T01:35:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.374 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4236343464, 2024-09-05T01:35:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645771, 2024-09-05T01:35:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-7.xml" 2024-09-05T01:35:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4243726074, 2024-09-05T01:35:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644942, 2024-09-05T01:35:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-5.jpg" 2024-09-05T01:35:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4247272937, 2024-09-05T01:35:54.375 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643119, 2024-09-05T01:35:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-40.jpg" 2024-09-05T01:35:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4248373186, 2024-09-05T01:35:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643209, 2024-09-05T01:35:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-59.jpg" 2024-09-05T01:35:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4249012918, 2024-09-05T01:35:54.376 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645741, 2024-09-05T01:35:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-36.xml" 2024-09-05T01:35:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4251183976, 2024-09-05T01:35:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643239, 2024-09-05T01:35:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-29.jpg" 2024-09-05T01:35:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4252422855, 2024-09-05T01:35:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643177, 2024-09-05T01:35:54.377 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-18.xml" 2024-09-05T01:35:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4257461411, 2024-09-05T01:35:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642515, 2024-09-05T01:35:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-47.jpg" 2024-09-05T01:35:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4272626399, 2024-09-05T01:35:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644957, 2024-09-05T01:35:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-21.xml" 2024-09-05T01:35:54.378 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4275424050, 2024-09-05T01:35:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645447, 2024-09-05T01:35:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-5.jpg" 2024-09-05T01:35:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4278930321, 2024-09-05T01:35:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511645757, 2024-09-05T01:35:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-20.xml" 2024-09-05T01:35:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.379 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4279486032, 2024-09-05T01:35:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511644938, 2024-09-05T01:35:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-9.jpg" 2024-09-05T01:35:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4285013340, 2024-09-05T01:35:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643126, 2024-09-05T01:35:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-33.jpg" 2024-09-05T01:35:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.380 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.381 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4286465808, 2024-09-05T01:35:54.381 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511643184, 2024-09-05T01:35:54.381 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-11.xml" 2024-09-05T01:35:54.381 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:35:54.381 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:35:54.381 INFO:teuthology.orchestra.run.smithi012.stdout: "damage_type": "backtrace", 2024-09-05T01:35:54.381 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4290403987, 2024-09-05T01:35:54.381 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 1099511642575, 2024-09-05T01:35:54.381 INFO:teuthology.orchestra.run.smithi012.stdout: "path": "/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-4.jpg" 2024-09-05T01:35:54.381 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:35:54.381 INFO:teuthology.orchestra.run.smithi012.stdout:] 2024-09-05T01:35:55.218 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-05T01:35:55.438 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:55 smithi012 ceph-mon[29942]: pgmap v349: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.1 MiB/s wr, 437 op/s 2024-09-05T01:35:55.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:55 smithi145 ceph-mon[34376]: pgmap v349: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.1 MiB/s wr, 437 op/s 2024-09-05T01:35:55.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:55 smithi151 ceph-mon[35013]: pgmap v349: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.1 MiB/s wr, 437 op/s 2024-09-05T01:35:55.645 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:35:56.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.396+0000 7f4bace00640 1 -- 172.21.15.12:0/1317614252 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ba8109140 msgr2=0x7f4ba8110cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:56.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.396+0000 7f4bace00640 1 --2- 172.21.15.12:0/1317614252 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ba8109140 0x7f4ba8110cc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009860 tx=0x7f4ba002a340 comp rx=0 tx=0).stop 2024-09-05T01:35:56.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.396+0000 7f4bace00640 1 -- 172.21.15.12:0/1317614252 shutdown_connections 2024-09-05T01:35:56.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.396+0000 7f4bace00640 1 --2- 172.21.15.12:0/1317614252 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ba8109140 0x7f4ba8110cc0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.396+0000 7f4bace00640 1 --2- 172.21.15.12:0/1317614252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ba81049c0 0x7f4ba8108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.396+0000 7f4bace00640 1 --2- 172.21.15.12:0/1317614252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ba8104010 0x7f4ba81043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.396+0000 7f4bace00640 1 -- 172.21.15.12:0/1317614252 >> 172.21.15.12:0/1317614252 conn(0x7f4ba80ffa50 msgr2=0x7f4ba8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:56.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.397+0000 7f4bace00640 1 -- 172.21.15.12:0/1317614252 shutdown_connections 2024-09-05T01:35:56.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.397+0000 7f4bace00640 1 -- 172.21.15.12:0/1317614252 wait complete. 2024-09-05T01:35:56.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.397+0000 7f4bace00640 1 Processor -- start 2024-09-05T01:35:56.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.398+0000 7f4bace00640 1 -- start start 2024-09-05T01:35:56.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.398+0000 7f4bace00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ba8104010 0x7f4ba819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:56.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.398+0000 7f4bace00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ba81049c0 0x7f4ba819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:56.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.398+0000 7f4bace00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ba8109140 0x7f4ba819eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:56.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.398+0000 7f4bace00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba8114150 con 0x7f4ba8104010 2024-09-05T01:35:56.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.398+0000 7f4bace00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba8113fd0 con 0x7f4ba81049c0 2024-09-05T01:35:56.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.398+0000 7f4bace00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba81142d0 con 0x7f4ba8109140 2024-09-05T01:35:56.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.398+0000 7f4ba5e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ba8104010 0x7f4ba819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:56.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.398+0000 7f4ba5e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ba8104010 0x7f4ba819a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41566/0 (socket says 172.21.15.12:41566) 2024-09-05T01:35:56.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.398+0000 7f4ba5e00640 1 -- 172.21.15.12:0/261972502 learned_addr learned my addr 172.21.15.12:0/261972502 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:56.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.398+0000 7f4ba6800640 1 --2- 172.21.15.12:0/261972502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ba8109140 0x7f4ba819eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:56.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.399+0000 7f4b9d400640 1 --2- 172.21.15.12:0/261972502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ba81049c0 0x7f4ba819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:56.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.399+0000 7f4ba5e00640 1 -- 172.21.15.12:0/261972502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ba8109140 msgr2=0x7f4ba819eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:56.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.399+0000 7f4ba5e00640 1 --2- 172.21.15.12:0/261972502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ba8109140 0x7f4ba819eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.399+0000 7f4ba5e00640 1 -- 172.21.15.12:0/261972502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ba81049c0 msgr2=0x7f4ba819ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:56.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.399+0000 7f4ba5e00640 1 --2- 172.21.15.12:0/261972502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ba81049c0 0x7f4ba819ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.399+0000 7f4ba5e00640 1 -- 172.21.15.12:0/261972502 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba819f5c0 con 0x7f4ba8104010 2024-09-05T01:35:56.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.399+0000 7f4b9d400640 1 --2- 172.21.15.12:0/261972502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ba81049c0 0x7f4ba819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:35:56.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.399+0000 7f4ba6800640 1 --2- 172.21.15.12:0/261972502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ba8109140 0x7f4ba819eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:35:56.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.399+0000 7f4ba5e00640 1 --2- 172.21.15.12:0/261972502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ba8104010 0x7f4ba819a610 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4b9800efb0 tx=0x7f4b9800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.399+0000 7f4b9f400640 1 -- 172.21.15.12:0/261972502 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9801b070 con 0x7f4ba8104010 2024-09-05T01:35:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.399+0000 7f4b9f400640 1 -- 172.21.15.12:0/261972502 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b9800ba50 con 0x7f4ba8104010 2024-09-05T01:35:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.399+0000 7f4bace00640 1 -- 172.21.15.12:0/261972502 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba819f8b0 con 0x7f4ba8104010 2024-09-05T01:35:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.399+0000 7f4b9f400640 1 -- 172.21.15.12:0/261972502 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b98016c00 con 0x7f4ba8104010 2024-09-05T01:35:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.399+0000 7f4bace00640 1 -- 172.21.15.12:0/261972502 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba81a7190 con 0x7f4ba8104010 2024-09-05T01:35:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.404+0000 7f4baf83b740 1 Processor -- start 2024-09-05T01:35:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.404+0000 7f4b9f400640 1 -- 172.21.15.12:0/261972502 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f4b9801e070 con 0x7f4ba8104010 2024-09-05T01:35:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.404+0000 7f4baf83b740 1 -- start start 2024-09-05T01:35:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.405+0000 7f4baf83b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd44372c70 0x55fd44373050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.405+0000 7f4baf83b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fd44373590 0x55fd4437d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.405+0000 7f4baf83b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd4437de50 0x55fd44380240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.405+0000 7f4baf83b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fd442d93e0 con 0x55fd4437de50 2024-09-05T01:35:56.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.405+0000 7f4baf83b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55fd44280d80 con 0x55fd44373590 2024-09-05T01:35:56.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.405+0000 7f4baf83b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55fd442d53a0 con 0x55fd44372c70 2024-09-05T01:35:56.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.405+0000 7f4ba6800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd44372c70 0x55fd44373050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:56.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.405+0000 7f4ba6800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd44372c70 0x55fd44373050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:58000/0 (socket says 172.21.15.12:58000) 2024-09-05T01:35:56.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.405+0000 7f4ba6800640 1 -- 172.21.15.12:0/2992301547 learned_addr learned my addr 172.21.15.12:0/2992301547 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:56.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.405+0000 7f4b9d400640 1 --2- 172.21.15.12:0/2992301547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd4437de50 0x55fd44380240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:56.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.405+0000 7f4ba5e00640 1 --2- 172.21.15.12:0/2992301547 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fd44373590 0x55fd4437d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:56.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.406+0000 7f4ba6800640 1 -- 172.21.15.12:0/2992301547 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fd44373590 msgr2=0x55fd4437d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:56.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.406+0000 7f4ba6800640 1 --2- 172.21.15.12:0/2992301547 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fd44373590 0x55fd4437d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.406+0000 7f4ba6800640 1 -- 172.21.15.12:0/2992301547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd4437de50 msgr2=0x55fd44380240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:56.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.406+0000 7f4ba6800640 1 --2- 172.21.15.12:0/2992301547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd4437de50 0x55fd44380240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.406+0000 7f4b9f400640 1 --2- 172.21.15.12:0/261972502 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f4b8c0a2cf0 0x7f4b8c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:56.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.406+0000 7f4ba6800640 1 -- 172.21.15.12:0/2992301547 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd4429fae0 con 0x55fd44372c70 2024-09-05T01:35:56.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.406+0000 7f4b9f400640 1 -- 172.21.15.12:0/261972502 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8579+0+0 (secure 0 0 0) 0x7f4b980cf3f0 con 0x7f4ba8104010 2024-09-05T01:35:56.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.406+0000 7f4ba5e00640 1 --2- 172.21.15.12:0/261972502 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f4b8c0a2cf0 0x7f4b8c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:56.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.406+0000 7f4ba6800640 1 --2- 172.21.15.12:0/2992301547 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd44372c70 0x55fd44373050 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0031000 tx=0x7f4ba0009520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3d8fe23e6c95c9c server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:56.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.406+0000 7f4b97400640 1 -- 172.21.15.12:0/2992301547 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0041020 con 0x55fd44372c70 2024-09-05T01:35:56.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.407+0000 7f4b97400640 1 -- 172.21.15.12:0/2992301547 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ba0004240 con 0x55fd44372c70 2024-09-05T01:35:56.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.407+0000 7f4b97400640 1 -- 172.21.15.12:0/2992301547 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0037040 con 0x55fd44372c70 2024-09-05T01:35:56.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.407+0000 7f4baf83b740 1 -- 172.21.15.12:0/2992301547 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd44372c70 msgr2=0x55fd44373050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:56.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.407+0000 7f4ba5e00640 1 --2- 172.21.15.12:0/261972502 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f4b8c0a2cf0 0x7f4b8c0a51b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4b980ccbb0 tx=0x7f4b980d2f40 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:56.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.407+0000 7f4baf83b740 1 --2- 172.21.15.12:0/2992301547 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd44372c70 0x55fd44373050 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0031000 tx=0x7f4ba0009520 comp rx=0 tx=0).stop 2024-09-05T01:35:56.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.408+0000 7f4baf83b740 1 -- 172.21.15.12:0/2992301547 shutdown_connections 2024-09-05T01:35:56.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.408+0000 7f4baf83b740 1 --2- 172.21.15.12:0/2992301547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd4437de50 0x55fd44380240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.408+0000 7f4baf83b740 1 --2- 172.21.15.12:0/2992301547 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fd44373590 0x55fd4437d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.408+0000 7f4baf83b740 1 --2- 172.21.15.12:0/2992301547 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd44372c70 0x55fd44373050 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.408+0000 7f4baf83b740 1 -- 172.21.15.12:0/2992301547 >> 172.21.15.12:0/2992301547 conn(0x55fd4436f200 msgr2=0x55fd4436f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:56.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.408+0000 7f4baf83b740 1 -- 172.21.15.12:0/2992301547 shutdown_connections 2024-09-05T01:35:56.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.408+0000 7f4baf83b740 1 -- 172.21.15.12:0/2992301547 wait complete. 2024-09-05T01:35:56.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.408+0000 7f4baf83b740 1 -- start start 2024-09-05T01:35:56.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.409+0000 7f4baf83b740 1 Processor -- start 2024-09-05T01:35:56.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.409+0000 7f4baf83b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd44372c70 0x55fd4437ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:56.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.409+0000 7f4baf83b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd44373590 0x55fd4437b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:56.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.409+0000 7f4baf83b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fd4437de50 0x55fd4437b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:56.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.409+0000 7f4baf83b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fd44380a20 con 0x55fd44373590 2024-09-05T01:35:56.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.409+0000 7f4baf83b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55fd442940f0 con 0x55fd4437de50 2024-09-05T01:35:56.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.409+0000 7f4baf83b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55fd44380ba0 con 0x55fd44372c70 2024-09-05T01:35:56.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.409+0000 7f4baf83b740 10 client.0 _ll_register_callbacks cb 0x55fd4427bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:35:56.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.410+0000 7f4ba6800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd44372c70 0x55fd4437ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:56.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.410+0000 7f4ba6800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd44372c70 0x55fd4437ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:58006/0 (socket says 172.21.15.12:58006) 2024-09-05T01:35:56.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.410+0000 7f4ba6800640 1 -- 172.21.15.12:0/1032486062 learned_addr learned my addr 172.21.15.12:0/1032486062 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:56.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.410+0000 7f4b9d400640 1 --2- 172.21.15.12:0/1032486062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd44373590 0x55fd4437b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:56.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.410+0000 7f4ba6800640 1 --2- 172.21.15.12:0/1032486062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fd4437de50 0x55fd4437b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:56.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.410+0000 7f4ba6800640 1 -- 172.21.15.12:0/1032486062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fd4437de50 msgr2=0x55fd4437b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:56.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.410+0000 7f4ba6800640 1 --2- 172.21.15.12:0/1032486062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fd4437de50 0x55fd4437b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.410+0000 7f4ba6800640 1 -- 172.21.15.12:0/1032486062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd44373590 msgr2=0x55fd4437b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:56.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.410+0000 7f4ba6800640 1 --2- 172.21.15.12:0/1032486062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd44373590 0x55fd4437b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.410+0000 7f4ba6800640 1 -- 172.21.15.12:0/1032486062 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd4404a3c0 con 0x55fd44372c70 2024-09-05T01:35:56.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.410+0000 7f4b9d400640 1 --2- 172.21.15.12:0/1032486062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd44373590 0x55fd4437b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:35:56.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.410+0000 7f4ba6800640 1 --2- 172.21.15.12:0/1032486062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd44372c70 0x55fd4437ad40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009780 tx=0x7f4ba00038f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ccf253b73efed8e server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:56.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.410+0000 7f4b8be00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-09-05T01:35:56.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.411+0000 7f4b8be00640 1 -- 172.21.15.12:0/1032486062 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0037070 con 0x55fd44372c70 2024-09-05T01:35:56.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.411+0000 7f4b8be00640 1 -- 172.21.15.12:0/1032486062 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8579+0+0 (secure 0 0 0) 0x7f4ba00043f0 con 0x55fd44372c70 2024-09-05T01:35:56.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.411+0000 7f4baf83b740 1 -- 172.21.15.12:0/1032486062 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ba0004240 con 0x55fd44372c70 2024-09-05T01:35:56.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.411+0000 7f4b8be00640 1 -- 172.21.15.12:0/1032486062 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f4ba0057050 con 0x55fd44372c70 2024-09-05T01:35:56.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.411+0000 7f4baf83b740 10 client.26737 fetch_fsmap learned FSMap version 62 2024-09-05T01:35:56.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.411+0000 7f4baf83b740 1 -- 172.21.15.12:0/1032486062 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55fd44380a20 con 0x55fd44372c70 2024-09-05T01:35:56.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.411+0000 7f4b8be00640 1 -- 172.21.15.12:0/1032486062 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ba0004240 con 0x55fd44372c70 2024-09-05T01:35:56.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.412+0000 7f4b8be00640 1 -- 172.21.15.12:0/1032486062 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 62) ==== 8442+0+0 (secure 0 0 0) 0x7f4ba003da80 con 0x55fd44372c70 2024-09-05T01:35:56.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.412+0000 7f4baf83b740 10 client.26737 fetch_fsmap finished waiting for FSMap version 62 2024-09-05T01:35:56.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.412+0000 7f4baf83b740 10 client.26737 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T01:35:56.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.412+0000 7f4baf83b740 20 client.26737 populate_metadata read hostname 'smithi012' 2024-09-05T01:35:56.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.412+0000 7f4baf83b740 1 --2- 172.21.15.12:0/1032486062 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55fd4438dbe0 0x55fd4438ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:56.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.412+0000 7f4baf83b740 4 client.26737 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:35:56.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.412+0000 7f4baf83b740 1 -- 172.21.15.12:0/1032486062 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd442e6950 con 0x55fd4438dbe0 2024-09-05T01:35:56.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.412+0000 7f4b9d400640 1 --2- 172.21.15.12:0/1032486062 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55fd4438dbe0 0x55fd4438ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:56.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.413+0000 7f4b8be00640 10 client.26737 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:35:56.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.413+0000 7f4b9d400640 1 --2- 172.21.15.12:0/1032486062 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55fd4438dbe0 0x55fd4438ffd0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7e492aae71ff6bb9 server_cookie=cc03c545e70d39fe in_seq=0 out_seq=0 2024-09-05T01:35:56.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.413+0000 7f4b8be00640 1 -- 172.21.15.12:0/1032486062 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fd442e6950 con 0x55fd4438dbe0 2024-09-05T01:35:56.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.414+0000 7f4b8be00640 10 client.26737 handle_command_reply: tid=0 2024-09-05T01:35:56.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.414+0000 7f4baf83b740 1 client.26737 shutdown 2024-09-05T01:35:56.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.414+0000 7f4baf83b740 1 -- 172.21.15.12:0/1032486062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd44372c70 msgr2=0x55fd4437ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:56.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.414+0000 7f4baf83b740 1 --2- 172.21.15.12:0/1032486062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd44372c70 0x55fd4437ad40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009780 tx=0x7f4ba00038f0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.414+0000 7f4baf83b740 1 -- 172.21.15.12:0/1032486062 shutdown_connections 2024-09-05T01:35:56.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.414+0000 7f4baf83b740 1 --2- 172.21.15.12:0/1032486062 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fd4437de50 0x55fd4437b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.414+0000 7f4baf83b740 1 --2- 172.21.15.12:0/1032486062 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55fd4438dbe0 0x55fd4438ffd0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.414+0000 7f4baf83b740 1 --2- 172.21.15.12:0/1032486062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd44373590 0x55fd4437b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.414+0000 7f4baf83b740 1 --2- 172.21.15.12:0/1032486062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd44372c70 0x55fd4437ad40 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.414+0000 7f4baf83b740 1 -- 172.21.15.12:0/1032486062 >> 172.21.15.12:0/1032486062 conn(0x55fd4436f200 msgr2=0x55fd44374ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:56.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.414+0000 7f4b8be00640 0 client.26737 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:35:56.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.414+0000 7f4baf83b740 1 -- 172.21.15.12:0/1032486062 shutdown_connections 2024-09-05T01:35:56.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.414+0000 7f4baf83b740 1 -- 172.21.15.12:0/1032486062 wait complete. 2024-09-05T01:35:56.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.414+0000 7f4baf83b740 20 client.26737 trim_cache size 0 max 16384 2024-09-05T01:35:56.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.428+0000 7f4baf83b740 1 Processor -- start 2024-09-05T01:35:56.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.428+0000 7f4baf83b740 1 -- start start 2024-09-05T01:35:56.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.428+0000 7f4baf83b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd44372c70 0x55fd443957b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:56.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.428+0000 7f4baf83b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd44373590 0x55fd44395cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:56.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.428+0000 7f4baf83b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fd4437de50 0x55fd44378020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:56.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.428+0000 7f4baf83b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba81afb20 con 0x55fd44372c70 2024-09-05T01:35:56.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.428+0000 7f4baf83b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba81b18a0 con 0x55fd4437de50 2024-09-05T01:35:56.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.428+0000 7f4baf83b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba81b01f0 con 0x55fd44373590 2024-09-05T01:35:56.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.429+0000 7f4ba6800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd44372c70 0x55fd443957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:56.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.429+0000 7f4ba6800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd44372c70 0x55fd443957b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41604/0 (socket says 172.21.15.12:41604) 2024-09-05T01:35:56.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.429+0000 7f4ba6800640 1 -- 172.21.15.12:0/489051840 learned_addr learned my addr 172.21.15.12:0/489051840 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:56.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.429+0000 7f4b9d400640 1 --2- 172.21.15.12:0/489051840 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd44373590 0x55fd44395cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:56.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.429+0000 7f4ba6800640 1 --2- 172.21.15.12:0/489051840 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fd4437de50 0x55fd44378020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:56.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.429+0000 7f4ba6800640 1 -- 172.21.15.12:0/489051840 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd44373590 msgr2=0x55fd44395cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:56.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.429+0000 7f4ba6800640 1 --2- 172.21.15.12:0/489051840 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd44373590 0x55fd44395cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.429+0000 7f4ba6800640 1 -- 172.21.15.12:0/489051840 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fd4437de50 msgr2=0x55fd44378020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:56.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.429+0000 7f4ba6800640 1 --2- 172.21.15.12:0/489051840 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fd4437de50 0x55fd44378020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.429+0000 7f4ba6800640 1 -- 172.21.15.12:0/489051840 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd443733c0 con 0x55fd44372c70 2024-09-05T01:35:56.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.429+0000 7f4b9d400640 1 --2- 172.21.15.12:0/489051840 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd44373590 0x55fd44395cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:35:56.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.429+0000 7f4ba6800640 1 --2- 172.21.15.12:0/489051840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd44372c70 0x55fd443957b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4ba002ab30 tx=0x7f4ba002a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d3083f363c5e1d server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:56.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.429+0000 7f4b96a00640 1 -- 172.21.15.12:0/489051840 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0037070 con 0x55fd44372c70 2024-09-05T01:35:56.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.430+0000 7f4b96a00640 1 -- 172.21.15.12:0/489051840 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ba0032e10 con 0x55fd44372c70 2024-09-05T01:35:56.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.430+0000 7f4b96a00640 1 -- 172.21.15.12:0/489051840 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba0041040 con 0x55fd44372c70 2024-09-05T01:35:56.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.430+0000 7f4baf83b740 1 -- 172.21.15.12:0/489051840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd44372c70 msgr2=0x55fd443957b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:56.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.430+0000 7f4baf83b740 1 --2- 172.21.15.12:0/489051840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd44372c70 0x55fd443957b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4ba002ab30 tx=0x7f4ba002a340 comp rx=0 tx=0).stop 2024-09-05T01:35:56.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.430+0000 7f4baf83b740 1 -- 172.21.15.12:0/489051840 shutdown_connections 2024-09-05T01:35:56.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.430+0000 7f4baf83b740 1 --2- 172.21.15.12:0/489051840 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fd4437de50 0x55fd44378020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.430+0000 7f4baf83b740 1 --2- 172.21.15.12:0/489051840 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd44373590 0x55fd44395cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.430+0000 7f4baf83b740 1 --2- 172.21.15.12:0/489051840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd44372c70 0x55fd443957b0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.430+0000 7f4baf83b740 1 -- 172.21.15.12:0/489051840 >> 172.21.15.12:0/489051840 conn(0x55fd4436f200 msgr2=0x55fd4437cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:56.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.430+0000 7f4baf83b740 1 -- 172.21.15.12:0/489051840 shutdown_connections 2024-09-05T01:35:56.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.430+0000 7f4baf83b740 1 -- 172.21.15.12:0/489051840 wait complete. 2024-09-05T01:35:56.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.431+0000 7f4baf83b740 1 -- start start 2024-09-05T01:35:56.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.431+0000 7f4baf83b740 1 Processor -- start 2024-09-05T01:35:56.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.432+0000 7f4baf83b740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd44372c70 0x55fd443863b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:56.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.432+0000 7f4baf83b740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fd44373590 0x55fd44377930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:56.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.432+0000 7f4baf83b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd4437de50 0x55fd44377e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:56.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.432+0000 7f4baf83b740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba81b1110 con 0x55fd44372c70 2024-09-05T01:35:56.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.432+0000 7f4baf83b740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba81b0980 con 0x55fd44373590 2024-09-05T01:35:56.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.432+0000 7f4baf83b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba81adb20 con 0x55fd4437de50 2024-09-05T01:35:56.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.432+0000 7f4baf83b740 10 client.0 _ll_register_callbacks cb 0x7f4b90009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:35:56.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.432+0000 7f4ba6800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd44372c70 0x55fd443863b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:56.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.432+0000 7f4b9d400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fd44373590 0x55fd44377930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:56.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.432+0000 7f4b9d400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fd44373590 0x55fd44377930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:57686/0 (socket says 172.21.15.12:57686) 2024-09-05T01:35:56.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.432+0000 7f4b9d400640 1 -- 172.21.15.12:0/1335870551 learned_addr learned my addr 172.21.15.12:0/1335870551 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:56.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.432+0000 7f4ba6800640 1 --2- 172.21.15.12:0/1335870551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd4437de50 0x55fd44377e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:56.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.432+0000 7f4b9d400640 1 -- 172.21.15.12:0/1335870551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd4437de50 msgr2=0x55fd44377e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:56.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.432+0000 7f4b9d400640 1 --2- 172.21.15.12:0/1335870551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd4437de50 0x55fd44377e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.432+0000 7f4b9d400640 1 -- 172.21.15.12:0/1335870551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd44372c70 msgr2=0x55fd443863b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:56.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.432+0000 7f4b9d400640 1 --2- 172.21.15.12:0/1335870551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd44372c70 0x55fd443863b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.432+0000 7f4b9d400640 1 -- 172.21.15.12:0/1335870551 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd443784e0 con 0x55fd44373590 2024-09-05T01:35:56.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.433+0000 7f4b9d400640 1 --2- 172.21.15.12:0/1335870551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fd44373590 0x55fd44377930 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x55fd44370580 tx=0x7f4b900044d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dc8c1863711dfb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:56.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.433+0000 7f4b8be00640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:35:56.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.433+0000 7f4b8be00640 1 -- 172.21.15.12:0/1335870551 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90020420 con 0x55fd44373590 2024-09-05T01:35:56.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.433+0000 7f4baf83b740 1 -- 172.21.15.12:0/1335870551 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ba0032e10 con 0x55fd44373590 2024-09-05T01:35:56.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.433+0000 7f4b8be00640 1 -- 172.21.15.12:0/1335870551 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8579+0+0 (secure 0 0 0) 0x7f4b900205c0 con 0x55fd44373590 2024-09-05T01:35:56.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.433+0000 7f4b8be00640 1 -- 172.21.15.12:0/1335870551 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f4b900207c0 con 0x55fd44373590 2024-09-05T01:35:56.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.433+0000 7f4baf83b740 10 client.26753 fetch_fsmap learned FSMap version 62 2024-09-05T01:35:56.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.433+0000 7f4baf83b740 1 -- 172.21.15.12:0/1335870551 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55fd443f8680 con 0x55fd44373590 2024-09-05T01:35:56.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.434+0000 7f4b8be00640 1 -- 172.21.15.12:0/1335870551 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ba0032e10 con 0x55fd44373590 2024-09-05T01:35:56.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.434+0000 7f4b8be00640 1 -- 172.21.15.12:0/1335870551 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 62) ==== 8442+0+0 (secure 0 0 0) 0x7f4b90027030 con 0x55fd44373590 2024-09-05T01:35:56.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.434+0000 7f4baf83b740 10 client.26753 fetch_fsmap finished waiting for FSMap version 62 2024-09-05T01:35:56.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.434+0000 7f4baf83b740 10 client.26753 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-05T01:35:56.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.434+0000 7f4baf83b740 20 client.26753 populate_metadata read hostname 'smithi012' 2024-09-05T01:35:56.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.434+0000 7f4baf83b740 1 --2- 172.21.15.12:0/1335870551 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55fd443f8ea0 0x55fd443fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:56.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.434+0000 7f4baf83b740 4 client.26753 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:35:56.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.434+0000 7f4baf83b740 1 -- 172.21.15.12:0/1335870551 --> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fd442e0e60 con 0x55fd443f8ea0 2024-09-05T01:35:56.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.434+0000 7f4ba6800640 1 --2- 172.21.15.12:0/1335870551 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55fd443f8ea0 0x55fd443fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:56.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.435+0000 7f4ba6800640 1 --2- 172.21.15.12:0/1335870551 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55fd443f8ea0 0x55fd443fb2c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6c0e50bc8f758312 server_cookie=ba85356a14d97b27 in_seq=0 out_seq=0 2024-09-05T01:35:56.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.435+0000 7f4b8be00640 10 client.26753 ms_handle_connect on v2:172.21.15.151:6838/2331000490 2024-09-05T01:35:56.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.435+0000 7f4b8be00640 1 -- 172.21.15.12:0/1335870551 <== mds.1 v2:172.21.15.151:6838/2331000490 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fd442e0e60 con 0x55fd443f8ea0 2024-09-05T01:35:56.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.435+0000 7f4b8be00640 10 client.26753 handle_command_reply: tid=0 2024-09-05T01:35:56.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.435+0000 7f4baf83b740 1 client.26753 shutdown 2024-09-05T01:35:56.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.435+0000 7f4baf83b740 1 -- 172.21.15.12:0/1335870551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fd44373590 msgr2=0x55fd44377930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:56.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.435+0000 7f4baf83b740 1 --2- 172.21.15.12:0/1335870551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fd44373590 0x55fd44377930 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x55fd44370580 tx=0x7f4b900044d0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.435+0000 7f4baf83b740 1 -- 172.21.15.12:0/1335870551 shutdown_connections 2024-09-05T01:35:56.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.435+0000 7f4baf83b740 1 --2- 172.21.15.12:0/1335870551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fd4437de50 0x55fd44377e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.435+0000 7f4baf83b740 1 --2- 172.21.15.12:0/1335870551 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55fd44373590 0x55fd44377930 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.435+0000 7f4baf83b740 1 --2- 172.21.15.12:0/1335870551 >> [v2:172.21.15.151:6838/2331000490,v1:172.21.15.151:6839/2331000490] conn(0x55fd443f8ea0 0x55fd443fb2c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.435+0000 7f4baf83b740 1 --2- 172.21.15.12:0/1335870551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fd44372c70 0x55fd443863b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.435+0000 7f4b8be00640 0 client.26753 ms_handle_reset on v2:172.21.15.151:6838/2331000490 2024-09-05T01:35:56.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.435+0000 7f4baf83b740 1 -- 172.21.15.12:0/1335870551 >> 172.21.15.12:0/1335870551 conn(0x55fd4436f200 msgr2=0x55fd4437ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:56.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.435+0000 7f4baf83b740 1 -- 172.21.15.12:0/1335870551 shutdown_connections 2024-09-05T01:35:56.569 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:35:56.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.435+0000 7f4baf83b740 1 -- 172.21.15.12:0/1335870551 wait complete. 2024-09-05T01:35:56.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.435+0000 7f4baf83b740 20 client.26753 trim_cache size 0 max 16384 2024-09-05T01:35:56.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.436+0000 7f4bace00640 1 -- 172.21.15.12:0/261972502 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f4b8c0a2cf0 msgr2=0x7f4b8c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:56.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.436+0000 7f4bace00640 1 --2- 172.21.15.12:0/261972502 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f4b8c0a2cf0 0x7f4b8c0a51b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4b980ccbb0 tx=0x7f4b980d2f40 comp rx=0 tx=0).stop 2024-09-05T01:35:56.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.436+0000 7f4bace00640 1 -- 172.21.15.12:0/261972502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ba8104010 msgr2=0x7f4ba819a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:56.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.436+0000 7f4bace00640 1 --2- 172.21.15.12:0/261972502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ba8104010 0x7f4ba819a610 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4b9800efb0 tx=0x7f4b9800c800 comp rx=0 tx=0).stop 2024-09-05T01:35:56.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.436+0000 7f4bace00640 1 -- 172.21.15.12:0/261972502 shutdown_connections 2024-09-05T01:35:56.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.436+0000 7f4bace00640 1 --2- 172.21.15.12:0/261972502 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f4b8c0a2cf0 0x7f4b8c0a51b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.436+0000 7f4bace00640 1 --2- 172.21.15.12:0/261972502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ba8109140 0x7f4ba819eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.436+0000 7f4bace00640 1 --2- 172.21.15.12:0/261972502 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4ba81049c0 0x7f4ba819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.436+0000 7f4bace00640 1 --2- 172.21.15.12:0/261972502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ba8104010 0x7f4ba819a610 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:56.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.436+0000 7f4bace00640 1 -- 172.21.15.12:0/261972502 >> 172.21.15.12:0/261972502 conn(0x7f4ba80ffa50 msgr2=0x7f4ba8100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:56.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.436+0000 7f4bace00640 1 -- 172.21.15.12:0/261972502 shutdown_connections 2024-09-05T01:35:56.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:56.436+0000 7f4bace00640 1 -- 172.21.15.12:0/261972502 wait complete. 2024-09-05T01:35:57.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:57 smithi012 ceph-mon[29942]: pgmap v350: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 336 op/s 2024-09-05T01:35:57.387 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-05T01:35:57.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:57 smithi145 ceph-mon[34376]: pgmap v350: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 336 op/s 2024-09-05T01:35:57.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:57 smithi151 ceph-mon[35013]: pgmap v350: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 336 op/s 2024-09-05T01:35:57.847 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:35:58.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.590+0000 7f7f02a00640 1 -- 172.21.15.12:0/3450782249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7efc1049c0 msgr2=0x7f7efc108a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:58.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.590+0000 7f7f02a00640 1 --2- 172.21.15.12:0/3450782249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7efc1049c0 0x7f7efc108a10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009900 tx=0x7f7ee402a3f0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.590+0000 7f7f02a00640 1 -- 172.21.15.12:0/3450782249 shutdown_connections 2024-09-05T01:35:58.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.590+0000 7f7f02a00640 1 --2- 172.21.15.12:0/3450782249 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7efc109140 0x7f7efc110cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.590+0000 7f7f02a00640 1 --2- 172.21.15.12:0/3450782249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7efc1049c0 0x7f7efc108a10 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.590+0000 7f7f02a00640 1 --2- 172.21.15.12:0/3450782249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7efc104010 0x7f7efc1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.590+0000 7f7f02a00640 1 -- 172.21.15.12:0/3450782249 >> 172.21.15.12:0/3450782249 conn(0x7f7efc0ffa50 msgr2=0x7f7efc101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:58.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.591+0000 7f7f02a00640 1 -- 172.21.15.12:0/3450782249 shutdown_connections 2024-09-05T01:35:58.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.591+0000 7f7f02a00640 1 -- 172.21.15.12:0/3450782249 wait complete. 2024-09-05T01:35:58.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.591+0000 7f7f02a00640 1 Processor -- start 2024-09-05T01:35:58.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.592+0000 7f7f02a00640 1 -- start start 2024-09-05T01:35:58.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.592+0000 7f7f02a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7efc104010 0x7f7efc19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:58.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.592+0000 7f7f02a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7efc1049c0 0x7f7efc19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:58.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.592+0000 7f7f02a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7efc109140 0x7f7efc19ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:58.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.592+0000 7f7f02a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc114160 con 0x7f7efc109140 2024-09-05T01:35:58.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.592+0000 7f7f02a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc113fe0 con 0x7f7efc1049c0 2024-09-05T01:35:58.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.592+0000 7f7f02a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc1142e0 con 0x7f7efc104010 2024-09-05T01:35:58.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.592+0000 7f7ef3400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7efc1049c0 0x7f7efc19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:58.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.592+0000 7f7ef3400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7efc1049c0 0x7f7efc19aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:34092/0 (socket says 172.21.15.12:34092) 2024-09-05T01:35:58.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.593+0000 7f7ef3400640 1 -- 172.21.15.12:0/2224156973 learned_addr learned my addr 172.21.15.12:0/2224156973 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:58.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.593+0000 7f7f00a00640 1 --2- 172.21.15.12:0/2224156973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7efc109140 0x7f7efc19ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:58.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.593+0000 7f7efbe00640 1 --2- 172.21.15.12:0/2224156973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7efc104010 0x7f7efc19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:58.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.593+0000 7f7ef3400640 1 -- 172.21.15.12:0/2224156973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7efc104010 msgr2=0x7f7efc19a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:58.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.593+0000 7f7ef3400640 1 --2- 172.21.15.12:0/2224156973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7efc104010 0x7f7efc19a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.593+0000 7f7ef3400640 1 -- 172.21.15.12:0/2224156973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7efc109140 msgr2=0x7f7efc19ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:58.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.593+0000 7f7ef3400640 1 --2- 172.21.15.12:0/2224156973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7efc109140 0x7f7efc19ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.593+0000 7f7ef3400640 1 -- 172.21.15.12:0/2224156973 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7efc19f610 con 0x7f7efc1049c0 2024-09-05T01:35:58.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.593+0000 7f7ef3400640 1 --2- 172.21.15.12:0/2224156973 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7efc1049c0 0x7f7efc19aba0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4006010 tx=0x7f7ee4004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:58.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.594+0000 7f7ef9600640 1 -- 172.21.15.12:0/2224156973 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee403f030 con 0x7f7efc1049c0 2024-09-05T01:35:58.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.594+0000 7f7f02a00640 1 -- 172.21.15.12:0/2224156973 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7efc19f8a0 con 0x7f7efc1049c0 2024-09-05T01:35:58.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.594+0000 7f7ef9600640 1 -- 172.21.15.12:0/2224156973 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ee4004440 con 0x7f7efc1049c0 2024-09-05T01:35:58.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.594+0000 7f7ef9600640 1 -- 172.21.15.12:0/2224156973 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4035070 con 0x7f7efc1049c0 2024-09-05T01:35:58.597 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.594+0000 7f7f02a00640 1 -- 172.21.15.12:0/2224156973 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7efc1a71e0 con 0x7f7efc1049c0 2024-09-05T01:35:58.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.597+0000 7f7f05442740 1 Processor -- start 2024-09-05T01:35:58.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.597+0000 7f7f05442740 1 -- start start 2024-09-05T01:35:58.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.597+0000 7f7ef9600640 1 -- 172.21.15.12:0/2224156973 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f7ee4042030 con 0x7f7efc1049c0 2024-09-05T01:35:58.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.597+0000 7f7f05442740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f18b1afc70 0x55f18b1b0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:58.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.597+0000 7f7f05442740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f18b1b0590 0x55f18b1ba910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:58.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.597+0000 7f7f05442740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1bae50 0x55f18b1bd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:58.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.597+0000 7f7f05442740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f18b1163e0 con 0x55f18b1b0590 2024-09-05T01:35:58.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.597+0000 7f7f05442740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55f18b0bdd80 con 0x55f18b1bae50 2024-09-05T01:35:58.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.597+0000 7f7f05442740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f18b1123a0 con 0x55f18b1afc70 2024-09-05T01:35:58.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.598+0000 7f7f00a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f18b1afc70 0x55f18b1b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:58.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.598+0000 7f7ef3400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1bae50 0x55f18b1bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:58.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.598+0000 7f7efbe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f18b1b0590 0x55f18b1ba910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:58.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.598+0000 7f7f00a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f18b1afc70 0x55f18b1b0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:45708/0 (socket says 172.21.15.12:45708) 2024-09-05T01:35:58.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.598+0000 7f7f00a00640 1 -- 172.21.15.12:0/731034978 learned_addr learned my addr 172.21.15.12:0/731034978 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:58.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.598+0000 7f7f00a00640 1 -- 172.21.15.12:0/731034978 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1bae50 msgr2=0x55f18b1bd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:58.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.598+0000 7f7f00a00640 1 --2- 172.21.15.12:0/731034978 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1bae50 0x55f18b1bd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.598+0000 7f7f00a00640 1 -- 172.21.15.12:0/731034978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f18b1b0590 msgr2=0x55f18b1ba910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:58.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.598+0000 7f7f00a00640 1 --2- 172.21.15.12:0/731034978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f18b1b0590 0x55f18b1ba910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.598+0000 7f7f00a00640 1 -- 172.21.15.12:0/731034978 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f18b0dcae0 con 0x55f18b1afc70 2024-09-05T01:35:58.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.598+0000 7f7ef3400640 1 --2- 172.21.15.12:0/731034978 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1bae50 0x55f18b1bd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:35:58.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.598+0000 7f7efbe00640 1 --2- 172.21.15.12:0/731034978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f18b1b0590 0x55f18b1ba910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:35:58.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.599+0000 7f7f00a00640 1 --2- 172.21.15.12:0/731034978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f18b1afc70 0x55f18b1b0050 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009f50 tx=0x7f7ef40118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc7eb34f7264e5bb server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:58.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.599+0000 7f7ef9600640 1 --2- 172.21.15.12:0/2224156973 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7ee00a2d70 0x7f7ee00a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:58.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.599+0000 7f7ef1200640 1 -- 172.21.15.12:0/731034978 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4004d20 con 0x55f18b1afc70 2024-09-05T01:35:58.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.599+0000 7f7ef1200640 1 -- 172.21.15.12:0/731034978 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ef4004050 con 0x55f18b1afc70 2024-09-05T01:35:58.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.599+0000 7f7ef1200640 1 -- 172.21.15.12:0/731034978 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4005280 con 0x55f18b1afc70 2024-09-05T01:35:58.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.599+0000 7f7ef9600640 1 -- 172.21.15.12:0/2224156973 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8579+0+0 (secure 0 0 0) 0x7f7ee40ef7c0 con 0x7f7efc1049c0 2024-09-05T01:35:58.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.599+0000 7f7efbe00640 1 --2- 172.21.15.12:0/2224156973 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7ee00a2d70 0x7f7ee00a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:58.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.600+0000 7f7f05442740 1 -- 172.21.15.12:0/731034978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f18b1afc70 msgr2=0x55f18b1b0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:58.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.600+0000 7f7f05442740 1 --2- 172.21.15.12:0/731034978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f18b1afc70 0x55f18b1b0050 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009f50 tx=0x7f7ef40118d0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.600+0000 7f7efbe00640 1 --2- 172.21.15.12:0/2224156973 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7ee00a2d70 0x7f7ee00a5230 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55f18b1ad060 tx=0x7f7eec005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:58.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.600+0000 7f7f05442740 1 -- 172.21.15.12:0/731034978 shutdown_connections 2024-09-05T01:35:58.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.600+0000 7f7f05442740 1 --2- 172.21.15.12:0/731034978 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1bae50 0x55f18b1bd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.600+0000 7f7f05442740 1 --2- 172.21.15.12:0/731034978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f18b1b0590 0x55f18b1ba910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.600+0000 7f7f05442740 1 --2- 172.21.15.12:0/731034978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f18b1afc70 0x55f18b1b0050 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.600+0000 7f7f05442740 1 -- 172.21.15.12:0/731034978 >> 172.21.15.12:0/731034978 conn(0x55f18b1ac200 msgr2=0x55f18b1ac5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:58.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.600+0000 7f7f05442740 1 -- 172.21.15.12:0/731034978 shutdown_connections 2024-09-05T01:35:58.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.600+0000 7f7f05442740 1 -- 172.21.15.12:0/731034978 wait complete. 2024-09-05T01:35:58.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.601+0000 7f7f05442740 1 -- start start 2024-09-05T01:35:58.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.601+0000 7f7f05442740 1 Processor -- start 2024-09-05T01:35:58.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.602+0000 7f7f05442740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1afc70 0x55f18b1b7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:58.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.602+0000 7f7f05442740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f18b1b0590 0x55f18b1b8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:58.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.602+0000 7f7f05442740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f18b1bae50 0x55f18b1b8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:58.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.602+0000 7f7f05442740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f18b1bda20 con 0x55f18b1bae50 2024-09-05T01:35:58.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.602+0000 7f7f05442740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x55f18b0d10f0 con 0x55f18b1afc70 2024-09-05T01:35:58.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.602+0000 7f7f05442740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f18b1bdba0 con 0x55f18b1b0590 2024-09-05T01:35:58.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.602+0000 7f7f05442740 10 client.0 _ll_register_callbacks cb 0x55f18b0b8bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:35:58.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.602+0000 7f7efbe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1afc70 0x55f18b1b7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:58.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.602+0000 7f7efbe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1afc70 0x55f18b1b7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:34110/0 (socket says 172.21.15.12:34110) 2024-09-05T01:35:58.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.602+0000 7f7efbe00640 1 -- 172.21.15.12:0/3240669911 learned_addr learned my addr 172.21.15.12:0/3240669911 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:58.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.602+0000 7f7f00a00640 1 --2- 172.21.15.12:0/3240669911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f18b1bae50 0x55f18b1b8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:58.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.602+0000 7f7ef3400640 1 --2- 172.21.15.12:0/3240669911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f18b1b0590 0x55f18b1b8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:58.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.602+0000 7f7efbe00640 1 -- 172.21.15.12:0/3240669911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f18b1b0590 msgr2=0x55f18b1b8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:58.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.602+0000 7f7efbe00640 1 --2- 172.21.15.12:0/3240669911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f18b1b0590 0x55f18b1b8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.602+0000 7f7efbe00640 1 -- 172.21.15.12:0/3240669911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f18b1bae50 msgr2=0x55f18b1b8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:58.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.602+0000 7f7efbe00640 1 --2- 172.21.15.12:0/3240669911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f18b1bae50 0x55f18b1b8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.602+0000 7f7efbe00640 1 -- 172.21.15.12:0/3240669911 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f18ae873c0 con 0x55f18b1afc70 2024-09-05T01:35:58.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.603+0000 7f7efbe00640 1 --2- 172.21.15.12:0/3240669911 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1afc70 0x55f18b1b7cc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7eec005880 tx=0x7f7eec004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13d8b2499fdf7bc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:58.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.603+0000 7f7ee9600640 10 client.0 ms_handle_connect on v2:172.21.15.145:3300/0 2024-09-05T01:35:58.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.603+0000 7f7ee9600640 1 -- 172.21.15.12:0/3240669911 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec009be0 con 0x55f18b1afc70 2024-09-05T01:35:58.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.603+0000 7f7ee9600640 1 -- 172.21.15.12:0/3240669911 <== mon.2 v2:172.21.15.145:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8579+0+0 (secure 0 0 0) 0x7f7eec018030 con 0x55f18b1afc70 2024-09-05T01:35:58.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.603+0000 7f7f05442740 1 -- 172.21.15.12:0/3240669911 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ef4004050 con 0x55f18b1afc70 2024-09-05T01:35:58.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.603+0000 7f7ee9600640 1 -- 172.21.15.12:0/3240669911 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f7eec004020 con 0x55f18b1afc70 2024-09-05T01:35:58.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.603+0000 7f7f05442740 10 client.26765 fetch_fsmap learned FSMap version 62 2024-09-05T01:35:58.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.603+0000 7f7f05442740 1 -- 172.21.15.12:0/3240669911 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55f18b1c9a70 con 0x55f18b1afc70 2024-09-05T01:35:58.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.604+0000 7f7ee9600640 1 -- 172.21.15.12:0/3240669911 <== mon.2 v2:172.21.15.145:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ef4004050 con 0x55f18b1afc70 2024-09-05T01:35:58.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.604+0000 7f7ee9600640 1 -- 172.21.15.12:0/3240669911 <== mon.2 v2:172.21.15.145:3300/0 5 ==== fsmap(e 62) ==== 8442+0+0 (secure 0 0 0) 0x7f7eec029420 con 0x55f18b1afc70 2024-09-05T01:35:58.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.604+0000 7f7f05442740 10 client.26765 fetch_fsmap finished waiting for FSMap version 62 2024-09-05T01:35:58.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.604+0000 7f7f05442740 10 client.26765 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:35:58.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.604+0000 7f7f05442740 20 client.26765 populate_metadata read hostname 'smithi012' 2024-09-05T01:35:58.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.604+0000 7f7f05442740 1 --2- 172.21.15.12:0/3240669911 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f18b1cafd0 0x55f18b1cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:58.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.604+0000 7f7f05442740 4 client.26765 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-05T01:35:58.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.604+0000 7f7f05442740 1 -- 172.21.15.12:0/3240669911 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f18b123950 con 0x55f18b1cafd0 2024-09-05T01:35:58.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.604+0000 7f7ef3400640 1 --2- 172.21.15.12:0/3240669911 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f18b1cafd0 0x55f18b1cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:58.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.605+0000 7f7ef3400640 1 --2- 172.21.15.12:0/3240669911 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f18b1cafd0 0x55f18b1cd410 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=906997a9c72434d1 server_cookie=a47940b9172e1660 in_seq=0 out_seq=0 2024-09-05T01:35:58.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.605+0000 7f7ee9600640 10 client.26765 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:35:58.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.606+0000 7f7ee9600640 1 -- 172.21.15.12:0/3240669911 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f18b123950 con 0x55f18b1cafd0 2024-09-05T01:35:58.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.606+0000 7f7ee9600640 10 client.26765 handle_command_reply: tid=0 2024-09-05T01:35:58.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.606+0000 7f7f05442740 1 client.26765 shutdown 2024-09-05T01:35:58.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.606+0000 7f7f05442740 1 -- 172.21.15.12:0/3240669911 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1afc70 msgr2=0x55f18b1b7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:58.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.606+0000 7f7f05442740 1 --2- 172.21.15.12:0/3240669911 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1afc70 0x55f18b1b7cc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7eec005880 tx=0x7f7eec004730 comp rx=0 tx=0).stop 2024-09-05T01:35:58.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.606+0000 7f7f05442740 1 -- 172.21.15.12:0/3240669911 shutdown_connections 2024-09-05T01:35:58.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.606+0000 7f7f05442740 1 --2- 172.21.15.12:0/3240669911 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f18b1cafd0 0x55f18b1cd410 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.606+0000 7f7f05442740 1 --2- 172.21.15.12:0/3240669911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f18b1bae50 0x55f18b1b8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.606+0000 7f7f05442740 1 --2- 172.21.15.12:0/3240669911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f18b1b0590 0x55f18b1b8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.606+0000 7f7f05442740 1 --2- 172.21.15.12:0/3240669911 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1afc70 0x55f18b1b7cc0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.606+0000 7f7ee9600640 0 client.26765 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:35:58.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.606+0000 7f7f05442740 1 -- 172.21.15.12:0/3240669911 >> 172.21.15.12:0/3240669911 conn(0x55f18b1ac200 msgr2=0x55f18b1ab380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:58.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.606+0000 7f7f05442740 1 -- 172.21.15.12:0/3240669911 shutdown_connections 2024-09-05T01:35:58.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.606+0000 7f7f05442740 1 -- 172.21.15.12:0/3240669911 wait complete. 2024-09-05T01:35:58.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.607+0000 7f7f05442740 20 client.26765 trim_cache size 0 max 16384 2024-09-05T01:35:58.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.622+0000 7f7f05442740 1 Processor -- start 2024-09-05T01:35:58.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.622+0000 7f7f05442740 1 -- start start 2024-09-05T01:35:58.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.622+0000 7f7f05442740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1afc70 0x55f18b1d2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:58.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.622+0000 7f7f05442740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f18b1b0590 0x55f18b1d3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:58.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.622+0000 7f7f05442740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f18b1bae50 0x55f18b1b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:58.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.622+0000 7f7f05442740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc1afbd0 con 0x55f18b1b0590 2024-09-05T01:35:58.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.622+0000 7f7f05442740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc1b1950 con 0x55f18b1afc70 2024-09-05T01:35:58.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.622+0000 7f7f05442740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc1b02a0 con 0x55f18b1bae50 2024-09-05T01:35:58.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.622+0000 7f7efbe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1afc70 0x55f18b1d2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:58.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.622+0000 7f7f00a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f18b1bae50 0x55f18b1b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:58.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.622+0000 7f7ef3400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f18b1b0590 0x55f18b1d3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:58.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.622+0000 7f7efbe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1afc70 0x55f18b1d2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:34116/0 (socket says 172.21.15.12:34116) 2024-09-05T01:35:58.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.622+0000 7f7efbe00640 1 -- 172.21.15.12:0/4069105326 learned_addr learned my addr 172.21.15.12:0/4069105326 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:58.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.622+0000 7f7f00a00640 1 --2- 172.21.15.12:0/4069105326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f18b1bae50 0x55f18b1b4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:45728/0 (socket says 172.21.15.12:45728) 2024-09-05T01:35:58.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.623+0000 7f7efbe00640 1 -- 172.21.15.12:0/4069105326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f18b1bae50 msgr2=0x55f18b1b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:58.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.623+0000 7f7efbe00640 1 --2- 172.21.15.12:0/4069105326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f18b1bae50 0x55f18b1b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.623+0000 7f7efbe00640 1 -- 172.21.15.12:0/4069105326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f18b1b0590 msgr2=0x55f18b1d3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:58.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.623+0000 7f7efbe00640 1 --2- 172.21.15.12:0/4069105326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f18b1b0590 0x55f18b1d3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.623+0000 7f7efbe00640 1 -- 172.21.15.12:0/4069105326 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f18b1abca0 con 0x55f18b1afc70 2024-09-05T01:35:58.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.623+0000 7f7efbe00640 1 --2- 172.21.15.12:0/4069105326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1afc70 0x55f18b1d2ce0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7eec019040 tx=0x7f7eec009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4f09a69ec94ae06 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:58.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.623+0000 7f7eebe00640 1 -- 172.21.15.12:0/4069105326 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec029c40 con 0x55f18b1afc70 2024-09-05T01:35:58.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.623+0000 7f7eebe00640 1 -- 172.21.15.12:0/4069105326 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7eec029420 con 0x55f18b1afc70 2024-09-05T01:35:58.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.623+0000 7f7eebe00640 1 -- 172.21.15.12:0/4069105326 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec003c70 con 0x55f18b1afc70 2024-09-05T01:35:58.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.624+0000 7f7f05442740 1 -- 172.21.15.12:0/4069105326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1afc70 msgr2=0x55f18b1d2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:58.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.624+0000 7f7f05442740 1 --2- 172.21.15.12:0/4069105326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1afc70 0x55f18b1d2ce0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7eec019040 tx=0x7f7eec009c60 comp rx=0 tx=0).stop 2024-09-05T01:35:58.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.624+0000 7f7f05442740 1 -- 172.21.15.12:0/4069105326 shutdown_connections 2024-09-05T01:35:58.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.624+0000 7f7f05442740 1 --2- 172.21.15.12:0/4069105326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f18b1bae50 0x55f18b1b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.624+0000 7f7f05442740 1 --2- 172.21.15.12:0/4069105326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f18b1b0590 0x55f18b1d3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.624+0000 7f7f05442740 1 --2- 172.21.15.12:0/4069105326 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1afc70 0x55f18b1d2ce0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.624+0000 7f7f05442740 1 -- 172.21.15.12:0/4069105326 >> 172.21.15.12:0/4069105326 conn(0x55f18b1ac200 msgr2=0x55f18b1b1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:58.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.624+0000 7f7f05442740 1 -- 172.21.15.12:0/4069105326 shutdown_connections 2024-09-05T01:35:58.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.624+0000 7f7f05442740 1 -- 172.21.15.12:0/4069105326 wait complete. 2024-09-05T01:35:58.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.624+0000 7f7f05442740 1 -- start start 2024-09-05T01:35:58.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.625+0000 7f7f05442740 1 Processor -- start 2024-09-05T01:35:58.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.625+0000 7f7f05442740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f18b1afc70 0x55f18b1bed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:58.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.625+0000 7f7f05442740 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1b0590 0x55f18b1bf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:58.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.625+0000 7f7f05442740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f18b1bae50 0x55f18b1bf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:58.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.625+0000 7f7f05442740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc1b11c0 con 0x55f18b1afc70 2024-09-05T01:35:58.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.625+0000 7f7f05442740 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc1b0a30 con 0x55f18b1b0590 2024-09-05T01:35:58.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.625+0000 7f7f05442740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc1adbd0 con 0x55f18b1bae50 2024-09-05T01:35:58.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.625+0000 7f7f05442740 10 client.0 _ll_register_callbacks cb 0x7f7eec009660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-05T01:35:58.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.625+0000 7f7efbe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f18b1afc70 0x55f18b1bed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:58.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.625+0000 7f7efbe00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f18b1afc70 0x55f18b1bed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41772/0 (socket says 172.21.15.12:41772) 2024-09-05T01:35:58.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.625+0000 7f7ef3400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1b0590 0x55f18b1bf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:58.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.625+0000 7f7efbe00640 1 -- 172.21.15.12:0/3406117750 learned_addr learned my addr 172.21.15.12:0/3406117750 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:35:58.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.626+0000 7f7efbe00640 1 -- 172.21.15.12:0/3406117750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f18b1bae50 msgr2=0x55f18b1bf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:58.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.626+0000 7f7efbe00640 1 --2- 172.21.15.12:0/3406117750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f18b1bae50 0x55f18b1bf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.626+0000 7f7efbe00640 1 -- 172.21.15.12:0/3406117750 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1b0590 msgr2=0x55f18b1bf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-05T01:35:58.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.626+0000 7f7efbe00640 1 --2- 172.21.15.12:0/3406117750 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1b0590 0x55f18b1bf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.626+0000 7f7efbe00640 1 -- 172.21.15.12:0/3406117750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f18b234eb0 con 0x55f18b1afc70 2024-09-05T01:35:58.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.626+0000 7f7ef3400640 1 --2- 172.21.15.12:0/3406117750 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1b0590 0x55f18b1bf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-05T01:35:58.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.626+0000 7f7efbe00640 1 --2- 172.21.15.12:0/3406117750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f18b1afc70 0x55f18b1bed80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7eec012cb0 tx=0x7f7eec01e840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ba59d203d5bad3 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:35:58.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.626+0000 7f7ee9600640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-09-05T01:35:58.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.626+0000 7f7ee9600640 1 -- 172.21.15.12:0/3406117750 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec040070 con 0x55f18b1afc70 2024-09-05T01:35:58.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.626+0000 7f7f05442740 1 -- 172.21.15.12:0/3406117750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7eec029420 con 0x55f18b1afc70 2024-09-05T01:35:58.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.626+0000 7f7ee9600640 1 -- 172.21.15.12:0/3406117750 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8579+0+0 (secure 0 0 0) 0x7f7eec0039f0 con 0x55f18b1afc70 2024-09-05T01:35:58.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.627+0000 7f7ee9600640 1 -- 172.21.15.12:0/3406117750 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f7eec003bf0 con 0x55f18b1afc70 2024-09-05T01:35:58.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.627+0000 7f7f05442740 10 client.16701 fetch_fsmap learned FSMap version 62 2024-09-05T01:35:58.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.627+0000 7f7f05442740 1 -- 172.21.15.12:0/3406117750 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55f18b236190 con 0x55f18b1afc70 2024-09-05T01:35:58.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.627+0000 7f7ee9600640 1 -- 172.21.15.12:0/3406117750 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7eec029420 con 0x55f18b1afc70 2024-09-05T01:35:58.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.627+0000 7f7ee9600640 1 -- 172.21.15.12:0/3406117750 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 62) ==== 8442+0+0 (secure 0 0 0) 0x7f7eec04a030 con 0x55f18b1afc70 2024-09-05T01:35:58.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.628+0000 7f7f05442740 10 client.16701 fetch_fsmap finished waiting for FSMap version 62 2024-09-05T01:35:58.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.628+0000 7f7f05442740 10 client.16701 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-05T01:35:58.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.628+0000 7f7f05442740 20 client.16701 populate_metadata read hostname 'smithi012' 2024-09-05T01:35:58.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.628+0000 7f7f05442740 1 --2- 172.21.15.12:0/3406117750 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f18b236840 0x55f18b238c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:35:58.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.628+0000 7f7f05442740 4 client.16701 mds_command: new command op to 24560 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-05T01:35:58.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.628+0000 7f7f05442740 1 -- 172.21.15.12:0/3406117750 --> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f18b11de60 con 0x55f18b236840 2024-09-05T01:35:58.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.628+0000 7f7ef3400640 1 --2- 172.21.15.12:0/3406117750 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f18b236840 0x55f18b238c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:35:58.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.629+0000 7f7ef3400640 1 --2- 172.21.15.12:0/3406117750 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f18b236840 0x55f18b238c70 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ec28c55120dc96d server_cookie=45a8d0358558de04 in_seq=0 out_seq=0 2024-09-05T01:35:58.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.629+0000 7f7ee9600640 10 client.16701 ms_handle_connect on v2:172.21.15.145:6838/1706431882 2024-09-05T01:35:58.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.629+0000 7f7ee9600640 1 -- 172.21.15.12:0/3406117750 <== mds.0 v2:172.21.15.145:6838/1706431882 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f18b11de60 con 0x55f18b236840 2024-09-05T01:35:58.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.629+0000 7f7ee9600640 10 client.16701 handle_command_reply: tid=0 2024-09-05T01:35:58.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.629+0000 7f7f05442740 1 client.16701 shutdown 2024-09-05T01:35:58.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.629+0000 7f7f05442740 1 -- 172.21.15.12:0/3406117750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f18b1afc70 msgr2=0x55f18b1bed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:58.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.629+0000 7f7f05442740 1 --2- 172.21.15.12:0/3406117750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f18b1afc70 0x55f18b1bed80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7eec012cb0 tx=0x7f7eec01e840 comp rx=0 tx=0).stop 2024-09-05T01:35:58.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.630+0000 7f7f05442740 1 -- 172.21.15.12:0/3406117750 shutdown_connections 2024-09-05T01:35:58.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.630+0000 7f7f05442740 1 --2- 172.21.15.12:0/3406117750 >> [v2:172.21.15.145:6838/1706431882,v1:172.21.15.145:6839/1706431882] conn(0x55f18b236840 0x55f18b238c70 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.630+0000 7f7f05442740 1 --2- 172.21.15.12:0/3406117750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f18b1bae50 0x55f18b1bf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.630+0000 7f7f05442740 1 --2- 172.21.15.12:0/3406117750 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x55f18b1b0590 0x55f18b1bf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.630+0000 7f7ee9600640 0 client.16701 ms_handle_reset on v2:172.21.15.145:6838/1706431882 2024-09-05T01:35:58.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.630+0000 7f7f05442740 1 --2- 172.21.15.12:0/3406117750 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f18b1afc70 0x55f18b1bed80 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.630+0000 7f7f05442740 1 -- 172.21.15.12:0/3406117750 >> 172.21.15.12:0/3406117750 conn(0x55f18b1ac200 msgr2=0x55f18b1b1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:58.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.630+0000 7f7f05442740 1 -- 172.21.15.12:0/3406117750 shutdown_connections 2024-09-05T01:35:58.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.630+0000 7f7f05442740 1 -- 172.21.15.12:0/3406117750 wait complete. 2024-09-05T01:35:58.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.630+0000 7f7f05442740 20 client.16701 trim_cache size 0 max 16384 2024-09-05T01:35:58.634 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2024-09-05T01:35:58.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.631+0000 7f7f02a00640 1 -- 172.21.15.12:0/2224156973 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7ee00a2d70 msgr2=0x7f7ee00a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:58.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.631+0000 7f7f02a00640 1 --2- 172.21.15.12:0/2224156973 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7ee00a2d70 0x7f7ee00a5230 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55f18b1ad060 tx=0x7f7eec005f90 comp rx=0 tx=0).stop 2024-09-05T01:35:58.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.631+0000 7f7f02a00640 1 -- 172.21.15.12:0/2224156973 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7efc1049c0 msgr2=0x7f7efc19aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:35:58.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.631+0000 7f7f02a00640 1 --2- 172.21.15.12:0/2224156973 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7efc1049c0 0x7f7efc19aba0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4006010 tx=0x7f7ee4004040 comp rx=0 tx=0).stop 2024-09-05T01:35:58.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.631+0000 7f7f02a00640 1 -- 172.21.15.12:0/2224156973 shutdown_connections 2024-09-05T01:35:58.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.631+0000 7f7f02a00640 1 --2- 172.21.15.12:0/2224156973 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f7ee00a2d70 0x7f7ee00a5230 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.631+0000 7f7f02a00640 1 --2- 172.21.15.12:0/2224156973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7efc109140 0x7f7efc19ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.631+0000 7f7f02a00640 1 --2- 172.21.15.12:0/2224156973 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f7efc1049c0 0x7f7efc19aba0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.631+0000 7f7f02a00640 1 --2- 172.21.15.12:0/2224156973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7efc104010 0x7f7efc19a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:35:58.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.631+0000 7f7f02a00640 1 -- 172.21.15.12:0/2224156973 >> 172.21.15.12:0/2224156973 conn(0x7f7efc0ffa50 msgr2=0x7f7efc100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:35:58.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.631+0000 7f7f02a00640 1 -- 172.21.15.12:0/2224156973 shutdown_connections 2024-09-05T01:35:58.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:35:58.631+0000 7f7f02a00640 1 -- 172.21.15.12:0/2224156973 wait complete. 2024-09-05T01:35:59.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:35:59 smithi012 ceph-mon[29942]: pgmap v351: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 354 op/s 2024-09-05T01:35:59.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:35:59 smithi145 ceph-mon[34376]: pgmap v351: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 354 op/s 2024-09-05T01:35:59.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:35:59 smithi151 ceph-mon[35013]: pgmap v351: 97 pgs: 97 active+clean; 3.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 354 op/s 2024-09-05T01:35:59.714 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 3705631, 'ino': 1099511643266, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 44795501, 'ino': 1099511643231, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 46616242, 'ino': 1099511643233, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 46797308, 'ino': 1099511643138, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 50522209, 'ino': 1099511643224, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 53465077, 'ino': 1099511645405, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 53952416, 'ino': 1099511642533, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 54430217, 'ino': 1099511642566, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 55620739, 'ino': 1099511642430, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-11.xml'}, {'damage_type': 'backtrace', 'id': 68937294, 'ino': 1099511643171, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-24.xml'}, {'damage_type': 'backtrace', 'id': 72903412, 'ino': 1099511634525, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-63.xml'}, {'damage_type': 'backtrace', 'id': 76748340, 'ino': 1099511643329, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 83349398, 'ino': 1099511645408, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 96145705, 'ino': 1099511642444, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-2.xml'}, {'damage_type': 'backtrace', 'id': 98241088, 'ino': 1099511643097, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-5.xml'}, {'damage_type': 'backtrace', 'id': 100596892, 'ino': 1099511644958, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-20.xml'}, {'damage_type': 'backtrace', 'id': 115612977, 'ino': 1099511643159, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 129446171, 'ino': 1099511639282, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 139834395, 'ino': 1099511643334, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 147790518, 'ino': 1099511643073, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-29.xml'}, {'damage_type': 'backtrace', 'id': 169741288, 'ino': 1099511644922, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 169764931, 'ino': 1099511644934, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 179965584, 'ino': 1099511644933, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 197393267, 'ino': 1099511645894, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 223130593, 'ino': 1099511644953, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-25.xml'}, {'damage_type': 'backtrace', 'id': 231808305, 'ino': 1099511643328, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 245857096, 'ino': 1099511642420, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-16.xml'}, {'damage_type': 'backtrace', 'id': 246017044, 'ino': 1099511643208, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 246825737, 'ino': 1099511643137, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 271093013, 'ino': 1099511645422, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 277210305, 'ino': 1099511643238, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 282931385, 'ino': 1099511639309, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 287339330, 'ino': 1099511643211, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 287528581, 'ino': 1099511645746, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-31.xml'}, {'damage_type': 'backtrace', 'id': 291422525, 'ino': 1099511643102, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 300527867, 'ino': 1099511643262, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 303455109, 'ino': 1099511645784, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 304757829, 'ino': 1099511645401, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 315488910, 'ino': 1099511642523, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 318858066, 'ino': 1099511639303, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 325987793, 'ino': 1099511642541, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 329127596, 'ino': 1099511645779, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 333218878, 'ino': 1099511643153, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-32.xml'}, {'damage_type': 'backtrace', 'id': 333573372, 'ino': 1099511643198, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-70.jpg'}, {'damage_type': 'backtrace', 'id': 340238015, 'ino': 1099511642448, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-76.jpg'}, {'damage_type': 'backtrace', 'id': 359813749, 'ino': 1099511643207, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 361046240, 'ino': 1099511643324, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 366439638, 'ino': 1099511643099, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-3.xml'}, {'damage_type': 'backtrace', 'id': 374034466, 'ino': 1099511645402, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 378796278, 'ino': 1099511634644, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-23.xml'}, {'damage_type': 'backtrace', 'id': 382084177, 'ino': 1099511645002, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 385795723, 'ino': 1099511643105, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 391604634, 'ino': 1099511643066, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-36.xml'}, {'damage_type': 'backtrace', 'id': 394360384, 'ino': 1099511645749, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-28.xml'}, {'damage_type': 'backtrace', 'id': 416180532, 'ino': 1099511643117, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 416725241, 'ino': 1099511643338, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 421039238, 'ino': 1099511645893, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 421221564, 'ino': 1099511643196, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-72.jpg'}, {'damage_type': 'backtrace', 'id': 428130248, 'ino': 1099511645446, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 440277329, 'ino': 1099511643114, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 445825404, 'ino': 1099511639316, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 466399938, 'ino': 1099511642551, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 466581276, 'ino': 1099511645382, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-6.xml'}, {'damage_type': 'backtrace', 'id': 471462720, 'ino': 1099511645724, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-53.xml'}, {'damage_type': 'backtrace', 'id': 477229173, 'ino': 1099511644951, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-27.xml'}, {'damage_type': 'backtrace', 'id': 490170566, 'ino': 1099511645744, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-33.xml'}, {'damage_type': 'backtrace', 'id': 503251657, 'ino': 1099511645776, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-3.xml'}, {'damage_type': 'backtrace', 'id': 503560737, 'ino': 1099511642484, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 522249158, 'ino': 1099511642572, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 523203650, 'ino': 1099511639322, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 526759248, 'ino': 1099511643162, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 526854189, 'ino': 1099511645781, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 529899080, 'ino': 1099511643058, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-44.xml'}, {'damage_type': 'backtrace', 'id': 530164471, 'ino': 1099511644972, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-6.xml'}, {'damage_type': 'backtrace', 'id': 531299158, 'ino': 1099511642442, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-3.xml'}, {'damage_type': 'backtrace', 'id': 534855357, 'ino': 1099511645386, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-2.xml'}, {'damage_type': 'backtrace', 'id': 537538936, 'ino': 1099511643252, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 547883740, 'ino': 1099511639306, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 551091996, 'ino': 1099511643141, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 559993032, 'ino': 1099511636797, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-36.xml'}, {'damage_type': 'backtrace', 'id': 576264899, 'ino': 1099511643089, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-13.xml'}, {'damage_type': 'backtrace', 'id': 580138181, 'ino': 1099511645424, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 583717103, 'ino': 1099511642446, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-1.xml'}, {'damage_type': 'backtrace', 'id': 597679101, 'ino': 1099511643255, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 610481446, 'ino': 1099511644998, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 618047023, 'ino': 1099511645392, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 629768233, 'ino': 1099511645726, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-51.xml'}, {'damage_type': 'backtrace', 'id': 631252146, 'ino': 1099511645391, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 635231524, 'ino': 1099511643091, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-11.xml'}, {'damage_type': 'backtrace', 'id': 639769150, 'ino': 1099511642438, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-6.xml'}, {'damage_type': 'backtrace', 'id': 640973948, 'ino': 1099511643081, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-21.xml'}, {'damage_type': 'backtrace', 'id': 644223014, 'ino': 1099511645895, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 659585596, 'ino': 1099511644959, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-19.xml'}, {'damage_type': 'backtrace', 'id': 664033468, 'ino': 1099511642418, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-17.xml'}, {'damage_type': 'backtrace', 'id': 688323206, 'ino': 1099511638283, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/comment-65.xml'}, {'damage_type': 'backtrace', 'id': 690807005, 'ino': 1099511645872, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 693214415, 'ino': 1099511644981, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 697904967, 'ino': 1099511645414, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 701698504, 'ino': 1099511642530, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 708125913, 'ino': 1099511642546, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 709835429, 'ino': 1099511643096, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-6.xml'}, {'damage_type': 'backtrace', 'id': 713811930, 'ino': 1099511645722, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-55.xml'}, {'damage_type': 'backtrace', 'id': 714552164, 'ino': 1099511642482, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-62.jpg'}, {'damage_type': 'backtrace', 'id': 719185201, 'ino': 1099511639313, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 720918049, 'ino': 1099511644932, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 725910950, 'ino': 1099511644989, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 725913995, 'ino': 1099511642424, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-14.xml'}, {'damage_type': 'backtrace', 'id': 728801391, 'ino': 1099511645742, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-35.xml'}, {'damage_type': 'backtrace', 'id': 747158252, 'ino': 1099511645898, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 749000218, 'ino': 1099511643084, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-18.xml'}, {'damage_type': 'backtrace', 'id': 750125796, 'ino': 1099511645395, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 750839426, 'ino': 1099511644948, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-30.xml'}, {'damage_type': 'backtrace', 'id': 755915924, 'ino': 1099511643125, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 765279051, 'ino': 1099511643161, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 774789775, 'ino': 1099511645863, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 783735906, 'ino': 1099511643076, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-26.xml'}, {'damage_type': 'backtrace', 'id': 785422354, 'ino': 1099511639299, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 786339058, 'ino': 1099511642538, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 807916857, 'ino': 1099511643318, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-2.xml'}, {'damage_type': 'backtrace', 'id': 808756345, 'ino': 1099511645728, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-49.xml'}, {'damage_type': 'backtrace', 'id': 816857026, 'ino': 1099511643256, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 818585990, 'ino': 1099511645723, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-54.xml'}, {'damage_type': 'backtrace', 'id': 825557394, 'ino': 1099511642510, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 841550082, 'ino': 1099511644920, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 851354392, 'ino': 1099511643342, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 856550922, 'ino': 1099511643060, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-42.xml'}, {'damage_type': 'backtrace', 'id': 861450705, 'ino': 1099511643147, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 878710876, 'ino': 1099511644978, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 882937923, 'ino': 1099511643109, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 892355228, 'ino': 1099511645001, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 893368716, 'ino': 1099511642519, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 894330622, 'ino': 1099511643150, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-34.xml'}, {'damage_type': 'backtrace', 'id': 906692714, 'ino': 1099511643146, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 907478396, 'ino': 1099511643247, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 914864257, 'ino': 1099511642568, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 925744662, 'ino': 1099511643075, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-27.xml'}, {'damage_type': 'backtrace', 'id': 929023443, 'ino': 1099511644973, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-5.xml'}, {'damage_type': 'backtrace', 'id': 934750578, 'ino': 1099511643265, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 936856608, 'ino': 1099511643260, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 946667766, 'ino': 1099511644988, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 949977052, 'ino': 1099511643241, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 975855133, 'ino': 1099511642532, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 983065179, 'ino': 1099511644943, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 983202854, 'ino': 1099511645730, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-47.xml'}, {'damage_type': 'backtrace', 'id': 986237632, 'ino': 1099511642478, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-64.jpg'}, {'damage_type': 'backtrace', 'id': 991297753, 'ino': 1099511643115, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 991412647, 'ino': 1099511634667, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-12.xml'}, {'damage_type': 'backtrace', 'id': 994978648, 'ino': 1099511643087, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-15.xml'}, {'damage_type': 'backtrace', 'id': 1001658310, 'ino': 1099511644964, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-14.xml'}, {'damage_type': 'backtrace', 'id': 1004590833, 'ino': 1099511645782, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 1017247819, 'ino': 1099511642563, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 1019593330, 'ino': 1099511645889, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 1027545380, 'ino': 1099511645394, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 1039198437, 'ino': 1099511645449, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 1058339831, 'ino': 1099511643112, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 1065902261, 'ino': 1099511644928, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 1069796797, 'ino': 1099511643353, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 1076491562, 'ino': 1099511642434, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-8.xml'}, {'damage_type': 'backtrace', 'id': 1077617576, 'ino': 1099511643201, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-67.jpg'}, {'damage_type': 'backtrace', 'id': 1081107260, 'ino': 1099511644954, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-24.xml'}, {'damage_type': 'backtrace', 'id': 1084257029, 'ino': 1099511643325, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 1085394889, 'ino': 1099511645430, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 1088052003, 'ino': 1099511645423, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 1104202488, 'ino': 1099511639325, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 1110060682, 'ino': 1099511643067, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-35.xml'}, {'damage_type': 'backtrace', 'id': 1117700442, 'ino': 1099511644987, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 1127938979, 'ino': 1099511645738, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-39.xml'}, {'damage_type': 'backtrace', 'id': 1131212617, 'ino': 1099511645418, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 1135876017, 'ino': 1099511645826, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 1137131174, 'ino': 1099511644918, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/article-1.xml'}, {'damage_type': 'backtrace', 'id': 1146721109, 'ino': 1099511643348, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 1152417527, 'ino': 1099511642436, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-7.xml'}, {'damage_type': 'backtrace', 'id': 1155679249, 'ino': 1099511642469, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-67.jpg'}, {'damage_type': 'backtrace', 'id': 1182578809, 'ino': 1099511642450, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-75.jpg'}, {'damage_type': 'backtrace', 'id': 1184205590, 'ino': 1099511642494, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 1189663676, 'ino': 1099511639290, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 1191208736, 'ino': 1099511642574, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 1192362721, 'ino': 1099511643216, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 1197922482, 'ino': 1099511644977, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-1.xml'}, {'damage_type': 'backtrace', 'id': 1204271520, 'ino': 1099511643170, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-25.xml'}, {'damage_type': 'backtrace', 'id': 1205439650, 'ino': 1099511644996, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 1207207932, 'ino': 1099511644925, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 1237310590, 'ino': 1099511643110, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 1237537246, 'ino': 1099511643131, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 1252185687, 'ino': 1099511642521, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 1258147627, 'ino': 1099511634743, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 1258372475, 'ino': 1099511645431, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 1261694385, 'ino': 1099511645393, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 1268473528, 'ino': 1099511645531, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-53.xml'}, {'damage_type': 'backtrace', 'id': 1281472738, 'ino': 1099511643142, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 1282386525, 'ino': 1099511642522, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 1300644419, 'ino': 1099511643254, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 1326346557, 'ino': 1099511643139, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 1339959307, 'ino': 1099511643128, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 1351252848, 'ino': 1099511643214, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 1362847849, 'ino': 1099511645409, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 1364693229, 'ino': 1099511645721, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-56.xml'}, {'damage_type': 'backtrace', 'id': 1367845157, 'ino': 1099511643175, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-20.xml'}, {'damage_type': 'backtrace', 'id': 1380936779, 'ino': 1099511644975, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-3.xml'}, {'damage_type': 'backtrace', 'id': 1381327308, 'ino': 1099511645425, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 1385082346, 'ino': 1099511640591, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/comment-49.xml'}, {'damage_type': 'backtrace', 'id': 1391186692, 'ino': 1099511642432, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-9.xml'}, {'damage_type': 'backtrace', 'id': 1393981661, 'ino': 1099511645759, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-18.xml'}, {'damage_type': 'backtrace', 'id': 1397014027, 'ino': 1099511642467, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-68.jpg'}, {'damage_type': 'backtrace', 'id': 1404078427, 'ino': 1099511643135, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 1404854426, 'ino': 1099511645758, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-19.xml'}, {'damage_type': 'backtrace', 'id': 1414375292, 'ino': 1099511645502, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-79.xml'}, {'damage_type': 'backtrace', 'id': 1418935322, 'ino': 1099511645786, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 1434371521, 'ino': 1099511645428, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 1440685159, 'ino': 1099511645775, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-4.xml'}, {'damage_type': 'backtrace', 'id': 1442531955, 'ino': 1099511639293, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 1443668306, 'ino': 1099511642570, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 1446913810, 'ino': 1099511642505, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 1451322121, 'ino': 1099511643187, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-8.xml'}, {'damage_type': 'backtrace', 'id': 1466086173, 'ino': 1099511643183, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-12.xml'}, {'damage_type': 'backtrace', 'id': 1482129201, 'ino': 1099511645396, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 1484685246, 'ino': 1099511645399, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 1505352147, 'ino': 1099511643062, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-40.xml'}, {'damage_type': 'backtrace', 'id': 1508472908, 'ino': 1099511642547, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 1509200987, 'ino': 1099511642527, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 1512303086, 'ino': 1099511645867, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 1526260417, 'ino': 1099511645554, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-29.xml'}, {'damage_type': 'backtrace', 'id': 1533385221, 'ino': 1099511642456, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-72.jpg'}, {'damage_type': 'backtrace', 'id': 1544756088, 'ino': 1099511644982, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 1553777883, 'ino': 1099511642571, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 1555392763, 'ino': 1099511643143, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 1566556094, 'ino': 1099511644935, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 1576898059, 'ino': 1099511643267, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 1581198277, 'ino': 1099511644974, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-4.xml'}, {'damage_type': 'backtrace', 'id': 1586302946, 'ino': 1099511642564, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 1587281970, 'ino': 1099511643123, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 1590798267, 'ino': 1099511642544, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 1595975215, 'ino': 1099511643103, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 1597832766, 'ino': 1099511642454, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-73.jpg'}, {'damage_type': 'backtrace', 'id': 1606096248, 'ino': 1099511644961, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-17.xml'}, {'damage_type': 'backtrace', 'id': 1622057255, 'ino': 1099511644967, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-11.xml'}, {'damage_type': 'backtrace', 'id': 1623379771, 'ino': 1099511645740, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-37.xml'}, {'damage_type': 'backtrace', 'id': 1642115472, 'ino': 1099511645432, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 1658182732, 'ino': 1099511639311, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 1663639526, 'ino': 1099511645783, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 1667018674, 'ino': 1099511645760, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-17.xml'}, {'damage_type': 'backtrace', 'id': 1673027214, 'ino': 1099511643120, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 1677588225, 'ino': 1099511643316, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-4.xml'}, {'damage_type': 'backtrace', 'id': 1679770760, 'ino': 1099511643244, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 1681647617, 'ino': 1099511643346, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 1690283550, 'ino': 1099511645762, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-15.xml'}, {'damage_type': 'backtrace', 'id': 1701963986, 'ino': 1099511645419, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 1703695792, 'ino': 1099511634602, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-37.xml'}, {'damage_type': 'backtrace', 'id': 1708916356, 'ino': 1099511634729, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 1709455173, 'ino': 1099511645427, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 1710890648, 'ino': 1099511643106, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 1716472432, 'ino': 1099511645000, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 1721918617, 'ino': 1099511644986, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 1738266783, 'ino': 1099511643158, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 1746623973, 'ino': 1099511644946, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 1752124428, 'ino': 1099511643069, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-33.xml'}, {'damage_type': 'backtrace', 'id': 1757711461, 'ino': 1099511643261, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 1764529259, 'ino': 1099511643168, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-27.xml'}, {'damage_type': 'backtrace', 'id': 1771345906, 'ino': 1099511645376, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-12.xml'}, {'damage_type': 'backtrace', 'id': 1771629175, 'ino': 1099511640585, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/comment-51.xml'}, {'damage_type': 'backtrace', 'id': 1789073462, 'ino': 1099511643121, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 1796921785, 'ino': 1099511643136, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 1800187281, 'ino': 1099511643314, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-6.xml'}, {'damage_type': 'backtrace', 'id': 1800970734, 'ino': 1099511644992, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 1813451696, 'ino': 1099511643307, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-13.xml'}, {'damage_type': 'backtrace', 'id': 1817724799, 'ino': 1099511634765, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 1820057242, 'ino': 1099511643350, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 1836269129, 'ino': 1099511634693, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 1841374309, 'ino': 1099511644979, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 1845168880, 'ino': 1099511643249, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 1846423677, 'ino': 1099511642550, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 1869268054, 'ino': 1099511643079, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-23.xml'}, {'damage_type': 'backtrace', 'id': 1884440679, 'ino': 1099511645390, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-62.jpg'}, {'damage_type': 'backtrace', 'id': 1886935508, 'ino': 1099511645883, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 1892038148, 'ino': 1099511644990, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 1892656968, 'ino': 1099511643306, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-14.xml'}, {'damage_type': 'backtrace', 'id': 1893621760, 'ino': 1099511643264, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 1897177958, 'ino': 1099511644960, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-18.xml'}, {'damage_type': 'backtrace', 'id': 1912365036, 'ino': 1099511644927, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 1932087972, 'ino': 1099511644984, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 1940284143, 'ino': 1099511645006, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 1944823815, 'ino': 1099511645754, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-23.xml'}, {'damage_type': 'backtrace', 'id': 1948834755, 'ino': 1099511634596, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-39.xml'}, {'damage_type': 'backtrace', 'id': 1950629472, 'ino': 1099511642525, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 1951135473, 'ino': 1099511643111, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 1964141804, 'ino': 1099511643193, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-2.xml'}, {'damage_type': 'backtrace', 'id': 1976281262, 'ino': 1099511644945, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 1981779882, 'ino': 1099511643310, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-10.xml'}, {'damage_type': 'backtrace', 'id': 2006188093, 'ino': 1099511645406, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 2026159898, 'ino': 1099511645727, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-50.xml'}, {'damage_type': 'backtrace', 'id': 2027757649, 'ino': 1099511643245, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 2034770028, 'ino': 1099511643182, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-13.xml'}, {'damage_type': 'backtrace', 'id': 2037014901, 'ino': 1099511642460, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-70.jpg'}, {'damage_type': 'backtrace', 'id': 2042976239, 'ino': 1099511644952, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-26.xml'}, {'damage_type': 'backtrace', 'id': 2045367634, 'ino': 1099511643077, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-25.xml'}, {'damage_type': 'backtrace', 'id': 2048006510, 'ino': 1099511642577, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 2059580972, 'ino': 1099511645437, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 2059637123, 'ino': 1099511643330, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 2064237593, 'ino': 1099511643145, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 2069063377, 'ino': 1099511645415, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 2083262966, 'ino': 1099511643071, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-31.xml'}, {'damage_type': 'backtrace', 'id': 2088165089, 'ino': 1099511642543, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 2091626371, 'ino': 1099511643118, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 2092406453, 'ino': 1099511645777, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-2.xml'}, {'damage_type': 'backtrace', 'id': 2094526103, 'ino': 1099511645901, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 2096702700, 'ino': 1099511645397, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 2103134068, 'ino': 1099511645407, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 2119199064, 'ino': 1099511643204, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-64.jpg'}, {'damage_type': 'backtrace', 'id': 2131318232, 'ino': 1099511644968, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-10.xml'}, {'damage_type': 'backtrace', 'id': 2132659372, 'ino': 1099511643185, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-10.xml'}, {'damage_type': 'backtrace', 'id': 2134287593, 'ino': 1099511642556, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 2142818051, 'ino': 1099511643347, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 2145270860, 'ino': 1099511644976, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-2.xml'}, {'damage_type': 'backtrace', 'id': 2161316347, 'ino': 1099511642422, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-15.xml'}, {'damage_type': 'backtrace', 'id': 2167673359, 'ino': 1099511644999, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 2186395788, 'ino': 1099511643197, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-71.jpg'}, {'damage_type': 'backtrace', 'id': 2187850925, 'ino': 1099511643312, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-8.xml'}, {'damage_type': 'backtrace', 'id': 2205584534, 'ino': 1099511643191, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-4.xml'}, {'damage_type': 'backtrace', 'id': 2215095804, 'ino': 1099511634516, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-66.xml'}, {'damage_type': 'backtrace', 'id': 2224815379, 'ino': 1099511639337, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 2229451464, 'ino': 1099511643352, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 2245011074, 'ino': 1099511645438, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 2254740754, 'ino': 1099511643203, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-65.jpg'}, {'damage_type': 'backtrace', 'id': 2255807426, 'ino': 1099511644944, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 2268914610, 'ino': 1099511642492, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 2273452419, 'ino': 1099511644937, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 2274854866, 'ino': 1099511643343, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 2291561282, 'ino': 1099511645403, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 2302796010, 'ino': 1099511645413, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 2314982014, 'ino': 1099511645440, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 2316827884, 'ino': 1099511644980, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 2332290826, 'ino': 1099511645389, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 2337241573, 'ino': 1099511639331, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 2338205361, 'ino': 1099511645005, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 2338847121, 'ino': 1099511642559, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 2353125085, 'ino': 1099511644941, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 2354659654, 'ino': 1099511643250, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 2365261014, 'ino': 1099511643098, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-4.xml'}, {'damage_type': 'backtrace', 'id': 2368721401, 'ino': 1099511645378, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-10.xml'}, {'damage_type': 'backtrace', 'id': 2384176778, 'ino': 1099511643229, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 2396200535, 'ino': 1099511643188, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-7.xml'}, {'damage_type': 'backtrace', 'id': 2398399399, 'ino': 1099511642465, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-69.jpg'}, {'damage_type': 'backtrace', 'id': 2404198926, 'ino': 1099511643113, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 2416388024, 'ino': 1099511642471, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-66.jpg'}, {'damage_type': 'backtrace', 'id': 2420491379, 'ino': 1099511642549, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 2437818000, 'ino': 1099511645732, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-45.xml'}, {'damage_type': 'backtrace', 'id': 2440067168, 'ino': 1099511643149, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-35.xml'}, {'damage_type': 'backtrace', 'id': 2442785348, 'ino': 1099511643335, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 2445327132, 'ino': 1099511643144, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 2453243110, 'ino': 1099511643317, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-3.xml'}, {'damage_type': 'backtrace', 'id': 2458154005, 'ino': 1099511643179, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-16.xml'}, {'damage_type': 'backtrace', 'id': 2476648965, 'ino': 1099511645416, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 2479979131, 'ino': 1099511645410, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 2482868220, 'ino': 1099511643327, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 2486898175, 'ino': 1099511643163, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 2503093975, 'ino': 1099511645398, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 2506876262, 'ino': 1099511645379, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-9.xml'}, {'damage_type': 'backtrace', 'id': 2508638065, 'ino': 1099511644919, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 2522517930, 'ino': 1099511642557, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 2527598631, 'ino': 1099511645445, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 2534823824, 'ino': 1099511642576, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 2541538885, 'ino': 1099511643243, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 2561041278, 'ino': 1099511643199, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-69.jpg'}, {'damage_type': 'backtrace', 'id': 2569910660, 'ino': 1099511643088, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-14.xml'}, {'damage_type': 'backtrace', 'id': 2571721911, 'ino': 1099511643257, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 2572731420, 'ino': 1099511644995, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 2584213559, 'ino': 1099511644997, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 2598565669, 'ino': 1099511643130, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 2609543084, 'ino': 1099511643122, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 2613220339, 'ino': 1099511634522, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-64.xml'}, {'damage_type': 'backtrace', 'id': 2621949068, 'ino': 1099511645434, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 2624505453, 'ino': 1099511643166, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-29.xml'}, {'damage_type': 'backtrace', 'id': 2651564053, 'ino': 1099511643189, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-6.xml'}, {'damage_type': 'backtrace', 'id': 2653584727, 'ino': 1099511642554, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 2654843209, 'ino': 1099511642452, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-74.jpg'}, {'damage_type': 'backtrace', 'id': 2658044907, 'ino': 1099511643344, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 2662426144, 'ino': 1099511645780, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 2663928957, 'ino': 1099511643133, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 2666863102, 'ino': 1099511643169, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-26.xml'}, {'damage_type': 'backtrace', 'id': 2666978861, 'ino': 1099511643101, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-1.xml'}, {'damage_type': 'backtrace', 'id': 2679328932, 'ino': 1099511645448, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 2680264272, 'ino': 1099511642529, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 2684464208, 'ino': 1099511639258, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 2688311896, 'ino': 1099511643192, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-3.xml'}, {'damage_type': 'backtrace', 'id': 2688625090, 'ino': 1099511644955, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-23.xml'}, {'damage_type': 'backtrace', 'id': 2692900413, 'ino': 1099511645743, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-34.xml'}, {'damage_type': 'backtrace', 'id': 2716967573, 'ino': 1099511643172, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-23.xml'}, {'damage_type': 'backtrace', 'id': 2725760830, 'ino': 1099511644956, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-22.xml'}, {'damage_type': 'backtrace', 'id': 2737176519, 'ino': 1099511642573, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 2738236138, 'ino': 1099511644949, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-29.xml'}, {'damage_type': 'backtrace', 'id': 2743791792, 'ino': 1099511645435, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 2746447872, 'ino': 1099511645748, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-29.xml'}, {'damage_type': 'backtrace', 'id': 2767110358, 'ino': 1099511645766, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-12.xml'}, {'damage_type': 'backtrace', 'id': 2767199301, 'ino': 1099511645385, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-3.xml'}, {'damage_type': 'backtrace', 'id': 2774187568, 'ino': 1099511645433, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 2785309413, 'ino': 1099511642517, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 2786125559, 'ino': 1099511643323, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 2792255708, 'ino': 1099511643212, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 2796944754, 'ino': 1099511643220, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 2796969613, 'ino': 1099511645778, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-1.xml'}, {'damage_type': 'backtrace', 'id': 2802193327, 'ino': 1099511643240, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 2804922662, 'ino': 1099511645791, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 2822960230, 'ino': 1099511643217, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 2823727994, 'ino': 1099511643315, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-5.xml'}, {'damage_type': 'backtrace', 'id': 2827658742, 'ino': 1099511643061, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-41.xml'}, {'damage_type': 'backtrace', 'id': 2830027780, 'ino': 1099511645004, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 2833411200, 'ino': 1099511643160, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 2838972686, 'ino': 1099511643180, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-15.xml'}, {'damage_type': 'backtrace', 'id': 2840726672, 'ino': 1099511643074, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-28.xml'}, {'damage_type': 'backtrace', 'id': 2845293993, 'ino': 1099511644983, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 2862158863, 'ino': 1099511643190, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-5.xml'}, {'damage_type': 'backtrace', 'id': 2867882166, 'ino': 1099511634733, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 2878817645, 'ino': 1099511643263, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 2879032742, 'ino': 1099511643336, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 2895441509, 'ino': 1099511645388, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-64.jpg'}, {'damage_type': 'backtrace', 'id': 2903166041, 'ino': 1099511643127, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 2912528493, 'ino': 1099511643195, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-73.jpg'}, {'damage_type': 'backtrace', 'id': 2914314752, 'ino': 1099511645752, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-25.xml'}, {'damage_type': 'backtrace', 'id': 2920554627, 'ino': 1099511643210, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 2931937980, 'ino': 1099511642489, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 2943983603, 'ino': 1099511642431, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-10.xml'}, {'damage_type': 'backtrace', 'id': 2949387123, 'ino': 1099511642507, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 2950364655, 'ino': 1099511643222, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 2951195725, 'ino': 1099511644963, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-15.xml'}, {'damage_type': 'backtrace', 'id': 2953078794, 'ino': 1099511639334, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 2957512785, 'ino': 1099511643309, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-11.xml'}, {'damage_type': 'backtrace', 'id': 2976957398, 'ino': 1099511643157, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 2980459034, 'ino': 1099511643093, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-9.xml'}, {'damage_type': 'backtrace', 'id': 3009373823, 'ino': 1099511645436, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 3009437245, 'ino': 1099511643085, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-17.xml'}, {'damage_type': 'backtrace', 'id': 3016437326, 'ino': 1099511642496, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 3021748178, 'ino': 1099511643339, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 3023341961, 'ino': 1099511643100, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-2.xml'}, {'damage_type': 'backtrace', 'id': 3040856509, 'ino': 1099511643332, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 3043128192, 'ino': 1099511643194, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-1.xml'}, {'damage_type': 'backtrace', 'id': 3043528230, 'ino': 1099511643108, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 3043928672, 'ino': 1099511643176, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-19.xml'}, {'damage_type': 'backtrace', 'id': 3062092935, 'ino': 1099511643064, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-38.xml'}, {'damage_type': 'backtrace', 'id': 3063334809, 'ino': 1099511643326, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 3082805165, 'ino': 1099511645747, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-30.xml'}, {'damage_type': 'backtrace', 'id': 3105469291, 'ino': 1099511644936, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 3114351851, 'ino': 1099511642565, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 3117691315, 'ino': 1099511644962, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-16.xml'}, {'damage_type': 'backtrace', 'id': 3126278128, 'ino': 1099511643152, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-33.xml'}, {'damage_type': 'backtrace', 'id': 3163947433, 'ino': 1099511643092, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-10.xml'}, {'damage_type': 'backtrace', 'id': 3167495597, 'ino': 1099511645443, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 3170411460, 'ino': 1099511642426, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-13.xml'}, {'damage_type': 'backtrace', 'id': 3174544189, 'ino': 1099511644965, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-13.xml'}, {'damage_type': 'backtrace', 'id': 3178376571, 'ino': 1099511643070, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-32.xml'}, {'damage_type': 'backtrace', 'id': 3185406219, 'ino': 1099511642578, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 3187298757, 'ino': 1099511642540, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 3194462942, 'ino': 1099511645377, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-11.xml'}, {'damage_type': 'backtrace', 'id': 3198683624, 'ino': 1099511643235, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 3209212513, 'ino': 1099511639284, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 3215674984, 'ino': 1099511643104, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 3224941229, 'ino': 1099511643232, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 3226193023, 'ino': 1099511645400, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 3230636294, 'ino': 1099511645729, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-48.xml'}, {'damage_type': 'backtrace', 'id': 3231069976, 'ino': 1099511643107, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 3235620368, 'ino': 1099511642497, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 3240232081, 'ino': 1099511643072, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-30.xml'}, {'damage_type': 'backtrace', 'id': 3246568947, 'ino': 1099511643140, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 3264978566, 'ino': 1099511643205, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 3268644555, 'ino': 1099511645774, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-5.xml'}, {'damage_type': 'backtrace', 'id': 3268897348, 'ino': 1099511645383, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-5.xml'}, {'damage_type': 'backtrace', 'id': 3276461395, 'ino': 1099511644917, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/article-2.xml'}, {'damage_type': 'backtrace', 'id': 3290658170, 'ino': 1099511642458, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-71.jpg'}, {'damage_type': 'backtrace', 'id': 3291860787, 'ino': 1099511645541, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-40.xml'}, {'damage_type': 'backtrace', 'id': 3299905369, 'ino': 1099511642440, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-4.xml'}, {'damage_type': 'backtrace', 'id': 3304636119, 'ino': 1099511645772, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-6.xml'}, {'damage_type': 'backtrace', 'id': 3306807723, 'ino': 1099511643082, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-20.xml'}, {'damage_type': 'backtrace', 'id': 3324713210, 'ino': 1099511642474, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-65.jpg'}, {'damage_type': 'backtrace', 'id': 3327260657, 'ino': 1099511643319, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-1.xml'}, {'damage_type': 'backtrace', 'id': 3329934863, 'ino': 1099511643083, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-19.xml'}, {'damage_type': 'backtrace', 'id': 3334808600, 'ino': 1099511643164, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 3337065890, 'ino': 1099511645770, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-8.xml'}, {'damage_type': 'backtrace', 'id': 3349522722, 'ino': 1099511642535, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 3374902859, 'ino': 1099511643311, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-9.xml'}, {'damage_type': 'backtrace', 'id': 3379693896, 'ino': 1099511645442, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 3402022887, 'ino': 1099511634691, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 3402574412, 'ino': 1099511643226, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 3403607134, 'ino': 1099511644930, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 3407613043, 'ino': 1099511645737, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-40.xml'}, {'damage_type': 'backtrace', 'id': 3410504027, 'ino': 1099511644931, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 3420310799, 'ino': 1099511644921, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 3427610851, 'ino': 1099511643322, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 3433193878, 'ino': 1099511643253, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 3442508564, 'ino': 1099511645756, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-21.xml'}, {'damage_type': 'backtrace', 'id': 3447350516, 'ino': 1099511645750, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-27.xml'}, {'damage_type': 'backtrace', 'id': 3457833921, 'ino': 1099511643340, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 3461234340, 'ino': 1099511643078, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-24.xml'}, {'damage_type': 'backtrace', 'id': 3468182635, 'ino': 1099511643165, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-30.xml'}, {'damage_type': 'backtrace', 'id': 3486973445, 'ino': 1099511642480, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 3489371751, 'ino': 1099511643116, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 3502688956, 'ino': 1099511645003, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 3503427652, 'ino': 1099511645387, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-1.xml'}, {'damage_type': 'backtrace', 'id': 3506513754, 'ino': 1099511644966, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-12.xml'}, {'damage_type': 'backtrace', 'id': 3514227798, 'ino': 1099511645420, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 3517724188, 'ino': 1099511643215, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 3532967051, 'ino': 1099511643258, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 3533818943, 'ino': 1099511644950, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-28.xml'}, {'damage_type': 'backtrace', 'id': 3534299333, 'ino': 1099511643155, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 3541184194, 'ino': 1099511643308, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-12.xml'}, {'damage_type': 'backtrace', 'id': 3563867272, 'ino': 1099511644929, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 3566183707, 'ino': 1099511643320, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 3567231874, 'ino': 1099511645751, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-26.xml'}, {'damage_type': 'backtrace', 'id': 3571390051, 'ino': 1099511643333, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 3578399467, 'ino': 1099511642561, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 3580015078, 'ino': 1099511643337, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 3583102704, 'ino': 1099511643321, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 3588480953, 'ino': 1099511644969, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-9.xml'}, {'damage_type': 'backtrace', 'id': 3593833465, 'ino': 1099511644993, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 3596751854, 'ino': 1099511643234, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 3603541537, 'ino': 1099511645840, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 3610528834, 'ino': 1099511643227, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 3614950349, 'ino': 1099511645441, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 3621403564, 'ino': 1099511645450, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 3633271767, 'ino': 1099511645426, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 3638068691, 'ino': 1099511634701, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 3638171539, 'ino': 1099511645739, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-38.xml'}, {'damage_type': 'backtrace', 'id': 3643252588, 'ino': 1099511634657, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-17.xml'}, {'damage_type': 'backtrace', 'id': 3643405523, 'ino': 1099511645444, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 3650256158, 'ino': 1099511643230, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 3653194106, 'ino': 1099511643094, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-8.xml'}, {'damage_type': 'backtrace', 'id': 3659655138, 'ino': 1099511644985, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 3660948983, 'ino': 1099511643181, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-14.xml'}, {'damage_type': 'backtrace', 'id': 3668122464, 'ino': 1099511643059, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-43.xml'}, {'damage_type': 'backtrace', 'id': 3675697335, 'ino': 1099511644939, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 3684650961, 'ino': 1099511642428, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/article-12.xml'}, {'damage_type': 'backtrace', 'id': 3690923867, 'ino': 1099511643219, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 3693680659, 'ino': 1099511639296, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 3696801719, 'ino': 1099511634689, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-1.xml'}, {'damage_type': 'backtrace', 'id': 3728839533, 'ino': 1099511645821, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 3733391319, 'ino': 1099511644926, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 3735888938, 'ino': 1099511643132, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 3763695893, 'ino': 1099511642500, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 3765038206, 'ino': 1099511645381, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-7.xml'}, {'damage_type': 'backtrace', 'id': 3769917322, 'ino': 1099511643221, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 3770065955, 'ino': 1099511642499, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 3773795367, 'ino': 1099511643086, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-16.xml'}, {'damage_type': 'backtrace', 'id': 3782780709, 'ino': 1099511642537, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 3785664639, 'ino': 1099511645789, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 3799609671, 'ino': 1099511643095, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-7.xml'}, {'damage_type': 'backtrace', 'id': 3804093538, 'ino': 1099511645753, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-24.xml'}, {'damage_type': 'backtrace', 'id': 3810038586, 'ino': 1099511645725, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-52.xml'}, {'damage_type': 'backtrace', 'id': 3824216681, 'ino': 1099511644991, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 3830152196, 'ino': 1099511645755, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-22.xml'}, {'damage_type': 'backtrace', 'id': 3837181325, 'ino': 1099511645731, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-46.xml'}, {'damage_type': 'backtrace', 'id': 3838081936, 'ino': 1099511643080, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-22.xml'}, {'damage_type': 'backtrace', 'id': 3864933534, 'ino': 1099511643156, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 3870126577, 'ino': 1099511643313, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/article-7.xml'}, {'damage_type': 'backtrace', 'id': 3889364476, 'ino': 1099511643237, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 3892054482, 'ino': 1099511643124, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 3892816373, 'ino': 1099511643174, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-21.xml'}, {'damage_type': 'backtrace', 'id': 3894937939, 'ino': 1099511642567, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 3911536247, 'ino': 1099511643213, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 3912100545, 'ino': 1099511645412, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 3919160184, 'ino': 1099511642553, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 3920644286, 'ino': 1099511643065, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-37.xml'}, {'damage_type': 'backtrace', 'id': 3922506557, 'ino': 1099511645735, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-42.xml'}, {'damage_type': 'backtrace', 'id': 3926398410, 'ino': 1099511642569, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 3935839840, 'ino': 1099511643236, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 3945442059, 'ino': 1099511645767, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-11.xml'}, {'damage_type': 'backtrace', 'id': 3958295948, 'ino': 1099511645404, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 3963477404, 'ino': 1099511643341, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 3964630989, 'ino': 1099511643218, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 3966596023, 'ino': 1099511645384, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-4.xml'}, {'damage_type': 'backtrace', 'id': 3969467422, 'ino': 1099511643349, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 3981601690, 'ino': 1099511643178, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-17.xml'}, {'damage_type': 'backtrace', 'id': 3983951819, 'ino': 1099511642513, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 3995292716, 'ino': 1099511643200, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-68.jpg'}, {'damage_type': 'backtrace', 'id': 4004596380, 'ino': 1099511639287, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 4025486236, 'ino': 1099511642562, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 4033552890, 'ino': 1099511645551, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-64.jpg'}, {'damage_type': 'backtrace', 'id': 4038322572, 'ino': 1099511643167, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-28.xml'}, {'damage_type': 'backtrace', 'id': 4070920448, 'ino': 1099511643248, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 4079336859, 'ino': 1099511645763, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-14.xml'}, {'damage_type': 'backtrace', 'id': 4089813275, 'ino': 1099511639327, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 4091753064, 'ino': 1099511643154, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-31.xml'}, {'damage_type': 'backtrace', 'id': 4098808373, 'ino': 1099511643173, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-22.xml'}, {'damage_type': 'backtrace', 'id': 4104755017, 'ino': 1099511643068, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-34.xml'}, {'damage_type': 'backtrace', 'id': 4105506351, 'ino': 1099511643331, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 4106217186, 'ino': 1099511642495, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 4114831856, 'ino': 1099511643063, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/article-39.xml'}, {'damage_type': 'backtrace', 'id': 4116099646, 'ino': 1099511645733, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-44.xml'}, {'damage_type': 'backtrace', 'id': 4130021956, 'ino': 1099511644994, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 4132798420, 'ino': 1099511643129, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 4140957031, 'ino': 1099511645769, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-9.xml'}, {'damage_type': 'backtrace', 'id': 4143910970, 'ino': 1099511643259, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 4151252259, 'ino': 1099511643242, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 4151943645, 'ino': 1099511643206, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-62.jpg'}, {'damage_type': 'backtrace', 'id': 4155955877, 'ino': 1099511643223, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 4165366331, 'ino': 1099511643186, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-9.xml'}, {'damage_type': 'backtrace', 'id': 4170399066, 'ino': 1099511644916, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/article-3.xml'}, {'damage_type': 'backtrace', 'id': 4174905726, 'ino': 1099511645451, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 4176464411, 'ino': 1099511643202, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-66.jpg'}, {'damage_type': 'backtrace', 'id': 4179112204, 'ino': 1099511645429, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 4182744635, 'ino': 1099511644924, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 4189644347, 'ino': 1099511645761, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-16.xml'}, {'damage_type': 'backtrace', 'id': 4194740331, 'ino': 1099511643345, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-139/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 4210986087, 'ino': 1099511645417, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 4216335262, 'ino': 1099511645380, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/article-8.xml'}, {'damage_type': 'backtrace', 'id': 4226576899, 'ino': 1099511645734, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-43.xml'}, {'damage_type': 'backtrace', 'id': 4236343464, 'ino': 1099511645771, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-7.xml'}, {'damage_type': 'backtrace', 'id': 4243726074, 'ino': 1099511644942, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 4247272937, 'ino': 1099511643119, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 4248373186, 'ino': 1099511643209, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 4249012918, 'ino': 1099511645741, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-36.xml'}, {'damage_type': 'backtrace', 'id': 4251183976, 'ino': 1099511643239, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 4252422855, 'ino': 1099511643177, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-18.xml'}, {'damage_type': 'backtrace', 'id': 4257461411, 'ino': 1099511642515, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 4272626399, 'ino': 1099511644957, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-193/article-21.xml'}, {'damage_type': 'backtrace', 'id': 4275424050, 'ino': 1099511645447, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-204/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 4278930321, 'ino': 1099511645757, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-215/article-20.xml'}, {'damage_type': 'backtrace', 'id': 4279486032, 'ino': 1099511644938, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-192/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 4285013340, 'ino': 1099511643126, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-132/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 4286465808, 'ino': 1099511643184, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-134/article-11.xml'}, {'damage_type': 'backtrace', 'id': 4290403987, 'ino': 1099511642575, 'path': '/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-115/picture-4.jpg'}] 2024-09-05T01:35:59.714 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/qa/tasks/fwd_scrub.py", line 48, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph_91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/qa/tasks/fwd_scrub.py", line 70, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph_91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/qa/tasks/fwd_scrub.py", line 81, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-09-05T01:36:01.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:01 smithi012 ceph-mon[29942]: pgmap v352: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.9 MiB/s wr, 505 op/s 2024-09-05T01:36:01.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:01 smithi145 ceph-mon[34376]: pgmap v352: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.9 MiB/s wr, 505 op/s 2024-09-05T01:36:01.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:01 smithi151 ceph-mon[35013]: pgmap v352: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.9 MiB/s wr, 505 op/s 2024-09-05T01:36:03.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:03 smithi012 ceph-mon[29942]: pgmap v353: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 421 op/s 2024-09-05T01:36:03.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:03 smithi145 ceph-mon[34376]: pgmap v353: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 421 op/s 2024-09-05T01:36:03.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:03 smithi151 ceph-mon[35013]: pgmap v353: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 421 op/s 2024-09-05T01:36:04.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:04 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:36:04.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:04 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:36:04.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:04 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:36:05.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:05 smithi012 ceph-mon[29942]: pgmap v354: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 629 op/s 2024-09-05T01:36:05.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:05 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:36:05.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:05 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:36:05.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:05 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:36:05.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:05 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:36:05.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:05 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:36:05.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:05 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:36:05.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:05 smithi145 ceph-mon[34376]: pgmap v354: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 629 op/s 2024-09-05T01:36:05.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:05 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:36:05.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:05 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:36:05.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:05 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:36:05.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:05 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:36:05.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:05 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:36:05.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:05 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:36:05.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:05 smithi151 ceph-mon[35013]: pgmap v354: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 629 op/s 2024-09-05T01:36:05.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:05 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:36:05.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:05 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:36:05.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:05 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:36:05.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:05 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:36:05.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:05 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:36:05.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:05 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:36:06.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:06 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:36:06.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:06 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:36:06.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:06 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:36:06.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:06 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:36:06.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:06 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:36:06.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:06 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:36:06.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:06 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:36:06.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:06 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:36:06.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:06 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:36:07.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:07 smithi012 ceph-mon[29942]: pgmap v355: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 575 op/s 2024-09-05T01:36:07.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:07 smithi145 ceph-mon[34376]: pgmap v355: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 575 op/s 2024-09-05T01:36:07.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:07 smithi151 ceph-mon[35013]: pgmap v355: 97 pgs: 97 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 575 op/s 2024-09-05T01:36:08.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:08 smithi012 ceph-mon[29942]: osdmap e97: 12 total, 12 up, 12 in 2024-09-05T01:36:08.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:08 smithi145 ceph-mon[34376]: osdmap e97: 12 total, 12 up, 12 in 2024-09-05T01:36:08.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:08 smithi151 ceph-mon[35013]: osdmap e97: 12 total, 12 up, 12 in 2024-09-05T01:36:09.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:09 smithi012 ceph-mon[29942]: pgmap v357: 97 pgs: 2 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 93 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.1 MiB/s wr, 660 op/s 2024-09-05T01:36:09.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:09 smithi145 ceph-mon[34376]: pgmap v357: 97 pgs: 2 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 93 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.1 MiB/s wr, 660 op/s 2024-09-05T01:36:09.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:09 smithi151 ceph-mon[35013]: pgmap v357: 97 pgs: 2 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 93 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.1 MiB/s wr, 660 op/s 2024-09-05T01:36:11.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:11 smithi012 ceph-mon[29942]: pgmap v358: 97 pgs: 34 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 41 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.2 MiB/s wr, 621 op/s 2024-09-05T01:36:11.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:11 smithi145 ceph-mon[34376]: pgmap v358: 97 pgs: 34 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 41 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.2 MiB/s wr, 621 op/s 2024-09-05T01:36:11.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:11 smithi151 ceph-mon[35013]: pgmap v358: 97 pgs: 34 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 41 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.2 MiB/s wr, 621 op/s 2024-09-05T01:36:13.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:13 smithi012 ceph-mon[29942]: pgmap v359: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.2 MiB/s wr, 584 op/s 2024-09-05T01:36:13.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:13 smithi145 ceph-mon[34376]: pgmap v359: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.2 MiB/s wr, 584 op/s 2024-09-05T01:36:13.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:13 smithi151 ceph-mon[35013]: pgmap v359: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.2 MiB/s wr, 584 op/s 2024-09-05T01:36:15.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:15 smithi012 ceph-mon[29942]: pgmap v360: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 366 op/s 2024-09-05T01:36:15.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:15 smithi145 ceph-mon[34376]: pgmap v360: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 366 op/s 2024-09-05T01:36:15.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:15 smithi151 ceph-mon[35013]: pgmap v360: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 366 op/s 2024-09-05T01:36:17.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:17 smithi012 ceph-mon[29942]: pgmap v361: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 302 op/s 2024-09-05T01:36:17.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:17 smithi145 ceph-mon[34376]: pgmap v361: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 302 op/s 2024-09-05T01:36:17.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:17 smithi151 ceph-mon[35013]: pgmap v361: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 302 op/s 2024-09-05T01:36:19.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:19 smithi145 ceph-mon[34376]: pgmap v362: 97 pgs: 37 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 38 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 291 op/s 2024-09-05T01:36:19.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:19 smithi151 ceph-mon[35013]: pgmap v362: 97 pgs: 37 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 38 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 291 op/s 2024-09-05T01:36:20.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:19 smithi012 ceph-mon[29942]: pgmap v362: 97 pgs: 37 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 38 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 291 op/s 2024-09-05T01:36:21.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:21 smithi145 ceph-mon[34376]: pgmap v363: 97 pgs: 35 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 45 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 355 op/s 2024-09-05T01:36:21.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:21 smithi151 ceph-mon[35013]: pgmap v363: 97 pgs: 35 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 45 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 355 op/s 2024-09-05T01:36:22.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:21 smithi012 ceph-mon[29942]: pgmap v363: 97 pgs: 35 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 45 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 355 op/s 2024-09-05T01:36:23.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:23 smithi151 ceph-mon[35013]: pgmap v364: 97 pgs: 35 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 45 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 217 op/s 2024-09-05T01:36:24.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:23 smithi012 ceph-mon[29942]: pgmap v364: 97 pgs: 35 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 45 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 217 op/s 2024-09-05T01:36:24.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:23 smithi145 ceph-mon[34376]: pgmap v364: 97 pgs: 35 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 45 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 217 op/s 2024-09-05T01:36:24.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:24 smithi151 ceph-mon[35013]: pgmap v365: 97 pgs: 25 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 61 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 278 op/s 2024-09-05T01:36:25.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:24 smithi012 ceph-mon[29942]: pgmap v365: 97 pgs: 25 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 61 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 278 op/s 2024-09-05T01:36:25.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:24 smithi145 ceph-mon[34376]: pgmap v365: 97 pgs: 25 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 61 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 278 op/s 2024-09-05T01:36:27.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:26 smithi012 ceph-mon[29942]: pgmap v366: 97 pgs: 16 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 73 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 259 op/s 2024-09-05T01:36:27.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:26 smithi145 ceph-mon[34376]: pgmap v366: 97 pgs: 16 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 73 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 259 op/s 2024-09-05T01:36:27.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:26 smithi151 ceph-mon[35013]: pgmap v366: 97 pgs: 16 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 73 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 259 op/s 2024-09-05T01:36:29.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:28 smithi012 ceph-mon[29942]: pgmap v367: 97 pgs: 10 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 81 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 265 op/s 2024-09-05T01:36:29.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:28 smithi145 ceph-mon[34376]: pgmap v367: 97 pgs: 10 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 81 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 265 op/s 2024-09-05T01:36:29.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:28 smithi151 ceph-mon[35013]: pgmap v367: 97 pgs: 10 active+clean+snaptrim_wait, 6 active+clean+snaptrim, 81 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 265 op/s 2024-09-05T01:36:31.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:30 smithi012 ceph-mon[29942]: pgmap v368: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 320 op/s 2024-09-05T01:36:31.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:30 smithi145 ceph-mon[34376]: pgmap v368: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 320 op/s 2024-09-05T01:36:31.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:30 smithi151 ceph-mon[35013]: pgmap v368: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 320 op/s 2024-09-05T01:36:33.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:33 smithi012 ceph-mon[29942]: pgmap v369: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 212 op/s 2024-09-05T01:36:33.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:33 smithi012 ceph-mon[29942]: osdmap e98: 12 total, 12 up, 12 in 2024-09-05T01:36:33.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:33 smithi145 ceph-mon[34376]: pgmap v369: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 212 op/s 2024-09-05T01:36:33.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:33 smithi145 ceph-mon[34376]: osdmap e98: 12 total, 12 up, 12 in 2024-09-05T01:36:33.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:33 smithi151 ceph-mon[35013]: pgmap v369: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 212 op/s 2024-09-05T01:36:33.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:33 smithi151 ceph-mon[35013]: osdmap e98: 12 total, 12 up, 12 in 2024-09-05T01:36:35.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:35 smithi012 ceph-mon[29942]: pgmap v371: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.7 MiB/s wr, 288 op/s 2024-09-05T01:36:35.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:35 smithi145 ceph-mon[34376]: pgmap v371: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.7 MiB/s wr, 288 op/s 2024-09-05T01:36:35.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:35 smithi151 ceph-mon[35013]: pgmap v371: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.7 MiB/s wr, 288 op/s 2024-09-05T01:36:37.406 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:37 smithi151 ceph-mon[35013]: pgmap v372: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 313 op/s 2024-09-05T01:36:37.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:37 smithi012 ceph-mon[29942]: pgmap v372: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 313 op/s 2024-09-05T01:36:37.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:37 smithi145 ceph-mon[34376]: pgmap v372: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 313 op/s 2024-09-05T01:36:39.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:39 smithi012 ceph-mon[29942]: pgmap v373: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.2 MiB/s wr, 336 op/s 2024-09-05T01:36:39.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:39 smithi145 ceph-mon[34376]: pgmap v373: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.2 MiB/s wr, 336 op/s 2024-09-05T01:36:39.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:39 smithi151 ceph-mon[35013]: pgmap v373: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.2 MiB/s wr, 336 op/s 2024-09-05T01:36:41.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:41 smithi012 ceph-mon[29942]: pgmap v374: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.9 MiB/s wr, 415 op/s 2024-09-05T01:36:41.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:41 smithi145 ceph-mon[34376]: pgmap v374: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.9 MiB/s wr, 415 op/s 2024-09-05T01:36:41.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:41 smithi151 ceph-mon[35013]: pgmap v374: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.9 MiB/s wr, 415 op/s 2024-09-05T01:36:43.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:43 smithi012 ceph-mon[29942]: pgmap v375: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.9 MiB/s wr, 416 op/s 2024-09-05T01:36:43.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:43 smithi145 ceph-mon[34376]: pgmap v375: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.9 MiB/s wr, 416 op/s 2024-09-05T01:36:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:43 smithi151 ceph-mon[35013]: pgmap v375: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.9 MiB/s wr, 416 op/s 2024-09-05T01:36:45.418 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:45 smithi012 ceph-mon[29942]: pgmap v376: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 475 op/s 2024-09-05T01:36:45.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:45 smithi145 ceph-mon[34376]: pgmap v376: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 475 op/s 2024-09-05T01:36:45.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:45 smithi151 ceph-mon[35013]: pgmap v376: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 475 op/s 2024-09-05T01:36:47.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:47 smithi012 ceph-mon[29942]: pgmap v377: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 389 op/s 2024-09-05T01:36:47.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:47 smithi145 ceph-mon[34376]: pgmap v377: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 389 op/s 2024-09-05T01:36:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:47 smithi151 ceph-mon[35013]: pgmap v377: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 389 op/s 2024-09-05T01:36:49.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:49 smithi012 ceph-mon[29942]: pgmap v378: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 382 op/s 2024-09-05T01:36:49.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:49 smithi145 ceph-mon[34376]: pgmap v378: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 382 op/s 2024-09-05T01:36:49.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:49 smithi151 ceph-mon[35013]: pgmap v378: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 382 op/s 2024-09-05T01:36:51.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:51 smithi012 ceph-mon[29942]: pgmap v379: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 493 op/s 2024-09-05T01:36:51.603 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:51 smithi145 ceph-mon[34376]: pgmap v379: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 493 op/s 2024-09-05T01:36:51.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:51 smithi151 ceph-mon[35013]: pgmap v379: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 493 op/s 2024-09-05T01:36:53.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:53 smithi012 ceph-mon[29942]: pgmap v380: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 366 op/s 2024-09-05T01:36:53.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:53 smithi145 ceph-mon[34376]: pgmap v380: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 366 op/s 2024-09-05T01:36:53.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:53 smithi151 ceph-mon[35013]: pgmap v380: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 366 op/s 2024-09-05T01:36:55.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:55 smithi012 ceph-mon[29942]: pgmap v381: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 429 op/s 2024-09-05T01:36:55.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:55 smithi145 ceph-mon[34376]: pgmap v381: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 429 op/s 2024-09-05T01:36:55.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:55 smithi151 ceph-mon[35013]: pgmap v381: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 429 op/s 2024-09-05T01:36:57.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:57 smithi012 ceph-mon[29942]: pgmap v382: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 347 op/s 2024-09-05T01:36:57.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:57 smithi145 ceph-mon[34376]: pgmap v382: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 347 op/s 2024-09-05T01:36:57.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:57 smithi151 ceph-mon[35013]: pgmap v382: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 347 op/s 2024-09-05T01:36:59.535 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:36:59 smithi012 ceph-mon[29942]: pgmap v383: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 338 op/s 2024-09-05T01:36:59.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:36:59 smithi145 ceph-mon[34376]: pgmap v383: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 338 op/s 2024-09-05T01:36:59.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:36:59 smithi151 ceph-mon[35013]: pgmap v383: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 338 op/s 2024-09-05T01:37:01.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:01 smithi012 ceph-mon[29942]: pgmap v384: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.0 MiB/s wr, 445 op/s 2024-09-05T01:37:01.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:01 smithi145 ceph-mon[34376]: pgmap v384: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.0 MiB/s wr, 445 op/s 2024-09-05T01:37:01.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:01 smithi151 ceph-mon[35013]: pgmap v384: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.0 MiB/s wr, 445 op/s 2024-09-05T01:37:03.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:03 smithi012 ceph-mon[29942]: pgmap v385: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.2 MiB/s wr, 315 op/s 2024-09-05T01:37:03.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:03 smithi145 ceph-mon[34376]: pgmap v385: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.2 MiB/s wr, 315 op/s 2024-09-05T01:37:03.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:03 smithi151 ceph-mon[35013]: pgmap v385: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.2 MiB/s wr, 315 op/s 2024-09-05T01:37:05.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:05 smithi012 ceph-mon[29942]: pgmap v386: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.0 MiB/s wr, 389 op/s 2024-09-05T01:37:05.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:05 smithi145 ceph-mon[34376]: pgmap v386: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.0 MiB/s wr, 389 op/s 2024-09-05T01:37:05.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:05 smithi151 ceph-mon[35013]: pgmap v386: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.0 MiB/s wr, 389 op/s 2024-09-05T01:37:06.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:06 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:37:06.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:06 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:37:06.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:06 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:37:07.464 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:07 smithi012 ceph-mon[29942]: pgmap v387: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 354 op/s 2024-09-05T01:37:07.464 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:07 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:37:07.464 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:07 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:37:07.465 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:07 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:37:07.505 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:07 smithi151 ceph-mon[35013]: pgmap v387: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 354 op/s 2024-09-05T01:37:07.505 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:07 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:37:07.505 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:07 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:37:07.505 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:07 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:37:07.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:07 smithi145 ceph-mon[34376]: pgmap v387: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.9 MiB/s wr, 354 op/s 2024-09-05T01:37:07.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:07 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:37:07.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:07 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:37:07.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:07 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:37:09.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:09 smithi012 ceph-mon[29942]: pgmap v388: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 339 op/s 2024-09-05T01:37:09.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:09 smithi012 ceph-mon[29942]: osdmap e99: 12 total, 12 up, 12 in 2024-09-05T01:37:09.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:09 smithi145 ceph-mon[34376]: pgmap v388: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 339 op/s 2024-09-05T01:37:09.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:09 smithi145 ceph-mon[34376]: osdmap e99: 12 total, 12 up, 12 in 2024-09-05T01:37:09.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:09 smithi151 ceph-mon[35013]: pgmap v388: 97 pgs: 97 active+clean; 3.5 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 339 op/s 2024-09-05T01:37:09.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:09 smithi151 ceph-mon[35013]: osdmap e99: 12 total, 12 up, 12 in 2024-09-05T01:37:11.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:11 smithi012 ceph-mon[29942]: pgmap v390: 97 pgs: 6 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 81 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 338 op/s 2024-09-05T01:37:11.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:11 smithi145 ceph-mon[34376]: pgmap v390: 97 pgs: 6 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 81 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 338 op/s 2024-09-05T01:37:11.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:11 smithi151 ceph-mon[35013]: pgmap v390: 97 pgs: 6 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 81 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 338 op/s 2024-09-05T01:37:13.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:13 smithi012 ceph-mon[29942]: pgmap v391: 97 pgs: 8 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 73 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 338 op/s 2024-09-05T01:37:13.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:13 smithi145 ceph-mon[34376]: pgmap v391: 97 pgs: 8 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 73 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 338 op/s 2024-09-05T01:37:13.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:13 smithi151 ceph-mon[35013]: pgmap v391: 97 pgs: 8 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 73 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 338 op/s 2024-09-05T01:37:15.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:15 smithi012 ceph-mon[29942]: pgmap v392: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 297 op/s 2024-09-05T01:37:15.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:15 smithi145 ceph-mon[34376]: pgmap v392: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 297 op/s 2024-09-05T01:37:15.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:15 smithi151 ceph-mon[35013]: pgmap v392: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 297 op/s 2024-09-05T01:37:17.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:17 smithi012 ceph-mon[29942]: pgmap v393: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 267 op/s 2024-09-05T01:37:17.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:17 smithi145 ceph-mon[34376]: pgmap v393: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 267 op/s 2024-09-05T01:37:17.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:17 smithi151 ceph-mon[35013]: pgmap v393: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 267 op/s 2024-09-05T01:37:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:19 smithi012 ceph-mon[29942]: pgmap v394: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.8 MiB/s wr, 257 op/s 2024-09-05T01:37:19.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:19 smithi145 ceph-mon[34376]: pgmap v394: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.8 MiB/s wr, 257 op/s 2024-09-05T01:37:19.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:19 smithi151 ceph-mon[35013]: pgmap v394: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.8 MiB/s wr, 257 op/s 2024-09-05T01:37:21.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:21 smithi012 ceph-mon[29942]: pgmap v395: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 202 op/s 2024-09-05T01:37:21.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:21 smithi145 ceph-mon[34376]: pgmap v395: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 202 op/s 2024-09-05T01:37:21.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:21 smithi151 ceph-mon[35013]: pgmap v395: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 202 op/s 2024-09-05T01:37:23.249 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:23 smithi012 ceph-mon[29942]: pgmap v396: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 170 op/s 2024-09-05T01:37:23.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:23 smithi145 ceph-mon[34376]: pgmap v396: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 170 op/s 2024-09-05T01:37:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:23 smithi151 ceph-mon[35013]: pgmap v396: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 170 op/s 2024-09-05T01:37:25.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:25 smithi012 ceph-mon[29942]: pgmap v397: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 201 op/s 2024-09-05T01:37:25.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:25 smithi145 ceph-mon[34376]: pgmap v397: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 201 op/s 2024-09-05T01:37:25.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:25 smithi151 ceph-mon[35013]: pgmap v397: 97 pgs: 24 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 33 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 201 op/s 2024-09-05T01:37:27.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:27 smithi012 ceph-mon[29942]: pgmap v398: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 168 op/s 2024-09-05T01:37:27.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:27 smithi145 ceph-mon[34376]: pgmap v398: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 168 op/s 2024-09-05T01:37:27.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:27 smithi151 ceph-mon[35013]: pgmap v398: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 168 op/s 2024-09-05T01:37:29.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:29 smithi012 ceph-mon[29942]: pgmap v399: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 154 op/s 2024-09-05T01:37:29.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:29 smithi145 ceph-mon[34376]: pgmap v399: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 154 op/s 2024-09-05T01:37:29.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:29 smithi151 ceph-mon[35013]: pgmap v399: 97 pgs: 23 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 35 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 154 op/s 2024-09-05T01:37:31.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:31 smithi012 ceph-mon[29942]: pgmap v400: 97 pgs: 19 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 41 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 208 op/s 2024-09-05T01:37:31.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:31 smithi145 ceph-mon[34376]: pgmap v400: 97 pgs: 19 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 41 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 208 op/s 2024-09-05T01:37:31.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:31 smithi151 ceph-mon[35013]: pgmap v400: 97 pgs: 19 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 41 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 208 op/s 2024-09-05T01:37:33.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:33 smithi012 ceph-mon[29942]: pgmap v401: 97 pgs: 19 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 41 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 149 op/s 2024-09-05T01:37:33.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:33 smithi145 ceph-mon[34376]: pgmap v401: 97 pgs: 19 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 41 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 149 op/s 2024-09-05T01:37:33.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:33 smithi151 ceph-mon[35013]: pgmap v401: 97 pgs: 19 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 41 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 149 op/s 2024-09-05T01:37:35.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:35 smithi012 ceph-mon[29942]: pgmap v402: 97 pgs: 14 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 53 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 190 op/s 2024-09-05T01:37:35.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:35 smithi145 ceph-mon[34376]: pgmap v402: 97 pgs: 14 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 53 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 190 op/s 2024-09-05T01:37:35.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:35 smithi151 ceph-mon[35013]: pgmap v402: 97 pgs: 14 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 53 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 190 op/s 2024-09-05T01:37:37.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:37 smithi012 ceph-mon[29942]: pgmap v403: 97 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 54 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 171 op/s 2024-09-05T01:37:37.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:37 smithi145 ceph-mon[34376]: pgmap v403: 97 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 54 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 171 op/s 2024-09-05T01:37:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:37 smithi151 ceph-mon[35013]: pgmap v403: 97 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 54 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 171 op/s 2024-09-05T01:37:39.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:39 smithi012 ceph-mon[29942]: pgmap v404: 97 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 54 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 161 op/s 2024-09-05T01:37:39.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:39 smithi145 ceph-mon[34376]: pgmap v404: 97 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 54 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 161 op/s 2024-09-05T01:37:39.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:39 smithi151 ceph-mon[35013]: pgmap v404: 97 pgs: 13 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 54 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 161 op/s 2024-09-05T01:37:41.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:41 smithi012 ceph-mon[29942]: pgmap v405: 97 pgs: 10 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 66 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 229 op/s 2024-09-05T01:37:41.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:41 smithi145 ceph-mon[34376]: pgmap v405: 97 pgs: 10 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 66 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 229 op/s 2024-09-05T01:37:41.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:41 smithi151 ceph-mon[35013]: pgmap v405: 97 pgs: 10 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 66 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 229 op/s 2024-09-05T01:37:43.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:43 smithi012 ceph-mon[29942]: pgmap v406: 97 pgs: 10 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 66 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 170 op/s 2024-09-05T01:37:43.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:43 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:37:43.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:43 smithi145 ceph-mon[34376]: pgmap v406: 97 pgs: 10 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 66 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 170 op/s 2024-09-05T01:37:43.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:43 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:37:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:43 smithi151 ceph-mon[35013]: pgmap v406: 97 pgs: 10 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 66 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 170 op/s 2024-09-05T01:37:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:43 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:37:45.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:45 smithi012 ceph-mon[29942]: pgmap v407: 97 pgs: 6 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 81 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 228 op/s 2024-09-05T01:37:45.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:45 smithi145 ceph-mon[34376]: pgmap v407: 97 pgs: 6 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 81 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 228 op/s 2024-09-05T01:37:45.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:45 smithi151 ceph-mon[35013]: pgmap v407: 97 pgs: 6 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 81 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 228 op/s 2024-09-05T01:37:47.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:47 smithi145 ceph-mon[34376]: pgmap v408: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 213 op/s 2024-09-05T01:37:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:47 smithi151 ceph-mon[35013]: pgmap v408: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 213 op/s 2024-09-05T01:37:47.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:47 smithi012 ceph-mon[29942]: pgmap v408: 97 pgs: 3 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 88 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 213 op/s 2024-09-05T01:37:48.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:48 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:37:48.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:48 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:37:48.654 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:48 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:37:49.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:49 smithi145 ceph-mon[34376]: pgmap v409: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 201 op/s 2024-09-05T01:37:49.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:49 smithi151 ceph-mon[35013]: pgmap v409: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 201 op/s 2024-09-05T01:37:49.606 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:49 smithi012 ceph-mon[29942]: pgmap v409: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 201 op/s 2024-09-05T01:37:51.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:51 smithi151 ceph-mon[35013]: pgmap v410: 97 pgs: 97 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 303 op/s 2024-09-05T01:37:51.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:51 smithi012 ceph-mon[29942]: pgmap v410: 97 pgs: 97 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 303 op/s 2024-09-05T01:37:51.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:51 smithi145 ceph-mon[34376]: pgmap v410: 97 pgs: 97 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 303 op/s 2024-09-05T01:37:53.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:53 smithi012 ceph-mon[29942]: pgmap v411: 97 pgs: 97 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 241 op/s 2024-09-05T01:37:53.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:53 smithi012 ceph-mon[29942]: osdmap e100: 12 total, 12 up, 12 in 2024-09-05T01:37:53.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:53 smithi145 ceph-mon[34376]: pgmap v411: 97 pgs: 97 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 241 op/s 2024-09-05T01:37:53.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:53 smithi145 ceph-mon[34376]: osdmap e100: 12 total, 12 up, 12 in 2024-09-05T01:37:53.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:53 smithi151 ceph-mon[35013]: pgmap v411: 97 pgs: 97 active+clean; 3.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 241 op/s 2024-09-05T01:37:53.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:53 smithi151 ceph-mon[35013]: osdmap e100: 12 total, 12 up, 12 in 2024-09-05T01:37:55.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:55 smithi012 ceph-mon[29942]: pgmap v413: 97 pgs: 97 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.9 MiB/s wr, 313 op/s 2024-09-05T01:37:55.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:55 smithi145 ceph-mon[34376]: pgmap v413: 97 pgs: 97 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.9 MiB/s wr, 313 op/s 2024-09-05T01:37:55.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:55 smithi151 ceph-mon[35013]: pgmap v413: 97 pgs: 97 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.9 MiB/s wr, 313 op/s 2024-09-05T01:37:57.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:57 smithi012 ceph-mon[29942]: pgmap v414: 97 pgs: 97 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 322 op/s 2024-09-05T01:37:57.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:57 smithi145 ceph-mon[34376]: pgmap v414: 97 pgs: 97 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 322 op/s 2024-09-05T01:37:57.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:57 smithi151 ceph-mon[35013]: pgmap v414: 97 pgs: 97 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 322 op/s 2024-09-05T01:37:59.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:37:59 smithi012 ceph-mon[29942]: pgmap v415: 97 pgs: 97 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 323 op/s 2024-09-05T01:37:59.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:37:59 smithi145 ceph-mon[34376]: pgmap v415: 97 pgs: 97 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 323 op/s 2024-09-05T01:37:59.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:37:59 smithi151 ceph-mon[35013]: pgmap v415: 97 pgs: 97 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 323 op/s 2024-09-05T01:38:01.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:01 smithi012 ceph-mon[29942]: pgmap v416: 97 pgs: 97 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.7 MiB/s wr, 350 op/s 2024-09-05T01:38:01.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:01 smithi145 ceph-mon[34376]: pgmap v416: 97 pgs: 97 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.7 MiB/s wr, 350 op/s 2024-09-05T01:38:01.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:01 smithi151 ceph-mon[35013]: pgmap v416: 97 pgs: 97 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.7 MiB/s wr, 350 op/s 2024-09-05T01:38:03.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:03 smithi012 ceph-mon[29942]: pgmap v417: 97 pgs: 97 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.7 MiB/s wr, 354 op/s 2024-09-05T01:38:03.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:03 smithi145 ceph-mon[34376]: pgmap v417: 97 pgs: 97 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.7 MiB/s wr, 354 op/s 2024-09-05T01:38:03.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:03 smithi151 ceph-mon[35013]: pgmap v417: 97 pgs: 97 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.7 MiB/s wr, 354 op/s 2024-09-05T01:38:05.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:05 smithi012 ceph-mon[29942]: pgmap v418: 97 pgs: 97 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 353 op/s 2024-09-05T01:38:05.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:05 smithi145 ceph-mon[34376]: pgmap v418: 97 pgs: 97 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 353 op/s 2024-09-05T01:38:05.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:05 smithi151 ceph-mon[35013]: pgmap v418: 97 pgs: 97 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 353 op/s 2024-09-05T01:38:07.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:07 smithi012 ceph-mon[29942]: pgmap v419: 97 pgs: 97 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 288 op/s 2024-09-05T01:38:07.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:07 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:38:07.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:07 smithi145 ceph-mon[34376]: pgmap v419: 97 pgs: 97 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 288 op/s 2024-09-05T01:38:07.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:07 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:38:07.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:07 smithi151 ceph-mon[35013]: pgmap v419: 97 pgs: 97 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 288 op/s 2024-09-05T01:38:07.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:07 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:38:08.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:08 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:38:08.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:08 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:38:08.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:08 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:38:08.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:08 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:38:08.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:08 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:38:08.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:08 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:38:08.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:08 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:38:08.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:08 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:38:08.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:08 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:38:09.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:09 smithi012 ceph-mon[29942]: pgmap v420: 97 pgs: 97 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 257 op/s 2024-09-05T01:38:09.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:09 smithi012 ceph-mon[29942]: osdmap e101: 12 total, 12 up, 12 in 2024-09-05T01:38:09.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:09 smithi145 ceph-mon[34376]: pgmap v420: 97 pgs: 97 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 257 op/s 2024-09-05T01:38:09.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:09 smithi145 ceph-mon[34376]: osdmap e101: 12 total, 12 up, 12 in 2024-09-05T01:38:09.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:09 smithi151 ceph-mon[35013]: pgmap v420: 97 pgs: 97 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 257 op/s 2024-09-05T01:38:09.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:09 smithi151 ceph-mon[35013]: osdmap e101: 12 total, 12 up, 12 in 2024-09-05T01:38:11.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:11 smithi012 ceph-mon[29942]: pgmap v422: 97 pgs: 12 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 77 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 281 op/s 2024-09-05T01:38:11.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:11 smithi145 ceph-mon[34376]: pgmap v422: 97 pgs: 12 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 77 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 281 op/s 2024-09-05T01:38:11.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:11 smithi151 ceph-mon[35013]: pgmap v422: 97 pgs: 12 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 77 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 281 op/s 2024-09-05T01:38:13.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:13 smithi012 ceph-mon[29942]: pgmap v423: 97 pgs: 18 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 69 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 273 op/s 2024-09-05T01:38:13.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:13 smithi145 ceph-mon[34376]: pgmap v423: 97 pgs: 18 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 69 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 273 op/s 2024-09-05T01:38:13.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:13 smithi151 ceph-mon[35013]: pgmap v423: 97 pgs: 18 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 69 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.6 MiB/s wr, 273 op/s 2024-09-05T01:38:15.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:15 smithi012 ceph-mon[29942]: pgmap v424: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.9 MiB/s wr, 258 op/s 2024-09-05T01:38:15.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:15 smithi145 ceph-mon[34376]: pgmap v424: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.9 MiB/s wr, 258 op/s 2024-09-05T01:38:15.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:15 smithi151 ceph-mon[35013]: pgmap v424: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.9 MiB/s wr, 258 op/s 2024-09-05T01:38:17.527 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:17 smithi012 ceph-mon[29942]: pgmap v425: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 232 op/s 2024-09-05T01:38:17.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:17 smithi145 ceph-mon[34376]: pgmap v425: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 232 op/s 2024-09-05T01:38:17.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:17 smithi151 ceph-mon[35013]: pgmap v425: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 232 op/s 2024-09-05T01:38:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:19 smithi012 ceph-mon[29942]: pgmap v426: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 229 op/s 2024-09-05T01:38:19.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:19 smithi145 ceph-mon[34376]: pgmap v426: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 229 op/s 2024-09-05T01:38:19.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:19 smithi151 ceph-mon[35013]: pgmap v426: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 229 op/s 2024-09-05T01:38:21.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:21 smithi012 ceph-mon[29942]: pgmap v427: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 176 op/s 2024-09-05T01:38:21.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:21 smithi145 ceph-mon[34376]: pgmap v427: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 176 op/s 2024-09-05T01:38:21.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:21 smithi151 ceph-mon[35013]: pgmap v427: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 176 op/s 2024-09-05T01:38:23.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:23 smithi012 ceph-mon[29942]: pgmap v428: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 130 op/s 2024-09-05T01:38:23.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:23 smithi145 ceph-mon[34376]: pgmap v428: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 130 op/s 2024-09-05T01:38:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:23 smithi151 ceph-mon[35013]: pgmap v428: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 130 op/s 2024-09-05T01:38:25.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:25 smithi012 ceph-mon[29942]: pgmap v429: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 148 op/s 2024-09-05T01:38:25.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:25 smithi145 ceph-mon[34376]: pgmap v429: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 148 op/s 2024-09-05T01:38:25.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:25 smithi151 ceph-mon[35013]: pgmap v429: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 148 op/s 2024-09-05T01:38:27.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:27 smithi012 ceph-mon[29942]: pgmap v430: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 123 op/s 2024-09-05T01:38:27.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:27 smithi145 ceph-mon[34376]: pgmap v430: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 123 op/s 2024-09-05T01:38:27.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:27 smithi151 ceph-mon[35013]: pgmap v430: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 123 op/s 2024-09-05T01:38:29.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:29 smithi012 ceph-mon[29942]: pgmap v431: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 116 op/s 2024-09-05T01:38:29.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:29 smithi145 ceph-mon[34376]: pgmap v431: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 116 op/s 2024-09-05T01:38:29.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:29 smithi151 ceph-mon[35013]: pgmap v431: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 116 op/s 2024-09-05T01:38:31.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:31 smithi012 ceph-mon[29942]: pgmap v432: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 175 op/s 2024-09-05T01:38:31.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:31 smithi145 ceph-mon[34376]: pgmap v432: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 175 op/s 2024-09-05T01:38:31.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:31 smithi151 ceph-mon[35013]: pgmap v432: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 175 op/s 2024-09-05T01:38:33.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:33 smithi012 ceph-mon[29942]: pgmap v433: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 120 op/s 2024-09-05T01:38:33.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:33 smithi145 ceph-mon[34376]: pgmap v433: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 120 op/s 2024-09-05T01:38:33.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:33 smithi151 ceph-mon[35013]: pgmap v433: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 120 op/s 2024-09-05T01:38:35.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:35 smithi012 ceph-mon[29942]: pgmap v434: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 153 op/s 2024-09-05T01:38:35.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:35 smithi145 ceph-mon[34376]: pgmap v434: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 153 op/s 2024-09-05T01:38:35.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:35 smithi151 ceph-mon[35013]: pgmap v434: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 153 op/s 2024-09-05T01:38:37.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:37 smithi012 ceph-mon[29942]: pgmap v435: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 142 op/s 2024-09-05T01:38:37.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:37 smithi145 ceph-mon[34376]: pgmap v435: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 142 op/s 2024-09-05T01:38:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:37 smithi151 ceph-mon[35013]: pgmap v435: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 142 op/s 2024-09-05T01:38:39.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:39 smithi012 ceph-mon[29942]: pgmap v436: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 135 op/s 2024-09-05T01:38:39.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:39 smithi145 ceph-mon[34376]: pgmap v436: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 135 op/s 2024-09-05T01:38:39.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:39 smithi151 ceph-mon[35013]: pgmap v436: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 135 op/s 2024-09-05T01:38:41.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:41 smithi145 ceph-mon[34376]: pgmap v437: 97 pgs: 35 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 42 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 201 op/s 2024-09-05T01:38:41.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:41 smithi151 ceph-mon[35013]: pgmap v437: 97 pgs: 35 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 42 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 201 op/s 2024-09-05T01:38:41.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:41 smithi012 ceph-mon[29942]: pgmap v437: 97 pgs: 35 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 42 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 201 op/s 2024-09-05T01:38:43.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:43 smithi145 ceph-mon[34376]: pgmap v438: 97 pgs: 35 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 42 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 144 op/s 2024-09-05T01:38:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:43 smithi151 ceph-mon[35013]: pgmap v438: 97 pgs: 35 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 42 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 144 op/s 2024-09-05T01:38:43.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:43 smithi012 ceph-mon[29942]: pgmap v438: 97 pgs: 35 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 42 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 144 op/s 2024-09-05T01:38:45.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:45 smithi151 ceph-mon[35013]: pgmap v439: 97 pgs: 35 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 45 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 183 op/s 2024-09-05T01:38:45.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:45 smithi012 ceph-mon[29942]: pgmap v439: 97 pgs: 35 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 45 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 183 op/s 2024-09-05T01:38:45.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:45 smithi145 ceph-mon[34376]: pgmap v439: 97 pgs: 35 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 45 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 183 op/s 2024-09-05T01:38:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:47 smithi151 ceph-mon[35013]: pgmap v440: 97 pgs: 35 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 46 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 169 op/s 2024-09-05T01:38:47.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:47 smithi012 ceph-mon[29942]: pgmap v440: 97 pgs: 35 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 46 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 169 op/s 2024-09-05T01:38:47.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:47 smithi145 ceph-mon[34376]: pgmap v440: 97 pgs: 35 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 46 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 169 op/s 2024-09-05T01:38:49.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:49 smithi151 ceph-mon[35013]: pgmap v441: 97 pgs: 35 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 46 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 161 op/s 2024-09-05T01:38:49.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:49 smithi012 ceph-mon[29942]: pgmap v441: 97 pgs: 35 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 46 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 161 op/s 2024-09-05T01:38:49.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:49 smithi145 ceph-mon[34376]: pgmap v441: 97 pgs: 35 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 46 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 161 op/s 2024-09-05T01:38:51.744 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:51 smithi012 ceph-mon[29942]: pgmap v442: 97 pgs: 32 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 50 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 226 op/s 2024-09-05T01:38:51.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:51 smithi145 ceph-mon[34376]: pgmap v442: 97 pgs: 32 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 50 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 226 op/s 2024-09-05T01:38:51.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:51 smithi151 ceph-mon[35013]: pgmap v442: 97 pgs: 32 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 50 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 226 op/s 2024-09-05T01:38:53.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:53 smithi012 ceph-mon[29942]: pgmap v443: 97 pgs: 32 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 50 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 162 op/s 2024-09-05T01:38:53.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:53 smithi145 ceph-mon[34376]: pgmap v443: 97 pgs: 32 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 50 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 162 op/s 2024-09-05T01:38:53.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:53 smithi151 ceph-mon[35013]: pgmap v443: 97 pgs: 32 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 50 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 162 op/s 2024-09-05T01:38:55.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:55 smithi012 ceph-mon[29942]: pgmap v444: 97 pgs: 25 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 60 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 202 op/s 2024-09-05T01:38:55.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:55 smithi145 ceph-mon[34376]: pgmap v444: 97 pgs: 25 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 60 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 202 op/s 2024-09-05T01:38:55.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:55 smithi151 ceph-mon[35013]: pgmap v444: 97 pgs: 25 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 60 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 202 op/s 2024-09-05T01:38:57.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:57 smithi012 ceph-mon[29942]: pgmap v445: 97 pgs: 16 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 71 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 185 op/s 2024-09-05T01:38:57.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:57 smithi145 ceph-mon[34376]: pgmap v445: 97 pgs: 16 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 71 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 185 op/s 2024-09-05T01:38:57.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:57 smithi151 ceph-mon[35013]: pgmap v445: 97 pgs: 16 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 71 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 185 op/s 2024-09-05T01:38:59.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:38:59 smithi012 ceph-mon[29942]: pgmap v446: 97 pgs: 16 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 71 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 173 op/s 2024-09-05T01:38:59.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:38:59 smithi145 ceph-mon[34376]: pgmap v446: 97 pgs: 16 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 71 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 173 op/s 2024-09-05T01:38:59.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:38:59 smithi151 ceph-mon[35013]: pgmap v446: 97 pgs: 16 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 71 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 173 op/s 2024-09-05T01:39:01.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:01 smithi012 ceph-mon[29942]: pgmap v447: 97 pgs: 16 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 73 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 244 op/s 2024-09-05T01:39:01.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:01 smithi145 ceph-mon[34376]: pgmap v447: 97 pgs: 16 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 73 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 244 op/s 2024-09-05T01:39:01.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:01 smithi151 ceph-mon[35013]: pgmap v447: 97 pgs: 16 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 73 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.7 MiB/s wr, 244 op/s 2024-09-05T01:39:03.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:03 smithi012 ceph-mon[29942]: pgmap v448: 97 pgs: 16 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 73 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 181 op/s 2024-09-05T01:39:03.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:03 smithi145 ceph-mon[34376]: pgmap v448: 97 pgs: 16 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 73 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 181 op/s 2024-09-05T01:39:03.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:03 smithi151 ceph-mon[35013]: pgmap v448: 97 pgs: 16 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 73 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 181 op/s 2024-09-05T01:39:05.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:05 smithi012 ceph-mon[29942]: pgmap v449: 97 pgs: 6 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 87 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 217 op/s 2024-09-05T01:39:05.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:05 smithi145 ceph-mon[34376]: pgmap v449: 97 pgs: 6 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 87 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 217 op/s 2024-09-05T01:39:05.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:05 smithi151 ceph-mon[35013]: pgmap v449: 97 pgs: 6 active+clean+snaptrim_wait, 4 active+clean+snaptrim, 87 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 217 op/s 2024-09-05T01:39:07.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:07 smithi151 ceph-mon[35013]: pgmap v450: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 203 op/s 2024-09-05T01:39:07.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:07 smithi012 ceph-mon[29942]: pgmap v450: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 203 op/s 2024-09-05T01:39:07.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:07 smithi145 ceph-mon[34376]: pgmap v450: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 203 op/s 2024-09-05T01:39:08.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:08 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:39:08.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:08 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:39:08.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:08 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:39:09.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:09 smithi012 ceph-mon[29942]: pgmap v451: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 184 op/s 2024-09-05T01:39:09.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:09 smithi012 ceph-mon[29942]: osdmap e102: 12 total, 12 up, 12 in 2024-09-05T01:39:09.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:09 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:39:09.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:09 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:39:09.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:09 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:39:09.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:09 smithi145 ceph-mon[34376]: pgmap v451: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 184 op/s 2024-09-05T01:39:09.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:09 smithi145 ceph-mon[34376]: osdmap e102: 12 total, 12 up, 12 in 2024-09-05T01:39:09.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:09 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:39:09.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:09 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:39:09.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:09 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:39:09.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:09 smithi151 ceph-mon[35013]: pgmap v451: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 184 op/s 2024-09-05T01:39:09.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:09 smithi151 ceph-mon[35013]: osdmap e102: 12 total, 12 up, 12 in 2024-09-05T01:39:09.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:09 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:39:09.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:09 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:39:09.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:09 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:39:11.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:11 smithi012 ceph-mon[29942]: pgmap v453: 97 pgs: 16 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 71 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 259 op/s 2024-09-05T01:39:11.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:11 smithi145 ceph-mon[34376]: pgmap v453: 97 pgs: 16 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 71 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 259 op/s 2024-09-05T01:39:11.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:11 smithi151 ceph-mon[35013]: pgmap v453: 97 pgs: 16 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 71 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 259 op/s 2024-09-05T01:39:13.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:13 smithi012 ceph-mon[29942]: pgmap v454: 97 pgs: 22 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 63 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 264 op/s 2024-09-05T01:39:13.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:13 smithi012 ceph-mon[29942]: osdmap e103: 12 total, 12 up, 12 in 2024-09-05T01:39:13.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:13 smithi145 ceph-mon[34376]: pgmap v454: 97 pgs: 22 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 63 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 264 op/s 2024-09-05T01:39:13.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:13 smithi145 ceph-mon[34376]: osdmap e103: 12 total, 12 up, 12 in 2024-09-05T01:39:13.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:13 smithi151 ceph-mon[35013]: pgmap v454: 97 pgs: 22 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 63 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 264 op/s 2024-09-05T01:39:13.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:13 smithi151 ceph-mon[35013]: osdmap e103: 12 total, 12 up, 12 in 2024-09-05T01:39:15.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:15 smithi012 ceph-mon[29942]: pgmap v456: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 280 op/s 2024-09-05T01:39:15.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:15 smithi145 ceph-mon[34376]: pgmap v456: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 280 op/s 2024-09-05T01:39:15.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:15 smithi151 ceph-mon[35013]: pgmap v456: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 280 op/s 2024-09-05T01:39:17.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:17 smithi012 ceph-mon[29942]: pgmap v457: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 295 op/s 2024-09-05T01:39:17.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:17 smithi145 ceph-mon[34376]: pgmap v457: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 295 op/s 2024-09-05T01:39:17.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:17 smithi151 ceph-mon[35013]: pgmap v457: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 295 op/s 2024-09-05T01:39:19.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:19 smithi012 ceph-mon[29942]: pgmap v458: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 170 op/s 2024-09-05T01:39:19.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:19 smithi145 ceph-mon[34376]: pgmap v458: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 170 op/s 2024-09-05T01:39:19.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:19 smithi151 ceph-mon[35013]: pgmap v458: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 170 op/s 2024-09-05T01:39:21.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:21 smithi012 ceph-mon[29942]: pgmap v459: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 171 op/s 2024-09-05T01:39:21.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:21 smithi145 ceph-mon[34376]: pgmap v459: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 171 op/s 2024-09-05T01:39:21.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:21 smithi151 ceph-mon[35013]: pgmap v459: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 171 op/s 2024-09-05T01:39:23.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:23 smithi012 ceph-mon[29942]: pgmap v460: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 164 op/s 2024-09-05T01:39:23.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:23 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:39:23.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:23 smithi145 ceph-mon[34376]: pgmap v460: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 164 op/s 2024-09-05T01:39:23.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:23 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:39:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:23 smithi151 ceph-mon[35013]: pgmap v460: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 164 op/s 2024-09-05T01:39:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:23 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:39:25.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:25 smithi012 ceph-mon[29942]: pgmap v461: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 190 op/s 2024-09-05T01:39:25.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:25 smithi145 ceph-mon[34376]: pgmap v461: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 190 op/s 2024-09-05T01:39:25.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:25 smithi151 ceph-mon[35013]: pgmap v461: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 190 op/s 2024-09-05T01:39:27.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:27 smithi012 ceph-mon[29942]: pgmap v462: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 160 op/s 2024-09-05T01:39:27.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:27 smithi145 ceph-mon[34376]: pgmap v462: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 160 op/s 2024-09-05T01:39:27.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:27 smithi151 ceph-mon[35013]: pgmap v462: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 160 op/s 2024-09-05T01:39:29.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:29 smithi012 ceph-mon[29942]: pgmap v463: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 147 op/s 2024-09-05T01:39:29.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:29 smithi145 ceph-mon[34376]: pgmap v463: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 147 op/s 2024-09-05T01:39:29.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:29 smithi151 ceph-mon[35013]: pgmap v463: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 147 op/s 2024-09-05T01:39:31.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:31 smithi012 ceph-mon[29942]: pgmap v464: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 202 op/s 2024-09-05T01:39:31.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:31 smithi145 ceph-mon[34376]: pgmap v464: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 202 op/s 2024-09-05T01:39:31.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:31 smithi151 ceph-mon[35013]: pgmap v464: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 202 op/s 2024-09-05T01:39:33.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:33 smithi012 ceph-mon[29942]: pgmap v465: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 147 op/s 2024-09-05T01:39:33.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:33 smithi145 ceph-mon[34376]: pgmap v465: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 147 op/s 2024-09-05T01:39:33.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:33 smithi151 ceph-mon[35013]: pgmap v465: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 147 op/s 2024-09-05T01:39:35.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:35 smithi012 ceph-mon[29942]: pgmap v466: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 185 op/s 2024-09-05T01:39:35.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:35 smithi145 ceph-mon[34376]: pgmap v466: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 185 op/s 2024-09-05T01:39:35.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:35 smithi151 ceph-mon[35013]: pgmap v466: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 185 op/s 2024-09-05T01:39:37.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:37 smithi012 ceph-mon[29942]: pgmap v467: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 154 op/s 2024-09-05T01:39:37.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:37 smithi145 ceph-mon[34376]: pgmap v467: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 154 op/s 2024-09-05T01:39:37.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:37 smithi151 ceph-mon[35013]: pgmap v467: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 154 op/s 2024-09-05T01:39:39.565 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:39 smithi012 ceph-mon[29942]: pgmap v468: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 143 op/s 2024-09-05T01:39:39.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:39 smithi145 ceph-mon[34376]: pgmap v468: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 143 op/s 2024-09-05T01:39:39.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:39 smithi151 ceph-mon[35013]: pgmap v468: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 143 op/s 2024-09-05T01:39:41.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:41 smithi145 ceph-mon[34376]: pgmap v469: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 199 op/s 2024-09-05T01:39:41.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:41 smithi151 ceph-mon[35013]: pgmap v469: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 199 op/s 2024-09-05T01:39:41.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:41 smithi012 ceph-mon[29942]: pgmap v469: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 199 op/s 2024-09-05T01:39:43.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:43 smithi145 ceph-mon[34376]: pgmap v470: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 143 op/s 2024-09-05T01:39:43.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:43 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:39:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:43 smithi151 ceph-mon[35013]: pgmap v470: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 143 op/s 2024-09-05T01:39:43.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:43 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:39:43.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:43 smithi012 ceph-mon[29942]: pgmap v470: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 143 op/s 2024-09-05T01:39:43.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:43 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:39:45.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:45 smithi151 ceph-mon[35013]: pgmap v471: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 180 op/s 2024-09-05T01:39:45.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:45 smithi012 ceph-mon[29942]: pgmap v471: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 180 op/s 2024-09-05T01:39:45.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:45 smithi145 ceph-mon[34376]: pgmap v471: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 180 op/s 2024-09-05T01:39:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:47 smithi151 ceph-mon[35013]: pgmap v472: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 153 op/s 2024-09-05T01:39:47.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:47 smithi012 ceph-mon[29942]: pgmap v472: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 153 op/s 2024-09-05T01:39:47.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:47 smithi145 ceph-mon[34376]: pgmap v472: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 153 op/s 2024-09-05T01:39:49.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:49 smithi151 ceph-mon[35013]: pgmap v473: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 150 op/s 2024-09-05T01:39:49.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:49 smithi012 ceph-mon[29942]: pgmap v473: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 150 op/s 2024-09-05T01:39:49.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:49 smithi145 ceph-mon[34376]: pgmap v473: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.5 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 150 op/s 2024-09-05T01:39:51.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:51 smithi151 ceph-mon[35013]: pgmap v474: 97 pgs: 37 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 38 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 191 op/s 2024-09-05T01:39:51.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:51 smithi012 ceph-mon[29942]: pgmap v474: 97 pgs: 37 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 38 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 191 op/s 2024-09-05T01:39:51.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:51 smithi145 ceph-mon[34376]: pgmap v474: 97 pgs: 37 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 38 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 191 op/s 2024-09-05T01:39:53.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:53 smithi012 ceph-mon[29942]: pgmap v475: 97 pgs: 37 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 38 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 135 op/s 2024-09-05T01:39:53.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:53 smithi145 ceph-mon[34376]: pgmap v475: 97 pgs: 37 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 38 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 135 op/s 2024-09-05T01:39:53.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:53 smithi151 ceph-mon[35013]: pgmap v475: 97 pgs: 37 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 38 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 135 op/s 2024-09-05T01:39:55.616 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:55 smithi012 ceph-mon[29942]: pgmap v476: 97 pgs: 35 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 168 op/s 2024-09-05T01:39:55.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:55 smithi145 ceph-mon[34376]: pgmap v476: 97 pgs: 35 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 168 op/s 2024-09-05T01:39:55.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:55 smithi151 ceph-mon[35013]: pgmap v476: 97 pgs: 35 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 168 op/s 2024-09-05T01:39:57.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:57 smithi012 ceph-mon[29942]: pgmap v477: 97 pgs: 35 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 142 op/s 2024-09-05T01:39:57.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:57 smithi145 ceph-mon[34376]: pgmap v477: 97 pgs: 35 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 142 op/s 2024-09-05T01:39:57.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:57 smithi151 ceph-mon[35013]: pgmap v477: 97 pgs: 35 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 142 op/s 2024-09-05T01:39:59.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:39:59 smithi012 ceph-mon[29942]: pgmap v478: 97 pgs: 35 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 131 op/s 2024-09-05T01:39:59.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:39:59 smithi145 ceph-mon[34376]: pgmap v478: 97 pgs: 35 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 131 op/s 2024-09-05T01:39:59.856 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:39:59 smithi151 ceph-mon[35013]: pgmap v478: 97 pgs: 35 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 41 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 131 op/s 2024-09-05T01:40:00.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:00 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-a[29938]: 2024-09-05T01:39:59.999+0000 7f4037200640 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-09-05T01:40:00.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:00 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-a[29938]: 2024-09-05T01:39:59.999+0000 7f4037200640 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-09-05T01:40:00.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:00 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-a[29938]: 2024-09-05T01:39:59.999+0000 7f4037200640 -1 log_channel(cluster) log [ERR] : mds.h(mds.2): Metadata damage detected 2024-09-05T01:40:00.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:00 smithi012 ceph-mon[29942]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-09-05T01:40:00.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:00 smithi012 ceph-mon[29942]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-09-05T01:40:00.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:00 smithi012 ceph-mon[29942]: mds.h(mds.2): Metadata damage detected 2024-09-05T01:40:00.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:00 smithi145 ceph-mon[34376]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-09-05T01:40:00.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:00 smithi145 ceph-mon[34376]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-09-05T01:40:00.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:00 smithi145 ceph-mon[34376]: mds.h(mds.2): Metadata damage detected 2024-09-05T01:40:00.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:00 smithi151 ceph-mon[35013]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-09-05T01:40:00.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:00 smithi151 ceph-mon[35013]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-09-05T01:40:00.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:00 smithi151 ceph-mon[35013]: mds.h(mds.2): Metadata damage detected 2024-09-05T01:40:01.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:01 smithi012 ceph-mon[29942]: pgmap v479: 97 pgs: 35 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 45 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 184 op/s 2024-09-05T01:40:01.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:01 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:40:01.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:01 smithi145 ceph-mon[34376]: pgmap v479: 97 pgs: 35 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 45 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 184 op/s 2024-09-05T01:40:01.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:01 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:40:01.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:01 smithi151 ceph-mon[35013]: pgmap v479: 97 pgs: 35 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 45 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 184 op/s 2024-09-05T01:40:01.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:01 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:40:03.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:03 smithi012 ceph-mon[29942]: pgmap v480: 97 pgs: 35 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 45 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 143 op/s 2024-09-05T01:40:03.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:03 smithi145 ceph-mon[34376]: pgmap v480: 97 pgs: 35 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 45 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 143 op/s 2024-09-05T01:40:03.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:03 smithi151 ceph-mon[35013]: pgmap v480: 97 pgs: 35 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 45 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 143 op/s 2024-09-05T01:40:05.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:05 smithi012 ceph-mon[29942]: pgmap v481: 97 pgs: 33 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 49 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 179 op/s 2024-09-05T01:40:05.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:05 smithi145 ceph-mon[34376]: pgmap v481: 97 pgs: 33 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 49 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 179 op/s 2024-09-05T01:40:05.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:05 smithi151 ceph-mon[35013]: pgmap v481: 97 pgs: 33 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 49 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 179 op/s 2024-09-05T01:40:07.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:07 smithi012 ceph-mon[29942]: pgmap v482: 97 pgs: 33 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 49 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 166 op/s 2024-09-05T01:40:07.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:07 smithi145 ceph-mon[34376]: pgmap v482: 97 pgs: 33 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 49 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 166 op/s 2024-09-05T01:40:07.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:07 smithi151 ceph-mon[35013]: pgmap v482: 97 pgs: 33 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 49 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 166 op/s 2024-09-05T01:40:09.819 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:09 smithi012 ceph-mon[29942]: pgmap v483: 97 pgs: 33 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 49 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 153 op/s 2024-09-05T01:40:09.820 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:09 smithi012 ceph-mon[29942]: osdmap e104: 12 total, 12 up, 12 in 2024-09-05T01:40:09.820 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:09 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:40:09.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:09 smithi145 ceph-mon[34376]: pgmap v483: 97 pgs: 33 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 49 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 153 op/s 2024-09-05T01:40:09.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:09 smithi145 ceph-mon[34376]: osdmap e104: 12 total, 12 up, 12 in 2024-09-05T01:40:09.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:09 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:40:09.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:09 smithi151 ceph-mon[35013]: pgmap v483: 97 pgs: 33 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 49 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 153 op/s 2024-09-05T01:40:09.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:09 smithi151 ceph-mon[35013]: osdmap e104: 12 total, 12 up, 12 in 2024-09-05T01:40:09.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:09 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:40:11.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:11 smithi012 ceph-mon[29942]: pgmap v485: 97 pgs: 40 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 35 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 148 op/s 2024-09-05T01:40:11.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:11 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:40:11.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:11 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:40:11.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:11 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:40:11.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:11 smithi145 ceph-mon[34376]: pgmap v485: 97 pgs: 40 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 35 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 148 op/s 2024-09-05T01:40:11.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:11 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:40:11.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:11 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:40:11.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:11 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:40:11.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:11 smithi151 ceph-mon[35013]: pgmap v485: 97 pgs: 40 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 35 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 148 op/s 2024-09-05T01:40:11.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:11 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:40:11.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:11 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:40:11.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:11 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:40:13.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:13 smithi012 ceph-mon[29942]: pgmap v486: 97 pgs: 40 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 35 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 145 op/s 2024-09-05T01:40:13.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:13 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:40:13.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:13 smithi145 ceph-mon[34376]: pgmap v486: 97 pgs: 40 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 35 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 145 op/s 2024-09-05T01:40:13.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:13 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:40:13.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:13 smithi151 ceph-mon[35013]: pgmap v486: 97 pgs: 40 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 35 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 145 op/s 2024-09-05T01:40:13.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:13 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:40:15.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:15 smithi012 ceph-mon[29942]: pgmap v487: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 138 op/s 2024-09-05T01:40:15.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:15 smithi145 ceph-mon[34376]: pgmap v487: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 138 op/s 2024-09-05T01:40:15.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:15 smithi151 ceph-mon[35013]: pgmap v487: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 138 op/s 2024-09-05T01:40:17.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:17 smithi012 ceph-mon[29942]: pgmap v488: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 140 op/s 2024-09-05T01:40:17.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:17 smithi145 ceph-mon[34376]: pgmap v488: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 140 op/s 2024-09-05T01:40:17.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:17 smithi151 ceph-mon[35013]: pgmap v488: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 140 op/s 2024-09-05T01:40:18.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:18 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:40:18.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:18 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:40:18.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:18 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:40:19.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:19 smithi012 ceph-mon[29942]: pgmap v489: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 142 op/s 2024-09-05T01:40:19.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:19 smithi145 ceph-mon[34376]: pgmap v489: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 142 op/s 2024-09-05T01:40:19.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:19 smithi151 ceph-mon[35013]: pgmap v489: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.9 MiB/s wr, 142 op/s 2024-09-05T01:40:21.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:21 smithi012 ceph-mon[29942]: pgmap v490: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 237 op/s 2024-09-05T01:40:21.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:21 smithi145 ceph-mon[34376]: pgmap v490: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 237 op/s 2024-09-05T01:40:21.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:21 smithi151 ceph-mon[35013]: pgmap v490: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 237 op/s 2024-09-05T01:40:23.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:23 smithi012 ceph-mon[29942]: pgmap v491: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 200 op/s 2024-09-05T01:40:23.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:23 smithi145 ceph-mon[34376]: pgmap v491: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 200 op/s 2024-09-05T01:40:23.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:23 smithi151 ceph-mon[35013]: pgmap v491: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 200 op/s 2024-09-05T01:40:25.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:25 smithi012 ceph-mon[29942]: pgmap v492: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 225 op/s 2024-09-05T01:40:25.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:25 smithi145 ceph-mon[34376]: pgmap v492: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 225 op/s 2024-09-05T01:40:25.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:25 smithi151 ceph-mon[35013]: pgmap v492: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 225 op/s 2024-09-05T01:40:27.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:27 smithi012 ceph-mon[29942]: pgmap v493: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 223 op/s 2024-09-05T01:40:27.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:27 smithi145 ceph-mon[34376]: pgmap v493: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 223 op/s 2024-09-05T01:40:27.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:27 smithi151 ceph-mon[35013]: pgmap v493: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 223 op/s 2024-09-05T01:40:29.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:29 smithi012 ceph-mon[29942]: pgmap v494: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 201 op/s 2024-09-05T01:40:29.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:29 smithi145 ceph-mon[34376]: pgmap v494: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 201 op/s 2024-09-05T01:40:29.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:29 smithi151 ceph-mon[35013]: pgmap v494: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 201 op/s 2024-09-05T01:40:31.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:31 smithi012 ceph-mon[29942]: pgmap v495: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 253 op/s 2024-09-05T01:40:31.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:31 smithi145 ceph-mon[34376]: pgmap v495: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 253 op/s 2024-09-05T01:40:31.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:31 smithi151 ceph-mon[35013]: pgmap v495: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 253 op/s 2024-09-05T01:40:33.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:33 smithi012 ceph-mon[29942]: pgmap v496: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 148 op/s 2024-09-05T01:40:33.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:33 smithi145 ceph-mon[34376]: pgmap v496: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 148 op/s 2024-09-05T01:40:33.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:33 smithi151 ceph-mon[35013]: pgmap v496: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 148 op/s 2024-09-05T01:40:35.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:35 smithi145 ceph-mon[34376]: pgmap v497: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 173 op/s 2024-09-05T01:40:35.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:35 smithi151 ceph-mon[35013]: pgmap v497: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 173 op/s 2024-09-05T01:40:36.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:35 smithi012 ceph-mon[29942]: pgmap v497: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 173 op/s 2024-09-05T01:40:37.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:37 smithi145 ceph-mon[34376]: pgmap v498: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 174 op/s 2024-09-05T01:40:37.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:37 smithi151 ceph-mon[35013]: pgmap v498: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 174 op/s 2024-09-05T01:40:38.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:37 smithi012 ceph-mon[29942]: pgmap v498: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 174 op/s 2024-09-05T01:40:39.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:39 smithi145 ceph-mon[34376]: pgmap v499: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 147 op/s 2024-09-05T01:40:39.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:39 smithi151 ceph-mon[35013]: pgmap v499: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 147 op/s 2024-09-05T01:40:40.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:39 smithi012 ceph-mon[29942]: pgmap v499: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 147 op/s 2024-09-05T01:40:41.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:41 smithi151 ceph-mon[35013]: pgmap v500: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 198 op/s 2024-09-05T01:40:41.981 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:41 smithi012 ceph-mon[29942]: pgmap v500: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 198 op/s 2024-09-05T01:40:41.982 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:40:41 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:40:41.976+0000 7f2df0600640 -1 calc_pg_upmaps abort due to max <= 0 2024-09-05T01:40:42.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:41 smithi145 ceph-mon[34376]: pgmap v500: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.4 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 198 op/s 2024-09-05T01:40:44.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:43 smithi012 ceph-mon[29942]: pgmap v501: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 153 op/s 2024-09-05T01:40:44.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:43 smithi145 ceph-mon[34376]: pgmap v501: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 153 op/s 2024-09-05T01:40:44.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:43 smithi151 ceph-mon[35013]: pgmap v501: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 153 op/s 2024-09-05T01:40:46.062 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:45 smithi012 ceph-mon[29942]: pgmap v502: 97 pgs: 40 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 34 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 167 op/s 2024-09-05T01:40:46.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:45 smithi145 ceph-mon[34376]: pgmap v502: 97 pgs: 40 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 34 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 167 op/s 2024-09-05T01:40:46.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:45 smithi151 ceph-mon[35013]: pgmap v502: 97 pgs: 40 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 34 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 167 op/s 2024-09-05T01:40:48.064 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:47 smithi012 ceph-mon[29942]: pgmap v503: 97 pgs: 39 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 36 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 161 op/s 2024-09-05T01:40:48.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:47 smithi145 ceph-mon[34376]: pgmap v503: 97 pgs: 39 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 36 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 161 op/s 2024-09-05T01:40:48.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:47 smithi151 ceph-mon[35013]: pgmap v503: 97 pgs: 39 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 36 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 161 op/s 2024-09-05T01:40:49.991 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:49 smithi012 ceph-mon[29942]: pgmap v504: 97 pgs: 39 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 36 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 136 op/s 2024-09-05T01:40:50.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:49 smithi145 ceph-mon[34376]: pgmap v504: 97 pgs: 39 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 36 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 136 op/s 2024-09-05T01:40:50.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:49 smithi151 ceph-mon[35013]: pgmap v504: 97 pgs: 39 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 36 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 136 op/s 2024-09-05T01:40:52.064 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:51 smithi012 ceph-mon[29942]: pgmap v505: 97 pgs: 37 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 40 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 179 op/s 2024-09-05T01:40:52.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:51 smithi145 ceph-mon[34376]: pgmap v505: 97 pgs: 37 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 40 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 179 op/s 2024-09-05T01:40:52.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:51 smithi151 ceph-mon[35013]: pgmap v505: 97 pgs: 37 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 40 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 179 op/s 2024-09-05T01:40:54.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:53 smithi012 ceph-mon[29942]: pgmap v506: 97 pgs: 37 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 40 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 133 op/s 2024-09-05T01:40:54.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:53 smithi145 ceph-mon[34376]: pgmap v506: 97 pgs: 37 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 40 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 133 op/s 2024-09-05T01:40:54.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:53 smithi151 ceph-mon[35013]: pgmap v506: 97 pgs: 37 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 40 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 133 op/s 2024-09-05T01:40:54.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:54 smithi012 ceph-mon[29942]: pgmap v507: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 150 op/s 2024-09-05T01:40:55.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:54 smithi145 ceph-mon[34376]: pgmap v507: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 150 op/s 2024-09-05T01:40:55.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:54 smithi151 ceph-mon[35013]: pgmap v507: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 150 op/s 2024-09-05T01:40:57.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:57 smithi012 ceph-mon[29942]: pgmap v508: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 156 op/s 2024-09-05T01:40:57.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:57 smithi145 ceph-mon[34376]: pgmap v508: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 156 op/s 2024-09-05T01:40:57.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:57 smithi151 ceph-mon[35013]: pgmap v508: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 156 op/s 2024-09-05T01:40:59.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:40:59 smithi012 ceph-mon[29942]: pgmap v509: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 138 op/s 2024-09-05T01:40:59.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:40:59 smithi145 ceph-mon[34376]: pgmap v509: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 138 op/s 2024-09-05T01:40:59.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:40:59 smithi151 ceph-mon[35013]: pgmap v509: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 138 op/s 2024-09-05T01:41:01.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:01 smithi012 ceph-mon[29942]: pgmap v510: 97 pgs: 33 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 47 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 191 op/s 2024-09-05T01:41:01.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:01 smithi145 ceph-mon[34376]: pgmap v510: 97 pgs: 33 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 47 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 191 op/s 2024-09-05T01:41:01.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:01 smithi151 ceph-mon[35013]: pgmap v510: 97 pgs: 33 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 47 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 191 op/s 2024-09-05T01:41:03.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:03 smithi012 ceph-mon[29942]: pgmap v511: 97 pgs: 33 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 47 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 155 op/s 2024-09-05T01:41:03.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:03 smithi012 ceph-mon[29942]: osdmap e105: 12 total, 12 up, 12 in 2024-09-05T01:41:03.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:03 smithi145 ceph-mon[34376]: pgmap v511: 97 pgs: 33 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 47 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 155 op/s 2024-09-05T01:41:03.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:03 smithi145 ceph-mon[34376]: osdmap e105: 12 total, 12 up, 12 in 2024-09-05T01:41:03.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:03 smithi151 ceph-mon[35013]: pgmap v511: 97 pgs: 33 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 47 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 155 op/s 2024-09-05T01:41:03.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:03 smithi151 ceph-mon[35013]: osdmap e105: 12 total, 12 up, 12 in 2024-09-05T01:41:04.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:04 smithi012 ceph-mon[29942]: osdmap e106: 12 total, 12 up, 12 in 2024-09-05T01:41:04.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:04 smithi145 ceph-mon[34376]: osdmap e106: 12 total, 12 up, 12 in 2024-09-05T01:41:04.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:04 smithi151 ceph-mon[35013]: osdmap e106: 12 total, 12 up, 12 in 2024-09-05T01:41:05.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:05 smithi012 ceph-mon[29942]: pgmap v514: 97 pgs: 37 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 38 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 168 op/s 2024-09-05T01:41:05.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:05 smithi145 ceph-mon[34376]: pgmap v514: 97 pgs: 37 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 38 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 168 op/s 2024-09-05T01:41:05.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:05 smithi151 ceph-mon[35013]: pgmap v514: 97 pgs: 37 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 38 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 168 op/s 2024-09-05T01:41:07.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:07 smithi012 ceph-mon[29942]: pgmap v515: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 224 op/s 2024-09-05T01:41:07.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:07 smithi145 ceph-mon[34376]: pgmap v515: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 224 op/s 2024-09-05T01:41:07.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:07 smithi151 ceph-mon[35013]: pgmap v515: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 224 op/s 2024-09-05T01:41:08.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:08 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:41:08.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:08 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:41:08.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:08 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:41:09.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:09 smithi012 ceph-mon[29942]: pgmap v516: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 1.0 MiB/s wr, 142 op/s 2024-09-05T01:41:09.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:09 smithi145 ceph-mon[34376]: pgmap v516: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 1.0 MiB/s wr, 142 op/s 2024-09-05T01:41:09.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:09 smithi151 ceph-mon[35013]: pgmap v516: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 1.0 MiB/s wr, 142 op/s 2024-09-05T01:41:11.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:11 smithi145 ceph-mon[34376]: pgmap v517: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 226 op/s 2024-09-05T01:41:11.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:11 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:41:11.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:11 smithi151 ceph-mon[35013]: pgmap v517: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 226 op/s 2024-09-05T01:41:11.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:11 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:41:11.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:11 smithi012 ceph-mon[29942]: pgmap v517: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 226 op/s 2024-09-05T01:41:11.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:11 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:41:12.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:12 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:41:12.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:12 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:41:12.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:12 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:41:12.767 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:12 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:41:12.767 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:12 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:41:12.767 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:12 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:41:12.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:12 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:41:12.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:12 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:41:12.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:12 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:41:13.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:13 smithi151 ceph-mon[35013]: pgmap v518: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 227 op/s 2024-09-05T01:41:13.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:13 smithi012 ceph-mon[29942]: pgmap v518: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 227 op/s 2024-09-05T01:41:13.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:13 smithi145 ceph-mon[34376]: pgmap v518: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.3 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 227 op/s 2024-09-05T01:41:15.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:15 smithi151 ceph-mon[35013]: pgmap v519: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 524 op/s 2024-09-05T01:41:15.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:15 smithi012 ceph-mon[29942]: pgmap v519: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 524 op/s 2024-09-05T01:41:15.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:15 smithi145 ceph-mon[34376]: pgmap v519: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 524 op/s 2024-09-05T01:41:17.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:17 smithi012 ceph-mon[29942]: pgmap v520: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 838 op/s 2024-09-05T01:41:17.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:17 smithi145 ceph-mon[34376]: pgmap v520: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 838 op/s 2024-09-05T01:41:17.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:17 smithi151 ceph-mon[35013]: pgmap v520: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 838 op/s 2024-09-05T01:41:19.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:19 smithi012 ceph-mon[29942]: pgmap v521: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 866 op/s 2024-09-05T01:41:19.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:19 smithi145 ceph-mon[34376]: pgmap v521: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 866 op/s 2024-09-05T01:41:19.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:19 smithi151 ceph-mon[35013]: pgmap v521: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.0 MiB/s wr, 866 op/s 2024-09-05T01:41:21.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:21 smithi012 ceph-mon[29942]: pgmap v522: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 993 op/s 2024-09-05T01:41:21.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:21 smithi145 ceph-mon[34376]: pgmap v522: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 993 op/s 2024-09-05T01:41:21.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:21 smithi151 ceph-mon[35013]: pgmap v522: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 993 op/s 2024-09-05T01:41:23.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:23 smithi012 ceph-mon[29942]: pgmap v523: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 2.3 MiB/s wr, 968 op/s 2024-09-05T01:41:23.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:23 smithi145 ceph-mon[34376]: pgmap v523: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 2.3 MiB/s wr, 968 op/s 2024-09-05T01:41:23.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:23 smithi151 ceph-mon[35013]: pgmap v523: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 2.3 MiB/s wr, 968 op/s 2024-09-05T01:41:25.815 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:25 smithi012 ceph-mon[29942]: pgmap v524: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 2.4 MiB/s wr, 974 op/s 2024-09-05T01:41:25.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:25 smithi145 ceph-mon[34376]: pgmap v524: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 2.4 MiB/s wr, 974 op/s 2024-09-05T01:41:25.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:25 smithi151 ceph-mon[35013]: pgmap v524: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.2 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 2.4 MiB/s wr, 974 op/s 2024-09-05T01:41:26.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:26 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:41:26.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:26 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:41:26.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:26 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:41:27.714 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:27 smithi012 ceph-mon[29942]: pgmap v525: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.4 MiB/s wr, 819 op/s 2024-09-05T01:41:27.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:27 smithi145 ceph-mon[34376]: pgmap v525: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.4 MiB/s wr, 819 op/s 2024-09-05T01:41:27.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:27 smithi151 ceph-mon[35013]: pgmap v525: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.4 MiB/s wr, 819 op/s 2024-09-05T01:41:29.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:29 smithi012 ceph-mon[29942]: pgmap v526: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.6 MiB/s wr, 429 op/s 2024-09-05T01:41:29.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:29 smithi145 ceph-mon[34376]: pgmap v526: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.6 MiB/s wr, 429 op/s 2024-09-05T01:41:29.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:29 smithi151 ceph-mon[35013]: pgmap v526: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.1 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.6 MiB/s wr, 429 op/s 2024-09-05T01:41:31.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:31 smithi012 ceph-mon[29942]: pgmap v527: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.1 MiB/s wr, 431 op/s 2024-09-05T01:41:31.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:31 smithi145 ceph-mon[34376]: pgmap v527: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.1 MiB/s wr, 431 op/s 2024-09-05T01:41:31.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:31 smithi151 ceph-mon[35013]: pgmap v527: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.1 MiB/s wr, 431 op/s 2024-09-05T01:41:33.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:33 smithi012 ceph-mon[29942]: pgmap v528: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 313 op/s 2024-09-05T01:41:33.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:33 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:41:33.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:33 smithi145 ceph-mon[34376]: pgmap v528: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 313 op/s 2024-09-05T01:41:33.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:33 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:41:33.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:33 smithi151 ceph-mon[35013]: pgmap v528: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 313 op/s 2024-09-05T01:41:33.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:33 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:41:35.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:35 smithi012 ceph-mon[29942]: pgmap v529: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 294 op/s 2024-09-05T01:41:35.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:35 smithi145 ceph-mon[34376]: pgmap v529: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 294 op/s 2024-09-05T01:41:35.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:35 smithi151 ceph-mon[35013]: pgmap v529: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 294 op/s 2024-09-05T01:41:37.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:37 smithi012 ceph-mon[29942]: pgmap v530: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 305 op/s 2024-09-05T01:41:37.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:37 smithi145 ceph-mon[34376]: pgmap v530: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 305 op/s 2024-09-05T01:41:37.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:37 smithi151 ceph-mon[35013]: pgmap v530: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.3 MiB/s wr, 305 op/s 2024-09-05T01:41:39.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:39 smithi012 ceph-mon[29942]: pgmap v531: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 188 op/s 2024-09-05T01:41:39.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:39 smithi145 ceph-mon[34376]: pgmap v531: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 188 op/s 2024-09-05T01:41:39.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:39 smithi151 ceph-mon[35013]: pgmap v531: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 188 op/s 2024-09-05T01:41:41.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:41 smithi012 ceph-mon[29942]: pgmap v532: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 223 op/s 2024-09-05T01:41:41.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:41 smithi145 ceph-mon[34376]: pgmap v532: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 223 op/s 2024-09-05T01:41:41.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:41 smithi151 ceph-mon[35013]: pgmap v532: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 223 op/s 2024-09-05T01:41:43.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:43 smithi012 ceph-mon[29942]: pgmap v533: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 976 KiB/s wr, 162 op/s 2024-09-05T01:41:43.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:43 smithi145 ceph-mon[34376]: pgmap v533: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 976 KiB/s wr, 162 op/s 2024-09-05T01:41:43.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:43 smithi151 ceph-mon[35013]: pgmap v533: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 3.1 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 976 KiB/s wr, 162 op/s 2024-09-05T01:41:45.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:45 smithi012 ceph-mon[29942]: pgmap v534: 97 pgs: 37 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 38 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 973 KiB/s wr, 165 op/s 2024-09-05T01:41:45.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:45 smithi145 ceph-mon[34376]: pgmap v534: 97 pgs: 37 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 38 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 973 KiB/s wr, 165 op/s 2024-09-05T01:41:45.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:45 smithi151 ceph-mon[35013]: pgmap v534: 97 pgs: 37 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 38 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 999 KiB/s rd, 973 KiB/s wr, 165 op/s 2024-09-05T01:41:47.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:47 smithi012 ceph-mon[29942]: pgmap v535: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 188 op/s 2024-09-05T01:41:47.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:47 smithi145 ceph-mon[34376]: pgmap v535: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 188 op/s 2024-09-05T01:41:47.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:47 smithi151 ceph-mon[35013]: pgmap v535: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 188 op/s 2024-09-05T01:41:47.938 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2024-09-05T01:41:47.938 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-05T01:41:49.776 DEBUG:teuthology.parallel:result is None 2024-09-05T01:41:49.776 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-05T01:41:49.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:49 smithi012 ceph-mon[29942]: pgmap v536: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 150 op/s 2024-09-05T01:41:49.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:49 smithi145 ceph-mon[34376]: pgmap v536: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 150 op/s 2024-09-05T01:41:49.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:49 smithi151 ceph-mon[35013]: pgmap v536: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 150 op/s 2024-09-05T01:41:49.886 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-05T01:41:49.887 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-05T01:41:49.897 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-05T01:41:49.897 INFO:teuthology.task.exec:Executing custom commands... 2024-09-05T01:41:49.898 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi012.front.sepia.ceph.com 2024-09-05T01:41:49.898 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-05T01:41:50.024 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-05T01:41:50.114 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-05T01:41:50.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.379+0000 7f6e36c00640 1 -- 172.21.15.12:0/730015946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e301078d0 msgr2=0x7f6e30107cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:50.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.379+0000 7f6e36c00640 1 --2- 172.21.15.12:0/730015946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e301078d0 0x7f6e30107cb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009890 tx=0x7f6e1c02a360 comp rx=0 tx=0).stop 2024-09-05T01:41:50.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.379+0000 7f6e36c00640 1 -- 172.21.15.12:0/730015946 shutdown_connections 2024-09-05T01:41:50.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.379+0000 7f6e36c00640 1 --2- 172.21.15.12:0/730015946 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e30102260 0x7f6e3010e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:50.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.379+0000 7f6e36c00640 1 --2- 172.21.15.12:0/730015946 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e301018c0 0x7f6e30101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:50.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.379+0000 7f6e36c00640 1 --2- 172.21.15.12:0/730015946 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e301078d0 0x7f6e30107cb0 secure :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009890 tx=0x7f6e1c02a360 comp rx=0 tx=0).stop 2024-09-05T01:41:50.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.379+0000 7f6e36c00640 1 -- 172.21.15.12:0/730015946 >> 172.21.15.12:0/730015946 conn(0x7f6e300fd620 msgr2=0x7f6e300ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:41:50.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.379+0000 7f6e36c00640 1 -- 172.21.15.12:0/730015946 shutdown_connections 2024-09-05T01:41:50.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.379+0000 7f6e36c00640 1 -- 172.21.15.12:0/730015946 wait complete. 2024-09-05T01:41:50.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.381+0000 7f6e36c00640 1 Processor -- start 2024-09-05T01:41:50.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.381+0000 7f6e36c00640 1 -- start start 2024-09-05T01:41:50.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.382+0000 7f6e36c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e301018c0 0x7f6e301152b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:50.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.382+0000 7f6e36c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e30102260 0x7f6e301157f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:50.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.382+0000 7f6e36c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e30111a20 0x7f6e30111eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:50.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.382+0000 7f6e36c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6e300747b0 con 0x7f6e301018c0 2024-09-05T01:41:50.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.382+0000 7f6e36c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6e30074630 con 0x7f6e30111a20 2024-09-05T01:41:50.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.382+0000 7f6e36c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6e30074930 con 0x7f6e30102260 2024-09-05T01:41:50.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.382+0000 7f6e34e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e30102260 0x7f6e301157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:50.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.382+0000 7f6e34e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e30102260 0x7f6e301157f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:33868/0 (socket says 172.21.15.12:33868) 2024-09-05T01:41:50.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.382+0000 7f6e34e00640 1 -- 172.21.15.12:0/3759733088 learned_addr learned my addr 172.21.15.12:0/3759733088 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:41:50.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.382+0000 7f6e35800640 1 --2- 172.21.15.12:0/3759733088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e301018c0 0x7f6e301152b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:50.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.383+0000 7f6e34e00640 1 -- 172.21.15.12:0/3759733088 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e30111a20 msgr2=0x7f6e30111eb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-05T01:41:50.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.383+0000 7f6e34e00640 1 --2- 172.21.15.12:0/3759733088 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e30111a20 0x7f6e30111eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:50.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.383+0000 7f6e34e00640 1 -- 172.21.15.12:0/3759733088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e301018c0 msgr2=0x7f6e301152b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:50.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.383+0000 7f6e34e00640 1 --2- 172.21.15.12:0/3759733088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e301018c0 0x7f6e301152b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:50.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.383+0000 7f6e34e00640 1 -- 172.21.15.12:0/3759733088 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e30112770 con 0x7f6e30102260 2024-09-05T01:41:50.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.383+0000 7f6e35800640 1 --2- 172.21.15.12:0/3759733088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e301018c0 0x7f6e301152b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:41:50.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.384+0000 7f6e34e00640 1 --2- 172.21.15.12:0/3759733088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e30102260 0x7f6e301157f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6e2400ea60 tx=0x7f6e2400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:41:50.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.385+0000 7f6e2e000640 1 -- 172.21.15.12:0/3759733088 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2400cde0 con 0x7f6e30102260 2024-09-05T01:41:50.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.385+0000 7f6e36c00640 1 -- 172.21.15.12:0/3759733088 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e3019ab50 con 0x7f6e30102260 2024-09-05T01:41:50.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.385+0000 7f6e2e000640 1 -- 172.21.15.12:0/3759733088 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e240035f0 con 0x7f6e30102260 2024-09-05T01:41:50.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.385+0000 7f6e2e000640 1 -- 172.21.15.12:0/3759733088 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2400cde0 con 0x7f6e30102260 2024-09-05T01:41:50.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.385+0000 7f6e36c00640 1 -- 172.21.15.12:0/3759733088 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e3019b0f0 con 0x7f6e30102260 2024-09-05T01:41:50.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.387+0000 7f6e36c00640 1 -- 172.21.15.12:0/3759733088 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e30107cb0 con 0x7f6e30102260 2024-09-05T01:41:50.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.391+0000 7f6e2e000640 1 -- 172.21.15.12:0/3759733088 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f6e240037a0 con 0x7f6e30102260 2024-09-05T01:41:50.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.393+0000 7f6e2e000640 1 --2- 172.21.15.12:0/3759733088 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6e180a3030 0x7f6e180a54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:50.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.393+0000 7f6e2e000640 1 -- 172.21.15.12:0/3759733088 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8671+0+0 (secure 0 0 0) 0x7f6e240cf570 con 0x7f6e30102260 2024-09-05T01:41:50.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.394+0000 7f6e35800640 1 --2- 172.21.15.12:0/3759733088 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6e180a3030 0x7f6e180a54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:50.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.395+0000 7f6e35800640 1 --2- 172.21.15.12:0/3759733088 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6e180a3030 0x7f6e180a54f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009780 tx=0x7f6e1c000bc0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:41:50.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.396+0000 7f6e2e000640 1 -- 172.21.15.12:0/3759733088 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e2409c0a0 con 0x7f6e30102260 2024-09-05T01:41:50.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.786+0000 7f6e36c00640 1 -- 172.21.15.12:0/3759733088 --> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f6e300ff590 con 0x7f6e180a3030 2024-09-05T01:41:50.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.863+0000 7f6e2e000640 1 -- 172.21.15.12:0/3759733088 <== mgr.15138 v2:172.21.15.12:6800/3451745620 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7f6e300ff590 con 0x7f6e180a3030 2024-09-05T01:41:50.864 INFO:teuthology.orchestra.run.smithi012.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-05T00:00:00", "created": "2024-09-05T01:24:52", "first": "2024-09-05T01:25:00", "last": "2024-09-05T01:41:00", "last_pruned": "2024-09-05T01:41:01", "created_count": 17, "pruned_count": 11, "active": true} 2024-09-05T01:41:50.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.869+0000 7f6e36c00640 1 -- 172.21.15.12:0/3759733088 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6e180a3030 msgr2=0x7f6e180a54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:50.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.869+0000 7f6e36c00640 1 --2- 172.21.15.12:0/3759733088 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6e180a3030 0x7f6e180a54f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009780 tx=0x7f6e1c000bc0 comp rx=0 tx=0).stop 2024-09-05T01:41:50.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.869+0000 7f6e36c00640 1 -- 172.21.15.12:0/3759733088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e30102260 msgr2=0x7f6e301157f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:50.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.869+0000 7f6e36c00640 1 --2- 172.21.15.12:0/3759733088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e30102260 0x7f6e301157f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6e2400ea60 tx=0x7f6e2400ef20 comp rx=0 tx=0).stop 2024-09-05T01:41:50.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.870+0000 7f6e36c00640 1 -- 172.21.15.12:0/3759733088 shutdown_connections 2024-09-05T01:41:50.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.870+0000 7f6e36c00640 1 --2- 172.21.15.12:0/3759733088 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6e180a3030 0x7f6e180a54f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:50.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.870+0000 7f6e36c00640 1 --2- 172.21.15.12:0/3759733088 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6e30111a20 0x7f6e30111eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:50.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.870+0000 7f6e36c00640 1 --2- 172.21.15.12:0/3759733088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e30102260 0x7f6e301157f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:50.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.870+0000 7f6e36c00640 1 --2- 172.21.15.12:0/3759733088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e301018c0 0x7f6e301152b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:50.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.870+0000 7f6e36c00640 1 -- 172.21.15.12:0/3759733088 >> 172.21.15.12:0/3759733088 conn(0x7f6e300fd620 msgr2=0x7f6e300fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:41:50.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.870+0000 7f6e36c00640 1 -- 172.21.15.12:0/3759733088 shutdown_connections 2024-09-05T01:41:50.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:50.870+0000 7f6e36c00640 1 -- 172.21.15.12:0/3759733088 wait complete. 2024-09-05T01:41:50.897 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-05T01:41:51.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.147+0000 7fa975800640 1 -- 172.21.15.12:0/3123893953 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa970074590 msgr2=0x7fa970074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:51.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.147+0000 7fa975800640 1 --2- 172.21.15.12:0/3123893953 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa970074590 0x7fa970074970 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa960009900 tx=0x7fa96002a480 comp rx=0 tx=0).stop 2024-09-05T01:41:51.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.148+0000 7fa975800640 1 -- 172.21.15.12:0/3123893953 shutdown_connections 2024-09-05T01:41:51.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.148+0000 7fa975800640 1 --2- 172.21.15.12:0/3123893953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa970112ae0 0x7fa970114ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:51.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.148+0000 7fa975800640 1 --2- 172.21.15.12:0/3123893953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa970074eb0 0x7fa9701125a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:51.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.148+0000 7fa975800640 1 --2- 172.21.15.12:0/3123893953 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa970074590 0x7fa970074970 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:51.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.148+0000 7fa975800640 1 -- 172.21.15.12:0/3123893953 >> 172.21.15.12:0/3123893953 conn(0x7fa9700fd7d0 msgr2=0x7fa9700ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:41:51.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.148+0000 7fa975800640 1 -- 172.21.15.12:0/3123893953 shutdown_connections 2024-09-05T01:41:51.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.148+0000 7fa975800640 1 -- 172.21.15.12:0/3123893953 wait complete. 2024-09-05T01:41:51.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.149+0000 7fa975800640 1 Processor -- start 2024-09-05T01:41:51.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.150+0000 7fa975800640 1 -- start start 2024-09-05T01:41:51.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.151+0000 7fa975800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa970074590 0x7fa970111f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:51.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.151+0000 7fa975800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa970074eb0 0x7fa970112450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:51.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.151+0000 7fa975800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa970112ae0 0x7fa97010c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:51.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.151+0000 7fa96ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa970074590 0x7fa970111f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:51.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.151+0000 7fa96ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa970074590 0x7fa970111f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:33892/0 (socket says 172.21.15.12:33892) 2024-09-05T01:41:51.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.151+0000 7fa975800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa9701064d0 con 0x7fa970112ae0 2024-09-05T01:41:51.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.151+0000 7fa96ea00640 1 -- 172.21.15.12:0/961967850 learned_addr learned my addr 172.21.15.12:0/961967850 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:41:51.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.151+0000 7fa96e000640 1 --2- 172.21.15.12:0/961967850 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa970074eb0 0x7fa970112450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:51.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.151+0000 7fa975800640 1 -- 172.21.15.12:0/961967850 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fa970106350 con 0x7fa970074eb0 2024-09-05T01:41:51.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.151+0000 7fa96f400640 1 --2- 172.21.15.12:0/961967850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa970112ae0 0x7fa97010c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:51.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.151+0000 7fa975800640 1 -- 172.21.15.12:0/961967850 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa970106650 con 0x7fa970074590 2024-09-05T01:41:51.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.153+0000 7fa96ea00640 1 -- 172.21.15.12:0/961967850 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa970074eb0 msgr2=0x7fa970112450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:51.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.153+0000 7fa96ea00640 1 --2- 172.21.15.12:0/961967850 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa970074eb0 0x7fa970112450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:51.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.153+0000 7fa96ea00640 1 -- 172.21.15.12:0/961967850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa970112ae0 msgr2=0x7fa97010c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:51.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.153+0000 7fa96ea00640 1 --2- 172.21.15.12:0/961967850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa970112ae0 0x7fa97010c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:51.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.153+0000 7fa96ea00640 1 -- 172.21.15.12:0/961967850 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa97010c8c0 con 0x7fa970074590 2024-09-05T01:41:51.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.153+0000 7fa96ea00640 1 --2- 172.21.15.12:0/961967850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa970074590 0x7fa970111f10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa960004770 tx=0x7fa960003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:41:51.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.153+0000 7fa967400640 1 -- 172.21.15.12:0/961967850 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96003f070 con 0x7fa970074590 2024-09-05T01:41:51.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.154+0000 7fa975800640 1 -- 172.21.15.12:0/961967850 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa97010cb50 con 0x7fa970074590 2024-09-05T01:41:51.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.154+0000 7fa975800640 1 -- 172.21.15.12:0/961967850 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9701b3ce0 con 0x7fa970074590 2024-09-05T01:41:51.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.154+0000 7fa967400640 1 -- 172.21.15.12:0/961967850 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa960031ca0 con 0x7fa970074590 2024-09-05T01:41:51.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.154+0000 7fa967400640 1 -- 172.21.15.12:0/961967850 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa960035030 con 0x7fa970074590 2024-09-05T01:41:51.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.156+0000 7fa975800640 1 -- 172.21.15.12:0/961967850 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa950005290 con 0x7fa970074590 2024-09-05T01:41:51.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.159+0000 7fa967400640 1 -- 172.21.15.12:0/961967850 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fa960042070 con 0x7fa970074590 2024-09-05T01:41:51.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.161+0000 7fa967400640 1 --2- 172.21.15.12:0/961967850 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fa9540a2ea0 0x7fa9540a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:51.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.161+0000 7fa967400640 1 -- 172.21.15.12:0/961967850 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8671+0+0 (secure 0 0 0) 0x7fa9600ef780 con 0x7fa970074590 2024-09-05T01:41:51.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.162+0000 7fa96e000640 1 --2- 172.21.15.12:0/961967850 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fa9540a2ea0 0x7fa9540a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:51.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.165+0000 7fa96e000640 1 --2- 172.21.15.12:0/961967850 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fa9540a2ea0 0x7fa9540a5360 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa97010d740 tx=0x7fa968009500 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:41:51.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.167+0000 7fa967400640 1 -- 172.21.15.12:0/961967850 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa9600bc2b0 con 0x7fa970074590 2024-09-05T01:41:51.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.533+0000 7fa975800640 1 -- 172.21.15.12:0/961967850 --> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fa950000bc0 con 0x7fa9540a2ea0 2024-09-05T01:41:51.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.618+0000 7fa967400640 1 -- 172.21.15.12:0/961967850 <== mgr.15138 v2:172.21.15.12:6800/3451745620 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fa950000bc0 con 0x7fa9540a2ea0 2024-09-05T01:41:51.620 INFO:teuthology.orchestra.run.smithi012.stdout:/ 1m 6m3h 2024-09-05T01:41:51.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.623+0000 7fa975800640 1 -- 172.21.15.12:0/961967850 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fa9540a2ea0 msgr2=0x7fa9540a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:51.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.623+0000 7fa975800640 1 --2- 172.21.15.12:0/961967850 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fa9540a2ea0 0x7fa9540a5360 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa97010d740 tx=0x7fa968009500 comp rx=0 tx=0).stop 2024-09-05T01:41:51.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.623+0000 7fa975800640 1 -- 172.21.15.12:0/961967850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa970074590 msgr2=0x7fa970111f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:51.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.623+0000 7fa975800640 1 --2- 172.21.15.12:0/961967850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa970074590 0x7fa970111f10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa960004770 tx=0x7fa960003c10 comp rx=0 tx=0).stop 2024-09-05T01:41:51.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.623+0000 7fa975800640 1 -- 172.21.15.12:0/961967850 shutdown_connections 2024-09-05T01:41:51.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.623+0000 7fa975800640 1 --2- 172.21.15.12:0/961967850 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fa9540a2ea0 0x7fa9540a5360 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:51.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.623+0000 7fa975800640 1 --2- 172.21.15.12:0/961967850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa970112ae0 0x7fa97010c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:51.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.623+0000 7fa975800640 1 --2- 172.21.15.12:0/961967850 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fa970074eb0 0x7fa970112450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:51.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.623+0000 7fa975800640 1 --2- 172.21.15.12:0/961967850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa970074590 0x7fa970111f10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:51.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.623+0000 7fa975800640 1 -- 172.21.15.12:0/961967850 >> 172.21.15.12:0/961967850 conn(0x7fa9700fd7d0 msgr2=0x7fa9700fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:41:51.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.624+0000 7fa975800640 1 -- 172.21.15.12:0/961967850 shutdown_connections 2024-09-05T01:41:51.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.624+0000 7fa975800640 1 -- 172.21.15.12:0/961967850 wait complete. 2024-09-05T01:41:51.653 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-05T01:41:51.663 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-05T01:41:51.663 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph_91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-09-05T01:41:51.664 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-05T01:41:51.711 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-05T01:41:51.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:51 smithi012 ceph-mon[29942]: pgmap v537: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 182 op/s 2024-09-05T01:41:51.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:51 smithi145 ceph-mon[34376]: pgmap v537: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 182 op/s 2024-09-05T01:41:51.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:51 smithi151 ceph-mon[35013]: pgmap v537: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 182 op/s 2024-09-05T01:41:51.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.968+0000 7f556c200640 1 -- 172.21.15.12:0/1260249323 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5564101ab0 msgr2=0x7f5564101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:51.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.968+0000 7f556c200640 1 --2- 172.21.15.12:0/1260249323 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5564101ab0 0x7f5564101f10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f555000dc90 tx=0x7f555002e370 comp rx=0 tx=0).stop 2024-09-05T01:41:51.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.969+0000 7f556c200640 1 -- 172.21.15.12:0/1260249323 shutdown_connections 2024-09-05T01:41:51.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.969+0000 7f556c200640 1 --2- 172.21.15.12:0/1260249323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5564102450 0x7f556410e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:51.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.969+0000 7f556c200640 1 --2- 172.21.15.12:0/1260249323 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5564101ab0 0x7f5564101f10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:51.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.969+0000 7f556c200640 1 --2- 172.21.15.12:0/1260249323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5564107ac0 0x7f5564107ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:51.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.969+0000 7f556c200640 1 -- 172.21.15.12:0/1260249323 >> 172.21.15.12:0/1260249323 conn(0x7f55640fd790 msgr2=0x7f55640ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:41:51.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.969+0000 7f556c200640 1 -- 172.21.15.12:0/1260249323 shutdown_connections 2024-09-05T01:41:51.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.969+0000 7f556c200640 1 -- 172.21.15.12:0/1260249323 wait complete. 2024-09-05T01:41:51.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.970+0000 7f556c200640 1 Processor -- start 2024-09-05T01:41:51.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.971+0000 7f556c200640 1 -- start start 2024-09-05T01:41:51.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.971+0000 7f556c200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5564101ab0 0x7f5564196170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.971+0000 7f556c200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5564102450 0x7f55641966b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.971+0000 7f556c200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5564107ac0 0x7f556419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.971+0000 7f556c200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f556410fd60 con 0x7f5564107ac0 2024-09-05T01:41:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.971+0000 7f556c200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f556410fbe0 con 0x7f5564102450 2024-09-05T01:41:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.971+0000 7f556c200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f556410fee0 con 0x7f5564101ab0 2024-09-05T01:41:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.972+0000 7f5568e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5564102450 0x7f55641966b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.972+0000 7f5569800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5564101ab0 0x7f5564196170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.972+0000 7f5569800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5564101ab0 0x7f5564196170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:33902/0 (socket says 172.21.15.12:33902) 2024-09-05T01:41:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.972+0000 7f5569800640 1 -- 172.21.15.12:0/2138640690 learned_addr learned my addr 172.21.15.12:0/2138640690 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:41:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.972+0000 7f556a200640 1 --2- 172.21.15.12:0/2138640690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5564107ac0 0x7f556419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.972+0000 7f5568e00640 1 -- 172.21.15.12:0/2138640690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5564101ab0 msgr2=0x7f5564196170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:51.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.972+0000 7f5568e00640 1 --2- 172.21.15.12:0/2138640690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5564101ab0 0x7f5564196170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:51.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.972+0000 7f5568e00640 1 -- 172.21.15.12:0/2138640690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5564107ac0 msgr2=0x7f556419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:51.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.972+0000 7f5568e00640 1 --2- 172.21.15.12:0/2138640690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5564107ac0 0x7f556419aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:51.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.973+0000 7f5568e00640 1 -- 172.21.15.12:0/2138640690 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f556419b160 con 0x7f5564102450 2024-09-05T01:41:51.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.973+0000 7f5568e00640 1 --2- 172.21.15.12:0/2138640690 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5564102450 0x7f55641966b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5550006010 tx=0x7f5550005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:41:51.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.975+0000 7f5562000640 1 -- 172.21.15.12:0/2138640690 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550005030 con 0x7f5564102450 2024-09-05T01:41:51.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.975+0000 7f5562000640 1 -- 172.21.15.12:0/2138640690 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55500051d0 con 0x7f5564102450 2024-09-05T01:41:51.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.975+0000 7f5562000640 1 -- 172.21.15.12:0/2138640690 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550005030 con 0x7f5564102450 2024-09-05T01:41:51.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.975+0000 7f556c200640 1 -- 172.21.15.12:0/2138640690 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f556419b3f0 con 0x7f5564102450 2024-09-05T01:41:51.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.975+0000 7f556c200640 1 -- 172.21.15.12:0/2138640690 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f556419b830 con 0x7f5564102450 2024-09-05T01:41:51.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.977+0000 7f556c200640 1 -- 172.21.15.12:0/2138640690 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5564101f10 con 0x7f5564102450 2024-09-05T01:41:51.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.979+0000 7f5562000640 1 -- 172.21.15.12:0/2138640690 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f5550046060 con 0x7f5564102450 2024-09-05T01:41:51.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.981+0000 7f5562000640 1 --2- 172.21.15.12:0/2138640690 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f554c0a2f80 0x7f554c0a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:51.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.981+0000 7f5562000640 1 -- 172.21.15.12:0/2138640690 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8671+0+0 (secure 0 0 0) 0x7f55500ede50 con 0x7f5564102450 2024-09-05T01:41:51.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.981+0000 7f5569800640 1 --2- 172.21.15.12:0/2138640690 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f554c0a2f80 0x7f554c0a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:51.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.982+0000 7f5569800640 1 --2- 172.21.15.12:0/2138640690 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f554c0a2f80 0x7f554c0a5440 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5558005fd0 tx=0x7f555800b480 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:41:51.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:51.988+0000 7f5562000640 1 -- 172.21.15.12:0/2138640690 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f55500baa90 con 0x7f5564102450 2024-09-05T01:41:52.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.319+0000 7f556c200640 1 -- 172.21.15.12:0/2138640690 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55641ab760 con 0x7f5564102450 2024-09-05T01:41:52.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.322+0000 7f5562000640 1 -- 172.21.15.12:0/2138640690 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) ==== 74+0+23471 (secure 0 0 0) 0x7f555009fbc0 con 0x7f5564102450 2024-09-05T01:41:52.324 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:41:52.324 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":106,"fsid":"0d44cd7e-6b24-11ef-bcd6-c7b262605968","created":"2024-09-05T01:14:21.162850+0000","modified":"2024-09-05T01:41:03.218063+0000","last_up_change":"2024-09-05T01:21:37.145073+0000","last_in_change":"2024-09-05T01:21:15.076991+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T01:17:44.744065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T01:22:31.540178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T01:22:33.999318+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":29,"snap_epoch":106,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b74ac640-b680-46e2-9106-d24168e685e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6803","nonce":2090563987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6805","nonce":2090563987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6809","nonce":2090563987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6807","nonce":2090563987}]},"public_addr":"172.21.15.12:6803/2090563987","cluster_addr":"172.21.15.12:6805/2090563987","heartbeat_back_addr":"172.21.15.12:6809/2090563987","heartbeat_front_addr":"172.21.15.12:6807/2090563987","state":["exists","up"]},{"osd":1,"uuid":"efca1216-8d85-4e6a-8c49-0afb511ece59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6801","nonce":2639126629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6803","nonce":2639126629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6807","nonce":2639126629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6805","nonce":2639126629}]},"public_addr":"172.21.15.145:6801/2639126629","cluster_addr":"172.21.15.145:6803/2639126629","heartbeat_back_addr":"172.21.15.145:6807/2639126629","heartbeat_front_addr":"172.21.15.145:6805/2639126629","state":["exists","up"]},{"osd":2,"uuid":"4d5699b2-646a-4ab6-94a5-ad223aa27ac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6801","nonce":3753171761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6803","nonce":3753171761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6807","nonce":3753171761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6805","nonce":3753171761}]},"public_addr":"172.21.15.151:6801/3753171761","cluster_addr":"172.21.15.151:6803/3753171761","heartbeat_back_addr":"172.21.15.151:6807/3753171761","heartbeat_front_addr":"172.21.15.151:6805/3753171761","state":["exists","up"]},{"osd":3,"uuid":"275ad2ad-93e6-4a68-8784-8f8dcb620f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6811","nonce":2231650146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6813","nonce":2231650146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6817","nonce":2231650146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6815","nonce":2231650146}]},"public_addr":"172.21.15.12:6811/2231650146","cluster_addr":"172.21.15.12:6813/2231650146","heartbeat_back_addr":"172.21.15.12:6817/2231650146","heartbeat_front_addr":"172.21.15.12:6815/2231650146","state":["exists","up"]},{"osd":4,"uuid":"21a0c5b4-4e0e-4fb6-8be6-a300cb811cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6809","nonce":1828591275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6811","nonce":1828591275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6815","nonce":1828591275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6813","nonce":1828591275}]},"public_addr":"172.21.15.145:6809/1828591275","cluster_addr":"172.21.15.145:6811/1828591275","heartbeat_back_addr":"172.21.15.145:6815/1828591275","heartbeat_front_addr":"172.21.15.145:6813/1828591275","state":["exists","up"]},{"osd":5,"uuid":"e2c7e6fb-5dea-459f-8d7a-7ae5b1936218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6809","nonce":3888870109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6811","nonce":3888870109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6815","nonce":3888870109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6813","nonce":3888870109}]},"public_addr":"172.21.15.151:6809/3888870109","cluster_addr":"172.21.15.151:6811/3888870109","heartbeat_back_addr":"172.21.15.151:6815/3888870109","heartbeat_front_addr":"172.21.15.151:6813/3888870109","state":["exists","up"]},{"osd":6,"uuid":"0df0a29c-3404-4ff5-ae48-78b69b77cbd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6819","nonce":3084810269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6821","nonce":3084810269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6825","nonce":3084810269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6823","nonce":3084810269}]},"public_addr":"172.21.15.12:6819/3084810269","cluster_addr":"172.21.15.12:6821/3084810269","heartbeat_back_addr":"172.21.15.12:6825/3084810269","heartbeat_front_addr":"172.21.15.12:6823/3084810269","state":["exists","up"]},{"osd":7,"uuid":"c7b3ad7c-a566-435c-9ef8-837bb764acb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6817","nonce":3058588721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6819","nonce":3058588721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6823","nonce":3058588721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6821","nonce":3058588721}]},"public_addr":"172.21.15.145:6817/3058588721","cluster_addr":"172.21.15.145:6819/3058588721","heartbeat_back_addr":"172.21.15.145:6823/3058588721","heartbeat_front_addr":"172.21.15.145:6821/3058588721","state":["exists","up"]},{"osd":8,"uuid":"8018a468-fbc5-4667-a53c-2e97c08713bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6817","nonce":905705309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6819","nonce":905705309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6823","nonce":905705309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6821","nonce":905705309}]},"public_addr":"172.21.15.151:6817/905705309","cluster_addr":"172.21.15.151:6819/905705309","heartbeat_back_addr":"172.21.15.151:6823/905705309","heartbeat_front_addr":"172.21.15.151:6821/905705309","state":["exists","up"]},{"osd":9,"uuid":"dcf3b524-c8b8-4ab6-83c6-fc52c776d72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6827","nonce":1193852496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6829","nonce":1193852496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6833","nonce":1193852496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6831","nonce":1193852496}]},"public_addr":"172.21.15.12:6827/1193852496","cluster_addr":"172.21.15.12:6829/1193852496","heartbeat_back_addr":"172.21.15.12:6833/1193852496","heartbeat_front_addr":"172.21.15.12:6831/1193852496","state":["exists","up"]},{"osd":10,"uuid":"7b5b34c3-8814-4d16-80ce-0b0c9be07cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6825","nonce":1296813755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6827","nonce":1296813755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6831","nonce":1296813755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6829","nonce":1296813755}]},"public_addr":"172.21.15.145:6825/1296813755","cluster_addr":"172.21.15.145:6827/1296813755","heartbeat_back_addr":"172.21.15.145:6831/1296813755","heartbeat_front_addr":"172.21.15.145:6829/1296813755","state":["exists","up"]},{"osd":11,"uuid":"157ee32a-43f0-4e5a-8dac-fce53c1efdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6825","nonce":2855185758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6827","nonce":2855185758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6831","nonce":2855185758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6829","nonce":2855185758}]},"public_addr":"172.21.15.151:6825/2855185758","cluster_addr":"172.21.15.151:6827/2855185758","heartbeat_back_addr":"172.21.15.151:6831/2855185758","heartbeat_front_addr":"172.21.15.151:6829/2855185758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:16:52.947222+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:17:17.845611+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:17:41.769521+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:10.848974+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:35.471340+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:59.554980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:19:28.908089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:19:53.540000+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:20:17.764886+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:20:46.835859+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:21:12.186176+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:21:35.863935+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9},{"from":4,"to":7}]},{"pgid":"3.19","mappings":[{"from":3,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3089660384":"2024-09-06T01:24:41.593667+0000","172.21.15.12:0/2280578773":"2024-09-06T01:24:41.593667+0000","172.21.15.12:0/1532325396":"2024-09-06T01:14:54.625209+0000","172.21.15.12:6800/3541208629":"2024-09-06T01:14:54.625209+0000","172.21.15.12:6801/3541208629":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/992405704":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/784506983":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/1815886492":"2024-09-06T01:24:41.593667+0000","172.21.15.12:6800/4067110310":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6801/2664180840":"2024-09-06T01:24:41.593667+0000","172.21.15.12:0/1171838695":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/1040591124":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6801/4067110310":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/1385871202":"2024-09-06T01:24:41.593667+0000","172.21.15.12:0/1132389058":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6800/2664180840":"2024-09-06T01:24:41.593667+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":14,"length":1},{"begin":16,"length":1},{"begin":25,"length":1},{"begin":27,"length":1},{"begin":29,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":16,"length":1},{"begin":29,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T01:41:52.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.325+0000 7f556c200640 1 -- 172.21.15.12:0/2138640690 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f554c0a2f80 msgr2=0x7f554c0a5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:52.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.325+0000 7f556c200640 1 --2- 172.21.15.12:0/2138640690 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f554c0a2f80 0x7f554c0a5440 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5558005fd0 tx=0x7f555800b480 comp rx=0 tx=0).stop 2024-09-05T01:41:52.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.325+0000 7f556c200640 1 -- 172.21.15.12:0/2138640690 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5564102450 msgr2=0x7f55641966b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:52.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.325+0000 7f556c200640 1 --2- 172.21.15.12:0/2138640690 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5564102450 0x7f55641966b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5550006010 tx=0x7f5550005dc0 comp rx=0 tx=0).stop 2024-09-05T01:41:52.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.325+0000 7f556c200640 1 -- 172.21.15.12:0/2138640690 shutdown_connections 2024-09-05T01:41:52.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.325+0000 7f556c200640 1 --2- 172.21.15.12:0/2138640690 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f554c0a2f80 0x7f554c0a5440 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:52.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.325+0000 7f556c200640 1 --2- 172.21.15.12:0/2138640690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5564107ac0 0x7f556419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:52.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.325+0000 7f556c200640 1 --2- 172.21.15.12:0/2138640690 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f5564102450 0x7f55641966b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:52.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.325+0000 7f556c200640 1 --2- 172.21.15.12:0/2138640690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5564101ab0 0x7f5564196170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:52.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.325+0000 7f556c200640 1 -- 172.21.15.12:0/2138640690 >> 172.21.15.12:0/2138640690 conn(0x7f55640fd790 msgr2=0x7f55640fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:41:52.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.326+0000 7f556c200640 1 -- 172.21.15.12:0/2138640690 shutdown_connections 2024-09-05T01:41:52.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.326+0000 7f556c200640 1 -- 172.21.15.12:0/2138640690 wait complete. 2024-09-05T01:41:52.353 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-05T01:17:44.744065+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-05T01:22:31.540178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-05T01:22:33.999318+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 29, 'snap_epoch': 106, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-05T01:41:52.353 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-05T01:41:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.605+0000 7f9971e00640 1 -- 172.21.15.12:0/2953223110 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f996c105e00 msgr2=0x7f996c1062b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.605+0000 7f9971e00640 1 --2- 172.21.15.12:0/2953223110 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f996c105e00 0x7f996c1062b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9964009c10 tx=0x7f996402a770 comp rx=0 tx=0).stop 2024-09-05T01:41:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.606+0000 7f9971e00640 1 -- 172.21.15.12:0/2953223110 shutdown_connections 2024-09-05T01:41:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.606+0000 7f9971e00640 1 --2- 172.21.15.12:0/2953223110 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f996c105e00 0x7f996c1062b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.606+0000 7f9971e00640 1 --2- 172.21.15.12:0/2953223110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f996c1012f0 0x7f996c1057b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.606+0000 7f9971e00640 1 --2- 172.21.15.12:0/2953223110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f996c1009d0 0x7f996c100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.606+0000 7f9971e00640 1 -- 172.21.15.12:0/2953223110 >> 172.21.15.12:0/2953223110 conn(0x7f996c0778c0 msgr2=0x7f996c0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:41:52.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.606+0000 7f9971e00640 1 -- 172.21.15.12:0/2953223110 shutdown_connections 2024-09-05T01:41:52.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.607+0000 7f9971e00640 1 -- 172.21.15.12:0/2953223110 wait complete. 2024-09-05T01:41:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.609+0000 7f9971e00640 1 Processor -- start 2024-09-05T01:41:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.609+0000 7f9971e00640 1 -- start start 2024-09-05T01:41:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.609+0000 7f9971e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f996c1009d0 0x7f996c1a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.609+0000 7f9971e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f996c1012f0 0x7f996c1a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.609+0000 7f9971e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f996c105e00 0x7f996c19e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.610+0000 7f9971e00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f996c118370 con 0x7f996c1009d0 2024-09-05T01:41:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.610+0000 7f9970a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f996c1009d0 0x7f996c1a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.610+0000 7f9971e00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f996c1181f0 con 0x7f996c1012f0 2024-09-05T01:41:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.610+0000 7f9971400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f996c105e00 0x7f996c19e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.610+0000 7f9971400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f996c105e00 0x7f996c19e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:33926/0 (socket says 172.21.15.12:33926) 2024-09-05T01:41:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.610+0000 7f9971400640 1 -- 172.21.15.12:0/2745669714 learned_addr learned my addr 172.21.15.12:0/2745669714 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:41:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.610+0000 7f9963e00640 1 --2- 172.21.15.12:0/2745669714 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f996c1012f0 0x7f996c1a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.610+0000 7f9971e00640 1 -- 172.21.15.12:0/2745669714 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f996c1184f0 con 0x7f996c105e00 2024-09-05T01:41:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.611+0000 7f9971400640 1 -- 172.21.15.12:0/2745669714 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f996c1012f0 msgr2=0x7f996c1a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.611+0000 7f9971400640 1 --2- 172.21.15.12:0/2745669714 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f996c1012f0 0x7f996c1a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.611+0000 7f9971400640 1 -- 172.21.15.12:0/2745669714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f996c1009d0 msgr2=0x7f996c1a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.611+0000 7f9971400640 1 --2- 172.21.15.12:0/2745669714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f996c1009d0 0x7f996c1a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.611+0000 7f9971400640 1 -- 172.21.15.12:0/2745669714 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996c19efb0 con 0x7f996c105e00 2024-09-05T01:41:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.611+0000 7f9963e00640 1 --2- 172.21.15.12:0/2745669714 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f996c1012f0 0x7f996c1a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:41:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.612+0000 7f9971400640 1 --2- 172.21.15.12:0/2745669714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f996c105e00 0x7f996c19e820 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9964034040 tx=0x7f9964030c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:41:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.612+0000 7f996a000640 1 -- 172.21.15.12:0/2745669714 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9964040020 con 0x7f996c105e00 2024-09-05T01:41:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.612+0000 7f996a000640 1 -- 172.21.15.12:0/2745669714 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9964003e50 con 0x7f996c105e00 2024-09-05T01:41:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.612+0000 7f996a000640 1 -- 172.21.15.12:0/2745669714 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9964036040 con 0x7f996c105e00 2024-09-05T01:41:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.612+0000 7f9971e00640 1 -- 172.21.15.12:0/2745669714 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f996c19f240 con 0x7f996c105e00 2024-09-05T01:41:52.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.612+0000 7f9971e00640 1 -- 172.21.15.12:0/2745669714 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f996c06bbf0 con 0x7f996c105e00 2024-09-05T01:41:52.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.614+0000 7f9971e00640 1 -- 172.21.15.12:0/2745669714 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f996c069bc0 con 0x7f996c105e00 2024-09-05T01:41:52.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.618+0000 7f996a000640 1 -- 172.21.15.12:0/2745669714 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f9964043020 con 0x7f996c105e00 2024-09-05T01:41:52.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.620+0000 7f996a000640 1 --2- 172.21.15.12:0/2745669714 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f99500a2d40 0x7f99500a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:52.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.621+0000 7f996a000640 1 -- 172.21.15.12:0/2745669714 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8671+0+0 (secure 0 0 0) 0x7f99640f0190 con 0x7f996c105e00 2024-09-05T01:41:52.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.621+0000 7f9970a00640 1 --2- 172.21.15.12:0/2745669714 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f99500a2d40 0x7f99500a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:52.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.621+0000 7f9970a00640 1 --2- 172.21.15.12:0/2745669714 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f99500a2d40 0x7f99500a5200 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9954005fd0 tx=0x7f9954009260 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:41:52.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.624+0000 7f996a000640 1 -- 172.21.15.12:0/2745669714 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f996404a020 con 0x7f996c105e00 2024-09-05T01:41:52.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:52 smithi012 ceph-mon[29942]: from='client.26764 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:41:52.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:52 smithi012 ceph-mon[29942]: from='client.26770 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:41:52.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:52 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2138640690' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:41:52.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:52 smithi145 ceph-mon[34376]: from='client.26764 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:41:52.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:52 smithi145 ceph-mon[34376]: from='client.26770 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:41:52.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:52 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/2138640690' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:41:52.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:52 smithi151 ceph-mon[35013]: from='client.26764 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:41:52.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:52 smithi151 ceph-mon[35013]: from='client.26770 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-05T01:41:52.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:52 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/2138640690' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:41:52.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.925+0000 7f9971e00640 1 -- 172.21.15.12:0/2745669714 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f996c06be50 con 0x7f996c105e00 2024-09-05T01:41:52.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.926+0000 7f996a000640 1 -- 172.21.15.12:0/2745669714 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v106) ==== 93+0+10 (secure 0 0 0) 0x7f99640bccc0 con 0x7f996c105e00 2024-09-05T01:41:52.927 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2024-09-05T01:41:52.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.929+0000 7f9971e00640 1 -- 172.21.15.12:0/2745669714 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f99500a2d40 msgr2=0x7f99500a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:52.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.929+0000 7f9971e00640 1 --2- 172.21.15.12:0/2745669714 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f99500a2d40 0x7f99500a5200 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9954005fd0 tx=0x7f9954009260 comp rx=0 tx=0).stop 2024-09-05T01:41:52.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.929+0000 7f9971e00640 1 -- 172.21.15.12:0/2745669714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f996c105e00 msgr2=0x7f996c19e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:52.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.929+0000 7f9971e00640 1 --2- 172.21.15.12:0/2745669714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f996c105e00 0x7f996c19e820 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9964034040 tx=0x7f9964030c50 comp rx=0 tx=0).stop 2024-09-05T01:41:52.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.929+0000 7f9971e00640 1 -- 172.21.15.12:0/2745669714 shutdown_connections 2024-09-05T01:41:52.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.929+0000 7f9971e00640 1 --2- 172.21.15.12:0/2745669714 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f99500a2d40 0x7f99500a5200 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:52.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.929+0000 7f9971e00640 1 --2- 172.21.15.12:0/2745669714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f996c105e00 0x7f996c19e820 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:52.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.929+0000 7f9971e00640 1 --2- 172.21.15.12:0/2745669714 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f996c1012f0 0x7f996c1a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:52.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.929+0000 7f9971e00640 1 --2- 172.21.15.12:0/2745669714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f996c1009d0 0x7f996c1a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:52.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.929+0000 7f9971e00640 1 -- 172.21.15.12:0/2745669714 >> 172.21.15.12:0/2745669714 conn(0x7f996c0778c0 msgr2=0x7f996c10f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:41:52.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.929+0000 7f9971e00640 1 -- 172.21.15.12:0/2745669714 shutdown_connections 2024-09-05T01:41:52.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:52.929+0000 7f9971e00640 1 -- 172.21.15.12:0/2745669714 wait complete. 2024-09-05T01:41:52.957 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-05T01:41:53.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.196+0000 7fc4b1800640 1 -- 172.21.15.12:0/1576799816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4ac074620 msgr2=0x7fc4ac074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:53.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.196+0000 7fc4b1800640 1 --2- 172.21.15.12:0/1576799816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4ac074620 0x7fc4ac074a00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc49c009900 tx=0x7fc49c02a490 comp rx=0 tx=0).stop 2024-09-05T01:41:53.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.197+0000 7fc4b1800640 1 -- 172.21.15.12:0/1576799816 shutdown_connections 2024-09-05T01:41:53.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.197+0000 7fc4b1800640 1 --2- 172.21.15.12:0/1576799816 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4ac10e1d0 0x7fc4ac110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:53.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.197+0000 7fc4b1800640 1 --2- 172.21.15.12:0/1576799816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4ac074f40 0x7fc4ac10dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:53.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.197+0000 7fc4b1800640 1 --2- 172.21.15.12:0/1576799816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4ac074620 0x7fc4ac074a00 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:53.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.197+0000 7fc4b1800640 1 -- 172.21.15.12:0/1576799816 >> 172.21.15.12:0/1576799816 conn(0x7fc4ac0fd670 msgr2=0x7fc4ac0ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:41:53.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.198+0000 7fc4b1800640 1 -- 172.21.15.12:0/1576799816 shutdown_connections 2024-09-05T01:41:53.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.198+0000 7fc4b1800640 1 -- 172.21.15.12:0/1576799816 wait complete. 2024-09-05T01:41:53.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.199+0000 7fc4b1800640 1 Processor -- start 2024-09-05T01:41:53.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.199+0000 7fc4b1800640 1 -- start start 2024-09-05T01:41:53.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.200+0000 7fc4b1800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4ac074620 0x7fc4ac1018f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:53.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.200+0000 7fc4b1800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4ac074f40 0x7fc4ac101e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:53.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.200+0000 7fc4b1800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4ac10e1d0 0x7fc4ac102370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:53.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.200+0000 7fc4b1800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac113f80 con 0x7fc4ac074f40 2024-09-05T01:41:53.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.200+0000 7fc4b1800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac113e00 con 0x7fc4ac10e1d0 2024-09-05T01:41:53.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.200+0000 7fc4b1800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ac114100 con 0x7fc4ac074620 2024-09-05T01:41:53.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.200+0000 7fc4abe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4ac074620 0x7fc4ac1018f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:53.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.200+0000 7fc4abe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4ac074620 0x7fc4ac1018f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:33936/0 (socket says 172.21.15.12:33936) 2024-09-05T01:41:53.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.200+0000 7fc4abe00640 1 -- 172.21.15.12:0/1998938310 learned_addr learned my addr 172.21.15.12:0/1998938310 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:41:53.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.200+0000 7fc4ab400640 1 --2- 172.21.15.12:0/1998938310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4ac074f40 0x7fc4ac101e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:53.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.201+0000 7fc4b0e00640 1 --2- 172.21.15.12:0/1998938310 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4ac10e1d0 0x7fc4ac102370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.201+0000 7fc4abe00640 1 -- 172.21.15.12:0/1998938310 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4ac10e1d0 msgr2=0x7fc4ac102370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.201+0000 7fc4abe00640 1 --2- 172.21.15.12:0/1998938310 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4ac10e1d0 0x7fc4ac102370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.201+0000 7fc4abe00640 1 -- 172.21.15.12:0/1998938310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4ac074f40 msgr2=0x7fc4ac101e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:53.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.201+0000 7fc4abe00640 1 --2- 172.21.15.12:0/1998938310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4ac074f40 0x7fc4ac101e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.201+0000 7fc4abe00640 1 -- 172.21.15.12:0/1998938310 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ac1aaae0 con 0x7fc4ac074620 2024-09-05T01:41:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.201+0000 7fc4ab400640 1 --2- 172.21.15.12:0/1998938310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4ac074f40 0x7fc4ac101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:41:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.202+0000 7fc4abe00640 1 --2- 172.21.15.12:0/1998938310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4ac074620 0x7fc4ac1018f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc49c006010 tx=0x7fc49c0042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:41:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.202+0000 7fc4a8c00640 1 -- 172.21.15.12:0/1998938310 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49c03f030 con 0x7fc4ac074620 2024-09-05T01:41:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.202+0000 7fc4b1800640 1 -- 172.21.15.12:0/1998938310 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4ac1aad70 con 0x7fc4ac074620 2024-09-05T01:41:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.202+0000 7fc4b1800640 1 -- 172.21.15.12:0/1998938310 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4ac1ab250 con 0x7fc4ac074620 2024-09-05T01:41:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.202+0000 7fc4a8c00640 1 -- 172.21.15.12:0/1998938310 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc49c003ce0 con 0x7fc4ac074620 2024-09-05T01:41:53.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.203+0000 7fc4a8c00640 1 -- 172.21.15.12:0/1998938310 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49c049060 con 0x7fc4ac074620 2024-09-05T01:41:53.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.204+0000 7fc4b1800640 1 -- 172.21.15.12:0/1998938310 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4ac075cd0 con 0x7fc4ac074620 2024-09-05T01:41:53.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.207+0000 7fc4a8c00640 1 -- 172.21.15.12:0/1998938310 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fc49c042030 con 0x7fc4ac074620 2024-09-05T01:41:53.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.210+0000 7fc4a8c00640 1 --2- 172.21.15.12:0/1998938310 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc4900a2d80 0x7fc4900a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:53.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.210+0000 7fc4a8c00640 1 -- 172.21.15.12:0/1998938310 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8671+0+0 (secure 0 0 0) 0x7fc49c0ef7d0 con 0x7fc4ac074620 2024-09-05T01:41:53.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.210+0000 7fc4ab400640 1 --2- 172.21.15.12:0/1998938310 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc4900a2d80 0x7fc4900a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:53.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.212+0000 7fc4ab400640 1 --2- 172.21.15.12:0/1998938310 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc4900a2d80 0x7fc4900a5240 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac1030b0 tx=0x7fc49800a2d0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:41:53.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.216+0000 7fc4a8c00640 1 -- 172.21.15.12:0/1998938310 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc49c0bc360 con 0x7fc4ac074620 2024-09-05T01:41:53.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.524+0000 7fc4b1800640 1 -- 172.21.15.12:0/1998938310 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc4ac102e20 con 0x7fc4ac074620 2024-09-05T01:41:53.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.525+0000 7fc4a8c00640 1 -- 172.21.15.12:0/1998938310 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v106) ==== 104+0+11 (secure 0 0 0) 0x7fc49c0bbc60 con 0x7fc4ac074620 2024-09-05T01:41:53.526 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2024-09-05T01:41:53.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.529+0000 7fc4b1800640 1 -- 172.21.15.12:0/1998938310 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc4900a2d80 msgr2=0x7fc4900a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:53.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.529+0000 7fc4b1800640 1 --2- 172.21.15.12:0/1998938310 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc4900a2d80 0x7fc4900a5240 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac1030b0 tx=0x7fc49800a2d0 comp rx=0 tx=0).stop 2024-09-05T01:41:53.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.529+0000 7fc4b1800640 1 -- 172.21.15.12:0/1998938310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4ac074620 msgr2=0x7fc4ac1018f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:53.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.529+0000 7fc4b1800640 1 --2- 172.21.15.12:0/1998938310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4ac074620 0x7fc4ac1018f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc49c006010 tx=0x7fc49c0042f0 comp rx=0 tx=0).stop 2024-09-05T01:41:53.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.529+0000 7fc4b1800640 1 -- 172.21.15.12:0/1998938310 shutdown_connections 2024-09-05T01:41:53.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.529+0000 7fc4b1800640 1 --2- 172.21.15.12:0/1998938310 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fc4900a2d80 0x7fc4900a5240 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:53.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.529+0000 7fc4b1800640 1 --2- 172.21.15.12:0/1998938310 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fc4ac10e1d0 0x7fc4ac102370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:53.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.529+0000 7fc4b1800640 1 --2- 172.21.15.12:0/1998938310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc4ac074f40 0x7fc4ac101e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:53.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.529+0000 7fc4b1800640 1 --2- 172.21.15.12:0/1998938310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4ac074620 0x7fc4ac1018f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:53.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.529+0000 7fc4b1800640 1 -- 172.21.15.12:0/1998938310 >> 172.21.15.12:0/1998938310 conn(0x7fc4ac0fd670 msgr2=0x7fc4ac0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:41:53.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.529+0000 7fc4b1800640 1 -- 172.21.15.12:0/1998938310 shutdown_connections 2024-09-05T01:41:53.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.529+0000 7fc4b1800640 1 -- 172.21.15.12:0/1998938310 wait complete. 2024-09-05T01:41:53.556 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-05T01:41:53.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.810+0000 7f3472a00640 1 -- 172.21.15.12:0/742458904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f346c108fc0 msgr2=0x7f346c110b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:53.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.810+0000 7f3472a00640 1 --2- 172.21.15.12:0/742458904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f346c108fc0 0x7f346c110b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3464009ca0 tx=0x7f346402a8b0 comp rx=0 tx=0).stop 2024-09-05T01:41:53.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.811+0000 7f3472a00640 1 -- 172.21.15.12:0/742458904 shutdown_connections 2024-09-05T01:41:53.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.811+0000 7f3472a00640 1 --2- 172.21.15.12:0/742458904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f346c108fc0 0x7f346c110b10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:53.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.811+0000 7f3472a00640 1 --2- 172.21.15.12:0/742458904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f346c104820 0x7f346c108860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:53.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.811+0000 7f3472a00640 1 --2- 172.21.15.12:0/742458904 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f346c103e70 0x7f346c104250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:53.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.811+0000 7f3472a00640 1 -- 172.21.15.12:0/742458904 >> 172.21.15.12:0/742458904 conn(0x7f346c0ff8a0 msgr2=0x7f346c101cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:41:53.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.811+0000 7f3472a00640 1 -- 172.21.15.12:0/742458904 shutdown_connections 2024-09-05T01:41:53.813 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.811+0000 7f3472a00640 1 -- 172.21.15.12:0/742458904 wait complete. 2024-09-05T01:41:53.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:53 smithi012 ceph-mon[29942]: pgmap v538: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 144 op/s 2024-09-05T01:41:53.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:53 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2745669714' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-05T01:41:53.814 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:53 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/1998938310' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-05T01:41:53.814 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.813+0000 7f3472a00640 1 Processor -- start 2024-09-05T01:41:53.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.814+0000 7f3472a00640 1 -- start start 2024-09-05T01:41:53.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.815+0000 7f3472a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f346c103e70 0x7f346c1a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:53.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.815+0000 7f3472a00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f346c108fc0 0x7f346c1a3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:53.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.815+0000 7f3472a00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f346c10f5b0 0x7f346c10fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:53.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.815+0000 7f3472a00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f346c077990 con 0x7f346c10f5b0 2024-09-05T01:41:53.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.815+0000 7f3472a00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f346c077810 con 0x7f346c108fc0 2024-09-05T01:41:53.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.815+0000 7f3472a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f346c077b10 con 0x7f346c103e70 2024-09-05T01:41:53.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.815+0000 7f3470c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f346c108fc0 0x7f346c1a3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:53.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.815+0000 7f3471600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f346c103e70 0x7f346c1a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:53.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.815+0000 7f3472000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f346c10f5b0 0x7f346c10fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:53.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.815+0000 7f3470c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f346c108fc0 0x7f346c1a3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:38156/0 (socket says 172.21.15.12:38156) 2024-09-05T01:41:53.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.815+0000 7f3470c00640 1 -- 172.21.15.12:0/2385022144 learned_addr learned my addr 172.21.15.12:0/2385022144 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:41:53.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.816+0000 7f3470c00640 1 -- 172.21.15.12:0/2385022144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f346c103e70 msgr2=0x7f346c1a3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:53.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.816+0000 7f3470c00640 1 --2- 172.21.15.12:0/2385022144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f346c103e70 0x7f346c1a3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:53.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.816+0000 7f3470c00640 1 -- 172.21.15.12:0/2385022144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f346c10f5b0 msgr2=0x7f346c10fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:53.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.816+0000 7f3470c00640 1 --2- 172.21.15.12:0/2385022144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f346c10f5b0 0x7f346c10fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:53.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.816+0000 7f3470c00640 1 -- 172.21.15.12:0/2385022144 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f346c1101e0 con 0x7f346c108fc0 2024-09-05T01:41:53.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.816+0000 7f3470c00640 1 --2- 172.21.15.12:0/2385022144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f346c108fc0 0x7f346c1a3bd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f345800b450 tx=0x7f345800b850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:41:53.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.816+0000 7f346a000640 1 -- 172.21.15.12:0/2385022144 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3458015020 con 0x7f346c108fc0 2024-09-05T01:41:53.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.816+0000 7f3472a00640 1 -- 172.21.15.12:0/2385022144 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f346c1ab3e0 con 0x7f346c108fc0 2024-09-05T01:41:53.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.817+0000 7f3472a00640 1 -- 172.21.15.12:0/2385022144 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f346c1ab8a0 con 0x7f346c108fc0 2024-09-05T01:41:53.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.817+0000 7f346a000640 1 -- 172.21.15.12:0/2385022144 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3458011d10 con 0x7f346c108fc0 2024-09-05T01:41:53.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.817+0000 7f346a000640 1 -- 172.21.15.12:0/2385022144 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34580193b0 con 0x7f346c108fc0 2024-09-05T01:41:53.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.818+0000 7f3472a00640 1 -- 172.21.15.12:0/2385022144 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f346c104250 con 0x7f346c108fc0 2024-09-05T01:41:53.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.820+0000 7f346a000640 1 -- 172.21.15.12:0/2385022144 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f3458018020 con 0x7f346c108fc0 2024-09-05T01:41:53.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.822+0000 7f346a000640 1 --2- 172.21.15.12:0/2385022144 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f34540a2d80 0x7f34540a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:53.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.822+0000 7f346a000640 1 -- 172.21.15.12:0/2385022144 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8671+0+0 (secure 0 0 0) 0x7f34580ceee0 con 0x7f346c108fc0 2024-09-05T01:41:53.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.822+0000 7f3471600640 1 --2- 172.21.15.12:0/2385022144 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f34540a2d80 0x7f34540a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:53.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.823+0000 7f3471600640 1 --2- 172.21.15.12:0/2385022144 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f34540a2d80 0x7f34540a5240 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3460009990 tx=0x7f3460009110 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:41:53.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:53.827+0000 7f346a000640 1 -- 172.21.15.12:0/2385022144 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f345801f020 con 0x7f346c108fc0 2024-09-05T01:41:53.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:53 smithi145 ceph-mon[34376]: pgmap v538: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 144 op/s 2024-09-05T01:41:53.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:53 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/2745669714' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-05T01:41:53.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:53 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/1998938310' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-05T01:41:53.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:53 smithi151 ceph-mon[35013]: pgmap v538: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 144 op/s 2024-09-05T01:41:53.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:53 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/2745669714' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-05T01:41:53.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:53 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/1998938310' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-05T01:41:54.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.163+0000 7f3472a00640 1 -- 172.21.15.12:0/2385022144 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f346c104820 con 0x7f346c108fc0 2024-09-05T01:41:54.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.164+0000 7f346a000640 1 -- 172.21.15.12:0/2385022144 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v106) ==== 100+0+11 (secure 0 0 0) 0x7f345809bb20 con 0x7f346c108fc0 2024-09-05T01:41:54.166 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2024-09-05T01:41:54.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.169+0000 7f3472a00640 1 -- 172.21.15.12:0/2385022144 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f34540a2d80 msgr2=0x7f34540a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:54.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.169+0000 7f3472a00640 1 --2- 172.21.15.12:0/2385022144 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f34540a2d80 0x7f34540a5240 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3460009990 tx=0x7f3460009110 comp rx=0 tx=0).stop 2024-09-05T01:41:54.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.169+0000 7f3472a00640 1 -- 172.21.15.12:0/2385022144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f346c108fc0 msgr2=0x7f346c1a3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:54.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.169+0000 7f3472a00640 1 --2- 172.21.15.12:0/2385022144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f346c108fc0 0x7f346c1a3bd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f345800b450 tx=0x7f345800b850 comp rx=0 tx=0).stop 2024-09-05T01:41:54.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.169+0000 7f3472a00640 1 -- 172.21.15.12:0/2385022144 shutdown_connections 2024-09-05T01:41:54.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.169+0000 7f3472a00640 1 --2- 172.21.15.12:0/2385022144 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f34540a2d80 0x7f34540a5240 secure :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3460009990 tx=0x7f3460009110 comp rx=0 tx=0).stop 2024-09-05T01:41:54.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.169+0000 7f3472a00640 1 --2- 172.21.15.12:0/2385022144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f346c10f5b0 0x7f346c10fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:54.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.169+0000 7f3472a00640 1 --2- 172.21.15.12:0/2385022144 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f346c108fc0 0x7f346c1a3bd0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:54.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.169+0000 7f3472a00640 1 --2- 172.21.15.12:0/2385022144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f346c103e70 0x7f346c1a3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:54.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.169+0000 7f3472a00640 1 -- 172.21.15.12:0/2385022144 >> 172.21.15.12:0/2385022144 conn(0x7f346c0ff8a0 msgr2=0x7f346c100bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:41:54.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.169+0000 7f3472a00640 1 -- 172.21.15.12:0/2385022144 shutdown_connections 2024-09-05T01:41:54.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.169+0000 7f3472a00640 1 -- 172.21.15.12:0/2385022144 wait complete. 2024-09-05T01:41:54.192 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-05T01:41:54.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.441+0000 7f6b4a400640 1 -- 172.21.15.12:0/2483448758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b44101660 msgr2=0x7f6b4410d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:54.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.441+0000 7f6b4a400640 1 --2- 172.21.15.12:0/2483448758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b44101660 0x7f6b4410d6b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c009c10 tx=0x7f6b3c02a700 comp rx=0 tx=0).stop 2024-09-05T01:41:54.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.441+0000 7f6b4a400640 1 -- 172.21.15.12:0/2483448758 shutdown_connections 2024-09-05T01:41:54.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.441+0000 7f6b4a400640 1 --2- 172.21.15.12:0/2483448758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b44101660 0x7f6b4410d6b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:54.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.441+0000 7f6b4a400640 1 --2- 172.21.15.12:0/2483448758 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b44100cc0 0x7f6b44101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:54.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.441+0000 7f6b4a400640 1 --2- 172.21.15.12:0/2483448758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b441067f0 0x7f6b44106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:54.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.441+0000 7f6b4a400640 1 -- 172.21.15.12:0/2483448758 >> 172.21.15.12:0/2483448758 conn(0x7f6b44076550 msgr2=0x7f6b44076960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:41:54.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.442+0000 7f6b4a400640 1 -- 172.21.15.12:0/2483448758 shutdown_connections 2024-09-05T01:41:54.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.442+0000 7f6b4a400640 1 -- 172.21.15.12:0/2483448758 wait complete. 2024-09-05T01:41:54.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.443+0000 7f6b4a400640 1 Processor -- start 2024-09-05T01:41:54.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.443+0000 7f6b4a400640 1 -- start start 2024-09-05T01:41:54.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.444+0000 7f6b4a400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b44100cc0 0x7f6b44199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:54.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.444+0000 7f6b4a400640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b44101660 0x7f6b441960b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:54.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.444+0000 7f6b4a400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b441067f0 0x7f6b441965f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:54.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.444+0000 7f6b4a400640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6b44110be0 con 0x7f6b441067f0 2024-09-05T01:41:54.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.444+0000 7f6b4a400640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f6b44110a60 con 0x7f6b44101660 2024-09-05T01:41:54.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.444+0000 7f6b4a400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6b44110d60 con 0x7f6b44100cc0 2024-09-05T01:41:54.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.444+0000 7f6b49000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b44100cc0 0x7f6b44199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:54.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.445+0000 7f6b43e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b44101660 0x7f6b441960b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:54.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.445+0000 7f6b49000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b44100cc0 0x7f6b44199e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:33978/0 (socket says 172.21.15.12:33978) 2024-09-05T01:41:54.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.445+0000 7f6b49000640 1 -- 172.21.15.12:0/783768390 learned_addr learned my addr 172.21.15.12:0/783768390 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:41:54.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.445+0000 7f6b49a00640 1 --2- 172.21.15.12:0/783768390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b441067f0 0x7f6b441965f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:54.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.446+0000 7f6b49000640 1 -- 172.21.15.12:0/783768390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b44101660 msgr2=0x7f6b441960b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:54.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.446+0000 7f6b49000640 1 --2- 172.21.15.12:0/783768390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b44101660 0x7f6b441960b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:54.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.446+0000 7f6b49000640 1 -- 172.21.15.12:0/783768390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b441067f0 msgr2=0x7f6b441965f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:54.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.446+0000 7f6b49000640 1 --2- 172.21.15.12:0/783768390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b441067f0 0x7f6b441965f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:54.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.446+0000 7f6b49000640 1 -- 172.21.15.12:0/783768390 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b44196e80 con 0x7f6b44100cc0 2024-09-05T01:41:54.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.446+0000 7f6b49000640 1 --2- 172.21.15.12:0/783768390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b44100cc0 0x7f6b44199e00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800e9c0 tx=0x7f6b3800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:41:54.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.447+0000 7f6b41600640 1 -- 172.21.15.12:0/783768390 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3800cde0 con 0x7f6b44100cc0 2024-09-05T01:41:54.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.447+0000 7f6b4a400640 1 -- 172.21.15.12:0/783768390 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4419a580 con 0x7f6b44100cc0 2024-09-05T01:41:54.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.447+0000 7f6b4a400640 1 -- 172.21.15.12:0/783768390 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b4419ab20 con 0x7f6b44100cc0 2024-09-05T01:41:54.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.447+0000 7f6b41600640 1 -- 172.21.15.12:0/783768390 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b38009460 con 0x7f6b44100cc0 2024-09-05T01:41:54.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.447+0000 7f6b41600640 1 -- 172.21.15.12:0/783768390 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38010430 con 0x7f6b44100cc0 2024-09-05T01:41:54.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.450+0000 7f6b4a400640 1 -- 172.21.15.12:0/783768390 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b24005290 con 0x7f6b44100cc0 2024-09-05T01:41:54.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.453+0000 7f6b41600640 1 -- 172.21.15.12:0/783768390 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f6b380035f0 con 0x7f6b44100cc0 2024-09-05T01:41:54.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.455+0000 7f6b41600640 1 --2- 172.21.15.12:0/783768390 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6b2c0a2e00 0x7f6b2c0a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:41:54.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.456+0000 7f6b41600640 1 -- 172.21.15.12:0/783768390 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 8671+0+0 (secure 0 0 0) 0x7f6b380cf6f0 con 0x7f6b44100cc0 2024-09-05T01:41:54.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.456+0000 7f6b43e00640 1 --2- 172.21.15.12:0/783768390 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6b2c0a2e00 0x7f6b2c0a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:41:54.459 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.458+0000 7f6b43e00640 1 --2- 172.21.15.12:0/783768390 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6b2c0a2e00 0x7f6b2c0a52c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6b44197650 tx=0x7f6b300090e0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:41:54.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.462+0000 7f6b41600640 1 -- 172.21.15.12:0/783768390 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6b3809c220 con 0x7f6b44100cc0 2024-09-05T01:41:54.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:54 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/2385022144' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-05T01:41:54.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:54 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/2385022144' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-05T01:41:54.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.882+0000 7f6b4a400640 1 -- 172.21.15.12:0/783768390 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f6b24005850 con 0x7f6b44100cc0 2024-09-05T01:41:54.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.895+0000 7f6b41600640 1 -- 172.21.15.12:0/783768390 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+740902 (secure 0 0 0) 0x7f6b3809bb20 con 0x7f6b44100cc0 2024-09-05T01:41:54.909 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:41:54.910 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:41:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 26, 2024-09-05T01:41:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: "active_gid": 15138, 2024-09-05T01:41:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: "active_name": "x", 2024-09-05T01:41:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: "active_addrs": { 2024-09-05T01:41:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-05T01:41:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-05T01:41:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6800", 2024-09-05T01:41:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3451745620 2024-09-05T01:41:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.910 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:54.911 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-09-05T01:41:54.911 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:6801", 2024-09-05T01:41:54.911 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3451745620 2024-09-05T01:41:54.911 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:54.911 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-05T01:41:54.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.911 INFO:teuthology.orchestra.run.smithi012.stdout: "active_addr": "172.21.15.12:6801/3451745620", 2024-09-05T01:41:54.911 INFO:teuthology.orchestra.run.smithi012.stdout: "active_change": "2024-09-05T01:24:41.593879+0000", 2024-09-05T01:41:54.911 INFO:teuthology.orchestra.run.smithi012.stdout: "active_mgr_features": 4540701547738038271, 2024-09-05T01:41:54.912 INFO:teuthology.orchestra.run.smithi012.stdout: "available": true, 2024-09-05T01:41:54.912 INFO:teuthology.orchestra.run.smithi012.stdout: "standbys": [ 2024-09-05T01:41:54.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:54.912 INFO:teuthology.orchestra.run.smithi012.stdout: "gid": 25145, 2024-09-05T01:41:54.912 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "y", 2024-09-05T01:41:54.912 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_features": 4540701547738038271, 2024-09-05T01:41:54.912 INFO:teuthology.orchestra.run.smithi012.stdout: "available_modules": [ 2024-09-05T01:41:54.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:54.912 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "alerts", 2024-09-05T01:41:54.912 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:54.912 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:54.912 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:54.912 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-05T01:41:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-05T01:41:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-05T01:41:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How frequently to reexamine health status", 2024-09-05T01:41:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:54.914 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:54.915 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.916 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.916 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:54.916 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.916 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.916 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.916 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:54.916 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.916 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.916 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.916 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:54.916 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:54.917 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.918 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_destination": { 2024-09-05T01:41:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_destination", 2024-09-05T01:41:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.919 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email address to send alerts to", 2024-09-05T01:41:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_from_name": { 2024-09-05T01:41:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_from_name", 2024-09-05T01:41:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "Ceph", 2024-09-05T01:41:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email From: name", 2024-09-05T01:41:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_host": { 2024-09-05T01:41:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_host", 2024-09-05T01:41:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.921 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP server", 2024-09-05T01:41:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_password": { 2024-09-05T01:41:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_password", 2024-09-05T01:41:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:54.922 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Password to authenticate with", 2024-09-05T01:41:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_port": { 2024-09-05T01:41:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_port", 2024-09-05T01:41:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "465", 2024-09-05T01:41:54.923 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP port", 2024-09-05T01:41:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_sender": { 2024-09-05T01:41:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_sender", 2024-09-05T01:41:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.924 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP envelope sender", 2024-09-05T01:41:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_ssl": { 2024-09-05T01:41:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_ssl", 2024-09-05T01:41:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:54.925 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-05T01:41:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_user": { 2024-09-05T01:41:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_user", 2024-09-05T01:41:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.926 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "User to authenticate as", 2024-09-05T01:41:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.927 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "balancer", 2024-09-05T01:41:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: "active": { 2024-09-05T01:41:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "active", 2024-09-05T01:41:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.928 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically balance PGs across cluster", 2024-09-05T01:41:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_time": { 2024-09-05T01:41:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_time", 2024-09-05T01:41:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0000", 2024-09-05T01:41:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.929 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "beginning time of day to automatically balance", 2024-09-05T01:41:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-05T01:41:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_weekday": { 2024-09-05T01:41:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_weekday", 2024-09-05T01:41:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-05T01:41:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-05T01:41:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-09-05T01:41:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-09-05T01:41:54.930 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-05T01:41:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-05T01:41:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_max_iterations": { 2024-09-05T01:41:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_max_iterations", 2024-09-05T01:41:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-05T01:41:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "25", 2024-09-05T01:41:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-05T01:41:54.931 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "250", 2024-09-05T01:41:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-05T01:41:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_metrics": { 2024-09-05T01:41:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_metrics", 2024-09-05T01:41:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "pgs,objects,bytes", 2024-09-05T01:41:54.932 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-05T01:41:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-05T01:41:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_step": { 2024-09-05T01:41:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_step", 2024-09-05T01:41:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-05T01:41:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.5", 2024-09-05T01:41:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0.001", 2024-09-05T01:41:54.933 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "0.999", 2024-09-05T01:41:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "aggressiveness of optimization", 2024-09-05T01:41:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-05T01:41:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: "end_time": { 2024-09-05T01:41:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_time", 2024-09-05T01:41:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2359", 2024-09-05T01:41:54.934 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ending time of day to automatically balance", 2024-09-05T01:41:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-05T01:41:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: "end_weekday": { 2024-09-05T01:41:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_weekday", 2024-09-05T01:41:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-05T01:41:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-05T01:41:54.935 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-09-05T01:41:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-09-05T01:41:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-05T01:41:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-05T01:41:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:54.936 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.938 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:54.939 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.940 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: "min_score": { 2024-09-05T01:41:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_score", 2024-09-05T01:41:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-05T01:41:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.941 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-05T01:41:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-05T01:41:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-09-05T01:41:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-09-05T01:41:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.942 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "upmap", 2024-09-05T01:41:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-compat", 2024-09-05T01:41:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "none", 2024-09-05T01:41:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "read", 2024-09-05T01:41:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap", 2024-09-05T01:41:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap-read" 2024-09-05T01:41:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Balancer mode", 2024-09-05T01:41:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.943 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_ids": { 2024-09-05T01:41:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_ids", 2024-09-05T01:41:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-05T01:41:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-05T01:41:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-05T01:41:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-05T01:41:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-05T01:41:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_deviation": { 2024-09-05T01:41:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_deviation", 2024-09-05T01:41:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-05T01:41:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-05T01:41:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-05T01:41:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-05T01:41:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_optimizations": { 2024-09-05T01:41:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_optimizations", 2024-09-05T01:41:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-05T01:41:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-05T01:41:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-05T01:41:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.947 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm", 2024-09-05T01:41:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_down_multiplier": { 2024-09-05T01:41:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_down_multiplier", 2024-09-05T01:41:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-05T01:41:54.948 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-09-05T01:41:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-05T01:41:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_refresh_rate": { 2024-09-05T01:41:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_refresh_rate", 2024-09-05T01:41:54.949 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "20", 2024-09-05T01:41:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-05T01:41:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_starting_port": { 2024-09-05T01:41:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_starting_port", 2024-09-05T01:41:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4721", 2024-09-05T01:41:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-05T01:41:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.951 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_ptrace": { 2024-09-05T01:41:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_ptrace", 2024-09-05T01:41:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-05T01:41:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-05T01:41:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.952 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.953 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_interval": { 2024-09-05T01:41:54.953 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_interval", 2024-09-05T01:41:54.953 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:54.953 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.953 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.953 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-05T01:41:54.953 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.953 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.953 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.953 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-05T01:41:54.953 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.953 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_memory_target_ratio": { 2024-09-05T01:41:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_memory_target_ratio", 2024-09-05T01:41:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-05T01:41:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.7", 2024-09-05T01:41:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-05T01:41:54.954 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm_log_destination": { 2024-09-05T01:41:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm_log_destination", 2024-09-05T01:41:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:54.955 INFO:teuthology.orchestra.run.smithi012.stdout: "file", 2024-09-05T01:41:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: "file,syslog", 2024-09-05T01:41:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: "syslog" 2024-09-05T01:41:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-05T01:41:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: "cgroups_split": { 2024-09-05T01:41:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cgroups_split", 2024-09-05T01:41:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.956 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-05T01:41:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: "config_checks_enabled": { 2024-09-05T01:41:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_checks_enabled", 2024-09-05T01:41:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:54.957 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-05T01:41:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: "config_dashboard": { 2024-09-05T01:41:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_dashboard", 2024-09-05T01:41:54.958 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:54.959 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.959 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.959 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:54.959 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.959 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.959 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.959 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-05T01:41:54.959 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.959 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.959 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.959 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.959 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_alertmanager": { 2024-09-05T01:41:54.959 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_alertmanager", 2024-09-05T01:41:54.959 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.960 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.960 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.960 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-05T01:41:54.960 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.960 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.960 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.960 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-05T01:41:54.960 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.960 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.960 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.960 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_base": { 2024-09-05T01:41:54.961 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_base", 2024-09-05T01:41:54.961 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.961 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.961 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.961 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-05T01:41:54.961 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.961 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.961 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.961 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Container image name, without the tag", 2024-09-05T01:41:54.961 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.961 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.961 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.961 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_elasticsearch": { 2024-09-05T01:41:54.962 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_elasticsearch", 2024-09-05T01:41:54.962 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.962 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.962 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.962 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-05T01:41:54.962 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.962 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.962 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.963 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "elasticsearch container image", 2024-09-05T01:41:54.963 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.964 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.964 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.964 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_grafana": { 2024-09-05T01:41:54.964 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_grafana", 2024-09-05T01:41:54.964 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.964 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.964 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.964 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-05T01:41:54.964 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.964 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.964 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.965 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-05T01:41:54.965 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.965 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.965 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.965 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.965 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_haproxy": { 2024-09-05T01:41:54.965 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_haproxy", 2024-09-05T01:41:54.965 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.965 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.965 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.965 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-05T01:41:54.965 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.965 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.966 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.966 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "HAproxy container image", 2024-09-05T01:41:54.966 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.966 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.966 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.966 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_agent": { 2024-09-05T01:41:54.966 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_agent", 2024-09-05T01:41:54.966 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.966 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.966 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.966 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-05T01:41:54.967 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.967 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.967 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.967 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger agent container image", 2024-09-05T01:41:54.967 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.967 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.967 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.967 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_collector": { 2024-09-05T01:41:54.967 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_collector", 2024-09-05T01:41:54.967 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.967 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.968 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.968 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-05T01:41:54.968 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.968 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.968 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.968 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger collector container image", 2024-09-05T01:41:54.968 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.968 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.968 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.968 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_query": { 2024-09-05T01:41:54.968 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_query", 2024-09-05T01:41:54.969 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.969 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.969 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.969 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-05T01:41:54.969 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.969 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.969 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.969 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger query container image", 2024-09-05T01:41:54.969 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.969 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.969 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.969 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_keepalived": { 2024-09-05T01:41:54.970 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_keepalived", 2024-09-05T01:41:54.970 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.970 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.970 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.970 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-05T01:41:54.970 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.970 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.970 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.970 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Keepalived container image", 2024-09-05T01:41:54.970 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.970 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.970 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.970 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.970 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_loki": { 2024-09-05T01:41:54.971 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_loki", 2024-09-05T01:41:54.971 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.971 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.971 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.971 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-05T01:41:54.971 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.971 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.971 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.971 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Loki container image", 2024-09-05T01:41:54.971 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.971 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.971 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.971 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.971 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_node_exporter": { 2024-09-05T01:41:54.972 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_node_exporter", 2024-09-05T01:41:54.972 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.972 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.972 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.972 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-05T01:41:54.972 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.972 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.972 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.972 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-05T01:41:54.972 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.972 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.972 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.973 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.973 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_nvmeof": { 2024-09-05T01:41:54.973 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_nvmeof", 2024-09-05T01:41:54.973 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.973 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.973 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.973 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-05T01:41:54.973 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.973 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.973 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.973 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Nvme-of container image", 2024-09-05T01:41:54.973 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.973 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.974 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.974 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_prometheus": { 2024-09-05T01:41:54.974 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_prometheus", 2024-09-05T01:41:54.974 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.974 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.974 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.974 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-05T01:41:54.974 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.974 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.974 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.974 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-05T01:41:54.975 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.975 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.975 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.975 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_promtail": { 2024-09-05T01:41:54.975 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_promtail", 2024-09-05T01:41:54.975 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.975 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.975 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.975 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-05T01:41:54.975 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.975 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.975 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.975 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Promtail container image", 2024-09-05T01:41:54.976 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.976 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.976 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.976 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_samba": { 2024-09-05T01:41:54.976 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_samba", 2024-09-05T01:41:54.976 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.976 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.976 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.976 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-05T01:41:54.976 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.976 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.976 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.977 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Samba/SMB container image", 2024-09-05T01:41:54.977 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.977 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.977 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.977 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.977 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_snmp_gateway": { 2024-09-05T01:41:54.977 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_snmp_gateway", 2024-09-05T01:41:54.977 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.977 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.977 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.977 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-05T01:41:54.977 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.977 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.978 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.978 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SNMP Gateway container image", 2024-09-05T01:41:54.978 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.978 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.978 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.978 INFO:teuthology.orchestra.run.smithi012.stdout: "container_init": { 2024-09-05T01:41:54.978 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_init", 2024-09-05T01:41:54.978 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:54.978 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.978 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.978 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:54.978 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.979 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.979 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.979 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Run podman/docker with `--init`", 2024-09-05T01:41:54.979 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.979 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.979 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.979 INFO:teuthology.orchestra.run.smithi012.stdout: "daemon_cache_timeout": { 2024-09-05T01:41:54.979 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "daemon_cache_timeout", 2024-09-05T01:41:54.979 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:54.979 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.979 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.979 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-05T01:41:54.979 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.980 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.980 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.980 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-05T01:41:54.980 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.980 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.980 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.980 INFO:teuthology.orchestra.run.smithi012.stdout: "default_cephadm_command_timeout": { 2024-09-05T01:41:54.980 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_cephadm_command_timeout", 2024-09-05T01:41:54.980 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:54.980 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.980 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.980 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "900", 2024-09-05T01:41:54.980 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.981 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.981 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.981 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-05T01:41:54.981 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.981 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.981 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.981 INFO:teuthology.orchestra.run.smithi012.stdout: "default_registry": { 2024-09-05T01:41:54.981 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_registry", 2024-09-05T01:41:54.981 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.981 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.981 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.981 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io", 2024-09-05T01:41:54.981 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.982 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.982 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.982 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-05T01:41:54.982 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.982 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.982 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.982 INFO:teuthology.orchestra.run.smithi012.stdout: "device_cache_timeout": { 2024-09-05T01:41:54.982 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_cache_timeout", 2024-09-05T01:41:54.982 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:54.982 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.982 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.982 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1800", 2024-09-05T01:41:54.983 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.983 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.983 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.983 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache device inventory", 2024-09-05T01:41:54.983 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.983 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.983 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.983 INFO:teuthology.orchestra.run.smithi012.stdout: "device_enhanced_scan": { 2024-09-05T01:41:54.983 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_enhanced_scan", 2024-09-05T01:41:54.983 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:54.983 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.983 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.983 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:54.983 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.984 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.984 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.984 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-05T01:41:54.984 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.984 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.984 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.984 INFO:teuthology.orchestra.run.smithi012.stdout: "facts_cache_timeout": { 2024-09-05T01:41:54.984 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "facts_cache_timeout", 2024-09-05T01:41:54.984 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:54.984 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.984 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.985 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-05T01:41:54.985 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.985 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.985 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.985 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache host facts data", 2024-09-05T01:41:54.985 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.985 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.985 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.985 INFO:teuthology.orchestra.run.smithi012.stdout: "grafana_dashboards_path": { 2024-09-05T01:41:54.985 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "grafana_dashboards_path", 2024-09-05T01:41:54.985 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.985 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.985 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.986 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-05T01:41:54.986 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.986 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.986 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.986 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-05T01:41:54.986 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.986 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.986 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.986 INFO:teuthology.orchestra.run.smithi012.stdout: "host_check_interval": { 2024-09-05T01:41:54.986 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "host_check_interval", 2024-09-05T01:41:54.986 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:54.986 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.986 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.986 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-05T01:41:54.987 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.987 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.987 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.987 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to perform a host check", 2024-09-05T01:41:54.987 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.987 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.987 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.987 INFO:teuthology.orchestra.run.smithi012.stdout: "hw_monitoring": { 2024-09-05T01:41:54.987 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hw_monitoring", 2024-09-05T01:41:54.987 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:54.987 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.987 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.988 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:54.988 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.988 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.988 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.988 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-05T01:41:54.988 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.988 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.988 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.988 INFO:teuthology.orchestra.run.smithi012.stdout: "inventory_list_all": { 2024-09-05T01:41:54.988 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "inventory_list_all", 2024-09-05T01:41:54.988 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:54.988 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.989 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.989 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:54.989 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.989 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.989 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.989 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-05T01:41:54.989 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.989 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.989 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.989 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:54.989 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:54.989 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.990 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.990 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.990 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:54.990 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.990 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.990 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:54.990 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:54.990 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:54.990 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:54.990 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:54.990 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:54.990 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:54.990 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:54.990 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:54.990 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.991 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.991 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.991 INFO:teuthology.orchestra.run.smithi012.stdout: "log_refresh_metadata": { 2024-09-05T01:41:54.991 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_refresh_metadata", 2024-09-05T01:41:54.991 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:54.991 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.991 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.991 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:54.991 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.991 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.991 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.991 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-05T01:41:54.992 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.992 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.992 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.992 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.992 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:54.992 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:54.992 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:54.992 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.992 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.992 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:54.992 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.992 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.992 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.992 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-05T01:41:54.993 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.993 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.993 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.993 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:54.993 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:54.993 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.993 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.993 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.993 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:54.993 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.993 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.993 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:54.994 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:54.994 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:54.994 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:54.994 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:54.994 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:54.994 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:54.994 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:54.994 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:54.994 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.994 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.994 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.994 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:54.994 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:54.995 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:54.995 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.995 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:54.995 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:54.995 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.995 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.995 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.995 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:54.995 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.995 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.995 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.995 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-05T01:41:54.996 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-05T01:41:54.996 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:54.996 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.996 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.996 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:54.996 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.996 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.996 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.996 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-05T01:41:54.996 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.996 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.996 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.996 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.997 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-05T01:41:54.997 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-05T01:41:54.997 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:54.997 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.997 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.997 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "*", 2024-09-05T01:41:54.997 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.997 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.997 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.997 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-05T01:41:54.997 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.997 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.998 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.998 INFO:teuthology.orchestra.run.smithi012.stdout: "max_count_per_host": { 2024-09-05T01:41:54.998 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_count_per_host", 2024-09-05T01:41:54.998 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:54.998 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.998 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.998 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-05T01:41:54.998 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.998 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:54.999 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:54.999 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of daemons per service per host", 2024-09-05T01:41:54.999 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:54.999 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:54.999 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:54.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:54.999 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd_draining_count": { 2024-09-05T01:41:54.999 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_osd_draining_count", 2024-09-05T01:41:54.999 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:54.999 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:54.999 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:54.999 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-05T01:41:54.999 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:54.999 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.000 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.000 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-05T01:41:55.000 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.000 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.000 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.000 INFO:teuthology.orchestra.run.smithi012.stdout: "migration_current": { 2024-09-05T01:41:55.000 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "migration_current", 2024-09-05T01:41:55.000 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.000 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.000 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.000 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.000 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.001 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.001 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.001 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "internal - do not modify", 2024-09-05T01:41:55.001 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.001 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.001 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.001 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-09-05T01:41:55.001 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-09-05T01:41:55.001 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.001 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.001 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.001 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "root", 2024-09-05T01:41:55.001 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.002 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.002 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.002 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm-package", 2024-09-05T01:41:55.002 INFO:teuthology.orchestra.run.smithi012.stdout: "root" 2024-09-05T01:41:55.002 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.002 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "mode for remote execution of cephadm", 2024-09-05T01:41:55.002 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.002 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.002 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.002 INFO:teuthology.orchestra.run.smithi012.stdout: "oob_default_addr": { 2024-09-05T01:41:55.002 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "oob_default_addr", 2024-09-05T01:41:55.002 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.002 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.003 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.003 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "169.254.1.1", 2024-09-05T01:41:55.003 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.003 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.003 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.003 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-05T01:41:55.003 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.003 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.003 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.003 INFO:teuthology.orchestra.run.smithi012.stdout: "prometheus_alerts_path": { 2024-09-05T01:41:55.003 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus_alerts_path", 2024-09-05T01:41:55.003 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.003 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.004 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.004 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-05T01:41:55.004 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.004 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.004 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.004 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-05T01:41:55.004 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.004 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.004 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.004 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_insecure": { 2024-09-05T01:41:55.004 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_insecure", 2024-09-05T01:41:55.004 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.005 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.005 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.005 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.005 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.005 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.005 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.005 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-05T01:41:55.005 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.005 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.005 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.005 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_password": { 2024-09-05T01:41:55.005 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_password", 2024-09-05T01:41:55.006 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.006 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.006 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.006 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.006 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.006 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.006 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.006 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-05T01:41:55.006 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.006 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.006 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.006 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.006 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_url": { 2024-09-05T01:41:55.007 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_url", 2024-09-05T01:41:55.007 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.007 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.007 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.007 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.007 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.007 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.007 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.007 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-05T01:41:55.007 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.007 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.007 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.008 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_username": { 2024-09-05T01:41:55.008 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_username", 2024-09-05T01:41:55.008 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.008 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.008 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.008 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.008 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.008 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.008 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.008 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-05T01:41:55.008 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.008 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.008 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.009 INFO:teuthology.orchestra.run.smithi012.stdout: "secure_monitoring_stack": { 2024-09-05T01:41:55.009 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "secure_monitoring_stack", 2024-09-05T01:41:55.009 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.009 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.009 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.009 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.009 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.009 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.009 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.009 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-05T01:41:55.009 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.009 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.009 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.010 INFO:teuthology.orchestra.run.smithi012.stdout: "service_discovery_port": { 2024-09-05T01:41:55.010 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "service_discovery_port", 2024-09-05T01:41:55.010 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.010 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.010 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.010 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8765", 2024-09-05T01:41:55.010 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.010 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.010 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.010 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "cephadm service discovery port", 2024-09-05T01:41:55.010 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.010 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.010 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.010 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.011 INFO:teuthology.orchestra.run.smithi012.stdout: "ssh_config_file": { 2024-09-05T01:41:55.011 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssh_config_file", 2024-09-05T01:41:55.011 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.011 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.011 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.011 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.011 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.011 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.011 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.011 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-05T01:41:55.011 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.011 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.011 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.012 INFO:teuthology.orchestra.run.smithi012.stdout: "use_agent": { 2024-09-05T01:41:55.012 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_agent", 2024-09-05T01:41:55.012 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.012 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.012 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.012 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.012 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.012 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.012 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.012 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-05T01:41:55.012 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.012 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.012 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.013 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.013 INFO:teuthology.orchestra.run.smithi012.stdout: "use_repo_digest": { 2024-09-05T01:41:55.013 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_repo_digest", 2024-09-05T01:41:55.013 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.013 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.013 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.013 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.013 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.013 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.013 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.013 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-05T01:41:55.013 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.013 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.013 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.014 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_failed_host_check": { 2024-09-05T01:41:55.014 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_failed_host_check", 2024-09-05T01:41:55.014 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.014 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.014 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.014 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.014 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.014 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.014 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.014 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if the host check fails", 2024-09-05T01:41:55.014 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.014 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.014 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.015 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_daemons": { 2024-09-05T01:41:55.015 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_daemons", 2024-09-05T01:41:55.015 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.015 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.015 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.015 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.015 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.015 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.015 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.015 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-05T01:41:55.015 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.015 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.016 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.016 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.016 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_hosts": { 2024-09-05T01:41:55.016 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_hosts", 2024-09-05T01:41:55.016 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.016 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.016 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.016 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.016 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.016 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.016 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.016 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-05T01:41:55.016 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.017 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.017 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.017 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.017 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.017 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.017 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crash", 2024-09-05T01:41:55.017 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.017 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.017 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.017 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.018 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.018 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.018 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.018 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.018 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.018 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.018 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.018 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.018 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.018 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.018 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.018 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.018 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.019 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.019 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.019 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.019 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.019 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.019 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.019 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.019 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.019 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.019 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.019 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.019 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.019 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.020 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.020 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.020 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.020 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.020 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.020 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.020 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.020 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.020 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.020 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.020 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.021 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.021 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.021 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.021 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.021 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.021 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.021 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.021 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.021 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.021 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.021 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.021 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.021 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.021 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.021 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.022 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.022 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.022 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.022 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.022 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.022 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.022 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.022 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.022 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.022 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.022 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.022 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.022 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.023 INFO:teuthology.orchestra.run.smithi012.stdout: "retain_interval": { 2024-09-05T01:41:55.023 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retain_interval", 2024-09-05T01:41:55.023 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.023 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.023 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.023 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "31536000", 2024-09-05T01:41:55.023 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.023 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.023 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.023 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-05T01:41:55.023 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.023 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.023 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.024 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_recent_interval": { 2024-09-05T01:41:55.024 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_recent_interval", 2024-09-05T01:41:55.024 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.024 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.024 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.024 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1209600", 2024-09-05T01:41:55.024 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.024 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.024 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.024 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-05T01:41:55.024 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.024 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.024 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.025 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.025 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.025 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.025 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dashboard", 2024-09-05T01:41:55.025 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.025 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.025 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.025 INFO:teuthology.orchestra.run.smithi012.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-05T01:41:55.025 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-05T01:41:55.025 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.025 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.025 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.025 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-05T01:41:55.026 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.026 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.026 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.026 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.026 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.026 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.026 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.026 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.026 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_HOST": { 2024-09-05T01:41:55.026 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-05T01:41:55.026 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.026 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.026 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.027 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.027 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.027 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.027 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.027 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.027 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.027 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.027 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.027 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-05T01:41:55.027 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-05T01:41:55.027 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.027 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.027 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.028 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.028 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.028 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.028 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.028 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.028 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.028 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.028 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.028 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.028 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_ENABLED": { 2024-09-05T01:41:55.028 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_ENABLED", 2024-09-05T01:41:55.028 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.028 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.028 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.029 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.029 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.029 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.029 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.029 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.029 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.029 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.029 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.029 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-05T01:41:55.029 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-05T01:41:55.029 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.029 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.029 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.030 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.030 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.030 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.030 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.030 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.030 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.030 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.030 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.030 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.030 INFO:teuthology.orchestra.run.smithi012.stdout: "ENABLE_BROWSABLE_API": { 2024-09-05T01:41:55.030 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-05T01:41:55.030 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.030 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.030 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.030 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.031 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.031 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.031 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.031 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.031 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.031 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.031 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.031 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.031 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-05T01:41:55.031 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-05T01:41:55.031 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.031 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.032 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.032 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.032 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.032 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.032 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.032 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.032 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.032 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.032 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.032 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-05T01:41:55.032 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-05T01:41:55.032 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.033 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.033 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.033 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.033 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.033 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.033 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.033 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.033 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.033 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.033 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.033 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-05T01:41:55.033 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-05T01:41:55.034 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.034 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.034 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.034 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.034 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.034 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.034 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.034 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.034 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.034 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.034 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.034 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-05T01:41:55.035 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-05T01:41:55.035 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.035 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.035 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.035 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.035 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.035 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.035 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.035 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.035 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.035 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.035 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.035 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-05T01:41:55.036 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-05T01:41:55.036 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.036 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.036 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.036 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.036 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.036 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.036 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.036 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.036 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.036 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.036 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.037 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-05T01:41:55.037 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-05T01:41:55.037 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.037 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.037 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.037 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.037 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.037 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.037 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.037 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.037 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.037 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.038 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.038 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.038 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-05T01:41:55.038 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-05T01:41:55.038 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.038 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.038 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.038 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.038 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.038 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.038 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.038 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.038 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.038 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.039 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.039 INFO:teuthology.orchestra.run.smithi012.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-05T01:41:55.039 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-05T01:41:55.039 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.039 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.039 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.039 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.039 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.039 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.039 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.039 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.039 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.039 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.040 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.040 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_PASSWORD": { 2024-09-05T01:41:55.040 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-05T01:41:55.040 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.040 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.040 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.040 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-05T01:41:55.040 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.040 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.040 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.040 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.040 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.040 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.041 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.041 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-05T01:41:55.041 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-05T01:41:55.041 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.041 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.041 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.041 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.041 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.041 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.041 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.041 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.041 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.041 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.042 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.042 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.042 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_URL": { 2024-09-05T01:41:55.042 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_URL", 2024-09-05T01:41:55.042 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.042 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.042 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.042 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.042 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.042 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.042 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.042 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.042 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.042 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.043 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.043 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_USERNAME": { 2024-09-05T01:41:55.043 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-05T01:41:55.043 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.043 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.043 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.043 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-05T01:41:55.043 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.043 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.043 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.043 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.043 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.043 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.044 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.044 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-05T01:41:55.044 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-05T01:41:55.044 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.044 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.044 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.044 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.044 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.044 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.044 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.044 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.044 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.045 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.045 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.045 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-05T01:41:55.045 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-05T01:41:55.045 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.045 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.045 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.045 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.045 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.045 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.045 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.045 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.046 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.046 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.046 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.046 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.046 INFO:teuthology.orchestra.run.smithi012.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-05T01:41:55.046 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-05T01:41:55.046 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.046 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.046 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.046 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.046 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.046 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.046 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.046 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.047 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.047 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.047 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.047 INFO:teuthology.orchestra.run.smithi012.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-05T01:41:55.047 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-05T01:41:55.047 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.047 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.047 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.047 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.047 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.047 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.047 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.047 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.048 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.048 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.048 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.048 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_HOST": { 2024-09-05T01:41:55.048 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-05T01:41:55.048 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.048 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.048 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.048 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.048 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.048 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.048 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.049 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.049 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.049 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.049 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.049 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.049 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-05T01:41:55.049 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-05T01:41:55.049 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.049 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.049 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.049 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.049 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.049 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.050 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.050 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.050 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.050 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.050 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.050 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-05T01:41:55.050 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-05T01:41:55.050 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.050 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.050 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.050 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.050 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.051 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.051 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.051 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.051 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.051 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.051 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.051 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-05T01:41:55.051 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-05T01:41:55.051 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.051 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.051 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.051 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.051 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.052 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.052 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.052 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.052 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.052 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.052 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.052 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-05T01:41:55.052 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-05T01:41:55.052 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.052 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.052 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.052 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.052 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.053 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.053 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.053 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.053 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.053 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.053 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.053 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.053 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-05T01:41:55.053 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-05T01:41:55.053 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.053 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.053 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.053 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.053 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.054 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.054 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.054 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.054 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.054 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.054 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.054 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-05T01:41:55.054 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-05T01:41:55.054 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.054 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.054 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.054 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.054 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.055 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.055 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.055 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.055 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.055 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.055 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.055 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-05T01:41:55.055 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-05T01:41:55.055 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.055 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.055 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.055 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.055 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.056 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.056 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.056 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.056 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.056 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.056 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.056 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.056 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-05T01:41:55.056 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-05T01:41:55.056 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.056 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.056 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.056 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.056 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.056 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.057 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.057 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.057 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.057 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.057 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.057 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_ENABLED": { 2024-09-05T01:41:55.057 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-05T01:41:55.057 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.057 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.057 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.057 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.057 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.058 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.058 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.058 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.058 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.058 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.058 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.058 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-05T01:41:55.058 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-05T01:41:55.058 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.058 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.058 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.059 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-05T01:41:55.059 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.059 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.059 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.059 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.059 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.059 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.059 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.059 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-05T01:41:55.059 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-05T01:41:55.059 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.059 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.059 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.059 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-05T01:41:55.060 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.060 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.060 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.060 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.060 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.060 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.060 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.060 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-05T01:41:55.060 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-05T01:41:55.060 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.060 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.060 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.061 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8", 2024-09-05T01:41:55.061 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.061 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.061 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.061 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.061 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.061 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.061 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.061 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.061 INFO:teuthology.orchestra.run.smithi012.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-05T01:41:55.061 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-05T01:41:55.061 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.061 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.061 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.062 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "45", 2024-09-05T01:41:55.062 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.062 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.062 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.062 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.062 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.062 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.062 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.062 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ACCESS_KEY": { 2024-09-05T01:41:55.062 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-05T01:41:55.062 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.062 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.062 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.062 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.063 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.063 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.063 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.063 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.063 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.063 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.063 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.063 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.063 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-05T01:41:55.063 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-05T01:41:55.063 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.063 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.063 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.063 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-05T01:41:55.064 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.064 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.064 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.064 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.064 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.064 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.064 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.064 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SECRET_KEY": { 2024-09-05T01:41:55.064 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-05T01:41:55.064 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.064 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.064 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.065 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.065 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.065 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.065 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.065 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.065 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.065 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.065 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.065 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SSL_VERIFY": { 2024-09-05T01:41:55.065 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-05T01:41:55.065 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.065 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.066 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.066 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.066 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.066 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.066 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.066 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.066 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.066 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.066 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.066 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-05T01:41:55.066 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-05T01:41:55.066 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.066 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.067 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.067 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-05T01:41:55.067 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.067 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.067 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.067 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.067 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.067 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.067 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.067 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-05T01:41:55.067 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-05T01:41:55.067 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.068 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.068 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.068 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-05T01:41:55.068 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.068 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.068 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.068 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.068 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.068 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.068 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.068 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.068 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-05T01:41:55.068 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-05T01:41:55.069 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.069 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.069 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.069 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-05T01:41:55.069 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.069 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.069 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.069 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.069 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.069 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.069 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.069 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.069 INFO:teuthology.orchestra.run.smithi012.stdout: "cross_origin_url": { 2024-09-05T01:41:55.069 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cross_origin_url", 2024-09-05T01:41:55.070 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.070 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.070 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.070 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.070 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.070 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.070 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.070 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.070 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.070 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.070 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.070 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.070 INFO:teuthology.orchestra.run.smithi012.stdout: "crt_file": { 2024-09-05T01:41:55.071 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crt_file", 2024-09-05T01:41:55.071 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.071 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.071 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.071 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.071 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.071 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.071 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.071 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.071 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.071 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.071 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.071 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.071 INFO:teuthology.orchestra.run.smithi012.stdout: "debug": { 2024-09-05T01:41:55.072 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "debug", 2024-09-05T01:41:55.072 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.072 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.072 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.072 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.072 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.072 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.072 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.072 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable/disable debug options", 2024-09-05T01:41:55.072 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.072 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.072 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.073 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.073 INFO:teuthology.orchestra.run.smithi012.stdout: "jwt_token_ttl": { 2024-09-05T01:41:55.073 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "jwt_token_ttl", 2024-09-05T01:41:55.073 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.073 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.073 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.073 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "28800", 2024-09-05T01:41:55.073 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.073 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.073 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.073 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.073 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.073 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.074 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.074 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.074 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-09-05T01:41:55.074 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-09-05T01:41:55.074 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.074 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.074 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.074 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.074 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.074 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.074 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.074 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.075 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.075 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.075 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.075 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.075 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.075 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.075 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.075 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.075 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.075 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.075 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.075 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.076 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.076 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.076 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.076 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.076 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.076 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.076 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.076 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.076 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.076 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.076 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.076 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.076 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.076 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.076 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.077 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.077 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.077 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.077 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.077 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.077 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.077 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.077 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.077 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.077 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.077 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.077 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.078 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.078 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.078 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.078 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.078 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.078 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.078 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.078 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.078 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.078 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.078 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.078 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.078 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.079 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.079 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.079 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.079 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.079 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.079 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.079 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.079 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.079 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.079 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.079 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.079 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.080 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.080 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.080 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.080 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.080 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.080 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.080 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.080 INFO:teuthology.orchestra.run.smithi012.stdout: "motd": { 2024-09-05T01:41:55.080 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "motd", 2024-09-05T01:41:55.080 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.080 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.080 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.080 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.081 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.081 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.081 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.081 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "The message of the day", 2024-09-05T01:41:55.081 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.081 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.081 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.081 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.081 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect_resolve_ip_addr": { 2024-09-05T01:41:55.081 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "redirect_resolve_ip_addr", 2024-09-05T01:41:55.081 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.081 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.081 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.082 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.082 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.082 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.082 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.082 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.082 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.082 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.082 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.082 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-05T01:41:55.082 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-05T01:41:55.082 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.082 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.082 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.083 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-09-05T01:41:55.083 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.083 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.083 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.083 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.083 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.083 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.083 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.083 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-05T01:41:55.083 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-05T01:41:55.083 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.083 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.083 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.083 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8080", 2024-09-05T01:41:55.084 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.084 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.084 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.084 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.084 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.084 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.084 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.084 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-09-05T01:41:55.084 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-09-05T01:41:55.084 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.084 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.084 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.085 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.085 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.085 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.085 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.085 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.085 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.085 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.085 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.085 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl_server_port": { 2024-09-05T01:41:55.085 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl_server_port", 2024-09-05T01:41:55.085 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.085 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.086 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.086 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8443", 2024-09-05T01:41:55.086 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.086 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.086 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.086 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.086 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.086 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.086 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.086 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.086 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-09-05T01:41:55.086 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-09-05T01:41:55.086 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.087 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.087 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.087 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "redirect", 2024-09-05T01:41:55.087 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.087 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.087 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.087 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.087 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect" 2024-09-05T01:41:55.087 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.087 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.087 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.087 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.087 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.088 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-09-05T01:41:55.088 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-09-05T01:41:55.088 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.088 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.088 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.088 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-09-05T01:41:55.088 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-09-05T01:41:55.088 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-09-05T01:41:55.088 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.088 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.088 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.088 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.088 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.089 INFO:teuthology.orchestra.run.smithi012.stdout: "url_prefix": { 2024-09-05T01:41:55.089 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url_prefix", 2024-09-05T01:41:55.089 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.089 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.089 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.089 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.089 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.089 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.089 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.089 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.089 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.089 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.090 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.090 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.090 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.090 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.090 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "devicehealth", 2024-09-05T01:41:55.090 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.090 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.090 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.090 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_monitoring": { 2024-09-05T01:41:55.090 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_monitoring", 2024-09-05T01:41:55.090 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.090 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.090 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.090 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.091 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.091 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.091 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.091 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "monitor device health metrics", 2024-09-05T01:41:55.091 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.091 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.091 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.091 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.091 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.091 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.091 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.091 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.091 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.092 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.092 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.092 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.092 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.092 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.092 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.092 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.092 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.092 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.092 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.092 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.092 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.092 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.092 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.093 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.093 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.093 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.093 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.093 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.093 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.093 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.093 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.093 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.093 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.093 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.093 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.093 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.094 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.094 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.094 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.094 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.094 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.094 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.094 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.094 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.094 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.094 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.094 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.094 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.094 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.094 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.095 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.095 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.095 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.095 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.095 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.095 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.095 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.095 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.095 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.095 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.095 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.095 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.095 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.095 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.096 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.096 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.096 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.096 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.096 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.096 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.096 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.096 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.096 INFO:teuthology.orchestra.run.smithi012.stdout: "mark_out_threshold": { 2024-09-05T01:41:55.096 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mark_out_threshold", 2024-09-05T01:41:55.096 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.096 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.096 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.096 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2419200", 2024-09-05T01:41:55.097 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.097 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.097 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.097 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-05T01:41:55.097 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.097 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.097 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.097 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": { 2024-09-05T01:41:55.097 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_name", 2024-09-05T01:41:55.097 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.097 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.097 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.098 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "device_health_metrics", 2024-09-05T01:41:55.098 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.098 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.098 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.098 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-05T01:41:55.098 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.098 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.098 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.098 INFO:teuthology.orchestra.run.smithi012.stdout: "retention_period": { 2024-09-05T01:41:55.099 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retention_period", 2024-09-05T01:41:55.099 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.099 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.099 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.099 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15552000", 2024-09-05T01:41:55.099 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.099 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.099 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.099 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain device health metrics", 2024-09-05T01:41:55.099 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.099 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.099 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.100 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_frequency": { 2024-09-05T01:41:55.100 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_frequency", 2024-09-05T01:41:55.100 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.100 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.100 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.100 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-09-05T01:41:55.100 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.100 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.100 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.100 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-05T01:41:55.100 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.100 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.101 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.101 INFO:teuthology.orchestra.run.smithi012.stdout: "self_heal": { 2024-09-05T01:41:55.101 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "self_heal", 2024-09-05T01:41:55.101 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.101 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.101 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.101 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.101 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.101 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.101 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.101 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-05T01:41:55.101 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.102 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.102 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.102 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-05T01:41:55.102 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-05T01:41:55.102 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.102 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.102 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.102 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-05T01:41:55.102 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.102 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.102 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.102 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and check device health", 2024-09-05T01:41:55.102 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.103 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.103 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.103 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_threshold": { 2024-09-05T01:41:55.103 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_threshold", 2024-09-05T01:41:55.103 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.103 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.103 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.103 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7257600", 2024-09-05T01:41:55.103 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.103 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.103 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.103 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-05T01:41:55.104 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.104 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.104 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.104 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.104 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.104 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.104 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "diskprediction_local", 2024-09-05T01:41:55.104 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.104 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.104 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.104 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.104 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.104 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.105 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.105 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.105 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.105 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.105 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.105 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.105 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.105 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.105 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.105 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.105 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.105 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.105 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.105 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.106 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.106 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.106 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.106 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.106 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.106 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.106 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.106 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.106 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.106 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.106 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.106 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.106 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.107 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.107 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.107 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.107 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.107 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.107 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.107 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.107 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.107 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.107 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.107 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.107 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.107 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.107 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.108 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.108 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.108 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.108 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.108 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.108 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.108 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.108 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.108 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.108 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.108 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.108 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.108 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.109 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.109 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.109 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.109 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.109 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.109 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.109 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.109 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.109 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.109 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.109 INFO:teuthology.orchestra.run.smithi012.stdout: "predict_interval": { 2024-09-05T01:41:55.109 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predict_interval", 2024-09-05T01:41:55.110 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.110 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.110 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.110 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-09-05T01:41:55.110 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.110 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.110 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.110 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.110 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.110 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.110 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.110 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.110 INFO:teuthology.orchestra.run.smithi012.stdout: "predictor_model": { 2024-09-05T01:41:55.111 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predictor_model", 2024-09-05T01:41:55.111 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.111 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.111 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.111 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "prophetstor", 2024-09-05T01:41:55.111 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.111 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.111 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.111 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.111 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.111 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.111 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.112 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-05T01:41:55.112 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-05T01:41:55.112 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.112 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.112 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.112 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-05T01:41:55.112 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.112 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.112 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.112 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.112 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.112 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.112 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.112 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.113 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.113 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.113 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "influx", 2024-09-05T01:41:55.113 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": false, 2024-09-05T01:41:55.113 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "influxdb python module not found", 2024-09-05T01:41:55.113 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.113 INFO:teuthology.orchestra.run.smithi012.stdout: "batch_size": { 2024-09-05T01:41:55.113 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "batch_size", 2024-09-05T01:41:55.113 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.113 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.113 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.113 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5000", 2024-09-05T01:41:55.113 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.114 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.114 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.114 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-05T01:41:55.114 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.114 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.114 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.114 INFO:teuthology.orchestra.run.smithi012.stdout: "database": { 2024-09-05T01:41:55.114 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "database", 2024-09-05T01:41:55.114 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.114 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.114 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.114 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "ceph", 2024-09-05T01:41:55.115 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.115 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.115 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.115 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-05T01:41:55.115 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.115 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.115 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.115 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": { 2024-09-05T01:41:55.115 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hostname", 2024-09-05T01:41:55.115 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.115 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.115 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.115 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.115 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.116 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.116 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.116 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server hostname", 2024-09-05T01:41:55.116 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.116 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.116 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.116 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-05T01:41:55.116 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-05T01:41:55.116 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.116 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.116 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.116 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "30", 2024-09-05T01:41:55.117 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "5", 2024-09-05T01:41:55.117 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.117 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.117 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-05T01:41:55.117 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.117 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.117 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.117 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.117 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.117 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.117 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.117 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.118 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.118 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.118 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.118 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.118 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.118 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.118 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.118 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.118 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.118 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.118 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.118 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.118 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.118 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.118 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.119 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.119 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.119 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.119 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.119 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.119 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.119 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.119 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.119 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.119 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.119 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.119 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.119 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.120 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.120 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.120 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.120 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.120 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.120 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.120 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.120 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.120 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.120 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.120 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.120 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.120 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.121 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.121 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.121 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.121 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.121 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.121 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.121 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.121 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.121 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.121 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.121 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.121 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.121 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.122 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.122 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.122 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.122 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.122 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.122 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.122 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.122 INFO:teuthology.orchestra.run.smithi012.stdout: "password": { 2024-09-05T01:41:55.122 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "password", 2024-09-05T01:41:55.122 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.122 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.122 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.122 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.122 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.122 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.123 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.123 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "password of InfluxDB server user", 2024-09-05T01:41:55.123 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.123 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.123 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.123 INFO:teuthology.orchestra.run.smithi012.stdout: "port": { 2024-09-05T01:41:55.123 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "port", 2024-09-05T01:41:55.123 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.123 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.123 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.123 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8086", 2024-09-05T01:41:55.123 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.123 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.123 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.124 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server port", 2024-09-05T01:41:55.124 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.124 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.124 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.124 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-09-05T01:41:55.124 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-09-05T01:41:55.124 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.124 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.124 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.124 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "false", 2024-09-05T01:41:55.124 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.124 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.124 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.125 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-05T01:41:55.125 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.125 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.125 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.125 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.125 INFO:teuthology.orchestra.run.smithi012.stdout: "threads": { 2024-09-05T01:41:55.125 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threads", 2024-09-05T01:41:55.125 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.125 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.125 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.125 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-05T01:41:55.125 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-05T01:41:55.125 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "32", 2024-09-05T01:41:55.126 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.126 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-05T01:41:55.126 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.126 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.126 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.126 INFO:teuthology.orchestra.run.smithi012.stdout: "username": { 2024-09-05T01:41:55.126 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "username", 2024-09-05T01:41:55.126 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.126 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.126 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.126 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.126 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.127 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.127 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.127 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "username of InfluxDB server user", 2024-09-05T01:41:55.127 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.127 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.127 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.127 INFO:teuthology.orchestra.run.smithi012.stdout: "verify_ssl": { 2024-09-05T01:41:55.127 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "verify_ssl", 2024-09-05T01:41:55.127 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.127 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.127 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.127 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "true", 2024-09-05T01:41:55.128 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.128 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.128 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.128 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-05T01:41:55.128 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.128 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.128 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.128 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.128 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.128 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.128 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.128 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "insights", 2024-09-05T01:41:55.128 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.128 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.129 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.129 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.129 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.129 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.129 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.129 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.129 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.129 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.129 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.129 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.129 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.129 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.129 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.129 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.130 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.130 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.130 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.130 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.130 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.130 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.130 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.130 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.130 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.130 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.130 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.130 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.130 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.130 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.131 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.131 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.131 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.131 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.131 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.131 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.131 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.131 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.131 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.131 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.131 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.131 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.132 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.132 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.132 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.132 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.132 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.132 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.132 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.132 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.132 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.132 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.132 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.132 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.132 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.133 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.133 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.133 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.133 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.133 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.133 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.133 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.133 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.133 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.133 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.133 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.133 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.133 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.133 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.133 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.134 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.134 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.134 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.134 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "iostat", 2024-09-05T01:41:55.134 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.134 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.134 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.134 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.134 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.134 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.134 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.134 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.134 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.135 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.135 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.135 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.135 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.135 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.135 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.135 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.135 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.135 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.135 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.135 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.135 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.135 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.135 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.136 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.136 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.136 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.136 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.136 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.136 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.136 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.136 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.136 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.136 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.136 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.136 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.136 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.137 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.137 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.137 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.137 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.137 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.137 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.137 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.137 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.137 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.137 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.137 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.137 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.137 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.138 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.138 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.138 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.138 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.138 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.138 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.138 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.138 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.138 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.138 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.138 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.138 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.138 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.138 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.139 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.139 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.139 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.139 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.139 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.139 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.139 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.139 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.139 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.139 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "k8sevents", 2024-09-05T01:41:55.139 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.139 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.139 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.139 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_event_retention_days": { 2024-09-05T01:41:55.140 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ceph_event_retention_days", 2024-09-05T01:41:55.140 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.140 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.140 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.140 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7", 2024-09-05T01:41:55.140 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.140 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.140 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.140 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-05T01:41:55.140 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.140 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.140 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.140 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.141 INFO:teuthology.orchestra.run.smithi012.stdout: "config_check_secs": { 2024-09-05T01:41:55.141 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_check_secs", 2024-09-05T01:41:55.141 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.141 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.141 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.141 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-05T01:41:55.141 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "10", 2024-09-05T01:41:55.141 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.141 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.141 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-05T01:41:55.141 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.141 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.141 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.142 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.142 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.142 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.142 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.142 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.142 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.142 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.142 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.142 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.142 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.142 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.142 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.142 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.143 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.143 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.143 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.143 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.143 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.143 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.143 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.143 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.143 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.143 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.143 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.143 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.143 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.143 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.144 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.144 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.144 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.144 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.144 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.144 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.144 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.144 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.144 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.144 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.144 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.144 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.144 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.145 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.145 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.145 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.145 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.145 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.145 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.145 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.145 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.145 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.145 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.145 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.145 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.145 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.146 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.146 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.146 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.146 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.146 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.146 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.146 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.146 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.146 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.146 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.146 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.146 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.146 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.146 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.147 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.147 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.147 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "localpool", 2024-09-05T01:41:55.147 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.147 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.147 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.147 INFO:teuthology.orchestra.run.smithi012.stdout: "failure_domain": { 2024-09-05T01:41:55.147 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "failure_domain", 2024-09-05T01:41:55.147 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.147 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.147 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.147 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "host", 2024-09-05T01:41:55.147 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.148 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.148 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.148 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "failure domain for any created local pool", 2024-09-05T01:41:55.148 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-05T01:41:55.148 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.148 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.148 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.148 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.148 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.148 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.148 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.148 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.148 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.149 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.149 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.149 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.149 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.149 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.149 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.149 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.149 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.149 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.149 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.149 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.149 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.150 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.150 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.150 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.150 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.150 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.150 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.150 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.150 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.150 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.150 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.150 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.150 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.150 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.150 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.151 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.151 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.151 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.151 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.151 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.151 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.151 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.151 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.151 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.151 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.151 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.151 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.152 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.152 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.152 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.152 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.152 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.152 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.152 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.152 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.152 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.152 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.152 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.152 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.152 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.153 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.153 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.153 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.153 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.153 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.153 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.153 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.153 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.153 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": { 2024-09-05T01:41:55.153 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_size", 2024-09-05T01:41:55.153 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.153 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.153 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.153 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.154 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.154 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.154 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.154 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default min_size for any created local pool", 2024-09-05T01:41:55.154 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-05T01:41:55.154 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.154 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.154 INFO:teuthology.orchestra.run.smithi012.stdout: "num_rep": { 2024-09-05T01:41:55.154 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "num_rep", 2024-09-05T01:41:55.154 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.154 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.154 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.155 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3", 2024-09-05T01:41:55.155 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.155 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.155 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.155 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default replica count for any created local pool", 2024-09-05T01:41:55.155 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.155 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.155 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.155 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": { 2024-09-05T01:41:55.155 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_num", 2024-09-05T01:41:55.155 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.156 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.156 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.156 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "128", 2024-09-05T01:41:55.156 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.156 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.156 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.156 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default pg_num for any created local pool", 2024-09-05T01:41:55.156 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.156 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.156 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.156 INFO:teuthology.orchestra.run.smithi012.stdout: "prefix": { 2024-09-05T01:41:55.156 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prefix", 2024-09-05T01:41:55.157 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.157 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.157 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.157 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.157 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.157 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.157 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.157 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name prefix for any created local pool", 2024-09-05T01:41:55.157 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.157 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.157 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.157 INFO:teuthology.orchestra.run.smithi012.stdout: "subtree": { 2024-09-05T01:41:55.157 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "subtree", 2024-09-05T01:41:55.158 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.158 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.158 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.158 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "rack", 2024-09-05T01:41:55.158 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.158 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.158 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.158 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-05T01:41:55.158 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-05T01:41:55.158 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.158 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.158 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.158 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.159 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.159 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mds_autoscaler", 2024-09-05T01:41:55.159 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.159 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.159 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.159 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.159 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.159 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.159 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.159 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.159 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.159 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.159 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.160 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.160 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.160 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.160 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.160 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.160 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.160 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.160 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.160 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.160 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.160 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.160 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.161 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.161 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.161 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.161 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.161 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.161 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.161 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.161 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.161 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.161 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.161 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.161 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.161 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.162 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.162 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.162 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.162 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.162 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.162 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.162 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.162 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.162 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.162 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.162 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.162 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.162 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.163 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.163 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.163 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.163 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.163 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.163 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.163 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.163 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.163 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.163 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.163 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.163 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.163 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.163 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.163 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.164 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.164 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.164 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.164 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.164 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.164 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.164 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.164 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.164 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.164 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirroring", 2024-09-05T01:41:55.164 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.164 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.165 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.165 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.165 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.165 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.165 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.165 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.165 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.165 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.165 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.165 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.165 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.165 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.166 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.166 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.166 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.166 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.166 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.166 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.166 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.166 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.166 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.166 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.166 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.166 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.167 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.167 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.167 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.167 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.167 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.167 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.167 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.167 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.167 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.167 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.167 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.167 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.167 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.168 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.168 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.168 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.168 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.168 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.168 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.168 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.168 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.168 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.168 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.168 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.168 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.168 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.169 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.169 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.169 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.169 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.169 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.169 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.169 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.169 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.169 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.169 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.169 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.169 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.170 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.170 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.170 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.170 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.170 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.170 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.170 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.170 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.170 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "nfs", 2024-09-05T01:41:55.170 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.170 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.170 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.171 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.171 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.171 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.171 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.171 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.171 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.171 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.171 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.171 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.171 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.171 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.171 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.171 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.172 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.172 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.172 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.172 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.172 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.172 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.172 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.172 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.172 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.172 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.172 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.172 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.173 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.173 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.173 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.173 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.173 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.173 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.173 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.173 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.173 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.173 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.173 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.173 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.173 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.174 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.174 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.174 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.174 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.174 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.174 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.174 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.174 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.174 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.174 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.174 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.174 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.174 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.174 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.175 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.175 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.175 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.175 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.175 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.175 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.175 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.175 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.175 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.175 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.175 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.175 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.176 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.176 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.176 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.176 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.176 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.176 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.176 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.176 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-09-05T01:41:55.176 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.176 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.176 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.176 INFO:teuthology.orchestra.run.smithi012.stdout: "fail_fs": { 2024-09-05T01:41:55.176 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "fail_fs", 2024-09-05T01:41:55.176 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.177 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.177 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.177 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.177 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.177 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.177 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.177 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-05T01:41:55.177 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.177 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.177 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.177 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.178 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.178 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.178 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.178 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.178 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.178 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.178 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.178 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.178 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.178 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.178 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.178 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.178 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.178 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.179 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.179 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.179 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.179 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.179 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.179 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.179 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.179 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.179 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.179 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.179 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.179 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.179 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.179 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.180 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.180 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.180 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.180 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.180 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.180 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.180 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.180 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.180 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.180 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.180 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.180 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.181 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.181 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.181 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.181 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.181 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.181 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.181 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.181 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.181 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.181 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.181 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.181 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.181 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.181 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.181 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.182 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.182 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.182 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.182 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.182 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.182 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.182 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.182 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.182 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.182 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.182 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.182 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.183 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator": { 2024-09-05T01:41:55.183 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-09-05T01:41:55.183 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.183 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.183 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.183 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.183 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.183 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.183 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.183 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm", 2024-09-05T01:41:55.183 INFO:teuthology.orchestra.run.smithi012.stdout: "rook", 2024-09-05T01:41:55.183 INFO:teuthology.orchestra.run.smithi012.stdout: "test_orchestrator" 2024-09-05T01:41:55.183 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.183 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Orchestrator backend", 2024-09-05T01:41:55.184 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.184 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.184 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.184 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.184 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.184 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.184 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.184 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_perf_query", 2024-09-05T01:41:55.184 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.184 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.184 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.184 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.184 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.185 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.185 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.185 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.185 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.185 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.185 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.185 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.185 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.185 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.185 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.185 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.185 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.186 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.186 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.186 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.186 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.186 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.186 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.186 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.186 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.186 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.186 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.186 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.186 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.186 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.186 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.187 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.187 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.187 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.187 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.187 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.187 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.187 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.187 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.187 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.187 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.187 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.187 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.187 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.187 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.187 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.188 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.188 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.188 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.188 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.188 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.188 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.188 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.188 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.188 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.188 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.188 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.188 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.188 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.189 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.189 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.189 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.189 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.189 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.189 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.189 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.189 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.189 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.189 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.189 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.189 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.189 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.190 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.190 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.190 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.190 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_support", 2024-09-05T01:41:55.190 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.190 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.190 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.190 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.190 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.190 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.190 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.190 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.190 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.190 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.191 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.191 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.191 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.191 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.191 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.191 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.191 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.191 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.191 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.191 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.191 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.191 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.191 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.191 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.192 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.192 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.192 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.192 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.192 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.192 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.192 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.192 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.192 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.192 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.192 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.192 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.192 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.193 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.193 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.193 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.193 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.193 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.193 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.193 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.193 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.193 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.193 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.193 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.193 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.193 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.194 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.194 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.194 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.194 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.194 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.194 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.194 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.194 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.194 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.194 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.194 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.194 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.194 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.194 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.195 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.195 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.195 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.195 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.195 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.195 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.195 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.195 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.195 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.195 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.195 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_autoscaler", 2024-09-05T01:41:55.195 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.195 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.196 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.196 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.196 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.196 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.196 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.196 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.196 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.196 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.196 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.196 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.196 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.196 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.196 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.196 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.197 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.197 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.197 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.197 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.197 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.197 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.197 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.197 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.197 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.197 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.197 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.197 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.197 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.198 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.198 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.198 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.198 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.198 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.198 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.198 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.198 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.198 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.199 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.199 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.199 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.199 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.199 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.199 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.199 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.199 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.199 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.199 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.199 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.199 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.199 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.200 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.200 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.200 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.200 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.200 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.200 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.200 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.200 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.200 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.200 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.200 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.200 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.201 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.201 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.201 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.201 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.201 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.201 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.201 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.201 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-05T01:41:55.201 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-05T01:41:55.201 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.201 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.201 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.202 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-05T01:41:55.202 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.202 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.202 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.202 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.202 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.202 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.202 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.202 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.202 INFO:teuthology.orchestra.run.smithi012.stdout: "threshold": { 2024-09-05T01:41:55.202 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threshold", 2024-09-05T01:41:55.202 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-05T01:41:55.202 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.202 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.203 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-09-05T01:41:55.203 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1.0", 2024-09-05T01:41:55.203 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.203 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.203 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "scaling threshold", 2024-09-05T01:41:55.203 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-05T01:41:55.203 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.203 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.203 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.203 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.203 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.204 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "progress", 2024-09-05T01:41:55.204 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.204 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.204 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.204 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_pg_recovery_event": { 2024-09-05T01:41:55.204 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_pg_recovery_event", 2024-09-05T01:41:55.204 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.204 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.204 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.204 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.204 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.204 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.204 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.204 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-05T01:41:55.205 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.205 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.205 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.205 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-09-05T01:41:55.205 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-09-05T01:41:55.205 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.205 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.205 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.205 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.205 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.205 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.205 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.206 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.206 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.206 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.206 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.206 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.206 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.206 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.206 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.206 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.206 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.206 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.206 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.206 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.207 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.207 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.207 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.207 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.207 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.207 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.207 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.207 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.207 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.207 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.207 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.207 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.207 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.208 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.208 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.208 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.208 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.208 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.208 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.208 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.208 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.208 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.208 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.208 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.208 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.209 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.209 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.209 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.209 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.209 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.209 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.209 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.209 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.209 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.209 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.209 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.209 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.209 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.210 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.210 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.210 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.210 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.210 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.210 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.210 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.210 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.210 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.210 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.210 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.210 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.210 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.211 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.211 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.211 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.211 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.211 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.211 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.211 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.211 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.211 INFO:teuthology.orchestra.run.smithi012.stdout: "max_completed_events": { 2024-09-05T01:41:55.211 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_completed_events", 2024-09-05T01:41:55.211 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.211 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.211 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.211 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "50", 2024-09-05T01:41:55.211 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.212 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.212 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.212 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "number of past completed events to remember", 2024-09-05T01:41:55.212 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.212 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.212 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.212 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-05T01:41:55.212 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-05T01:41:55.212 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.212 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.212 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.212 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-05T01:41:55.213 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.213 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.213 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.213 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long the module is going to sleep", 2024-09-05T01:41:55.213 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.213 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.213 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.213 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.213 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.213 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.213 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus", 2024-09-05T01:41:55.213 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.214 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.214 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.214 INFO:teuthology.orchestra.run.smithi012.stdout: "cache": { 2024-09-05T01:41:55.214 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cache", 2024-09-05T01:41:55.214 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.214 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.214 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.214 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.214 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.214 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.214 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.214 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.214 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.215 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.215 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.215 INFO:teuthology.orchestra.run.smithi012.stdout: "exclude_perf_counters": { 2024-09-05T01:41:55.215 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "exclude_perf_counters", 2024-09-05T01:41:55.215 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.215 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.215 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.215 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.215 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.215 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.215 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.215 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-05T01:41:55.215 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-05T01:41:55.216 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.216 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.216 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.216 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.216 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.216 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.216 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.216 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.216 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.216 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.216 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.216 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.217 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.217 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.217 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.217 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.217 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.217 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.217 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.217 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.217 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.217 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.217 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.217 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.218 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.218 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.218 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.218 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.218 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.218 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.218 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.218 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.218 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.218 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.218 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.218 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.219 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.219 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.219 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.219 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.219 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.219 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.219 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.219 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.219 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.219 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.219 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.219 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.219 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.219 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.220 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.220 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.220 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.220 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.220 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.220 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.220 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.220 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.220 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.220 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.220 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.220 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.221 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.221 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.221 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.221 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.221 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.221 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.221 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.221 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools": { 2024-09-05T01:41:55.221 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools", 2024-09-05T01:41:55.221 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.221 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.221 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.221 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.222 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.222 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.222 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.222 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.222 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.222 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.222 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.222 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-05T01:41:55.222 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-05T01:41:55.222 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.222 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.222 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.223 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "300", 2024-09-05T01:41:55.223 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.223 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.223 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.223 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.223 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.223 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.223 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.223 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_interval": { 2024-09-05T01:41:55.223 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_interval", 2024-09-05T01:41:55.223 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-05T01:41:55.223 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.223 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.224 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15.0", 2024-09-05T01:41:55.224 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.224 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.224 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.224 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.224 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.224 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.224 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.224 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-05T01:41:55.224 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-05T01:41:55.224 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.224 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.224 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.225 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-09-05T01:41:55.225 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.225 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.225 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.225 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-05T01:41:55.225 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.225 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.225 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.225 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-05T01:41:55.225 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-05T01:41:55.225 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.225 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.225 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.226 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "9283", 2024-09-05T01:41:55.226 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.226 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.226 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.226 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-05T01:41:55.226 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.226 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.226 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.226 INFO:teuthology.orchestra.run.smithi012.stdout: "stale_cache_strategy": { 2024-09-05T01:41:55.226 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stale_cache_strategy", 2024-09-05T01:41:55.226 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.226 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.227 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.227 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "log", 2024-09-05T01:41:55.227 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.227 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.227 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.227 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.227 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.227 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.227 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.227 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-09-05T01:41:55.227 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-09-05T01:41:55.227 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.227 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.228 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.228 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "default", 2024-09-05T01:41:55.228 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.228 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.228 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.228 INFO:teuthology.orchestra.run.smithi012.stdout: "default", 2024-09-05T01:41:55.228 INFO:teuthology.orchestra.run.smithi012.stdout: "error" 2024-09-05T01:41:55.228 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.228 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.228 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.228 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.228 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.229 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-09-05T01:41:55.229 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-09-05T01:41:55.229 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.229 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.229 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.229 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-09-05T01:41:55.229 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-09-05T01:41:55.229 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-09-05T01:41:55.229 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.229 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.229 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.229 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.229 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.229 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.230 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.230 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.230 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_support", 2024-09-05T01:41:55.230 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.230 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.230 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.230 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.230 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.230 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.230 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.230 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.230 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.231 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.231 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.231 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.231 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.231 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.231 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.231 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.231 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.231 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.231 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.231 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.231 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.231 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.231 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.231 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.232 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.232 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.232 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.232 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.232 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.232 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.232 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.232 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.232 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.232 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.232 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.232 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.232 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.233 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.233 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.233 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.233 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.233 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.233 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.233 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.233 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.233 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.233 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.233 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.233 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.234 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.234 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.234 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.234 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.234 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.234 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.234 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.234 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.234 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.234 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.234 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.234 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.234 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.234 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.235 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.235 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.235 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.235 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.235 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.235 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.235 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.235 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.235 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.235 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_snap_create": { 2024-09-05T01:41:55.235 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_snap_create", 2024-09-05T01:41:55.235 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.235 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.235 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.236 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-05T01:41:55.236 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.236 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.236 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.236 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.236 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.236 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.236 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.236 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.236 INFO:teuthology.orchestra.run.smithi012.stdout: "mirror_snapshot_schedule": { 2024-09-05T01:41:55.236 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirror_snapshot_schedule", 2024-09-05T01:41:55.236 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.236 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.236 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.237 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.237 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.237 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.237 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.237 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.237 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.237 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.237 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.237 INFO:teuthology.orchestra.run.smithi012.stdout: "trash_purge_schedule": { 2024-09-05T01:41:55.237 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "trash_purge_schedule", 2024-09-05T01:41:55.237 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.237 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.237 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.238 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.238 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.238 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.238 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.238 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.238 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.238 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.238 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.238 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.238 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.238 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "restful", 2024-09-05T01:41:55.238 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.239 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.239 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.239 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_auth": { 2024-09-05T01:41:55.239 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_auth", 2024-09-05T01:41:55.239 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.239 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.239 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.239 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.239 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.239 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.239 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.239 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.239 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.240 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.240 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.240 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-09-05T01:41:55.240 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-09-05T01:41:55.240 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.240 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.240 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.240 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.240 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.240 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.240 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.240 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.240 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.241 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.241 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.241 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.241 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.241 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.241 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.241 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.241 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.241 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.242 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.242 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.242 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.242 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.242 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.242 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.242 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.242 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.242 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.242 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.242 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.242 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.242 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.242 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.243 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.243 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.243 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.243 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.243 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.243 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.243 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.243 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.243 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.243 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.243 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.243 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.243 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.244 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.244 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.244 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.244 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.244 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.244 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.244 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.244 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.244 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.244 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.244 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.244 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.244 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.245 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.245 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.245 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.245 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.245 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.245 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.245 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.245 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.245 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.245 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.245 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.245 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.246 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.246 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.246 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.246 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.246 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.246 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.246 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.246 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.246 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.246 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.246 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.246 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.246 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-05T01:41:55.246 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-05T01:41:55.247 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.247 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.247 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.247 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.247 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.247 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.247 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.247 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.247 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.247 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.247 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.247 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.247 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-05T01:41:55.247 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-05T01:41:55.248 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.248 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.248 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.248 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.248 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.248 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.248 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.248 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.248 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.248 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.248 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.248 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.248 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.248 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.249 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.249 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rgw", 2024-09-05T01:41:55.249 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.249 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.249 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.249 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.249 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.249 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.249 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.249 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.249 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.249 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.249 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.250 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.250 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.250 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.250 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.250 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.250 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.250 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.250 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.250 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.250 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.250 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.250 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.250 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.251 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.251 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.251 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.251 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.251 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.251 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.251 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.251 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.251 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.251 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.251 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.251 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.251 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.252 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.252 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.252 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.252 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.252 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.252 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.252 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.252 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.252 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.252 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.252 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.252 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.252 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.252 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.253 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.253 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.253 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.253 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.253 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.253 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.253 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.253 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.253 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.253 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.253 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.253 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.253 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.254 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.254 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.254 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.254 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.254 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.254 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.254 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.254 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.254 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.254 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.254 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.254 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.254 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rook", 2024-09-05T01:41:55.254 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.255 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.255 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.255 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.255 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.255 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.255 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.255 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.255 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.255 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.255 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.255 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.255 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.255 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.256 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.256 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.256 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.256 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.256 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.256 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.256 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.256 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.256 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.256 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.256 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.256 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.257 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.257 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.257 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.257 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.257 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.257 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.257 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.257 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.257 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.257 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.257 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.257 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.258 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.258 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.258 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.258 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.258 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.258 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.258 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.258 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.258 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.258 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.258 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.258 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.258 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.259 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.259 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.259 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.259 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.259 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.259 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.259 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.259 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.259 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.259 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.259 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.259 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.259 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.260 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.260 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.260 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.260 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.260 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.260 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.260 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.260 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.260 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.260 INFO:teuthology.orchestra.run.smithi012.stdout: "storage_class": { 2024-09-05T01:41:55.260 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "storage_class", 2024-09-05T01:41:55.260 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.260 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.260 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.261 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "local", 2024-09-05T01:41:55.261 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.261 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.261 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.261 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-05T01:41:55.261 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.261 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.261 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.261 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.261 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.261 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.261 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.261 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "selftest", 2024-09-05T01:41:55.262 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.262 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.262 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.262 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.262 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.262 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.262 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.262 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.262 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.262 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.262 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.262 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.262 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.263 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.263 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.263 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.263 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.263 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.263 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.263 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.263 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.263 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.263 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.263 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.263 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.263 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.263 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.263 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.264 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.264 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.264 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.264 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.264 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.264 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.264 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.264 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.264 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.264 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.264 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.264 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.264 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.265 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.265 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.265 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.265 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.265 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.265 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.265 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.265 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.265 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.265 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.265 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.265 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.265 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.266 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.266 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.266 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.266 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.266 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.266 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.266 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.266 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.266 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.266 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.266 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.266 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.266 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.267 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.267 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.267 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.267 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.267 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.267 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.267 INFO:teuthology.orchestra.run.smithi012.stdout: "roption1": { 2024-09-05T01:41:55.267 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption1", 2024-09-05T01:41:55.267 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.267 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.267 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.267 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.267 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.267 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.268 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.268 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.268 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.268 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.268 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.268 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.268 INFO:teuthology.orchestra.run.smithi012.stdout: "roption2": { 2024-09-05T01:41:55.268 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption2", 2024-09-05T01:41:55.268 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.268 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.268 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.268 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "xyz", 2024-09-05T01:41:55.268 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.268 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.269 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.269 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.269 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.269 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.269 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.269 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.269 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption1": { 2024-09-05T01:41:55.269 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption1", 2024-09-05T01:41:55.269 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.269 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.269 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.269 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.269 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.270 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.270 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.270 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.270 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.270 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.270 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.270 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.270 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption2": { 2024-09-05T01:41:55.270 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption2", 2024-09-05T01:41:55.270 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.270 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.270 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.270 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.270 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.271 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.271 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.271 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.271 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.271 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.271 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.271 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.271 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption3": { 2024-09-05T01:41:55.271 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption3", 2024-09-05T01:41:55.271 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-05T01:41:55.271 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.271 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.271 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.272 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.272 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.272 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.272 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.272 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.272 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.272 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.272 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.272 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption4": { 2024-09-05T01:41:55.272 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption4", 2024-09-05T01:41:55.272 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.272 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.273 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.273 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.273 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.273 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.273 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.273 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.273 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.273 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.273 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.273 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.273 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption5": { 2024-09-05T01:41:55.273 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption5", 2024-09-05T01:41:55.273 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.273 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.274 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.274 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.274 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.274 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.274 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.274 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.274 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.274 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.274 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.274 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.274 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption6": { 2024-09-05T01:41:55.274 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption6", 2024-09-05T01:41:55.274 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.275 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.275 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.275 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.275 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.275 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.275 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.275 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.275 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.275 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.275 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.275 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.275 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption7": { 2024-09-05T01:41:55.275 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption7", 2024-09-05T01:41:55.276 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.276 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.276 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.276 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.276 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-05T01:41:55.276 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "42", 2024-09-05T01:41:55.276 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.276 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.276 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.276 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.276 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.276 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.276 INFO:teuthology.orchestra.run.smithi012.stdout: "testkey": { 2024-09-05T01:41:55.277 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testkey", 2024-09-05T01:41:55.277 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.277 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.277 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.277 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.277 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.277 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.277 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.277 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.277 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.277 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.277 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.277 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.278 INFO:teuthology.orchestra.run.smithi012.stdout: "testlkey": { 2024-09-05T01:41:55.278 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testlkey", 2024-09-05T01:41:55.278 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.278 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.278 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.278 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.278 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.278 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.278 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.278 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.278 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.278 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.278 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.279 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.279 INFO:teuthology.orchestra.run.smithi012.stdout: "testnewline": { 2024-09-05T01:41:55.279 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testnewline", 2024-09-05T01:41:55.279 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.279 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.279 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.279 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.279 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.279 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.279 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.279 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.279 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.279 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.279 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.280 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.280 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.280 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.280 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.280 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snap_schedule", 2024-09-05T01:41:55.280 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.280 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.280 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.280 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_m_granularity": { 2024-09-05T01:41:55.280 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_m_granularity", 2024-09-05T01:41:55.280 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.280 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.280 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.281 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.281 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.281 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.281 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.281 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow minute scheduled snapshots", 2024-09-05T01:41:55.281 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.281 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.281 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.281 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.281 INFO:teuthology.orchestra.run.smithi012.stdout: "dump_on_update": { 2024-09-05T01:41:55.281 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dump_on_update", 2024-09-05T01:41:55.281 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.281 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.282 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.282 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.282 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.282 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.282 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.282 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "dump database to debug log on update", 2024-09-05T01:41:55.282 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.282 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.282 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.282 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.282 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.282 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.282 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.282 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.283 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.283 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.283 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.283 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.283 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.283 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.283 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.283 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.283 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.283 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.283 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.283 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.283 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.283 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.284 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.284 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.284 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.284 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.284 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.284 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.284 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.284 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.284 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.284 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.284 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.284 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.284 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.284 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.285 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.285 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.285 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.285 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.285 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.285 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.285 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.285 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.285 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.285 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.285 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.285 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.286 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.286 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.286 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.286 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.286 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.286 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.286 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.286 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.286 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.286 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.286 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.286 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.286 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.286 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.287 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.287 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.287 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.287 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.287 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.287 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.287 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.287 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.287 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.287 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.287 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.287 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.287 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stats", 2024-09-05T01:41:55.288 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.288 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.288 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.288 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.288 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.288 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.288 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.288 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.288 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.288 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.288 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.288 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.288 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.289 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.289 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.289 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.289 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.289 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.289 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.289 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.289 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.289 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.289 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.289 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.290 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.290 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.290 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.290 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.290 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.290 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.290 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.290 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.290 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.290 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.290 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.290 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.290 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.290 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.291 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.291 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.291 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.291 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.291 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.291 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.291 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.291 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.291 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.291 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.291 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.291 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.291 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.291 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.292 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.292 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.292 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.292 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.292 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.292 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.292 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.292 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.292 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.292 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.292 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.292 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.293 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.293 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.293 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.293 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.293 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.293 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.293 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.293 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.293 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.293 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "status", 2024-09-05T01:41:55.293 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.293 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.294 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.294 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.294 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.294 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.294 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.294 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.294 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.294 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.294 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.294 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.294 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.294 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.294 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.294 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.295 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.295 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.295 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.295 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.295 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.295 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.295 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.295 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.295 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.295 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.295 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.295 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.296 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.296 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.296 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.296 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.296 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.296 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.296 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.296 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.296 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.296 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.296 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.296 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.296 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.297 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.297 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.297 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.297 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.297 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.297 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.297 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.297 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.297 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.297 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.297 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.297 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.297 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.298 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.298 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.298 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.298 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.298 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.298 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.298 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.298 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.298 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.298 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.298 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.299 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.299 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.299 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.299 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.299 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.299 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.299 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.299 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.299 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telegraf", 2024-09-05T01:41:55.299 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.299 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.300 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.300 INFO:teuthology.orchestra.run.smithi012.stdout: "address": { 2024-09-05T01:41:55.300 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "address", 2024-09-05T01:41:55.300 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.300 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.300 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.300 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-05T01:41:55.300 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.300 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.300 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.300 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.300 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.301 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.301 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.301 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.301 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-05T01:41:55.301 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-05T01:41:55.301 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.301 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.301 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.301 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15", 2024-09-05T01:41:55.301 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.301 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.301 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.301 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.302 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.302 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.302 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.302 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.302 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.302 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.302 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.302 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.302 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.302 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.302 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.302 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.302 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.303 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.303 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.303 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.303 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.303 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.303 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.303 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.303 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.303 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.303 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.303 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.303 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.303 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.304 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.304 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.304 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.304 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.304 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.304 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.304 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.304 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.304 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.304 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.304 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.304 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.305 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.305 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.305 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.305 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.305 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.305 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.305 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.305 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.305 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.305 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.305 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.305 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.305 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.306 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.306 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.306 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.306 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.306 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.306 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.306 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.306 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.306 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.306 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.306 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.306 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.306 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.306 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.307 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.307 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.307 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.307 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.307 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.307 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.307 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.307 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.307 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.307 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.307 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.307 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.307 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telemetry", 2024-09-05T01:41:55.308 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.308 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.308 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.308 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_basic": { 2024-09-05T01:41:55.308 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_basic", 2024-09-05T01:41:55.308 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.308 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.308 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.308 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.308 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.308 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.308 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.308 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-05T01:41:55.309 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.309 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.309 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.309 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.309 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_crash": { 2024-09-05T01:41:55.309 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_crash", 2024-09-05T01:41:55.309 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.309 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.309 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.309 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.309 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.309 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.309 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.310 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-05T01:41:55.310 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.310 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.310 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.310 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.310 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_device": { 2024-09-05T01:41:55.310 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_device", 2024-09-05T01:41:55.310 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.310 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.310 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.310 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.310 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.310 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.310 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.311 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-05T01:41:55.311 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.311 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.311 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.311 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.311 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_ident": { 2024-09-05T01:41:55.311 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_ident", 2024-09-05T01:41:55.311 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.311 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.311 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.311 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.311 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.311 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.312 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.312 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-05T01:41:55.312 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.312 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.312 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.312 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.312 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_perf": { 2024-09-05T01:41:55.312 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_perf", 2024-09-05T01:41:55.312 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.312 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.312 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.312 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.312 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.313 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.313 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.313 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-05T01:41:55.313 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.313 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.313 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.313 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.313 INFO:teuthology.orchestra.run.smithi012.stdout: "contact": { 2024-09-05T01:41:55.313 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "contact", 2024-09-05T01:41:55.313 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.313 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.313 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.313 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.313 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.313 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.314 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.314 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.314 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.314 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.314 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.314 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.314 INFO:teuthology.orchestra.run.smithi012.stdout: "description": { 2024-09-05T01:41:55.314 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "description", 2024-09-05T01:41:55.314 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.314 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.314 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.314 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.314 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.315 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.315 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.315 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.315 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.315 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.315 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.315 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.315 INFO:teuthology.orchestra.run.smithi012.stdout: "device_url": { 2024-09-05T01:41:55.315 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_url", 2024-09-05T01:41:55.315 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.315 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.315 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.315 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-05T01:41:55.316 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.316 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.316 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.316 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.316 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.316 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.316 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.316 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.316 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-09-05T01:41:55.316 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-09-05T01:41:55.316 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.316 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.316 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.317 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.317 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.317 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.317 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.317 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.317 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.317 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.317 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.317 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.317 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-05T01:41:55.317 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-05T01:41:55.317 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.318 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.318 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.318 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "24", 2024-09-05T01:41:55.318 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "8", 2024-09-05T01:41:55.318 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.318 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.318 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.318 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.318 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.318 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.318 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.318 INFO:teuthology.orchestra.run.smithi012.stdout: "last_opt_revision": { 2024-09-05T01:41:55.318 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "last_opt_revision", 2024-09-05T01:41:55.318 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.319 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.319 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.319 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1", 2024-09-05T01:41:55.319 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.319 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.319 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.319 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.319 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.319 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.319 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.319 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.319 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard": { 2024-09-05T01:41:55.319 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard", 2024-09-05T01:41:55.320 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.320 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.320 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.320 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.320 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.320 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.320 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.320 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.320 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.320 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.320 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.320 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.320 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard_description": { 2024-09-05T01:41:55.320 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard_description", 2024-09-05T01:41:55.321 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.321 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.321 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.321 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.321 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.321 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.321 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.321 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.321 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.321 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.321 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.321 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.321 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.322 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.322 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.322 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.322 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.322 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.322 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.322 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.322 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.322 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.322 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.322 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.322 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.322 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.322 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.323 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.323 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.323 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.323 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.323 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.323 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.323 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.323 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.323 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.323 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.323 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.323 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.323 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.323 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.324 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.324 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.324 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.324 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.324 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.324 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.324 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.324 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.324 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.324 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.324 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.324 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.324 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.324 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.325 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.325 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.325 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.325 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.325 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.325 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.325 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.325 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.325 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.325 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.325 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.325 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.325 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.325 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.325 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.326 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.326 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.326 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.326 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.326 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.326 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.326 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.326 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.326 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.326 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.326 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.326 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.326 INFO:teuthology.orchestra.run.smithi012.stdout: "organization": { 2024-09-05T01:41:55.327 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "organization", 2024-09-05T01:41:55.327 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.327 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.327 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.327 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.327 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.327 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.327 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.327 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.327 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.327 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.327 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.327 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.327 INFO:teuthology.orchestra.run.smithi012.stdout: "proxy": { 2024-09-05T01:41:55.327 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "proxy", 2024-09-05T01:41:55.328 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.328 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.328 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.328 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.328 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.328 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.328 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.328 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.328 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.328 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.328 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.328 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.328 INFO:teuthology.orchestra.run.smithi012.stdout: "url": { 2024-09-05T01:41:55.329 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url", 2024-09-05T01:41:55.329 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.329 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.329 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.329 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-05T01:41:55.329 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.329 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.329 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.329 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.329 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.329 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.329 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.329 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.330 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.330 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.330 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.330 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "test_orchestrator", 2024-09-05T01:41:55.330 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.330 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.330 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.330 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.330 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.330 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.330 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.330 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.330 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.330 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.331 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.331 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.331 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.331 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.331 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.331 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.331 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.331 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.331 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.331 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.331 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.331 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.331 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.331 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.331 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.332 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.332 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.332 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.332 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.332 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.332 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.332 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.332 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.332 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.332 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.332 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.332 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.332 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.333 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.333 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.333 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.333 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.333 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.333 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.333 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.333 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.333 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.333 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.333 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.333 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.333 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.334 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.334 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.334 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.334 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.334 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.334 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.334 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.334 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.334 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.334 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.334 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.334 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.334 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.334 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.335 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.335 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.335 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.335 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.335 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.335 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.335 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.335 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.335 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.335 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.335 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2024-09-05T01:41:55.335 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.336 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.336 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.336 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.336 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.336 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.336 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.336 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.336 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.336 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.336 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.336 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.336 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.336 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.337 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.337 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.337 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.337 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.337 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.337 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.337 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.337 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.337 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.337 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.337 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.337 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.337 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.337 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.338 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.338 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.338 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.338 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.338 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.338 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.338 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.338 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.338 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.338 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.338 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.338 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.338 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.338 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.339 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.339 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.339 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.339 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.339 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.339 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.339 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.339 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.339 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.339 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.339 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.339 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.339 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.339 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.340 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.340 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.340 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.340 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.340 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.340 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.340 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.340 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.340 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.340 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.340 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.340 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.340 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.341 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.341 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.341 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.341 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.341 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_clones": { 2024-09-05T01:41:55.341 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_clones", 2024-09-05T01:41:55.341 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.341 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.341 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.341 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4", 2024-09-05T01:41:55.341 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.341 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.341 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.342 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-05T01:41:55.342 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.342 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.342 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.342 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.342 INFO:teuthology.orchestra.run.smithi012.stdout: "periodic_async_work": { 2024-09-05T01:41:55.342 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "periodic_async_work", 2024-09-05T01:41:55.342 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.342 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.342 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.342 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.342 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.342 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.342 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.343 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Periodically check for async work", 2024-09-05T01:41:55.343 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.343 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.343 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.343 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.343 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_delay": { 2024-09-05T01:41:55.343 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_delay", 2024-09-05T01:41:55.343 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.343 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.343 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.343 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-05T01:41:55.343 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.344 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.344 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.344 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-05T01:41:55.344 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.344 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.344 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.344 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.344 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_no_wait": { 2024-09-05T01:41:55.344 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_no_wait", 2024-09-05T01:41:55.344 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.344 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.344 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.344 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.345 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.345 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.345 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.345 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-05T01:41:55.345 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.345 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.345 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.345 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.345 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.345 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.345 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.345 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix", 2024-09-05T01:41:55.345 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.345 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.346 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.346 INFO:teuthology.orchestra.run.smithi012.stdout: "discovery_interval": { 2024-09-05T01:41:55.346 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "discovery_interval", 2024-09-05T01:41:55.346 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-05T01:41:55.346 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.346 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.346 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "100", 2024-09-05T01:41:55.346 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.346 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.346 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.346 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.346 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.346 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.346 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.347 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.347 INFO:teuthology.orchestra.run.smithi012.stdout: "identifier": { 2024-09-05T01:41:55.347 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "identifier", 2024-09-05T01:41:55.347 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.347 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.347 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.347 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.347 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.347 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.347 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.347 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.347 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.347 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.347 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.347 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.348 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-05T01:41:55.348 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-05T01:41:55.348 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.348 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.348 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.348 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-05T01:41:55.348 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.348 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.348 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.348 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.348 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.348 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.348 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.348 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.349 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.349 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.349 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.349 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.349 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.349 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.349 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.349 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.349 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.349 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.349 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.349 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.350 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.350 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.350 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.350 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.350 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.350 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.350 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.350 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.350 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.350 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.350 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.350 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.350 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.351 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.351 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.351 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.351 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.351 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.351 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.351 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.351 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.351 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.351 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.351 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.351 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.351 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.351 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.352 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.352 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.352 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.352 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.352 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.352 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.352 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.352 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.352 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.352 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.352 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.352 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.352 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.353 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.353 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.353 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.353 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.353 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.353 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.353 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.353 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.353 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.353 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.354 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.354 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.354 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.354 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.354 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.354 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.354 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.354 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.354 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_host": { 2024-09-05T01:41:55.354 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_host", 2024-09-05T01:41:55.354 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.354 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.355 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.355 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.355 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.355 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.355 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.355 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.355 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.355 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.355 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.355 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.355 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_port": { 2024-09-05T01:41:55.355 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_port", 2024-09-05T01:41:55.355 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.355 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.355 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.356 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10051", 2024-09-05T01:41:55.356 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.356 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.356 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.356 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.356 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.356 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.356 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.356 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.356 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_sender": { 2024-09-05T01:41:55.356 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_sender", 2024-09-05T01:41:55.356 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.356 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.356 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.357 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-05T01:41:55.357 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.357 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.357 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.357 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.357 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.357 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.357 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.357 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.357 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.357 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.357 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-05T01:41:55.357 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.357 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.358 INFO:teuthology.orchestra.run.smithi012.stdout: "gid": 25147, 2024-09-05T01:41:55.358 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "z", 2024-09-05T01:41:55.358 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr_features": 4540701547738038271, 2024-09-05T01:41:55.358 INFO:teuthology.orchestra.run.smithi012.stdout: "available_modules": [ 2024-09-05T01:41:55.358 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.358 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "alerts", 2024-09-05T01:41:55.358 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.358 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.358 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.358 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-05T01:41:55.358 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-05T01:41:55.358 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.358 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.358 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.359 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-05T01:41:55.359 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.359 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.359 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.359 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How frequently to reexamine health status", 2024-09-05T01:41:55.359 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.359 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.359 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.359 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.359 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.359 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.359 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.359 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.359 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.359 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.360 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.360 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.360 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.360 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.360 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.360 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.360 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.360 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.360 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.360 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.360 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.360 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.360 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.360 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.361 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.361 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.361 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.361 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.361 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.361 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.361 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.361 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.361 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.361 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.361 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.361 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.361 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.361 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.362 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.362 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.362 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.362 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.362 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.362 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.362 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.362 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.362 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.362 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.362 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.362 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.362 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.362 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.363 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.363 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.363 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.363 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.363 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.363 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.363 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.363 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.363 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.363 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.363 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.363 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.363 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.363 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.364 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.364 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.364 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.364 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.364 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.364 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.364 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.364 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.364 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_destination": { 2024-09-05T01:41:55.364 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_destination", 2024-09-05T01:41:55.364 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.364 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.364 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.365 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.365 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.365 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.365 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.365 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email address to send alerts to", 2024-09-05T01:41:55.365 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.365 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.365 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.365 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.365 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_from_name": { 2024-09-05T01:41:55.365 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_from_name", 2024-09-05T01:41:55.365 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.365 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.366 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.366 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "Ceph", 2024-09-05T01:41:55.366 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.366 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.366 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.366 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email From: name", 2024-09-05T01:41:55.366 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.366 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.366 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.366 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.366 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_host": { 2024-09-05T01:41:55.366 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_host", 2024-09-05T01:41:55.366 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.366 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.366 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.367 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.367 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.367 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.367 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.367 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP server", 2024-09-05T01:41:55.367 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.367 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.367 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.367 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.367 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_password": { 2024-09-05T01:41:55.367 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_password", 2024-09-05T01:41:55.367 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.367 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.367 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.367 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.368 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.368 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.368 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.368 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Password to authenticate with", 2024-09-05T01:41:55.368 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.368 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.368 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.368 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.368 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_port": { 2024-09-05T01:41:55.368 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_port", 2024-09-05T01:41:55.368 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.368 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.368 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.368 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "465", 2024-09-05T01:41:55.368 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.369 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.369 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.369 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP port", 2024-09-05T01:41:55.369 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.369 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.369 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.369 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.369 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_sender": { 2024-09-05T01:41:55.369 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_sender", 2024-09-05T01:41:55.369 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.369 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.369 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.369 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.369 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.370 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.370 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.370 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP envelope sender", 2024-09-05T01:41:55.370 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.370 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.370 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.370 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.370 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_ssl": { 2024-09-05T01:41:55.370 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_ssl", 2024-09-05T01:41:55.370 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.370 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.370 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.370 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.370 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.370 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.370 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.371 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-05T01:41:55.371 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.371 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.371 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.371 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.371 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_user": { 2024-09-05T01:41:55.371 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_user", 2024-09-05T01:41:55.371 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.371 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.371 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.371 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.371 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.371 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.371 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.372 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "User to authenticate as", 2024-09-05T01:41:55.372 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.372 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.372 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.372 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.372 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.372 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.372 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.372 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "balancer", 2024-09-05T01:41:55.372 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.372 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.372 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.372 INFO:teuthology.orchestra.run.smithi012.stdout: "active": { 2024-09-05T01:41:55.373 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "active", 2024-09-05T01:41:55.373 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.373 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.373 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.373 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.373 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.373 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.373 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.373 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically balance PGs across cluster", 2024-09-05T01:41:55.373 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.373 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.374 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.374 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.374 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_time": { 2024-09-05T01:41:55.374 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_time", 2024-09-05T01:41:55.374 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.374 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.374 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.374 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0000", 2024-09-05T01:41:55.374 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.374 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.374 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.374 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "beginning time of day to automatically balance", 2024-09-05T01:41:55.374 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-05T01:41:55.375 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.375 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.375 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.375 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_weekday": { 2024-09-05T01:41:55.375 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_weekday", 2024-09-05T01:41:55.375 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-05T01:41:55.375 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.375 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.375 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-05T01:41:55.375 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-09-05T01:41:55.375 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-09-05T01:41:55.375 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.375 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-05T01:41:55.375 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-05T01:41:55.376 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.376 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.376 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.376 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_max_iterations": { 2024-09-05T01:41:55.376 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_max_iterations", 2024-09-05T01:41:55.376 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-05T01:41:55.376 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.376 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.376 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "25", 2024-09-05T01:41:55.376 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-05T01:41:55.376 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "250", 2024-09-05T01:41:55.376 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.376 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-05T01:41:55.376 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.377 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.377 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.377 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.377 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_metrics": { 2024-09-05T01:41:55.377 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_metrics", 2024-09-05T01:41:55.377 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.377 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.377 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.377 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "pgs,objects,bytes", 2024-09-05T01:41:55.377 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.377 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.377 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.378 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-05T01:41:55.378 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-05T01:41:55.378 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.378 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.378 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.378 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_step": { 2024-09-05T01:41:55.378 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_step", 2024-09-05T01:41:55.378 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-05T01:41:55.378 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.378 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.378 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.5", 2024-09-05T01:41:55.378 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0.001", 2024-09-05T01:41:55.378 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "0.999", 2024-09-05T01:41:55.379 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.379 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "aggressiveness of optimization", 2024-09-05T01:41:55.379 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-05T01:41:55.379 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.379 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.379 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.379 INFO:teuthology.orchestra.run.smithi012.stdout: "end_time": { 2024-09-05T01:41:55.379 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_time", 2024-09-05T01:41:55.379 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.379 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.379 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.379 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2359", 2024-09-05T01:41:55.379 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.379 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.380 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.380 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ending time of day to automatically balance", 2024-09-05T01:41:55.380 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-05T01:41:55.380 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.380 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.380 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.380 INFO:teuthology.orchestra.run.smithi012.stdout: "end_weekday": { 2024-09-05T01:41:55.380 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_weekday", 2024-09-05T01:41:55.380 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-05T01:41:55.380 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.380 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.380 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-05T01:41:55.380 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-09-05T01:41:55.381 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-09-05T01:41:55.381 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.381 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-05T01:41:55.381 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-05T01:41:55.381 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.381 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.381 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.381 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.381 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.381 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.381 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.381 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.381 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.381 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.382 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.382 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.382 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.382 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.382 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.382 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.382 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.382 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.382 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.382 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.382 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.382 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.382 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.382 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.383 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.383 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.383 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.383 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.383 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.383 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.383 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.383 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.383 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.383 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.383 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.383 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.383 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.383 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.383 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.384 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.384 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.384 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.384 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.384 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.384 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.384 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.384 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.384 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.384 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.384 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.384 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.384 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.385 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.385 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.385 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.385 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.385 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.385 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.385 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.385 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.385 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.385 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.385 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.385 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.385 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.386 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.386 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.386 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.386 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.386 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.386 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.386 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.386 INFO:teuthology.orchestra.run.smithi012.stdout: "min_score": { 2024-09-05T01:41:55.386 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_score", 2024-09-05T01:41:55.386 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-05T01:41:55.386 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.386 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.386 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-05T01:41:55.386 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.387 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.387 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.387 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-05T01:41:55.387 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.387 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.387 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.387 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.387 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-09-05T01:41:55.387 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-09-05T01:41:55.387 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.387 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.387 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.387 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "upmap", 2024-09-05T01:41:55.387 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.387 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.388 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.388 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-compat", 2024-09-05T01:41:55.388 INFO:teuthology.orchestra.run.smithi012.stdout: "none", 2024-09-05T01:41:55.388 INFO:teuthology.orchestra.run.smithi012.stdout: "read", 2024-09-05T01:41:55.388 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap", 2024-09-05T01:41:55.388 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap-read" 2024-09-05T01:41:55.388 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.388 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Balancer mode", 2024-09-05T01:41:55.388 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.388 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.388 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.388 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.388 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_ids": { 2024-09-05T01:41:55.388 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_ids", 2024-09-05T01:41:55.389 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.389 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.389 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.389 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.389 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.389 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.389 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.389 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-05T01:41:55.389 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.389 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.389 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.389 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.389 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-05T01:41:55.389 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-05T01:41:55.389 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.390 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.390 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.390 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-05T01:41:55.390 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.390 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.390 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.390 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-05T01:41:55.390 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.390 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.390 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.390 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.390 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_deviation": { 2024-09-05T01:41:55.390 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_deviation", 2024-09-05T01:41:55.390 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.391 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.391 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.391 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-05T01:41:55.391 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-05T01:41:55.391 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.391 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.391 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-05T01:41:55.391 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-05T01:41:55.391 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.391 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.391 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.391 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_optimizations": { 2024-09-05T01:41:55.391 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_optimizations", 2024-09-05T01:41:55.391 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-05T01:41:55.391 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.392 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.392 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-05T01:41:55.392 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.392 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.392 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.392 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-05T01:41:55.392 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.392 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.392 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.392 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.392 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.392 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.392 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.392 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm", 2024-09-05T01:41:55.392 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.393 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.393 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.393 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_down_multiplier": { 2024-09-05T01:41:55.393 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_down_multiplier", 2024-09-05T01:41:55.393 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-05T01:41:55.393 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.393 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.393 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-09-05T01:41:55.393 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.393 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.393 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.393 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-05T01:41:55.393 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.393 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.394 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.394 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.394 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_refresh_rate": { 2024-09-05T01:41:55.394 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_refresh_rate", 2024-09-05T01:41:55.394 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.394 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.394 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.394 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "20", 2024-09-05T01:41:55.394 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.394 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.394 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.394 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-05T01:41:55.394 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.394 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.395 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.395 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.395 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_starting_port": { 2024-09-05T01:41:55.395 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_starting_port", 2024-09-05T01:41:55.395 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.395 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.395 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.395 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4721", 2024-09-05T01:41:55.395 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.395 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.395 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.395 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-05T01:41:55.395 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.395 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.396 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.396 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.396 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_ptrace": { 2024-09-05T01:41:55.396 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_ptrace", 2024-09-05T01:41:55.396 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.396 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.396 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.396 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.396 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.396 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.396 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.396 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-05T01:41:55.396 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-05T01:41:55.396 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.397 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.397 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.397 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_interval": { 2024-09-05T01:41:55.397 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_interval", 2024-09-05T01:41:55.397 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.397 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.397 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.397 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-05T01:41:55.397 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.397 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.397 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.397 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-05T01:41:55.397 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.397 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.398 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.398 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.398 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_memory_target_ratio": { 2024-09-05T01:41:55.398 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_memory_target_ratio", 2024-09-05T01:41:55.398 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-05T01:41:55.398 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.398 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.398 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.7", 2024-09-05T01:41:55.398 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.398 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.398 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.398 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-05T01:41:55.398 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.399 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.399 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.399 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.399 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm_log_destination": { 2024-09-05T01:41:55.399 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm_log_destination", 2024-09-05T01:41:55.399 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.399 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.399 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.399 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.399 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.400 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.400 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.400 INFO:teuthology.orchestra.run.smithi012.stdout: "file", 2024-09-05T01:41:55.400 INFO:teuthology.orchestra.run.smithi012.stdout: "file,syslog", 2024-09-05T01:41:55.400 INFO:teuthology.orchestra.run.smithi012.stdout: "syslog" 2024-09-05T01:41:55.400 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.400 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-05T01:41:55.400 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.400 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.400 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.400 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.400 INFO:teuthology.orchestra.run.smithi012.stdout: "cgroups_split": { 2024-09-05T01:41:55.400 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cgroups_split", 2024-09-05T01:41:55.400 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.401 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.401 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.401 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.401 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.401 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.401 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.401 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-05T01:41:55.401 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.401 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.401 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.401 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.401 INFO:teuthology.orchestra.run.smithi012.stdout: "config_checks_enabled": { 2024-09-05T01:41:55.402 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_checks_enabled", 2024-09-05T01:41:55.402 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.402 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.402 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.402 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.402 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.402 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.402 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.402 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-05T01:41:55.402 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.402 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.402 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.403 INFO:teuthology.orchestra.run.smithi012.stdout: "config_dashboard": { 2024-09-05T01:41:55.403 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_dashboard", 2024-09-05T01:41:55.403 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.403 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.403 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.403 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.403 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.403 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.403 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.403 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-05T01:41:55.403 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.403 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.403 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.404 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_alertmanager": { 2024-09-05T01:41:55.404 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_alertmanager", 2024-09-05T01:41:55.404 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.404 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.404 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.404 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-05T01:41:55.404 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.404 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.404 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.404 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-05T01:41:55.404 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.404 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.405 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.405 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_base": { 2024-09-05T01:41:55.405 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_base", 2024-09-05T01:41:55.405 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.405 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.405 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.405 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-05T01:41:55.405 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.405 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.405 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.405 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Container image name, without the tag", 2024-09-05T01:41:55.405 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.405 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.406 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.406 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_elasticsearch": { 2024-09-05T01:41:55.406 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_elasticsearch", 2024-09-05T01:41:55.406 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.406 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.406 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.406 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-05T01:41:55.406 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.406 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.406 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.406 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "elasticsearch container image", 2024-09-05T01:41:55.406 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.406 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.407 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.407 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_grafana": { 2024-09-05T01:41:55.407 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_grafana", 2024-09-05T01:41:55.407 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.407 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.407 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.407 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-05T01:41:55.407 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.407 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.407 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.407 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-05T01:41:55.407 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.407 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.407 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.408 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_haproxy": { 2024-09-05T01:41:55.408 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_haproxy", 2024-09-05T01:41:55.408 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.408 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.408 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.408 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-05T01:41:55.408 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.408 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.408 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.408 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "HAproxy container image", 2024-09-05T01:41:55.408 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.408 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.408 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.408 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.409 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_agent": { 2024-09-05T01:41:55.409 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_agent", 2024-09-05T01:41:55.409 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.409 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.409 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.409 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-05T01:41:55.409 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.409 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.409 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.409 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger agent container image", 2024-09-05T01:41:55.409 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.409 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.409 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.410 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_collector": { 2024-09-05T01:41:55.410 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_collector", 2024-09-05T01:41:55.410 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.410 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.410 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.410 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-05T01:41:55.410 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.410 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.410 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.410 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger collector container image", 2024-09-05T01:41:55.410 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.410 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.410 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.410 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.411 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_query": { 2024-09-05T01:41:55.411 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_query", 2024-09-05T01:41:55.411 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.411 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.411 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.411 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-05T01:41:55.411 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.411 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.411 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.411 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger query container image", 2024-09-05T01:41:55.411 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.411 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.411 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.411 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_keepalived": { 2024-09-05T01:41:55.412 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_keepalived", 2024-09-05T01:41:55.412 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.412 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.412 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.412 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-05T01:41:55.412 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.412 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.412 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.412 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Keepalived container image", 2024-09-05T01:41:55.412 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.412 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.412 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.412 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.412 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_loki": { 2024-09-05T01:41:55.413 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_loki", 2024-09-05T01:41:55.413 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.413 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.413 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.413 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-05T01:41:55.413 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.413 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.413 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.413 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Loki container image", 2024-09-05T01:41:55.413 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.413 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.413 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.413 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.413 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_node_exporter": { 2024-09-05T01:41:55.413 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_node_exporter", 2024-09-05T01:41:55.414 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.414 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.414 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.414 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-05T01:41:55.414 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.414 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.414 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.414 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-05T01:41:55.414 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.414 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.414 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.414 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.414 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_nvmeof": { 2024-09-05T01:41:55.414 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_nvmeof", 2024-09-05T01:41:55.415 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.415 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.415 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.415 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-05T01:41:55.415 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.415 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.415 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.415 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Nvme-of container image", 2024-09-05T01:41:55.415 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.415 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.415 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.415 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.415 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_prometheus": { 2024-09-05T01:41:55.415 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_prometheus", 2024-09-05T01:41:55.415 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.416 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.416 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.416 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-05T01:41:55.416 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.416 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.416 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.416 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-05T01:41:55.416 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.416 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.416 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.416 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_promtail": { 2024-09-05T01:41:55.416 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_promtail", 2024-09-05T01:41:55.416 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.416 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.417 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.417 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-05T01:41:55.417 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.417 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.417 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.417 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Promtail container image", 2024-09-05T01:41:55.417 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.417 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.417 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.417 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.417 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_samba": { 2024-09-05T01:41:55.417 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_samba", 2024-09-05T01:41:55.417 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.417 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.418 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.418 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-05T01:41:55.418 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.418 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.418 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.418 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Samba/SMB container image", 2024-09-05T01:41:55.418 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.418 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.418 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.418 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.418 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_snmp_gateway": { 2024-09-05T01:41:55.418 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_snmp_gateway", 2024-09-05T01:41:55.418 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.418 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.419 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.419 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-05T01:41:55.419 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.419 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.419 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.419 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SNMP Gateway container image", 2024-09-05T01:41:55.419 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.419 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.419 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.419 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.419 INFO:teuthology.orchestra.run.smithi012.stdout: "container_init": { 2024-09-05T01:41:55.419 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_init", 2024-09-05T01:41:55.419 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.419 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.419 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.420 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.420 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.420 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.420 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.420 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Run podman/docker with `--init`", 2024-09-05T01:41:55.420 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.420 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.420 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.420 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.420 INFO:teuthology.orchestra.run.smithi012.stdout: "daemon_cache_timeout": { 2024-09-05T01:41:55.420 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "daemon_cache_timeout", 2024-09-05T01:41:55.420 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.420 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.420 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.421 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-05T01:41:55.421 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.421 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.421 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.421 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-05T01:41:55.421 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.421 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.421 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.421 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.421 INFO:teuthology.orchestra.run.smithi012.stdout: "default_cephadm_command_timeout": { 2024-09-05T01:41:55.421 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_cephadm_command_timeout", 2024-09-05T01:41:55.421 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.421 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.421 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.422 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "900", 2024-09-05T01:41:55.422 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.422 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.422 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.422 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-05T01:41:55.422 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.422 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.422 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.422 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.422 INFO:teuthology.orchestra.run.smithi012.stdout: "default_registry": { 2024-09-05T01:41:55.422 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_registry", 2024-09-05T01:41:55.422 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.422 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.422 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.423 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io", 2024-09-05T01:41:55.423 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.423 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.423 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.423 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-05T01:41:55.423 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.423 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.423 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.423 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.423 INFO:teuthology.orchestra.run.smithi012.stdout: "device_cache_timeout": { 2024-09-05T01:41:55.423 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_cache_timeout", 2024-09-05T01:41:55.423 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.423 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.424 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.424 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1800", 2024-09-05T01:41:55.424 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.424 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.424 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.424 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache device inventory", 2024-09-05T01:41:55.424 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.424 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.424 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.424 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.424 INFO:teuthology.orchestra.run.smithi012.stdout: "device_enhanced_scan": { 2024-09-05T01:41:55.424 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_enhanced_scan", 2024-09-05T01:41:55.424 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.424 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.425 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.425 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.425 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.425 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.425 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.425 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-05T01:41:55.425 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.425 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.425 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.425 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.425 INFO:teuthology.orchestra.run.smithi012.stdout: "facts_cache_timeout": { 2024-09-05T01:41:55.425 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "facts_cache_timeout", 2024-09-05T01:41:55.426 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.426 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.426 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.426 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-05T01:41:55.426 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.426 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.426 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.426 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache host facts data", 2024-09-05T01:41:55.426 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.426 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.426 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.426 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.426 INFO:teuthology.orchestra.run.smithi012.stdout: "grafana_dashboards_path": { 2024-09-05T01:41:55.426 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "grafana_dashboards_path", 2024-09-05T01:41:55.426 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.427 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.427 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.427 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-05T01:41:55.427 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.427 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.427 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.427 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-05T01:41:55.427 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.427 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.427 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.427 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.427 INFO:teuthology.orchestra.run.smithi012.stdout: "host_check_interval": { 2024-09-05T01:41:55.427 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "host_check_interval", 2024-09-05T01:41:55.427 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-05T01:41:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to perform a host check", 2024-09-05T01:41:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: "hw_monitoring": { 2024-09-05T01:41:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hw_monitoring", 2024-09-05T01:41:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.428 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-05T01:41:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: "inventory_list_all": { 2024-09-05T01:41:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "inventory_list_all", 2024-09-05T01:41:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.429 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-05T01:41:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.430 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.431 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: "log_refresh_metadata": { 2024-09-05T01:41:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_refresh_metadata", 2024-09-05T01:41:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-05T01:41:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.432 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-05T01:41:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.433 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.434 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.435 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-05T01:41:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-05T01:41:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.436 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-05T01:41:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-05T01:41:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-05T01:41:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "*", 2024-09-05T01:41:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.437 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-05T01:41:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: "max_count_per_host": { 2024-09-05T01:41:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_count_per_host", 2024-09-05T01:41:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-05T01:41:55.438 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of daemons per service per host", 2024-09-05T01:41:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd_draining_count": { 2024-09-05T01:41:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_osd_draining_count", 2024-09-05T01:41:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-05T01:41:55.439 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-05T01:41:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: "migration_current": { 2024-09-05T01:41:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "migration_current", 2024-09-05T01:41:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.440 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "internal - do not modify", 2024-09-05T01:41:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-09-05T01:41:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-09-05T01:41:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "root", 2024-09-05T01:41:55.441 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm-package", 2024-09-05T01:41:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: "root" 2024-09-05T01:41:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "mode for remote execution of cephadm", 2024-09-05T01:41:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: "oob_default_addr": { 2024-09-05T01:41:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "oob_default_addr", 2024-09-05T01:41:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.442 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "169.254.1.1", 2024-09-05T01:41:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-05T01:41:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "prometheus_alerts_path": { 2024-09-05T01:41:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus_alerts_path", 2024-09-05T01:41:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-05T01:41:55.443 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-05T01:41:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_insecure": { 2024-09-05T01:41:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_insecure", 2024-09-05T01:41:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.444 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-05T01:41:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_password": { 2024-09-05T01:41:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_password", 2024-09-05T01:41:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.445 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-05T01:41:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_url": { 2024-09-05T01:41:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_url", 2024-09-05T01:41:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.446 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-05T01:41:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_username": { 2024-09-05T01:41:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_username", 2024-09-05T01:41:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.447 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-05T01:41:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: "secure_monitoring_stack": { 2024-09-05T01:41:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "secure_monitoring_stack", 2024-09-05T01:41:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.448 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-05T01:41:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: "service_discovery_port": { 2024-09-05T01:41:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "service_discovery_port", 2024-09-05T01:41:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8765", 2024-09-05T01:41:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "cephadm service discovery port", 2024-09-05T01:41:55.449 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: "ssh_config_file": { 2024-09-05T01:41:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssh_config_file", 2024-09-05T01:41:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-05T01:41:55.450 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: "use_agent": { 2024-09-05T01:41:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_agent", 2024-09-05T01:41:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-05T01:41:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.451 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: "use_repo_digest": { 2024-09-05T01:41:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_repo_digest", 2024-09-05T01:41:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-05T01:41:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_failed_host_check": { 2024-09-05T01:41:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_failed_host_check", 2024-09-05T01:41:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if the host check fails", 2024-09-05T01:41:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.453 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_daemons": { 2024-09-05T01:41:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_daemons", 2024-09-05T01:41:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-05T01:41:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.454 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_hosts": { 2024-09-05T01:41:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_hosts", 2024-09-05T01:41:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-05T01:41:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.455 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crash", 2024-09-05T01:41:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.456 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.457 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.458 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.459 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.460 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: "retain_interval": { 2024-09-05T01:41:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retain_interval", 2024-09-05T01:41:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "31536000", 2024-09-05T01:41:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.461 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-05T01:41:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_recent_interval": { 2024-09-05T01:41:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_recent_interval", 2024-09-05T01:41:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1209600", 2024-09-05T01:41:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.462 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-05T01:41:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dashboard", 2024-09-05T01:41:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-05T01:41:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-05T01:41:55.463 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-05T01:41:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_HOST": { 2024-09-05T01:41:55.464 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-05T01:41:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-05T01:41:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-05T01:41:55.465 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_ENABLED": { 2024-09-05T01:41:55.466 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_ENABLED", 2024-09-05T01:41:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-05T01:41:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-05T01:41:55.467 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.468 INFO:teuthology.orchestra.run.smithi012.stdout: "ENABLE_BROWSABLE_API": { 2024-09-05T01:41:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-05T01:41:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.469 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-05T01:41:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-05T01:41:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.470 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-05T01:41:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-05T01:41:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-05T01:41:55.471 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-05T01:41:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-05T01:41:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-05T01:41:55.472 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-05T01:41:55.473 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-05T01:41:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-05T01:41:55.474 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-05T01:41:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-05T01:41:55.475 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-05T01:41:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-05T01:41:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-05T01:41:55.476 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_PASSWORD": { 2024-09-05T01:41:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-05T01:41:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.477 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-05T01:41:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-05T01:41:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-05T01:41:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.478 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_URL": { 2024-09-05T01:41:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_URL", 2024-09-05T01:41:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.479 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_USERNAME": { 2024-09-05T01:41:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-05T01:41:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-05T01:41:55.480 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-05T01:41:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-05T01:41:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.481 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-05T01:41:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-05T01:41:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.482 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-05T01:41:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-05T01:41:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.483 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-05T01:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-05T01:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.484 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_HOST": { 2024-09-05T01:41:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-05T01:41:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.485 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-05T01:41:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-05T01:41:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.486 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-05T01:41:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-05T01:41:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.487 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-05T01:41:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-05T01:41:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.488 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-05T01:41:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-05T01:41:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.489 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-05T01:41:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-05T01:41:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.490 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-05T01:41:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-05T01:41:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.491 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-05T01:41:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-05T01:41:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.492 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-05T01:41:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-05T01:41:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.493 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_ENABLED": { 2024-09-05T01:41:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-05T01:41:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.494 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-05T01:41:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-05T01:41:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-05T01:41:55.495 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-05T01:41:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-05T01:41:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.496 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-05T01:41:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-05T01:41:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-05T01:41:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.497 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8", 2024-09-05T01:41:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-05T01:41:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-05T01:41:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.498 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "45", 2024-09-05T01:41:55.499 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.499 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.499 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.499 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.499 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.499 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.499 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.499 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.499 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ACCESS_KEY": { 2024-09-05T01:41:55.499 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-05T01:41:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-05T01:41:55.500 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-05T01:41:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-05T01:41:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SECRET_KEY": { 2024-09-05T01:41:55.501 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-05T01:41:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.502 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SSL_VERIFY": { 2024-09-05T01:41:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-05T01:41:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.503 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-05T01:41:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-05T01:41:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-05T01:41:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.504 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-05T01:41:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-05T01:41:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-05T01:41:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.505 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-05T01:41:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-05T01:41:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-05T01:41:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.506 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: "cross_origin_url": { 2024-09-05T01:41:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cross_origin_url", 2024-09-05T01:41:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.507 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: "crt_file": { 2024-09-05T01:41:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crt_file", 2024-09-05T01:41:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.508 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: "debug": { 2024-09-05T01:41:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "debug", 2024-09-05T01:41:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.509 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable/disable debug options", 2024-09-05T01:41:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: "jwt_token_ttl": { 2024-09-05T01:41:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "jwt_token_ttl", 2024-09-05T01:41:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "28800", 2024-09-05T01:41:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.510 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-09-05T01:41:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-09-05T01:41:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.511 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.512 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.513 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.514 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.516 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: "motd": { 2024-09-05T01:41:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "motd", 2024-09-05T01:41:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.517 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "The message of the day", 2024-09-05T01:41:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect_resolve_ip_addr": { 2024-09-05T01:41:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "redirect_resolve_ip_addr", 2024-09-05T01:41:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.518 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.519 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.519 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.519 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.519 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.519 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.519 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.519 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-05T01:41:55.519 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-05T01:41:55.519 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.519 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.519 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.519 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-09-05T01:41:55.519 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.520 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.520 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.520 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.520 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.520 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.520 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.520 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.520 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-05T01:41:55.520 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-05T01:41:55.520 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.520 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.520 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.520 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8080", 2024-09-05T01:41:55.520 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.521 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.521 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.521 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.521 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.521 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.521 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.521 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.521 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-09-05T01:41:55.521 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-09-05T01:41:55.521 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.521 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.521 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.521 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.521 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.522 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.522 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.522 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.522 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.522 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.522 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.522 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.522 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl_server_port": { 2024-09-05T01:41:55.522 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl_server_port", 2024-09-05T01:41:55.522 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.522 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.522 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.522 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8443", 2024-09-05T01:41:55.522 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.523 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.523 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.523 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.523 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.523 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.523 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.523 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.523 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-09-05T01:41:55.523 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-09-05T01:41:55.523 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.523 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.523 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.523 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "redirect", 2024-09-05T01:41:55.523 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.523 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.523 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.524 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.524 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect" 2024-09-05T01:41:55.524 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.524 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.524 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.524 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.524 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.524 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.524 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-09-05T01:41:55.524 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-09-05T01:41:55.524 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.524 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.524 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.524 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-09-05T01:41:55.525 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-09-05T01:41:55.525 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-09-05T01:41:55.525 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.525 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.525 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.525 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.525 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.525 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.525 INFO:teuthology.orchestra.run.smithi012.stdout: "url_prefix": { 2024-09-05T01:41:55.525 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url_prefix", 2024-09-05T01:41:55.525 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.525 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.525 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.525 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.526 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.526 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.526 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.526 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.526 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.526 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.526 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.526 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.526 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.526 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.526 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.526 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "devicehealth", 2024-09-05T01:41:55.526 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.526 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.527 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.527 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_monitoring": { 2024-09-05T01:41:55.527 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_monitoring", 2024-09-05T01:41:55.527 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.527 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.527 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.527 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.527 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.527 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.527 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.527 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "monitor device health metrics", 2024-09-05T01:41:55.527 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.527 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.527 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.528 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.528 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.528 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.528 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.528 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.528 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.528 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.528 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.528 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.528 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.528 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.528 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.528 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.528 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.529 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.529 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.529 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.529 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.529 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.529 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.529 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.529 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.529 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.529 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.529 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.529 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.529 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.530 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.530 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.530 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.530 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.530 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.530 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.530 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.530 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.530 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.530 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.530 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.530 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.530 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.530 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.530 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.531 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.531 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.531 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.531 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.531 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.531 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.531 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.531 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.531 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.531 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.531 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.531 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.531 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.531 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.531 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.532 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.532 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.532 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.532 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.532 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.532 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.532 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.532 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.532 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.532 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.532 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.532 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.532 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.532 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.532 INFO:teuthology.orchestra.run.smithi012.stdout: "mark_out_threshold": { 2024-09-05T01:41:55.533 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mark_out_threshold", 2024-09-05T01:41:55.533 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.533 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.533 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.533 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2419200", 2024-09-05T01:41:55.533 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.533 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.533 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.533 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-05T01:41:55.533 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.533 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.533 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.533 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.533 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": { 2024-09-05T01:41:55.533 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_name", 2024-09-05T01:41:55.534 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.534 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.534 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.534 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "device_health_metrics", 2024-09-05T01:41:55.534 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.534 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.534 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.534 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-05T01:41:55.534 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.534 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.534 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.534 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.534 INFO:teuthology.orchestra.run.smithi012.stdout: "retention_period": { 2024-09-05T01:41:55.534 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retention_period", 2024-09-05T01:41:55.534 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.535 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.535 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.535 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15552000", 2024-09-05T01:41:55.535 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.535 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.535 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.535 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain device health metrics", 2024-09-05T01:41:55.535 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.535 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.535 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.535 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.535 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_frequency": { 2024-09-05T01:41:55.535 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_frequency", 2024-09-05T01:41:55.535 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.535 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.535 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.536 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-09-05T01:41:55.536 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.536 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.536 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.536 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-05T01:41:55.536 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.536 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.536 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.536 INFO:teuthology.orchestra.run.smithi012.stdout: "self_heal": { 2024-09-05T01:41:55.536 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "self_heal", 2024-09-05T01:41:55.536 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.536 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.536 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.537 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.537 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.537 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.537 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.537 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-05T01:41:55.537 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.537 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.537 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.537 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.537 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-05T01:41:55.537 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-05T01:41:55.537 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.537 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.537 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.537 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-05T01:41:55.538 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.538 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.538 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.538 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and check device health", 2024-09-05T01:41:55.538 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.538 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.538 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.538 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.538 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_threshold": { 2024-09-05T01:41:55.538 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_threshold", 2024-09-05T01:41:55.538 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.538 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.538 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.538 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7257600", 2024-09-05T01:41:55.539 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.539 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.539 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.539 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-05T01:41:55.539 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.539 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.539 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.539 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.539 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.539 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.539 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.539 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "diskprediction_local", 2024-09-05T01:41:55.539 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.539 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.539 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.540 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.540 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.540 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.540 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.540 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.540 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.540 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.540 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.540 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.540 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.540 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.540 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.540 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.540 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.540 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.541 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.541 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.541 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.541 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.541 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.541 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.541 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.541 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.541 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.541 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.541 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.541 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.541 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.541 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.542 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.542 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.542 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.542 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.542 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.542 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.542 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.542 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.542 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.542 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.542 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.542 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.542 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.542 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.542 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.543 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.543 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.543 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.543 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.543 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.543 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.543 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.543 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.543 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.543 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.543 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.543 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.543 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.543 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.543 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.544 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.544 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.544 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.544 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.544 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.544 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.544 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.544 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.544 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.544 INFO:teuthology.orchestra.run.smithi012.stdout: "predict_interval": { 2024-09-05T01:41:55.544 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predict_interval", 2024-09-05T01:41:55.544 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.544 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.544 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.545 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-09-05T01:41:55.545 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.545 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.545 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.545 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.545 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.545 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.545 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.545 INFO:teuthology.orchestra.run.smithi012.stdout: "predictor_model": { 2024-09-05T01:41:55.545 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predictor_model", 2024-09-05T01:41:55.545 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.545 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.546 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.546 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "prophetstor", 2024-09-05T01:41:55.546 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.546 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.546 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.546 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.546 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.546 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.546 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.546 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-05T01:41:55.546 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-05T01:41:55.546 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.546 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.546 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.547 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-05T01:41:55.547 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.547 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.547 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.547 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.547 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.547 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.547 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.547 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.547 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.547 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.547 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.547 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "influx", 2024-09-05T01:41:55.547 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": false, 2024-09-05T01:41:55.547 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "influxdb python module not found", 2024-09-05T01:41:55.548 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.548 INFO:teuthology.orchestra.run.smithi012.stdout: "batch_size": { 2024-09-05T01:41:55.548 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "batch_size", 2024-09-05T01:41:55.548 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.548 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.548 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.548 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5000", 2024-09-05T01:41:55.548 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.548 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.548 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.548 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-05T01:41:55.548 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.548 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.548 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.548 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.549 INFO:teuthology.orchestra.run.smithi012.stdout: "database": { 2024-09-05T01:41:55.549 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "database", 2024-09-05T01:41:55.549 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.549 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.549 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.549 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "ceph", 2024-09-05T01:41:55.549 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.549 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.549 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.549 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-05T01:41:55.549 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.549 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.549 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.549 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.550 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": { 2024-09-05T01:41:55.550 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hostname", 2024-09-05T01:41:55.550 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.550 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.550 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.550 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.550 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.550 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.550 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.550 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server hostname", 2024-09-05T01:41:55.550 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.550 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.551 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.551 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.551 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-05T01:41:55.551 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-05T01:41:55.551 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.551 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.551 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.551 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "30", 2024-09-05T01:41:55.551 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "5", 2024-09-05T01:41:55.551 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.551 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.551 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-05T01:41:55.551 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.552 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.552 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.552 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.552 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.552 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.552 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.552 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.552 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.552 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.552 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.552 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.552 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.552 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.553 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.553 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.553 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.553 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.553 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.553 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.553 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.553 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.553 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.553 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.553 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.553 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.553 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.554 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.554 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.554 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.554 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.554 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.554 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.554 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.554 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.554 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.554 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.554 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.554 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.555 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.555 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.555 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.555 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.555 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.555 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.555 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.555 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.555 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.555 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.555 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.555 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.555 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.555 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.555 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.556 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.556 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.556 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.556 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.556 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.556 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.556 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.556 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.556 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.556 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.556 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.556 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.556 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.557 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.557 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.557 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.557 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.557 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.557 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.557 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.557 INFO:teuthology.orchestra.run.smithi012.stdout: "password": { 2024-09-05T01:41:55.557 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "password", 2024-09-05T01:41:55.557 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.557 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.557 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.557 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.557 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.557 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.558 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.558 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "password of InfluxDB server user", 2024-09-05T01:41:55.558 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.558 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.558 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.558 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.558 INFO:teuthology.orchestra.run.smithi012.stdout: "port": { 2024-09-05T01:41:55.558 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "port", 2024-09-05T01:41:55.558 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.558 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.558 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.558 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8086", 2024-09-05T01:41:55.558 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.558 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.558 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.559 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server port", 2024-09-05T01:41:55.559 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.559 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.559 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.559 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.559 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-09-05T01:41:55.559 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-09-05T01:41:55.559 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.559 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.559 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.559 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "false", 2024-09-05T01:41:55.559 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.559 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.559 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.559 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-05T01:41:55.560 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.560 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.560 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.560 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.560 INFO:teuthology.orchestra.run.smithi012.stdout: "threads": { 2024-09-05T01:41:55.560 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threads", 2024-09-05T01:41:55.560 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.560 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.560 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.560 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-05T01:41:55.560 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-05T01:41:55.560 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "32", 2024-09-05T01:41:55.560 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.560 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-05T01:41:55.560 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.561 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.561 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.561 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.561 INFO:teuthology.orchestra.run.smithi012.stdout: "username": { 2024-09-05T01:41:55.561 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "username", 2024-09-05T01:41:55.561 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.561 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.561 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.561 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.561 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.561 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.561 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.561 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "username of InfluxDB server user", 2024-09-05T01:41:55.561 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.562 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.562 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.562 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.562 INFO:teuthology.orchestra.run.smithi012.stdout: "verify_ssl": { 2024-09-05T01:41:55.562 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "verify_ssl", 2024-09-05T01:41:55.562 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.562 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.562 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.562 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "true", 2024-09-05T01:41:55.562 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.562 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.562 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.562 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-05T01:41:55.562 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.562 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.563 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.563 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.563 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.563 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.563 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.563 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "insights", 2024-09-05T01:41:55.563 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.563 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.563 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.563 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.563 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.563 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.563 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.563 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.563 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.563 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.565 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.565 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.565 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.565 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.565 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.565 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.565 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.565 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.565 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.565 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.565 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.565 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.565 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.565 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.566 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.566 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.566 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.566 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.566 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.566 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.566 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.566 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.566 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.566 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.566 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.566 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.566 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.566 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.566 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.566 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.567 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.567 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.567 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.567 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.567 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.567 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.567 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.567 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.567 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.567 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.567 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.567 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.567 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.567 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.568 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.568 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.568 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.568 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.568 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.568 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.568 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "iostat", 2024-09-05T01:41:55.568 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.568 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.568 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.568 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.568 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.568 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.568 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.569 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.569 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.569 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.569 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.569 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.569 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.569 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.569 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.569 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.569 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.569 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.569 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.569 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.569 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.569 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.570 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.570 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.570 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.570 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.570 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.570 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.570 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.570 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.570 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.570 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.570 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.570 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.570 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.570 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.571 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.571 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.571 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.571 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.571 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.571 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.571 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.571 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.571 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.571 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.571 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.571 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.571 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.571 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.572 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.572 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.572 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.572 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.572 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.572 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.572 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.572 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.572 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.572 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.572 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.572 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.572 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.573 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.573 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.573 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.573 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.573 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.576 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.576 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.576 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.576 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.576 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.576 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "k8sevents", 2024-09-05T01:41:55.577 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.577 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.577 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.577 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_event_retention_days": { 2024-09-05T01:41:55.577 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ceph_event_retention_days", 2024-09-05T01:41:55.577 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.577 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.577 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.577 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7", 2024-09-05T01:41:55.577 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.577 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.577 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.577 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-05T01:41:55.578 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.578 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.578 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.578 INFO:teuthology.orchestra.run.smithi012.stdout: "config_check_secs": { 2024-09-05T01:41:55.578 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_check_secs", 2024-09-05T01:41:55.578 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.578 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.578 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.578 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-05T01:41:55.578 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "10", 2024-09-05T01:41:55.578 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.578 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.578 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-05T01:41:55.579 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.579 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.579 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.579 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.579 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.579 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.579 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.579 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.579 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.579 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.579 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.580 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.580 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.580 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.580 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.580 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.580 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.580 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.580 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.580 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.580 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.580 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.580 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.580 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.581 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.581 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.581 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.581 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.581 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.581 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.581 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.581 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.581 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.581 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.581 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.581 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.581 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.582 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.582 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.582 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.582 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.582 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.582 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.582 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.582 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.582 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.582 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.582 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.582 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.582 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.582 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.583 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.583 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.583 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.583 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.583 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.583 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.583 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.583 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.583 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.583 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.583 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.583 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.583 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.583 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.584 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.584 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.584 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.584 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.584 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.584 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.584 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.584 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.584 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.584 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.584 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.584 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "localpool", 2024-09-05T01:41:55.584 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.584 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.585 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.585 INFO:teuthology.orchestra.run.smithi012.stdout: "failure_domain": { 2024-09-05T01:41:55.585 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "failure_domain", 2024-09-05T01:41:55.585 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.585 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.585 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.585 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "host", 2024-09-05T01:41:55.585 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.585 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.585 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.585 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "failure domain for any created local pool", 2024-09-05T01:41:55.585 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-05T01:41:55.585 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.586 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.587 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.588 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.589 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.590 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.591 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.591 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": { 2024-09-05T01:41:55.591 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_size", 2024-09-05T01:41:55.591 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.591 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.591 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.591 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.591 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.591 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.591 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.591 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default min_size for any created local pool", 2024-09-05T01:41:55.591 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-05T01:41:55.591 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: "num_rep": { 2024-09-05T01:41:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "num_rep", 2024-09-05T01:41:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3", 2024-09-05T01:41:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default replica count for any created local pool", 2024-09-05T01:41:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.592 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.593 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": { 2024-09-05T01:41:55.593 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_num", 2024-09-05T01:41:55.593 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.593 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.593 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.593 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "128", 2024-09-05T01:41:55.593 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.593 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.593 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default pg_num for any created local pool", 2024-09-05T01:41:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: "prefix": { 2024-09-05T01:41:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prefix", 2024-09-05T01:41:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.594 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name prefix for any created local pool", 2024-09-05T01:41:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: "subtree": { 2024-09-05T01:41:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "subtree", 2024-09-05T01:41:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "rack", 2024-09-05T01:41:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.595 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.596 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-05T01:41:55.596 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-05T01:41:55.596 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.596 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.596 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.596 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.596 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.596 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.596 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mds_autoscaler", 2024-09-05T01:41:55.596 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.596 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.596 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.596 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.596 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.597 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.597 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.597 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.597 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.597 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.597 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.597 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.597 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.597 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.597 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.597 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.597 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.597 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.597 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.598 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.598 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.598 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.598 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.598 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.598 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.598 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.598 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.598 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.598 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.598 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.598 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.598 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.598 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.599 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.599 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.599 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.599 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.599 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.599 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.599 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.599 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.599 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.599 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.599 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.600 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.600 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.600 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.600 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.600 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.600 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.600 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.600 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.600 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.600 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.601 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.601 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.601 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.601 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.601 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.601 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.601 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.601 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.601 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.601 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.601 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.601 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.601 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.602 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.602 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.602 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.602 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.602 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.602 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.602 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.602 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.602 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.602 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirroring", 2024-09-05T01:41:55.602 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.602 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.602 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.602 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.602 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.603 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.603 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.603 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.603 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.603 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.603 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.603 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.603 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.603 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.603 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.603 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.603 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.603 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.603 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.604 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.604 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.604 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.604 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.604 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.604 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.604 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.604 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.604 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.604 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.604 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.604 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.604 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.604 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.605 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.605 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.605 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.605 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.605 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.605 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.605 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.605 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.605 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.605 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.605 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.605 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.605 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.606 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.606 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.606 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.606 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.606 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.606 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.606 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.606 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.606 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.606 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.606 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.606 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.606 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.606 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.607 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.607 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.607 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.607 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.607 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.607 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.607 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.607 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.607 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.607 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.607 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.607 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.607 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.607 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.607 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.608 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.608 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "nfs", 2024-09-05T01:41:55.608 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.608 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.608 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.608 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.608 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.608 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.608 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.608 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.608 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.608 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.608 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.609 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.609 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.609 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.609 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.609 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.609 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.609 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.609 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.609 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.609 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.609 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.609 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.609 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.610 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.610 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.610 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.610 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.610 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.610 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.610 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.610 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.610 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.610 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.610 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.610 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.610 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.611 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.611 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.611 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.611 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.611 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.611 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.611 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.611 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.611 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.611 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.611 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.611 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.611 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.611 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.612 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.612 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.612 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.612 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.612 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.612 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.612 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.612 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.612 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.612 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.612 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.612 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.612 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.612 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.613 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.613 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.613 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.613 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.613 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.613 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.613 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.613 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.613 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.613 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.613 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.613 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-09-05T01:41:55.613 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.613 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.614 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.614 INFO:teuthology.orchestra.run.smithi012.stdout: "fail_fs": { 2024-09-05T01:41:55.614 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "fail_fs", 2024-09-05T01:41:55.614 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.614 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.614 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.614 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.614 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.614 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.614 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.614 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-05T01:41:55.614 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.614 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.615 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.615 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.615 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.615 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.615 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.615 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.615 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.615 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.615 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.615 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.615 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.615 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.615 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.615 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.616 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.616 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.616 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.616 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.616 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.616 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.616 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.616 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.616 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.616 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.616 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.616 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.616 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.616 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.617 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.617 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.617 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.617 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.617 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.617 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.617 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.617 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.617 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.617 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.617 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.617 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.617 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.617 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.618 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.618 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.618 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.618 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.618 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.618 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.618 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.618 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.618 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.618 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.618 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.618 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.618 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.619 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.619 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.619 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.619 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.619 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.619 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.619 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.619 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.619 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.619 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.619 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.619 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.619 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.619 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.620 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.620 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.620 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.620 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator": { 2024-09-05T01:41:55.620 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-09-05T01:41:55.620 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.620 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.620 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.620 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.620 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.620 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.620 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.620 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm", 2024-09-05T01:41:55.621 INFO:teuthology.orchestra.run.smithi012.stdout: "rook", 2024-09-05T01:41:55.621 INFO:teuthology.orchestra.run.smithi012.stdout: "test_orchestrator" 2024-09-05T01:41:55.621 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.621 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Orchestrator backend", 2024-09-05T01:41:55.621 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.621 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.621 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.621 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.621 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.621 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.621 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.621 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_perf_query", 2024-09-05T01:41:55.621 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.621 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.622 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.622 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.622 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.622 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.622 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.622 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.622 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.622 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.622 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.622 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.622 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.622 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.622 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.622 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.623 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.623 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.623 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.623 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.623 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.623 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.623 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.623 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.623 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.623 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.623 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.623 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.623 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.623 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.624 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.624 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.624 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.624 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.624 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.624 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.624 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.624 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.624 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.624 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.624 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.624 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.624 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.625 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.625 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.625 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.625 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.625 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.625 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.625 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.625 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.625 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.625 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.625 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.625 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.625 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.626 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.626 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.626 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.626 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.626 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.626 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.626 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.626 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.626 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.626 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.626 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.626 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.626 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.626 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.626 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.627 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.627 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.627 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.627 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.627 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.627 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_support", 2024-09-05T01:41:55.627 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.627 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.627 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.627 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.627 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.627 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.627 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.628 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.628 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.628 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.628 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.628 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.628 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.628 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.628 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.628 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.628 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.628 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.628 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.628 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.629 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.629 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.629 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.629 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.629 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.629 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.629 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.629 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.629 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.629 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.629 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.629 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.629 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.630 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.630 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.630 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.630 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.630 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.630 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.630 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.630 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.630 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.630 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.630 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.630 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.630 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.631 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.631 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.631 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.631 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.631 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.631 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.631 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.631 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.631 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.631 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.631 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.631 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.631 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.631 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.632 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.632 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.632 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.632 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.632 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.632 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.632 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.632 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.632 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.632 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.632 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.632 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.633 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.633 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.633 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.633 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.633 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_autoscaler", 2024-09-05T01:41:55.633 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.633 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.633 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.633 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.633 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.633 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.633 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.633 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.634 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.634 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.634 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.634 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.634 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.634 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.634 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.634 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.634 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.634 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.634 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.634 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.634 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.634 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.635 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.635 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.635 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.635 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.635 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.635 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.635 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.635 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.635 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.635 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.635 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.635 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.635 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.636 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.636 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.636 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.636 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.636 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.636 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.636 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.636 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.636 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.636 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.636 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.636 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.637 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.637 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.637 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.637 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.637 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.637 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.637 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.637 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.637 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.637 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.637 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.637 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.638 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.638 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.638 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.638 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.638 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.638 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.638 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.638 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.638 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.638 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.638 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.638 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-05T01:41:55.638 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-05T01:41:55.638 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.638 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.639 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.639 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-05T01:41:55.639 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.639 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.639 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.639 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.639 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.639 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.639 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.639 INFO:teuthology.orchestra.run.smithi012.stdout: "threshold": { 2024-09-05T01:41:55.639 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threshold", 2024-09-05T01:41:55.639 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-05T01:41:55.639 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.640 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.640 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-09-05T01:41:55.640 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1.0", 2024-09-05T01:41:55.640 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.640 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.640 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "scaling threshold", 2024-09-05T01:41:55.640 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-05T01:41:55.640 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.640 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.640 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.640 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.641 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.641 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "progress", 2024-09-05T01:41:55.641 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.641 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.641 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.641 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_pg_recovery_event": { 2024-09-05T01:41:55.641 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_pg_recovery_event", 2024-09-05T01:41:55.641 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.641 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.641 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.641 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.641 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.641 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.641 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.642 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-05T01:41:55.642 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.642 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.642 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.642 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.642 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-09-05T01:41:55.642 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-09-05T01:41:55.642 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.642 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.642 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.642 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.642 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.642 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.643 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.643 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.643 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.643 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.643 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.643 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.643 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.643 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.643 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.643 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.643 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.643 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.643 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.644 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.644 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.644 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.644 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.644 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.644 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.644 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.644 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.644 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.644 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.644 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.644 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.644 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.645 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.645 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.645 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.645 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.645 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.645 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.645 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.645 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.645 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.645 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.645 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.645 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.646 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.646 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.646 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.646 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.646 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.646 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.646 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.646 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.646 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.646 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.646 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.646 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.646 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.646 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.646 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.647 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.647 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.647 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.647 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.647 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.647 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.647 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.647 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.647 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.647 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.647 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.647 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.648 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.648 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.648 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.648 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.648 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.648 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.648 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.648 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.648 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.648 INFO:teuthology.orchestra.run.smithi012.stdout: "max_completed_events": { 2024-09-05T01:41:55.648 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_completed_events", 2024-09-05T01:41:55.648 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.648 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.648 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.649 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "50", 2024-09-05T01:41:55.649 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.649 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.649 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.649 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "number of past completed events to remember", 2024-09-05T01:41:55.649 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.649 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.649 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.649 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.649 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-05T01:41:55.649 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-05T01:41:55.649 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.649 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.649 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.650 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-05T01:41:55.650 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.650 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.650 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.650 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long the module is going to sleep", 2024-09-05T01:41:55.650 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.650 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.650 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.650 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.650 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.650 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.650 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.651 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus", 2024-09-05T01:41:55.651 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.651 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.651 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.651 INFO:teuthology.orchestra.run.smithi012.stdout: "cache": { 2024-09-05T01:41:55.651 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cache", 2024-09-05T01:41:55.651 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.651 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.651 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.651 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.651 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.651 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.651 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.652 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.652 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.652 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.652 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.652 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.652 INFO:teuthology.orchestra.run.smithi012.stdout: "exclude_perf_counters": { 2024-09-05T01:41:55.652 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "exclude_perf_counters", 2024-09-05T01:41:55.652 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.652 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.652 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.652 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.652 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.652 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.652 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.653 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-05T01:41:55.653 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-05T01:41:55.653 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.653 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.653 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.653 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.653 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.653 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.653 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.653 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.653 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.653 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.654 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.654 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.654 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.654 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.654 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.654 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.654 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.654 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.654 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.654 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.654 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.654 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.654 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.654 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.655 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.655 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.655 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.655 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.655 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.655 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.655 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.655 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.655 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.655 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.655 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.655 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.656 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.656 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.656 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.656 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.656 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.656 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.656 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.656 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.656 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.656 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.656 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.656 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.656 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.656 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.657 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.657 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.657 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.657 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.657 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.657 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.657 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.657 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.657 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.657 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.657 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.657 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.657 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.658 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.658 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.658 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.658 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.658 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.658 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.658 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.658 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools": { 2024-09-05T01:41:55.658 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools", 2024-09-05T01:41:55.658 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.658 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.658 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.659 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.659 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.659 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.659 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.659 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.659 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.659 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.659 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.659 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.659 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-05T01:41:55.659 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-05T01:41:55.659 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.659 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.659 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.660 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "300", 2024-09-05T01:41:55.660 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.660 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.660 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.660 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.660 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.660 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.660 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.660 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.660 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_interval": { 2024-09-05T01:41:55.660 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_interval", 2024-09-05T01:41:55.660 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-05T01:41:55.660 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.660 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.661 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15.0", 2024-09-05T01:41:55.661 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.661 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.661 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.661 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.661 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.661 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.661 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.661 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.661 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-05T01:41:55.661 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-05T01:41:55.661 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.661 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.661 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.662 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-09-05T01:41:55.662 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.662 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.662 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.662 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-05T01:41:55.662 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.662 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.662 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.662 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.662 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-05T01:41:55.662 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-05T01:41:55.662 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.662 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.663 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.663 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "9283", 2024-09-05T01:41:55.663 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.663 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.663 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.663 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-05T01:41:55.663 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.663 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.663 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.663 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.663 INFO:teuthology.orchestra.run.smithi012.stdout: "stale_cache_strategy": { 2024-09-05T01:41:55.663 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stale_cache_strategy", 2024-09-05T01:41:55.663 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.663 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.663 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.664 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "log", 2024-09-05T01:41:55.664 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.664 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.664 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.664 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.664 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.664 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.664 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.664 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-09-05T01:41:55.664 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-09-05T01:41:55.664 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.664 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.664 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.665 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "default", 2024-09-05T01:41:55.665 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.665 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.665 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.665 INFO:teuthology.orchestra.run.smithi012.stdout: "default", 2024-09-05T01:41:55.665 INFO:teuthology.orchestra.run.smithi012.stdout: "error" 2024-09-05T01:41:55.665 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.665 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.665 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.665 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.665 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.665 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.665 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-09-05T01:41:55.666 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-09-05T01:41:55.666 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.666 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.666 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.666 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-09-05T01:41:55.666 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-09-05T01:41:55.666 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-09-05T01:41:55.666 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.666 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.666 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.666 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.666 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.666 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.666 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.666 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.667 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.667 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_support", 2024-09-05T01:41:55.667 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.667 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.667 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.667 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.667 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.667 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.667 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.667 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.667 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.667 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.667 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.667 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.668 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.668 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.668 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.668 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.668 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.668 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.668 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.668 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.668 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.668 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.668 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.668 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.669 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.669 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.669 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.669 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.669 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.669 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.669 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.669 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.669 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.669 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.669 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.669 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.669 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.669 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.670 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.670 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.670 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.670 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.670 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.670 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.670 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.670 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.670 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.670 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.670 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.670 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.670 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.670 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.671 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.671 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.671 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.671 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.671 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.671 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.671 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.671 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.671 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.671 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.671 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.671 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.671 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.671 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.672 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.672 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.672 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.672 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.672 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.672 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.672 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_snap_create": { 2024-09-05T01:41:55.672 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_snap_create", 2024-09-05T01:41:55.672 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.672 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.672 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.672 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-05T01:41:55.672 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.673 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.673 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.673 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.673 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.673 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.673 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.673 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.673 INFO:teuthology.orchestra.run.smithi012.stdout: "mirror_snapshot_schedule": { 2024-09-05T01:41:55.673 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirror_snapshot_schedule", 2024-09-05T01:41:55.673 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.673 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.673 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.673 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.674 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.674 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.674 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.674 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.674 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.674 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.674 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.674 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.674 INFO:teuthology.orchestra.run.smithi012.stdout: "trash_purge_schedule": { 2024-09-05T01:41:55.674 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "trash_purge_schedule", 2024-09-05T01:41:55.674 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.674 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.674 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.675 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.675 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.675 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.675 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.675 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.675 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.675 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.675 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.675 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.675 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.675 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.675 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.675 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "restful", 2024-09-05T01:41:55.675 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.675 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.676 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.676 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_auth": { 2024-09-05T01:41:55.676 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_auth", 2024-09-05T01:41:55.676 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.676 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.676 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.676 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.676 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.676 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.676 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.676 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.676 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.676 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.677 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.677 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.677 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-09-05T01:41:55.677 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-09-05T01:41:55.677 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.677 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.677 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.677 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.677 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.677 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.677 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.677 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.677 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.678 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.678 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.678 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.678 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.678 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.678 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.678 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.678 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.678 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.678 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.678 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.678 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.678 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.678 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.679 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.679 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.679 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.679 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.679 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.679 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.679 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.679 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.679 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.679 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.679 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.679 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.679 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.680 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.680 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.680 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.680 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.680 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.680 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.680 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.680 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.680 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.680 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.680 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.680 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.680 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.681 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.681 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.681 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.681 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.681 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.681 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.681 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.681 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.681 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.681 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.681 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.681 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.681 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.682 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.682 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.682 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.682 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.682 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.682 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.682 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.682 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.682 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.682 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.682 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.682 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.682 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.682 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.683 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.683 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.683 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.683 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.683 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.683 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.683 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-05T01:41:55.683 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-05T01:41:55.683 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.683 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.683 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.683 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.683 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.684 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.684 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.684 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.684 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.684 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.684 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.684 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.684 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-05T01:41:55.684 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-05T01:41:55.684 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.684 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.684 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.684 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.685 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.685 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.685 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.685 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.685 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.685 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.685 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.685 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.685 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.685 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.685 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.685 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rgw", 2024-09-05T01:41:55.685 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.686 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.686 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.686 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.686 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.686 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.686 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.686 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.686 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.686 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.686 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.686 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.686 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.686 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.686 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.687 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.687 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.687 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.687 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.687 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.687 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.687 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.687 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.687 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.687 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.687 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.687 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.687 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.687 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.687 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.688 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.688 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.688 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.688 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.688 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.688 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.688 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.688 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.688 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.688 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.688 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.688 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.688 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.689 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.689 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.689 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.689 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.689 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.689 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.689 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.689 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.689 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.689 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.689 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.689 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.689 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.689 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.689 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.690 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.690 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.690 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.690 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.690 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.690 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.690 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.690 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.690 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.690 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.690 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.690 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.690 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.691 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.691 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.691 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.691 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.691 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.691 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rook", 2024-09-05T01:41:55.691 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.691 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.691 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.691 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.691 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.691 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.691 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.692 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.692 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.692 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.692 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.692 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.692 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.692 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.692 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.692 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.692 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.692 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.692 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.692 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.692 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.693 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.693 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.693 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.693 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.693 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.693 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.693 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.693 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.693 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.693 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.693 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.693 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.693 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.694 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.694 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.694 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.694 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.694 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.694 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.694 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.694 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.694 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.694 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.694 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.694 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.695 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.695 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.695 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.695 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.695 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.695 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.695 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.695 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.695 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.695 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.695 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.696 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.696 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.696 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.696 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.696 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.696 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.696 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.696 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.696 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.696 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.696 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.696 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.696 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.697 INFO:teuthology.orchestra.run.smithi012.stdout: "storage_class": { 2024-09-05T01:41:55.697 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "storage_class", 2024-09-05T01:41:55.697 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.697 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.697 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.697 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "local", 2024-09-05T01:41:55.697 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.697 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.697 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.697 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-05T01:41:55.697 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.697 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.698 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.698 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.698 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.698 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.698 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.698 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "selftest", 2024-09-05T01:41:55.698 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.698 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.698 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.698 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.698 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.698 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.698 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.699 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.699 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.699 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.699 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.699 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.699 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.699 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.699 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.699 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.699 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.699 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.699 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.699 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.700 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.700 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.700 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.700 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.700 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.700 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.700 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.700 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.700 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.700 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.700 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.700 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.701 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.701 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.701 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.701 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.701 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.701 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.701 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.701 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.701 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.701 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.701 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.701 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.701 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.702 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.702 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.702 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.702 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.702 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.702 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.702 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.702 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.702 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.702 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.702 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.702 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.702 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.702 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.702 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.703 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.703 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.703 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.703 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.703 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.703 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.703 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.703 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.703 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.703 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.703 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.703 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.703 INFO:teuthology.orchestra.run.smithi012.stdout: "roption1": { 2024-09-05T01:41:55.703 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption1", 2024-09-05T01:41:55.703 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.704 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.704 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.704 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.704 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.704 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.704 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.704 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.704 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.704 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.704 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.704 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.704 INFO:teuthology.orchestra.run.smithi012.stdout: "roption2": { 2024-09-05T01:41:55.705 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption2", 2024-09-05T01:41:55.705 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.705 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.705 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.705 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "xyz", 2024-09-05T01:41:55.705 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.705 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.705 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.705 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.705 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.705 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.705 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.705 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.705 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption1": { 2024-09-05T01:41:55.705 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption1", 2024-09-05T01:41:55.706 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.706 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.706 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.706 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.706 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.706 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.706 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.706 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.706 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.706 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.706 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.706 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.706 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption2": { 2024-09-05T01:41:55.706 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption2", 2024-09-05T01:41:55.707 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.707 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.707 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.707 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.707 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.707 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.707 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.707 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.707 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.707 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.707 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.707 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.707 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption3": { 2024-09-05T01:41:55.707 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption3", 2024-09-05T01:41:55.708 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-05T01:41:55.708 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.708 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.708 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.708 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.708 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.708 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.708 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.708 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.708 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.708 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.708 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.708 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption4": { 2024-09-05T01:41:55.709 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption4", 2024-09-05T01:41:55.709 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.709 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.709 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.709 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.709 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.709 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.709 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.709 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.709 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.709 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.709 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.709 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.710 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption5": { 2024-09-05T01:41:55.710 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption5", 2024-09-05T01:41:55.710 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.710 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.710 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.710 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.710 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.710 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.710 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.710 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.710 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.710 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.710 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.710 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.711 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption6": { 2024-09-05T01:41:55.711 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption6", 2024-09-05T01:41:55.711 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.711 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.711 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.711 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.711 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.711 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.711 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.711 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.711 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.711 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.711 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.712 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.712 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption7": { 2024-09-05T01:41:55.712 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption7", 2024-09-05T01:41:55.712 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.712 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.712 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.712 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.712 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-05T01:41:55.712 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "42", 2024-09-05T01:41:55.712 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.712 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.712 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.712 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.712 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.713 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.713 INFO:teuthology.orchestra.run.smithi012.stdout: "testkey": { 2024-09-05T01:41:55.713 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testkey", 2024-09-05T01:41:55.713 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.713 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.713 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.713 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.713 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.713 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.713 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.713 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.713 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.713 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.714 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.714 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.714 INFO:teuthology.orchestra.run.smithi012.stdout: "testlkey": { 2024-09-05T01:41:55.714 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testlkey", 2024-09-05T01:41:55.714 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.714 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.714 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.714 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.714 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.714 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.714 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.714 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.714 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.715 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.715 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.715 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.715 INFO:teuthology.orchestra.run.smithi012.stdout: "testnewline": { 2024-09-05T01:41:55.715 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testnewline", 2024-09-05T01:41:55.715 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.715 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.715 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.715 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.715 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.715 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.715 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.715 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.715 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.716 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.716 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.716 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.716 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.716 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.716 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.716 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snap_schedule", 2024-09-05T01:41:55.716 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.716 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.716 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.716 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_m_granularity": { 2024-09-05T01:41:55.716 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_m_granularity", 2024-09-05T01:41:55.716 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.717 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.717 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.717 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.717 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.717 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.717 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.717 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow minute scheduled snapshots", 2024-09-05T01:41:55.717 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.717 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.717 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.717 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.717 INFO:teuthology.orchestra.run.smithi012.stdout: "dump_on_update": { 2024-09-05T01:41:55.717 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dump_on_update", 2024-09-05T01:41:55.718 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.718 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.718 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.718 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.718 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.718 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.718 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.718 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "dump database to debug log on update", 2024-09-05T01:41:55.718 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.718 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.718 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.718 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.718 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.718 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.719 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.719 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.719 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.719 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.719 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.719 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.719 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.719 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.719 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.719 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.719 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.719 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.719 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.720 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.720 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.720 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.720 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.720 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.720 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.720 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.720 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.720 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.720 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.720 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.720 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.720 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.721 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.721 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.721 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.721 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.721 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.721 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.721 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.721 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.721 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.721 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.721 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.721 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.721 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.722 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.722 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.722 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.722 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.722 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.722 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.722 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.722 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.722 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.722 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.722 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.722 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.722 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.723 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.723 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.723 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.723 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.723 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.723 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.723 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.723 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.723 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.723 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.723 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.723 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.723 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.723 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.723 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.724 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.724 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.724 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.724 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.724 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stats", 2024-09-05T01:41:55.724 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.724 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.724 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.724 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.724 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.724 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.724 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.725 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.725 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.725 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.725 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.725 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.725 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.725 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.725 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.725 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.725 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.725 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.725 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.725 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.726 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.726 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.726 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.726 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.726 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.726 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.726 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.726 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.726 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.726 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.726 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.726 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.726 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.726 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.727 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.727 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.727 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.727 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.727 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.727 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.727 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.727 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.727 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.727 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.727 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.727 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.727 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.727 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.728 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.728 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.728 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.728 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.728 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.728 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.728 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.728 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.728 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.728 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.728 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.728 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.728 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.728 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.729 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.729 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.729 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.729 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.729 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.729 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.729 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.729 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.729 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.729 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.729 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.729 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.729 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.730 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.730 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "status", 2024-09-05T01:41:55.730 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.730 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.730 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.730 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.730 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.730 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.730 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.730 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.730 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.730 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.730 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.731 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.731 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.731 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.731 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.731 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.731 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.731 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.731 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.731 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.731 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.731 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.731 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.731 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.731 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.731 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.732 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.732 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.732 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.732 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.732 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.732 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.732 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.732 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.732 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.732 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.732 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.732 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.732 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.732 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.733 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.733 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.733 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.733 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.733 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.733 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.733 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.733 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.733 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.733 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.733 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.733 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.733 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.733 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.734 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.734 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.734 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.734 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.734 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.734 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.734 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.734 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.734 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.734 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.734 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.734 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.734 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.735 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.735 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.735 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.735 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.735 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.735 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.735 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.735 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.735 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.735 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telegraf", 2024-09-05T01:41:55.735 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.735 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.735 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.735 INFO:teuthology.orchestra.run.smithi012.stdout: "address": { 2024-09-05T01:41:55.735 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "address", 2024-09-05T01:41:55.736 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.736 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.736 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.736 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-05T01:41:55.736 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.736 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.736 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.736 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.736 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.736 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.736 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.736 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.736 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-05T01:41:55.736 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-05T01:41:55.737 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.737 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.737 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.737 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15", 2024-09-05T01:41:55.737 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.737 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.737 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.737 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.737 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.737 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.737 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.737 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.737 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.738 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.738 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.738 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.738 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.738 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.738 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.738 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.738 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.738 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.738 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.738 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.738 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.738 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.739 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.739 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.739 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.739 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.739 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.739 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.739 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.739 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.739 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.739 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.739 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.739 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.739 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.740 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.740 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.740 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.740 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.740 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.740 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.740 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.740 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.740 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.740 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.740 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.740 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.740 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.741 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.741 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.741 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.741 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.741 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.741 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.741 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.741 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.741 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.741 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.741 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.741 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.741 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.741 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.742 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.742 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.742 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.742 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.742 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.742 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.742 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.742 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.742 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.742 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.742 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.742 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.742 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.743 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.743 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.743 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.743 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.743 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.743 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.743 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telemetry", 2024-09-05T01:41:55.743 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.743 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.743 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.743 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_basic": { 2024-09-05T01:41:55.743 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_basic", 2024-09-05T01:41:55.743 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.744 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.744 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.744 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.744 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.744 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.744 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.744 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-05T01:41:55.744 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.744 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.744 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.744 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.744 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_crash": { 2024-09-05T01:41:55.744 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_crash", 2024-09-05T01:41:55.745 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.745 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.745 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.745 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.745 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.745 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.745 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.745 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-05T01:41:55.745 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.745 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.745 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.745 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.745 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_device": { 2024-09-05T01:41:55.745 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_device", 2024-09-05T01:41:55.746 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.746 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.746 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.746 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.746 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.746 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.746 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.746 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-05T01:41:55.746 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.746 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.746 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.746 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.746 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_ident": { 2024-09-05T01:41:55.746 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_ident", 2024-09-05T01:41:55.747 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.747 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.747 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.747 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.747 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.747 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.747 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.747 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-05T01:41:55.747 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.747 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.747 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.747 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.747 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_perf": { 2024-09-05T01:41:55.747 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_perf", 2024-09-05T01:41:55.748 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.748 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.748 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.748 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.748 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.748 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.748 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.748 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-05T01:41:55.748 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.748 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.748 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.748 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.749 INFO:teuthology.orchestra.run.smithi012.stdout: "contact": { 2024-09-05T01:41:55.749 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "contact", 2024-09-05T01:41:55.749 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.749 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.749 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.749 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.749 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.749 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.749 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.749 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.749 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.749 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.749 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.749 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.750 INFO:teuthology.orchestra.run.smithi012.stdout: "description": { 2024-09-05T01:41:55.750 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "description", 2024-09-05T01:41:55.750 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.750 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.750 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.750 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.750 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.750 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.750 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.750 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.750 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.750 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.750 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.750 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.751 INFO:teuthology.orchestra.run.smithi012.stdout: "device_url": { 2024-09-05T01:41:55.751 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_url", 2024-09-05T01:41:55.751 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.751 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.751 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.751 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-05T01:41:55.751 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.751 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.751 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.751 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.751 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.751 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.751 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.752 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.752 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-09-05T01:41:55.752 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-09-05T01:41:55.752 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.752 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.752 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.752 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.752 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.752 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.752 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.752 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.752 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.753 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.753 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.753 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.753 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-05T01:41:55.753 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-05T01:41:55.753 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.753 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.753 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.753 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "24", 2024-09-05T01:41:55.753 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "8", 2024-09-05T01:41:55.753 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.753 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.753 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.753 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.754 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.754 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.754 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.754 INFO:teuthology.orchestra.run.smithi012.stdout: "last_opt_revision": { 2024-09-05T01:41:55.754 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "last_opt_revision", 2024-09-05T01:41:55.754 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.754 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.754 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.754 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1", 2024-09-05T01:41:55.754 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.754 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.754 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.754 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.754 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.755 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.755 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.755 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.755 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard": { 2024-09-05T01:41:55.755 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard", 2024-09-05T01:41:55.755 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.755 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.755 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.755 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.755 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.755 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.755 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.755 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.755 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.756 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.756 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.756 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.756 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard_description": { 2024-09-05T01:41:55.756 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard_description", 2024-09-05T01:41:55.756 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.756 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.756 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.756 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.756 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.756 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.756 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.756 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.756 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.757 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.757 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.757 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.757 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.757 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.757 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.757 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.757 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.757 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.757 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.757 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.757 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.758 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.758 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.758 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.758 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.758 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.758 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.758 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.758 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.758 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.758 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.758 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.758 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.758 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.758 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.759 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.759 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.759 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.759 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.759 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.759 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.759 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.759 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.759 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.759 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.759 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.759 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.759 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.760 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.760 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.760 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.760 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.760 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.760 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.760 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.760 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.760 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.760 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.760 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.760 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.760 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.761 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.761 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.761 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.761 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.761 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.761 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.761 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.761 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.761 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.761 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.761 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.761 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.761 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.761 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.762 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.762 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.762 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.762 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.762 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.762 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.762 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.762 INFO:teuthology.orchestra.run.smithi012.stdout: "organization": { 2024-09-05T01:41:55.762 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "organization", 2024-09-05T01:41:55.762 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.762 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.762 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.762 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.762 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.763 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.763 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.763 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.763 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.763 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.763 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.763 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.763 INFO:teuthology.orchestra.run.smithi012.stdout: "proxy": { 2024-09-05T01:41:55.763 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "proxy", 2024-09-05T01:41:55.763 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.763 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.763 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.763 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.763 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.764 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.764 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.764 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.764 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.764 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.764 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.764 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.764 INFO:teuthology.orchestra.run.smithi012.stdout: "url": { 2024-09-05T01:41:55.764 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url", 2024-09-05T01:41:55.764 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.764 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.764 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.764 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-05T01:41:55.764 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.765 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.765 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.765 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.765 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.765 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.765 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.765 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.765 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.765 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.765 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.765 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "test_orchestrator", 2024-09-05T01:41:55.765 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.766 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.766 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.766 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.766 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.766 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.766 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.766 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.766 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.766 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.766 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.766 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.766 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.766 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.766 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.767 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.767 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.767 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.767 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.767 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.767 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.767 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.767 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.767 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.767 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.767 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.767 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.767 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.767 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.768 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.768 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.768 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.768 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.768 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.768 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.768 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.768 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.768 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.768 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.768 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.769 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.769 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.769 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.769 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.769 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.769 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.769 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.769 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.769 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.769 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.769 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.769 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.769 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.770 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.770 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.770 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.770 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.770 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.770 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.770 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.770 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.770 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.770 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.770 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.770 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.770 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.771 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.771 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.771 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.771 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.771 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.771 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.771 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.771 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.771 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.771 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.771 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2024-09-05T01:41:55.771 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.771 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.772 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.772 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.772 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.772 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.772 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.772 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.772 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.772 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.772 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.772 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.772 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.772 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.772 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.773 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.773 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.773 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.773 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.773 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.773 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.773 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.773 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.773 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.773 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.773 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.773 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.773 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.773 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.774 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.774 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.774 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.774 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.774 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.774 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.774 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.774 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.774 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.774 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.774 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.774 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.774 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.774 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.775 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.775 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.775 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.775 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.775 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.775 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.775 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.775 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.775 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.775 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.775 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.775 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.775 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.775 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.776 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.776 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.776 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.776 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.776 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.776 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.776 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.776 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.776 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.776 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.776 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.776 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.776 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.776 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.777 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.777 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.777 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_clones": { 2024-09-05T01:41:55.777 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_clones", 2024-09-05T01:41:55.777 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.777 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.777 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.777 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4", 2024-09-05T01:41:55.777 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.777 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.777 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.777 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-05T01:41:55.777 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.777 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.778 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.778 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.778 INFO:teuthology.orchestra.run.smithi012.stdout: "periodic_async_work": { 2024-09-05T01:41:55.778 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "periodic_async_work", 2024-09-05T01:41:55.778 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.778 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.778 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.778 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.778 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.778 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.778 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.778 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Periodically check for async work", 2024-09-05T01:41:55.778 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.779 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.779 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.779 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.779 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_delay": { 2024-09-05T01:41:55.779 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_delay", 2024-09-05T01:41:55.779 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.779 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.779 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.779 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-05T01:41:55.779 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.779 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.779 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.779 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-05T01:41:55.780 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.780 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.780 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.780 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.780 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_no_wait": { 2024-09-05T01:41:55.780 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_no_wait", 2024-09-05T01:41:55.780 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.780 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.780 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.780 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.780 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.780 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.780 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.781 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-05T01:41:55.781 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.781 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.781 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.781 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.781 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.781 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.781 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix", 2024-09-05T01:41:55.781 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.781 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.781 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.781 INFO:teuthology.orchestra.run.smithi012.stdout: "discovery_interval": { 2024-09-05T01:41:55.781 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "discovery_interval", 2024-09-05T01:41:55.782 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-05T01:41:55.782 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.782 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.782 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "100", 2024-09-05T01:41:55.782 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.782 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.782 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.782 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.782 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.782 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.782 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.782 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.783 INFO:teuthology.orchestra.run.smithi012.stdout: "identifier": { 2024-09-05T01:41:55.783 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "identifier", 2024-09-05T01:41:55.783 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.783 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.783 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.783 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.783 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.783 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.783 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.783 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.783 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.783 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.783 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.783 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.783 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-05T01:41:55.784 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-05T01:41:55.784 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.784 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.784 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.784 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-05T01:41:55.784 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.784 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.784 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.784 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.784 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.784 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.784 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.784 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.785 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.785 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.785 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.785 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.785 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.785 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.785 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.785 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.785 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.785 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.785 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.785 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.785 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.785 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.786 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.786 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.786 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.786 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.786 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.786 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.786 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.786 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.786 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.786 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.786 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.786 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.786 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.786 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.787 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.787 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.787 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.787 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.787 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.787 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.787 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.787 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.787 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.787 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.787 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.787 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.787 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.787 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.787 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.788 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.788 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.788 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.788 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.788 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.788 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.788 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.788 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.788 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.788 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.788 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.788 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.788 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.789 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.789 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.789 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.789 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.789 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.789 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.789 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.789 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.789 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.789 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.789 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.789 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.789 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.789 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.790 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_host": { 2024-09-05T01:41:55.790 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_host", 2024-09-05T01:41:55.790 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.790 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.790 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.790 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.790 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.790 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.790 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.790 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.790 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.790 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.790 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.791 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_port": { 2024-09-05T01:41:55.791 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_port", 2024-09-05T01:41:55.791 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.791 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.791 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.791 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10051", 2024-09-05T01:41:55.791 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.791 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.791 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.791 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.791 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.791 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.792 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.792 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.792 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_sender": { 2024-09-05T01:41:55.792 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_sender", 2024-09-05T01:41:55.792 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.792 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.792 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.792 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-05T01:41:55.792 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.792 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.792 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.792 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.792 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.792 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.793 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.793 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.793 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.793 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.793 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-05T01:41:55.793 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.793 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.793 INFO:teuthology.orchestra.run.smithi012.stdout: "modules": [ 2024-09-05T01:41:55.793 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm", 2024-09-05T01:41:55.793 INFO:teuthology.orchestra.run.smithi012.stdout: "dashboard", 2024-09-05T01:41:55.793 INFO:teuthology.orchestra.run.smithi012.stdout: "iostat", 2024-09-05T01:41:55.793 INFO:teuthology.orchestra.run.smithi012.stdout: "nfs", 2024-09-05T01:41:55.793 INFO:teuthology.orchestra.run.smithi012.stdout: "restful", 2024-09-05T01:41:55.793 INFO:teuthology.orchestra.run.smithi012.stdout: "snap_schedule" 2024-09-05T01:41:55.794 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.794 INFO:teuthology.orchestra.run.smithi012.stdout: "available_modules": [ 2024-09-05T01:41:55.794 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.794 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "alerts", 2024-09-05T01:41:55.794 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.794 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.794 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.794 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-05T01:41:55.794 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-05T01:41:55.794 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.794 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.794 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.795 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-05T01:41:55.795 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.795 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.795 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.795 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How frequently to reexamine health status", 2024-09-05T01:41:55.795 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.795 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.795 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.795 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.795 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.795 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.795 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.795 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.796 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.796 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.796 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.796 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.796 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.796 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.796 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.796 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.796 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.796 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.796 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.796 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.796 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.797 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.797 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.797 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.797 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.797 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.797 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.797 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.797 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.797 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.797 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.797 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.797 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.797 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.798 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.798 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.798 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.798 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.798 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.798 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.798 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.798 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.798 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.798 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.798 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.798 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.798 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.799 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.799 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.799 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.799 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.799 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.799 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.799 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.799 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.799 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.799 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.799 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.799 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.800 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.800 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.800 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.800 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.800 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.800 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.800 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.800 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.800 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.800 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.800 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.800 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.800 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.801 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_destination": { 2024-09-05T01:41:55.801 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_destination", 2024-09-05T01:41:55.801 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.801 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.801 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.801 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.801 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.801 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.801 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.801 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email address to send alerts to", 2024-09-05T01:41:55.801 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.802 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.802 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.802 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_from_name": { 2024-09-05T01:41:55.802 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_from_name", 2024-09-05T01:41:55.802 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.802 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.802 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.802 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "Ceph", 2024-09-05T01:41:55.802 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.802 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.802 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.802 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Email From: name", 2024-09-05T01:41:55.802 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.803 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.803 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.803 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.803 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_host": { 2024-09-05T01:41:55.803 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_host", 2024-09-05T01:41:55.803 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.803 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.803 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.803 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.803 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.803 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.803 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.803 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP server", 2024-09-05T01:41:55.804 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.804 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.804 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.804 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_password": { 2024-09-05T01:41:55.804 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_password", 2024-09-05T01:41:55.804 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.804 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.804 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.804 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.804 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.804 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.804 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.805 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Password to authenticate with", 2024-09-05T01:41:55.805 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.805 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.805 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.805 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.805 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_port": { 2024-09-05T01:41:55.805 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_port", 2024-09-05T01:41:55.805 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.805 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.805 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.805 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "465", 2024-09-05T01:41:55.805 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.805 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.806 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.806 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP port", 2024-09-05T01:41:55.806 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.806 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.806 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.806 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.806 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_sender": { 2024-09-05T01:41:55.806 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_sender", 2024-09-05T01:41:55.806 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.806 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.806 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.806 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.806 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.806 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.807 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.807 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SMTP envelope sender", 2024-09-05T01:41:55.807 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.807 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.807 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.807 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_ssl": { 2024-09-05T01:41:55.807 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_ssl", 2024-09-05T01:41:55.807 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.807 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.807 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.807 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.807 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.808 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.808 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.808 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-05T01:41:55.808 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.808 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.808 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.808 INFO:teuthology.orchestra.run.smithi012.stdout: "smtp_user": { 2024-09-05T01:41:55.808 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "smtp_user", 2024-09-05T01:41:55.808 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.808 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.808 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.808 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.809 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.809 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.809 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.809 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "User to authenticate as", 2024-09-05T01:41:55.809 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.809 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.809 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.809 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.809 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.809 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.809 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "balancer", 2024-09-05T01:41:55.809 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.809 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.810 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.810 INFO:teuthology.orchestra.run.smithi012.stdout: "active": { 2024-09-05T01:41:55.810 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "active", 2024-09-05T01:41:55.810 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.810 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.810 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.810 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.810 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.810 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.810 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.810 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically balance PGs across cluster", 2024-09-05T01:41:55.810 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.810 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.811 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.811 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_time": { 2024-09-05T01:41:55.811 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_time", 2024-09-05T01:41:55.811 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.811 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.811 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.811 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0000", 2024-09-05T01:41:55.811 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.811 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.811 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.811 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "beginning time of day to automatically balance", 2024-09-05T01:41:55.811 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-05T01:41:55.811 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.812 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.812 INFO:teuthology.orchestra.run.smithi012.stdout: "begin_weekday": { 2024-09-05T01:41:55.812 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "begin_weekday", 2024-09-05T01:41:55.812 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-05T01:41:55.812 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.812 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.812 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-05T01:41:55.812 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-09-05T01:41:55.812 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-09-05T01:41:55.812 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.812 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-05T01:41:55.813 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-05T01:41:55.813 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.813 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.813 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_max_iterations": { 2024-09-05T01:41:55.813 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_max_iterations", 2024-09-05T01:41:55.813 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-05T01:41:55.813 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.813 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.813 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "25", 2024-09-05T01:41:55.813 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-05T01:41:55.813 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "250", 2024-09-05T01:41:55.813 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.814 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-05T01:41:55.814 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.814 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.814 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.814 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_metrics": { 2024-09-05T01:41:55.814 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_metrics", 2024-09-05T01:41:55.814 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.814 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.814 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.814 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "pgs,objects,bytes", 2024-09-05T01:41:55.814 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.814 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.814 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.815 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-05T01:41:55.815 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-05T01:41:55.815 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.815 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.815 INFO:teuthology.orchestra.run.smithi012.stdout: "crush_compat_step": { 2024-09-05T01:41:55.815 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crush_compat_step", 2024-09-05T01:41:55.815 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-05T01:41:55.815 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.815 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.815 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.5", 2024-09-05T01:41:55.815 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0.001", 2024-09-05T01:41:55.815 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "0.999", 2024-09-05T01:41:55.816 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.816 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "aggressiveness of optimization", 2024-09-05T01:41:55.816 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-05T01:41:55.816 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.816 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.816 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.816 INFO:teuthology.orchestra.run.smithi012.stdout: "end_time": { 2024-09-05T01:41:55.816 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_time", 2024-09-05T01:41:55.816 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.816 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.816 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.816 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2359", 2024-09-05T01:41:55.817 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.817 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.817 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.817 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ending time of day to automatically balance", 2024-09-05T01:41:55.817 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-05T01:41:55.817 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.817 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.817 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.817 INFO:teuthology.orchestra.run.smithi012.stdout: "end_weekday": { 2024-09-05T01:41:55.817 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "end_weekday", 2024-09-05T01:41:55.817 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-05T01:41:55.817 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.817 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.817 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-05T01:41:55.818 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "0", 2024-09-05T01:41:55.818 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "6", 2024-09-05T01:41:55.818 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.818 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-05T01:41:55.818 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-05T01:41:55.818 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.818 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.818 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.818 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.818 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.818 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.818 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.818 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.819 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.819 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.819 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.819 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.819 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.819 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.819 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.819 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.819 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.819 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.819 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.819 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.820 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.820 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.820 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.820 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.820 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.820 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.820 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.820 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.820 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.820 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.820 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.820 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.821 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.821 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.821 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.821 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.821 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.821 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.821 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.821 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.821 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.821 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.821 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.821 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.822 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.822 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.822 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.822 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.822 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.822 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.822 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.822 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.822 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.822 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.822 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.822 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.822 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.822 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.823 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.823 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.823 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.823 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.823 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.823 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.823 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.823 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.823 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.823 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.823 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.823 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.823 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.824 INFO:teuthology.orchestra.run.smithi012.stdout: "min_score": { 2024-09-05T01:41:55.824 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_score", 2024-09-05T01:41:55.824 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-05T01:41:55.824 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.824 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.824 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-05T01:41:55.824 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.824 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.824 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.824 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-05T01:41:55.824 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.824 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.824 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.825 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-09-05T01:41:55.825 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-09-05T01:41:55.825 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.825 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.825 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.825 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "upmap", 2024-09-05T01:41:55.825 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.825 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.825 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.825 INFO:teuthology.orchestra.run.smithi012.stdout: "crush-compat", 2024-09-05T01:41:55.825 INFO:teuthology.orchestra.run.smithi012.stdout: "none", 2024-09-05T01:41:55.826 INFO:teuthology.orchestra.run.smithi012.stdout: "read", 2024-09-05T01:41:55.826 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap", 2024-09-05T01:41:55.826 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap-read" 2024-09-05T01:41:55.826 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.826 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Balancer mode", 2024-09-05T01:41:55.826 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.826 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.826 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.826 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.826 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_ids": { 2024-09-05T01:41:55.826 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_ids", 2024-09-05T01:41:55.826 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.826 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.827 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.827 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.827 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.827 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.827 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.827 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-05T01:41:55.827 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.827 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.827 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.827 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.827 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-05T01:41:55.827 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-05T01:41:55.827 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.827 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.828 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.828 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-05T01:41:55.828 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.828 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.828 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.828 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-05T01:41:55.828 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.828 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.828 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.828 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_deviation": { 2024-09-05T01:41:55.828 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_deviation", 2024-09-05T01:41:55.828 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.829 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.829 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.829 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-05T01:41:55.829 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-05T01:41:55.829 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.829 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.829 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-05T01:41:55.829 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-05T01:41:55.829 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.829 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.829 INFO:teuthology.orchestra.run.smithi012.stdout: "upmap_max_optimizations": { 2024-09-05T01:41:55.829 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "upmap_max_optimizations", 2024-09-05T01:41:55.830 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-05T01:41:55.830 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.830 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.830 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-05T01:41:55.830 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.830 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.830 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.830 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-05T01:41:55.830 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.830 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.830 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.830 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.830 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.831 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.831 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm", 2024-09-05T01:41:55.831 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.831 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.831 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.831 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_down_multiplier": { 2024-09-05T01:41:55.831 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_down_multiplier", 2024-09-05T01:41:55.831 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-05T01:41:55.831 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.831 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.831 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-09-05T01:41:55.831 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.831 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.832 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.832 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-05T01:41:55.832 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.832 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.832 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.832 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.832 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_refresh_rate": { 2024-09-05T01:41:55.832 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_refresh_rate", 2024-09-05T01:41:55.832 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.832 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.832 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.832 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "20", 2024-09-05T01:41:55.832 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.832 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.833 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.833 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-05T01:41:55.833 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.833 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.833 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.833 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.833 INFO:teuthology.orchestra.run.smithi012.stdout: "agent_starting_port": { 2024-09-05T01:41:55.833 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "agent_starting_port", 2024-09-05T01:41:55.833 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.833 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.833 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.833 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4721", 2024-09-05T01:41:55.833 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.834 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.834 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.834 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-05T01:41:55.834 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.834 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.834 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.834 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.834 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_ptrace": { 2024-09-05T01:41:55.834 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_ptrace", 2024-09-05T01:41:55.834 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.834 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.834 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.834 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.835 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.835 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.835 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.835 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-05T01:41:55.835 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-05T01:41:55.835 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.835 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.835 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_interval": { 2024-09-05T01:41:55.835 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_interval", 2024-09-05T01:41:55.835 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.835 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.835 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.836 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-05T01:41:55.836 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.836 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.836 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.836 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-05T01:41:55.836 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.836 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.836 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.836 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.836 INFO:teuthology.orchestra.run.smithi012.stdout: "autotune_memory_target_ratio": { 2024-09-05T01:41:55.836 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "autotune_memory_target_ratio", 2024-09-05T01:41:55.836 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-05T01:41:55.836 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.836 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.837 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0.7", 2024-09-05T01:41:55.837 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.837 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.837 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.837 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-05T01:41:55.837 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.837 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.837 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.837 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm_log_destination": { 2024-09-05T01:41:55.837 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephadm_log_destination", 2024-09-05T01:41:55.837 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.837 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.838 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.838 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.838 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.838 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.838 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.838 INFO:teuthology.orchestra.run.smithi012.stdout: "file", 2024-09-05T01:41:55.838 INFO:teuthology.orchestra.run.smithi012.stdout: "file,syslog", 2024-09-05T01:41:55.838 INFO:teuthology.orchestra.run.smithi012.stdout: "syslog" 2024-09-05T01:41:55.838 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.838 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-05T01:41:55.838 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.838 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.838 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.838 INFO:teuthology.orchestra.run.smithi012.stdout: "cgroups_split": { 2024-09-05T01:41:55.839 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cgroups_split", 2024-09-05T01:41:55.839 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.839 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.839 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.839 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.839 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.839 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.839 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.839 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-05T01:41:55.839 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.839 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.839 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.839 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.839 INFO:teuthology.orchestra.run.smithi012.stdout: "config_checks_enabled": { 2024-09-05T01:41:55.840 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_checks_enabled", 2024-09-05T01:41:55.840 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.840 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.840 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.840 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.840 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.840 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.840 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.840 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-05T01:41:55.840 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.840 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.840 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.840 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.840 INFO:teuthology.orchestra.run.smithi012.stdout: "config_dashboard": { 2024-09-05T01:41:55.841 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_dashboard", 2024-09-05T01:41:55.841 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.841 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.841 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.841 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.841 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.841 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.841 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.841 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-05T01:41:55.841 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.841 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.841 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.841 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.842 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_alertmanager": { 2024-09-05T01:41:55.842 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_alertmanager", 2024-09-05T01:41:55.842 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.842 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.842 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.842 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-05T01:41:55.842 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.842 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.842 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.842 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-05T01:41:55.842 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.842 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.842 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.843 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_base": { 2024-09-05T01:41:55.843 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_base", 2024-09-05T01:41:55.843 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.843 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.843 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.843 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-05T01:41:55.843 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.843 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.843 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.843 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Container image name, without the tag", 2024-09-05T01:41:55.843 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.843 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.843 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.843 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.844 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_elasticsearch": { 2024-09-05T01:41:55.844 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_elasticsearch", 2024-09-05T01:41:55.844 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.844 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.844 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.844 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-05T01:41:55.844 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.844 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.844 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.844 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "elasticsearch container image", 2024-09-05T01:41:55.844 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.844 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.845 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.845 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.845 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_grafana": { 2024-09-05T01:41:55.845 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_grafana", 2024-09-05T01:41:55.845 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.845 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.845 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.845 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-05T01:41:55.845 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.845 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.845 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.845 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-05T01:41:55.845 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.845 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.846 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.846 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.846 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_haproxy": { 2024-09-05T01:41:55.846 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_haproxy", 2024-09-05T01:41:55.846 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.846 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.846 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.846 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-05T01:41:55.846 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.846 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.846 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.846 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "HAproxy container image", 2024-09-05T01:41:55.846 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.847 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.847 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.847 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.847 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_agent": { 2024-09-05T01:41:55.847 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_agent", 2024-09-05T01:41:55.847 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.847 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.847 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.847 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-05T01:41:55.847 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.847 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.847 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.847 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger agent container image", 2024-09-05T01:41:55.847 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.848 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.848 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.848 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.848 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_collector": { 2024-09-05T01:41:55.848 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_collector", 2024-09-05T01:41:55.848 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.848 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.848 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.848 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-05T01:41:55.848 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.848 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.848 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.848 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger collector container image", 2024-09-05T01:41:55.848 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.849 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.849 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.849 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.849 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_jaeger_query": { 2024-09-05T01:41:55.849 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_jaeger_query", 2024-09-05T01:41:55.849 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.849 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.849 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.849 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-05T01:41:55.849 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.849 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.849 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.849 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Jaeger query container image", 2024-09-05T01:41:55.849 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.850 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.850 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.850 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_keepalived": { 2024-09-05T01:41:55.850 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_keepalived", 2024-09-05T01:41:55.850 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.850 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.850 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.850 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-05T01:41:55.850 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.850 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.850 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.850 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Keepalived container image", 2024-09-05T01:41:55.851 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.851 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.851 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.851 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.851 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_loki": { 2024-09-05T01:41:55.851 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_loki", 2024-09-05T01:41:55.851 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.851 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.851 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.851 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-05T01:41:55.851 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.851 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.851 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.851 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Loki container image", 2024-09-05T01:41:55.852 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.852 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.852 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.852 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.852 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_node_exporter": { 2024-09-05T01:41:55.852 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_node_exporter", 2024-09-05T01:41:55.852 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.852 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.852 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.852 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-05T01:41:55.852 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.852 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.853 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.853 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-05T01:41:55.853 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.853 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.853 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.853 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.853 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_nvmeof": { 2024-09-05T01:41:55.853 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_nvmeof", 2024-09-05T01:41:55.853 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.853 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.853 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.853 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-05T01:41:55.853 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.854 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.854 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.854 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Nvme-of container image", 2024-09-05T01:41:55.854 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.854 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.854 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.854 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.854 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_prometheus": { 2024-09-05T01:41:55.854 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_prometheus", 2024-09-05T01:41:55.854 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.854 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.854 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.854 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-05T01:41:55.855 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.855 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.855 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.855 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Prometheus container image", 2024-09-05T01:41:55.855 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.855 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.855 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.855 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.855 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_promtail": { 2024-09-05T01:41:55.855 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_promtail", 2024-09-05T01:41:55.855 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.855 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.855 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.855 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-05T01:41:55.856 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.856 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.856 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.856 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Promtail container image", 2024-09-05T01:41:55.856 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.856 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.856 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.856 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.856 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_samba": { 2024-09-05T01:41:55.856 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_samba", 2024-09-05T01:41:55.856 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.856 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.856 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.857 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-05T01:41:55.857 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.857 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.857 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.857 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Samba/SMB container image", 2024-09-05T01:41:55.857 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.857 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.857 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.857 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.857 INFO:teuthology.orchestra.run.smithi012.stdout: "container_image_snmp_gateway": { 2024-09-05T01:41:55.857 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_image_snmp_gateway", 2024-09-05T01:41:55.857 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.857 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.858 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.858 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-05T01:41:55.858 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.858 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.858 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.858 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "SNMP Gateway container image", 2024-09-05T01:41:55.858 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.858 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.858 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.858 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.858 INFO:teuthology.orchestra.run.smithi012.stdout: "container_init": { 2024-09-05T01:41:55.858 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "container_init", 2024-09-05T01:41:55.858 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.859 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.859 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.859 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.859 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.859 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.859 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.859 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Run podman/docker with `--init`", 2024-09-05T01:41:55.859 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.859 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.859 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.859 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.859 INFO:teuthology.orchestra.run.smithi012.stdout: "daemon_cache_timeout": { 2024-09-05T01:41:55.859 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "daemon_cache_timeout", 2024-09-05T01:41:55.860 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.860 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.860 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.860 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-05T01:41:55.860 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.860 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.860 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.860 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-05T01:41:55.860 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.860 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.860 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.860 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.860 INFO:teuthology.orchestra.run.smithi012.stdout: "default_cephadm_command_timeout": { 2024-09-05T01:41:55.861 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_cephadm_command_timeout", 2024-09-05T01:41:55.861 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.861 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.861 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.861 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "900", 2024-09-05T01:41:55.861 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.861 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.861 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.861 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-05T01:41:55.861 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.861 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.861 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.862 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.862 INFO:teuthology.orchestra.run.smithi012.stdout: "default_registry": { 2024-09-05T01:41:55.862 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "default_registry", 2024-09-05T01:41:55.862 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.862 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.862 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.862 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "docker.io", 2024-09-05T01:41:55.862 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.862 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.862 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.862 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-05T01:41:55.862 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.862 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.862 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.863 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.863 INFO:teuthology.orchestra.run.smithi012.stdout: "device_cache_timeout": { 2024-09-05T01:41:55.863 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_cache_timeout", 2024-09-05T01:41:55.863 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.863 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.863 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.863 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1800", 2024-09-05T01:41:55.863 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.863 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.863 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.863 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache device inventory", 2024-09-05T01:41:55.863 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.863 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.863 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.864 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.864 INFO:teuthology.orchestra.run.smithi012.stdout: "device_enhanced_scan": { 2024-09-05T01:41:55.864 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_enhanced_scan", 2024-09-05T01:41:55.864 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.864 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.864 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.864 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.864 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.864 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.864 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.864 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-05T01:41:55.864 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.864 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.865 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.865 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.865 INFO:teuthology.orchestra.run.smithi012.stdout: "facts_cache_timeout": { 2024-09-05T01:41:55.865 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "facts_cache_timeout", 2024-09-05T01:41:55.865 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.865 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.865 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.865 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-05T01:41:55.865 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.865 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.865 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.865 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "seconds to cache host facts data", 2024-09-05T01:41:55.865 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.866 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.866 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.866 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.866 INFO:teuthology.orchestra.run.smithi012.stdout: "grafana_dashboards_path": { 2024-09-05T01:41:55.866 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "grafana_dashboards_path", 2024-09-05T01:41:55.866 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.866 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.866 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.866 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-05T01:41:55.866 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.866 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.866 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.866 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-05T01:41:55.866 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.867 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.867 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.867 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.867 INFO:teuthology.orchestra.run.smithi012.stdout: "host_check_interval": { 2024-09-05T01:41:55.867 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "host_check_interval", 2024-09-05T01:41:55.867 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.867 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.867 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.867 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-05T01:41:55.867 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.867 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.867 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.867 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to perform a host check", 2024-09-05T01:41:55.867 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.867 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.868 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.868 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.868 INFO:teuthology.orchestra.run.smithi012.stdout: "hw_monitoring": { 2024-09-05T01:41:55.868 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hw_monitoring", 2024-09-05T01:41:55.868 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.868 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.868 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.868 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.868 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.868 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.868 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.868 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-05T01:41:55.868 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.869 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.869 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.869 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.869 INFO:teuthology.orchestra.run.smithi012.stdout: "inventory_list_all": { 2024-09-05T01:41:55.869 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "inventory_list_all", 2024-09-05T01:41:55.869 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.869 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.869 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.869 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.869 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.869 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.869 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.869 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-05T01:41:55.869 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.870 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.870 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.870 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.870 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.870 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.870 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.870 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.870 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.870 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.870 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.870 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.870 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.870 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.870 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.871 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.871 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.871 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.871 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.871 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.871 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.871 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.871 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.871 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.871 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.871 INFO:teuthology.orchestra.run.smithi012.stdout: "log_refresh_metadata": { 2024-09-05T01:41:55.871 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_refresh_metadata", 2024-09-05T01:41:55.871 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.871 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.872 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.872 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.872 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.872 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.872 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.872 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-05T01:41:55.872 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.872 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.872 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.872 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.872 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.872 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.872 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.872 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.873 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.873 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.873 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.873 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.873 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.873 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-05T01:41:55.873 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.873 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.873 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.873 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.873 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.873 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.873 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.873 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.874 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.874 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.874 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.874 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.874 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.874 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.874 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.874 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.874 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.874 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.874 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.874 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.874 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.875 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.875 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.875 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.875 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.875 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.875 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.875 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.875 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.875 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.875 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.875 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.875 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.875 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.875 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.876 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.876 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.876 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.876 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.876 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-05T01:41:55.876 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-05T01:41:55.876 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.876 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.876 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.876 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.876 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.876 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.877 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.877 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-05T01:41:55.877 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.877 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.877 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.877 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.877 INFO:teuthology.orchestra.run.smithi012.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-05T01:41:55.877 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-05T01:41:55.877 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.877 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.877 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.877 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "*", 2024-09-05T01:41:55.877 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.877 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.878 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.878 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-05T01:41:55.878 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.878 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.878 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.878 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.878 INFO:teuthology.orchestra.run.smithi012.stdout: "max_count_per_host": { 2024-09-05T01:41:55.878 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_count_per_host", 2024-09-05T01:41:55.878 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.878 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.878 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.878 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-05T01:41:55.878 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.879 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.879 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.879 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of daemons per service per host", 2024-09-05T01:41:55.879 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.879 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.879 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.879 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.879 INFO:teuthology.orchestra.run.smithi012.stdout: "max_osd_draining_count": { 2024-09-05T01:41:55.879 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_osd_draining_count", 2024-09-05T01:41:55.879 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.879 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.879 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.879 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-05T01:41:55.879 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.880 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.880 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.880 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-05T01:41:55.880 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.880 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.880 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.880 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.880 INFO:teuthology.orchestra.run.smithi012.stdout: "migration_current": { 2024-09-05T01:41:55.880 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "migration_current", 2024-09-05T01:41:55.880 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.880 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.880 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.880 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.881 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.881 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.881 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.881 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "internal - do not modify", 2024-09-05T01:41:55.881 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.881 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.881 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.881 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.881 INFO:teuthology.orchestra.run.smithi012.stdout: "mode": { 2024-09-05T01:41:55.881 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mode", 2024-09-05T01:41:55.881 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.881 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.881 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.882 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "root", 2024-09-05T01:41:55.882 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.882 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.882 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.882 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm-package", 2024-09-05T01:41:55.882 INFO:teuthology.orchestra.run.smithi012.stdout: "root" 2024-09-05T01:41:55.882 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.882 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "mode for remote execution of cephadm", 2024-09-05T01:41:55.882 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.882 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.882 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.882 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.882 INFO:teuthology.orchestra.run.smithi012.stdout: "oob_default_addr": { 2024-09-05T01:41:55.882 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "oob_default_addr", 2024-09-05T01:41:55.883 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.883 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.883 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.883 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "169.254.1.1", 2024-09-05T01:41:55.883 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.883 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.883 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.883 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-05T01:41:55.883 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.883 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.883 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.883 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.883 INFO:teuthology.orchestra.run.smithi012.stdout: "prometheus_alerts_path": { 2024-09-05T01:41:55.883 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus_alerts_path", 2024-09-05T01:41:55.883 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.884 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.884 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.884 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-05T01:41:55.884 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.884 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.884 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.884 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-05T01:41:55.884 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.884 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.884 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.884 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.884 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_insecure": { 2024-09-05T01:41:55.884 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_insecure", 2024-09-05T01:41:55.884 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.885 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.885 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.885 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.885 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.885 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.885 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.885 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-05T01:41:55.885 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.885 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.885 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.885 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.885 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_password": { 2024-09-05T01:41:55.885 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_password", 2024-09-05T01:41:55.885 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.886 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.886 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.886 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.886 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.886 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.886 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.886 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-05T01:41:55.886 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.886 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.886 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.886 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.886 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_url": { 2024-09-05T01:41:55.886 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_url", 2024-09-05T01:41:55.886 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.887 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.887 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.887 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.887 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.887 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.887 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.887 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-05T01:41:55.887 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.887 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.887 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.887 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.887 INFO:teuthology.orchestra.run.smithi012.stdout: "registry_username": { 2024-09-05T01:41:55.887 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "registry_username", 2024-09-05T01:41:55.887 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.887 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.888 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.888 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.888 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.888 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.888 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.888 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-05T01:41:55.888 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.888 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.888 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.888 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.888 INFO:teuthology.orchestra.run.smithi012.stdout: "secure_monitoring_stack": { 2024-09-05T01:41:55.888 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "secure_monitoring_stack", 2024-09-05T01:41:55.888 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.888 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.888 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.889 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.889 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.889 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.889 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.889 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-05T01:41:55.889 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.889 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.889 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.889 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.889 INFO:teuthology.orchestra.run.smithi012.stdout: "service_discovery_port": { 2024-09-05T01:41:55.889 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "service_discovery_port", 2024-09-05T01:41:55.889 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.889 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.890 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.890 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8765", 2024-09-05T01:41:55.890 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.890 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.890 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.890 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "cephadm service discovery port", 2024-09-05T01:41:55.890 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.890 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.890 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.890 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.890 INFO:teuthology.orchestra.run.smithi012.stdout: "ssh_config_file": { 2024-09-05T01:41:55.890 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssh_config_file", 2024-09-05T01:41:55.890 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.890 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.890 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.891 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.891 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.891 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.891 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.891 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-05T01:41:55.891 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.891 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.891 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.891 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.891 INFO:teuthology.orchestra.run.smithi012.stdout: "use_agent": { 2024-09-05T01:41:55.891 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_agent", 2024-09-05T01:41:55.891 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.891 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.892 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.892 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.892 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.892 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.892 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.892 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-05T01:41:55.892 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.892 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.892 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.892 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.892 INFO:teuthology.orchestra.run.smithi012.stdout: "use_repo_digest": { 2024-09-05T01:41:55.892 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "use_repo_digest", 2024-09-05T01:41:55.892 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.893 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.893 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.893 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.893 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.893 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.893 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.893 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-05T01:41:55.893 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.893 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.893 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.893 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.893 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_failed_host_check": { 2024-09-05T01:41:55.893 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_failed_host_check", 2024-09-05T01:41:55.894 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.894 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.894 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.894 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.894 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.894 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.894 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.894 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if the host check fails", 2024-09-05T01:41:55.894 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.894 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.894 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.894 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.894 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_daemons": { 2024-09-05T01:41:55.894 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_daemons", 2024-09-05T01:41:55.895 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.895 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.895 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.895 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.895 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.895 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.895 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.895 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-05T01:41:55.895 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.895 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.895 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.895 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.895 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_on_stray_hosts": { 2024-09-05T01:41:55.896 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_on_stray_hosts", 2024-09-05T01:41:55.896 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.896 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.896 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.896 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.896 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.896 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.896 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.896 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-05T01:41:55.896 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.896 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.896 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.897 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.897 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.897 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.897 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.897 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crash", 2024-09-05T01:41:55.897 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.897 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.897 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.897 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.897 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.897 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.897 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.897 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.897 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.898 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.898 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.898 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.898 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.898 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.898 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.898 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.898 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.898 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.898 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.898 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.898 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.898 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.898 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.899 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.899 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.899 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.899 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.899 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.899 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.899 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.899 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.899 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.899 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.899 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.899 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.899 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.899 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.900 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.900 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.900 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.900 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.900 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.900 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.900 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.900 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.900 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.900 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.900 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.900 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.901 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.901 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.901 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.901 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.901 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.901 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.901 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.901 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.901 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.901 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.901 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.901 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.901 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.901 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.902 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.902 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.902 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.902 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.902 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.902 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.902 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.902 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.902 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.902 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.902 INFO:teuthology.orchestra.run.smithi012.stdout: "retain_interval": { 2024-09-05T01:41:55.902 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retain_interval", 2024-09-05T01:41:55.902 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.902 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.903 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.903 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "31536000", 2024-09-05T01:41:55.903 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.903 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.903 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.903 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-05T01:41:55.903 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.903 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.903 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.903 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.903 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_recent_interval": { 2024-09-05T01:41:55.903 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_recent_interval", 2024-09-05T01:41:55.903 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.903 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.904 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.904 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1209600", 2024-09-05T01:41:55.904 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.904 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.904 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.904 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-05T01:41:55.904 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.904 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.904 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.904 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.904 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.904 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.904 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.904 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dashboard", 2024-09-05T01:41:55.904 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.905 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.905 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.905 INFO:teuthology.orchestra.run.smithi012.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-05T01:41:55.905 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-05T01:41:55.905 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.905 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.905 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.905 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-05T01:41:55.905 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.905 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.905 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.905 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.905 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.905 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.906 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.906 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_HOST": { 2024-09-05T01:41:55.906 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-05T01:41:55.906 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.906 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.906 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.906 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.906 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.906 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.906 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.906 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.906 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.906 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.907 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.907 INFO:teuthology.orchestra.run.smithi012.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-05T01:41:55.907 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-05T01:41:55.907 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.907 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.907 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.907 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.907 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.907 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.907 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.907 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.907 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.908 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.908 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.908 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_ENABLED": { 2024-09-05T01:41:55.908 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_ENABLED", 2024-09-05T01:41:55.908 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.908 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.908 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.908 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.908 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.908 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.908 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.908 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.908 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.908 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.909 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.909 INFO:teuthology.orchestra.run.smithi012.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-05T01:41:55.909 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-05T01:41:55.909 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.909 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.909 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.909 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.909 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.909 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.909 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.909 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.910 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.910 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.910 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.910 INFO:teuthology.orchestra.run.smithi012.stdout: "ENABLE_BROWSABLE_API": { 2024-09-05T01:41:55.910 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-05T01:41:55.910 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.910 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.910 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.910 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.910 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.910 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.910 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.910 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.910 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.911 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.911 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.911 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-05T01:41:55.911 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-05T01:41:55.911 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.911 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.911 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.911 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.911 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.911 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.911 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.911 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.911 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.912 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.912 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.912 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-05T01:41:55.912 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-05T01:41:55.912 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.912 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.912 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.912 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.912 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.912 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.912 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.912 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.913 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.913 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.913 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.913 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-05T01:41:55.913 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-05T01:41:55.913 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.913 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.913 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.913 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.913 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.913 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.913 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.913 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.913 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.914 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.914 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.914 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-05T01:41:55.914 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-05T01:41:55.914 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.914 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.914 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.914 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.914 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.914 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.914 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.914 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.914 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.915 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.915 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.915 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-05T01:41:55.915 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-05T01:41:55.915 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.915 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.915 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.915 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.915 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.915 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.915 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.915 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.915 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.916 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.916 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.916 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-05T01:41:55.916 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-05T01:41:55.916 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.916 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.916 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.916 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.916 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.916 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.916 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.916 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.916 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.917 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.917 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.917 INFO:teuthology.orchestra.run.smithi012.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-05T01:41:55.917 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-05T01:41:55.917 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.917 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.917 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.917 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.917 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.917 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.917 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.917 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.918 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.918 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.918 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.918 INFO:teuthology.orchestra.run.smithi012.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-05T01:41:55.918 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-05T01:41:55.918 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.918 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.918 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.918 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.918 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.918 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.918 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.919 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.919 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.919 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.919 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.919 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_PASSWORD": { 2024-09-05T01:41:55.919 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-05T01:41:55.919 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.919 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.919 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.919 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-05T01:41:55.919 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.919 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.919 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.920 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.920 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.920 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.920 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.920 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.920 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-05T01:41:55.920 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-05T01:41:55.920 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.920 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.920 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.920 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.920 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.920 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.921 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.921 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.921 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.921 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.921 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.921 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_URL": { 2024-09-05T01:41:55.921 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_URL", 2024-09-05T01:41:55.921 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.921 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.921 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.921 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.921 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.921 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.922 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.922 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.922 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.922 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.922 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.922 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.922 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_API_USERNAME": { 2024-09-05T01:41:55.922 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-05T01:41:55.922 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.922 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.922 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.922 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-05T01:41:55.922 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.922 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.923 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.923 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.923 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.923 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.923 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.923 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.923 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-05T01:41:55.923 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-05T01:41:55.923 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.923 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.923 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.923 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.923 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.924 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.924 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.924 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.924 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.924 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.924 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.924 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.924 INFO:teuthology.orchestra.run.smithi012.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-05T01:41:55.924 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-05T01:41:55.924 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.924 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.924 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.924 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.924 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.925 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.925 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.925 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.925 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.925 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.925 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.925 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.925 INFO:teuthology.orchestra.run.smithi012.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-05T01:41:55.925 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-05T01:41:55.925 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.925 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.925 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.925 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.926 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.926 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.926 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.926 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.926 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.926 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.926 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.926 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.926 INFO:teuthology.orchestra.run.smithi012.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-05T01:41:55.926 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-05T01:41:55.926 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.926 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.926 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.927 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.927 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.927 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.927 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.927 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.927 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.927 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.927 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.927 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.927 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_HOST": { 2024-09-05T01:41:55.927 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-05T01:41:55.927 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.927 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.927 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.927 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.928 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.928 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.928 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.928 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.928 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.928 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.928 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.928 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.928 INFO:teuthology.orchestra.run.smithi012.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-05T01:41:55.928 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-05T01:41:55.928 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.928 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.928 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.928 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.928 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.929 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.929 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.929 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.929 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.929 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.929 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.929 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.929 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-05T01:41:55.929 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-05T01:41:55.929 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.929 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.929 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.929 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.930 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.930 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.930 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.930 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.930 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.930 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.930 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.930 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.930 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-05T01:41:55.930 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-05T01:41:55.930 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.930 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.930 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.930 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.931 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.931 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.931 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.931 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.931 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.931 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.931 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.931 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.931 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-05T01:41:55.931 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-05T01:41:55.931 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.931 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.931 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.931 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.932 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.932 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.932 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.932 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.932 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.932 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.932 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.932 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.932 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-05T01:41:55.932 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-05T01:41:55.932 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.932 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.932 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.932 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.933 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.933 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.933 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.933 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.933 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.933 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.933 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.933 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.933 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-05T01:41:55.933 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-05T01:41:55.933 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.933 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.933 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.933 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.934 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.934 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.934 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.934 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.934 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.934 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.934 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.934 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.934 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-05T01:41:55.934 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-05T01:41:55.934 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.934 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.934 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.935 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.935 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.935 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.935 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.935 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.935 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.935 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.935 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.935 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.935 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-05T01:41:55.935 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-05T01:41:55.935 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.935 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.935 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.935 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.936 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.936 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.936 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.936 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.936 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.936 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.936 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.936 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.936 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_ENABLED": { 2024-09-05T01:41:55.936 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-05T01:41:55.936 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.936 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.936 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.936 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.937 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.937 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.937 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.937 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.937 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.937 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.937 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.937 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.937 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-05T01:41:55.937 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-05T01:41:55.937 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.937 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.937 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.938 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-05T01:41:55.938 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.938 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.938 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.938 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.938 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.938 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.938 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.938 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.938 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-05T01:41:55.938 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-05T01:41:55.938 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.938 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.939 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.939 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-05T01:41:55.939 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.939 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.939 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.939 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.939 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.939 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.939 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.939 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.939 INFO:teuthology.orchestra.run.smithi012.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-05T01:41:55.939 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-05T01:41:55.939 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.939 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.940 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.940 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8", 2024-09-05T01:41:55.940 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.940 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.940 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.940 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.940 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.940 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.940 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.940 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.940 INFO:teuthology.orchestra.run.smithi012.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-05T01:41:55.940 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-05T01:41:55.940 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.941 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.941 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.941 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "45", 2024-09-05T01:41:55.941 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.941 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.941 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.941 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.941 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.941 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.941 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.941 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.941 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ACCESS_KEY": { 2024-09-05T01:41:55.942 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-05T01:41:55.942 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.942 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.942 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.942 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.942 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.942 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.942 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.942 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.942 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.942 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.942 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.942 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.942 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-05T01:41:55.942 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-05T01:41:55.943 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.943 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.943 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.943 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "admin", 2024-09-05T01:41:55.943 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.943 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.943 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.943 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.943 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.943 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.943 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.943 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.943 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SECRET_KEY": { 2024-09-05T01:41:55.943 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-05T01:41:55.944 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.944 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.944 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.944 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.944 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.944 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.944 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.944 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.944 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.944 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.944 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.944 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.944 INFO:teuthology.orchestra.run.smithi012.stdout: "RGW_API_SSL_VERIFY": { 2024-09-05T01:41:55.944 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-05T01:41:55.945 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.945 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.945 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.945 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.945 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.945 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.945 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.945 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.945 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.945 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.945 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.945 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.946 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-05T01:41:55.946 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-05T01:41:55.946 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.946 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.946 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.946 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-05T01:41:55.946 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.946 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.946 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.946 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.946 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.946 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.946 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.946 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.947 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-05T01:41:55.947 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-05T01:41:55.947 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.947 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.947 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.947 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-05T01:41:55.947 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.947 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.947 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.947 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.947 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.947 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.947 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.947 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.948 INFO:teuthology.orchestra.run.smithi012.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-05T01:41:55.948 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-05T01:41:55.948 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.948 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.948 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.948 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-05T01:41:55.948 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.948 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.948 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.948 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.948 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.948 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.948 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.948 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.948 INFO:teuthology.orchestra.run.smithi012.stdout: "cross_origin_url": { 2024-09-05T01:41:55.949 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cross_origin_url", 2024-09-05T01:41:55.949 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.949 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.949 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.949 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.949 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.949 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.949 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.949 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.949 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.949 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.949 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.949 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.949 INFO:teuthology.orchestra.run.smithi012.stdout: "crt_file": { 2024-09-05T01:41:55.950 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "crt_file", 2024-09-05T01:41:55.950 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.950 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.950 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.950 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.950 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.950 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.950 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.950 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.950 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.950 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.950 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.950 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.951 INFO:teuthology.orchestra.run.smithi012.stdout: "debug": { 2024-09-05T01:41:55.951 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "debug", 2024-09-05T01:41:55.951 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.951 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.951 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.951 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.951 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.951 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.951 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.951 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Enable/disable debug options", 2024-09-05T01:41:55.951 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.951 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.951 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.951 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.952 INFO:teuthology.orchestra.run.smithi012.stdout: "jwt_token_ttl": { 2024-09-05T01:41:55.952 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "jwt_token_ttl", 2024-09-05T01:41:55.952 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.952 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.952 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.952 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "28800", 2024-09-05T01:41:55.952 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.952 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.952 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.952 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.952 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.952 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.952 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.953 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.953 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-09-05T01:41:55.953 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-09-05T01:41:55.953 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.953 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.953 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.953 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.953 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.953 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.953 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.953 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.953 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.953 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.953 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.954 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.954 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.954 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.954 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.954 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.954 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.954 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.954 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.954 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.954 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.954 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.954 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.954 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.955 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.955 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.955 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.955 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.955 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.955 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.955 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.955 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.955 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.955 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.955 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.955 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.955 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.955 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.955 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.956 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.956 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.956 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.956 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.956 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.956 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.956 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.956 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.956 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.956 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.956 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.956 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.956 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.956 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.957 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.957 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.957 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.957 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.957 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.957 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.957 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.957 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.957 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.957 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.957 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.957 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.957 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.957 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.957 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.958 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.958 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.958 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.958 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.958 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.958 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.958 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.958 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.958 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.958 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.958 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.958 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.959 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.959 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.959 INFO:teuthology.orchestra.run.smithi012.stdout: "motd": { 2024-09-05T01:41:55.959 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "motd", 2024-09-05T01:41:55.959 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.959 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.959 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.959 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.959 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.959 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.959 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.959 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "The message of the day", 2024-09-05T01:41:55.959 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.959 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.960 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.960 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.960 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect_resolve_ip_addr": { 2024-09-05T01:41:55.960 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "redirect_resolve_ip_addr", 2024-09-05T01:41:55.960 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.960 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.960 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.960 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.960 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.960 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.960 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.960 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.960 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.961 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.961 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.961 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.961 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-05T01:41:55.961 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-05T01:41:55.961 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.961 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.961 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.961 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-09-05T01:41:55.961 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.961 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.961 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.961 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.961 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.962 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.962 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.962 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.962 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-05T01:41:55.962 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-05T01:41:55.962 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.962 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.962 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.962 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8080", 2024-09-05T01:41:55.962 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.962 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.962 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.962 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.962 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.963 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.963 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.963 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.963 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-09-05T01:41:55.963 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-09-05T01:41:55.963 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.963 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.963 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.963 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.963 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.963 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.963 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.963 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.963 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.964 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.964 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.964 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.964 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl_server_port": { 2024-09-05T01:41:55.964 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl_server_port", 2024-09-05T01:41:55.964 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.964 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.964 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.964 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8443", 2024-09-05T01:41:55.964 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.964 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.964 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.964 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.964 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.965 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.965 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.965 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.965 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-09-05T01:41:55.965 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-09-05T01:41:55.965 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.965 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.965 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.965 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "redirect", 2024-09-05T01:41:55.965 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.965 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.965 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.965 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.965 INFO:teuthology.orchestra.run.smithi012.stdout: "redirect" 2024-09-05T01:41:55.966 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.966 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.966 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.966 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.966 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.966 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.966 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-09-05T01:41:55.966 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-09-05T01:41:55.966 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.966 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.966 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.966 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-09-05T01:41:55.966 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-09-05T01:41:55.966 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-09-05T01:41:55.967 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.967 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.967 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.967 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.967 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.967 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.967 INFO:teuthology.orchestra.run.smithi012.stdout: "url_prefix": { 2024-09-05T01:41:55.967 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url_prefix", 2024-09-05T01:41:55.967 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.967 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.967 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.967 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.967 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.967 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.967 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.968 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.968 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.968 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.968 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.968 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.968 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.968 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.968 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.968 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "devicehealth", 2024-09-05T01:41:55.968 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.968 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.968 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.968 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_monitoring": { 2024-09-05T01:41:55.969 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_monitoring", 2024-09-05T01:41:55.969 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.969 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.969 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.969 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.969 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.969 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.969 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.969 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "monitor device health metrics", 2024-09-05T01:41:55.969 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.969 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.969 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.969 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.970 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.970 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.970 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.970 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.970 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.970 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.970 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.970 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.970 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.970 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.970 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.970 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.970 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.970 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.970 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.970 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.971 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.971 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.971 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.971 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.971 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.971 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.971 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.971 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.971 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.971 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.971 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.971 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.972 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.972 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.972 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.972 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.972 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.972 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.972 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.972 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.972 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.972 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.972 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.972 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.972 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.973 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.973 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.973 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.973 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.973 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.973 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.973 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.973 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.973 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.973 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.973 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.973 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.973 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.973 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.974 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.974 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.974 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.974 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.974 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.974 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.974 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.974 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.974 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.974 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.974 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.974 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.974 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.974 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.975 INFO:teuthology.orchestra.run.smithi012.stdout: "mark_out_threshold": { 2024-09-05T01:41:55.975 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mark_out_threshold", 2024-09-05T01:41:55.975 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.975 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.975 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.975 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "2419200", 2024-09-05T01:41:55.975 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.975 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.975 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.975 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-05T01:41:55.975 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.975 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.975 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.975 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.976 INFO:teuthology.orchestra.run.smithi012.stdout: "pool_name": { 2024-09-05T01:41:55.976 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pool_name", 2024-09-05T01:41:55.976 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.976 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.976 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.976 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "device_health_metrics", 2024-09-05T01:41:55.976 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.976 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.976 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.976 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-05T01:41:55.976 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.976 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.976 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.977 INFO:teuthology.orchestra.run.smithi012.stdout: "retention_period": { 2024-09-05T01:41:55.977 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "retention_period", 2024-09-05T01:41:55.977 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.977 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.977 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.977 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15552000", 2024-09-05T01:41:55.977 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.977 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.977 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.977 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long to retain device health metrics", 2024-09-05T01:41:55.977 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.977 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.977 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.978 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_frequency": { 2024-09-05T01:41:55.978 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_frequency", 2024-09-05T01:41:55.978 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.978 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.978 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.978 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-09-05T01:41:55.978 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.978 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.978 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.978 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-05T01:41:55.978 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.978 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.978 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.979 INFO:teuthology.orchestra.run.smithi012.stdout: "self_heal": { 2024-09-05T01:41:55.979 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "self_heal", 2024-09-05T01:41:55.979 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.979 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.979 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.979 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:55.979 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.979 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.979 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.979 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-05T01:41:55.979 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.979 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.980 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.980 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-05T01:41:55.980 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-05T01:41:55.980 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.980 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.980 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.980 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-05T01:41:55.980 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.980 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.980 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.980 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how frequently to wake up and check device health", 2024-09-05T01:41:55.980 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: "warn_threshold": { 2024-09-05T01:41:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "warn_threshold", 2024-09-05T01:41:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7257600", 2024-09-05T01:41:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.981 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-05T01:41:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "diskprediction_local", 2024-09-05T01:41:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.982 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.983 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.985 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.986 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: "predict_interval": { 2024-09-05T01:41:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predict_interval", 2024-09-05T01:41:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.988 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.988 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.988 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "86400", 2024-09-05T01:41:55.988 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.988 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.988 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.988 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.988 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.988 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.988 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: "predictor_model": { 2024-09-05T01:41:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "predictor_model", 2024-09-05T01:41:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "prophetstor", 2024-09-05T01:41:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.989 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-05T01:41:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-05T01:41:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "600", 2024-09-05T01:41:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.990 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "influx", 2024-09-05T01:41:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": false, 2024-09-05T01:41:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "influxdb python module not found", 2024-09-05T01:41:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: "batch_size": { 2024-09-05T01:41:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "batch_size", 2024-09-05T01:41:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.991 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5000", 2024-09-05T01:41:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-05T01:41:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: "database": { 2024-09-05T01:41:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "database", 2024-09-05T01:41:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.992 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "ceph", 2024-09-05T01:41:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-05T01:41:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": { 2024-09-05T01:41:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "hostname", 2024-09-05T01:41:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.993 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server hostname", 2024-09-05T01:41:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-05T01:41:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-05T01:41:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:55.994 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "30", 2024-09-05T01:41:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "5", 2024-09-05T01:41:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-05T01:41:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:55.995 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.996 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.997 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:55.998 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:55.999 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.000 INFO:teuthology.orchestra.run.smithi012.stdout: "password": { 2024-09-05T01:41:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "password", 2024-09-05T01:41:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "password of InfluxDB server user", 2024-09-05T01:41:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.001 INFO:teuthology.orchestra.run.smithi012.stdout: "port": { 2024-09-05T01:41:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "port", 2024-09-05T01:41:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "8086", 2024-09-05T01:41:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "InfluxDB server port", 2024-09-05T01:41:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.002 INFO:teuthology.orchestra.run.smithi012.stdout: "ssl": { 2024-09-05T01:41:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ssl", 2024-09-05T01:41:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "false", 2024-09-05T01:41:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-05T01:41:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.003 INFO:teuthology.orchestra.run.smithi012.stdout: "threads": { 2024-09-05T01:41:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threads", 2024-09-05T01:41:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-05T01:41:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-05T01:41:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "32", 2024-09-05T01:41:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-05T01:41:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.004 INFO:teuthology.orchestra.run.smithi012.stdout: "username": { 2024-09-05T01:41:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "username", 2024-09-05T01:41:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "username of InfluxDB server user", 2024-09-05T01:41:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.005 INFO:teuthology.orchestra.run.smithi012.stdout: "verify_ssl": { 2024-09-05T01:41:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "verify_ssl", 2024-09-05T01:41:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "true", 2024-09-05T01:41:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-05T01:41:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.006 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "insights", 2024-09-05T01:41:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.007 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.010 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.011 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "iostat", 2024-09-05T01:41:56.012 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.013 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.014 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.015 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.016 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.017 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "k8sevents", 2024-09-05T01:41:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_event_retention_days": { 2024-09-05T01:41:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "ceph_event_retention_days", 2024-09-05T01:41:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:56.018 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "7", 2024-09-05T01:41:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-05T01:41:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: "config_check_secs": { 2024-09-05T01:41:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "config_check_secs", 2024-09-05T01:41:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:56.019 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-05T01:41:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "10", 2024-09-05T01:41:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-05T01:41:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.020 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.021 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.022 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.023 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.024 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.025 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "localpool", 2024-09-05T01:41:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: "failure_domain": { 2024-09-05T01:41:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "failure_domain", 2024-09-05T01:41:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "host", 2024-09-05T01:41:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.026 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "failure domain for any created local pool", 2024-09-05T01:41:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-05T01:41:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.027 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.028 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.029 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.030 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.031 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: "min_size": { 2024-09-05T01:41:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "min_size", 2024-09-05T01:41:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.032 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default min_size for any created local pool", 2024-09-05T01:41:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-05T01:41:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: "num_rep": { 2024-09-05T01:41:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "num_rep", 2024-09-05T01:41:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3", 2024-09-05T01:41:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.033 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default replica count for any created local pool", 2024-09-05T01:41:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_num": { 2024-09-05T01:41:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_num", 2024-09-05T01:41:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "128", 2024-09-05T01:41:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.034 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "default pg_num for any created local pool", 2024-09-05T01:41:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: "prefix": { 2024-09-05T01:41:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prefix", 2024-09-05T01:41:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.035 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "name prefix for any created local pool", 2024-09-05T01:41:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: "subtree": { 2024-09-05T01:41:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "subtree", 2024-09-05T01:41:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "rack", 2024-09-05T01:41:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.036 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-05T01:41:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-05T01:41:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mds_autoscaler", 2024-09-05T01:41:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.037 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.038 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.039 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.040 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.041 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.042 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirroring", 2024-09-05T01:41:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.043 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.044 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.045 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.045 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.045 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.045 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.045 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.045 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.045 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.045 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.045 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.045 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.045 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.045 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.045 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.046 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.047 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "nfs", 2024-09-05T01:41:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.048 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.049 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.051 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.052 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.053 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-09-05T01:41:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: "fail_fs": { 2024-09-05T01:41:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "fail_fs", 2024-09-05T01:41:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.054 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-05T01:41:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.055 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.056 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.057 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.058 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.059 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator": { 2024-09-05T01:41:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "orchestrator", 2024-09-05T01:41:56.060 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: "cephadm", 2024-09-05T01:41:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: "rook", 2024-09-05T01:41:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: "test_orchestrator" 2024-09-05T01:41:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Orchestrator backend", 2024-09-05T01:41:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.061 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_perf_query", 2024-09-05T01:41:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.062 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.063 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.064 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.065 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.066 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "osd_support", 2024-09-05T01:41:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.067 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.068 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.069 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.070 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.071 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.072 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "pg_autoscaler", 2024-09-05T01:41:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.073 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.074 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.075 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.075 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.075 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.075 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.075 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.075 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.075 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.075 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.075 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.075 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.075 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.075 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.075 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.075 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.076 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.076 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.076 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.076 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.076 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.076 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.076 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.076 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.076 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.076 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.076 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.076 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.076 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.076 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.077 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.077 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.077 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.077 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.077 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.077 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.077 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.077 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.077 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.077 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.077 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.077 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.077 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.078 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.078 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.078 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.078 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.078 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.078 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.078 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.078 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.078 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.078 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-05T01:41:56.078 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-05T01:41:56.078 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:56.078 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.078 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.079 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-05T01:41:56.079 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.079 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.079 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.079 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.079 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.079 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.079 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.079 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.079 INFO:teuthology.orchestra.run.smithi012.stdout: "threshold": { 2024-09-05T01:41:56.079 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "threshold", 2024-09-05T01:41:56.079 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-05T01:41:56.079 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.080 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.080 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "3.0", 2024-09-05T01:41:56.080 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1.0", 2024-09-05T01:41:56.080 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.080 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.080 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "scaling threshold", 2024-09-05T01:41:56.080 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-05T01:41:56.080 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.080 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.080 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.080 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.080 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.080 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.081 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "progress", 2024-09-05T01:41:56.081 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.081 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.081 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.081 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_pg_recovery_event": { 2024-09-05T01:41:56.081 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_pg_recovery_event", 2024-09-05T01:41:56.081 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.081 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.081 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.081 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.081 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.081 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.081 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.082 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-05T01:41:56.082 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.082 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.082 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.082 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.082 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-09-05T01:41:56.082 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-09-05T01:41:56.082 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.082 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.082 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.082 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:56.082 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.082 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.083 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.083 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.083 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.083 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.083 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.083 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.083 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.083 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.083 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.083 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.083 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.083 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.083 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.083 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.084 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.084 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.084 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.084 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.084 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.084 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.084 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.084 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.084 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.084 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.084 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.084 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.084 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.085 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.085 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.085 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.085 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.085 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.085 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.085 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.085 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.085 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.085 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.085 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.085 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.085 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.085 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.086 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.086 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.086 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.086 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.086 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.086 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.086 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.086 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.086 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.086 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.086 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.086 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.086 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.087 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.087 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.087 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.087 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.087 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.087 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.087 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.087 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.087 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.087 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.087 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.087 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.087 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.087 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.088 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.088 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.088 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.088 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.088 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.088 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.088 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.088 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.088 INFO:teuthology.orchestra.run.smithi012.stdout: "max_completed_events": { 2024-09-05T01:41:56.088 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_completed_events", 2024-09-05T01:41:56.088 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:56.088 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.088 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.088 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "50", 2024-09-05T01:41:56.089 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.089 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.089 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.089 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "number of past completed events to remember", 2024-09-05T01:41:56.089 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.089 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.089 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.089 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.089 INFO:teuthology.orchestra.run.smithi012.stdout: "sleep_interval": { 2024-09-05T01:41:56.089 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "sleep_interval", 2024-09-05T01:41:56.089 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:56.089 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.089 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.089 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "5", 2024-09-05T01:41:56.090 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.090 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.090 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.090 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "how long the module is going to sleep", 2024-09-05T01:41:56.090 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.090 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.090 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.090 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.090 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.090 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.090 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.090 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "prometheus", 2024-09-05T01:41:56.090 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.091 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.091 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.091 INFO:teuthology.orchestra.run.smithi012.stdout: "cache": { 2024-09-05T01:41:56.091 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cache", 2024-09-05T01:41:56.091 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.091 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.091 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.091 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:56.091 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.091 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.091 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.091 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.091 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.092 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.092 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.092 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.092 INFO:teuthology.orchestra.run.smithi012.stdout: "exclude_perf_counters": { 2024-09-05T01:41:56.092 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "exclude_perf_counters", 2024-09-05T01:41:56.092 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.092 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.092 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.092 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:56.092 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.092 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.092 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.092 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-05T01:41:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-05T01:41:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.093 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.094 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.094 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.094 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.094 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.094 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.094 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.094 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.094 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.094 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.094 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.094 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.094 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.095 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.096 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.097 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools": { 2024-09-05T01:41:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools", 2024-09-05T01:41:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.098 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-05T01:41:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-05T01:41:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "300", 2024-09-05T01:41:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.099 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: "scrape_interval": { 2024-09-05T01:41:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "scrape_interval", 2024-09-05T01:41:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-05T01:41:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15.0", 2024-09-05T01:41:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.100 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-05T01:41:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-05T01:41:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "::", 2024-09-05T01:41:56.101 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-05T01:41:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-05T01:41:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-05T01:41:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "9283", 2024-09-05T01:41:56.102 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.103 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.103 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.103 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-05T01:41:56.103 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.103 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.103 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.103 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.103 INFO:teuthology.orchestra.run.smithi012.stdout: "stale_cache_strategy": { 2024-09-05T01:41:56.103 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stale_cache_strategy", 2024-09-05T01:41:56.103 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.103 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.103 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.103 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "log", 2024-09-05T01:41:56.103 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.104 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.104 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.104 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.104 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.104 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.104 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.104 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.104 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_behaviour": { 2024-09-05T01:41:56.104 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_behaviour", 2024-09-05T01:41:56.104 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.104 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.104 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.104 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "default", 2024-09-05T01:41:56.104 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.105 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.105 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.105 INFO:teuthology.orchestra.run.smithi012.stdout: "default", 2024-09-05T01:41:56.105 INFO:teuthology.orchestra.run.smithi012.stdout: "error" 2024-09-05T01:41:56.105 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.105 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.105 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.105 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.105 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.105 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.105 INFO:teuthology.orchestra.run.smithi012.stdout: "standby_error_status_code": { 2024-09-05T01:41:56.105 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "standby_error_status_code", 2024-09-05T01:41:56.105 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:56.105 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.105 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.106 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "500", 2024-09-05T01:41:56.106 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "400", 2024-09-05T01:41:56.106 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "599", 2024-09-05T01:41:56.106 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.106 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.106 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.106 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.106 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.106 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.106 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.106 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.106 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.106 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_support", 2024-09-05T01:41:56.106 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.107 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.107 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.107 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.107 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.107 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.107 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.107 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.107 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.107 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.107 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.107 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.107 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.107 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.107 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.108 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.108 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.108 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.108 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.108 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.108 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.108 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.108 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.108 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.108 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.108 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.108 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.108 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.108 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.109 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.109 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.109 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.109 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.109 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.109 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.109 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.109 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.109 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.109 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.109 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.109 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.109 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.109 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.110 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.110 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.110 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.110 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.110 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.110 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.110 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.110 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.110 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.110 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.110 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.110 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.110 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.110 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.111 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.111 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.111 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.111 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.111 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.111 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.111 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.111 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.111 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.111 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.111 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.111 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.111 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.111 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.112 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.112 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.112 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_snap_create": { 2024-09-05T01:41:56.112 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_snap_create", 2024-09-05T01:41:56.112 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:56.112 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.112 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.112 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10", 2024-09-05T01:41:56.112 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.112 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.112 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.112 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.112 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.112 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.113 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.113 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.113 INFO:teuthology.orchestra.run.smithi012.stdout: "mirror_snapshot_schedule": { 2024-09-05T01:41:56.113 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "mirror_snapshot_schedule", 2024-09-05T01:41:56.113 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.113 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.113 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.113 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.113 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.113 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.113 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.113 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.113 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.114 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.114 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.114 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.114 INFO:teuthology.orchestra.run.smithi012.stdout: "trash_purge_schedule": { 2024-09-05T01:41:56.114 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "trash_purge_schedule", 2024-09-05T01:41:56.114 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.114 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.114 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.114 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.114 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.114 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.114 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.114 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.114 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.115 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.115 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.115 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.115 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.115 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.115 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.115 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "restful", 2024-09-05T01:41:56.115 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.115 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.115 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.115 INFO:teuthology.orchestra.run.smithi012.stdout: "enable_auth": { 2024-09-05T01:41:56.115 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enable_auth", 2024-09-05T01:41:56.115 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.115 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.116 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.116 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:56.116 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.116 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.116 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.116 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.116 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.116 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.116 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.116 INFO:teuthology.orchestra.run.smithi012.stdout: "key_file": { 2024-09-05T01:41:56.116 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "key_file", 2024-09-05T01:41:56.116 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.116 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.117 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.117 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.117 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.117 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.117 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.117 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.117 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.117 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.117 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.117 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.117 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.117 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.117 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.117 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.118 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.118 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.118 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.118 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.118 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.118 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.118 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.118 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.118 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.118 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.118 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.118 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.118 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.118 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.119 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.119 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.119 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.119 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.119 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.119 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.119 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.119 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.119 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.119 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.119 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.119 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.119 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.119 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.119 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.120 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.120 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.120 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.120 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.120 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.120 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.120 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.120 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.120 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.120 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.120 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.120 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.120 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.120 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.121 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.121 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.121 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.121 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.121 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.121 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.121 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.121 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.121 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.121 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.121 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.121 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.121 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.122 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.122 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.122 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.122 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.122 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.122 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.122 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.122 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.122 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.122 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.122 INFO:teuthology.orchestra.run.smithi012.stdout: "server_addr": { 2024-09-05T01:41:56.122 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_addr", 2024-09-05T01:41:56.122 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.122 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.122 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.123 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.123 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.123 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.123 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.123 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.123 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.123 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.123 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.123 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.123 INFO:teuthology.orchestra.run.smithi012.stdout: "server_port": { 2024-09-05T01:41:56.123 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "server_port", 2024-09-05T01:41:56.123 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.123 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.123 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.123 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.123 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.124 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.124 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.124 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.124 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.124 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.124 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.124 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.124 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.124 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.124 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.124 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rgw", 2024-09-05T01:41:56.124 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.124 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.125 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.125 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.125 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.125 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.125 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.125 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.125 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.125 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.125 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.125 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.125 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.125 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.125 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.125 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.126 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.126 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.126 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.126 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.126 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.126 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.126 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.126 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.126 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.126 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.126 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.126 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.126 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.126 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.127 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.127 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.127 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.127 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.127 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.127 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.127 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.127 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.127 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.127 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.127 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.127 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.127 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.128 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.128 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.128 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.128 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.128 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.128 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.128 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.128 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.128 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.128 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.128 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.128 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.128 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.128 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.129 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.129 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.129 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.129 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.129 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.129 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.129 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.129 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.129 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.129 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.129 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.129 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.129 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.129 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.129 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.130 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.130 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.130 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.130 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rook", 2024-09-05T01:41:56.130 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.130 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.130 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.130 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.130 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.130 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.130 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.130 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.130 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.130 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.131 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.131 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.131 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.131 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.131 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.131 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.131 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.131 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.131 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.131 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.131 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.131 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.131 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.131 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.131 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.132 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.132 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.132 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.132 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.132 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.132 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.132 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.132 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.132 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.132 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.132 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.132 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.132 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.133 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.133 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.133 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.133 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.133 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.133 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.133 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.133 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.133 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.133 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.133 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.133 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.133 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.133 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.134 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.134 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.134 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.134 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.134 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.134 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.134 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.134 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.134 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.134 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.134 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.134 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.134 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.135 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.135 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.135 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.135 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.135 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.135 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.135 INFO:teuthology.orchestra.run.smithi012.stdout: "storage_class": { 2024-09-05T01:41:56.135 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "storage_class", 2024-09-05T01:41:56.135 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.135 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.135 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.135 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "local", 2024-09-05T01:41:56.136 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.136 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.136 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.136 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-05T01:41:56.136 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.136 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.136 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.136 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.136 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.136 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.136 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.136 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "selftest", 2024-09-05T01:41:56.136 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.137 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.137 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.137 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.137 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.137 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.137 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.137 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.137 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.137 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.137 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.137 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.137 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.137 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.138 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.138 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.138 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.138 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.138 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.138 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.138 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.138 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.138 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.138 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.138 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.138 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.138 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.139 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.139 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.139 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.139 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.139 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.139 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.139 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.139 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.139 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.139 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.139 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.139 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.139 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.139 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.140 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.140 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.140 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.140 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.140 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.140 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.140 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.140 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.140 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.140 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.140 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.140 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.140 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.140 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.140 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.141 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.141 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.141 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.141 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.141 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.141 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.141 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.141 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.141 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.141 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.141 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.141 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.141 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.141 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.141 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.142 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.142 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.142 INFO:teuthology.orchestra.run.smithi012.stdout: "roption1": { 2024-09-05T01:41:56.142 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption1", 2024-09-05T01:41:56.142 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.142 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.142 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.142 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.142 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.142 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.142 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.142 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.142 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.143 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.143 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.143 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.143 INFO:teuthology.orchestra.run.smithi012.stdout: "roption2": { 2024-09-05T01:41:56.143 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "roption2", 2024-09-05T01:41:56.143 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.143 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.143 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.143 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "xyz", 2024-09-05T01:41:56.143 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.143 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.143 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.143 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.143 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.144 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.144 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.144 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.144 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption1": { 2024-09-05T01:41:56.144 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption1", 2024-09-05T01:41:56.144 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.144 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.144 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.144 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.144 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.144 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.144 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.144 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.144 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.145 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.145 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.145 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.145 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption2": { 2024-09-05T01:41:56.145 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption2", 2024-09-05T01:41:56.145 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:56.145 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.145 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.145 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.145 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.145 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.145 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.145 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.146 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.146 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.146 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.146 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.146 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption3": { 2024-09-05T01:41:56.146 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption3", 2024-09-05T01:41:56.146 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "float", 2024-09-05T01:41:56.146 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.146 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.146 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.146 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.146 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.146 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.146 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.147 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.147 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.147 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.147 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.147 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption4": { 2024-09-05T01:41:56.147 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption4", 2024-09-05T01:41:56.147 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.147 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.147 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.147 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.147 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.147 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.147 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.147 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.148 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.148 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.148 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.148 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.148 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption5": { 2024-09-05T01:41:56.148 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption5", 2024-09-05T01:41:56.148 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.148 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.148 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.148 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.148 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.148 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.148 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.148 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.149 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.149 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.149 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.149 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption6": { 2024-09-05T01:41:56.149 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption6", 2024-09-05T01:41:56.149 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.149 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.149 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.149 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:56.149 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.149 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.149 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.149 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.149 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.150 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.150 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.150 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.150 INFO:teuthology.orchestra.run.smithi012.stdout: "rwoption7": { 2024-09-05T01:41:56.150 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rwoption7", 2024-09-05T01:41:56.150 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:56.150 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.150 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.150 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.150 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "1", 2024-09-05T01:41:56.150 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "42", 2024-09-05T01:41:56.150 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.150 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.150 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.151 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.151 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.151 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.151 INFO:teuthology.orchestra.run.smithi012.stdout: "testkey": { 2024-09-05T01:41:56.151 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testkey", 2024-09-05T01:41:56.151 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.151 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.151 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.151 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.151 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.151 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.151 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.151 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.151 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.152 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.152 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.152 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.152 INFO:teuthology.orchestra.run.smithi012.stdout: "testlkey": { 2024-09-05T01:41:56.152 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testlkey", 2024-09-05T01:41:56.152 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.152 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.152 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.152 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.152 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.152 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.152 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.152 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.152 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.153 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.153 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.153 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.153 INFO:teuthology.orchestra.run.smithi012.stdout: "testnewline": { 2024-09-05T01:41:56.153 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "testnewline", 2024-09-05T01:41:56.153 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.153 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.153 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.153 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.153 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.153 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.153 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.153 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.154 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.154 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.154 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.154 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.154 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.154 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.154 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.154 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snap_schedule", 2024-09-05T01:41:56.154 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.154 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.154 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.154 INFO:teuthology.orchestra.run.smithi012.stdout: "allow_m_granularity": { 2024-09-05T01:41:56.154 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "allow_m_granularity", 2024-09-05T01:41:56.155 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.155 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.155 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.155 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.155 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.155 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.155 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.155 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "allow minute scheduled snapshots", 2024-09-05T01:41:56.155 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.155 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.155 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.155 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.155 INFO:teuthology.orchestra.run.smithi012.stdout: "dump_on_update": { 2024-09-05T01:41:56.155 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "dump_on_update", 2024-09-05T01:41:56.156 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.156 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.156 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.156 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.156 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.156 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.156 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.156 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "dump database to debug log on update", 2024-09-05T01:41:56.156 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.156 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.156 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.156 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.156 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.156 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.156 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.157 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.157 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.157 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.157 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.157 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.157 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.157 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.157 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.157 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.157 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.157 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.157 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.158 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.158 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.158 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.158 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.158 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.158 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.158 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.158 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.158 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.158 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.158 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.158 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.158 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.158 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.159 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.159 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.159 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.159 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.159 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.159 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.159 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.159 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.159 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.159 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.159 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.159 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.159 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.159 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.160 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.160 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.160 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.160 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.160 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.160 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.160 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.160 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.160 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.160 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.160 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.160 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.160 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.161 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.161 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.161 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.161 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.161 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.161 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.161 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.161 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.161 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.161 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.161 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.161 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.161 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.161 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.162 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.162 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.162 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.162 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "stats", 2024-09-05T01:41:56.162 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.162 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.162 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.162 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.162 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.162 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.162 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.162 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.162 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.164 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.164 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.164 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.164 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.164 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.164 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.164 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.164 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.164 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.164 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.164 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.164 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.164 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.164 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.165 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.165 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.165 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.165 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.165 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.165 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.165 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.165 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.165 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.165 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.165 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.165 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.165 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.166 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.166 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.166 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.166 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.166 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.166 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.166 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.166 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.166 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.166 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.166 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.166 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.166 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.166 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.167 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.167 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.167 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.167 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.167 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.167 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.167 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.167 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.167 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.167 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.167 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.167 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "status", 2024-09-05T01:41:56.167 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.168 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.168 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.168 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.168 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.168 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.168 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.168 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.168 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.168 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.168 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.168 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.168 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.169 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.169 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.169 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.169 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.169 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.169 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.169 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.169 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.169 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.169 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.169 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.169 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.169 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.169 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.170 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.170 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.170 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.170 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.170 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.170 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.170 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.170 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.170 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.170 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.170 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.170 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.170 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.171 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.171 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.171 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.171 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.171 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.171 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.171 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.171 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.171 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.171 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.171 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.171 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.171 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.171 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.171 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telegraf", 2024-09-05T01:41:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: "address": { 2024-09-05T01:41:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "address", 2024-09-05T01:41:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-05T01:41:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-05T01:41:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-05T01:41:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "15", 2024-09-05T01:41:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.179 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.179 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.179 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.179 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.179 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.179 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.179 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.179 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.179 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.179 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.179 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.179 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.179 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.180 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.180 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.180 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.180 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.180 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.180 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.180 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.180 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.180 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.180 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.180 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.180 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.181 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.181 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.181 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.181 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.181 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.181 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.181 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "telemetry", 2024-09-05T01:41:56.181 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.181 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.181 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.181 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_basic": { 2024-09-05T01:41:56.181 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_basic", 2024-09-05T01:41:56.181 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.181 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.182 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.182 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:56.182 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.182 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.182 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.182 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-05T01:41:56.182 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.182 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.182 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.182 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.182 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_crash": { 2024-09-05T01:41:56.182 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_crash", 2024-09-05T01:41:56.182 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.182 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.183 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.183 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:56.183 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.183 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.183 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.183 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-05T01:41:56.183 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.183 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.183 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.183 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.183 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_device": { 2024-09-05T01:41:56.183 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_device", 2024-09-05T01:41:56.183 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.183 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.184 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.184 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:56.184 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.184 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.184 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.184 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-05T01:41:56.184 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.184 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.184 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.184 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.184 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_ident": { 2024-09-05T01:41:56.184 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_ident", 2024-09-05T01:41:56.184 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.184 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.185 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.185 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.185 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.185 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.185 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.185 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-05T01:41:56.185 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.185 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.185 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.185 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.185 INFO:teuthology.orchestra.run.smithi012.stdout: "channel_perf": { 2024-09-05T01:41:56.185 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "channel_perf", 2024-09-05T01:41:56.185 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.186 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.186 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.186 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.186 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.186 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.186 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.186 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-05T01:41:56.186 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.186 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.186 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.186 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.186 INFO:teuthology.orchestra.run.smithi012.stdout: "contact": { 2024-09-05T01:41:56.186 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "contact", 2024-09-05T01:41:56.187 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.187 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.187 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.187 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.187 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.187 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.187 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.187 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.187 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.187 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.187 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.187 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.187 INFO:teuthology.orchestra.run.smithi012.stdout: "description": { 2024-09-05T01:41:56.187 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "description", 2024-09-05T01:41:56.187 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.188 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.188 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.188 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.188 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.188 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.188 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.188 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.188 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.188 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.188 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.188 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.188 INFO:teuthology.orchestra.run.smithi012.stdout: "device_url": { 2024-09-05T01:41:56.188 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "device_url", 2024-09-05T01:41:56.188 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.189 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.189 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.189 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-05T01:41:56.189 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.189 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.189 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.189 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.189 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.189 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.189 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.189 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.189 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": { 2024-09-05T01:41:56.189 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "enabled", 2024-09-05T01:41:56.190 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.190 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.190 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.190 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.192 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.192 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.192 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.192 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.192 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.192 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.192 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.192 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.192 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-05T01:41:56.192 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-05T01:41:56.192 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:56.193 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.193 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.193 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "24", 2024-09-05T01:41:56.193 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "8", 2024-09-05T01:41:56.193 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.193 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.193 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.193 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.193 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.193 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.193 INFO:teuthology.orchestra.run.smithi012.stdout: "last_opt_revision": { 2024-09-05T01:41:56.193 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "last_opt_revision", 2024-09-05T01:41:56.193 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:56.194 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.194 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.194 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "1", 2024-09-05T01:41:56.194 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.194 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.194 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.194 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.194 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.194 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.194 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.194 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard": { 2024-09-05T01:41:56.194 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard", 2024-09-05T01:41:56.194 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.194 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.195 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.195 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.195 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.195 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.195 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.195 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.195 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.195 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.195 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.195 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.195 INFO:teuthology.orchestra.run.smithi012.stdout: "leaderboard_description": { 2024-09-05T01:41:56.195 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "leaderboard_description", 2024-09-05T01:41:56.195 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.195 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.195 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.196 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.196 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.196 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.196 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.196 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.196 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.196 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.196 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.196 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.196 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.196 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.196 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.197 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.197 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.197 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.197 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.197 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.197 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.197 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.197 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.197 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.197 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.197 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.197 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.197 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.198 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.198 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.198 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.198 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.198 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.198 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.198 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.198 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.198 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.198 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.198 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.198 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.199 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.199 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.199 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.199 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.199 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.199 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.199 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.199 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.199 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.199 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.199 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.199 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.199 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.199 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.200 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.200 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.200 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.200 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.200 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.200 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.200 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.200 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.200 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.200 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.200 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.200 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.200 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.201 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.201 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.201 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.201 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.201 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.201 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.201 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.201 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.201 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.201 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.201 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.202 INFO:teuthology.orchestra.run.smithi012.stdout: "organization": { 2024-09-05T01:41:56.202 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "organization", 2024-09-05T01:41:56.202 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.202 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.202 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.202 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.202 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.202 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.202 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.202 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.202 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.202 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.202 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.203 INFO:teuthology.orchestra.run.smithi012.stdout: "proxy": { 2024-09-05T01:41:56.203 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "proxy", 2024-09-05T01:41:56.203 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.203 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.203 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.203 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.203 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.203 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.203 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.203 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.203 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.203 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.203 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.204 INFO:teuthology.orchestra.run.smithi012.stdout: "url": { 2024-09-05T01:41:56.204 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "url", 2024-09-05T01:41:56.204 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.204 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.204 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.204 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-05T01:41:56.204 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.204 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.204 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.204 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.204 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.204 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.204 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.205 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.205 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.205 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.205 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.205 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "test_orchestrator", 2024-09-05T01:41:56.205 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.205 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.205 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.205 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.205 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.205 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.205 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.205 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.205 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.206 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.206 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.206 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.206 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.206 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.206 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.206 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.206 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.206 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.206 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.206 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.206 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.206 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.206 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.206 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.207 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.207 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.207 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.207 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.207 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.207 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.207 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.207 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.207 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.207 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.207 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.207 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.207 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.208 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.208 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.208 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.208 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.208 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.208 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.208 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.208 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.208 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.208 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.208 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.208 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.208 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.208 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.208 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.209 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.209 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.209 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.209 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.209 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.209 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.209 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.209 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.209 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.209 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.209 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.209 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.209 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.209 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.210 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.210 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.210 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.210 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.210 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.210 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.210 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.210 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.210 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.210 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.210 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2024-09-05T01:41:56.210 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.210 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.211 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.211 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.211 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.211 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.211 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.211 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.211 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.211 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.211 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.211 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.211 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.211 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.211 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.211 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.212 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.212 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.212 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.212 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.212 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.212 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.212 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.212 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.212 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.212 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.212 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.212 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.212 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.213 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.213 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.213 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.213 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.213 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.213 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.213 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.213 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.213 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.213 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.213 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.213 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.213 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.213 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.214 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.214 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.214 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.214 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.214 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.214 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.214 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.214 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.214 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.214 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.214 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.214 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.214 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.214 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.215 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.215 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.215 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.215 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.215 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.215 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.215 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.215 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.215 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.215 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.215 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.215 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.215 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.216 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.216 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.216 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.216 INFO:teuthology.orchestra.run.smithi012.stdout: "max_concurrent_clones": { 2024-09-05T01:41:56.216 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "max_concurrent_clones", 2024-09-05T01:41:56.216 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:56.216 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.216 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.216 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "4", 2024-09-05T01:41:56.216 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.216 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.216 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.217 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-05T01:41:56.217 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.217 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.217 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.217 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.217 INFO:teuthology.orchestra.run.smithi012.stdout: "periodic_async_work": { 2024-09-05T01:41:56.217 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "periodic_async_work", 2024-09-05T01:41:56.217 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.217 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.217 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.217 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.217 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.217 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.218 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.218 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Periodically check for async work", 2024-09-05T01:41:56.218 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.218 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.218 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.218 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.218 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_delay": { 2024-09-05T01:41:56.218 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_delay", 2024-09-05T01:41:56.218 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:56.218 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.218 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.218 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "0", 2024-09-05T01:41:56.218 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.218 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.219 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.219 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-05T01:41:56.219 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.219 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.219 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.219 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.219 INFO:teuthology.orchestra.run.smithi012.stdout: "snapshot_clone_no_wait": { 2024-09-05T01:41:56.219 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snapshot_clone_no_wait", 2024-09-05T01:41:56.219 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.219 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.219 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.219 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "True", 2024-09-05T01:41:56.219 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.219 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.220 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.220 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-05T01:41:56.220 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.220 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.220 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.220 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.220 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.220 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.220 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.220 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix", 2024-09-05T01:41:56.220 INFO:teuthology.orchestra.run.smithi012.stdout: "can_run": true, 2024-09-05T01:41:56.220 INFO:teuthology.orchestra.run.smithi012.stdout: "error_string": "", 2024-09-05T01:41:56.220 INFO:teuthology.orchestra.run.smithi012.stdout: "module_options": { 2024-09-05T01:41:56.221 INFO:teuthology.orchestra.run.smithi012.stdout: "discovery_interval": { 2024-09-05T01:41:56.221 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "discovery_interval", 2024-09-05T01:41:56.221 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "uint", 2024-09-05T01:41:56.221 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.221 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.221 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "100", 2024-09-05T01:41:56.221 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.221 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.221 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.221 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.221 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.221 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.221 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.222 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.222 INFO:teuthology.orchestra.run.smithi012.stdout: "identifier": { 2024-09-05T01:41:56.222 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "identifier", 2024-09-05T01:41:56.222 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.222 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.222 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.222 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.222 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.222 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.222 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.222 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.222 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.222 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.223 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.223 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.223 INFO:teuthology.orchestra.run.smithi012.stdout: "interval": { 2024-09-05T01:41:56.223 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "interval", 2024-09-05T01:41:56.223 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "secs", 2024-09-05T01:41:56.223 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.223 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.223 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "60", 2024-09-05T01:41:56.223 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.223 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.223 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.223 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.223 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.223 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.223 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.224 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.224 INFO:teuthology.orchestra.run.smithi012.stdout: "log_level": { 2024-09-05T01:41:56.224 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_level", 2024-09-05T01:41:56.224 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.224 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.224 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.224 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.224 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.224 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.224 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.224 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.224 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.224 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.225 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.225 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.225 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.225 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.225 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.225 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.225 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.225 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.225 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.225 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster": { 2024-09-05T01:41:56.225 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster", 2024-09-05T01:41:56.225 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.225 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.225 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.225 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.226 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.226 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.226 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.226 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.226 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.226 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.226 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.226 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_cluster_level": { 2024-09-05T01:41:56.226 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_cluster_level", 2024-09-05T01:41:56.226 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.226 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.226 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.226 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "info", 2024-09-05T01:41:56.226 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.227 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.227 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [ 2024-09-05T01:41:56.227 INFO:teuthology.orchestra.run.smithi012.stdout: "", 2024-09-05T01:41:56.227 INFO:teuthology.orchestra.run.smithi012.stdout: "critical", 2024-09-05T01:41:56.227 INFO:teuthology.orchestra.run.smithi012.stdout: "debug", 2024-09-05T01:41:56.227 INFO:teuthology.orchestra.run.smithi012.stdout: "error", 2024-09-05T01:41:56.227 INFO:teuthology.orchestra.run.smithi012.stdout: "info", 2024-09-05T01:41:56.227 INFO:teuthology.orchestra.run.smithi012.stdout: "warning" 2024-09-05T01:41:56.227 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.227 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.227 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.227 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.227 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.228 INFO:teuthology.orchestra.run.smithi012.stdout: "log_to_file": { 2024-09-05T01:41:56.228 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "log_to_file", 2024-09-05T01:41:56.228 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "bool", 2024-09-05T01:41:56.228 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.228 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 1, 2024-09-05T01:41:56.228 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "False", 2024-09-05T01:41:56.228 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.228 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.228 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.228 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.228 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.228 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.228 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.229 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_host": { 2024-09-05T01:41:56.229 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_host", 2024-09-05T01:41:56.229 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.229 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.229 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.229 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "", 2024-09-05T01:41:56.229 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.229 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.229 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.229 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.229 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.229 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.229 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.229 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_port": { 2024-09-05T01:41:56.230 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_port", 2024-09-05T01:41:56.230 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "int", 2024-09-05T01:41:56.230 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.230 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.230 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "10051", 2024-09-05T01:41:56.230 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.230 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.230 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.230 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.230 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.230 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.230 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.230 INFO:teuthology.orchestra.run.smithi012.stdout: "zabbix_sender": { 2024-09-05T01:41:56.231 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "zabbix_sender", 2024-09-05T01:41:56.231 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "str", 2024-09-05T01:41:56.231 INFO:teuthology.orchestra.run.smithi012.stdout: "level": "advanced", 2024-09-05T01:41:56.231 INFO:teuthology.orchestra.run.smithi012.stdout: "flags": 0, 2024-09-05T01:41:56.231 INFO:teuthology.orchestra.run.smithi012.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-05T01:41:56.231 INFO:teuthology.orchestra.run.smithi012.stdout: "min": "", 2024-09-05T01:41:56.231 INFO:teuthology.orchestra.run.smithi012.stdout: "max": "", 2024-09-05T01:41:56.231 INFO:teuthology.orchestra.run.smithi012.stdout: "enum_allowed": [], 2024-09-05T01:41:56.231 INFO:teuthology.orchestra.run.smithi012.stdout: "desc": "", 2024-09-05T01:41:56.231 INFO:teuthology.orchestra.run.smithi012.stdout: "long_desc": "", 2024-09-05T01:41:56.231 INFO:teuthology.orchestra.run.smithi012.stdout: "tags": [], 2024-09-05T01:41:56.231 INFO:teuthology.orchestra.run.smithi012.stdout: "see_also": [] 2024-09-05T01:41:56.231 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.231 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.231 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.232 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.232 INFO:teuthology.orchestra.run.smithi012.stdout: "services": { 2024-09-05T01:41:56.232 INFO:teuthology.orchestra.run.smithi012.stdout: "dashboard": "https://172.21.15.12:8443/" 2024-09-05T01:41:56.232 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.232 INFO:teuthology.orchestra.run.smithi012.stdout: "always_on_modules": { 2024-09-05T01:41:56.232 INFO:teuthology.orchestra.run.smithi012.stdout: "octopus": [ 2024-09-05T01:41:56.232 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-09-05T01:41:56.232 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-09-05T01:41:56.232 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-09-05T01:41:56.232 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-09-05T01:41:56.232 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-09-05T01:41:56.232 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-09-05T01:41:56.232 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-09-05T01:41:56.232 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-09-05T01:41:56.233 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-09-05T01:41:56.233 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-09-05T01:41:56.233 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.233 INFO:teuthology.orchestra.run.smithi012.stdout: "pacific": [ 2024-09-05T01:41:56.233 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-09-05T01:41:56.233 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-09-05T01:41:56.233 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-09-05T01:41:56.233 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-09-05T01:41:56.233 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-09-05T01:41:56.233 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-09-05T01:41:56.233 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-09-05T01:41:56.233 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-09-05T01:41:56.233 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-09-05T01:41:56.233 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-09-05T01:41:56.234 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.234 INFO:teuthology.orchestra.run.smithi012.stdout: "quincy": [ 2024-09-05T01:41:56.234 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-09-05T01:41:56.234 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-09-05T01:41:56.234 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-09-05T01:41:56.234 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-09-05T01:41:56.234 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-09-05T01:41:56.234 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-09-05T01:41:56.234 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-09-05T01:41:56.234 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-09-05T01:41:56.234 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-09-05T01:41:56.234 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-09-05T01:41:56.234 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.234 INFO:teuthology.orchestra.run.smithi012.stdout: "reef": [ 2024-09-05T01:41:56.235 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-09-05T01:41:56.235 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-09-05T01:41:56.235 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-09-05T01:41:56.235 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-09-05T01:41:56.235 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-09-05T01:41:56.235 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-09-05T01:41:56.235 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-09-05T01:41:56.235 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-09-05T01:41:56.235 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-09-05T01:41:56.235 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-09-05T01:41:56.235 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2024-09-05T01:41:56.235 INFO:teuthology.orchestra.run.smithi012.stdout: "squid": [ 2024-09-05T01:41:56.235 INFO:teuthology.orchestra.run.smithi012.stdout: "balancer", 2024-09-05T01:41:56.235 INFO:teuthology.orchestra.run.smithi012.stdout: "crash", 2024-09-05T01:41:56.236 INFO:teuthology.orchestra.run.smithi012.stdout: "devicehealth", 2024-09-05T01:41:56.236 INFO:teuthology.orchestra.run.smithi012.stdout: "orchestrator", 2024-09-05T01:41:56.236 INFO:teuthology.orchestra.run.smithi012.stdout: "pg_autoscaler", 2024-09-05T01:41:56.236 INFO:teuthology.orchestra.run.smithi012.stdout: "progress", 2024-09-05T01:41:56.236 INFO:teuthology.orchestra.run.smithi012.stdout: "rbd_support", 2024-09-05T01:41:56.236 INFO:teuthology.orchestra.run.smithi012.stdout: "status", 2024-09-05T01:41:56.236 INFO:teuthology.orchestra.run.smithi012.stdout: "telemetry", 2024-09-05T01:41:56.236 INFO:teuthology.orchestra.run.smithi012.stdout: "volumes" 2024-09-05T01:41:56.236 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-05T01:41:56.236 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.236 INFO:teuthology.orchestra.run.smithi012.stdout: "last_failure_osd_epoch": 86, 2024-09-05T01:41:56.236 INFO:teuthology.orchestra.run.smithi012.stdout: "active_clients": [ 2024-09-05T01:41:56.236 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.236 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "devicehealth", 2024-09-05T01:41:56.236 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-05T01:41:56.237 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.237 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-05T01:41:56.237 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:0", 2024-09-05T01:41:56.237 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1015487178 2024-09-05T01:41:56.237 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.237 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-05T01:41:56.237 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.237 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.237 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "libcephsqlite", 2024-09-05T01:41:56.237 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-05T01:41:56.237 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.237 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-05T01:41:56.237 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:0", 2024-09-05T01:41:56.237 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3270976201 2024-09-05T01:41:56.237 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.238 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-05T01:41:56.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.238 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "rbd_support", 2024-09-05T01:41:56.238 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-05T01:41:56.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.238 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-05T01:41:56.238 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:0", 2024-09-05T01:41:56.238 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 3067675967 2024-09-05T01:41:56.238 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.238 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-05T01:41:56.238 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.238 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.238 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snap_schedule", 2024-09-05T01:41:56.239 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-05T01:41:56.239 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.239 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-05T01:41:56.239 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:0", 2024-09-05T01:41:56.239 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1520446876 2024-09-05T01:41:56.239 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.239 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-05T01:41:56.239 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.239 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.239 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "snap_schedule", 2024-09-05T01:41:56.239 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-05T01:41:56.239 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.239 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-05T01:41:56.239 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:0", 2024-09-05T01:41:56.240 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 1539231372 2024-09-05T01:41:56.240 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.240 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-05T01:41:56.240 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:56.240 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.240 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "volumes", 2024-09-05T01:41:56.240 INFO:teuthology.orchestra.run.smithi012.stdout: "addrvec": [ 2024-09-05T01:41:56.240 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-09-05T01:41:56.240 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v2", 2024-09-05T01:41:56.240 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "172.21.15.12:0", 2024-09-05T01:41:56.240 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 829204660 2024-09-05T01:41:56.240 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.240 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-05T01:41:56.240 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:56.240 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2024-09-05T01:41:56.240 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:41:56.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.907+0000 7f6b4a400640 1 -- 172.21.15.12:0/783768390 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6b2c0a2e00 msgr2=0x7f6b2c0a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:56.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.907+0000 7f6b4a400640 1 --2- 172.21.15.12:0/783768390 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6b2c0a2e00 0x7f6b2c0a52c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6b44197650 tx=0x7f6b300090e0 comp rx=0 tx=0).stop 2024-09-05T01:41:56.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.907+0000 7f6b4a400640 1 -- 172.21.15.12:0/783768390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b44100cc0 msgr2=0x7f6b44199e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:41:56.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.907+0000 7f6b4a400640 1 --2- 172.21.15.12:0/783768390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b44100cc0 0x7f6b44199e00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800e9c0 tx=0x7f6b3800ee80 comp rx=0 tx=0).stop 2024-09-05T01:41:56.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.908+0000 7f6b4a400640 1 -- 172.21.15.12:0/783768390 shutdown_connections 2024-09-05T01:41:56.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.908+0000 7f6b4a400640 1 --2- 172.21.15.12:0/783768390 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f6b2c0a2e00 0x7f6b2c0a52c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:56.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.908+0000 7f6b4a400640 1 --2- 172.21.15.12:0/783768390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b441067f0 0x7f6b441965f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:56.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.908+0000 7f6b4a400640 1 --2- 172.21.15.12:0/783768390 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f6b44101660 0x7f6b441960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:56.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.908+0000 7f6b4a400640 1 --2- 172.21.15.12:0/783768390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b44100cc0 0x7f6b44199e00 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:41:56.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.908+0000 7f6b4a400640 1 -- 172.21.15.12:0/783768390 >> 172.21.15.12:0/783768390 conn(0x7f6b44076550 msgr2=0x7f6b440feed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:41:56.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.908+0000 7f6b4a400640 1 -- 172.21.15.12:0/783768390 shutdown_connections 2024-09-05T01:41:56.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:41:54.908+0000 7f6b4a400640 1 -- 172.21.15.12:0/783768390 wait complete. 2024-09-05T01:41:56.243 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:55 smithi151 ceph-mon[35013]: pgmap v539: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 944 KiB/s wr, 133 op/s 2024-09-05T01:41:56.243 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:55 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/783768390' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-05T01:41:56.243 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:55 smithi145 ceph-mon[34376]: pgmap v539: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 944 KiB/s wr, 133 op/s 2024-09-05T01:41:56.243 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:55 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/783768390' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-05T01:41:56.243 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:54 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2385022144' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-05T01:41:56.299 DEBUG:tasks.check_counter:Getting stats from a 2024-09-05T01:41:56.299 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-05T01:41:56.300 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:55 smithi012 ceph-mon[29942]: pgmap v539: 97 pgs: 35 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 43 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 959 KiB/s rd, 944 KiB/s wr, 133 op/s 2024-09-05T01:41:56.300 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:55 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/783768390' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-05T01:41:56.899 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:41:57.687 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:57 smithi012 ceph-mon[29942]: pgmap v540: 97 pgs: 33 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 48 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 956 KiB/s wr, 128 op/s 2024-09-05T01:41:57.689 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:41:57.689 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T01:41:57.689 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 2078, 2024-09-05T01:41:57.689 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 2080, 2024-09-05T01:41:57.689 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 147439058, 2024-09-05T01:41:57.689 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 660805, 2024-09-05T01:41:57.689 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 8, 2024-09-05T01:41:57.689 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 4, 2024-09-05T01:41:57.689 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.609899543, 2024-09-05T01:41:57.689 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.109009751, 2024-09-05T01:41:57.690 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.352629512, 2024-09-05T01:41:57.690 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.120627929, 2024-09-05T01:41:57.690 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:41:57.690 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 2078, 2024-09-05T01:41:57.690 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.221636840, 2024-09-05T01:41:57.690 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000106658 2024-09-05T01:41:57.690 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.690 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:41:57.690 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.690 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.690 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.690 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.690 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-05T01:41:57.691 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 0 2024-09-05T01:41:57.691 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.691 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T01:41:57.691 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 1115, 2024-09-05T01:41:57.691 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 1352, 2024-09-05T01:41:57.691 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 130332967, 2024-09-05T01:41:57.691 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 1030929, 2024-09-05T01:41:57.691 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 10, 2024-09-05T01:41:57.691 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 7, 2024-09-05T01:41:57.691 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.444327594, 2024-09-05T01:41:57.691 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.059452473, 2024-09-05T01:41:57.691 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.301725920, 2024-09-05T01:41:57.692 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.066877876, 2024-09-05T01:41:57.692 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:41:57.692 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 1350, 2024-09-05T01:41:57.692 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.157179252, 2024-09-05T01:41:57.692 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000116429 2024-09-05T01:41:57.692 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.692 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:41:57.692 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.692 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.692 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.692 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.692 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 3472, 2024-09-05T01:41:57.692 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 678528 2024-09-05T01:41:57.693 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.693 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T01:41:57.693 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 1261, 2024-09-05T01:41:57.693 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 1204, 2024-09-05T01:41:57.693 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 154610246, 2024-09-05T01:41:57.693 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 472563, 2024-09-05T01:41:57.693 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 5, 2024-09-05T01:41:57.693 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 4, 2024-09-05T01:41:57.693 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.558971634, 2024-09-05T01:41:57.693 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.077843788, 2024-09-05T01:41:57.693 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.435857009, 2024-09-05T01:41:57.693 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.050040070, 2024-09-05T01:41:57.694 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:41:57.694 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 1203, 2024-09-05T01:41:57.694 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.143865547, 2024-09-05T01:41:57.694 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000119588 2024-09-05T01:41:57.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.694 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:41:57.694 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.694 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.694 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.694 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 1954464, 2024-09-05T01:41:57.694 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 199072 2024-09-05T01:41:57.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.695 INFO:teuthology.orchestra.run.smithi012.stdout: "cct": { 2024-09-05T01:41:57.695 INFO:teuthology.orchestra.run.smithi012.stdout: "total_workers": 1, 2024-09-05T01:41:57.695 INFO:teuthology.orchestra.run.smithi012.stdout: "unhealthy_workers": 0 2024-09-05T01:41:57.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.695 INFO:teuthology.orchestra.run.smithi012.stdout: "finisher-MDSRank": { 2024-09-05T01:41:57.695 INFO:teuthology.orchestra.run.smithi012.stdout: "queue_len": 0, 2024-09-05T01:41:57.695 INFO:teuthology.orchestra.run.smithi012.stdout: "complete_latency": { 2024-09-05T01:41:57.695 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 6441, 2024-09-05T01:41:57.695 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.251802669, 2024-09-05T01:41:57.695 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000039093 2024-09-05T01:41:57.695 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:57.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.696 INFO:teuthology.orchestra.run.smithi012.stdout: "finisher-PurgeQueue": { 2024-09-05T01:41:57.696 INFO:teuthology.orchestra.run.smithi012.stdout: "queue_len": 0, 2024-09-05T01:41:57.696 INFO:teuthology.orchestra.run.smithi012.stdout: "complete_latency": { 2024-09-05T01:41:57.696 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.696 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.696 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.696 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:57.696 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.696 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-05T01:41:57.696 INFO:teuthology.orchestra.run.smithi012.stdout: "request": 0, 2024-09-05T01:41:57.696 INFO:teuthology.orchestra.run.smithi012.stdout: "reply": 0, 2024-09-05T01:41:57.696 INFO:teuthology.orchestra.run.smithi012.stdout: "reply_latency": { 2024-09-05T01:41:57.697 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.697 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.697 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.697 INFO:teuthology.orchestra.run.smithi012.stdout: "slow_reply": 0, 2024-09-05T01:41:57.697 INFO:teuthology.orchestra.run.smithi012.stdout: "forward": 0, 2024-09-05T01:41:57.697 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_fetch_complete": 0, 2024-09-05T01:41:57.697 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_fetch_keys": 0, 2024-09-05T01:41:57.697 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_commit": 0, 2024-09-05T01:41:57.697 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_split": 0, 2024-09-05T01:41:57.697 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_merge": 0, 2024-09-05T01:41:57.697 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes": 52016, 2024-09-05T01:41:57.698 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_top": 2618, 2024-09-05T01:41:57.698 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_bottom": 49398, 2024-09-05T01:41:57.698 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_pin_tail": 0, 2024-09-05T01:41:57.698 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_pinned": 48275, 2024-09-05T01:41:57.698 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_expired": 0, 2024-09-05T01:41:57.698 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_with_caps": 0, 2024-09-05T01:41:57.698 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": 0, 2024-09-05T01:41:57.698 INFO:teuthology.orchestra.run.smithi012.stdout: "subtrees": 1, 2024-09-05T01:41:57.698 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse": 0, 2024-09-05T01:41:57.698 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_hit": 0, 2024-09-05T01:41:57.698 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_forward": 0, 2024-09-05T01:41:57.698 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_discover": 0, 2024-09-05T01:41:57.699 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_dir_fetch": 0, 2024-09-05T01:41:57.699 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_remote_ino": 0, 2024-09-05T01:41:57.699 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_lock": 0, 2024-09-05T01:41:57.699 INFO:teuthology.orchestra.run.smithi012.stdout: "load_cent": 0, 2024-09-05T01:41:57.699 INFO:teuthology.orchestra.run.smithi012.stdout: "q": 0, 2024-09-05T01:41:57.699 INFO:teuthology.orchestra.run.smithi012.stdout: "exported": 0, 2024-09-05T01:41:57.699 INFO:teuthology.orchestra.run.smithi012.stdout: "exported_inodes": 0, 2024-09-05T01:41:57.699 INFO:teuthology.orchestra.run.smithi012.stdout: "imported": 0, 2024-09-05T01:41:57.699 INFO:teuthology.orchestra.run.smithi012.stdout: "imported_inodes": 0, 2024-09-05T01:41:57.699 INFO:teuthology.orchestra.run.smithi012.stdout: "openino_dir_fetch": 0, 2024-09-05T01:41:57.699 INFO:teuthology.orchestra.run.smithi012.stdout: "openino_backtrace_fetch": 0, 2024-09-05T01:41:57.699 INFO:teuthology.orchestra.run.smithi012.stdout: "openino_peer_discover": 0, 2024-09-05T01:41:57.699 INFO:teuthology.orchestra.run.smithi012.stdout: "root_rfiles": 0, 2024-09-05T01:41:57.699 INFO:teuthology.orchestra.run.smithi012.stdout: "root_rbytes": 0, 2024-09-05T01:41:57.700 INFO:teuthology.orchestra.run.smithi012.stdout: "root_rsnaps": 0, 2024-09-05T01:41:57.700 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_backtrace_fetch": 0, 2024-09-05T01:41:57.700 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_set_tag": 0, 2024-09-05T01:41:57.700 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T01:41:57.700 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_inotable_repaired": 0, 2024-09-05T01:41:57.700 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_dir_inodes": 0, 2024-09-05T01:41:57.700 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_dir_base_inodes": 0, 2024-09-05T01:41:57.700 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_dirfrag_rstats": 0, 2024-09-05T01:41:57.700 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_file_inodes": 0, 2024-09-05T01:41:57.700 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_inode_file_caps": 0, 2024-09-05T01:41:57.700 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_revoke": 0, 2024-09-05T01:41:57.700 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_grant": 0, 2024-09-05T01:41:57.700 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_trunc": 0, 2024-09-05T01:41:57.700 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T01:41:57.701 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T01:41:57.701 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_caps": 0, 2024-09-05T01:41:57.701 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_caps_dirty": 0, 2024-09-05T01:41:57.701 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_cap_release": 0, 2024-09-05T01:41:57.701 INFO:teuthology.orchestra.run.smithi012.stdout: "process_request_cap_release": 0 2024-09-05T01:41:57.701 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.701 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_cache": { 2024-09-05T01:41:57.701 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_update": 0, 2024-09-05T01:41:57.701 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_update_receipt": 0, 2024-09-05T01:41:57.701 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_try_discover": 0, 2024-09-05T01:41:57.701 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_send_discover": 0, 2024-09-05T01:41:57.701 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_handle_discover": 0, 2024-09-05T01:41:57.701 INFO:teuthology.orchestra.run.smithi012.stdout: "num_strays": 0, 2024-09-05T01:41:57.701 INFO:teuthology.orchestra.run.smithi012.stdout: "num_strays_delayed": 0, 2024-09-05T01:41:57.702 INFO:teuthology.orchestra.run.smithi012.stdout: "num_strays_enqueuing": 0, 2024-09-05T01:41:57.702 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_created": 0, 2024-09-05T01:41:57.702 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_enqueued": 0, 2024-09-05T01:41:57.702 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_reintegrated": 0, 2024-09-05T01:41:57.702 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_migrated": 0, 2024-09-05T01:41:57.702 INFO:teuthology.orchestra.run.smithi012.stdout: "num_recovering_processing": 0, 2024-09-05T01:41:57.702 INFO:teuthology.orchestra.run.smithi012.stdout: "num_recovering_enqueued": 0, 2024-09-05T01:41:57.702 INFO:teuthology.orchestra.run.smithi012.stdout: "num_recovering_prioritized": 0, 2024-09-05T01:41:57.702 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_started": 0, 2024-09-05T01:41:57.702 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_completed": 0, 2024-09-05T01:41:57.702 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_quiesce_path": 0, 2024-09-05T01:41:57.702 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_quiesce_inode": 0, 2024-09-05T01:41:57.702 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_enqueue_scrub": 0, 2024-09-05T01:41:57.703 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_exportdir": 0, 2024-09-05T01:41:57.703 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_flush": 0, 2024-09-05T01:41:57.703 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_fragmentdir": 0, 2024-09-05T01:41:57.703 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_fragstats": 0, 2024-09-05T01:41:57.703 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_inodestats": 0 2024-09-05T01:41:57.703 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.703 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_log": { 2024-09-05T01:41:57.703 INFO:teuthology.orchestra.run.smithi012.stdout: "evlrg": 0, 2024-09-05T01:41:57.703 INFO:teuthology.orchestra.run.smithi012.stdout: "evadd": 0, 2024-09-05T01:41:57.703 INFO:teuthology.orchestra.run.smithi012.stdout: "evex": 0, 2024-09-05T01:41:57.703 INFO:teuthology.orchestra.run.smithi012.stdout: "evtrm": 0, 2024-09-05T01:41:57.703 INFO:teuthology.orchestra.run.smithi012.stdout: "ev": 127618, 2024-09-05T01:41:57.703 INFO:teuthology.orchestra.run.smithi012.stdout: "evexg": 0, 2024-09-05T01:41:57.703 INFO:teuthology.orchestra.run.smithi012.stdout: "evexd": 0, 2024-09-05T01:41:57.703 INFO:teuthology.orchestra.run.smithi012.stdout: "segadd": 0, 2024-09-05T01:41:57.704 INFO:teuthology.orchestra.run.smithi012.stdout: "segex": 0, 2024-09-05T01:41:57.704 INFO:teuthology.orchestra.run.smithi012.stdout: "segtrm": 0, 2024-09-05T01:41:57.704 INFO:teuthology.orchestra.run.smithi012.stdout: "seg": 131, 2024-09-05T01:41:57.704 INFO:teuthology.orchestra.run.smithi012.stdout: "segmjr": 12, 2024-09-05T01:41:57.704 INFO:teuthology.orchestra.run.smithi012.stdout: "segexg": 0, 2024-09-05T01:41:57.704 INFO:teuthology.orchestra.run.smithi012.stdout: "segexd": 0, 2024-09-05T01:41:57.704 INFO:teuthology.orchestra.run.smithi012.stdout: "expos": 97484773, 2024-09-05T01:41:57.704 INFO:teuthology.orchestra.run.smithi012.stdout: "wrpos": 433439367, 2024-09-05T01:41:57.704 INFO:teuthology.orchestra.run.smithi012.stdout: "rdpos": 433432076, 2024-09-05T01:41:57.704 INFO:teuthology.orchestra.run.smithi012.stdout: "jlat": { 2024-09-05T01:41:57.704 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.704 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.704 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.704 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.705 INFO:teuthology.orchestra.run.smithi012.stdout: "replayed": 127618 2024-09-05T01:41:57.705 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.705 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_mem": { 2024-09-05T01:41:57.705 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 15846, 2024-09-05T01:41:57.705 INFO:teuthology.orchestra.run.smithi012.stdout: "ino+": 66901, 2024-09-05T01:41:57.705 INFO:teuthology.orchestra.run.smithi012.stdout: "ino-": 51055, 2024-09-05T01:41:57.705 INFO:teuthology.orchestra.run.smithi012.stdout: "dir": 602, 2024-09-05T01:41:57.705 INFO:teuthology.orchestra.run.smithi012.stdout: "dir+": 1761, 2024-09-05T01:41:57.705 INFO:teuthology.orchestra.run.smithi012.stdout: "dir-": 1159, 2024-09-05T01:41:57.705 INFO:teuthology.orchestra.run.smithi012.stdout: "dn": 52016, 2024-09-05T01:41:57.705 INFO:teuthology.orchestra.run.smithi012.stdout: "dn+": 111508, 2024-09-05T01:41:57.705 INFO:teuthology.orchestra.run.smithi012.stdout: "dn-": 59492, 2024-09-05T01:41:57.705 INFO:teuthology.orchestra.run.smithi012.stdout: "cap": 0, 2024-09-05T01:41:57.706 INFO:teuthology.orchestra.run.smithi012.stdout: "cap+": 0, 2024-09-05T01:41:57.706 INFO:teuthology.orchestra.run.smithi012.stdout: "cap-": 0, 2024-09-05T01:41:57.706 INFO:teuthology.orchestra.run.smithi012.stdout: "rss": 167600, 2024-09-05T01:41:57.706 INFO:teuthology.orchestra.run.smithi012.stdout: "heap": 215328 2024-09-05T01:41:57.706 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.706 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_server": { 2024-09-05T01:41:57.706 INFO:teuthology.orchestra.run.smithi012.stdout: "dispatch_client_request": 0, 2024-09-05T01:41:57.706 INFO:teuthology.orchestra.run.smithi012.stdout: "dispatch_server_request": 0, 2024-09-05T01:41:57.706 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_request": 0, 2024-09-05T01:41:57.706 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_session": 0, 2024-09-05T01:41:57.706 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_peer_request": 0, 2024-09-05T01:41:57.706 INFO:teuthology.orchestra.run.smithi012.stdout: "req_create_latency": { 2024-09-05T01:41:57.706 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.706 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.707 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.707 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.707 INFO:teuthology.orchestra.run.smithi012.stdout: "req_getattr_latency": { 2024-09-05T01:41:57.707 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.707 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.707 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.707 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.707 INFO:teuthology.orchestra.run.smithi012.stdout: "req_getfilelock_latency": { 2024-09-05T01:41:57.707 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.707 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.707 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.707 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.708 INFO:teuthology.orchestra.run.smithi012.stdout: "req_link_latency": { 2024-09-05T01:41:57.708 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.708 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.708 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.708 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.708 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookup_latency": { 2024-09-05T01:41:57.708 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.708 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.708 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.708 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.708 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookuphash_latency": { 2024-09-05T01:41:57.708 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.708 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.708 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.708 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.709 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupino_latency": { 2024-09-05T01:41:57.709 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.709 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.709 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.709 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.709 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupname_latency": { 2024-09-05T01:41:57.709 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.709 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.709 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.709 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.709 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupparent_latency": { 2024-09-05T01:41:57.709 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.709 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.710 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.710 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.710 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupsnap_latency": { 2024-09-05T01:41:57.710 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.710 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.710 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.710 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.710 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lssnap_latency": { 2024-09-05T01:41:57.710 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.710 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.710 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.711 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.711 INFO:teuthology.orchestra.run.smithi012.stdout: "req_mkdir_latency": { 2024-09-05T01:41:57.711 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.711 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.711 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.711 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.711 INFO:teuthology.orchestra.run.smithi012.stdout: "req_mknod_latency": { 2024-09-05T01:41:57.711 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.711 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.712 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.712 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.712 INFO:teuthology.orchestra.run.smithi012.stdout: "req_mksnap_latency": { 2024-09-05T01:41:57.712 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.712 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.712 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.712 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.712 INFO:teuthology.orchestra.run.smithi012.stdout: "req_open_latency": { 2024-09-05T01:41:57.712 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.712 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.712 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.712 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.712 INFO:teuthology.orchestra.run.smithi012.stdout: "req_readdir_latency": { 2024-09-05T01:41:57.713 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.713 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.713 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.713 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.713 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rename_latency": { 2024-09-05T01:41:57.713 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.713 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.713 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.713 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.713 INFO:teuthology.orchestra.run.smithi012.stdout: "req_renamesnap_latency": { 2024-09-05T01:41:57.713 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.713 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.713 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.714 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.714 INFO:teuthology.orchestra.run.smithi012.stdout: "req_snapdiff_latency": { 2024-09-05T01:41:57.714 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.714 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.714 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.714 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.714 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rmdir_latency": { 2024-09-05T01:41:57.714 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.714 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.714 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.714 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.714 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rmsnap_latency": { 2024-09-05T01:41:57.714 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.715 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.715 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.715 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.715 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rmxattr_latency": { 2024-09-05T01:41:57.715 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.715 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.715 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.715 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.715 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setattr_latency": { 2024-09-05T01:41:57.715 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.715 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.715 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.715 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.716 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setdirlayout_latency": { 2024-09-05T01:41:57.716 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.716 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.716 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.716 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.716 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setfilelock_latency": { 2024-09-05T01:41:57.716 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.716 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.716 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.716 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.716 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setlayout_latency": { 2024-09-05T01:41:57.716 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.716 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.716 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.717 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.717 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setxattr_latency": { 2024-09-05T01:41:57.717 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.717 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.717 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.717 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.717 INFO:teuthology.orchestra.run.smithi012.stdout: "req_symlink_latency": { 2024-09-05T01:41:57.717 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.717 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.717 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.717 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.717 INFO:teuthology.orchestra.run.smithi012.stdout: "req_unlink_latency": { 2024-09-05T01:41:57.717 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.717 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.718 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.718 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.718 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_revoke_eviction": 0, 2024-09-05T01:41:57.718 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_acquisition_throttle": 0, 2024-09-05T01:41:57.718 INFO:teuthology.orchestra.run.smithi012.stdout: "req_getvxattr_latency": { 2024-09-05T01:41:57.718 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.718 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.718 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.718 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:57.718 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.718 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_sessions": { 2024-09-05T01:41:57.718 INFO:teuthology.orchestra.run.smithi012.stdout: "session_count": 2, 2024-09-05T01:41:57.718 INFO:teuthology.orchestra.run.smithi012.stdout: "session_add": 4, 2024-09-05T01:41:57.718 INFO:teuthology.orchestra.run.smithi012.stdout: "session_remove": 2, 2024-09-05T01:41:57.719 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions_open": 2, 2024-09-05T01:41:57.719 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions_stale": 0, 2024-09-05T01:41:57.719 INFO:teuthology.orchestra.run.smithi012.stdout: "total_load": 0, 2024-09-05T01:41:57.719 INFO:teuthology.orchestra.run.smithi012.stdout: "average_load": 0, 2024-09-05T01:41:57.719 INFO:teuthology.orchestra.run.smithi012.stdout: "avg_session_uptime": 3249, 2024-09-05T01:41:57.719 INFO:teuthology.orchestra.run.smithi012.stdout: "mdthresh_evicted": 0 2024-09-05T01:41:57.719 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.719 INFO:teuthology.orchestra.run.smithi012.stdout: "mempool": { 2024-09-05T01:41:57.719 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_bytes": 0, 2024-09-05T01:41:57.719 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_items": 0, 2024-09-05T01:41:57.719 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T01:41:57.719 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_items": 0, 2024-09-05T01:41:57.719 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T01:41:57.720 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_items": 0, 2024-09-05T01:41:57.720 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T01:41:57.720 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T01:41:57.720 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T01:41:57.720 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T01:41:57.720 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T01:41:57.720 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_items": 0, 2024-09-05T01:41:57.720 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T01:41:57.720 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T01:41:57.720 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_bytes": 0, 2024-09-05T01:41:57.720 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_items": 0, 2024-09-05T01:41:57.720 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_bytes": 0, 2024-09-05T01:41:57.721 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_items": 0, 2024-09-05T01:41:57.721 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T01:41:57.721 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T01:41:57.721 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T01:41:57.721 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T01:41:57.721 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T01:41:57.721 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_items": 0, 2024-09-05T01:41:57.721 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_bytes": 0, 2024-09-05T01:41:57.721 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_items": 0, 2024-09-05T01:41:57.721 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T01:41:57.721 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T01:41:57.721 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_bytes": 0, 2024-09-05T01:41:57.721 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_items": 0, 2024-09-05T01:41:57.721 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_bytes": 0, 2024-09-05T01:41:57.721 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_items": 0, 2024-09-05T01:41:57.722 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T01:41:57.722 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_items": 0, 2024-09-05T01:41:57.722 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T01:41:57.722 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_items": 0, 2024-09-05T01:41:57.722 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_bytes": 839535, 2024-09-05T01:41:57.722 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_items": 16278, 2024-09-05T01:41:57.722 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_bytes": 0, 2024-09-05T01:41:57.722 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_items": 0, 2024-09-05T01:41:57.722 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_bytes": 0, 2024-09-05T01:41:57.722 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_items": 0, 2024-09-05T01:41:57.722 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_bytes": 0, 2024-09-05T01:41:57.722 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_items": 0, 2024-09-05T01:41:57.722 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_bytes": 0, 2024-09-05T01:41:57.722 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_items": 0, 2024-09-05T01:41:57.723 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_bytes": 8512, 2024-09-05T01:41:57.723 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_items": 191, 2024-09-05T01:41:57.723 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T01:41:57.723 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_items": 0, 2024-09-05T01:41:57.723 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_bytes": 0, 2024-09-05T01:41:57.723 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_items": 0, 2024-09-05T01:41:57.723 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_bytes": 74155520, 2024-09-05T01:41:57.723 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_items": 733866, 2024-09-05T01:41:57.723 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_bytes": 0, 2024-09-05T01:41:57.723 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_items": 0, 2024-09-05T01:41:57.723 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_bytes": 0, 2024-09-05T01:41:57.723 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_items": 0 2024-09-05T01:41:57.723 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.723 INFO:teuthology.orchestra.run.smithi012.stdout: "objecter": { 2024-09-05T01:41:57.724 INFO:teuthology.orchestra.run.smithi012.stdout: "op_active": 0, 2024-09-05T01:41:57.724 INFO:teuthology.orchestra.run.smithi012.stdout: "op_laggy": 0, 2024-09-05T01:41:57.724 INFO:teuthology.orchestra.run.smithi012.stdout: "op_send": 4046, 2024-09-05T01:41:57.724 INFO:teuthology.orchestra.run.smithi012.stdout: "op_send_bytes": 21, 2024-09-05T01:41:57.724 INFO:teuthology.orchestra.run.smithi012.stdout: "op_resend": 3, 2024-09-05T01:41:57.724 INFO:teuthology.orchestra.run.smithi012.stdout: "op_reply": 4046, 2024-09-05T01:41:57.724 INFO:teuthology.orchestra.run.smithi012.stdout: "op_latency": { 2024-09-05T01:41:57.724 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 4046, 2024-09-05T01:41:57.724 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 24.912781239, 2024-09-05T01:41:57.724 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.006157385 2024-09-05T01:41:57.724 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.724 INFO:teuthology.orchestra.run.smithi012.stdout: "op_inflight": 0, 2024-09-05T01:41:57.724 INFO:teuthology.orchestra.run.smithi012.stdout: "oplen_avg": { 2024-09-05T01:41:57.725 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 4046, 2024-09-05T01:41:57.725 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 4047 2024-09-05T01:41:57.725 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.725 INFO:teuthology.orchestra.run.smithi012.stdout: "op": 4046, 2024-09-05T01:41:57.725 INFO:teuthology.orchestra.run.smithi012.stdout: "op_r": 4046, 2024-09-05T01:41:57.725 INFO:teuthology.orchestra.run.smithi012.stdout: "op_w": 0, 2024-09-05T01:41:57.725 INFO:teuthology.orchestra.run.smithi012.stdout: "op_rmw": 0, 2024-09-05T01:41:57.725 INFO:teuthology.orchestra.run.smithi012.stdout: "op_pg": 0, 2024-09-05T01:41:57.725 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_stat": 2446, 2024-09-05T01:41:57.725 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_create": 0, 2024-09-05T01:41:57.725 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_read": 1598, 2024-09-05T01:41:57.725 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_write": 0, 2024-09-05T01:41:57.725 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_writefull": 0, 2024-09-05T01:41:57.725 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_writesame": 0, 2024-09-05T01:41:57.726 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_append": 0, 2024-09-05T01:41:57.726 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_zero": 0, 2024-09-05T01:41:57.726 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_truncate": 0, 2024-09-05T01:41:57.726 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_delete": 0, 2024-09-05T01:41:57.726 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_mapext": 0, 2024-09-05T01:41:57.726 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_sparse_read": 0, 2024-09-05T01:41:57.726 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_clonerange": 0, 2024-09-05T01:41:57.726 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_getxattr": 1, 2024-09-05T01:41:57.726 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_setxattr": 0, 2024-09-05T01:41:57.726 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_cmpxattr": 0, 2024-09-05T01:41:57.726 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_rmxattr": 0, 2024-09-05T01:41:57.726 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_resetxattrs": 0, 2024-09-05T01:41:57.726 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_call": 0, 2024-09-05T01:41:57.726 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_watch": 0, 2024-09-05T01:41:57.726 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_notify": 0, 2024-09-05T01:41:57.727 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T01:41:57.727 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_pgls": 0, 2024-09-05T01:41:57.727 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_pgls_filter": 0, 2024-09-05T01:41:57.727 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_other": 0, 2024-09-05T01:41:57.727 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_active": 0, 2024-09-05T01:41:57.727 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_send": 0, 2024-09-05T01:41:57.727 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_resend": 0, 2024-09-05T01:41:57.727 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_ping": 0, 2024-09-05T01:41:57.727 INFO:teuthology.orchestra.run.smithi012.stdout: "poolop_active": 0, 2024-09-05T01:41:57.727 INFO:teuthology.orchestra.run.smithi012.stdout: "poolop_send": 0, 2024-09-05T01:41:57.727 INFO:teuthology.orchestra.run.smithi012.stdout: "poolop_resend": 0, 2024-09-05T01:41:57.727 INFO:teuthology.orchestra.run.smithi012.stdout: "poolstat_active": 0, 2024-09-05T01:41:57.727 INFO:teuthology.orchestra.run.smithi012.stdout: "poolstat_send": 0, 2024-09-05T01:41:57.727 INFO:teuthology.orchestra.run.smithi012.stdout: "poolstat_resend": 0, 2024-09-05T01:41:57.727 INFO:teuthology.orchestra.run.smithi012.stdout: "statfs_active": 0, 2024-09-05T01:41:57.728 INFO:teuthology.orchestra.run.smithi012.stdout: "statfs_send": 0, 2024-09-05T01:41:57.728 INFO:teuthology.orchestra.run.smithi012.stdout: "statfs_resend": 0, 2024-09-05T01:41:57.728 INFO:teuthology.orchestra.run.smithi012.stdout: "command_active": 0, 2024-09-05T01:41:57.728 INFO:teuthology.orchestra.run.smithi012.stdout: "command_send": 0, 2024-09-05T01:41:57.728 INFO:teuthology.orchestra.run.smithi012.stdout: "command_resend": 0, 2024-09-05T01:41:57.728 INFO:teuthology.orchestra.run.smithi012.stdout: "map_epoch": 106, 2024-09-05T01:41:57.728 INFO:teuthology.orchestra.run.smithi012.stdout: "map_full": 0, 2024-09-05T01:41:57.728 INFO:teuthology.orchestra.run.smithi012.stdout: "map_inc": 25, 2024-09-05T01:41:57.728 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_sessions": 11, 2024-09-05T01:41:57.728 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_session_open": 11, 2024-09-05T01:41:57.728 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_session_close": 0, 2024-09-05T01:41:57.728 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_laggy": 0, 2024-09-05T01:41:57.728 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_wr": 0, 2024-09-05T01:41:57.728 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_rd": 2, 2024-09-05T01:41:57.729 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_del": 0 2024-09-05T01:41:57.729 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.729 INFO:teuthology.orchestra.run.smithi012.stdout: "oft": { 2024-09-05T01:41:57.729 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_objs": 0, 2024-09-05T01:41:57.729 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_kv_pairs": 0, 2024-09-05T01:41:57.729 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_updates": 0, 2024-09-05T01:41:57.729 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_removes": 0 2024-09-05T01:41:57.729 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.729 INFO:teuthology.orchestra.run.smithi012.stdout: "osd-slow-ops": { 2024-09-05T01:41:57.729 INFO:teuthology.orchestra.run.smithi012.stdout: "slow_ops_count": 0 2024-09-05T01:41:57.729 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.729 INFO:teuthology.orchestra.run.smithi012.stdout: "purge_queue": { 2024-09-05T01:41:57.729 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing_ops": 0, 2024-09-05T01:41:57.730 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing_ops_high_water": 0, 2024-09-05T01:41:57.730 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing": 0, 2024-09-05T01:41:57.730 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing_high_water": 0, 2024-09-05T01:41:57.730 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executed_ops": 0, 2024-09-05T01:41:57.730 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executed": 0, 2024-09-05T01:41:57.730 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_item_in_journal": 0 2024-09-05T01:41:57.730 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.730 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T01:41:57.730 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-05T01:41:57.730 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2024-09-05T01:41:57.730 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-05T01:41:57.730 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 4450, 2024-09-05T01:41:57.730 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 431958376, 2024-09-05T01:41:57.730 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-05T01:41:57.731 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 4450, 2024-09-05T01:41:57.731 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-05T01:41:57.731 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-05T01:41:57.731 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 4450, 2024-09-05T01:41:57.731 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 431958376, 2024-09-05T01:41:57.731 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-05T01:41:57.731 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.731 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.731 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.731 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:57.731 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.731 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-objecter_bytes": { 2024-09-05T01:41:57.731 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-05T01:41:57.732 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2024-09-05T01:41:57.732 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-05T01:41:57.732 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-05T01:41:57.732 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-05T01:41:57.732 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-05T01:41:57.732 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-05T01:41:57.732 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 4046, 2024-09-05T01:41:57.732 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 429301875, 2024-09-05T01:41:57.732 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 4046, 2024-09-05T01:41:57.732 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 429301875, 2024-09-05T01:41:57.732 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-05T01:41:57.732 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.733 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.733 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.733 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:57.733 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.733 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-objecter_ops": { 2024-09-05T01:41:57.733 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-05T01:41:57.733 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 1024, 2024-09-05T01:41:57.733 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-05T01:41:57.733 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-05T01:41:57.733 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-05T01:41:57.733 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-05T01:41:57.733 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-05T01:41:57.734 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 4046, 2024-09-05T01:41:57.734 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 4046, 2024-09-05T01:41:57.734 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 4046, 2024-09-05T01:41:57.734 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 4046, 2024-09-05T01:41:57.734 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-05T01:41:57.734 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.734 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.734 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.734 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:57.734 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.734 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-write_buf_throttle": { 2024-09-05T01:41:57.734 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-05T01:41:57.735 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 3758096384, 2024-09-05T01:41:57.735 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-05T01:41:57.735 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-05T01:41:57.735 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-05T01:41:57.735 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-05T01:41:57.735 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-05T01:41:57.735 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-05T01:41:57.735 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-05T01:41:57.735 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 0, 2024-09-05T01:41:57.735 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 0, 2024-09-05T01:41:57.735 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-05T01:41:57.735 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.735 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.736 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.736 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:57.736 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:41:57.736 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-write_buf_throttle-0x55ad602f4be0": { 2024-09-05T01:41:57.736 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-05T01:41:57.736 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 3758096384, 2024-09-05T01:41:57.736 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-05T01:41:57.736 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-05T01:41:57.736 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-05T01:41:57.736 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-05T01:41:57.736 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-05T01:41:57.736 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-05T01:41:57.736 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-05T01:41:57.736 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 0, 2024-09-05T01:41:57.737 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 0, 2024-09-05T01:41:57.737 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-05T01:41:57.737 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:41:57.737 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:41:57.737 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:41:57.737 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:57.737 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:41:57.737 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:41:57.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:57 smithi145 ceph-mon[34376]: pgmap v540: 97 pgs: 33 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 48 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 956 KiB/s wr, 128 op/s 2024-09-05T01:41:57.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:57 smithi151 ceph-mon[35013]: pgmap v540: 97 pgs: 33 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 48 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 956 KiB/s wr, 128 op/s 2024-09-05T01:41:58.795 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-05T01:41:58.795 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-05T01:41:58.795 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-09-05T01:41:58.795 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-09-05T01:41:58.796 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-09-05T01:41:58.796 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=0 2024-09-05T01:41:58.796 DEBUG:tasks.check_counter:Getting stats from d 2024-09-05T01:41:58.796 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-05T01:41:59.439 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:41:59.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:41:59 smithi145 ceph-mon[34376]: pgmap v541: 97 pgs: 33 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 48 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 306 KiB/s wr, 80 op/s 2024-09-05T01:41:59.842 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:41:59 smithi012 ceph-mon[29942]: pgmap v541: 97 pgs: 33 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 48 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 306 KiB/s wr, 80 op/s 2024-09-05T01:41:59.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:41:59 smithi151 ceph-mon[35013]: pgmap v541: 97 pgs: 33 active+clean+snaptrim_wait, 16 active+clean+snaptrim, 48 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 306 KiB/s wr, 80 op/s 2024-09-05T01:42:00.225 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:42:00.225 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T01:42:00.225 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 4, 2024-09-05T01:42:00.225 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 4, 2024-09-05T01:42:00.225 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 2992, 2024-09-05T01:42:00.226 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 448, 2024-09-05T01:42:00.226 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 4, 2024-09-05T01:42:00.226 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 0, 2024-09-05T01:42:00.226 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.006444416, 2024-09-05T01:42:00.226 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.000082249, 2024-09-05T01:42:00.226 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.003459887, 2024-09-05T01:42:00.226 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T01:42:00.226 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:00.226 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 3, 2024-09-05T01:42:00.226 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.006056323, 2024-09-05T01:42:00.226 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.002018774 2024-09-05T01:42:00.226 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:00.227 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:00.227 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:00.227 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:00.227 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:00.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:00.227 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-05T01:42:00.227 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 448 2024-09-05T01:42:00.227 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:00.227 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T01:42:00.227 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 3, 2024-09-05T01:42:00.227 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 246, 2024-09-05T01:42:00.227 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 480, 2024-09-05T01:42:00.227 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 279264, 2024-09-05T01:42:00.227 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 6, 2024-09-05T01:42:00.228 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 3, 2024-09-05T01:42:00.228 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.030929856, 2024-09-05T01:42:00.228 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.022616860, 2024-09-05T01:42:00.228 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.003953458, 2024-09-05T01:42:00.228 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T01:42:00.228 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:00.228 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 243, 2024-09-05T01:42:00.228 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.037166906, 2024-09-05T01:42:00.228 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000152950 2024-09-05T01:42:00.228 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:00.228 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:00.228 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:00.228 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:00.229 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:00.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:00.229 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 480, 2024-09-05T01:42:00.229 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 279264 2024-09-05T01:42:00.229 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:00.229 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T01:42:00.229 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 331, 2024-09-05T01:42:00.229 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 320, 2024-09-05T01:42:00.229 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 1611872, 2024-09-05T01:42:00.229 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 197680, 2024-09-05T01:42:00.229 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 2, 2024-09-05T01:42:00.229 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 1, 2024-09-05T01:42:00.229 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.093490865, 2024-09-05T01:42:00.230 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.034166455, 2024-09-05T01:42:00.230 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.078164795, 2024-09-05T01:42:00.230 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T01:42:00.230 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:00.230 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 319, 2024-09-05T01:42:00.230 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.035900038, 2024-09-05T01:42:00.230 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000112539 2024-09-05T01:42:00.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:00.230 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:00.230 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:00.230 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:00.230 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:00.230 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:00.231 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 1611872, 2024-09-05T01:42:00.231 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 197680 2024-09-05T01:42:00.231 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:00.231 INFO:teuthology.orchestra.run.smithi012.stdout: "cct": { 2024-09-05T01:42:00.231 INFO:teuthology.orchestra.run.smithi012.stdout: "total_workers": 0, 2024-09-05T01:42:00.231 INFO:teuthology.orchestra.run.smithi012.stdout: "unhealthy_workers": 0 2024-09-05T01:42:00.231 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:00.231 INFO:teuthology.orchestra.run.smithi012.stdout: "mempool": { 2024-09-05T01:42:00.231 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_bytes": 0, 2024-09-05T01:42:00.231 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_items": 0, 2024-09-05T01:42:00.231 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T01:42:00.231 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_items": 0, 2024-09-05T01:42:00.231 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T01:42:00.231 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_items": 0, 2024-09-05T01:42:00.231 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T01:42:00.232 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T01:42:00.232 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T01:42:00.232 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T01:42:00.232 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T01:42:00.232 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_items": 0, 2024-09-05T01:42:00.232 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T01:42:00.232 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T01:42:00.232 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_bytes": 0, 2024-09-05T01:42:00.232 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_items": 0, 2024-09-05T01:42:00.232 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_bytes": 0, 2024-09-05T01:42:00.232 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_items": 0, 2024-09-05T01:42:00.232 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T01:42:00.232 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T01:42:00.233 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T01:42:00.233 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T01:42:00.233 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T01:42:00.233 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_items": 0, 2024-09-05T01:42:00.233 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_bytes": 0, 2024-09-05T01:42:00.233 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_items": 0, 2024-09-05T01:42:00.233 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T01:42:00.233 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T01:42:00.233 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_bytes": 0, 2024-09-05T01:42:00.233 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_items": 0, 2024-09-05T01:42:00.234 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_bytes": 0, 2024-09-05T01:42:00.234 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_items": 0, 2024-09-05T01:42:00.234 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T01:42:00.234 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_items": 0, 2024-09-05T01:42:00.234 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T01:42:00.234 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_items": 0, 2024-09-05T01:42:00.234 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_bytes": 148714, 2024-09-05T01:42:00.234 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_items": 30, 2024-09-05T01:42:00.234 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_bytes": 0, 2024-09-05T01:42:00.234 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_items": 0, 2024-09-05T01:42:00.234 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_bytes": 0, 2024-09-05T01:42:00.234 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_items": 0, 2024-09-05T01:42:00.234 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_bytes": 0, 2024-09-05T01:42:00.234 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_items": 0, 2024-09-05T01:42:00.235 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_bytes": 0, 2024-09-05T01:42:00.235 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_items": 0, 2024-09-05T01:42:00.235 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_bytes": 0, 2024-09-05T01:42:00.235 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_items": 0, 2024-09-05T01:42:00.235 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T01:42:00.235 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_items": 0, 2024-09-05T01:42:00.235 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_bytes": 0, 2024-09-05T01:42:00.235 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_items": 0, 2024-09-05T01:42:00.235 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_bytes": 928, 2024-09-05T01:42:00.235 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_items": 2, 2024-09-05T01:42:00.235 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_bytes": 0, 2024-09-05T01:42:00.235 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_items": 0, 2024-09-05T01:42:00.235 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_bytes": 0, 2024-09-05T01:42:00.235 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_items": 0 2024-09-05T01:42:00.235 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:00.236 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T01:42:00.236 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-05T01:42:00.236 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2024-09-05T01:42:00.236 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-05T01:42:00.236 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 334, 2024-09-05T01:42:00.236 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 1565158, 2024-09-05T01:42:00.236 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:00.236 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 334, 2024-09-05T01:42:00.236 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-05T01:42:00.236 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-05T01:42:00.236 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 334, 2024-09-05T01:42:00.236 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 1565158, 2024-09-05T01:42:00.236 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-05T01:42:00.236 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:00.236 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:00.237 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:00.237 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:42:00.237 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:42:00.237 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:42:01.846 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-05T01:42:01.846 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-05T01:42:01.846 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-05T01:42:01.847 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-05T01:42:01.847 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-05T01:42:01.847 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-05T01:42:01.847 DEBUG:tasks.check_counter:Getting stats from g 2024-09-05T01:42:01.847 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-05T01:42:01.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:01 smithi151 ceph-mon[35013]: pgmap v542: 97 pgs: 33 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 49 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 317 KiB/s wr, 72 op/s 2024-09-05T01:42:01.927 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:01 smithi012 ceph-mon[29942]: pgmap v542: 97 pgs: 33 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 49 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 317 KiB/s wr, 72 op/s 2024-09-05T01:42:02.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:01 smithi145 ceph-mon[34376]: pgmap v542: 97 pgs: 33 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 49 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 317 KiB/s wr, 72 op/s 2024-09-05T01:42:02.471 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:42:03.401 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:42:03.401 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T01:42:03.401 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 0, 2024-09-05T01:42:03.401 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 2, 2024-09-05T01:42:03.401 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 0, 2024-09-05T01:42:03.401 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 0, 2024-09-05T01:42:03.402 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 4, 2024-09-05T01:42:03.402 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 0, 2024-09-05T01:42:03.402 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.003574893, 2024-09-05T01:42:03.402 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.000000000, 2024-09-05T01:42:03.402 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.000548313, 2024-09-05T01:42:03.402 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T01:42:03.402 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:03.402 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:03.402 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:03.402 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:03.402 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:03.403 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:03.403 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:03.403 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:03.403 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:03.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:03.403 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-05T01:42:03.403 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 0 2024-09-05T01:42:03.403 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:03.403 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T01:42:03.403 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 7, 2024-09-05T01:42:03.403 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 245, 2024-09-05T01:42:03.403 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 3472, 2024-09-05T01:42:03.403 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 279184, 2024-09-05T01:42:03.404 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 6, 2024-09-05T01:42:03.404 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 3, 2024-09-05T01:42:03.404 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.033939111, 2024-09-05T01:42:03.404 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.022118117, 2024-09-05T01:42:03.404 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.007170087, 2024-09-05T01:42:03.404 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T01:42:03.404 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:03.404 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 243, 2024-09-05T01:42:03.404 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.054147024, 2024-09-05T01:42:03.404 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000222827 2024-09-05T01:42:03.404 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:03.404 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:03.405 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:03.405 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:03.405 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:03.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:03.405 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 3472, 2024-09-05T01:42:03.405 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 279184 2024-09-05T01:42:03.405 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:03.405 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T01:42:03.405 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 327, 2024-09-05T01:42:03.405 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 316, 2024-09-05T01:42:03.405 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 1610784, 2024-09-05T01:42:03.405 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 195120, 2024-09-05T01:42:03.405 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 2, 2024-09-05T01:42:03.405 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 1, 2024-09-05T01:42:03.406 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.082750574, 2024-09-05T01:42:03.406 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.038790816, 2024-09-05T01:42:03.406 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.059384380, 2024-09-05T01:42:03.406 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-05T01:42:03.406 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:03.406 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 315, 2024-09-05T01:42:03.406 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.041479836, 2024-09-05T01:42:03.406 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000131682 2024-09-05T01:42:03.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:03.406 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:03.406 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:03.406 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:03.406 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:03.406 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:03.407 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 1610784, 2024-09-05T01:42:03.407 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 195120 2024-09-05T01:42:03.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:03.407 INFO:teuthology.orchestra.run.smithi012.stdout: "cct": { 2024-09-05T01:42:03.407 INFO:teuthology.orchestra.run.smithi012.stdout: "total_workers": 0, 2024-09-05T01:42:03.407 INFO:teuthology.orchestra.run.smithi012.stdout: "unhealthy_workers": 0 2024-09-05T01:42:03.407 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:03.407 INFO:teuthology.orchestra.run.smithi012.stdout: "mempool": { 2024-09-05T01:42:03.407 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_bytes": 0, 2024-09-05T01:42:03.407 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_items": 0, 2024-09-05T01:42:03.407 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T01:42:03.407 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_items": 0, 2024-09-05T01:42:03.407 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T01:42:03.407 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_items": 0, 2024-09-05T01:42:03.408 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T01:42:03.408 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T01:42:03.408 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T01:42:03.408 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T01:42:03.408 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T01:42:03.408 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_items": 0, 2024-09-05T01:42:03.408 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T01:42:03.408 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T01:42:03.408 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_bytes": 0, 2024-09-05T01:42:03.408 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_items": 0, 2024-09-05T01:42:03.408 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_bytes": 0, 2024-09-05T01:42:03.408 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_items": 0, 2024-09-05T01:42:03.408 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T01:42:03.408 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T01:42:03.409 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T01:42:03.409 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T01:42:03.409 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T01:42:03.409 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_items": 0, 2024-09-05T01:42:03.409 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_bytes": 0, 2024-09-05T01:42:03.409 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_items": 0, 2024-09-05T01:42:03.409 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T01:42:03.409 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T01:42:03.409 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_bytes": 0, 2024-09-05T01:42:03.409 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_items": 0, 2024-09-05T01:42:03.409 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_bytes": 0, 2024-09-05T01:42:03.409 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_items": 0, 2024-09-05T01:42:03.409 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T01:42:03.409 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_items": 0, 2024-09-05T01:42:03.410 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T01:42:03.410 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_items": 0, 2024-09-05T01:42:03.410 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_bytes": 148714, 2024-09-05T01:42:03.410 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_items": 30, 2024-09-05T01:42:03.410 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_bytes": 0, 2024-09-05T01:42:03.410 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_items": 0, 2024-09-05T01:42:03.410 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_bytes": 0, 2024-09-05T01:42:03.410 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_items": 0, 2024-09-05T01:42:03.410 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_bytes": 0, 2024-09-05T01:42:03.410 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_items": 0, 2024-09-05T01:42:03.410 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_bytes": 0, 2024-09-05T01:42:03.410 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_items": 0, 2024-09-05T01:42:03.410 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_bytes": 0, 2024-09-05T01:42:03.411 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_items": 0, 2024-09-05T01:42:03.411 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T01:42:03.411 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_items": 0, 2024-09-05T01:42:03.411 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_bytes": 0, 2024-09-05T01:42:03.411 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_items": 0, 2024-09-05T01:42:03.411 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_bytes": 928, 2024-09-05T01:42:03.411 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_items": 2, 2024-09-05T01:42:03.411 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_bytes": 0, 2024-09-05T01:42:03.411 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_items": 0, 2024-09-05T01:42:03.411 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_bytes": 0, 2024-09-05T01:42:03.411 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_items": 0 2024-09-05T01:42:03.411 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:03.411 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T01:42:03.411 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-05T01:42:03.412 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2024-09-05T01:42:03.412 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-05T01:42:03.412 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 330, 2024-09-05T01:42:03.412 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 1564638, 2024-09-05T01:42:03.412 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:03.412 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 330, 2024-09-05T01:42:03.412 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-05T01:42:03.412 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-05T01:42:03.412 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 330, 2024-09-05T01:42:03.412 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 1564638, 2024-09-05T01:42:03.412 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-05T01:42:03.412 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:03.412 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:03.413 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:03.413 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:42:03.413 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:42:03.413 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:42:03.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:03 smithi151 ceph-mon[35013]: pgmap v543: 97 pgs: 33 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 50 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 47 KiB/s wr, 30 op/s 2024-09-05T01:42:03.870 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:03 smithi012 ceph-mon[29942]: pgmap v543: 97 pgs: 33 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 50 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 47 KiB/s wr, 30 op/s 2024-09-05T01:42:04.083 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:03 smithi145 ceph-mon[34376]: pgmap v543: 97 pgs: 33 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 50 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 47 KiB/s wr, 30 op/s 2024-09-05T01:42:04.310 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-05T01:42:04.310 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-05T01:42:04.310 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-05T01:42:04.310 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-05T01:42:04.310 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-05T01:42:04.311 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-09-05T01:42:04.311 DEBUG:tasks.check_counter:Getting stats from j 2024-09-05T01:42:04.311 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-05T01:42:04.964 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:42:05.779 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:05 smithi012 ceph-mon[29942]: pgmap v544: 97 pgs: 33 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 50 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 31 KiB/s wr, 20 op/s 2024-09-05T01:42:05.780 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-05T01:42:05.780 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T01:42:05.780 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 1224, 2024-09-05T01:42:05.780 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 1224, 2024-09-05T01:42:05.780 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 109380540, 2024-09-05T01:42:05.780 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 388472, 2024-09-05T01:42:05.781 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 8, 2024-09-05T01:42:05.781 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 4, 2024-09-05T01:42:05.781 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.351511348, 2024-09-05T01:42:05.781 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.040553772, 2024-09-05T01:42:05.781 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.235844942, 2024-09-05T01:42:05.781 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.059554817, 2024-09-05T01:42:05.781 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:05.781 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 1223, 2024-09-05T01:42:05.781 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.104691447, 2024-09-05T01:42:05.781 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000085602 2024-09-05T01:42:05.781 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.781 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:05.781 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.782 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.782 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.782 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.782 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-05T01:42:05.782 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 448 2024-09-05T01:42:05.782 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.782 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T01:42:05.782 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 1134, 2024-09-05T01:42:05.782 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 1074, 2024-09-05T01:42:05.782 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 128024405, 2024-09-05T01:42:05.782 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 433793, 2024-09-05T01:42:05.782 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 6, 2024-09-05T01:42:05.783 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 5, 2024-09-05T01:42:05.783 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.471179081, 2024-09-05T01:42:05.783 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.063374450, 2024-09-05T01:42:05.783 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.367378963, 2024-09-05T01:42:05.783 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.049910744, 2024-09-05T01:42:05.783 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:05.783 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 1073, 2024-09-05T01:42:05.783 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.107623588, 2024-09-05T01:42:05.783 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000100301 2024-09-05T01:42:05.783 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.783 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:05.783 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.784 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.784 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.784 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.784 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 1974464, 2024-09-05T01:42:05.784 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 204192 2024-09-05T01:42:05.784 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.784 INFO:teuthology.orchestra.run.smithi012.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T01:42:05.784 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_messages": 2109, 2024-09-05T01:42:05.784 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages": 2353, 2024-09-05T01:42:05.784 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_bytes": 113592403, 2024-09-05T01:42:05.784 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_bytes": 1260698, 2024-09-05T01:42:05.784 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_created_connections": 8, 2024-09-05T01:42:05.785 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_active_connections": 6, 2024-09-05T01:42:05.785 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_total_time": 0.630596367, 2024-09-05T01:42:05.785 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_send_time": 0.148437595, 2024-09-05T01:42:05.789 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_recv_time": 0.318430611, 2024-09-05T01:42:05.789 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_running_fast_dispatch_time": 0.125348680, 2024-09-05T01:42:05.789 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:05.789 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 2350, 2024-09-05T01:42:05.789 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.258860817, 2024-09-05T01:42:05.789 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000110153 2024-09-05T01:42:05.789 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.790 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:05.790 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.790 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.790 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.790 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.790 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-05T01:42:05.790 INFO:teuthology.orchestra.run.smithi012.stdout: "msgr_send_encrypted_bytes": 590672 2024-09-05T01:42:05.790 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.790 INFO:teuthology.orchestra.run.smithi012.stdout: "cct": { 2024-09-05T01:42:05.790 INFO:teuthology.orchestra.run.smithi012.stdout: "total_workers": 1, 2024-09-05T01:42:05.790 INFO:teuthology.orchestra.run.smithi012.stdout: "unhealthy_workers": 0 2024-09-05T01:42:05.790 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.790 INFO:teuthology.orchestra.run.smithi012.stdout: "finisher-MDSRank": { 2024-09-05T01:42:05.791 INFO:teuthology.orchestra.run.smithi012.stdout: "queue_len": 0, 2024-09-05T01:42:05.791 INFO:teuthology.orchestra.run.smithi012.stdout: "complete_latency": { 2024-09-05T01:42:05.791 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 6491, 2024-09-05T01:42:05.791 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.241200721, 2024-09-05T01:42:05.791 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000037159 2024-09-05T01:42:05.791 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:42:05.791 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.791 INFO:teuthology.orchestra.run.smithi012.stdout: "finisher-PurgeQueue": { 2024-09-05T01:42:05.791 INFO:teuthology.orchestra.run.smithi012.stdout: "queue_len": 0, 2024-09-05T01:42:05.791 INFO:teuthology.orchestra.run.smithi012.stdout: "complete_latency": { 2024-09-05T01:42:05.791 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.791 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.791 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.792 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:42:05.792 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.792 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": { 2024-09-05T01:42:05.792 INFO:teuthology.orchestra.run.smithi012.stdout: "request": 0, 2024-09-05T01:42:05.792 INFO:teuthology.orchestra.run.smithi012.stdout: "reply": 0, 2024-09-05T01:42:05.792 INFO:teuthology.orchestra.run.smithi012.stdout: "reply_latency": { 2024-09-05T01:42:05.792 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.792 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.792 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.792 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.792 INFO:teuthology.orchestra.run.smithi012.stdout: "slow_reply": 0, 2024-09-05T01:42:05.792 INFO:teuthology.orchestra.run.smithi012.stdout: "forward": 0, 2024-09-05T01:42:05.792 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_fetch_complete": 0, 2024-09-05T01:42:05.793 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_fetch_keys": 0, 2024-09-05T01:42:05.793 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_commit": 0, 2024-09-05T01:42:05.793 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_split": 0, 2024-09-05T01:42:05.793 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_merge": 0, 2024-09-05T01:42:05.793 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes": 37017, 2024-09-05T01:42:05.793 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_top": 2160, 2024-09-05T01:42:05.793 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_bottom": 34857, 2024-09-05T01:42:05.793 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_pin_tail": 0, 2024-09-05T01:42:05.793 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_pinned": 33930, 2024-09-05T01:42:05.793 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_expired": 0, 2024-09-05T01:42:05.793 INFO:teuthology.orchestra.run.smithi012.stdout: "inodes_with_caps": 0, 2024-09-05T01:42:05.793 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": 0, 2024-09-05T01:42:05.793 INFO:teuthology.orchestra.run.smithi012.stdout: "subtrees": 1, 2024-09-05T01:42:05.794 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse": 0, 2024-09-05T01:42:05.794 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_hit": 0, 2024-09-05T01:42:05.794 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_forward": 0, 2024-09-05T01:42:05.794 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_discover": 0, 2024-09-05T01:42:05.794 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_dir_fetch": 0, 2024-09-05T01:42:05.794 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_remote_ino": 0, 2024-09-05T01:42:05.794 INFO:teuthology.orchestra.run.smithi012.stdout: "traverse_lock": 0, 2024-09-05T01:42:05.794 INFO:teuthology.orchestra.run.smithi012.stdout: "load_cent": 0, 2024-09-05T01:42:05.794 INFO:teuthology.orchestra.run.smithi012.stdout: "q": 0, 2024-09-05T01:42:05.794 INFO:teuthology.orchestra.run.smithi012.stdout: "exported": 0, 2024-09-05T01:42:05.794 INFO:teuthology.orchestra.run.smithi012.stdout: "exported_inodes": 0, 2024-09-05T01:42:05.794 INFO:teuthology.orchestra.run.smithi012.stdout: "imported": 0, 2024-09-05T01:42:05.795 INFO:teuthology.orchestra.run.smithi012.stdout: "imported_inodes": 0, 2024-09-05T01:42:05.795 INFO:teuthology.orchestra.run.smithi012.stdout: "openino_dir_fetch": 0, 2024-09-05T01:42:05.795 INFO:teuthology.orchestra.run.smithi012.stdout: "openino_backtrace_fetch": 0, 2024-09-05T01:42:05.795 INFO:teuthology.orchestra.run.smithi012.stdout: "openino_peer_discover": 0, 2024-09-05T01:42:05.795 INFO:teuthology.orchestra.run.smithi012.stdout: "root_rfiles": 0, 2024-09-05T01:42:05.795 INFO:teuthology.orchestra.run.smithi012.stdout: "root_rbytes": 0, 2024-09-05T01:42:05.795 INFO:teuthology.orchestra.run.smithi012.stdout: "root_rsnaps": 0, 2024-09-05T01:42:05.795 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_backtrace_fetch": 0, 2024-09-05T01:42:05.795 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_set_tag": 0, 2024-09-05T01:42:05.796 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T01:42:05.796 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_inotable_repaired": 0, 2024-09-05T01:42:05.796 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_dir_inodes": 0, 2024-09-05T01:42:05.796 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_dir_base_inodes": 0, 2024-09-05T01:42:05.796 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_dirfrag_rstats": 0, 2024-09-05T01:42:05.796 INFO:teuthology.orchestra.run.smithi012.stdout: "scrub_file_inodes": 0, 2024-09-05T01:42:05.796 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_inode_file_caps": 0, 2024-09-05T01:42:05.796 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_revoke": 0, 2024-09-05T01:42:05.796 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_grant": 0, 2024-09-05T01:42:05.796 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_trunc": 0, 2024-09-05T01:42:05.796 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T01:42:05.796 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T01:42:05.796 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_caps": 0, 2024-09-05T01:42:05.797 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_caps_dirty": 0, 2024-09-05T01:42:05.797 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_cap_release": 0, 2024-09-05T01:42:05.797 INFO:teuthology.orchestra.run.smithi012.stdout: "process_request_cap_release": 0 2024-09-05T01:42:05.797 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.797 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_cache": { 2024-09-05T01:42:05.797 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_update": 0, 2024-09-05T01:42:05.797 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_update_receipt": 0, 2024-09-05T01:42:05.797 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_try_discover": 0, 2024-09-05T01:42:05.797 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_send_discover": 0, 2024-09-05T01:42:05.797 INFO:teuthology.orchestra.run.smithi012.stdout: "dir_handle_discover": 0, 2024-09-05T01:42:05.797 INFO:teuthology.orchestra.run.smithi012.stdout: "num_strays": 0, 2024-09-05T01:42:05.797 INFO:teuthology.orchestra.run.smithi012.stdout: "num_strays_delayed": 0, 2024-09-05T01:42:05.797 INFO:teuthology.orchestra.run.smithi012.stdout: "num_strays_enqueuing": 0, 2024-09-05T01:42:05.798 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_created": 0, 2024-09-05T01:42:05.798 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_enqueued": 0, 2024-09-05T01:42:05.798 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_reintegrated": 0, 2024-09-05T01:42:05.798 INFO:teuthology.orchestra.run.smithi012.stdout: "strays_migrated": 0, 2024-09-05T01:42:05.798 INFO:teuthology.orchestra.run.smithi012.stdout: "num_recovering_processing": 0, 2024-09-05T01:42:05.798 INFO:teuthology.orchestra.run.smithi012.stdout: "num_recovering_enqueued": 0, 2024-09-05T01:42:05.798 INFO:teuthology.orchestra.run.smithi012.stdout: "num_recovering_prioritized": 0, 2024-09-05T01:42:05.798 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_started": 0, 2024-09-05T01:42:05.798 INFO:teuthology.orchestra.run.smithi012.stdout: "recovery_completed": 0, 2024-09-05T01:42:05.798 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_quiesce_path": 0, 2024-09-05T01:42:05.799 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_quiesce_inode": 0, 2024-09-05T01:42:05.799 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_enqueue_scrub": 0, 2024-09-05T01:42:05.799 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_exportdir": 0, 2024-09-05T01:42:05.799 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_flush": 0, 2024-09-05T01:42:05.799 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_fragmentdir": 0, 2024-09-05T01:42:05.799 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_fragstats": 0, 2024-09-05T01:42:05.799 INFO:teuthology.orchestra.run.smithi012.stdout: "ireq_inodestats": 0 2024-09-05T01:42:05.799 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.799 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_log": { 2024-09-05T01:42:05.799 INFO:teuthology.orchestra.run.smithi012.stdout: "evlrg": 0, 2024-09-05T01:42:05.799 INFO:teuthology.orchestra.run.smithi012.stdout: "evadd": 0, 2024-09-05T01:42:05.799 INFO:teuthology.orchestra.run.smithi012.stdout: "evex": 0, 2024-09-05T01:42:05.799 INFO:teuthology.orchestra.run.smithi012.stdout: "evtrm": 0, 2024-09-05T01:42:05.799 INFO:teuthology.orchestra.run.smithi012.stdout: "ev": 106080, 2024-09-05T01:42:05.800 INFO:teuthology.orchestra.run.smithi012.stdout: "evexg": 0, 2024-09-05T01:42:05.800 INFO:teuthology.orchestra.run.smithi012.stdout: "evexd": 0, 2024-09-05T01:42:05.800 INFO:teuthology.orchestra.run.smithi012.stdout: "segadd": 0, 2024-09-05T01:42:05.800 INFO:teuthology.orchestra.run.smithi012.stdout: "segex": 0, 2024-09-05T01:42:05.800 INFO:teuthology.orchestra.run.smithi012.stdout: "segtrm": 0, 2024-09-05T01:42:05.800 INFO:teuthology.orchestra.run.smithi012.stdout: "seg": 129, 2024-09-05T01:42:05.800 INFO:teuthology.orchestra.run.smithi012.stdout: "segmjr": 10, 2024-09-05T01:42:05.800 INFO:teuthology.orchestra.run.smithi012.stdout: "segexg": 0, 2024-09-05T01:42:05.800 INFO:teuthology.orchestra.run.smithi012.stdout: "segexd": 0, 2024-09-05T01:42:05.800 INFO:teuthology.orchestra.run.smithi012.stdout: "expos": 32948863, 2024-09-05T01:42:05.800 INFO:teuthology.orchestra.run.smithi012.stdout: "wrpos": 352010557, 2024-09-05T01:42:05.800 INFO:teuthology.orchestra.run.smithi012.stdout: "rdpos": 352002290, 2024-09-05T01:42:05.801 INFO:teuthology.orchestra.run.smithi012.stdout: "jlat": { 2024-09-05T01:42:05.801 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.801 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.801 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.801 INFO:teuthology.orchestra.run.smithi012.stdout: "replayed": 106080 2024-09-05T01:42:05.801 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.801 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_mem": { 2024-09-05T01:42:05.801 INFO:teuthology.orchestra.run.smithi012.stdout: "ino": 14133, 2024-09-05T01:42:05.801 INFO:teuthology.orchestra.run.smithi012.stdout: "ino+": 76563, 2024-09-05T01:42:05.801 INFO:teuthology.orchestra.run.smithi012.stdout: "ino-": 62430, 2024-09-05T01:42:05.801 INFO:teuthology.orchestra.run.smithi012.stdout: "dir": 394, 2024-09-05T01:42:05.801 INFO:teuthology.orchestra.run.smithi012.stdout: "dir+": 2691, 2024-09-05T01:42:05.802 INFO:teuthology.orchestra.run.smithi012.stdout: "dir-": 2297, 2024-09-05T01:42:05.802 INFO:teuthology.orchestra.run.smithi012.stdout: "dn": 37017, 2024-09-05T01:42:05.802 INFO:teuthology.orchestra.run.smithi012.stdout: "dn+": 126168, 2024-09-05T01:42:05.802 INFO:teuthology.orchestra.run.smithi012.stdout: "dn-": 89151, 2024-09-05T01:42:05.802 INFO:teuthology.orchestra.run.smithi012.stdout: "cap": 0, 2024-09-05T01:42:05.802 INFO:teuthology.orchestra.run.smithi012.stdout: "cap+": 0, 2024-09-05T01:42:05.802 INFO:teuthology.orchestra.run.smithi012.stdout: "cap-": 0, 2024-09-05T01:42:05.802 INFO:teuthology.orchestra.run.smithi012.stdout: "rss": 152640, 2024-09-05T01:42:05.802 INFO:teuthology.orchestra.run.smithi012.stdout: "heap": 215328 2024-09-05T01:42:05.802 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.802 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_server": { 2024-09-05T01:42:05.802 INFO:teuthology.orchestra.run.smithi012.stdout: "dispatch_client_request": 0, 2024-09-05T01:42:05.802 INFO:teuthology.orchestra.run.smithi012.stdout: "dispatch_server_request": 0, 2024-09-05T01:42:05.802 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_request": 0, 2024-09-05T01:42:05.803 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_client_session": 0, 2024-09-05T01:42:05.803 INFO:teuthology.orchestra.run.smithi012.stdout: "handle_peer_request": 0, 2024-09-05T01:42:05.803 INFO:teuthology.orchestra.run.smithi012.stdout: "req_create_latency": { 2024-09-05T01:42:05.803 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.803 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.803 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.803 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.803 INFO:teuthology.orchestra.run.smithi012.stdout: "req_getattr_latency": { 2024-09-05T01:42:05.803 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.803 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.803 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.803 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.803 INFO:teuthology.orchestra.run.smithi012.stdout: "req_getfilelock_latency": { 2024-09-05T01:42:05.803 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.804 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.804 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.804 INFO:teuthology.orchestra.run.smithi012.stdout: "req_link_latency": { 2024-09-05T01:42:05.804 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.804 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.804 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.804 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookup_latency": { 2024-09-05T01:42:05.804 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.804 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.804 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.804 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.805 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookuphash_latency": { 2024-09-05T01:42:05.805 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.805 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.805 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.805 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.805 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupino_latency": { 2024-09-05T01:42:05.805 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.805 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.805 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.805 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.805 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupname_latency": { 2024-09-05T01:42:05.805 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.805 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.805 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.806 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.806 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupparent_latency": { 2024-09-05T01:42:05.806 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.806 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.806 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.806 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.806 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lookupsnap_latency": { 2024-09-05T01:42:05.806 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.806 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.806 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.806 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.806 INFO:teuthology.orchestra.run.smithi012.stdout: "req_lssnap_latency": { 2024-09-05T01:42:05.806 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.807 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.807 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.807 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.807 INFO:teuthology.orchestra.run.smithi012.stdout: "req_mkdir_latency": { 2024-09-05T01:42:05.807 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.807 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.808 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.808 INFO:teuthology.orchestra.run.smithi012.stdout: "req_mknod_latency": { 2024-09-05T01:42:05.808 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.808 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.808 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.808 INFO:teuthology.orchestra.run.smithi012.stdout: "req_mksnap_latency": { 2024-09-05T01:42:05.808 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.808 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.808 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.808 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.808 INFO:teuthology.orchestra.run.smithi012.stdout: "req_open_latency": { 2024-09-05T01:42:05.808 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.809 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.809 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.809 INFO:teuthology.orchestra.run.smithi012.stdout: "req_readdir_latency": { 2024-09-05T01:42:05.809 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.809 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.809 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.809 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rename_latency": { 2024-09-05T01:42:05.809 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.809 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.809 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.809 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.809 INFO:teuthology.orchestra.run.smithi012.stdout: "req_renamesnap_latency": { 2024-09-05T01:42:05.810 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.810 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.810 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.810 INFO:teuthology.orchestra.run.smithi012.stdout: "req_snapdiff_latency": { 2024-09-05T01:42:05.810 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.810 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.810 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.810 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rmdir_latency": { 2024-09-05T01:42:05.810 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.810 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.810 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.810 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.811 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rmsnap_latency": { 2024-09-05T01:42:05.811 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.811 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.811 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.811 INFO:teuthology.orchestra.run.smithi012.stdout: "req_rmxattr_latency": { 2024-09-05T01:42:05.811 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.811 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.811 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.811 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.811 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setattr_latency": { 2024-09-05T01:42:05.811 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.811 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.811 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.812 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setdirlayout_latency": { 2024-09-05T01:42:05.812 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.812 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.812 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.812 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setfilelock_latency": { 2024-09-05T01:42:05.812 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.812 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.812 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.812 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.812 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setlayout_latency": { 2024-09-05T01:42:05.812 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.812 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.813 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.813 INFO:teuthology.orchestra.run.smithi012.stdout: "req_setxattr_latency": { 2024-09-05T01:42:05.813 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.813 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.813 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.813 INFO:teuthology.orchestra.run.smithi012.stdout: "req_symlink_latency": { 2024-09-05T01:42:05.813 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.813 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.813 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.813 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.813 INFO:teuthology.orchestra.run.smithi012.stdout: "req_unlink_latency": { 2024-09-05T01:42:05.813 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.814 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.814 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.814 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_revoke_eviction": 0, 2024-09-05T01:42:05.814 INFO:teuthology.orchestra.run.smithi012.stdout: "cap_acquisition_throttle": 0, 2024-09-05T01:42:05.814 INFO:teuthology.orchestra.run.smithi012.stdout: "req_getvxattr_latency": { 2024-09-05T01:42:05.814 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.814 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.814 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.814 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:42:05.814 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.814 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_sessions": { 2024-09-05T01:42:05.814 INFO:teuthology.orchestra.run.smithi012.stdout: "session_count": 1, 2024-09-05T01:42:05.814 INFO:teuthology.orchestra.run.smithi012.stdout: "session_add": 4, 2024-09-05T01:42:05.815 INFO:teuthology.orchestra.run.smithi012.stdout: "session_remove": 3, 2024-09-05T01:42:05.815 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions_open": 3, 2024-09-05T01:42:05.815 INFO:teuthology.orchestra.run.smithi012.stdout: "sessions_stale": 0, 2024-09-05T01:42:05.815 INFO:teuthology.orchestra.run.smithi012.stdout: "total_load": 0, 2024-09-05T01:42:05.815 INFO:teuthology.orchestra.run.smithi012.stdout: "average_load": 0, 2024-09-05T01:42:05.815 INFO:teuthology.orchestra.run.smithi012.stdout: "avg_session_uptime": 4368, 2024-09-05T01:42:05.815 INFO:teuthology.orchestra.run.smithi012.stdout: "mdthresh_evicted": 0 2024-09-05T01:42:05.815 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.815 INFO:teuthology.orchestra.run.smithi012.stdout: "mempool": { 2024-09-05T01:42:05.815 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_bytes": 0, 2024-09-05T01:42:05.815 INFO:teuthology.orchestra.run.smithi012.stdout: "bloom_filter_items": 0, 2024-09-05T01:42:05.815 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T01:42:05.815 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_alloc_items": 0, 2024-09-05T01:42:05.815 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T01:42:05.816 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_data_items": 0, 2024-09-05T01:42:05.816 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T01:42:05.816 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T01:42:05.816 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T01:42:05.816 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T01:42:05.816 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T01:42:05.816 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_other_items": 0, 2024-09-05T01:42:05.816 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T01:42:05.816 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T01:42:05.816 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_bytes": 0, 2024-09-05T01:42:05.816 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_extent_items": 0, 2024-09-05T01:42:05.816 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_bytes": 0, 2024-09-05T01:42:05.816 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_blob_items": 0, 2024-09-05T01:42:05.816 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T01:42:05.816 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T01:42:05.817 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T01:42:05.817 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T01:42:05.817 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T01:42:05.817 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_fsck_items": 0, 2024-09-05T01:42:05.817 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_bytes": 0, 2024-09-05T01:42:05.817 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_txc_items": 0, 2024-09-05T01:42:05.817 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T01:42:05.817 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T01:42:05.817 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_bytes": 0, 2024-09-05T01:42:05.817 INFO:teuthology.orchestra.run.smithi012.stdout: "bluestore_writing_items": 0, 2024-09-05T01:42:05.817 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_bytes": 0, 2024-09-05T01:42:05.817 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_items": 0, 2024-09-05T01:42:05.817 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T01:42:05.817 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_reader_items": 0, 2024-09-05T01:42:05.818 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T01:42:05.818 INFO:teuthology.orchestra.run.smithi012.stdout: "bluefs_file_writer_items": 0, 2024-09-05T01:42:05.818 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_bytes": 773612, 2024-09-05T01:42:05.818 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_anon_items": 14470, 2024-09-05T01:42:05.818 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_bytes": 0, 2024-09-05T01:42:05.818 INFO:teuthology.orchestra.run.smithi012.stdout: "buffer_meta_items": 0, 2024-09-05T01:42:05.818 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_bytes": 0, 2024-09-05T01:42:05.818 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_items": 0, 2024-09-05T01:42:05.818 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_bytes": 0, 2024-09-05T01:42:05.818 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_mapbl_items": 0, 2024-09-05T01:42:05.818 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_bytes": 0, 2024-09-05T01:42:05.818 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_pglog_items": 0, 2024-09-05T01:42:05.818 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_bytes": 8512, 2024-09-05T01:42:05.818 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_items": 191, 2024-09-05T01:42:05.818 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T01:42:05.819 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_mapping_items": 0, 2024-09-05T01:42:05.819 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_bytes": 0, 2024-09-05T01:42:05.819 INFO:teuthology.orchestra.run.smithi012.stdout: "pgmap_items": 0, 2024-09-05T01:42:05.819 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_bytes": 59351922, 2024-09-05T01:42:05.819 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_co_items": 556303, 2024-09-05T01:42:05.819 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_bytes": 0, 2024-09-05T01:42:05.819 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_1_items": 0, 2024-09-05T01:42:05.819 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_bytes": 0, 2024-09-05T01:42:05.819 INFO:teuthology.orchestra.run.smithi012.stdout: "unittest_2_items": 0 2024-09-05T01:42:05.819 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.819 INFO:teuthology.orchestra.run.smithi012.stdout: "objecter": { 2024-09-05T01:42:05.819 INFO:teuthology.orchestra.run.smithi012.stdout: "op_active": 0, 2024-09-05T01:42:05.819 INFO:teuthology.orchestra.run.smithi012.stdout: "op_laggy": 0, 2024-09-05T01:42:05.820 INFO:teuthology.orchestra.run.smithi012.stdout: "op_send": 4049, 2024-09-05T01:42:05.820 INFO:teuthology.orchestra.run.smithi012.stdout: "op_send_bytes": 21, 2024-09-05T01:42:05.820 INFO:teuthology.orchestra.run.smithi012.stdout: "op_resend": 3, 2024-09-05T01:42:05.820 INFO:teuthology.orchestra.run.smithi012.stdout: "op_reply": 4049, 2024-09-05T01:42:05.820 INFO:teuthology.orchestra.run.smithi012.stdout: "op_latency": { 2024-09-05T01:42:05.820 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 4049, 2024-09-05T01:42:05.820 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 24.857778508, 2024-09-05T01:42:05.820 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.006139238 2024-09-05T01:42:05.820 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.820 INFO:teuthology.orchestra.run.smithi012.stdout: "op_inflight": 0, 2024-09-05T01:42:05.820 INFO:teuthology.orchestra.run.smithi012.stdout: "oplen_avg": { 2024-09-05T01:42:05.820 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 4049, 2024-09-05T01:42:05.820 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 4050 2024-09-05T01:42:05.821 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.821 INFO:teuthology.orchestra.run.smithi012.stdout: "op": 4049, 2024-09-05T01:42:05.821 INFO:teuthology.orchestra.run.smithi012.stdout: "op_r": 4049, 2024-09-05T01:42:05.821 INFO:teuthology.orchestra.run.smithi012.stdout: "op_w": 0, 2024-09-05T01:42:05.821 INFO:teuthology.orchestra.run.smithi012.stdout: "op_rmw": 0, 2024-09-05T01:42:05.821 INFO:teuthology.orchestra.run.smithi012.stdout: "op_pg": 0, 2024-09-05T01:42:05.821 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_stat": 2462, 2024-09-05T01:42:05.821 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_create": 0, 2024-09-05T01:42:05.821 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_read": 1585, 2024-09-05T01:42:05.821 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_write": 0, 2024-09-05T01:42:05.821 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_writefull": 0, 2024-09-05T01:42:05.821 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_writesame": 0, 2024-09-05T01:42:05.821 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_append": 0, 2024-09-05T01:42:05.821 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_zero": 0, 2024-09-05T01:42:05.822 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_truncate": 0, 2024-09-05T01:42:05.822 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_delete": 0, 2024-09-05T01:42:05.822 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_mapext": 0, 2024-09-05T01:42:05.822 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_sparse_read": 0, 2024-09-05T01:42:05.822 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_clonerange": 0, 2024-09-05T01:42:05.822 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_getxattr": 1, 2024-09-05T01:42:05.822 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_setxattr": 0, 2024-09-05T01:42:05.822 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_cmpxattr": 0, 2024-09-05T01:42:05.822 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_rmxattr": 0, 2024-09-05T01:42:05.822 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_resetxattrs": 0, 2024-09-05T01:42:05.822 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_call": 0, 2024-09-05T01:42:05.822 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_watch": 0, 2024-09-05T01:42:05.822 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_notify": 0, 2024-09-05T01:42:05.822 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T01:42:05.823 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_pgls": 0, 2024-09-05T01:42:05.823 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_pgls_filter": 0, 2024-09-05T01:42:05.823 INFO:teuthology.orchestra.run.smithi012.stdout: "osdop_other": 0, 2024-09-05T01:42:05.823 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_active": 0, 2024-09-05T01:42:05.823 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_send": 0, 2024-09-05T01:42:05.823 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_resend": 0, 2024-09-05T01:42:05.823 INFO:teuthology.orchestra.run.smithi012.stdout: "linger_ping": 0, 2024-09-05T01:42:05.823 INFO:teuthology.orchestra.run.smithi012.stdout: "poolop_active": 0, 2024-09-05T01:42:05.823 INFO:teuthology.orchestra.run.smithi012.stdout: "poolop_send": 0, 2024-09-05T01:42:05.823 INFO:teuthology.orchestra.run.smithi012.stdout: "poolop_resend": 0, 2024-09-05T01:42:05.823 INFO:teuthology.orchestra.run.smithi012.stdout: "poolstat_active": 0, 2024-09-05T01:42:05.823 INFO:teuthology.orchestra.run.smithi012.stdout: "poolstat_send": 0, 2024-09-05T01:42:05.823 INFO:teuthology.orchestra.run.smithi012.stdout: "poolstat_resend": 0, 2024-09-05T01:42:05.823 INFO:teuthology.orchestra.run.smithi012.stdout: "statfs_active": 0, 2024-09-05T01:42:05.824 INFO:teuthology.orchestra.run.smithi012.stdout: "statfs_send": 0, 2024-09-05T01:42:05.824 INFO:teuthology.orchestra.run.smithi012.stdout: "statfs_resend": 0, 2024-09-05T01:42:05.824 INFO:teuthology.orchestra.run.smithi012.stdout: "command_active": 0, 2024-09-05T01:42:05.824 INFO:teuthology.orchestra.run.smithi012.stdout: "command_send": 0, 2024-09-05T01:42:05.824 INFO:teuthology.orchestra.run.smithi012.stdout: "command_resend": 0, 2024-09-05T01:42:05.824 INFO:teuthology.orchestra.run.smithi012.stdout: "map_epoch": 106, 2024-09-05T01:42:05.824 INFO:teuthology.orchestra.run.smithi012.stdout: "map_full": 0, 2024-09-05T01:42:05.824 INFO:teuthology.orchestra.run.smithi012.stdout: "map_inc": 25, 2024-09-05T01:42:05.824 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_sessions": 11, 2024-09-05T01:42:05.824 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_session_open": 11, 2024-09-05T01:42:05.824 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_session_close": 0, 2024-09-05T01:42:05.824 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_laggy": 0, 2024-09-05T01:42:05.824 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_wr": 0, 2024-09-05T01:42:05.824 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_rd": 2, 2024-09-05T01:42:05.824 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_del": 0 2024-09-05T01:42:05.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.825 INFO:teuthology.orchestra.run.smithi012.stdout: "oft": { 2024-09-05T01:42:05.825 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_objs": 0, 2024-09-05T01:42:05.825 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_kv_pairs": 0, 2024-09-05T01:42:05.825 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_updates": 0, 2024-09-05T01:42:05.825 INFO:teuthology.orchestra.run.smithi012.stdout: "omap_total_removes": 0 2024-09-05T01:42:05.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.825 INFO:teuthology.orchestra.run.smithi012.stdout: "osd-slow-ops": { 2024-09-05T01:42:05.825 INFO:teuthology.orchestra.run.smithi012.stdout: "slow_ops_count": 0 2024-09-05T01:42:05.825 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.825 INFO:teuthology.orchestra.run.smithi012.stdout: "purge_queue": { 2024-09-05T01:42:05.825 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing_ops": 0, 2024-09-05T01:42:05.825 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing_ops_high_water": 0, 2024-09-05T01:42:05.825 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing": 0, 2024-09-05T01:42:05.826 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executing_high_water": 0, 2024-09-05T01:42:05.826 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executed_ops": 0, 2024-09-05T01:42:05.826 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_executed": 0, 2024-09-05T01:42:05.826 INFO:teuthology.orchestra.run.smithi012.stdout: "pq_item_in_journal": 0 2024-09-05T01:42:05.826 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.826 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T01:42:05.826 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-05T01:42:05.826 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2024-09-05T01:42:05.826 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-05T01:42:05.826 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 4463, 2024-09-05T01:42:05.826 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 350571783, 2024-09-05T01:42:05.826 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:05.826 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 4463, 2024-09-05T01:42:05.826 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-05T01:42:05.827 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-05T01:42:05.827 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 4463, 2024-09-05T01:42:05.827 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 350571783, 2024-09-05T01:42:05.827 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-05T01:42:05.827 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.827 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.827 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.827 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:42:05.827 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.827 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-objecter_bytes": { 2024-09-05T01:42:05.827 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-05T01:42:05.827 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 104857600, 2024-09-05T01:42:05.827 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-05T01:42:05.827 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-05T01:42:05.828 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-05T01:42:05.828 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:05.828 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:05.828 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 4049, 2024-09-05T01:42:05.828 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 347895556, 2024-09-05T01:42:05.828 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 4049, 2024-09-05T01:42:05.828 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 347895556, 2024-09-05T01:42:05.828 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-05T01:42:05.828 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.828 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.828 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.828 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:42:05.828 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.829 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-objecter_ops": { 2024-09-05T01:42:05.829 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-05T01:42:05.829 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 1024, 2024-09-05T01:42:05.829 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-05T01:42:05.829 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-05T01:42:05.829 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-05T01:42:05.829 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:05.829 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:05.829 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 4049, 2024-09-05T01:42:05.829 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 4049, 2024-09-05T01:42:05.829 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 4049, 2024-09-05T01:42:05.829 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 4049, 2024-09-05T01:42:05.829 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-05T01:42:05.830 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.830 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.830 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.830 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:42:05.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.830 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-write_buf_throttle": { 2024-09-05T01:42:05.830 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-05T01:42:05.830 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 3758096384, 2024-09-05T01:42:05.830 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-05T01:42:05.830 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-05T01:42:05.830 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-05T01:42:05.830 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:05.830 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:05.830 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-05T01:42:05.830 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-05T01:42:05.831 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 0, 2024-09-05T01:42:05.831 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 0, 2024-09-05T01:42:05.831 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-05T01:42:05.831 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.831 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.831 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.831 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:42:05.831 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-09-05T01:42:05.831 INFO:teuthology.orchestra.run.smithi012.stdout: "throttle-write_buf_throttle-0x564e60d62be0": { 2024-09-05T01:42:05.831 INFO:teuthology.orchestra.run.smithi012.stdout: "val": 0, 2024-09-05T01:42:05.831 INFO:teuthology.orchestra.run.smithi012.stdout: "max": 3758096384, 2024-09-05T01:42:05.831 INFO:teuthology.orchestra.run.smithi012.stdout: "get_started": 0, 2024-09-05T01:42:05.831 INFO:teuthology.orchestra.run.smithi012.stdout: "get": 0, 2024-09-05T01:42:05.831 INFO:teuthology.orchestra.run.smithi012.stdout: "get_sum": 0, 2024-09-05T01:42:05.831 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:05.832 INFO:teuthology.orchestra.run.smithi012.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:05.832 INFO:teuthology.orchestra.run.smithi012.stdout: "take": 0, 2024-09-05T01:42:05.832 INFO:teuthology.orchestra.run.smithi012.stdout: "take_sum": 0, 2024-09-05T01:42:05.832 INFO:teuthology.orchestra.run.smithi012.stdout: "put": 0, 2024-09-05T01:42:05.832 INFO:teuthology.orchestra.run.smithi012.stdout: "put_sum": 0, 2024-09-05T01:42:05.832 INFO:teuthology.orchestra.run.smithi012.stdout: "wait": { 2024-09-05T01:42:05.832 INFO:teuthology.orchestra.run.smithi012.stdout: "avgcount": 0, 2024-09-05T01:42:05.832 INFO:teuthology.orchestra.run.smithi012.stdout: "sum": 0.000000000, 2024-09-05T01:42:05.832 INFO:teuthology.orchestra.run.smithi012.stdout: "avgtime": 0.000000000 2024-09-05T01:42:05.832 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:42:05.832 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-09-05T01:42:05.832 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-05T01:42:06.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:05 smithi145 ceph-mon[34376]: pgmap v544: 97 pgs: 33 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 50 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 31 KiB/s wr, 20 op/s 2024-09-05T01:42:06.104 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:05 smithi151 ceph-mon[35013]: pgmap v544: 97 pgs: 33 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 50 active+clean; 3.0 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 31 KiB/s wr, 20 op/s 2024-09-05T01:42:07.330 INFO:tasks.check_counter:Daemon mds.j mds.exported=0 2024-09-05T01:42:07.330 INFO:tasks.check_counter:Daemon mds.j mds.imported=0 2024-09-05T01:42:07.331 INFO:tasks.check_counter:Daemon mds.j mds.root_rsnaps=0 2024-09-05T01:42:07.331 INFO:tasks.check_counter:Daemon mds.j mds_server.req_mksnap_latency.avgcount=0 2024-09-05T01:42:07.331 INFO:tasks.check_counter:Daemon mds.j mds_server.req_rmsnap_latency.avgcount=0 2024-09-05T01:42:07.331 INFO:tasks.check_counter:Daemon mds.j mds.dir_split=0 2024-09-05T01:42:07.331 DEBUG:tasks.check_counter:Getting stats from b 2024-09-05T01:42:07.331 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-05T01:42:07.906 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:07 smithi151 ceph-mon[35013]: pgmap v545: 97 pgs: 30 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 55 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 76 KiB/s wr, 40 op/s 2024-09-05T01:42:07.906 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:07 smithi151 ceph-mon[35013]: osdmap e107: 12 total, 12 up, 12 in 2024-09-05T01:42:08.046 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T01:42:08.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:07 smithi012 ceph-mon[29942]: pgmap v545: 97 pgs: 30 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 55 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 76 KiB/s wr, 40 op/s 2024-09-05T01:42:08.063 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:07 smithi012 ceph-mon[29942]: osdmap e107: 12 total, 12 up, 12 in 2024-09-05T01:42:08.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:07 smithi145 ceph-mon[34376]: pgmap v545: 97 pgs: 30 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 55 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 76 KiB/s wr, 40 op/s 2024-09-05T01:42:08.084 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:07 smithi145 ceph-mon[34376]: osdmap e107: 12 total, 12 up, 12 in 2024-09-05T01:42:08.858 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-09-05T01:42:08.858 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T01:42:08.858 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 66931, 2024-09-05T01:42:08.858 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 74277, 2024-09-05T01:42:08.858 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 45437440, 2024-09-05T01:42:08.858 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 262303261, 2024-09-05T01:42:08.858 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 19, 2024-09-05T01:42:08.858 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 6, 2024-09-05T01:42:08.858 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 5.617517737, 2024-09-05T01:42:08.859 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 1.809530606, 2024-09-05T01:42:08.859 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 1.732240984, 2024-09-05T01:42:08.859 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 2.002786180, 2024-09-05T01:42:08.859 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:08.859 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 74269, 2024-09-05T01:42:08.859 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 10.714529648, 2024-09-05T01:42:08.859 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000144266 2024-09-05T01:42:08.859 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.859 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:08.859 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 42928, 2024-09-05T01:42:08.859 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.007836717, 2024-09-05T01:42:08.859 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000182 2024-09-05T01:42:08.860 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.860 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 2106448, 2024-09-05T01:42:08.860 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 964656 2024-09-05T01:42:08.860 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.860 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T01:42:08.860 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 410416, 2024-09-05T01:42:08.860 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 673237, 2024-09-05T01:42:08.860 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 176873849, 2024-09-05T01:42:08.860 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 697374013, 2024-09-05T01:42:08.860 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 17, 2024-09-05T01:42:08.860 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 7, 2024-09-05T01:42:08.860 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 28.880962976, 2024-09-05T01:42:08.860 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 11.182862591, 2024-09-05T01:42:08.861 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 23.042535125, 2024-09-05T01:42:08.861 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 3.357489904, 2024-09-05T01:42:08.861 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:08.861 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 673239, 2024-09-05T01:42:08.861 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 116.675588896, 2024-09-05T01:42:08.861 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000173304 2024-09-05T01:42:08.861 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.861 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:08.861 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 675426, 2024-09-05T01:42:08.861 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.161431699, 2024-09-05T01:42:08.861 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000239 2024-09-05T01:42:08.861 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.862 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 552512, 2024-09-05T01:42:08.862 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 311360 2024-09-05T01:42:08.862 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.862 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T01:42:08.862 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 101947, 2024-09-05T01:42:08.862 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 115508, 2024-09-05T01:42:08.862 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 64354425, 2024-09-05T01:42:08.862 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 527789223, 2024-09-05T01:42:08.862 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 91, 2024-09-05T01:42:08.862 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 5, 2024-09-05T01:42:08.862 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 8.642142975, 2024-09-05T01:42:08.862 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 3.710601464, 2024-09-05T01:42:08.862 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 3.102726684, 2024-09-05T01:42:08.863 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 2.032612108, 2024-09-05T01:42:08.863 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:08.863 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 115509, 2024-09-05T01:42:08.863 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 16.072748209, 2024-09-05T01:42:08.863 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000139147 2024-09-05T01:42:08.863 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.863 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:08.863 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 112844, 2024-09-05T01:42:08.863 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.023284080, 2024-09-05T01:42:08.863 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000206 2024-09-05T01:42:08.863 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.863 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 42384, 2024-09-05T01:42:08.863 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 1216 2024-09-05T01:42:08.863 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.864 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2024-09-05T01:42:08.864 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 1, 2024-09-05T01:42:08.864 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2024-09-05T01:42:08.864 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.864 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-MDSRank": { 2024-09-05T01:42:08.864 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2024-09-05T01:42:08.864 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2024-09-05T01:42:08.864 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 99641, 2024-09-05T01:42:08.864 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 188.046432516, 2024-09-05T01:42:08.864 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.001887239 2024-09-05T01:42:08.864 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:08.864 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.864 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-PurgeQueue": { 2024-09-05T01:42:08.865 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2024-09-05T01:42:08.865 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2024-09-05T01:42:08.865 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 85032, 2024-09-05T01:42:08.865 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 12.759736522, 2024-09-05T01:42:08.865 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000150058 2024-09-05T01:42:08.865 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:08.865 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.865 INFO:teuthology.orchestra.run.smithi145.stdout: "mds": { 2024-09-05T01:42:08.865 INFO:teuthology.orchestra.run.smithi145.stdout: "request": 178933, 2024-09-05T01:42:08.865 INFO:teuthology.orchestra.run.smithi145.stdout: "reply": 171034, 2024-09-05T01:42:08.865 INFO:teuthology.orchestra.run.smithi145.stdout: "reply_latency": { 2024-09-05T01:42:08.865 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 171034, 2024-09-05T01:42:08.865 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 2693.409054083, 2024-09-05T01:42:08.866 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.015747798 2024-09-05T01:42:08.866 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.866 INFO:teuthology.orchestra.run.smithi145.stdout: "slow_reply": 0, 2024-09-05T01:42:08.866 INFO:teuthology.orchestra.run.smithi145.stdout: "forward": 7872, 2024-09-05T01:42:08.866 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch_complete": 345, 2024-09-05T01:42:08.866 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch_keys": 2, 2024-09-05T01:42:08.866 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_commit": 2952, 2024-09-05T01:42:08.866 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_split": 146, 2024-09-05T01:42:08.866 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_merge": 0, 2024-09-05T01:42:08.866 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes": 110859, 2024-09-05T01:42:08.866 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_top": 55738, 2024-09-05T01:42:08.866 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_bottom": 54826, 2024-09-05T01:42:08.867 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pin_tail": 295, 2024-09-05T01:42:08.867 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pinned": 31232, 2024-09-05T01:42:08.867 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_expired": 121337, 2024-09-05T01:42:08.867 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_with_caps": 3, 2024-09-05T01:42:08.867 INFO:teuthology.orchestra.run.smithi145.stdout: "caps": 3, 2024-09-05T01:42:08.867 INFO:teuthology.orchestra.run.smithi145.stdout: "subtrees": 6, 2024-09-05T01:42:08.867 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse": 269946, 2024-09-05T01:42:08.867 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_hit": 238528, 2024-09-05T01:42:08.867 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_forward": 7646, 2024-09-05T01:42:08.867 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_discover": 817, 2024-09-05T01:42:08.867 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_dir_fetch": 25, 2024-09-05T01:42:08.867 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_remote_ino": 0, 2024-09-05T01:42:08.867 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_lock": 290, 2024-09-05T01:42:08.868 INFO:teuthology.orchestra.run.smithi145.stdout: "load_cent": 3346, 2024-09-05T01:42:08.868 INFO:teuthology.orchestra.run.smithi145.stdout: "q": 0, 2024-09-05T01:42:08.868 INFO:teuthology.orchestra.run.smithi145.stdout: "exported": 645, 2024-09-05T01:42:08.868 INFO:teuthology.orchestra.run.smithi145.stdout: "exported_inodes": 104947, 2024-09-05T01:42:08.868 INFO:teuthology.orchestra.run.smithi145.stdout: "imported": 552, 2024-09-05T01:42:08.868 INFO:teuthology.orchestra.run.smithi145.stdout: "imported_inodes": 130340, 2024-09-05T01:42:08.868 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_dir_fetch": 0, 2024-09-05T01:42:08.868 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_backtrace_fetch": 119273, 2024-09-05T01:42:08.868 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_peer_discover": 0, 2024-09-05T01:42:08.868 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rfiles": 4, 2024-09-05T01:42:08.868 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rbytes": 234, 2024-09-05T01:42:08.868 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rsnaps": 6, 2024-09-05T01:42:08.868 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_backtrace_fetch": 119273, 2024-09-05T01:42:08.868 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_set_tag": 0, 2024-09-05T01:42:08.869 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T01:42:08.869 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_inotable_repaired": 0, 2024-09-05T01:42:08.869 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dir_inodes": 1273, 2024-09-05T01:42:08.869 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dir_base_inodes": 11, 2024-09-05T01:42:08.869 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dirfrag_rstats": 1262, 2024-09-05T01:42:08.869 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_file_inodes": 118000, 2024-09-05T01:42:08.869 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_inode_file_caps": 338, 2024-09-05T01:42:08.869 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_revoke": 22147, 2024-09-05T01:42:08.869 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_grant": 83182, 2024-09-05T01:42:08.869 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_trunc": 5, 2024-09-05T01:42:08.869 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T01:42:08.869 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T01:42:08.870 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_caps": 66350, 2024-09-05T01:42:08.870 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_caps_dirty": 29957, 2024-09-05T01:42:08.870 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_cap_release": 1174, 2024-09-05T01:42:08.870 INFO:teuthology.orchestra.run.smithi145.stdout: "process_request_cap_release": 84914 2024-09-05T01:42:08.870 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.870 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache": { 2024-09-05T01:42:08.870 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_update": 4, 2024-09-05T01:42:08.870 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_update_receipt": 0, 2024-09-05T01:42:08.870 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_try_discover": 0, 2024-09-05T01:42:08.870 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_send_discover": 933, 2024-09-05T01:42:08.870 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_handle_discover": 1617, 2024-09-05T01:42:08.870 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays": 334, 2024-09-05T01:42:08.870 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_delayed": 0, 2024-09-05T01:42:08.870 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_enqueuing": 0, 2024-09-05T01:42:08.871 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_created": 45213, 2024-09-05T01:42:08.871 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_enqueued": 44879, 2024-09-05T01:42:08.871 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_reintegrated": 0, 2024-09-05T01:42:08.871 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_migrated": 0, 2024-09-05T01:42:08.871 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_processing": 0, 2024-09-05T01:42:08.871 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_enqueued": 0, 2024-09-05T01:42:08.871 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_prioritized": 0, 2024-09-05T01:42:08.871 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_started": 0, 2024-09-05T01:42:08.871 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_completed": 0, 2024-09-05T01:42:08.871 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_quiesce_path": 0, 2024-09-05T01:42:08.871 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_quiesce_inode": 0, 2024-09-05T01:42:08.871 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_enqueue_scrub": 11, 2024-09-05T01:42:08.871 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_exportdir": 652, 2024-09-05T01:42:08.872 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_flush": 0, 2024-09-05T01:42:08.872 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragmentdir": 148, 2024-09-05T01:42:08.872 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragstats": 0, 2024-09-05T01:42:08.872 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_inodestats": 0 2024-09-05T01:42:08.872 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.872 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log": { 2024-09-05T01:42:08.872 INFO:teuthology.orchestra.run.smithi145.stdout: "evlrg": 12, 2024-09-05T01:42:08.872 INFO:teuthology.orchestra.run.smithi145.stdout: "evadd": 233471, 2024-09-05T01:42:08.872 INFO:teuthology.orchestra.run.smithi145.stdout: "evex": 141188, 2024-09-05T01:42:08.872 INFO:teuthology.orchestra.run.smithi145.stdout: "evtrm": 135191, 2024-09-05T01:42:08.872 INFO:teuthology.orchestra.run.smithi145.stdout: "ev": 98280, 2024-09-05T01:42:08.872 INFO:teuthology.orchestra.run.smithi145.stdout: "evexg": 0, 2024-09-05T01:42:08.872 INFO:teuthology.orchestra.run.smithi145.stdout: "evexd": 5997, 2024-09-05T01:42:08.872 INFO:teuthology.orchestra.run.smithi145.stdout: "segadd": 331, 2024-09-05T01:42:08.873 INFO:teuthology.orchestra.run.smithi145.stdout: "segex": 203, 2024-09-05T01:42:08.873 INFO:teuthology.orchestra.run.smithi145.stdout: "segtrm": 196, 2024-09-05T01:42:08.873 INFO:teuthology.orchestra.run.smithi145.stdout: "seg": 135, 2024-09-05T01:42:08.873 INFO:teuthology.orchestra.run.smithi145.stdout: "segmjr": 8, 2024-09-05T01:42:08.873 INFO:teuthology.orchestra.run.smithi145.stdout: "segexg": 0, 2024-09-05T01:42:08.873 INFO:teuthology.orchestra.run.smithi145.stdout: "segexd": 7, 2024-09-05T01:42:08.873 INFO:teuthology.orchestra.run.smithi145.stdout: "expos": 479595495, 2024-09-05T01:42:08.873 INFO:teuthology.orchestra.run.smithi145.stdout: "wrpos": 987515566, 2024-09-05T01:42:08.873 INFO:teuthology.orchestra.run.smithi145.stdout: "rdpos": 0, 2024-09-05T01:42:08.873 INFO:teuthology.orchestra.run.smithi145.stdout: "jlat": { 2024-09-05T01:42:08.873 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 5694, 2024-09-05T01:42:08.873 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 405.986385392, 2024-09-05T01:42:08.873 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.071300735 2024-09-05T01:42:08.874 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.874 INFO:teuthology.orchestra.run.smithi145.stdout: "replayed": 0 2024-09-05T01:42:08.874 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.874 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_mem": { 2024-09-05T01:42:08.874 INFO:teuthology.orchestra.run.smithi145.stdout: "ino": 57319, 2024-09-05T01:42:08.874 INFO:teuthology.orchestra.run.smithi145.stdout: "ino+": 164969, 2024-09-05T01:42:08.874 INFO:teuthology.orchestra.run.smithi145.stdout: "ino-": 107650, 2024-09-05T01:42:08.874 INFO:teuthology.orchestra.run.smithi145.stdout: "dir": 2193, 2024-09-05T01:42:08.874 INFO:teuthology.orchestra.run.smithi145.stdout: "dir+": 4287, 2024-09-05T01:42:08.874 INFO:teuthology.orchestra.run.smithi145.stdout: "dir-": 2094, 2024-09-05T01:42:08.874 INFO:teuthology.orchestra.run.smithi145.stdout: "dn": 110859, 2024-09-05T01:42:08.874 INFO:teuthology.orchestra.run.smithi145.stdout: "dn+": 287448, 2024-09-05T01:42:08.874 INFO:teuthology.orchestra.run.smithi145.stdout: "dn-": 176589, 2024-09-05T01:42:08.874 INFO:teuthology.orchestra.run.smithi145.stdout: "cap": 3, 2024-09-05T01:42:08.875 INFO:teuthology.orchestra.run.smithi145.stdout: "cap+": 95866, 2024-09-05T01:42:08.875 INFO:teuthology.orchestra.run.smithi145.stdout: "cap-": 95863, 2024-09-05T01:42:08.875 INFO:teuthology.orchestra.run.smithi145.stdout: "rss": 399708, 2024-09-05T01:42:08.875 INFO:teuthology.orchestra.run.smithi145.stdout: "heap": 231712 2024-09-05T01:42:08.875 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.875 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_server": { 2024-09-05T01:42:08.875 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_client_request": 194661, 2024-09-05T01:42:08.875 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_server_request": 12435, 2024-09-05T01:42:08.875 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_request": 178933, 2024-09-05T01:42:08.875 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_session": 713, 2024-09-05T01:42:08.875 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_peer_request": 24111, 2024-09-05T01:42:08.875 INFO:teuthology.orchestra.run.smithi145.stdout: "req_create_latency": { 2024-09-05T01:42:08.875 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 33894, 2024-09-05T01:42:08.876 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 143.116894538, 2024-09-05T01:42:08.876 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.004222484 2024-09-05T01:42:08.876 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.876 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getattr_latency": { 2024-09-05T01:42:08.876 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1210, 2024-09-05T01:42:08.876 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 117.081424667, 2024-09-05T01:42:08.876 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.096761507 2024-09-05T01:42:08.876 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.876 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getfilelock_latency": { 2024-09-05T01:42:08.876 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:08.876 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:08.876 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:08.876 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.877 INFO:teuthology.orchestra.run.smithi145.stdout: "req_link_latency": { 2024-09-05T01:42:08.877 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:08.877 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:08.877 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:08.877 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.877 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookup_latency": { 2024-09-05T01:42:08.877 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 47369, 2024-09-05T01:42:08.877 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1689.223038245, 2024-09-05T01:42:08.877 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.035660939 2024-09-05T01:42:08.877 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.877 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookuphash_latency": { 2024-09-05T01:42:08.877 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:08.877 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:08.878 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:08.878 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.878 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupino_latency": { 2024-09-05T01:42:08.878 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1, 2024-09-05T01:42:08.878 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000132371, 2024-09-05T01:42:08.878 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000132371 2024-09-05T01:42:08.878 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.878 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupname_latency": { 2024-09-05T01:42:08.878 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:08.878 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:08.878 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:08.878 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.878 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupparent_latency": { 2024-09-05T01:42:08.878 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:08.879 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:08.879 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:08.879 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.879 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupsnap_latency": { 2024-09-05T01:42:08.879 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:08.880 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:08.880 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:08.880 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.880 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lssnap_latency": { 2024-09-05T01:42:08.880 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 18, 2024-09-05T01:42:08.880 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.008142484, 2024-09-05T01:42:08.880 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000452360 2024-09-05T01:42:08.880 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.880 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mkdir_latency": { 2024-09-05T01:42:08.880 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 285, 2024-09-05T01:42:08.880 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 5.557956037, 2024-09-05T01:42:08.880 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.019501600 2024-09-05T01:42:08.881 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.881 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mknod_latency": { 2024-09-05T01:42:08.881 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:08.881 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:08.881 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:08.881 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.881 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mksnap_latency": { 2024-09-05T01:42:08.881 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 18, 2024-09-05T01:42:08.881 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 7.103751017, 2024-09-05T01:42:08.881 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.394652834 2024-09-05T01:42:08.881 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.881 INFO:teuthology.orchestra.run.smithi145.stdout: "req_open_latency": { 2024-09-05T01:42:08.881 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 9416, 2024-09-05T01:42:08.882 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 51.288406716, 2024-09-05T01:42:08.882 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.005446942 2024-09-05T01:42:08.882 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.882 INFO:teuthology.orchestra.run.smithi145.stdout: "req_readdir_latency": { 2024-09-05T01:42:08.882 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 2195, 2024-09-05T01:42:08.882 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 6.251641303, 2024-09-05T01:42:08.882 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.002848128 2024-09-05T01:42:08.882 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.882 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rename_latency": { 2024-09-05T01:42:08.882 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 33511, 2024-09-05T01:42:08.882 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 455.224985987, 2024-09-05T01:42:08.882 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.013584345 2024-09-05T01:42:08.882 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.883 INFO:teuthology.orchestra.run.smithi145.stdout: "req_renamesnap_latency": { 2024-09-05T01:42:08.883 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:08.883 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:08.883 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:08.883 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.883 INFO:teuthology.orchestra.run.smithi145.stdout: "req_snapdiff_latency": { 2024-09-05T01:42:08.883 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:08.883 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:08.883 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:08.883 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.883 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmdir_latency": { 2024-09-05T01:42:08.883 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 345, 2024-09-05T01:42:08.884 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 63.672570404, 2024-09-05T01:42:08.884 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.184558175 2024-09-05T01:42:08.884 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.884 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmsnap_latency": { 2024-09-05T01:42:08.884 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 12, 2024-09-05T01:42:08.884 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 44.194241687, 2024-09-05T01:42:08.884 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 3.682853473 2024-09-05T01:42:08.884 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.884 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmxattr_latency": { 2024-09-05T01:42:08.884 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:08.884 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:08.884 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:08.884 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.885 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setattr_latency": { 2024-09-05T01:42:08.885 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 6, 2024-09-05T01:42:08.885 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.035554751, 2024-09-05T01:42:08.885 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.005925791 2024-09-05T01:42:08.885 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.885 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setdirlayout_latency": { 2024-09-05T01:42:08.885 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:08.885 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:08.885 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:08.885 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.885 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setfilelock_latency": { 2024-09-05T01:42:08.885 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:08.886 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:08.886 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:08.886 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.886 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setlayout_latency": { 2024-09-05T01:42:08.886 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:08.886 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:08.886 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:08.886 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.886 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setxattr_latency": { 2024-09-05T01:42:08.886 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 7, 2024-09-05T01:42:08.886 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.020710063, 2024-09-05T01:42:08.886 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.002958580 2024-09-05T01:42:08.886 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.887 INFO:teuthology.orchestra.run.smithi145.stdout: "req_symlink_latency": { 2024-09-05T01:42:08.887 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 3, 2024-09-05T01:42:08.887 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.002013129, 2024-09-05T01:42:08.887 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000671043 2024-09-05T01:42:08.887 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.887 INFO:teuthology.orchestra.run.smithi145.stdout: "req_unlink_latency": { 2024-09-05T01:42:08.887 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 42744, 2024-09-05T01:42:08.887 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 110.627590684, 2024-09-05T01:42:08.887 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.002588143 2024-09-05T01:42:08.887 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.887 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_revoke_eviction": 0, 2024-09-05T01:42:08.887 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_acquisition_throttle": 0, 2024-09-05T01:42:08.887 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getvxattr_latency": { 2024-09-05T01:42:08.887 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:08.888 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:08.888 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:08.888 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:08.888 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.888 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_sessions": { 2024-09-05T01:42:08.888 INFO:teuthology.orchestra.run.smithi145.stdout: "session_count": 2, 2024-09-05T01:42:08.888 INFO:teuthology.orchestra.run.smithi145.stdout: "session_add": 5, 2024-09-05T01:42:08.888 INFO:teuthology.orchestra.run.smithi145.stdout: "session_remove": 3, 2024-09-05T01:42:08.888 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_open": 2, 2024-09-05T01:42:08.888 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_stale": 0, 2024-09-05T01:42:08.888 INFO:teuthology.orchestra.run.smithi145.stdout: "total_load": 12888, 2024-09-05T01:42:08.888 INFO:teuthology.orchestra.run.smithi145.stdout: "average_load": 6444, 2024-09-05T01:42:08.888 INFO:teuthology.orchestra.run.smithi145.stdout: "avg_session_uptime": 1037, 2024-09-05T01:42:08.889 INFO:teuthology.orchestra.run.smithi145.stdout: "mdthresh_evicted": 0 2024-09-05T01:42:08.889 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.889 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2024-09-05T01:42:08.889 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 0, 2024-09-05T01:42:08.889 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 0, 2024-09-05T01:42:08.889 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T01:42:08.889 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2024-09-05T01:42:08.889 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T01:42:08.889 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2024-09-05T01:42:08.889 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T01:42:08.889 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T01:42:08.889 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T01:42:08.889 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T01:42:08.890 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T01:42:08.890 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2024-09-05T01:42:08.890 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T01:42:08.890 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T01:42:08.890 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_bytes": 0, 2024-09-05T01:42:08.890 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_items": 0, 2024-09-05T01:42:08.890 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_bytes": 0, 2024-09-05T01:42:08.890 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_items": 0, 2024-09-05T01:42:08.890 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T01:42:08.890 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T01:42:08.890 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T01:42:08.890 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T01:42:08.890 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T01:42:08.891 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2024-09-05T01:42:08.891 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2024-09-05T01:42:08.891 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2024-09-05T01:42:08.891 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T01:42:08.891 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T01:42:08.891 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2024-09-05T01:42:08.891 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2024-09-05T01:42:08.891 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2024-09-05T01:42:08.891 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2024-09-05T01:42:08.891 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T01:42:08.891 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2024-09-05T01:42:08.891 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T01:42:08.891 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2024-09-05T01:42:08.892 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 5176939, 2024-09-05T01:42:08.892 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 58117, 2024-09-05T01:42:08.892 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 176, 2024-09-05T01:42:08.892 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 2, 2024-09-05T01:42:08.892 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2024-09-05T01:42:08.892 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2024-09-05T01:42:08.892 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2024-09-05T01:42:08.892 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2024-09-05T01:42:08.892 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2024-09-05T01:42:08.892 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2024-09-05T01:42:08.892 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 8496, 2024-09-05T01:42:08.892 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 190, 2024-09-05T01:42:08.892 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T01:42:08.893 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2024-09-05T01:42:08.893 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2024-09-05T01:42:08.893 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2024-09-05T01:42:08.893 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 215522813, 2024-09-05T01:42:08.893 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 2268827, 2024-09-05T01:42:08.893 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2024-09-05T01:42:08.893 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2024-09-05T01:42:08.893 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2024-09-05T01:42:08.893 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2024-09-05T01:42:08.893 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.893 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter": { 2024-09-05T01:42:08.893 INFO:teuthology.orchestra.run.smithi145.stdout: "op_active": 0, 2024-09-05T01:42:08.893 INFO:teuthology.orchestra.run.smithi145.stdout: "op_laggy": 0, 2024-09-05T01:42:08.893 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send": 181963, 2024-09-05T01:42:08.894 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send_bytes": 1050271409, 2024-09-05T01:42:08.894 INFO:teuthology.orchestra.run.smithi145.stdout: "op_resend": 32, 2024-09-05T01:42:08.894 INFO:teuthology.orchestra.run.smithi145.stdout: "op_reply": 181963, 2024-09-05T01:42:08.894 INFO:teuthology.orchestra.run.smithi145.stdout: "op_latency": { 2024-09-05T01:42:08.894 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 181963, 2024-09-05T01:42:08.894 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 7654.231002643, 2024-09-05T01:42:08.894 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.042064765 2024-09-05T01:42:08.894 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.894 INFO:teuthology.orchestra.run.smithi145.stdout: "op_inflight": 0, 2024-09-05T01:42:08.894 INFO:teuthology.orchestra.run.smithi145.stdout: "oplen_avg": { 2024-09-05T01:42:08.894 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 181963, 2024-09-05T01:42:08.894 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 199051 2024-09-05T01:42:08.894 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: "op": 181963, 2024-09-05T01:42:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: "op_r": 120576, 2024-09-05T01:42:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: "op_w": 61387, 2024-09-05T01:42:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: "op_rmw": 0, 2024-09-05T01:42:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: "op_pg": 0, 2024-09-05T01:42:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_stat": 1543, 2024-09-05T01:42:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_create": 4734, 2024-09-05T01:42:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_read": 945, 2024-09-05T01:42:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_write": 6633, 2024-09-05T01:42:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writefull": 437, 2024-09-05T01:42:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writesame": 0, 2024-09-05T01:42:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_append": 0, 2024-09-05T01:42:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_zero": 0, 2024-09-05T01:42:08.895 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_truncate": 146, 2024-09-05T01:42:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_delete": 45772, 2024-09-05T01:42:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_mapext": 0, 2024-09-05T01:42:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_sparse_read": 0, 2024-09-05T01:42:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_clonerange": 0, 2024-09-05T01:42:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_getxattr": 119295, 2024-09-05T01:42:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_setxattr": 9468, 2024-09-05T01:42:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_cmpxattr": 0, 2024-09-05T01:42:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_rmxattr": 0, 2024-09-05T01:42:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_resetxattrs": 0, 2024-09-05T01:42:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_call": 0, 2024-09-05T01:42:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_watch": 0, 2024-09-05T01:42:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_notify": 0, 2024-09-05T01:42:08.896 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T01:42:08.897 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls": 0, 2024-09-05T01:42:08.897 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls_filter": 0, 2024-09-05T01:42:08.897 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_other": 5, 2024-09-05T01:42:08.897 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_active": 0, 2024-09-05T01:42:08.897 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_send": 0, 2024-09-05T01:42:08.897 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_resend": 0, 2024-09-05T01:42:08.897 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_ping": 0, 2024-09-05T01:42:08.897 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_active": 0, 2024-09-05T01:42:08.897 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_send": 0, 2024-09-05T01:42:08.897 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_resend": 0, 2024-09-05T01:42:08.897 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_active": 0, 2024-09-05T01:42:08.897 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_send": 0, 2024-09-05T01:42:08.897 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_resend": 0, 2024-09-05T01:42:08.897 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_active": 0, 2024-09-05T01:42:08.898 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_send": 0, 2024-09-05T01:42:08.898 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_resend": 0, 2024-09-05T01:42:08.898 INFO:teuthology.orchestra.run.smithi145.stdout: "command_active": 0, 2024-09-05T01:42:08.898 INFO:teuthology.orchestra.run.smithi145.stdout: "command_send": 0, 2024-09-05T01:42:08.898 INFO:teuthology.orchestra.run.smithi145.stdout: "command_resend": 0, 2024-09-05T01:42:08.898 INFO:teuthology.orchestra.run.smithi145.stdout: "map_epoch": 108, 2024-09-05T01:42:08.898 INFO:teuthology.orchestra.run.smithi145.stdout: "map_full": 0, 2024-09-05T01:42:08.898 INFO:teuthology.orchestra.run.smithi145.stdout: "map_inc": 27, 2024-09-05T01:42:08.898 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_sessions": 12, 2024-09-05T01:42:08.898 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_open": 12, 2024-09-05T01:42:08.898 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_close": 0, 2024-09-05T01:42:08.898 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_laggy": 0, 2024-09-05T01:42:08.898 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_wr": 7223, 2024-09-05T01:42:08.898 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_rd": 694, 2024-09-05T01:42:08.898 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_del": 2156 2024-09-05T01:42:08.899 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.899 INFO:teuthology.orchestra.run.smithi145.stdout: "oft": { 2024-09-05T01:42:08.899 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_objs": 1, 2024-09-05T01:42:08.899 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_kv_pairs": 0, 2024-09-05T01:42:08.899 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_updates": 0, 2024-09-05T01:42:08.899 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_removes": 0 2024-09-05T01:42:08.899 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.899 INFO:teuthology.orchestra.run.smithi145.stdout: "osd-slow-ops": { 2024-09-05T01:42:08.899 INFO:teuthology.orchestra.run.smithi145.stdout: "slow_ops_count": 47 2024-09-05T01:42:08.899 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.899 INFO:teuthology.orchestra.run.smithi145.stdout: "purge_queue": { 2024-09-05T01:42:08.899 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops": 0, 2024-09-05T01:42:08.899 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops_high_water": 14, 2024-09-05T01:42:08.899 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing": 0, 2024-09-05T01:42:08.899 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_high_water": 6, 2024-09-05T01:42:08.900 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed_ops": 44911, 2024-09-05T01:42:08.900 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed": 44879, 2024-09-05T01:42:08.900 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_item_in_journal": 0 2024-09-05T01:42:08.900 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.900 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T01:42:08.900 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-05T01:42:08.900 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-09-05T01:42:08.900 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-05T01:42:08.900 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 579290, 2024-09-05T01:42:08.900 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 234429283, 2024-09-05T01:42:08.900 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:08.900 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 579290, 2024-09-05T01:42:08.900 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-09-05T01:42:08.901 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-09-05T01:42:08.901 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 579290, 2024-09-05T01:42:08.901 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 234429283, 2024-09-05T01:42:08.901 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-05T01:42:08.901 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:08.901 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:08.901 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:08.901 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:08.901 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.901 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_bytes": { 2024-09-05T01:42:08.901 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-05T01:42:08.901 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-09-05T01:42:08.901 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-05T01:42:08.902 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-09-05T01:42:08.902 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-09-05T01:42:08.902 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:08.902 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:08.902 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 181963, 2024-09-05T01:42:08.902 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 1056829772, 2024-09-05T01:42:08.902 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 181963, 2024-09-05T01:42:08.902 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 1056829772, 2024-09-05T01:42:08.902 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-05T01:42:08.902 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:08.902 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:08.902 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:08.902 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:08.902 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.902 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_ops": { 2024-09-05T01:42:08.903 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-05T01:42:08.903 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 1024, 2024-09-05T01:42:08.903 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-05T01:42:08.903 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-09-05T01:42:08.903 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-09-05T01:42:08.903 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:08.903 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:08.903 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 181963, 2024-09-05T01:42:08.903 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 181963, 2024-09-05T01:42:08.903 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 181963, 2024-09-05T01:42:08.903 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 181963, 2024-09-05T01:42:08.903 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-05T01:42:08.903 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:08.903 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:08.904 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:08.904 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:08.904 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.904 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle": { 2024-09-05T01:42:08.904 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-05T01:42:08.904 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2024-09-05T01:42:08.904 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-05T01:42:08.904 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 44879, 2024-09-05T01:42:08.904 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 6563891, 2024-09-05T01:42:08.904 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:08.904 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 44879, 2024-09-05T01:42:08.904 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-09-05T01:42:08.904 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-09-05T01:42:08.904 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 934, 2024-09-05T01:42:08.905 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 6563891, 2024-09-05T01:42:08.905 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-05T01:42:08.905 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:08.905 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:08.905 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:08.905 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:08.905 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:08.905 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle-0x560c10b8a960": { 2024-09-05T01:42:08.905 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 112, 2024-09-05T01:42:08.905 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2024-09-05T01:42:08.905 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-05T01:42:08.905 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 233471, 2024-09-05T01:42:08.905 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 983321262, 2024-09-05T01:42:08.905 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:08.906 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 233471, 2024-09-05T01:42:08.906 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-09-05T01:42:08.906 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-09-05T01:42:08.906 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 5694, 2024-09-05T01:42:08.906 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 983321150, 2024-09-05T01:42:08.906 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-05T01:42:08.906 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:08.906 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:08.906 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:08.906 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:08.906 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:08.906 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-09-05T01:42:09.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:09 smithi012 ceph-mon[29942]: pgmap v547: 97 pgs: 30 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 55 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-09-05T01:42:09.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:09 smithi012 ceph-mon[29942]: osdmap e108: 12 total, 12 up, 12 in 2024-09-05T01:42:09.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:09 smithi145 ceph-mon[34376]: pgmap v547: 97 pgs: 30 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 55 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-09-05T01:42:09.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:09 smithi145 ceph-mon[34376]: osdmap e108: 12 total, 12 up, 12 in 2024-09-05T01:42:09.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:09 smithi151 ceph-mon[35013]: pgmap v547: 97 pgs: 30 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 55 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 67 KiB/s wr, 33 op/s 2024-09-05T01:42:09.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:09 smithi151 ceph-mon[35013]: osdmap e108: 12 total, 12 up, 12 in 2024-09-05T01:42:09.985 INFO:tasks.check_counter:Daemon mds.b mds.exported=645 2024-09-05T01:42:09.985 INFO:tasks.check_counter:Daemon mds.b mds.imported=552 2024-09-05T01:42:09.985 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-05T01:42:09.985 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=18 2024-09-05T01:42:09.985 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=12 2024-09-05T01:42:09.985 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=146 2024-09-05T01:42:09.986 DEBUG:tasks.check_counter:Getting stats from e 2024-09-05T01:42:09.986 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-05T01:42:10.451 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T01:42:11.090 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-09-05T01:42:11.090 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T01:42:11.090 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 1984, 2024-09-05T01:42:11.090 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 1924, 2024-09-05T01:42:11.090 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 69598219, 2024-09-05T01:42:11.090 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 703804, 2024-09-05T01:42:11.090 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 7, 2024-09-05T01:42:11.090 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 3, 2024-09-05T01:42:11.090 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.231739988, 2024-09-05T01:42:11.091 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.070232709, 2024-09-05T01:42:11.091 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.122491834, 2024-09-05T01:42:11.091 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.042858702, 2024-09-05T01:42:11.091 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:11.091 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1923, 2024-09-05T01:42:11.091 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.115098717, 2024-09-05T01:42:11.091 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000059853 2024-09-05T01:42:11.091 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.091 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:11.091 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.091 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.091 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.091 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.091 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 1975776, 2024-09-05T01:42:11.092 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 204544 2024-09-05T01:42:11.092 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.092 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T01:42:11.092 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 433, 2024-09-05T01:42:11.092 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 675, 2024-09-05T01:42:11.092 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 79815533, 2024-09-05T01:42:11.092 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 730200, 2024-09-05T01:42:11.092 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 9, 2024-09-05T01:42:11.092 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 7, 2024-09-05T01:42:11.092 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.087052545, 2024-09-05T01:42:11.092 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.018680413, 2024-09-05T01:42:11.092 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.053059537, 2024-09-05T01:42:11.092 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.010510260, 2024-09-05T01:42:11.092 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:11.093 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 673, 2024-09-05T01:42:11.093 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.045201355, 2024-09-05T01:42:11.093 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000067163 2024-09-05T01:42:11.093 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.093 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:11.093 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.093 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.093 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.093 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.093 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-05T01:42:11.093 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 594352 2024-09-05T01:42:11.093 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.093 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T01:42:11.093 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 2045, 2024-09-05T01:42:11.094 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 2047, 2024-09-05T01:42:11.094 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 161639594, 2024-09-05T01:42:11.094 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 650317, 2024-09-05T01:42:11.094 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 6, 2024-09-05T01:42:11.094 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 5, 2024-09-05T01:42:11.094 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.238370074, 2024-09-05T01:42:11.094 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.032390027, 2024-09-05T01:42:11.094 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.139232812, 2024-09-05T01:42:11.094 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.057054555, 2024-09-05T01:42:11.094 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:11.094 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 2045, 2024-09-05T01:42:11.094 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.075726476, 2024-09-05T01:42:11.094 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000037030 2024-09-05T01:42:11.094 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.095 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:11.095 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.095 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.095 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.095 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.095 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-05T01:42:11.095 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 0 2024-09-05T01:42:11.095 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.095 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2024-09-05T01:42:11.095 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 1, 2024-09-05T01:42:11.095 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2024-09-05T01:42:11.095 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.095 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-MDSRank": { 2024-09-05T01:42:11.095 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2024-09-05T01:42:11.096 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2024-09-05T01:42:11.096 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 6602, 2024-09-05T01:42:11.096 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.151102508, 2024-09-05T01:42:11.096 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000022887 2024-09-05T01:42:11.096 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:11.096 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.096 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-PurgeQueue": { 2024-09-05T01:42:11.096 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2024-09-05T01:42:11.096 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2024-09-05T01:42:11.096 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.096 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.096 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.096 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:11.096 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.097 INFO:teuthology.orchestra.run.smithi145.stdout: "mds": { 2024-09-05T01:42:11.097 INFO:teuthology.orchestra.run.smithi145.stdout: "request": 0, 2024-09-05T01:42:11.097 INFO:teuthology.orchestra.run.smithi145.stdout: "reply": 0, 2024-09-05T01:42:11.097 INFO:teuthology.orchestra.run.smithi145.stdout: "reply_latency": { 2024-09-05T01:42:11.097 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.097 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.097 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.097 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.097 INFO:teuthology.orchestra.run.smithi145.stdout: "slow_reply": 0, 2024-09-05T01:42:11.097 INFO:teuthology.orchestra.run.smithi145.stdout: "forward": 0, 2024-09-05T01:42:11.097 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch_complete": 0, 2024-09-05T01:42:11.097 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch_keys": 0, 2024-09-05T01:42:11.097 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_commit": 0, 2024-09-05T01:42:11.097 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_split": 0, 2024-09-05T01:42:11.098 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_merge": 0, 2024-09-05T01:42:11.098 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes": 46417, 2024-09-05T01:42:11.098 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_top": 3869, 2024-09-05T01:42:11.098 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_bottom": 42548, 2024-09-05T01:42:11.098 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pin_tail": 0, 2024-09-05T01:42:11.098 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pinned": 40889, 2024-09-05T01:42:11.098 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_expired": 1, 2024-09-05T01:42:11.098 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_with_caps": 0, 2024-09-05T01:42:11.098 INFO:teuthology.orchestra.run.smithi145.stdout: "caps": 0, 2024-09-05T01:42:11.098 INFO:teuthology.orchestra.run.smithi145.stdout: "subtrees": 1, 2024-09-05T01:42:11.098 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse": 0, 2024-09-05T01:42:11.098 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_hit": 0, 2024-09-05T01:42:11.098 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_forward": 0, 2024-09-05T01:42:11.099 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_discover": 0, 2024-09-05T01:42:11.099 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_dir_fetch": 0, 2024-09-05T01:42:11.099 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_remote_ino": 0, 2024-09-05T01:42:11.099 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_lock": 0, 2024-09-05T01:42:11.099 INFO:teuthology.orchestra.run.smithi145.stdout: "load_cent": 0, 2024-09-05T01:42:11.099 INFO:teuthology.orchestra.run.smithi145.stdout: "q": 0, 2024-09-05T01:42:11.099 INFO:teuthology.orchestra.run.smithi145.stdout: "exported": 0, 2024-09-05T01:42:11.099 INFO:teuthology.orchestra.run.smithi145.stdout: "exported_inodes": 0, 2024-09-05T01:42:11.099 INFO:teuthology.orchestra.run.smithi145.stdout: "imported": 0, 2024-09-05T01:42:11.099 INFO:teuthology.orchestra.run.smithi145.stdout: "imported_inodes": 0, 2024-09-05T01:42:11.099 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_dir_fetch": 0, 2024-09-05T01:42:11.099 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_backtrace_fetch": 0, 2024-09-05T01:42:11.099 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_peer_discover": 0, 2024-09-05T01:42:11.099 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rfiles": 0, 2024-09-05T01:42:11.100 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rbytes": 0, 2024-09-05T01:42:11.100 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rsnaps": 0, 2024-09-05T01:42:11.100 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_backtrace_fetch": 0, 2024-09-05T01:42:11.100 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_set_tag": 0, 2024-09-05T01:42:11.100 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T01:42:11.100 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_inotable_repaired": 0, 2024-09-05T01:42:11.100 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dir_inodes": 0, 2024-09-05T01:42:11.100 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dir_base_inodes": 0, 2024-09-05T01:42:11.100 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dirfrag_rstats": 0, 2024-09-05T01:42:11.100 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_file_inodes": 0, 2024-09-05T01:42:11.100 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_inode_file_caps": 0, 2024-09-05T01:42:11.100 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_revoke": 0, 2024-09-05T01:42:11.100 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_grant": 0, 2024-09-05T01:42:11.100 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_trunc": 0, 2024-09-05T01:42:11.100 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T01:42:11.101 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T01:42:11.101 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_caps": 0, 2024-09-05T01:42:11.101 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_caps_dirty": 0, 2024-09-05T01:42:11.101 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_cap_release": 0, 2024-09-05T01:42:11.101 INFO:teuthology.orchestra.run.smithi145.stdout: "process_request_cap_release": 0 2024-09-05T01:42:11.101 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.101 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache": { 2024-09-05T01:42:11.101 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_update": 0, 2024-09-05T01:42:11.101 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_update_receipt": 0, 2024-09-05T01:42:11.101 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_try_discover": 0, 2024-09-05T01:42:11.101 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_send_discover": 0, 2024-09-05T01:42:11.101 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_handle_discover": 0, 2024-09-05T01:42:11.101 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays": 0, 2024-09-05T01:42:11.101 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_delayed": 0, 2024-09-05T01:42:11.102 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_enqueuing": 0, 2024-09-05T01:42:11.102 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_created": 0, 2024-09-05T01:42:11.102 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_enqueued": 0, 2024-09-05T01:42:11.102 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_reintegrated": 0, 2024-09-05T01:42:11.102 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_migrated": 0, 2024-09-05T01:42:11.102 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_processing": 0, 2024-09-05T01:42:11.102 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_enqueued": 0, 2024-09-05T01:42:11.102 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_prioritized": 0, 2024-09-05T01:42:11.102 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_started": 0, 2024-09-05T01:42:11.102 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_completed": 0, 2024-09-05T01:42:11.102 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_quiesce_path": 0, 2024-09-05T01:42:11.102 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_quiesce_inode": 0, 2024-09-05T01:42:11.102 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_enqueue_scrub": 0, 2024-09-05T01:42:11.102 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_exportdir": 0, 2024-09-05T01:42:11.102 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_flush": 0, 2024-09-05T01:42:11.103 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragmentdir": 0, 2024-09-05T01:42:11.103 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragstats": 0, 2024-09-05T01:42:11.103 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_inodestats": 0 2024-09-05T01:42:11.103 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.103 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log": { 2024-09-05T01:42:11.103 INFO:teuthology.orchestra.run.smithi145.stdout: "evlrg": 0, 2024-09-05T01:42:11.103 INFO:teuthology.orchestra.run.smithi145.stdout: "evadd": 0, 2024-09-05T01:42:11.103 INFO:teuthology.orchestra.run.smithi145.stdout: "evex": 0, 2024-09-05T01:42:11.103 INFO:teuthology.orchestra.run.smithi145.stdout: "evtrm": 0, 2024-09-05T01:42:11.103 INFO:teuthology.orchestra.run.smithi145.stdout: "ev": 91082, 2024-09-05T01:42:11.103 INFO:teuthology.orchestra.run.smithi145.stdout: "evexg": 0, 2024-09-05T01:42:11.103 INFO:teuthology.orchestra.run.smithi145.stdout: "evexd": 0, 2024-09-05T01:42:11.103 INFO:teuthology.orchestra.run.smithi145.stdout: "segadd": 0, 2024-09-05T01:42:11.103 INFO:teuthology.orchestra.run.smithi145.stdout: "segex": 0, 2024-09-05T01:42:11.103 INFO:teuthology.orchestra.run.smithi145.stdout: "segtrm": 0, 2024-09-05T01:42:11.104 INFO:teuthology.orchestra.run.smithi145.stdout: "seg": 128, 2024-09-05T01:42:11.104 INFO:teuthology.orchestra.run.smithi145.stdout: "segmjr": 9, 2024-09-05T01:42:11.104 INFO:teuthology.orchestra.run.smithi145.stdout: "segexg": 0, 2024-09-05T01:42:11.104 INFO:teuthology.orchestra.run.smithi145.stdout: "segexd": 0, 2024-09-05T01:42:11.104 INFO:teuthology.orchestra.run.smithi145.stdout: "expos": 4194304, 2024-09-05T01:42:11.104 INFO:teuthology.orchestra.run.smithi145.stdout: "wrpos": 312106947, 2024-09-05T01:42:11.104 INFO:teuthology.orchestra.run.smithi145.stdout: "rdpos": 312098237, 2024-09-05T01:42:11.104 INFO:teuthology.orchestra.run.smithi145.stdout: "jlat": { 2024-09-05T01:42:11.104 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.104 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.104 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.104 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.104 INFO:teuthology.orchestra.run.smithi145.stdout: "replayed": 91082 2024-09-05T01:42:11.104 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.105 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_mem": { 2024-09-05T01:42:11.105 INFO:teuthology.orchestra.run.smithi145.stdout: "ino": 15236, 2024-09-05T01:42:11.105 INFO:teuthology.orchestra.run.smithi145.stdout: "ino+": 66683, 2024-09-05T01:42:11.105 INFO:teuthology.orchestra.run.smithi145.stdout: "ino-": 51447, 2024-09-05T01:42:11.105 INFO:teuthology.orchestra.run.smithi145.stdout: "dir": 581, 2024-09-05T01:42:11.105 INFO:teuthology.orchestra.run.smithi145.stdout: "dir+": 2250, 2024-09-05T01:42:11.105 INFO:teuthology.orchestra.run.smithi145.stdout: "dir-": 1669, 2024-09-05T01:42:11.105 INFO:teuthology.orchestra.run.smithi145.stdout: "dn": 46417, 2024-09-05T01:42:11.105 INFO:teuthology.orchestra.run.smithi145.stdout: "dn+": 113439, 2024-09-05T01:42:11.105 INFO:teuthology.orchestra.run.smithi145.stdout: "dn-": 67022, 2024-09-05T01:42:11.105 INFO:teuthology.orchestra.run.smithi145.stdout: "cap": 0, 2024-09-05T01:42:11.105 INFO:teuthology.orchestra.run.smithi145.stdout: "cap+": 0, 2024-09-05T01:42:11.105 INFO:teuthology.orchestra.run.smithi145.stdout: "cap-": 0, 2024-09-05T01:42:11.105 INFO:teuthology.orchestra.run.smithi145.stdout: "rss": 156128, 2024-09-05T01:42:11.106 INFO:teuthology.orchestra.run.smithi145.stdout: "heap": 215328 2024-09-05T01:42:11.106 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.106 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_server": { 2024-09-05T01:42:11.106 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_client_request": 0, 2024-09-05T01:42:11.106 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_server_request": 0, 2024-09-05T01:42:11.106 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_request": 0, 2024-09-05T01:42:11.106 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_session": 0, 2024-09-05T01:42:11.106 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_peer_request": 0, 2024-09-05T01:42:11.106 INFO:teuthology.orchestra.run.smithi145.stdout: "req_create_latency": { 2024-09-05T01:42:11.106 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.106 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.106 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.106 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.106 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getattr_latency": { 2024-09-05T01:42:11.106 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.107 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.107 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.107 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.107 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getfilelock_latency": { 2024-09-05T01:42:11.107 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.107 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.107 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.107 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.107 INFO:teuthology.orchestra.run.smithi145.stdout: "req_link_latency": { 2024-09-05T01:42:11.107 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.107 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.107 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.107 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.107 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookup_latency": { 2024-09-05T01:42:11.107 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.108 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.108 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.108 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.108 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookuphash_latency": { 2024-09-05T01:42:11.108 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.108 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.108 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.108 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.108 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupino_latency": { 2024-09-05T01:42:11.108 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.108 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.108 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.108 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.108 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupname_latency": { 2024-09-05T01:42:11.108 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.109 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.109 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.109 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.109 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupparent_latency": { 2024-09-05T01:42:11.109 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.109 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.109 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.109 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.109 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupsnap_latency": { 2024-09-05T01:42:11.109 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.109 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.109 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.109 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.109 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lssnap_latency": { 2024-09-05T01:42:11.109 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.110 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.110 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.110 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.110 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mkdir_latency": { 2024-09-05T01:42:11.110 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.110 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.110 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.110 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.111 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mknod_latency": { 2024-09-05T01:42:11.111 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.111 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.111 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.111 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.111 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mksnap_latency": { 2024-09-05T01:42:11.111 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.111 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.111 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.111 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.111 INFO:teuthology.orchestra.run.smithi145.stdout: "req_open_latency": { 2024-09-05T01:42:11.111 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.111 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.111 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.111 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.112 INFO:teuthology.orchestra.run.smithi145.stdout: "req_readdir_latency": { 2024-09-05T01:42:11.112 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.112 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.112 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.112 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.112 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rename_latency": { 2024-09-05T01:42:11.112 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.112 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.112 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.112 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.112 INFO:teuthology.orchestra.run.smithi145.stdout: "req_renamesnap_latency": { 2024-09-05T01:42:11.113 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.113 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.113 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.113 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.113 INFO:teuthology.orchestra.run.smithi145.stdout: "req_snapdiff_latency": { 2024-09-05T01:42:11.113 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.113 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.113 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.113 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.113 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmdir_latency": { 2024-09-05T01:42:11.113 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.113 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.113 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.113 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.114 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmsnap_latency": { 2024-09-05T01:42:11.114 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.114 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.114 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.114 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.114 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmxattr_latency": { 2024-09-05T01:42:11.114 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.114 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.114 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.114 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.114 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setattr_latency": { 2024-09-05T01:42:11.114 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.114 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.114 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.115 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.115 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setdirlayout_latency": { 2024-09-05T01:42:11.115 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.115 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.115 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.115 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.115 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setfilelock_latency": { 2024-09-05T01:42:11.115 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.115 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.115 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.115 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.115 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setlayout_latency": { 2024-09-05T01:42:11.115 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.116 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.116 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.116 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.116 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setxattr_latency": { 2024-09-05T01:42:11.116 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.116 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.116 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.116 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.116 INFO:teuthology.orchestra.run.smithi145.stdout: "req_symlink_latency": { 2024-09-05T01:42:11.116 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.116 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.116 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.116 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.117 INFO:teuthology.orchestra.run.smithi145.stdout: "req_unlink_latency": { 2024-09-05T01:42:11.117 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.117 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.117 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.117 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.117 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_revoke_eviction": 0, 2024-09-05T01:42:11.117 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_acquisition_throttle": 0, 2024-09-05T01:42:11.117 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getvxattr_latency": { 2024-09-05T01:42:11.117 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.117 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.117 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.117 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:11.117 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.117 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_sessions": { 2024-09-05T01:42:11.118 INFO:teuthology.orchestra.run.smithi145.stdout: "session_count": 1, 2024-09-05T01:42:11.118 INFO:teuthology.orchestra.run.smithi145.stdout: "session_add": 2, 2024-09-05T01:42:11.118 INFO:teuthology.orchestra.run.smithi145.stdout: "session_remove": 1, 2024-09-05T01:42:11.118 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_open": 1, 2024-09-05T01:42:11.118 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_stale": 0, 2024-09-05T01:42:11.118 INFO:teuthology.orchestra.run.smithi145.stdout: "total_load": 0, 2024-09-05T01:42:11.118 INFO:teuthology.orchestra.run.smithi145.stdout: "average_load": 0, 2024-09-05T01:42:11.118 INFO:teuthology.orchestra.run.smithi145.stdout: "avg_session_uptime": 2390, 2024-09-05T01:42:11.118 INFO:teuthology.orchestra.run.smithi145.stdout: "mdthresh_evicted": 0 2024-09-05T01:42:11.118 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.118 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2024-09-05T01:42:11.118 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 0, 2024-09-05T01:42:11.118 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 0, 2024-09-05T01:42:11.118 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T01:42:11.118 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2024-09-05T01:42:11.119 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T01:42:11.119 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2024-09-05T01:42:11.119 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T01:42:11.119 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T01:42:11.119 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T01:42:11.119 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T01:42:11.119 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T01:42:11.119 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2024-09-05T01:42:11.119 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T01:42:11.119 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T01:42:11.119 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_bytes": 0, 2024-09-05T01:42:11.119 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_items": 0, 2024-09-05T01:42:11.119 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_bytes": 0, 2024-09-05T01:42:11.120 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_items": 0, 2024-09-05T01:42:11.120 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T01:42:11.120 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T01:42:11.120 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T01:42:11.120 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T01:42:11.120 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T01:42:11.120 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2024-09-05T01:42:11.120 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2024-09-05T01:42:11.120 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2024-09-05T01:42:11.120 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T01:42:11.120 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T01:42:11.120 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2024-09-05T01:42:11.120 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2024-09-05T01:42:11.121 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2024-09-05T01:42:11.121 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2024-09-05T01:42:11.121 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T01:42:11.121 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2024-09-05T01:42:11.121 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T01:42:11.121 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2024-09-05T01:42:11.121 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 813143, 2024-09-05T01:42:11.121 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 15585, 2024-09-05T01:42:11.121 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 0, 2024-09-05T01:42:11.121 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 0, 2024-09-05T01:42:11.121 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2024-09-05T01:42:11.121 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2024-09-05T01:42:11.121 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2024-09-05T01:42:11.121 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2024-09-05T01:42:11.122 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2024-09-05T01:42:11.122 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2024-09-05T01:42:11.122 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 8512, 2024-09-05T01:42:11.122 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 191, 2024-09-05T01:42:11.122 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T01:42:11.122 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2024-09-05T01:42:11.122 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2024-09-05T01:42:11.122 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2024-09-05T01:42:11.122 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 68765665, 2024-09-05T01:42:11.122 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 677475, 2024-09-05T01:42:11.122 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2024-09-05T01:42:11.122 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2024-09-05T01:42:11.122 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2024-09-05T01:42:11.122 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2024-09-05T01:42:11.123 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.123 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter": { 2024-09-05T01:42:11.123 INFO:teuthology.orchestra.run.smithi145.stdout: "op_active": 0, 2024-09-05T01:42:11.123 INFO:teuthology.orchestra.run.smithi145.stdout: "op_laggy": 0, 2024-09-05T01:42:11.123 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send": 4042, 2024-09-05T01:42:11.123 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send_bytes": 21, 2024-09-05T01:42:11.123 INFO:teuthology.orchestra.run.smithi145.stdout: "op_resend": 3, 2024-09-05T01:42:11.123 INFO:teuthology.orchestra.run.smithi145.stdout: "op_reply": 4042, 2024-09-05T01:42:11.123 INFO:teuthology.orchestra.run.smithi145.stdout: "op_latency": { 2024-09-05T01:42:11.123 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 4042, 2024-09-05T01:42:11.123 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 18.564621149, 2024-09-05T01:42:11.123 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.004592929 2024-09-05T01:42:11.123 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.123 INFO:teuthology.orchestra.run.smithi145.stdout: "op_inflight": 0, 2024-09-05T01:42:11.123 INFO:teuthology.orchestra.run.smithi145.stdout: "oplen_avg": { 2024-09-05T01:42:11.123 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 4042, 2024-09-05T01:42:11.124 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 4043 2024-09-05T01:42:11.124 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.124 INFO:teuthology.orchestra.run.smithi145.stdout: "op": 4042, 2024-09-05T01:42:11.124 INFO:teuthology.orchestra.run.smithi145.stdout: "op_r": 4042, 2024-09-05T01:42:11.124 INFO:teuthology.orchestra.run.smithi145.stdout: "op_w": 0, 2024-09-05T01:42:11.124 INFO:teuthology.orchestra.run.smithi145.stdout: "op_rmw": 0, 2024-09-05T01:42:11.124 INFO:teuthology.orchestra.run.smithi145.stdout: "op_pg": 0, 2024-09-05T01:42:11.124 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_stat": 2452, 2024-09-05T01:42:11.124 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_create": 0, 2024-09-05T01:42:11.124 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_read": 1588, 2024-09-05T01:42:11.124 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_write": 0, 2024-09-05T01:42:11.124 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writefull": 0, 2024-09-05T01:42:11.124 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writesame": 0, 2024-09-05T01:42:11.124 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_append": 0, 2024-09-05T01:42:11.125 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_zero": 0, 2024-09-05T01:42:11.125 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_truncate": 0, 2024-09-05T01:42:11.125 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_delete": 0, 2024-09-05T01:42:11.125 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_mapext": 0, 2024-09-05T01:42:11.125 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_sparse_read": 0, 2024-09-05T01:42:11.125 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_clonerange": 0, 2024-09-05T01:42:11.125 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_getxattr": 1, 2024-09-05T01:42:11.125 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_setxattr": 0, 2024-09-05T01:42:11.125 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_cmpxattr": 0, 2024-09-05T01:42:11.125 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_rmxattr": 0, 2024-09-05T01:42:11.125 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_resetxattrs": 0, 2024-09-05T01:42:11.125 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_call": 0, 2024-09-05T01:42:11.125 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_watch": 0, 2024-09-05T01:42:11.125 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_notify": 0, 2024-09-05T01:42:11.125 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T01:42:11.126 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls": 0, 2024-09-05T01:42:11.126 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls_filter": 0, 2024-09-05T01:42:11.126 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_other": 0, 2024-09-05T01:42:11.126 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_active": 0, 2024-09-05T01:42:11.126 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_send": 0, 2024-09-05T01:42:11.126 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_resend": 0, 2024-09-05T01:42:11.126 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_ping": 0, 2024-09-05T01:42:11.126 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_active": 0, 2024-09-05T01:42:11.126 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_send": 0, 2024-09-05T01:42:11.126 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_resend": 0, 2024-09-05T01:42:11.126 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_active": 0, 2024-09-05T01:42:11.126 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_send": 0, 2024-09-05T01:42:11.126 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_resend": 0, 2024-09-05T01:42:11.126 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_active": 0, 2024-09-05T01:42:11.127 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_send": 0, 2024-09-05T01:42:11.127 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_resend": 0, 2024-09-05T01:42:11.127 INFO:teuthology.orchestra.run.smithi145.stdout: "command_active": 0, 2024-09-05T01:42:11.127 INFO:teuthology.orchestra.run.smithi145.stdout: "command_send": 0, 2024-09-05T01:42:11.127 INFO:teuthology.orchestra.run.smithi145.stdout: "command_resend": 0, 2024-09-05T01:42:11.127 INFO:teuthology.orchestra.run.smithi145.stdout: "map_epoch": 108, 2024-09-05T01:42:11.127 INFO:teuthology.orchestra.run.smithi145.stdout: "map_full": 0, 2024-09-05T01:42:11.127 INFO:teuthology.orchestra.run.smithi145.stdout: "map_inc": 27, 2024-09-05T01:42:11.127 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_sessions": 11, 2024-09-05T01:42:11.127 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_open": 11, 2024-09-05T01:42:11.127 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_close": 0, 2024-09-05T01:42:11.127 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_laggy": 0, 2024-09-05T01:42:11.127 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_wr": 0, 2024-09-05T01:42:11.127 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_rd": 2, 2024-09-05T01:42:11.128 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_del": 0 2024-09-05T01:42:11.128 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.128 INFO:teuthology.orchestra.run.smithi145.stdout: "oft": { 2024-09-05T01:42:11.128 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_objs": 0, 2024-09-05T01:42:11.128 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_kv_pairs": 0, 2024-09-05T01:42:11.128 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_updates": 0, 2024-09-05T01:42:11.128 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_removes": 0 2024-09-05T01:42:11.128 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.128 INFO:teuthology.orchestra.run.smithi145.stdout: "osd-slow-ops": { 2024-09-05T01:42:11.128 INFO:teuthology.orchestra.run.smithi145.stdout: "slow_ops_count": 0 2024-09-05T01:42:11.128 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.128 INFO:teuthology.orchestra.run.smithi145.stdout: "purge_queue": { 2024-09-05T01:42:11.128 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops": 0, 2024-09-05T01:42:11.128 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops_high_water": 0, 2024-09-05T01:42:11.128 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing": 0, 2024-09-05T01:42:11.129 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_high_water": 0, 2024-09-05T01:42:11.129 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed_ops": 0, 2024-09-05T01:42:11.129 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed": 0, 2024-09-05T01:42:11.129 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_item_in_journal": 0 2024-09-05T01:42:11.129 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.129 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T01:42:11.129 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-05T01:42:11.129 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-09-05T01:42:11.129 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-05T01:42:11.129 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 4458, 2024-09-05T01:42:11.129 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 310628138, 2024-09-05T01:42:11.129 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:11.129 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 4458, 2024-09-05T01:42:11.129 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-09-05T01:42:11.129 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-09-05T01:42:11.130 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 4458, 2024-09-05T01:42:11.130 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 310628138, 2024-09-05T01:42:11.130 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-05T01:42:11.130 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.130 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.130 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.130 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:11.130 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.130 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_bytes": { 2024-09-05T01:42:11.130 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-05T01:42:11.130 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-09-05T01:42:11.130 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-05T01:42:11.130 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-09-05T01:42:11.130 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-09-05T01:42:11.130 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:11.131 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:11.131 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 4042, 2024-09-05T01:42:11.131 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 307950496, 2024-09-05T01:42:11.131 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 4042, 2024-09-05T01:42:11.131 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 307950496, 2024-09-05T01:42:11.131 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-05T01:42:11.131 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.131 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.131 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.131 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:11.131 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.131 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_ops": { 2024-09-05T01:42:11.131 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-05T01:42:11.131 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 1024, 2024-09-05T01:42:11.132 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-05T01:42:11.132 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-09-05T01:42:11.132 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-09-05T01:42:11.132 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:11.132 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:11.132 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 4042, 2024-09-05T01:42:11.132 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 4042, 2024-09-05T01:42:11.132 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 4042, 2024-09-05T01:42:11.132 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 4042, 2024-09-05T01:42:11.132 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-05T01:42:11.132 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.132 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.132 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.133 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:11.133 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.133 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle": { 2024-09-05T01:42:11.133 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-05T01:42:11.133 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2024-09-05T01:42:11.133 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-05T01:42:11.133 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-09-05T01:42:11.133 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-09-05T01:42:11.133 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:11.133 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:11.133 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-09-05T01:42:11.133 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-09-05T01:42:11.133 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 0, 2024-09-05T01:42:11.133 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 0, 2024-09-05T01:42:11.134 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-05T01:42:11.134 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.134 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.134 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.134 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:11.134 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:11.134 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle-0x564192d06b40": { 2024-09-05T01:42:11.134 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-05T01:42:11.134 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2024-09-05T01:42:11.134 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-05T01:42:11.134 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-09-05T01:42:11.134 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-09-05T01:42:11.134 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:11.134 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:11.135 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-09-05T01:42:11.135 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-09-05T01:42:11.135 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 0, 2024-09-05T01:42:11.135 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 0, 2024-09-05T01:42:11.135 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-05T01:42:11.135 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:11.135 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:11.135 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:11.135 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:11.135 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:11.135 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-09-05T01:42:11.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:11 smithi012 ceph-mon[29942]: pgmap v549: 97 pgs: 37 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 40 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 69 KiB/s wr, 36 op/s 2024-09-05T01:42:11.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:11 smithi145 ceph-mon[34376]: pgmap v549: 97 pgs: 37 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 40 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 69 KiB/s wr, 36 op/s 2024-09-05T01:42:11.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:11 smithi151 ceph-mon[35013]: pgmap v549: 97 pgs: 37 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 40 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 69 KiB/s wr, 36 op/s 2024-09-05T01:42:13.519 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:13 smithi145 ceph-mon[34376]: pgmap v550: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 69 KiB/s wr, 39 op/s 2024-09-05T01:42:13.519 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:13 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:42:13.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:13 smithi012 ceph-mon[29942]: pgmap v550: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 69 KiB/s wr, 39 op/s 2024-09-05T01:42:13.566 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:13 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:42:13.570 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-05T01:42:13.570 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-05T01:42:13.570 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-09-05T01:42:13.570 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-05T01:42:13.570 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-05T01:42:13.570 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-09-05T01:42:13.570 DEBUG:tasks.check_counter:Getting stats from h 2024-09-05T01:42:13.570 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-05T01:42:13.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:13 smithi151 ceph-mon[35013]: pgmap v550: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 69 KiB/s wr, 39 op/s 2024-09-05T01:42:13.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:13 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-05T01:42:14.072 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T01:42:14.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:14 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:42:14.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:14 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:42:14.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:14 smithi012 ceph-mon[29942]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:42:14.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:14 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:42:14.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:14 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:42:14.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:14 smithi145 ceph-mon[34376]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:42:14.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:14 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-05T01:42:14.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:14 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-05T01:42:14.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:14 smithi151 ceph-mon[35013]: from='mgr.15138 ' entity='mgr.x' 2024-09-05T01:42:15.181 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-09-05T01:42:15.181 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T01:42:15.181 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 198794, 2024-09-05T01:42:15.181 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 322934, 2024-09-05T01:42:15.181 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 77233020, 2024-09-05T01:42:15.182 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 224677706, 2024-09-05T01:42:15.182 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 14, 2024-09-05T01:42:15.182 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 2, 2024-09-05T01:42:15.182 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 10.156242598, 2024-09-05T01:42:15.182 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 4.603214582, 2024-09-05T01:42:15.182 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 11.830899905, 2024-09-05T01:42:15.182 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.357024566, 2024-09-05T01:42:15.182 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:15.182 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 322936, 2024-09-05T01:42:15.182 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 37.844148150, 2024-09-05T01:42:15.182 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000117187 2024-09-05T01:42:15.182 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.182 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:15.182 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 369806, 2024-09-05T01:42:15.183 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.072040512, 2024-09-05T01:42:15.183 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000194 2024-09-05T01:42:15.183 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.183 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 1997744, 2024-09-05T01:42:15.183 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 727856 2024-09-05T01:42:15.183 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.183 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T01:42:15.183 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 66254, 2024-09-05T01:42:15.183 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 66505, 2024-09-05T01:42:15.183 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 17536740, 2024-09-05T01:42:15.183 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 179901666, 2024-09-05T01:42:15.183 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 18, 2024-09-05T01:42:15.183 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 8, 2024-09-05T01:42:15.184 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 4.746797272, 2024-09-05T01:42:15.184 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 1.695390475, 2024-09-05T01:42:15.184 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.944528653, 2024-09-05T01:42:15.184 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 1.735596832, 2024-09-05T01:42:15.184 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:15.184 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 66500, 2024-09-05T01:42:15.184 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 5.136789240, 2024-09-05T01:42:15.184 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000077244 2024-09-05T01:42:15.184 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.184 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:15.184 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 28, 2024-09-05T01:42:15.184 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000004201, 2024-09-05T01:42:15.184 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000150 2024-09-05T01:42:15.184 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.185 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-05T01:42:15.185 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 601040 2024-09-05T01:42:15.185 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.185 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T01:42:15.185 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 108685, 2024-09-05T01:42:15.185 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 112457, 2024-09-05T01:42:15.185 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 74989413, 2024-09-05T01:42:15.185 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 184566877, 2024-09-05T01:42:15.185 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 29, 2024-09-05T01:42:15.185 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 6, 2024-09-05T01:42:15.185 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 7.053808148, 2024-09-05T01:42:15.185 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 2.949089032, 2024-09-05T01:42:15.185 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 3.470431216, 2024-09-05T01:42:15.186 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 1.384679749, 2024-09-05T01:42:15.186 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:15.186 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 112455, 2024-09-05T01:42:15.186 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 11.507596875, 2024-09-05T01:42:15.186 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000102330 2024-09-05T01:42:15.186 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.186 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:15.186 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 114439, 2024-09-05T01:42:15.186 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.020644449, 2024-09-05T01:42:15.186 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000180 2024-09-05T01:42:15.186 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.186 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-05T01:42:15.186 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 0 2024-09-05T01:42:15.186 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.187 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2024-09-05T01:42:15.187 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 1, 2024-09-05T01:42:15.187 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2024-09-05T01:42:15.187 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.187 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-MDSRank": { 2024-09-05T01:42:15.187 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2024-09-05T01:42:15.187 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2024-09-05T01:42:15.187 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 88414, 2024-09-05T01:42:15.187 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 81.171490577, 2024-09-05T01:42:15.187 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000918084 2024-09-05T01:42:15.187 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:15.187 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.187 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-PurgeQueue": { 2024-09-05T01:42:15.188 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2024-09-05T01:42:15.188 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2024-09-05T01:42:15.188 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 18808, 2024-09-05T01:42:15.188 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 4.907319784, 2024-09-05T01:42:15.188 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000260916 2024-09-05T01:42:15.188 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:15.188 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.188 INFO:teuthology.orchestra.run.smithi145.stdout: "mds": { 2024-09-05T01:42:15.188 INFO:teuthology.orchestra.run.smithi145.stdout: "request": 76143, 2024-09-05T01:42:15.188 INFO:teuthology.orchestra.run.smithi145.stdout: "reply": 74491, 2024-09-05T01:42:15.188 INFO:teuthology.orchestra.run.smithi145.stdout: "reply_latency": { 2024-09-05T01:42:15.188 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 74491, 2024-09-05T01:42:15.188 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 518.899982047, 2024-09-05T01:42:15.189 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.006965941 2024-09-05T01:42:15.189 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.189 INFO:teuthology.orchestra.run.smithi145.stdout: "slow_reply": 0, 2024-09-05T01:42:15.189 INFO:teuthology.orchestra.run.smithi145.stdout: "forward": 1648, 2024-09-05T01:42:15.189 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch_complete": 68, 2024-09-05T01:42:15.189 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch_keys": 0, 2024-09-05T01:42:15.189 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_commit": 1218, 2024-09-05T01:42:15.189 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_split": 125, 2024-09-05T01:42:15.189 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_merge": 0, 2024-09-05T01:42:15.189 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes": 24689, 2024-09-05T01:42:15.189 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_top": 0, 2024-09-05T01:42:15.189 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_bottom": 2, 2024-09-05T01:42:15.189 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pin_tail": 24687, 2024-09-05T01:42:15.190 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pinned": 24687, 2024-09-05T01:42:15.190 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_expired": 94742, 2024-09-05T01:42:15.190 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_with_caps": 2, 2024-09-05T01:42:15.190 INFO:teuthology.orchestra.run.smithi145.stdout: "caps": 2, 2024-09-05T01:42:15.190 INFO:teuthology.orchestra.run.smithi145.stdout: "subtrees": 3, 2024-09-05T01:42:15.190 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse": 123017, 2024-09-05T01:42:15.190 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_hit": 103429, 2024-09-05T01:42:15.190 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_forward": 1399, 2024-09-05T01:42:15.190 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_discover": 511, 2024-09-05T01:42:15.190 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_dir_fetch": 13, 2024-09-05T01:42:15.190 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_remote_ino": 0, 2024-09-05T01:42:15.190 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_lock": 124, 2024-09-05T01:42:15.190 INFO:teuthology.orchestra.run.smithi145.stdout: "load_cent": 0, 2024-09-05T01:42:15.190 INFO:teuthology.orchestra.run.smithi145.stdout: "q": 0, 2024-09-05T01:42:15.191 INFO:teuthology.orchestra.run.smithi145.stdout: "exported": 223, 2024-09-05T01:42:15.191 INFO:teuthology.orchestra.run.smithi145.stdout: "exported_inodes": 76147, 2024-09-05T01:42:15.191 INFO:teuthology.orchestra.run.smithi145.stdout: "imported": 272, 2024-09-05T01:42:15.191 INFO:teuthology.orchestra.run.smithi145.stdout: "imported_inodes": 61014, 2024-09-05T01:42:15.191 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_dir_fetch": 0, 2024-09-05T01:42:15.191 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_backtrace_fetch": 110239, 2024-09-05T01:42:15.191 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_peer_discover": 0, 2024-09-05T01:42:15.191 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rfiles": 6751, 2024-09-05T01:42:15.191 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rbytes": 158779880, 2024-09-05T01:42:15.191 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rsnaps": 6, 2024-09-05T01:42:15.191 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_backtrace_fetch": 110239, 2024-09-05T01:42:15.191 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_set_tag": 0, 2024-09-05T01:42:15.191 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T01:42:15.192 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_inotable_repaired": 0, 2024-09-05T01:42:15.192 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dir_inodes": 706, 2024-09-05T01:42:15.192 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dir_base_inodes": 0, 2024-09-05T01:42:15.192 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dirfrag_rstats": 706, 2024-09-05T01:42:15.192 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_file_inodes": 109533, 2024-09-05T01:42:15.192 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_inode_file_caps": 134, 2024-09-05T01:42:15.192 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_revoke": 19897, 2024-09-05T01:42:15.192 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_grant": 33829, 2024-09-05T01:42:15.192 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_trunc": 0, 2024-09-05T01:42:15.192 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T01:42:15.192 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T01:42:15.192 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_caps": 57649, 2024-09-05T01:42:15.192 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_caps_dirty": 25774, 2024-09-05T01:42:15.193 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_cap_release": 447, 2024-09-05T01:42:15.193 INFO:teuthology.orchestra.run.smithi145.stdout: "process_request_cap_release": 38540 2024-09-05T01:42:15.193 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.193 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache": { 2024-09-05T01:42:15.193 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_update": 2, 2024-09-05T01:42:15.193 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_update_receipt": 3, 2024-09-05T01:42:15.193 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_try_discover": 2, 2024-09-05T01:42:15.193 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_send_discover": 677, 2024-09-05T01:42:15.193 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_handle_discover": 465, 2024-09-05T01:42:15.193 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays": 61, 2024-09-05T01:42:15.193 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_delayed": 0, 2024-09-05T01:42:15.193 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_enqueuing": 0, 2024-09-05T01:42:15.193 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_created": 9612, 2024-09-05T01:42:15.193 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_enqueued": 9551, 2024-09-05T01:42:15.194 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_reintegrated": 0, 2024-09-05T01:42:15.194 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_migrated": 0, 2024-09-05T01:42:15.194 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_processing": 0, 2024-09-05T01:42:15.194 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_enqueued": 0, 2024-09-05T01:42:15.194 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_prioritized": 0, 2024-09-05T01:42:15.194 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_started": 0, 2024-09-05T01:42:15.194 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_completed": 0, 2024-09-05T01:42:15.194 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_quiesce_path": 0, 2024-09-05T01:42:15.194 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_quiesce_inode": 0, 2024-09-05T01:42:15.194 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_enqueue_scrub": 0, 2024-09-05T01:42:15.194 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_exportdir": 230, 2024-09-05T01:42:15.194 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_flush": 0, 2024-09-05T01:42:15.194 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragmentdir": 126, 2024-09-05T01:42:15.195 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragstats": 0, 2024-09-05T01:42:15.195 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_inodestats": 0 2024-09-05T01:42:15.195 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.195 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log": { 2024-09-05T01:42:15.195 INFO:teuthology.orchestra.run.smithi145.stdout: "evlrg": 4, 2024-09-05T01:42:15.195 INFO:teuthology.orchestra.run.smithi145.stdout: "evadd": 106080, 2024-09-05T01:42:15.195 INFO:teuthology.orchestra.run.smithi145.stdout: "evex": 12428, 2024-09-05T01:42:15.195 INFO:teuthology.orchestra.run.smithi145.stdout: "evtrm": 12291, 2024-09-05T01:42:15.195 INFO:teuthology.orchestra.run.smithi145.stdout: "ev": 93789, 2024-09-05T01:42:15.195 INFO:teuthology.orchestra.run.smithi145.stdout: "evexg": 0, 2024-09-05T01:42:15.195 INFO:teuthology.orchestra.run.smithi145.stdout: "evexd": 12427, 2024-09-05T01:42:15.195 INFO:teuthology.orchestra.run.smithi145.stdout: "segadd": 145, 2024-09-05T01:42:15.195 INFO:teuthology.orchestra.run.smithi145.stdout: "segex": 17, 2024-09-05T01:42:15.195 INFO:teuthology.orchestra.run.smithi145.stdout: "segtrm": 16, 2024-09-05T01:42:15.196 INFO:teuthology.orchestra.run.smithi145.stdout: "seg": 129, 2024-09-05T01:42:15.196 INFO:teuthology.orchestra.run.smithi145.stdout: "segmjr": 8, 2024-09-05T01:42:15.196 INFO:teuthology.orchestra.run.smithi145.stdout: "segexg": 0, 2024-09-05T01:42:15.196 INFO:teuthology.orchestra.run.smithi145.stdout: "segexd": 16, 2024-09-05T01:42:15.196 INFO:teuthology.orchestra.run.smithi145.stdout: "expos": 32948863, 2024-09-05T01:42:15.196 INFO:teuthology.orchestra.run.smithi145.stdout: "wrpos": 352010557, 2024-09-05T01:42:15.196 INFO:teuthology.orchestra.run.smithi145.stdout: "rdpos": 0, 2024-09-05T01:42:15.196 INFO:teuthology.orchestra.run.smithi145.stdout: "jlat": { 2024-09-05T01:42:15.196 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 2055, 2024-09-05T01:42:15.196 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 121.868757244, 2024-09-05T01:42:15.196 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.059303531 2024-09-05T01:42:15.196 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.196 INFO:teuthology.orchestra.run.smithi145.stdout: "replayed": 0 2024-09-05T01:42:15.196 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.197 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_mem": { 2024-09-05T01:42:15.197 INFO:teuthology.orchestra.run.smithi145.stdout: "ino": 13689, 2024-09-05T01:42:15.197 INFO:teuthology.orchestra.run.smithi145.stdout: "ino+": 76977, 2024-09-05T01:42:15.197 INFO:teuthology.orchestra.run.smithi145.stdout: "ino-": 63288, 2024-09-05T01:42:15.197 INFO:teuthology.orchestra.run.smithi145.stdout: "dir": 402, 2024-09-05T01:42:15.197 INFO:teuthology.orchestra.run.smithi145.stdout: "dir+": 2616, 2024-09-05T01:42:15.197 INFO:teuthology.orchestra.run.smithi145.stdout: "dir-": 2214, 2024-09-05T01:42:15.197 INFO:teuthology.orchestra.run.smithi145.stdout: "dn": 24689, 2024-09-05T01:42:15.197 INFO:teuthology.orchestra.run.smithi145.stdout: "dn+": 130658, 2024-09-05T01:42:15.197 INFO:teuthology.orchestra.run.smithi145.stdout: "dn-": 105969, 2024-09-05T01:42:15.197 INFO:teuthology.orchestra.run.smithi145.stdout: "cap": 2, 2024-09-05T01:42:15.197 INFO:teuthology.orchestra.run.smithi145.stdout: "cap+": 47957, 2024-09-05T01:42:15.197 INFO:teuthology.orchestra.run.smithi145.stdout: "cap-": 47955, 2024-09-05T01:42:15.198 INFO:teuthology.orchestra.run.smithi145.stdout: "rss": 223920, 2024-09-05T01:42:15.198 INFO:teuthology.orchestra.run.smithi145.stdout: "heap": 223520 2024-09-05T01:42:15.198 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.198 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_server": { 2024-09-05T01:42:15.198 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_client_request": 87091, 2024-09-05T01:42:15.198 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_server_request": 4880, 2024-09-05T01:42:15.198 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_request": 76143, 2024-09-05T01:42:15.198 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_session": 178, 2024-09-05T01:42:15.198 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_peer_request": 12849, 2024-09-05T01:42:15.198 INFO:teuthology.orchestra.run.smithi145.stdout: "req_create_latency": { 2024-09-05T01:42:15.198 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 22362, 2024-09-05T01:42:15.198 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 43.881971630, 2024-09-05T01:42:15.198 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.001962345 2024-09-05T01:42:15.198 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.199 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getattr_latency": { 2024-09-05T01:42:15.199 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 48, 2024-09-05T01:42:15.199 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.241161059, 2024-09-05T01:42:15.199 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.005024188 2024-09-05T01:42:15.199 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.199 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getfilelock_latency": { 2024-09-05T01:42:15.199 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.199 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.199 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.199 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.199 INFO:teuthology.orchestra.run.smithi145.stdout: "req_link_latency": { 2024-09-05T01:42:15.199 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.200 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.200 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.200 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.200 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookup_latency": { 2024-09-05T01:42:15.200 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 15422, 2024-09-05T01:42:15.200 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 218.201665197, 2024-09-05T01:42:15.200 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.014148726 2024-09-05T01:42:15.200 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.200 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookuphash_latency": { 2024-09-05T01:42:15.200 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.200 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.200 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.200 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.201 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupino_latency": { 2024-09-05T01:42:15.201 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1, 2024-09-05T01:42:15.201 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000132467, 2024-09-05T01:42:15.201 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000132467 2024-09-05T01:42:15.201 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.201 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupname_latency": { 2024-09-05T01:42:15.201 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.201 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.201 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.201 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.201 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupparent_latency": { 2024-09-05T01:42:15.201 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.201 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.201 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.202 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.202 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupsnap_latency": { 2024-09-05T01:42:15.202 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.202 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.202 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.203 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.203 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lssnap_latency": { 2024-09-05T01:42:15.203 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.203 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.203 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.203 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.203 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mkdir_latency": { 2024-09-05T01:42:15.203 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 153, 2024-09-05T01:42:15.203 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 1.319639734, 2024-09-05T01:42:15.203 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.008625096 2024-09-05T01:42:15.203 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.203 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mknod_latency": { 2024-09-05T01:42:15.203 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.204 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.204 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.204 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.204 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mksnap_latency": { 2024-09-05T01:42:15.204 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.204 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.204 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.204 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.204 INFO:teuthology.orchestra.run.smithi145.stdout: "req_open_latency": { 2024-09-05T01:42:15.204 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 5934, 2024-09-05T01:42:15.204 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 25.937339376, 2024-09-05T01:42:15.204 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.004370970 2024-09-05T01:42:15.204 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.205 INFO:teuthology.orchestra.run.smithi145.stdout: "req_readdir_latency": { 2024-09-05T01:42:15.205 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 389, 2024-09-05T01:42:15.205 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.535850934, 2024-09-05T01:42:15.205 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.001377508 2024-09-05T01:42:15.205 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.205 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rename_latency": { 2024-09-05T01:42:15.205 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 22382, 2024-09-05T01:42:15.205 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 202.423767258, 2024-09-05T01:42:15.205 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.009044042 2024-09-05T01:42:15.205 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.205 INFO:teuthology.orchestra.run.smithi145.stdout: "req_renamesnap_latency": { 2024-09-05T01:42:15.205 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.205 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.206 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.206 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.206 INFO:teuthology.orchestra.run.smithi145.stdout: "req_snapdiff_latency": { 2024-09-05T01:42:15.206 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.206 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.206 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.206 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.206 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmdir_latency": { 2024-09-05T01:42:15.206 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 61, 2024-09-05T01:42:15.206 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 6.458486833, 2024-09-05T01:42:15.206 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.105876833 2024-09-05T01:42:15.206 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.206 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmsnap_latency": { 2024-09-05T01:42:15.206 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.207 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.207 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.207 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.207 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmxattr_latency": { 2024-09-05T01:42:15.207 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.207 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.207 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.207 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.207 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setattr_latency": { 2024-09-05T01:42:15.207 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.207 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.207 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.207 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.208 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setdirlayout_latency": { 2024-09-05T01:42:15.208 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.208 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.208 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.208 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.208 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setfilelock_latency": { 2024-09-05T01:42:15.208 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.208 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.208 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.208 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.208 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setlayout_latency": { 2024-09-05T01:42:15.208 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.208 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.208 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.209 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.209 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setxattr_latency": { 2024-09-05T01:42:15.209 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.209 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.209 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.209 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.209 INFO:teuthology.orchestra.run.smithi145.stdout: "req_symlink_latency": { 2024-09-05T01:42:15.209 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.209 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.209 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.209 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.209 INFO:teuthology.orchestra.run.smithi145.stdout: "req_unlink_latency": { 2024-09-05T01:42:15.209 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 7739, 2024-09-05T01:42:15.209 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 19.899967559, 2024-09-05T01:42:15.209 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.002571387 2024-09-05T01:42:15.210 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.210 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_revoke_eviction": 0, 2024-09-05T01:42:15.210 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_acquisition_throttle": 0, 2024-09-05T01:42:15.210 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getvxattr_latency": { 2024-09-05T01:42:15.210 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.210 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.210 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.210 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:15.210 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.210 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_sessions": { 2024-09-05T01:42:15.210 INFO:teuthology.orchestra.run.smithi145.stdout: "session_count": 1, 2024-09-05T01:42:15.210 INFO:teuthology.orchestra.run.smithi145.stdout: "session_add": 4, 2024-09-05T01:42:15.210 INFO:teuthology.orchestra.run.smithi145.stdout: "session_remove": 3, 2024-09-05T01:42:15.210 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_open": 1, 2024-09-05T01:42:15.211 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_stale": 0, 2024-09-05T01:42:15.211 INFO:teuthology.orchestra.run.smithi145.stdout: "total_load": 590, 2024-09-05T01:42:15.211 INFO:teuthology.orchestra.run.smithi145.stdout: "average_load": 590, 2024-09-05T01:42:15.211 INFO:teuthology.orchestra.run.smithi145.stdout: "avg_session_uptime": 1050, 2024-09-05T01:42:15.211 INFO:teuthology.orchestra.run.smithi145.stdout: "mdthresh_evicted": 0 2024-09-05T01:42:15.211 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.211 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2024-09-05T01:42:15.211 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 0, 2024-09-05T01:42:15.211 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 0, 2024-09-05T01:42:15.211 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T01:42:15.211 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2024-09-05T01:42:15.211 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T01:42:15.211 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2024-09-05T01:42:15.211 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T01:42:15.211 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T01:42:15.212 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T01:42:15.212 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T01:42:15.212 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T01:42:15.212 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2024-09-05T01:42:15.212 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T01:42:15.212 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T01:42:15.212 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_bytes": 0, 2024-09-05T01:42:15.212 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_items": 0, 2024-09-05T01:42:15.212 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_bytes": 0, 2024-09-05T01:42:15.212 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_items": 0, 2024-09-05T01:42:15.212 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T01:42:15.212 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T01:42:15.212 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T01:42:15.213 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T01:42:15.213 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T01:42:15.213 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2024-09-05T01:42:15.213 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2024-09-05T01:42:15.213 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2024-09-05T01:42:15.213 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T01:42:15.213 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T01:42:15.213 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2024-09-05T01:42:15.213 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2024-09-05T01:42:15.213 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2024-09-05T01:42:15.213 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2024-09-05T01:42:15.213 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T01:42:15.213 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2024-09-05T01:42:15.213 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T01:42:15.214 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2024-09-05T01:42:15.214 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 1355082, 2024-09-05T01:42:15.214 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 14014, 2024-09-05T01:42:15.214 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 88, 2024-09-05T01:42:15.214 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 1, 2024-09-05T01:42:15.214 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2024-09-05T01:42:15.214 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2024-09-05T01:42:15.214 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2024-09-05T01:42:15.214 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2024-09-05T01:42:15.214 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2024-09-05T01:42:15.214 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2024-09-05T01:42:15.214 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 8512, 2024-09-05T01:42:15.214 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 191, 2024-09-05T01:42:15.215 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T01:42:15.215 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2024-09-05T01:42:15.215 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2024-09-05T01:42:15.215 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2024-09-05T01:42:15.215 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 50199590, 2024-09-05T01:42:15.215 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 534645, 2024-09-05T01:42:15.215 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2024-09-05T01:42:15.215 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2024-09-05T01:42:15.215 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2024-09-05T01:42:15.215 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2024-09-05T01:42:15.215 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.215 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter": { 2024-09-05T01:42:15.215 INFO:teuthology.orchestra.run.smithi145.stdout: "op_active": 0, 2024-09-05T01:42:15.216 INFO:teuthology.orchestra.run.smithi145.stdout: "op_laggy": 0, 2024-09-05T01:42:15.216 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send": 127280, 2024-09-05T01:42:15.216 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send_bytes": 375119131, 2024-09-05T01:42:15.216 INFO:teuthology.orchestra.run.smithi145.stdout: "op_resend": 33, 2024-09-05T01:42:15.216 INFO:teuthology.orchestra.run.smithi145.stdout: "op_reply": 127280, 2024-09-05T01:42:15.216 INFO:teuthology.orchestra.run.smithi145.stdout: "op_latency": { 2024-09-05T01:42:15.216 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 127280, 2024-09-05T01:42:15.216 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 792.575161767, 2024-09-05T01:42:15.216 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.006227020 2024-09-05T01:42:15.216 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.216 INFO:teuthology.orchestra.run.smithi145.stdout: "op_inflight": 0, 2024-09-05T01:42:15.216 INFO:teuthology.orchestra.run.smithi145.stdout: "oplen_avg": { 2024-09-05T01:42:15.216 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 127280, 2024-09-05T01:42:15.216 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 134398 2024-09-05T01:42:15.217 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.217 INFO:teuthology.orchestra.run.smithi145.stdout: "op": 127280, 2024-09-05T01:42:15.217 INFO:teuthology.orchestra.run.smithi145.stdout: "op_r": 110691, 2024-09-05T01:42:15.217 INFO:teuthology.orchestra.run.smithi145.stdout: "op_w": 16589, 2024-09-05T01:42:15.217 INFO:teuthology.orchestra.run.smithi145.stdout: "op_rmw": 0, 2024-09-05T01:42:15.217 INFO:teuthology.orchestra.run.smithi145.stdout: "op_pg": 0, 2024-09-05T01:42:15.217 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_stat": 81, 2024-09-05T01:42:15.217 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_create": 2465, 2024-09-05T01:42:15.217 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_read": 384, 2024-09-05T01:42:15.217 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_write": 2441, 2024-09-05T01:42:15.217 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writefull": 253, 2024-09-05T01:42:15.217 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writesame": 0, 2024-09-05T01:42:15.217 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_append": 0, 2024-09-05T01:42:15.217 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_zero": 0, 2024-09-05T01:42:15.218 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_truncate": 124, 2024-09-05T01:42:15.218 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_delete": 9652, 2024-09-05T01:42:15.218 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_mapext": 0, 2024-09-05T01:42:15.218 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_sparse_read": 0, 2024-09-05T01:42:15.218 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_clonerange": 0, 2024-09-05T01:42:15.218 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_getxattr": 110239, 2024-09-05T01:42:15.218 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_setxattr": 4930, 2024-09-05T01:42:15.218 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_cmpxattr": 0, 2024-09-05T01:42:15.218 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_rmxattr": 0, 2024-09-05T01:42:15.218 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_resetxattrs": 0, 2024-09-05T01:42:15.218 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_call": 0, 2024-09-05T01:42:15.218 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_watch": 0, 2024-09-05T01:42:15.218 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_notify": 0, 2024-09-05T01:42:15.218 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T01:42:15.218 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls": 0, 2024-09-05T01:42:15.219 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls_filter": 0, 2024-09-05T01:42:15.219 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_other": 0, 2024-09-05T01:42:15.219 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_active": 0, 2024-09-05T01:42:15.219 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_send": 0, 2024-09-05T01:42:15.219 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_resend": 0, 2024-09-05T01:42:15.219 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_ping": 0, 2024-09-05T01:42:15.219 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_active": 0, 2024-09-05T01:42:15.219 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_send": 0, 2024-09-05T01:42:15.219 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_resend": 0, 2024-09-05T01:42:15.219 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_active": 0, 2024-09-05T01:42:15.219 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_send": 0, 2024-09-05T01:42:15.219 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_resend": 0, 2024-09-05T01:42:15.219 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_active": 0, 2024-09-05T01:42:15.219 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_send": 0, 2024-09-05T01:42:15.219 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_resend": 0, 2024-09-05T01:42:15.219 INFO:teuthology.orchestra.run.smithi145.stdout: "command_active": 0, 2024-09-05T01:42:15.220 INFO:teuthology.orchestra.run.smithi145.stdout: "command_send": 0, 2024-09-05T01:42:15.220 INFO:teuthology.orchestra.run.smithi145.stdout: "command_resend": 0, 2024-09-05T01:42:15.220 INFO:teuthology.orchestra.run.smithi145.stdout: "map_epoch": 108, 2024-09-05T01:42:15.220 INFO:teuthology.orchestra.run.smithi145.stdout: "map_full": 0, 2024-09-05T01:42:15.220 INFO:teuthology.orchestra.run.smithi145.stdout: "map_inc": 27, 2024-09-05T01:42:15.220 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_sessions": 12, 2024-09-05T01:42:15.220 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_open": 12, 2024-09-05T01:42:15.220 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_close": 0, 2024-09-05T01:42:15.220 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_laggy": 0, 2024-09-05T01:42:15.220 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_wr": 3236, 2024-09-05T01:42:15.220 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_rd": 136, 2024-09-05T01:42:15.220 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_del": 457 2024-09-05T01:42:15.220 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.220 INFO:teuthology.orchestra.run.smithi145.stdout: "oft": { 2024-09-05T01:42:15.221 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_objs": 1, 2024-09-05T01:42:15.221 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_kv_pairs": 0, 2024-09-05T01:42:15.221 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_updates": 0, 2024-09-05T01:42:15.221 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_removes": 0 2024-09-05T01:42:15.221 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.221 INFO:teuthology.orchestra.run.smithi145.stdout: "osd-slow-ops": { 2024-09-05T01:42:15.221 INFO:teuthology.orchestra.run.smithi145.stdout: "slow_ops_count": 5 2024-09-05T01:42:15.221 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.221 INFO:teuthology.orchestra.run.smithi145.stdout: "purge_queue": { 2024-09-05T01:42:15.221 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops": 0, 2024-09-05T01:42:15.221 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops_high_water": 6, 2024-09-05T01:42:15.221 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing": 0, 2024-09-05T01:42:15.221 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_high_water": 6, 2024-09-05T01:42:15.221 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed_ops": 9551, 2024-09-05T01:42:15.222 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed": 9551, 2024-09-05T01:42:15.222 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_item_in_journal": 0 2024-09-05T01:42:15.222 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.222 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T01:42:15.222 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-05T01:42:15.222 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-09-05T01:42:15.222 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-05T01:42:15.222 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 373729, 2024-09-05T01:42:15.222 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 136096120, 2024-09-05T01:42:15.222 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:15.222 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 373729, 2024-09-05T01:42:15.222 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-09-05T01:42:15.222 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-09-05T01:42:15.222 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 373729, 2024-09-05T01:42:15.223 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 136096120, 2024-09-05T01:42:15.223 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-05T01:42:15.223 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.223 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.223 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.223 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:15.223 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.223 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_bytes": { 2024-09-05T01:42:15.223 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-05T01:42:15.223 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-09-05T01:42:15.223 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-05T01:42:15.223 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-09-05T01:42:15.223 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-09-05T01:42:15.223 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:15.224 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:15.224 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 127280, 2024-09-05T01:42:15.224 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 376457702, 2024-09-05T01:42:15.224 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 127280, 2024-09-05T01:42:15.224 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 376457702, 2024-09-05T01:42:15.224 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-05T01:42:15.224 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.224 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.224 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.224 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:15.224 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.224 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_ops": { 2024-09-05T01:42:15.224 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-05T01:42:15.224 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 1024, 2024-09-05T01:42:15.224 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-05T01:42:15.225 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-09-05T01:42:15.225 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-09-05T01:42:15.225 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:15.225 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:15.225 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 127280, 2024-09-05T01:42:15.225 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 127280, 2024-09-05T01:42:15.225 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 127280, 2024-09-05T01:42:15.225 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 127280, 2024-09-05T01:42:15.225 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-05T01:42:15.225 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.225 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.225 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.225 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:15.225 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.226 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle": { 2024-09-05T01:42:15.226 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-05T01:42:15.226 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2024-09-05T01:42:15.226 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-05T01:42:15.226 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 9551, 2024-09-05T01:42:15.226 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 1339659, 2024-09-05T01:42:15.226 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:15.226 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 9551, 2024-09-05T01:42:15.226 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-09-05T01:42:15.226 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-09-05T01:42:15.226 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 384, 2024-09-05T01:42:15.226 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 1339659, 2024-09-05T01:42:15.227 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-05T01:42:15.227 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.227 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.227 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.227 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:15.227 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:15.227 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle-0x55c52ba86960": { 2024-09-05T01:42:15.227 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-05T01:42:15.227 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2024-09-05T01:42:15.227 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-05T01:42:15.227 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 106080, 2024-09-05T01:42:15.227 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 347816253, 2024-09-05T01:42:15.227 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:15.227 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 106080, 2024-09-05T01:42:15.227 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-09-05T01:42:15.228 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-09-05T01:42:15.228 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 2055, 2024-09-05T01:42:15.228 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 347816253, 2024-09-05T01:42:15.228 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-05T01:42:15.228 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:15.228 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:15.228 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:15.228 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:15.228 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:15.228 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-09-05T01:42:15.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:15 smithi012 ceph-mon[29942]: pgmap v551: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-05T01:42:15.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:15 smithi145 ceph-mon[34376]: pgmap v551: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-05T01:42:15.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:15 smithi151 ceph-mon[35013]: pgmap v551: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-05T01:42:16.200 INFO:tasks.check_counter:Daemon mds.h mds.exported=223 2024-09-05T01:42:16.201 INFO:tasks.check_counter:Daemon mds.h mds.imported=272 2024-09-05T01:42:16.201 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-09-05T01:42:16.201 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-05T01:42:16.201 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-05T01:42:16.201 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=125 2024-09-05T01:42:16.205 DEBUG:tasks.check_counter:Getting stats from k 2024-09-05T01:42:16.205 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-05T01:42:16.677 INFO:teuthology.orchestra.run.smithi145.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.b/config 2024-09-05T01:42:17.339 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-09-05T01:42:17.339 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T01:42:17.340 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 2510, 2024-09-05T01:42:17.340 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 2512, 2024-09-05T01:42:17.340 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 139638878, 2024-09-05T01:42:17.340 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 798181, 2024-09-05T01:42:17.340 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 8, 2024-09-05T01:42:17.340 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 4, 2024-09-05T01:42:17.340 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.295791758, 2024-09-05T01:42:17.340 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.064695499, 2024-09-05T01:42:17.340 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.115527993, 2024-09-05T01:42:17.340 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.099630241, 2024-09-05T01:42:17.340 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:17.340 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 2510, 2024-09-05T01:42:17.341 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.134710776, 2024-09-05T01:42:17.341 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000053669 2024-09-05T01:42:17.341 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.341 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:17.341 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.341 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.341 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.341 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.341 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-05T01:42:17.341 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 0 2024-09-05T01:42:17.341 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.341 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T01:42:17.342 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 1119, 2024-09-05T01:42:17.342 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 1058, 2024-09-05T01:42:17.342 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 144781790, 2024-09-05T01:42:17.342 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 429772, 2024-09-05T01:42:17.342 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 6, 2024-09-05T01:42:17.342 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 5, 2024-09-05T01:42:17.342 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.177249296, 2024-09-05T01:42:17.342 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.032338700, 2024-09-05T01:42:17.342 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.145477049, 2024-09-05T01:42:17.342 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.013893632, 2024-09-05T01:42:17.342 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:17.342 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1057, 2024-09-05T01:42:17.343 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.048953998, 2024-09-05T01:42:17.343 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000046314 2024-09-05T01:42:17.343 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.343 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:17.343 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.343 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.343 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.343 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.343 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 1983664, 2024-09-05T01:42:17.343 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 207104 2024-09-05T01:42:17.343 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.344 INFO:teuthology.orchestra.run.smithi145.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T01:42:17.344 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_messages": 985, 2024-09-05T01:42:17.344 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages": 1229, 2024-09-05T01:42:17.344 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_bytes": 126109439, 2024-09-05T01:42:17.344 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_bytes": 907500, 2024-09-05T01:42:17.344 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_created_connections": 8, 2024-09-05T01:42:17.344 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_active_connections": 6, 2024-09-05T01:42:17.344 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_total_time": 0.141435762, 2024-09-05T01:42:17.344 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_send_time": 0.028495945, 2024-09-05T01:42:17.344 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_recv_time": 0.084519727, 2024-09-05T01:42:17.344 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_running_fast_dispatch_time": 0.021293029, 2024-09-05T01:42:17.344 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:17.345 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 1227, 2024-09-05T01:42:17.345 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.052745014, 2024-09-05T01:42:17.345 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000042986 2024-09-05T01:42:17.345 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.345 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:17.345 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.345 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.345 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.345 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.345 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-05T01:42:17.345 INFO:teuthology.orchestra.run.smithi145.stdout: "msgr_send_encrypted_bytes": 596496 2024-09-05T01:42:17.346 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.346 INFO:teuthology.orchestra.run.smithi145.stdout: "cct": { 2024-09-05T01:42:17.346 INFO:teuthology.orchestra.run.smithi145.stdout: "total_workers": 1, 2024-09-05T01:42:17.346 INFO:teuthology.orchestra.run.smithi145.stdout: "unhealthy_workers": 0 2024-09-05T01:42:17.346 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.346 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-MDSRank": { 2024-09-05T01:42:17.346 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2024-09-05T01:42:17.346 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2024-09-05T01:42:17.346 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 6810, 2024-09-05T01:42:17.346 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.209204911, 2024-09-05T01:42:17.346 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000030720 2024-09-05T01:42:17.346 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:17.347 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.347 INFO:teuthology.orchestra.run.smithi145.stdout: "finisher-PurgeQueue": { 2024-09-05T01:42:17.347 INFO:teuthology.orchestra.run.smithi145.stdout: "queue_len": 0, 2024-09-05T01:42:17.347 INFO:teuthology.orchestra.run.smithi145.stdout: "complete_latency": { 2024-09-05T01:42:17.347 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.347 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.347 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.347 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:17.347 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.347 INFO:teuthology.orchestra.run.smithi145.stdout: "mds": { 2024-09-05T01:42:17.347 INFO:teuthology.orchestra.run.smithi145.stdout: "request": 0, 2024-09-05T01:42:17.347 INFO:teuthology.orchestra.run.smithi145.stdout: "reply": 0, 2024-09-05T01:42:17.347 INFO:teuthology.orchestra.run.smithi145.stdout: "reply_latency": { 2024-09-05T01:42:17.348 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.348 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.348 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.348 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.348 INFO:teuthology.orchestra.run.smithi145.stdout: "slow_reply": 0, 2024-09-05T01:42:17.348 INFO:teuthology.orchestra.run.smithi145.stdout: "forward": 0, 2024-09-05T01:42:17.348 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch_complete": 0, 2024-09-05T01:42:17.348 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_fetch_keys": 0, 2024-09-05T01:42:17.348 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_commit": 0, 2024-09-05T01:42:17.348 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_split": 0, 2024-09-05T01:42:17.348 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_merge": 0, 2024-09-05T01:42:17.348 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes": 75130, 2024-09-05T01:42:17.348 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_top": 5011, 2024-09-05T01:42:17.348 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_bottom": 70119, 2024-09-05T01:42:17.349 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pin_tail": 0, 2024-09-05T01:42:17.349 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_pinned": 67971, 2024-09-05T01:42:17.349 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_expired": 1, 2024-09-05T01:42:17.349 INFO:teuthology.orchestra.run.smithi145.stdout: "inodes_with_caps": 0, 2024-09-05T01:42:17.349 INFO:teuthology.orchestra.run.smithi145.stdout: "caps": 0, 2024-09-05T01:42:17.349 INFO:teuthology.orchestra.run.smithi145.stdout: "subtrees": 1, 2024-09-05T01:42:17.349 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse": 0, 2024-09-05T01:42:17.349 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_hit": 0, 2024-09-05T01:42:17.349 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_forward": 0, 2024-09-05T01:42:17.349 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_discover": 0, 2024-09-05T01:42:17.349 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_dir_fetch": 0, 2024-09-05T01:42:17.349 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_remote_ino": 0, 2024-09-05T01:42:17.350 INFO:teuthology.orchestra.run.smithi145.stdout: "traverse_lock": 0, 2024-09-05T01:42:17.350 INFO:teuthology.orchestra.run.smithi145.stdout: "load_cent": 0, 2024-09-05T01:42:17.350 INFO:teuthology.orchestra.run.smithi145.stdout: "q": 0, 2024-09-05T01:42:17.350 INFO:teuthology.orchestra.run.smithi145.stdout: "exported": 0, 2024-09-05T01:42:17.350 INFO:teuthology.orchestra.run.smithi145.stdout: "exported_inodes": 0, 2024-09-05T01:42:17.350 INFO:teuthology.orchestra.run.smithi145.stdout: "imported": 0, 2024-09-05T01:42:17.350 INFO:teuthology.orchestra.run.smithi145.stdout: "imported_inodes": 0, 2024-09-05T01:42:17.350 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_dir_fetch": 0, 2024-09-05T01:42:17.350 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_backtrace_fetch": 0, 2024-09-05T01:42:17.350 INFO:teuthology.orchestra.run.smithi145.stdout: "openino_peer_discover": 0, 2024-09-05T01:42:17.350 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rfiles": 0, 2024-09-05T01:42:17.350 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rbytes": 0, 2024-09-05T01:42:17.350 INFO:teuthology.orchestra.run.smithi145.stdout: "root_rsnaps": 0, 2024-09-05T01:42:17.350 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_backtrace_fetch": 0, 2024-09-05T01:42:17.351 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_set_tag": 0, 2024-09-05T01:42:17.351 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T01:42:17.351 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_inotable_repaired": 0, 2024-09-05T01:42:17.351 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dir_inodes": 0, 2024-09-05T01:42:17.351 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dir_base_inodes": 0, 2024-09-05T01:42:17.351 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_dirfrag_rstats": 0, 2024-09-05T01:42:17.351 INFO:teuthology.orchestra.run.smithi145.stdout: "scrub_file_inodes": 0, 2024-09-05T01:42:17.351 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_inode_file_caps": 0, 2024-09-05T01:42:17.351 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_revoke": 0, 2024-09-05T01:42:17.351 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_grant": 0, 2024-09-05T01:42:17.351 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_trunc": 0, 2024-09-05T01:42:17.351 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T01:42:17.351 INFO:teuthology.orchestra.run.smithi145.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T01:42:17.351 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_caps": 0, 2024-09-05T01:42:17.352 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_caps_dirty": 0, 2024-09-05T01:42:17.352 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_cap_release": 0, 2024-09-05T01:42:17.352 INFO:teuthology.orchestra.run.smithi145.stdout: "process_request_cap_release": 0 2024-09-05T01:42:17.352 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.352 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache": { 2024-09-05T01:42:17.352 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_update": 0, 2024-09-05T01:42:17.352 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_update_receipt": 0, 2024-09-05T01:42:17.352 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_try_discover": 0, 2024-09-05T01:42:17.352 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_send_discover": 0, 2024-09-05T01:42:17.352 INFO:teuthology.orchestra.run.smithi145.stdout: "dir_handle_discover": 0, 2024-09-05T01:42:17.352 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays": 0, 2024-09-05T01:42:17.352 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_delayed": 0, 2024-09-05T01:42:17.352 INFO:teuthology.orchestra.run.smithi145.stdout: "num_strays_enqueuing": 0, 2024-09-05T01:42:17.353 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_created": 0, 2024-09-05T01:42:17.353 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_enqueued": 0, 2024-09-05T01:42:17.353 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_reintegrated": 0, 2024-09-05T01:42:17.353 INFO:teuthology.orchestra.run.smithi145.stdout: "strays_migrated": 0, 2024-09-05T01:42:17.353 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_processing": 0, 2024-09-05T01:42:17.353 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_enqueued": 0, 2024-09-05T01:42:17.353 INFO:teuthology.orchestra.run.smithi145.stdout: "num_recovering_prioritized": 0, 2024-09-05T01:42:17.353 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_started": 0, 2024-09-05T01:42:17.353 INFO:teuthology.orchestra.run.smithi145.stdout: "recovery_completed": 0, 2024-09-05T01:42:17.353 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_quiesce_path": 0, 2024-09-05T01:42:17.353 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_quiesce_inode": 0, 2024-09-05T01:42:17.353 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_enqueue_scrub": 0, 2024-09-05T01:42:17.353 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_exportdir": 0, 2024-09-05T01:42:17.353 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_flush": 0, 2024-09-05T01:42:17.354 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragmentdir": 0, 2024-09-05T01:42:17.354 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_fragstats": 0, 2024-09-05T01:42:17.354 INFO:teuthology.orchestra.run.smithi145.stdout: "ireq_inodestats": 0 2024-09-05T01:42:17.354 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.354 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log": { 2024-09-05T01:42:17.354 INFO:teuthology.orchestra.run.smithi145.stdout: "evlrg": 0, 2024-09-05T01:42:17.354 INFO:teuthology.orchestra.run.smithi145.stdout: "evadd": 0, 2024-09-05T01:42:17.354 INFO:teuthology.orchestra.run.smithi145.stdout: "evex": 0, 2024-09-05T01:42:17.354 INFO:teuthology.orchestra.run.smithi145.stdout: "evtrm": 0, 2024-09-05T01:42:17.354 INFO:teuthology.orchestra.run.smithi145.stdout: "ev": 112391, 2024-09-05T01:42:17.354 INFO:teuthology.orchestra.run.smithi145.stdout: "evexg": 0, 2024-09-05T01:42:17.354 INFO:teuthology.orchestra.run.smithi145.stdout: "evexd": 0, 2024-09-05T01:42:17.354 INFO:teuthology.orchestra.run.smithi145.stdout: "segadd": 0, 2024-09-05T01:42:17.355 INFO:teuthology.orchestra.run.smithi145.stdout: "segex": 0, 2024-09-05T01:42:17.355 INFO:teuthology.orchestra.run.smithi145.stdout: "segtrm": 0, 2024-09-05T01:42:17.355 INFO:teuthology.orchestra.run.smithi145.stdout: "seg": 132, 2024-09-05T01:42:17.355 INFO:teuthology.orchestra.run.smithi145.stdout: "segmjr": 11, 2024-09-05T01:42:17.355 INFO:teuthology.orchestra.run.smithi145.stdout: "segexg": 0, 2024-09-05T01:42:17.355 INFO:teuthology.orchestra.run.smithi145.stdout: "segexd": 0, 2024-09-05T01:42:17.355 INFO:teuthology.orchestra.run.smithi145.stdout: "expos": 64061312, 2024-09-05T01:42:17.355 INFO:teuthology.orchestra.run.smithi145.stdout: "wrpos": 411503583, 2024-09-05T01:42:17.355 INFO:teuthology.orchestra.run.smithi145.stdout: "rdpos": 411437778, 2024-09-05T01:42:17.355 INFO:teuthology.orchestra.run.smithi145.stdout: "jlat": { 2024-09-05T01:42:17.355 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.355 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.355 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.355 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.355 INFO:teuthology.orchestra.run.smithi145.stdout: "replayed": 112391 2024-09-05T01:42:17.356 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.356 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_mem": { 2024-09-05T01:42:17.356 INFO:teuthology.orchestra.run.smithi145.stdout: "ino": 24069, 2024-09-05T01:42:17.356 INFO:teuthology.orchestra.run.smithi145.stdout: "ino+": 72922, 2024-09-05T01:42:17.356 INFO:teuthology.orchestra.run.smithi145.stdout: "ino-": 48853, 2024-09-05T01:42:17.356 INFO:teuthology.orchestra.run.smithi145.stdout: "dir": 836, 2024-09-05T01:42:17.356 INFO:teuthology.orchestra.run.smithi145.stdout: "dir+": 2047, 2024-09-05T01:42:17.356 INFO:teuthology.orchestra.run.smithi145.stdout: "dir-": 1211, 2024-09-05T01:42:17.356 INFO:teuthology.orchestra.run.smithi145.stdout: "dn": 75130, 2024-09-05T01:42:17.356 INFO:teuthology.orchestra.run.smithi145.stdout: "dn+": 122122, 2024-09-05T01:42:17.356 INFO:teuthology.orchestra.run.smithi145.stdout: "dn-": 46992, 2024-09-05T01:42:17.357 INFO:teuthology.orchestra.run.smithi145.stdout: "cap": 0, 2024-09-05T01:42:17.357 INFO:teuthology.orchestra.run.smithi145.stdout: "cap+": 0, 2024-09-05T01:42:17.357 INFO:teuthology.orchestra.run.smithi145.stdout: "cap-": 0, 2024-09-05T01:42:17.357 INFO:teuthology.orchestra.run.smithi145.stdout: "rss": 195004, 2024-09-05T01:42:17.357 INFO:teuthology.orchestra.run.smithi145.stdout: "heap": 215328 2024-09-05T01:42:17.357 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.357 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_server": { 2024-09-05T01:42:17.357 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_client_request": 0, 2024-09-05T01:42:17.357 INFO:teuthology.orchestra.run.smithi145.stdout: "dispatch_server_request": 0, 2024-09-05T01:42:17.357 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_request": 0, 2024-09-05T01:42:17.357 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_client_session": 0, 2024-09-05T01:42:17.357 INFO:teuthology.orchestra.run.smithi145.stdout: "handle_peer_request": 0, 2024-09-05T01:42:17.357 INFO:teuthology.orchestra.run.smithi145.stdout: "req_create_latency": { 2024-09-05T01:42:17.358 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.358 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.358 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.358 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.358 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getattr_latency": { 2024-09-05T01:42:17.358 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.358 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.358 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.358 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.358 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getfilelock_latency": { 2024-09-05T01:42:17.358 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.358 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.359 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.359 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.359 INFO:teuthology.orchestra.run.smithi145.stdout: "req_link_latency": { 2024-09-05T01:42:17.359 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.359 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.359 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.359 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.359 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookup_latency": { 2024-09-05T01:42:17.359 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.359 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.359 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.359 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.360 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookuphash_latency": { 2024-09-05T01:42:17.360 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.360 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.360 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.360 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.360 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupino_latency": { 2024-09-05T01:42:17.360 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.360 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.360 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.360 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.360 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupname_latency": { 2024-09-05T01:42:17.361 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.361 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.361 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.361 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.361 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupparent_latency": { 2024-09-05T01:42:17.361 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.361 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.361 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.361 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.361 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lookupsnap_latency": { 2024-09-05T01:42:17.361 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.361 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.361 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.362 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.362 INFO:teuthology.orchestra.run.smithi145.stdout: "req_lssnap_latency": { 2024-09-05T01:42:17.362 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.362 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.362 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.362 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.363 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mkdir_latency": { 2024-09-05T01:42:17.363 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.363 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.363 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.363 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.363 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mknod_latency": { 2024-09-05T01:42:17.363 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.363 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.363 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.363 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.363 INFO:teuthology.orchestra.run.smithi145.stdout: "req_mksnap_latency": { 2024-09-05T01:42:17.364 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.364 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.364 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.364 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.364 INFO:teuthology.orchestra.run.smithi145.stdout: "req_open_latency": { 2024-09-05T01:42:17.364 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.364 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.364 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.364 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.364 INFO:teuthology.orchestra.run.smithi145.stdout: "req_readdir_latency": { 2024-09-05T01:42:17.364 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.364 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.365 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.365 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.365 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rename_latency": { 2024-09-05T01:42:17.365 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.365 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.365 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.365 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.365 INFO:teuthology.orchestra.run.smithi145.stdout: "req_renamesnap_latency": { 2024-09-05T01:42:17.365 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.365 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.366 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.366 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.366 INFO:teuthology.orchestra.run.smithi145.stdout: "req_snapdiff_latency": { 2024-09-05T01:42:17.366 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.366 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.366 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.366 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.366 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmdir_latency": { 2024-09-05T01:42:17.366 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.366 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.366 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.366 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.366 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmsnap_latency": { 2024-09-05T01:42:17.367 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.367 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.367 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.367 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.367 INFO:teuthology.orchestra.run.smithi145.stdout: "req_rmxattr_latency": { 2024-09-05T01:42:17.367 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.367 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.367 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.367 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.367 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setattr_latency": { 2024-09-05T01:42:17.367 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.367 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.368 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.368 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.368 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setdirlayout_latency": { 2024-09-05T01:42:17.368 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.368 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.368 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.368 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.368 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setfilelock_latency": { 2024-09-05T01:42:17.368 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.368 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.368 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.368 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.369 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setlayout_latency": { 2024-09-05T01:42:17.369 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.369 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.369 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.369 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.369 INFO:teuthology.orchestra.run.smithi145.stdout: "req_setxattr_latency": { 2024-09-05T01:42:17.369 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.369 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.369 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.369 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.369 INFO:teuthology.orchestra.run.smithi145.stdout: "req_symlink_latency": { 2024-09-05T01:42:17.369 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.369 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.370 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.370 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.370 INFO:teuthology.orchestra.run.smithi145.stdout: "req_unlink_latency": { 2024-09-05T01:42:17.370 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.370 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.370 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.370 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.370 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_revoke_eviction": 0, 2024-09-05T01:42:17.370 INFO:teuthology.orchestra.run.smithi145.stdout: "cap_acquisition_throttle": 0, 2024-09-05T01:42:17.370 INFO:teuthology.orchestra.run.smithi145.stdout: "req_getvxattr_latency": { 2024-09-05T01:42:17.370 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.370 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.370 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.371 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:17.371 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.371 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_sessions": { 2024-09-05T01:42:17.371 INFO:teuthology.orchestra.run.smithi145.stdout: "session_count": 1, 2024-09-05T01:42:17.371 INFO:teuthology.orchestra.run.smithi145.stdout: "session_add": 3, 2024-09-05T01:42:17.371 INFO:teuthology.orchestra.run.smithi145.stdout: "session_remove": 2, 2024-09-05T01:42:17.371 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_open": 3, 2024-09-05T01:42:17.371 INFO:teuthology.orchestra.run.smithi145.stdout: "sessions_stale": 0, 2024-09-05T01:42:17.371 INFO:teuthology.orchestra.run.smithi145.stdout: "total_load": 0, 2024-09-05T01:42:17.371 INFO:teuthology.orchestra.run.smithi145.stdout: "average_load": 0, 2024-09-05T01:42:17.371 INFO:teuthology.orchestra.run.smithi145.stdout: "avg_session_uptime": 5092, 2024-09-05T01:42:17.371 INFO:teuthology.orchestra.run.smithi145.stdout: "mdthresh_evicted": 0 2024-09-05T01:42:17.371 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.372 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool": { 2024-09-05T01:42:17.372 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_bytes": 0, 2024-09-05T01:42:17.372 INFO:teuthology.orchestra.run.smithi145.stdout: "bloom_filter_items": 0, 2024-09-05T01:42:17.372 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T01:42:17.372 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_items": 0, 2024-09-05T01:42:17.372 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T01:42:17.372 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_data_items": 0, 2024-09-05T01:42:17.372 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T01:42:17.372 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T01:42:17.372 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T01:42:17.372 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T01:42:17.372 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T01:42:17.372 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_other_items": 0, 2024-09-05T01:42:17.373 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T01:42:17.373 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T01:42:17.373 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_bytes": 0, 2024-09-05T01:42:17.373 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_items": 0, 2024-09-05T01:42:17.373 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_bytes": 0, 2024-09-05T01:42:17.373 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blob_items": 0, 2024-09-05T01:42:17.373 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T01:42:17.373 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T01:42:17.373 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T01:42:17.373 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T01:42:17.373 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T01:42:17.373 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_items": 0, 2024-09-05T01:42:17.373 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_bytes": 0, 2024-09-05T01:42:17.374 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_txc_items": 0, 2024-09-05T01:42:17.374 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T01:42:17.374 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T01:42:17.374 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_bytes": 0, 2024-09-05T01:42:17.374 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_writing_items": 0, 2024-09-05T01:42:17.374 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_bytes": 0, 2024-09-05T01:42:17.374 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_items": 0, 2024-09-05T01:42:17.374 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T01:42:17.374 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_reader_items": 0, 2024-09-05T01:42:17.374 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T01:42:17.374 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_file_writer_items": 0, 2024-09-05T01:42:17.374 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_bytes": 1148777, 2024-09-05T01:42:17.374 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_anon_items": 24637, 2024-09-05T01:42:17.375 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_bytes": 0, 2024-09-05T01:42:17.375 INFO:teuthology.orchestra.run.smithi145.stdout: "buffer_meta_items": 0, 2024-09-05T01:42:17.375 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bytes": 0, 2024-09-05T01:42:17.375 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_items": 0, 2024-09-05T01:42:17.375 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_bytes": 0, 2024-09-05T01:42:17.375 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mapbl_items": 0, 2024-09-05T01:42:17.375 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_bytes": 0, 2024-09-05T01:42:17.375 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pglog_items": 0, 2024-09-05T01:42:17.375 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_bytes": 8512, 2024-09-05T01:42:17.375 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_items": 191, 2024-09-05T01:42:17.375 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T01:42:17.375 INFO:teuthology.orchestra.run.smithi145.stdout: "osdmap_mapping_items": 0, 2024-09-05T01:42:17.376 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_bytes": 0, 2024-09-05T01:42:17.376 INFO:teuthology.orchestra.run.smithi145.stdout: "pgmap_items": 0, 2024-09-05T01:42:17.376 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_bytes": 110047801, 2024-09-05T01:42:17.376 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_co_items": 1079260, 2024-09-05T01:42:17.376 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_bytes": 0, 2024-09-05T01:42:17.376 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_1_items": 0, 2024-09-05T01:42:17.376 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_bytes": 0, 2024-09-05T01:42:17.376 INFO:teuthology.orchestra.run.smithi145.stdout: "unittest_2_items": 0 2024-09-05T01:42:17.376 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.376 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter": { 2024-09-05T01:42:17.376 INFO:teuthology.orchestra.run.smithi145.stdout: "op_active": 0, 2024-09-05T01:42:17.376 INFO:teuthology.orchestra.run.smithi145.stdout: "op_laggy": 0, 2024-09-05T01:42:17.377 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send": 4188, 2024-09-05T01:42:17.377 INFO:teuthology.orchestra.run.smithi145.stdout: "op_send_bytes": 21, 2024-09-05T01:42:17.377 INFO:teuthology.orchestra.run.smithi145.stdout: "op_resend": 3, 2024-09-05T01:42:17.377 INFO:teuthology.orchestra.run.smithi145.stdout: "op_reply": 4188, 2024-09-05T01:42:17.377 INFO:teuthology.orchestra.run.smithi145.stdout: "op_latency": { 2024-09-05T01:42:17.377 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 4188, 2024-09-05T01:42:17.377 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 27.344440553, 2024-09-05T01:42:17.377 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.006529236 2024-09-05T01:42:17.377 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.377 INFO:teuthology.orchestra.run.smithi145.stdout: "op_inflight": 0, 2024-09-05T01:42:17.377 INFO:teuthology.orchestra.run.smithi145.stdout: "oplen_avg": { 2024-09-05T01:42:17.377 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 4188, 2024-09-05T01:42:17.377 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 4189 2024-09-05T01:42:17.378 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.378 INFO:teuthology.orchestra.run.smithi145.stdout: "op": 4188, 2024-09-05T01:42:17.378 INFO:teuthology.orchestra.run.smithi145.stdout: "op_r": 4188, 2024-09-05T01:42:17.378 INFO:teuthology.orchestra.run.smithi145.stdout: "op_w": 0, 2024-09-05T01:42:17.378 INFO:teuthology.orchestra.run.smithi145.stdout: "op_rmw": 0, 2024-09-05T01:42:17.378 INFO:teuthology.orchestra.run.smithi145.stdout: "op_pg": 0, 2024-09-05T01:42:17.378 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_stat": 2566, 2024-09-05T01:42:17.378 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_create": 0, 2024-09-05T01:42:17.378 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_read": 1620, 2024-09-05T01:42:17.378 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_write": 0, 2024-09-05T01:42:17.378 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writefull": 0, 2024-09-05T01:42:17.378 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_writesame": 0, 2024-09-05T01:42:17.379 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_append": 0, 2024-09-05T01:42:17.379 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_zero": 0, 2024-09-05T01:42:17.379 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_truncate": 0, 2024-09-05T01:42:17.379 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_delete": 0, 2024-09-05T01:42:17.379 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_mapext": 0, 2024-09-05T01:42:17.379 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_sparse_read": 0, 2024-09-05T01:42:17.379 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_clonerange": 0, 2024-09-05T01:42:17.379 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_getxattr": 1, 2024-09-05T01:42:17.379 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_setxattr": 0, 2024-09-05T01:42:17.379 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_cmpxattr": 0, 2024-09-05T01:42:17.379 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_rmxattr": 0, 2024-09-05T01:42:17.379 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_resetxattrs": 0, 2024-09-05T01:42:17.379 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_call": 0, 2024-09-05T01:42:17.380 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_watch": 0, 2024-09-05T01:42:17.380 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_notify": 0, 2024-09-05T01:42:17.380 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T01:42:17.380 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls": 0, 2024-09-05T01:42:17.380 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_pgls_filter": 0, 2024-09-05T01:42:17.380 INFO:teuthology.orchestra.run.smithi145.stdout: "osdop_other": 0, 2024-09-05T01:42:17.380 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_active": 0, 2024-09-05T01:42:17.380 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_send": 0, 2024-09-05T01:42:17.380 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_resend": 0, 2024-09-05T01:42:17.380 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_ping": 0, 2024-09-05T01:42:17.380 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_active": 0, 2024-09-05T01:42:17.380 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_send": 0, 2024-09-05T01:42:17.380 INFO:teuthology.orchestra.run.smithi145.stdout: "poolop_resend": 0, 2024-09-05T01:42:17.381 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_active": 0, 2024-09-05T01:42:17.381 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_send": 0, 2024-09-05T01:42:17.381 INFO:teuthology.orchestra.run.smithi145.stdout: "poolstat_resend": 0, 2024-09-05T01:42:17.381 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_active": 0, 2024-09-05T01:42:17.381 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_send": 0, 2024-09-05T01:42:17.381 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_resend": 0, 2024-09-05T01:42:17.381 INFO:teuthology.orchestra.run.smithi145.stdout: "command_active": 0, 2024-09-05T01:42:17.381 INFO:teuthology.orchestra.run.smithi145.stdout: "command_send": 0, 2024-09-05T01:42:17.381 INFO:teuthology.orchestra.run.smithi145.stdout: "command_resend": 0, 2024-09-05T01:42:17.381 INFO:teuthology.orchestra.run.smithi145.stdout: "map_epoch": 108, 2024-09-05T01:42:17.381 INFO:teuthology.orchestra.run.smithi145.stdout: "map_full": 0, 2024-09-05T01:42:17.381 INFO:teuthology.orchestra.run.smithi145.stdout: "map_inc": 27, 2024-09-05T01:42:17.382 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_sessions": 11, 2024-09-05T01:42:17.382 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_open": 11, 2024-09-05T01:42:17.382 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_session_close": 0, 2024-09-05T01:42:17.382 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_laggy": 0, 2024-09-05T01:42:17.382 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_wr": 0, 2024-09-05T01:42:17.382 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_rd": 2, 2024-09-05T01:42:17.382 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_del": 0 2024-09-05T01:42:17.382 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.382 INFO:teuthology.orchestra.run.smithi145.stdout: "oft": { 2024-09-05T01:42:17.382 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_objs": 0, 2024-09-05T01:42:17.382 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_kv_pairs": 0, 2024-09-05T01:42:17.382 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_updates": 0, 2024-09-05T01:42:17.382 INFO:teuthology.orchestra.run.smithi145.stdout: "omap_total_removes": 0 2024-09-05T01:42:17.383 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.383 INFO:teuthology.orchestra.run.smithi145.stdout: "osd-slow-ops": { 2024-09-05T01:42:17.383 INFO:teuthology.orchestra.run.smithi145.stdout: "slow_ops_count": 0 2024-09-05T01:42:17.383 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.383 INFO:teuthology.orchestra.run.smithi145.stdout: "purge_queue": { 2024-09-05T01:42:17.383 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops": 0, 2024-09-05T01:42:17.383 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_ops_high_water": 0, 2024-09-05T01:42:17.383 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing": 0, 2024-09-05T01:42:17.383 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executing_high_water": 0, 2024-09-05T01:42:17.383 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed_ops": 0, 2024-09-05T01:42:17.383 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_executed": 0, 2024-09-05T01:42:17.383 INFO:teuthology.orchestra.run.smithi145.stdout: "pq_item_in_journal": 0 2024-09-05T01:42:17.383 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.383 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T01:42:17.384 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-05T01:42:17.384 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-09-05T01:42:17.384 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-05T01:42:17.384 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 4610, 2024-09-05T01:42:17.384 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 410090962, 2024-09-05T01:42:17.384 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:17.384 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 4610, 2024-09-05T01:42:17.384 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-09-05T01:42:17.384 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-09-05T01:42:17.384 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 4610, 2024-09-05T01:42:17.384 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 410090962, 2024-09-05T01:42:17.384 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-05T01:42:17.384 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.385 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.385 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.385 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:17.385 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.385 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_bytes": { 2024-09-05T01:42:17.385 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-05T01:42:17.385 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 104857600, 2024-09-05T01:42:17.385 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-05T01:42:17.385 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-09-05T01:42:17.385 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-09-05T01:42:17.385 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:17.385 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:17.385 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 4188, 2024-09-05T01:42:17.386 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 407379049, 2024-09-05T01:42:17.386 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 4188, 2024-09-05T01:42:17.386 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 407379049, 2024-09-05T01:42:17.386 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-05T01:42:17.386 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.386 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.386 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.386 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:17.386 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.386 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-objecter_ops": { 2024-09-05T01:42:17.386 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-05T01:42:17.386 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 1024, 2024-09-05T01:42:17.386 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-05T01:42:17.386 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-09-05T01:42:17.387 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-09-05T01:42:17.387 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:17.387 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:17.387 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 4188, 2024-09-05T01:42:17.387 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 4188, 2024-09-05T01:42:17.387 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 4188, 2024-09-05T01:42:17.387 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 4188, 2024-09-05T01:42:17.387 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-05T01:42:17.387 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.387 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.388 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.388 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:17.388 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.388 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle": { 2024-09-05T01:42:17.388 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-05T01:42:17.388 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2024-09-05T01:42:17.388 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-05T01:42:17.388 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-09-05T01:42:17.388 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-09-05T01:42:17.388 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:17.388 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:17.388 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-09-05T01:42:17.388 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-09-05T01:42:17.389 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 0, 2024-09-05T01:42:17.389 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 0, 2024-09-05T01:42:17.389 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-05T01:42:17.389 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.389 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.389 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.389 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:17.389 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-05T01:42:17.389 INFO:teuthology.orchestra.run.smithi145.stdout: "throttle-write_buf_throttle-0x555b98f1cb40": { 2024-09-05T01:42:17.389 INFO:teuthology.orchestra.run.smithi145.stdout: "val": 0, 2024-09-05T01:42:17.389 INFO:teuthology.orchestra.run.smithi145.stdout: "max": 3758096384, 2024-09-05T01:42:17.389 INFO:teuthology.orchestra.run.smithi145.stdout: "get_started": 0, 2024-09-05T01:42:17.390 INFO:teuthology.orchestra.run.smithi145.stdout: "get": 0, 2024-09-05T01:42:17.390 INFO:teuthology.orchestra.run.smithi145.stdout: "get_sum": 0, 2024-09-05T01:42:17.390 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:17.390 INFO:teuthology.orchestra.run.smithi145.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:17.390 INFO:teuthology.orchestra.run.smithi145.stdout: "take": 0, 2024-09-05T01:42:17.390 INFO:teuthology.orchestra.run.smithi145.stdout: "take_sum": 0, 2024-09-05T01:42:17.390 INFO:teuthology.orchestra.run.smithi145.stdout: "put": 0, 2024-09-05T01:42:17.390 INFO:teuthology.orchestra.run.smithi145.stdout: "put_sum": 0, 2024-09-05T01:42:17.390 INFO:teuthology.orchestra.run.smithi145.stdout: "wait": { 2024-09-05T01:42:17.390 INFO:teuthology.orchestra.run.smithi145.stdout: "avgcount": 0, 2024-09-05T01:42:17.390 INFO:teuthology.orchestra.run.smithi145.stdout: "sum": 0.000000000, 2024-09-05T01:42:17.390 INFO:teuthology.orchestra.run.smithi145.stdout: "avgtime": 0.000000000 2024-09-05T01:42:17.390 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:17.390 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-05T01:42:17.391 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-09-05T01:42:17.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:17 smithi012 ceph-mon[29942]: pgmap v552: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2024-09-05T01:42:17.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:17 smithi145 ceph-mon[34376]: pgmap v552: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2024-09-05T01:42:17.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:17 smithi151 ceph-mon[35013]: pgmap v552: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2024-09-05T01:42:18.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:18 smithi145 ceph-mon[34376]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:42:18.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:18 smithi151 ceph-mon[35013]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:42:18.749 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-05T01:42:18.749 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-05T01:42:18.749 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-09-05T01:42:18.749 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-09-05T01:42:18.749 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-09-05T01:42:18.749 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2024-09-05T01:42:18.750 DEBUG:tasks.check_counter:Getting stats from c 2024-09-05T01:42:18.750 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-05T01:42:18.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:18 smithi012 ceph-mon[29942]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-05T01:42:19.251 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T01:42:19.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:19 smithi145 ceph-mon[34376]: pgmap v553: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-05T01:42:19.592 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:19 smithi151 ceph-mon[35013]: pgmap v553: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-05T01:42:19.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:19 smithi012 ceph-mon[29942]: pgmap v553: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-05T01:42:20.315 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-05T01:42:20.316 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T01:42:20.316 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 61278, 2024-09-05T01:42:20.316 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 68389, 2024-09-05T01:42:20.316 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 26118906, 2024-09-05T01:42:20.316 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 174881676, 2024-09-05T01:42:20.316 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 21, 2024-09-05T01:42:20.316 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 4, 2024-09-05T01:42:20.316 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 5.632172539, 2024-09-05T01:42:20.316 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 2.457455163, 2024-09-05T01:42:20.316 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 1.402692443, 2024-09-05T01:42:20.317 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 1.503146361, 2024-09-05T01:42:20.317 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:20.317 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 68387, 2024-09-05T01:42:20.317 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 4.253752126, 2024-09-05T01:42:20.317 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000062201 2024-09-05T01:42:20.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.317 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:20.317 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 31672, 2024-09-05T01:42:20.317 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.006134293, 2024-09-05T01:42:20.317 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000193 2024-09-05T01:42:20.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.317 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 1840, 2024-09-05T01:42:20.318 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 3360 2024-09-05T01:42:20.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.318 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T01:42:20.318 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 62039, 2024-09-05T01:42:20.318 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 67145, 2024-09-05T01:42:20.318 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 28793558, 2024-09-05T01:42:20.318 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 217447296, 2024-09-05T01:42:20.318 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 15, 2024-09-05T01:42:20.318 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 7, 2024-09-05T01:42:20.318 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 5.145214504, 2024-09-05T01:42:20.318 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 1.889246968, 2024-09-05T01:42:20.318 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 1.246137941, 2024-09-05T01:42:20.319 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 1.667583620, 2024-09-05T01:42:20.319 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:20.319 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 67142, 2024-09-05T01:42:20.319 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 4.546326463, 2024-09-05T01:42:20.319 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000067712 2024-09-05T01:42:20.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.319 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:20.319 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 20151, 2024-09-05T01:42:20.319 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.003784272, 2024-09-05T01:42:20.319 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000187 2024-09-05T01:42:20.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.319 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 1088, 2024-09-05T01:42:20.320 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 599552 2024-09-05T01:42:20.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.320 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T01:42:20.320 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 208976, 2024-09-05T01:42:20.320 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 332127, 2024-09-05T01:42:20.320 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 94378597, 2024-09-05T01:42:20.320 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 239878809, 2024-09-05T01:42:20.320 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 24, 2024-09-05T01:42:20.320 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 5, 2024-09-05T01:42:20.320 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 12.475924945, 2024-09-05T01:42:20.320 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 5.527996709, 2024-09-05T01:42:20.320 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 12.215558427, 2024-09-05T01:42:20.321 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.980251458, 2024-09-05T01:42:20.321 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:20.321 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 332127, 2024-09-05T01:42:20.321 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 48.596841119, 2024-09-05T01:42:20.321 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000146320 2024-09-05T01:42:20.321 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.321 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:20.321 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 378967, 2024-09-05T01:42:20.322 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.074295091, 2024-09-05T01:42:20.322 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000196 2024-09-05T01:42:20.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.322 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 1998480, 2024-09-05T01:42:20.322 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 252016 2024-09-05T01:42:20.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.322 INFO:teuthology.orchestra.run.smithi151.stdout: "cct": { 2024-09-05T01:42:20.322 INFO:teuthology.orchestra.run.smithi151.stdout: "total_workers": 1, 2024-09-05T01:42:20.322 INFO:teuthology.orchestra.run.smithi151.stdout: "unhealthy_workers": 0 2024-09-05T01:42:20.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.322 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-MDSRank": { 2024-09-05T01:42:20.322 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-09-05T01:42:20.322 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-09-05T01:42:20.322 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 75089, 2024-09-05T01:42:20.323 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 79.008285732, 2024-09-05T01:42:20.323 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001052195 2024-09-05T01:42:20.323 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:20.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.323 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-PurgeQueue": { 2024-09-05T01:42:20.323 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-09-05T01:42:20.323 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-09-05T01:42:20.323 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 41704, 2024-09-05T01:42:20.323 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 8.269013188, 2024-09-05T01:42:20.323 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000198278 2024-09-05T01:42:20.323 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:20.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.323 INFO:teuthology.orchestra.run.smithi151.stdout: "mds": { 2024-09-05T01:42:20.323 INFO:teuthology.orchestra.run.smithi151.stdout: "request": 70073, 2024-09-05T01:42:20.323 INFO:teuthology.orchestra.run.smithi151.stdout: "reply": 68866, 2024-09-05T01:42:20.324 INFO:teuthology.orchestra.run.smithi151.stdout: "reply_latency": { 2024-09-05T01:42:20.324 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 68866, 2024-09-05T01:42:20.324 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 821.072259555, 2024-09-05T01:42:20.324 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.011922752 2024-09-05T01:42:20.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.324 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_reply": 0, 2024-09-05T01:42:20.324 INFO:teuthology.orchestra.run.smithi151.stdout: "forward": 1206, 2024-09-05T01:42:20.324 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_complete": 133, 2024-09-05T01:42:20.324 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_keys": 0, 2024-09-05T01:42:20.324 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_commit": 897, 2024-09-05T01:42:20.324 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_split": 72, 2024-09-05T01:42:20.324 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_merge": 0, 2024-09-05T01:42:20.324 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes": 41520, 2024-09-05T01:42:20.325 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_top": 7959, 2024-09-05T01:42:20.325 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_bottom": 23716, 2024-09-05T01:42:20.325 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pin_tail": 9845, 2024-09-05T01:42:20.325 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pinned": 30147, 2024-09-05T01:42:20.325 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_expired": 60652, 2024-09-05T01:42:20.325 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_with_caps": 0, 2024-09-05T01:42:20.325 INFO:teuthology.orchestra.run.smithi151.stdout: "caps": 0, 2024-09-05T01:42:20.325 INFO:teuthology.orchestra.run.smithi151.stdout: "subtrees": 6, 2024-09-05T01:42:20.325 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse": 114387, 2024-09-05T01:42:20.325 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_hit": 98988, 2024-09-05T01:42:20.325 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_forward": 883, 2024-09-05T01:42:20.325 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_discover": 597, 2024-09-05T01:42:20.326 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_dir_fetch": 0, 2024-09-05T01:42:20.326 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_remote_ino": 0, 2024-09-05T01:42:20.326 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_lock": 270, 2024-09-05T01:42:20.326 INFO:teuthology.orchestra.run.smithi151.stdout: "load_cent": 0, 2024-09-05T01:42:20.326 INFO:teuthology.orchestra.run.smithi151.stdout: "q": 0, 2024-09-05T01:42:20.326 INFO:teuthology.orchestra.run.smithi151.stdout: "exported": 396, 2024-09-05T01:42:20.326 INFO:teuthology.orchestra.run.smithi151.stdout: "exported_inodes": 45172, 2024-09-05T01:42:20.326 INFO:teuthology.orchestra.run.smithi151.stdout: "imported": 404, 2024-09-05T01:42:20.326 INFO:teuthology.orchestra.run.smithi151.stdout: "imported_inodes": 50064, 2024-09-05T01:42:20.326 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_dir_fetch": 0, 2024-09-05T01:42:20.326 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_backtrace_fetch": 96933, 2024-09-05T01:42:20.326 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_peer_discover": 1, 2024-09-05T01:42:20.326 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rfiles": 6751, 2024-09-05T01:42:20.326 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rbytes": 158779880, 2024-09-05T01:42:20.327 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rsnaps": 6, 2024-09-05T01:42:20.327 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_fetch": 96933, 2024-09-05T01:42:20.327 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_set_tag": 0, 2024-09-05T01:42:20.327 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T01:42:20.327 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_inotable_repaired": 0, 2024-09-05T01:42:20.327 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_inodes": 631, 2024-09-05T01:42:20.327 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_base_inodes": 0, 2024-09-05T01:42:20.327 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dirfrag_rstats": 631, 2024-09-05T01:42:20.327 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_file_inodes": 96302, 2024-09-05T01:42:20.327 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_inode_file_caps": 116, 2024-09-05T01:42:20.327 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_revoke": 15292, 2024-09-05T01:42:20.327 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_grant": 37995, 2024-09-05T01:42:20.327 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_trunc": 0, 2024-09-05T01:42:20.327 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T01:42:20.328 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T01:42:20.328 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps": 40150, 2024-09-05T01:42:20.328 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps_dirty": 20130, 2024-09-05T01:42:20.328 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_cap_release": 638, 2024-09-05T01:42:20.328 INFO:teuthology.orchestra.run.smithi151.stdout: "process_request_cap_release": 43532 2024-09-05T01:42:20.328 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.328 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_cache": { 2024-09-05T01:42:20.328 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update": 0, 2024-09-05T01:42:20.328 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update_receipt": 5, 2024-09-05T01:42:20.328 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_try_discover": 3, 2024-09-05T01:42:20.329 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_send_discover": 812, 2024-09-05T01:42:20.329 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_handle_discover": 1313, 2024-09-05T01:42:20.329 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays": 132, 2024-09-05T01:42:20.329 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_delayed": 0, 2024-09-05T01:42:20.329 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_enqueuing": 0, 2024-09-05T01:42:20.329 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_created": 22237, 2024-09-05T01:42:20.329 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_enqueued": 22105, 2024-09-05T01:42:20.329 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_reintegrated": 0, 2024-09-05T01:42:20.329 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_migrated": 0, 2024-09-05T01:42:20.329 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_processing": 0, 2024-09-05T01:42:20.330 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_enqueued": 0, 2024-09-05T01:42:20.330 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_prioritized": 0, 2024-09-05T01:42:20.330 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_started": 0, 2024-09-05T01:42:20.330 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_completed": 0, 2024-09-05T01:42:20.330 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_path": 0, 2024-09-05T01:42:20.330 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_inode": 0, 2024-09-05T01:42:20.330 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_enqueue_scrub": 0, 2024-09-05T01:42:20.330 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_exportdir": 398, 2024-09-05T01:42:20.330 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_flush": 0, 2024-09-05T01:42:20.330 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragmentdir": 72, 2024-09-05T01:42:20.330 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragstats": 0, 2024-09-05T01:42:20.330 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_inodestats": 0 2024-09-05T01:42:20.330 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.330 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_log": { 2024-09-05T01:42:20.331 INFO:teuthology.orchestra.run.smithi151.stdout: "evlrg": 5, 2024-09-05T01:42:20.331 INFO:teuthology.orchestra.run.smithi151.stdout: "evadd": 112391, 2024-09-05T01:42:20.331 INFO:teuthology.orchestra.run.smithi151.stdout: "evex": 27579, 2024-09-05T01:42:20.331 INFO:teuthology.orchestra.run.smithi151.stdout: "evtrm": 24581, 2024-09-05T01:42:20.331 INFO:teuthology.orchestra.run.smithi151.stdout: "ev": 87810, 2024-09-05T01:42:20.331 INFO:teuthology.orchestra.run.smithi151.stdout: "evexg": 0, 2024-09-05T01:42:20.331 INFO:teuthology.orchestra.run.smithi151.stdout: "evexd": 2998, 2024-09-05T01:42:20.331 INFO:teuthology.orchestra.run.smithi151.stdout: "segadd": 164, 2024-09-05T01:42:20.331 INFO:teuthology.orchestra.run.smithi151.stdout: "segex": 36, 2024-09-05T01:42:20.331 INFO:teuthology.orchestra.run.smithi151.stdout: "segtrm": 32, 2024-09-05T01:42:20.331 INFO:teuthology.orchestra.run.smithi151.stdout: "seg": 132, 2024-09-05T01:42:20.331 INFO:teuthology.orchestra.run.smithi151.stdout: "segmjr": 8, 2024-09-05T01:42:20.331 INFO:teuthology.orchestra.run.smithi151.stdout: "segexg": 0, 2024-09-05T01:42:20.331 INFO:teuthology.orchestra.run.smithi151.stdout: "segexd": 4, 2024-09-05T01:42:20.332 INFO:teuthology.orchestra.run.smithi151.stdout: "expos": 64061312, 2024-09-05T01:42:20.332 INFO:teuthology.orchestra.run.smithi151.stdout: "wrpos": 411503583, 2024-09-05T01:42:20.332 INFO:teuthology.orchestra.run.smithi151.stdout: "rdpos": 0, 2024-09-05T01:42:20.332 INFO:teuthology.orchestra.run.smithi151.stdout: "jlat": { 2024-09-05T01:42:20.332 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 3040, 2024-09-05T01:42:20.332 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 129.118816477, 2024-09-05T01:42:20.332 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.042473294 2024-09-05T01:42:20.332 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.332 INFO:teuthology.orchestra.run.smithi151.stdout: "replayed": 0 2024-09-05T01:42:20.332 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.332 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_mem": { 2024-09-05T01:42:20.332 INFO:teuthology.orchestra.run.smithi151.stdout: "ino": 21065, 2024-09-05T01:42:20.332 INFO:teuthology.orchestra.run.smithi151.stdout: "ino+": 73413, 2024-09-05T01:42:20.332 INFO:teuthology.orchestra.run.smithi151.stdout: "ino-": 52348, 2024-09-05T01:42:20.332 INFO:teuthology.orchestra.run.smithi151.stdout: "dir": 885, 2024-09-05T01:42:20.333 INFO:teuthology.orchestra.run.smithi151.stdout: "dir+": 2035, 2024-09-05T01:42:20.333 INFO:teuthology.orchestra.run.smithi151.stdout: "dir-": 1150, 2024-09-05T01:42:20.333 INFO:teuthology.orchestra.run.smithi151.stdout: "dn": 41520, 2024-09-05T01:42:20.333 INFO:teuthology.orchestra.run.smithi151.stdout: "dn+": 124671, 2024-09-05T01:42:20.333 INFO:teuthology.orchestra.run.smithi151.stdout: "dn-": 83151, 2024-09-05T01:42:20.333 INFO:teuthology.orchestra.run.smithi151.stdout: "cap": 0, 2024-09-05T01:42:20.333 INFO:teuthology.orchestra.run.smithi151.stdout: "cap+": 42382, 2024-09-05T01:42:20.333 INFO:teuthology.orchestra.run.smithi151.stdout: "cap-": 42382, 2024-09-05T01:42:20.333 INFO:teuthology.orchestra.run.smithi151.stdout: "rss": 236384, 2024-09-05T01:42:20.333 INFO:teuthology.orchestra.run.smithi151.stdout: "heap": 223520 2024-09-05T01:42:20.333 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.333 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_server": { 2024-09-05T01:42:20.333 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_client_request": 85758, 2024-09-05T01:42:20.334 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_server_request": 4112, 2024-09-05T01:42:20.334 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_request": 70073, 2024-09-05T01:42:20.334 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_session": 403, 2024-09-05T01:42:20.334 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_peer_request": 13209, 2024-09-05T01:42:20.334 INFO:teuthology.orchestra.run.smithi151.stdout: "req_create_latency": { 2024-09-05T01:42:20.334 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 13906, 2024-09-05T01:42:20.334 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 41.280254314, 2024-09-05T01:42:20.334 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.002968521 2024-09-05T01:42:20.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.334 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getattr_latency": { 2024-09-05T01:42:20.334 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 59, 2024-09-05T01:42:20.334 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 1.848146011, 2024-09-05T01:42:20.334 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.031324508 2024-09-05T01:42:20.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.335 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getfilelock_latency": { 2024-09-05T01:42:20.335 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.335 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.335 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.335 INFO:teuthology.orchestra.run.smithi151.stdout: "req_link_latency": { 2024-09-05T01:42:20.335 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.335 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.335 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.335 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.335 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookup_latency": { 2024-09-05T01:42:20.335 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 16534, 2024-09-05T01:42:20.335 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 405.057183254, 2024-09-05T01:42:20.336 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.024498438 2024-09-05T01:42:20.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.336 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookuphash_latency": { 2024-09-05T01:42:20.336 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.336 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.336 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.336 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupino_latency": { 2024-09-05T01:42:20.336 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.336 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.336 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.336 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupname_latency": { 2024-09-05T01:42:20.337 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.337 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.337 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.337 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupparent_latency": { 2024-09-05T01:42:20.337 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.337 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.337 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.337 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupsnap_latency": { 2024-09-05T01:42:20.338 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.338 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.338 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.338 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lssnap_latency": { 2024-09-05T01:42:20.338 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.338 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.339 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.339 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mkdir_latency": { 2024-09-05T01:42:20.339 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 82, 2024-09-05T01:42:20.339 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 1.729448535, 2024-09-05T01:42:20.339 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.021090835 2024-09-05T01:42:20.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.339 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mknod_latency": { 2024-09-05T01:42:20.339 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.339 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.339 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.339 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mksnap_latency": { 2024-09-05T01:42:20.340 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.340 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.340 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.340 INFO:teuthology.orchestra.run.smithi151.stdout: "req_open_latency": { 2024-09-05T01:42:20.340 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 3542, 2024-09-05T01:42:20.340 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 15.671403916, 2024-09-05T01:42:20.340 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.004424450 2024-09-05T01:42:20.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.340 INFO:teuthology.orchestra.run.smithi151.stdout: "req_readdir_latency": { 2024-09-05T01:42:20.340 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 898, 2024-09-05T01:42:20.340 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 1.148296786, 2024-09-05T01:42:20.340 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001278726 2024-09-05T01:42:20.340 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.341 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rename_latency": { 2024-09-05T01:42:20.341 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 13913, 2024-09-05T01:42:20.341 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 292.873511017, 2024-09-05T01:42:20.341 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.021050349 2024-09-05T01:42:20.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.341 INFO:teuthology.orchestra.run.smithi151.stdout: "req_renamesnap_latency": { 2024-09-05T01:42:20.341 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.341 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.341 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.341 INFO:teuthology.orchestra.run.smithi151.stdout: "req_snapdiff_latency": { 2024-09-05T01:42:20.341 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.341 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.342 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.342 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmdir_latency": { 2024-09-05T01:42:20.342 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 134, 2024-09-05T01:42:20.342 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 23.256459448, 2024-09-05T01:42:20.342 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.173555667 2024-09-05T01:42:20.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.342 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmsnap_latency": { 2024-09-05T01:42:20.342 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.342 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.342 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.342 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.342 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmxattr_latency": { 2024-09-05T01:42:20.342 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.343 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.343 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.343 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setattr_latency": { 2024-09-05T01:42:20.343 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.343 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.343 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.343 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setdirlayout_latency": { 2024-09-05T01:42:20.343 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.343 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.343 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.344 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setfilelock_latency": { 2024-09-05T01:42:20.344 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.344 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.344 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.344 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setlayout_latency": { 2024-09-05T01:42:20.344 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.344 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.345 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.345 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setxattr_latency": { 2024-09-05T01:42:20.345 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.345 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.345 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.345 INFO:teuthology.orchestra.run.smithi151.stdout: "req_symlink_latency": { 2024-09-05T01:42:20.345 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.346 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.346 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.346 INFO:teuthology.orchestra.run.smithi151.stdout: "req_unlink_latency": { 2024-09-05T01:42:20.346 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 19798, 2024-09-05T01:42:20.346 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 38.207556274, 2024-09-05T01:42:20.346 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001929869 2024-09-05T01:42:20.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.346 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_revoke_eviction": 0, 2024-09-05T01:42:20.346 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_acquisition_throttle": 0, 2024-09-05T01:42:20.346 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getvxattr_latency": { 2024-09-05T01:42:20.346 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.346 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.346 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.346 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:20.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.347 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_sessions": { 2024-09-05T01:42:20.347 INFO:teuthology.orchestra.run.smithi151.stdout: "session_count": 1, 2024-09-05T01:42:20.347 INFO:teuthology.orchestra.run.smithi151.stdout: "session_add": 3, 2024-09-05T01:42:20.347 INFO:teuthology.orchestra.run.smithi151.stdout: "session_remove": 2, 2024-09-05T01:42:20.347 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_open": 1, 2024-09-05T01:42:20.347 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_stale": 0, 2024-09-05T01:42:20.347 INFO:teuthology.orchestra.run.smithi151.stdout: "total_load": 579, 2024-09-05T01:42:20.347 INFO:teuthology.orchestra.run.smithi151.stdout: "average_load": 579, 2024-09-05T01:42:20.347 INFO:teuthology.orchestra.run.smithi151.stdout: "avg_session_uptime": 1042, 2024-09-05T01:42:20.347 INFO:teuthology.orchestra.run.smithi151.stdout: "mdthresh_evicted": 0 2024-09-05T01:42:20.347 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.347 INFO:teuthology.orchestra.run.smithi151.stdout: "mempool": { 2024-09-05T01:42:20.348 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_bytes": 0, 2024-09-05T01:42:20.348 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_items": 0, 2024-09-05T01:42:20.348 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T01:42:20.348 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_items": 0, 2024-09-05T01:42:20.348 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T01:42:20.348 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_items": 0, 2024-09-05T01:42:20.348 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T01:42:20.348 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T01:42:20.348 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T01:42:20.348 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T01:42:20.348 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T01:42:20.348 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_items": 0, 2024-09-05T01:42:20.348 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T01:42:20.349 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T01:42:20.349 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_bytes": 0, 2024-09-05T01:42:20.349 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_items": 0, 2024-09-05T01:42:20.349 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_bytes": 0, 2024-09-05T01:42:20.349 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_items": 0, 2024-09-05T01:42:20.349 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T01:42:20.349 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T01:42:20.349 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T01:42:20.349 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T01:42:20.350 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T01:42:20.350 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_items": 0, 2024-09-05T01:42:20.350 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_bytes": 0, 2024-09-05T01:42:20.350 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_items": 0, 2024-09-05T01:42:20.350 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T01:42:20.350 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T01:42:20.350 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_bytes": 0, 2024-09-05T01:42:20.350 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_items": 0, 2024-09-05T01:42:20.350 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_bytes": 0, 2024-09-05T01:42:20.350 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_items": 0, 2024-09-05T01:42:20.350 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T01:42:20.350 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_items": 0, 2024-09-05T01:42:20.350 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T01:42:20.351 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_items": 0, 2024-09-05T01:42:20.351 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_bytes": 2161727, 2024-09-05T01:42:20.351 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_items": 20174, 2024-09-05T01:42:20.351 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_bytes": 0, 2024-09-05T01:42:20.351 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_items": 0, 2024-09-05T01:42:20.351 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_bytes": 0, 2024-09-05T01:42:20.351 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_items": 0, 2024-09-05T01:42:20.351 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_bytes": 0, 2024-09-05T01:42:20.351 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_items": 0, 2024-09-05T01:42:20.351 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_bytes": 0, 2024-09-05T01:42:20.351 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_items": 0, 2024-09-05T01:42:20.351 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_bytes": 8512, 2024-09-05T01:42:20.351 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_items": 191, 2024-09-05T01:42:20.351 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T01:42:20.352 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_items": 0, 2024-09-05T01:42:20.352 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_bytes": 0, 2024-09-05T01:42:20.352 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_items": 0, 2024-09-05T01:42:20.352 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_bytes": 80324266, 2024-09-05T01:42:20.352 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_items": 849435, 2024-09-05T01:42:20.352 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_bytes": 0, 2024-09-05T01:42:20.352 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_items": 0, 2024-09-05T01:42:20.352 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_bytes": 0, 2024-09-05T01:42:20.352 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_items": 0 2024-09-05T01:42:20.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.352 INFO:teuthology.orchestra.run.smithi151.stdout: "objecter": { 2024-09-05T01:42:20.352 INFO:teuthology.orchestra.run.smithi151.stdout: "op_active": 0, 2024-09-05T01:42:20.352 INFO:teuthology.orchestra.run.smithi151.stdout: "op_laggy": 0, 2024-09-05T01:42:20.352 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send": 125442, 2024-09-05T01:42:20.353 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send_bytes": 430768183, 2024-09-05T01:42:20.353 INFO:teuthology.orchestra.run.smithi151.stdout: "op_resend": 33, 2024-09-05T01:42:20.353 INFO:teuthology.orchestra.run.smithi151.stdout: "op_reply": 125442, 2024-09-05T01:42:20.353 INFO:teuthology.orchestra.run.smithi151.stdout: "op_latency": { 2024-09-05T01:42:20.353 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 125442, 2024-09-05T01:42:20.353 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 516.030088777, 2024-09-05T01:42:20.353 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.004113694 2024-09-05T01:42:20.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.353 INFO:teuthology.orchestra.run.smithi151.stdout: "op_inflight": 0, 2024-09-05T01:42:20.353 INFO:teuthology.orchestra.run.smithi151.stdout: "oplen_avg": { 2024-09-05T01:42:20.353 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 125442, 2024-09-05T01:42:20.353 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 127769 2024-09-05T01:42:20.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.354 INFO:teuthology.orchestra.run.smithi151.stdout: "op": 125442, 2024-09-05T01:42:20.354 INFO:teuthology.orchestra.run.smithi151.stdout: "op_r": 97709, 2024-09-05T01:42:20.354 INFO:teuthology.orchestra.run.smithi151.stdout: "op_w": 27733, 2024-09-05T01:42:20.354 INFO:teuthology.orchestra.run.smithi151.stdout: "op_rmw": 0, 2024-09-05T01:42:20.354 INFO:teuthology.orchestra.run.smithi151.stdout: "op_pg": 0, 2024-09-05T01:42:20.354 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_stat": 223, 2024-09-05T01:42:20.354 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_create": 21, 2024-09-05T01:42:20.354 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_read": 643, 2024-09-05T01:42:20.354 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_write": 3683, 2024-09-05T01:42:20.354 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writefull": 366, 2024-09-05T01:42:20.354 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writesame": 0, 2024-09-05T01:42:20.354 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_append": 0, 2024-09-05T01:42:20.355 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_zero": 0, 2024-09-05T01:42:20.355 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_truncate": 72, 2024-09-05T01:42:20.355 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_delete": 22236, 2024-09-05T01:42:20.355 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_mapext": 0, 2024-09-05T01:42:20.355 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_sparse_read": 0, 2024-09-05T01:42:20.355 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_clonerange": 0, 2024-09-05T01:42:20.355 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_getxattr": 96933, 2024-09-05T01:42:20.355 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_setxattr": 42, 2024-09-05T01:42:20.355 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_cmpxattr": 0, 2024-09-05T01:42:20.355 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_rmxattr": 0, 2024-09-05T01:42:20.355 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_resetxattrs": 0, 2024-09-05T01:42:20.355 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_call": 0, 2024-09-05T01:42:20.355 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_watch": 0, 2024-09-05T01:42:20.356 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_notify": 0, 2024-09-05T01:42:20.356 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T01:42:20.356 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls": 0, 2024-09-05T01:42:20.356 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls_filter": 0, 2024-09-05T01:42:20.356 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_other": 0, 2024-09-05T01:42:20.356 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_active": 0, 2024-09-05T01:42:20.356 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_send": 0, 2024-09-05T01:42:20.356 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_resend": 0, 2024-09-05T01:42:20.356 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_ping": 0, 2024-09-05T01:42:20.356 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_active": 0, 2024-09-05T01:42:20.356 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_send": 0, 2024-09-05T01:42:20.356 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_resend": 0, 2024-09-05T01:42:20.356 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_active": 0, 2024-09-05T01:42:20.356 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_send": 0, 2024-09-05T01:42:20.357 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_resend": 0, 2024-09-05T01:42:20.357 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_active": 0, 2024-09-05T01:42:20.357 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_send": 0, 2024-09-05T01:42:20.357 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_resend": 0, 2024-09-05T01:42:20.357 INFO:teuthology.orchestra.run.smithi151.stdout: "command_active": 0, 2024-09-05T01:42:20.357 INFO:teuthology.orchestra.run.smithi151.stdout: "command_send": 0, 2024-09-05T01:42:20.357 INFO:teuthology.orchestra.run.smithi151.stdout: "command_resend": 0, 2024-09-05T01:42:20.357 INFO:teuthology.orchestra.run.smithi151.stdout: "map_epoch": 108, 2024-09-05T01:42:20.357 INFO:teuthology.orchestra.run.smithi151.stdout: "map_full": 0, 2024-09-05T01:42:20.357 INFO:teuthology.orchestra.run.smithi151.stdout: "map_inc": 27, 2024-09-05T01:42:20.357 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_sessions": 12, 2024-09-05T01:42:20.357 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_open": 12, 2024-09-05T01:42:20.357 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_close": 0, 2024-09-05T01:42:20.357 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_laggy": 0, 2024-09-05T01:42:20.358 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_wr": 2648, 2024-09-05T01:42:20.358 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_rd": 266, 2024-09-05T01:42:20.358 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_del": 636 2024-09-05T01:42:20.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.358 INFO:teuthology.orchestra.run.smithi151.stdout: "oft": { 2024-09-05T01:42:20.358 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_objs": 1, 2024-09-05T01:42:20.358 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_kv_pairs": 0, 2024-09-05T01:42:20.358 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_updates": 0, 2024-09-05T01:42:20.358 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_removes": 0 2024-09-05T01:42:20.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.358 INFO:teuthology.orchestra.run.smithi151.stdout: "osd-slow-ops": { 2024-09-05T01:42:20.358 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_ops_count": 22 2024-09-05T01:42:20.358 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.358 INFO:teuthology.orchestra.run.smithi151.stdout: "purge_queue": { 2024-09-05T01:42:20.358 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops": 0, 2024-09-05T01:42:20.359 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops_high_water": 9, 2024-09-05T01:42:20.359 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing": 0, 2024-09-05T01:42:20.359 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_high_water": 6, 2024-09-05T01:42:20.359 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed_ops": 22113, 2024-09-05T01:42:20.359 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed": 22105, 2024-09-05T01:42:20.359 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_item_in_journal": 0 2024-09-05T01:42:20.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.359 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T01:42:20.359 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-09-05T01:42:20.359 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-09-05T01:42:20.359 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-09-05T01:42:20.359 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 332289, 2024-09-05T01:42:20.359 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 119357902, 2024-09-05T01:42:20.359 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:20.360 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 332289, 2024-09-05T01:42:20.360 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-09-05T01:42:20.360 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-09-05T01:42:20.360 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 332289, 2024-09-05T01:42:20.360 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 119357902, 2024-09-05T01:42:20.360 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-09-05T01:42:20.360 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.360 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.360 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.361 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:20.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.361 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_bytes": { 2024-09-05T01:42:20.361 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-09-05T01:42:20.361 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-09-05T01:42:20.361 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-09-05T01:42:20.361 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-09-05T01:42:20.361 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-09-05T01:42:20.361 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:20.362 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:20.362 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 125442, 2024-09-05T01:42:20.362 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 433841492, 2024-09-05T01:42:20.362 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 125442, 2024-09-05T01:42:20.362 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 433841492, 2024-09-05T01:42:20.362 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-09-05T01:42:20.362 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.362 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.362 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.362 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:20.362 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.362 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_ops": { 2024-09-05T01:42:20.362 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-09-05T01:42:20.362 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 1024, 2024-09-05T01:42:20.363 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-09-05T01:42:20.363 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-09-05T01:42:20.363 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-09-05T01:42:20.363 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:20.363 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:20.363 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 125442, 2024-09-05T01:42:20.363 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 125442, 2024-09-05T01:42:20.363 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 125442, 2024-09-05T01:42:20.363 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 125442, 2024-09-05T01:42:20.363 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-09-05T01:42:20.363 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.363 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.363 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.363 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:20.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.364 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle": { 2024-09-05T01:42:20.364 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-09-05T01:42:20.364 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-09-05T01:42:20.364 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-09-05T01:42:20.364 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 22105, 2024-09-05T01:42:20.364 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 3075437, 2024-09-05T01:42:20.364 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:20.364 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 22105, 2024-09-05T01:42:20.364 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-09-05T01:42:20.364 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-09-05T01:42:20.364 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 643, 2024-09-05T01:42:20.364 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 3075437, 2024-09-05T01:42:20.364 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-09-05T01:42:20.364 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.365 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.365 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.365 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:20.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:20.365 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle-0x558874ee4960": { 2024-09-05T01:42:20.365 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-09-05T01:42:20.365 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-09-05T01:42:20.365 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-09-05T01:42:20.365 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 112391, 2024-09-05T01:42:20.365 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 407309279, 2024-09-05T01:42:20.365 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:20.365 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 112391, 2024-09-05T01:42:20.365 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-09-05T01:42:20.365 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-09-05T01:42:20.366 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 3040, 2024-09-05T01:42:20.366 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 407309279, 2024-09-05T01:42:20.366 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-09-05T01:42:20.366 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:20.366 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:20.366 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:20.366 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:20.366 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:20.366 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-05T01:42:21.464 INFO:tasks.check_counter:Daemon mds.c mds.exported=396 2024-09-05T01:42:21.465 INFO:tasks.check_counter:Daemon mds.c mds.imported=404 2024-09-05T01:42:21.465 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-05T01:42:21.465 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-05T01:42:21.465 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-05T01:42:21.465 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=72 2024-09-05T01:42:21.465 DEBUG:tasks.check_counter:Getting stats from f 2024-09-05T01:42:21.465 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-05T01:42:21.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:21 smithi145 ceph-mon[34376]: pgmap v554: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-05T01:42:21.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:21 smithi151 ceph-mon[35013]: pgmap v554: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-05T01:42:21.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:21 smithi012 ceph-mon[29942]: pgmap v554: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-05T01:42:21.932 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T01:42:22.657 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-05T01:42:22.657 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T01:42:22.657 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 2510, 2024-09-05T01:42:22.657 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 2510, 2024-09-05T01:42:22.657 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 311257473, 2024-09-05T01:42:22.657 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 797366, 2024-09-05T01:42:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 8, 2024-09-05T01:42:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 4, 2024-09-05T01:42:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.404146514, 2024-09-05T01:42:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.059363975, 2024-09-05T01:42:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.254480271, 2024-09-05T01:42:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.071291886, 2024-09-05T01:42:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 2509, 2024-09-05T01:42:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.092000959, 2024-09-05T01:42:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000036668 2024-09-05T01:42:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:22.658 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-05T01:42:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 448 2024-09-05T01:42:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T01:42:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 1691, 2024-09-05T01:42:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 1630, 2024-09-05T01:42:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 360836827, 2024-09-05T01:42:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 610864, 2024-09-05T01:42:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 6, 2024-09-05T01:42:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 5, 2024-09-05T01:42:22.659 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.340195701, 2024-09-05T01:42:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.048088655, 2024-09-05T01:42:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.267221835, 2024-09-05T01:42:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.033679816, 2024-09-05T01:42:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 1629, 2024-09-05T01:42:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.093702334, 2024-09-05T01:42:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000057521 2024-09-05T01:42:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 1983280, 2024-09-05T01:42:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 205984 2024-09-05T01:42:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T01:42:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 1597, 2024-09-05T01:42:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 1843, 2024-09-05T01:42:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 315245804, 2024-09-05T01:42:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 1104699, 2024-09-05T01:42:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 8, 2024-09-05T01:42:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 6, 2024-09-05T01:42:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.305427712, 2024-09-05T01:42:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.047806869, 2024-09-05T01:42:22.661 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.201843118, 2024-09-05T01:42:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.042646123, 2024-09-05T01:42:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 1840, 2024-09-05T01:42:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.092047048, 2024-09-05T01:42:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000050025 2024-09-05T01:42:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-05T01:42:22.662 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 597488 2024-09-05T01:42:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: "cct": { 2024-09-05T01:42:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: "total_workers": 1, 2024-09-05T01:42:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: "unhealthy_workers": 0 2024-09-05T01:42:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-MDSRank": { 2024-09-05T01:42:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-09-05T01:42:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-09-05T01:42:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 8201, 2024-09-05T01:42:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.449515733, 2024-09-05T01:42:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000054812 2024-09-05T01:42:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:22.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.664 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-PurgeQueue": { 2024-09-05T01:42:22.664 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-09-05T01:42:22.664 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-09-05T01:42:22.664 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.664 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.664 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.664 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:22.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.664 INFO:teuthology.orchestra.run.smithi151.stdout: "mds": { 2024-09-05T01:42:22.664 INFO:teuthology.orchestra.run.smithi151.stdout: "request": 0, 2024-09-05T01:42:22.664 INFO:teuthology.orchestra.run.smithi151.stdout: "reply": 0, 2024-09-05T01:42:22.664 INFO:teuthology.orchestra.run.smithi151.stdout: "reply_latency": { 2024-09-05T01:42:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_reply": 0, 2024-09-05T01:42:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: "forward": 0, 2024-09-05T01:42:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_complete": 0, 2024-09-05T01:42:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_keys": 0, 2024-09-05T01:42:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_commit": 0, 2024-09-05T01:42:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_split": 0, 2024-09-05T01:42:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_merge": 0, 2024-09-05T01:42:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes": 168584, 2024-09-05T01:42:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_top": 35899, 2024-09-05T01:42:22.665 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_bottom": 132685, 2024-09-05T01:42:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pin_tail": 0, 2024-09-05T01:42:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pinned": 117300, 2024-09-05T01:42:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_expired": 0, 2024-09-05T01:42:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_with_caps": 0, 2024-09-05T01:42:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: "caps": 0, 2024-09-05T01:42:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: "subtrees": 2, 2024-09-05T01:42:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse": 0, 2024-09-05T01:42:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_hit": 0, 2024-09-05T01:42:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_forward": 0, 2024-09-05T01:42:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_discover": 0, 2024-09-05T01:42:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_dir_fetch": 0, 2024-09-05T01:42:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_remote_ino": 0, 2024-09-05T01:42:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_lock": 0, 2024-09-05T01:42:22.666 INFO:teuthology.orchestra.run.smithi151.stdout: "load_cent": 0, 2024-09-05T01:42:22.667 INFO:teuthology.orchestra.run.smithi151.stdout: "q": 0, 2024-09-05T01:42:22.667 INFO:teuthology.orchestra.run.smithi151.stdout: "exported": 0, 2024-09-05T01:42:22.667 INFO:teuthology.orchestra.run.smithi151.stdout: "exported_inodes": 0, 2024-09-05T01:42:22.667 INFO:teuthology.orchestra.run.smithi151.stdout: "imported": 0, 2024-09-05T01:42:22.667 INFO:teuthology.orchestra.run.smithi151.stdout: "imported_inodes": 0, 2024-09-05T01:42:22.667 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_dir_fetch": 0, 2024-09-05T01:42:22.667 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_backtrace_fetch": 0, 2024-09-05T01:42:22.667 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_peer_discover": 0, 2024-09-05T01:42:22.667 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rfiles": 4, 2024-09-05T01:42:22.667 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rbytes": 234, 2024-09-05T01:42:22.667 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rsnaps": 6, 2024-09-05T01:42:22.667 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_fetch": 0, 2024-09-05T01:42:22.667 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_set_tag": 0, 2024-09-05T01:42:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T01:42:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_inotable_repaired": 0, 2024-09-05T01:42:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_inodes": 0, 2024-09-05T01:42:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_base_inodes": 0, 2024-09-05T01:42:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dirfrag_rstats": 0, 2024-09-05T01:42:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_file_inodes": 0, 2024-09-05T01:42:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_inode_file_caps": 0, 2024-09-05T01:42:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_revoke": 0, 2024-09-05T01:42:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_grant": 0, 2024-09-05T01:42:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_trunc": 0, 2024-09-05T01:42:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T01:42:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T01:42:22.668 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps": 0, 2024-09-05T01:42:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps_dirty": 0, 2024-09-05T01:42:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_cap_release": 0, 2024-09-05T01:42:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: "process_request_cap_release": 0 2024-09-05T01:42:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_cache": { 2024-09-05T01:42:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update": 0, 2024-09-05T01:42:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update_receipt": 0, 2024-09-05T01:42:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_try_discover": 0, 2024-09-05T01:42:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_send_discover": 0, 2024-09-05T01:42:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_handle_discover": 0, 2024-09-05T01:42:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays": 0, 2024-09-05T01:42:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_delayed": 0, 2024-09-05T01:42:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_enqueuing": 0, 2024-09-05T01:42:22.669 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_created": 0, 2024-09-05T01:42:22.670 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_enqueued": 0, 2024-09-05T01:42:22.670 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_reintegrated": 0, 2024-09-05T01:42:22.670 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_migrated": 0, 2024-09-05T01:42:22.670 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_processing": 0, 2024-09-05T01:42:22.670 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_enqueued": 0, 2024-09-05T01:42:22.670 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_prioritized": 0, 2024-09-05T01:42:22.670 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_started": 0, 2024-09-05T01:42:22.670 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_completed": 0, 2024-09-05T01:42:22.670 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_path": 0, 2024-09-05T01:42:22.670 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_inode": 0, 2024-09-05T01:42:22.670 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_enqueue_scrub": 0, 2024-09-05T01:42:22.670 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_exportdir": 0, 2024-09-05T01:42:22.670 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_flush": 0, 2024-09-05T01:42:22.671 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragmentdir": 0, 2024-09-05T01:42:22.671 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragstats": 0, 2024-09-05T01:42:22.671 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_inodestats": 0 2024-09-05T01:42:22.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.671 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_log": { 2024-09-05T01:42:22.671 INFO:teuthology.orchestra.run.smithi151.stdout: "evlrg": 0, 2024-09-05T01:42:22.671 INFO:teuthology.orchestra.run.smithi151.stdout: "evadd": 0, 2024-09-05T01:42:22.671 INFO:teuthology.orchestra.run.smithi151.stdout: "evex": 0, 2024-09-05T01:42:22.671 INFO:teuthology.orchestra.run.smithi151.stdout: "evtrm": 0, 2024-09-05T01:42:22.671 INFO:teuthology.orchestra.run.smithi151.stdout: "ev": 233471, 2024-09-05T01:42:22.671 INFO:teuthology.orchestra.run.smithi151.stdout: "evexg": 0, 2024-09-05T01:42:22.671 INFO:teuthology.orchestra.run.smithi151.stdout: "evexd": 0, 2024-09-05T01:42:22.671 INFO:teuthology.orchestra.run.smithi151.stdout: "segadd": 0, 2024-09-05T01:42:22.671 INFO:teuthology.orchestra.run.smithi151.stdout: "segex": 0, 2024-09-05T01:42:22.671 INFO:teuthology.orchestra.run.smithi151.stdout: "segtrm": 0, 2024-09-05T01:42:22.672 INFO:teuthology.orchestra.run.smithi151.stdout: "seg": 135, 2024-09-05T01:42:22.672 INFO:teuthology.orchestra.run.smithi151.stdout: "segmjr": 20, 2024-09-05T01:42:22.672 INFO:teuthology.orchestra.run.smithi151.stdout: "segexg": 0, 2024-09-05T01:42:22.672 INFO:teuthology.orchestra.run.smithi151.stdout: "segexd": 0, 2024-09-05T01:42:22.672 INFO:teuthology.orchestra.run.smithi151.stdout: "expos": 479595495, 2024-09-05T01:42:22.672 INFO:teuthology.orchestra.run.smithi151.stdout: "wrpos": 987515566, 2024-09-05T01:42:22.672 INFO:teuthology.orchestra.run.smithi151.stdout: "rdpos": 987515454, 2024-09-05T01:42:22.672 INFO:teuthology.orchestra.run.smithi151.stdout: "jlat": { 2024-09-05T01:42:22.672 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.672 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.672 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.672 INFO:teuthology.orchestra.run.smithi151.stdout: "replayed": 233471 2024-09-05T01:42:22.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.673 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_mem": { 2024-09-05T01:42:22.673 INFO:teuthology.orchestra.run.smithi151.stdout: "ino": 58937, 2024-09-05T01:42:22.673 INFO:teuthology.orchestra.run.smithi151.stdout: "ino+": 172733, 2024-09-05T01:42:22.673 INFO:teuthology.orchestra.run.smithi151.stdout: "ino-": 113796, 2024-09-05T01:42:22.673 INFO:teuthology.orchestra.run.smithi151.stdout: "dir": 2178, 2024-09-05T01:42:22.673 INFO:teuthology.orchestra.run.smithi151.stdout: "dir+": 4561, 2024-09-05T01:42:22.673 INFO:teuthology.orchestra.run.smithi151.stdout: "dir-": 2383, 2024-09-05T01:42:22.673 INFO:teuthology.orchestra.run.smithi151.stdout: "dn": 168584, 2024-09-05T01:42:22.673 INFO:teuthology.orchestra.run.smithi151.stdout: "dn+": 289646, 2024-09-05T01:42:22.673 INFO:teuthology.orchestra.run.smithi151.stdout: "dn-": 121062, 2024-09-05T01:42:22.673 INFO:teuthology.orchestra.run.smithi151.stdout: "cap": 0, 2024-09-05T01:42:22.673 INFO:teuthology.orchestra.run.smithi151.stdout: "cap+": 0, 2024-09-05T01:42:22.673 INFO:teuthology.orchestra.run.smithi151.stdout: "cap-": 0, 2024-09-05T01:42:22.674 INFO:teuthology.orchestra.run.smithi151.stdout: "rss": 349596, 2024-09-05T01:42:22.674 INFO:teuthology.orchestra.run.smithi151.stdout: "heap": 215328 2024-09-05T01:42:22.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.674 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_server": { 2024-09-05T01:42:22.674 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_client_request": 0, 2024-09-05T01:42:22.674 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_server_request": 0, 2024-09-05T01:42:22.674 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_request": 0, 2024-09-05T01:42:22.674 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_session": 0, 2024-09-05T01:42:22.674 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_peer_request": 0, 2024-09-05T01:42:22.674 INFO:teuthology.orchestra.run.smithi151.stdout: "req_create_latency": { 2024-09-05T01:42:22.674 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.674 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.674 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.675 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getattr_latency": { 2024-09-05T01:42:22.675 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.675 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.675 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.675 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getfilelock_latency": { 2024-09-05T01:42:22.675 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.675 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.675 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.675 INFO:teuthology.orchestra.run.smithi151.stdout: "req_link_latency": { 2024-09-05T01:42:22.675 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.675 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookup_latency": { 2024-09-05T01:42:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookuphash_latency": { 2024-09-05T01:42:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupino_latency": { 2024-09-05T01:42:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.676 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupname_latency": { 2024-09-05T01:42:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupparent_latency": { 2024-09-05T01:42:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupsnap_latency": { 2024-09-05T01:42:22.677 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.678 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.678 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.678 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lssnap_latency": { 2024-09-05T01:42:22.678 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.678 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.678 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.679 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mkdir_latency": { 2024-09-05T01:42:22.679 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.679 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.679 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.679 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mknod_latency": { 2024-09-05T01:42:22.679 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.679 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.679 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.679 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mksnap_latency": { 2024-09-05T01:42:22.679 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.679 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.680 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.680 INFO:teuthology.orchestra.run.smithi151.stdout: "req_open_latency": { 2024-09-05T01:42:22.680 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.680 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.680 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.680 INFO:teuthology.orchestra.run.smithi151.stdout: "req_readdir_latency": { 2024-09-05T01:42:22.680 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.680 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.680 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.680 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rename_latency": { 2024-09-05T01:42:22.680 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.681 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.681 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.681 INFO:teuthology.orchestra.run.smithi151.stdout: "req_renamesnap_latency": { 2024-09-05T01:42:22.681 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.681 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.681 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.681 INFO:teuthology.orchestra.run.smithi151.stdout: "req_snapdiff_latency": { 2024-09-05T01:42:22.681 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.681 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.681 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.682 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmdir_latency": { 2024-09-05T01:42:22.682 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.682 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.682 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.682 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmsnap_latency": { 2024-09-05T01:42:22.682 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.682 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.682 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.682 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmxattr_latency": { 2024-09-05T01:42:22.682 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.683 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.683 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.683 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setattr_latency": { 2024-09-05T01:42:22.683 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.683 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.683 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.683 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setdirlayout_latency": { 2024-09-05T01:42:22.683 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.683 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.683 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.684 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setfilelock_latency": { 2024-09-05T01:42:22.684 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.684 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.684 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.684 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setlayout_latency": { 2024-09-05T01:42:22.684 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.684 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.684 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.684 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setxattr_latency": { 2024-09-05T01:42:22.684 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.684 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.684 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: "req_symlink_latency": { 2024-09-05T01:42:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: "req_unlink_latency": { 2024-09-05T01:42:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_revoke_eviction": 0, 2024-09-05T01:42:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_acquisition_throttle": 0, 2024-09-05T01:42:22.685 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getvxattr_latency": { 2024-09-05T01:42:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_sessions": { 2024-09-05T01:42:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: "session_count": 2, 2024-09-05T01:42:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: "session_add": 5, 2024-09-05T01:42:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: "session_remove": 3, 2024-09-05T01:42:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_open": 4, 2024-09-05T01:42:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_stale": 0, 2024-09-05T01:42:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: "total_load": 0, 2024-09-05T01:42:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: "average_load": 0, 2024-09-05T01:42:22.686 INFO:teuthology.orchestra.run.smithi151.stdout: "avg_session_uptime": 3686, 2024-09-05T01:42:22.687 INFO:teuthology.orchestra.run.smithi151.stdout: "mdthresh_evicted": 0 2024-09-05T01:42:22.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.687 INFO:teuthology.orchestra.run.smithi151.stdout: "mempool": { 2024-09-05T01:42:22.687 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_bytes": 0, 2024-09-05T01:42:22.687 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_items": 0, 2024-09-05T01:42:22.687 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T01:42:22.687 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_items": 0, 2024-09-05T01:42:22.687 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T01:42:22.687 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_items": 0, 2024-09-05T01:42:22.687 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T01:42:22.687 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T01:42:22.687 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T01:42:22.687 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T01:42:22.688 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T01:42:22.688 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_items": 0, 2024-09-05T01:42:22.688 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T01:42:22.688 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T01:42:22.688 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_bytes": 0, 2024-09-05T01:42:22.688 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_items": 0, 2024-09-05T01:42:22.688 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_bytes": 0, 2024-09-05T01:42:22.688 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_items": 0, 2024-09-05T01:42:22.688 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T01:42:22.688 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T01:42:22.688 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T01:42:22.688 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T01:42:22.688 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T01:42:22.689 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_items": 0, 2024-09-05T01:42:22.689 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_bytes": 0, 2024-09-05T01:42:22.689 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_items": 0, 2024-09-05T01:42:22.689 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T01:42:22.689 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T01:42:22.689 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_bytes": 0, 2024-09-05T01:42:22.689 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_items": 0, 2024-09-05T01:42:22.689 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_bytes": 0, 2024-09-05T01:42:22.689 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_items": 0, 2024-09-05T01:42:22.689 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T01:42:22.689 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_items": 0, 2024-09-05T01:42:22.689 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T01:42:22.689 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_items": 0, 2024-09-05T01:42:22.689 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_bytes": 2467007, 2024-09-05T01:42:22.690 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_items": 60284, 2024-09-05T01:42:22.690 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_bytes": 0, 2024-09-05T01:42:22.690 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_items": 0, 2024-09-05T01:42:22.690 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_bytes": 0, 2024-09-05T01:42:22.690 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_items": 0, 2024-09-05T01:42:22.690 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_bytes": 0, 2024-09-05T01:42:22.690 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_items": 0, 2024-09-05T01:42:22.690 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_bytes": 0, 2024-09-05T01:42:22.690 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_items": 0, 2024-09-05T01:42:22.690 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_bytes": 8512, 2024-09-05T01:42:22.690 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_items": 191, 2024-09-05T01:42:22.690 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T01:42:22.690 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_items": 0, 2024-09-05T01:42:22.690 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_bytes": 0, 2024-09-05T01:42:22.691 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_items": 0, 2024-09-05T01:42:22.691 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_bytes": 257699459, 2024-09-05T01:42:22.691 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_items": 2354476, 2024-09-05T01:42:22.691 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_bytes": 0, 2024-09-05T01:42:22.691 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_items": 0, 2024-09-05T01:42:22.691 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_bytes": 0, 2024-09-05T01:42:22.691 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_items": 0 2024-09-05T01:42:22.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.691 INFO:teuthology.orchestra.run.smithi151.stdout: "objecter": { 2024-09-05T01:42:22.691 INFO:teuthology.orchestra.run.smithi151.stdout: "op_active": 0, 2024-09-05T01:42:22.691 INFO:teuthology.orchestra.run.smithi151.stdout: "op_laggy": 0, 2024-09-05T01:42:22.691 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send": 5374, 2024-09-05T01:42:22.691 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send_bytes": 26, 2024-09-05T01:42:22.691 INFO:teuthology.orchestra.run.smithi151.stdout: "op_resend": 4, 2024-09-05T01:42:22.692 INFO:teuthology.orchestra.run.smithi151.stdout: "op_reply": 5374, 2024-09-05T01:42:22.692 INFO:teuthology.orchestra.run.smithi151.stdout: "op_latency": { 2024-09-05T01:42:22.692 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 5374, 2024-09-05T01:42:22.692 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 30.404599683, 2024-09-05T01:42:22.692 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.005657722 2024-09-05T01:42:22.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.692 INFO:teuthology.orchestra.run.smithi151.stdout: "op_inflight": 0, 2024-09-05T01:42:22.692 INFO:teuthology.orchestra.run.smithi151.stdout: "oplen_avg": { 2024-09-05T01:42:22.692 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 5374, 2024-09-05T01:42:22.692 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 5375 2024-09-05T01:42:22.692 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.692 INFO:teuthology.orchestra.run.smithi151.stdout: "op": 5374, 2024-09-05T01:42:22.692 INFO:teuthology.orchestra.run.smithi151.stdout: "op_r": 5374, 2024-09-05T01:42:22.692 INFO:teuthology.orchestra.run.smithi151.stdout: "op_w": 0, 2024-09-05T01:42:22.693 INFO:teuthology.orchestra.run.smithi151.stdout: "op_rmw": 0, 2024-09-05T01:42:22.693 INFO:teuthology.orchestra.run.smithi151.stdout: "op_pg": 0, 2024-09-05T01:42:22.693 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_stat": 3332, 2024-09-05T01:42:22.693 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_create": 0, 2024-09-05T01:42:22.693 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_read": 2039, 2024-09-05T01:42:22.693 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_write": 0, 2024-09-05T01:42:22.693 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writefull": 0, 2024-09-05T01:42:22.693 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writesame": 0, 2024-09-05T01:42:22.693 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_append": 0, 2024-09-05T01:42:22.693 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_zero": 0, 2024-09-05T01:42:22.693 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_truncate": 0, 2024-09-05T01:42:22.693 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_delete": 0, 2024-09-05T01:42:22.693 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_mapext": 0, 2024-09-05T01:42:22.693 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_sparse_read": 0, 2024-09-05T01:42:22.694 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_clonerange": 0, 2024-09-05T01:42:22.694 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_getxattr": 2, 2024-09-05T01:42:22.694 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_setxattr": 0, 2024-09-05T01:42:22.694 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_cmpxattr": 0, 2024-09-05T01:42:22.694 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_rmxattr": 0, 2024-09-05T01:42:22.694 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_resetxattrs": 0, 2024-09-05T01:42:22.694 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_call": 0, 2024-09-05T01:42:22.694 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_watch": 0, 2024-09-05T01:42:22.694 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_notify": 0, 2024-09-05T01:42:22.694 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T01:42:22.694 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls": 0, 2024-09-05T01:42:22.694 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls_filter": 0, 2024-09-05T01:42:22.694 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_other": 0, 2024-09-05T01:42:22.695 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_active": 0, 2024-09-05T01:42:22.695 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_send": 0, 2024-09-05T01:42:22.695 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_resend": 0, 2024-09-05T01:42:22.695 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_ping": 0, 2024-09-05T01:42:22.695 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_active": 0, 2024-09-05T01:42:22.695 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_send": 0, 2024-09-05T01:42:22.695 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_resend": 0, 2024-09-05T01:42:22.695 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_active": 0, 2024-09-05T01:42:22.695 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_send": 0, 2024-09-05T01:42:22.695 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_resend": 0, 2024-09-05T01:42:22.695 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_active": 0, 2024-09-05T01:42:22.695 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_send": 0, 2024-09-05T01:42:22.695 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_resend": 0, 2024-09-05T01:42:22.695 INFO:teuthology.orchestra.run.smithi151.stdout: "command_active": 0, 2024-09-05T01:42:22.696 INFO:teuthology.orchestra.run.smithi151.stdout: "command_send": 0, 2024-09-05T01:42:22.696 INFO:teuthology.orchestra.run.smithi151.stdout: "command_resend": 0, 2024-09-05T01:42:22.696 INFO:teuthology.orchestra.run.smithi151.stdout: "map_epoch": 108, 2024-09-05T01:42:22.696 INFO:teuthology.orchestra.run.smithi151.stdout: "map_full": 0, 2024-09-05T01:42:22.696 INFO:teuthology.orchestra.run.smithi151.stdout: "map_inc": 27, 2024-09-05T01:42:22.696 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_sessions": 11, 2024-09-05T01:42:22.696 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_open": 11, 2024-09-05T01:42:22.696 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_close": 0, 2024-09-05T01:42:22.696 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_laggy": 0, 2024-09-05T01:42:22.696 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_wr": 0, 2024-09-05T01:42:22.696 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_rd": 2, 2024-09-05T01:42:22.696 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_del": 0 2024-09-05T01:42:22.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.697 INFO:teuthology.orchestra.run.smithi151.stdout: "oft": { 2024-09-05T01:42:22.697 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_objs": 0, 2024-09-05T01:42:22.697 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_kv_pairs": 0, 2024-09-05T01:42:22.697 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_updates": 0, 2024-09-05T01:42:22.697 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_removes": 0 2024-09-05T01:42:22.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.697 INFO:teuthology.orchestra.run.smithi151.stdout: "osd-slow-ops": { 2024-09-05T01:42:22.697 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_ops_count": 0 2024-09-05T01:42:22.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.697 INFO:teuthology.orchestra.run.smithi151.stdout: "purge_queue": { 2024-09-05T01:42:22.697 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops": 0, 2024-09-05T01:42:22.697 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops_high_water": 0, 2024-09-05T01:42:22.698 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing": 0, 2024-09-05T01:42:22.698 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_high_water": 0, 2024-09-05T01:42:22.698 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed_ops": 0, 2024-09-05T01:42:22.698 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed": 0, 2024-09-05T01:42:22.698 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_item_in_journal": 0 2024-09-05T01:42:22.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.698 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T01:42:22.698 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-09-05T01:42:22.698 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-09-05T01:42:22.698 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-09-05T01:42:22.698 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 5794, 2024-09-05T01:42:22.698 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 986794457, 2024-09-05T01:42:22.698 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:22.699 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 5794, 2024-09-05T01:42:22.699 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-09-05T01:42:22.699 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-09-05T01:42:22.699 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 5794, 2024-09-05T01:42:22.699 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 986794457, 2024-09-05T01:42:22.699 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-09-05T01:42:22.699 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.699 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.699 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.699 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:22.699 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.699 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_bytes": { 2024-09-05T01:42:22.699 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-09-05T01:42:22.699 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-09-05T01:42:22.700 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-09-05T01:42:22.700 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-09-05T01:42:22.700 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-09-05T01:42:22.700 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:22.700 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:22.700 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 5374, 2024-09-05T01:42:22.700 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 983884946, 2024-09-05T01:42:22.700 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 5374, 2024-09-05T01:42:22.700 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 983884946, 2024-09-05T01:42:22.700 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-09-05T01:42:22.700 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.700 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.700 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.701 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:22.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.701 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_ops": { 2024-09-05T01:42:22.701 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-09-05T01:42:22.701 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 1024, 2024-09-05T01:42:22.701 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-09-05T01:42:22.701 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-09-05T01:42:22.701 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-09-05T01:42:22.701 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:22.701 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:22.701 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 5374, 2024-09-05T01:42:22.701 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 5374, 2024-09-05T01:42:22.701 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 5374, 2024-09-05T01:42:22.701 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 5374, 2024-09-05T01:42:22.701 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-09-05T01:42:22.702 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.702 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.702 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.702 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:22.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.702 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle": { 2024-09-05T01:42:22.702 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-09-05T01:42:22.702 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-09-05T01:42:22.702 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-09-05T01:42:22.702 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-09-05T01:42:22.702 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-09-05T01:42:22.702 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:22.702 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:22.703 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-09-05T01:42:22.703 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-09-05T01:42:22.703 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 0, 2024-09-05T01:42:22.703 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 0, 2024-09-05T01:42:22.703 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-09-05T01:42:22.703 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.703 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.703 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.703 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:22.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:22.703 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle-0x55938a5aab40": { 2024-09-05T01:42:22.703 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-09-05T01:42:22.703 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-09-05T01:42:22.703 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-09-05T01:42:22.704 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-09-05T01:42:22.704 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-09-05T01:42:22.704 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:22.704 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:22.704 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-09-05T01:42:22.704 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-09-05T01:42:22.704 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 0, 2024-09-05T01:42:22.704 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 0, 2024-09-05T01:42:22.704 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-09-05T01:42:22.704 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:22.704 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:22.704 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:22.704 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:22.705 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:22.705 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-05T01:42:23.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:23 smithi145 ceph-mon[34376]: pgmap v555: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-05T01:42:23.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:23 smithi151 ceph-mon[35013]: pgmap v555: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-05T01:42:23.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:23 smithi012 ceph-mon[29942]: pgmap v555: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-05T01:42:24.634 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-05T01:42:24.634 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-05T01:42:24.634 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-09-05T01:42:24.634 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-05T01:42:24.635 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-05T01:42:24.635 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-09-05T01:42:24.635 DEBUG:tasks.check_counter:Getting stats from i 2024-09-05T01:42:24.635 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-05T01:42:25.082 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T01:42:25.540 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:25 smithi151 ceph-mon[35013]: pgmap v556: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-05T01:42:25.712 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-05T01:42:25.713 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T01:42:25.713 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 227162, 2024-09-05T01:42:25.713 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 310580, 2024-09-05T01:42:25.713 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 78158217, 2024-09-05T01:42:25.713 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 289688744, 2024-09-05T01:42:25.713 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 21, 2024-09-05T01:42:25.713 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 8, 2024-09-05T01:42:25.713 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 11.968622168, 2024-09-05T01:42:25.713 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 5.111361949, 2024-09-05T01:42:25.713 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 11.202593479, 2024-09-05T01:42:25.713 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 1.436600539, 2024-09-05T01:42:25.713 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:25.714 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 310572, 2024-09-05T01:42:25.714 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 27.855960804, 2024-09-05T01:42:25.714 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000089692 2024-09-05T01:42:25.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.714 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:25.714 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 334764, 2024-09-05T01:42:25.714 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.069244129, 2024-09-05T01:42:25.714 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000206 2024-09-05T01:42:25.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.714 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 1248, 2024-09-05T01:42:25.714 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 560032 2024-09-05T01:42:25.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.714 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T01:42:25.714 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 115474, 2024-09-05T01:42:25.715 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 94725, 2024-09-05T01:42:25.715 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 91261238, 2024-09-05T01:42:25.715 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 116373926, 2024-09-05T01:42:25.715 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 10, 2024-09-05T01:42:25.715 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 5, 2024-09-05T01:42:25.715 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 7.091120130, 2024-09-05T01:42:25.715 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 2.689581574, 2024-09-05T01:42:25.715 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 3.473019873, 2024-09-05T01:42:25.715 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 1.460948484, 2024-09-05T01:42:25.715 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:25.715 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 94729, 2024-09-05T01:42:25.715 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 6.548851714, 2024-09-05T01:42:25.715 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000069132 2024-09-05T01:42:25.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.716 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:25.716 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 110461, 2024-09-05T01:42:25.716 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.018934675, 2024-09-05T01:42:25.716 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000171 2024-09-05T01:42:25.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.716 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 2006640, 2024-09-05T01:42:25.716 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 220112 2024-09-05T01:42:25.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.716 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T01:42:25.716 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 100527, 2024-09-05T01:42:25.716 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 86888, 2024-09-05T01:42:25.716 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 80392710, 2024-09-05T01:42:25.717 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 129924047, 2024-09-05T01:42:25.717 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 29, 2024-09-05T01:42:25.717 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 5, 2024-09-05T01:42:25.717 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 6.981851615, 2024-09-05T01:42:25.717 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 3.097113673, 2024-09-05T01:42:25.717 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 2.908441753, 2024-09-05T01:42:25.717 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 1.376374254, 2024-09-05T01:42:25.717 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:25.717 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 86887, 2024-09-05T01:42:25.717 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 4.782267297, 2024-09-05T01:42:25.717 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000055040 2024-09-05T01:42:25.717 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.718 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:25.718 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 108253, 2024-09-05T01:42:25.718 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.017883355, 2024-09-05T01:42:25.718 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000165 2024-09-05T01:42:25.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.718 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-05T01:42:25.718 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 128944 2024-09-05T01:42:25.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.718 INFO:teuthology.orchestra.run.smithi151.stdout: "cct": { 2024-09-05T01:42:25.718 INFO:teuthology.orchestra.run.smithi151.stdout: "total_workers": 1, 2024-09-05T01:42:25.718 INFO:teuthology.orchestra.run.smithi151.stdout: "unhealthy_workers": 0 2024-09-05T01:42:25.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.718 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-MDSRank": { 2024-09-05T01:42:25.719 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-09-05T01:42:25.719 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-09-05T01:42:25.719 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 69886, 2024-09-05T01:42:25.719 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 78.634008130, 2024-09-05T01:42:25.719 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001125175 2024-09-05T01:42:25.719 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:25.719 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.719 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-PurgeQueue": { 2024-09-05T01:42:25.719 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-09-05T01:42:25.719 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-09-05T01:42:25.719 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 21811, 2024-09-05T01:42:25.719 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 2.900604591, 2024-09-05T01:42:25.719 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000132988 2024-09-05T01:42:25.720 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:25.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.720 INFO:teuthology.orchestra.run.smithi151.stdout: "mds": { 2024-09-05T01:42:25.720 INFO:teuthology.orchestra.run.smithi151.stdout: "request": 72866, 2024-09-05T01:42:25.720 INFO:teuthology.orchestra.run.smithi151.stdout: "reply": 71001, 2024-09-05T01:42:25.720 INFO:teuthology.orchestra.run.smithi151.stdout: "reply_latency": { 2024-09-05T01:42:25.720 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 71001, 2024-09-05T01:42:25.720 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 1331.892489964, 2024-09-05T01:42:25.720 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.018758784 2024-09-05T01:42:25.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.720 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_reply": 0, 2024-09-05T01:42:25.720 INFO:teuthology.orchestra.run.smithi151.stdout: "forward": 1859, 2024-09-05T01:42:25.720 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_complete": 105, 2024-09-05T01:42:25.721 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_keys": 0, 2024-09-05T01:42:25.721 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_commit": 874, 2024-09-05T01:42:25.721 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_split": 96, 2024-09-05T01:42:25.721 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_merge": 3, 2024-09-05T01:42:25.721 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes": 29528, 2024-09-05T01:42:25.721 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_top": 304, 2024-09-05T01:42:25.721 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_bottom": 131, 2024-09-05T01:42:25.721 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pin_tail": 29093, 2024-09-05T01:42:25.721 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pinned": 29093, 2024-09-05T01:42:25.721 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_expired": 79672, 2024-09-05T01:42:25.721 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_with_caps": 0, 2024-09-05T01:42:25.721 INFO:teuthology.orchestra.run.smithi151.stdout: "caps": 0, 2024-09-05T01:42:25.721 INFO:teuthology.orchestra.run.smithi151.stdout: "subtrees": 2, 2024-09-05T01:42:25.722 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse": 132667, 2024-09-05T01:42:25.722 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_hit": 110387, 2024-09-05T01:42:25.722 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_forward": 1386, 2024-09-05T01:42:25.722 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_discover": 883, 2024-09-05T01:42:25.722 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_dir_fetch": 7, 2024-09-05T01:42:25.722 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_remote_ino": 0, 2024-09-05T01:42:25.722 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_lock": 166, 2024-09-05T01:42:25.722 INFO:teuthology.orchestra.run.smithi151.stdout: "load_cent": 0, 2024-09-05T01:42:25.722 INFO:teuthology.orchestra.run.smithi151.stdout: "q": 0, 2024-09-05T01:42:25.722 INFO:teuthology.orchestra.run.smithi151.stdout: "exported": 657, 2024-09-05T01:42:25.722 INFO:teuthology.orchestra.run.smithi151.stdout: "exported_inodes": 58698, 2024-09-05T01:42:25.722 INFO:teuthology.orchestra.run.smithi151.stdout: "imported": 513, 2024-09-05T01:42:25.722 INFO:teuthology.orchestra.run.smithi151.stdout: "imported_inodes": 62657, 2024-09-05T01:42:25.723 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_dir_fetch": 0, 2024-09-05T01:42:25.723 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_backtrace_fetch": 104467, 2024-09-05T01:42:25.723 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_peer_discover": 0, 2024-09-05T01:42:25.723 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rfiles": 6751, 2024-09-05T01:42:25.723 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rbytes": 158779880, 2024-09-05T01:42:25.723 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rsnaps": 6, 2024-09-05T01:42:25.723 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_fetch": 104467, 2024-09-05T01:42:25.723 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_set_tag": 0, 2024-09-05T01:42:25.723 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T01:42:25.723 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_inotable_repaired": 0, 2024-09-05T01:42:25.723 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_inodes": 630, 2024-09-05T01:42:25.723 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_base_inodes": 0, 2024-09-05T01:42:25.723 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dirfrag_rstats": 630, 2024-09-05T01:42:25.723 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_file_inodes": 103837, 2024-09-05T01:42:25.724 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_inode_file_caps": 350, 2024-09-05T01:42:25.724 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_revoke": 14829, 2024-09-05T01:42:25.724 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_grant": 23654, 2024-09-05T01:42:25.724 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_trunc": 0, 2024-09-05T01:42:25.724 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T01:42:25.724 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T01:42:25.724 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps": 47664, 2024-09-05T01:42:25.724 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps_dirty": 19628, 2024-09-05T01:42:25.724 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_cap_release": 499, 2024-09-05T01:42:25.724 INFO:teuthology.orchestra.run.smithi151.stdout: "process_request_cap_release": 30167 2024-09-05T01:42:25.724 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.724 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_cache": { 2024-09-05T01:42:25.724 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update": 0, 2024-09-05T01:42:25.725 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update_receipt": 3, 2024-09-05T01:42:25.725 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_try_discover": 2, 2024-09-05T01:42:25.725 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_send_discover": 1079, 2024-09-05T01:42:25.725 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_handle_discover": 1094, 2024-09-05T01:42:25.725 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays": 87, 2024-09-05T01:42:25.725 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_delayed": 0, 2024-09-05T01:42:25.725 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_enqueuing": 0, 2024-09-05T01:42:25.725 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_created": 11133, 2024-09-05T01:42:25.725 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_enqueued": 11046, 2024-09-05T01:42:25.725 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_reintegrated": 0, 2024-09-05T01:42:25.725 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_migrated": 0, 2024-09-05T01:42:25.725 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_processing": 0, 2024-09-05T01:42:25.725 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_enqueued": 0, 2024-09-05T01:42:25.725 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_prioritized": 0, 2024-09-05T01:42:25.726 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_started": 0, 2024-09-05T01:42:25.726 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_completed": 0, 2024-09-05T01:42:25.726 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_path": 0, 2024-09-05T01:42:25.726 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_inode": 0, 2024-09-05T01:42:25.726 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_enqueue_scrub": 0, 2024-09-05T01:42:25.726 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_exportdir": 657, 2024-09-05T01:42:25.726 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_flush": 0, 2024-09-05T01:42:25.726 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragmentdir": 100, 2024-09-05T01:42:25.726 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragstats": 0, 2024-09-05T01:42:25.726 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_inodestats": 0 2024-09-05T01:42:25.726 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.726 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_log": { 2024-09-05T01:42:25.726 INFO:teuthology.orchestra.run.smithi151.stdout: "evlrg": 3, 2024-09-05T01:42:25.727 INFO:teuthology.orchestra.run.smithi151.stdout: "evadd": 91082, 2024-09-05T01:42:25.727 INFO:teuthology.orchestra.run.smithi151.stdout: "evex": 0, 2024-09-05T01:42:25.727 INFO:teuthology.orchestra.run.smithi151.stdout: "evtrm": 0, 2024-09-05T01:42:25.727 INFO:teuthology.orchestra.run.smithi151.stdout: "ev": 91082, 2024-09-05T01:42:25.727 INFO:teuthology.orchestra.run.smithi151.stdout: "evexg": 0, 2024-09-05T01:42:25.727 INFO:teuthology.orchestra.run.smithi151.stdout: "evexd": 0, 2024-09-05T01:42:25.727 INFO:teuthology.orchestra.run.smithi151.stdout: "segadd": 128, 2024-09-05T01:42:25.727 INFO:teuthology.orchestra.run.smithi151.stdout: "segex": 0, 2024-09-05T01:42:25.727 INFO:teuthology.orchestra.run.smithi151.stdout: "segtrm": 0, 2024-09-05T01:42:25.727 INFO:teuthology.orchestra.run.smithi151.stdout: "seg": 128, 2024-09-05T01:42:25.727 INFO:teuthology.orchestra.run.smithi151.stdout: "segmjr": 9, 2024-09-05T01:42:25.727 INFO:teuthology.orchestra.run.smithi151.stdout: "segexg": 0, 2024-09-05T01:42:25.727 INFO:teuthology.orchestra.run.smithi151.stdout: "segexd": 0, 2024-09-05T01:42:25.727 INFO:teuthology.orchestra.run.smithi151.stdout: "expos": 4194304, 2024-09-05T01:42:25.727 INFO:teuthology.orchestra.run.smithi151.stdout: "wrpos": 312106947, 2024-09-05T01:42:25.728 INFO:teuthology.orchestra.run.smithi151.stdout: "rdpos": 0, 2024-09-05T01:42:25.728 INFO:teuthology.orchestra.run.smithi151.stdout: "jlat": { 2024-09-05T01:42:25.728 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 3287, 2024-09-05T01:42:25.728 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 152.968544946, 2024-09-05T01:42:25.728 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.046537433 2024-09-05T01:42:25.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.728 INFO:teuthology.orchestra.run.smithi151.stdout: "replayed": 0 2024-09-05T01:42:25.728 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.728 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_mem": { 2024-09-05T01:42:25.728 INFO:teuthology.orchestra.run.smithi151.stdout: "ino": 14569, 2024-09-05T01:42:25.728 INFO:teuthology.orchestra.run.smithi151.stdout: "ino+": 67277, 2024-09-05T01:42:25.728 INFO:teuthology.orchestra.run.smithi151.stdout: "ino-": 52708, 2024-09-05T01:42:25.728 INFO:teuthology.orchestra.run.smithi151.stdout: "dir": 585, 2024-09-05T01:42:25.729 INFO:teuthology.orchestra.run.smithi151.stdout: "dir+": 2151, 2024-09-05T01:42:25.729 INFO:teuthology.orchestra.run.smithi151.stdout: "dir-": 1566, 2024-09-05T01:42:25.729 INFO:teuthology.orchestra.run.smithi151.stdout: "dn": 29528, 2024-09-05T01:42:25.729 INFO:teuthology.orchestra.run.smithi151.stdout: "dn+": 121220, 2024-09-05T01:42:25.729 INFO:teuthology.orchestra.run.smithi151.stdout: "dn-": 91692, 2024-09-05T01:42:25.729 INFO:teuthology.orchestra.run.smithi151.stdout: "cap": 0, 2024-09-05T01:42:25.729 INFO:teuthology.orchestra.run.smithi151.stdout: "cap+": 38707, 2024-09-05T01:42:25.729 INFO:teuthology.orchestra.run.smithi151.stdout: "cap-": 38707, 2024-09-05T01:42:25.729 INFO:teuthology.orchestra.run.smithi151.stdout: "rss": 242228, 2024-09-05T01:42:25.729 INFO:teuthology.orchestra.run.smithi151.stdout: "heap": 223520 2024-09-05T01:42:25.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.729 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_server": { 2024-09-05T01:42:25.729 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_client_request": 85592, 2024-09-05T01:42:25.730 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_server_request": 7702, 2024-09-05T01:42:25.730 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_request": 72866, 2024-09-05T01:42:25.730 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_session": 482, 2024-09-05T01:42:25.730 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_peer_request": 18747, 2024-09-05T01:42:25.730 INFO:teuthology.orchestra.run.smithi151.stdout: "req_create_latency": { 2024-09-05T01:42:25.730 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 10739, 2024-09-05T01:42:25.730 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 60.583511400, 2024-09-05T01:42:25.730 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.005641448 2024-09-05T01:42:25.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.730 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getattr_latency": { 2024-09-05T01:42:25.730 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 351, 2024-09-05T01:42:25.730 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 4.157650947, 2024-09-05T01:42:25.730 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.011845159 2024-09-05T01:42:25.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.731 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getfilelock_latency": { 2024-09-05T01:42:25.731 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.731 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.731 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.731 INFO:teuthology.orchestra.run.smithi151.stdout: "req_link_latency": { 2024-09-05T01:42:25.731 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.731 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.731 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.731 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.731 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookup_latency": { 2024-09-05T01:42:25.731 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 35387, 2024-09-05T01:42:25.731 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 938.484714403, 2024-09-05T01:42:25.731 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.026520606 2024-09-05T01:42:25.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.732 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookuphash_latency": { 2024-09-05T01:42:25.732 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.732 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.732 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.732 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupino_latency": { 2024-09-05T01:42:25.732 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.732 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.732 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.732 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupname_latency": { 2024-09-05T01:42:25.732 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.733 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.733 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.733 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupparent_latency": { 2024-09-05T01:42:25.733 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.733 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.733 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.733 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupsnap_latency": { 2024-09-05T01:42:25.734 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.734 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.734 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.734 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lssnap_latency": { 2024-09-05T01:42:25.734 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.734 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.734 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.735 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mkdir_latency": { 2024-09-05T01:42:25.735 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 55, 2024-09-05T01:42:25.735 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.876028294, 2024-09-05T01:42:25.735 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.015927787 2024-09-05T01:42:25.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.735 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mknod_latency": { 2024-09-05T01:42:25.735 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.735 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.735 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.735 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mksnap_latency": { 2024-09-05T01:42:25.735 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.735 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.735 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.736 INFO:teuthology.orchestra.run.smithi151.stdout: "req_open_latency": { 2024-09-05T01:42:25.736 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 3623, 2024-09-05T01:42:25.736 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 42.119023155, 2024-09-05T01:42:25.736 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.011625454 2024-09-05T01:42:25.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.736 INFO:teuthology.orchestra.run.smithi151.stdout: "req_readdir_latency": { 2024-09-05T01:42:25.736 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 522, 2024-09-05T01:42:25.736 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.929764259, 2024-09-05T01:42:25.736 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001781157 2024-09-05T01:42:25.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.736 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rename_latency": { 2024-09-05T01:42:25.736 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 10718, 2024-09-05T01:42:25.736 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 256.484766948, 2024-09-05T01:42:25.737 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.023930282 2024-09-05T01:42:25.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.737 INFO:teuthology.orchestra.run.smithi151.stdout: "req_renamesnap_latency": { 2024-09-05T01:42:25.737 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.737 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.737 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.737 INFO:teuthology.orchestra.run.smithi151.stdout: "req_snapdiff_latency": { 2024-09-05T01:42:25.737 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.737 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.737 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.738 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmdir_latency": { 2024-09-05T01:42:25.738 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 87, 2024-09-05T01:42:25.738 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 9.053065869, 2024-09-05T01:42:25.738 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.104058228 2024-09-05T01:42:25.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.738 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmsnap_latency": { 2024-09-05T01:42:25.738 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.738 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.738 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.738 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmxattr_latency": { 2024-09-05T01:42:25.738 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.738 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.738 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.739 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setattr_latency": { 2024-09-05T01:42:25.739 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.739 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.739 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.739 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setdirlayout_latency": { 2024-09-05T01:42:25.739 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.739 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.739 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.739 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setfilelock_latency": { 2024-09-05T01:42:25.739 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.739 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.740 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.740 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setlayout_latency": { 2024-09-05T01:42:25.740 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.740 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.740 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.740 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setxattr_latency": { 2024-09-05T01:42:25.740 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.740 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.740 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.740 INFO:teuthology.orchestra.run.smithi151.stdout: "req_symlink_latency": { 2024-09-05T01:42:25.741 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.741 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.741 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.741 INFO:teuthology.orchestra.run.smithi151.stdout: "req_unlink_latency": { 2024-09-05T01:42:25.741 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 9519, 2024-09-05T01:42:25.741 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 19.203964689, 2024-09-05T01:42:25.741 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.002017435 2024-09-05T01:42:25.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.741 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_revoke_eviction": 0, 2024-09-05T01:42:25.741 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_acquisition_throttle": 0, 2024-09-05T01:42:25.741 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getvxattr_latency": { 2024-09-05T01:42:25.741 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.742 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.742 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.742 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:25.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.742 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_sessions": { 2024-09-05T01:42:25.742 INFO:teuthology.orchestra.run.smithi151.stdout: "session_count": 1, 2024-09-05T01:42:25.742 INFO:teuthology.orchestra.run.smithi151.stdout: "session_add": 2, 2024-09-05T01:42:25.742 INFO:teuthology.orchestra.run.smithi151.stdout: "session_remove": 1, 2024-09-05T01:42:25.742 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_open": 1, 2024-09-05T01:42:25.742 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_stale": 0, 2024-09-05T01:42:25.742 INFO:teuthology.orchestra.run.smithi151.stdout: "total_load": 1804, 2024-09-05T01:42:25.742 INFO:teuthology.orchestra.run.smithi151.stdout: "average_load": 1804, 2024-09-05T01:42:25.742 INFO:teuthology.orchestra.run.smithi151.stdout: "avg_session_uptime": 949, 2024-09-05T01:42:25.743 INFO:teuthology.orchestra.run.smithi151.stdout: "mdthresh_evicted": 0 2024-09-05T01:42:25.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.743 INFO:teuthology.orchestra.run.smithi151.stdout: "mempool": { 2024-09-05T01:42:25.743 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_bytes": 0, 2024-09-05T01:42:25.743 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_items": 0, 2024-09-05T01:42:25.743 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T01:42:25.743 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_items": 0, 2024-09-05T01:42:25.743 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T01:42:25.743 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_items": 0, 2024-09-05T01:42:25.743 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T01:42:25.743 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T01:42:25.743 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T01:42:25.744 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T01:42:25.744 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T01:42:25.744 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_items": 0, 2024-09-05T01:42:25.744 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T01:42:25.744 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T01:42:25.744 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_bytes": 0, 2024-09-05T01:42:25.744 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_items": 0, 2024-09-05T01:42:25.744 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_bytes": 0, 2024-09-05T01:42:25.744 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_items": 0, 2024-09-05T01:42:25.744 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T01:42:25.744 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T01:42:25.744 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T01:42:25.744 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T01:42:25.745 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T01:42:25.745 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_items": 0, 2024-09-05T01:42:25.745 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_bytes": 0, 2024-09-05T01:42:25.745 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_items": 0, 2024-09-05T01:42:25.745 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T01:42:25.745 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T01:42:25.745 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_bytes": 0, 2024-09-05T01:42:25.745 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_items": 0, 2024-09-05T01:42:25.745 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_bytes": 0, 2024-09-05T01:42:25.745 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_items": 0, 2024-09-05T01:42:25.745 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T01:42:25.745 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_items": 0, 2024-09-05T01:42:25.745 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T01:42:25.745 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_items": 0, 2024-09-05T01:42:25.746 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_bytes": 1512185, 2024-09-05T01:42:25.746 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_items": 13867, 2024-09-05T01:42:25.746 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_bytes": 88, 2024-09-05T01:42:25.746 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_items": 1, 2024-09-05T01:42:25.746 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_bytes": 0, 2024-09-05T01:42:25.746 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_items": 0, 2024-09-05T01:42:25.746 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_bytes": 0, 2024-09-05T01:42:25.746 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_items": 0, 2024-09-05T01:42:25.746 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_bytes": 0, 2024-09-05T01:42:25.746 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_items": 0, 2024-09-05T01:42:25.746 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_bytes": 8512, 2024-09-05T01:42:25.746 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_items": 191, 2024-09-05T01:42:25.746 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T01:42:25.747 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_items": 0, 2024-09-05T01:42:25.747 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_bytes": 0, 2024-09-05T01:42:25.747 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_items": 0, 2024-09-05T01:42:25.747 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_bytes": 55830925, 2024-09-05T01:42:25.747 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_items": 582728, 2024-09-05T01:42:25.747 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_bytes": 0, 2024-09-05T01:42:25.747 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_items": 0, 2024-09-05T01:42:25.747 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_bytes": 0, 2024-09-05T01:42:25.747 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_items": 0 2024-09-05T01:42:25.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.747 INFO:teuthology.orchestra.run.smithi151.stdout: "objecter": { 2024-09-05T01:42:25.747 INFO:teuthology.orchestra.run.smithi151.stdout: "op_active": 0, 2024-09-05T01:42:25.747 INFO:teuthology.orchestra.run.smithi151.stdout: "op_laggy": 0, 2024-09-05T01:42:25.747 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send": 121874, 2024-09-05T01:42:25.748 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send_bytes": 328972629, 2024-09-05T01:42:25.748 INFO:teuthology.orchestra.run.smithi151.stdout: "op_resend": 33, 2024-09-05T01:42:25.748 INFO:teuthology.orchestra.run.smithi151.stdout: "op_reply": 121874, 2024-09-05T01:42:25.748 INFO:teuthology.orchestra.run.smithi151.stdout: "op_latency": { 2024-09-05T01:42:25.748 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 121874, 2024-09-05T01:42:25.748 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 521.392055595, 2024-09-05T01:42:25.748 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.004278123 2024-09-05T01:42:25.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.748 INFO:teuthology.orchestra.run.smithi151.stdout: "op_inflight": 0, 2024-09-05T01:42:25.748 INFO:teuthology.orchestra.run.smithi151.stdout: "oplen_avg": { 2024-09-05T01:42:25.748 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 121874, 2024-09-05T01:42:25.748 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 123625 2024-09-05T01:42:25.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.749 INFO:teuthology.orchestra.run.smithi151.stdout: "op": 121874, 2024-09-05T01:42:25.749 INFO:teuthology.orchestra.run.smithi151.stdout: "op_r": 105130, 2024-09-05T01:42:25.749 INFO:teuthology.orchestra.run.smithi151.stdout: "op_w": 16744, 2024-09-05T01:42:25.749 INFO:teuthology.orchestra.run.smithi151.stdout: "op_rmw": 0, 2024-09-05T01:42:25.749 INFO:teuthology.orchestra.run.smithi151.stdout: "op_pg": 0, 2024-09-05T01:42:25.749 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_stat": 0, 2024-09-05T01:42:25.749 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_create": 10, 2024-09-05T01:42:25.749 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_read": 558, 2024-09-05T01:42:25.749 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_write": 3846, 2024-09-05T01:42:25.749 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writefull": 332, 2024-09-05T01:42:25.749 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writesame": 0, 2024-09-05T01:42:25.749 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_append": 0, 2024-09-05T01:42:25.750 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_zero": 0, 2024-09-05T01:42:25.750 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_truncate": 95, 2024-09-05T01:42:25.750 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_delete": 11156, 2024-09-05T01:42:25.750 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_mapext": 0, 2024-09-05T01:42:25.750 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_sparse_read": 0, 2024-09-05T01:42:25.750 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_clonerange": 0, 2024-09-05T01:42:25.750 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_getxattr": 104470, 2024-09-05T01:42:25.750 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_setxattr": 20, 2024-09-05T01:42:25.750 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_cmpxattr": 0, 2024-09-05T01:42:25.750 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_rmxattr": 0, 2024-09-05T01:42:25.750 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_resetxattrs": 0, 2024-09-05T01:42:25.750 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_call": 0, 2024-09-05T01:42:25.750 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_watch": 0, 2024-09-05T01:42:25.751 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_notify": 0, 2024-09-05T01:42:25.751 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T01:42:25.751 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls": 0, 2024-09-05T01:42:25.751 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls_filter": 0, 2024-09-05T01:42:25.751 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_other": 0, 2024-09-05T01:42:25.751 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_active": 0, 2024-09-05T01:42:25.751 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_send": 0, 2024-09-05T01:42:25.751 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_resend": 0, 2024-09-05T01:42:25.751 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_ping": 0, 2024-09-05T01:42:25.751 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_active": 0, 2024-09-05T01:42:25.751 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_send": 0, 2024-09-05T01:42:25.751 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_resend": 0, 2024-09-05T01:42:25.751 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_active": 0, 2024-09-05T01:42:25.751 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_send": 0, 2024-09-05T01:42:25.752 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_resend": 0, 2024-09-05T01:42:25.752 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_active": 0, 2024-09-05T01:42:25.752 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_send": 0, 2024-09-05T01:42:25.752 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_resend": 0, 2024-09-05T01:42:25.752 INFO:teuthology.orchestra.run.smithi151.stdout: "command_active": 0, 2024-09-05T01:42:25.752 INFO:teuthology.orchestra.run.smithi151.stdout: "command_send": 0, 2024-09-05T01:42:25.752 INFO:teuthology.orchestra.run.smithi151.stdout: "command_resend": 0, 2024-09-05T01:42:25.752 INFO:teuthology.orchestra.run.smithi151.stdout: "map_epoch": 108, 2024-09-05T01:42:25.752 INFO:teuthology.orchestra.run.smithi151.stdout: "map_full": 0, 2024-09-05T01:42:25.752 INFO:teuthology.orchestra.run.smithi151.stdout: "map_inc": 27, 2024-09-05T01:42:25.752 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_sessions": 12, 2024-09-05T01:42:25.752 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_open": 12, 2024-09-05T01:42:25.752 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_close": 0, 2024-09-05T01:42:25.753 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_laggy": 0, 2024-09-05T01:42:25.753 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_wr": 2551, 2024-09-05T01:42:25.753 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_rd": 210, 2024-09-05T01:42:25.753 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_del": 377 2024-09-05T01:42:25.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.753 INFO:teuthology.orchestra.run.smithi151.stdout: "oft": { 2024-09-05T01:42:25.753 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_objs": 1, 2024-09-05T01:42:25.753 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_kv_pairs": 0, 2024-09-05T01:42:25.753 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_updates": 0, 2024-09-05T01:42:25.753 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_removes": 0 2024-09-05T01:42:25.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.753 INFO:teuthology.orchestra.run.smithi151.stdout: "osd-slow-ops": { 2024-09-05T01:42:25.753 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_ops_count": 8 2024-09-05T01:42:25.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.754 INFO:teuthology.orchestra.run.smithi151.stdout: "purge_queue": { 2024-09-05T01:42:25.754 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops": 0, 2024-09-05T01:42:25.754 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops_high_water": 6, 2024-09-05T01:42:25.754 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing": 0, 2024-09-05T01:42:25.754 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_high_water": 6, 2024-09-05T01:42:25.754 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed_ops": 11046, 2024-09-05T01:42:25.754 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed": 11046, 2024-09-05T01:42:25.754 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_item_in_journal": 0 2024-09-05T01:42:25.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.754 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T01:42:25.754 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-09-05T01:42:25.754 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-09-05T01:42:25.754 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-09-05T01:42:25.755 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 443159, 2024-09-05T01:42:25.755 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 209901014, 2024-09-05T01:42:25.755 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:25.755 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 443159, 2024-09-05T01:42:25.755 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-09-05T01:42:25.755 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-09-05T01:42:25.755 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 443159, 2024-09-05T01:42:25.755 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 209901014, 2024-09-05T01:42:25.755 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-09-05T01:42:25.755 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.755 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.755 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.755 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:25.756 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.756 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_bytes": { 2024-09-05T01:42:25.756 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-09-05T01:42:25.756 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-09-05T01:42:25.756 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-09-05T01:42:25.756 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-09-05T01:42:25.756 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-09-05T01:42:25.756 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:25.756 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:25.756 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 121874, 2024-09-05T01:42:25.756 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 330512963, 2024-09-05T01:42:25.756 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 121874, 2024-09-05T01:42:25.756 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 330512963, 2024-09-05T01:42:25.757 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-09-05T01:42:25.757 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.757 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.757 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.757 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:25.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.757 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_ops": { 2024-09-05T01:42:25.757 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-09-05T01:42:25.757 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 1024, 2024-09-05T01:42:25.757 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-09-05T01:42:25.757 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-09-05T01:42:25.757 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-09-05T01:42:25.757 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:25.757 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:25.758 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 121874, 2024-09-05T01:42:25.758 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 121874, 2024-09-05T01:42:25.758 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 121874, 2024-09-05T01:42:25.758 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 121874, 2024-09-05T01:42:25.758 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-09-05T01:42:25.758 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.758 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.758 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.758 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:25.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.758 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle": { 2024-09-05T01:42:25.758 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-09-05T01:42:25.758 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-09-05T01:42:25.758 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-09-05T01:42:25.759 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 11046, 2024-09-05T01:42:25.759 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 1542014, 2024-09-05T01:42:25.759 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:25.759 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 11046, 2024-09-05T01:42:25.759 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-09-05T01:42:25.759 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-09-05T01:42:25.759 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 558, 2024-09-05T01:42:25.759 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 1542014, 2024-09-05T01:42:25.759 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-09-05T01:42:25.759 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.759 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.759 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.759 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:25.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:25.760 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle-0x556d72f6a960": { 2024-09-05T01:42:25.760 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-09-05T01:42:25.760 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-09-05T01:42:25.760 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-09-05T01:42:25.760 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 91082, 2024-09-05T01:42:25.760 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 307912643, 2024-09-05T01:42:25.760 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:25.760 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 91082, 2024-09-05T01:42:25.760 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-09-05T01:42:25.760 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-09-05T01:42:25.760 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 3287, 2024-09-05T01:42:25.760 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 307912643, 2024-09-05T01:42:25.760 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-09-05T01:42:25.761 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:25.761 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:25.761 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:25.761 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:25.761 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:25.761 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-05T01:42:25.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:25 smithi012 ceph-mon[29942]: pgmap v556: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-05T01:42:25.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:25 smithi145 ceph-mon[34376]: pgmap v556: 97 pgs: 40 active+clean+snaptrim_wait, 24 active+clean+snaptrim, 33 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-05T01:42:26.517 INFO:tasks.check_counter:Daemon mds.i mds.exported=657 2024-09-05T01:42:26.517 INFO:tasks.check_counter:Daemon mds.i mds.imported=513 2024-09-05T01:42:26.517 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-05T01:42:26.517 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-05T01:42:26.518 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-05T01:42:26.518 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=96 2024-09-05T01:42:26.518 DEBUG:tasks.check_counter:Getting stats from l 2024-09-05T01:42:26.518 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-05T01:42:26.963 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.c/config 2024-09-05T01:42:27.348 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:27 smithi145 ceph-mon[34376]: pgmap v557: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 13 op/s 2024-09-05T01:42:27.615 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:27 smithi012 ceph-mon[29942]: pgmap v557: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 13 op/s 2024-09-05T01:42:27.623 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:27 smithi151 ceph-mon[35013]: pgmap v557: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 85 B/s wr, 13 op/s 2024-09-05T01:42:27.624 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-09-05T01:42:27.624 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-0": { 2024-09-05T01:42:27.624 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 91715, 2024-09-05T01:42:27.624 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 77221, 2024-09-05T01:42:27.624 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 53228233, 2024-09-05T01:42:27.624 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 132459997, 2024-09-05T01:42:27.624 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 32, 2024-09-05T01:42:27.624 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 4, 2024-09-05T01:42:27.624 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 6.465683470, 2024-09-05T01:42:27.624 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 2.050153873, 2024-09-05T01:42:27.624 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 2.446214216, 2024-09-05T01:42:27.625 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 2.053960211, 2024-09-05T01:42:27.625 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:27.625 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 77220, 2024-09-05T01:42:27.625 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 7.247889672, 2024-09-05T01:42:27.625 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000093860 2024-09-05T01:42:27.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.625 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:27.625 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 74967, 2024-09-05T01:42:27.625 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.011679112, 2024-09-05T01:42:27.625 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000155 2024-09-05T01:42:27.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.625 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 1988816, 2024-09-05T01:42:27.626 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 276032 2024-09-05T01:42:27.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.626 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-1": { 2024-09-05T01:42:27.626 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 270451, 2024-09-05T01:42:27.626 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 388302, 2024-09-05T01:42:27.626 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 98311871, 2024-09-05T01:42:27.626 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 336948116, 2024-09-05T01:42:27.626 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 17, 2024-09-05T01:42:27.626 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 5, 2024-09-05T01:42:27.626 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 16.123489543, 2024-09-05T01:42:27.626 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 6.795027537, 2024-09-05T01:42:27.626 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 27.199903078, 2024-09-05T01:42:27.626 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 1.898657731, 2024-09-05T01:42:27.626 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:27.627 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 388300, 2024-09-05T01:42:27.627 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 31.525265611, 2024-09-05T01:42:27.627 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000081187 2024-09-05T01:42:27.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.627 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:27.627 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 435276, 2024-09-05T01:42:27.627 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.081511183, 2024-09-05T01:42:27.627 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000187 2024-09-05T01:42:27.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.627 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 5168, 2024-09-05T01:42:27.627 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 603328 2024-09-05T01:42:27.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.627 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-2": { 2024-09-05T01:42:27.628 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 65103, 2024-09-05T01:42:27.628 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 63364, 2024-09-05T01:42:27.628 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 20960480, 2024-09-05T01:42:27.628 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 230414818, 2024-09-05T01:42:27.628 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 12, 2024-09-05T01:42:27.628 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 6, 2024-09-05T01:42:27.628 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 6.571339835, 2024-09-05T01:42:27.628 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 2.927404003, 2024-09-05T01:42:27.628 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 1.191801461, 2024-09-05T01:42:27.628 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 2.072220294, 2024-09-05T01:42:27.628 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-09-05T01:42:27.628 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 63362, 2024-09-05T01:42:27.628 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 6.807041353, 2024-09-05T01:42:27.629 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000107430 2024-09-05T01:42:27.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.629 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-09-05T01:42:27.629 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 9013, 2024-09-05T01:42:27.629 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.001405268, 2024-09-05T01:42:27.629 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000155 2024-09-05T01:42:27.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.629 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 3936, 2024-09-05T01:42:27.629 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 20672 2024-09-05T01:42:27.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.629 INFO:teuthology.orchestra.run.smithi151.stdout: "cct": { 2024-09-05T01:42:27.629 INFO:teuthology.orchestra.run.smithi151.stdout: "total_workers": 1, 2024-09-05T01:42:27.629 INFO:teuthology.orchestra.run.smithi151.stdout: "unhealthy_workers": 0 2024-09-05T01:42:27.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.630 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-MDSRank": { 2024-09-05T01:42:27.630 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-09-05T01:42:27.630 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-09-05T01:42:27.630 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 103313, 2024-09-05T01:42:27.630 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 105.485241550, 2024-09-05T01:42:27.630 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001021025 2024-09-05T01:42:27.630 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:27.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.630 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-PurgeQueue": { 2024-09-05T01:42:27.630 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-09-05T01:42:27.630 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-09-05T01:42:27.630 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 29820, 2024-09-05T01:42:27.630 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 5.922286817, 2024-09-05T01:42:27.631 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000198601 2024-09-05T01:42:27.631 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:27.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.631 INFO:teuthology.orchestra.run.smithi151.stdout: "mds": { 2024-09-05T01:42:27.631 INFO:teuthology.orchestra.run.smithi151.stdout: "request": 84435, 2024-09-05T01:42:27.631 INFO:teuthology.orchestra.run.smithi151.stdout: "reply": 82661, 2024-09-05T01:42:27.631 INFO:teuthology.orchestra.run.smithi151.stdout: "reply_latency": { 2024-09-05T01:42:27.631 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 82661, 2024-09-05T01:42:27.631 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 660.309398675, 2024-09-05T01:42:27.631 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.007988161 2024-09-05T01:42:27.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.631 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_reply": 0, 2024-09-05T01:42:27.631 INFO:teuthology.orchestra.run.smithi151.stdout: "forward": 1773, 2024-09-05T01:42:27.631 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_complete": 221, 2024-09-05T01:42:27.632 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_keys": 0, 2024-09-05T01:42:27.632 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_commit": 1193, 2024-09-05T01:42:27.632 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_split": 115, 2024-09-05T01:42:27.632 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_merge": 0, 2024-09-05T01:42:27.632 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes": 29002, 2024-09-05T01:42:27.632 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_top": 985, 2024-09-05T01:42:27.632 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_bottom": 13834, 2024-09-05T01:42:27.632 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pin_tail": 14183, 2024-09-05T01:42:27.632 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pinned": 27588, 2024-09-05T01:42:27.632 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_expired": 70533, 2024-09-05T01:42:27.632 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_with_caps": 1, 2024-09-05T01:42:27.632 INFO:teuthology.orchestra.run.smithi151.stdout: "caps": 1, 2024-09-05T01:42:27.632 INFO:teuthology.orchestra.run.smithi151.stdout: "subtrees": 3, 2024-09-05T01:42:27.633 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse": 136896, 2024-09-05T01:42:27.633 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_hit": 120089, 2024-09-05T01:42:27.633 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_forward": 1625, 2024-09-05T01:42:27.633 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_discover": 903, 2024-09-05T01:42:27.633 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_dir_fetch": 6, 2024-09-05T01:42:27.633 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_remote_ino": 0, 2024-09-05T01:42:27.633 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_lock": 182, 2024-09-05T01:42:27.633 INFO:teuthology.orchestra.run.smithi151.stdout: "load_cent": 0, 2024-09-05T01:42:27.633 INFO:teuthology.orchestra.run.smithi151.stdout: "q": 0, 2024-09-05T01:42:27.633 INFO:teuthology.orchestra.run.smithi151.stdout: "exported": 511, 2024-09-05T01:42:27.633 INFO:teuthology.orchestra.run.smithi151.stdout: "exported_inodes": 53603, 2024-09-05T01:42:27.633 INFO:teuthology.orchestra.run.smithi151.stdout: "imported": 691, 2024-09-05T01:42:27.634 INFO:teuthology.orchestra.run.smithi151.stdout: "imported_inodes": 34492, 2024-09-05T01:42:27.634 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_dir_fetch": 0, 2024-09-05T01:42:27.634 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_backtrace_fetch": 134325, 2024-09-05T01:42:27.634 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_peer_discover": 0, 2024-09-05T01:42:27.634 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rfiles": 6751, 2024-09-05T01:42:27.634 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rbytes": 158779880, 2024-09-05T01:42:27.634 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rsnaps": 6, 2024-09-05T01:42:27.634 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_fetch": 134325, 2024-09-05T01:42:27.634 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_set_tag": 0, 2024-09-05T01:42:27.634 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_repaired": 0, 2024-09-05T01:42:27.634 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_inotable_repaired": 0, 2024-09-05T01:42:27.634 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_inodes": 1187, 2024-09-05T01:42:27.634 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_base_inodes": 0, 2024-09-05T01:42:27.634 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dirfrag_rstats": 1187, 2024-09-05T01:42:27.635 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_file_inodes": 133138, 2024-09-05T01:42:27.635 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_inode_file_caps": 196, 2024-09-05T01:42:27.635 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_revoke": 20047, 2024-09-05T01:42:27.635 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_grant": 39266, 2024-09-05T01:42:27.635 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_trunc": 0, 2024-09-05T01:42:27.635 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-05T01:42:27.635 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-05T01:42:27.635 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps": 62504, 2024-09-05T01:42:27.635 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps_dirty": 25919, 2024-09-05T01:42:27.635 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_cap_release": 651, 2024-09-05T01:42:27.635 INFO:teuthology.orchestra.run.smithi151.stdout: "process_request_cap_release": 43870 2024-09-05T01:42:27.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.635 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_cache": { 2024-09-05T01:42:27.635 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update": 0, 2024-09-05T01:42:27.635 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update_receipt": 5, 2024-09-05T01:42:27.636 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_try_discover": 3, 2024-09-05T01:42:27.636 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_send_discover": 1089, 2024-09-05T01:42:27.636 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_handle_discover": 848, 2024-09-05T01:42:27.636 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays": 94, 2024-09-05T01:42:27.636 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_delayed": 0, 2024-09-05T01:42:27.636 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_enqueuing": 0, 2024-09-05T01:42:27.636 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_created": 15479, 2024-09-05T01:42:27.636 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_enqueued": 15385, 2024-09-05T01:42:27.636 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_reintegrated": 0, 2024-09-05T01:42:27.636 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_migrated": 0, 2024-09-05T01:42:27.636 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_processing": 0, 2024-09-05T01:42:27.636 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_enqueued": 0, 2024-09-05T01:42:27.636 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_prioritized": 0, 2024-09-05T01:42:27.636 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_started": 0, 2024-09-05T01:42:27.637 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_completed": 0, 2024-09-05T01:42:27.637 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_path": 0, 2024-09-05T01:42:27.637 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_inode": 0, 2024-09-05T01:42:27.637 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_enqueue_scrub": 0, 2024-09-05T01:42:27.637 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_exportdir": 513, 2024-09-05T01:42:27.637 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_flush": 0, 2024-09-05T01:42:27.637 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragmentdir": 115, 2024-09-05T01:42:27.637 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragstats": 0, 2024-09-05T01:42:27.637 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_inodestats": 0 2024-09-05T01:42:27.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.637 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_log": { 2024-09-05T01:42:27.637 INFO:teuthology.orchestra.run.smithi151.stdout: "evlrg": 3, 2024-09-05T01:42:27.637 INFO:teuthology.orchestra.run.smithi151.stdout: "evadd": 127618, 2024-09-05T01:42:27.637 INFO:teuthology.orchestra.run.smithi151.stdout: "evex": 38950, 2024-09-05T01:42:27.637 INFO:teuthology.orchestra.run.smithi151.stdout: "evtrm": 36871, 2024-09-05T01:42:27.638 INFO:teuthology.orchestra.run.smithi151.stdout: "ev": 90747, 2024-09-05T01:42:27.638 INFO:teuthology.orchestra.run.smithi151.stdout: "evexg": 0, 2024-09-05T01:42:27.638 INFO:teuthology.orchestra.run.smithi151.stdout: "evexd": 2079, 2024-09-05T01:42:27.638 INFO:teuthology.orchestra.run.smithi151.stdout: "segadd": 179, 2024-09-05T01:42:27.638 INFO:teuthology.orchestra.run.smithi151.stdout: "segex": 51, 2024-09-05T01:42:27.638 INFO:teuthology.orchestra.run.smithi151.stdout: "segtrm": 48, 2024-09-05T01:42:27.638 INFO:teuthology.orchestra.run.smithi151.stdout: "seg": 131, 2024-09-05T01:42:27.638 INFO:teuthology.orchestra.run.smithi151.stdout: "segmjr": 8, 2024-09-05T01:42:27.638 INFO:teuthology.orchestra.run.smithi151.stdout: "segexg": 0, 2024-09-05T01:42:27.638 INFO:teuthology.orchestra.run.smithi151.stdout: "segexd": 3, 2024-09-05T01:42:27.638 INFO:teuthology.orchestra.run.smithi151.stdout: "expos": 97484773, 2024-09-05T01:42:27.638 INFO:teuthology.orchestra.run.smithi151.stdout: "wrpos": 433439367, 2024-09-05T01:42:27.638 INFO:teuthology.orchestra.run.smithi151.stdout: "rdpos": 0, 2024-09-05T01:42:27.638 INFO:teuthology.orchestra.run.smithi151.stdout: "jlat": { 2024-09-05T01:42:27.639 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 3462, 2024-09-05T01:42:27.639 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 172.881653318, 2024-09-05T01:42:27.639 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.049936930 2024-09-05T01:42:27.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.639 INFO:teuthology.orchestra.run.smithi151.stdout: "replayed": 0 2024-09-05T01:42:27.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.639 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_mem": { 2024-09-05T01:42:27.639 INFO:teuthology.orchestra.run.smithi151.stdout: "ino": 14557, 2024-09-05T01:42:27.639 INFO:teuthology.orchestra.run.smithi151.stdout: "ino+": 67994, 2024-09-05T01:42:27.639 INFO:teuthology.orchestra.run.smithi151.stdout: "ino-": 53437, 2024-09-05T01:42:27.639 INFO:teuthology.orchestra.run.smithi151.stdout: "dir": 618, 2024-09-05T01:42:27.639 INFO:teuthology.orchestra.run.smithi151.stdout: "dir+": 1795, 2024-09-05T01:42:27.639 INFO:teuthology.orchestra.run.smithi151.stdout: "dir-": 1177, 2024-09-05T01:42:27.639 INFO:teuthology.orchestra.run.smithi151.stdout: "dn": 29002, 2024-09-05T01:42:27.640 INFO:teuthology.orchestra.run.smithi151.stdout: "dn+": 117226, 2024-09-05T01:42:27.640 INFO:teuthology.orchestra.run.smithi151.stdout: "dn-": 88224, 2024-09-05T01:42:27.640 INFO:teuthology.orchestra.run.smithi151.stdout: "cap": 1, 2024-09-05T01:42:27.640 INFO:teuthology.orchestra.run.smithi151.stdout: "cap+": 40007, 2024-09-05T01:42:27.640 INFO:teuthology.orchestra.run.smithi151.stdout: "cap-": 40006, 2024-09-05T01:42:27.640 INFO:teuthology.orchestra.run.smithi151.stdout: "rss": 227664, 2024-09-05T01:42:27.640 INFO:teuthology.orchestra.run.smithi151.stdout: "heap": 223520 2024-09-05T01:42:27.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.640 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_server": { 2024-09-05T01:42:27.640 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_client_request": 99492, 2024-09-05T01:42:27.640 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_server_request": 5839, 2024-09-05T01:42:27.640 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_request": 84435, 2024-09-05T01:42:27.640 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_session": 569, 2024-09-05T01:42:27.640 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_peer_request": 13219, 2024-09-05T01:42:27.641 INFO:teuthology.orchestra.run.smithi151.stdout: "req_create_latency": { 2024-09-05T01:42:27.641 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 22053, 2024-09-05T01:42:27.641 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 59.282514280, 2024-09-05T01:42:27.641 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.002688183 2024-09-05T01:42:27.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.641 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getattr_latency": { 2024-09-05T01:42:27.641 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 36, 2024-09-05T01:42:27.641 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 2.939570405, 2024-09-05T01:42:27.641 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.081654733 2024-09-05T01:42:27.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.641 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getfilelock_latency": { 2024-09-05T01:42:27.641 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.641 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.641 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.642 INFO:teuthology.orchestra.run.smithi151.stdout: "req_link_latency": { 2024-09-05T01:42:27.642 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.642 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.642 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.642 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookup_latency": { 2024-09-05T01:42:27.642 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 17941, 2024-09-05T01:42:27.642 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 236.208840751, 2024-09-05T01:42:27.642 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.013165868 2024-09-05T01:42:27.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.642 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookuphash_latency": { 2024-09-05T01:42:27.642 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.642 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.642 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.643 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupino_latency": { 2024-09-05T01:42:27.643 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.643 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.643 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.643 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupname_latency": { 2024-09-05T01:42:27.643 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.643 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.643 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.643 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupparent_latency": { 2024-09-05T01:42:27.643 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.643 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.643 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.644 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupsnap_latency": { 2024-09-05T01:42:27.644 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.644 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.644 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.644 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lssnap_latency": { 2024-09-05T01:42:27.644 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.645 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.645 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.645 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mkdir_latency": { 2024-09-05T01:42:27.645 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 152, 2024-09-05T01:42:27.645 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 10.863162081, 2024-09-05T01:42:27.645 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.071468171 2024-09-05T01:42:27.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.645 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mknod_latency": { 2024-09-05T01:42:27.645 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.645 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.645 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.645 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mksnap_latency": { 2024-09-05T01:42:27.646 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.646 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.646 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.646 INFO:teuthology.orchestra.run.smithi151.stdout: "req_open_latency": { 2024-09-05T01:42:27.646 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 5940, 2024-09-05T01:42:27.646 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 26.689491953, 2024-09-05T01:42:27.646 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.004493180 2024-09-05T01:42:27.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.646 INFO:teuthology.orchestra.run.smithi151.stdout: "req_readdir_latency": { 2024-09-05T01:42:27.646 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 666, 2024-09-05T01:42:27.646 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.974320238, 2024-09-05T01:42:27.646 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001462943 2024-09-05T01:42:27.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.647 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rename_latency": { 2024-09-05T01:42:27.647 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 22052, 2024-09-05T01:42:27.647 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 285.014815555, 2024-09-05T01:42:27.647 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.012924669 2024-09-05T01:42:27.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.647 INFO:teuthology.orchestra.run.smithi151.stdout: "req_renamesnap_latency": { 2024-09-05T01:42:27.647 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.647 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.647 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.647 INFO:teuthology.orchestra.run.smithi151.stdout: "req_snapdiff_latency": { 2024-09-05T01:42:27.647 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.647 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.648 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.648 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmdir_latency": { 2024-09-05T01:42:27.648 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 94, 2024-09-05T01:42:27.648 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 10.469519471, 2024-09-05T01:42:27.648 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.111377866 2024-09-05T01:42:27.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.648 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmsnap_latency": { 2024-09-05T01:42:27.648 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.648 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.648 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.648 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmxattr_latency": { 2024-09-05T01:42:27.648 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.649 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.649 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.649 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setattr_latency": { 2024-09-05T01:42:27.649 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.649 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.649 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.649 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setdirlayout_latency": { 2024-09-05T01:42:27.649 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.649 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.649 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.649 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setfilelock_latency": { 2024-09-05T01:42:27.650 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.650 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.650 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.650 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setlayout_latency": { 2024-09-05T01:42:27.650 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.650 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.650 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.650 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setxattr_latency": { 2024-09-05T01:42:27.650 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.650 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.650 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.651 INFO:teuthology.orchestra.run.smithi151.stdout: "req_symlink_latency": { 2024-09-05T01:42:27.651 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.651 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.651 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.651 INFO:teuthology.orchestra.run.smithi151.stdout: "req_unlink_latency": { 2024-09-05T01:42:27.651 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 13727, 2024-09-05T01:42:27.651 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 27.867163941, 2024-09-05T01:42:27.651 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.002030098 2024-09-05T01:42:27.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.651 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_revoke_eviction": 0, 2024-09-05T01:42:27.651 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_acquisition_throttle": 0, 2024-09-05T01:42:27.651 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getvxattr_latency": { 2024-09-05T01:42:27.651 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.651 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.651 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.652 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:27.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.652 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_sessions": { 2024-09-05T01:42:27.652 INFO:teuthology.orchestra.run.smithi151.stdout: "session_count": 2, 2024-09-05T01:42:27.652 INFO:teuthology.orchestra.run.smithi151.stdout: "session_add": 4, 2024-09-05T01:42:27.652 INFO:teuthology.orchestra.run.smithi151.stdout: "session_remove": 2, 2024-09-05T01:42:27.652 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_open": 2, 2024-09-05T01:42:27.652 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_stale": 0, 2024-09-05T01:42:27.652 INFO:teuthology.orchestra.run.smithi151.stdout: "total_load": 2201, 2024-09-05T01:42:27.652 INFO:teuthology.orchestra.run.smithi151.stdout: "average_load": 1100, 2024-09-05T01:42:27.652 INFO:teuthology.orchestra.run.smithi151.stdout: "avg_session_uptime": 998, 2024-09-05T01:42:27.652 INFO:teuthology.orchestra.run.smithi151.stdout: "mdthresh_evicted": 0 2024-09-05T01:42:27.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.653 INFO:teuthology.orchestra.run.smithi151.stdout: "mempool": { 2024-09-05T01:42:27.653 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_bytes": 0, 2024-09-05T01:42:27.653 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_items": 0, 2024-09-05T01:42:27.653 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_bytes": 0, 2024-09-05T01:42:27.653 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_items": 0, 2024-09-05T01:42:27.653 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_bytes": 0, 2024-09-05T01:42:27.653 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_items": 0, 2024-09-05T01:42:27.653 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-05T01:42:27.653 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_items": 0, 2024-09-05T01:42:27.653 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-05T01:42:27.653 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_items": 0, 2024-09-05T01:42:27.654 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_bytes": 0, 2024-09-05T01:42:27.654 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_items": 0, 2024-09-05T01:42:27.654 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-05T01:42:27.654 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_items": 0, 2024-09-05T01:42:27.654 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_bytes": 0, 2024-09-05T01:42:27.654 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_items": 0, 2024-09-05T01:42:27.654 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_bytes": 0, 2024-09-05T01:42:27.654 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_items": 0, 2024-09-05T01:42:27.654 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-05T01:42:27.655 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_items": 0, 2024-09-05T01:42:27.655 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-05T01:42:27.655 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_items": 0, 2024-09-05T01:42:27.655 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_bytes": 0, 2024-09-05T01:42:27.655 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_items": 0, 2024-09-05T01:42:27.655 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_bytes": 0, 2024-09-05T01:42:27.655 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_items": 0, 2024-09-05T01:42:27.655 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-05T01:42:27.655 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_items": 0, 2024-09-05T01:42:27.655 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_bytes": 0, 2024-09-05T01:42:27.655 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_items": 0, 2024-09-05T01:42:27.655 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_bytes": 0, 2024-09-05T01:42:27.655 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_items": 0, 2024-09-05T01:42:27.656 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_bytes": 0, 2024-09-05T01:42:27.656 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_items": 0, 2024-09-05T01:42:27.656 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_bytes": 0, 2024-09-05T01:42:27.656 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_items": 0, 2024-09-05T01:42:27.656 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_bytes": 1605503, 2024-09-05T01:42:27.656 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_items": 13605, 2024-09-05T01:42:27.656 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_bytes": 88, 2024-09-05T01:42:27.656 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_items": 1, 2024-09-05T01:42:27.656 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_bytes": 0, 2024-09-05T01:42:27.656 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_items": 0, 2024-09-05T01:42:27.656 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_bytes": 0, 2024-09-05T01:42:27.656 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_items": 0, 2024-09-05T01:42:27.656 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_bytes": 0, 2024-09-05T01:42:27.657 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_items": 0, 2024-09-05T01:42:27.657 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_bytes": 8512, 2024-09-05T01:42:27.657 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_items": 191, 2024-09-05T01:42:27.657 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_bytes": 0, 2024-09-05T01:42:27.657 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_items": 0, 2024-09-05T01:42:27.657 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_bytes": 0, 2024-09-05T01:42:27.657 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_items": 0, 2024-09-05T01:42:27.657 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_bytes": 55464833, 2024-09-05T01:42:27.657 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_items": 585438, 2024-09-05T01:42:27.657 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_bytes": 0, 2024-09-05T01:42:27.657 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_items": 0, 2024-09-05T01:42:27.657 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_bytes": 0, 2024-09-05T01:42:27.657 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_items": 0 2024-09-05T01:42:27.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.658 INFO:teuthology.orchestra.run.smithi151.stdout: "objecter": { 2024-09-05T01:42:27.658 INFO:teuthology.orchestra.run.smithi151.stdout: "op_active": 0, 2024-09-05T01:42:27.658 INFO:teuthology.orchestra.run.smithi151.stdout: "op_laggy": 0, 2024-09-05T01:42:27.658 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send": 159543, 2024-09-05T01:42:27.658 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send_bytes": 457342956, 2024-09-05T01:42:27.658 INFO:teuthology.orchestra.run.smithi151.stdout: "op_resend": 33, 2024-09-05T01:42:27.658 INFO:teuthology.orchestra.run.smithi151.stdout: "op_reply": 159543, 2024-09-05T01:42:27.658 INFO:teuthology.orchestra.run.smithi151.stdout: "op_latency": { 2024-09-05T01:42:27.658 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 159543, 2024-09-05T01:42:27.658 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 874.726639915, 2024-09-05T01:42:27.658 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.005482701 2024-09-05T01:42:27.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.658 INFO:teuthology.orchestra.run.smithi151.stdout: "op_inflight": 0, 2024-09-05T01:42:27.658 INFO:teuthology.orchestra.run.smithi151.stdout: "oplen_avg": { 2024-09-05T01:42:27.659 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 159543, 2024-09-05T01:42:27.659 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 167673 2024-09-05T01:42:27.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.659 INFO:teuthology.orchestra.run.smithi151.stdout: "op": 159543, 2024-09-05T01:42:27.659 INFO:teuthology.orchestra.run.smithi151.stdout: "op_r": 135111, 2024-09-05T01:42:27.659 INFO:teuthology.orchestra.run.smithi151.stdout: "op_w": 24432, 2024-09-05T01:42:27.659 INFO:teuthology.orchestra.run.smithi151.stdout: "op_rmw": 0, 2024-09-05T01:42:27.659 INFO:teuthology.orchestra.run.smithi151.stdout: "op_pg": 0, 2024-09-05T01:42:27.659 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_stat": 144, 2024-09-05T01:42:27.659 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_create": 2793, 2024-09-05T01:42:27.659 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_read": 565, 2024-09-05T01:42:27.659 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_write": 4027, 2024-09-05T01:42:27.659 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writefull": 326, 2024-09-05T01:42:27.659 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writesame": 0, 2024-09-05T01:42:27.660 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_append": 0, 2024-09-05T01:42:27.660 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_zero": 0, 2024-09-05T01:42:27.660 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_truncate": 115, 2024-09-05T01:42:27.660 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_delete": 15521, 2024-09-05T01:42:27.660 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_mapext": 0, 2024-09-05T01:42:27.660 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_sparse_read": 0, 2024-09-05T01:42:27.660 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_clonerange": 0, 2024-09-05T01:42:27.660 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_getxattr": 134327, 2024-09-05T01:42:27.660 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_setxattr": 5586, 2024-09-05T01:42:27.660 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_cmpxattr": 0, 2024-09-05T01:42:27.660 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_rmxattr": 0, 2024-09-05T01:42:27.661 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_resetxattrs": 0, 2024-09-05T01:42:27.661 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_call": 0, 2024-09-05T01:42:27.661 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_watch": 0, 2024-09-05T01:42:27.661 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_notify": 0, 2024-09-05T01:42:27.661 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_src_cmpxattr": 0, 2024-09-05T01:42:27.661 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls": 0, 2024-09-05T01:42:27.661 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls_filter": 0, 2024-09-05T01:42:27.661 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_other": 0, 2024-09-05T01:42:27.661 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_active": 0, 2024-09-05T01:42:27.661 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_send": 0, 2024-09-05T01:42:27.662 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_resend": 0, 2024-09-05T01:42:27.662 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_ping": 0, 2024-09-05T01:42:27.662 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_active": 0, 2024-09-05T01:42:27.662 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_send": 0, 2024-09-05T01:42:27.662 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_resend": 0, 2024-09-05T01:42:27.662 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_active": 0, 2024-09-05T01:42:27.662 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_send": 0, 2024-09-05T01:42:27.662 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_resend": 0, 2024-09-05T01:42:27.663 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_active": 0, 2024-09-05T01:42:27.663 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_send": 0, 2024-09-05T01:42:27.663 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_resend": 0, 2024-09-05T01:42:27.663 INFO:teuthology.orchestra.run.smithi151.stdout: "command_active": 0, 2024-09-05T01:42:27.663 INFO:teuthology.orchestra.run.smithi151.stdout: "command_send": 0, 2024-09-05T01:42:27.663 INFO:teuthology.orchestra.run.smithi151.stdout: "command_resend": 0, 2024-09-05T01:42:27.663 INFO:teuthology.orchestra.run.smithi151.stdout: "map_epoch": 108, 2024-09-05T01:42:27.663 INFO:teuthology.orchestra.run.smithi151.stdout: "map_full": 0, 2024-09-05T01:42:27.663 INFO:teuthology.orchestra.run.smithi151.stdout: "map_inc": 27, 2024-09-05T01:42:27.663 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_sessions": 12, 2024-09-05T01:42:27.664 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_open": 12, 2024-09-05T01:42:27.664 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_close": 0, 2024-09-05T01:42:27.664 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_laggy": 0, 2024-09-05T01:42:27.664 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_wr": 3228, 2024-09-05T01:42:27.664 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_rd": 442, 2024-09-05T01:42:27.664 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_del": 599 2024-09-05T01:42:27.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.664 INFO:teuthology.orchestra.run.smithi151.stdout: "oft": { 2024-09-05T01:42:27.664 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_objs": 1, 2024-09-05T01:42:27.664 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_kv_pairs": 0, 2024-09-05T01:42:27.664 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_updates": 0, 2024-09-05T01:42:27.664 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_removes": 0 2024-09-05T01:42:27.664 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.665 INFO:teuthology.orchestra.run.smithi151.stdout: "osd-slow-ops": { 2024-09-05T01:42:27.665 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_ops_count": 19 2024-09-05T01:42:27.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.665 INFO:teuthology.orchestra.run.smithi151.stdout: "purge_queue": { 2024-09-05T01:42:27.665 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops": 0, 2024-09-05T01:42:27.665 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops_high_water": 6, 2024-09-05T01:42:27.665 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing": 0, 2024-09-05T01:42:27.665 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_high_water": 6, 2024-09-05T01:42:27.665 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed_ops": 15385, 2024-09-05T01:42:27.665 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed": 15385, 2024-09-05T01:42:27.665 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_item_in_journal": 0 2024-09-05T01:42:27.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.665 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-05T01:42:27.665 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-09-05T01:42:27.666 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-09-05T01:42:27.666 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-09-05T01:42:27.666 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 427265, 2024-09-05T01:42:27.666 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 134018562, 2024-09-05T01:42:27.666 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:27.666 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 427265, 2024-09-05T01:42:27.666 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-09-05T01:42:27.666 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-09-05T01:42:27.666 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 427265, 2024-09-05T01:42:27.666 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 134018562, 2024-09-05T01:42:27.666 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-09-05T01:42:27.666 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.666 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.666 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.666 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:27.667 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.667 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_bytes": { 2024-09-05T01:42:27.667 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-09-05T01:42:27.667 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-09-05T01:42:27.667 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-09-05T01:42:27.667 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-09-05T01:42:27.667 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-09-05T01:42:27.667 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:27.667 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:27.667 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 159543, 2024-09-05T01:42:27.667 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 459552657, 2024-09-05T01:42:27.667 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 159543, 2024-09-05T01:42:27.667 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 459552657, 2024-09-05T01:42:27.667 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-09-05T01:42:27.667 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.668 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.668 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.668 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:27.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.668 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_ops": { 2024-09-05T01:42:27.668 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-09-05T01:42:27.668 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 1024, 2024-09-05T01:42:27.668 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-09-05T01:42:27.668 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-09-05T01:42:27.668 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-09-05T01:42:27.668 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:27.668 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-09-05T01:42:27.668 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 159543, 2024-09-05T01:42:27.668 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 159543, 2024-09-05T01:42:27.669 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 159543, 2024-09-05T01:42:27.669 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 159543, 2024-09-05T01:42:27.669 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-09-05T01:42:27.669 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.669 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.669 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.669 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:27.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.669 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle": { 2024-09-05T01:42:27.669 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-09-05T01:42:27.669 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-09-05T01:42:27.669 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-09-05T01:42:27.669 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 15385, 2024-09-05T01:42:27.669 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 2213237, 2024-09-05T01:42:27.670 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:27.670 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 15385, 2024-09-05T01:42:27.670 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-09-05T01:42:27.670 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-09-05T01:42:27.670 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 565, 2024-09-05T01:42:27.670 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 2213237, 2024-09-05T01:42:27.670 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-09-05T01:42:27.670 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.670 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.670 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.670 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:27.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-09-05T01:42:27.670 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle-0x5646dd164960": { 2024-09-05T01:42:27.671 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-09-05T01:42:27.671 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-09-05T01:42:27.671 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-09-05T01:42:27.671 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 127618, 2024-09-05T01:42:27.671 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 429245063, 2024-09-05T01:42:27.671 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-09-05T01:42:27.671 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 127618, 2024-09-05T01:42:27.671 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-09-05T01:42:27.671 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-09-05T01:42:27.671 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 3462, 2024-09-05T01:42:27.671 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 429245063, 2024-09-05T01:42:27.671 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-09-05T01:42:27.671 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-09-05T01:42:27.671 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-09-05T01:42:27.672 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-09-05T01:42:27.672 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:27.672 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-09-05T01:42:27.672 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-09-05T01:42:28.581 INFO:tasks.check_counter:Daemon mds.l mds.exported=511 2024-09-05T01:42:28.581 INFO:tasks.check_counter:Daemon mds.l mds.imported=691 2024-09-05T01:42:28.581 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=6 2024-09-05T01:42:28.581 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-09-05T01:42:28.581 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-09-05T01:42:28.581 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=115 2024-09-05T01:42:28.582 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-05T01:42:28.592 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-05T01:42:28.592 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-05T01:42:28.592 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-05T01:42:28.660 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-05T01:42:28.660 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-05T01:42:28.731 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd blocklist ls 2024-09-05T01:42:29.429 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:42:29.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:29 smithi012 ceph-mon[29942]: pgmap v558: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-05T01:42:29.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:29 smithi145 ceph-mon[34376]: pgmap v558: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-05T01:42:29.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:29 smithi151 ceph-mon[35013]: pgmap v558: 97 pgs: 39 active+clean+snaptrim_wait, 23 active+clean+snaptrim, 35 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-05T01:42:30.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.247+0000 7f437b600640 1 -- 172.21.15.12:0/3216415584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4374109830 msgr2=0x7f4374109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:30.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.247+0000 7f437b600640 1 --2- 172.21.15.12:0/3216415584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4374109830 0x7f4374109c90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4360009900 tx=0x7f436002a440 comp rx=0 tx=0).stop 2024-09-05T01:42:30.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.250+0000 7f437b600640 1 -- 172.21.15.12:0/3216415584 shutdown_connections 2024-09-05T01:42:30.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.250+0000 7f437b600640 1 --2- 172.21.15.12:0/3216415584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f437411b140 0x7f437411d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:30.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.250+0000 7f437b600640 1 --2- 172.21.15.12:0/3216415584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4374109830 0x7f4374109c90 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:30.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.250+0000 7f437b600640 1 --2- 172.21.15.12:0/3216415584 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4374109450 0x7f4374110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:30.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.250+0000 7f437b600640 1 -- 172.21.15.12:0/3216415584 >> 172.21.15.12:0/3216415584 conn(0x7f437406e140 msgr2=0x7f437406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:42:30.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.250+0000 7f437b600640 1 -- 172.21.15.12:0/3216415584 shutdown_connections 2024-09-05T01:42:30.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.250+0000 7f437b600640 1 -- 172.21.15.12:0/3216415584 wait complete. 2024-09-05T01:42:30.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.252+0000 7f437b600640 1 Processor -- start 2024-09-05T01:42:30.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.252+0000 7f437b600640 1 -- start start 2024-09-05T01:42:30.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.253+0000 7f437b600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4374109450 0x7f43741a71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:30.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.254+0000 7f437b600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4374109830 0x7f43741a7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:30.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.254+0000 7f4378c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4374109450 0x7f43741a71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:30.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.254+0000 7f4378c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4374109450 0x7f43741a71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:52292/0 (socket says 172.21.15.12:52292) 2024-09-05T01:42:30.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.254+0000 7f4378c00640 1 -- 172.21.15.12:0/3375330630 learned_addr learned my addr 172.21.15.12:0/3375330630 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:42:30.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.254+0000 7f437b600640 1 --2- 172.21.15.12:0/3375330630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f437411b140 0x7f43741abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:30.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.255+0000 7f4373e00640 1 --2- 172.21.15.12:0/3375330630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4374109830 0x7f43741a7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:30.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.255+0000 7f437b600640 1 -- 172.21.15.12:0/3375330630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4374120da0 con 0x7f437411b140 2024-09-05T01:42:30.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.255+0000 7f437b600640 1 -- 172.21.15.12:0/3375330630 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f4374120c20 con 0x7f4374109450 2024-09-05T01:42:30.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.255+0000 7f437b600640 1 -- 172.21.15.12:0/3375330630 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4374120f20 con 0x7f4374109830 2024-09-05T01:42:30.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.255+0000 7f4379600640 1 --2- 172.21.15.12:0/3375330630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f437411b140 0x7f43741abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:30.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.255+0000 7f4378c00640 1 -- 172.21.15.12:0/3375330630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4374109830 msgr2=0x7f43741a7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:30.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.255+0000 7f4378c00640 1 --2- 172.21.15.12:0/3375330630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4374109830 0x7f43741a7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:30.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.255+0000 7f4378c00640 1 -- 172.21.15.12:0/3375330630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f437411b140 msgr2=0x7f43741abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:30.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.255+0000 7f4378c00640 1 --2- 172.21.15.12:0/3375330630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f437411b140 0x7f43741abab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:30.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.256+0000 7f4379600640 1 --2- 172.21.15.12:0/3375330630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f437411b140 0x7f43741abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:42:30.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.256+0000 7f4378c00640 1 -- 172.21.15.12:0/3375330630 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43741ac190 con 0x7f4374109450 2024-09-05T01:42:30.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.256+0000 7f4373e00640 1 --2- 172.21.15.12:0/3375330630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4374109830 0x7f43741a7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-05T01:42:30.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.256+0000 7f4378c00640 1 --2- 172.21.15.12:0/3375330630 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4374109450 0x7f43741a71e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f436400d950 tx=0x7f436400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:42:30.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.257+0000 7f4371600640 1 -- 172.21.15.12:0/3375330630 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4364017070 con 0x7f4374109450 2024-09-05T01:42:30.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.257+0000 7f437b600640 1 -- 172.21.15.12:0/3375330630 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43741ac480 con 0x7f4374109450 2024-09-05T01:42:30.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.257+0000 7f437b600640 1 -- 172.21.15.12:0/3375330630 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43741b3d60 con 0x7f4374109450 2024-09-05T01:42:30.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.257+0000 7f4371600640 1 -- 172.21.15.12:0/3375330630 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4364009c30 con 0x7f4374109450 2024-09-05T01:42:30.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.257+0000 7f4371600640 1 -- 172.21.15.12:0/3375330630 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436400f6b0 con 0x7f4374109450 2024-09-05T01:42:30.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.262+0000 7f4371600640 1 -- 172.21.15.12:0/3375330630 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f436400f850 con 0x7f4374109450 2024-09-05T01:42:30.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.262+0000 7f437b600640 1 -- 172.21.15.12:0/3375330630 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4354005290 con 0x7f4374109450 2024-09-05T01:42:30.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.264+0000 7f4371600640 1 --2- 172.21.15.12:0/3375330630 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f43580a2d70 0x7f43580a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:30.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.264+0000 7f4371600640 1 -- 172.21.15.12:0/3375330630 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8687+0+0 (secure 0 0 0) 0x7f43640cf3e0 con 0x7f4374109450 2024-09-05T01:42:30.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.265+0000 7f4373e00640 1 --2- 172.21.15.12:0/3375330630 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f43580a2d70 0x7f43580a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:30.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.270+0000 7f4373e00640 1 --2- 172.21.15.12:0/3375330630 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f43580a2d70 0x7f43580a5230 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4360005ab0 tx=0x7f4360004c10 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:42:30.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.272+0000 7f4371600640 1 -- 172.21.15.12:0/3375330630 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f436409bf60 con 0x7f4374109450 2024-09-05T01:42:30.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.665+0000 7f437b600640 1 -- 172.21.15.12:0/3375330630 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4354005850 con 0x7f4374109450 2024-09-05T01:42:30.666 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.665+0000 7f4371600640 1 -- 172.21.15.12:0/3375330630 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v108) ==== 81+0+944 (secure 0 0 0) 0x7f4364009de0 con 0x7f4374109450 2024-09-05T01:42:30.669 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/3089660384 2024-09-06T01:24:41.593667+0000 2024-09-05T01:42:30.669 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/2280578773 2024-09-06T01:24:41.593667+0000 2024-09-05T01:42:30.669 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/1532325396 2024-09-06T01:14:54.625209+0000 2024-09-05T01:42:30.669 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6800/3541208629 2024-09-06T01:14:54.625209+0000 2024-09-05T01:42:30.669 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6801/3541208629 2024-09-06T01:14:54.625209+0000 2024-09-05T01:42:30.669 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/992405704 2024-09-06T01:15:22.093410+0000 2024-09-05T01:42:30.669 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/784506983 2024-09-06T01:14:54.625209+0000 2024-09-05T01:42:30.669 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/1815886492 2024-09-06T01:24:41.593667+0000 2024-09-05T01:42:30.669 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6800/4067110310 2024-09-06T01:15:22.093410+0000 2024-09-05T01:42:30.669 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6801/2664180840 2024-09-06T01:24:41.593667+0000 2024-09-05T01:42:30.670 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/1171838695 2024-09-06T01:14:54.625209+0000 2024-09-05T01:42:30.670 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/1040591124 2024-09-06T01:15:22.093410+0000 2024-09-05T01:42:30.670 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6801/4067110310 2024-09-06T01:15:22.093410+0000 2024-09-05T01:42:30.670 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/1385871202 2024-09-06T01:24:41.593667+0000 2024-09-05T01:42:30.670 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:0/1132389058 2024-09-06T01:15:22.093410+0000 2024-09-05T01:42:30.670 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12:6800/2664180840 2024-09-06T01:24:41.593667+0000 2024-09-05T01:42:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:listed 16 entries 2024-09-05T01:42:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.669+0000 7f437b600640 1 -- 172.21.15.12:0/3375330630 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f43580a2d70 msgr2=0x7f43580a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.669+0000 7f437b600640 1 --2- 172.21.15.12:0/3375330630 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f43580a2d70 0x7f43580a5230 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4360005ab0 tx=0x7f4360004c10 comp rx=0 tx=0).stop 2024-09-05T01:42:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.669+0000 7f437b600640 1 -- 172.21.15.12:0/3375330630 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4374109450 msgr2=0x7f43741a71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.669+0000 7f437b600640 1 --2- 172.21.15.12:0/3375330630 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4374109450 0x7f43741a71e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f436400d950 tx=0x7f436400de10 comp rx=0 tx=0).stop 2024-09-05T01:42:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.669+0000 7f437b600640 1 -- 172.21.15.12:0/3375330630 shutdown_connections 2024-09-05T01:42:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.669+0000 7f437b600640 1 --2- 172.21.15.12:0/3375330630 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f43580a2d70 0x7f43580a5230 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.669+0000 7f437b600640 1 --2- 172.21.15.12:0/3375330630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f437411b140 0x7f43741abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.669+0000 7f437b600640 1 --2- 172.21.15.12:0/3375330630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4374109830 0x7f43741a7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.669+0000 7f437b600640 1 --2- 172.21.15.12:0/3375330630 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f4374109450 0x7f43741a71e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.669+0000 7f437b600640 1 -- 172.21.15.12:0/3375330630 >> 172.21.15.12:0/3375330630 conn(0x7f437406e140 msgr2=0x7f437411c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:42:30.671 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.670+0000 7f437b600640 1 -- 172.21.15.12:0/3375330630 shutdown_connections 2024-09-05T01:42:30.672 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:30.670+0000 7f437b600640 1 -- 172.21.15.12:0/3375330630 wait complete. 2024-09-05T01:42:31.557 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-05T01:42:31.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T01:42:31.558 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-05T01:42:31.657 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:31 smithi012 ceph-mon[29942]: pgmap v559: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 10 op/s 2024-09-05T01:42:31.657 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:31 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3375330630' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-05T01:42:31.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:31 smithi145 ceph-mon[34376]: pgmap v559: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 10 op/s 2024-09-05T01:42:31.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:31 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3375330630' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-05T01:42:31.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:31 smithi151 ceph-mon[35013]: pgmap v559: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 10 op/s 2024-09-05T01:42:31.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:31 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3375330630' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-05T01:42:31.875 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2024-09-05T01:42:31.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T01:42:31.876 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-05T01:42:31.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T01:42:31.952 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-05T01:42:32.031 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-05T01:42:32.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T01:42:32.032 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-05T01:42:32.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T01:42:32.162 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2024-09-05T01:42:32.524 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-05T01:42:32.525 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-05T01:42:32.525 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-05T01:42:32.597 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053403,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/2c87f7f1ac0eb8494e65feed5b06df4c6c159107b9406c87c1024126a54cea87/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/FMHX22VN5YXGRNXA34XTSQHFBP:/var/lib/containers/storage/overlay/l/K3C2YDB2JCUIB23ZMTROLP33CR,upperdir=/var/lib/containers/storage/overlay/2c87f7f1ac0eb8494e65feed5b06df4c6c159107b9406c87c1024126a54cea87/diff,workdir=/var/lib/containers/storage/overlay/2c87f7f1ac0eb8494e65feed5b06df4c6c159107b9406c87c1024126a54cea87/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/2f4d0fbe9c9cf0b02e2ad877cdab7411bbbcb4a88ca746830ffbb626373e0b82/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/FMHX22VN5YXGRNXA34XTSQHFBP:/var/lib/containers/storage/overlay/l/K3C2YDB2JCUIB23ZMTROLP33CR,upperdir=/var/lib/containers/storage/overlay/2f4d0fbe9c9cf0b02e2ad877cdab7411bbbcb4a88ca746830ffbb626373e0b82/diff,workdir=/var/lib/containers/storage/overlay/2f4d0fbe9c9cf0b02e2ad877cdab7411bbbcb4a88ca746830ffbb626373e0b82/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/955aa554ea919b6cad7df175672eb3241abacb3a9ffdc219e4ff4526a2e27616/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/FMHX22VN5YXGRNXA34XTSQHFBP:/var/lib/containers/storage/overlay/l/K3C2YDB2JCUIB23ZMTROLP33CR,upperdir=/var/lib/containers/storage/overlay/955aa554ea919b6cad7df175672eb3241abacb3a9ffdc219e4ff4526a2e27616/diff,workdir=/var/lib/containers/storage/overlay/955aa554ea919b6cad7df175672eb3241abacb3a9ffdc219e4ff4526a2e27616/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/342744ab2d3ccdd592f8755d7b7de1862c5162082d9bdce20bd808c8b0c18072/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/FMHX22VN5YXGRNXA34XTSQHFBP:/var/lib/containers/storage/overlay/l/K3C2YDB2JCUIB23ZMTROLP33CR,upperdir=/var/lib/containers/storage/overlay/342744ab2d3ccdd592f8755d7b7de1862c5162082d9bdce20bd808c8b0c18072/diff,workdir=/var/lib/containers/storage/overlay/342744ab2d3ccdd592f8755d7b7de1862c5162082d9bdce20bd808c8b0c18072/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/d2dffeb6f3ad83c43abd6fe68f273df55eed960f8af3cc5bda78ef48a487e8dc/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/FMHX22VN5YXGRNXA34XTSQHFBP:/var/lib/containers/storage/overlay/l/K3C2YDB2JCUIB23ZMTROLP33CR,upperdir=/var/lib/containers/storage/overlay/d2dffeb6f3ad83c43abd6fe68f273df55eed960f8af3cc5bda78ef48a487e8dc/diff,workdir=/var/lib/containers/storage/overlay/d2dffeb6f3ad83c43abd6fe68f273df55eed960f8af3cc5bda78ef48a487e8dc/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/bad141c07b0a2bb058e884e3a6559f05853c7882fa42ddd59830ef284687f115/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/FMHX22VN5YXGRNXA34XTSQHFBP:/var/lib/containers/storage/overlay/l/K3C2YDB2JCUIB23ZMTROLP33CR,upperdir=/var/lib/containers/storage/overlay/bad141c07b0a2bb058e884e3a6559f05853c7882fa42ddd59830ef284687f115/diff,workdir=/var/lib/containers/storage/overlay/bad141c07b0a2bb058e884e3a6559f05853c7882fa42ddd59830ef284687f115/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/2d050321b1f678b90f4dbd1e32366d130281b852454168cbbca73c8a0d178e59/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/FMHX22VN5YXGRNXA34XTSQHFBP:/var/lib/containers/storage/overlay/l/K3C2YDB2JCUIB23ZMTROLP33CR,upperdir=/var/lib/containers/storage/overlay/2d050321b1f678b90f4dbd1e32366d130281b852454168cbbca73c8a0d178e59/diff,workdir=/var/lib/containers/storage/overlay/2d050321b1f678b90f4dbd1e32366d130281b852454168cbbca73c8a0d178e59/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/9a397c1314508d0630b35980a569029a1866b83d4ab51af77fb71abe8ac9a541/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/FMHX22VN5YXGRNXA34XTSQHFBP:/var/lib/containers/storage/overlay/l/K3C2YDB2JCUIB23ZMTROLP33CR,upperdir=/var/lib/containers/storage/overlay/9a397c1314508d0630b35980a569029a1866b83d4ab51af77fb71abe8ac9a541/diff,workdir=/var/lib/containers/storage/overlay/9a397c1314508d0630b35980a569029a1866b83d4ab51af77fb71abe8ac9a541/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/6ed231a25a2c6a4dada2eeed56eb7e8b9abeeaff653256ec691aafab2057e5bf/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/FMHX22VN5YXGRNXA34XTSQHFBP:/var/lib/containers/storage/overlay/l/K3C2YDB2JCUIB23ZMTROLP33CR,upperdir=/var/lib/containers/storage/overlay/6ed231a25a2c6a4dada2eeed56eb7e8b9abeeaff653256ec691aafab2057e5bf/diff,workdir=/var/lib/containers/storage/overlay/6ed231a25a2c6a4dada2eeed56eb7e8b9abeeaff653256ec691aafab2057e5bf/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/a5d0c931d901e1e7296cefc7103a98644b534cf6c82815b982f04f027d2d6c45/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/FMHX22VN5YXGRNXA34XTSQHFBP:/var/lib/containers/storage/overlay/l/K3C2YDB2JCUIB23ZMTROLP33CR,upperdir=/var/lib/containers/storage/overlay/a5d0c931d901e1e7296cefc7103a98644b534cf6c82815b982f04f027d2d6c45/diff,workdir=/var/lib/containers/storage/overlay/a5d0c931d901e1e7296cefc7103a98644b534cf6c82815b982f04f027d2d6c45/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 2024-09-05T01:42:32.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T01:42:32.598 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-09-05T01:42:32.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-05T01:42:32.673 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2024-09-05T01:42:32.803 INFO:teuthology.orchestra.run.smithi012.stderr:Cannot find device "ceph-brx" 2024-09-05T01:42:32.807 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T01:42:32.808 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-05T01:42:32.818 INFO:tasks.cephadm:Teardown begin 2024-09-05T01:42:32.819 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-05T01:42:32.819 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:42:33.529 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:42:33.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:33 smithi151 ceph-mon[35013]: pgmap v560: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-05T01:42:33.711 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:33 smithi012 ceph-mon[29942]: pgmap v560: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-05T01:42:33.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:33 smithi145 ceph-mon[34376]: pgmap v560: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-05T01:42:34.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.303+0000 7fabb7600640 1 -- 172.21.15.12:0/1078377517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fabb0116ea0 msgr2=0x7fabb0119290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:34.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.303+0000 7fabb7600640 1 --2- 172.21.15.12:0/1078377517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fabb0116ea0 0x7fabb0119290 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7faba8009ca0 tx=0x7faba802a8c0 comp rx=0 tx=0).stop 2024-09-05T01:42:34.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.306+0000 7fabb7600640 1 -- 172.21.15.12:0/1078377517 shutdown_connections 2024-09-05T01:42:34.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.306+0000 7fabb7600640 1 --2- 172.21.15.12:0/1078377517 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fabb0116ea0 0x7fabb0119290 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:34.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.306+0000 7fabb7600640 1 --2- 172.21.15.12:0/1078377517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb0109b10 0x7fabb0116960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:34.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.306+0000 7fabb7600640 1 --2- 172.21.15.12:0/1078377517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fabb01091f0 0x7fabb01095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:34.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.306+0000 7fabb7600640 1 -- 172.21.15.12:0/1078377517 >> 172.21.15.12:0/1078377517 conn(0x7fabb006e140 msgr2=0x7fabb006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:42:34.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.306+0000 7fabb7600640 1 -- 172.21.15.12:0/1078377517 shutdown_connections 2024-09-05T01:42:34.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.307+0000 7fabb7600640 1 -- 172.21.15.12:0/1078377517 wait complete. 2024-09-05T01:42:34.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.308+0000 7fabb7600640 1 Processor -- start 2024-09-05T01:42:34.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.309+0000 7fabb7600640 1 -- start start 2024-09-05T01:42:34.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.310+0000 7fabb7600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fabb01091f0 0x7fabb0114ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:34.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.310+0000 7fabb7600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb0109b10 0x7fabb0115420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:34.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.311+0000 7fabb4c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fabb01091f0 0x7fabb0114ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:34.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.311+0000 7fabb7600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fabb0116ea0 0x7fabb01b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:34.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.311+0000 7fabb7600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fabb010d410 con 0x7fabb0109b10 2024-09-05T01:42:34.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.311+0000 7fabb7600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fabb010d290 con 0x7fabb01091f0 2024-09-05T01:42:34.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.311+0000 7fabb7600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fabb010d590 con 0x7fabb0116ea0 2024-09-05T01:42:34.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.311+0000 7fabb4c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fabb01091f0 0x7fabb0114ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:52308/0 (socket says 172.21.15.12:52308) 2024-09-05T01:42:34.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.311+0000 7fabb4c00640 1 -- 172.21.15.12:0/626661888 learned_addr learned my addr 172.21.15.12:0/626661888 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:42:34.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.312+0000 7fabb5600640 1 --2- 172.21.15.12:0/626661888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fabb0116ea0 0x7fabb01b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:34.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.312+0000 7fabb4c00640 1 -- 172.21.15.12:0/626661888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fabb0116ea0 msgr2=0x7fabb01b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:34.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.312+0000 7fabb4c00640 1 --2- 172.21.15.12:0/626661888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fabb0116ea0 0x7fabb01b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:34.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.312+0000 7fabb4c00640 1 -- 172.21.15.12:0/626661888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb0109b10 msgr2=0x7fabb0115420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:34.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.312+0000 7fabb4c00640 1 --2- 172.21.15.12:0/626661888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb0109b10 0x7fabb0115420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:34.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.313+0000 7fabb4c00640 1 -- 172.21.15.12:0/626661888 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb01b3580 con 0x7fabb01091f0 2024-09-05T01:42:34.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.316+0000 7fabb4c00640 1 --2- 172.21.15.12:0/626661888 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fabb01091f0 0x7fabb0114ee0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7faba400e9e0 tx=0x7faba400eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:42:34.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.316+0000 7fabad600640 1 -- 172.21.15.12:0/626661888 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba400cd50 con 0x7fabb01091f0 2024-09-05T01:42:34.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.316+0000 7fabb7600640 1 -- 172.21.15.12:0/626661888 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb01b37b0 con 0x7fabb01091f0 2024-09-05T01:42:34.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.317+0000 7fabb7600640 1 -- 172.21.15.12:0/626661888 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb01b3d40 con 0x7fabb01091f0 2024-09-05T01:42:34.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.318+0000 7fabad600640 1 -- 172.21.15.12:0/626661888 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faba40035f0 con 0x7fabb01091f0 2024-09-05T01:42:34.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.318+0000 7fabad600640 1 -- 172.21.15.12:0/626661888 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba4010690 con 0x7fabb01091f0 2024-09-05T01:42:34.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.319+0000 7fabb7600640 1 -- 172.21.15.12:0/626661888 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabb01095d0 con 0x7fabb01091f0 2024-09-05T01:42:34.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.322+0000 7fabad600640 1 -- 172.21.15.12:0/626661888 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7faba4010830 con 0x7fabb01091f0 2024-09-05T01:42:34.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.326+0000 7fabad600640 1 --2- 172.21.15.12:0/626661888 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fab980a2dc0 0x7fab980a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:34.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.326+0000 7fabad600640 1 -- 172.21.15.12:0/626661888 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8687+0+0 (secure 0 0 0) 0x7faba40cf840 con 0x7fabb01091f0 2024-09-05T01:42:34.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.327+0000 7fabafe00640 1 --2- 172.21.15.12:0/626661888 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fab980a2dc0 0x7fab980a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:34.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.328+0000 7fabafe00640 1 --2- 172.21.15.12:0/626661888 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fab980a2dc0 0x7fab980a5280 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fabb0116970 tx=0x7fab9c005b60 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:42:34.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.332+0000 7fabad600640 1 -- 172.21.15.12:0/626661888 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faba409c3c0 con 0x7fabb01091f0 2024-09-05T01:42:34.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.751+0000 7fabb7600640 1 -- 172.21.15.12:0/626661888 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fabb01b4000 con 0x7fabb01091f0 2024-09-05T01:42:34.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.754+0000 7fabad600640 1 -- 172.21.15.12:0/626661888 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+12007 (secure 0 0 0) 0x7faba409bcc0 con 0x7fabb01091f0 2024-09-05T01:42:34.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:42:34.756 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":73,"btime":"2024-09-05T01:42:17:279269+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14532,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/2949711075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":2949711075},{"type":"v1","addr":"172.21.15.12:6839","nonce":2949711075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":73,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T01:22:35.979384+0000","modified":"2024-09-05T01:42:17.178147+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24529,"mds_2":24524,"mds_3":24517,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/497406458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":497406458},{"type":"v1","addr":"172.21.15.12:6841","nonce":497406458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[0,1,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":202,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":10,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.145:6839/1706431882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":1706431882},{"type":"v1","addr":"172.21.15.145:6839","nonce":1706431882}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24460,24517,24524,24529,24560]},"id":1}]} 2024-09-05T01:42:34.757 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 73 2024-09-05T01:42:34.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.757+0000 7fabb7600640 1 -- 172.21.15.12:0/626661888 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fab980a2dc0 msgr2=0x7fab980a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:34.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.757+0000 7fabb7600640 1 --2- 172.21.15.12:0/626661888 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fab980a2dc0 0x7fab980a5280 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fabb0116970 tx=0x7fab9c005b60 comp rx=0 tx=0).stop 2024-09-05T01:42:34.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.757+0000 7fabb7600640 1 -- 172.21.15.12:0/626661888 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fabb01091f0 msgr2=0x7fabb0114ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:34.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.757+0000 7fabb7600640 1 --2- 172.21.15.12:0/626661888 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fabb01091f0 0x7fabb0114ee0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7faba400e9e0 tx=0x7faba400eea0 comp rx=0 tx=0).stop 2024-09-05T01:42:34.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.758+0000 7fabb7600640 1 -- 172.21.15.12:0/626661888 shutdown_connections 2024-09-05T01:42:34.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.758+0000 7fabb7600640 1 --2- 172.21.15.12:0/626661888 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fab980a2dc0 0x7fab980a5280 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:34.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.758+0000 7fabb7600640 1 --2- 172.21.15.12:0/626661888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fabb0116ea0 0x7fabb01b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:34.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.758+0000 7fabb7600640 1 --2- 172.21.15.12:0/626661888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb0109b10 0x7fabb0115420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:34.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.758+0000 7fabb7600640 1 --2- 172.21.15.12:0/626661888 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fabb01091f0 0x7fabb0114ee0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:34.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.758+0000 7fabb7600640 1 -- 172.21.15.12:0/626661888 >> 172.21.15.12:0/626661888 conn(0x7fabb006e140 msgr2=0x7fabb01173c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:42:34.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.759+0000 7fabb7600640 1 -- 172.21.15.12:0/626661888 shutdown_connections 2024-09-05T01:42:34.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:34.759+0000 7fabb7600640 1 -- 172.21.15.12:0/626661888 wait complete. 2024-09-05T01:42:35.658 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:35 smithi012 ceph-mon[29942]: pgmap v561: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-05T01:42:35.658 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:35 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/626661888' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:42:35.707 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs dump --format=json 2024-09-05T01:42:35.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:35 smithi145 ceph-mon[34376]: pgmap v561: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-05T01:42:35.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:35 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/626661888' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:42:35.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:35 smithi151 ceph-mon[35013]: pgmap v561: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-05T01:42:35.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:35 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/626661888' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:42:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:42:37.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.418+0000 7f49c9600640 1 -- 172.21.15.12:0/4234296329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49c41091f0 msgr2=0x7f49c41095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:37.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.418+0000 7f49c9600640 1 --2- 172.21.15.12:0/4234296329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49c41091f0 0x7f49c41095d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009900 tx=0x7f49b402a4d0 comp rx=0 tx=0).stop 2024-09-05T01:42:37.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.419+0000 7f49c9600640 1 -- 172.21.15.12:0/4234296329 shutdown_connections 2024-09-05T01:42:37.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.419+0000 7f49c9600640 1 --2- 172.21.15.12:0/4234296329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49c4114ab0 0x7f49c4116ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:37.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.419+0000 7f49c9600640 1 --2- 172.21.15.12:0/4234296329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49c4109b10 0x7f49c4114570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:37.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.419+0000 7f49c9600640 1 --2- 172.21.15.12:0/4234296329 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49c41091f0 0x7f49c41095d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:37.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.419+0000 7f49c9600640 1 -- 172.21.15.12:0/4234296329 >> 172.21.15.12:0/4234296329 conn(0x7f49c406e140 msgr2=0x7f49c406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:42:37.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.419+0000 7f49c9600640 1 -- 172.21.15.12:0/4234296329 shutdown_connections 2024-09-05T01:42:37.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.419+0000 7f49c9600640 1 -- 172.21.15.12:0/4234296329 wait complete. 2024-09-05T01:42:37.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.421+0000 7f49c9600640 1 Processor -- start 2024-09-05T01:42:37.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.421+0000 7f49c9600640 1 -- start start 2024-09-05T01:42:37.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.422+0000 7f49c9600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49c41091f0 0x7f49c4113f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:37.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.422+0000 7f49c9600640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49c4109b10 0x7f49c4114440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:37.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.422+0000 7f49c9600640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49c4114ab0 0x7f49c410b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:37.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.422+0000 7f49c9600640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f49c411a860 con 0x7f49c4114ab0 2024-09-05T01:42:37.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.422+0000 7f49c9600640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f49c411a6e0 con 0x7f49c4109b10 2024-09-05T01:42:37.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.422+0000 7f49c9600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f49c411a9e0 con 0x7f49c41091f0 2024-09-05T01:42:37.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.422+0000 7f49c2000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49c4109b10 0x7f49c4114440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:37.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.422+0000 7f49c2000640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49c4109b10 0x7f49c4114440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:38896/0 (socket says 172.21.15.12:38896) 2024-09-05T01:42:37.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.422+0000 7f49c2000640 1 -- 172.21.15.12:0/4268162146 learned_addr learned my addr 172.21.15.12:0/4268162146 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:42:37.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.423+0000 7f49c2000640 1 -- 172.21.15.12:0/4268162146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49c41091f0 msgr2=0x7f49c4113f00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-05T01:42:37.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.423+0000 7f49c2000640 1 --2- 172.21.15.12:0/4268162146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49c41091f0 0x7f49c4113f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:37.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.423+0000 7f49c2000640 1 -- 172.21.15.12:0/4268162146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49c4114ab0 msgr2=0x7f49c410b870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-05T01:42:37.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.423+0000 7f49c2000640 1 --2- 172.21.15.12:0/4268162146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49c4114ab0 0x7f49c410b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:37.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.423+0000 7f49c2000640 1 -- 172.21.15.12:0/4268162146 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c410c100 con 0x7f49c4109b10 2024-09-05T01:42:37.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.424+0000 7f49c2000640 1 --2- 172.21.15.12:0/4268162146 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49c4109b10 0x7f49c4114440 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f49b000b4a0 tx=0x7f49b000b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:42:37.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.424+0000 7f49bb400640 1 -- 172.21.15.12:0/4268162146 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b0014070 con 0x7f49c4109b10 2024-09-05T01:42:37.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.425+0000 7f49bb400640 1 -- 172.21.15.12:0/4268162146 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49b0010af0 con 0x7f49c4109b10 2024-09-05T01:42:37.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.425+0000 7f49c9600640 1 -- 172.21.15.12:0/4268162146 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49c410c3f0 con 0x7f49c4109b10 2024-09-05T01:42:37.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.425+0000 7f49bb400640 1 -- 172.21.15.12:0/4268162146 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b0017d10 con 0x7f49c4109b10 2024-09-05T01:42:37.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.425+0000 7f49c9600640 1 -- 172.21.15.12:0/4268162146 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49c410fb80 con 0x7f49c4109b10 2024-09-05T01:42:37.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.430+0000 7f49c9600640 1 -- 172.21.15.12:0/4268162146 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49c4073a40 con 0x7f49c4109b10 2024-09-05T01:42:37.434 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.431+0000 7f49bb400640 1 -- 172.21.15.12:0/4268162146 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f49b0017070 con 0x7f49c4109b10 2024-09-05T01:42:37.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.434+0000 7f49bb400640 1 --2- 172.21.15.12:0/4268162146 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f49a80a2dc0 0x7f49a80a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:37.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.434+0000 7f49bb400640 1 -- 172.21.15.12:0/4268162146 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8687+0+0 (secure 0 0 0) 0x7f49b00ce7e0 con 0x7f49c4109b10 2024-09-05T01:42:37.436 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.435+0000 7f49c2a00640 1 --2- 172.21.15.12:0/4268162146 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f49a80a2dc0 0x7f49a80a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:37.438 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.436+0000 7f49c2a00640 1 --2- 172.21.15.12:0/4268162146 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f49a80a2dc0 0x7f49a80a5280 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f49b40096c0 tx=0x7f49b4005fd0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:42:37.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.441+0000 7f49bb400640 1 -- 172.21.15.12:0/4268162146 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f49b009b470 con 0x7f49c4109b10 2024-09-05T01:42:37.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:37 smithi012 ceph-mon[29942]: pgmap v562: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.1 KiB/s wr, 14 op/s 2024-09-05T01:42:37.668 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:37 smithi151 ceph-mon[35013]: pgmap v562: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.1 KiB/s wr, 14 op/s 2024-09-05T01:42:37.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:37 smithi145 ceph-mon[34376]: pgmap v562: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.1 KiB/s wr, 14 op/s 2024-09-05T01:42:37.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.837+0000 7f49c9600640 1 -- 172.21.15.12:0/4268162146 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49c410fea0 con 0x7f49c4109b10 2024-09-05T01:42:37.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.839+0000 7f49bb400640 1 -- 172.21.15.12:0/4268162146 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+12007 (secure 0 0 0) 0x7f49b009ad70 con 0x7f49c4109b10 2024-09-05T01:42:37.843 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:42:37.843 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":73,"btime":"2024-09-05T01:42:17:279269+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2004256626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2004256626},{"type":"v1","addr":"172.21.15.12:6837","nonce":2004256626}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14532,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6839/2949711075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6838","nonce":2949711075},{"type":"v1","addr":"172.21.15.12:6839","nonce":2949711075}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":73,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-05T01:22:35.979384+0000","modified":"2024-09-05T01:42:17.178147+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24560,"mds_1":24529,"mds_2":24524,"mds_3":24517,"mds_4":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14544":{"gid":14544,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6841/497406458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6840","nonce":497406458},{"type":"v1","addr":"172.21.15.12:6841","nonce":497406458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6833/1259141438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1259141438},{"type":"v1","addr":"172.21.15.151:6833","nonce":1259141438}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24461":{"gid":24461,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6833/2656226932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6832","nonce":2656226932},{"type":"v1","addr":"172.21.15.145:6833","nonce":2656226932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"j","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.12:6835/544280854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":544280854},{"type":"v1","addr":"172.21.15.12:6835","nonce":544280854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.145:6835/397717562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6834","nonce":397717562},{"type":"v1","addr":"172.21.15.145:6835","nonce":397717562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/309674660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":309674660},{"type":"v1","addr":"172.21.15.151:6835","nonce":309674660}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24517":{"gid":24517,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":11,"addr":"172.21.15.151:6837/3977122893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3977122893},{"type":"v1","addr":"172.21.15.151:6837","nonce":3977122893}]},"join_fscid":-1,"export_targets":[0,1,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":202,"addr":"172.21.15.145:6837/3765112395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6836","nonce":3765112395},{"type":"v1","addr":"172.21.15.145:6837","nonce":3765112395}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24529":{"gid":24529,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":10,"addr":"172.21.15.151:6839/2331000490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2331000490},{"type":"v1","addr":"172.21.15.151:6839","nonce":2331000490}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24560":{"gid":24560,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.145:6839/1706431882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6838","nonce":1706431882},{"type":"v1","addr":"172.21.15.145:6839","nonce":1706431882}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24560,"qdb_cluster":[24460,24517,24524,24529,24560]},"id":1}]} 2024-09-05T01:42:37.843 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 73 2024-09-05T01:42:37.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.843+0000 7f49c9600640 1 -- 172.21.15.12:0/4268162146 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f49a80a2dc0 msgr2=0x7f49a80a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:37.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.843+0000 7f49c9600640 1 --2- 172.21.15.12:0/4268162146 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f49a80a2dc0 0x7f49a80a5280 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f49b40096c0 tx=0x7f49b4005fd0 comp rx=0 tx=0).stop 2024-09-05T01:42:37.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.843+0000 7f49c9600640 1 -- 172.21.15.12:0/4268162146 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49c4109b10 msgr2=0x7f49c4114440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:37.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.843+0000 7f49c9600640 1 --2- 172.21.15.12:0/4268162146 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49c4109b10 0x7f49c4114440 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f49b000b4a0 tx=0x7f49b000b960 comp rx=0 tx=0).stop 2024-09-05T01:42:37.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.843+0000 7f49c9600640 1 -- 172.21.15.12:0/4268162146 shutdown_connections 2024-09-05T01:42:37.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.843+0000 7f49c9600640 1 --2- 172.21.15.12:0/4268162146 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f49a80a2dc0 0x7f49a80a5280 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:37.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.843+0000 7f49c9600640 1 --2- 172.21.15.12:0/4268162146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49c4114ab0 0x7f49c410b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:37.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.843+0000 7f49c9600640 1 --2- 172.21.15.12:0/4268162146 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f49c4109b10 0x7f49c4114440 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:37.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.843+0000 7f49c9600640 1 --2- 172.21.15.12:0/4268162146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49c41091f0 0x7f49c4113f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:37.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.843+0000 7f49c9600640 1 -- 172.21.15.12:0/4268162146 >> 172.21.15.12:0/4268162146 conn(0x7f49c406e140 msgr2=0x7f49c410a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:42:37.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.843+0000 7f49c9600640 1 -- 172.21.15.12:0/4268162146 shutdown_connections 2024-09-05T01:42:37.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:37.844+0000 7f49c9600640 1 -- 172.21.15.12:0/4268162146 wait complete. 2024-09-05T01:42:38.713 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:38 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/4268162146' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:42:38.783 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd dump --format=json 2024-09-05T01:42:38.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:38 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/4268162146' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:42:38.855 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:38 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/4268162146' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-05T01:42:39.455 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:42:39.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:39 smithi012 ceph-mon[29942]: pgmap v563: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-05T01:42:39.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:39 smithi145 ceph-mon[34376]: pgmap v563: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-05T01:42:39.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:39 smithi151 ceph-mon[35013]: pgmap v563: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-05T01:42:40.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.192+0000 7fcf4b800640 1 -- 172.21.15.12:0/1249851519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf441091f0 msgr2=0x7fcf441095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:40.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.192+0000 7fcf4b800640 1 --2- 172.21.15.12:0/1249851519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf441091f0 0x7fcf441095d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcf38009860 tx=0x7fcf3802a340 comp rx=0 tx=0).stop 2024-09-05T01:42:40.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.196+0000 7fcf4b800640 1 -- 172.21.15.12:0/1249851519 shutdown_connections 2024-09-05T01:42:40.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.196+0000 7fcf4b800640 1 --2- 172.21.15.12:0/1249851519 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf44116eb0 0x7fcf441192a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:40.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.196+0000 7fcf4b800640 1 --2- 172.21.15.12:0/1249851519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf44109b10 0x7fcf44116970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:40.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.196+0000 7fcf4b800640 1 --2- 172.21.15.12:0/1249851519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf441091f0 0x7fcf441095d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:40.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.196+0000 7fcf4b800640 1 -- 172.21.15.12:0/1249851519 >> 172.21.15.12:0/1249851519 conn(0x7fcf4406e140 msgr2=0x7fcf4406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:42:40.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.196+0000 7fcf4b800640 1 -- 172.21.15.12:0/1249851519 shutdown_connections 2024-09-05T01:42:40.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.196+0000 7fcf4b800640 1 -- 172.21.15.12:0/1249851519 wait complete. 2024-09-05T01:42:40.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.197+0000 7fcf4b800640 1 Processor -- start 2024-09-05T01:42:40.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.198+0000 7fcf4b800640 1 -- start start 2024-09-05T01:42:40.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.198+0000 7fcf4b800640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf441091f0 0x7fcf44114350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:40.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.198+0000 7fcf4b800640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf44109b10 0x7fcf44111400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:40.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.198+0000 7fcf4b800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf44116eb0 0x7fcf44111940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:40.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.198+0000 7fcf4b800640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4411ca30 con 0x7fcf441091f0 2024-09-05T01:42:40.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.198+0000 7fcf4b800640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4411c8b0 con 0x7fcf44109b10 2024-09-05T01:42:40.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.198+0000 7fcf4b800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4411cbb0 con 0x7fcf44116eb0 2024-09-05T01:42:40.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.199+0000 7fcf49800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf44116eb0 0x7fcf44111940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:40.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.199+0000 7fcf49800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf44116eb0 0x7fcf44111940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.12:47348/0 (socket says 172.21.15.12:47348) 2024-09-05T01:42:40.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.199+0000 7fcf48e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf441091f0 0x7fcf44114350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:40.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.199+0000 7fcf49800640 1 -- 172.21.15.12:0/3002800941 learned_addr learned my addr 172.21.15.12:0/3002800941 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:42:40.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.199+0000 7fcf49800640 1 -- 172.21.15.12:0/3002800941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf44109b10 msgr2=0x7fcf44111400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:40.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.199+0000 7fcf49800640 1 --2- 172.21.15.12:0/3002800941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf44109b10 0x7fcf44111400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:40.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.199+0000 7fcf49800640 1 -- 172.21.15.12:0/3002800941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf441091f0 msgr2=0x7fcf44114350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:40.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.199+0000 7fcf49800640 1 --2- 172.21.15.12:0/3002800941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf441091f0 0x7fcf44114350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:40.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.199+0000 7fcf49800640 1 -- 172.21.15.12:0/3002800941 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf441121d0 con 0x7fcf44116eb0 2024-09-05T01:42:40.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.200+0000 7fcf49800640 1 --2- 172.21.15.12:0/3002800941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf44116eb0 0x7fcf44111940 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009fa0 tx=0x7fcf3c00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:42:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.200+0000 7fcf41600640 1 -- 172.21.15.12:0/3002800941 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c004b20 con 0x7fcf44116eb0 2024-09-05T01:42:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.200+0000 7fcf4b800640 1 -- 172.21.15.12:0/3002800941 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf441b37e0 con 0x7fcf44116eb0 2024-09-05T01:42:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.200+0000 7fcf4b800640 1 -- 172.21.15.12:0/3002800941 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf441b3d20 con 0x7fcf44116eb0 2024-09-05T01:42:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.201+0000 7fcf41600640 1 -- 172.21.15.12:0/3002800941 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf3c003e50 con 0x7fcf44116eb0 2024-09-05T01:42:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.201+0000 7fcf41600640 1 -- 172.21.15.12:0/3002800941 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c00b570 con 0x7fcf44116eb0 2024-09-05T01:42:40.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.202+0000 7fcf4b800640 1 -- 172.21.15.12:0/3002800941 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf240052c0 con 0x7fcf44116eb0 2024-09-05T01:42:40.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.211+0000 7fcf41600640 1 -- 172.21.15.12:0/3002800941 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fcf3c01d020 con 0x7fcf44116eb0 2024-09-05T01:42:40.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.213+0000 7fcf41600640 1 --2- 172.21.15.12:0/3002800941 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fcf2c0a2d70 0x7fcf2c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:40.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.213+0000 7fcf41600640 1 -- 172.21.15.12:0/3002800941 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8687+0+0 (secure 0 0 0) 0x7fcf3c0cf900 con 0x7fcf44116eb0 2024-09-05T01:42:40.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.213+0000 7fcf41600640 1 -- 172.21.15.12:0/3002800941 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcf3c09c420 con 0x7fcf44116eb0 2024-09-05T01:42:40.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.214+0000 7fcf48e00640 1 --2- 172.21.15.12:0/3002800941 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fcf2c0a2d70 0x7fcf2c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:40.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.218+0000 7fcf48e00640 1 --2- 172.21.15.12:0/3002800941 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fcf2c0a2d70 0x7fcf2c0a5230 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcf3802a930 tx=0x7fcf380058d0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:42:40.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.565+0000 7fcf4b800640 1 -- 172.21.15.12:0/3002800941 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf24005880 con 0x7fcf44116eb0 2024-09-05T01:42:40.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.568+0000 7fcf41600640 1 -- 172.21.15.12:0/3002800941 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) ==== 74+0+23495 (secure 0 0 0) 0x7fcf3c09bd20 con 0x7fcf44116eb0 2024-09-05T01:42:40.574 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-05T01:42:40.575 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":108,"fsid":"0d44cd7e-6b24-11ef-bcd6-c7b262605968","created":"2024-09-05T01:14:21.162850+0000","modified":"2024-09-05T01:42:08.239280+0000","last_up_change":"2024-09-05T01:21:37.145073+0000","last_in_change":"2024-09-05T01:21:15.076991+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-05T01:17:44.744065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-05T01:22:31.540178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-05T01:22:33.999318+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":31,"snap_epoch":108,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b74ac640-b680-46e2-9106-d24168e685e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6803","nonce":2090563987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6805","nonce":2090563987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6809","nonce":2090563987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":2090563987},{"type":"v1","addr":"172.21.15.12:6807","nonce":2090563987}]},"public_addr":"172.21.15.12:6803/2090563987","cluster_addr":"172.21.15.12:6805/2090563987","heartbeat_back_addr":"172.21.15.12:6809/2090563987","heartbeat_front_addr":"172.21.15.12:6807/2090563987","state":["exists","up"]},{"osd":1,"uuid":"efca1216-8d85-4e6a-8c49-0afb511ece59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6801","nonce":2639126629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6803","nonce":2639126629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6807","nonce":2639126629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":2639126629},{"type":"v1","addr":"172.21.15.145:6805","nonce":2639126629}]},"public_addr":"172.21.15.145:6801/2639126629","cluster_addr":"172.21.15.145:6803/2639126629","heartbeat_back_addr":"172.21.15.145:6807/2639126629","heartbeat_front_addr":"172.21.15.145:6805/2639126629","state":["exists","up"]},{"osd":2,"uuid":"4d5699b2-646a-4ab6-94a5-ad223aa27ac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6801","nonce":3753171761}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6803","nonce":3753171761}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6807","nonce":3753171761}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3753171761},{"type":"v1","addr":"172.21.15.151:6805","nonce":3753171761}]},"public_addr":"172.21.15.151:6801/3753171761","cluster_addr":"172.21.15.151:6803/3753171761","heartbeat_back_addr":"172.21.15.151:6807/3753171761","heartbeat_front_addr":"172.21.15.151:6805/3753171761","state":["exists","up"]},{"osd":3,"uuid":"275ad2ad-93e6-4a68-8784-8f8dcb620f45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6811","nonce":2231650146}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6813","nonce":2231650146}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6817","nonce":2231650146}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":2231650146},{"type":"v1","addr":"172.21.15.12:6815","nonce":2231650146}]},"public_addr":"172.21.15.12:6811/2231650146","cluster_addr":"172.21.15.12:6813/2231650146","heartbeat_back_addr":"172.21.15.12:6817/2231650146","heartbeat_front_addr":"172.21.15.12:6815/2231650146","state":["exists","up"]},{"osd":4,"uuid":"21a0c5b4-4e0e-4fb6-8be6-a300cb811cb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6809","nonce":1828591275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6811","nonce":1828591275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6815","nonce":1828591275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":1828591275},{"type":"v1","addr":"172.21.15.145:6813","nonce":1828591275}]},"public_addr":"172.21.15.145:6809/1828591275","cluster_addr":"172.21.15.145:6811/1828591275","heartbeat_back_addr":"172.21.15.145:6815/1828591275","heartbeat_front_addr":"172.21.15.145:6813/1828591275","state":["exists","up"]},{"osd":5,"uuid":"e2c7e6fb-5dea-459f-8d7a-7ae5b1936218","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6809","nonce":3888870109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6811","nonce":3888870109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6815","nonce":3888870109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":3888870109},{"type":"v1","addr":"172.21.15.151:6813","nonce":3888870109}]},"public_addr":"172.21.15.151:6809/3888870109","cluster_addr":"172.21.15.151:6811/3888870109","heartbeat_back_addr":"172.21.15.151:6815/3888870109","heartbeat_front_addr":"172.21.15.151:6813/3888870109","state":["exists","up"]},{"osd":6,"uuid":"0df0a29c-3404-4ff5-ae48-78b69b77cbd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6819","nonce":3084810269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6821","nonce":3084810269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6825","nonce":3084810269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3084810269},{"type":"v1","addr":"172.21.15.12:6823","nonce":3084810269}]},"public_addr":"172.21.15.12:6819/3084810269","cluster_addr":"172.21.15.12:6821/3084810269","heartbeat_back_addr":"172.21.15.12:6825/3084810269","heartbeat_front_addr":"172.21.15.12:6823/3084810269","state":["exists","up"]},{"osd":7,"uuid":"c7b3ad7c-a566-435c-9ef8-837bb764acb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6817","nonce":3058588721}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6819","nonce":3058588721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6823","nonce":3058588721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":3058588721},{"type":"v1","addr":"172.21.15.145:6821","nonce":3058588721}]},"public_addr":"172.21.15.145:6817/3058588721","cluster_addr":"172.21.15.145:6819/3058588721","heartbeat_back_addr":"172.21.15.145:6823/3058588721","heartbeat_front_addr":"172.21.15.145:6821/3058588721","state":["exists","up"]},{"osd":8,"uuid":"8018a468-fbc5-4667-a53c-2e97c08713bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6817","nonce":905705309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6819","nonce":905705309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6823","nonce":905705309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":905705309},{"type":"v1","addr":"172.21.15.151:6821","nonce":905705309}]},"public_addr":"172.21.15.151:6817/905705309","cluster_addr":"172.21.15.151:6819/905705309","heartbeat_back_addr":"172.21.15.151:6823/905705309","heartbeat_front_addr":"172.21.15.151:6821/905705309","state":["exists","up"]},{"osd":9,"uuid":"dcf3b524-c8b8-4ab6-83c6-fc52c776d72b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6827","nonce":1193852496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6829","nonce":1193852496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6833","nonce":1193852496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":1193852496},{"type":"v1","addr":"172.21.15.12:6831","nonce":1193852496}]},"public_addr":"172.21.15.12:6827/1193852496","cluster_addr":"172.21.15.12:6829/1193852496","heartbeat_back_addr":"172.21.15.12:6833/1193852496","heartbeat_front_addr":"172.21.15.12:6831/1193852496","state":["exists","up"]},{"osd":10,"uuid":"7b5b34c3-8814-4d16-80ce-0b0c9be07cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6825","nonce":1296813755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6826","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6827","nonce":1296813755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6830","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6831","nonce":1296813755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6828","nonce":1296813755},{"type":"v1","addr":"172.21.15.145:6829","nonce":1296813755}]},"public_addr":"172.21.15.145:6825/1296813755","cluster_addr":"172.21.15.145:6827/1296813755","heartbeat_back_addr":"172.21.15.145:6831/1296813755","heartbeat_front_addr":"172.21.15.145:6829/1296813755","state":["exists","up"]},{"osd":11,"uuid":"157ee32a-43f0-4e5a-8dac-fce53c1efdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6825","nonce":2855185758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6827","nonce":2855185758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6831","nonce":2855185758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2855185758},{"type":"v1","addr":"172.21.15.151:6829","nonce":2855185758}]},"public_addr":"172.21.15.151:6825/2855185758","cluster_addr":"172.21.15.151:6827/2855185758","heartbeat_back_addr":"172.21.15.151:6831/2855185758","heartbeat_front_addr":"172.21.15.151:6829/2855185758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:16:52.947222+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:17:17.845611+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:17:41.769521+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:10.848974+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:35.471340+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:18:59.554980+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:19:28.908089+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:19:53.540000+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:20:17.764886+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:20:46.835859+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:21:12.186176+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-05T01:21:35.863935+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":1}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9},{"from":4,"to":7}]},{"pgid":"3.19","mappings":[{"from":3,"to":8}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3089660384":"2024-09-06T01:24:41.593667+0000","172.21.15.12:0/2280578773":"2024-09-06T01:24:41.593667+0000","172.21.15.12:0/1532325396":"2024-09-06T01:14:54.625209+0000","172.21.15.12:6800/3541208629":"2024-09-06T01:14:54.625209+0000","172.21.15.12:6801/3541208629":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/992405704":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/784506983":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/1815886492":"2024-09-06T01:24:41.593667+0000","172.21.15.12:6800/4067110310":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6801/2664180840":"2024-09-06T01:24:41.593667+0000","172.21.15.12:0/1171838695":"2024-09-06T01:14:54.625209+0000","172.21.15.12:0/1040591124":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6801/4067110310":"2024-09-06T01:15:22.093410+0000","172.21.15.12:0/1385871202":"2024-09-06T01:24:41.593667+0000","172.21.15.12:0/1132389058":"2024-09-06T01:15:22.093410+0000","172.21.15.12:6800/2664180840":"2024-09-06T01:24:41.593667+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":16,"length":1},{"begin":18,"length":1},{"begin":25,"length":1},{"begin":27,"length":1},{"begin":29,"length":1},{"begin":31,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":18,"length":1},{"begin":31,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-05T01:42:40.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.574+0000 7fcf4b800640 1 -- 172.21.15.12:0/3002800941 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fcf2c0a2d70 msgr2=0x7fcf2c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:40.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.574+0000 7fcf4b800640 1 --2- 172.21.15.12:0/3002800941 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fcf2c0a2d70 0x7fcf2c0a5230 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcf3802a930 tx=0x7fcf380058d0 comp rx=0 tx=0).stop 2024-09-05T01:42:40.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.574+0000 7fcf4b800640 1 -- 172.21.15.12:0/3002800941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf44116eb0 msgr2=0x7fcf44111940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:40.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.574+0000 7fcf4b800640 1 --2- 172.21.15.12:0/3002800941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf44116eb0 0x7fcf44111940 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009fa0 tx=0x7fcf3c00c800 comp rx=0 tx=0).stop 2024-09-05T01:42:40.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.574+0000 7fcf4b800640 1 -- 172.21.15.12:0/3002800941 shutdown_connections 2024-09-05T01:42:40.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.574+0000 7fcf4b800640 1 --2- 172.21.15.12:0/3002800941 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fcf2c0a2d70 0x7fcf2c0a5230 secure :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcf3802a930 tx=0x7fcf380058d0 comp rx=0 tx=0).stop 2024-09-05T01:42:40.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.574+0000 7fcf4b800640 1 --2- 172.21.15.12:0/3002800941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf44116eb0 0x7fcf44111940 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:40.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.574+0000 7fcf4b800640 1 --2- 172.21.15.12:0/3002800941 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fcf44109b10 0x7fcf44111400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:40.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.574+0000 7fcf4b800640 1 --2- 172.21.15.12:0/3002800941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf441091f0 0x7fcf44114350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:40.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.574+0000 7fcf4b800640 1 -- 172.21.15.12:0/3002800941 >> 172.21.15.12:0/3002800941 conn(0x7fcf4406e140 msgr2=0x7fcf44114ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:42:40.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.575+0000 7fcf4b800640 1 -- 172.21.15.12:0/3002800941 shutdown_connections 2024-09-05T01:42:40.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:40.575+0000 7fcf4b800640 1 -- 172.21.15.12:0/3002800941 wait complete. 2024-09-05T01:42:41.382 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs fail cephfs 2024-09-05T01:42:41.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:41 smithi012 ceph-mon[29942]: pgmap v564: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-05T01:42:41.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:41 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3002800941' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:42:41.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:41 smithi145 ceph-mon[34376]: pgmap v564: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-05T01:42:41.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:41 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3002800941' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:42:41.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:41 smithi151 ceph-mon[35013]: pgmap v564: 97 pgs: 39 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 37 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-05T01:42:41.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:41 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3002800941' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-05T01:42:42.005 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:42:42.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.734+0000 7f2c15c00640 1 -- 172.21.15.12:0/3318644490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c10101270 msgr2=0x7f2c1010d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:42.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.734+0000 7f2c15c00640 1 --2- 172.21.15.12:0/3318644490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c10101270 0x7f2c1010d7a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009cd0 tx=0x7f2c0802a910 comp rx=0 tx=0).stop 2024-09-05T01:42:42.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.734+0000 7f2c15c00640 1 -- 172.21.15.12:0/3318644490 shutdown_connections 2024-09-05T01:42:42.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.734+0000 7f2c15c00640 1 --2- 172.21.15.12:0/3318644490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c10101270 0x7f2c1010d7a0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:42.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.734+0000 7f2c15c00640 1 --2- 172.21.15.12:0/3318644490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c101008d0 0x7f2c10100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:42.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.734+0000 7f2c15c00640 1 --2- 172.21.15.12:0/3318644490 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c101068d0 0x7f2c10106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:42.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.734+0000 7f2c15c00640 1 -- 172.21.15.12:0/3318644490 >> 172.21.15.12:0/3318644490 conn(0x7f2c100fc610 msgr2=0x7f2c100fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:42:42.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.735+0000 7f2c15c00640 1 -- 172.21.15.12:0/3318644490 shutdown_connections 2024-09-05T01:42:42.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.735+0000 7f2c15c00640 1 -- 172.21.15.12:0/3318644490 wait complete. 2024-09-05T01:42:42.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.736+0000 7f2c15c00640 1 Processor -- start 2024-09-05T01:42:42.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.736+0000 7f2c15c00640 1 -- start start 2024-09-05T01:42:42.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.736+0000 7f2c15c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c101008d0 0x7f2c10107800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:42.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.737+0000 7f2c15c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c10101270 0x7f2c10107d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:42.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.737+0000 7f2c15c00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c101068d0 0x7f2c10108280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:42.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.737+0000 7f2c15c00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1010fbc0 con 0x7f2c101068d0 2024-09-05T01:42:42.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.737+0000 7f2c15c00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1010fa40 con 0x7f2c101008d0 2024-09-05T01:42:42.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.737+0000 7f2c15c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1010fd40 con 0x7f2c10101270 2024-09-05T01:42:42.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.737+0000 7f2c0fe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c101008d0 0x7f2c10107800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:42.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.737+0000 7f2c0f400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c10101270 0x7f2c10107d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:42.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.737+0000 7f2c0fe00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c101008d0 0x7f2c10107800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:38940/0 (socket says 172.21.15.12:38940) 2024-09-05T01:42:42.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.737+0000 7f2c0fe00640 1 -- 172.21.15.12:0/3877417410 learned_addr learned my addr 172.21.15.12:0/3877417410 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:42:42.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.738+0000 7f2c15200640 1 --2- 172.21.15.12:0/3877417410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c101068d0 0x7f2c10108280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:42.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.738+0000 7f2c0f400640 1 -- 172.21.15.12:0/3877417410 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c101008d0 msgr2=0x7f2c10107800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:42.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.738+0000 7f2c0f400640 1 --2- 172.21.15.12:0/3877417410 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c101008d0 0x7f2c10107800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:42.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.738+0000 7f2c0f400640 1 -- 172.21.15.12:0/3877417410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c101068d0 msgr2=0x7f2c10108280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:42.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.738+0000 7f2c0f400640 1 --2- 172.21.15.12:0/3877417410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c101068d0 0x7f2c10108280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:42.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.738+0000 7f2c0f400640 1 -- 172.21.15.12:0/3877417410 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c101aab00 con 0x7f2c10101270 2024-09-05T01:42:42.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.738+0000 7f2c0f400640 1 --2- 172.21.15.12:0/3877417410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c10101270 0x7f2c10107d40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00ea20 tx=0x7f2bfc00eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:42:42.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.739+0000 7f2c0cc00640 1 -- 172.21.15.12:0/3877417410 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc00cd50 con 0x7f2c10101270 2024-09-05T01:42:42.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.739+0000 7f2c15c00640 1 -- 172.21.15.12:0/3877417410 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c101aadf0 con 0x7f2c10101270 2024-09-05T01:42:42.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.739+0000 7f2c15c00640 1 -- 172.21.15.12:0/3877417410 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c101ab2f0 con 0x7f2c10101270 2024-09-05T01:42:42.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.739+0000 7f2c0cc00640 1 -- 172.21.15.12:0/3877417410 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bfc009390 con 0x7f2c10101270 2024-09-05T01:42:42.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.739+0000 7f2c0cc00640 1 -- 172.21.15.12:0/3877417410 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc010430 con 0x7f2c10101270 2024-09-05T01:42:42.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.741+0000 7f2c15c00640 1 -- 172.21.15.12:0/3877417410 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bf0005290 con 0x7f2c10101270 2024-09-05T01:42:42.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.745+0000 7f2c0cc00640 1 -- 172.21.15.12:0/3877417410 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f2bfc0035f0 con 0x7f2c10101270 2024-09-05T01:42:42.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.748+0000 7f2c0cc00640 1 --2- 172.21.15.12:0/3877417410 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f2bf40a2df0 0x7f2bf40a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:42.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.748+0000 7f2c0cc00640 1 -- 172.21.15.12:0/3877417410 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8687+0+0 (secure 0 0 0) 0x7f2bfc0cf9b0 con 0x7f2c10101270 2024-09-05T01:42:42.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.748+0000 7f2c0fe00640 1 --2- 172.21.15.12:0/3877417410 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f2bf40a2df0 0x7f2bf40a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:42.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.749+0000 7f2c0cc00640 1 -- 172.21.15.12:0/3877417410 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2bfc09c4d0 con 0x7f2c10101270 2024-09-05T01:42:42.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:42.750+0000 7f2c0fe00640 1 --2- 172.21.15.12:0/3877417410 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f2bf40a2df0 0x7f2bf40a52b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000b3c0 tx=0x7f2c0000d040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:42:43.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:43.141+0000 7f2c15c00640 1 -- 172.21.15.12:0/3877417410 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2bf0005850 con 0x7f2c10101270 2024-09-05T01:42:43.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:43.169+0000 7f2c0cc00640 1 -- 172.21.15.12:0/3877417410 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v74) ==== 161+0+0 (secure 0 0 0) 0x7f2bfc09bdd0 con 0x7f2c10101270 2024-09-05T01:42:43.171 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-05T01:42:43.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:43.174+0000 7f2c15c00640 1 -- 172.21.15.12:0/3877417410 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f2bf40a2df0 msgr2=0x7f2bf40a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:43.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:43.174+0000 7f2c15c00640 1 --2- 172.21.15.12:0/3877417410 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f2bf40a2df0 0x7f2bf40a52b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000b3c0 tx=0x7f2c0000d040 comp rx=0 tx=0).stop 2024-09-05T01:42:43.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:43.174+0000 7f2c15c00640 1 -- 172.21.15.12:0/3877417410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c10101270 msgr2=0x7f2c10107d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:43.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:43.174+0000 7f2c15c00640 1 --2- 172.21.15.12:0/3877417410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c10101270 0x7f2c10107d40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00ea20 tx=0x7f2bfc00eee0 comp rx=0 tx=0).stop 2024-09-05T01:42:43.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:43.176+0000 7f2c15c00640 1 -- 172.21.15.12:0/3877417410 shutdown_connections 2024-09-05T01:42:43.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:43.176+0000 7f2c15c00640 1 --2- 172.21.15.12:0/3877417410 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f2bf40a2df0 0x7f2bf40a52b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:43.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:43.176+0000 7f2c15c00640 1 --2- 172.21.15.12:0/3877417410 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c101068d0 0x7f2c10108280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:43.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:43.176+0000 7f2c15c00640 1 --2- 172.21.15.12:0/3877417410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c10101270 0x7f2c10107d40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:43.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:43.176+0000 7f2c15c00640 1 --2- 172.21.15.12:0/3877417410 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f2c101008d0 0x7f2c10107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:43.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:43.176+0000 7f2c15c00640 1 -- 172.21.15.12:0/3877417410 >> 172.21.15.12:0/3877417410 conn(0x7f2c100fc610 msgr2=0x7f2c100fcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:42:43.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:43.176+0000 7f2c15c00640 1 -- 172.21.15.12:0/3877417410 shutdown_connections 2024-09-05T01:42:43.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:43.177+0000 7f2c15c00640 1 -- 172.21.15.12:0/3877417410 wait complete. 2024-09-05T01:42:43.438 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:43 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-a[29938]: 2024-09-05T01:42:43.143+0000 7f4034000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-05T01:42:43.438 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 05 01:42:43 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-a[70949]: ignoring --setuser ceph since I am not root 2024-09-05T01:42:43.438 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 05 01:42:43 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-a[70949]: ignoring --setgroup ceph since I am not root 2024-09-05T01:42:43.438 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 05 01:42:43 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-a[70949]: starting mds.a at 2024-09-05T01:42:43.438 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 05 01:42:43 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-j[69388]: ignoring --setuser ceph since I am not root 2024-09-05T01:42:43.439 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 05 01:42:43 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-j[69388]: ignoring --setgroup ceph since I am not root 2024-09-05T01:42:43.439 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 05 01:42:43 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-j[69388]: starting mds.j at 2024-09-05T01:42:43.439 INFO:journalctl@ceph.mds.b.smithi145.stdout:Sep 05 01:42:43 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-b[65009]: ignoring --setuser ceph since I am not root 2024-09-05T01:42:43.439 INFO:journalctl@ceph.mds.b.smithi145.stdout:Sep 05 01:42:43 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-b[65009]: ignoring --setgroup ceph since I am not root 2024-09-05T01:42:43.439 INFO:journalctl@ceph.mds.b.smithi145.stdout:Sep 05 01:42:43 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-b[65009]: starting mds.b at 2024-09-05T01:42:43.440 INFO:journalctl@ceph.mds.e.smithi145.stdout:Sep 05 01:42:43 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-e[64396]: ignoring --setuser ceph since I am not root 2024-09-05T01:42:43.440 INFO:journalctl@ceph.mds.e.smithi145.stdout:Sep 05 01:42:43 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-e[64396]: ignoring --setgroup ceph since I am not root 2024-09-05T01:42:43.440 INFO:journalctl@ceph.mds.e.smithi145.stdout:Sep 05 01:42:43 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-e[64396]: starting mds.e at 2024-09-05T01:42:43.440 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:42:43 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: ignoring --setuser ceph since I am not root 2024-09-05T01:42:43.440 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:42:43 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: ignoring --setgroup ceph since I am not root 2024-09-05T01:42:43.440 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:42:43 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: starting mds.h at 2024-09-05T01:42:43.440 INFO:journalctl@ceph.mds.k.smithi145.stdout:Sep 05 01:42:43 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-k[64078]: ignoring --setuser ceph since I am not root 2024-09-05T01:42:43.441 INFO:journalctl@ceph.mds.k.smithi145.stdout:Sep 05 01:42:43 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-k[64078]: ignoring --setgroup ceph since I am not root 2024-09-05T01:42:43.441 INFO:journalctl@ceph.mds.k.smithi145.stdout:Sep 05 01:42:43 smithi145 ceph-mds[64082]: -- 172.21.15.145:0/374635941 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5578293b6680 con 0x55782938b400 2024-09-05T01:42:43.441 INFO:journalctl@ceph.mds.k.smithi145.stdout:Sep 05 01:42:43 smithi145 ceph-mds[64082]: -- 172.21.15.145:0/374635941 <== mon.2 v2:172.21.15.145:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5578293ad860 con 0x55782938b400 2024-09-05T01:42:43.441 INFO:journalctl@ceph.mds.k.smithi145.stdout:Sep 05 01:42:43 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-k[64078]: starting mds.k at 2024-09-05T01:42:43.604 INFO:journalctl@ceph.mds.l.smithi151.stdout:Sep 05 01:42:43 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-l[63974]: ignoring --setuser ceph since I am not root 2024-09-05T01:42:43.604 INFO:journalctl@ceph.mds.l.smithi151.stdout:Sep 05 01:42:43 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-l[63974]: ignoring --setgroup ceph since I am not root 2024-09-05T01:42:43.604 INFO:journalctl@ceph.mds.l.smithi151.stdout:Sep 05 01:42:43 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-l[63974]: starting mds.l at 2024-09-05T01:42:43.605 INFO:journalctl@ceph.mds.f.smithi151.stdout:Sep 05 01:42:43 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-f[64279]: ignoring --setuser ceph since I am not root 2024-09-05T01:42:43.605 INFO:journalctl@ceph.mds.f.smithi151.stdout:Sep 05 01:42:43 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-f[64279]: ignoring --setgroup ceph since I am not root 2024-09-05T01:42:43.605 INFO:journalctl@ceph.mds.f.smithi151.stdout:Sep 05 01:42:43 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-f[64279]: starting mds.f at 2024-09-05T01:42:43.605 INFO:journalctl@ceph.mds.i.smithi151.stdout:Sep 05 01:42:43 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-i[64895]: ignoring --setuser ceph since I am not root 2024-09-05T01:42:43.605 INFO:journalctl@ceph.mds.i.smithi151.stdout:Sep 05 01:42:43 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-i[64895]: ignoring --setgroup ceph since I am not root 2024-09-05T01:42:43.605 INFO:journalctl@ceph.mds.i.smithi151.stdout:Sep 05 01:42:43 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-i[64895]: starting mds.i at 2024-09-05T01:42:43.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:43 smithi151 ceph-mon[35013]: pgmap v565: 97 pgs: 37 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 41 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-05T01:42:43.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:43 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3877417410' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-05T01:42:43.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:43 smithi151 ceph-mon[35013]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-05T01:42:43.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:43 smithi151 ceph-mon[35013]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-05T01:42:43.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:43 smithi151 ceph-mon[35013]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-05T01:42:43.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:43 smithi151 ceph-mon[35013]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2024-09-05T01:42:43.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:43 smithi151 ceph-mon[35013]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-05T01:42:43.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:43 smithi151 ceph-mon[35013]: osdmap e109: 12 total, 12 up, 12 in 2024-09-05T01:42:43.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:43 smithi151 ceph-mon[35013]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-05T01:42:43.606 INFO:journalctl@ceph.mds.c.smithi151.stdout:Sep 05 01:42:43 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-c[64593]: ignoring --setuser ceph since I am not root 2024-09-05T01:42:43.607 INFO:journalctl@ceph.mds.c.smithi151.stdout:Sep 05 01:42:43 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-c[64593]: ignoring --setgroup ceph since I am not root 2024-09-05T01:42:43.607 INFO:journalctl@ceph.mds.c.smithi151.stdout:Sep 05 01:42:43 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-c[64593]: starting mds.c at 2024-09-05T01:42:43.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:43 smithi012 ceph-mon[29942]: pgmap v565: 97 pgs: 37 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 41 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-05T01:42:43.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:43 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3877417410' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-05T01:42:43.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:43 smithi012 ceph-mon[29942]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-05T01:42:43.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:43 smithi012 ceph-mon[29942]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-05T01:42:43.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:43 smithi012 ceph-mon[29942]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-05T01:42:43.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:43 smithi012 ceph-mon[29942]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2024-09-05T01:42:43.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:43 smithi012 ceph-mon[29942]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-05T01:42:43.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:43 smithi012 ceph-mon[29942]: osdmap e109: 12 total, 12 up, 12 in 2024-09-05T01:42:43.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:43 smithi012 ceph-mon[29942]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-05T01:42:43.833 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:43 smithi145 ceph-mon[34376]: pgmap v565: 97 pgs: 37 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 41 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-05T01:42:43.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:43 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3877417410' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-05T01:42:43.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:43 smithi145 ceph-mon[34376]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-05T01:42:43.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:43 smithi145 ceph-mon[34376]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-05T01:42:43.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:43 smithi145 ceph-mon[34376]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-05T01:42:43.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:43 smithi145 ceph-mon[34376]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2024-09-05T01:42:43.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:43 smithi145 ceph-mon[34376]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-05T01:42:43.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:43 smithi145 ceph-mon[34376]: osdmap e109: 12 total, 12 up, 12 in 2024-09-05T01:42:43.834 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:43 smithi145 ceph-mon[34376]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-05T01:42:44.569 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-05T01:42:45.169 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:42:45.437 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:45 smithi012 ceph-mon[29942]: pgmap v567: 97 pgs: 37 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 41 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-05T01:42:45.437 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:45 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.145:6832/2993450073,v1:172.21.15.145:6833/2993450073] up:boot 2024-09-05T01:42:45.437 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:45 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.145:6836/3183694592,v1:172.21.15.145:6837/3183694592] up:boot 2024-09-05T01:42:45.437 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:45 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.145:6834/1916660049,v1:172.21.15.145:6835/1916660049] up:boot 2024-09-05T01:42:45.437 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:45 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.12:6834/2251476505,v1:172.21.15.12:6840/2251476505] up:boot 2024-09-05T01:42:45.437 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:45 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.145:6838/2712380329,v1:172.21.15.145:6839/2712380329] up:boot 2024-09-05T01:42:45.437 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:45 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.12:6835/2115534886,v1:172.21.15.12:6841/2115534886] up:boot 2024-09-05T01:42:45.437 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:45 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.151:6832/4159912484,v1:172.21.15.151:6833/4159912484] up:boot 2024-09-05T01:42:45.438 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:45 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.151:6834/2196760834,v1:172.21.15.151:6835/2196760834] up:boot 2024-09-05T01:42:45.438 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:45 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.151:6838/3678460296,v1:172.21.15.151:6839/3678460296] up:boot 2024-09-05T01:42:45.438 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:45 smithi012 ceph-mon[29942]: mds.? [v2:172.21.15.151:6836/196664435,v1:172.21.15.151:6837/196664435] up:boot 2024-09-05T01:42:45.438 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:45 smithi012 ceph-mon[29942]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-05T01:42:45.438 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:45 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-05T01:42:45.438 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:45 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-05T01:42:45.438 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:45 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-05T01:42:45.438 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:45 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-05T01:42:45.438 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:45 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-05T01:42:45.438 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:45 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-05T01:42:45.438 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:45 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-05T01:42:45.438 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:45 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-05T01:42:45.438 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:45 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-05T01:42:45.439 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:45 smithi012 ceph-mon[29942]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T01:42:45.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:45 smithi145 ceph-mon[34376]: pgmap v567: 97 pgs: 37 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 41 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-05T01:42:45.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:45 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.145:6832/2993450073,v1:172.21.15.145:6833/2993450073] up:boot 2024-09-05T01:42:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:45 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.145:6836/3183694592,v1:172.21.15.145:6837/3183694592] up:boot 2024-09-05T01:42:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:45 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.145:6834/1916660049,v1:172.21.15.145:6835/1916660049] up:boot 2024-09-05T01:42:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:45 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.12:6834/2251476505,v1:172.21.15.12:6840/2251476505] up:boot 2024-09-05T01:42:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:45 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.145:6838/2712380329,v1:172.21.15.145:6839/2712380329] up:boot 2024-09-05T01:42:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:45 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.12:6835/2115534886,v1:172.21.15.12:6841/2115534886] up:boot 2024-09-05T01:42:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:45 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.151:6832/4159912484,v1:172.21.15.151:6833/4159912484] up:boot 2024-09-05T01:42:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:45 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.151:6834/2196760834,v1:172.21.15.151:6835/2196760834] up:boot 2024-09-05T01:42:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:45 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.151:6838/3678460296,v1:172.21.15.151:6839/3678460296] up:boot 2024-09-05T01:42:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:45 smithi145 ceph-mon[34376]: mds.? [v2:172.21.15.151:6836/196664435,v1:172.21.15.151:6837/196664435] up:boot 2024-09-05T01:42:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:45 smithi145 ceph-mon[34376]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-05T01:42:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:45 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-05T01:42:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:45 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-05T01:42:45.585 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:45 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-05T01:42:45.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:45 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-05T01:42:45.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:45 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-05T01:42:45.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:45 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-05T01:42:45.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:45 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-05T01:42:45.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:45 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-05T01:42:45.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:45 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-05T01:42:45.586 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:45 smithi145 ceph-mon[34376]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T01:42:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:45 smithi151 ceph-mon[35013]: pgmap v567: 97 pgs: 37 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 41 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-05T01:42:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:45 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.145:6832/2993450073,v1:172.21.15.145:6833/2993450073] up:boot 2024-09-05T01:42:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:45 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.145:6836/3183694592,v1:172.21.15.145:6837/3183694592] up:boot 2024-09-05T01:42:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:45 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.145:6834/1916660049,v1:172.21.15.145:6835/1916660049] up:boot 2024-09-05T01:42:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:45 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.12:6834/2251476505,v1:172.21.15.12:6840/2251476505] up:boot 2024-09-05T01:42:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:45 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.145:6838/2712380329,v1:172.21.15.145:6839/2712380329] up:boot 2024-09-05T01:42:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:45 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.12:6835/2115534886,v1:172.21.15.12:6841/2115534886] up:boot 2024-09-05T01:42:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:45 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.151:6832/4159912484,v1:172.21.15.151:6833/4159912484] up:boot 2024-09-05T01:42:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:45 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.151:6834/2196760834,v1:172.21.15.151:6835/2196760834] up:boot 2024-09-05T01:42:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:45 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.151:6838/3678460296,v1:172.21.15.151:6839/3678460296] up:boot 2024-09-05T01:42:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:45 smithi151 ceph-mon[35013]: mds.? [v2:172.21.15.151:6836/196664435,v1:172.21.15.151:6837/196664435] up:boot 2024-09-05T01:42:45.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:45 smithi151 ceph-mon[35013]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-05T01:42:45.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:45 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-05T01:42:45.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:45 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-05T01:42:45.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:45 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-05T01:42:45.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:45 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-05T01:42:45.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:45 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-05T01:42:45.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:45 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-05T01:42:45.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:45 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-05T01:42:45.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:45 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-05T01:42:45.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:45 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-05T01:42:45.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:45 smithi151 ceph-mon[35013]: from='mgr.15138 172.21.15.12:0/1797364412' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-05T01:42:45.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.930+0000 7f2309200640 1 -- 172.21.15.12:0/3779708740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2304109e00 msgr2=0x7f230410e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:45.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.930+0000 7f2309200640 1 --2- 172.21.15.12:0/3779708740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2304109e00 0x7f230410e240 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f22f00074e0 tx=0x7f22f002b080 comp rx=0 tx=0).stop 2024-09-05T01:42:45.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.931+0000 7f2309200640 1 -- 172.21.15.12:0/3779708740 shutdown_connections 2024-09-05T01:42:45.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.931+0000 7f2309200640 1 --2- 172.21.15.12:0/3779708740 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f230410e970 0x7f2304115310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:45.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.931+0000 7f2309200640 1 --2- 172.21.15.12:0/3779708740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2304109e00 0x7f230410e240 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:45.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.931+0000 7f2309200640 1 --2- 172.21.15.12:0/3779708740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2304109450 0x7f2304109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:45.933 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.931+0000 7f2309200640 1 -- 172.21.15.12:0/3779708740 >> 172.21.15.12:0/3779708740 conn(0x7f2304073180 msgr2=0x7f2304073590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:42:45.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.931+0000 7f2309200640 1 -- 172.21.15.12:0/3779708740 shutdown_connections 2024-09-05T01:42:45.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.932+0000 7f2309200640 1 -- 172.21.15.12:0/3779708740 wait complete. 2024-09-05T01:42:45.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.933+0000 7f2309200640 1 Processor -- start 2024-09-05T01:42:45.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.933+0000 7f2309200640 1 -- start start 2024-09-05T01:42:45.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.934+0000 7f2309200640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2304109450 0x7f23041a2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:45.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.934+0000 7f2309200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2304109e00 0x7f23041a3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:45.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.934+0000 7f2309200640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f230410e970 0x7f23041a75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:45.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.934+0000 7f2309200640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f230411c7d0 con 0x7f2304109450 2024-09-05T01:42:45.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.934+0000 7f2309200640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7f230411c650 con 0x7f230410e970 2024-09-05T01:42:45.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.934+0000 7f2309200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f230411c950 con 0x7f2304109e00 2024-09-05T01:42:45.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.934+0000 7f2302a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2304109e00 0x7f23041a3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:45.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.934+0000 7f2303400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2304109450 0x7f23041a2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:45.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.934+0000 7f2303e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f230410e970 0x7f23041a75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:45.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.934+0000 7f2303e00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f230410e970 0x7f23041a75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:38976/0 (socket says 172.21.15.12:38976) 2024-09-05T01:42:45.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.934+0000 7f2303e00640 1 -- 172.21.15.12:0/2676281096 learned_addr learned my addr 172.21.15.12:0/2676281096 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:42:45.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.935+0000 7f2303e00640 1 -- 172.21.15.12:0/2676281096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2304109e00 msgr2=0x7f23041a3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:45.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.935+0000 7f2303e00640 1 --2- 172.21.15.12:0/2676281096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2304109e00 0x7f23041a3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:45.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.935+0000 7f2303e00640 1 -- 172.21.15.12:0/2676281096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2304109450 msgr2=0x7f23041a2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:45.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.935+0000 7f2303e00640 1 --2- 172.21.15.12:0/2676281096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2304109450 0x7f23041a2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:45.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.935+0000 7f2303e00640 1 -- 172.21.15.12:0/2676281096 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23041a7cc0 con 0x7f230410e970 2024-09-05T01:42:45.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.935+0000 7f2303400640 1 --2- 172.21.15.12:0/2676281096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2304109450 0x7f23041a2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:42:45.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.935+0000 7f2303e00640 1 --2- 172.21.15.12:0/2676281096 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f230410e970 0x7f23041a75e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f22fc00b9e0 tx=0x7f22fc00bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:42:45.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.936+0000 7f22fbe00640 1 -- 172.21.15.12:0/2676281096 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22fc019070 con 0x7f230410e970 2024-09-05T01:42:45.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.936+0000 7f22fbe00640 1 -- 172.21.15.12:0/2676281096 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22fc014440 con 0x7f230410e970 2024-09-05T01:42:45.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.936+0000 7f22fbe00640 1 -- 172.21.15.12:0/2676281096 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22fc0075d0 con 0x7f230410e970 2024-09-05T01:42:45.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.936+0000 7f2309200640 1 -- 172.21.15.12:0/2676281096 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23041a7fb0 con 0x7f230410e970 2024-09-05T01:42:45.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.936+0000 7f2309200640 1 -- 172.21.15.12:0/2676281096 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23041af890 con 0x7f230410e970 2024-09-05T01:42:45.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.938+0000 7f2309200640 1 -- 172.21.15.12:0/2676281096 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2304109830 con 0x7f230410e970 2024-09-05T01:42:45.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.941+0000 7f22fbe00640 1 -- 172.21.15.12:0/2676281096 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7f22fc01c070 con 0x7f230410e970 2024-09-05T01:42:45.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.943+0000 7f22fbe00640 1 --2- 172.21.15.12:0/2676281096 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f22e80a2d70 0x7f22e80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:45.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.944+0000 7f22fbe00640 1 -- 172.21.15.12:0/2676281096 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9073+0+0 (secure 0 0 0) 0x7f22fc098fb0 con 0x7f230410e970 2024-09-05T01:42:45.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.944+0000 7f2303400640 1 --2- 172.21.15.12:0/2676281096 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f22e80a2d70 0x7f22e80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:45.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.946+0000 7f2303400640 1 --2- 172.21.15.12:0/2676281096 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f22e80a2d70 0x7f22e80a5230 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f22f4009fc0 tx=0x7f22f4005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:42:45.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:45.953+0000 7f22fbe00640 1 -- 172.21.15.12:0/2676281096 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f22fc09af10 con 0x7f230410e970 2024-09-05T01:42:46.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:46.355+0000 7f2309200640 1 -- 172.21.15.12:0/2676281096 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f230402d7c0 con 0x7f230410e970 2024-09-05T01:42:47.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:47.173+0000 7f22fbe00640 1 -- 172.21.15.12:0/2676281096 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v76) ==== 104+0+0 (secure 0 0 0) 0x7f22fc09f210 con 0x7f230410e970 2024-09-05T01:42:47.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:47.176+0000 7f2309200640 1 -- 172.21.15.12:0/2676281096 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f22e80a2d70 msgr2=0x7f22e80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:47.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:47.176+0000 7f2309200640 1 --2- 172.21.15.12:0/2676281096 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f22e80a2d70 0x7f22e80a5230 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f22f4009fc0 tx=0x7f22f4005f90 comp rx=0 tx=0).stop 2024-09-05T01:42:47.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:47.176+0000 7f2309200640 1 -- 172.21.15.12:0/2676281096 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f230410e970 msgr2=0x7f23041a75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:47.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:47.176+0000 7f2309200640 1 --2- 172.21.15.12:0/2676281096 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f230410e970 0x7f23041a75e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f22fc00b9e0 tx=0x7f22fc00bea0 comp rx=0 tx=0).stop 2024-09-05T01:42:47.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:47.176+0000 7f2309200640 1 -- 172.21.15.12:0/2676281096 shutdown_connections 2024-09-05T01:42:47.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:47.176+0000 7f2309200640 1 --2- 172.21.15.12:0/2676281096 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7f22e80a2d70 0x7f22e80a5230 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:47.176+0000 7f2309200640 1 --2- 172.21.15.12:0/2676281096 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7f230410e970 0x7f23041a75e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:47.176+0000 7f2309200640 1 --2- 172.21.15.12:0/2676281096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2304109e00 0x7f23041a3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:47.176+0000 7f2309200640 1 --2- 172.21.15.12:0/2676281096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2304109450 0x7f23041a2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:47.176+0000 7f2309200640 1 -- 172.21.15.12:0/2676281096 >> 172.21.15.12:0/2676281096 conn(0x7f2304073180 msgr2=0x7f230410c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:42:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:47.176+0000 7f2309200640 1 -- 172.21.15.12:0/2676281096 shutdown_connections 2024-09-05T01:42:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:47.177+0000 7f2309200640 1 -- 172.21.15.12:0/2676281096 wait complete. 2024-09-05T01:42:47.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:47 smithi012 ceph-mon[29942]: pgmap v568: 97 pgs: 35 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 44 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-05T01:42:47.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:47 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/2676281096' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-05T01:42:47.564 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:47 smithi012 ceph-mon[29942]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-05T01:42:47.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:47 smithi145 ceph-mon[34376]: pgmap v568: 97 pgs: 35 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 44 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-05T01:42:47.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:47 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/2676281096' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-05T01:42:47.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:47 smithi145 ceph-mon[34376]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-05T01:42:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:47 smithi151 ceph-mon[35013]: pgmap v568: 97 pgs: 35 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 44 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-09-05T01:42:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:47 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/2676281096' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-05T01:42:47.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:47 smithi151 ceph-mon[35013]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-05T01:42:48.004 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-05T01:42:48.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:48 smithi012 ceph-mon[29942]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-05T01:42:48.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:48 smithi012 ceph-mon[29942]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-05T01:42:48.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:48 smithi012 ceph-mon[29942]: Cluster is now healthy 2024-09-05T01:42:48.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:48 smithi012 ceph-mon[29942]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-05T01:42:48.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:48 smithi012 ceph-mon[29942]: fsmap 12 up:standby 2024-09-05T01:42:48.313 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:48 smithi012 ceph-mon[29942]: osdmap e110: 12 total, 12 up, 12 in 2024-09-05T01:42:48.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:48 smithi145 ceph-mon[34376]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-05T01:42:48.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:48 smithi145 ceph-mon[34376]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-05T01:42:48.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:48 smithi145 ceph-mon[34376]: Cluster is now healthy 2024-09-05T01:42:48.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:48 smithi145 ceph-mon[34376]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-05T01:42:48.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:48 smithi145 ceph-mon[34376]: fsmap 12 up:standby 2024-09-05T01:42:48.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:48 smithi145 ceph-mon[34376]: osdmap e110: 12 total, 12 up, 12 in 2024-09-05T01:42:48.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:48 smithi151 ceph-mon[35013]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-05T01:42:48.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:48 smithi151 ceph-mon[35013]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-05T01:42:48.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:48 smithi151 ceph-mon[35013]: Cluster is now healthy 2024-09-05T01:42:48.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:48 smithi151 ceph-mon[35013]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-05T01:42:48.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:48 smithi151 ceph-mon[35013]: fsmap 12 up:standby 2024-09-05T01:42:48.605 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:48 smithi151 ceph-mon[35013]: osdmap e110: 12 total, 12 up, 12 in 2024-09-05T01:42:48.616 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:42:49.315 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:49 smithi012 ceph-mon[29942]: pgmap v570: 97 pgs: 35 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 44 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-05T01:42:49.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:49 smithi145 ceph-mon[34376]: pgmap v570: 97 pgs: 35 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 44 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-05T01:42:49.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:49 smithi151 ceph-mon[35013]: pgmap v570: 97 pgs: 35 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 44 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-09-05T01:42:49.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.672+0000 7fec9bc00640 1 -- 172.21.15.12:0/3174358511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec941010c0 msgr2=0x7fec94104e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:49.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.672+0000 7fec9bc00640 1 --2- 172.21.15.12:0/3174358511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec941010c0 0x7fec94104e70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fec8000aa40 tx=0x7fec8002b750 comp rx=0 tx=0).stop 2024-09-05T01:42:49.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.672+0000 7fec9bc00640 1 -- 172.21.15.12:0/3174358511 shutdown_connections 2024-09-05T01:42:49.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.672+0000 7fec9bc00640 1 --2- 172.21.15.12:0/3174358511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec94105580 0x7fec9410d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:49.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.672+0000 7fec9bc00640 1 --2- 172.21.15.12:0/3174358511 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec941010c0 0x7fec94104e70 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:49.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.672+0000 7fec9bc00640 1 --2- 172.21.15.12:0/3174358511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec94100710 0x7fec94100af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:49.674 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.672+0000 7fec9bc00640 1 -- 172.21.15.12:0/3174358511 >> 172.21.15.12:0/3174358511 conn(0x7fec940fba90 msgr2=0x7fec940fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:42:49.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.673+0000 7fec9bc00640 1 -- 172.21.15.12:0/3174358511 shutdown_connections 2024-09-05T01:42:49.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.673+0000 7fec9bc00640 1 -- 172.21.15.12:0/3174358511 wait complete. 2024-09-05T01:42:49.675 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.674+0000 7fec9bc00640 1 Processor -- start 2024-09-05T01:42:49.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.675+0000 7fec9bc00640 1 -- start start 2024-09-05T01:42:49.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.675+0000 7fec9bc00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec94100710 0x7fec94073a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:49.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.675+0000 7fec9bc00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec941010c0 0x7fec9406cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:49.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.675+0000 7fec9bc00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec94105580 0x7fec9406d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:49.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.675+0000 7fec9bc00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fec9410fca0 con 0x7fec941010c0 2024-09-05T01:42:49.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.675+0000 7fec9bc00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7fec9410fb20 con 0x7fec94105580 2024-09-05T01:42:49.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.675+0000 7fec9bc00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fec9410ff00 con 0x7fec94100710 2024-09-05T01:42:49.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.675+0000 7fec93e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec941010c0 0x7fec9406cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:49.677 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.675+0000 7fec99c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec94105580 0x7fec9406d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:49.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.675+0000 7fec99c00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec94105580 0x7fec9406d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.145:3300/0 says I am v2:172.21.15.12:54772/0 (socket says 172.21.15.12:54772) 2024-09-05T01:42:49.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.675+0000 7fec99c00640 1 -- 172.21.15.12:0/3156303655 learned_addr learned my addr 172.21.15.12:0/3156303655 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:42:49.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.676+0000 7fec99200640 1 --2- 172.21.15.12:0/3156303655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec94100710 0x7fec94073a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:49.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.676+0000 7fec99c00640 1 -- 172.21.15.12:0/3156303655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec94100710 msgr2=0x7fec94073a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:49.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.676+0000 7fec99c00640 1 --2- 172.21.15.12:0/3156303655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec94100710 0x7fec94073a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:49.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.676+0000 7fec99c00640 1 -- 172.21.15.12:0/3156303655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec941010c0 msgr2=0x7fec9406cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:49.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.676+0000 7fec99c00640 1 --2- 172.21.15.12:0/3156303655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec941010c0 0x7fec9406cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:49.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.676+0000 7fec99c00640 1 -- 172.21.15.12:0/3156303655 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec9406d5f0 con 0x7fec94105580 2024-09-05T01:42:49.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.676+0000 7fec93e00640 1 --2- 172.21.15.12:0/3156303655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec941010c0 0x7fec9406cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-05T01:42:49.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.677+0000 7fec99c00640 1 --2- 172.21.15.12:0/3156303655 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec94105580 0x7fec9406d000 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00eaa0 tx=0x7fec8c00ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:42:49.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.677+0000 7fec91600640 1 -- 172.21.15.12:0/3156303655 <== mon.2 v2:172.21.15.145:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8c00cdb0 con 0x7fec94105580 2024-09-05T01:42:49.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.678+0000 7fec9bc00640 1 -- 172.21.15.12:0/3156303655 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec9406d8e0 con 0x7fec94105580 2024-09-05T01:42:49.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.678+0000 7fec9bc00640 1 -- 172.21.15.12:0/3156303655 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec940718a0 con 0x7fec94105580 2024-09-05T01:42:49.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.678+0000 7fec91600640 1 -- 172.21.15.12:0/3156303655 <== mon.2 v2:172.21.15.145:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec8c005020 con 0x7fec94105580 2024-09-05T01:42:49.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.678+0000 7fec91600640 1 -- 172.21.15.12:0/3156303655 <== mon.2 v2:172.21.15.145:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8c0116d0 con 0x7fec94105580 2024-09-05T01:42:49.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.683+0000 7fec9bc00640 1 -- 172.21.15.12:0/3156303655 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec74005290 con 0x7fec94105580 2024-09-05T01:42:49.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.687+0000 7fec91600640 1 -- 172.21.15.12:0/3156303655 <== mon.2 v2:172.21.15.145:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7fec8c011870 con 0x7fec94105580 2024-09-05T01:42:49.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.689+0000 7fec91600640 1 --2- 172.21.15.12:0/3156303655 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fec7c0a2df0 0x7fec7c0a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:49.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.689+0000 7fec91600640 1 -- 172.21.15.12:0/3156303655 <== mon.2 v2:172.21.15.145:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 9085+0+0 (secure 0 0 0) 0x7fec8c0cf670 con 0x7fec94105580 2024-09-05T01:42:49.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.693+0000 7fec99200640 1 --2- 172.21.15.12:0/3156303655 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fec7c0a2df0 0x7fec7c0a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:49.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.694+0000 7fec99200640 1 --2- 172.21.15.12:0/3156303655 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fec7c0a2df0 0x7fec7c0a52b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fec88009bd0 tx=0x7fec88005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:42:49.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:49.696+0000 7fec91600640 1 -- 172.21.15.12:0/3156303655 <== mon.2 v2:172.21.15.145:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fec8c016030 con 0x7fec94105580 2024-09-05T01:42:50.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:50.042+0000 7fec9bc00640 1 -- 172.21.15.12:0/3156303655 --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fec74005580 con 0x7fec94105580 2024-09-05T01:42:50.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:50.275+0000 7fec91600640 1 -- 172.21.15.12:0/3156303655 <== mon.2 v2:172.21.15.145:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v111) ==== 181+0+0 (secure 0 0 0) 0x7fec8c09b9b0 con 0x7fec94105580 2024-09-05T01:42:50.279 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2024-09-05T01:42:50.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:50.280+0000 7fec9bc00640 1 -- 172.21.15.12:0/3156303655 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fec7c0a2df0 msgr2=0x7fec7c0a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:50.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:50.280+0000 7fec9bc00640 1 --2- 172.21.15.12:0/3156303655 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fec7c0a2df0 0x7fec7c0a52b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fec88009bd0 tx=0x7fec88005f90 comp rx=0 tx=0).stop 2024-09-05T01:42:50.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:50.280+0000 7fec9bc00640 1 -- 172.21.15.12:0/3156303655 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec94105580 msgr2=0x7fec9406d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:50.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:50.280+0000 7fec9bc00640 1 --2- 172.21.15.12:0/3156303655 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec94105580 0x7fec9406d000 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00eaa0 tx=0x7fec8c00ef60 comp rx=0 tx=0).stop 2024-09-05T01:42:50.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:50.281+0000 7fec9bc00640 1 -- 172.21.15.12:0/3156303655 shutdown_connections 2024-09-05T01:42:50.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:50.281+0000 7fec9bc00640 1 --2- 172.21.15.12:0/3156303655 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7fec7c0a2df0 0x7fec7c0a52b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:50.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:50.281+0000 7fec9bc00640 1 --2- 172.21.15.12:0/3156303655 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7fec94105580 0x7fec9406d000 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:50.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:50.281+0000 7fec9bc00640 1 --2- 172.21.15.12:0/3156303655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec941010c0 0x7fec9406cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:50.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:50.281+0000 7fec9bc00640 1 --2- 172.21.15.12:0/3156303655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec94100710 0x7fec94073a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:50.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:50.281+0000 7fec9bc00640 1 -- 172.21.15.12:0/3156303655 >> 172.21.15.12:0/3156303655 conn(0x7fec940fba90 msgr2=0x7fec940fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:42:50.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:50.282+0000 7fec9bc00640 1 -- 172.21.15.12:0/3156303655 shutdown_connections 2024-09-05T01:42:50.284 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:50.282+0000 7fec9bc00640 1 -- 172.21.15.12:0/3156303655 wait complete. 2024-09-05T01:42:50.309 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:50 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3156303655' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-05T01:42:50.310 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:50 smithi012 ceph-mon[29942]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-05T01:42:50.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:50 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3156303655' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-05T01:42:50.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:50 smithi145 ceph-mon[34376]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-05T01:42:50.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:50 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3156303655' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-05T01:42:50.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:50 smithi151 ceph-mon[35013]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-05T01:42:51.275 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4 shell --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-05T01:42:51.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:51 smithi012 ceph-mon[29942]: pgmap v571: 97 pgs: 30 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 52 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-05T01:42:51.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:51 smithi012 ceph-mon[29942]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-05T01:42:51.563 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:51 smithi012 ceph-mon[29942]: osdmap e111: 12 total, 12 up, 12 in 2024-09-05T01:42:51.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:51 smithi145 ceph-mon[34376]: pgmap v571: 97 pgs: 30 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 52 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-05T01:42:51.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:51 smithi145 ceph-mon[34376]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-05T01:42:51.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:51 smithi145 ceph-mon[34376]: osdmap e111: 12 total, 12 up, 12 in 2024-09-05T01:42:51.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:51 smithi151 ceph-mon[35013]: pgmap v571: 97 pgs: 30 active+clean+snaptrim_wait, 15 active+clean+snaptrim, 52 active+clean; 2.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-05T01:42:51.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:51 smithi151 ceph-mon[35013]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-05T01:42:51.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:51 smithi151 ceph-mon[35013]: osdmap e111: 12 total, 12 up, 12 in 2024-09-05T01:42:51.958 INFO:teuthology.orchestra.run.smithi012.stderr:Inferring config /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/mon.a/config 2024-09-05T01:42:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.935+0000 7faf4da00640 1 -- 172.21.15.12:0/2203715130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf48109b10 msgr2=0x7faf48116960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.935+0000 7faf4da00640 1 --2- 172.21.15.12:0/2203715130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf48109b10 0x7faf48116960 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7faf34009860 tx=0x7faf3402a360 comp rx=0 tx=0).stop 2024-09-05T01:42:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.935+0000 7faf4da00640 1 -- 172.21.15.12:0/2203715130 shutdown_connections 2024-09-05T01:42:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.935+0000 7faf4da00640 1 --2- 172.21.15.12:0/2203715130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf48116ea0 0x7faf48119290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.935+0000 7faf4da00640 1 --2- 172.21.15.12:0/2203715130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf48109b10 0x7faf48116960 secure :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7faf34009860 tx=0x7faf3402a360 comp rx=0 tx=0).stop 2024-09-05T01:42:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.935+0000 7faf4da00640 1 --2- 172.21.15.12:0/2203715130 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf481091f0 0x7faf481095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.935+0000 7faf4da00640 1 -- 172.21.15.12:0/2203715130 >> 172.21.15.12:0/2203715130 conn(0x7faf48073660 msgr2=0x7faf48073a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:42:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.937+0000 7faf4da00640 1 -- 172.21.15.12:0/2203715130 shutdown_connections 2024-09-05T01:42:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.937+0000 7faf4da00640 1 -- 172.21.15.12:0/2203715130 wait complete. 2024-09-05T01:42:52.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.938+0000 7faf4da00640 1 Processor -- start 2024-09-05T01:42:52.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.939+0000 7faf4da00640 1 -- start start 2024-09-05T01:42:52.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.939+0000 7faf4da00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf481091f0 0x7faf4810c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:52.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.940+0000 7faf4da00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf48116ea0 0x7faf4810cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:52.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.940+0000 7faf4da00640 1 --2- >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf4810d060 0x7faf481b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:52.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.940+0000 7faf4da00640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7faf4811c7b0 con 0x7faf481091f0 2024-09-05T01:42:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.940+0000 7faf4da00640 1 -- --> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] -- mon_getmap magic: 0 -- 0x7faf4811c630 con 0x7faf4810d060 2024-09-05T01:42:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.940+0000 7faf4da00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7faf4811c930 con 0x7faf48116ea0 2024-09-05T01:42:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.940+0000 7faf47e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf481091f0 0x7faf4810c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.940+0000 7faf47e00640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf481091f0 0x7faf4810c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57888/0 (socket says 172.21.15.12:57888) 2024-09-05T01:42:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.940+0000 7faf47e00640 1 -- 172.21.15.12:0/3308160516 learned_addr learned my addr 172.21.15.12:0/3308160516 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-05T01:42:52.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.940+0000 7faf47400640 1 --2- 172.21.15.12:0/3308160516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf48116ea0 0x7faf4810cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:52.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.941+0000 7faf47e00640 1 -- 172.21.15.12:0/3308160516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf48116ea0 msgr2=0x7faf4810cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:52.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.941+0000 7faf47e00640 1 --2- 172.21.15.12:0/3308160516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf48116ea0 0x7faf4810cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:52.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.941+0000 7faf47e00640 1 -- 172.21.15.12:0/3308160516 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf4810d060 msgr2=0x7faf481b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:52.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.941+0000 7faf47e00640 1 --2- 172.21.15.12:0/3308160516 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf4810d060 0x7faf481b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:52.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.941+0000 7faf47e00640 1 -- 172.21.15.12:0/3308160516 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf481b3960 con 0x7faf481091f0 2024-09-05T01:42:52.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.941+0000 7faf47e00640 1 --2- 172.21.15.12:0/3308160516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf481091f0 0x7faf4810c5e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7faf3800e9c0 tx=0x7faf3800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:42:52.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.942+0000 7faf44c00640 1 -- 172.21.15.12:0/3308160516 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3800ccc0 con 0x7faf481091f0 2024-09-05T01:42:52.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.942+0000 7faf44c00640 1 -- 172.21.15.12:0/3308160516 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf38005500 con 0x7faf481091f0 2024-09-05T01:42:52.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.942+0000 7faf44c00640 1 -- 172.21.15.12:0/3308160516 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf38010430 con 0x7faf481091f0 2024-09-05T01:42:52.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.943+0000 7faf4da00640 1 -- 172.21.15.12:0/3308160516 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf481b3c50 con 0x7faf481091f0 2024-09-05T01:42:52.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.943+0000 7faf4da00640 1 -- 172.21.15.12:0/3308160516 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf481b4110 con 0x7faf481091f0 2024-09-05T01:42:52.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.950+0000 7faf4da00640 1 -- 172.21.15.12:0/3308160516 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf28005290 con 0x7faf481091f0 2024-09-05T01:42:52.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.952+0000 7faf44c00640 1 -- 172.21.15.12:0/3308160516 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 26) ==== 137964+0+0 (secure 0 0 0) 0x7faf38005000 con 0x7faf481091f0 2024-09-05T01:42:52.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.957+0000 7faf44c00640 1 --2- 172.21.15.12:0/3308160516 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7faf2c0a2df0 0x7faf2c0a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-05T01:42:52.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.957+0000 7faf44c00640 1 -- 172.21.15.12:0/3308160516 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 8503+0+0 (secure 0 0 0) 0x7faf380cf7a0 con 0x7faf481091f0 2024-09-05T01:42:52.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.958+0000 7faf47400640 1 --2- 172.21.15.12:0/3308160516 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7faf2c0a2df0 0x7faf2c0a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-05T01:42:52.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.960+0000 7faf47400640 1 --2- 172.21.15.12:0/3308160516 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7faf2c0a2df0 0x7faf2c0a52b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faf34035040 tx=0x7faf34000bc0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-05T01:42:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:52.962+0000 7faf44c00640 1 -- 172.21.15.12:0/3308160516 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faf3809c370 con 0x7faf481091f0 2024-09-05T01:42:53.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:53.325+0000 7faf4da00640 1 -- 172.21.15.12:0/3308160516 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7faf28005580 con 0x7faf481091f0 2024-09-05T01:42:53.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:53 smithi012 ceph-mon[29942]: pgmap v573: 65 pgs: 30 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 21 active+clean; 995 MiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:42:53.583 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:53 smithi145 ceph-mon[34376]: pgmap v573: 65 pgs: 30 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 21 active+clean; 995 MiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:42:53.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:53 smithi151 ceph-mon[35013]: pgmap v573: 65 pgs: 30 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 21 active+clean; 995 MiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:42:54.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:54.310+0000 7faf44c00640 1 -- 172.21.15.12:0/3308160516 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v112) ==== 169+0+0 (secure 0 0 0) 0x7faf38086020 con 0x7faf481091f0 2024-09-05T01:42:54.315 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2024-09-05T01:42:54.315 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:54.314+0000 7faf4da00640 1 -- 172.21.15.12:0/3308160516 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7faf2c0a2df0 msgr2=0x7faf2c0a52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:54.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:54.315+0000 7faf4da00640 1 --2- 172.21.15.12:0/3308160516 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7faf2c0a2df0 0x7faf2c0a52b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faf34035040 tx=0x7faf34000bc0 comp rx=0 tx=0).stop 2024-09-05T01:42:54.316 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:54.315+0000 7faf4da00640 1 -- 172.21.15.12:0/3308160516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf481091f0 msgr2=0x7faf4810c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-05T01:42:54.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:54.315+0000 7faf4da00640 1 --2- 172.21.15.12:0/3308160516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf481091f0 0x7faf4810c5e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7faf3800e9c0 tx=0x7faf3800ee80 comp rx=0 tx=0).stop 2024-09-05T01:42:54.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:54.316+0000 7faf4da00640 1 -- 172.21.15.12:0/3308160516 shutdown_connections 2024-09-05T01:42:54.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:54.316+0000 7faf4da00640 1 --2- 172.21.15.12:0/3308160516 >> [v2:172.21.15.12:6800/3451745620,v1:172.21.15.12:6801/3451745620] conn(0x7faf2c0a2df0 0x7faf2c0a52b0 secure :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faf34035040 tx=0x7faf34000bc0 comp rx=0 tx=0).stop 2024-09-05T01:42:54.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:54.316+0000 7faf4da00640 1 --2- 172.21.15.12:0/3308160516 >> [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] conn(0x7faf4810d060 0x7faf481b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:54.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:54.316+0000 7faf4da00640 1 --2- 172.21.15.12:0/3308160516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf48116ea0 0x7faf4810cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:54.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:54.316+0000 7faf4da00640 1 --2- 172.21.15.12:0/3308160516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf481091f0 0x7faf4810c5e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-05T01:42:54.317 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:54.316+0000 7faf4da00640 1 -- 172.21.15.12:0/3308160516 >> 172.21.15.12:0/3308160516 conn(0x7faf48073660 msgr2=0x7faf481174c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-05T01:42:54.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:54.317+0000 7faf4da00640 1 -- 172.21.15.12:0/3308160516 shutdown_connections 2024-09-05T01:42:54.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-05T01:42:54.317+0000 7faf4da00640 1 -- 172.21.15.12:0/3308160516 wait complete. 2024-09-05T01:42:54.562 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:54 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3308160516' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-05T01:42:54.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:54 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3308160516' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-05T01:42:54.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:54 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3308160516' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-05T01:42:55.061 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-05T01:42:55.156 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-05T01:42:55.201 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-05T01:42:55.250 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-05T01:42:55.250 DEBUG:teuthology.orchestra.run.smithi012:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-05T01:42:55.309 DEBUG:teuthology.orchestra.run.smithi145:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-05T01:42:55.332 DEBUG:teuthology.orchestra.run.smithi151:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-05T01:42:55.347 INFO:tasks.cephadm:Stopping all daemons... 2024-09-05T01:42:55.347 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-05T01:42:55.347 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mon.a 2024-09-05T01:42:55.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:55 smithi145 ceph-mon[34376]: pgmap v574: 65 pgs: 30 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 21 active+clean; 988 MiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:42:55.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:55 smithi145 ceph-mon[34376]: from='client.? 172.21.15.12:0/3308160516' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-05T01:42:55.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:55 smithi145 ceph-mon[34376]: osdmap e112: 12 total, 12 up, 12 in 2024-09-05T01:42:55.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:55 smithi151 ceph-mon[35013]: pgmap v574: 65 pgs: 30 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 21 active+clean; 988 MiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:42:55.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:55 smithi151 ceph-mon[35013]: from='client.? 172.21.15.12:0/3308160516' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-05T01:42:55.604 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:55 smithi151 ceph-mon[35013]: osdmap e112: 12 total, 12 up, 12 in 2024-09-05T01:42:55.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:55 smithi012 ceph-mon[29942]: pgmap v574: 65 pgs: 30 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 21 active+clean; 988 MiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-05T01:42:55.812 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:55 smithi012 ceph-mon[29942]: from='client.? 172.21.15.12:0/3308160516' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-05T01:42:55.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:55 smithi012 ceph-mon[29942]: osdmap e112: 12 total, 12 up, 12 in 2024-09-05T01:42:55.813 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:55 smithi012 systemd[1]: Stopping Ceph mon.a for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:42:56.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:55 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-a[29938]: 2024-09-05T01:42:55.995+0000 7f403ae00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:42:56.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:55 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-a[29938]: 2024-09-05T01:42:55.995+0000 7f403ae00640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-05T01:42:56.312 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:56 smithi012 podman[105617]: 2024-09-05 01:42:56.140591739 +0000 UTC m=+0.292985781 container died 2b0036d96b7cab00d6a5d5d605f0046ba3fbeccf207605341a858b7868d5efaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2) 2024-09-05T01:42:56.782 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:56 smithi012 podman[105617]: 2024-09-05 01:42:56.58883108 +0000 UTC m=+0.741225114 container cleanup 2b0036d96b7cab00d6a5d5d605f0046ba3fbeccf207605341a858b7868d5efaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-a, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T01:42:56.782 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:56 smithi012 bash[105617]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-a 2024-09-05T01:42:57.050 INFO:journalctl@ceph.mon.a.smithi012.stdout:Sep 05 01:42:56 smithi012 podman[105628]: 2024-09-05 01:42:56.781899713 +0000 UTC m=+0.630171195 container remove 2b0036d96b7cab00d6a5d5d605f0046ba3fbeccf207605341a858b7868d5efaa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-09-05T01:42:57.071 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mon.a.service' 2024-09-05T01:42:57.175 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:42:57.176 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-05T01:42:57.176 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-05T01:42:57.176 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mon.b 2024-09-05T01:42:57.584 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:57 smithi145 systemd[1]: Stopping Ceph mon.b for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:42:57.990 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:57 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-b[34372]: 2024-09-05T01:42:57.597+0000 7f570aecf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:42:57.990 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:57 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-b[34372]: 2024-09-05T01:42:57.597+0000 7f570aecf640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-05T01:42:57.990 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:57 smithi145 podman[71780]: 2024-09-05 01:42:57.729862898 +0000 UTC m=+0.273691580 container died 9fe420c2f8a5b7b2f880c3fbf10cda1d4c2fe15374ba86da1db24ec812e79bc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-b, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-09-05T01:42:58.333 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:58 smithi145 podman[71780]: 2024-09-05 01:42:58.098135571 +0000 UTC m=+0.641964247 container cleanup 9fe420c2f8a5b7b2f880c3fbf10cda1d4c2fe15374ba86da1db24ec812e79bc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-05T01:42:58.334 INFO:journalctl@ceph.mon.b.smithi145.stdout:Sep 05 01:42:58 smithi145 bash[71780]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-b 2024-09-05T01:42:58.511 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mon.b.service' 2024-09-05T01:42:58.558 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:42:58.558 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-05T01:42:58.559 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-05T01:42:58.559 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mon.c 2024-09-05T01:42:58.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:58 smithi151 systemd[1]: Stopping Ceph mon.c for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:42:59.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:58 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-c[35004]: 2024-09-05T01:42:58.884+0000 7fe4309dc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:42:59.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:58 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-c[35004]: 2024-09-05T01:42:58.884+0000 7fe4309dc640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-05T01:42:59.354 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:59 smithi151 podman[71672]: 2024-09-05 01:42:59.10965314 +0000 UTC m=+0.314574730 container died 28c7935e5f5c2ee92797c961ad12b0240848cbb31fdd4fcbd4f23a3abc010d1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-c, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-05T01:42:59.722 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:59 smithi151 podman[71672]: 2024-09-05 01:42:59.489723705 +0000 UTC m=+0.694645283 container cleanup 28c7935e5f5c2ee92797c961ad12b0240848cbb31fdd4fcbd4f23a3abc010d1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-05T01:42:59.722 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:59 smithi151 bash[71672]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-c 2024-09-05T01:42:59.956 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mon.c.service' 2024-09-05T01:42:59.978 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:59 smithi151 podman[71683]: 2024-09-05 01:42:59.721702527 +0000 UTC m=+0.610809724 container remove 28c7935e5f5c2ee92797c961ad12b0240848cbb31fdd4fcbd4f23a3abc010d1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mon-c, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-05T01:42:59.978 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:59 smithi151 systemd[1]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mon.c.service: Deactivated successfully. 2024-09-05T01:42:59.978 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:59 smithi151 systemd[1]: Stopped Ceph mon.c for 0d44cd7e-6b24-11ef-bcd6-c7b262605968. 2024-09-05T01:42:59.978 INFO:journalctl@ceph.mon.c.smithi151.stdout:Sep 05 01:42:59 smithi151 systemd[1]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mon.c.service: Consumed 18.591s CPU time. 2024-09-05T01:43:00.001 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:43:00.001 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-05T01:43:00.001 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-05T01:43:00.001 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mgr.x 2024-09-05T01:43:00.312 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:43:00 smithi012 systemd[1]: Stopping Ceph mgr.x for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:43:00.783 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:43:00 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:43:00.422+0000 7f2e53c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:43:00.783 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:43:00 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x[30170]: 2024-09-05T01:43:00.422+0000 7f2e53c00640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-05T01:43:00.783 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:43:00 smithi012 podman[105745]: 2024-09-05 01:43:00.514946126 +0000 UTC m=+0.230430209 container died 2b85e24fdb2467858c93880764802bac49f202333eb79b978ea3349b178247d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True) 2024-09-05T01:43:01.062 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:43:00 smithi012 podman[105745]: 2024-09-05 01:43:00.913154103 +0000 UTC m=+0.628638186 container cleanup 2b85e24fdb2467858c93880764802bac49f202333eb79b978ea3349b178247d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-05T01:43:01.062 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:43:00 smithi012 bash[105745]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x 2024-09-05T01:43:01.353 INFO:journalctl@ceph.mgr.x.smithi012.stdout:Sep 05 01:43:01 smithi012 podman[105756]: 2024-09-05 01:43:01.106342313 +0000 UTC m=+0.577117324 container remove 2b85e24fdb2467858c93880764802bac49f202333eb79b978ea3349b178247d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:91c8a7e56f7ba6f8ae8d6d8c0ae8cae96c5619e4, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-x, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-09-05T01:43:01.372 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mgr.x.service' 2024-09-05T01:43:01.451 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:43:01.451 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-05T01:43:01.451 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-05T01:43:01.451 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mgr.y 2024-09-05T01:43:01.781 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:43:01 smithi145 systemd[1]: Stopping Ceph mgr.y for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:43:02.084 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:43:01 smithi145 podman[71901]: 2024-09-05 01:43:01.781199311 +0000 UTC m=+0.137085954 container died 0007f54337ed2aeab7e04c120797c248cb8a3512cc90ae71720c2adda8a25c50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-91c8a7e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T01:43:02.562 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:43:02 smithi145 podman[71901]: 2024-09-05 01:43:02.202094626 +0000 UTC m=+0.557981268 container cleanup 0007f54337ed2aeab7e04c120797c248cb8a3512cc90ae71720c2adda8a25c50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True) 2024-09-05T01:43:02.562 INFO:journalctl@ceph.mgr.y.smithi145.stdout:Sep 05 01:43:02 smithi145 bash[71901]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-y 2024-09-05T01:43:02.774 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mgr.y.service' 2024-09-05T01:43:02.809 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:43:02.809 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-05T01:43:02.809 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-05T01:43:02.810 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mgr.z 2024-09-05T01:43:03.104 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:43:02 smithi151 systemd[1]: Stopping Ceph mgr.z for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:43:03.410 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:43:03 smithi151 podman[71796]: 2024-09-05 01:43:03.129206804 +0000 UTC m=+0.129438210 container died 075d33658ae8cf19e83ba40f137413fa7c752fca9c0d09dbc2893fd8ceecdabe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-05T01:43:03.794 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:43:03 smithi151 podman[71796]: 2024-09-05 01:43:03.525703776 +0000 UTC m=+0.525935138 container cleanup 075d33658ae8cf19e83ba40f137413fa7c752fca9c0d09dbc2893fd8ceecdabe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-91c8a7e, GIT_BRANCH=HEAD) 2024-09-05T01:43:03.794 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Sep 05 01:43:03 smithi151 bash[71796]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mgr-z 2024-09-05T01:43:03.923 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mgr.z.service' 2024-09-05T01:43:03.958 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:43:03.958 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-05T01:43:03.958 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-05T01:43:03.958 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.0 2024-09-05T01:43:04.312 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:43:04 smithi012 systemd[1]: Stopping Ceph osd.0 for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:43:04.812 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:43:04 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-0[43795]: 2024-09-05T01:43:04.361+0000 7fca90c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:43:04.812 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:43:04 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-0[43795]: 2024-09-05T01:43:04.361+0000 7fca90c00640 -1 osd.0 112 *** Got signal Terminated *** 2024-09-05T01:43:04.812 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:43:04 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-0[43795]: 2024-09-05T01:43:04.361+0000 7fca90c00640 -1 osd.0 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T01:43:10.310 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:43:10 smithi012 podman[105864]: 2024-09-05 01:43:10.045491381 +0000 UTC m=+5.794018961 container died 0c25f19fab14dd9214cd7224f7d8e0e482ac7646a5faf64e7ba4ec04d502fc2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-0, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-05T01:43:10.562 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:43:10 smithi012 podman[105864]: 2024-09-05 01:43:10.424734815 +0000 UTC m=+6.173262393 container cleanup 0c25f19fab14dd9214cd7224f7d8e0e482ac7646a5faf64e7ba4ec04d502fc2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-91c8a7e, org.label-schema.license=GPLv2) 2024-09-05T01:43:10.562 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:43:10 smithi012 bash[105864]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-0 2024-09-05T01:43:11.062 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:43:10 smithi012 podman[105881]: 2024-09-05 01:43:10.751847336 +0000 UTC m=+0.700646506 container remove 0c25f19fab14dd9214cd7224f7d8e0e482ac7646a5faf64e7ba4ec04d502fc2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-91c8a7e) 2024-09-05T01:43:11.473 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:43:11 smithi012 podman[105972]: 2024-09-05 01:43:11.108456875 +0000 UTC m=+0.027538326 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:43:11.473 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:43:11 smithi012 podman[105972]: 2024-09-05 01:43:11.227820977 +0000 UTC m=+0.146902414 container create 8f0777c250e9f6db0263d43768508ab835a1df9070d12e42475b2a0ba216eb13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T01:43:11.473 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:43:11 smithi012 podman[105972]: 2024-09-05 01:43:11.472367867 +0000 UTC m=+0.391449328 container init 8f0777c250e9f6db0263d43768508ab835a1df9070d12e42475b2a0ba216eb13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-09-05T01:43:11.757 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:43:11 smithi012 podman[105972]: 2024-09-05 01:43:11.479897688 +0000 UTC m=+0.398979134 container start 8f0777c250e9f6db0263d43768508ab835a1df9070d12e42475b2a0ba216eb13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-05T01:43:11.757 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:43:11 smithi012 podman[105972]: 2024-09-05 01:43:11.572257705 +0000 UTC m=+0.491339181 container attach 8f0777c250e9f6db0263d43768508ab835a1df9070d12e42475b2a0ba216eb13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, ceph=True, org.label-schema.build-date=20240731) 2024-09-05T01:43:11.757 INFO:journalctl@ceph.osd.0.smithi012.stdout:Sep 05 01:43:11 smithi012 podman[105972]: 2024-09-05 01:43:11.756390677 +0000 UTC m=+0.675472121 container died 8f0777c250e9f6db0263d43768508ab835a1df9070d12e42475b2a0ba216eb13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-0-deactivate, RELEASE=squid-91c8a7e, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-05T01:43:12.482 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.0.service' 2024-09-05T01:43:12.573 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:43:12.574 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-05T01:43:12.574 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-05T01:43:12.574 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.1 2024-09-05T01:43:12.886 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:43:12 smithi145 systemd[1]: Stopping Ceph osd.1 for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:43:13.150 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:43:12 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-1[38825]: 2024-09-05T01:43:12.956+0000 7f8df9b3f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:43:13.150 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:43:12 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-1[38825]: 2024-09-05T01:43:12.956+0000 7f8df9b3f640 -1 osd.1 112 *** Got signal Terminated *** 2024-09-05T01:43:13.150 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:43:12 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-1[38825]: 2024-09-05T01:43:12.956+0000 7f8df9b3f640 -1 osd.1 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T01:43:18.891 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:43:18 smithi145 podman[72028]: 2024-09-05 01:43:18.614382478 +0000 UTC m=+5.851193511 container died a46b5aeefb54e8c964a698274e21fe84df9c58758e07ca1efa061f373ac2e3b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-1, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-91c8a7e) 2024-09-05T01:43:19.308 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:43:18 smithi145 podman[72028]: 2024-09-05 01:43:18.981526416 +0000 UTC m=+6.218337452 container cleanup a46b5aeefb54e8c964a698274e21fe84df9c58758e07ca1efa061f373ac2e3b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-1, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T01:43:19.309 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:43:18 smithi145 bash[72028]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-1 2024-09-05T01:43:19.584 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:43:19 smithi145 podman[72054]: 2024-09-05 01:43:19.30826326 +0000 UTC m=+0.692203775 container remove a46b5aeefb54e8c964a698274e21fe84df9c58758e07ca1efa061f373ac2e3b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-05T01:43:19.904 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:43:19 smithi145 podman[72141]: 2024-09-05 01:43:19.522787278 +0000 UTC m=+0.015603378 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:43:19.904 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:43:19 smithi145 podman[72141]: 2024-09-05 01:43:19.676045663 +0000 UTC m=+0.168861752 container create 6144b49f3ee1ac7d241fea34dfea679a519d6f81ac21a6c34ee929de4573ca55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-05T01:43:19.904 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:43:19 smithi145 podman[72141]: 2024-09-05 01:43:19.903590816 +0000 UTC m=+0.396406909 container init 6144b49f3ee1ac7d241fea34dfea679a519d6f81ac21a6c34ee929de4573ca55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T01:43:20.201 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:43:19 smithi145 podman[72141]: 2024-09-05 01:43:19.907097089 +0000 UTC m=+0.399913181 container start 6144b49f3ee1ac7d241fea34dfea679a519d6f81ac21a6c34ee929de4573ca55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-91c8a7e, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD) 2024-09-05T01:43:20.201 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:43:20 smithi145 podman[72141]: 2024-09-05 01:43:20.012108299 +0000 UTC m=+0.504924392 container attach 6144b49f3ee1ac7d241fea34dfea679a519d6f81ac21a6c34ee929de4573ca55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-91c8a7e, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-05T01:43:20.557 INFO:journalctl@ceph.osd.1.smithi145.stdout:Sep 05 01:43:20 smithi145 podman[72141]: 2024-09-05 01:43:20.200710309 +0000 UTC m=+0.693526402 container died 6144b49f3ee1ac7d241fea34dfea679a519d6f81ac21a6c34ee929de4573ca55 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-91c8a7e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-05T01:43:20.844 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.1.service' 2024-09-05T01:43:20.883 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:43:20.883 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-05T01:43:20.884 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-05T01:43:20.884 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.2 2024-09-05T01:43:21.274 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:43:20 smithi151 systemd[1]: Stopping Ceph osd.2 for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:43:21.604 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:43:21 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-2[39994]: 2024-09-05T01:43:21.273+0000 7fbd2492a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:43:21.604 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:43:21 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-2[39994]: 2024-09-05T01:43:21.273+0000 7fbd2492a640 -1 osd.2 112 *** Got signal Terminated *** 2024-09-05T01:43:21.604 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:43:21 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-2[39994]: 2024-09-05T01:43:21.273+0000 7fbd2492a640 -1 osd.2 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T01:43:27.193 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:43:26 smithi151 podman[71933]: 2024-09-05 01:43:26.888368654 +0000 UTC m=+5.806022211 container died fbf38a77de197f7f863e0da9a5103b5159d6771890760bde1cc3eb9d43094a9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-05T01:43:27.576 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:43:27 smithi151 podman[71933]: 2024-09-05 01:43:27.281605401 +0000 UTC m=+6.199258957 container cleanup fbf38a77de197f7f863e0da9a5103b5159d6771890760bde1cc3eb9d43094a9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-05T01:43:27.576 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:43:27 smithi151 bash[71933]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-2 2024-09-05T01:43:27.854 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:43:27 smithi151 podman[71951]: 2024-09-05 01:43:27.575766874 +0000 UTC m=+0.671596057 container remove fbf38a77de197f7f863e0da9a5103b5159d6771890760bde1cc3eb9d43094a9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD) 2024-09-05T01:43:28.138 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:43:27 smithi151 podman[72038]: 2024-09-05 01:43:27.789924522 +0000 UTC m=+0.016030308 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:43:28.138 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:43:27 smithi151 podman[72038]: 2024-09-05 01:43:27.918950482 +0000 UTC m=+0.145056254 container create 21848625bd839f2b64db4015f250d29be55cb1657717b338b182c7127750b4a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T01:43:28.139 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:43:28 smithi151 podman[72038]: 2024-09-05 01:43:28.138267165 +0000 UTC m=+0.364372935 container init 21848625bd839f2b64db4015f250d29be55cb1657717b338b182c7127750b4a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-05T01:43:28.513 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:43:28 smithi151 podman[72038]: 2024-09-05 01:43:28.14187898 +0000 UTC m=+0.367984752 container start 21848625bd839f2b64db4015f250d29be55cb1657717b338b182c7127750b4a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-05T01:43:28.513 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:43:28 smithi151 podman[72038]: 2024-09-05 01:43:28.2385523 +0000 UTC m=+0.464658080 container attach 21848625bd839f2b64db4015f250d29be55cb1657717b338b182c7127750b4a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-05T01:43:28.854 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:43:28 smithi151 podman[72038]: 2024-09-05 01:43:28.513169445 +0000 UTC m=+0.739275226 container died 21848625bd839f2b64db4015f250d29be55cb1657717b338b182c7127750b4a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T01:43:29.224 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.2.service' 2024-09-05T01:43:29.249 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:43:29 smithi151 podman[72061]: 2024-09-05 01:43:29.201362867 +0000 UTC m=+0.682163862 container remove 21848625bd839f2b64db4015f250d29be55cb1657717b338b182c7127750b4a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T01:43:29.249 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:43:29 smithi151 systemd[1]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-05T01:43:29.249 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:43:29 smithi151 systemd[1]: Stopped Ceph osd.2 for 0d44cd7e-6b24-11ef-bcd6-c7b262605968. 2024-09-05T01:43:29.249 INFO:journalctl@ceph.osd.2.smithi151.stdout:Sep 05 01:43:29 smithi151 systemd[1]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.2.service: Consumed 12min 3.706s CPU time. 2024-09-05T01:43:29.267 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:43:29.267 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-05T01:43:29.268 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-05T01:43:29.268 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.3 2024-09-05T01:43:29.689 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 05 01:43:29 smithi012 systemd[1]: Stopping Ceph osd.3 for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:43:30.015 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 05 01:43:29 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-3[50569]: 2024-09-05T01:43:29.687+0000 7f06fa000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:43:30.015 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 05 01:43:29 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-3[50569]: 2024-09-05T01:43:29.687+0000 7f06fa000640 -1 osd.3 112 *** Got signal Terminated *** 2024-09-05T01:43:30.015 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 05 01:43:29 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-3[50569]: 2024-09-05T01:43:29.687+0000 7f06fa000640 -1 osd.3 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T01:43:31.104 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:30 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:30.846+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.276373+0000 front 2024-09-05T01:43:06.276333+0000 (oldest deadline 2024-09-05T01:43:30.376132+0000) 2024-09-05T01:43:31.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:31 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:31.301+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:32.104 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:31 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:31.841+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.276373+0000 front 2024-09-05T01:43:06.276333+0000 (oldest deadline 2024-09-05T01:43:30.376132+0000) 2024-09-05T01:43:32.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:31 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:31.791+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:32.312 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 05 01:43:31 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-3[50569]: 2024-09-05T01:43:31.811+0000 7f06f5a00640 -1 osd.3 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:08.528963+0000 front 2024-09-05T01:43:08.529027+0000 (oldest deadline 2024-09-05T01:43:30.829129+0000) 2024-09-05T01:43:32.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:32 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:32.311+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:33.062 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 05 01:43:32 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-3[50569]: 2024-09-05T01:43:32.802+0000 7f06f5a00640 -1 osd.3 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:08.528963+0000 front 2024-09-05T01:43:08.529027+0000 (oldest deadline 2024-09-05T01:43:30.829129+0000) 2024-09-05T01:43:33.063 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:32 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:32.865+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:33.104 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:32 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:32.835+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.276373+0000 front 2024-09-05T01:43:06.276333+0000 (oldest deadline 2024-09-05T01:43:30.376132+0000) 2024-09-05T01:43:33.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:32 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:32.751+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:33.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:33 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:33.330+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:34.104 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:33 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:33.796+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.276373+0000 front 2024-09-05T01:43:06.276333+0000 (oldest deadline 2024-09-05T01:43:30.376132+0000) 2024-09-05T01:43:34.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:33 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:33.798+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:34.312 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 05 01:43:33 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-3[50569]: 2024-09-05T01:43:33.836+0000 7f06f5a00640 -1 osd.3 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:08.528963+0000 front 2024-09-05T01:43:08.529027+0000 (oldest deadline 2024-09-05T01:43:30.829129+0000) 2024-09-05T01:43:34.313 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:33 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:33.910+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:34.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:34 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:34.042+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:34.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:34 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:34.370+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:35.104 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:34 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:34.835+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.276373+0000 front 2024-09-05T01:43:06.276333+0000 (oldest deadline 2024-09-05T01:43:30.376132+0000) 2024-09-05T01:43:35.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:34 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:34.842+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:35.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:34 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:34.899+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:35.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:35 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:35.051+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:35.762 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 05 01:43:35 smithi012 podman[106074]: 2024-09-05 01:43:35.479024547 +0000 UTC m=+5.918638581 container died cdc1450fd3949945d7b2e7c9bde6d87b5656af80bbdd2d6e8da61e3a727ea178 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-3, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-05T01:43:35.762 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:35 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:35.404+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:36.062 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:35 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:35.867+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:36.062 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 05 01:43:35 smithi012 podman[106074]: 2024-09-05 01:43:35.851198356 +0000 UTC m=+6.290812389 container cleanup cdc1450fd3949945d7b2e7c9bde6d87b5656af80bbdd2d6e8da61e3a727ea178 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T01:43:36.063 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 05 01:43:35 smithi012 bash[106074]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-3 2024-09-05T01:43:36.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:36 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:36.076+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:36.354 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:35 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:35.871+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.276373+0000 front 2024-09-05T01:43:06.276333+0000 (oldest deadline 2024-09-05T01:43:30.376132+0000) 2024-09-05T01:43:36.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:35 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:35.858+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:36.369 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 05 01:43:36 smithi012 podman[106104]: 2024-09-05 01:43:36.144397551 +0000 UTC m=+0.655012472 container remove cdc1450fd3949945d7b2e7c9bde6d87b5656af80bbdd2d6e8da61e3a727ea178 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-3, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-05T01:43:36.632 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:36 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:36.368+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:36.834 INFO:journalctl@ceph.osd.4.smithi145.stdout:Sep 05 01:43:36 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-4[45785]: 2024-09-05T01:43:36.348+0000 7fd33415e640 -1 osd.4 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.397131+0000 front 2024-09-05T01:43:06.397114+0000 (oldest deadline 2024-09-05T01:43:35.797770+0000) 2024-09-05T01:43:36.890 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:36 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:36.864+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:36.890 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 05 01:43:36 smithi012 podman[106191]: 2024-09-05 01:43:36.536571633 +0000 UTC m=+0.028251415 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:43:36.890 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 05 01:43:36 smithi012 podman[106191]: 2024-09-05 01:43:36.645401778 +0000 UTC m=+0.137081559 container create a51fdf8bb06da2cf192d0dd02395f10c6a1647b64e7a8eb0309c23c3f6f32cf1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, GIT_CLEAN=True) 2024-09-05T01:43:37.163 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 05 01:43:36 smithi012 podman[106191]: 2024-09-05 01:43:36.889855706 +0000 UTC m=+0.381535488 container init a51fdf8bb06da2cf192d0dd02395f10c6a1647b64e7a8eb0309c23c3f6f32cf1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T01:43:37.163 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 05 01:43:36 smithi012 podman[106191]: 2024-09-05 01:43:36.896860133 +0000 UTC m=+0.388539915 container start a51fdf8bb06da2cf192d0dd02395f10c6a1647b64e7a8eb0309c23c3f6f32cf1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T01:43:37.163 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 05 01:43:36 smithi012 podman[106191]: 2024-09-05 01:43:36.972861652 +0000 UTC m=+0.464541438 container attach a51fdf8bb06da2cf192d0dd02395f10c6a1647b64e7a8eb0309c23c3f6f32cf1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-3-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-05T01:43:37.354 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:36 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:36.863+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.276373+0000 front 2024-09-05T01:43:06.276333+0000 (oldest deadline 2024-09-05T01:43:30.376132+0000) 2024-09-05T01:43:37.355 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:36 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:36.871+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:37.399 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:37 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:37.121+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:37.417 INFO:journalctl@ceph.osd.3.smithi012.stdout:Sep 05 01:43:37 smithi012 podman[106214]: 2024-09-05 01:43:37.202289351 +0000 UTC m=+0.026506443 container died a51fdf8bb06da2cf192d0dd02395f10c6a1647b64e7a8eb0309c23c3f6f32cf1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , ceph=True) 2024-09-05T01:43:37.417 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:37 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:37.364+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:37.710 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.3.service' 2024-09-05T01:43:37.790 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:43:37.790 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-05T01:43:37.791 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-05T01:43:37.791 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.4 2024-09-05T01:43:37.814 INFO:journalctl@ceph.osd.4.smithi145.stdout:Sep 05 01:43:37 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-4[45785]: 2024-09-05T01:43:37.398+0000 7fd33415e640 -1 osd.4 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.397131+0000 front 2024-09-05T01:43:06.397114+0000 (oldest deadline 2024-09-05T01:43:35.797770+0000) 2024-09-05T01:43:38.062 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:37 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:37.835+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:38.083 INFO:journalctl@ceph.osd.4.smithi145.stdout:Sep 05 01:43:37 smithi145 systemd[1]: Stopping Ceph osd.4 for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:43:38.104 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:37 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:37.841+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.276373+0000 front 2024-09-05T01:43:06.276333+0000 (oldest deadline 2024-09-05T01:43:30.376132+0000) 2024-09-05T01:43:38.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:37 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:37.849+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:38.380 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:38 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:38.097+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:38.381 INFO:journalctl@ceph.osd.4.smithi145.stdout:Sep 05 01:43:38 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-4[45785]: 2024-09-05T01:43:38.098+0000 7fd337b59640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:43:38.381 INFO:journalctl@ceph.osd.4.smithi145.stdout:Sep 05 01:43:38 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-4[45785]: 2024-09-05T01:43:38.098+0000 7fd337b59640 -1 osd.4 112 *** Got signal Terminated *** 2024-09-05T01:43:38.381 INFO:journalctl@ceph.osd.4.smithi145.stdout:Sep 05 01:43:38 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-4[45785]: 2024-09-05T01:43:38.098+0000 7fd337b59640 -1 osd.4 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T01:43:38.381 INFO:journalctl@ceph.osd.4.smithi145.stdout:Sep 05 01:43:38 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-4[45785]: 2024-09-05T01:43:38.379+0000 7fd33415e640 -1 osd.4 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.397131+0000 front 2024-09-05T01:43:06.397114+0000 (oldest deadline 2024-09-05T01:43:35.797770+0000) 2024-09-05T01:43:38.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:38 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:38.338+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:39.104 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:38 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:38.861+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.276373+0000 front 2024-09-05T01:43:06.276333+0000 (oldest deadline 2024-09-05T01:43:30.376132+0000) 2024-09-05T01:43:39.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:38 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:38.818+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:39.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:38 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:38.858+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:39.414 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:39 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:39.132+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:39.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:39 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:39.386+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:39.833 INFO:journalctl@ceph.osd.4.smithi145.stdout:Sep 05 01:43:39 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-4[45785]: 2024-09-05T01:43:39.413+0000 7fd33415e640 -1 osd.4 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.397131+0000 front 2024-09-05T01:43:06.397114+0000 (oldest deadline 2024-09-05T01:43:35.797770+0000) 2024-09-05T01:43:40.105 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:39 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:39.860+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.276373+0000 front 2024-09-05T01:43:06.276333+0000 (oldest deadline 2024-09-05T01:43:30.376132+0000) 2024-09-05T01:43:40.105 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:39 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:39.860+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.377701+0000 front 2024-09-05T01:43:17.377643+0000 (oldest deadline 2024-09-05T01:43:39.077715+0000) 2024-09-05T01:43:40.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:39 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:39.769+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:40.313 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:39 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:39.901+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:40.584 INFO:journalctl@ceph.osd.4.smithi145.stdout:Sep 05 01:43:40 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-4[45785]: 2024-09-05T01:43:40.371+0000 7fd33415e640 -1 osd.4 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.397131+0000 front 2024-09-05T01:43:06.397114+0000 (oldest deadline 2024-09-05T01:43:35.797770+0000) 2024-09-05T01:43:40.584 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:40 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:40.143+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:40.682 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:40 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:40.368+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:40.683 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:40 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:40.368+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:43:41.062 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:40 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:40.877+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:41.062 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:40 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:40.877+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:14.631148+0000 front 2024-09-05T01:43:14.631234+0000 (oldest deadline 2024-09-05T01:43:39.931199+0000) 2024-09-05T01:43:41.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:40 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:40.799+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:41.104 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:40 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:40.846+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.276373+0000 front 2024-09-05T01:43:06.276333+0000 (oldest deadline 2024-09-05T01:43:30.376132+0000) 2024-09-05T01:43:41.104 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:40 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:40.846+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.377701+0000 front 2024-09-05T01:43:17.377643+0000 (oldest deadline 2024-09-05T01:43:39.077715+0000) 2024-09-05T01:43:41.584 INFO:journalctl@ceph.osd.4.smithi145.stdout:Sep 05 01:43:41 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-4[45785]: 2024-09-05T01:43:41.378+0000 7fd33415e640 -1 osd.4 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.397131+0000 front 2024-09-05T01:43:06.397114+0000 (oldest deadline 2024-09-05T01:43:35.797770+0000) 2024-09-05T01:43:41.584 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:41 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:41.133+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:41.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:41 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:41.398+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:41.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:41 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:41.398+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:43:42.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:41 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:41.799+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:42.104 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:41 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:41.824+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.276373+0000 front 2024-09-05T01:43:06.276333+0000 (oldest deadline 2024-09-05T01:43:30.376132+0000) 2024-09-05T01:43:42.104 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:41 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:41.824+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.377701+0000 front 2024-09-05T01:43:17.377643+0000 (oldest deadline 2024-09-05T01:43:39.077715+0000) 2024-09-05T01:43:42.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:41 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:41.909+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:42.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:41 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:41.909+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:14.631148+0000 front 2024-09-05T01:43:14.631234+0000 (oldest deadline 2024-09-05T01:43:39.931199+0000) 2024-09-05T01:43:42.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:41 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:41.909+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:43:42.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:42 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:42.134+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:42.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:42 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:42.134+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:43:42.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:42 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:42.359+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:42.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:42 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:42.359+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:43:42.834 INFO:journalctl@ceph.osd.4.smithi145.stdout:Sep 05 01:43:42 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-4[45785]: 2024-09-05T01:43:42.374+0000 7fd33415e640 -1 osd.4 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.397131+0000 front 2024-09-05T01:43:06.397114+0000 (oldest deadline 2024-09-05T01:43:35.797770+0000) 2024-09-05T01:43:43.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:42 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:42.828+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:43.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:42 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:42.828+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:43:43.105 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:42 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:42.872+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.276373+0000 front 2024-09-05T01:43:06.276333+0000 (oldest deadline 2024-09-05T01:43:30.376132+0000) 2024-09-05T01:43:43.105 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:42 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:42.872+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.377701+0000 front 2024-09-05T01:43:17.377643+0000 (oldest deadline 2024-09-05T01:43:39.077715+0000) 2024-09-05T01:43:43.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:42 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:42.959+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:43.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:42 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:42.959+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:14.631148+0000 front 2024-09-05T01:43:14.631234+0000 (oldest deadline 2024-09-05T01:43:39.931199+0000) 2024-09-05T01:43:43.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:42 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:42.897+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:43:43.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:43 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:43.100+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:43.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:43 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:43.100+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:43:43.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:43 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:43.163+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:43:43.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:43 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:43.399+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:43.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:43 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:43.399+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:43:43.819 INFO:journalctl@ceph.osd.4.smithi145.stdout:Sep 05 01:43:43 smithi145 podman[72243]: 2024-09-05 01:43:43.526221082 +0000 UTC m=+5.547076831 container died 6f164d50ee15005b8686acc3f06573af9aa446dc88af81dcf65dc2a8859c2b5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-4, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-05T01:43:44.084 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:43 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:43.934+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:43:44.084 INFO:journalctl@ceph.osd.4.smithi145.stdout:Sep 05 01:43:43 smithi145 podman[72243]: 2024-09-05 01:43:43.926171685 +0000 UTC m=+5.947027426 container cleanup 6f164d50ee15005b8686acc3f06573af9aa446dc88af81dcf65dc2a8859c2b5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-91c8a7e) 2024-09-05T01:43:44.084 INFO:journalctl@ceph.osd.4.smithi145.stdout:Sep 05 01:43:43 smithi145 bash[72243]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-4 2024-09-05T01:43:44.163 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:43 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:43.887+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.276373+0000 front 2024-09-05T01:43:06.276333+0000 (oldest deadline 2024-09-05T01:43:30.376132+0000) 2024-09-05T01:43:44.163 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:43 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:43.887+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.377701+0000 front 2024-09-05T01:43:17.377643+0000 (oldest deadline 2024-09-05T01:43:39.077715+0000) 2024-09-05T01:43:44.163 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:43 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:43.855+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:44.163 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:43 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:43.855+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:43:44.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:43 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:43.935+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:44.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:43 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:43.935+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:14.631148+0000 front 2024-09-05T01:43:14.631234+0000 (oldest deadline 2024-09-05T01:43:39.931199+0000) 2024-09-05T01:43:44.537 INFO:journalctl@ceph.osd.4.smithi145.stdout:Sep 05 01:43:44 smithi145 podman[72258]: 2024-09-05 01:43:44.203005831 +0000 UTC m=+0.672137196 container remove 6f164d50ee15005b8686acc3f06573af9aa446dc88af81dcf65dc2a8859c2b5c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-91c8a7e, GIT_BRANCH=HEAD) 2024-09-05T01:43:44.537 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:44 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:44.116+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:44.537 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:44 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:44.116+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:43:44.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:44 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:44.161+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:43:44.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:44 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:44.386+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:44.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:44 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:44.386+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:43:44.834 INFO:journalctl@ceph.osd.4.smithi145.stdout:Sep 05 01:43:44 smithi145 podman[72351]: 2024-09-05 01:43:44.537053949 +0000 UTC m=+0.107934287 container create f344085024ca74bef981f1177800105d00cdc5ab70c33259375df08a31c441d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T01:43:44.834 INFO:journalctl@ceph.osd.4.smithi145.stdout:Sep 05 01:43:44 smithi145 podman[72351]: 2024-09-05 01:43:44.444537922 +0000 UTC m=+0.015418272 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:43:44.834 INFO:journalctl@ceph.osd.4.smithi145.stdout:Sep 05 01:43:44 smithi145 podman[72351]: 2024-09-05 01:43:44.75631068 +0000 UTC m=+0.327191019 container init f344085024ca74bef981f1177800105d00cdc5ab70c33259375df08a31c441d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-4-deactivate, RELEASE=squid-91c8a7e, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-05T01:43:44.834 INFO:journalctl@ceph.osd.4.smithi145.stdout:Sep 05 01:43:44 smithi145 podman[72351]: 2024-09-05 01:43:44.759606265 +0000 UTC m=+0.330486613 container start f344085024ca74bef981f1177800105d00cdc5ab70c33259375df08a31c441d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-05T01:43:45.107 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:44 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:44.979+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:43:45.108 INFO:journalctl@ceph.osd.4.smithi145.stdout:Sep 05 01:43:44 smithi145 podman[72351]: 2024-09-05 01:43:44.83949754 +0000 UTC m=+0.410377890 container attach f344085024ca74bef981f1177800105d00cdc5ab70c33259375df08a31c441d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-4-deactivate, RELEASE=squid-91c8a7e, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-05T01:43:45.108 INFO:journalctl@ceph.osd.4.smithi145.stdout:Sep 05 01:43:44 smithi145 podman[72351]: 2024-09-05 01:43:44.945072266 +0000 UTC m=+0.515952622 container died f344085024ca74bef981f1177800105d00cdc5ab70c33259375df08a31c441d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T01:43:45.211 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:44 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:44.913+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.276373+0000 front 2024-09-05T01:43:06.276333+0000 (oldest deadline 2024-09-05T01:43:30.376132+0000) 2024-09-05T01:43:45.211 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:44 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:44.913+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.377701+0000 front 2024-09-05T01:43:17.377643+0000 (oldest deadline 2024-09-05T01:43:39.077715+0000) 2024-09-05T01:43:45.212 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:44 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:44.862+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:45.212 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:44 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:44.862+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:43:45.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:44 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:44.896+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:45.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:44 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:44.896+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:14.631148+0000 front 2024-09-05T01:43:14.631234+0000 (oldest deadline 2024-09-05T01:43:39.931199+0000) 2024-09-05T01:43:45.493 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:45 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:45.106+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:45.494 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:45 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:45.106+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:43:45.515 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.4.service' 2024-09-05T01:43:45.597 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:43:45.597 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-05T01:43:45.597 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-05T01:43:45.598 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.5 2024-09-05T01:43:45.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:45 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:45.209+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:43:45.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:45 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:45.405+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:45.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:45 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:45.405+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:43:45.893 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:45 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:45.844+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:45.894 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:45 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:45.844+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:43:45.894 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:45 smithi151 systemd[1]: Stopping Ceph osd.5 for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:43:45.894 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:45 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:45.892+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.276373+0000 front 2024-09-05T01:43:06.276333+0000 (oldest deadline 2024-09-05T01:43:30.376132+0000) 2024-09-05T01:43:45.894 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:45 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:45.892+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.377701+0000 front 2024-09-05T01:43:17.377643+0000 (oldest deadline 2024-09-05T01:43:39.077715+0000) 2024-09-05T01:43:46.230 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:45 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:45.928+0000 7f1bb629f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:43:46.230 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:45 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:45.928+0000 7f1bb629f640 -1 osd.5 112 *** Got signal Terminated *** 2024-09-05T01:43:46.230 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:45 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:45.928+0000 7f1bb629f640 -1 osd.5 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T01:43:46.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:45 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:45.945+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:46.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:45 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:45.945+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:14.631148+0000 front 2024-09-05T01:43:14.631234+0000 (oldest deadline 2024-09-05T01:43:39.931199+0000) 2024-09-05T01:43:46.333 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:45 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:45.931+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:43:46.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:46 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:46.124+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:46.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:46 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:46.124+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:43:46.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:46 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:46.228+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:43:46.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:46 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:46.425+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:46.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:46 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:46.425+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:43:47.104 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:46 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:46.850+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.276373+0000 front 2024-09-05T01:43:06.276333+0000 (oldest deadline 2024-09-05T01:43:30.376132+0000) 2024-09-05T01:43:47.104 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:46 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:46.850+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.377701+0000 front 2024-09-05T01:43:17.377643+0000 (oldest deadline 2024-09-05T01:43:39.077715+0000) 2024-09-05T01:43:47.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:46 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:46.846+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:47.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:46 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:46.846+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:43:47.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:46 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:46.952+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:47.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:46 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:46.952+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:14.631148+0000 front 2024-09-05T01:43:14.631234+0000 (oldest deadline 2024-09-05T01:43:39.931199+0000) 2024-09-05T01:43:47.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:46 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:46.969+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:43:47.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:47 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:47.106+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:47.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:47 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:47.106+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:43:47.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:47 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:47.278+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:43:47.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:47 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:47.409+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:47.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:47 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:47.409+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:43:47.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:47 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:47.409+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:43:48.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:47 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:47.964+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:48.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:47 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:47.964+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:14.631148+0000 front 2024-09-05T01:43:14.631234+0000 (oldest deadline 2024-09-05T01:43:39.931199+0000) 2024-09-05T01:43:48.320 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:47 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:47.884+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.276373+0000 front 2024-09-05T01:43:06.276333+0000 (oldest deadline 2024-09-05T01:43:30.376132+0000) 2024-09-05T01:43:48.320 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:47 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:47.884+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.377701+0000 front 2024-09-05T01:43:17.377643+0000 (oldest deadline 2024-09-05T01:43:39.077715+0000) 2024-09-05T01:43:48.320 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:47 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:47.884+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:26.079220+0000 front 2024-09-05T01:43:26.079267+0000 (oldest deadline 2024-09-05T01:43:47.779375+0000) 2024-09-05T01:43:48.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:47 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:47.860+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:48.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:47 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:47.860+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:43:48.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:47 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:47.860+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:43:48.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:48 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:48.000+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:43:48.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:48 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:48.000+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.968398+0000 front 2024-09-05T01:43:25.968213+0000 (oldest deadline 2024-09-05T01:43:47.668214+0000) 2024-09-05T01:43:48.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:48 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:48.147+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:48.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:48 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:48.147+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:43:48.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:48 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:48.147+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:43:48.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:48 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:48.319+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:43:48.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:48 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:48.400+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:48.813 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:48 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:48.400+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:43:48.813 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:48 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:48.400+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:43:49.104 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:48 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:48.932+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.276373+0000 front 2024-09-05T01:43:06.276333+0000 (oldest deadline 2024-09-05T01:43:30.376132+0000) 2024-09-05T01:43:49.105 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:48 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:48.932+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.377701+0000 front 2024-09-05T01:43:17.377643+0000 (oldest deadline 2024-09-05T01:43:39.077715+0000) 2024-09-05T01:43:49.105 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:48 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:48.932+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:26.079220+0000 front 2024-09-05T01:43:26.079267+0000 (oldest deadline 2024-09-05T01:43:47.779375+0000) 2024-09-05T01:43:49.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:48 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:48.837+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:49.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:48 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:48.837+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:43:49.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:48 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:48.837+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:43:49.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:48 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:48.930+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:49.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:48 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:48.930+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:14.631148+0000 front 2024-09-05T01:43:14.631234+0000 (oldest deadline 2024-09-05T01:43:39.931199+0000) 2024-09-05T01:43:49.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:48 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:48.930+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.832377+0000 front 2024-09-05T01:43:22.832388+0000 (oldest deadline 2024-09-05T01:43:48.732341+0000) 2024-09-05T01:43:49.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:49 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:49.041+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:43:49.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:49 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:49.041+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.968398+0000 front 2024-09-05T01:43:25.968213+0000 (oldest deadline 2024-09-05T01:43:47.668214+0000) 2024-09-05T01:43:49.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:49 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:49.116+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:49.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:49 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:49.116+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:43:49.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:49 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:49.116+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:43:49.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:49 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:49.393+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:49.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:49 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:49.393+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:43:49.813 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:49 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:49.393+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:43:49.854 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:49 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:49.364+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:43:50.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:49 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:49.894+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:50.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:49 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:49.894+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:14.631148+0000 front 2024-09-05T01:43:14.631234+0000 (oldest deadline 2024-09-05T01:43:39.931199+0000) 2024-09-05T01:43:50.313 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:49 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:49.894+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.832377+0000 front 2024-09-05T01:43:22.832388+0000 (oldest deadline 2024-09-05T01:43:48.732341+0000) 2024-09-05T01:43:50.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:50 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:50.008+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:43:50.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:50 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:50.008+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.968398+0000 front 2024-09-05T01:43:25.968213+0000 (oldest deadline 2024-09-05T01:43:47.668214+0000) 2024-09-05T01:43:50.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:50 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:50.091+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:50.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:50 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:50.091+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:43:50.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:50 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:50.091+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:43:50.354 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:49 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:49.973+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.276373+0000 front 2024-09-05T01:43:06.276333+0000 (oldest deadline 2024-09-05T01:43:30.376132+0000) 2024-09-05T01:43:50.354 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:49 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:49.973+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.377701+0000 front 2024-09-05T01:43:17.377643+0000 (oldest deadline 2024-09-05T01:43:39.077715+0000) 2024-09-05T01:43:50.354 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:49 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5[46594]: 2024-09-05T01:43:49.973+0000 7f1bb28a4640 -1 osd.5 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:26.079220+0000 front 2024-09-05T01:43:26.079267+0000 (oldest deadline 2024-09-05T01:43:47.779375+0000) 2024-09-05T01:43:50.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:49 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:49.865+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:50.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:49 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:49.865+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:43:50.355 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:49 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:49.865+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:43:50.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:50 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:50.356+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:50.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:50 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:50.356+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:43:50.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:50 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:50.356+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:43:50.852 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:50 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:50.363+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:43:51.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:50 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:50.850+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:51.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:50 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:50.850+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:43:51.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:50 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:50.850+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:43:51.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:50 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:50.870+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:51.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:50 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:50.870+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:14.631148+0000 front 2024-09-05T01:43:14.631234+0000 (oldest deadline 2024-09-05T01:43:39.931199+0000) 2024-09-05T01:43:51.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:50 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:50.870+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.832377+0000 front 2024-09-05T01:43:22.832388+0000 (oldest deadline 2024-09-05T01:43:48.732341+0000) 2024-09-05T01:43:51.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:51 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:51.056+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:43:51.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:51 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:51.056+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.968398+0000 front 2024-09-05T01:43:25.968213+0000 (oldest deadline 2024-09-05T01:43:47.668214+0000) 2024-09-05T01:43:51.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:51 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:51.059+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:51.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:51 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:51.059+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:43:51.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:51 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:51.060+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:43:51.604 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:51 smithi151 podman[72164]: 2024-09-05 01:43:51.406212631 +0000 UTC m=+5.610239061 container died b377bb0c1b543095c0ab4c4c63ca00a061df620ca4f7641c5646d7660b038dab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-05T01:43:51.605 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:51 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:51.322+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:43:51.605 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:51 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:51.322+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.302524+0000 front 2024-09-05T01:43:22.302555+0000 (oldest deadline 2024-09-05T01:43:51.103333+0000) 2024-09-05T01:43:51.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:51 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:51.362+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:51.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:51 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:51.362+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:43:51.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:51 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:51.362+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:43:52.058 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:51 smithi151 podman[72164]: 2024-09-05 01:43:51.764034277 +0000 UTC m=+5.968060703 container cleanup b377bb0c1b543095c0ab4c4c63ca00a061df620ca4f7641c5646d7660b038dab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T01:43:52.058 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:51 smithi151 bash[72164]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5 2024-09-05T01:43:52.058 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:51 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:51.893+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:52.058 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:51 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:51.893+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:43:52.058 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:51 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:51.893+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:43:52.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:51 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:51.875+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:52.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:51 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:51.875+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:14.631148+0000 front 2024-09-05T01:43:14.631234+0000 (oldest deadline 2024-09-05T01:43:39.931199+0000) 2024-09-05T01:43:52.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:51 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:51.875+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.832377+0000 front 2024-09-05T01:43:22.832388+0000 (oldest deadline 2024-09-05T01:43:48.732341+0000) 2024-09-05T01:43:52.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:52 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:52.020+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:43:52.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:52 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:52.020+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.968398+0000 front 2024-09-05T01:43:25.968213+0000 (oldest deadline 2024-09-05T01:43:47.668214+0000) 2024-09-05T01:43:52.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:52 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:52.042+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:52.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:52 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:52.042+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:43:52.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:52 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:52.042+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:43:52.346 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:52 smithi151 podman[72180]: 2024-09-05 01:43:52.05759158 +0000 UTC m=+0.651965347 container remove b377bb0c1b543095c0ab4c4c63ca00a061df620ca4f7641c5646d7660b038dab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-05T01:43:52.604 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:52 smithi151 podman[72267]: 2024-09-05 01:43:52.269957686 +0000 UTC m=+0.016376877 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:43:52.605 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:52 smithi151 podman[72267]: 2024-09-05 01:43:52.392380954 +0000 UTC m=+0.138800178 container create 0d03420564642a44b499ad9b228a25c5c187db5a10b684449ff1fc734177f828 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-05T01:43:52.605 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:52 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:52.344+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:43:52.605 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:52 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:52.344+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.302524+0000 front 2024-09-05T01:43:22.302555+0000 (oldest deadline 2024-09-05T01:43:51.103333+0000) 2024-09-05T01:43:52.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:52 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:52.330+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:52.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:52 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:52.330+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:43:52.813 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:52 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:52.330+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:43:53.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:52 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:52.861+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:53.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:52 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:52.861+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:43:53.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:52 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:52.861+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:43:53.105 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:52 smithi151 podman[72267]: 2024-09-05 01:43:52.628682634 +0000 UTC m=+0.375101812 container init 0d03420564642a44b499ad9b228a25c5c187db5a10b684449ff1fc734177f828 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-05T01:43:53.105 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:52 smithi151 podman[72267]: 2024-09-05 01:43:52.631917897 +0000 UTC m=+0.378337076 container start 0d03420564642a44b499ad9b228a25c5c187db5a10b684449ff1fc734177f828 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, RELEASE=squid-91c8a7e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T01:43:53.105 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:52 smithi151 podman[72267]: 2024-09-05 01:43:52.695347346 +0000 UTC m=+0.441766539 container attach 0d03420564642a44b499ad9b228a25c5c187db5a10b684449ff1fc734177f828 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T01:43:53.105 INFO:journalctl@ceph.osd.5.smithi151.stdout:Sep 05 01:43:52 smithi151 podman[72291]: 2024-09-05 01:43:52.845124816 +0000 UTC m=+0.016383957 container died 0d03420564642a44b499ad9b228a25c5c187db5a10b684449ff1fc734177f828 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-91c8a7e, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-05T01:43:53.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:52 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:52.898+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:53.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:52 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:52.898+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:14.631148+0000 front 2024-09-05T01:43:14.631234+0000 (oldest deadline 2024-09-05T01:43:39.931199+0000) 2024-09-05T01:43:53.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:52 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:52.898+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.832377+0000 front 2024-09-05T01:43:22.832388+0000 (oldest deadline 2024-09-05T01:43:48.732341+0000) 2024-09-05T01:43:53.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:53 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:53.025+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:43:53.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:53 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:53.025+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.968398+0000 front 2024-09-05T01:43:25.968213+0000 (oldest deadline 2024-09-05T01:43:47.668214+0000) 2024-09-05T01:43:53.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:53 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:53.057+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:53.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:53 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:53.057+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:43:53.335 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:53 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:53.057+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:43:53.425 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:53 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:53.303+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:43:53.425 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:53 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:53.303+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.302524+0000 front 2024-09-05T01:43:22.302555+0000 (oldest deadline 2024-09-05T01:43:51.103333+0000) 2024-09-05T01:43:53.452 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.5.service' 2024-09-05T01:43:53.531 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:43:53.531 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-05T01:43:53.531 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-05T01:43:53.531 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.6 2024-09-05T01:43:53.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:53 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:53.365+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:53.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:53 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:53.365+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:43:53.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:53 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:53.365+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:43:53.813 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:53 smithi012 systemd[1]: Stopping Ceph osd.6 for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:43:54.312 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:53 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:53.876+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:54.312 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:53 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:53.876+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:43:54.313 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:53 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:53.876+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:43:54.313 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:53 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:53.902+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:54.313 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:53 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:53.902+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:14.631148+0000 front 2024-09-05T01:43:14.631234+0000 (oldest deadline 2024-09-05T01:43:39.931199+0000) 2024-09-05T01:43:54.313 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:53 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:53.902+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.832377+0000 front 2024-09-05T01:43:22.832388+0000 (oldest deadline 2024-09-05T01:43:48.732341+0000) 2024-09-05T01:43:54.314 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:53 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:53.939+0000 7ffa44000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:43:54.314 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:53 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:53.939+0000 7ffa44000640 -1 osd.6 112 *** Got signal Terminated *** 2024-09-05T01:43:54.314 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:53 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:53.939+0000 7ffa44000640 -1 osd.6 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T01:43:54.333 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:54 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:54.005+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:43:54.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:54 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:54.005+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.968398+0000 front 2024-09-05T01:43:25.968213+0000 (oldest deadline 2024-09-05T01:43:47.668214+0000) 2024-09-05T01:43:54.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:54 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:54.041+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:54.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:54 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:54.041+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:43:54.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:54 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:54.041+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:43:54.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:54 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:54.311+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:43:54.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:54 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:54.311+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.302524+0000 front 2024-09-05T01:43:22.302555+0000 (oldest deadline 2024-09-05T01:43:51.103333+0000) 2024-09-05T01:43:54.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:54 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:54.340+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:54.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:54 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:54.340+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:43:54.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:54 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:54.340+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:43:55.287 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:54 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:54.853+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:55.287 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:54 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:54.853+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:43:55.287 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:54 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:54.853+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:43:55.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:54 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:54.920+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:55.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:54 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:54.920+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:14.631148+0000 front 2024-09-05T01:43:14.631234+0000 (oldest deadline 2024-09-05T01:43:39.931199+0000) 2024-09-05T01:43:55.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:54 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:54.920+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.832377+0000 front 2024-09-05T01:43:22.832388+0000 (oldest deadline 2024-09-05T01:43:48.732341+0000) 2024-09-05T01:43:55.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:55 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:55.054+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:43:55.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:55 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:55.054+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.968398+0000 front 2024-09-05T01:43:25.968213+0000 (oldest deadline 2024-09-05T01:43:47.668214+0000) 2024-09-05T01:43:55.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:55 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:55.004+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:55.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:55 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:55.004+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:43:55.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:55 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:55.004+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:43:55.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:55 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:55.286+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:43:55.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:55 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:55.286+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.302524+0000 front 2024-09-05T01:43:22.302555+0000 (oldest deadline 2024-09-05T01:43:51.103333+0000) 2024-09-05T01:43:55.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:55 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:55.385+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:55.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:55 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:55.385+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:43:55.813 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:55 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:55.385+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:43:56.246 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:55 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:55.861+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:56.246 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:55 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:55.861+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:43:56.247 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:55 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:55.861+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:43:56.312 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:55 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:55.960+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:56.313 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:55 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:55.960+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:14.631148+0000 front 2024-09-05T01:43:14.631234+0000 (oldest deadline 2024-09-05T01:43:39.931199+0000) 2024-09-05T01:43:56.313 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:55 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:55.960+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.832377+0000 front 2024-09-05T01:43:22.832388+0000 (oldest deadline 2024-09-05T01:43:48.732341+0000) 2024-09-05T01:43:56.313 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:55 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:55.960+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.734278+0000 front 2024-09-05T01:43:32.734132+0000 (oldest deadline 2024-09-05T01:43:55.634060+0000) 2024-09-05T01:43:56.333 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:56 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:56.058+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:43:56.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:56 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:56.058+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.968398+0000 front 2024-09-05T01:43:25.968213+0000 (oldest deadline 2024-09-05T01:43:47.668214+0000) 2024-09-05T01:43:56.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:56 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:56.045+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:56.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:56 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:56.045+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:43:56.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:56 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:56.045+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:43:56.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:56 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:56.245+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:43:56.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:56 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:56.245+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.302524+0000 front 2024-09-05T01:43:22.302555+0000 (oldest deadline 2024-09-05T01:43:51.103333+0000) 2024-09-05T01:43:56.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:56 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:56.339+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:56.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:56 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:56.339+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:43:56.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:56 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:56.339+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:43:56.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:56 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:56.339+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:43:57.252 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:56 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:56.875+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:57.252 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:56 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:56.875+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:43:57.252 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:56 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:56.875+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:43:57.308 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:56 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:56.934+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:57.309 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:56 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:56.934+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:14.631148+0000 front 2024-09-05T01:43:14.631234+0000 (oldest deadline 2024-09-05T01:43:39.931199+0000) 2024-09-05T01:43:57.309 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:56 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:56.934+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.832377+0000 front 2024-09-05T01:43:22.832388+0000 (oldest deadline 2024-09-05T01:43:48.732341+0000) 2024-09-05T01:43:57.309 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:56 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:56.934+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.734278+0000 front 2024-09-05T01:43:32.734132+0000 (oldest deadline 2024-09-05T01:43:55.634060+0000) 2024-09-05T01:43:57.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:57 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:57.035+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:43:57.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:57 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:57.035+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.968398+0000 front 2024-09-05T01:43:25.968213+0000 (oldest deadline 2024-09-05T01:43:47.668214+0000) 2024-09-05T01:43:57.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:57 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:57.069+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:57.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:57 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:57.069+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:43:57.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:57 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:57.069+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:43:57.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:57.307+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:57.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:57.307+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:43:57.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:57.307+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:43:57.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:57.307+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:43:57.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:57 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:57.251+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:43:57.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:57 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:57.251+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.302524+0000 front 2024-09-05T01:43:22.302555+0000 (oldest deadline 2024-09-05T01:43:51.103333+0000) 2024-09-05T01:43:58.222 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:57 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:57.896+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:58.222 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:57 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:57.896+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:43:58.222 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:57 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:57.896+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:43:58.309 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:57.944+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:58.309 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:57.944+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:14.631148+0000 front 2024-09-05T01:43:14.631234+0000 (oldest deadline 2024-09-05T01:43:39.931199+0000) 2024-09-05T01:43:58.310 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:57.944+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.832377+0000 front 2024-09-05T01:43:22.832388+0000 (oldest deadline 2024-09-05T01:43:48.732341+0000) 2024-09-05T01:43:58.310 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:57.944+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.734278+0000 front 2024-09-05T01:43:32.734132+0000 (oldest deadline 2024-09-05T01:43:55.634060+0000) 2024-09-05T01:43:58.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:58 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:58.014+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:43:58.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:58 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:58.014+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.968398+0000 front 2024-09-05T01:43:25.968213+0000 (oldest deadline 2024-09-05T01:43:47.668214+0000) 2024-09-05T01:43:58.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:58 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:58.025+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:58.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:58 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:58.025+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:43:58.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:58 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:58.025+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:43:58.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:58 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:58.025+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:43:58.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:58 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:58.308+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:58.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:58 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:58.308+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:43:58.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:58 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:58.308+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:43:58.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:58 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:58.308+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:43:58.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:58 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:58.221+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:43:58.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:58 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:58.221+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.302524+0000 front 2024-09-05T01:43:22.302555+0000 (oldest deadline 2024-09-05T01:43:51.103333+0000) 2024-09-05T01:43:58.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:58 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:58.221+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.905139+0000 front 2024-09-05T01:43:33.905117+0000 (oldest deadline 2024-09-05T01:43:58.005137+0000) 2024-09-05T01:43:59.233 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:58 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:58.889+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:43:59.233 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:58 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:58.889+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:43:59.233 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:58 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:58.889+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:43:59.277 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:58 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:58.938+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:06.529606+0000 front 2024-09-05T01:43:06.529705+0000 (oldest deadline 2024-09-05T01:43:32.429745+0000) 2024-09-05T01:43:59.277 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:58 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:58.938+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:14.631148+0000 front 2024-09-05T01:43:14.631234+0000 (oldest deadline 2024-09-05T01:43:39.931199+0000) 2024-09-05T01:43:59.277 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:58 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:58.938+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.832377+0000 front 2024-09-05T01:43:22.832388+0000 (oldest deadline 2024-09-05T01:43:48.732341+0000) 2024-09-05T01:43:59.277 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:58 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6[57215]: 2024-09-05T01:43:58.938+0000 7ffa3aa00640 -1 osd.6 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.734278+0000 front 2024-09-05T01:43:32.734132+0000 (oldest deadline 2024-09-05T01:43:55.634060+0000) 2024-09-05T01:43:59.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:59 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:59.018+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:43:59.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:59 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:59.018+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.968398+0000 front 2024-09-05T01:43:25.968213+0000 (oldest deadline 2024-09-05T01:43:47.668214+0000) 2024-09-05T01:43:59.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:59 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:59.018+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.569436+0000 front 2024-09-05T01:43:33.569353+0000 (oldest deadline 2024-09-05T01:43:58.269266+0000) 2024-09-05T01:43:59.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:59 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:59.070+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:43:59.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:59 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:59.070+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:43:59.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:59 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:59.070+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:43:59.335 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:43:59 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:43:59.070+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:43:59.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:59 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:59.276+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:43:59.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:59 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:59.276+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:43:59.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:59 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:59.276+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:43:59.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:43:59 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:43:59.276+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:43:59.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:59 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:59.232+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:43:59.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:59 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:59.232+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.302524+0000 front 2024-09-05T01:43:22.302555+0000 (oldest deadline 2024-09-05T01:43:51.103333+0000) 2024-09-05T01:43:59.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:43:59 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:43:59.232+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.905139+0000 front 2024-09-05T01:43:33.905117+0000 (oldest deadline 2024-09-05T01:43:58.005137+0000) 2024-09-05T01:43:59.950 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:43:59 smithi012 podman[106291]: 2024-09-05 01:43:59.756081099 +0000 UTC m=+5.938756859 container died 1a8f7d749e69c1a4c0bfa8edc7c94eef986c025dd82cb05ab142e42b590cc247 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T01:44:00.261 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:59 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:59.928+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:00.261 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:59 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:59.928+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:00.261 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:43:59 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:43:59.928+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:00.309 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:44:00 smithi012 podman[106291]: 2024-09-05 01:44:00.110222158 +0000 UTC m=+6.292897910 container cleanup 1a8f7d749e69c1a4c0bfa8edc7c94eef986c025dd82cb05ab142e42b590cc247 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True) 2024-09-05T01:44:00.309 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:44:00 smithi012 bash[106291]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6 2024-09-05T01:44:00.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:59 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:59.979+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:44:00.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:59 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:59.979+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.968398+0000 front 2024-09-05T01:43:25.968213+0000 (oldest deadline 2024-09-05T01:43:47.668214+0000) 2024-09-05T01:44:00.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:43:59 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:43:59.979+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.569436+0000 front 2024-09-05T01:43:33.569353+0000 (oldest deadline 2024-09-05T01:43:58.269266+0000) 2024-09-05T01:44:00.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:00 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:00.068+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:00.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:00 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:00.068+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:00.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:00 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:00.068+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:00.335 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:00 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:00.068+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:00.562 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:44:00 smithi012 podman[106310]: 2024-09-05 01:44:00.337252803 +0000 UTC m=+0.573825558 container remove 1a8f7d749e69c1a4c0bfa8edc7c94eef986c025dd82cb05ab142e42b590cc247 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-91c8a7e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-05T01:44:00.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:00 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:00.307+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:44:00.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:00 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:00.307+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:44:00.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:00 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:00.307+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:44:00.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:00 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:00.307+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:44:00.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:00 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:00.260+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:44:00.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:00 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:00.260+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.302524+0000 front 2024-09-05T01:43:22.302555+0000 (oldest deadline 2024-09-05T01:43:51.103333+0000) 2024-09-05T01:44:00.605 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:00 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:00.260+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.905139+0000 front 2024-09-05T01:43:33.905117+0000 (oldest deadline 2024-09-05T01:43:58.005137+0000) 2024-09-05T01:44:01.165 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:44:00 smithi012 podman[106407]: 2024-09-05 01:44:00.831527748 +0000 UTC m=+0.028060070 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:44:01.165 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:44:00 smithi012 podman[106407]: 2024-09-05 01:44:00.945990897 +0000 UTC m=+0.142523213 container create f0336e3da247689c49accc4a10d559f442eb01d7e5657a0aa578196923987926 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux ) 2024-09-05T01:44:01.243 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:00 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:00.924+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:01.243 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:00 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:00.924+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:01.243 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:00 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:00.924+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:01.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:00 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:44:00.969+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:44:01.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:00 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:44:00.969+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.968398+0000 front 2024-09-05T01:43:25.968213+0000 (oldest deadline 2024-09-05T01:43:47.668214+0000) 2024-09-05T01:44:01.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:00 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:44:00.969+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.569436+0000 front 2024-09-05T01:43:33.569353+0000 (oldest deadline 2024-09-05T01:43:58.269266+0000) 2024-09-05T01:44:01.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:01 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:01.037+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:01.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:01 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:01.037+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:01.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:01 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:01.037+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:01.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:01 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:01.037+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:01.438 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:01 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:01.274+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:44:01.438 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:01 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:01.274+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:44:01.438 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:01 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:01.274+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:44:01.438 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:01 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:01.274+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:44:01.438 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:44:01 smithi012 podman[106407]: 2024-09-05 01:44:01.165261763 +0000 UTC m=+0.361794073 container init f0336e3da247689c49accc4a10d559f442eb01d7e5657a0aa578196923987926 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-05T01:44:01.438 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:44:01 smithi012 podman[106407]: 2024-09-05 01:44:01.172357597 +0000 UTC m=+0.368889907 container start f0336e3da247689c49accc4a10d559f442eb01d7e5657a0aa578196923987926 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-05T01:44:01.438 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:44:01 smithi012 podman[106407]: 2024-09-05 01:44:01.2313702 +0000 UTC m=+0.427902510 container attach f0336e3da247689c49accc4a10d559f442eb01d7e5657a0aa578196923987926 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-05T01:44:01.438 INFO:journalctl@ceph.osd.6.smithi012.stdout:Sep 05 01:44:01 smithi012 podman[106407]: 2024-09-05 01:44:01.437576186 +0000 UTC m=+0.634108507 container died f0336e3da247689c49accc4a10d559f442eb01d7e5657a0aa578196923987926 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-05T01:44:01.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:01 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:01.242+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:44:01.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:01 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:01.242+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.302524+0000 front 2024-09-05T01:43:22.302555+0000 (oldest deadline 2024-09-05T01:43:51.103333+0000) 2024-09-05T01:44:01.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:01 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:01.242+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.905139+0000 front 2024-09-05T01:43:33.905117+0000 (oldest deadline 2024-09-05T01:43:58.005137+0000) 2024-09-05T01:44:02.182 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.6.service' 2024-09-05T01:44:02.259 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:44:02.259 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-05T01:44:02.259 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-05T01:44:02.259 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.7 2024-09-05T01:44:02.270 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:01 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:01.963+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:02.270 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:01 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:01.963+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:02.270 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:01 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:01.963+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:02.286 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:01 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:44:01.926+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:44:02.286 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:01 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:44:01.926+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.968398+0000 front 2024-09-05T01:43:25.968213+0000 (oldest deadline 2024-09-05T01:43:47.668214+0000) 2024-09-05T01:44:02.287 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:01 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:44:01.926+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.569436+0000 front 2024-09-05T01:43:33.569353+0000 (oldest deadline 2024-09-05T01:43:58.269266+0000) 2024-09-05T01:44:02.287 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:01 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:01.992+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:02.287 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:01 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:01.992+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:02.287 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:01 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:01.992+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:02.287 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:01 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:01.992+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:02.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:02 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:02.261+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:44:02.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:02 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:02.261+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:44:02.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:02 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:02.261+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:44:02.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:02 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:02.261+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:44:02.583 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:02 smithi145 systemd[1]: Stopping Ceph osd.7 for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:44:02.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:02 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:02.269+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:44:02.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:02 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:02.269+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.302524+0000 front 2024-09-05T01:43:22.302555+0000 (oldest deadline 2024-09-05T01:43:51.103333+0000) 2024-09-05T01:44:02.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:02 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:02.269+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.905139+0000 front 2024-09-05T01:43:33.905117+0000 (oldest deadline 2024-09-05T01:43:58.005137+0000) 2024-09-05T01:44:03.084 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:02 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:02.943+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:03.084 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:02 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:02.943+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:03.084 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:02 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:02.943+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:03.085 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:02 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:02.943+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:03.085 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:02 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:44:02.711+0000 7fa19bfe2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:44:03.085 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:02 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:44:02.711+0000 7fa19bfe2640 -1 osd.7 112 *** Got signal Terminated *** 2024-09-05T01:44:03.085 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:02 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:44:02.711+0000 7fa19bfe2640 -1 osd.7 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T01:44:03.085 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:02 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:44:02.881+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:44:03.085 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:02 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:44:02.881+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.968398+0000 front 2024-09-05T01:43:25.968213+0000 (oldest deadline 2024-09-05T01:43:47.668214+0000) 2024-09-05T01:44:03.085 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:02 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:44:02.881+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.569436+0000 front 2024-09-05T01:43:33.569353+0000 (oldest deadline 2024-09-05T01:43:58.269266+0000) 2024-09-05T01:44:03.283 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:03 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:03.012+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:03.283 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:03 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:03.012+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:03.283 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:03 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:03.012+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:03.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:03 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:03.226+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:44:03.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:03 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:03.226+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:44:03.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:03 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:03.226+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:44:03.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:03 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:03.226+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:44:03.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:03 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:03.282+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:44:03.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:03 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:03.282+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.302524+0000 front 2024-09-05T01:43:22.302555+0000 (oldest deadline 2024-09-05T01:43:51.103333+0000) 2024-09-05T01:44:03.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:03 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:03.282+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.905139+0000 front 2024-09-05T01:43:33.905117+0000 (oldest deadline 2024-09-05T01:43:58.005137+0000) 2024-09-05T01:44:04.323 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:03 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:03.974+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:04.323 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:03 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:03.974+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:04.323 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:03 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:03.974+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:04.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:03 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:44:03.845+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:44:04.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:03 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:44:03.845+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.968398+0000 front 2024-09-05T01:43:25.968213+0000 (oldest deadline 2024-09-05T01:43:47.668214+0000) 2024-09-05T01:44:04.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:03 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:44:03.845+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.569436+0000 front 2024-09-05T01:43:33.569353+0000 (oldest deadline 2024-09-05T01:43:58.269266+0000) 2024-09-05T01:44:04.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:03 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:03.939+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:04.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:03 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:03.939+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:04.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:03 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:03.939+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:04.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:03 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:03.939+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:04.335 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:03 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:03.939+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:04.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:04 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:04.210+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:44:04.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:04 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:04.210+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:44:04.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:04 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:04.210+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:44:04.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:04 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:04.210+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:44:04.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:04 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:04.322+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:44:04.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:04 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:04.322+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.302524+0000 front 2024-09-05T01:43:22.302555+0000 (oldest deadline 2024-09-05T01:43:51.103333+0000) 2024-09-05T01:44:04.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:04 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:04.322+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.905139+0000 front 2024-09-05T01:43:33.905117+0000 (oldest deadline 2024-09-05T01:43:58.005137+0000) 2024-09-05T01:44:05.084 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:04 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:04.965+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:05.084 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:04 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:04.965+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:05.084 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:04 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:04.965+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:05.084 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:04 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:04.965+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:05.084 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:04 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:04.965+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:05.085 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:04 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:44:04.827+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:44:05.085 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:04 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:44:04.827+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.968398+0000 front 2024-09-05T01:43:25.968213+0000 (oldest deadline 2024-09-05T01:43:47.668214+0000) 2024-09-05T01:44:05.085 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:04 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:44:04.827+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.569436+0000 front 2024-09-05T01:43:33.569353+0000 (oldest deadline 2024-09-05T01:43:58.269266+0000) 2024-09-05T01:44:05.341 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:04 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:04.976+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:05.341 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:04 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:04.976+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:05.342 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:04 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:04.976+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:05.342 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:04 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:04.976+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:05.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:05 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:05.242+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:44:05.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:05 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:05.242+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:44:05.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:05 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:05.242+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:44:05.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:05 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:05.242+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:44:05.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:05 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:05.340+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:44:05.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:05 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:05.340+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.302524+0000 front 2024-09-05T01:43:22.302555+0000 (oldest deadline 2024-09-05T01:43:51.103333+0000) 2024-09-05T01:44:05.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:05 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:05.340+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.905139+0000 front 2024-09-05T01:43:33.905117+0000 (oldest deadline 2024-09-05T01:43:58.005137+0000) 2024-09-05T01:44:06.084 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:06 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:06.005+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:06.084 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:06 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:06.005+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:06.084 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:06 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:06.005+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:06.084 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:06 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:06.005+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:06.084 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:06 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:06.005+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:06.084 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:05 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:44:05.830+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:44:06.085 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:05 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:44:05.830+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.968398+0000 front 2024-09-05T01:43:25.968213+0000 (oldest deadline 2024-09-05T01:43:47.668214+0000) 2024-09-05T01:44:06.085 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:05 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:44:05.830+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.569436+0000 front 2024-09-05T01:43:33.569353+0000 (oldest deadline 2024-09-05T01:43:58.269266+0000) 2024-09-05T01:44:06.355 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:05 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:05.955+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:06.355 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:05 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:05.955+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:06.355 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:05 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:05.955+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:06.355 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:05 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:05.955+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:06.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:06 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:06.222+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:44:06.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:06 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:06.222+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:44:06.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:06 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:06.222+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:44:06.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:06 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:06.222+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:44:06.854 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:06 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:06.384+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:44:06.854 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:06 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:06.384+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.302524+0000 front 2024-09-05T01:43:22.302555+0000 (oldest deadline 2024-09-05T01:43:51.103333+0000) 2024-09-05T01:44:06.855 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:06 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:06.384+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.905139+0000 front 2024-09-05T01:43:33.905117+0000 (oldest deadline 2024-09-05T01:43:58.005137+0000) 2024-09-05T01:44:06.855 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:06 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:06.384+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.005648+0000 front 2024-09-05T01:43:38.005863+0000 (oldest deadline 2024-09-05T01:44:05.605953+0000) 2024-09-05T01:44:07.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:06 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:44:06.870+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.266203+0000 front 2024-09-05T01:43:17.266298+0000 (oldest deadline 2024-09-05T01:43:41.366387+0000) 2024-09-05T01:44:07.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:06 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:44:06.870+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.968398+0000 front 2024-09-05T01:43:25.968213+0000 (oldest deadline 2024-09-05T01:43:47.668214+0000) 2024-09-05T01:44:07.334 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:06 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7[52744]: 2024-09-05T01:44:06.870+0000 7fa1985e7640 -1 osd.7 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.569436+0000 front 2024-09-05T01:43:33.569353+0000 (oldest deadline 2024-09-05T01:43:58.269266+0000) 2024-09-05T01:44:07.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:06 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:06.986+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:07.335 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:06 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:06.986+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:07.335 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:06 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:06.986+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:07.335 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:06 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:06.986+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:07.335 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:06 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:06.986+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:07.355 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:06 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:06.976+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:07.356 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:06 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:06.976+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:07.356 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:06 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:06.976+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:07.356 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:06 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:06.976+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:07.564 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:07 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:07.189+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:44:07.564 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:07 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:07.189+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:44:07.564 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:07 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:07.189+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:44:07.564 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:07 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:07.189+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:44:07.854 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:07 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:07.425+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:44:07.854 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:07 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:07.425+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.302524+0000 front 2024-09-05T01:43:22.302555+0000 (oldest deadline 2024-09-05T01:43:51.103333+0000) 2024-09-05T01:44:07.854 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:07 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:07.425+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.905139+0000 front 2024-09-05T01:43:33.905117+0000 (oldest deadline 2024-09-05T01:43:58.005137+0000) 2024-09-05T01:44:07.854 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:07 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:07.425+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.005648+0000 front 2024-09-05T01:43:38.005863+0000 (oldest deadline 2024-09-05T01:44:05.605953+0000) 2024-09-05T01:44:08.336 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:08 smithi145 podman[72453]: 2024-09-05 01:44:08.173835653 +0000 UTC m=+5.725203718 container died b877197634620797cc25828846a98bccd0658536686ac8ff35eec590f1848703 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-91c8a7e) 2024-09-05T01:44:08.336 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:08 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:08.029+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:08.336 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:08 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:08.029+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:08.336 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:08 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:08.029+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:08.337 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:08 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:08.029+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:08.337 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:08 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:08.029+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:08.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:07 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:07.939+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:08.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:07 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:07.939+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:08.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:07 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:07.939+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:08.355 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:07 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:07.939+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:08.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:08 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:08.209+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:44:08.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:08 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:08.209+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:44:08.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:08 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:08.209+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:44:08.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:08 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:08.209+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:44:08.687 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:08 smithi145 podman[72453]: 2024-09-05 01:44:08.511227448 +0000 UTC m=+6.062595498 container cleanup b877197634620797cc25828846a98bccd0658536686ac8ff35eec590f1848703 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T01:44:08.688 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:08 smithi145 bash[72453]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7 2024-09-05T01:44:08.854 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:08 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:08.473+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:44:08.854 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:08 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:08.473+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.302524+0000 front 2024-09-05T01:43:22.302555+0000 (oldest deadline 2024-09-05T01:43:51.103333+0000) 2024-09-05T01:44:08.854 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:08 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:08.473+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.905139+0000 front 2024-09-05T01:43:33.905117+0000 (oldest deadline 2024-09-05T01:43:58.005137+0000) 2024-09-05T01:44:08.854 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:08 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:08.473+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.005648+0000 front 2024-09-05T01:43:38.005863+0000 (oldest deadline 2024-09-05T01:44:05.605953+0000) 2024-09-05T01:44:09.036 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:08 smithi145 podman[72471]: 2024-09-05 01:44:08.687354487 +0000 UTC m=+0.510376329 container remove b877197634620797cc25828846a98bccd0658536686ac8ff35eec590f1848703 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-05T01:44:09.299 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:09 smithi145 podman[72557]: 2024-09-05 01:44:08.989570776 +0000 UTC m=+0.015551376 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:44:09.299 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:09 smithi145 podman[72557]: 2024-09-05 01:44:09.096714774 +0000 UTC m=+0.122695424 container create c264e0db4a04518abe49d1078f5081ab876aa5422b708250dc48016a0a6b3924 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T01:44:09.299 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:09 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:09.035+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:09.299 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:09 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:09.035+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:09.300 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:09 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:09.035+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:09.300 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:09 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:09.035+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:09.300 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:09 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:09.035+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:09.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:08 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:08.972+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:09.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:08 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:08.972+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:09.355 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:08 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:08.972+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:09.355 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:08 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:08.972+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:09.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:09 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:09.188+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:44:09.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:09 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:09.188+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:44:09.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:09 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:09.188+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:44:09.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:09 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:09.188+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:44:09.584 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:09 smithi145 podman[72557]: 2024-09-05 01:44:09.298955967 +0000 UTC m=+0.324936561 container init c264e0db4a04518abe49d1078f5081ab876aa5422b708250dc48016a0a6b3924 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True) 2024-09-05T01:44:09.585 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:09 smithi145 podman[72557]: 2024-09-05 01:44:09.30261431 +0000 UTC m=+0.328594908 container start c264e0db4a04518abe49d1078f5081ab876aa5422b708250dc48016a0a6b3924 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-05T01:44:09.585 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:09 smithi145 podman[72557]: 2024-09-05 01:44:09.382418264 +0000 UTC m=+0.408398856 container attach c264e0db4a04518abe49d1078f5081ab876aa5422b708250dc48016a0a6b3924 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T01:44:09.585 INFO:journalctl@ceph.osd.7.smithi145.stdout:Sep 05 01:44:09 smithi145 podman[72557]: 2024-09-05 01:44:09.485939693 +0000 UTC m=+0.511920302 container died c264e0db4a04518abe49d1078f5081ab876aa5422b708250dc48016a0a6b3924 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-7-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-05T01:44:09.854 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:09 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:09.486+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:44:09.854 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:09 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:09.486+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.302524+0000 front 2024-09-05T01:43:22.302555+0000 (oldest deadline 2024-09-05T01:43:51.103333+0000) 2024-09-05T01:44:09.854 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:09 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:09.486+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.905139+0000 front 2024-09-05T01:43:33.905117+0000 (oldest deadline 2024-09-05T01:43:58.005137+0000) 2024-09-05T01:44:09.855 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:09 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:09.486+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.005648+0000 front 2024-09-05T01:43:38.005863+0000 (oldest deadline 2024-09-05T01:44:05.605953+0000) 2024-09-05T01:44:10.053 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:10 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:10.000+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:10.053 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:10 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:10.000+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:10.053 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:10 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:10.000+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:10.053 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:10 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:10.000+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:10.053 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:10 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:10.000+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:10.070 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.7.service' 2024-09-05T01:44:10.150 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:44:10.150 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-05T01:44:10.151 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-05T01:44:10.151 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.8 2024-09-05T01:44:10.180 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:09 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:09.928+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:10.180 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:09 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:09.928+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:10.180 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:09 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:09.928+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:10.180 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:09 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:09.928+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:10.535 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:10 smithi151 systemd[1]: Stopping Ceph osd.8 for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:44:10.535 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:10 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:10.418+0000 7fabf96f4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:44:10.535 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:10 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:10.418+0000 7fabf96f4640 -1 osd.8 112 *** Got signal Terminated *** 2024-09-05T01:44:10.535 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:10 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:10.418+0000 7fabf96f4640 -1 osd.8 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T01:44:10.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:10 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:10.202+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:44:10.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:10 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:10.202+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:44:10.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:10 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:10.202+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:44:10.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:10 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:10.202+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:44:10.854 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:10 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:10.534+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:44:10.854 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:10 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:10.534+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.302524+0000 front 2024-09-05T01:43:22.302555+0000 (oldest deadline 2024-09-05T01:43:51.103333+0000) 2024-09-05T01:44:10.855 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:10 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:10.534+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.905139+0000 front 2024-09-05T01:43:33.905117+0000 (oldest deadline 2024-09-05T01:43:58.005137+0000) 2024-09-05T01:44:10.855 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:10 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:10.534+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.005648+0000 front 2024-09-05T01:43:38.005863+0000 (oldest deadline 2024-09-05T01:44:05.605953+0000) 2024-09-05T01:44:11.275 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:11 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:11.015+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:11.276 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:11 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:11.015+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:11.276 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:11 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:11.015+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:11.276 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:11 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:11.015+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:11.276 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:11 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:11.015+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:11.355 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:10 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:10.881+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:11.355 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:10 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:10.881+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:11.355 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:10 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:10.881+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:11.355 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:10 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:10.881+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:11.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:11 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:11.224+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:44:11.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:11 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:11.224+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:44:11.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:11 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:11.224+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:44:11.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:11 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:11.224+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:44:11.620 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:11 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:11.532+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:44:11.620 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:11 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:11.532+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.302524+0000 front 2024-09-05T01:43:22.302555+0000 (oldest deadline 2024-09-05T01:43:51.103333+0000) 2024-09-05T01:44:11.620 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:11 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:11.532+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.905139+0000 front 2024-09-05T01:43:33.905117+0000 (oldest deadline 2024-09-05T01:43:58.005137+0000) 2024-09-05T01:44:11.620 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:11 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:11.532+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.005648+0000 front 2024-09-05T01:43:38.005863+0000 (oldest deadline 2024-09-05T01:44:05.605953+0000) 2024-09-05T01:44:12.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:11 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:11.837+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:12.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:11 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:11.837+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:12.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:11 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:11.837+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:12.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:11 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:11.837+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:12.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:11 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:11.997+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:12.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:11 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:11.997+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:12.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:11 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:11.997+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:12.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:11 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:11.997+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:12.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:11 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:11.997+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:12.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:11 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:11.997+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:48.865175+0000 front 2024-09-05T01:43:48.865195+0000 (oldest deadline 2024-09-05T01:44:11.765029+0000) 2024-09-05T01:44:12.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:12 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:12.236+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:44:12.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:12 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:12.236+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:44:12.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:12 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:12.236+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:44:12.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:12 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:12.236+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:44:12.822 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:12 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:12.519+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:44:12.823 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:12 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:12.519+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.302524+0000 front 2024-09-05T01:43:22.302555+0000 (oldest deadline 2024-09-05T01:43:51.103333+0000) 2024-09-05T01:44:12.823 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:12 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:12.519+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.905139+0000 front 2024-09-05T01:43:33.905117+0000 (oldest deadline 2024-09-05T01:43:58.005137+0000) 2024-09-05T01:44:12.823 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:12 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:12.519+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.005648+0000 front 2024-09-05T01:43:38.005863+0000 (oldest deadline 2024-09-05T01:44:05.605953+0000) 2024-09-05T01:44:13.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:12 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:12.821+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:13.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:12 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:12.821+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:13.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:12 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:12.821+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:13.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:12 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:12.821+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:13.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:12 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:12.821+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:13.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:13 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:13.006+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:13.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:13 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:13.006+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:13.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:13 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:13.006+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:13.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:13 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:13.006+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:13.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:13 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:13.006+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:13.335 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:13 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:13.006+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:48.865175+0000 front 2024-09-05T01:43:48.865195+0000 (oldest deadline 2024-09-05T01:44:11.765029+0000) 2024-09-05T01:44:13.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:13 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:13.248+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:44:13.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:13 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:13.248+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:44:13.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:13 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:13.248+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:44:13.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:13 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:13.248+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:44:13.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:13 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:13.248+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:47.690693+0000 front 2024-09-05T01:43:47.690828+0000 (oldest deadline 2024-09-05T01:44:12.291355+0000) 2024-09-05T01:44:13.830 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:13 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:13.483+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:44:13.830 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:13 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:13.483+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.302524+0000 front 2024-09-05T01:43:22.302555+0000 (oldest deadline 2024-09-05T01:43:51.103333+0000) 2024-09-05T01:44:13.830 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:13 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:13.483+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.905139+0000 front 2024-09-05T01:43:33.905117+0000 (oldest deadline 2024-09-05T01:43:58.005137+0000) 2024-09-05T01:44:13.830 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:13 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:13.483+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.005648+0000 front 2024-09-05T01:43:38.005863+0000 (oldest deadline 2024-09-05T01:44:05.605953+0000) 2024-09-05T01:44:14.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:13 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:13.829+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:14.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:13 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:13.829+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:14.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:13 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:13.829+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:14.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:13 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:13.829+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:14.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:13 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:13.829+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:14.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:13 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:13.988+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:14.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:13 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:13.988+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:14.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:13 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:13.988+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:14.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:13 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:13.988+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:14.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:13 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:13.988+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:14.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:13 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:13.988+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:48.865175+0000 front 2024-09-05T01:43:48.865195+0000 (oldest deadline 2024-09-05T01:44:11.765029+0000) 2024-09-05T01:44:14.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:14 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:14.199+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:44:14.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:14 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:14.199+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:44:14.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:14 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:14.199+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:44:14.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:14 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:14.199+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:44:14.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:14 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:14.199+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:47.690693+0000 front 2024-09-05T01:43:47.690828+0000 (oldest deadline 2024-09-05T01:44:12.291355+0000) 2024-09-05T01:44:14.821 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:14 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:14.437+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.402073+0000 front 2024-09-05T01:43:16.402095+0000 (oldest deadline 2024-09-05T01:43:42.302015+0000) 2024-09-05T01:44:14.822 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:14 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:14.437+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:22.302524+0000 front 2024-09-05T01:43:22.302555+0000 (oldest deadline 2024-09-05T01:43:51.103333+0000) 2024-09-05T01:44:14.822 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:14 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:14.437+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.905139+0000 front 2024-09-05T01:43:33.905117+0000 (oldest deadline 2024-09-05T01:43:58.005137+0000) 2024-09-05T01:44:14.822 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:14 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:14.437+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.005648+0000 front 2024-09-05T01:43:38.005863+0000 (oldest deadline 2024-09-05T01:44:05.605953+0000) 2024-09-05T01:44:14.822 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:14 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8[53133]: 2024-09-05T01:44:14.437+0000 7fabf1cf1640 -1 osd.8 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.707130+0000 front 2024-09-05T01:43:49.707062+0000 (oldest deadline 2024-09-05T01:44:14.407223+0000) 2024-09-05T01:44:15.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:14 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:14.820+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:15.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:14 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:14.820+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:15.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:14 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:14.820+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:15.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:14 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:14.820+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:15.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:14 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:14.820+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:15.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:15 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:15.025+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:15.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:15 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:15.025+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:15.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:15 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:15.025+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:15.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:15 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:15.025+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:15.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:15 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:15.025+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:15.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:15 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:15.025+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:48.865175+0000 front 2024-09-05T01:43:48.865195+0000 (oldest deadline 2024-09-05T01:44:11.765029+0000) 2024-09-05T01:44:15.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:15 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:15.249+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:44:15.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:15 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:15.249+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:44:15.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:15 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:15.249+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:44:15.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:15 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:15.249+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:44:15.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:15 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:15.249+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:47.690693+0000 front 2024-09-05T01:43:47.690828+0000 (oldest deadline 2024-09-05T01:44:12.291355+0000) 2024-09-05T01:44:16.319 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:15 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:15.860+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:16.319 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:15 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:15.860+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:16.319 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:15 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:15.860+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:16.319 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:15 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:15.860+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:16.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:15 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:15.860+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:16.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:16 smithi151 podman[72371]: 2024-09-05 01:44:16.054525177 +0000 UTC m=+5.710004196 container died d23737e9f63e01cd10e90cca5dbfd2b099fd22ed60684b37800a57e154815dcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-05T01:44:16.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:16 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:16.017+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:16.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:16 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:16.017+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:16.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:16 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:16.017+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:16.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:16 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:16.017+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:16.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:16 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:16.017+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:16.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:16 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:16.017+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:48.865175+0000 front 2024-09-05T01:43:48.865195+0000 (oldest deadline 2024-09-05T01:44:11.765029+0000) 2024-09-05T01:44:16.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:16 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:16.269+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:44:16.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:16 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:16.269+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:44:16.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:16 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:16.269+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:44:16.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:16 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:16.269+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:44:16.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:16 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:16.269+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:47.690693+0000 front 2024-09-05T01:43:47.690828+0000 (oldest deadline 2024-09-05T01:44:12.291355+0000) 2024-09-05T01:44:16.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:16 smithi151 podman[72371]: 2024-09-05 01:44:16.402522045 +0000 UTC m=+6.058001109 container cleanup d23737e9f63e01cd10e90cca5dbfd2b099fd22ed60684b37800a57e154815dcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-05T01:44:16.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:16 smithi151 bash[72371]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8 2024-09-05T01:44:17.030 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:16 smithi151 podman[72398]: 2024-09-05 01:44:16.721331276 +0000 UTC m=+0.661612267 container remove d23737e9f63e01cd10e90cca5dbfd2b099fd22ed60684b37800a57e154815dcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-05T01:44:17.030 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:16 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:16.836+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:17.030 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:16 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:16.836+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:17.031 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:16 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:16.836+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:17.031 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:16 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:16.836+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:17.031 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:16 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:16.836+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:17.325 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:17 smithi151 podman[72490]: 2024-09-05 01:44:16.932488068 +0000 UTC m=+0.015948607 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:44:17.325 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:17 smithi151 podman[72490]: 2024-09-05 01:44:17.030434556 +0000 UTC m=+0.113895090 container create 158ed2aebf4fc4cc9fbbccaa4a425dc3f074d10fa4cec50d8e29a972771ffb47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-05T01:44:17.325 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:17 smithi151 podman[72490]: 2024-09-05 01:44:17.241610013 +0000 UTC m=+0.325070539 container init 158ed2aebf4fc4cc9fbbccaa4a425dc3f074d10fa4cec50d8e29a972771ffb47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-05T01:44:17.325 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:17 smithi151 podman[72490]: 2024-09-05 01:44:17.244890729 +0000 UTC m=+0.328351263 container start 158ed2aebf4fc4cc9fbbccaa4a425dc3f074d10fa4cec50d8e29a972771ffb47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-05T01:44:17.326 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:17 smithi151 podman[72490]: 2024-09-05 01:44:17.324878834 +0000 UTC m=+0.408339375 container attach 158ed2aebf4fc4cc9fbbccaa4a425dc3f074d10fa4cec50d8e29a972771ffb47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e) 2024-09-05T01:44:17.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:16 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:16.982+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:17.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:16 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:16.982+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:17.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:16 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:16.982+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:17.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:16 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:16.982+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:17.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:16 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:16.982+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:17.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:16 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:16.982+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:48.865175+0000 front 2024-09-05T01:43:48.865195+0000 (oldest deadline 2024-09-05T01:44:11.765029+0000) 2024-09-05T01:44:17.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:17 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:17.267+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:44:17.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:17 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:17.267+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:44:17.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:17 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:17.267+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:44:17.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:17 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:17.267+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:44:17.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:17 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:17.267+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:47.690693+0000 front 2024-09-05T01:43:47.690828+0000 (oldest deadline 2024-09-05T01:44:12.291355+0000) 2024-09-05T01:44:17.604 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:17 smithi151 podman[72490]: 2024-09-05 01:44:17.435279549 +0000 UTC m=+0.518740085 container died 158ed2aebf4fc4cc9fbbccaa4a425dc3f074d10fa4cec50d8e29a972771ffb47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=) 2024-09-05T01:44:18.030 INFO:journalctl@ceph.osd.8.smithi151.stdout:Sep 05 01:44:18 smithi151 podman[72513]: 2024-09-05 01:44:18.01289908 +0000 UTC m=+0.571355715 container remove 158ed2aebf4fc4cc9fbbccaa4a425dc3f074d10fa4cec50d8e29a972771ffb47 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-05T01:44:18.030 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:17 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:17.811+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:18.031 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:17 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:17.811+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:18.031 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:17 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:17.811+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:18.031 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:17 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:17.811+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:18.031 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:17 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:17.811+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:18.036 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.8.service' 2024-09-05T01:44:18.114 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:44:18.115 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-05T01:44:18.115 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-05T01:44:18.115 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.9 2024-09-05T01:44:18.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:17 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:17.970+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:18.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:17 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:17.970+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:18.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:17 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:17.970+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:18.335 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:17 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:17.970+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:18.335 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:17 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:17.970+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:18.335 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:17 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:17.970+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:48.865175+0000 front 2024-09-05T01:43:48.865195+0000 (oldest deadline 2024-09-05T01:44:11.765029+0000) 2024-09-05T01:44:18.556 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:18 smithi012 systemd[1]: Stopping Ceph osd.9 for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:44:18.557 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:18 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:18.249+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:44:18.557 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:18 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:18.249+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:44:18.557 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:18 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:18.249+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:44:18.557 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:18 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:18.249+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:44:18.557 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:18 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:18.249+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:47.690693+0000 front 2024-09-05T01:43:47.690828+0000 (oldest deadline 2024-09-05T01:44:12.291355+0000) 2024-09-05T01:44:18.557 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:18 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:18.556+0000 7f29c1c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:44:18.557 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:18 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:18.556+0000 7f29c1c00640 -1 osd.9 112 *** Got signal Terminated *** 2024-09-05T01:44:18.557 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:18 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:18.556+0000 7f29c1c00640 -1 osd.9 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T01:44:19.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:18 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:18.768+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:19.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:18 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:18.768+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:19.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:18 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:18.768+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:19.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:18 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:18.768+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:19.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:18 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:18.768+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:19.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:18 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:18.987+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:19.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:18 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:18.987+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:19.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:18 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:18.987+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:19.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:18 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:18.987+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:19.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:18 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:18.987+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:19.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:18 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:18.987+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:48.865175+0000 front 2024-09-05T01:43:48.865195+0000 (oldest deadline 2024-09-05T01:44:11.765029+0000) 2024-09-05T01:44:19.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:19 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:19.217+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:44:19.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:19 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:19.217+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:44:19.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:19 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:19.217+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:44:19.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:19 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:19.217+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:44:19.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:19 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:19.217+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:47.690693+0000 front 2024-09-05T01:43:47.690828+0000 (oldest deadline 2024-09-05T01:44:12.291355+0000) 2024-09-05T01:44:20.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:19 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:19.755+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:20.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:19 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:19.755+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:20.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:19 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:19.755+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:20.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:19 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:19.755+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:20.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:19 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:19.755+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:20.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:19 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:19.967+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:20.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:19 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:19.967+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:20.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:19 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:19.967+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:20.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:19 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:19.967+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:20.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:19 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:19.967+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:20.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:19 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:19.967+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:48.865175+0000 front 2024-09-05T01:43:48.865195+0000 (oldest deadline 2024-09-05T01:44:11.765029+0000) 2024-09-05T01:44:20.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:20 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:20.227+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:44:20.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:20 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:20.227+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:44:20.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:20 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:20.227+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:44:20.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:20 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:20.227+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:44:20.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:20 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:20.227+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:47.690693+0000 front 2024-09-05T01:43:47.690828+0000 (oldest deadline 2024-09-05T01:44:12.291355+0000) 2024-09-05T01:44:21.084 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:21 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:21.004+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:21.084 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:21 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:21.004+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:21.084 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:21 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:21.004+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:21.084 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:21 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:21.004+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:21.085 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:21 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:21.005+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:21.085 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:21 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:21.005+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:48.865175+0000 front 2024-09-05T01:43:48.865195+0000 (oldest deadline 2024-09-05T01:44:11.765029+0000) 2024-09-05T01:44:21.085 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:21 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:21.005+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:57.868193+0000 front 2024-09-05T01:43:57.868023+0000 (oldest deadline 2024-09-05T01:44:20.167848+0000) 2024-09-05T01:44:21.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:20 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:20.803+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:21.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:20 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:20.803+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:21.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:20 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:20.803+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:21.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:20 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:20.803+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:21.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:20 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:20.803+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:21.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:20 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:20.803+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:58.306673+0000 front 2024-09-05T01:43:58.306696+0000 (oldest deadline 2024-09-05T01:44:20.606559+0000) 2024-09-05T01:44:21.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:21 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:21.244+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:44:21.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:21 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:21.244+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:44:21.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:21 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:21.244+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:44:21.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:21 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:21.244+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:44:21.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:21 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:21.244+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:47.690693+0000 front 2024-09-05T01:43:47.690828+0000 (oldest deadline 2024-09-05T01:44:12.291355+0000) 2024-09-05T01:44:22.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:21 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:21.809+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:22.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:21 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:21.809+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:22.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:21 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:21.809+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:22.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:21 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:21.809+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:22.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:21 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:21.809+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:22.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:21 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:21.809+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:58.306673+0000 front 2024-09-05T01:43:58.306696+0000 (oldest deadline 2024-09-05T01:44:20.606559+0000) 2024-09-05T01:44:22.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:21 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:21.985+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:22.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:21 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:21.985+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:22.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:21 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:21.985+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:22.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:21 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:21.985+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:22.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:21 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:21.985+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:22.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:21 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:21.985+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:48.865175+0000 front 2024-09-05T01:43:48.865195+0000 (oldest deadline 2024-09-05T01:44:11.765029+0000) 2024-09-05T01:44:22.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:21 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:21.985+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:57.868193+0000 front 2024-09-05T01:43:57.868023+0000 (oldest deadline 2024-09-05T01:44:20.167848+0000) 2024-09-05T01:44:22.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:22 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:22.250+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:44:22.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:22 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:22.250+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:44:22.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:22 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:22.250+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:44:22.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:22 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:22.250+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:44:22.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:22 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:22.250+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:47.690693+0000 front 2024-09-05T01:43:47.690828+0000 (oldest deadline 2024-09-05T01:44:12.291355+0000) 2024-09-05T01:44:22.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:22 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:22.250+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:58.693040+0000 front 2024-09-05T01:43:58.693243+0000 (oldest deadline 2024-09-05T01:44:22.192953+0000) 2024-09-05T01:44:23.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:22 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:22.836+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:23.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:22 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:22.836+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:23.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:22 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:22.836+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:23.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:22 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:22.836+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:23.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:22 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:22.836+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:23.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:22 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:22.836+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:58.306673+0000 front 2024-09-05T01:43:58.306696+0000 (oldest deadline 2024-09-05T01:44:20.606559+0000) 2024-09-05T01:44:23.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:22 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:22.991+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:23.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:22 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:22.991+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:23.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:22 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:22.991+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:23.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:22 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:22.991+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:23.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:22 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:22.991+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:23.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:22 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:22.991+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:48.865175+0000 front 2024-09-05T01:43:48.865195+0000 (oldest deadline 2024-09-05T01:44:11.765029+0000) 2024-09-05T01:44:23.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:22 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:22.991+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:57.868193+0000 front 2024-09-05T01:43:57.868023+0000 (oldest deadline 2024-09-05T01:44:20.167848+0000) 2024-09-05T01:44:23.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:23 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:23.280+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:05.681764+0000 front 2024-09-05T01:43:05.681799+0000 (oldest deadline 2024-09-05T01:43:30.981904+0000) 2024-09-05T01:44:23.562 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:23 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:23.280+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.783741+0000 front 2024-09-05T01:43:16.783696+0000 (oldest deadline 2024-09-05T01:43:40.283840+0000) 2024-09-05T01:44:23.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:23 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:23.280+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:21.985681+0000 front 2024-09-05T01:43:21.985613+0000 (oldest deadline 2024-09-05T01:43:47.285802+0000) 2024-09-05T01:44:23.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:23 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:23.280+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:33.688062+0000 front 2024-09-05T01:43:33.687972+0000 (oldest deadline 2024-09-05T01:43:55.988134+0000) 2024-09-05T01:44:23.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:23 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:23.280+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:47.690693+0000 front 2024-09-05T01:43:47.690828+0000 (oldest deadline 2024-09-05T01:44:12.291355+0000) 2024-09-05T01:44:23.563 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:23 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9[64203]: 2024-09-05T01:44:23.280+0000 7f29b8600640 -1 osd.9 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:58.693040+0000 front 2024-09-05T01:43:58.693243+0000 (oldest deadline 2024-09-05T01:44:22.192953+0000) 2024-09-05T01:44:24.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:23 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:23.942+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:24.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:23 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:23.942+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:24.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:23 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:23.942+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:24.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:23 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:23.942+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:24.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:23 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:23.942+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:24.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:23 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:23.942+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:48.865175+0000 front 2024-09-05T01:43:48.865195+0000 (oldest deadline 2024-09-05T01:44:11.765029+0000) 2024-09-05T01:44:24.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:23 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:23.942+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:57.868193+0000 front 2024-09-05T01:43:57.868023+0000 (oldest deadline 2024-09-05T01:44:20.167848+0000) 2024-09-05T01:44:24.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:23 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:23.873+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:24.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:23 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:23.873+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:24.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:23 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:23.873+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:24.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:23 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:23.873+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:24.355 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:23 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:23.873+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:24.355 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:23 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:23.873+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:58.306673+0000 front 2024-09-05T01:43:58.306696+0000 (oldest deadline 2024-09-05T01:44:20.606559+0000) 2024-09-05T01:44:24.537 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:24 smithi012 podman[106511]: 2024-09-05 01:44:24.227224281 +0000 UTC m=+5.815394012 container died 861c84b917b29ec7a989c0465e499098cfe10b3b0114d8e779d3c9919e9afc06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-05T01:44:24.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:24 smithi012 podman[106511]: 2024-09-05 01:44:24.64342732 +0000 UTC m=+6.231597042 container cleanup 861c84b917b29ec7a989c0465e499098cfe10b3b0114d8e779d3c9919e9afc06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-91c8a7e) 2024-09-05T01:44:24.812 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:24 smithi012 bash[106511]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9 2024-09-05T01:44:25.312 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:24 smithi012 podman[106528]: 2024-09-05 01:44:24.911534504 +0000 UTC m=+0.671346599 container remove 861c84b917b29ec7a989c0465e499098cfe10b3b0114d8e779d3c9919e9afc06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T01:44:25.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:24 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:24.919+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:25.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:24 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:24.919+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:25.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:24 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:24.919+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:25.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:24 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:24.919+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:25.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:24 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:24.919+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:25.335 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:24 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:24.919+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:48.865175+0000 front 2024-09-05T01:43:48.865195+0000 (oldest deadline 2024-09-05T01:44:11.765029+0000) 2024-09-05T01:44:25.335 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:24 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:24.919+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:57.868193+0000 front 2024-09-05T01:43:57.868023+0000 (oldest deadline 2024-09-05T01:44:20.167848+0000) 2024-09-05T01:44:25.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:24 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:24.867+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:25.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:24 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:24.867+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:25.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:24 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:24.867+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:25.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:24 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:24.867+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:25.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:24 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:24.867+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:25.355 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:24 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:24.867+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:58.306673+0000 front 2024-09-05T01:43:58.306696+0000 (oldest deadline 2024-09-05T01:44:20.606559+0000) 2024-09-05T01:44:25.606 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:25 smithi012 podman[106613]: 2024-09-05 01:44:25.258387125 +0000 UTC m=+0.027385419 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:44:25.606 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:25 smithi012 podman[106613]: 2024-09-05 01:44:25.370505013 +0000 UTC m=+0.139503307 container create 95e5caec4d6f78a2fa6bb30fc899233cdf21182f3c09041a7423c33508d28916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, org.label-schema.license=GPLv2) 2024-09-05T01:44:25.606 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:25 smithi012 podman[106613]: 2024-09-05 01:44:25.59811699 +0000 UTC m=+0.367115300 container init 95e5caec4d6f78a2fa6bb30fc899233cdf21182f3c09041a7423c33508d28916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T01:44:25.606 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:25 smithi012 podman[106613]: 2024-09-05 01:44:25.604987628 +0000 UTC m=+0.373985924 container start 95e5caec4d6f78a2fa6bb30fc899233cdf21182f3c09041a7423c33508d28916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-91c8a7e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-05T01:44:25.874 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:25 smithi012 podman[106613]: 2024-09-05 01:44:25.706252582 +0000 UTC m=+0.475250892 container attach 95e5caec4d6f78a2fa6bb30fc899233cdf21182f3c09041a7423c33508d28916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T01:44:26.200 INFO:journalctl@ceph.osd.9.smithi012.stdout:Sep 05 01:44:25 smithi012 podman[106613]: 2024-09-05 01:44:25.874198252 +0000 UTC m=+0.643196553 container died 95e5caec4d6f78a2fa6bb30fc899233cdf21182f3c09041a7423c33508d28916 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-9-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-05T01:44:26.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:25 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:25.922+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:26.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:25 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:25.922+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:26.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:25 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:25.922+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:26.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:25 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:25.922+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:26.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:25 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:25.922+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:26.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:25 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:25.922+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:48.865175+0000 front 2024-09-05T01:43:48.865195+0000 (oldest deadline 2024-09-05T01:44:11.765029+0000) 2024-09-05T01:44:26.335 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:25 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:25.922+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:57.868193+0000 front 2024-09-05T01:43:57.868023+0000 (oldest deadline 2024-09-05T01:44:20.167848+0000) 2024-09-05T01:44:26.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:25 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:25.903+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:26.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:25 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:25.903+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:26.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:25 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:25.903+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:26.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:25 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:25.903+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:26.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:25 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:25.903+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:26.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:25 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:25.903+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:58.306673+0000 front 2024-09-05T01:43:58.306696+0000 (oldest deadline 2024-09-05T01:44:20.606559+0000) 2024-09-05T01:44:26.502 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.9.service' 2024-09-05T01:44:26.578 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:44:26.578 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-05T01:44:26.578 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-05T01:44:26.578 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.10 2024-09-05T01:44:26.872 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:26 smithi145 systemd[1]: Stopping Ceph osd.10 for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:44:27.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:26.871+0000 7ff90d12d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:44:27.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:26.871+0000 7ff90d12d640 -1 osd.10 112 *** Got signal Terminated *** 2024-09-05T01:44:27.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:26.871+0000 7ff90d12d640 -1 osd.10 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T01:44:27.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:26.967+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:27.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:26.967+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:27.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:26.967+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:27.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:26.967+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:27.335 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:26.967+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:27.335 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:26.967+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:48.865175+0000 front 2024-09-05T01:43:48.865195+0000 (oldest deadline 2024-09-05T01:44:11.765029+0000) 2024-09-05T01:44:27.335 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:26 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:26.967+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:57.868193+0000 front 2024-09-05T01:43:57.868023+0000 (oldest deadline 2024-09-05T01:44:20.167848+0000) 2024-09-05T01:44:27.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:26 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:26.861+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:27.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:26 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:26.861+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:27.354 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:26 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:26.861+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:27.355 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:26 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:26.861+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:27.355 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:26 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:26.861+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:27.355 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:26 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:26.861+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:58.306673+0000 front 2024-09-05T01:43:58.306696+0000 (oldest deadline 2024-09-05T01:44:20.606559+0000) 2024-09-05T01:44:28.120 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:27 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:27.860+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:28.120 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:27 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:27.860+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:28.120 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:27 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:27.860+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:28.120 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:27 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:27.860+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:28.121 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:27 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:27.860+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:28.121 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:27 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:27.860+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:58.306673+0000 front 2024-09-05T01:43:58.306696+0000 (oldest deadline 2024-09-05T01:44:20.606559+0000) 2024-09-05T01:44:28.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:27.952+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:28.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:27.952+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:28.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:27.952+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:28.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:27.952+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:28.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:27.952+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:28.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:27.952+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:48.865175+0000 front 2024-09-05T01:43:48.865195+0000 (oldest deadline 2024-09-05T01:44:11.765029+0000) 2024-09-05T01:44:28.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:27 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:27.952+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:57.868193+0000 front 2024-09-05T01:43:57.868023+0000 (oldest deadline 2024-09-05T01:44:20.167848+0000) 2024-09-05T01:44:29.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:28 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:28.821+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:29.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:28 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:28.821+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:29.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:28 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:28.821+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:29.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:28 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:28.821+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:29.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:28 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:28.821+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:29.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:28 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:28.821+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:58.306673+0000 front 2024-09-05T01:43:58.306696+0000 (oldest deadline 2024-09-05T01:44:20.606559+0000) 2024-09-05T01:44:29.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:28.977+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:29.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:28.977+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:29.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:28.977+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:29.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:28.977+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:29.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:28.977+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:29.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:28.977+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:48.865175+0000 front 2024-09-05T01:43:48.865195+0000 (oldest deadline 2024-09-05T01:44:11.765029+0000) 2024-09-05T01:44:29.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:28 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:28.977+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:57.868193+0000 front 2024-09-05T01:43:57.868023+0000 (oldest deadline 2024-09-05T01:44:20.167848+0000) 2024-09-05T01:44:30.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:29 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:29.799+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:30.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:29 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:29.799+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:30.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:29 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:29.799+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:30.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:29 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:29.799+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:30.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:29 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:29.799+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:30.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:29 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:29.799+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:58.306673+0000 front 2024-09-05T01:43:58.306696+0000 (oldest deadline 2024-09-05T01:44:20.606559+0000) 2024-09-05T01:44:30.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:29 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:29.799+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6820 osd.7 since back 2024-09-05T01:44:05.108368+0000 front 2024-09-05T01:44:05.108465+0000 (oldest deadline 2024-09-05T01:44:29.208253+0000) 2024-09-05T01:44:30.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:29.981+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:30.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:29.981+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:30.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:29.981+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:30.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:29.981+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:30.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:29.981+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:30.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:29.981+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:48.865175+0000 front 2024-09-05T01:43:48.865195+0000 (oldest deadline 2024-09-05T01:44:11.765029+0000) 2024-09-05T01:44:30.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:29 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:29.981+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:57.868193+0000 front 2024-09-05T01:43:57.868023+0000 (oldest deadline 2024-09-05T01:44:20.167848+0000) 2024-09-05T01:44:31.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:30 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:30.760+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:31.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:30 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:30.760+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:31.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:30 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:30.760+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:31.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:30 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:30.760+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:31.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:30 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:30.760+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:31.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:30 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:30.760+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:58.306673+0000 front 2024-09-05T01:43:58.306696+0000 (oldest deadline 2024-09-05T01:44:20.606559+0000) 2024-09-05T01:44:31.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:30 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:30.760+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6820 osd.7 since back 2024-09-05T01:44:05.108368+0000 front 2024-09-05T01:44:05.108465+0000 (oldest deadline 2024-09-05T01:44:29.208253+0000) 2024-09-05T01:44:31.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:30 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:30.945+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:09.358427+0000 front 2024-09-05T01:43:09.358567+0000 (oldest deadline 2024-09-05T01:43:33.458451+0000) 2024-09-05T01:44:31.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:30 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:30.945+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:17.360206+0000 front 2024-09-05T01:43:17.360325+0000 (oldest deadline 2024-09-05T01:43:42.060351+0000) 2024-09-05T01:44:31.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:30 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:30.945+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:25.561372+0000 front 2024-09-05T01:43:25.561527+0000 (oldest deadline 2024-09-05T01:43:47.861385+0000) 2024-09-05T01:44:31.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:30 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:30.945+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6814 osd.3 since back 2024-09-05T01:43:32.963622+0000 front 2024-09-05T01:43:32.963447+0000 (oldest deadline 2024-09-05T01:43:57.663410+0000) 2024-09-05T01:44:31.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:30 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:30.945+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:37.663788+0000 front 2024-09-05T01:43:37.663839+0000 (oldest deadline 2024-09-05T01:44:03.564022+0000) 2024-09-05T01:44:31.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:30 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:30.945+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:48.865175+0000 front 2024-09-05T01:43:48.865195+0000 (oldest deadline 2024-09-05T01:44:11.765029+0000) 2024-09-05T01:44:31.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:30 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10[59313]: 2024-09-05T01:44:30.945+0000 7ff90572a640 -1 osd.10 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:57.868193+0000 front 2024-09-05T01:43:57.868023+0000 (oldest deadline 2024-09-05T01:44:20.167848+0000) 2024-09-05T01:44:32.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:31 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:31.732+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:32.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:31 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:31.732+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:32.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:31 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:31.732+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:32.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:31 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:31.732+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:32.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:31 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:31.732+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:32.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:31 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:31.732+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:58.306673+0000 front 2024-09-05T01:43:58.306696+0000 (oldest deadline 2024-09-05T01:44:20.606559+0000) 2024-09-05T01:44:32.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:31 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:31.732+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6820 osd.7 since back 2024-09-05T01:44:05.108368+0000 front 2024-09-05T01:44:05.108465+0000 (oldest deadline 2024-09-05T01:44:29.208253+0000) 2024-09-05T01:44:32.705 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:32 smithi145 podman[72671]: 2024-09-05 01:44:32.450028351 +0000 UTC m=+5.677856301 container died 8db2d34d1030e1bf8a8ca9c74b8624da820b76139e788503ec946fdc5ad39d8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-05T01:44:33.064 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:32 smithi145 podman[72671]: 2024-09-05 01:44:32.795496532 +0000 UTC m=+6.023324483 container cleanup 8db2d34d1030e1bf8a8ca9c74b8624da820b76139e788503ec946fdc5ad39d8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T01:44:33.064 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:32 smithi145 bash[72671]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10 2024-09-05T01:44:33.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:32 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:32.747+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:33.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:32 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:32.747+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:33.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:32 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:32.747+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:33.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:32 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:32.747+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:33.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:32 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:32.747+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:33.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:32 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:32.747+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:58.306673+0000 front 2024-09-05T01:43:58.306696+0000 (oldest deadline 2024-09-05T01:44:20.606559+0000) 2024-09-05T01:44:33.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:32 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:32.747+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6820 osd.7 since back 2024-09-05T01:44:05.108368+0000 front 2024-09-05T01:44:05.108465+0000 (oldest deadline 2024-09-05T01:44:29.208253+0000) 2024-09-05T01:44:33.334 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:33 smithi145 podman[72686]: 2024-09-05 01:44:33.063234449 +0000 UTC m=+0.614802783 container remove 8db2d34d1030e1bf8a8ca9c74b8624da820b76139e788503ec946fdc5ad39d8e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True) 2024-09-05T01:44:33.667 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:33 smithi145 podman[72773]: 2024-09-05 01:44:33.271095511 +0000 UTC m=+0.015485656 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:44:33.667 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:33 smithi145 podman[72773]: 2024-09-05 01:44:33.387266904 +0000 UTC m=+0.131657074 container create 42da4debb5ca1040fc24f68e127ef1f731fb74fd544772fc0129e7c36ae3f541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-05T01:44:33.667 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:33 smithi145 podman[72773]: 2024-09-05 01:44:33.583316758 +0000 UTC m=+0.327706886 container init 42da4debb5ca1040fc24f68e127ef1f731fb74fd544772fc0129e7c36ae3f541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, RELEASE=squid-91c8a7e, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-05T01:44:33.667 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:33 smithi145 podman[72773]: 2024-09-05 01:44:33.586557947 +0000 UTC m=+0.330948076 container start 42da4debb5ca1040fc24f68e127ef1f731fb74fd544772fc0129e7c36ae3f541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T01:44:33.667 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:33 smithi145 podman[72773]: 2024-09-05 01:44:33.666625147 +0000 UTC m=+0.411015277 container attach 42da4debb5ca1040fc24f68e127ef1f731fb74fd544772fc0129e7c36ae3f541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-91c8a7e) 2024-09-05T01:44:34.069 INFO:journalctl@ceph.osd.10.smithi145.stdout:Sep 05 01:44:33 smithi145 podman[72773]: 2024-09-05 01:44:33.775316294 +0000 UTC m=+0.519706440 container died 42da4debb5ca1040fc24f68e127ef1f731fb74fd544772fc0129e7c36ae3f541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T01:44:34.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:33 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:33.762+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:34.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:33 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:33.762+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:34.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:33 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:33.762+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:34.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:33 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:33.762+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:34.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:33 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:33.762+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:34.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:33 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:33.762+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:58.306673+0000 front 2024-09-05T01:43:58.306696+0000 (oldest deadline 2024-09-05T01:44:20.606559+0000) 2024-09-05T01:44:34.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:33 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:33.762+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6820 osd.7 since back 2024-09-05T01:44:05.108368+0000 front 2024-09-05T01:44:05.108465+0000 (oldest deadline 2024-09-05T01:44:29.208253+0000) 2024-09-05T01:44:34.399 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.10.service' 2024-09-05T01:44:34.439 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:44:34.440 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-05T01:44:34.440 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-05T01:44:34.440 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.11 2024-09-05T01:44:34.723 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:34 smithi151 systemd[1]: Stopping Ceph osd.11 for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:44:35.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:34 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:34.722+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:35.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:34 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:34.722+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:35.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:34 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:34.722+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:35.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:34 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:34.722+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:35.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:34 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:34.722+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:35.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:34 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:34.722+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:58.306673+0000 front 2024-09-05T01:43:58.306696+0000 (oldest deadline 2024-09-05T01:44:20.606559+0000) 2024-09-05T01:44:35.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:34 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:34.722+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6820 osd.7 since back 2024-09-05T01:44:05.108368+0000 front 2024-09-05T01:44:05.108465+0000 (oldest deadline 2024-09-05T01:44:29.208253+0000) 2024-09-05T01:44:35.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:34 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:34.965+0000 7f06b4805640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:44:35.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:34 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:34.965+0000 7f06b4805640 -1 osd.11 112 *** Got signal Terminated *** 2024-09-05T01:44:35.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:34 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:34.965+0000 7f06b4805640 -1 osd.11 112 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-05T01:44:36.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:35 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:35.720+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:36.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:35 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:35.720+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:36.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:35 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:35.720+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:36.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:35 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:35.720+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:36.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:35 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:35.720+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:36.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:35 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:35.720+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:58.306673+0000 front 2024-09-05T01:43:58.306696+0000 (oldest deadline 2024-09-05T01:44:20.606559+0000) 2024-09-05T01:44:36.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:35 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:35.720+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6820 osd.7 since back 2024-09-05T01:44:05.108368+0000 front 2024-09-05T01:44:05.108465+0000 (oldest deadline 2024-09-05T01:44:29.208253+0000) 2024-09-05T01:44:37.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:36 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:36.698+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:37.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:36 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:36.698+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:37.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:36 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:36.698+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:37.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:36 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:36.698+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:37.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:36 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:36.698+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:37.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:36 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:36.698+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:58.306673+0000 front 2024-09-05T01:43:58.306696+0000 (oldest deadline 2024-09-05T01:44:20.606559+0000) 2024-09-05T01:44:37.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:36 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:36.698+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6820 osd.7 since back 2024-09-05T01:44:05.108368+0000 front 2024-09-05T01:44:05.108465+0000 (oldest deadline 2024-09-05T01:44:29.208253+0000) 2024-09-05T01:44:38.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:37 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:37.652+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:38.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:37 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:37.652+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:38.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:37 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:37.652+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:38.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:37 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:37.652+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:38.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:37 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:37.652+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:38.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:37 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:37.652+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:58.306673+0000 front 2024-09-05T01:43:58.306696+0000 (oldest deadline 2024-09-05T01:44:20.606559+0000) 2024-09-05T01:44:38.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:37 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:37.652+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6820 osd.7 since back 2024-09-05T01:44:05.108368+0000 front 2024-09-05T01:44:05.108465+0000 (oldest deadline 2024-09-05T01:44:29.208253+0000) 2024-09-05T01:44:38.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:37 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:37.652+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6820 osd.8 since back 2024-09-05T01:44:13.309095+0000 front 2024-09-05T01:44:13.309119+0000 (oldest deadline 2024-09-05T01:44:36.709728+0000) 2024-09-05T01:44:39.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:38 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:38.604+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:39.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:38 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:38.604+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:39.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:38 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:38.604+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:39.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:38 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:38.604+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:39.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:38 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:38.604+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:39.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:38 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:38.604+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:58.306673+0000 front 2024-09-05T01:43:58.306696+0000 (oldest deadline 2024-09-05T01:44:20.606559+0000) 2024-09-05T01:44:39.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:38 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:38.604+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6820 osd.7 since back 2024-09-05T01:44:05.108368+0000 front 2024-09-05T01:44:05.108465+0000 (oldest deadline 2024-09-05T01:44:29.208253+0000) 2024-09-05T01:44:39.105 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:38 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:38.604+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6820 osd.8 since back 2024-09-05T01:44:13.309095+0000 front 2024-09-05T01:44:13.309119+0000 (oldest deadline 2024-09-05T01:44:36.709728+0000) 2024-09-05T01:44:39.854 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:39 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:39.600+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6806 osd.0 since back 2024-09-05T01:43:07.097726+0000 front 2024-09-05T01:43:07.097620+0000 (oldest deadline 2024-09-05T01:43:31.197713+0000) 2024-09-05T01:44:39.854 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:39 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:39.600+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6804 osd.1 since back 2024-09-05T01:43:16.900030+0000 front 2024-09-05T01:43:16.899929+0000 (oldest deadline 2024-09-05T01:43:42.199986+0000) 2024-09-05T01:44:39.854 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:39 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:39.600+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-09-05T01:43:23.801185+0000 front 2024-09-05T01:43:23.801215+0000 (oldest deadline 2024-09-05T01:43:47.301365+0000) 2024-09-05T01:44:39.854 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:39 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:39.600+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6812 osd.4 since back 2024-09-05T01:43:38.304146+0000 front 2024-09-05T01:43:38.304120+0000 (oldest deadline 2024-09-05T01:44:04.204185+0000) 2024-09-05T01:44:39.855 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:39 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:39.600+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-09-05T01:43:49.505171+0000 front 2024-09-05T01:43:49.505209+0000 (oldest deadline 2024-09-05T01:44:12.405328+0000) 2024-09-05T01:44:39.855 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:39 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:39.600+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.12:6822 osd.6 since back 2024-09-05T01:43:58.306673+0000 front 2024-09-05T01:43:58.306696+0000 (oldest deadline 2024-09-05T01:44:20.606559+0000) 2024-09-05T01:44:39.855 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:39 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:39.600+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.145:6820 osd.7 since back 2024-09-05T01:44:05.108368+0000 front 2024-09-05T01:44:05.108465+0000 (oldest deadline 2024-09-05T01:44:29.208253+0000) 2024-09-05T01:44:39.855 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:39 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11[59716]: 2024-09-05T01:44:39.600+0000 7f06b0e0a640 -1 osd.11 112 heartbeat_check: no reply from 172.21.15.151:6820 osd.8 since back 2024-09-05T01:44:13.309095+0000 front 2024-09-05T01:44:13.309119+0000 (oldest deadline 2024-09-05T01:44:36.709728+0000) 2024-09-05T01:44:40.833 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:40 smithi151 podman[72590]: 2024-09-05 01:44:40.575410908 +0000 UTC m=+5.943282375 container died 460e3b3eba0bd9ac256ea1a9f082e72ab7afdb424f2b0002d0859931b6a2e5b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-05T01:44:41.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:40 smithi151 podman[72590]: 2024-09-05 01:44:40.915213667 +0000 UTC m=+6.283085124 container cleanup 460e3b3eba0bd9ac256ea1a9f082e72ab7afdb424f2b0002d0859931b6a2e5b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, RELEASE=squid-91c8a7e, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T01:44:41.104 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:40 smithi151 bash[72590]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11 2024-09-05T01:44:41.560 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:41 smithi151 podman[72605]: 2024-09-05 01:44:41.167372756 +0000 UTC m=+0.592555918 container remove 460e3b3eba0bd9ac256ea1a9f082e72ab7afdb424f2b0002d0859931b6a2e5b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11, RELEASE=squid-91c8a7e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-05T01:44:41.854 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:41 smithi151 podman[72693]: 2024-09-05 01:44:41.560060927 +0000 UTC m=+0.108544338 container create 1df6df98756a318bc4997589b1535c41b09d1cd6a07a6b1a1bfa1714606b6cfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T01:44:41.855 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:41 smithi151 podman[72693]: 2024-09-05 01:44:41.467385113 +0000 UTC m=+0.015868488 image pull 77770cf7e895c297c29130881c012db5698948fe2279610297198415e1f3d0ac quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067 2024-09-05T01:44:41.855 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:41 smithi151 podman[72693]: 2024-09-05 01:44:41.771175385 +0000 UTC m=+0.319658750 container init 1df6df98756a318bc4997589b1535c41b09d1cd6a07a6b1a1bfa1714606b6cfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-05T01:44:41.855 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:41 smithi151 podman[72693]: 2024-09-05 01:44:41.774632493 +0000 UTC m=+0.323115869 container start 1df6df98756a318bc4997589b1535c41b09d1cd6a07a6b1a1bfa1714606b6cfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-05T01:44:42.258 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:41 smithi151 podman[72693]: 2024-09-05 01:44:41.854503119 +0000 UTC m=+0.402986500 container attach 1df6df98756a318bc4997589b1535c41b09d1cd6a07a6b1a1bfa1714606b6cfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T01:44:42.259 INFO:journalctl@ceph.osd.11.smithi151.stdout:Sep 05 01:44:41 smithi151 podman[72693]: 2024-09-05 01:44:41.964443679 +0000 UTC m=+0.512927055 container died 1df6df98756a318bc4997589b1535c41b09d1cd6a07a6b1a1bfa1714606b6cfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e) 2024-09-05T01:44:42.552 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@osd.11.service' 2024-09-05T01:44:42.591 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:44:42.591 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-05T01:44:42.592 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-05T01:44:42.592 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.a 2024-09-05T01:44:42.989 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 05 01:44:42 smithi012 systemd[1]: Stopping Ceph mds.a for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:44:43.312 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 05 01:44:42 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-a[70949]: 2024-09-05T01:44:42.987+0000 7f6dfe400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:44:43.312 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 05 01:44:42 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-a[70949]: 2024-09-05T01:44:42.987+0000 7f6dfe400640 -1 mds.a *** got signal Terminated *** 2024-09-05T01:44:47.252 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 05 01:44:46 smithi012 podman[106726]: 2024-09-05 01:44:46.99917205 +0000 UTC m=+4.119983047 container died 438915eed20df073fbd3c4c6e1c242dfc39642cd3f86a5f847944534fd784f83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-05T01:44:47.562 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 05 01:44:47 smithi012 podman[106726]: 2024-09-05 01:44:47.400914785 +0000 UTC m=+4.521725782 container cleanup 438915eed20df073fbd3c4c6e1c242dfc39642cd3f86a5f847944534fd784f83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-a, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-05T01:44:47.563 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 05 01:44:47 smithi012 bash[106726]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-a 2024-09-05T01:44:47.828 INFO:journalctl@ceph.mds.a.smithi012.stdout:Sep 05 01:44:47 smithi012 podman[106738]: 2024-09-05 01:44:47.568539078 +0000 UTC m=+0.555980128 container remove 438915eed20df073fbd3c4c6e1c242dfc39642cd3f86a5f847944534fd784f83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-a, org.label-schema.schema-version=1.0, RELEASE=squid-91c8a7e, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-05T01:44:47.857 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.a.service' 2024-09-05T01:44:47.928 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:44:47.928 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-05T01:44:47.928 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-05T01:44:47.929 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.d 2024-09-05T01:44:48.312 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 05 01:44:48 smithi012 systemd[1]: Stopping Ceph mds.d for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:44:48.812 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 05 01:44:48 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-d[69777]: 2024-09-05T01:44:48.447+0000 7f73c7400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:44:48.812 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 05 01:44:48 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-d[69777]: 2024-09-05T01:44:48.447+0000 7f73c7400640 -1 mds.d *** got signal Terminated *** 2024-09-05T01:44:51.457 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 05 01:44:51 smithi012 podman[106848]: 2024-09-05 01:44:51.165798462 +0000 UTC m=+2.943341956 container died aa64d64fa9db86edd877ab398df2f85b50bb15595406991c6b5b3ff9df9c6805 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-d, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2) 2024-09-05T01:44:51.789 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 05 01:44:51 smithi012 podman[106848]: 2024-09-05 01:44:51.55427394 +0000 UTC m=+3.331817429 container cleanup aa64d64fa9db86edd877ab398df2f85b50bb15595406991c6b5b3ff9df9c6805 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-05T01:44:51.789 INFO:journalctl@ceph.mds.d.smithi012.stdout:Sep 05 01:44:51 smithi012 bash[106848]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-d 2024-09-05T01:44:51.959 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.d.service' 2024-09-05T01:44:52.028 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:44:52.028 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-05T01:44:52.029 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-05T01:44:52.029 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.g 2024-09-05T01:44:52.395 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 05 01:44:52 smithi012 systemd[1]: Stopping Ceph mds.g for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:44:52.812 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 05 01:44:52 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-g[70543]: 2024-09-05T01:44:52.393+0000 7ff723a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:44:52.812 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 05 01:44:52 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-g[70543]: 2024-09-05T01:44:52.393+0000 7ff723a00640 -1 mds.g *** got signal Terminated *** 2024-09-05T01:44:56.275 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 05 01:44:56 smithi012 podman[106972]: 2024-09-05 01:44:56.016749412 +0000 UTC m=+3.714918210 container died a364cf5ba0471318fa5a0bc6b1114b8963cc6b1588b60554ad9ff3634b9c61a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-g, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-91c8a7e) 2024-09-05T01:44:56.562 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 05 01:44:56 smithi012 podman[106972]: 2024-09-05 01:44:56.382287848 +0000 UTC m=+4.080456646 container cleanup a364cf5ba0471318fa5a0bc6b1114b8963cc6b1588b60554ad9ff3634b9c61a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-g, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-05T01:44:56.562 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 05 01:44:56 smithi012 bash[106972]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-g 2024-09-05T01:44:56.873 INFO:journalctl@ceph.mds.g.smithi012.stdout:Sep 05 01:44:56 smithi012 podman[106984]: 2024-09-05 01:44:56.56676031 +0000 UTC m=+0.535961416 container remove a364cf5ba0471318fa5a0bc6b1114b8963cc6b1588b60554ad9ff3634b9c61a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-g, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T01:44:56.891 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.g.service' 2024-09-05T01:44:56.960 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:44:56.961 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-05T01:44:56.961 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-05T01:44:56.961 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.j 2024-09-05T01:44:57.312 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 05 01:44:57 smithi012 systemd[1]: Stopping Ceph mds.j for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:44:57.812 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 05 01:44:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-j[69388]: 2024-09-05T01:44:57.346+0000 7f0455200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:44:57.812 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 05 01:44:57 smithi012 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-j[69388]: 2024-09-05T01:44:57.346+0000 7f0455200640 -1 mds.j *** got signal Terminated *** 2024-09-05T01:44:59.639 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 05 01:44:59 smithi012 podman[107090]: 2024-09-05 01:44:59.314681168 +0000 UTC m=+2.085070103 container died f40bb22e13e18f70d18929e28615100796a9533a7c6497de4a4ea5f0ead22672 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-j, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-05T01:44:59.954 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 05 01:44:59 smithi012 podman[107090]: 2024-09-05 01:44:59.744627769 +0000 UTC m=+2.515016701 container cleanup f40bb22e13e18f70d18929e28615100796a9533a7c6497de4a4ea5f0ead22672 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-j, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-91c8a7e) 2024-09-05T01:44:59.954 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 05 01:44:59 smithi012 bash[107090]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-j 2024-09-05T01:45:00.206 INFO:journalctl@ceph.mds.j.smithi012.stdout:Sep 05 01:44:59 smithi012 podman[107114]: 2024-09-05 01:44:59.954000837 +0000 UTC m=+0.623550968 container remove f40bb22e13e18f70d18929e28615100796a9533a7c6497de4a4ea5f0ead22672 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-j, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-05T01:45:00.227 DEBUG:teuthology.orchestra.run.smithi012:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.j.service' 2024-09-05T01:45:00.297 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:45:00.298 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-05T01:45:00.298 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-05T01:45:00.298 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.b 2024-09-05T01:45:00.584 INFO:journalctl@ceph.mds.b.smithi145.stdout:Sep 05 01:45:00 smithi145 systemd[1]: Stopping Ceph mds.b for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:45:01.084 INFO:journalctl@ceph.mds.b.smithi145.stdout:Sep 05 01:45:00 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-b[65009]: 2024-09-05T01:45:00.702+0000 7fbd0e6a9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:45:01.084 INFO:journalctl@ceph.mds.b.smithi145.stdout:Sep 05 01:45:00 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-b[65009]: 2024-09-05T01:45:00.702+0000 7fbd0e6a9640 -1 mds.b *** got signal Terminated *** 2024-09-05T01:45:03.579 INFO:journalctl@ceph.mds.b.smithi145.stdout:Sep 05 01:45:03 smithi145 podman[72875]: 2024-09-05 01:45:03.311666679 +0000 UTC m=+2.821432355 container died 6163f51c3a258a6f7b9988189e7fad8b46c5cffe81f2377cea7a7ff7413514ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731) 2024-09-05T01:45:03.834 INFO:journalctl@ceph.mds.b.smithi145.stdout:Sep 05 01:45:03 smithi145 podman[72875]: 2024-09-05 01:45:03.669373415 +0000 UTC m=+3.179139088 container cleanup 6163f51c3a258a6f7b9988189e7fad8b46c5cffe81f2377cea7a7ff7413514ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-b, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-05T01:45:03.834 INFO:journalctl@ceph.mds.b.smithi145.stdout:Sep 05 01:45:03 smithi145 bash[72875]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-b 2024-09-05T01:45:04.092 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.b.service' 2024-09-05T01:45:04.127 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:45:04.127 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-05T01:45:04.128 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-05T01:45:04.128 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.e 2024-09-05T01:45:04.584 INFO:journalctl@ceph.mds.e.smithi145.stdout:Sep 05 01:45:04 smithi145 systemd[1]: Stopping Ceph mds.e for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:45:04.584 INFO:journalctl@ceph.mds.e.smithi145.stdout:Sep 05 01:45:04 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-e[64396]: 2024-09-05T01:45:04.431+0000 7f5d83554640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:45:04.584 INFO:journalctl@ceph.mds.e.smithi145.stdout:Sep 05 01:45:04 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-e[64396]: 2024-09-05T01:45:04.431+0000 7f5d83554640 -1 mds.e *** got signal Terminated *** 2024-09-05T01:45:07.584 INFO:journalctl@ceph.mds.e.smithi145.stdout:Sep 05 01:45:07 smithi145 podman[73008]: 2024-09-05 01:45:07.299733939 +0000 UTC m=+2.958940878 container died bdcecdf76fa2914beda5e523c1c9f0f1c61358ca877db5bb9a23d18b2220214e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, ceph=True, org.label-schema.build-date=20240731) 2024-09-05T01:45:08.034 INFO:journalctl@ceph.mds.e.smithi145.stdout:Sep 05 01:45:07 smithi145 podman[73008]: 2024-09-05 01:45:07.623125126 +0000 UTC m=+3.282332052 container cleanup bdcecdf76fa2914beda5e523c1c9f0f1c61358ca877db5bb9a23d18b2220214e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, ceph=True, org.label-schema.schema-version=1.0) 2024-09-05T01:45:08.334 INFO:journalctl@ceph.mds.e.smithi145.stdout:Sep 05 01:45:07 smithi145 bash[73008]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-e 2024-09-05T01:45:08.334 INFO:journalctl@ceph.mds.e.smithi145.stdout:Sep 05 01:45:07 smithi145 podman[73022]: 2024-09-05 01:45:07.816020797 +0000 UTC m=+0.515781595 container remove bdcecdf76fa2914beda5e523c1c9f0f1c61358ca877db5bb9a23d18b2220214e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-e, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-91c8a7e) 2024-09-05T01:45:08.336 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.e.service' 2024-09-05T01:45:08.336 INFO:journalctl@ceph.mds.e.smithi145.stdout:Sep 05 01:45:08 smithi145 systemd[1]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.e.service: Deactivated successfully. 2024-09-05T01:45:08.336 INFO:journalctl@ceph.mds.e.smithi145.stdout:Sep 05 01:45:08 smithi145 systemd[1]: Stopped Ceph mds.e for 0d44cd7e-6b24-11ef-bcd6-c7b262605968. 2024-09-05T01:45:08.337 INFO:journalctl@ceph.mds.e.smithi145.stdout:Sep 05 01:45:08 smithi145 systemd[1]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.e.service: Consumed 22.449s CPU time. 2024-09-05T01:45:08.373 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:45:08.373 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-05T01:45:08.373 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-05T01:45:08.373 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.h 2024-09-05T01:45:08.743 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:45:08 smithi145 systemd[1]: Stopping Ceph mds.h for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:45:09.083 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:45:08 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:45:08.741+0000 7f424ba87640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:45:09.084 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:45:08 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h[64708]: 2024-09-05T01:45:08.741+0000 7f424ba87640 -1 mds.h *** got signal Terminated *** 2024-09-05T01:45:11.561 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:45:11 smithi145 podman[73129]: 2024-09-05 01:45:11.30274495 +0000 UTC m=+2.705254952 container died 9eafb72706375af105b87377488d176d052f24b384d773751cfb9c2e6b13a10a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-91c8a7e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-05T01:45:11.834 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:45:11 smithi145 podman[73129]: 2024-09-05 01:45:11.65187249 +0000 UTC m=+3.054382482 container cleanup 9eafb72706375af105b87377488d176d052f24b384d773751cfb9c2e6b13a10a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-91c8a7e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-05T01:45:11.834 INFO:journalctl@ceph.mds.h.smithi145.stdout:Sep 05 01:45:11 smithi145 bash[73129]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-h 2024-09-05T01:45:12.088 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.h.service' 2024-09-05T01:45:12.120 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:45:12.120 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-05T01:45:12.120 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-05T01:45:12.120 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.k 2024-09-05T01:45:12.448 INFO:journalctl@ceph.mds.k.smithi145.stdout:Sep 05 01:45:12 smithi145 systemd[1]: Stopping Ceph mds.k for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:45:12.834 INFO:journalctl@ceph.mds.k.smithi145.stdout:Sep 05 01:45:12 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-k[64078]: 2024-09-05T01:45:12.447+0000 7f39e11b4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:45:12.834 INFO:journalctl@ceph.mds.k.smithi145.stdout:Sep 05 01:45:12 smithi145 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-k[64078]: 2024-09-05T01:45:12.447+0000 7f39e11b4640 -1 mds.k *** got signal Terminated *** 2024-09-05T01:45:15.584 INFO:journalctl@ceph.mds.k.smithi145.stdout:Sep 05 01:45:15 smithi145 podman[73248]: 2024-09-05 01:45:15.278476098 +0000 UTC m=+2.934496714 container died 0809dfc6ee30bc4a24ddb13cfe0b8baa9fef496634deafae1fa38a296039ce8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-k, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-05T01:45:15.916 INFO:journalctl@ceph.mds.k.smithi145.stdout:Sep 05 01:45:15 smithi145 podman[73248]: 2024-09-05 01:45:15.672685354 +0000 UTC m=+3.328705971 container cleanup 0809dfc6ee30bc4a24ddb13cfe0b8baa9fef496634deafae1fa38a296039ce8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-k, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-91c8a7e, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-05T01:45:15.916 INFO:journalctl@ceph.mds.k.smithi145.stdout:Sep 05 01:45:15 smithi145 bash[73248]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-k 2024-09-05T01:45:16.049 DEBUG:teuthology.orchestra.run.smithi145:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.k.service' 2024-09-05T01:45:16.081 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:45:16.081 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-05T01:45:16.081 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-05T01:45:16.081 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.c 2024-09-05T01:45:16.409 INFO:journalctl@ceph.mds.c.smithi151.stdout:Sep 05 01:45:16 smithi151 systemd[1]: Stopping Ceph mds.c for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:45:16.678 INFO:journalctl@ceph.mds.c.smithi151.stdout:Sep 05 01:45:16 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-c[64593]: 2024-09-05T01:45:16.408+0000 7f0d3d479640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:45:16.678 INFO:journalctl@ceph.mds.c.smithi151.stdout:Sep 05 01:45:16 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-c[64593]: 2024-09-05T01:45:16.408+0000 7f0d3d479640 -1 mds.c *** got signal Terminated *** 2024-09-05T01:45:19.852 INFO:journalctl@ceph.mds.c.smithi151.stdout:Sep 05 01:45:19 smithi151 podman[72796]: 2024-09-05 01:45:19.412125164 +0000 UTC m=+3.126039265 container died 9209fcf9f5013ba8af19740a9d9c5d3d4e40c6e3303e9b0e97c78cbea0896946 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-c, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-05T01:45:20.104 INFO:journalctl@ceph.mds.c.smithi151.stdout:Sep 05 01:45:19 smithi151 podman[72796]: 2024-09-05 01:45:19.916897132 +0000 UTC m=+3.630811233 container cleanup 9209fcf9f5013ba8af19740a9d9c5d3d4e40c6e3303e9b0e97c78cbea0896946 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-c, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0) 2024-09-05T01:45:20.104 INFO:journalctl@ceph.mds.c.smithi151.stdout:Sep 05 01:45:19 smithi151 bash[72796]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-c 2024-09-05T01:45:20.274 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.c.service' 2024-09-05T01:45:20.310 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:45:20.310 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-05T01:45:20.310 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-05T01:45:20.310 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.f 2024-09-05T01:45:20.854 INFO:journalctl@ceph.mds.f.smithi151.stdout:Sep 05 01:45:20 smithi151 systemd[1]: Stopping Ceph mds.f for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:45:20.854 INFO:journalctl@ceph.mds.f.smithi151.stdout:Sep 05 01:45:20 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-f[64279]: 2024-09-05T01:45:20.629+0000 7f3dff0b3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:45:20.855 INFO:journalctl@ceph.mds.f.smithi151.stdout:Sep 05 01:45:20 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-f[64279]: 2024-09-05T01:45:20.629+0000 7f3dff0b3640 -1 mds.f *** got signal Terminated *** 2024-09-05T01:45:23.705 INFO:journalctl@ceph.mds.f.smithi151.stdout:Sep 05 01:45:23 smithi151 podman[72926]: 2024-09-05 01:45:23.403401935 +0000 UTC m=+2.874862925 container died 547cb7b9ff22093387a6c2dfe0e55d683620ff77ebb6a6acfcf312bab722c7cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-f, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-91c8a7e) 2024-09-05T01:45:23.705 INFO:journalctl@ceph.mds.f.smithi151.stdout:Sep 05 01:45:23 smithi151 podman[72926]: 2024-09-05 01:45:23.705165011 +0000 UTC m=+3.176626000 container cleanup 547cb7b9ff22093387a6c2dfe0e55d683620ff77ebb6a6acfcf312bab722c7cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-f, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-91c8a7e) 2024-09-05T01:45:24.073 INFO:journalctl@ceph.mds.f.smithi151.stdout:Sep 05 01:45:23 smithi151 bash[72926]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-f 2024-09-05T01:45:24.073 INFO:journalctl@ceph.mds.f.smithi151.stdout:Sep 05 01:45:23 smithi151 podman[72939]: 2024-09-05 01:45:23.948368123 +0000 UTC m=+0.546503276 container remove 547cb7b9ff22093387a6c2dfe0e55d683620ff77ebb6a6acfcf312bab722c7cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-f, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-91c8a7e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-05T01:45:24.095 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.f.service' 2024-09-05T01:45:24.129 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:45:24.129 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-05T01:45:24.129 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-05T01:45:24.130 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.i 2024-09-05T01:45:24.354 INFO:journalctl@ceph.mds.i.smithi151.stdout:Sep 05 01:45:24 smithi151 systemd[1]: Stopping Ceph mds.i for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:45:24.854 INFO:journalctl@ceph.mds.i.smithi151.stdout:Sep 05 01:45:24 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-i[64895]: 2024-09-05T01:45:24.443+0000 7ff8450f6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:45:24.854 INFO:journalctl@ceph.mds.i.smithi151.stdout:Sep 05 01:45:24 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-i[64895]: 2024-09-05T01:45:24.443+0000 7ff8450f6640 -1 mds.i *** got signal Terminated *** 2024-09-05T01:45:27.694 INFO:journalctl@ceph.mds.i.smithi151.stdout:Sep 05 01:45:27 smithi151 podman[73049]: 2024-09-05 01:45:27.385648752 +0000 UTC m=+3.042012317 container died 6f3865ede7957b91a562b832176c5766d0b9247f935756ce6ee32be40fb467b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-i, GIT_CLEAN=True, RELEASE=squid-91c8a7e, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T01:45:28.079 INFO:journalctl@ceph.mds.i.smithi151.stdout:Sep 05 01:45:27 smithi151 podman[73049]: 2024-09-05 01:45:27.793406452 +0000 UTC m=+3.449770018 container cleanup 6f3865ede7957b91a562b832176c5766d0b9247f935756ce6ee32be40fb467b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-i, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-91c8a7e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-05T01:45:28.079 INFO:journalctl@ceph.mds.i.smithi151.stdout:Sep 05 01:45:27 smithi151 bash[73049]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-i 2024-09-05T01:45:28.232 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.i.service' 2024-09-05T01:45:28.265 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:45:28.265 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-05T01:45:28.266 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-05T01:45:28.266 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.l 2024-09-05T01:45:28.598 INFO:journalctl@ceph.mds.l.smithi151.stdout:Sep 05 01:45:28 smithi151 systemd[1]: Stopping Ceph mds.l for 0d44cd7e-6b24-11ef-bcd6-c7b262605968... 2024-09-05T01:45:28.862 INFO:journalctl@ceph.mds.l.smithi151.stdout:Sep 05 01:45:28 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-l[63974]: 2024-09-05T01:45:28.597+0000 7fee1d75b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-05T01:45:28.863 INFO:journalctl@ceph.mds.l.smithi151.stdout:Sep 05 01:45:28 smithi151 ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-l[63974]: 2024-09-05T01:45:28.597+0000 7fee1d75b640 -1 mds.l *** got signal Terminated *** 2024-09-05T01:45:31.698 INFO:journalctl@ceph.mds.l.smithi151.stdout:Sep 05 01:45:31 smithi151 podman[73169]: 2024-09-05 01:45:31.393522362 +0000 UTC m=+2.910671711 container died fd55372d0e466f1ff63371f0e228760a01349db0ffac08055f7a940dec75d70f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-l, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True) 2024-09-05T01:45:32.025 INFO:journalctl@ceph.mds.l.smithi151.stdout:Sep 05 01:45:31 smithi151 podman[73169]: 2024-09-05 01:45:31.773488224 +0000 UTC m=+3.290637582 container cleanup fd55372d0e466f1ff63371f0e228760a01349db0ffac08055f7a940dec75d70f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:bc24b8b0fb57fbf3f589c6abdf5aefd5f62db62238cebcb4209974c168290067, name=ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-91c8a7e, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-05T01:45:32.025 INFO:journalctl@ceph.mds.l.smithi151.stdout:Sep 05 01:45:31 smithi151 bash[73169]: ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968-mds-l 2024-09-05T01:45:32.139 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0d44cd7e-6b24-11ef-bcd6-c7b262605968@mds.l.service' 2024-09-05T01:45:32.171 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-05T01:45:32.171 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-05T01:45:32.172 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 --force --keep-logs 2024-09-05T01:45:32.455 INFO:teuthology.orchestra.run.smithi012.stdout:Deleting cluster with fsid: 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:45:36.398 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 --force --keep-logs 2024-09-05T01:45:36.599 INFO:teuthology.orchestra.run.smithi145.stdout:Deleting cluster with fsid: 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:45:39.226 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 --force --keep-logs 2024-09-05T01:45:39.430 INFO:teuthology.orchestra.run.smithi151.stdout:Deleting cluster with fsid: 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T01:45:41.923 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-05T01:45:41.986 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-05T01:45:42.019 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-05T01:45:42.046 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-05T01:45:42.048 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7889758/remote/smithi012/crash 2024-09-05T01:45:42.049 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/crash -- . 2024-09-05T01:45:42.107 INFO:teuthology.orchestra.run.smithi012.stderr:tar: /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/crash: Cannot open: No such file or directory 2024-09-05T01:45:42.107 INFO:teuthology.orchestra.run.smithi012.stderr:tar: Error is not recoverable: exiting now 2024-09-05T01:45:42.113 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7889758/remote/smithi145/crash 2024-09-05T01:45:42.114 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/crash -- . 2024-09-05T01:45:42.154 INFO:teuthology.orchestra.run.smithi145.stderr:tar: /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/crash: Cannot open: No such file or directory 2024-09-05T01:45:42.154 INFO:teuthology.orchestra.run.smithi145.stderr:tar: Error is not recoverable: exiting now 2024-09-05T01:45:42.156 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7889758/remote/smithi151/crash 2024-09-05T01:45:42.157 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/crash -- . 2024-09-05T01:45:42.198 INFO:teuthology.orchestra.run.smithi151.stderr:tar: /var/lib/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/crash: Cannot open: No such file or directory 2024-09-05T01:45:42.198 INFO:teuthology.orchestra.run.smithi151.stderr:tar: Error is not recoverable: exiting now 2024-09-05T01:45:42.199 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-05T01:45:42.199 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-05T01:45:42.296 INFO:teuthology.orchestra.run.smithi012.stdout:2024-09-05T01:35:25.786746+0000 mds.h (mds.2) 151 : cluster [WRN] Scrub error on inode 0x10000001aaa (/volumes/qa/sv_1/7156e7f8-5c39-449c-8c2a-7be3d13af491/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-42/article-37.xml) see mds.h log and `damage ls` output for details 2024-09-05T01:45:42.301 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-05T01:45:42.301 INFO:tasks.cephadm:Compressing logs... 2024-09-05T01:45:42.301 DEBUG:teuthology.orchestra.run.smithi012:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-05T01:45:42.306 DEBUG:teuthology.orchestra.run.smithi145:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-05T01:45:42.309 DEBUG:teuthology.orchestra.run.smithi151:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-05T01:45:42.339 INFO:teuthology.orchestra.run.smithi151.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-05T01:45:42.340 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-volume.log 2024-09-05T01:45:42.341 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.audit.log 2024-09-05T01:45:42.341 INFO:teuthology.orchestra.run.smithi151.stderr:gzip/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-volume.log: -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.i.log 2024-09-05T01:45:42.345 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mon.c.log 2024-09-05T01:45:42.345 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.cephadm.log 2024-09-05T01:45:42.345 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.11.log 2024-09-05T01:45:42.345 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.2.log 2024-09-05T01:45:42.346 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.5.log 2024-09-05T01:45:42.346 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.log 2024-09-05T01:45:42.346 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.l.log 2024-09-05T01:45:42.346 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.8.log 2024-09-05T01:45:42.346 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mgr.z.log 2024-09-05T01:45:42.346 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.c.log 2024-09-05T01:45:42.346 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.f.log 2024-09-05T01:45:42.346 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-05T01:45:42.355 INFO:teuthology.orchestra.run.smithi145.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-05T01:45:42.356 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.10.log 2024-09-05T01:45:42.356 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.1.log 2024-09-05T01:45:42.358 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.7.log 2024-09-05T01:45:42.358 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.10.log: /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-volume.log 2024-09-05T01:45:42.358 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.b.log 2024-09-05T01:45:42.360 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.k.log 2024-09-05T01:45:42.361 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.4.log 2024-09-05T01:45:42.361 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.audit.log 2024-09-05T01:45:42.361 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.cephadm.log 2024-09-05T01:45:42.361 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mgr.y.log 2024-09-05T01:45:42.361 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.log 2024-09-05T01:45:42.361 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.h.log 2024-09-05T01:45:42.361 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mgr.y.log: /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mon.b.log 2024-09-05T01:45:42.361 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.e.log 2024-09-05T01:45:42.361 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-05T01:45:42.362 INFO:teuthology.orchestra.run.smithi012.stderr:find: ‘/var/log/rbd-target-api’: No such file or directorygzip 2024-09-05T01:45:42.363 INFO:teuthology.orchestra.run.smithi012.stderr: -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.0.log 2024-09-05T01:45:42.363 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.9.log 2024-09-05T01:45:42.363 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-volume.log 2024-09-05T01:45:42.363 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.audit.log 2024-09-05T01:45:42.364 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.a.log 2024-09-05T01:45:42.365 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.cephadm.log 2024-09-05T01:45:42.366 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mon.a.log 2024-09-05T01:45:42.368 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.cephadm.log: 84.4% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.cephadm.log.gz 2024-09-05T01:45:42.369 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.g.log 2024-09-05T01:45:42.369 INFO:teuthology.orchestra.run.smithi012.stderr: 90.3% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.audit.log.gz 2024-09-05T01:45:42.370 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.6.log 2024-09-05T01:45:42.375 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.g.log: /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.log 2024-09-05T01:45:42.377 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.d.log 2024-09-05T01:45:42.378 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mgr.x.log 2024-09-05T01:45:42.380 INFO:teuthology.orchestra.run.smithi012.stderr: 94.5%/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.j.log 2024-09-05T01:45:42.382 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mgr.x.log: 91.0% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.g.log.gz -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-volume.log.gz 2024-09-05T01:45:42.382 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-05T01:45:42.383 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.3.log 2024-09-05T01:45:42.390 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.j.log: /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.3.log: 94.4%gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-05T01:45:42.395 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.d.log.gz 2024-09-05T01:45:42.404 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/cephadm.log: 90.7% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.log.gz 2024-09-05T01:45:42.421 INFO:teuthology.orchestra.run.smithi012.stderr: 94.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-05T01:45:42.441 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mgr.y.log.gz 2024-09-05T01:45:42.475 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 81.8% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.cephadm.log.gz 2024-09-05T01:45:42.478 INFO:teuthology.orchestra.run.smithi145.stderr: 81.9% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.cephadm.log.gz 2024-09-05T01:45:42.480 INFO:teuthology.orchestra.run.smithi145.stderr: 90.4% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.audit.log.gz 2024-09-05T01:45:42.494 INFO:teuthology.orchestra.run.smithi145.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-05T01:45:42.497 INFO:teuthology.orchestra.run.smithi151.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-05T01:45:42.502 INFO:teuthology.orchestra.run.smithi145.stderr: 90.8% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-volume.log.gz 2024-09-05T01:45:42.526 INFO:teuthology.orchestra.run.smithi151.stderr: 92.4% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mgr.z.log.gz 2024-09-05T01:45:42.567 INFO:teuthology.orchestra.run.smithi151.stderr: 90.8% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-volume.log.gz 2024-09-05T01:45:42.574 INFO:teuthology.orchestra.run.smithi151.stderr: 90.5% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.audit.log.gz 2024-09-05T01:45:42.652 INFO:teuthology.orchestra.run.smithi145.stderr: 90.7% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.log.gz 2024-09-05T01:45:42.975 INFO:teuthology.orchestra.run.smithi012.stderr: 90.7% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mgr.x.log.gz 2024-09-05T01:45:44.043 INFO:teuthology.orchestra.run.smithi151.stderr: 90.7% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph.log.gz 2024-09-05T01:45:44.265 INFO:teuthology.orchestra.run.smithi012.stderr: 90.5% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mon.a.log.gz 2024-09-05T01:45:54.042 INFO:teuthology.orchestra.run.smithi012.stderr: 95.4% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.j.log.gz 2024-09-05T01:45:55.284 INFO:teuthology.orchestra.run.smithi012.stderr: 95.5% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.a.log.gz 2024-09-05T01:45:59.218 INFO:teuthology.orchestra.run.smithi145.stderr: 91.8% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mon.b.log.gz 2024-09-05T01:46:03.303 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mon.c.log.gz 2024-09-05T01:46:04.542 INFO:teuthology.orchestra.run.smithi012.stderr: 93.7% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.9.log.gz 2024-09-05T01:46:18.708 INFO:teuthology.orchestra.run.smithi012.stderr: 93.6% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.6.log.gz 2024-09-05T01:46:19.218 INFO:teuthology.orchestra.run.smithi012.stderr: 93.6% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.0.log.gz 2024-09-05T01:46:22.272 INFO:teuthology.orchestra.run.smithi012.stderr: 93.6% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.3.log.gz 2024-09-05T01:46:22.276 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-05T01:46:22.276 INFO:teuthology.orchestra.run.smithi012.stderr:real 0m39.939s 2024-09-05T01:46:22.276 INFO:teuthology.orchestra.run.smithi012.stderr:user 2m29.328s 2024-09-05T01:46:22.276 INFO:teuthology.orchestra.run.smithi012.stderr:sys 0m12.411s 2024-09-05T01:46:53.613 INFO:teuthology.orchestra.run.smithi145.stderr: 95.2% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.k.log.gz 2024-09-05T01:47:17.043 INFO:teuthology.orchestra.run.smithi145.stderr: 95.1% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.e.log.gz 2024-09-05T01:47:46.409 INFO:teuthology.orchestra.run.smithi151.stderr: 95.3% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.f.log.gz 2024-09-05T01:49:04.333 INFO:teuthology.orchestra.run.smithi145.stderr: 93.7% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.7.log.gz 2024-09-05T01:49:08.292 INFO:teuthology.orchestra.run.smithi145.stderr: 93.6% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.1.log.gz 2024-09-05T01:49:51.868 INFO:teuthology.orchestra.run.smithi145.stderr: 93.5% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.4.log.gz 2024-09-05T01:50:09.430 INFO:teuthology.orchestra.run.smithi145.stderr: 93.5% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.10.log.gz 2024-09-05T01:50:27.580 INFO:teuthology.orchestra.run.smithi151.stderr: 93.6% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.2.log.gz 2024-09-05T01:51:11.348 INFO:teuthology.orchestra.run.smithi151.stderr: 93.6% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.8.log.gz 2024-09-05T01:51:52.106 INFO:teuthology.orchestra.run.smithi151.stderr: 93.6% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.c.log.gz 2024-09-05T01:52:31.752 INFO:teuthology.orchestra.run.smithi151.stderr: 93.7% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.11.log.gz 2024-09-05T01:53:39.081 INFO:teuthology.orchestra.run.smithi151.stderr: 93.6% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-osd.5.log.gz 2024-09-05T01:56:17.475 INFO:teuthology.orchestra.run.smithi151.stderr: 93.8% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.i.log.gz 2024-09-05T01:56:56.169 INFO:teuthology.orchestra.run.smithi151.stderr: 93.6% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.l.log.gz 2024-09-05T01:56:56.171 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-05T01:56:56.171 INFO:teuthology.orchestra.run.smithi151.stderr:real 11m13.847s 2024-09-05T01:56:56.171 INFO:teuthology.orchestra.run.smithi151.stderr:user 6m43.732s 2024-09-05T01:56:56.171 INFO:teuthology.orchestra.run.smithi151.stderr:sys 0m18.638s 2024-09-05T01:59:31.288 INFO:teuthology.orchestra.run.smithi145.stderr: 93.8% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.h.log.gz 2024-09-05T02:01:25.187 INFO:teuthology.orchestra.run.smithi145.stderr: 93.4% -- replaced with /var/log/ceph/0d44cd7e-6b24-11ef-bcd6-c7b262605968/ceph-mds.b.log.gz 2024-09-05T02:01:25.189 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-09-05T02:01:25.189 INFO:teuthology.orchestra.run.smithi145.stderr:real 15m42.866s 2024-09-05T02:01:25.189 INFO:teuthology.orchestra.run.smithi145.stderr:user 7m1.558s 2024-09-05T02:01:25.189 INFO:teuthology.orchestra.run.smithi145.stderr:sys 0m20.508s 2024-09-05T02:01:25.190 INFO:tasks.cephadm:Archiving logs... 2024-09-05T02:01:25.191 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7889758/remote/smithi012/log 2024-09-05T02:01:25.192 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-05T02:01:43.824 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7889758/remote/smithi145/log 2024-09-05T02:01:43.825 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-05T02:02:47.317 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7889758/remote/smithi151/log 2024-09-05T02:02:47.318 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-05T02:03:48.377 INFO:tasks.cephadm:Removing cluster... 2024-09-05T02:03:48.378 DEBUG:teuthology.orchestra.run.smithi012:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 --force 2024-09-05T02:03:48.661 INFO:teuthology.orchestra.run.smithi012.stdout:Deleting cluster with fsid: 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T02:03:49.617 DEBUG:teuthology.orchestra.run.smithi145:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 --force 2024-09-05T02:03:49.953 INFO:teuthology.orchestra.run.smithi145.stdout:Deleting cluster with fsid: 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T02:03:50.631 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0d44cd7e-6b24-11ef-bcd6-c7b262605968 --force 2024-09-05T02:03:50.986 INFO:teuthology.orchestra.run.smithi151.stdout:Deleting cluster with fsid: 0d44cd7e-6b24-11ef-bcd6-c7b262605968 2024-09-05T02:03:51.727 INFO:tasks.cephadm:Removing cephadm ... 2024-09-05T02:03:51.727 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-05T02:03:51.768 DEBUG:teuthology.orchestra.run.smithi145:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-05T02:03:51.788 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-05T02:03:51.805 INFO:tasks.cephadm:Teardown complete 2024-09-05T02:03:51.805 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-05T02:03:51.817 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-05T02:03:51.817 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-05T02:03:51.822 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-05T02:03:51.831 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-05T02:03:51.958 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-05T02:03:51.969 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-05T02:03:51.970 DEBUG:teuthology.orchestra.run.smithi012:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T02:03:51.974 DEBUG:teuthology.orchestra.run.smithi145:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T02:03:51.977 DEBUG:teuthology.orchestra.run.smithi151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-05T02:03:51.992 INFO:teuthology.orchestra.run.smithi145.stderr:bash: line 1: ntpq: command not found 2024-09-05T02:03:51.992 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 1: ntpq: command not found 2024-09-05T02:03:52.006 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2024-09-05T02:03:52.007 INFO:teuthology.orchestra.run.smithi145.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-05T02:03:52.007 INFO:teuthology.orchestra.run.smithi145.stdout:=============================================================================== 2024-09-05T02:03:52.008 INFO:teuthology.orchestra.run.smithi145.stdout:^* hv01.front.sepia.ceph.com 3 6 377 29 +155us[ +132us] +/- 38ms 2024-09-05T02:03:52.008 INFO:teuthology.orchestra.run.smithi145.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 30 -520us[ -544us] +/- 53ms 2024-09-05T02:03:52.008 INFO:teuthology.orchestra.run.smithi145.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 29 +366us[ +343us] +/- 79ms 2024-09-05T02:03:52.008 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T02:03:52.013 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-05T02:03:52.013 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2024-09-05T02:03:52.013 INFO:teuthology.orchestra.run.smithi012.stdout:^* hv01.front.sepia.ceph.com 3 6 377 35 +164us[ +167us] +/- 38ms 2024-09-05T02:03:52.013 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 28 -511us[ -511us] +/- 53ms 2024-09-05T02:03:52.013 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 +377us[ +377us] +/- 79ms 2024-09-05T02:03:52.013 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T02:03:52.020 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-05T02:03:52.020 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2024-09-05T02:03:52.020 INFO:teuthology.orchestra.run.smithi151.stdout:^* hv01.front.sepia.ceph.com 3 6 377 31 +174us[ +185us] +/- 38ms 2024-09-05T02:03:52.020 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 33 -512us[ -501us] +/- 53ms 2024-09-05T02:03:52.020 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 +397us[ +409us] +/- 79ms 2024-09-05T02:03:52.020 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-05T02:03:52.021 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-05T02:03:52.031 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-05T02:03:52.031 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-05T02:03:52.058 DEBUG:teuthology.orchestra.run.smithi012:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-05T02:03:52.194 DEBUG:teuthology.orchestra.run.smithi145:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-05T02:03:52.293 DEBUG:teuthology.orchestra.run.smithi151:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-05T02:03:52.433 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-05T02:03:52.495 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T02:03:52.495 DEBUG:teuthology.orchestra.run.smithi145:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-05T02:03:52.527 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T02:03:52.527 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-05T02:03:52.556 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T02:03:52.557 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-05T02:03:52.569 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-05T02:03:52.603 INFO:teuthology.task.internal:Duration was 3420.202888 seconds 2024-09-05T02:03:52.604 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-05T02:03:52.650 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-05T02:03:52.650 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-05T02:03:52.655 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-05T02:03:52.657 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-05T02:03:52.709 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-05T02:03:52.725 INFO:teuthology.orchestra.run.smithi145.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-05T02:03:52.739 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-05T02:03:53.158 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-05T02:03:53.158 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi012.front.sepia.ceph.com 2024-09-05T02:03:53.158 DEBUG:teuthology.orchestra.run.smithi012:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-05T02:03:53.209 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi145.front.sepia.ceph.com 2024-09-05T02:03:53.209 DEBUG:teuthology.orchestra.run.smithi145:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-05T02:03:53.245 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi151.front.sepia.ceph.com 2024-09-05T02:03:53.245 DEBUG:teuthology.orchestra.run.smithi151:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-05T02:03:53.278 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-05T02:03:53.279 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-05T02:03:53.283 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-05T02:03:53.288 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-05T02:03:53.353 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-05T02:03:53.353 DEBUG:teuthology.orchestra.run.smithi012:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-05T02:03:53.357 DEBUG:teuthology.orchestra.run.smithi145:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-05T02:03:53.361 DEBUG:teuthology.orchestra.run.smithi151:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-05T02:03:54.556 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-05T02:03:54.569 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-05T02:03:54.569 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-05T02:03:54.625 DEBUG:teuthology.orchestra.run.smithi145:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-05T02:03:54.655 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-05T02:03:54.703 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-05T02:03:54.714 DEBUG:teuthology.orchestra.run.smithi012:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-05T02:03:54.718 DEBUG:teuthology.orchestra.run.smithi145:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-05T02:03:54.721 DEBUG:teuthology.orchestra.run.smithi151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-05T02:03:54.764 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = core 2024-09-05T02:03:54.765 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = core 2024-09-05T02:03:54.785 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = core 2024-09-05T02:03:54.815 DEBUG:teuthology.orchestra.run.smithi012:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-05T02:03:54.849 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T02:03:54.849 DEBUG:teuthology.orchestra.run.smithi145:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-05T02:03:54.866 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T02:03:54.866 DEBUG:teuthology.orchestra.run.smithi151:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-05T02:03:54.882 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-05T02:03:54.883 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-05T02:03:54.894 INFO:teuthology.task.internal:Transferring archived files... 2024-09-05T02:03:54.896 DEBUG:teuthology.misc:Transferring archived files from smithi012:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7889758/remote/smithi012 2024-09-05T02:03:54.896 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-05T02:03:54.983 DEBUG:teuthology.misc:Transferring archived files from smithi145:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7889758/remote/smithi145 2024-09-05T02:03:54.983 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-05T02:03:55.022 DEBUG:teuthology.misc:Transferring archived files from smithi151:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-04_21:24:16-fs-squid-distro-default-smithi/7889758/remote/smithi151 2024-09-05T02:03:55.022 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-05T02:03:55.062 INFO:teuthology.task.internal:Removing archive directory... 2024-09-05T02:03:55.062 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-05T02:03:55.066 DEBUG:teuthology.orchestra.run.smithi145:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-05T02:03:55.070 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-05T02:03:55.114 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-05T02:03:55.127 INFO:teuthology.task.internal:Not uploading archives. 2024-09-05T02:03:55.128 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-05T02:03:55.151 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-05T02:03:55.151 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-05T02:03:55.155 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-05T02:03:55.158 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-05T02:03:55.172 INFO:teuthology.orchestra.run.smithi145.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 5 02:03 /home/ubuntu/cephtest 2024-09-05T02:03:55.174 INFO:teuthology.orchestra.run.smithi151.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 5 02:03 /home/ubuntu/cephtest 2024-09-05T02:03:55.186 INFO:teuthology.orchestra.run.smithi012.stdout: 393956 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 5 02:03 /home/ubuntu/cephtest 2024-09-05T02:03:55.188 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-05T02:03:55.199 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-05T02:03:55.304 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8ad8b8b160987a14eb199bb67cc00e23a08d43f6 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/blogbench}} duration: 3420.2028880119324 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-09-05T02:03:55.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-05T02:03:55.389 INFO:teuthology.run:FAIL